-- Logs begin at Mon 2022-10-24 09:37:16 UTC, end at Mon 2022-10-24 12:12:59 UTC. -- Oct 24 10:13:00.002486 n-d-858383-15 systemd[1]: Starting Devstack devstack@n-api.service... Oct 24 10:13:00.011858 n-d-858383-15 devstack@n-api.service[104546]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 24 10:13:00.013888 n-d-858383-15 devstack@n-api.service[104546]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 24 10:13:00 2022] *** Oct 24 10:13:00.013888 n-d-858383-15 devstack@n-api.service[104546]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 24 10:13:00.013888 n-d-858383-15 devstack@n-api.service[104546]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 24 10:13:00.013888 n-d-858383-15 devstack@n-api.service[104546]: nodename: n-d-858383-15 Oct 24 10:13:00.013888 n-d-858383-15 devstack@n-api.service[104546]: machine: x86_64 Oct 24 10:13:00.013888 n-d-858383-15 devstack@n-api.service[104546]: clock source: unix Oct 24 10:13:00.013888 n-d-858383-15 devstack@n-api.service[104546]: pcre jit disabled Oct 24 10:13:00.013888 n-d-858383-15 devstack@n-api.service[104546]: detected number of CPU cores: 4 Oct 24 10:13:00.013888 n-d-858383-15 devstack@n-api.service[104546]: current working directory: / Oct 24 10:13:00.013888 n-d-858383-15 devstack@n-api.service[104546]: detected binary path: /usr/bin/uwsgi-core Oct 24 10:13:00.014479 n-d-858383-15 devstack@n-api.service[104546]: your processes number limit is 47680 Oct 24 10:13:00.014479 n-d-858383-15 devstack@n-api.service[104546]: your memory page size is 4096 bytes Oct 24 10:13:00.014479 n-d-858383-15 devstack@n-api.service[104546]: detected max file descriptor number: 2048 Oct 24 10:13:00.014479 n-d-858383-15 devstack@n-api.service[104546]: lock engine: pthread robust mutexes Oct 24 10:13:00.014479 n-d-858383-15 devstack@n-api.service[104546]: thunder lock: enabled Oct 24 10:13:00.014479 n-d-858383-15 devstack@n-api.service[104546]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 24 10:13:00.014479 n-d-858383-15 devstack@n-api.service[104546]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 24 10:13:00.052846 n-d-858383-15 devstack@n-api.service[104546]: Python main interpreter initialized at 0x555cfa37c9c0 Oct 24 10:13:00.052994 n-d-858383-15 devstack@n-api.service[104546]: python threads support enabled Oct 24 10:13:00.052994 n-d-858383-15 devstack@n-api.service[104546]: your server socket listen backlog is limited to 100 connections Oct 24 10:13:00.052994 n-d-858383-15 devstack@n-api.service[104546]: your mercy for graceful operations on workers is 90 seconds Oct 24 10:13:00.053217 n-d-858383-15 devstack@n-api.service[104546]: mapped 403077 bytes (393 KB) for 2 cores Oct 24 10:13:00.053303 n-d-858383-15 devstack@n-api.service[104546]: *** Operational MODE: preforking *** Oct 24 10:13:00.053533 n-d-858383-15 devstack@n-api.service[104546]: *** uWSGI is running in multiple interpreter mode *** Oct 24 10:13:00.053533 n-d-858383-15 devstack@n-api.service[104546]: spawned uWSGI master process (pid: 104546) Oct 24 10:13:00.053753 n-d-858383-15 systemd[1]: Started Devstack devstack@n-api.service. Oct 24 10:13:00.058333 n-d-858383-15 devstack@n-api.service[104546]: spawned uWSGI worker 1 (pid: 104547, cores: 1) Oct 24 10:13:00.058333 n-d-858383-15 devstack@n-api.service[104546]: spawned uWSGI worker 2 (pid: 104548, cores: 1) Oct 24 10:13:00.058333 n-d-858383-15 devstack@n-api.service[104546]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 24 10:13:00.719552 n-d-858383-15 devstack@n-api.service[104547]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 10:13:00.720162 n-d-858383-15 devstack@n-api.service[104548]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 10:13:01.798249 n-d-858383-15 devstack@n-api.service[104548]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 10:13:01.798249 n-d-858383-15 devstack@n-api.service[104548]: from cryptography.utils import int_from_bytes Oct 24 10:13:01.798946 n-d-858383-15 devstack@n-api.service[104547]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 10:13:01.798946 n-d-858383-15 devstack@n-api.service[104547]: from cryptography.utils import int_from_bytes Oct 24 10:13:01.799324 n-d-858383-15 devstack@n-api.service[104548]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 10:13:01.799324 n-d-858383-15 devstack@n-api.service[104548]: from cryptography.utils import int_from_bytes Oct 24 10:13:01.799467 n-d-858383-15 devstack@n-api.service[104547]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 10:13:01.799467 n-d-858383-15 devstack@n-api.service[104547]: from cryptography.utils import int_from_bytes Oct 24 10:13:04.287025 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 10:13:04.287660 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 10:13:04.287762 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 10:13:04.287993 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 10:13:04.288365 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 10:13:04.288463 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 10:13:04.288550 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 10:13:04.288720 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.288818 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 10:13:04.289065 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.289151 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 10:13:04.289358 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 10:13:04.289454 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.289678 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.289765 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.290001 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.290087 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.290304 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.290404 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.290616 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.290708 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.290933 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.291018 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.291234 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.291329 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.292094 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.292188 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.292411 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.292507 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.292728 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-15 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.292940 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.293068 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.293201 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.293368 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.293511 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.293967 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.294072 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-15 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.294158 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.294242 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.294332 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.294415 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.294565 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.294713 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.294879 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.295026 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.295322 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.295415 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.295636 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.295751 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.295935 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.296046 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.296332 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.296454 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.296660 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.296773 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.296983 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.297073 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.297292 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.297436 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.297617 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.297715 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.297921 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.298030 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.298235 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.298355 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.298531 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.298624 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.298830 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.298943 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-15 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.299130 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.299235 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.299431 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.299544 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.299804 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.299896 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-15 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.300108 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.300210 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.300414 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.300519 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.300718 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.300850 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.301106 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.301220 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.301424 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.301528 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.301724 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.301853 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.302036 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.302182 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.302332 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.302454 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.302642 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.302809 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.302985 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.303150 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.303307 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.303427 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.303513 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.303640 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.303809 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.303903 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.304121 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.304238 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.304419 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.304513 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.304717 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.304803 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.304988 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.305102 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.305291 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.305389 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.305605 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.305693 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.305848 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.305933 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.306149 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.306276 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.306454 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.306539 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.306699 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.306795 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.307026 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.307177 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.307344 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.307586 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.307696 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.307938 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.308040 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.308236 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.308330 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.308536 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.308635 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.308872 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.308994 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.309153 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.309240 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.309451 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.309550 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.309750 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.309837 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.310050 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.310134 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.310352 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.310451 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.310652 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.310737 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.310951 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.311043 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.311259 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.311346 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.311562 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.311647 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.311873 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.311960 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.312173 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.312259 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.312485 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.312572 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.312794 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.312908 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.313120 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.313210 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.313425 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.313511 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.313735 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.313828 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.314035 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.314123 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.314331 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.314418 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.314630 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.314725 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.314939 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.315026 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.315235 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.315334 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.315536 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.315649 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.315775 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.315862 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.316068 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.316154 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.316366 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.316460 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.316674 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.316767 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.316973 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.317093 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.317270 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.317384 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.317567 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.317653 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.317856 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.317943 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.318155 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.318242 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.318449 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.318534 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.318745 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.318829 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.319035 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.319121 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.319329 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.319413 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.319624 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.319714 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.319916 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.320001 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.320211 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.320297 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.320504 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.320590 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.320799 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.320917 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.321116 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.321203 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.321414 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.321500 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.321710 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.321804 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.322005 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.322104 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.322301 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.322389 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.322598 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.322700 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.322934 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.323124 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.323217 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.323520 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.323610 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.323834 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.323929 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.324132 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.324216 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.324426 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.324520 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.324734 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.324888 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.325058 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.325159 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.325358 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.325452 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.325662 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.325769 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.325952 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.326037 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.326251 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.326346 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.326551 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.326645 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.326849 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.326943 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.327147 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.327234 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.327440 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.327539 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.327731 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.327871 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.328028 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.328128 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.328324 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.328409 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.328616 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.328708 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.328933 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.329024 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.329229 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.329314 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.329523 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.329620 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.329820 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.329907 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.330114 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.330201 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.330409 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.330504 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.330703 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.330790 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.331015 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.331117 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.331319 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.331415 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.331618 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.331705 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.331917 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.332003 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.332214 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.332314 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.332524 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:13:04.332615 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.332869 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.332974 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.333198 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.333284 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.333506 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.333591 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.333816 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.333924 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.334134 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.334229 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.334440 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.334526 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.334744 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.334831 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.335047 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.335141 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.335356 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.335454 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.335674 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.335768 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.335968 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.336054 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.336272 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.336371 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.336575 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.336661 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.336905 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.337031 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.337210 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.337309 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.337523 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.337630 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.337829 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.337915 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.338139 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.338235 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.338978 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.339250 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.339386 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.339557 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.339934 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.340029 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.340269 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.340513 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.340652 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.340930 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.341100 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.341258 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.341531 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.341648 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.341834 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.342069 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.342167 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.342428 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.342586 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.342732 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.342861 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.343071 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.343176 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.343376 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.343474 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.344020 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.344673 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.344827 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.344827 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.345136 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.345299 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.345439 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.345563 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.345647 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.345735 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.345815 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.345893 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.345961 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.346067 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.346155 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.346393 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.346638 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.346807 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.347148 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.347314 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.347461 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.347679 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.347778 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.348082 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.348232 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.348393 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.348705 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.348797 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.349035 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.349343 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.349437 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.349645 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.349944 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.350030 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.350246 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.350531 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.350618 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.350880 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.351122 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.351215 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.351500 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.351711 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.351813 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.352097 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.352302 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.352636 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.352922 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.353108 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.353503 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.353605 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.353821 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.354633 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.354753 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.355229 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.355478 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.355644 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.355959 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.356054 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.356268 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.356591 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.356677 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.356924 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.357199 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.357301 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.357579 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.357673 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.357982 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.358126 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.358455 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.358582 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.358767 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.358897 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.359078 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.359218 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.359404 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.359560 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.359720 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.359876 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.360030 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.360193 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.360370 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.360509 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.360698 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.360822 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.361029 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.361157 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.361354 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.361472 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.361678 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.361785 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.361995 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.362107 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.362295 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.362383 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.362601 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.362694 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.362906 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.363001 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.363208 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.363301 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.363509 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.363595 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.363815 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.363916 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.364123 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.364205 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.364412 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.364499 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.364711 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.364806 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.365041 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.365130 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.365343 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.365430 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.365662 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.365758 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.365966 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.366057 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.366268 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.366354 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.366567 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.366655 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.366865 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.366951 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.367191 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.367277 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.367497 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.367586 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.367818 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.367902 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.368130 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.368216 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.368431 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.368520 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.368736 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.368822 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.369061 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.369159 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.369359 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.369460 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.369742 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.369839 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.370174 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.370331 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.370485 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.370573 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.370788 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.370875 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.371091 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.371187 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.371393 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.371487 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.371695 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.371783 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.372049 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.372160 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.372310 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.372406 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.372611 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.372699 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.372943 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.373048 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.373246 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.373328 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.373603 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.373696 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.373868 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.373956 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.374207 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.374301 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.374517 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.374602 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.374836 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.374925 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.375145 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.375231 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.375453 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.375546 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.375757 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.375845 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.376061 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.376147 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.376365 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.376460 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.376670 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.376759 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.376998 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.377099 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.377305 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.377401 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.377610 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.377697 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.377915 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.378000 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.378219 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.378310 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.378528 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.378621 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.378832 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.378918 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.379132 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.379229 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.379434 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.379527 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.379744 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.379838 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.380069 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.380166 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.380380 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.380467 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.380688 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.380788 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.381027 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.381126 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.381330 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.381424 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.381634 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.381721 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.381936 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.382024 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.382238 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.382338 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.382534 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.382622 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.382837 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.382932 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.383144 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.383231 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.383446 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.383531 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.383747 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.383834 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.384045 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.384130 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.384353 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.384439 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.384656 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.384743 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.384977 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.385079 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.385301 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.385427 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.385624 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.385711 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.385947 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.386035 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.386252 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.386351 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.386562 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.386649 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.386869 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.386955 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.387166 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.387266 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.387465 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.387551 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.387767 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.387862 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.388064 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.388161 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.388362 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.388449 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.388657 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.388755 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.388978 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.389067 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.389287 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.389374 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.389592 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.389677 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.389891 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.389978 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.390188 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.390272 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.390496 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.390583 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.390800 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.390886 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.391095 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.391179 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.391393 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.391479 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.391692 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.391778 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.392004 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.392088 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.392306 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.392420 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.392607 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.392703 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.392933 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.393025 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.393233 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.393332 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.393533 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.393628 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.393836 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.393921 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.394137 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.394232 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.394437 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.394524 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.394735 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.394821 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.395035 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.395130 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.395333 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.395419 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.395638 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.395724 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.395949 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.396038 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.396261 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.396514 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.396603 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.396854 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.396956 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.397179 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.397266 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.397479 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.397564 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.397783 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.397883 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.398099 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.398201 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.398404 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.398488 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.398706 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.398800 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.399011 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.399100 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.399315 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.399408 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.399617 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.399704 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.399915 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.400003 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.400221 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.400308 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.400520 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.400604 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.401349 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.401447 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.401655 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.401742 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.401958 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.402054 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.402247 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.402351 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.402548 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.402648 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.402847 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.403121 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.403218 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.403432 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.403517 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.403739 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.403826 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.404039 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.404127 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.404344 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.404432 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.404644 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.404751 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.404982 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.405086 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.405287 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.405375 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.405586 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.405672 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.405883 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.405979 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.406185 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.406283 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.406485 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.406589 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.406787 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.406876 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.407093 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.407185 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.407393 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.407495 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.407696 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.407797 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.407992 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.408079 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.408295 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.408385 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.408596 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.408684 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.408916 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.409007 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.409218 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.409305 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.409519 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.409616 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.409819 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.409905 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.410115 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.410214 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.410412 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.410498 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.410710 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.410796 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.411011 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.411106 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.411313 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.411399 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.411609 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.411706 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.411905 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.411999 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.412202 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.412288 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.412501 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.412612 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.412808 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.412965 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.413132 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.413219 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.413430 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.413523 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.413727 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.413816 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.414030 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.414126 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.414332 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.414426 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.414631 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.414719 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.414934 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.415020 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.415232 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.415317 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.415538 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.415625 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.415833 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.415917 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.416131 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.416239 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.416430 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.417111 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.417292 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.417413 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.417626 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.417733 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.417908 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.418017 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.418211 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.418338 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.418510 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.418647 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.418813 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.418948 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.419113 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.419248 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.419421 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.419553 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.419725 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.419855 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.420024 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.420155 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.420320 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.420485 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.420624 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.420767 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.420948 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.421110 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.421248 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.421410 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.421548 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.421714 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.421847 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.422014 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.422158 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.422312 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.422461 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.422609 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.422759 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.422931 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.423043 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.423202 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.423347 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.423498 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.423649 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.423795 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.423947 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.424094 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.424263 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.424390 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.424570 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.424707 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.424890 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.425034 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.425189 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.425333 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.425491 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.425629 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.425789 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.425928 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.426087 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.426262 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.426390 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.426561 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.426705 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.426911 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.427004 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.427213 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.427295 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.427521 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.427608 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.427834 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.427919 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.428142 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.428238 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.428437 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.428522 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.428736 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.428818 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.429055 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.429161 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.429352 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.429441 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.429648 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.429733 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.429943 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.430038 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.430238 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.430331 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.430535 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.430621 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.430845 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.430943 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.431145 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.431232 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.431442 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.431535 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.431739 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.431827 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.432057 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.432190 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.432427 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.432588 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.432785 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.432957 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.433127 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.433242 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.433412 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.433526 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.433725 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.433814 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.434033 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.434127 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.434339 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.434425 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.434645 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.434734 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.434945 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.435042 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.435252 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.435340 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.435559 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.435648 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.435863 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.435949 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.436159 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.436253 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.436458 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.436545 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.436759 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.436865 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.437107 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.437215 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.437390 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.437484 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.437691 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.437777 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.437989 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.438085 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.438290 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.438378 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.438587 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.438673 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.438886 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.438981 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.439182 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.439268 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.439482 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.439603 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.439785 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.439910 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.440088 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.440214 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.440394 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.440511 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.440701 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.440821 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.441028 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.441145 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.441332 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.441454 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.441637 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.441760 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.441937 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.442058 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.442240 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.442466 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.442561 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.442773 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.442859 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.443080 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.443180 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.443388 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.443489 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.443684 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.443770 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.443982 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.444087 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.444276 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.444363 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.444580 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.444666 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.444896 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.444997 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.445197 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.445318 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.445492 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.445627 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.445808 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.445932 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.446107 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.446230 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.446420 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.446532 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.446823 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.446928 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.447130 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.447218 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.447427 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.447509 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.447744 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.447880 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.448189 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.448277 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.448494 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.448579 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.448800 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.448993 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.449128 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.449218 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.449427 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.449524 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.449723 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.449824 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.450028 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.450114 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.450332 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.450420 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.450627 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.450722 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.450926 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.451013 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.451221 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.451328 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.451535 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.451624 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.451832 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.451920 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.452144 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.452241 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.452463 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.452551 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.452770 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.452878 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.453111 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.453198 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.453519 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.453621 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.453834 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.453921 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.454138 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.454224 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.454451 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.454546 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.454766 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.454859 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.455067 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.455162 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.455366 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.455468 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.455668 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.455761 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.455966 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.456051 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.456266 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.456362 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.456584 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.456675 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.456906 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.456996 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.457216 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.457316 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.457515 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.457656 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.457830 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.457968 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.458132 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.458277 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.458430 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.458560 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.458742 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.458869 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.459078 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.459206 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.459332 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.459458 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.459628 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.459759 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.459942 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.460073 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.460256 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.460386 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.460556 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.460694 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.460898 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.461032 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.461200 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.461342 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.461498 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.461627 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.461794 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.461934 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.462091 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.462220 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.462405 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.462547 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.462710 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.462838 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.463013 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.463141 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.463952 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.464144 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.464275 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.464410 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.464537 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.464663 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.464788 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.464963 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.465095 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.465220 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.465344 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.465469 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.465602 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.465730 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.465918 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.466049 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.466231 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.466361 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.466529 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.466670 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.466843 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.466979 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.467142 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.467272 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.467438 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.467567 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.467731 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.467858 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.468025 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.468157 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.468324 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.468455 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.468620 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.468750 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.468938 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.469082 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.469237 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.469375 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.469553 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.469683 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.469851 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.469990 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.470167 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.470298 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.470469 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.470598 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.470766 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.470905 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.471062 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.471191 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.471365 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.471494 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.471681 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.471817 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.471982 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.472111 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.472301 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.472439 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.472603 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.472733 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.472943 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.473076 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.473254 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.473383 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.473552 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.473683 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.473853 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.473997 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.474189 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.474319 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.474456 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.474584 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.474709 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.474834 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.475017 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.475146 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.475314 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.475563 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.475706 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.475832 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.475965 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.476102 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.476228 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.476352 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.476485 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.476710 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.476871 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.477062 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.477194 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.477373 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.477503 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.477680 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.477802 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.477982 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.478111 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.478289 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.478416 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.478596 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.478727 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.478901 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.479684 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.479823 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.479950 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.480322 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.480459 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.480586 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.480712 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.480918 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.481051 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.481235 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.481385 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.481558 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.481688 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.481890 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.482020 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.482197 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.482335 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.482505 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.482633 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.482815 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.483022 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.483161 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.483350 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.483480 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.483661 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.483790 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.483968 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.484107 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.484318 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.484447 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.484570 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.484694 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.484884 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.485032 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.485193 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.485321 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.485499 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.485626 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.485806 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.485937 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.486110 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.486238 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.486411 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.486545 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.486715 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.486854 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.487022 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.487151 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.487326 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.487454 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.487646 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.487776 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.487961 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.488094 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.488262 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.488471 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.488601 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.488725 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.488912 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.489043 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.489172 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.489306 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.489520 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.489679 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.489829 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.489991 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.490131 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.490318 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.490448 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.490637 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.490766 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.490955 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.491094 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.491270 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.491400 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.491580 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.491717 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.491892 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.492029 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.492192 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.492322 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.492491 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.492620 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.492794 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.492966 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.493123 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.493238 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.493423 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.493538 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.493737 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.493853 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.494041 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.494155 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.494362 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.494489 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.494675 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.494850 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.494989 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.495295 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.495476 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.495608 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.495825 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.495956 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.496140 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.496270 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.496465 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.496605 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.496787 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.496971 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.497128 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.497271 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.497432 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.497574 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.497745 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.497873 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.498046 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.498184 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.498346 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.498483 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.498649 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.498785 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.498948 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.499077 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.499245 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.499383 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.499545 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.499675 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.499841 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.499968 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.500143 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.500271 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.500442 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.500579 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.500746 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.500983 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.501132 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.501324 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.501457 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.501634 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.501764 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.501954 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.502093 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.502250 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.502379 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.502558 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.502687 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.502859 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.503005 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.503159 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.503289 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.503456 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.503586 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.503754 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.503891 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.504058 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.504186 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.504358 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.504571 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.504712 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.504872 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.505014 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.505140 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.505265 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.505388 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.505554 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.505693 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.505853 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.505984 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.506157 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.506286 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.506456 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.506587 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.506755 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.506883 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.507051 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.507190 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.507349 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.507536 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.507666 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.507792 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.507925 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.508061 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.508241 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.508369 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.508546 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.508682 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.508905 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.509054 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.509216 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.509354 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.509529 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.509740 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.509871 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.510069 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.510236 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.510459 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.510602 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.510774 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.510918 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.511123 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.511254 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.511430 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.511559 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.511732 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.511870 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.512033 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.512163 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.512335 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.512465 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.512637 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.512780 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.512968 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.513108 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.513273 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.513400 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.513574 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.513711 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.513880 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.514010 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.514183 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.514313 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.514487 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.514699 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.514822 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.514948 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.515074 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.515332 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.515473 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.515656 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.515785 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.515959 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.516095 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.516260 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.516401 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.516560 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.516690 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.516888 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.517023 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.517230 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.517358 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.517494 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.517620 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.517790 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.517920 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.518096 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.518219 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.518402 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.518532 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.518704 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.518839 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.519005 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.519142 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.519306 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.519434 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.519609 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.519736 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.519914 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.520054 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.520218 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.520355 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.520522 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.520661 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.520816 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.520963 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.521141 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.521446 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.521574 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.521749 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.521887 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.522051 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.522181 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.522359 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.522489 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.522698 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.522837 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.523012 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.523149 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.523324 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.523466 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.523633 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.523764 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.523944 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.524074 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.524248 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.524385 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.524550 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.524694 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.524947 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.525077 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.525203 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.525345 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.525481 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.525614 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.525774 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.526430 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.526605 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.526743 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.526904 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.527042 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.527354 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.527562 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.527701 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.527873 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.528003 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.528189 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.528310 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.528506 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.528646 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.528810 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.528959 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.529136 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.529265 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.529436 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.529566 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.529734 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.529871 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.530032 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.530164 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.530336 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.530467 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.530634 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.530763 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.530931 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.531071 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.531228 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.531358 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.531525 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.531654 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.531822 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.531951 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.532122 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.532261 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.532426 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.532555 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.532724 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.532888 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.533060 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.533189 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.533357 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.533484 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.533651 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.533792 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.533945 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.534073 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.534244 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.534372 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.534542 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.534681 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.534839 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.535054 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.535185 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.535311 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.535446 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.535580 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.535706 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.535831 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.535986 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.536115 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.536279 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.536418 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.536576 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.536712 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.536886 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.537027 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.537198 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.537326 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.537453 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.537577 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.537742 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.537871 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.538038 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.538168 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.538332 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.538453 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.538627 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.538767 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.538921 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.539050 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.539216 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.539354 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.539539 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.539678 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.539863 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.539993 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.540169 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.540290 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.540483 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.540623 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.540787 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.540938 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.541124 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.541254 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.541429 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.542127 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.542378 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.542518 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.542699 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.542828 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.543009 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.543147 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.543319 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.543448 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.543646 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.543777 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.543952 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.544083 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.544259 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.544388 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.544567 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.544706 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.544893 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.545040 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.545235 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.545363 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.545487 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.545625 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.545800 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.545928 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.546120 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.546246 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.546418 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.546619 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.546747 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.546871 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.547036 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.547164 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.547345 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.547482 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.547655 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.547792 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.547962 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.548100 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.548285 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.548414 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.548590 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.548718 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.548915 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.549047 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.549220 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.549358 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.549518 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.549645 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.549769 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 10:13:04.549894 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.550117 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.550423 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.550726 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.551037 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.551342 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.551663 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.551983 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.552287 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.552605 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.552950 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.553299 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.553607 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.553941 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.554263 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.554570 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.554875 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.555177 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:13:04.555415 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 10:13:04.704505 n-d-858383-15 devstack@n-api.service[104548]: INFO dbcounter [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] Registered counter for database nova_api Oct 24 10:13:04.709534 n-d-858383-15 devstack@n-api.service[104547]: INFO dbcounter [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] Registered counter for database nova_api Oct 24 10:13:04.724573 n-d-858383-15 devstack@n-api.service[104548]: DEBUG oslo_db.sqlalchemy.engines [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 10:13:04.728880 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_db.sqlalchemy.engines [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 10:13:04.731898 n-d-858383-15 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writer thread running {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 10:13:04.736172 n-d-858383-15 devstack@n-api.service[104547]: DEBUG dbcounter [-] [104547] Writer thread running {{(pid=104547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 10:13:04.787396 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.context [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),75e76125-592d-4292-bea1-3b51451d7165(cell1) {{(pid=104548) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 10:13:04.791277 n-d-858383-15 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:13:04.792194 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.context [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),75e76125-592d-4292-bea1-3b51451d7165(cell1) {{(pid=104547) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 10:13:04.792312 n-d-858383-15 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:13:04.793890 n-d-858383-15 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:13:04.794600 n-d-858383-15 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:13:04.795041 n-d-858383-15 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:13:04.796106 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_concurrency.lockutils [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:13:04.796576 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_concurrency.lockutils [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:13:04.797056 n-d-858383-15 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:13:04.798191 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_concurrency.lockutils [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:13:04.798909 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_concurrency.lockutils [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:13:04.799024 n-d-858383-15 devstack@n-api.service[104548]: INFO dbcounter [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] Registered counter for database nova_cell0 Oct 24 10:13:04.799351 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_concurrency.lockutils [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:13:04.801355 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_concurrency.lockutils [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:13:04.803038 n-d-858383-15 devstack@n-api.service[104548]: INFO dbcounter [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] Registered counter for database nova_cell1 Oct 24 10:13:04.803313 n-d-858383-15 devstack@n-api.service[104547]: INFO dbcounter [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] Registered counter for database nova_cell0 Oct 24 10:13:04.813421 n-d-858383-15 devstack@n-api.service[104547]: INFO dbcounter [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] Registered counter for database nova_cell1 Oct 24 10:13:04.813615 n-d-858383-15 devstack@n-api.service[104548]: DEBUG oslo_db.sqlalchemy.engines [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 10:13:04.813870 n-d-858383-15 devstack@n-api.service[104548]: DEBUG oslo_db.sqlalchemy.engines [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 10:13:04.815614 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_db.sqlalchemy.engines [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 10:13:04.820188 n-d-858383-15 devstack@n-api.service[104547]: DEBUG dbcounter [-] [104547] Writer thread running {{(pid=104547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 10:13:04.820826 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_db.sqlalchemy.engines [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 10:13:04.821600 n-d-858383-15 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writer thread running {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 10:13:04.821935 n-d-858383-15 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writer thread running {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 10:13:04.960814 n-d-858383-15 devstack@n-api.service[104547]: DEBUG dbcounter [-] [104547] Writer thread running {{(pid=104547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 10:13:04.966707 n-d-858383-15 devstack@n-api.service[104548]: INFO dbcounter [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] Registered counter for database nova_cell0 Oct 24 10:13:04.969458 n-d-858383-15 devstack@n-api.service[104547]: INFO dbcounter [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] Registered counter for database nova_cell0 Oct 24 10:13:04.974084 n-d-858383-15 devstack@n-api.service[104548]: DEBUG oslo_db.sqlalchemy.engines [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 10:13:04.977923 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_db.sqlalchemy.engines [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 10:13:04.978828 n-d-858383-15 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writer thread running {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 10:13:04.983601 n-d-858383-15 devstack@n-api.service[104547]: DEBUG dbcounter [-] [104547] Writer thread running {{(pid=104547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 10:13:05.319182 n-d-858383-15 devstack@n-api.service[104547]: WARNING keystonemiddleware.auth_token [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 10:13:05.323299 n-d-858383-15 devstack@n-api.service[104548]: WARNING keystonemiddleware.auth_token [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 10:13:05.326644 n-d-858383-15 devstack@n-api.service[104547]: WARNING keystonemiddleware.auth_token [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 10:13:05.330628 n-d-858383-15 devstack@n-api.service[104548]: WARNING keystonemiddleware.auth_token [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 10:13:05.669280 n-d-858383-15 devstack@n-api.service[104547]: WARNING keystonemiddleware.auth_token [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 10:13:05.675200 n-d-858383-15 devstack@n-api.service[104547]: WARNING keystonemiddleware.auth_token [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 10:13:05.675717 n-d-858383-15 devstack@n-api.service[104548]: WARNING keystonemiddleware.auth_token [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 10:13:05.680448 n-d-858383-15 devstack@n-api.service[104547]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555cfa37c9c0 pid: 104547 (default app) Oct 24 10:13:05.681699 n-d-858383-15 devstack@n-api.service[104548]: WARNING keystonemiddleware.auth_token [None req-86487c04-1e75-4db0-ad5e-92c4613ac1f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 10:13:05.682566 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:13:05.683741 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001747 Oct 24 10:13:05.684158 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 788 bytes} [Mon Oct 24 10:13:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:13:05.687252 n-d-858383-15 devstack@n-api.service[104548]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555cfa37c9c0 pid: 104548 (default app) Oct 24 10:14:27.698751 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:27.699791 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 24 10:14:27.700186 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 2/2] 10.222.0.50 () {54 vars in 931 bytes} [Mon Oct 24 10:14:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:14:27.712293 n-d-858383-15 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writing DB stats nova_api:SELECT=3 {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:27.713282 n-d-858383-15 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writing DB stats nova_cell0:SELECT=3 {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:27.714496 n-d-858383-15 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writing DB stats nova_cell1:SELECT=3 {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:27.715858 n-d-858383-15 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:28.616307 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-5b95a52c-7517-44f8-a616-d4366be01f57 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:28.650269 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-5b95a52c-7517-44f8-a616-d4366be01f57 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.943096 Oct 24 10:14:28.651077 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 1/3] 10.222.0.50 () {60 vars in 1292 bytes} [Mon Oct 24 10:14:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:31.399172 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:31.400179 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-8fe5fa89-1446-4483-a0e1-720ef2ed323a None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Oct 24 10:14:31.400751 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 3/4] 10.222.0.50 () {54 vars in 931 bytes} [Mon Oct 24 10:14:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:14:31.852279 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-fbe8ed9b-99bb-416a-81d5-77c59247f1b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "id": "c1", "ram": 256, "vcpus": 1}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:31.900095 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-fbe8ed9b-99bb-416a-81d5-77c59247f1b6 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.492398 Oct 24 10:14:31.900663 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 2/5] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Oct 24 10:14:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:14:31.915409 n-d-858383-15 devstack@n-api.service[104547]: DEBUG dbcounter [-] [104547] Writing DB stats nova_api:SELECT=3 {{(pid=104547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:31.918390 n-d-858383-15 devstack@n-api.service[104547]: DEBUG dbcounter [-] [104547] Writing DB stats nova_cell0:SELECT=3 {{(pid=104547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:31.919685 n-d-858383-15 devstack@n-api.service[104547]: DEBUG dbcounter [-] [104547] Writing DB stats nova_cell1:SELECT=3 {{(pid=104547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:31.920585 n-d-858383-15 devstack@n-api.service[104547]: DEBUG dbcounter [-] [104547] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:32.127178 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-8a143364-ae91-440e-8340-65e5d3457074 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:32.196026 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-8a143364-ae91-440e-8340-65e5d3457074 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285893 Oct 24 10:14:32.196663 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 4/6] 10.222.0.50 () {64 vars in 1336 bytes} [Mon Oct 24 10:14:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:34.860314 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-fbe8ed9b-99bb-416a-81d5-77c59247f1b6 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:34.861278 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-fbe8ed9b-99bb-416a-81d5-77c59247f1b6 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001765 Oct 24 10:14:34.861681 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 3/7] 10.222.0.50 () {54 vars in 931 bytes} [Mon Oct 24 10:14:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:14:35.647615 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-1688039d-7145-426b-bd04-bd2da0943b04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "swap": 0, "vcpus": 1}} {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:35.697334 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-1688039d-7145-426b-bd04-bd2da0943b04 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.828727 Oct 24 10:14:35.698219 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 5/8] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Oct 24 10:14:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:14:35.711074 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-0d56cb63-ae1b-4bcb-ad7b-07326f5f155a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:35.779157 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-0d56cb63-ae1b-4bcb-ad7b-07326f5f155a admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071535 Oct 24 10:14:35.779765 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 4/9] 10.222.0.50 () {64 vars in 1336 bytes} [Mon Oct 24 10:14:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:38.753861 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-1688039d-7145-426b-bd04-bd2da0943b04 admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:38.754880 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-1688039d-7145-426b-bd04-bd2da0943b04 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 24 10:14:38.755611 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 6/10] 10.222.0.50 () {54 vars in 931 bytes} [Mon Oct 24 10:14:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:14:39.306891 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-5834e7b8-0a96-492d-93cb-184551a639c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 1024, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:39.335003 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-5834e7b8-0a96-492d-93cb-184551a639c7 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.573480 Oct 24 10:14:39.335667 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 5/11] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Oct 24 10:14:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:14:39.347756 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-1dd03f06-4ee5-4a24-930d-ad62fec1f6d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:39.377235 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-1dd03f06-4ee5-4a24-930d-ad62fec1f6d4 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032994 Oct 24 10:14:39.378194 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 7/12] 10.222.0.50 () {64 vars in 1336 bytes} [Mon Oct 24 10:14:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:42.013811 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-5834e7b8-0a96-492d-93cb-184551a639c7 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:42.015972 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-5834e7b8-0a96-492d-93cb-184551a639c7 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002977 Oct 24 10:14:42.017097 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 6/13] 10.222.0.50 () {54 vars in 931 bytes} [Mon Oct 24 10:14:42 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:14:42.489373 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-df1fed35-0f18-4bde-ac41-9f37b30e2e83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "swap": 0}} {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:42.511230 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-df1fed35-0f18-4bde-ac41-9f37b30e2e83 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.487484 Oct 24 10:14:42.512016 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 8/14] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Oct 24 10:14:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:14:42.525498 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-c6a388d4-9dd4-45d4-b6d1-966beadf494c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:42.557257 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-c6a388d4-9dd4-45d4-b6d1-966beadf494c admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035434 Oct 24 10:14:42.557855 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 7/15] 10.222.0.50 () {64 vars in 1336 bytes} [Mon Oct 24 10:14:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:45.294020 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-df1fed35-0f18-4bde-ac41-9f37b30e2e83 admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:45.295784 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-df1fed35-0f18-4bde-ac41-9f37b30e2e83 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002757 Oct 24 10:14:45.301479 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 9/16] 10.222.0.50 () {54 vars in 931 bytes} [Mon Oct 24 10:14:45 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:14:45.721036 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-ec481ee1-f927-4133-8956-324723e84244 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "id": "d4", "ram": 4096}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:45.743799 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-ec481ee1-f927-4133-8956-324723e84244 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.441257 Oct 24 10:14:45.744367 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 8/17] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Oct 24 10:14:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:14:45.757342 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-92dd2362-328f-4d41-a8ca-59a414ccdfe0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:45.783685 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-92dd2362-328f-4d41-a8ca-59a414ccdfe0 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029902 Oct 24 10:14:45.784511 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 10/18] 10.222.0.50 () {64 vars in 1336 bytes} [Mon Oct 24 10:14:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:14:48.482893 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-ec481ee1-f927-4133-8956-324723e84244 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:48.482893 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-ec481ee1-f927-4133-8956-324723e84244 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Oct 24 10:14:48.482893 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 9/19] 10.222.0.50 () {54 vars in 931 bytes} [Mon Oct 24 10:14:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:14:48.940006 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-84f1b240-5674-4777-94e7-ff93ee9c1b60 admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:48.965053 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-84f1b240-5674-4777-94e7-ff93ee9c1b60 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.477606 Oct 24 10:14:48.965656 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 11/20] 10.222.0.50 () {60 vars in 1292 bytes} [Mon Oct 24 10:14:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:14:51.864711 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-ec481ee1-f927-4133-8956-324723e84244 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:51.865749 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-ec481ee1-f927-4133-8956-324723e84244 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 24 10:14:51.866170 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 10/21] 10.222.0.50 () {54 vars in 931 bytes} [Mon Oct 24 10:14:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:14:52.325577 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-4815759a-a973-4c03-bd2e-de88b1d5b166 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "ram": 512, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:52.355171 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-4815759a-a973-4c03-bd2e-de88b1d5b166 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.481138 Oct 24 10:14:52.356038 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 12/22] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Oct 24 10:14:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:14:52.371767 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-dfbfca33-b3f8-45bd-86c0-30cc119d2a49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:52.405986 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-dfbfca33-b3f8-45bd-86c0-30cc119d2a49 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038714 Oct 24 10:14:52.406622 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 11/23] 10.222.0.50 () {64 vars in 1333 bytes} [Mon Oct 24 10:14:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:14:55.062986 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-4815759a-a973-4c03-bd2e-de88b1d5b166 admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:55.063903 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-4815759a-a973-4c03-bd2e-de88b1d5b166 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 24 10:14:55.064305 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 13/24] 10.222.0.50 () {54 vars in 931 bytes} [Mon Oct 24 10:14:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:14:55.466322 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-0cbb9453-4474-4890-b8cc-4b2c6aaeb012 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:55.485305 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-0cbb9453-4474-4890-b8cc-4b2c6aaeb012 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.414976 Oct 24 10:14:55.486525 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 12/25] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Oct 24 10:14:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 10:14:55.499337 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-89a0cc6f-cb36-4a3e-86fb-1bc560d20383 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:55.522207 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-89a0cc6f-cb36-4a3e-86fb-1bc560d20383 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027256 Oct 24 10:14:55.522774 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 14/26] 10.222.0.50 () {64 vars in 1333 bytes} [Mon Oct 24 10:14:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:14:58.157377 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-0cbb9453-4474-4890-b8cc-4b2c6aaeb012 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:14:58.159077 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-0cbb9453-4474-4890-b8cc-4b2c6aaeb012 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002143 Oct 24 10:14:58.159489 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 13/27] 10.222.0.50 () {54 vars in 931 bytes} [Mon Oct 24 10:14:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:14:58.542433 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-60618310-a757-426f-a685-5a2a3fa7b329 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:58.563555 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-60618310-a757-426f-a685-5a2a3fa7b329 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.397859 Oct 24 10:14:58.564108 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 15/28] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Oct 24 10:14:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:14:58.576771 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-6af888b5-2072-40f2-ab5a-71011d2ac7c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:14:58.581496 n-d-858383-15 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:58.606594 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-6af888b5-2072-40f2-ab5a-71011d2ac7c2 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033933 Oct 24 10:14:58.607303 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 14/29] 10.222.0.50 () {64 vars in 1333 bytes} [Mon Oct 24 10:14:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:15:01.233451 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-60618310-a757-426f-a685-5a2a3fa7b329 admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:01.235347 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-60618310-a757-426f-a685-5a2a3fa7b329 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002360 Oct 24 10:15:01.236392 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 16/30] 10.222.0.50 () {54 vars in 931 bytes} [Mon Oct 24 10:15:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:15:01.674274 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-e5c6e854-bd9d-4bb1-87e5-ed4195532d7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:15:01.695498 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-e5c6e854-bd9d-4bb1-87e5-ed4195532d7b admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.451654 Oct 24 10:15:01.700910 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 15/31] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Oct 24 10:15:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:15:01.708779 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-d89c3f65-ebad-437d-833f-9f03270a8e56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:15:01.735472 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-d89c3f65-ebad-437d-833f-9f03270a8e56 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030307 Oct 24 10:15:01.736657 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 17/32] 10.222.0.50 () {64 vars in 1333 bytes} [Mon Oct 24 10:15:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:15:04.394793 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-e5c6e854-bd9d-4bb1-87e5-ed4195532d7b admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:04.395722 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-e5c6e854-bd9d-4bb1-87e5-ed4195532d7b admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 24 10:15:04.396292 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 16/33] 10.222.0.50 () {54 vars in 931 bytes} [Mon Oct 24 10:15:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:15:04.849144 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-36681ae3-8b12-4cac-8e57-3c7aed7a97af admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "name": "m1.xlarge", "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:15:04.856131 n-d-858383-15 devstack@n-api.service[104547]: DEBUG dbcounter [-] [104547] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:15:04.874260 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-36681ae3-8b12-4cac-8e57-3c7aed7a97af admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.471061 Oct 24 10:15:04.875101 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 18/34] 10.222.0.50 () {64 vars in 1283 bytes} [Mon Oct 24 10:15:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 10:15:04.886736 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-d3376081-e595-433c-ada4-2b5a22e8b665 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:15:04.915304 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-d3376081-e595-433c-ada4-2b5a22e8b665 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032134 Oct 24 10:15:04.916179 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 17/35] 10.222.0.50 () {64 vars in 1333 bytes} [Mon Oct 24 10:15:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:15:26.050137 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-36681ae3-8b12-4cac-8e57-3c7aed7a97af admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:26.051145 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-36681ae3-8b12-4cac-8e57-3c7aed7a97af admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 24 10:15:26.051539 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 19/36] 10.222.0.50 () {54 vars in 931 bytes} [Mon Oct 24 10:15:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:15:26.062540 n-d-858383-15 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:15:26.433511 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-aa8d0941-e238-402e-808f-a99009195bd5 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:26.452098 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-aa8d0941-e238-402e-808f-a99009195bd5 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.394495 Oct 24 10:15:26.452779 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 18/37] 10.222.0.50 () {60 vars in 1292 bytes} [Mon Oct 24 10:15:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:15:27.754829 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-36681ae3-8b12-4cac-8e57-3c7aed7a97af admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:27.755833 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-36681ae3-8b12-4cac-8e57-3c7aed7a97af admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Oct 24 10:15:27.756234 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 20/38] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Oct 24 10:15:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:15:28.308334 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-10b0fb0c-c7db-423c-9c4b-0eb2fea737e1 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:28.313785 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.wsgi [None req-10b0fb0c-c7db-423c-9c4b-0eb2fea737e1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-10b0fb0c-c7db-423c-9c4b-0eb2fea737e1 admin admin] Request method failure captured: Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: Accept: application/json Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: Accept-Encoding: gzip, deflate Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: Connection: keep-alive Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: Content-Length: 0 Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: Host: 10.222.0.50 Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: Openstack-Api-Version: compute 2.92 Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: Openstack-System-Scope: None Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: User-Agent: python-novaclient Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: X-Auth-Token: gAAAAABjVmW_-yequiMoUXxtcaPLe0X-S6GqO7AAvwyGFqDc2j2Rnc5fuIhNUaX5kxnKD1OqBmfC1i_0CyIUOcvx8ymqlOHprX8VoYj_R9A-_fv9xTQJb170Is5Xt6ZhhQcm9tJH-YJU4hk0CRP5v9KIH5BOxF9ESaj1IinQQjjpB_ZlfIJBkwc Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: X-Domain-Id: None Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: X-Domain-Name: None Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: X-Identity-Status: Confirmed Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: X-Is-Admin-Project: True Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: X-Project-Domain-Id: default Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: X-Project-Domain-Name: Default Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: X-Project-Id: 303720ac3dc84130bb1b00cb47ad9891 Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: X-Project-Name: admin Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: X-Role: reader,admin,member Oct 24 10:15:28.317012 n-d-858383-15 devstack@n-api.service[104548]: X-Roles: reader,admin,member Oct 24 10:15:28.318674 n-d-858383-15 devstack@n-api.service[104548]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/303720ac3dc84130bb1b00cb47ad9891"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/303720ac3dc84130bb1b00cb47ad9891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/303720ac3dc84130bb1b00cb47ad9891"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_303720ac3dc84130bb1b00cb47ad9891", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:15:28.318674 n-d-858383-15 devstack@n-api.service[104548]: X-Tenant: admin Oct 24 10:15:28.318674 n-d-858383-15 devstack@n-api.service[104548]: X-Tenant-Id: 303720ac3dc84130bb1b00cb47ad9891 Oct 24 10:15:28.318674 n-d-858383-15 devstack@n-api.service[104548]: X-Tenant-Name: admin Oct 24 10:15:28.318674 n-d-858383-15 devstack@n-api.service[104548]: X-User: admin Oct 24 10:15:28.318674 n-d-858383-15 devstack@n-api.service[104548]: X-User-Domain-Id: default Oct 24 10:15:28.318674 n-d-858383-15 devstack@n-api.service[104548]: X-User-Domain-Name: Default Oct 24 10:15:28.318674 n-d-858383-15 devstack@n-api.service[104548]: X-User-Id: bb5dadf8c8d64348b638592e137a5d3a Oct 24 10:15:28.318674 n-d-858383-15 devstack@n-api.service[104548]: X-User-Name: admin Oct 24 10:15:28.318674 n-d-858383-15 devstack@n-api.service[104548]: method: > Oct 24 10:15:28.318674 n-d-858383-15 devstack@n-api.service[104548]: exception: Flavor 42 could not be found. Oct 24 10:15:28.318674 n-d-858383-15 devstack@n-api.service[104548]: action_args: {'id': '42'} Oct 24 10:15:28.318674 n-d-858383-15 devstack@n-api.service[104548]: {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:15:28.318674 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:15:28.319747 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:15:28.321228 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:15:28.321228 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:15:28.321228 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:15:28.321228 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:15:28.321228 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 10:15:28.321228 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:15:28.321228 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 24 10:15:28.321228 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 24 10:15:28.321228 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:15:28.321228 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 24 10:15:28.321228 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:15:28.321228 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:15:28.321228 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:15:28.321228 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:15:28.321228 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:15:28.321228 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 24 10:15:28.321228 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 24 10:15:28.321228 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-10b0fb0c-c7db-423c-9c4b-0eb2fea737e1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:15:28.322508 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-10b0fb0c-c7db-423c-9c4b-0eb2fea737e1 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.408873 Oct 24 10:15:28.322508 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 19/39] 10.222.0.50 () {60 vars in 1190 bytes} [Mon Oct 24 10:15:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 10:15:28.329147 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-af50fe4d-0fb1-4791-9104-b86fb0a78ccf admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:28.351809 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-af50fe4d-0fb1-4791-9104-b86fb0a78ccf admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027124 Oct 24 10:15:28.352380 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 21/40] 10.222.0.50 () {60 vars in 1210 bytes} [Mon Oct 24 10:15:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:15:28.364446 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-34caaba4-91f3-4d40-be77-4f83a5974b1b admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:28.388567 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-34caaba4-91f3-4d40-be77-4f83a5974b1b admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029479 Oct 24 10:15:28.389195 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 20/41] 10.222.0.50 () {60 vars in 1210 bytes} [Mon Oct 24 10:15:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:15:28.399405 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-e9985f79-fbc1-4881-a603-d65a69247dca admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:28.405091 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.wsgi [None req-e9985f79-fbc1-4881-a603-d65a69247dca admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-e9985f79-fbc1-4881-a603-d65a69247dca admin admin] Request method failure captured: Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: Accept: application/json Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: Accept-Encoding: gzip, deflate Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: Connection: keep-alive Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: Content-Length: 0 Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: Host: 10.222.0.50 Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: Openstack-Api-Version: compute 2.92 Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: Openstack-System-Scope: None Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: User-Agent: python-novaclient Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: X-Auth-Token: gAAAAABjVmW_-yequiMoUXxtcaPLe0X-S6GqO7AAvwyGFqDc2j2Rnc5fuIhNUaX5kxnKD1OqBmfC1i_0CyIUOcvx8ymqlOHprX8VoYj_R9A-_fv9xTQJb170Is5Xt6ZhhQcm9tJH-YJU4hk0CRP5v9KIH5BOxF9ESaj1IinQQjjpB_ZlfIJBkwc Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: X-Domain-Id: None Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: X-Domain-Name: None Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: X-Identity-Status: Confirmed Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: X-Is-Admin-Project: True Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: X-Project-Domain-Id: default Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: X-Project-Domain-Name: Default Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: X-Project-Id: 303720ac3dc84130bb1b00cb47ad9891 Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: X-Project-Name: admin Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: X-Role: reader,admin,member Oct 24 10:15:28.410247 n-d-858383-15 devstack@n-api.service[104547]: X-Roles: reader,admin,member Oct 24 10:15:28.412763 n-d-858383-15 devstack@n-api.service[104547]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/303720ac3dc84130bb1b00cb47ad9891"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/303720ac3dc84130bb1b00cb47ad9891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/303720ac3dc84130bb1b00cb47ad9891"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_303720ac3dc84130bb1b00cb47ad9891", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:15:28.412763 n-d-858383-15 devstack@n-api.service[104547]: X-Tenant: admin Oct 24 10:15:28.412763 n-d-858383-15 devstack@n-api.service[104547]: X-Tenant-Id: 303720ac3dc84130bb1b00cb47ad9891 Oct 24 10:15:28.412763 n-d-858383-15 devstack@n-api.service[104547]: X-Tenant-Name: admin Oct 24 10:15:28.412763 n-d-858383-15 devstack@n-api.service[104547]: X-User: admin Oct 24 10:15:28.412763 n-d-858383-15 devstack@n-api.service[104547]: X-User-Domain-Id: default Oct 24 10:15:28.412763 n-d-858383-15 devstack@n-api.service[104547]: X-User-Domain-Name: Default Oct 24 10:15:28.412763 n-d-858383-15 devstack@n-api.service[104547]: X-User-Id: bb5dadf8c8d64348b638592e137a5d3a Oct 24 10:15:28.412763 n-d-858383-15 devstack@n-api.service[104547]: X-User-Name: admin Oct 24 10:15:28.412763 n-d-858383-15 devstack@n-api.service[104547]: method: > Oct 24 10:15:28.412763 n-d-858383-15 devstack@n-api.service[104547]: exception: Flavor 42 could not be found. Oct 24 10:15:28.412763 n-d-858383-15 devstack@n-api.service[104547]: action_args: {'id': '42'} Oct 24 10:15:28.412763 n-d-858383-15 devstack@n-api.service[104547]: {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:15:28.412763 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:15:28.417364 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:15:28.418870 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:15:28.418870 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:15:28.418870 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:15:28.418870 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:15:28.418870 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 10:15:28.418870 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:15:28.418870 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 24 10:15:28.418870 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Oct 24 10:15:28.418870 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:15:28.418870 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Oct 24 10:15:28.418870 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:15:28.418870 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:15:28.418870 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:15:28.418870 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:15:28.418870 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:15:28.418870 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 24 10:15:28.418870 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Oct 24 10:15:28.418870 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-e9985f79-fbc1-4881-a603-d65a69247dca admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:15:28.420067 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-e9985f79-fbc1-4881-a603-d65a69247dca admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014734 Oct 24 10:15:28.420067 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 22/42] 10.222.0.50 () {60 vars in 1190 bytes} [Mon Oct 24 10:15:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 10:15:29.650366 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-34caaba4-91f3-4d40-be77-4f83a5974b1b admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:29.651374 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-34caaba4-91f3-4d40-be77-4f83a5974b1b admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 24 10:15:29.651771 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 21/43] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Oct 24 10:15:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:15:30.172274 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-a4a8e890-fda9-41ad-982a-0b8a1e4256be admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:30.177242 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.wsgi [None req-a4a8e890-fda9-41ad-982a-0b8a1e4256be admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-a4a8e890-fda9-41ad-982a-0b8a1e4256be admin admin] Request method failure captured: Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: Accept: application/json Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: Accept-Encoding: gzip, deflate Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: Connection: keep-alive Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: Content-Length: 0 Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: Host: 10.222.0.50 Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: Openstack-Api-Version: compute 2.92 Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: Openstack-System-Scope: None Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: User-Agent: python-novaclient Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: X-Auth-Token: gAAAAABjVmXBRaZsN_GcBA4TxqQlyI0KoaR7F4adjUeTklFCSekcM7jMVOOMlYyq8wtYyEvwLPQ78jQbdF5l0KPEX5lkTdoQIx-SIQH9cPRqAMg2j3k8hCqa0Zv5Ue7I5w7XbrwtpYCuhd-UgNc4ZIhPt4BwaSOrl6XSMZclKXeAGekfLMvdvg8 Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: X-Domain-Id: None Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: X-Domain-Name: None Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: X-Identity-Status: Confirmed Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: X-Is-Admin-Project: True Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: X-Project-Domain-Id: default Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: X-Project-Domain-Name: Default Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: X-Project-Id: 303720ac3dc84130bb1b00cb47ad9891 Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: X-Project-Name: admin Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: X-Role: reader,admin,member Oct 24 10:15:30.178745 n-d-858383-15 devstack@n-api.service[104547]: X-Roles: reader,admin,member Oct 24 10:15:30.180281 n-d-858383-15 devstack@n-api.service[104547]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/303720ac3dc84130bb1b00cb47ad9891"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/303720ac3dc84130bb1b00cb47ad9891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/303720ac3dc84130bb1b00cb47ad9891"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_303720ac3dc84130bb1b00cb47ad9891", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:15:30.180281 n-d-858383-15 devstack@n-api.service[104547]: X-Tenant: admin Oct 24 10:15:30.180281 n-d-858383-15 devstack@n-api.service[104547]: X-Tenant-Id: 303720ac3dc84130bb1b00cb47ad9891 Oct 24 10:15:30.180281 n-d-858383-15 devstack@n-api.service[104547]: X-Tenant-Name: admin Oct 24 10:15:30.180281 n-d-858383-15 devstack@n-api.service[104547]: X-User: admin Oct 24 10:15:30.180281 n-d-858383-15 devstack@n-api.service[104547]: X-User-Domain-Id: default Oct 24 10:15:30.180281 n-d-858383-15 devstack@n-api.service[104547]: X-User-Domain-Name: Default Oct 24 10:15:30.180281 n-d-858383-15 devstack@n-api.service[104547]: X-User-Id: bb5dadf8c8d64348b638592e137a5d3a Oct 24 10:15:30.180281 n-d-858383-15 devstack@n-api.service[104547]: X-User-Name: admin Oct 24 10:15:30.180281 n-d-858383-15 devstack@n-api.service[104547]: method: > Oct 24 10:15:30.180281 n-d-858383-15 devstack@n-api.service[104547]: exception: Flavor 84 could not be found. Oct 24 10:15:30.180281 n-d-858383-15 devstack@n-api.service[104547]: action_args: {'id': '84'} Oct 24 10:15:30.180281 n-d-858383-15 devstack@n-api.service[104547]: {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:15:30.180281 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:15:30.181192 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:15:30.182295 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:15:30.182295 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:15:30.182295 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:15:30.182295 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:15:30.182295 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 10:15:30.182295 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:15:30.182295 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 24 10:15:30.182295 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Oct 24 10:15:30.182295 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:15:30.182295 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Oct 24 10:15:30.182295 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:15:30.182295 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:15:30.182295 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:15:30.182295 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:15:30.182295 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:15:30.182295 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 24 10:15:30.182295 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Oct 24 10:15:30.182295 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-a4a8e890-fda9-41ad-982a-0b8a1e4256be admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:15:30.183286 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-a4a8e890-fda9-41ad-982a-0b8a1e4256be admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.389817 Oct 24 10:15:30.183286 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 23/44] 10.222.0.50 () {60 vars in 1190 bytes} [Mon Oct 24 10:15:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 10:15:30.190858 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-0a6785e5-93bb-4c63-8325-7f7218457865 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:30.205940 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-0a6785e5-93bb-4c63-8325-7f7218457865 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019712 Oct 24 10:15:30.206472 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 22/45] 10.222.0.50 () {60 vars in 1210 bytes} [Mon Oct 24 10:15:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:15:30.215770 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-b91f402b-a58e-45bc-8156-dfbad98c769b admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:30.231204 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-b91f402b-a58e-45bc-8156-dfbad98c769b admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018967 Oct 24 10:15:30.231740 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 24/46] 10.222.0.50 () {60 vars in 1210 bytes} [Mon Oct 24 10:15:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:15:30.241725 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-be2db8f4-3a23-4e3f-b19e-ef5310ab1093 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:30.246579 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.wsgi [None req-be2db8f4-3a23-4e3f-b19e-ef5310ab1093 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-be2db8f4-3a23-4e3f-b19e-ef5310ab1093 admin admin] Request method failure captured: Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: Accept: application/json Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: Accept-Encoding: gzip, deflate Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: Connection: keep-alive Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: Content-Length: 0 Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: Host: 10.222.0.50 Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: Openstack-Api-Version: compute 2.92 Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: Openstack-System-Scope: None Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: User-Agent: python-novaclient Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: X-Auth-Token: gAAAAABjVmXBRaZsN_GcBA4TxqQlyI0KoaR7F4adjUeTklFCSekcM7jMVOOMlYyq8wtYyEvwLPQ78jQbdF5l0KPEX5lkTdoQIx-SIQH9cPRqAMg2j3k8hCqa0Zv5Ue7I5w7XbrwtpYCuhd-UgNc4ZIhPt4BwaSOrl6XSMZclKXeAGekfLMvdvg8 Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: X-Domain-Id: None Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: X-Domain-Name: None Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: X-Identity-Status: Confirmed Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: X-Is-Admin-Project: True Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: X-Project-Domain-Id: default Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: X-Project-Domain-Name: Default Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: X-Project-Id: 303720ac3dc84130bb1b00cb47ad9891 Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: X-Project-Name: admin Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: X-Role: reader,admin,member Oct 24 10:15:30.248083 n-d-858383-15 devstack@n-api.service[104548]: X-Roles: reader,admin,member Oct 24 10:15:30.250316 n-d-858383-15 devstack@n-api.service[104548]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/303720ac3dc84130bb1b00cb47ad9891"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/303720ac3dc84130bb1b00cb47ad9891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/303720ac3dc84130bb1b00cb47ad9891"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_303720ac3dc84130bb1b00cb47ad9891", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:15:30.250316 n-d-858383-15 devstack@n-api.service[104548]: X-Tenant: admin Oct 24 10:15:30.250316 n-d-858383-15 devstack@n-api.service[104548]: X-Tenant-Id: 303720ac3dc84130bb1b00cb47ad9891 Oct 24 10:15:30.250316 n-d-858383-15 devstack@n-api.service[104548]: X-Tenant-Name: admin Oct 24 10:15:30.250316 n-d-858383-15 devstack@n-api.service[104548]: X-User: admin Oct 24 10:15:30.250316 n-d-858383-15 devstack@n-api.service[104548]: X-User-Domain-Id: default Oct 24 10:15:30.250316 n-d-858383-15 devstack@n-api.service[104548]: X-User-Domain-Name: Default Oct 24 10:15:30.250316 n-d-858383-15 devstack@n-api.service[104548]: X-User-Id: bb5dadf8c8d64348b638592e137a5d3a Oct 24 10:15:30.250316 n-d-858383-15 devstack@n-api.service[104548]: X-User-Name: admin Oct 24 10:15:30.250316 n-d-858383-15 devstack@n-api.service[104548]: method: > Oct 24 10:15:30.250316 n-d-858383-15 devstack@n-api.service[104548]: exception: Flavor 84 could not be found. Oct 24 10:15:30.250316 n-d-858383-15 devstack@n-api.service[104548]: action_args: {'id': '84'} Oct 24 10:15:30.250316 n-d-858383-15 devstack@n-api.service[104548]: {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:15:30.250316 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:15:30.251210 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:15:30.252563 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:15:30.252563 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:15:30.252563 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:15:30.252563 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:15:30.252563 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 10:15:30.252563 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:15:30.252563 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 24 10:15:30.252563 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 24 10:15:30.252563 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:15:30.252563 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 24 10:15:30.252563 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:15:30.252563 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:15:30.252563 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:15:30.252563 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:15:30.252563 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:15:30.252563 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 24 10:15:30.252563 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 24 10:15:30.252563 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-be2db8f4-3a23-4e3f-b19e-ef5310ab1093 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:15:30.253798 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-be2db8f4-3a23-4e3f-b19e-ef5310ab1093 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011564 Oct 24 10:15:30.253798 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 23/47] 10.222.0.50 () {60 vars in 1190 bytes} [Mon Oct 24 10:15:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 10:15:31.447041 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-b91f402b-a58e-45bc-8156-dfbad98c769b admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:31.448051 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-b91f402b-a58e-45bc-8156-dfbad98c769b admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 24 10:15:31.448450 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 25/48] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Oct 24 10:15:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:15:31.972019 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-c43ef147-72dc-41f0-9b43-dd27636bb791 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:31.977875 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.wsgi [None req-c43ef147-72dc-41f0-9b43-dd27636bb791 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-c43ef147-72dc-41f0-9b43-dd27636bb791 admin admin] Request method failure captured: Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: Accept: application/json Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: Accept-Encoding: gzip, deflate Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: Connection: keep-alive Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: Content-Length: 0 Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: Host: 10.222.0.50 Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: Openstack-Api-Version: compute 2.92 Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: Openstack-System-Scope: None Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: User-Agent: python-novaclient Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: X-Auth-Token: gAAAAABjVmXDUsPh7uJJBZ1hi0eIZNWoDWZ-eGsvNJYpmIe-xN_rlHnBb3pgyw7o7r--CiXaQRj4rWN8TyYspeBbDQUEA4opE3LNrNWjTMTec3_a-Sdhp3XOdzuOe4NmI_BH4MqgmvVJWh3dRB3NVmy2CCNfuy9N47EunFGNVUP-QVcY6pXPiyc Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: X-Domain-Id: None Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: X-Domain-Name: None Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: X-Identity-Status: Confirmed Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: X-Is-Admin-Project: True Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: X-Project-Domain-Id: default Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: X-Project-Domain-Name: Default Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: X-Project-Id: 303720ac3dc84130bb1b00cb47ad9891 Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: X-Project-Name: admin Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: X-Role: reader,admin,member Oct 24 10:15:31.979356 n-d-858383-15 devstack@n-api.service[104548]: X-Roles: reader,admin,member Oct 24 10:15:31.980906 n-d-858383-15 devstack@n-api.service[104548]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/303720ac3dc84130bb1b00cb47ad9891"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/303720ac3dc84130bb1b00cb47ad9891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/303720ac3dc84130bb1b00cb47ad9891"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_303720ac3dc84130bb1b00cb47ad9891", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:15:31.980906 n-d-858383-15 devstack@n-api.service[104548]: X-Tenant: admin Oct 24 10:15:31.980906 n-d-858383-15 devstack@n-api.service[104548]: X-Tenant-Id: 303720ac3dc84130bb1b00cb47ad9891 Oct 24 10:15:31.980906 n-d-858383-15 devstack@n-api.service[104548]: X-Tenant-Name: admin Oct 24 10:15:31.980906 n-d-858383-15 devstack@n-api.service[104548]: X-User: admin Oct 24 10:15:31.980906 n-d-858383-15 devstack@n-api.service[104548]: X-User-Domain-Id: default Oct 24 10:15:31.980906 n-d-858383-15 devstack@n-api.service[104548]: X-User-Domain-Name: Default Oct 24 10:15:31.980906 n-d-858383-15 devstack@n-api.service[104548]: X-User-Id: bb5dadf8c8d64348b638592e137a5d3a Oct 24 10:15:31.980906 n-d-858383-15 devstack@n-api.service[104548]: X-User-Name: admin Oct 24 10:15:31.980906 n-d-858383-15 devstack@n-api.service[104548]: method: > Oct 24 10:15:31.980906 n-d-858383-15 devstack@n-api.service[104548]: exception: Flavor 451 could not be found. Oct 24 10:15:31.980906 n-d-858383-15 devstack@n-api.service[104548]: action_args: {'id': '451'} Oct 24 10:15:31.980906 n-d-858383-15 devstack@n-api.service[104548]: {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:15:31.980906 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:15:31.981914 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:15:31.983268 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:15:31.983268 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:15:31.983268 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:15:31.983268 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:15:31.983268 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 10:15:31.983268 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:15:31.983268 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 24 10:15:31.983268 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 24 10:15:31.983268 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:15:31.983268 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 24 10:15:31.983268 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:15:31.983268 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:15:31.983268 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:15:31.983268 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:15:31.983268 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:15:31.983268 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 24 10:15:31.983268 n-d-858383-15 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 24 10:15:31.983268 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-c43ef147-72dc-41f0-9b43-dd27636bb791 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:15:31.984630 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-c43ef147-72dc-41f0-9b43-dd27636bb791 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392409 Oct 24 10:15:31.984630 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 24/49] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Oct 24 10:15:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 10:15:31.990906 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-141bfdec-c390-44fc-b6e2-20da09e817ef admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:32.006487 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-141bfdec-c390-44fc-b6e2-20da09e817ef admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019731 Oct 24 10:15:32.007035 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 26/50] 10.222.0.50 () {60 vars in 1210 bytes} [Mon Oct 24 10:15:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:15:32.017207 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-ad8cd9ad-e4a2-44ab-bf66-ab56b8095726 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:32.032437 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-ad8cd9ad-e4a2-44ab-bf66-ab56b8095726 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019756 Oct 24 10:15:32.033004 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 25/51] 10.222.0.50 () {60 vars in 1210 bytes} [Mon Oct 24 10:15:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:15:32.042112 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-3c968793-6f0e-44b5-8b39-2ea159d8e5dc admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:32.047992 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.wsgi [None req-3c968793-6f0e-44b5-8b39-2ea159d8e5dc admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-3c968793-6f0e-44b5-8b39-2ea159d8e5dc admin admin] Request method failure captured: Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: Accept: application/json Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: Accept-Encoding: gzip, deflate Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: Connection: keep-alive Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: Content-Length: 0 Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: Host: 10.222.0.50 Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: Openstack-Api-Version: compute 2.92 Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: Openstack-System-Scope: None Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: User-Agent: python-novaclient Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: X-Auth-Token: gAAAAABjVmXDUsPh7uJJBZ1hi0eIZNWoDWZ-eGsvNJYpmIe-xN_rlHnBb3pgyw7o7r--CiXaQRj4rWN8TyYspeBbDQUEA4opE3LNrNWjTMTec3_a-Sdhp3XOdzuOe4NmI_BH4MqgmvVJWh3dRB3NVmy2CCNfuy9N47EunFGNVUP-QVcY6pXPiyc Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: X-Domain-Id: None Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: X-Domain-Name: None Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: X-Identity-Status: Confirmed Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: X-Is-Admin-Project: True Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: X-Project-Domain-Id: default Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: X-Project-Domain-Name: Default Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: X-Project-Id: 303720ac3dc84130bb1b00cb47ad9891 Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: X-Project-Name: admin Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: X-Role: reader,admin,member Oct 24 10:15:32.049532 n-d-858383-15 devstack@n-api.service[104547]: X-Roles: reader,admin,member Oct 24 10:15:32.051102 n-d-858383-15 devstack@n-api.service[104547]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/303720ac3dc84130bb1b00cb47ad9891"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/303720ac3dc84130bb1b00cb47ad9891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/303720ac3dc84130bb1b00cb47ad9891"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_303720ac3dc84130bb1b00cb47ad9891", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:15:32.051102 n-d-858383-15 devstack@n-api.service[104547]: X-Tenant: admin Oct 24 10:15:32.051102 n-d-858383-15 devstack@n-api.service[104547]: X-Tenant-Id: 303720ac3dc84130bb1b00cb47ad9891 Oct 24 10:15:32.051102 n-d-858383-15 devstack@n-api.service[104547]: X-Tenant-Name: admin Oct 24 10:15:32.051102 n-d-858383-15 devstack@n-api.service[104547]: X-User: admin Oct 24 10:15:32.051102 n-d-858383-15 devstack@n-api.service[104547]: X-User-Domain-Id: default Oct 24 10:15:32.051102 n-d-858383-15 devstack@n-api.service[104547]: X-User-Domain-Name: Default Oct 24 10:15:32.051102 n-d-858383-15 devstack@n-api.service[104547]: X-User-Id: bb5dadf8c8d64348b638592e137a5d3a Oct 24 10:15:32.051102 n-d-858383-15 devstack@n-api.service[104547]: X-User-Name: admin Oct 24 10:15:32.051102 n-d-858383-15 devstack@n-api.service[104547]: method: > Oct 24 10:15:32.051102 n-d-858383-15 devstack@n-api.service[104547]: exception: Flavor 451 could not be found. Oct 24 10:15:32.051102 n-d-858383-15 devstack@n-api.service[104547]: action_args: {'id': '451'} Oct 24 10:15:32.051102 n-d-858383-15 devstack@n-api.service[104547]: {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:15:32.051102 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:15:32.051920 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:15:32.052964 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:15:32.052964 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:15:32.052964 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:15:32.052964 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:15:32.052964 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 10:15:32.052964 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:15:32.052964 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 24 10:15:32.052964 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Oct 24 10:15:32.052964 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:15:32.052964 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Oct 24 10:15:32.052964 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:15:32.052964 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:15:32.052964 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:15:32.052964 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:15:32.052964 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:15:32.052964 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 24 10:15:32.052964 n-d-858383-15 devstack@n-api.service[104547]: ERROR nova.api.openstack.wsgi Oct 24 10:15:32.052964 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-3c968793-6f0e-44b5-8b39-2ea159d8e5dc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:15:32.053964 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-3c968793-6f0e-44b5-8b39-2ea159d8e5dc admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012317 Oct 24 10:15:32.053964 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 27/52] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Oct 24 10:15:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 24 10:15:33.247549 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-ad8cd9ad-e4a2-44ab-bf66-ab56b8095726 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:33.248569 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-ad8cd9ad-e4a2-44ab-bf66-ab56b8095726 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 24 10:15:33.249002 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 26/53] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Oct 24 10:15:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:15:33.769584 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-5fd5fae7-d185-451d-b3d6-792a9d7d51ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:15:33.790577 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-5fd5fae7-d185-451d-b3d6-792a9d7d51ac admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.403261 Oct 24 10:15:33.791561 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 28/54] 10.222.0.50 () {64 vars in 1235 bytes} [Mon Oct 24 10:15:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:15:34.995512 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-ad8cd9ad-e4a2-44ab-bf66-ab56b8095726 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:34.996539 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-ad8cd9ad-e4a2-44ab-bf66-ab56b8095726 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 24 10:15:34.996954 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 27/55] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Oct 24 10:15:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:15:35.511727 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-19864464-61e5-4981-83bc-78509e11714e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:15:35.529546 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-19864464-61e5-4981-83bc-78509e11714e admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.394780 Oct 24 10:15:35.530091 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 29/56] 10.222.0.50 () {64 vars in 1235 bytes} [Mon Oct 24 10:15:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:15:36.745191 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-ad8cd9ad-e4a2-44ab-bf66-ab56b8095726 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:36.746205 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-ad8cd9ad-e4a2-44ab-bf66-ab56b8095726 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 24 10:15:36.746608 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 28/57] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Oct 24 10:15:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:15:37.269788 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-ae6dcd85-5f53-4f94-95e2-4dc9acdb1a58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:15:37.289034 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-ae6dcd85-5f53-4f94-95e2-4dc9acdb1a58 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.404430 Oct 24 10:15:37.289572 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 30/58] 10.222.0.50 () {64 vars in 1235 bytes} [Mon Oct 24 10:15:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:15:38.511466 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-ad8cd9ad-e4a2-44ab-bf66-ab56b8095726 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:38.512486 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-ad8cd9ad-e4a2-44ab-bf66-ab56b8095726 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 24 10:15:38.512910 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 29/59] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Oct 24 10:15:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:15:39.037370 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-86f4c40f-2b56-4636-8439-ddfbb3c711bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:15:39.056360 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-86f4c40f-2b56-4636-8439-ddfbb3c711bf admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.406185 Oct 24 10:15:39.057016 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 31/60] 10.222.0.50 () {64 vars in 1235 bytes} [Mon Oct 24 10:15:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:15:40.265140 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-ad8cd9ad-e4a2-44ab-bf66-ab56b8095726 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:40.266792 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-ad8cd9ad-e4a2-44ab-bf66-ab56b8095726 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002140 Oct 24 10:15:40.267200 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 30/61] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Oct 24 10:15:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:15:40.780453 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-83f0aad4-40ba-44a0-997e-4869a4005396 admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:15:40.800981 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-83f0aad4-40ba-44a0-997e-4869a4005396 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.396235 Oct 24 10:15:40.801512 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 32/62] 10.222.0.50 () {60 vars in 1202 bytes} [Mon Oct 24 10:15:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:16:37.651001 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-ad8cd9ad-e4a2-44ab-bf66-ab56b8095726 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:37.652017 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-ad8cd9ad-e4a2-44ab-bf66-ab56b8095726 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 24 10:16:37.652420 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 31/63] 10.222.0.50 () {54 vars in 931 bytes} [Mon Oct 24 10:16:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:16:37.662952 n-d-858383-15 devstack@n-api.service[104547]: DEBUG dbcounter [-] [104547] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:16:38.044454 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-3a8dc918-b952-4925-8518-513b4aed3af5 admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:38.064859 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-3a8dc918-b952-4925-8518-513b4aed3af5 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406410 Oct 24 10:16:38.065405 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 33/64] 10.222.0.50 () {60 vars in 1292 bytes} [Mon Oct 24 10:16:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:16:38.086456 n-d-858383-15 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writing DB stats nova_api:SELECT=14 {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:16:38.090830 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-98b339b3-5cb3-41e6-9368-4c2c4cb3752c admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:38.098441 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-98b339b3-5cb3-41e6-9368-4c2c4cb3752c admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013414 Oct 24 10:16:38.098962 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 32/65] 10.222.0.50 () {60 vars in 1283 bytes} [Mon Oct 24 10:16:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:38.112114 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-a0d845f4-b2a4-4d75-ae20-cb9748fb10c0 admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:38.119379 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-a0d845f4-b2a4-4d75-ae20-cb9748fb10c0 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011072 Oct 24 10:16:38.123408 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 34/66] 10.222.0.50 () {60 vars in 1286 bytes} [Mon Oct 24 10:16:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:16:38.131902 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-590c073b-13ed-496e-b71c-45ff6ff0c453 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:38.139254 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-590c073b-13ed-496e-b71c-45ff6ff0c453 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011144 Oct 24 10:16:38.139714 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 33/67] 10.222.0.50 () {60 vars in 1286 bytes} [Mon Oct 24 10:16:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:16:38.151105 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-2e129d21-3418-4d70-9a44-8eb45b29dda9 admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:16:38.159012 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-2e129d21-3418-4d70-9a44-8eb45b29dda9 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011478 Oct 24 10:16:38.159533 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 35/68] 10.222.0.50 () {60 vars in 1283 bytes} [Mon Oct 24 10:16:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:22:23.405153 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-590c073b-13ed-496e-b71c-45ff6ff0c453 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:22:23.406165 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-590c073b-13ed-496e-b71c-45ff6ff0c453 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Oct 24 10:22:23.406561 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 34/69] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Oct 24 10:22:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:22:23.547397 n-d-858383-15 devstack@n-api.service[104547]: DEBUG dbcounter [-] [104547] Writing DB stats nova_api:SELECT=6 {{(pid=104547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:22:23.687955 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-ea9f5f22-c873-4f2d-a241-973eaf794c10 admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:22:23.693527 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_concurrency.lockutils [None req-ea9f5f22-c873-4f2d-a241-973eaf794c10 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:22:23.694008 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_concurrency.lockutils [None req-ea9f5f22-c873-4f2d-a241-973eaf794c10 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:22:23.694441 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_concurrency.lockutils [None req-ea9f5f22-c873-4f2d-a241-973eaf794c10 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:22:23.695159 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_concurrency.lockutils [None req-ea9f5f22-c873-4f2d-a241-973eaf794c10 admin admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:22:23.695612 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_concurrency.lockutils [None req-ea9f5f22-c873-4f2d-a241-973eaf794c10 admin admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:22:23.696030 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_concurrency.lockutils [None req-ea9f5f22-c873-4f2d-a241-973eaf794c10 admin admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:22:23.738088 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-ea9f5f22-c873-4f2d-a241-973eaf794c10 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.191792 Oct 24 10:22:23.738670 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 36/70] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Oct 24 10:22:23 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:22:24.797586 n-d-858383-15 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-590c073b-13ed-496e-b71c-45ff6ff0c453 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:22:24.798588 n-d-858383-15 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-590c073b-13ed-496e-b71c-45ff6ff0c453 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 24 10:22:24.798986 n-d-858383-15 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 35/71] 10.222.0.50 () {56 vars in 1074 bytes} [Mon Oct 24 10:22:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:22:24.991131 n-d-858383-15 devstack@n-api.service[104547]: DEBUG nova.api.openstack.wsgi [None req-20622096-7264-4478-9ebc-28e2238a4d58 admin admin] Calling method '>' {{(pid=104547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:22:24.994579 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_concurrency.lockutils [None req-20622096-7264-4478-9ebc-28e2238a4d58 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:22:24.995081 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_concurrency.lockutils [None req-20622096-7264-4478-9ebc-28e2238a4d58 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:22:24.995509 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_concurrency.lockutils [None req-20622096-7264-4478-9ebc-28e2238a4d58 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:22:24.996216 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_concurrency.lockutils [None req-20622096-7264-4478-9ebc-28e2238a4d58 admin admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:22:24.996660 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_concurrency.lockutils [None req-20622096-7264-4478-9ebc-28e2238a4d58 admin admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:22:24.997104 n-d-858383-15 devstack@n-api.service[104547]: DEBUG oslo_concurrency.lockutils [None req-20622096-7264-4478-9ebc-28e2238a4d58 admin admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:22:25.020641 n-d-858383-15 devstack@n-api.service[104547]: INFO nova.api.openstack.requestlog [None req-20622096-7264-4478-9ebc-28e2238a4d58 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.081039 Oct 24 10:22:25.021283 n-d-858383-15 devstack@n-api.service[104547]: [pid: 104547|app: 0|req: 37/72] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Oct 24 10:22:24 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:23:12.503670 n-d-858383-15 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 24 10:23:12.504295 n-d-858383-15 devstack@n-api.service[104546]: Mon Oct 24 10:23:12 2022 - graceful shutdown triggered... Oct 24 10:23:12.504741 n-d-858383-15 devstack@n-api.service[104548]: Gracefully killing worker 2 (pid: 104548)... Oct 24 10:23:12.505804 n-d-858383-15 devstack@n-api.service[104547]: Gracefully killing worker 1 (pid: 104547)... Oct 24 10:23:12.634402 n-d-858383-15 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writing DB stats nova_api:SELECT=4 {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:23:13.517992 n-d-858383-15 devstack@n-api.service[104546]: worker 1 buried after 1 seconds Oct 24 10:23:13.517992 n-d-858383-15 devstack@n-api.service[104546]: worker 2 buried after 1 seconds Oct 24 10:23:13.517992 n-d-858383-15 devstack@n-api.service[104546]: goodbye to uWSGI. Oct 24 10:23:13.519595 n-d-858383-15 systemd[1]: devstack@n-api.service: Succeeded. Oct 24 10:23:13.520177 n-d-858383-15 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 24 10:23:13.523739 n-d-858383-15 systemd[1]: Starting Devstack devstack@n-api.service... Oct 24 10:23:13.544713 n-d-858383-15 devstack@n-api.service[120415]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 24 10:23:13.572786 n-d-858383-15 devstack@n-api.service[120415]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 24 10:23:13 2022] *** Oct 24 10:23:13.572786 n-d-858383-15 devstack@n-api.service[120415]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 24 10:23:13.572786 n-d-858383-15 devstack@n-api.service[120415]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 24 10:23:13.572786 n-d-858383-15 devstack@n-api.service[120415]: nodename: n-d-858383-15 Oct 24 10:23:13.572786 n-d-858383-15 devstack@n-api.service[120415]: machine: x86_64 Oct 24 10:23:13.572786 n-d-858383-15 devstack@n-api.service[120415]: clock source: unix Oct 24 10:23:13.572786 n-d-858383-15 devstack@n-api.service[120415]: pcre jit disabled Oct 24 10:23:13.572786 n-d-858383-15 devstack@n-api.service[120415]: detected number of CPU cores: 4 Oct 24 10:23:13.572786 n-d-858383-15 devstack@n-api.service[120415]: current working directory: / Oct 24 10:23:13.572786 n-d-858383-15 devstack@n-api.service[120415]: detected binary path: /usr/bin/uwsgi-core Oct 24 10:23:13.572786 n-d-858383-15 devstack@n-api.service[120415]: your processes number limit is 47680 Oct 24 10:23:13.572786 n-d-858383-15 devstack@n-api.service[120415]: your memory page size is 4096 bytes Oct 24 10:23:13.572786 n-d-858383-15 devstack@n-api.service[120415]: detected max file descriptor number: 2048 Oct 24 10:23:13.572786 n-d-858383-15 devstack@n-api.service[120415]: lock engine: pthread robust mutexes Oct 24 10:23:13.573839 n-d-858383-15 devstack@n-api.service[120415]: thunder lock: enabled Oct 24 10:23:13.573839 n-d-858383-15 devstack@n-api.service[120415]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 24 10:23:13.573839 n-d-858383-15 devstack@n-api.service[120415]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 24 10:23:13.613842 n-d-858383-15 devstack@n-api.service[120415]: Python main interpreter initialized at 0x55970de739c0 Oct 24 10:23:13.613842 n-d-858383-15 devstack@n-api.service[120415]: python threads support enabled Oct 24 10:23:13.613842 n-d-858383-15 devstack@n-api.service[120415]: your server socket listen backlog is limited to 100 connections Oct 24 10:23:13.613842 n-d-858383-15 devstack@n-api.service[120415]: your mercy for graceful operations on workers is 90 seconds Oct 24 10:23:13.614767 n-d-858383-15 devstack@n-api.service[120415]: mapped 403077 bytes (393 KB) for 2 cores Oct 24 10:23:13.614767 n-d-858383-15 devstack@n-api.service[120415]: *** Operational MODE: preforking *** Oct 24 10:23:13.615133 n-d-858383-15 devstack@n-api.service[120415]: *** uWSGI is running in multiple interpreter mode *** Oct 24 10:23:13.615133 n-d-858383-15 devstack@n-api.service[120415]: spawned uWSGI master process (pid: 120415) Oct 24 10:23:13.615354 n-d-858383-15 systemd[1]: Started Devstack devstack@n-api.service. Oct 24 10:23:13.616002 n-d-858383-15 devstack@n-api.service[120415]: spawned uWSGI worker 1 (pid: 120425, cores: 1) Oct 24 10:23:13.616524 n-d-858383-15 devstack@n-api.service[120415]: spawned uWSGI worker 2 (pid: 120426, cores: 1) Oct 24 10:23:13.616792 n-d-858383-15 devstack@n-api.service[120415]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 24 10:23:14.283757 n-d-858383-15 devstack@n-api.service[120425]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 10:23:14.285440 n-d-858383-15 devstack@n-api.service[120426]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 10:23:15.533380 n-d-858383-15 devstack@n-api.service[120425]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 10:23:15.533380 n-d-858383-15 devstack@n-api.service[120425]: from cryptography.utils import int_from_bytes Oct 24 10:23:15.534030 n-d-858383-15 devstack@n-api.service[120425]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 10:23:15.534030 n-d-858383-15 devstack@n-api.service[120425]: from cryptography.utils import int_from_bytes Oct 24 10:23:15.534392 n-d-858383-15 devstack@n-api.service[120426]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 10:23:15.534392 n-d-858383-15 devstack@n-api.service[120426]: from cryptography.utils import int_from_bytes Oct 24 10:23:15.534836 n-d-858383-15 devstack@n-api.service[120426]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 10:23:15.534836 n-d-858383-15 devstack@n-api.service[120426]: from cryptography.utils import int_from_bytes Oct 24 10:23:18.003926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 10:23:18.004502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 10:23:18.004763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 10:23:18.005618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 10:23:18.005875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 10:23:18.006265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.006590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.006914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.007235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.007571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.007880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.008202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.008521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.008860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.009145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.009462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.009788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-15 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.010021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 10:23:18.010454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.010554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 10:23:18.010643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.010739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.010842 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 10:23:18.011008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.011152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 10:23:18.011310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.011404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 10:23:18.011632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.011783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.011937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.012110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.012436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.012569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.012757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.012937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.013111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.013212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.013423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.013527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.013744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.013845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.014059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.014179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.014385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.014620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.014823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.015045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.015232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.015413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.015615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-15 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.015799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.016008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.016204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.016400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.016593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-15 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.016787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.017002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.017203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.017402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.017586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.017777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.017978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.018178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.018384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.018578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.018578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.018876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.019055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.019229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.019369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.019507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.019676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.019808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.019951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.020082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.020219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.020375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.021129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.021370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.021598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.021860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.022009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.022149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.022289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.022289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.022577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.022720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.022993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.023146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.023296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-15 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.023436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.023436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.023707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.023837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.023979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.024119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.024258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.024454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.024595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.024770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.025025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.025168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.025309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.025439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.025577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.025715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.025856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.025997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.026139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.026269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.026405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.026543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.026688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.026826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.026964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.027101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.027241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.027386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.027521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.027650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.027788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.027918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.028059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.028198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.028329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.028458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.028594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.028733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.028903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.029054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.029186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.029325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.029455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.029583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.029720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.029860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.029998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.030127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.030264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.030402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.030544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.030676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.030806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.030944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.031082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.031219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.031358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.031489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.031626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.031756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.031885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.032027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.032203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.032335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.032463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.032591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.032720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.032889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.033112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.033260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.033392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.033521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.033650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.033792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.033923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.034061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.034190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.034327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.034464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.034602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.034741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.034870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.035007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.035137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.035273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.035412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.035543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.035679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.035818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.035948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.036109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.036255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.036457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.036654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.036900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.037073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.037223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.037355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.037496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.037627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.037765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.037904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.038045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.038175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.038305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.038434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.038571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.038708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.038854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.038992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.039124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.039254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.039395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.039535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.039676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.039813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.039951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.040090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.040228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.040368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.040536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.040671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.040941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.041076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.041213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.041344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.041473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.041601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.041741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.041872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.042033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.042176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.042339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.042473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.042653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.042795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.042959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.043228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.043377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.043521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.043662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.043803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.043941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.044077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.044207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.044337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.044457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.044576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.044736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.044908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.045082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.045229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.045390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.045525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.045698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.045839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.045987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.046124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.046289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.046431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.046594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.046736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.046877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.047008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.047188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.047328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.047506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.047640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.047810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.047949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.048113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.048245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.048419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.048553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.048722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.048890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.049054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.049210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.049371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.049512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.049670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.049813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.049974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.050117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.050290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.050430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.050595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.050730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.050939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.051082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.051245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.051379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.051549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.051681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.052397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.052621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.052860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.053013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.053145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.053274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.053420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.053552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.053718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.053852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.054037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.054177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.054357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.054497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.054666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.054799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.054974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.055107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.055280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.055415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.055588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.055728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 10:23:18.055908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.056057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.056234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.056375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.056555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.056688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.056986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.057148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.057295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.057441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.057580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.057718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.057882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.058024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.058198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.058336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.058514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.058648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.058839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.058973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.059154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.059289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.059469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.059603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.059782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.059916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.060103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.060239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.060422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.060562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.060745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.060917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.061085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.061224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.061405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.061537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.061719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.061866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.062029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.062167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.062343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.062474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.062655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.062803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.062971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.063105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.063773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.063923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.064065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.064209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.064209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.064458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.064587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.064725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.064899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.065047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.065188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.065326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.065465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.065596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.065739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.065878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.066009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.066145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.066276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.066406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.066546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.066678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.066815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.066946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.067078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.067214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.068032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.068249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.068470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.068694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.068694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.068985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.069137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.069270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.069401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.069537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.069670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.069814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.069954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.070084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.070214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.070343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.070479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.070618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.070752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.070880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.071009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.071273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.071408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.071657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.071803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.071988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.072114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.072300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.072419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.072617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.072746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.072962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.073082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.073270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.073405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.073634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.073771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.073886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.074005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.074176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.074305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.074496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.074616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.074828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.074956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.075136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.075264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.075448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.075574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.075763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.075889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.076076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.076204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.076473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.077569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.077569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.077876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.078005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.078141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.078271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.078410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.078410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.078666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.078805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.078944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.079081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.079220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.079358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.079495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.079636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.079771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.079901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.080030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.080162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.080293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.080432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.080563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.080700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.080846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.080978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.081122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.081254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.081391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.081522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.081660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.081799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.081943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.082083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.082214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.082345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.082485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.082616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.082759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.082890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.083042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.083223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.083452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.083710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.083867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.084007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.084147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.084279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.084410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.084554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.084686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.084816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.084995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.085125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.085268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.085417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.085556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.085696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.085838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.085969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.086107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.086248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.086388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.086520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.086650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.086789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.086929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.087071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.087202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.087346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.087480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.087609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.087753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.087884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.088023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.088162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.088322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.088466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.088648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.088792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.089011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.089154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.089286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.089424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.089590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.089734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.089929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.090100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.090329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.090463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.090652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.090789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.090977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.091110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.091293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.091437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.091607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.091742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.091918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.092057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.092227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.092369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.092538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.092683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.092907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.093045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.093190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.093337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.093476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.093613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.093794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.093939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.094103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.094255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.094417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.094558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.094726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.094868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.095047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.095196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.095354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.095496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.095660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.095792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.095978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.096122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.096311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.096446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.096626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.096769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.097004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.097139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.097267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.097405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.097577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.097731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.097873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.098012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.098187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.098321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.098495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.098692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.098899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.099114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.099328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.099486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.099629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.099752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.099929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.100057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.100246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.100367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.100560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.100693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.100887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.101012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.101270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.101399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.101526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.101655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.101807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.101936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.102114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.102235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.102425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.102555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.102748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.102875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.103253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.103396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.103537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.103684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.103816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.103987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.104133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.104290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.104434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.104614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.104746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.104947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.105086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.105260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.105388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.105576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.105695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.105895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.106014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.106209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.106342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.106532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.106669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.106830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.106964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.107148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.107295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.107459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.107605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.107759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.107902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.108043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.108175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.108356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.108492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.108677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.108813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.109011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.109257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.109378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.109610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.109752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.109928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.110077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.110216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.110353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.110544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.110678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.110857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.111000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.111164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.111326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.111467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.111599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.111764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.111907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.112109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.112251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.112418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.112559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.112723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.112883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.113385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.113523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.113636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.113749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.114059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.114825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.115045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.115236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.115593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.115753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.115982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.116116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.116314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.116449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.116638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.116776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.116982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.117104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.117305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.117435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.117621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.117743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.117936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.118056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.118250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.118397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.118559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.118858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.118995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.119174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.119302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.119483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.119612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.119794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.119914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.120099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.120232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.120410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.120549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.120718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.120923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.121121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.121320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.121449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.121660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.121796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.121985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.122168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.122311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.122451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.122618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.122760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.122925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.123071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.123249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.123377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.123592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.123724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.123838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.123956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.124144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.124265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.124449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.124599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.124791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.125056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.125193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.125324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.125467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.125599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.125737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.125866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.126018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.126160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.126311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.126450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.126626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.126767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.126933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.127066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.127240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.127382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.127586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.127811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.127951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.128161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.128294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.128424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.128562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.128721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.128877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.129060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.129195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.129369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.129519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.129694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.129856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.130594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.130794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.131010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.131811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.131949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.132100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.132241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.132381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.132514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.132654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.132787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.133000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.133142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.133274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.133274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.133530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.133692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.133825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.133955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.134093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.134224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.134362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.134503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.134638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.134770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.134907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.135065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.135205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.135351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.135484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.135614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.135745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.135874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.136088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.136229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.136360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.136490 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.136620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.136749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.136907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.137041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.137171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.137300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.137430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.137567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.137709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.137842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.137980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.138118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.138257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.138395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.138540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.138679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.138679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.138943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.139073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.139213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.139357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.139498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.139628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.139758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.139896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.140038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.140169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.140322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.140457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.140634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.140770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.140972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.141106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.141267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.141402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.141640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.141793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.141941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.142083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.142214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.142354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.142492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.142630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.142776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.142908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.143045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.143193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.143413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.143558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.143691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.143821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.143959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.144163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.144286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.144514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.144869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.145318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.145487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.145636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.145831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.146050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.146220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.146337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.146458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.146578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.146698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.146845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.146967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.147194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.147335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.147448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.147575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.147761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.147895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.148074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.148201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.148391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.148525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.148698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.148818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.149047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.149167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.149349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.149483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.149652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.149772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.149956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.150085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.150259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.150393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.150581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.150702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.150901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.151054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.151198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.151338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.151485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.151618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.151832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.151966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.152192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.152408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.152551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.152689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.152817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.152988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.153128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.153258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.153413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.153548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.153732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.153881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.154045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.154213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.154368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.154540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.154676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.154852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.154987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.155173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.155315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.155485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.155634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.155775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.155914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.156161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.156296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.156466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.156609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.156809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.156960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.157148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.157306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.157507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.157653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.157795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.157927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.158111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.158289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.158467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.158753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.159012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.159155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.159332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.159467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.159682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.159934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.160076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.160245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.160390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.160592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.160752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.160907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.161042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.161258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.161456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.161651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.161915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.162107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.162235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.162376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.162504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.162621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.162808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.162946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.163125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.163247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.163471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.163617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.163805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.163940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.164121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.164270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.164438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.164634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.164770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.165019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.165177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.165375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.165516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.165680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.165816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.166032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.166343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.166484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.166669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.166818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.166996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.167129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.167310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.167448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.167676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.167818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.167950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.168088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.168221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.168390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.168705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.168897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.169071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.169218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.169396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.169631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.169780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.169949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.170091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.170268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.170410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.170582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.170726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.170891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.171026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.171198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.171338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.171509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.171653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.171834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.171970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.172137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.172280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.172426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.172557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.172733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.172921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.173067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.173213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.173383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.173519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.173706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.173840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.174112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.174254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.174424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.174569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.174728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.174861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.175066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.175208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.175373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.175516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.175679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.175822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.175991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.176135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.176297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.176432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.176626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.177363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.177566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.177789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.178025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.178202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.178335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.178483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.178625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.178763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.178895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.179025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.179155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.179295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.179436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.179576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.179708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.179849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.179988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.180139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.180280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.180420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.180551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.180689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.180822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.181040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.181184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.181433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.181574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.181756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.181902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.182070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.182205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.182377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.182520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.182684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.182838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.182986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.183119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.183293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.183435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.183607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.183752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.183921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.184056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.184232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.184366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.184557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.184702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.184885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.185036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.185201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.185336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.185517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.185653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.185828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.185962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.186138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.186273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.186447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.186582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.186769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.186909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.187073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.187214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.187378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.187511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.187688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.187822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.188031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.188175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.188351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.188488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.188660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.188789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.189077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.189416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.189724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.189856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.190029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.190150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.190354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.190558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.190674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.190786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.190971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.191100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.191282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.191413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.191589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.191718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.191894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.192023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.192198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.192339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.193169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.193369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.193677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.194018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.194369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.194626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.194760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.194971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.195091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.195293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.195425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.195621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.195751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.195928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.196063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.196235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.196381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.196549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.196686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.196927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.197060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.197256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.197379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.197581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.197711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.197891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.198027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.198304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.198422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.198551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.198691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.198830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.198960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.199100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.199239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.199397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.199721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.199862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.200032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.200176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.200336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.200470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.200643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.200786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.200974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.201118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.201318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.201452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.201624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.201767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.201951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.202094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.202263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.202405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.202585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.202718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.202901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.203044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.203216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.203357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.203533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.203666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.203853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.203996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.204169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.204304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.204485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.204634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.204801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.204970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.205126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.205265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.205439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.205585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.205757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.205891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.206136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.206292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.206435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.206631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.206774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.206961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.207104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.207277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.207423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.207644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.207786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.207927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.208160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.208356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.208524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.208666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.208907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.209052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.209211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.209373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.209534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.209695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.209830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.210014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.210157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.210346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.210489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.210683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.210825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.211008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.211143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.211332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.211467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.211651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.211792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.211971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.212115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.212292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.212494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.212627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.212811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.212996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.213196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.213334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.213523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.213658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.213850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.213993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.214170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.214314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.214487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.214627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.214802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.214947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.215108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.215250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.215414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.215550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.215725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.215868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.216035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.216191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.216398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.216534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.216665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.216804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.216958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.217089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.217284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.217430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.217602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.217745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.217914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.218048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.218232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.218447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.218599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.218838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.218981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.219230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.219409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.219550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.219905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.220026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.220228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.220356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.220541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.220924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.221238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.221401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.221558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.221732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.221975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.222242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.222448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.222632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.222815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.222997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.223179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.223375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.223588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.223854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.224103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.224314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.224534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.224760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.225004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.225004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.225418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.225620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.225832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.226075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.226288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.226288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.226852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.227091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.227091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.227091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.227745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.227745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.228166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.228378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.228530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.228670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.228670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.228974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.229115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.229254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.229433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.229748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.229960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.230097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.230366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.230507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.230654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.230962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.231097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.231283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.231483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.231632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.231907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.232040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.232221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.232448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.232583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.232893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.233045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.233218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.233437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.233783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.233926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.234123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.234444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.234578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.234785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.234950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.235122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.235398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.235534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.235729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.235910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.236045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.236353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.236489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.236717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.237069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.237390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.237546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.237690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.237943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.238339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.238524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.238793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.238927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.239137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.239836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.240026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.240266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.240497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.240737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.241014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.241238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.241238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.241658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.241859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.242006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.242204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.242445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.242580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.242834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.242966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.243153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.243372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.243648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.243806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.243938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.244070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.244348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.244483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.244660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.244858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.245019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.245309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.245452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.245655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.245810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.245967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.246252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.246396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.246754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.246967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.247260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.247407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.247626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.247799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.247937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.248244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.248378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.248559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.248894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.249035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.249208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.249415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.249557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.249858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.250002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.250186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.250372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.250505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.250805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.250939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.251111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.251336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.251477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.251711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.251852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.252032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.252300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.252434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.252633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.252806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.252968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.253273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.253416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.253578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.253770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.253916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.254226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.254379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.254511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.254782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.255484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.255688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.255916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.256215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.256366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.256509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.256921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.257072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.257354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.257507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.257717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.257858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.258020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.258316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.258463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.258604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.258909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.259054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.259241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.259437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.259585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.259876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.260012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.260199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.260428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.260573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.260820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.260993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.261168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.261399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.261541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.261798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.261941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.262118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.262347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.262489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.262751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.262898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.263063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.263272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.263406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.263677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.263809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.263990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.264192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.264334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.264598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.264739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.264953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.265194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.265329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.265643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.265784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.265988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.266170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.266305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.266616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.266750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.266932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.267257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.267615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.267615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.267961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.268094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.268233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.268465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.268612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.268776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.269104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.269239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.269433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.269628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.269765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.270044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.270186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.270362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.270594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.270801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.271054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.271288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.271469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.271697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.271851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.272146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.272282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.272494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.272674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.272861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.273142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.273288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.273515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.273656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.273845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.274091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.274238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.274460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.274627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.274762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.274994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 10:23:18.275129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.275610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.276003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.276403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.276865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.277392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.277992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.278365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.278763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.279213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.279607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.280019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.280440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.280875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.281281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.281667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.282052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.282440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.282830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.283228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.283619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.284016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.284400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.284805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.285209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.285593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.285978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.286508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.286936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.287533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.288103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.288428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.288817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.289302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.289765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.294603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.294603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.294603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.294603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.294603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.294603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.294603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.294603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.295701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.295701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.295701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.295701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.295701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.295701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.295701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.296581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.296581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.297014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.297523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.298158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.298547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.298941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.299333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.299997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.300109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.300481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.300885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.301294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.301691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.302848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.303279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.303671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.304086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.304941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.304941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.305148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.305761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.306325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.306733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.307168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.308200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.308684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.309144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.309686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.310338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.310480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.310964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.311259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.311758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.312093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.312541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.312979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.313370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.313823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.314147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 10:23:18.314462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 10:23:18.340577 n-d-858383-15 devstack@n-api.service[120425]: INFO dbcounter [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] Registered counter for database nova_api Oct 24 10:23:18.361732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_db.sqlalchemy.engines [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 10:23:18.369919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writer thread running {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 10:23:18.381465 n-d-858383-15 devstack@n-api.service[120426]: INFO dbcounter [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] Registered counter for database nova_api Oct 24 10:23:18.401741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_db.sqlalchemy.engines [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 10:23:18.408649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writer thread running {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 10:23:18.428105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.context [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),75e76125-592d-4292-bea1-3b51451d7165(cell1) {{(pid=120425) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 10:23:18.432625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:18.433128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:18.434771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:18.435483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:18.435921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:18.437990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:18.440016 n-d-858383-15 devstack@n-api.service[120425]: INFO dbcounter [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] Registered counter for database nova_cell0 Oct 24 10:23:18.444864 n-d-858383-15 devstack@n-api.service[120425]: INFO dbcounter [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] Registered counter for database nova_cell1 Oct 24 10:23:18.453840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_db.sqlalchemy.engines [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 10:23:18.455678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_db.sqlalchemy.engines [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 10:23:18.461799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writer thread running {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 10:23:18.468456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.context [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),75e76125-592d-4292-bea1-3b51451d7165(cell1) {{(pid=120426) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 10:23:18.472531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:18.473050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:18.475589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:18.476324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:23:18.476780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:23:18.478837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:23:18.480891 n-d-858383-15 devstack@n-api.service[120426]: INFO dbcounter [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] Registered counter for database nova_cell0 Oct 24 10:23:18.485127 n-d-858383-15 devstack@n-api.service[120426]: INFO dbcounter [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] Registered counter for database nova_cell1 Oct 24 10:23:18.493867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_db.sqlalchemy.engines [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 10:23:18.495065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_db.sqlalchemy.engines [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 10:23:18.501061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writer thread running {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 10:23:18.507286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writer thread running {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 10:23:18.608595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writer thread running {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 10:23:18.618802 n-d-858383-15 devstack@n-api.service[120425]: INFO dbcounter [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] Registered counter for database nova_cell0 Oct 24 10:23:18.625726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_db.sqlalchemy.engines [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 10:23:18.631007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writer thread running {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 10:23:18.656026 n-d-858383-15 devstack@n-api.service[120426]: INFO dbcounter [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] Registered counter for database nova_cell0 Oct 24 10:23:18.665004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_db.sqlalchemy.engines [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 10:23:18.669871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writer thread running {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 10:23:18.963575 n-d-858383-15 devstack@n-api.service[120425]: WARNING keystonemiddleware.auth_token [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 10:23:18.970941 n-d-858383-15 devstack@n-api.service[120425]: WARNING keystonemiddleware.auth_token [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 10:23:18.999253 n-d-858383-15 devstack@n-api.service[120426]: WARNING keystonemiddleware.auth_token [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 10:23:19.007371 n-d-858383-15 devstack@n-api.service[120426]: WARNING keystonemiddleware.auth_token [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 10:23:19.335243 n-d-858383-15 devstack@n-api.service[120425]: WARNING keystonemiddleware.auth_token [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 10:23:19.341340 n-d-858383-15 devstack@n-api.service[120425]: WARNING keystonemiddleware.auth_token [None req-a29e3b1e-f992-43e6-9c7d-7477564e1d62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 10:23:19.346688 n-d-858383-15 devstack@n-api.service[120425]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55970de739c0 pid: 120425 (default app) Oct 24 10:23:19.358030 n-d-858383-15 devstack@n-api.service[120426]: WARNING keystonemiddleware.auth_token [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 10:23:19.364980 n-d-858383-15 devstack@n-api.service[120426]: WARNING keystonemiddleware.auth_token [None req-ebf335aa-ed21-47dd-a7aa-7fdebc2c6717 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 10:23:19.370444 n-d-858383-15 devstack@n-api.service[120426]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55970de739c0 pid: 120426 (default app) Oct 24 10:23:58.982267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:23:58.983623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:23:58.984523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:23:58.985452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:00.174605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:00.176398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:00.178300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:00.179431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:00.256895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d9dfd3d2-09ed-4568-9447-022718d589ec tempest-InstanceUsageAuditLogTestJSON-225723885 tempest-InstanceUsageAuditLogTestJSON-225723885-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:00.282486 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d9dfd3d2-09ed-4568-9447-022718d589ec tempest-InstanceUsageAuditLogTestJSON-225723885 tempest-InstanceUsageAuditLogTestJSON-225723885-project-admin] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-24 10:23:58" status: 200 len: 318 microversion: 2.1 time: 1.306884 Oct 24 10:24:00.283068 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1/1] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Oct 24 10:23:58 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-24%2010%3A23%3A58 => generated 318 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:00.299890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2c287e1b-9740-4817-8db4-ebb10baa9655 tempest-InstanceUsageAuditLogTestJSON-225723885 tempest-InstanceUsageAuditLogTestJSON-225723885-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:00.312263 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2c287e1b-9740-4817-8db4-ebb10baa9655 tempest-InstanceUsageAuditLogTestJSON-225723885 tempest-InstanceUsageAuditLogTestJSON-225723885-project-admin] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.016629 Oct 24 10:24:00.313394 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2/2] 10.222.0.50 () {58 vars in 1185 bytes} [Mon Oct 24 10:24:00 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:00.833835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a1355a91-f8a9-48b7-af04-44ea6aa146f0 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Calling method '.version_select at 0x7f04d26f2c10>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:00.844313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a1355a91-f8a9-48b7-af04-44ea6aa146f0 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),75e76125-592d-4292-bea1-3b51451d7165(cell1) {{(pid=120425) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 24 10:24:00.845583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1355a91-f8a9-48b7-af04-44ea6aa146f0 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:00.846249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1355a91-f8a9-48b7-af04-44ea6aa146f0 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:00.846806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1355a91-f8a9-48b7-af04-44ea6aa146f0 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:00.874237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1355a91-f8a9-48b7-af04-44ea6aa146f0 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:00.874793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1355a91-f8a9-48b7-af04-44ea6aa146f0 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:00.875289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1355a91-f8a9-48b7-af04-44ea6aa146f0 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:00.889445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1355a91-f8a9-48b7-af04-44ea6aa146f0 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:00.889929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1355a91-f8a9-48b7-af04-44ea6aa146f0 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:00.890361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1355a91-f8a9-48b7-af04-44ea6aa146f0 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:00.897345 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a1355a91-f8a9-48b7-af04-44ea6aa146f0 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.497704 Oct 24 10:24:00.897934 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3/3] 10.222.0.50 () {60 vars in 1208 bytes} [Mon Oct 24 10:24:00 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:24:01.061363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0cae7573-4e78-48d6-bb37-ccae778ddc1f tempest-FlavorMetadataValidation-841327403 tempest-FlavorMetadataValidation-841327403-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-945824783", "id": 269744951, "os-flavor-access:is_public": "True"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:01.142029 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0cae7573-4e78-48d6-bb37-ccae778ddc1f tempest-FlavorMetadataValidation-841327403 tempest-FlavorMetadataValidation-841327403-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.242541 Oct 24 10:24:01.142963 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 4/4] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Oct 24 10:24:00 2022] POST /compute/v2.1/flavors => generated 467 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:24:01.286388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c57b63d0-2055-43bb-bf6b-cd7e10477690 tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1648881481", "ram": 512, "vcpus": 1, "disk": 10, "id": 81172725, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:01.343511 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c57b63d0-2055-43bb-bf6b-cd7e10477690 tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 1.182191 Oct 24 10:24:01.344174 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1/5] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:24:00 2022] POST /compute/v2.1/flavors => generated 410 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:24:01.345343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c57b63d0-2055-43bb-bf6b-cd7e10477690 tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:01.346348 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c57b63d0-2055-43bb-bf6b-cd7e10477690 tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001272 Oct 24 10:24:01.356272 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2/6] 10.222.0.50 () {56 vars in 886 bytes} [Mon Oct 24 10:24:01 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 24 10:24:01.417282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa382b85-6520-4dd0-8160-d890c540d516 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '.version_select at 0x7f04d25709d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:01.419649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa382b85-6520-4dd0-8160-d890c540d516 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:01.420726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa382b85-6520-4dd0-8160-d890c540d516 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:01.421338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa382b85-6520-4dd0-8160-d890c540d516 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:01.446413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa382b85-6520-4dd0-8160-d890c540d516 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:01.447144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa382b85-6520-4dd0-8160-d890c540d516 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:01.447857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa382b85-6520-4dd0-8160-d890c540d516 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:01.466001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa382b85-6520-4dd0-8160-d890c540d516 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:01.466500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa382b85-6520-4dd0-8160-d890c540d516 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:01.466945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa382b85-6520-4dd0-8160-d890c540d516 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:01.476934 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa382b85-6520-4dd0-8160-d890c540d516 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.330310 Oct 24 10:24:01.489625 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 5/7] 10.222.0.50 () {58 vars in 1167 bytes} [Mon Oct 24 10:24:01 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:01.496587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c2ed15b6-a29b-48ea-934a-4903f9c8b1ab tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1208051109"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:01.501222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.aggregate [None req-c2ed15b6-a29b-48ea-934a-4903f9c8b1ab tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Generated uuid bcb2e2c0-689a-4d24-9303-f22a797b153b for aggregate {{(pid=120425) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:01.543921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-73f17bc5-6fdf-4a97-8508-816929a487e8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:01.548735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73f17bc5-6fdf-4a97-8508-816929a487e8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:01.549450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73f17bc5-6fdf-4a97-8508-816929a487e8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:01.550091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73f17bc5-6fdf-4a97-8508-816929a487e8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:01.551255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73f17bc5-6fdf-4a97-8508-816929a487e8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:01.553714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73f17bc5-6fdf-4a97-8508-816929a487e8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:01.554652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73f17bc5-6fdf-4a97-8508-816929a487e8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:01.607630 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c2ed15b6-a29b-48ea-934a-4903f9c8b1ab tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.116163 Oct 24 10:24:01.608784 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 6/8] 10.222.0.50 () {62 vars in 1205 bytes} [Mon Oct 24 10:24:01 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:24:01.619764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f3d3c6c1-c0dc-494a-a6e9-91647049eb1d tempest-FlavorMetadataValidation-841327403 tempest-FlavorMetadataValidation-841327403-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:01.636574 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-73f17bc5-6fdf-4a97-8508-816929a487e8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.278927 Oct 24 10:24:01.644754 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3/9] 10.222.0.50 () {58 vars in 1176 bytes} [Mon Oct 24 10:24:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:01.660960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-124cb68e-b813-4fd6-a22b-a8e4f3446b2d tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:01.726811 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-124cb68e-b813-4fd6-a22b-a8e4f3446b2d tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/81172725/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.080081 Oct 24 10:24:01.727978 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4/10] 10.222.0.50 () {60 vars in 1218 bytes} [Mon Oct 24 10:24:01 2022] POST /compute/v2.1/flavors/81172725/os-extra_specs => generated 66 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:24:01.841345 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f3d3c6c1-c0dc-494a-a6e9-91647049eb1d tempest-FlavorMetadataValidation-841327403 tempest-FlavorMetadataValidation-841327403-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/269744951/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.231224 Oct 24 10:24:01.841955 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 7/11] 10.222.0.50 () {62 vars in 1262 bytes} [Mon Oct 24 10:24:01 2022] POST /compute/v2.1/flavors/269744951/os-extra_specs => generated 62 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:01.847360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-812668c8-abb7-414d-8b4f-3d23fa33b9e4 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1805220867"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:01.985675 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-812668c8-abb7-414d-8b4f-3d23fa33b9e4 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.141002 Oct 24 10:24:01.987229 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 8/12] 10.222.0.50 () {62 vars in 1210 bytes} [Mon Oct 24 10:24:01 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:24:02.069236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5fed9319-53aa-482e-92ea-002507a8248a tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1040190469", "id": 657241279, "os-flavor-access:is_public": "False"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:02.098209 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5fed9319-53aa-482e-92ea-002507a8248a tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.368681 Oct 24 10:24:02.110287 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 5/13] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:24:01 2022] POST /compute/v2.1/flavors => generated 436 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:02.116913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-335943a9-0c4e-4ed8-87d4-4cc37e152382 tempest-FlavorMetadataValidation-841327403 tempest-FlavorMetadataValidation-841327403-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:02.163897 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-335943a9-0c4e-4ed8-87d4-4cc37e152382 tempest-FlavorMetadataValidation-841327403 tempest-FlavorMetadataValidation-841327403-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/269744951" status: 202 len: 0 microversion: 2.86 time: 0.052161 Oct 24 10:24:02.164904 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 6/14] 10.222.0.50 () {60 vars in 1199 bytes} [Mon Oct 24 10:24:02 2022] DELETE /compute/v2.1/flavors/269744951 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:24:02.173599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-41198ee2-3e8a-4ae4-91d1-88094ae989d0 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:02.201995 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-41198ee2-3e8a-4ae4-91d1-88094ae989d0 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.035737 Oct 24 10:24:02.203182 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 7/15] 10.222.0.50 () {60 vars in 1190 bytes} [Mon Oct 24 10:24:02 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:24:02.209009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cd6c7b8c-bc1c-4c77-b6b2-cc4df854520a tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "371f4ff5b6cd405997ae972aec88a225"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:02.332329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e370af36-889f-4e6a-955c-8915da09e133 tempest-FlavorsExtraSpecsTestJSON-692123441 tempest-FlavorsExtraSpecsTestJSON-692123441-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:02.351807 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e370af36-889f-4e6a-955c-8915da09e133 tempest-FlavorsExtraSpecsTestJSON-692123441 tempest-FlavorsExtraSpecsTestJSON-692123441-project] 10.222.0.50 "GET /compute/v2.1/flavors/81172725/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.363292 Oct 24 10:24:02.353350 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 9/16] 10.222.0.50 () {58 vars in 1197 bytes} [Mon Oct 24 10:24:01 2022] GET /compute/v2.1/flavors/81172725/os-extra_specs => generated 66 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:24:02.359898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d0422d2a-f0bc-4be2-9df1-2716732b1f5c tempest-FlavorMetadataValidation-841327403 tempest-FlavorMetadataValidation-841327403-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:02.397364 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d0422d2a-f0bc-4be2-9df1-2716732b1f5c tempest-FlavorMetadataValidation-841327403 tempest-FlavorMetadataValidation-841327403-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 6264 microversion: 2.86 time: 0.042422 Oct 24 10:24:02.398578 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 10/17] 10.222.0.50 () {60 vars in 1187 bytes} [Mon Oct 24 10:24:02 2022] GET /compute/v2.1/flavors/detail => generated 6264 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:24:02.403524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8e41388c-01e2-4fab-9aff-05fb6296be10 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-15"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:02.421656 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cd6c7b8c-bc1c-4c77-b6b2-cc4df854520a tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/657241279/action" status: 200 len: 96 microversion: 2.1 time: 0.216787 Oct 24 10:24:02.422427 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 8/18] 10.222.0.50 () {60 vars in 1197 bytes} [Mon Oct 24 10:24:02 2022] POST /compute/v2.1/flavors/657241279/action => generated 96 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:24:02.423916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e41388c-01e2-4fab-9aff-05fb6296be10 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:02.424849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e41388c-01e2-4fab-9aff-05fb6296be10 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:02.425601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e41388c-01e2-4fab-9aff-05fb6296be10 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:02.432859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c56a8cf8-d4d3-47ac-b1a5-8b91bedf53d2 tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:02.497480 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c56a8cf8-d4d3-47ac-b1a5-8b91bedf53d2 tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/81172725/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.073615 Oct 24 10:24:02.498516 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 9/19] 10.222.0.50 () {60 vars in 1218 bytes} [Mon Oct 24 10:24:02 2022] POST /compute/v2.1/flavors/81172725/os-extra_specs => generated 66 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:24:02.506473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c8468b87-bd13-4269-8894-c6da1590d529 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "371f4ff5b6cd405997ae972aec88a225"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:03.071362 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-c8468b87-bd13-4269-8894-c6da1590d529 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project 371f4ff5b6cd405997ae972aec88a225 combination. Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c8468b87-bd13-4269-8894-c6da1590d529 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Request method failure captured: Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/flavors/657241279/action HTTP/1.1 Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 67 Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfAGH4VcnpG199IkP8VMJSqSH0q2L7cwM7jSowl8HAWe1C7YUr0Xge1__Ut4vJY_war0J0pdzXCwSZq3hdm9BmVTl4QNBu5EZQBT7eVBxF8BviNZtIzMNRUfXwi75wUnBI5NFaza5FLewFgCIRHtcTrftLvVcQM1PLIDX6c-YnUlrk Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: a6f0aa0588d34154a08bfa914e3ba9d2 Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-824024383 Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:24:03.089072 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:24:03.090374 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6f0aa0588d34154a08bfa914e3ba9d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6f0aa0588d34154a08bfa914e3ba9d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a6f0aa0588d34154a08bfa914e3ba9d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a6f0aa0588d34154a08bfa914e3ba9d2", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:03.090374 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-824024383 Oct 24 10:24:03.090374 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: a6f0aa0588d34154a08bfa914e3ba9d2 Oct 24 10:24:03.090374 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-824024383 Oct 24 10:24:03.090374 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin Oct 24 10:24:03.090374 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:03.090374 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:03.090374 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 543f7171da6d4faf95797a79d2e9169a Oct 24 10:24:03.090374 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin Oct 24 10:24:03.090374 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:24:03.090374 n-d-858383-15 devstack@n-api.service[120426]: {"addTenantAccess": {"tenant": "371f4ff5b6cd405997ae972aec88a225"}} Oct 24 10:24:03.090374 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:03.091004 n-d-858383-15 devstack@n-api.service[120426]: exception: Flavor access already exists for flavor 17 and project 371f4ff5b6cd405997ae972aec88a225 combination. Oct 24 10:24:03.091004 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '657241279', 'body': {'addTenantAccess': {'tenant': '371f4ff5b6cd405997ae972aec88a225'}}} Oct 24 10:24:03.091004 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:03.091004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:03.091004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 10:24:03.091004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 24 10:24:03.091004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 10:24:03.091004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 24 10:24:03.091004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 10:24:03.091004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 24 10:24:03.091004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 10:24:03.091004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 24 10:24:03.091004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 10:24:03.091004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 10:24:03.091004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 10:24:03.091004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result.read() Oct 24 10:24:03.091004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 10:24:03.091004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-371f4ff5b6cd405997ae972aec88a225' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi session.flush() Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 10:24:03.092074 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 24 10:24:03.093229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 10:24:03.093229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 24 10:24:03.093229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 10:24:03.093229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception Oct 24 10:24:03.093229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 10:24:03.093229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 24 10:24:03.093229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 10:24:03.093229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 24 10:24:03.093229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 10:24:03.093229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 24 10:24:03.093229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 10:24:03.093229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 24 10:24:03.093229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 24 10:24:03.093229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 24 10:24:03.093229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 10:24:03.093229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 10:24:03.093229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 10:24:03.093229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 24 10:24:03.094290 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 10:24:03.094290 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 24 10:24:03.094290 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 10:24:03.094290 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 24 10:24:03.094290 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 10:24:03.094290 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 10:24:03.094290 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 10:24:03.094290 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception Oct 24 10:24:03.094290 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 10:24:03.094290 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 24 10:24:03.094290 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 10:24:03.094290 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 24 10:24:03.094290 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 10:24:03.094290 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 24 10:24:03.094290 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 10:24:03.094290 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 24 10:24:03.094290 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 10:24:03.094290 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 10:24:03.095260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 10:24:03.095260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result.read() Oct 24 10:24:03.095260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 10:24:03.095260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 24 10:24:03.095260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 10:24:03.095260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 24 10:24:03.095260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 10:24:03.095260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 24 10:24:03.095260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 10:24:03.095260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 24 10:24:03.095260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-371f4ff5b6cd405997ae972aec88a225' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 24 10:24:03.095260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 24 10:24:03.095260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 24, 10, 24, 3, 65518), 'updated_at': None, 'flavor_id': 17, 'project_id': '371f4ff5b6cd405997ae972aec88a225'}] Oct 24 10:24:03.095260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 10:24:03.095260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:03.095260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:03.095260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project 371f4ff5b6cd405997ae972aec88a225 combination. Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:03.096156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project 371f4ff5b6cd405997ae972aec88a225 combination. Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:03.097315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:03.098509 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project 371f4ff5b6cd405997ae972aec88a225 combination. Oct 24 10:24:03.098509 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:03.100960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c8468b87-bd13-4269-8894-c6da1590d529 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project 371f4ff5b6cd405997ae972aec88a225 combination. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:03.102071 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c8468b87-bd13-4269-8894-c6da1590d529 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/657241279/action" status: 409 len: 152 microversion: 2.1 time: 0.602396 Oct 24 10:24:03.106624 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 10/20] 10.222.0.50 () {60 vars in 1197 bytes} [Mon Oct 24 10:24:02 2022] POST /compute/v2.1/flavors/657241279/action => generated 152 bytes in 607 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:24:03.113401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c71f179b-265d-4204-b4be-50fcefe123d0 tempest-FlavorsExtraSpecsTestJSON-692123441 tempest-FlavorsExtraSpecsTestJSON-692123441-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:03.142535 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c71f179b-265d-4204-b4be-50fcefe123d0 tempest-FlavorsExtraSpecsTestJSON-692123441 tempest-FlavorsExtraSpecsTestJSON-692123441-project] 10.222.0.50 "GET /compute/v2.1/flavors/81172725/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.033604 Oct 24 10:24:03.143713 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 11/21] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:24:03 2022] GET /compute/v2.1/flavors/81172725/os-extra_specs/hw:numa_nodes => generated 22 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:24:03.151318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-56a22ae3-72f9-4c97-8381-1cc81706fef8 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "371f4ff5b6cd405997ae972aec88a225"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:03.364108 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8e41388c-01e2-4fab-9aff-05fb6296be10 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.41 time: 0.964129 Oct 24 10:24:03.365322 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 11/22] 10.222.0.50 () {62 vars in 1232 bytes} [Mon Oct 24 10:24:02 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:24:03.373034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b354c56-3449-481e-851a-a8bd4552b6e6 tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:03.411091 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6b354c56-3449-481e-851a-a8bd4552b6e6 tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/81172725/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044506 Oct 24 10:24:03.412610 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 12/23] 10.222.0.50 () {60 vars in 1218 bytes} [Mon Oct 24 10:24:03 2022] POST /compute/v2.1/flavors/81172725/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:24:03.420293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d18ed64e-6d20-43c6-8f61-8b58fbe7821e tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-15"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:03.435298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d18ed64e-6d20-43c6-8f61-8b58fbe7821e tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:03.436187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d18ed64e-6d20-43c6-8f61-8b58fbe7821e tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:03.436638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d18ed64e-6d20-43c6-8f61-8b58fbe7821e tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:03.575356 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d18ed64e-6d20-43c6-8f61-8b58fbe7821e tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.160710 Oct 24 10:24:03.577323 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 13/24] 10.222.0.50 () {62 vars in 1232 bytes} [Mon Oct 24 10:24:03 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:24:03.586305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f046a37e-35fc-4e36-b60a-a1b0ef905a9a tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:03.598978 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f046a37e-35fc-4e36-b60a-a1b0ef905a9a tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/81172725/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.019478 Oct 24 10:24:03.599601 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 14/25] 10.222.0.50 () {58 vars in 1197 bytes} [Mon Oct 24 10:24:03 2022] GET /compute/v2.1/flavors/81172725/os-extra_specs => generated 66 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:24:03.609223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fc99c101-df3d-4372-b43a-2bc54f9b4f65 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:03.649799 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fc99c101-df3d-4372-b43a-2bc54f9b4f65 tempest-AggregatesAdminTestV241-824973498 tempest-AggregatesAdminTestV241-824973498-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.048203 Oct 24 10:24:03.651079 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 15/26] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Oct 24 10:24:03 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:03.660180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8e1ec3d0-51c2-48b2-b23e-c17f3a0e564a tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:03.703954 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8e1ec3d0-51c2-48b2-b23e-c17f3a0e564a tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/81172725/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.051071 Oct 24 10:24:03.705136 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 16/27] 10.222.0.50 () {60 vars in 1259 bytes} [Mon Oct 24 10:24:03 2022] PUT /compute/v2.1/flavors/81172725/os-extra_specs/hw:numa_nodes => generated 22 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:24:03.718810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2c6713fd-a8da-43de-a94c-573cc70c16a8 tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:03.723881 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-56a22ae3-72f9-4c97-8381-1cc81706fef8 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/657241279/action" status: 200 len: 21 microversion: 2.1 time: 0.578711 Oct 24 10:24:03.726680 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 12/28] 10.222.0.50 () {60 vars in 1197 bytes} [Mon Oct 24 10:24:03 2022] POST /compute/v2.1/flavors/657241279/action => generated 21 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:24:03.731846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e768b8b2-c3b8-4480-8215-2340861e649a tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1319054424"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:03.734491 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2c6713fd-a8da-43de-a94c-573cc70c16a8 tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/81172725/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.020475 Oct 24 10:24:03.735291 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 17/29] 10.222.0.50 () {58 vars in 1197 bytes} [Mon Oct 24 10:24:03 2022] GET /compute/v2.1/flavors/81172725/os-extra_specs => generated 66 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 10:24:03.739905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.aggregate [None req-e768b8b2-c3b8-4480-8215-2340861e649a tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Generated uuid 761c5b13-7b13-4385-bcb2-02002e5365e1 for aggregate {{(pid=120426) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:03.745903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f1d102bf-b3dc-42ef-92cf-ae34cb2320f8 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:03.782998 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f1d102bf-b3dc-42ef-92cf-ae34cb2320f8 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/657241279" status: 202 len: 0 microversion: 2.1 time: 0.040802 Oct 24 10:24:03.784044 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 18/30] 10.222.0.50 () {58 vars in 1158 bytes} [Mon Oct 24 10:24:03 2022] DELETE /compute/v2.1/flavors/657241279 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:24:03.791120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-adc082d4-b746-4c23-aede-198b3cc6700b tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:03.813498 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e768b8b2-c3b8-4480-8215-2340861e649a tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.085302 Oct 24 10:24:03.814503 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 13/31] 10.222.0.50 () {60 vars in 1164 bytes} [Mon Oct 24 10:24:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:03.822188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3a50ce4a-59c3-4bdb-8b49-4ade563fdd50 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:03.826045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=5,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=2,nova_api:DELETE=7 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:03.843341 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-adc082d4-b746-4c23-aede-198b3cc6700b tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/81172725/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.057840 Oct 24 10:24:03.845133 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 19/32] 10.222.0.50 () {58 vars in 1242 bytes} [Mon Oct 24 10:24:03 2022] DELETE /compute/v2.1/flavors/81172725/os-extra_specs/hw:numa_nodes => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:24:03.851254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9155e591-8263-44d5-be74-de8542a06419 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-15"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:03.860999 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3a50ce4a-59c3-4bdb-8b49-4ade563fdd50 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.045088 Oct 24 10:24:03.861894 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 14/33] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:24:03 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:03.868164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9155e591-8263-44d5-be74-de8542a06419 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:03.868954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9155e591-8263-44d5-be74-de8542a06419 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:03.869541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9155e591-8263-44d5-be74-de8542a06419 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:03.878008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b706b5da-6b25-44d1-900e-733c0272e07b tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:03.905612 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b706b5da-6b25-44d1-900e-733c0272e07b tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/81172725/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.042295 Oct 24 10:24:03.906982 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 15/34] 10.222.0.50 () {58 vars in 1242 bytes} [Mon Oct 24 10:24:03 2022] DELETE /compute/v2.1/flavors/81172725/os-extra_specs/hw:cpu_policy => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:24:03.913961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e5fc2f8a-5241-49ab-b23d-d3f731661433 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2031611738", "id": 1122332904, "os-flavor-access:is_public": "True"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:03.944350 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e5fc2f8a-5241-49ab-b23d-d3f731661433 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.035493 Oct 24 10:24:03.949321 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 16/35] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:24:03 2022] POST /compute/v2.1/flavors => generated 438 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:03.956999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-428928a4-3617-4b85-9d4b-56266631f986 tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:03.968110 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-428928a4-3617-4b85-9d4b-56266631f986 tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/81172725/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017168 Oct 24 10:24:03.970295 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 17/36] 10.222.0.50 () {58 vars in 1197 bytes} [Mon Oct 24 10:24:03 2022] GET /compute/v2.1/flavors/81172725/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:24:03.980534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e372db36-d879-45ad-a75d-bbd5318352f3 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:03.990012 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-e372db36-d879-45ad-a75d-bbd5318352f3 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e372db36-d879-45ad-a75d-bbd5318352f3 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Request method failure captured: Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/flavors/1122332904/os-flavor-access HTTP/1.1 Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfAGH4VcnpG199IkP8VMJSqSH0q2L7cwM7jSowl8HAWe1C7YUr0Xge1__Ut4vJY_war0J0pdzXCwSZq3hdm9BmVTl4QNBu5EZQBT7eVBxF8BviNZtIzMNRUfXwi75wUnBI5NFaza5FLewFgCIRHtcTrftLvVcQM1PLIDX6c-YnUlrk Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: a6f0aa0588d34154a08bfa914e3ba9d2 Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-824024383 Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:24:03.991420 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:24:03.992475 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6f0aa0588d34154a08bfa914e3ba9d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6f0aa0588d34154a08bfa914e3ba9d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a6f0aa0588d34154a08bfa914e3ba9d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a6f0aa0588d34154a08bfa914e3ba9d2", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:03.992475 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-824024383 Oct 24 10:24:03.992475 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: a6f0aa0588d34154a08bfa914e3ba9d2 Oct 24 10:24:03.992475 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-824024383 Oct 24 10:24:03.992475 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin Oct 24 10:24:03.992475 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:03.992475 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:03.992475 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 543f7171da6d4faf95797a79d2e9169a Oct 24 10:24:03.992475 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin Oct 24 10:24:03.992475 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:03.992475 n-d-858383-15 devstack@n-api.service[120426]: exception: Access list not available for public flavors. Oct 24 10:24:03.992475 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'flavor_id': '1122332904'} Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 24 10:24:03.993078 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:03.994287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e372db36-d879-45ad-a75d-bbd5318352f3 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:03.994287 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e372db36-d879-45ad-a75d-bbd5318352f3 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1122332904/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.021549 Oct 24 10:24:03.998351 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 18/37] 10.222.0.50 () {58 vars in 1209 bytes} [Mon Oct 24 10:24:03 2022] GET /compute/v2.1/flavors/1122332904/os-flavor-access => generated 91 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:24:04.011585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-02126654-567a-4359-bf5d-9ce7abbb98b9 tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:04.035444 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9155e591-8263-44d5-be74-de8542a06419 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 243 microversion: 2.1 time: 0.188907 Oct 24 10:24:04.043494 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 20/38] 10.222.0.50 () {60 vars in 1191 bytes} [Mon Oct 24 10:24:03 2022] POST /compute/v2.1/os-aggregates/2/action => generated 243 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:04.043678 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-02126654-567a-4359-bf5d-9ce7abbb98b9 tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/81172725" status: 202 len: 0 microversion: 2.1 time: 0.035820 Oct 24 10:24:04.043678 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 19/39] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Oct 24 10:24:03 2022] DELETE /compute/v2.1/flavors/81172725 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:24:04.043828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-78f7495a-f81c-4bed-85c6-3ae715262859 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:04.048201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c67edb4e-8bd8-4fa7-a071-c3b5d18eb482 tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:04.065336 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-78f7495a-f81c-4bed-85c6-3ae715262859 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1122332904" status: 202 len: 0 microversion: 2.1 time: 0.026383 Oct 24 10:24:04.069796 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 21/40] 10.222.0.50 () {58 vars in 1161 bytes} [Mon Oct 24 10:24:04 2022] DELETE /compute/v2.1/flavors/1122332904 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:24:04.074219 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c67edb4e-8bd8-4fa7-a071-c3b5d18eb482 tempest-FlavorsExtraSpecsTestJSON-590009618 tempest-FlavorsExtraSpecsTestJSON-590009618-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5419 microversion: 2.1 time: 0.031090 Oct 24 10:24:04.074978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1296ff22-d7b3-4bde-a8b2-bdca91c142c1 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-15"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:04.075291 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 20/41] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:24:04 2022] GET /compute/v2.1/flavors/detail => generated 5419 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:04.079744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6965a590-4a68-4f22-9310-b1b579df8534 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:04.102005 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6965a590-4a68-4f22-9310-b1b579df8534 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025483 Oct 24 10:24:04.102273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1296ff22-d7b3-4bde-a8b2-bdca91c142c1 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:04.102993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1296ff22-d7b3-4bde-a8b2-bdca91c142c1 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:04.103108 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 21/42] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:24:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:04.105455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1296ff22-d7b3-4bde-a8b2-bdca91c142c1 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:04.124550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54fe3890-ae15-4e23-9895-5f4fd73f4efa tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1692568290", "id": 1847604812, "os-flavor-access:is_public": "False"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:04.141567 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-1296ff22-d7b3-4bde-a8b2-bdca91c142c1 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h1-858383-15. Oct 24 10:24:04.147781 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-54fe3890-ae15-4e23-9895-5f4fd73f4efa tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.027673 Oct 24 10:24:04.148611 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 22/43] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:24:04 2022] POST /compute/v2.1/flavors => generated 439 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1296ff22-d7b3-4bde-a8b2-bdca91c142c1 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Request method failure captured: Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 40 Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfA48W2RXlFYPfdKqb8r_nHINmQwJGF39j8kzLHpavwwHU6XqshPkFBHsyagxHy988VOmL_1dG6CY-Wg-YyFF3ftJBudJ22H_fPhqxowj3G14jpqizf-T-eaoo_4M8iZsP7GH-GR3AkkKNJf2n5BeazeRftoqyZuaDn7m-8qWL7Hn0 Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 374e5d25c2884ae2a7e0cb9b4a15bf6a Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:24:04.159953 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:24:04.161831 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_374e5d25c2884ae2a7e0cb9b4a15bf6a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:04.161831 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:04.161831 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 374e5d25c2884ae2a7e0cb9b4a15bf6a Oct 24 10:24:04.161831 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:04.161831 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin Oct 24 10:24:04.161831 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:04.161831 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:04.161831 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 1002979e5f6841f880feee4608ac23a6 Oct 24 10:24:04.161831 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin Oct 24 10:24:04.161831 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:24:04.161831 n-d-858383-15 devstack@n-api.service[120425]: {"add_host": {"host": "n-h1-858383-15"}} Oct 24 10:24:04.161831 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:24:04.161831 n-d-858383-15 devstack@n-api.service[120425]: exception: Aggregate 2 already has host n-h1-858383-15. Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-858383-15'}}} Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result.read() Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 10:24:04.162469 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-858383-15-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi session.flush() Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 10:24:04.163343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 24 10:24:04.164669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 10:24:04.164669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception Oct 24 10:24:04.164669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 10:24:04.164669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 24 10:24:04.164669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 10:24:04.164669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 24 10:24:04.164669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 10:24:04.164669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 24 10:24:04.164669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 10:24:04.164669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 24 10:24:04.164669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 24 10:24:04.164669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 24 10:24:04.164669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 10:24:04.164669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 10:24:04.164669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 10:24:04.164669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 24 10:24:04.164669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 10:24:04.164669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 24 10:24:04.165788 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 10:24:04.165788 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 24 10:24:04.165788 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 10:24:04.165788 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 10:24:04.165788 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 10:24:04.165788 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception Oct 24 10:24:04.165788 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 10:24:04.165788 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 24 10:24:04.165788 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 10:24:04.165788 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 24 10:24:04.165788 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 10:24:04.165788 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 24 10:24:04.165788 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 10:24:04.165788 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 24 10:24:04.165788 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 10:24:04.165788 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 10:24:04.165788 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 10:24:04.165788 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result.read() Oct 24 10:24:04.167184 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 10:24:04.167184 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 24 10:24:04.167184 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 10:24:04.167184 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 24 10:24:04.167184 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 10:24:04.167184 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 24 10:24:04.167184 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 10:24:04.167184 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 24 10:24:04.167184 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-858383-15-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 24 10:24:04.167184 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 24 10:24:04.167184 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 24, 10, 24, 4, 126940), 'updated_at': None, 'host': 'n-h1-858383-15', 'aggregate_id': 2}] Oct 24 10:24:04.167184 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 10:24:04.167184 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:04.167184 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:04.167184 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:04.167184 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:04.167184 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6644, in add_host_to_aggregate Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h1-858383-15. Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:04.168912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h1-858383-15. Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:04.173695 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:04.175805 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h1-858383-15. Oct 24 10:24:04.175805 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:04.175805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1296ff22-d7b3-4bde-a8b2-bdca91c142c1 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Returning 409 to user: Aggregate 2 already has host n-h1-858383-15. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:04.175805 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1296ff22-d7b3-4bde-a8b2-bdca91c142c1 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 96 microversion: 2.1 time: 0.091614 Oct 24 10:24:04.175805 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 22/44] 10.222.0.50 () {60 vars in 1191 bytes} [Mon Oct 24 10:24:04 2022] POST /compute/v2.1/os-aggregates/2/action => generated 96 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 24 10:24:04.177156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cb42112b-3240-4f95-a0b8-6875d30e4754 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-15"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:04.191685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb42112b-3240-4f95-a0b8-6875d30e4754 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:04.192096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb42112b-3240-4f95-a0b8-6875d30e4754 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:04.193282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb42112b-3240-4f95-a0b8-6875d30e4754 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:04.348431 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cb42112b-3240-4f95-a0b8-6875d30e4754 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.179170 Oct 24 10:24:04.351228 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 23/45] 10.222.0.50 () {60 vars in 1191 bytes} [Mon Oct 24 10:24:04 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:24:04.367127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6906f740-9414-428d-b248-984966fd1366 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:04.401709 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6906f740-9414-428d-b248-984966fd1366 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.043187 Oct 24 10:24:04.407230 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 24/46] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:24:04 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:24:04.419832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-987dad1d-4f22-4779-abf5-d7fedbcd0be2 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1850623950"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:04.442460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.aggregate [None req-987dad1d-4f22-4779-abf5-d7fedbcd0be2 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Generated uuid d5316591-8ca7-4b5a-9a0c-79416e46c5f0 for aggregate {{(pid=120425) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:04.476880 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-987dad1d-4f22-4779-abf5-d7fedbcd0be2 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.062887 Oct 24 10:24:04.478268 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 25/47] 10.222.0.50 () {60 vars in 1164 bytes} [Mon Oct 24 10:24:04 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:04.498528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-71e91549-b0b3-4dfd-b47d-2c7f09822710 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1244601053", "name": "tempest-test_aggregate-1182005135"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:04.527891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.aggregate [None req-71e91549-b0b3-4dfd-b47d-2c7f09822710 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Generated uuid 9ca3f7c3-28e7-4d98-9f84-2bb30ebf456a for aggregate {{(pid=120425) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:04.563552 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-71e91549-b0b3-4dfd-b47d-2c7f09822710 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.083859 Oct 24 10:24:04.564866 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 26/48] 10.222.0.50 () {60 vars in 1165 bytes} [Mon Oct 24 10:24:04 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:04.622593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8a2a9051-b54d-418e-980c-a3c797d4ff8f tempest-FlavorsAccessNegativeTestJSON-1012312288 tempest-FlavorsAccessNegativeTestJSON-1012312288-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "371f4ff5b6cd405997ae972aec88a225"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:04.625742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8a2a9051-b54d-418e-980c-a3c797d4ff8f tempest-FlavorsAccessNegativeTestJSON-1012312288 tempest-FlavorsAccessNegativeTestJSON-1012312288-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'a519d50a4fdb486ab1c0a5f6a2bc5696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371f4ff5b6cd405997ae972aec88a225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8a2a9051-b54d-418e-980c-a3c797d4ff8f tempest-FlavorsAccessNegativeTestJSON-1012312288 tempest-FlavorsAccessNegativeTestJSON-1012312288-project] Request method failure captured: Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/flavors/1847604812/action HTTP/1.1 Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 67 Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVme9ESR-3W3hNU9cggNWyObXMao3eTuR_bsqYFD0VCNYZLWyDcXbN7xTzAnp8mKKoO_9JXUcnmh3r7_-5XGo2kVaHThzDNgjNEiyBzq5SFdxDSvcko5CdiCS9TpEc63704oWEu60ajPpasgWxNOpUYaXyY4rhWp9fRN3NjiCz4rmFmI Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 371f4ff5b6cd405997ae972aec88a225 Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1012312288 Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:24:04.628895 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:24:04.629956 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/371f4ff5b6cd405997ae972aec88a225"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/371f4ff5b6cd405997ae972aec88a225"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/371f4ff5b6cd405997ae972aec88a225"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_371f4ff5b6cd405997ae972aec88a225", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:04.629956 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1012312288 Oct 24 10:24:04.629956 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 371f4ff5b6cd405997ae972aec88a225 Oct 24 10:24:04.629956 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1012312288 Oct 24 10:24:04.629956 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-FlavorsAccessNegativeTestJSON-1012312288-project Oct 24 10:24:04.629956 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:04.629956 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:04.629956 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a519d50a4fdb486ab1c0a5f6a2bc5696 Oct 24 10:24:04.629956 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1012312288-project Oct 24 10:24:04.629956 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:24:04.629956 n-d-858383-15 devstack@n-api.service[120426]: {"addTenantAccess": {"tenant": "371f4ff5b6cd405997ae972aec88a225"}} Oct 24 10:24:04.629956 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '1847604812', 'body': {'addTenantAccess': {'tenant': '371f4ff5b6cd405997ae972aec88a225'}}} Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:04.630529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 24 10:24:04.631430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:04.634390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8a2a9051-b54d-418e-980c-a3c797d4ff8f tempest-FlavorsAccessNegativeTestJSON-1012312288 tempest-FlavorsAccessNegativeTestJSON-1012312288-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:04.635456 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8a2a9051-b54d-418e-980c-a3c797d4ff8f tempest-FlavorsAccessNegativeTestJSON-1012312288 tempest-FlavorsAccessNegativeTestJSON-1012312288-project] 10.222.0.50 "POST /compute/v2.1/flavors/1847604812/action" status: 403 len: 130 microversion: 2.1 time: 0.477916 Oct 24 10:24:04.636298 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 23/49] 10.222.0.50 () {60 vars in 1200 bytes} [Mon Oct 24 10:24:04 2022] POST /compute/v2.1/flavors/1847604812/action => generated 130 bytes in 479 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:04.644306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-62cf4c1b-93ed-4658-9fce-d44a3549587e tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:04.664877 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-62cf4c1b-93ed-4658-9fce-d44a3549587e tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 517 microversion: 2.1 time: 0.027105 Oct 24 10:24:04.665578 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 24/50] 10.222.0.50 () {58 vars in 1143 bytes} [Mon Oct 24 10:24:04 2022] GET /compute/v2.1/os-aggregates => generated 517 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:04.670114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-95941c3c-e33e-484e-bf07-0a4e60f44259 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:04.674612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=8 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:04.699593 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-95941c3c-e33e-484e-bf07-0a4e60f44259 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1847604812" status: 202 len: 0 microversion: 2.1 time: 0.032723 Oct 24 10:24:04.700469 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 25/51] 10.222.0.50 () {58 vars in 1161 bytes} [Mon Oct 24 10:24:04 2022] DELETE /compute/v2.1/flavors/1847604812 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:24:04.707659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e2b708a4-b956-48ca-87bd-5ef10290cbb4 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-15"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:04.731038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2b708a4-b956-48ca-87bd-5ef10290cbb4 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:04.732338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2b708a4-b956-48ca-87bd-5ef10290cbb4 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:04.733109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2b708a4-b956-48ca-87bd-5ef10290cbb4 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:05.168303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ff5246fb-827a-452a-a634-c64d01e5d167 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-15"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:05.171927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ff5246fb-827a-452a-a634-c64d01e5d167 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '579ff076ba0242369042cbadcc806aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581cecbb5efb45e4b48bca78f37498f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ff5246fb-827a-452a-a634-c64d01e5d167 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Request method failure captured: Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 40 Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVme-PPKkmxASlg69UtdoomfOXdFifBcxm_XPojQ4Zjy2tLTpu00Ky-GrOHJ0K502yerf7W1amENxUxHuJdUGk9bmsVHMioPz_9i5U9YbihcdG-_6KB31jfY3nqQPAmGPhJ6WtqiUhfnJWuZTniQ-2xB8Lp6qY22kzbWmq3MVrRl8PH0 Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 581cecbb5efb45e4b48bca78f37498f4 Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1824377028 Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:24:05.185044 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:24:05.186500 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/581cecbb5efb45e4b48bca78f37498f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/581cecbb5efb45e4b48bca78f37498f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/581cecbb5efb45e4b48bca78f37498f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_581cecbb5efb45e4b48bca78f37498f4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:05.186500 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1824377028 Oct 24 10:24:05.186500 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 581cecbb5efb45e4b48bca78f37498f4 Oct 24 10:24:05.186500 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1824377028 Oct 24 10:24:05.186500 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AggregatesAdminNegativeTestJSON-1824377028-project Oct 24 10:24:05.186500 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:05.186500 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:05.186500 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 579ff076ba0242369042cbadcc806aef Oct 24 10:24:05.186500 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1824377028-project Oct 24 10:24:05.186500 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:24:05.186500 n-d-858383-15 devstack@n-api.service[120425]: {"add_host": {"host": "n-h1-858383-15"}} Oct 24 10:24:05.186500 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:24:05.186500 n-d-858383-15 devstack@n-api.service[120425]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-858383-15'}}} Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:05.187416 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 24 10:24:05.188480 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:05.189558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ff5246fb-827a-452a-a634-c64d01e5d167 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:05.189558 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ff5246fb-827a-452a-a634-c64d01e5d167 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] 10.222.0.50 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.620361 Oct 24 10:24:05.191588 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 27/52] 10.222.0.50 () {60 vars in 1191 bytes} [Mon Oct 24 10:24:04 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 625 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:05.203225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d096afa-7488-433a-80a8-a6da5101d610 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:05.228956 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0d096afa-7488-433a-80a8-a6da5101d610 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035432 Oct 24 10:24:05.229326 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 28/53] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:24:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:05.233937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c0ea5a4e-eac1-4e94-bcb9-e72af3323e3e tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:05.276352 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c0ea5a4e-eac1-4e94-bcb9-e72af3323e3e tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.045625 Oct 24 10:24:05.282335 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 29/54] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:24:05 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:24:05.290331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2bb9126e-269f-442d-adeb-237be1f2c65b tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1098556059", "id": 1874377133, "os-flavor-access:is_public": "False"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:05.332115 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2bb9126e-269f-442d-adeb-237be1f2c65b tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.049473 Oct 24 10:24:05.335275 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 30/55] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:24:05 2022] POST /compute/v2.1/flavors => generated 439 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:05.355473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f18c41c4-cd00-4c69-ba0f-8afa8f3cc709 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-741100616"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:05.368358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.aggregate [None req-f18c41c4-cd00-4c69-ba0f-8afa8f3cc709 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Generated uuid d8e6dd99-7ec5-46ca-883b-82ef3114d60d for aggregate {{(pid=120425) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:05.410006 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f18c41c4-cd00-4c69-ba0f-8afa8f3cc709 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.071487 Oct 24 10:24:05.412375 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 31/56] 10.222.0.50 () {60 vars in 1164 bytes} [Mon Oct 24 10:24:05 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:05.425768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5a9f189-fb7e-4fba-95e7-b3aee62272ff tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "371f4ff5b6cd405997ae972aec88a225"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:06.191031 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d5a9f189-fb7e-4fba-95e7-b3aee62272ff tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1874377133/action" status: 200 len: 97 microversion: 2.1 time: 0.776043 Oct 24 10:24:06.201532 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 32/57] 10.222.0.50 () {60 vars in 1200 bytes} [Mon Oct 24 10:24:05 2022] POST /compute/v2.1/flavors/1874377133/action => generated 97 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:24:06.216811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7f6d4f85-a694-4169-ae8c-28f1cbb9e743 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1363150720"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:06.240248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f6d4f85-a694-4169-ae8c-28f1cbb9e743 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:06.241186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f6d4f85-a694-4169-ae8c-28f1cbb9e743 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:06.241734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f6d4f85-a694-4169-ae8c-28f1cbb9e743 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:06.253227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f6d4f85-a694-4169-ae8c-28f1cbb9e743 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:06.253227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f6d4f85-a694-4169-ae8c-28f1cbb9e743 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:06.253227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f6d4f85-a694-4169-ae8c-28f1cbb9e743 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:06.264901 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-7f6d4f85-a694-4169-ae8c-28f1cbb9e743 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1363150720 could not be found. Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7f6d4f85-a694-4169-ae8c-28f1cbb9e743 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Request method failure captured: Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 58 Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfA48W2RXlFYPfdKqb8r_nHINmQwJGF39j8kzLHpavwwHU6XqshPkFBHsyagxHy988VOmL_1dG6CY-Wg-YyFF3ftJBudJ22H_fPhqxowj3G14jpqizf-T-eaoo_4M8iZsP7GH-GR3AkkKNJf2n5BeazeRftoqyZuaDn7m-8qWL7Hn0 Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 374e5d25c2884ae2a7e0cb9b4a15bf6a Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:24:06.267902 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:24:06.269124 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_374e5d25c2884ae2a7e0cb9b4a15bf6a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:06.269124 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:06.269124 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 374e5d25c2884ae2a7e0cb9b4a15bf6a Oct 24 10:24:06.269124 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:06.269124 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin Oct 24 10:24:06.269124 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:06.269124 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:06.269124 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 1002979e5f6841f880feee4608ac23a6 Oct 24 10:24:06.269124 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin Oct 24 10:24:06.269124 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:24:06.269124 n-d-858383-15 devstack@n-api.service[120425]: {"add_host": {"host": "tempest-nonexist_host-1363150720"}} Oct 24 10:24:06.269124 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:24:06.269124 n-d-858383-15 devstack@n-api.service[120425]: exception: Compute host tempest-nonexist_host-1363150720 could not be found. Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-1363150720'}}} Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1363150720' is not mapped to any cell Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:06.269866 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6008, in _get_service_in_cell_by_host Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6624, in add_host_to_aggregate Oct 24 10:24:06.271374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6010, in _get_service_in_cell_by_host Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1363150720 could not be found. Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1363150720 could not be found. Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:06.272497 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.274150 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:06.274150 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:06.274150 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:06.274150 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:06.274150 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:06.274150 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1363150720 could not be found. Oct 24 10:24:06.274150 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.274150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7f6d4f85-a694-4169-ae8c-28f1cbb9e743 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1363150720 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:06.274150 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7f6d4f85-a694-4169-ae8c-28f1cbb9e743 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.065864 Oct 24 10:24:06.274150 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 33/58] 10.222.0.50 () {60 vars in 1191 bytes} [Mon Oct 24 10:24:06 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:06.284588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-57a0c6aa-2136-4bef-8b6d-1a60adf9cd53 tempest-FlavorsAccessNegativeTestJSON-1012312288 tempest-FlavorsAccessNegativeTestJSON-1012312288-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "371f4ff5b6cd405997ae972aec88a225"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:06.291363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-57a0c6aa-2136-4bef-8b6d-1a60adf9cd53 tempest-FlavorsAccessNegativeTestJSON-1012312288 tempest-FlavorsAccessNegativeTestJSON-1012312288-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'a519d50a4fdb486ab1c0a5f6a2bc5696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371f4ff5b6cd405997ae972aec88a225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-57a0c6aa-2136-4bef-8b6d-1a60adf9cd53 tempest-FlavorsAccessNegativeTestJSON-1012312288 tempest-FlavorsAccessNegativeTestJSON-1012312288-project] Request method failure captured: Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/flavors/1874377133/action HTTP/1.1 Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 70 Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVme9ESR-3W3hNU9cggNWyObXMao3eTuR_bsqYFD0VCNYZLWyDcXbN7xTzAnp8mKKoO_9JXUcnmh3r7_-5XGo2kVaHThzDNgjNEiyBzq5SFdxDSvcko5CdiCS9TpEc63704oWEu60ajPpasgWxNOpUYaXyY4rhWp9fRN3NjiCz4rmFmI Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 371f4ff5b6cd405997ae972aec88a225 Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1012312288 Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:24:06.295845 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:24:06.296893 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/371f4ff5b6cd405997ae972aec88a225"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/371f4ff5b6cd405997ae972aec88a225"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/371f4ff5b6cd405997ae972aec88a225"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_371f4ff5b6cd405997ae972aec88a225", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:06.296893 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1012312288 Oct 24 10:24:06.296893 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 371f4ff5b6cd405997ae972aec88a225 Oct 24 10:24:06.296893 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1012312288 Oct 24 10:24:06.296893 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-FlavorsAccessNegativeTestJSON-1012312288-project Oct 24 10:24:06.296893 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:06.296893 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:06.296893 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a519d50a4fdb486ab1c0a5f6a2bc5696 Oct 24 10:24:06.296893 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1012312288-project Oct 24 10:24:06.296893 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:24:06.296893 n-d-858383-15 devstack@n-api.service[120425]: {"removeTenantAccess": {"tenant": "371f4ff5b6cd405997ae972aec88a225"}} Oct 24 10:24:06.296893 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '1874377133', 'body': {'removeTenantAccess': {'tenant': '371f4ff5b6cd405997ae972aec88a225'}}} Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi context.can( Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:06.297481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 24 10:24:06.298455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.300247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-57a0c6aa-2136-4bef-8b6d-1a60adf9cd53 tempest-FlavorsAccessNegativeTestJSON-1012312288 tempest-FlavorsAccessNegativeTestJSON-1012312288-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:06.300247 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-57a0c6aa-2136-4bef-8b6d-1a60adf9cd53 tempest-FlavorsAccessNegativeTestJSON-1012312288 tempest-FlavorsAccessNegativeTestJSON-1012312288-project] 10.222.0.50 "POST /compute/v2.1/flavors/1874377133/action" status: 403 len: 133 microversion: 2.1 time: 0.025405 Oct 24 10:24:06.305092 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 34/59] 10.222.0.50 () {60 vars in 1200 bytes} [Mon Oct 24 10:24:06 2022] POST /compute/v2.1/flavors/1874377133/action => generated 133 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:06.315221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-49b6fb11-4b42-4e99-bab8-9caf206906e3 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:06.368930 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-49b6fb11-4b42-4e99-bab8-9caf206906e3 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.061096 Oct 24 10:24:06.375550 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 35/60] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:24:06 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:24:06.382715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f3099abc-1372-4144-a4cf-afc75a6dfc3a tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "371f4ff5b6cd405997ae972aec88a225"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:06.720914 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e2b708a4-b956-48ca-87bd-5ef10290cbb4 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 316 microversion: 2.1 time: 2.018940 Oct 24 10:24:06.738690 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 26/61] 10.222.0.50 () {60 vars in 1191 bytes} [Mon Oct 24 10:24:04 2022] POST /compute/v2.1/os-aggregates/4/action => generated 316 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:06.751590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c834a49f-b759-4453-8951-3ad039f22229 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c834a49f-b759-4453-8951-3ad039f22229 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Request method failure captured: Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 283 Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfA48W2RXlFYPfdKqb8r_nHINmQwJGF39j8kzLHpavwwHU6XqshPkFBHsyagxHy988VOmL_1dG6CY-Wg-YyFF3ftJBudJ22H_fPhqxowj3G14jpqizf-T-eaoo_4M8iZsP7GH-GR3AkkKNJf2n5BeazeRftoqyZuaDn7m-8qWL7Hn0 Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 374e5d25c2884ae2a7e0cb9b4a15bf6a Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:24:06.759514 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:24:06.760627 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_374e5d25c2884ae2a7e0cb9b4a15bf6a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:06.760627 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:06.760627 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 374e5d25c2884ae2a7e0cb9b4a15bf6a Oct 24 10:24:06.760627 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:06.760627 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin Oct 24 10:24:06.760627 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:06.760627 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:06.760627 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 1002979e5f6841f880feee4608ac23a6 Oct 24 10:24:06.760627 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin Oct 24 10:24:06.760627 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:24:06.761150 n-d-858383-15 devstack@n-api.service[120426]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 24 10:24:06.761150 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:06.761150 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 10:24:06.761150 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 24 10:24:06.761150 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:06.761150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:06.761150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:24:06.761150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:24:06.761150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:24:06.761150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:24:06.761639 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 10:24:06.761639 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.761639 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 24 10:24:06.761639 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 10:24:06.761639 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.761639 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 24 10:24:06.761639 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 24 10:24:06.761639 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.761639 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:06.761639 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.761639 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:06.761639 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:06.761639 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:06.761639 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:06.761639 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:06.761639 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:06.761639 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:06.762452 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:06.762452 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:06.762452 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:24:06.762452 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:24:06.762452 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:24:06.762452 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:24:06.762452 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:24:06.762452 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:24:06.762452 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 10:24:06.762452 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.762452 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:06.762452 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.762452 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:06.762452 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:06.762452 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:06.763212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:24:06.763212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:24:06.763212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 10:24:06.763212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.763212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c834a49f-b759-4453-8951-3ad039f22229 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:06.763490 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c834a49f-b759-4453-8951-3ad039f22229 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.020644 Oct 24 10:24:06.768960 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 27/62] 10.222.0.50 () {60 vars in 1165 bytes} [Mon Oct 24 10:24:06 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:24:06.776016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-505b4759-746a-42d9-8254-bf96d16c5f16 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-505b4759-746a-42d9-8254-bf96d16c5f16 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Request method failure captured: Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 27 Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfA48W2RXlFYPfdKqb8r_nHINmQwJGF39j8kzLHpavwwHU6XqshPkFBHsyagxHy988VOmL_1dG6CY-Wg-YyFF3ftJBudJ22H_fPhqxowj3G14jpqizf-T-eaoo_4M8iZsP7GH-GR3AkkKNJf2n5BeazeRftoqyZuaDn7m-8qWL7Hn0 Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 374e5d25c2884ae2a7e0cb9b4a15bf6a Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:24:06.780123 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:24:06.781455 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_374e5d25c2884ae2a7e0cb9b4a15bf6a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:06.781455 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:06.781455 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 374e5d25c2884ae2a7e0cb9b4a15bf6a Oct 24 10:24:06.781455 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:06.781455 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin Oct 24 10:24:06.781455 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:06.781455 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:06.781455 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 1002979e5f6841f880feee4608ac23a6 Oct 24 10:24:06.781455 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin Oct 24 10:24:06.781455 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:24:06.781455 n-d-858383-15 devstack@n-api.service[120426]: {"aggregate": {"name": ""}} Oct 24 10:24:06.781455 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:06.781455 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi '' Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:06.782256 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 24 10:24:06.783526 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.785350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-505b4759-746a-42d9-8254-bf96d16c5f16 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:06.785350 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-505b4759-746a-42d9-8254-bf96d16c5f16 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.010191 Oct 24 10:24:06.785350 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 28/63] 10.222.0.50 () {60 vars in 1164 bytes} [Mon Oct 24 10:24:06 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:24:06.795768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-471f87dd-36c2-433f-9246-4daba514bc7c tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-752930337"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:06.800355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-471f87dd-36c2-433f-9246-4daba514bc7c tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '579ff076ba0242369042cbadcc806aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581cecbb5efb45e4b48bca78f37498f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-471f87dd-36c2-433f-9246-4daba514bc7c tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Request method failure captured: Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 59 Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVme-PPKkmxASlg69UtdoomfOXdFifBcxm_XPojQ4Zjy2tLTpu00Ky-GrOHJ0K502yerf7W1amENxUxHuJdUGk9bmsVHMioPz_9i5U9YbihcdG-_6KB31jfY3nqQPAmGPhJ6WtqiUhfnJWuZTniQ-2xB8Lp6qY22kzbWmq3MVrRl8PH0 Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 581cecbb5efb45e4b48bca78f37498f4 Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1824377028 Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:24:06.803149 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:24:06.804251 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/581cecbb5efb45e4b48bca78f37498f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/581cecbb5efb45e4b48bca78f37498f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/581cecbb5efb45e4b48bca78f37498f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_581cecbb5efb45e4b48bca78f37498f4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:06.804251 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1824377028 Oct 24 10:24:06.804251 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 581cecbb5efb45e4b48bca78f37498f4 Oct 24 10:24:06.804251 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1824377028 Oct 24 10:24:06.804251 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AggregatesAdminNegativeTestJSON-1824377028-project Oct 24 10:24:06.804251 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:06.804251 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:06.804251 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 579ff076ba0242369042cbadcc806aef Oct 24 10:24:06.804251 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1824377028-project Oct 24 10:24:06.804251 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:24:06.804251 n-d-858383-15 devstack@n-api.service[120426]: {"aggregate": {"name": "tempest-test_aggregate-752930337"}} Oct 24 10:24:06.804251 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:06.804251 n-d-858383-15 devstack@n-api.service[120426]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-752930337'}}} Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:06.805642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:06.806761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 24 10:24:06.808193 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.808193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-471f87dd-36c2-433f-9246-4daba514bc7c tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:06.808421 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-471f87dd-36c2-433f-9246-4daba514bc7c tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.014857 Oct 24 10:24:06.809548 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 29/64] 10.222.0.50 () {60 vars in 1164 bytes} [Mon Oct 24 10:24:06 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:24:06.819226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e3be4052-c987-4f36-8a53-de1fb6deab76 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1937227213"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:06.834153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.aggregate [None req-e3be4052-c987-4f36-8a53-de1fb6deab76 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Generated uuid 7f02142b-263a-40ea-8530-f831882fa5b8 for aggregate {{(pid=120426) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:06.863962 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e3be4052-c987-4f36-8a53-de1fb6deab76 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049443 Oct 24 10:24:06.865826 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 30/65] 10.222.0.50 () {60 vars in 1164 bytes} [Mon Oct 24 10:24:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:24:06.878910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-51d6ab02-7a5d-4cdd-a7c2-617264883b83 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1937227213"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:06.888162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.aggregate [None req-51d6ab02-7a5d-4cdd-a7c2-617264883b83 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Generated uuid 6106990c-0ffc-450a-9da8-f6353e9e2eed for aggregate {{(pid=120426) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:06.906478 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-51d6ab02-7a5d-4cdd-a7c2-617264883b83 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1937227213 already exists. Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-51d6ab02-7a5d-4cdd-a7c2-617264883b83 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Request method failure captured: Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 60 Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfA48W2RXlFYPfdKqb8r_nHINmQwJGF39j8kzLHpavwwHU6XqshPkFBHsyagxHy988VOmL_1dG6CY-Wg-YyFF3ftJBudJ22H_fPhqxowj3G14jpqizf-T-eaoo_4M8iZsP7GH-GR3AkkKNJf2n5BeazeRftoqyZuaDn7m-8qWL7Hn0 Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 374e5d25c2884ae2a7e0cb9b4a15bf6a Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:24:06.916907 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:24:06.918066 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_374e5d25c2884ae2a7e0cb9b4a15bf6a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:06.918066 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:06.918066 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 374e5d25c2884ae2a7e0cb9b4a15bf6a Oct 24 10:24:06.918066 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:06.918066 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin Oct 24 10:24:06.918066 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:06.918066 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:06.918066 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 1002979e5f6841f880feee4608ac23a6 Oct 24 10:24:06.918066 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin Oct 24 10:24:06.918066 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:24:06.918066 n-d-858383-15 devstack@n-api.service[120426]: {"aggregate": {"name": "tempest-test_aggregate-1937227213"}} Oct 24 10:24:06.918066 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:06.918066 n-d-858383-15 devstack@n-api.service[120426]: exception: Aggregate tempest-test_aggregate-1937227213 already exists. Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1937227213'}}} Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6461, in create_aggregate Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 24 10:24:06.918680 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1937227213 already exists. Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:06.919587 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 24 10:24:06.920631 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 24 10:24:06.920631 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1937227213 already exists. Oct 24 10:24:06.920631 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.920631 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:06.920631 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.920631 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:06.920631 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:06.920631 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:06.920631 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:06.920631 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:06.920631 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1937227213 already exists. Oct 24 10:24:06.920631 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:06.925325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-51d6ab02-7a5d-4cdd-a7c2-617264883b83 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1937227213 already exists. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:06.928820 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-51d6ab02-7a5d-4cdd-a7c2-617264883b83 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.053140 Oct 24 10:24:06.931507 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 31/66] 10.222.0.50 () {60 vars in 1164 bytes} [Mon Oct 24 10:24:06 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 24 10:24:06.945539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2cfd9873-84a9-4e79-b9ea-2a39d139030f tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:06.994164 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2cfd9873-84a9-4e79-b9ea-2a39d139030f tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.058897 Oct 24 10:24:06.997447 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 32/67] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:24:06 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:24:07.008723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9edbb136-f9a1-4e7b-9d8b-b87a88175639 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1281650909"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:07.012819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.aggregate [None req-9edbb136-f9a1-4e7b-9d8b-b87a88175639 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Generated uuid 966f3a00-91a4-4c46-9edd-2c087e02814b for aggregate {{(pid=120426) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:07.059164 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9edbb136-f9a1-4e7b-9d8b-b87a88175639 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056725 Oct 24 10:24:07.064997 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 33/68] 10.222.0.50 () {60 vars in 1164 bytes} [Mon Oct 24 10:24:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:07.077164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a794bdc8-358c-477b-bca8-016dd47dcbb8 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:07.078869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a794bdc8-358c-477b-bca8-016dd47dcbb8 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '579ff076ba0242369042cbadcc806aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581cecbb5efb45e4b48bca78f37498f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a794bdc8-358c-477b-bca8-016dd47dcbb8 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Request method failure captured: Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVme-PPKkmxASlg69UtdoomfOXdFifBcxm_XPojQ4Zjy2tLTpu00Ky-GrOHJ0K502yerf7W1amENxUxHuJdUGk9bmsVHMioPz_9i5U9YbihcdG-_6KB31jfY3nqQPAmGPhJ6WtqiUhfnJWuZTniQ-2xB8Lp6qY22kzbWmq3MVrRl8PH0 Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 581cecbb5efb45e4b48bca78f37498f4 Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1824377028 Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:24:07.080689 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:24:07.082008 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/581cecbb5efb45e4b48bca78f37498f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/581cecbb5efb45e4b48bca78f37498f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/581cecbb5efb45e4b48bca78f37498f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_581cecbb5efb45e4b48bca78f37498f4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:07.082008 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1824377028 Oct 24 10:24:07.082008 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 581cecbb5efb45e4b48bca78f37498f4 Oct 24 10:24:07.082008 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1824377028 Oct 24 10:24:07.082008 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AggregatesAdminNegativeTestJSON-1824377028-project Oct 24 10:24:07.082008 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:07.082008 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:07.082008 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 579ff076ba0242369042cbadcc806aef Oct 24 10:24:07.082008 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1824377028-project Oct 24 10:24:07.082008 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:07.082008 n-d-858383-15 devstack@n-api.service[120426]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 24 10:24:07.082008 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '7'} Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:07.082819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:07.084915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:07.084915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:07.084915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:07.084915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:07.084915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:07.084915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 24 10:24:07.084915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.084915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:07.084915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.084915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:07.084915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:07.084915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:07.084915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:07.084915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:07.084915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 24 10:24:07.084915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.084915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a794bdc8-358c-477b-bca8-016dd47dcbb8 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:07.086134 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a794bdc8-358c-477b-bca8-016dd47dcbb8 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.013496 Oct 24 10:24:07.089794 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 34/69] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:24:07 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:07.097321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-693b1ba1-d6ca-4ff5-81e8-4d6a55f6e71a tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:07.127309 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-693b1ba1-d6ca-4ff5-81e8-4d6a55f6e71a tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.036087 Oct 24 10:24:07.129608 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 35/70] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:24:07 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 24 10:24:07.141758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2e2799c4-7e85-4278-9912-d32adb05ccd8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:07.157023 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-2e2799c4-7e85-4278-9912-d32adb05ccd8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2e2799c4-7e85-4278-9912-d32adb05ccd8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Request method failure captured: Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfA48W2RXlFYPfdKqb8r_nHINmQwJGF39j8kzLHpavwwHU6XqshPkFBHsyagxHy988VOmL_1dG6CY-Wg-YyFF3ftJBudJ22H_fPhqxowj3G14jpqizf-T-eaoo_4M8iZsP7GH-GR3AkkKNJf2n5BeazeRftoqyZuaDn7m-8qWL7Hn0 Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 374e5d25c2884ae2a7e0cb9b4a15bf6a Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:24:07.158837 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:24:07.160086 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_374e5d25c2884ae2a7e0cb9b4a15bf6a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:07.160086 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:07.160086 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 374e5d25c2884ae2a7e0cb9b4a15bf6a Oct 24 10:24:07.160086 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:07.160086 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin Oct 24 10:24:07.160086 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:07.160086 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:07.160086 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 1002979e5f6841f880feee4608ac23a6 Oct 24 10:24:07.160086 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin Oct 24 10:24:07.160086 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:07.160086 n-d-858383-15 devstack@n-api.service[120426]: exception: Aggregate -1 could not be found. Oct 24 10:24:07.160086 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '-1'} Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 24 10:24:07.160775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.162302 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:07.163741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:07.163741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:07.163741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:07.163741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:07.163741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 24 10:24:07.163741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.165213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2e2799c4-7e85-4278-9912-d32adb05ccd8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:07.166239 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2e2799c4-7e85-4278-9912-d32adb05ccd8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.031453 Oct 24 10:24:07.167276 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 36/71] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Oct 24 10:24:07 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 24 10:24:07.176374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ae4ef521-e3ef-44c2-b4e2-711e6ecb56ba tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1092519483"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:07.180994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.aggregate [None req-ae4ef521-e3ef-44c2-b4e2-711e6ecb56ba tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Generated uuid 8b0c6b06-3e9b-4f72-904d-dd1f4ffb55f9 for aggregate {{(pid=120426) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:07.210804 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ae4ef521-e3ef-44c2-b4e2-711e6ecb56ba tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038564 Oct 24 10:24:07.216819 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 37/72] 10.222.0.50 () {60 vars in 1164 bytes} [Mon Oct 24 10:24:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:07.233417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-72db33f7-4883-4b14-859f-197d374c0015 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:07.235075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-72db33f7-4883-4b14-859f-197d374c0015 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '579ff076ba0242369042cbadcc806aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581cecbb5efb45e4b48bca78f37498f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-72db33f7-4883-4b14-859f-197d374c0015 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Request method failure captured: Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVme-PPKkmxASlg69UtdoomfOXdFifBcxm_XPojQ4Zjy2tLTpu00Ky-GrOHJ0K502yerf7W1amENxUxHuJdUGk9bmsVHMioPz_9i5U9YbihcdG-_6KB31jfY3nqQPAmGPhJ6WtqiUhfnJWuZTniQ-2xB8Lp6qY22kzbWmq3MVrRl8PH0 Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 581cecbb5efb45e4b48bca78f37498f4 Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1824377028 Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:24:07.237833 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:24:07.238926 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/581cecbb5efb45e4b48bca78f37498f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/581cecbb5efb45e4b48bca78f37498f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/581cecbb5efb45e4b48bca78f37498f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_581cecbb5efb45e4b48bca78f37498f4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:07.238926 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1824377028 Oct 24 10:24:07.238926 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 581cecbb5efb45e4b48bca78f37498f4 Oct 24 10:24:07.238926 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1824377028 Oct 24 10:24:07.238926 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AggregatesAdminNegativeTestJSON-1824377028-project Oct 24 10:24:07.238926 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:07.238926 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:07.238926 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 579ff076ba0242369042cbadcc806aef Oct 24 10:24:07.238926 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1824377028-project Oct 24 10:24:07.238926 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:07.238926 n-d-858383-15 devstack@n-api.service[120426]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 24 10:24:07.238926 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '8'} Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:07.239992 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:07.240946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:07.240946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:07.240946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:07.240946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:07.240946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:07.240946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 24 10:24:07.240946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.240946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:07.240946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.240946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:07.240946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:07.240946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:07.240946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:07.240946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:07.240946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 24 10:24:07.240946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.240946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-72db33f7-4883-4b14-859f-197d374c0015 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:07.243274 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-72db33f7-4883-4b14-859f-197d374c0015 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] 10.222.0.50 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.015124 Oct 24 10:24:07.243274 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 38/73] 10.222.0.50 () {58 vars in 1149 bytes} [Mon Oct 24 10:24:07 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:24:07.617272 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f3099abc-1372-4144-a4cf-afc75a6dfc3a tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1874377133/action" status: 200 len: 21 microversion: 2.1 time: 1.240287 Oct 24 10:24:07.619171 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 36/74] 10.222.0.50 () {60 vars in 1200 bytes} [Mon Oct 24 10:24:06 2022] POST /compute/v2.1/flavors/1874377133/action => generated 21 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:24:07.626119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fab10240-2b40-4dcf-b4a1-f0ea74f65ff0 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:07.682061 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fab10240-2b40-4dcf-b4a1-f0ea74f65ff0 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.061226 Oct 24 10:24:07.683393 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 37/75] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:24:07 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:24:07.699823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4a5d4d52-6dbc-4d50-93a0-7ef97817e775 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:07.747121 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4a5d4d52-6dbc-4d50-93a0-7ef97817e775 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1874377133" status: 202 len: 0 microversion: 2.1 time: 0.062294 Oct 24 10:24:07.748252 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 38/76] 10.222.0.50 () {58 vars in 1161 bytes} [Mon Oct 24 10:24:07 2022] DELETE /compute/v2.1/flavors/1874377133 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:24:07.760014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d79c94f6-47b8-4adb-9fa4-f776ca9b358b tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:07.777307 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-d79c94f6-47b8-4adb-9fa4-f776ca9b358b tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d79c94f6-47b8-4adb-9fa4-f776ca9b358b tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Request method failure captured: Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfA48W2RXlFYPfdKqb8r_nHINmQwJGF39j8kzLHpavwwHU6XqshPkFBHsyagxHy988VOmL_1dG6CY-Wg-YyFF3ftJBudJ22H_fPhqxowj3G14jpqizf-T-eaoo_4M8iZsP7GH-GR3AkkKNJf2n5BeazeRftoqyZuaDn7m-8qWL7Hn0 Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 374e5d25c2884ae2a7e0cb9b4a15bf6a Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:24:07.779927 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:24:07.781180 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_374e5d25c2884ae2a7e0cb9b4a15bf6a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:07.781180 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:07.781180 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 374e5d25c2884ae2a7e0cb9b4a15bf6a Oct 24 10:24:07.781180 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:07.781180 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin Oct 24 10:24:07.781180 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:07.781180 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:07.781180 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 1002979e5f6841f880feee4608ac23a6 Oct 24 10:24:07.781180 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin Oct 24 10:24:07.781180 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:24:07.781180 n-d-858383-15 devstack@n-api.service[120425]: exception: Aggregate -1 could not be found. Oct 24 10:24:07.781180 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '-1'} Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:07.781778 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:07.782773 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:07.782773 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:07.782773 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:07.782773 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:07.782773 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:07.782773 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 24 10:24:07.782773 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:24:07.782773 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 24 10:24:07.782773 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.782773 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:07.782773 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.782773 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:07.782773 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:07.782773 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:07.782773 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:07.782773 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:07.782773 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 24 10:24:07.782773 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.786072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d79c94f6-47b8-4adb-9fa4-f776ca9b358b tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:07.792707 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d79c94f6-47b8-4adb-9fa4-f776ca9b358b tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.043082 Oct 24 10:24:07.793874 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 39/77] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:24:07 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:24:07.800360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d3665bac-6ed2-473e-8d05-de03583d97f0 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:07.855314 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d3665bac-6ed2-473e-8d05-de03583d97f0 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060063 Oct 24 10:24:07.883338 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 40/78] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:24:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:07.888239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2d117c12-962f-4554-a981-1f556aa98539 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:07.899278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2d117c12-962f-4554-a981-1f556aa98539 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '579ff076ba0242369042cbadcc806aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581cecbb5efb45e4b48bca78f37498f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2d117c12-962f-4554-a981-1f556aa98539 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Request method failure captured: Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVme-PPKkmxASlg69UtdoomfOXdFifBcxm_XPojQ4Zjy2tLTpu00Ky-GrOHJ0K502yerf7W1amENxUxHuJdUGk9bmsVHMioPz_9i5U9YbihcdG-_6KB31jfY3nqQPAmGPhJ6WtqiUhfnJWuZTniQ-2xB8Lp6qY22kzbWmq3MVrRl8PH0 Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 581cecbb5efb45e4b48bca78f37498f4 Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1824377028 Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:24:07.900929 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:24:07.902087 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/581cecbb5efb45e4b48bca78f37498f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/581cecbb5efb45e4b48bca78f37498f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/581cecbb5efb45e4b48bca78f37498f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_581cecbb5efb45e4b48bca78f37498f4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:07.902087 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1824377028 Oct 24 10:24:07.902087 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 581cecbb5efb45e4b48bca78f37498f4 Oct 24 10:24:07.902087 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1824377028 Oct 24 10:24:07.902087 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AggregatesAdminNegativeTestJSON-1824377028-project Oct 24 10:24:07.902087 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:07.902087 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:07.902087 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 579ff076ba0242369042cbadcc806aef Oct 24 10:24:07.902087 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1824377028-project Oct 24 10:24:07.902087 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:24:07.902087 n-d-858383-15 devstack@n-api.service[120425]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 24 10:24:07.902087 n-d-858383-15 devstack@n-api.service[120425]: action_args: {} Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:07.902925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:07.903900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:07.903900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:07.903900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:07.903900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:07.903900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:07.903900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 24 10:24:07.903900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.903900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:07.903900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.903900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:07.903900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:07.903900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:07.903900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:07.903900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:07.903900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 24 10:24:07.903900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:07.908631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2d117c12-962f-4554-a981-1f556aa98539 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:07.917011 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2d117c12-962f-4554-a981-1f556aa98539 tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.025115 Oct 24 10:24:07.917966 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 41/79] 10.222.0.50 () {58 vars in 1143 bytes} [Mon Oct 24 10:24:07 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:07.943736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-16eb259e-4321-4ae8-8005-cb61d5e94d8f tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1779015969", "id": 1996105336, "os-flavor-access:is_public": "False"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:07.963343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=8,nova_api:DELETE=16 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:07.968457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-8117492", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "availability_zone": "tempest-test_az-1244601053"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:07.984967 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-16eb259e-4321-4ae8-8005-cb61d5e94d8f tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.062442 Oct 24 10:24:07.994576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:07.995030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:07.995474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:07.996207 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 42/80] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:24:07 2022] POST /compute/v2.1/flavors => generated 439 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:08.001011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c598a0e7-008f-4264-98f1-678374922b2d tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "59326217eec444b89defc1a1533361e5"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:08.002424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:08.002932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:08.005574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:08.596444 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-c598a0e7-008f-4264-98f1-678374922b2d tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] HTTP exception thrown: Flavor access not found for 21 / 59326217eec444b89defc1a1533361e5 combination. Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c598a0e7-008f-4264-98f1-678374922b2d tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Request method failure captured: Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/flavors/1996105336/action HTTP/1.1 Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 70 Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfAGH4VcnpG199IkP8VMJSqSH0q2L7cwM7jSowl8HAWe1C7YUr0Xge1__Ut4vJY_war0J0pdzXCwSZq3hdm9BmVTl4QNBu5EZQBT7eVBxF8BviNZtIzMNRUfXwi75wUnBI5NFaza5FLewFgCIRHtcTrftLvVcQM1PLIDX6c-YnUlrk Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: a6f0aa0588d34154a08bfa914e3ba9d2 Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-824024383 Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:24:08.600170 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:24:08.601237 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6f0aa0588d34154a08bfa914e3ba9d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6f0aa0588d34154a08bfa914e3ba9d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a6f0aa0588d34154a08bfa914e3ba9d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a6f0aa0588d34154a08bfa914e3ba9d2", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:08.601237 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-824024383 Oct 24 10:24:08.601237 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: a6f0aa0588d34154a08bfa914e3ba9d2 Oct 24 10:24:08.601237 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-824024383 Oct 24 10:24:08.601237 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin Oct 24 10:24:08.601237 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:08.601237 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:08.601237 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 543f7171da6d4faf95797a79d2e9169a Oct 24 10:24:08.601237 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin Oct 24 10:24:08.601237 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:24:08.601237 n-d-858383-15 devstack@n-api.service[120425]: {"removeTenantAccess": {"tenant": "59326217eec444b89defc1a1533361e5"}} Oct 24 10:24:08.601237 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:24:08.601877 n-d-858383-15 devstack@n-api.service[120425]: exception: Flavor access not found for 21 / 59326217eec444b89defc1a1533361e5 combination. Oct 24 10:24:08.601877 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '1996105336', 'body': {'removeTenantAccess': {'tenant': '59326217eec444b89defc1a1533361e5'}}} Oct 24 10:24:08.601877 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:08.601877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:08.601877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 24 10:24:08.601877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 24 10:24:08.601877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 24 10:24:08.601877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 24 10:24:08.601877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 24 10:24:08.601877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 24 10:24:08.601877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 24 10:24:08.601877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 24 10:24:08.601877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 24 10:24:08.601877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 24 10:24:08.601877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:24:08.601877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:24:08.601877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 24 10:24:08.601877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 21 / 59326217eec444b89defc1a1533361e5 combination. Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 21 / 59326217eec444b89defc1a1533361e5 combination. Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:08.602874 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:08.603814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:08.603814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:08.603814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:08.603814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:08.603814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 21 / 59326217eec444b89defc1a1533361e5 combination. Oct 24 10:24:08.603814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:08.603814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c598a0e7-008f-4264-98f1-678374922b2d tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Returning 404 to user: Flavor access not found for 21 / 59326217eec444b89defc1a1533361e5 combination. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:08.603814 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c598a0e7-008f-4264-98f1-678374922b2d tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1996105336/action" status: 404 len: 124 microversion: 2.1 time: 0.603549 Oct 24 10:24:08.604998 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 43/81] 10.222.0.50 () {60 vars in 1200 bytes} [Mon Oct 24 10:24:07 2022] POST /compute/v2.1/flavors/1996105336/action => generated 124 bytes in 608 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:08.620549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-14093ff5-3c8a-4d2b-be9c-fbc6e367d059 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:08.645480 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-14093ff5-3c8a-4d2b-be9c-fbc6e367d059 tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1996105336" status: 202 len: 0 microversion: 2.1 time: 0.035412 Oct 24 10:24:08.646510 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 44/82] 10.222.0.50 () {58 vars in 1161 bytes} [Mon Oct 24 10:24:08 2022] DELETE /compute/v2.1/flavors/1996105336 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:24:08.657503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7508eed6-7658-4ead-ba95-d435fe0d038b tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:08.681921 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7508eed6-7658-4ead-ba95-d435fe0d038b tempest-FlavorsAccessNegativeTestJSON-824024383 tempest-FlavorsAccessNegativeTestJSON-824024383-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028243 Oct 24 10:24:08.694762 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 45/83] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:24:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:09.138327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:24:09.701257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:24:09.701924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:24:09.703127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:24:09.703730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:24:09.704482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:24:09.743882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:09.744393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:09.744882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:09.748545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:09.749396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:09.752081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:09.827425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Getting quotas for project bdc7632d3e704c27abeeedb0e3fab434. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:24:09.838580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Getting quotas for user 8c6e751686ba42339301446509eb8a5b and project bdc7632d3e704c27abeeedb0e3fab434. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:24:09.854081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:24:09.860188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:24:10.000061 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7babcd2f-1ff2-4e44-98f8-2893a64fbad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.756648 Oct 24 10:24:10.003839 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 39/84] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:24:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:24:10.019397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9c5f074a-e425-405d-834c-fa9046cdaa47 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:10.020194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9c5f074a-e425-405d-834c-fa9046cdaa47 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:10.201164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9c5f074a-e425-405d-834c-fa9046cdaa47 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:10.243932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b6c46427-adab-4579-baf3-00713f1cdcbe tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Calling method '.version_select at 0x7f04d2f29310>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:10.246312 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9c5f074a-e425-405d-834c-fa9046cdaa47 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1240 microversion: 2.1 time: 0.233524 Oct 24 10:24:10.246456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6c46427-adab-4579-baf3-00713f1cdcbe tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:10.247023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6c46427-adab-4579-baf3-00713f1cdcbe tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:10.247351 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 40/85] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:10 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1240 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:10.247672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6c46427-adab-4579-baf3-00713f1cdcbe tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:10.310016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:10.314593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6c46427-adab-4579-baf3-00713f1cdcbe tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:10.315369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6c46427-adab-4579-baf3-00713f1cdcbe tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:10.316455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6c46427-adab-4579-baf3-00713f1cdcbe tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:10.352804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6c46427-adab-4579-baf3-00713f1cdcbe tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:10.354414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6c46427-adab-4579-baf3-00713f1cdcbe tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:10.356707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6c46427-adab-4579-baf3-00713f1cdcbe tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:10.375786 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b6c46427-adab-4579-baf3-00713f1cdcbe tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 1.010980 Oct 24 10:24:10.377024 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 46/86] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:24:09 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:24:10.388657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c748e8cd-d21c-48f4-a9d1-d8764acfc408 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Calling method '.version_select at 0x7f04d17fc790>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:10.407680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c748e8cd-d21c-48f4-a9d1-d8764acfc408 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),75e76125-592d-4292-bea1-3b51451d7165(cell1) {{(pid=120426) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 24 10:24:10.409978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c748e8cd-d21c-48f4-a9d1-d8764acfc408 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:10.412697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c748e8cd-d21c-48f4-a9d1-d8764acfc408 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:10.414130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c748e8cd-d21c-48f4-a9d1-d8764acfc408 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:10.461289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c748e8cd-d21c-48f4-a9d1-d8764acfc408 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:10.462499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c748e8cd-d21c-48f4-a9d1-d8764acfc408 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:10.463106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c748e8cd-d21c-48f4-a9d1-d8764acfc408 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:10.549545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c748e8cd-d21c-48f4-a9d1-d8764acfc408 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:10.550766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c748e8cd-d21c-48f4-a9d1-d8764acfc408 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:10.552300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c748e8cd-d21c-48f4-a9d1-d8764acfc408 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:10.560698 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c748e8cd-d21c-48f4-a9d1-d8764acfc408 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/n-h1-858383-15/servers" status: 200 len: 105 microversion: 2.1 time: 0.176695 Oct 24 10:24:10.561962 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 41/87] 10.222.0.50 () {58 vars in 1215 bytes} [Mon Oct 24 10:24:10 2022] GET /compute/v2.1/os-hypervisors/n-h1-858383-15/servers => generated 105 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:10.576734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-865b4b16-0205-48ed-9f47-1e4bc82af23e tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Calling method '.version_select at 0x7f04d18c3940>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:10.580082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-865b4b16-0205-48ed-9f47-1e4bc82af23e tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:10.580988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-865b4b16-0205-48ed-9f47-1e4bc82af23e tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:10.581987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-865b4b16-0205-48ed-9f47-1e4bc82af23e tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:10.615019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-865b4b16-0205-48ed-9f47-1e4bc82af23e tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:10.616715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-865b4b16-0205-48ed-9f47-1e4bc82af23e tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:10.617195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-865b4b16-0205-48ed-9f47-1e4bc82af23e tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:10.641998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-865b4b16-0205-48ed-9f47-1e4bc82af23e tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:10.642736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-865b4b16-0205-48ed-9f47-1e4bc82af23e tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:10.643324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-865b4b16-0205-48ed-9f47-1e4bc82af23e tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:10.650481 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-865b4b16-0205-48ed-9f47-1e4bc82af23e tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.079056 Oct 24 10:24:10.651795 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 47/88] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:24:10 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:10.665330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9a0878da-eb2f-4ed2-8927-e5d81ee1dee7 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Calling method '.version_select at 0x7f04d19f31f0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:10.669899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a0878da-eb2f-4ed2-8927-e5d81ee1dee7 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:10.670407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a0878da-eb2f-4ed2-8927-e5d81ee1dee7 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:10.671269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a0878da-eb2f-4ed2-8927-e5d81ee1dee7 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:10.707744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a0878da-eb2f-4ed2-8927-e5d81ee1dee7 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:10.711829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a0878da-eb2f-4ed2-8927-e5d81ee1dee7 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:10.712943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a0878da-eb2f-4ed2-8927-e5d81ee1dee7 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:10.729638 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9a0878da-eb2f-4ed2-8927-e5d81ee1dee7 tempest-HypervisorAdminUnderV252Test-30949525 tempest-HypervisorAdminUnderV252Test-30949525-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/n-h1-858383-15/search" status: 200 len: 105 microversion: 2.1 time: 0.071115 Oct 24 10:24:10.739074 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 42/89] 10.222.0.50 () {58 vars in 1212 bytes} [Mon Oct 24 10:24:10 2022] GET /compute/v2.1/os-hypervisors/n-h1-858383-15/search => generated 105 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:11.272640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0ceb1569-d2b2-4686-9a2b-d2a66d4e072a tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:11.273327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0ceb1569-d2b2-4686-9a2b-d2a66d4e072a tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:11.383037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0ceb1569-d2b2-4686-9a2b-d2a66d4e072a tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:11.391908 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0ceb1569-d2b2-4686-9a2b-d2a66d4e072a tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1240 microversion: 2.1 time: 0.124258 Oct 24 10:24:11.392501 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 43/90] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:11 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1240 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:11.764992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a971b8b5-bc33-4044-a0b9-e72b9efd7b8e tempest-FlavorsV261TestJSON-282602046 tempest-FlavorsV261TestJSON-282602046-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-998925965", "id": 1148450172, "os-flavor-access:is_public": "True"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:11.834493 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a971b8b5-bc33-4044-a0b9-e72b9efd7b8e tempest-FlavorsV261TestJSON-282602046 tempest-FlavorsV261TestJSON-282602046-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.742575 Oct 24 10:24:11.844743 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 48/91] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Oct 24 10:24:11 2022] POST /compute/v2.1/flavors => generated 467 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:24:12.410581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5b8e5479-2439-4109-94af-127d4f1a40b8 tempest-FlavorsV261TestJSON-1295676591 tempest-FlavorsV261TestJSON-1295676591-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:12.419664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-afa3bd51-7240-433c-a26c-6b2f21299179 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:12.420576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-afa3bd51-7240-433c-a26c-6b2f21299179 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:12.439656 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5b8e5479-2439-4109-94af-127d4f1a40b8 tempest-FlavorsV261TestJSON-1295676591 tempest-FlavorsV261TestJSON-1295676591-project] 10.222.0.50 "GET /compute/v2.1/flavors/1148450172" status: 200 len: 467 microversion: 2.61 time: 0.594497 Oct 24 10:24:12.444293 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 44/92] 10.222.0.50 () {60 vars in 1199 bytes} [Mon Oct 24 10:24:11 2022] GET /compute/v2.1/flavors/1148450172 => generated 467 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 10:24:12.464162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ad20a7ef-059c-4641-b3c2-e1648ca2d9b8 tempest-FlavorsV261TestJSON-282602046 tempest-FlavorsV261TestJSON-282602046-project-admin] Action: 'update', calling method: .version_select at 0x7f04d2a9cf70>, body: {"flavor": {"description": "new"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:12.464811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afa3bd51-7240-433c-a26c-6b2f21299179 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:12.468011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afa3bd51-7240-433c-a26c-6b2f21299179 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:12.468466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afa3bd51-7240-433c-a26c-6b2f21299179 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:12.469243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afa3bd51-7240-433c-a26c-6b2f21299179 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:12.474091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afa3bd51-7240-433c-a26c-6b2f21299179 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:12.477003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afa3bd51-7240-433c-a26c-6b2f21299179 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:12.616233 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ad20a7ef-059c-4641-b3c2-e1648ca2d9b8 tempest-FlavorsV261TestJSON-282602046 tempest-FlavorsV261TestJSON-282602046-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/1148450172" status: 200 len: 468 microversion: 2.61 time: 0.149263 Oct 24 10:24:12.617514 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 45/93] 10.222.0.50 () {62 vars in 1219 bytes} [Mon Oct 24 10:24:12 2022] PUT /compute/v2.1/flavors/1148450172 => generated 468 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 10:24:12.637912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e136aa3e-7eca-4aaf-86fe-3e56667abe58 tempest-FlavorsV261TestJSON-1295676591 tempest-FlavorsV261TestJSON-1295676591-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:12.732091 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e136aa3e-7eca-4aaf-86fe-3e56667abe58 tempest-FlavorsV261TestJSON-1295676591 tempest-FlavorsV261TestJSON-1295676591-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.103839 Oct 24 10:24:12.741815 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 46/94] 10.222.0.50 () {60 vars in 1187 bytes} [Mon Oct 24 10:24:12 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:24:12.765110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-61ae1627-b797-4767-a421-68c7a270bc4e tempest-FlavorsV261TestJSON-1295676591 tempest-FlavorsV261TestJSON-1295676591-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:12.845254 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-61ae1627-b797-4767-a421-68c7a270bc4e tempest-FlavorsV261TestJSON-1295676591 tempest-FlavorsV261TestJSON-1295676591-project] 10.222.0.50 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.088981 Oct 24 10:24:12.847050 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 47/95] 10.222.0.50 () {60 vars in 1166 bytes} [Mon Oct 24 10:24:12 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:24:12.868373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1f095c7d-da0c-4a95-986d-f8ed4a6b7059 tempest-FlavorsV261TestJSON-282602046 tempest-FlavorsV261TestJSON-282602046-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:12.906108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=9,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:12.917612 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1f095c7d-da0c-4a95-986d-f8ed4a6b7059 tempest-FlavorsV261TestJSON-282602046 tempest-FlavorsV261TestJSON-282602046-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1148450172" status: 202 len: 0 microversion: 2.61 time: 0.058071 Oct 24 10:24:12.918968 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 48/96] 10.222.0.50 () {60 vars in 1202 bytes} [Mon Oct 24 10:24:12 2022] DELETE /compute/v2.1/flavors/1148450172 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:24:12.931066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-340f5497-65cf-4d3e-b08a-8086cd8ea29f tempest-FlavorsV261TestJSON-282602046 tempest-FlavorsV261TestJSON-282602046-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:12.985989 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-340f5497-65cf-4d3e-b08a-8086cd8ea29f tempest-FlavorsV261TestJSON-282602046 tempest-FlavorsV261TestJSON-282602046-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.062632 Oct 24 10:24:12.988471 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 49/97] 10.222.0.50 () {60 vars in 1187 bytes} [Mon Oct 24 10:24:12 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:24:13.835856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-afa3bd51-7240-433c-a26c-6b2f21299179 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:13.899069 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-afa3bd51-7240-433c-a26c-6b2f21299179 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1240 microversion: 2.1 time: 1.477437 Oct 24 10:24:13.900595 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 49/98] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:12 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1240 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:14.926139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-38b94d15-45a8-43bf-856e-1d788ba9d67d tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:14.926795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-38b94d15-45a8-43bf-856e-1d788ba9d67d tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:14.938328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38b94d15-45a8-43bf-856e-1d788ba9d67d tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:14.938590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38b94d15-45a8-43bf-856e-1d788ba9d67d tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:14.939031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38b94d15-45a8-43bf-856e-1d788ba9d67d tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:14.943549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38b94d15-45a8-43bf-856e-1d788ba9d67d tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:14.944087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38b94d15-45a8-43bf-856e-1d788ba9d67d tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:14.944536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38b94d15-45a8-43bf-856e-1d788ba9d67d tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:15.237728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-38b94d15-45a8-43bf-856e-1d788ba9d67d tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:15.265915 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-38b94d15-45a8-43bf-856e-1d788ba9d67d tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1294 microversion: 2.1 time: 0.344146 Oct 24 10:24:15.277147 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 50/99] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:14 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1294 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:15.955577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a7b5bf9e-1e1d-4138-bfc1-a1179a834a6d tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-831071942", "ram": 512, "vcpus": 1, "disk": 10, "id": 1706525223, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:15.986643 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a7b5bf9e-1e1d-4138-bfc1-a1179a834a6d tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.518715 Oct 24 10:24:15.987984 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 50/100] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:24:15 2022] POST /compute/v2.1/flavors => generated 415 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:16.280891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-235e4cef-1538-42eb-ba5e-b5c0a1b38104 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:16.295399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33eeb295-b7a4-47ab-81d5-7a28f8956971 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:16.296638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-33eeb295-b7a4-47ab-81d5-7a28f8956971 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:16.307364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:16.312418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33eeb295-b7a4-47ab-81d5-7a28f8956971 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:16.317136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33eeb295-b7a4-47ab-81d5-7a28f8956971 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:16.318144 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-235e4cef-1538-42eb-ba5e-b5c0a1b38104 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] HTTP exception thrown: Flavor 1706525223 has no extra specs with key hw:cpu_thread_policy. Oct 24 10:24:16.321071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33eeb295-b7a4-47ab-81d5-7a28f8956971 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:16.323841 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33eeb295-b7a4-47ab-81d5-7a28f8956971 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:16.324445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33eeb295-b7a4-47ab-81d5-7a28f8956971 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-235e4cef-1538-42eb-ba5e-b5c0a1b38104 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] Request method failure captured: Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/flavors/1706525223/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfLxz6t0P2uVzOhowjHx2lwa30BLx683BuF800BmO5OUsOgDbFH4tA9Aytudc4va_zx09S_l-8zVQeKhZVLPZ7ZZjvPrXN1rL6GtSM0tLPJJfeeVb_xm4D7UsKqI8di-qnE_AeAJtYMdhlZqzYkV_R7Zp7arRNAZwHY-rXy0YoQxx8 Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 5ed642140f0045a280473de02c27febf Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:24:16.328064 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:24:16.329774 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ed642140f0045a280473de02c27febf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ed642140f0045a280473de02c27febf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ed642140f0045a280473de02c27febf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ed642140f0045a280473de02c27febf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:16.329774 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 Oct 24 10:24:16.329774 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 5ed642140f0045a280473de02c27febf Oct 24 10:24:16.329774 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 Oct 24 10:24:16.329774 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project Oct 24 10:24:16.329774 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:16.329774 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:16.329774 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a5e29018b419485d9a57486f759dddac Oct 24 10:24:16.329774 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project Oct 24 10:24:16.329774 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:16.329774 n-d-858383-15 devstack@n-api.service[120426]: exception: Flavor 1706525223 has no extra specs with key hw:cpu_thread_policy. Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'flavor_id': '1706525223', 'id': 'hw:cpu_thread_policy'} Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1706525223 has no extra specs with key hw:cpu_thread_policy. Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:16.330767 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.332360 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:16.332360 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:16.332360 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:16.332360 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:16.332360 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:16.332360 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1706525223 has no extra specs with key hw:cpu_thread_policy. Oct 24 10:24:16.332360 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.337842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33eeb295-b7a4-47ab-81d5-7a28f8956971 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:16.338799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-235e4cef-1538-42eb-ba5e-b5c0a1b38104 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] Returning 404 to user: Flavor 1706525223 has no extra specs with key hw:cpu_thread_policy. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:16.341643 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-235e4cef-1538-42eb-ba5e-b5c0a1b38104 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] 10.222.0.50 "GET /compute/v2.1/flavors/1706525223/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.342102 Oct 24 10:24:16.352089 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 51/101] 10.222.0.50 () {58 vars in 1266 bytes} [Mon Oct 24 10:24:15 2022] GET /compute/v2.1/flavors/1706525223/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 354 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:16.378457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0c9f972b-edc9-4738-9589-50fb304df323 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:16.385864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0c9f972b-edc9-4738-9589-50fb304df323 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'a5e29018b419485d9a57486f759dddac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed642140f0045a280473de02c27febf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0c9f972b-edc9-4738-9589-50fb304df323 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] Request method failure captured: Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/flavors/1706525223/os-extra_specs HTTP/1.1 Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 66 Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfLxz6t0P2uVzOhowjHx2lwa30BLx683BuF800BmO5OUsOgDbFH4tA9Aytudc4va_zx09S_l-8zVQeKhZVLPZ7ZZjvPrXN1rL6GtSM0tLPJJfeeVb_xm4D7UsKqI8di-qnE_AeAJtYMdhlZqzYkV_R7Zp7arRNAZwHY-rXy0YoQxx8 Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 5ed642140f0045a280473de02c27febf Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:24:16.405701 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:24:16.407398 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ed642140f0045a280473de02c27febf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ed642140f0045a280473de02c27febf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ed642140f0045a280473de02c27febf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ed642140f0045a280473de02c27febf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:16.407398 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 Oct 24 10:24:16.407398 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 5ed642140f0045a280473de02c27febf Oct 24 10:24:16.407398 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 Oct 24 10:24:16.407398 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project Oct 24 10:24:16.407398 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:16.407398 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:16.407398 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a5e29018b419485d9a57486f759dddac Oct 24 10:24:16.407398 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project Oct 24 10:24:16.407398 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:24:16.407398 n-d-858383-15 devstack@n-api.service[120426]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 24 10:24:16.407398 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'flavor_id': '1706525223', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:16.408335 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 24 10:24:16.409676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.412522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0c9f972b-edc9-4738-9589-50fb304df323 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:16.419698 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0c9f972b-edc9-4738-9589-50fb304df323 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] 10.222.0.50 "POST /compute/v2.1/flavors/1706525223/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.066242 Oct 24 10:24:16.420444 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 52/102] 10.222.0.50 () {60 vars in 1224 bytes} [Mon Oct 24 10:24:16 2022] POST /compute/v2.1/flavors/1706525223/os-extra_specs => generated 124 bytes in 68 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:16.433057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4591085d-65c9-4512-b6eb-ece60c27a35c tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:16.526886 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4591085d-65c9-4512-b6eb-ece60c27a35c tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1706525223/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.097439 Oct 24 10:24:16.534634 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 53/103] 10.222.0.50 () {60 vars in 1224 bytes} [Mon Oct 24 10:24:16 2022] POST /compute/v2.1/flavors/1706525223/os-extra_specs => generated 66 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:24:16.542050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6571e04d-7b26-4ac2-8c65-ba837acdad5f tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:16.544757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6571e04d-7b26-4ac2-8c65-ba837acdad5f tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'a5e29018b419485d9a57486f759dddac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed642140f0045a280473de02c27febf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6571e04d-7b26-4ac2-8c65-ba837acdad5f tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] Request method failure captured: Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/flavors/1706525223/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfLxz6t0P2uVzOhowjHx2lwa30BLx683BuF800BmO5OUsOgDbFH4tA9Aytudc4va_zx09S_l-8zVQeKhZVLPZ7ZZjvPrXN1rL6GtSM0tLPJJfeeVb_xm4D7UsKqI8di-qnE_AeAJtYMdhlZqzYkV_R7Zp7arRNAZwHY-rXy0YoQxx8 Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 5ed642140f0045a280473de02c27febf Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:24:16.547987 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:24:16.549278 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ed642140f0045a280473de02c27febf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ed642140f0045a280473de02c27febf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ed642140f0045a280473de02c27febf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ed642140f0045a280473de02c27febf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:16.549278 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 Oct 24 10:24:16.549278 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 5ed642140f0045a280473de02c27febf Oct 24 10:24:16.549278 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 Oct 24 10:24:16.549278 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project Oct 24 10:24:16.549278 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:16.549278 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:16.549278 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a5e29018b419485d9a57486f759dddac Oct 24 10:24:16.549278 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project Oct 24 10:24:16.549278 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:16.549278 n-d-858383-15 devstack@n-api.service[120426]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'flavor_id': '1706525223', 'id': 'hw:numa_nodes'} Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:16.549835 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:16.553764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:16.553764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:16.553764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:16.553764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:16.553764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:16.553764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 24 10:24:16.553764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.553764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:16.553764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.553764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:16.553764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:16.553764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:16.553764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:16.553764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:16.553764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 24 10:24:16.553764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.557488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6571e04d-7b26-4ac2-8c65-ba837acdad5f tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:16.558517 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6571e04d-7b26-4ac2-8c65-ba837acdad5f tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] 10.222.0.50 "DELETE /compute/v2.1/flavors/1706525223/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.022106 Oct 24 10:24:16.573264 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 54/104] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Oct 24 10:24:16 2022] DELETE /compute/v2.1/flavors/1706525223/os-extra_specs/hw:numa_nodes => generated 124 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:16.586567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eb2f4e02-ab3c-414f-86d2-2a5a97947481 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:16.698922 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-eb2f4e02-ab3c-414f-86d2-2a5a97947481 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1706525223/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.131697 Oct 24 10:24:16.700144 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 55/105] 10.222.0.50 () {60 vars in 1224 bytes} [Mon Oct 24 10:24:16 2022] POST /compute/v2.1/flavors/1706525223/os-extra_specs => generated 66 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:24:16.713815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-40682987-cc8d-4b0c-ab45-8e34cb1f0159 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:16.735251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-40682987-cc8d-4b0c-ab45-8e34cb1f0159 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'a5e29018b419485d9a57486f759dddac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed642140f0045a280473de02c27febf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-40682987-cc8d-4b0c-ab45-8e34cb1f0159 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] Request method failure captured: Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: request: PUT /compute/v2.1/flavors/1706525223/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 22 Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfLxz6t0P2uVzOhowjHx2lwa30BLx683BuF800BmO5OUsOgDbFH4tA9Aytudc4va_zx09S_l-8zVQeKhZVLPZ7ZZjvPrXN1rL6GtSM0tLPJJfeeVb_xm4D7UsKqI8di-qnE_AeAJtYMdhlZqzYkV_R7Zp7arRNAZwHY-rXy0YoQxx8 Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 5ed642140f0045a280473de02c27febf Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:24:16.742832 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:24:16.743931 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ed642140f0045a280473de02c27febf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ed642140f0045a280473de02c27febf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ed642140f0045a280473de02c27febf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ed642140f0045a280473de02c27febf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:16.743931 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 Oct 24 10:24:16.743931 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 5ed642140f0045a280473de02c27febf Oct 24 10:24:16.743931 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 Oct 24 10:24:16.743931 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project Oct 24 10:24:16.743931 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:16.743931 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:16.743931 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a5e29018b419485d9a57486f759dddac Oct 24 10:24:16.743931 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project Oct 24 10:24:16.743931 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:24:16.743931 n-d-858383-15 devstack@n-api.service[120426]: {"hw:numa_nodes": "1"} Oct 24 10:24:16.743931 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:16.743931 n-d-858383-15 devstack@n-api.service[120426]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'flavor_id': '1706525223', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:16.744651 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 24 10:24:16.745954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.766123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-40682987-cc8d-4b0c-ab45-8e34cb1f0159 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:16.774172 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-40682987-cc8d-4b0c-ab45-8e34cb1f0159 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523 tempest-FlavorsExtraSpecsNegativeTestJSON-1903497523-project] 10.222.0.50 "PUT /compute/v2.1/flavors/1706525223/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.067359 Oct 24 10:24:16.775058 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 56/106] 10.222.0.50 () {60 vars in 1265 bytes} [Mon Oct 24 10:24:16 2022] PUT /compute/v2.1/flavors/1706525223/os-extra_specs/hw:numa_nodes => generated 124 bytes in 69 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:24:16.786931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9517dc50-5719-4dbd-8ede-84eab06fd12c tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:16.804342 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-9517dc50-5719-4dbd-8ede-84eab06fd12c tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] HTTP exception thrown: Flavor 1706525223 has no extra specs with key hw:cpu_thread_policy. Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9517dc50-5719-4dbd-8ede-84eab06fd12c tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] Request method failure captured: Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/flavors/1706525223/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfPCKMQ6LZmHGepltSjnNx1oT1eA09sE_T_PaBtejidDAhm6tbSfZIZY-JGOf1C5toJOyxjWNhok4JkBtvadjp1Wkxc9N1qOgTQGV4eAlAMLvyROLKSiyWsn86wjfN8BGVvA2L0zamydcASSA74BaCgw7NhiUIb1vAV-Bpi0KgbZu4 Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 86555164a395453e8cfb69f049d09d29 Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:24:16.806288 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:24:16.807672 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/86555164a395453e8cfb69f049d09d29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/86555164a395453e8cfb69f049d09d29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/86555164a395453e8cfb69f049d09d29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_86555164a395453e8cfb69f049d09d29", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:16.807672 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 Oct 24 10:24:16.807672 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 86555164a395453e8cfb69f049d09d29 Oct 24 10:24:16.807672 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 Oct 24 10:24:16.807672 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin Oct 24 10:24:16.807672 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:16.807672 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:16.807672 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: dda734cf3bb843979824870ad858b16b Oct 24 10:24:16.807672 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin Oct 24 10:24:16.807672 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:16.807672 n-d-858383-15 devstack@n-api.service[120426]: exception: Flavor 1706525223 has no extra specs with key hw:cpu_thread_policy. Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'flavor_id': '1706525223', 'id': 'hw:cpu_thread_policy'} Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1706525223 has no extra specs with key hw:cpu_thread_policy. Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:16.808467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.809936 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:16.809936 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:16.809936 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:16.809936 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:16.809936 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:16.809936 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1706525223 has no extra specs with key hw:cpu_thread_policy. Oct 24 10:24:16.809936 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.811299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9517dc50-5719-4dbd-8ede-84eab06fd12c tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] Returning 404 to user: Flavor 1706525223 has no extra specs with key hw:cpu_thread_policy. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:16.812358 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9517dc50-5719-4dbd-8ede-84eab06fd12c tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1706525223/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.030383 Oct 24 10:24:16.813443 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 57/107] 10.222.0.50 () {58 vars in 1269 bytes} [Mon Oct 24 10:24:16 2022] DELETE /compute/v2.1/flavors/1706525223/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:24:16.823387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b5b6b16a-2863-4ca6-8c98-3f0b200ce004 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:16.827799 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-b5b6b16a-2863-4ca6-8c98-3f0b200ce004 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b5b6b16a-2863-4ca6-8c98-3f0b200ce004 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] Request method failure captured: Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: request: PUT /compute/v2.1/flavors/1706525223/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 27 Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfPCKMQ6LZmHGepltSjnNx1oT1eA09sE_T_PaBtejidDAhm6tbSfZIZY-JGOf1C5toJOyxjWNhok4JkBtvadjp1Wkxc9N1qOgTQGV4eAlAMLvyROLKSiyWsn86wjfN8BGVvA2L0zamydcASSA74BaCgw7NhiUIb1vAV-Bpi0KgbZu4 Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 86555164a395453e8cfb69f049d09d29 Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:24:16.829734 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:24:16.831263 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/86555164a395453e8cfb69f049d09d29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/86555164a395453e8cfb69f049d09d29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/86555164a395453e8cfb69f049d09d29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_86555164a395453e8cfb69f049d09d29", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:16.831263 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 Oct 24 10:24:16.831263 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 86555164a395453e8cfb69f049d09d29 Oct 24 10:24:16.831263 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 Oct 24 10:24:16.831263 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin Oct 24 10:24:16.831263 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:16.831263 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:16.831263 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: dda734cf3bb843979824870ad858b16b Oct 24 10:24:16.831263 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin Oct 24 10:24:16.831263 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:24:16.831263 n-d-858383-15 devstack@n-api.service[120426]: {"hw:cpu_policy": "shared"} Oct 24 10:24:16.831263 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:16.831263 n-d-858383-15 devstack@n-api.service[120426]: exception: Request body and URI mismatch Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'flavor_id': '1706525223', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:16.832002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:16.833869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:16.833869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:16.833869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 24 10:24:16.833869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.835642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b5b6b16a-2863-4ca6-8c98-3f0b200ce004 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:16.836754 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b5b6b16a-2863-4ca6-8c98-3f0b200ce004 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/1706525223/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.017361 Oct 24 10:24:16.837855 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 58/108] 10.222.0.50 () {60 vars in 1265 bytes} [Mon Oct 24 10:24:16 2022] PUT /compute/v2.1/flavors/1706525223/os-extra_specs/hw:numa_nodes => generated 73 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 10:24:16.849895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9b761d80-86df-4cb2-b72d-a4b36e9b62ba tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9b761d80-86df-4cb2-b72d-a4b36e9b62ba tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] Request method failure captured: Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: request: PUT /compute/v2.1/flavors/1706525223/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 49 Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfPCKMQ6LZmHGepltSjnNx1oT1eA09sE_T_PaBtejidDAhm6tbSfZIZY-JGOf1C5toJOyxjWNhok4JkBtvadjp1Wkxc9N1qOgTQGV4eAlAMLvyROLKSiyWsn86wjfN8BGVvA2L0zamydcASSA74BaCgw7NhiUIb1vAV-Bpi0KgbZu4 Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 86555164a395453e8cfb69f049d09d29 Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:24:16.855547 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:24:16.856974 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/86555164a395453e8cfb69f049d09d29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/86555164a395453e8cfb69f049d09d29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/86555164a395453e8cfb69f049d09d29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_86555164a395453e8cfb69f049d09d29", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:16.856974 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 Oct 24 10:24:16.856974 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 86555164a395453e8cfb69f049d09d29 Oct 24 10:24:16.856974 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 Oct 24 10:24:16.856974 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin Oct 24 10:24:16.856974 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:16.856974 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:16.856974 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: dda734cf3bb843979824870ad858b16b Oct 24 10:24:16.856974 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin Oct 24 10:24:16.856974 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:24:16.856974 n-d-858383-15 devstack@n-api.service[120426]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 24 10:24:16.856974 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'flavor_id': '1706525223', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi On instance: Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 24 10:24:16.857679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.859008 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:16.860067 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:16.860067 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:16.860067 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:24:16.860067 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:24:16.860067 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 24 10:24:16.860067 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:16.861376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9b761d80-86df-4cb2-b72d-a4b36e9b62ba tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:16.862682 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9b761d80-86df-4cb2-b72d-a4b36e9b62ba tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/1706525223/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.018424 Oct 24 10:24:16.863929 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 59/109] 10.222.0.50 () {60 vars in 1265 bytes} [Mon Oct 24 10:24:16 2022] PUT /compute/v2.1/flavors/1706525223/os-extra_specs/hw:numa_nodes => generated 117 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 10:24:16.875970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ae97a548-13b9-4865-8c0d-dcf12531a608 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:16.918348 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ae97a548-13b9-4865-8c0d-dcf12531a608 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1706525223" status: 202 len: 0 microversion: 2.1 time: 0.048070 Oct 24 10:24:16.919624 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 60/110] 10.222.0.50 () {58 vars in 1161 bytes} [Mon Oct 24 10:24:16 2022] DELETE /compute/v2.1/flavors/1706525223 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:24:16.928520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-87a59adf-2020-41a7-975e-dbc617a86695 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:16.990738 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-87a59adf-2020-41a7-975e-dbc617a86695 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240 tempest-FlavorsExtraSpecsNegativeTestJSON-989932240-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066516 Oct 24 10:24:17.016375 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 61/111] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:24:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:17.038140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-33eeb295-b7a4-47ab-81d5-7a28f8956971 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:17.063066 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-33eeb295-b7a4-47ab-81d5-7a28f8956971 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1294 microversion: 2.1 time: 0.771380 Oct 24 10:24:17.067044 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 51/112] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:16 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1294 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:18.105427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-904cdf7d-c89a-4d8f-a66f-e8589cdb12ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:18.107473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-904cdf7d-c89a-4d8f-a66f-e8589cdb12ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:18.137872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-904cdf7d-c89a-4d8f-a66f-e8589cdb12ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:18.139478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-904cdf7d-c89a-4d8f-a66f-e8589cdb12ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:18.140096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-904cdf7d-c89a-4d8f-a66f-e8589cdb12ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:18.142601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-904cdf7d-c89a-4d8f-a66f-e8589cdb12ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:18.144278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-904cdf7d-c89a-4d8f-a66f-e8589cdb12ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:18.147190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-904cdf7d-c89a-4d8f-a66f-e8589cdb12ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:18.865196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-904cdf7d-c89a-4d8f-a66f-e8589cdb12ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:18.899084 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-904cdf7d-c89a-4d8f-a66f-e8589cdb12ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1294 microversion: 2.1 time: 0.803993 Oct 24 10:24:18.902965 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 62/113] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:18 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1294 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:19.932812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e4ee9496-8291-4c1a-8815-5a682a04e7e7 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:19.933478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e4ee9496-8291-4c1a-8815-5a682a04e7e7 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:19.947409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4ee9496-8291-4c1a-8815-5a682a04e7e7 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:19.951048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4ee9496-8291-4c1a-8815-5a682a04e7e7 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:19.951675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4ee9496-8291-4c1a-8815-5a682a04e7e7 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:19.952721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4ee9496-8291-4c1a-8815-5a682a04e7e7 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:19.953679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4ee9496-8291-4c1a-8815-5a682a04e7e7 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:19.955752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4ee9496-8291-4c1a-8815-5a682a04e7e7 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:21.246931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e4ee9496-8291-4c1a-8815-5a682a04e7e7 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:21.255838 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e4ee9496-8291-4c1a-8815-5a682a04e7e7 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1336 microversion: 2.1 time: 1.326635 Oct 24 10:24:21.263239 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 52/114] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:19 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1336 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:22.281429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0c36dc76-7a98-416b-ad3e-f21ec576a4ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:22.282053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0c36dc76-7a98-416b-ad3e-f21ec576a4ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:22.285356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:22.290071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=10 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:22.306690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c36dc76-7a98-416b-ad3e-f21ec576a4ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:22.307249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c36dc76-7a98-416b-ad3e-f21ec576a4ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:22.307773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c36dc76-7a98-416b-ad3e-f21ec576a4ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:22.308504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c36dc76-7a98-416b-ad3e-f21ec576a4ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:22.309045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c36dc76-7a98-416b-ad3e-f21ec576a4ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:22.309524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c36dc76-7a98-416b-ad3e-f21ec576a4ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:24.213774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0c36dc76-7a98-416b-ad3e-f21ec576a4ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:24.256978 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0c36dc76-7a98-416b-ad3e-f21ec576a4ea tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1336 microversion: 2.1 time: 1.976990 Oct 24 10:24:24.259318 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 63/115] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:22 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1336 bytes in 1982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:25.212378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8071a4e6-00e3-48b7-aa95-1b449bd71b05 tempest-FlavorsV255TestJSON-1667956019 tempest-FlavorsV255TestJSON-1667956019-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1616081084", "id": 297285793, "os-flavor-access:is_public": "True"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:25.225579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-738c9f18-2dbe-42f7-9fca-6beb0905d923 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-968646588", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:25.288584 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8071a4e6-00e3-48b7-aa95-1b449bd71b05 tempest-FlavorsV255TestJSON-1667956019 tempest-FlavorsV255TestJSON-1667956019-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.448784 Oct 24 10:24:25.299898 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 64/116] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Oct 24 10:24:24 2022] POST /compute/v2.1/flavors => generated 446 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:24:25.313092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eef7162b-f589-4e99-b6cc-4582dbd746c6 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:25.314223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-eef7162b-f589-4e99-b6cc-4582dbd746c6 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:25.321917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eef7162b-f589-4e99-b6cc-4582dbd746c6 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:25.322589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eef7162b-f589-4e99-b6cc-4582dbd746c6 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:25.323189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eef7162b-f589-4e99-b6cc-4582dbd746c6 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:25.324201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eef7162b-f589-4e99-b6cc-4582dbd746c6 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:25.324807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eef7162b-f589-4e99-b6cc-4582dbd746c6 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:25.325414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eef7162b-f589-4e99-b6cc-4582dbd746c6 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:25.398742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-738c9f18-2dbe-42f7-9fca-6beb0905d923 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] validate_networks() for None {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:24:26.586879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-eef7162b-f589-4e99-b6cc-4582dbd746c6 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:26.604205 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-eef7162b-f589-4e99-b6cc-4582dbd746c6 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1336 microversion: 2.1 time: 1.294173 Oct 24 10:24:26.621322 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 65/117] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:25 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1336 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:27.300591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-620f6ee1-4a01-476b-90d3-3932fc322a1c tempest-FlavorsV255TestJSON-1580203241 tempest-FlavorsV255TestJSON-1580203241-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:27.337673 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-620f6ee1-4a01-476b-90d3-3932fc322a1c tempest-FlavorsV255TestJSON-1580203241 tempest-FlavorsV255TestJSON-1580203241-project] 10.222.0.50 "GET /compute/v2.1/flavors/297285793" status: 200 len: 446 microversion: 2.55 time: 0.713100 Oct 24 10:24:27.338489 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 66/118] 10.222.0.50 () {60 vars in 1196 bytes} [Mon Oct 24 10:24:26 2022] GET /compute/v2.1/flavors/297285793 => generated 446 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:24:27.362779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ce454608-1221-4134-bcc5-18397264eb5b tempest-FlavorsV255TestJSON-1667956019 tempest-FlavorsV255TestJSON-1667956019-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:27.439396 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ce454608-1221-4134-bcc5-18397264eb5b tempest-FlavorsV255TestJSON-1667956019 tempest-FlavorsV255TestJSON-1667956019-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/297285793" status: 200 len: 447 microversion: 2.55 time: 0.087374 Oct 24 10:24:27.449522 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 67/119] 10.222.0.50 () {62 vars in 1216 bytes} [Mon Oct 24 10:24:27 2022] PUT /compute/v2.1/flavors/297285793 => generated 447 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:24:27.455266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c62e32e6-781b-4aab-be5a-2a4cbd0c4991 tempest-FlavorsV255TestJSON-1580203241 tempest-FlavorsV255TestJSON-1580203241-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:27.467704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-738c9f18-2dbe-42f7-9fca-6beb0905d923 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:24:27.468744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-738c9f18-2dbe-42f7-9fca-6beb0905d923 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:24:27.469380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-738c9f18-2dbe-42f7-9fca-6beb0905d923 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:24:27.470156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-738c9f18-2dbe-42f7-9fca-6beb0905d923 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:24:27.471424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-738c9f18-2dbe-42f7-9fca-6beb0905d923 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:24:27.506510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-738c9f18-2dbe-42f7-9fca-6beb0905d923 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:27.507266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-738c9f18-2dbe-42f7-9fca-6beb0905d923 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:27.507860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-738c9f18-2dbe-42f7-9fca-6beb0905d923 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:27.508733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-738c9f18-2dbe-42f7-9fca-6beb0905d923 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:27.509377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-738c9f18-2dbe-42f7-9fca-6beb0905d923 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:27.509962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-738c9f18-2dbe-42f7-9fca-6beb0905d923 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:27.517451 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c62e32e6-781b-4aab-be5a-2a4cbd0c4991 tempest-FlavorsV255TestJSON-1580203241 tempest-FlavorsV255TestJSON-1580203241-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.066049 Oct 24 10:24:27.518275 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 68/120] 10.222.0.50 () {60 vars in 1187 bytes} [Mon Oct 24 10:24:27 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:24:27.612473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-738c9f18-2dbe-42f7-9fca-6beb0905d923 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Getting quotas for project ac5f703504204b91a5c7e895964ec985. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:24:27.642296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-738c9f18-2dbe-42f7-9fca-6beb0905d923 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Getting quotas for user b684c865fc9e4abb8e0e55616087b92e and project ac5f703504204b91a5c7e895964ec985. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:24:27.675503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-738c9f18-2dbe-42f7-9fca-6beb0905d923 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:24:27.682550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-738c9f18-2dbe-42f7-9fca-6beb0905d923 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:24:27.813041 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-738c9f18-2dbe-42f7-9fca-6beb0905d923 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.392817 Oct 24 10:24:27.820655 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 53/121] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:24:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:24:27.825749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ac455a6c-f325-4639-8235-a199f2cfab23 tempest-FlavorsV255TestJSON-1580203241 tempest-FlavorsV255TestJSON-1580203241-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:27.925459 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ac455a6c-f325-4639-8235-a199f2cfab23 tempest-FlavorsV255TestJSON-1580203241 tempest-FlavorsV255TestJSON-1580203241-project] 10.222.0.50 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.103305 Oct 24 10:24:27.930350 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 54/122] 10.222.0.50 () {60 vars in 1166 bytes} [Mon Oct 24 10:24:27 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:24:27.953663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7ebbc6c1-bbf0-47be-8f6e-e24cd5822dc0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:27.954312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7ebbc6c1-bbf0-47be-8f6e-e24cd5822dc0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:27.996255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ebbc6c1-bbf0-47be-8f6e-e24cd5822dc0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:27.998530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ebbc6c1-bbf0-47be-8f6e-e24cd5822dc0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:28.000171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ebbc6c1-bbf0-47be-8f6e-e24cd5822dc0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:28.006440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ebbc6c1-bbf0-47be-8f6e-e24cd5822dc0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:28.007473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ebbc6c1-bbf0-47be-8f6e-e24cd5822dc0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:28.009374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ebbc6c1-bbf0-47be-8f6e-e24cd5822dc0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:28.178686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-15b5d185-4db0-4803-bffb-88ec590eaf67 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Calling method '.version_select at 0x7f04d1721040>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:28.202884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15b5d185-4db0-4803-bffb-88ec590eaf67 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:28.204324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15b5d185-4db0-4803-bffb-88ec590eaf67 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:28.205044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15b5d185-4db0-4803-bffb-88ec590eaf67 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:28.206059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15b5d185-4db0-4803-bffb-88ec590eaf67 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:28.206833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15b5d185-4db0-4803-bffb-88ec590eaf67 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:28.207475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15b5d185-4db0-4803-bffb-88ec590eaf67 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:28.320551 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-15b5d185-4db0-4803-bffb-88ec590eaf67 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.781237 Oct 24 10:24:28.321860 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 69/123] 10.222.0.50 () {58 vars in 1128 bytes} [Mon Oct 24 10:24:27 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:28.328302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a0017d9f-d8ab-4cf6-a14b-4a8d8c1f3e08 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:28.329432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a0017d9f-d8ab-4cf6-a14b-4a8d8c1f3e08 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:28.717208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a0017d9f-d8ab-4cf6-a14b-4a8d8c1f3e08 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:28.731403 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a0017d9f-d8ab-4cf6-a14b-4a8d8c1f3e08 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1212 microversion: 2.1 time: 0.407641 Oct 24 10:24:28.734101 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 70/124] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:28 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1212 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:28.746343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-46c0a0bb-7097-425e-8fb9-5bcd7ffc1a01 tempest-FlavorsV255TestJSON-1667956019 tempest-FlavorsV255TestJSON-1667956019-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:28.799868 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-46c0a0bb-7097-425e-8fb9-5bcd7ffc1a01 tempest-FlavorsV255TestJSON-1667956019 tempest-FlavorsV255TestJSON-1667956019-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/297285793" status: 202 len: 0 microversion: 2.55 time: 0.064529 Oct 24 10:24:28.801553 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 71/125] 10.222.0.50 () {60 vars in 1199 bytes} [Mon Oct 24 10:24:28 2022] DELETE /compute/v2.1/flavors/297285793 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:24:29.186990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7ebbc6c1-bbf0-47be-8f6e-e24cd5822dc0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:29.186990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=69 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:29.199724 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7ebbc6c1-bbf0-47be-8f6e-e24cd5822dc0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1336 microversion: 2.1 time: 1.266485 Oct 24 10:24:29.200567 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 55/126] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:27 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1336 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:29.225101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d5b2113e-636c-4c03-8285-4b3f7e5494a0 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Calling method '.version_select at 0x7f04d179ab80>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:29.230768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d5b2113e-636c-4c03-8285-4b3f7e5494a0 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '36ec02e4ca814c31b68ddf5c7878a3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de300c4506de49f599a3d16c2dee2493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d5b2113e-636c-4c03-8285-4b3f7e5494a0 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Request method failure captured: Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfZofh8YlIS8GkatLd7RoaVWqfhYmVDCDn4u8_0_vn8gQVyAEl000v8tluyQOwC0cEfbKN_hcUBuxBq0PmyCvhnw5GL10a3--EYQh4jt_NTxtgUvdWrY1XgpIFRAgQFl71EKADEsQZJ3YlqCo6wI9PxhBqzbciy9ucgx6l0XJchoBo Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: de300c4506de49f599a3d16c2dee2493 Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1516466343 Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:24:29.247985 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:24:29.249285 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de300c4506de49f599a3d16c2dee2493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de300c4506de49f599a3d16c2dee2493"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/de300c4506de49f599a3d16c2dee2493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_de300c4506de49f599a3d16c2dee2493", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:29.249285 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1516466343 Oct 24 10:24:29.249285 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: de300c4506de49f599a3d16c2dee2493 Oct 24 10:24:29.249285 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1516466343 Oct 24 10:24:29.249285 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-HostsAdminNegativeTestJSON-1516466343-project Oct 24 10:24:29.249285 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:29.249285 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:29.249285 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 36ec02e4ca814c31b68ddf5c7878a3e4 Oct 24 10:24:29.249285 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1516466343-project Oct 24 10:24:29.249285 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:24:29.249285 n-d-858383-15 devstack@n-api.service[120426]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 24 10:24:29.249285 n-d-858383-15 devstack@n-api.service[120426]: action_args: {} Oct 24 10:24:29.249285 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:29.250023 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 24 10:24:29.251041 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.256400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d5b2113e-636c-4c03-8285-4b3f7e5494a0 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:29.260646 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d5b2113e-636c-4c03-8285-4b3f7e5494a0 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.456774 Oct 24 10:24:29.265574 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 72/127] 10.222.0.50 () {58 vars in 1128 bytes} [Mon Oct 24 10:24:28 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 463 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:29.396499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-28c452ba-2fbc-42b0-a014-cf97a939da8a tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] Calling method '.version_select at 0x7f04d16d6670>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:29.396765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28c452ba-2fbc-42b0-a014-cf97a939da8a tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:29.397733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28c452ba-2fbc-42b0-a014-cf97a939da8a tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:29.398397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28c452ba-2fbc-42b0-a014-cf97a939da8a tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:29.450061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28c452ba-2fbc-42b0-a014-cf97a939da8a tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:29.450922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28c452ba-2fbc-42b0-a014-cf97a939da8a tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:29.451582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28c452ba-2fbc-42b0-a014-cf97a939da8a tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:29.465318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-ad12b11c-afe5-4797-9285-03c8bf199e4f req-a56bad91-d2fe-474a-b1e5-1a6bbc5c9ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a8cb09c-21cc-4d82-ab6a-ea07747f898e", "tag": "3126420a-5024-4d6d-a97f-0626a6360fb0"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:29.509249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28c452ba-2fbc-42b0-a014-cf97a939da8a tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:29.512570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ad12b11c-afe5-4797-9285-03c8bf199e4f req-a56bad91-d2fe-474a-b1e5-1a6bbc5c9ff1 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:29.513410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28c452ba-2fbc-42b0-a014-cf97a939da8a tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:29.514607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ad12b11c-afe5-4797-9285-03c8bf199e4f req-a56bad91-d2fe-474a-b1e5-1a6bbc5c9ff1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:29.515292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28c452ba-2fbc-42b0-a014-cf97a939da8a tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:29.515950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ad12b11c-afe5-4797-9285-03c8bf199e4f req-a56bad91-d2fe-474a-b1e5-1a6bbc5c9ff1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:29.540213 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-28c452ba-2fbc-42b0-a014-cf97a939da8a tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.338225 Oct 24 10:24:29.545573 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 56/128] 10.222.0.50 () {60 vars in 1187 bytes} [Mon Oct 24 10:24:29 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:24:29.562163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ccf64fa-6b99-4e09-a7e6-4784c8bcd476 tempest-FlavorsV255TestJSON-1667956019 tempest-FlavorsV255TestJSON-1667956019-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:29.587243 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ad12b11c-afe5-4797-9285-03c8bf199e4f req-a56bad91-d2fe-474a-b1e5-1a6bbc5c9ff1 service nova] Creating event network-changed:3126420a-5024-4d6d-a97f-0626a6360fb0 for instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e on n-h1-858383-15 Oct 24 10:24:29.592140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ad12b11c-afe5-4797-9285-03c8bf199e4f req-a56bad91-d2fe-474a-b1e5-1a6bbc5c9ff1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 10:24:29.593669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ad12b11c-afe5-4797-9285-03c8bf199e4f req-a56bad91-d2fe-474a-b1e5-1a6bbc5c9ff1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 10:24:29.595826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d12729d4-6bef-4088-9be3-aac4aa747283 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:29.598440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d12729d4-6bef-4088-9be3-aac4aa747283 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:29.599975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d12729d4-6bef-4088-9be3-aac4aa747283 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:29.601630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d12729d4-6bef-4088-9be3-aac4aa747283 None None] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:29.604470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d12729d4-6bef-4088-9be3-aac4aa747283 None None] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:29.605187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d12729d4-6bef-4088-9be3-aac4aa747283 None None] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:29.616894 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ccf64fa-6b99-4e09-a7e6-4784c8bcd476 tempest-FlavorsV255TestJSON-1667956019 tempest-FlavorsV255TestJSON-1667956019-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.068240 Oct 24 10:24:29.629973 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.compute.rpcapi [None req-d12729d4-6bef-4088-9be3-aac4aa747283 None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 24 10:24:29.631663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d12729d4-6bef-4088-9be3-aac4aa747283 None None] Releasing lock "compute-rpcapi-router" {{(pid=120426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 10:24:29.637590 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 57/129] 10.222.0.50 () {60 vars in 1187 bytes} [Mon Oct 24 10:24:29 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:24:29.642445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3e75d2ce-2a09-4528-9c7b-70e89d807350 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Calling method '.version_select at 0x7f04d16d69d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:29.668450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3e75d2ce-2a09-4528-9c7b-70e89d807350 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '36ec02e4ca814c31b68ddf5c7878a3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de300c4506de49f599a3d16c2dee2493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3e75d2ce-2a09-4528-9c7b-70e89d807350 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Request method failure captured: Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-hosts/n-d-858383-15/reboot HTTP/1.1 Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfZofh8YlIS8GkatLd7RoaVWqfhYmVDCDn4u8_0_vn8gQVyAEl000v8tluyQOwC0cEfbKN_hcUBuxBq0PmyCvhnw5GL10a3--EYQh4jt_NTxtgUvdWrY1XgpIFRAgQFl71EKADEsQZJ3YlqCo6wI9PxhBqzbciy9ucgx6l0XJchoBo Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: de300c4506de49f599a3d16c2dee2493 Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1516466343 Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:24:29.670488 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:24:29.671612 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de300c4506de49f599a3d16c2dee2493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de300c4506de49f599a3d16c2dee2493"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/de300c4506de49f599a3d16c2dee2493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_de300c4506de49f599a3d16c2dee2493", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:29.671612 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1516466343 Oct 24 10:24:29.671612 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: de300c4506de49f599a3d16c2dee2493 Oct 24 10:24:29.671612 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1516466343 Oct 24 10:24:29.671612 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-HostsAdminNegativeTestJSON-1516466343-project Oct 24 10:24:29.671612 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:29.671612 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:29.671612 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 36ec02e4ca814c31b68ddf5c7878a3e4 Oct 24 10:24:29.671612 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1516466343-project Oct 24 10:24:29.671612 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:24:29.671612 n-d-858383-15 devstack@n-api.service[120425]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 24 10:24:29.671612 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'n-d-858383-15'} Oct 24 10:24:29.671612 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:29.672284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:29.674244 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:29.674244 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:29.674244 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:29.674244 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:29.674244 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:29.674244 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:29.674244 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 24 10:24:29.674244 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.674244 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:29.674244 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.674244 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:29.674244 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:29.674244 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:29.674244 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:29.674244 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:29.674244 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 24 10:24:29.674244 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.675140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3e75d2ce-2a09-4528-9c7b-70e89d807350 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:29.675140 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3e75d2ce-2a09-4528-9c7b-70e89d807350 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-858383-15/reboot" status: 403 len: 111 microversion: 2.1 time: 0.033294 Oct 24 10:24:29.675140 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 58/130] 10.222.0.50 () {58 vars in 1191 bytes} [Mon Oct 24 10:24:29 2022] GET /compute/v2.1/os-hosts/n-d-858383-15/reboot => generated 111 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:29.681484 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d12729d4-6bef-4088-9be3-aac4aa747283 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.411761 Oct 24 10:24:29.684596 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 73/131] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:29.685410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4ae09098-a991-4bb9-9815-7c6546604d71 tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] Calling method '.version_select at 0x7f04d16d60d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:29.687735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ae09098-a991-4bb9-9815-7c6546604d71 tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:29.687844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ae09098-a991-4bb9-9815-7c6546604d71 tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:29.688188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ae09098-a991-4bb9-9815-7c6546604d71 tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:29.699476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1d56ed78-0956-4308-91e6-8ddccf6c9056 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Calling method '.version_select at 0x7f04d16870d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:29.738529 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-1d56ed78-0956-4308-91e6-8ddccf6c9056 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:29.741413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ae09098-a991-4bb9-9815-7c6546604d71 tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:29.741911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ae09098-a991-4bb9-9815-7c6546604d71 tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:29.742352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ae09098-a991-4bb9-9815-7c6546604d71 tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1d56ed78-0956-4308-91e6-8ddccf6c9056 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Request method failure captured: Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfbqV3QzwnCDU2M_ZlZomltgDikg7WcEIJqXwr9Lgx3SIFwLWSteDjAXR_vsu_si5IyNGzQkbatsSiaL1Ur7BgUDxQWahbrvOVMSAmahy0Hsm0k_K9Og1FuSL_RBSQ5Pu-hVLhVzTeptfwsCWaTsP-c3KvFgYO-alcSw020HHADssE Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: c09f408d9ed34c31a0b92ef8f1826aa2 Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:24:29.747011 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:24:29.748275 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c09f408d9ed34c31a0b92ef8f1826aa2", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:29.748275 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:29.748275 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: c09f408d9ed34c31a0b92ef8f1826aa2 Oct 24 10:24:29.748275 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:29.748275 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-HostsAdminNegativeTestJSON-1055362838-project-admin Oct 24 10:24:29.748275 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:29.748275 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:29.748275 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 2bd4376410f14548b889d3576fc795aa Oct 24 10:24:29.748275 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1055362838-project-admin Oct 24 10:24:29.748275 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:24:29.748275 n-d-858383-15 devstack@n-api.service[120426]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:29.748275 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'nonexistent_hostname'} Oct 24 10:24:29.748275 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:24:29.749025 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 24 10:24:29.750082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:24:29.751052 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:29.751052 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.751052 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:29.751052 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.751052 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:29.751052 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:29.751052 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:29.751052 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:29.751052 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:29.751052 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:29.751052 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.763936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1d56ed78-0956-4308-91e6-8ddccf6c9056 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:29.765519 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1d56ed78-0956-4308-91e6-8ddccf6c9056 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.078479 Oct 24 10:24:29.767765 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 74/132] 10.222.0.50 () {58 vars in 1212 bytes} [Mon Oct 24 10:24:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:24:29.778934 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4ae09098-a991-4bb9-9815-7c6546604d71 tempest-HypervisorAdminV228Test-767754351 tempest-HypervisorAdminV228Test-767754351-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.105466 Oct 24 10:24:29.779814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-22bb0142-34f8-4707-a130-be5a95362933 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:29.780931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-22bb0142-34f8-4707-a130-be5a95362933 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:29.785327 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 59/133] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Oct 24 10:24:29 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:24:29.811391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-78f94224-4059-4fc5-ae5d-2fe5947ce878 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Calling method '.version_select at 0x7f04d16d6ee0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:29.813450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-78f94224-4059-4fc5-ae5d-2fe5947ce878 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '36ec02e4ca814c31b68ddf5c7878a3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de300c4506de49f599a3d16c2dee2493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-78f94224-4059-4fc5-ae5d-2fe5947ce878 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Request method failure captured: Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-hosts/n-d-858383-15 HTTP/1.1 Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfZofh8YlIS8GkatLd7RoaVWqfhYmVDCDn4u8_0_vn8gQVyAEl000v8tluyQOwC0cEfbKN_hcUBuxBq0PmyCvhnw5GL10a3--EYQh4jt_NTxtgUvdWrY1XgpIFRAgQFl71EKADEsQZJ3YlqCo6wI9PxhBqzbciy9ucgx6l0XJchoBo Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: de300c4506de49f599a3d16c2dee2493 Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1516466343 Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:24:29.830560 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:24:29.831750 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de300c4506de49f599a3d16c2dee2493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de300c4506de49f599a3d16c2dee2493"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/de300c4506de49f599a3d16c2dee2493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_de300c4506de49f599a3d16c2dee2493", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:29.831750 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1516466343 Oct 24 10:24:29.831750 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: de300c4506de49f599a3d16c2dee2493 Oct 24 10:24:29.831750 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1516466343 Oct 24 10:24:29.831750 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-HostsAdminNegativeTestJSON-1516466343-project Oct 24 10:24:29.831750 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:29.831750 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:29.831750 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 36ec02e4ca814c31b68ddf5c7878a3e4 Oct 24 10:24:29.831750 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1516466343-project Oct 24 10:24:29.831750 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:24:29.831750 n-d-858383-15 devstack@n-api.service[120425]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 24 10:24:29.831750 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'n-d-858383-15'} Oct 24 10:24:29.831750 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:29.834485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:29.835439 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:29.835439 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:29.835439 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:29.835439 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:29.835439 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:29.835439 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:29.835439 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 24 10:24:29.835439 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.835439 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:29.835439 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.835439 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:29.835439 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:29.835439 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:29.835439 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:29.835439 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:29.835439 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 24 10:24:29.835439 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.836291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-78f94224-4059-4fc5-ae5d-2fe5947ce878 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:29.836291 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-78f94224-4059-4fc5-ae5d-2fe5947ce878 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-858383-15" status: 403 len: 109 microversion: 2.1 time: 0.045027 Oct 24 10:24:29.836291 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 60/134] 10.222.0.50 () {58 vars in 1170 bytes} [Mon Oct 24 10:24:29 2022] GET /compute/v2.1/os-hosts/n-d-858383-15 => generated 109 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:29.866642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c5c6a720-874b-4c70-97fe-84e16884d1c4 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Calling method '.version_select at 0x7f04d16cd700>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:29.896798 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-c5c6a720-874b-4c70-97fe-84e16884d1c4 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c5c6a720-874b-4c70-97fe-84e16884d1c4 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Request method failure captured: Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfbqV3QzwnCDU2M_ZlZomltgDikg7WcEIJqXwr9Lgx3SIFwLWSteDjAXR_vsu_si5IyNGzQkbatsSiaL1Ur7BgUDxQWahbrvOVMSAmahy0Hsm0k_K9Og1FuSL_RBSQ5Pu-hVLhVzTeptfwsCWaTsP-c3KvFgYO-alcSw020HHADssE Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: c09f408d9ed34c31a0b92ef8f1826aa2 Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:24:29.898437 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:24:29.899604 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c09f408d9ed34c31a0b92ef8f1826aa2", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:29.899604 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:29.899604 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: c09f408d9ed34c31a0b92ef8f1826aa2 Oct 24 10:24:29.899604 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:29.899604 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-HostsAdminNegativeTestJSON-1055362838-project-admin Oct 24 10:24:29.899604 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:29.899604 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:29.899604 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2bd4376410f14548b889d3576fc795aa Oct 24 10:24:29.899604 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1055362838-project-admin Oct 24 10:24:29.899604 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:24:29.899604 n-d-858383-15 devstack@n-api.service[120425]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:29.899604 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'nonexistent_hostname'} Oct 24 10:24:29.899604 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:29.900264 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:29.901327 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:29.901327 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:29.901327 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:29.901327 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:29.901327 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:29.901327 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 24 10:24:29.901327 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:24:29.901327 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:29.901327 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.901327 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:29.901327 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.901327 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:29.901327 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:29.901327 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:29.901327 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:29.901327 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:29.901327 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:29.901327 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.908077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c5c6a720-874b-4c70-97fe-84e16884d1c4 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:29.912852 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c5c6a720-874b-4c70-97fe-84e16884d1c4 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.066916 Oct 24 10:24:29.913752 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 61/135] 10.222.0.50 () {58 vars in 1191 bytes} [Mon Oct 24 10:24:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:24:29.929504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-23f51502-f92d-4424-b941-55a76a3dc3e2 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Calling method '.version_select at 0x7f04d16d69d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:29.942338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-23f51502-f92d-4424-b941-55a76a3dc3e2 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '36ec02e4ca814c31b68ddf5c7878a3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de300c4506de49f599a3d16c2dee2493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-23f51502-f92d-4424-b941-55a76a3dc3e2 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Request method failure captured: Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-hosts/n-d-858383-15/shutdown HTTP/1.1 Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfZofh8YlIS8GkatLd7RoaVWqfhYmVDCDn4u8_0_vn8gQVyAEl000v8tluyQOwC0cEfbKN_hcUBuxBq0PmyCvhnw5GL10a3--EYQh4jt_NTxtgUvdWrY1XgpIFRAgQFl71EKADEsQZJ3YlqCo6wI9PxhBqzbciy9ucgx6l0XJchoBo Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: de300c4506de49f599a3d16c2dee2493 Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1516466343 Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:24:29.954195 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:24:29.955507 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de300c4506de49f599a3d16c2dee2493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de300c4506de49f599a3d16c2dee2493"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/de300c4506de49f599a3d16c2dee2493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_de300c4506de49f599a3d16c2dee2493", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:29.955507 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1516466343 Oct 24 10:24:29.955507 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: de300c4506de49f599a3d16c2dee2493 Oct 24 10:24:29.955507 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1516466343 Oct 24 10:24:29.955507 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-HostsAdminNegativeTestJSON-1516466343-project Oct 24 10:24:29.955507 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:29.955507 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:29.955507 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 36ec02e4ca814c31b68ddf5c7878a3e4 Oct 24 10:24:29.955507 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1516466343-project Oct 24 10:24:29.955507 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:24:29.955507 n-d-858383-15 devstack@n-api.service[120425]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 24 10:24:29.955507 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'n-d-858383-15'} Oct 24 10:24:29.955507 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:29.956217 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:29.957343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:29.957343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:29.957343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:29.957343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:29.957343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:29.957343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:29.957343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 24 10:24:29.957343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.957343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:29.957343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.957343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:29.957343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:29.957343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:29.957343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:29.957343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:29.957343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 24 10:24:29.957343 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:29.959844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-23f51502-f92d-4424-b941-55a76a3dc3e2 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:29.960986 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-23f51502-f92d-4424-b941-55a76a3dc3e2 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-858383-15/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.035876 Oct 24 10:24:29.963244 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 62/136] 10.222.0.50 () {58 vars in 1197 bytes} [Mon Oct 24 10:24:29 2022] GET /compute/v2.1/os-hosts/n-d-858383-15/shutdown => generated 113 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:29.985416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d3011eaf-3688-4154-829e-52320c407d25 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Calling method '.version_select at 0x7f04d16cdf70>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:30.016056 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-d3011eaf-3688-4154-829e-52320c407d25 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d3011eaf-3688-4154-829e-52320c407d25 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Request method failure captured: Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfbqV3QzwnCDU2M_ZlZomltgDikg7WcEIJqXwr9Lgx3SIFwLWSteDjAXR_vsu_si5IyNGzQkbatsSiaL1Ur7BgUDxQWahbrvOVMSAmahy0Hsm0k_K9Og1FuSL_RBSQ5Pu-hVLhVzTeptfwsCWaTsP-c3KvFgYO-alcSw020HHADssE Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: c09f408d9ed34c31a0b92ef8f1826aa2 Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:24:30.017714 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:24:30.018789 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c09f408d9ed34c31a0b92ef8f1826aa2", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:30.018789 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:30.018789 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: c09f408d9ed34c31a0b92ef8f1826aa2 Oct 24 10:24:30.018789 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:30.018789 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-HostsAdminNegativeTestJSON-1055362838-project-admin Oct 24 10:24:30.018789 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:30.018789 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:30.018789 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2bd4376410f14548b889d3576fc795aa Oct 24 10:24:30.018789 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1055362838-project-admin Oct 24 10:24:30.018789 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:24:30.018789 n-d-858383-15 devstack@n-api.service[120425]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:30.018789 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'nonexistent_hostname'} Oct 24 10:24:30.018789 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:24:30.019438 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 24 10:24:30.021752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:24:30.023014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:30.023014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.023014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:30.023014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.023014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.023014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:30.023014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:30.023014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:30.023014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:30.023014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:30.023014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.023014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d3011eaf-3688-4154-829e-52320c407d25 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:30.023014 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d3011eaf-3688-4154-829e-52320c407d25 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.048129 Oct 24 10:24:30.035523 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 63/137] 10.222.0.50 () {58 vars in 1218 bytes} [Mon Oct 24 10:24:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:24:30.048446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fc79a225-921c-461f-9024-7c9a9985c0a5 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Calling method '.version_select at 0x7f04d16d6a60>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:30.050319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fc79a225-921c-461f-9024-7c9a9985c0a5 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '36ec02e4ca814c31b68ddf5c7878a3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de300c4506de49f599a3d16c2dee2493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fc79a225-921c-461f-9024-7c9a9985c0a5 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Request method failure captured: Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-hosts/n-d-858383-15/startup HTTP/1.1 Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfZofh8YlIS8GkatLd7RoaVWqfhYmVDCDn4u8_0_vn8gQVyAEl000v8tluyQOwC0cEfbKN_hcUBuxBq0PmyCvhnw5GL10a3--EYQh4jt_NTxtgUvdWrY1XgpIFRAgQFl71EKADEsQZJ3YlqCo6wI9PxhBqzbciy9ucgx6l0XJchoBo Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: de300c4506de49f599a3d16c2dee2493 Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1516466343 Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:24:30.052464 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:24:30.054017 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de300c4506de49f599a3d16c2dee2493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de300c4506de49f599a3d16c2dee2493"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/de300c4506de49f599a3d16c2dee2493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_de300c4506de49f599a3d16c2dee2493", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:30.054017 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1516466343 Oct 24 10:24:30.054017 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: de300c4506de49f599a3d16c2dee2493 Oct 24 10:24:30.054017 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1516466343 Oct 24 10:24:30.054017 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-HostsAdminNegativeTestJSON-1516466343-project Oct 24 10:24:30.054017 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:30.054017 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:30.054017 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 36ec02e4ca814c31b68ddf5c7878a3e4 Oct 24 10:24:30.054017 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1516466343-project Oct 24 10:24:30.054017 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:24:30.054017 n-d-858383-15 devstack@n-api.service[120425]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 24 10:24:30.054017 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'n-d-858383-15'} Oct 24 10:24:30.054017 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:30.054826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:30.055786 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:30.055786 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:30.055786 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:30.055786 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:30.055786 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:30.055786 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:30.055786 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 24 10:24:30.055786 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.055786 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:30.055786 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.055786 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.055786 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:30.055786 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:30.055786 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:30.055786 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:30.055786 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 24 10:24:30.055786 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.056628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fc79a225-921c-461f-9024-7c9a9985c0a5 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:30.056628 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fc79a225-921c-461f-9024-7c9a9985c0a5 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-858383-15/startup" status: 403 len: 110 microversion: 2.1 time: 0.017082 Oct 24 10:24:30.056628 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 64/138] 10.222.0.50 () {58 vars in 1194 bytes} [Mon Oct 24 10:24:30 2022] GET /compute/v2.1/os-hosts/n-d-858383-15/startup => generated 110 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:30.088802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-22bb0142-34f8-4707-a130-be5a95362933 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:30.096576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-74e8e70e-4241-49ed-bb99-add6d1ac1252 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Calling method '.version_select at 0x7f04d16cd940>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:30.098636 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-22bb0142-34f8-4707-a130-be5a95362933 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1212 microversion: 2.1 time: 0.329418 Oct 24 10:24:30.107046 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 75/139] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:29 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1212 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:30.140555 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-74e8e70e-4241-49ed-bb99-add6d1ac1252 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-74e8e70e-4241-49ed-bb99-add6d1ac1252 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Request method failure captured: Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfbqV3QzwnCDU2M_ZlZomltgDikg7WcEIJqXwr9Lgx3SIFwLWSteDjAXR_vsu_si5IyNGzQkbatsSiaL1Ur7BgUDxQWahbrvOVMSAmahy0Hsm0k_K9Og1FuSL_RBSQ5Pu-hVLhVzTeptfwsCWaTsP-c3KvFgYO-alcSw020HHADssE Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: c09f408d9ed34c31a0b92ef8f1826aa2 Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:24:30.144243 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:24:30.146196 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c09f408d9ed34c31a0b92ef8f1826aa2", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:30.146196 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:30.146196 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: c09f408d9ed34c31a0b92ef8f1826aa2 Oct 24 10:24:30.146196 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:30.146196 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-HostsAdminNegativeTestJSON-1055362838-project-admin Oct 24 10:24:30.146196 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:30.146196 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:30.146196 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2bd4376410f14548b889d3576fc795aa Oct 24 10:24:30.146196 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1055362838-project-admin Oct 24 10:24:30.146196 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:24:30.146196 n-d-858383-15 devstack@n-api.service[120425]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:30.146196 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'nonexistent_hostname'} Oct 24 10:24:30.146196 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:24:30.146927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 24 10:24:30.148081 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:24:30.149233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:30.149233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.149233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:30.149233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.149233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.149233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:30.149233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:30.149233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:30.149233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:30.149233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:30.149233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.152777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-74e8e70e-4241-49ed-bb99-add6d1ac1252 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:30.153847 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-74e8e70e-4241-49ed-bb99-add6d1ac1252 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.083815 Oct 24 10:24:30.159906 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 65/140] 10.222.0.50 () {58 vars in 1215 bytes} [Mon Oct 24 10:24:30 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:24:30.166330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-59eb8bde-2dc5-4a4c-81d9-15d741066cd6 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Action: 'update', calling method: .version_select at 0x7f04d179a280>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-59eb8bde-2dc5-4a4c-81d9-15d741066cd6 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Request method failure captured: Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: request: PUT /compute/v2.1/os-hosts/n-d-858383-15 HTTP/1.1 Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 51 Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfbqV3QzwnCDU2M_ZlZomltgDikg7WcEIJqXwr9Lgx3SIFwLWSteDjAXR_vsu_si5IyNGzQkbatsSiaL1Ur7BgUDxQWahbrvOVMSAmahy0Hsm0k_K9Og1FuSL_RBSQ5Pu-hVLhVzTeptfwsCWaTsP-c3KvFgYO-alcSw020HHADssE Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: c09f408d9ed34c31a0b92ef8f1826aa2 Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:24:30.173283 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:24:30.174657 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c09f408d9ed34c31a0b92ef8f1826aa2", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:30.174657 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:30.174657 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: c09f408d9ed34c31a0b92ef8f1826aa2 Oct 24 10:24:30.174657 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:30.174657 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-HostsAdminNegativeTestJSON-1055362838-project-admin Oct 24 10:24:30.174657 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:30.174657 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:30.174657 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 2bd4376410f14548b889d3576fc795aa Oct 24 10:24:30.174657 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1055362838-project-admin Oct 24 10:24:30.174657 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:24:30.174657 n-d-858383-15 devstack@n-api.service[120426]: {"status": "enable", "maintenance_mode": "invalid"} Oct 24 10:24:30.174657 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:24:30.174657 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'n-d-858383-15', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'disable', Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'Enable', Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'Disable', Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi On instance: Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'invalid' Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.175418 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.176953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:30.178521 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:30.178521 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:24:30.178521 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:24:30.178521 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 24 10:24:30.178521 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.181871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-59eb8bde-2dc5-4a4c-81d9-15d741066cd6 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:30.182968 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-59eb8bde-2dc5-4a4c-81d9-15d741066cd6 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-858383-15" status: 400 len: 199 microversion: 2.1 time: 0.021533 Oct 24 10:24:30.187364 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 76/141] 10.222.0.50 () {60 vars in 1190 bytes} [Mon Oct 24 10:24:30 2022] PUT /compute/v2.1/os-hosts/n-d-858383-15 => generated 199 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:24:30.197318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0dc181ca-6c33-4f6a-9d54-3c1b48bfc224 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Action: 'update', calling method: .version_select at 0x7f04d16d6b80>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0dc181ca-6c33-4f6a-9d54-3c1b48bfc224 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Request method failure captured: Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: request: PUT /compute/v2.1/os-hosts/n-d-858383-15 HTTP/1.1 Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 51 Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfbqV3QzwnCDU2M_ZlZomltgDikg7WcEIJqXwr9Lgx3SIFwLWSteDjAXR_vsu_si5IyNGzQkbatsSiaL1Ur7BgUDxQWahbrvOVMSAmahy0Hsm0k_K9Og1FuSL_RBSQ5Pu-hVLhVzTeptfwsCWaTsP-c3KvFgYO-alcSw020HHADssE Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: c09f408d9ed34c31a0b92ef8f1826aa2 Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:24:30.213794 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:24:30.215226 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c09f408d9ed34c31a0b92ef8f1826aa2", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:30.215226 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:30.215226 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: c09f408d9ed34c31a0b92ef8f1826aa2 Oct 24 10:24:30.215226 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:30.215226 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-HostsAdminNegativeTestJSON-1055362838-project-admin Oct 24 10:24:30.215226 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:30.215226 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:30.215226 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2bd4376410f14548b889d3576fc795aa Oct 24 10:24:30.215226 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1055362838-project-admin Oct 24 10:24:30.215226 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:24:30.215226 n-d-858383-15 devstack@n-api.service[120425]: {"status": "invalid", "maintenance_mode": "enable"} Oct 24 10:24:30.215226 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:24:30.215226 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'n-d-858383-15', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'disable', Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'Enable', Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'Disable', Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance: Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'invalid' Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.215986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.219338 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:30.221841 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:30.221841 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:24:30.221841 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:24:30.221841 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 24 10:24:30.221841 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.221841 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0dc181ca-6c33-4f6a-9d54-3c1b48bfc224 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:30.221841 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0dc181ca-6c33-4f6a-9d54-3c1b48bfc224 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-858383-15" status: 400 len: 189 microversion: 2.1 time: 0.022878 Oct 24 10:24:30.221841 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 66/142] 10.222.0.50 () {60 vars in 1190 bytes} [Mon Oct 24 10:24:30 2022] PUT /compute/v2.1/os-hosts/n-d-858383-15 => generated 189 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 10:24:30.226741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a48120b4-3bbe-4204-90c4-1938aa21be15 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:30.232333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c14ab18-ef1d-4364-9e51-66ac22c93d34 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Action: 'update', calling method: .version_select at 0x7f04d1688790>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:30.235803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a48120b4-3bbe-4204-90c4-1938aa21be15 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:30.248992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1c14ab18-ef1d-4364-9e51-66ac22c93d34 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '36ec02e4ca814c31b68ddf5c7878a3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de300c4506de49f599a3d16c2dee2493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c14ab18-ef1d-4364-9e51-66ac22c93d34 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Request method failure captured: Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: request: PUT /compute/v2.1/os-hosts/n-d-858383-15 HTTP/1.1 Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 50 Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfZofh8YlIS8GkatLd7RoaVWqfhYmVDCDn4u8_0_vn8gQVyAEl000v8tluyQOwC0cEfbKN_hcUBuxBq0PmyCvhnw5GL10a3--EYQh4jt_NTxtgUvdWrY1XgpIFRAgQFl71EKADEsQZJ3YlqCo6wI9PxhBqzbciy9ucgx6l0XJchoBo Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: de300c4506de49f599a3d16c2dee2493 Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1516466343 Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:24:30.253869 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:24:30.255225 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de300c4506de49f599a3d16c2dee2493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/de300c4506de49f599a3d16c2dee2493"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/de300c4506de49f599a3d16c2dee2493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_de300c4506de49f599a3d16c2dee2493", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:30.255225 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1516466343 Oct 24 10:24:30.255225 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: de300c4506de49f599a3d16c2dee2493 Oct 24 10:24:30.255225 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1516466343 Oct 24 10:24:30.255225 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-HostsAdminNegativeTestJSON-1516466343-project Oct 24 10:24:30.255225 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:30.255225 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:30.255225 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 36ec02e4ca814c31b68ddf5c7878a3e4 Oct 24 10:24:30.255225 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1516466343-project Oct 24 10:24:30.255225 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:24:30.255225 n-d-858383-15 devstack@n-api.service[120425]: {"status": "enable", "maintenance_mode": "enable"} Oct 24 10:24:30.255225 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:24:30.255225 n-d-858383-15 devstack@n-api.service[120425]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 24 10:24:30.255225 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'n-d-858383-15', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:30.255975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 24 10:24:30.257113 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.262521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c14ab18-ef1d-4364-9e51-66ac22c93d34 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:30.263422 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1c14ab18-ef1d-4364-9e51-66ac22c93d34 tempest-HostsAdminNegativeTestJSON-1516466343 tempest-HostsAdminNegativeTestJSON-1516466343-project] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-858383-15" status: 403 len: 111 microversion: 2.1 time: 0.034804 Oct 24 10:24:30.264025 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 67/143] 10.222.0.50 () {60 vars in 1190 bytes} [Mon Oct 24 10:24:30 2022] PUT /compute/v2.1/os-hosts/n-d-858383-15 => generated 111 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:30.265973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a48120b4-3bbe-4204-90c4-1938aa21be15 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:30.268204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a48120b4-3bbe-4204-90c4-1938aa21be15 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:30.278117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a48120b4-3bbe-4204-90c4-1938aa21be15 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:30.279183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a48120b4-3bbe-4204-90c4-1938aa21be15 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:30.279873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a48120b4-3bbe-4204-90c4-1938aa21be15 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:30.280532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a48120b4-3bbe-4204-90c4-1938aa21be15 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:30.287409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3973331a-704e-43d4-96ac-456bec184194 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Action: 'update', calling method: .version_select at 0x7f04d16d6ee0>, body: {"status": null, "maintenance_mode": null} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3973331a-704e-43d4-96ac-456bec184194 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Request method failure captured: Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: request: PUT /compute/v2.1/os-hosts/n-d-858383-15 HTTP/1.1 Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 42 Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfbqV3QzwnCDU2M_ZlZomltgDikg7WcEIJqXwr9Lgx3SIFwLWSteDjAXR_vsu_si5IyNGzQkbatsSiaL1Ur7BgUDxQWahbrvOVMSAmahy0Hsm0k_K9Og1FuSL_RBSQ5Pu-hVLhVzTeptfwsCWaTsP-c3KvFgYO-alcSw020HHADssE Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: c09f408d9ed34c31a0b92ef8f1826aa2 Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:24:30.298549 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:24:30.299801 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c09f408d9ed34c31a0b92ef8f1826aa2", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:30.299801 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:30.299801 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: c09f408d9ed34c31a0b92ef8f1826aa2 Oct 24 10:24:30.299801 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:30.299801 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-HostsAdminNegativeTestJSON-1055362838-project-admin Oct 24 10:24:30.299801 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:30.299801 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:30.299801 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2bd4376410f14548b889d3576fc795aa Oct 24 10:24:30.299801 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1055362838-project-admin Oct 24 10:24:30.299801 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:24:30.299801 n-d-858383-15 devstack@n-api.service[120425]: {"status": null, "maintenance_mode": null} Oct 24 10:24:30.299801 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:24:30.299801 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 24 10:24:30.299801 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'n-d-858383-15', 'body': {'status': None, 'maintenance_mode': None}} Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'disable', Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'Enable', Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'Disable', Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance: Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi None Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:30.300679 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:30.302839 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:30.303912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:24:30.303912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:24:30.303912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 24 10:24:30.303912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.309774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3973331a-704e-43d4-96ac-456bec184194 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:30.313937 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3973331a-704e-43d4-96ac-456bec184194 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-858383-15" status: 400 len: 127 microversion: 2.1 time: 0.038289 Oct 24 10:24:30.323371 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 68/144] 10.222.0.50 () {60 vars in 1190 bytes} [Mon Oct 24 10:24:30 2022] PUT /compute/v2.1/os-hosts/n-d-858383-15 => generated 127 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:24:30.334351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b487f1b7-afa8-490e-9110-1fb9089454b5 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Action: 'update', calling method: .version_select at 0x7f04d1688820>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:30.337974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=51 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:30.344320 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.hosts [None req-b487f1b7-afa8-490e-9110-1fb9089454b5 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Enabling host nonexistent_hostname. Oct 24 10:24:30.362622 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-b487f1b7-afa8-490e-9110-1fb9089454b5 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b487f1b7-afa8-490e-9110-1fb9089454b5 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Request method failure captured: Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 50 Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfbqV3QzwnCDU2M_ZlZomltgDikg7WcEIJqXwr9Lgx3SIFwLWSteDjAXR_vsu_si5IyNGzQkbatsSiaL1Ur7BgUDxQWahbrvOVMSAmahy0Hsm0k_K9Og1FuSL_RBSQ5Pu-hVLhVzTeptfwsCWaTsP-c3KvFgYO-alcSw020HHADssE Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: c09f408d9ed34c31a0b92ef8f1826aa2 Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:24:30.368218 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:24:30.369527 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c09f408d9ed34c31a0b92ef8f1826aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c09f408d9ed34c31a0b92ef8f1826aa2", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:30.369527 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:30.369527 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: c09f408d9ed34c31a0b92ef8f1826aa2 Oct 24 10:24:30.369527 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1055362838 Oct 24 10:24:30.369527 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-HostsAdminNegativeTestJSON-1055362838-project-admin Oct 24 10:24:30.369527 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:30.369527 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:30.369527 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2bd4376410f14548b889d3576fc795aa Oct 24 10:24:30.369527 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1055362838-project-admin Oct 24 10:24:30.369527 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:24:30.369527 n-d-858383-15 devstack@n-api.service[120425]: {"status": "enable", "maintenance_mode": "enable"} Oct 24 10:24:30.369527 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:24:30.369527 n-d-858383-15 devstack@n-api.service[120425]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:30.369527 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 24 10:24:30.370267 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:30.370267 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.370267 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 24 10:24:30.370267 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 24 10:24:30.370267 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 10:24:30.370267 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 10:24:30.370267 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:30.370267 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:30.370267 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:30.370267 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:30.370267 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 10:24:30.370267 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 10:24:30.370267 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 24 10:24:30.370267 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 24 10:24:30.370267 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:24:30.370267 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:24:30.370267 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 24 10:24:30.370267 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:30.371182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 24 10:24:30.372283 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 24 10:24:30.372283 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 24 10:24:30.372283 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:24:30.372283 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:30.372283 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.372283 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:30.372283 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.372283 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:30.372283 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:30.372283 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:30.372283 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:30.372283 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:30.372283 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 24 10:24:30.372283 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:30.372283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b487f1b7-afa8-490e-9110-1fb9089454b5 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:30.374290 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b487f1b7-afa8-490e-9110-1fb9089454b5 tempest-HostsAdminNegativeTestJSON-1055362838 tempest-HostsAdminNegativeTestJSON-1055362838-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.044152 Oct 24 10:24:30.374290 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 69/145] 10.222.0.50 () {60 vars in 1211 bytes} [Mon Oct 24 10:24:30 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:24:31.131170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-11e5b524-efa3-4f76-9be9-5553c9fd8ae4 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:31.132601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-11e5b524-efa3-4f76-9be9-5553c9fd8ae4 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:31.146787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11e5b524-efa3-4f76-9be9-5553c9fd8ae4 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:31.150964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11e5b524-efa3-4f76-9be9-5553c9fd8ae4 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:31.151631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11e5b524-efa3-4f76-9be9-5553c9fd8ae4 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:31.157298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11e5b524-efa3-4f76-9be9-5553c9fd8ae4 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:31.158050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11e5b524-efa3-4f76-9be9-5553c9fd8ae4 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:31.159155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11e5b524-efa3-4f76-9be9-5553c9fd8ae4 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:31.496077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-11e5b524-efa3-4f76-9be9-5553c9fd8ae4 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:31.511617 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-11e5b524-efa3-4f76-9be9-5553c9fd8ae4 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1264 microversion: 2.1 time: 0.384949 Oct 24 10:24:31.531333 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 70/146] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:31 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1264 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:32.361613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a48120b4-3bbe-4204-90c4-1938aa21be15 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:32.382053 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a48120b4-3bbe-4204-90c4-1938aa21be15 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1336 microversion: 2.1 time: 2.162017 Oct 24 10:24:32.382824 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 77/147] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:30 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1336 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:32.541140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43bbe959-16e8-4435-b8cb-730741292fb7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:32.541768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-43bbe959-16e8-4435-b8cb-730741292fb7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:32.554942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43bbe959-16e8-4435-b8cb-730741292fb7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:32.555945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43bbe959-16e8-4435-b8cb-730741292fb7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:32.561892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43bbe959-16e8-4435-b8cb-730741292fb7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:32.563032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43bbe959-16e8-4435-b8cb-730741292fb7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:32.563676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43bbe959-16e8-4435-b8cb-730741292fb7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:32.564273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43bbe959-16e8-4435-b8cb-730741292fb7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:32.710640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-43bbe959-16e8-4435-b8cb-730741292fb7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:32.744782 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-43bbe959-16e8-4435-b8cb-730741292fb7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1270 microversion: 2.1 time: 0.208352 Oct 24 10:24:32.753810 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 71/148] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:32 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1270 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:33.415076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0aecd23b-52b3-48dd-9bae-41186005cc05 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:33.416285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0aecd23b-52b3-48dd-9bae-41186005cc05 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:33.428153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0aecd23b-52b3-48dd-9bae-41186005cc05 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:33.430796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0aecd23b-52b3-48dd-9bae-41186005cc05 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:33.431686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0aecd23b-52b3-48dd-9bae-41186005cc05 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:33.435634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0aecd23b-52b3-48dd-9bae-41186005cc05 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:33.436426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0aecd23b-52b3-48dd-9bae-41186005cc05 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:33.437986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0aecd23b-52b3-48dd-9bae-41186005cc05 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:33.777443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-800c2114-2283-4386-aed1-261253922263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:33.778065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-800c2114-2283-4386-aed1-261253922263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:33.784668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-800c2114-2283-4386-aed1-261253922263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:33.785219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-800c2114-2283-4386-aed1-261253922263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:33.785660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-800c2114-2283-4386-aed1-261253922263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:33.786517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-800c2114-2283-4386-aed1-261253922263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:33.786959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-800c2114-2283-4386-aed1-261253922263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:33.787592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-800c2114-2283-4386-aed1-261253922263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:34.195137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-800c2114-2283-4386-aed1-261253922263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:34.217107 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-800c2114-2283-4386-aed1-261253922263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1270 microversion: 2.1 time: 0.439427 Oct 24 10:24:34.224735 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 72/149] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:33 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1270 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:24:34.438378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0aecd23b-52b3-48dd-9bae-41186005cc05 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:34.513638 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0aecd23b-52b3-48dd-9bae-41186005cc05 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1336 microversion: 2.1 time: 1.107132 Oct 24 10:24:34.539595 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 78/150] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:33 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1336 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:35.266215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e58c221-348c-4542-9ba3-cea14bff6f27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:35.267437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5e58c221-348c-4542-9ba3-cea14bff6f27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:35.282847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e58c221-348c-4542-9ba3-cea14bff6f27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:35.285459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e58c221-348c-4542-9ba3-cea14bff6f27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:35.286167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e58c221-348c-4542-9ba3-cea14bff6f27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:35.288704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e58c221-348c-4542-9ba3-cea14bff6f27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:35.289327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e58c221-348c-4542-9ba3-cea14bff6f27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:35.293740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e58c221-348c-4542-9ba3-cea14bff6f27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:35.551333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d6ad03fd-18aa-4d04-ad2c-967a86e521f1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:35.552430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d6ad03fd-18aa-4d04-ad2c-967a86e521f1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:35.562670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6ad03fd-18aa-4d04-ad2c-967a86e521f1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:35.563173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6ad03fd-18aa-4d04-ad2c-967a86e521f1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:35.563473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6ad03fd-18aa-4d04-ad2c-967a86e521f1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:35.564184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6ad03fd-18aa-4d04-ad2c-967a86e521f1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:35.564633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6ad03fd-18aa-4d04-ad2c-967a86e521f1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:35.565071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6ad03fd-18aa-4d04-ad2c-967a86e521f1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:36.093910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5e58c221-348c-4542-9ba3-cea14bff6f27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:36.106943 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5e58c221-348c-4542-9ba3-cea14bff6f27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1270 microversion: 2.1 time: 0.856824 Oct 24 10:24:36.108908 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 73/151] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:35 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1270 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:36.685969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d6ad03fd-18aa-4d04-ad2c-967a86e521f1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:36.716221 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d6ad03fd-18aa-4d04-ad2c-967a86e521f1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1336 microversion: 2.1 time: 1.165879 Oct 24 10:24:36.720598 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 79/152] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:35 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1336 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:37.137798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d4d22cf4-3f0b-4883-a696-c016b2bbda05 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:37.138188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d4d22cf4-3f0b-4883-a696-c016b2bbda05 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:37.154204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4d22cf4-3f0b-4883-a696-c016b2bbda05 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:37.155032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4d22cf4-3f0b-4883-a696-c016b2bbda05 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:37.155433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4d22cf4-3f0b-4883-a696-c016b2bbda05 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:37.156258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4d22cf4-3f0b-4883-a696-c016b2bbda05 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:37.156760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4d22cf4-3f0b-4883-a696-c016b2bbda05 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:37.157162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4d22cf4-3f0b-4883-a696-c016b2bbda05 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:37.338769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d4d22cf4-3f0b-4883-a696-c016b2bbda05 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:37.348097 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d4d22cf4-3f0b-4883-a696-c016b2bbda05 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1270 microversion: 2.1 time: 0.216435 Oct 24 10:24:37.363897 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 74/153] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:37 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1270 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:37.741530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-47c1b014-8b60-47b6-95bb-ece47d3daae1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:37.742153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-47c1b014-8b60-47b6-95bb-ece47d3daae1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:37.752531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47c1b014-8b60-47b6-95bb-ece47d3daae1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:37.758222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47c1b014-8b60-47b6-95bb-ece47d3daae1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:37.759542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47c1b014-8b60-47b6-95bb-ece47d3daae1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:37.760295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47c1b014-8b60-47b6-95bb-ece47d3daae1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:37.760783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47c1b014-8b60-47b6-95bb-ece47d3daae1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:37.761209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47c1b014-8b60-47b6-95bb-ece47d3daae1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:38.154869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:38.157419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:38.851391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-47c1b014-8b60-47b6-95bb-ece47d3daae1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:38.886723 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-47c1b014-8b60-47b6-95bb-ece47d3daae1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1336 microversion: 2.1 time: 1.150120 Oct 24 10:24:38.891340 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 80/154] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:37 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1336 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:38.923245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6728774d-2aca-43ff-9a94-f89163f3c566 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:38.925038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6728774d-2aca-43ff-9a94-f89163f3c566 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:38.947800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6728774d-2aca-43ff-9a94-f89163f3c566 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:38.950061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6728774d-2aca-43ff-9a94-f89163f3c566 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:38.950962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6728774d-2aca-43ff-9a94-f89163f3c566 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:38.952947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6728774d-2aca-43ff-9a94-f89163f3c566 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:38.955824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6728774d-2aca-43ff-9a94-f89163f3c566 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:38.958072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6728774d-2aca-43ff-9a94-f89163f3c566 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:39.202156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-605e479b-c1c6-49e4-b894-3fe5f1c89bfa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:39.215094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=75,nova_api:DELETE=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:39.234574 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-605e479b-c1c6-49e4-b894-3fe5f1c89bfa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.085784 Oct 24 10:24:39.242625 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 75/155] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:24:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:24:39.378435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6728774d-2aca-43ff-9a94-f89163f3c566 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:39.400294 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6728774d-2aca-43ff-9a94-f89163f3c566 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1270 microversion: 2.1 time: 0.504886 Oct 24 10:24:39.415898 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 81/156] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:38 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1270 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:39.522757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4b379e49-e61b-42d3-954f-637c713d3bb6 tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Calling method '.version_select at 0x7f04d16958b0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:39.526261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4b379e49-e61b-42d3-954f-637c713d3bb6 tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '5a0c2878540047f6898f4fece816a705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3214eb0feea4667a4910a568980e20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4b379e49-e61b-42d3-954f-637c713d3bb6 tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Request method failure captured: Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfkHba7RqAjVJgSWg2mikhLQac4-PEs98I6QoMy1MEL9QkpvdKVzzud-nlEC521Sy-_s2MHTo4j5jzXx0ENvBU_e43cKO_d2IQ3OmDkPb50ip45q2nckMX9utfmw5iGW3YNsLywOFntac6M1gMfYIBugFY2OgzzTdFjlsOrpRhR39E Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: e3214eb0feea4667a4910a568980e20c Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1644836438 Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:24:39.530463 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:24:39.531663 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e3214eb0feea4667a4910a568980e20c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e3214eb0feea4667a4910a568980e20c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e3214eb0feea4667a4910a568980e20c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e3214eb0feea4667a4910a568980e20c", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:39.531663 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1644836438 Oct 24 10:24:39.531663 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: e3214eb0feea4667a4910a568980e20c Oct 24 10:24:39.531663 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1644836438 Oct 24 10:24:39.531663 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-HypervisorAdminNegativeTestJSON-1644836438-project Oct 24 10:24:39.531663 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:39.531663 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:39.531663 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5a0c2878540047f6898f4fece816a705 Oct 24 10:24:39.531663 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1644836438-project Oct 24 10:24:39.531663 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:24:39.531663 n-d-858383-15 devstack@n-api.service[120425]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 24 10:24:39.531663 n-d-858383-15 devstack@n-api.service[120425]: action_args: {} Oct 24 10:24:39.531663 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:39.532418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 24 10:24:39.533427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:39.540200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4b379e49-e61b-42d3-954f-637c713d3bb6 tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:39.544367 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4b379e49-e61b-42d3-954f-637c713d3bb6 tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.298883 Oct 24 10:24:39.545226 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 76/157] 10.222.0.50 () {58 vars in 1167 bytes} [Mon Oct 24 10:24:39 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 302 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:39.558985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-02e7d7f2-d0ed-4e20-8b29-2bc0a0e7c617 tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Calling method '.version_select at 0x7f04d16cd550>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:39.561917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-02e7d7f2-d0ed-4e20-8b29-2bc0a0e7c617 tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '5a0c2878540047f6898f4fece816a705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3214eb0feea4667a4910a568980e20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-02e7d7f2-d0ed-4e20-8b29-2bc0a0e7c617 tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Request method failure captured: Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfkHba7RqAjVJgSWg2mikhLQac4-PEs98I6QoMy1MEL9QkpvdKVzzud-nlEC521Sy-_s2MHTo4j5jzXx0ENvBU_e43cKO_d2IQ3OmDkPb50ip45q2nckMX9utfmw5iGW3YNsLywOFntac6M1gMfYIBugFY2OgzzTdFjlsOrpRhR39E Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: e3214eb0feea4667a4910a568980e20c Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1644836438 Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:24:39.565942 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:24:39.567651 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e3214eb0feea4667a4910a568980e20c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e3214eb0feea4667a4910a568980e20c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e3214eb0feea4667a4910a568980e20c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e3214eb0feea4667a4910a568980e20c", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:39.567651 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1644836438 Oct 24 10:24:39.567651 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: e3214eb0feea4667a4910a568980e20c Oct 24 10:24:39.567651 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1644836438 Oct 24 10:24:39.567651 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-HypervisorAdminNegativeTestJSON-1644836438-project Oct 24 10:24:39.567651 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:39.567651 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:39.567651 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5a0c2878540047f6898f4fece816a705 Oct 24 10:24:39.567651 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1644836438-project Oct 24 10:24:39.567651 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:24:39.567651 n-d-858383-15 devstack@n-api.service[120425]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 24 10:24:39.567651 n-d-858383-15 devstack@n-api.service[120425]: action_args: {} Oct 24 10:24:39.567651 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:39.568734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 24 10:24:39.569763 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:39.573230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-02e7d7f2-d0ed-4e20-8b29-2bc0a0e7c617 tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:39.576085 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-02e7d7f2-d0ed-4e20-8b29-2bc0a0e7c617 tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.024738 Oct 24 10:24:39.577479 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 77/158] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:24:39 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:24:39.596935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-133f4399-b745-4a7e-bba7-97dce8f6e0ec tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Calling method '.version_select at 0x7f04d1cb5c10>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:39.599286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-133f4399-b745-4a7e-bba7-97dce8f6e0ec tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '5a0c2878540047f6898f4fece816a705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3214eb0feea4667a4910a568980e20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-133f4399-b745-4a7e-bba7-97dce8f6e0ec tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Request method failure captured: Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfkHba7RqAjVJgSWg2mikhLQac4-PEs98I6QoMy1MEL9QkpvdKVzzud-nlEC521Sy-_s2MHTo4j5jzXx0ENvBU_e43cKO_d2IQ3OmDkPb50ip45q2nckMX9utfmw5iGW3YNsLywOFntac6M1gMfYIBugFY2OgzzTdFjlsOrpRhR39E Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: e3214eb0feea4667a4910a568980e20c Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1644836438 Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:24:39.601094 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:24:39.602319 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e3214eb0feea4667a4910a568980e20c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e3214eb0feea4667a4910a568980e20c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e3214eb0feea4667a4910a568980e20c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e3214eb0feea4667a4910a568980e20c", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:39.602319 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1644836438 Oct 24 10:24:39.602319 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: e3214eb0feea4667a4910a568980e20c Oct 24 10:24:39.602319 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1644836438 Oct 24 10:24:39.602319 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-HypervisorAdminNegativeTestJSON-1644836438-project Oct 24 10:24:39.602319 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:39.602319 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:39.602319 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5a0c2878540047f6898f4fece816a705 Oct 24 10:24:39.602319 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1644836438-project Oct 24 10:24:39.602319 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:24:39.602319 n-d-858383-15 devstack@n-api.service[120425]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 24 10:24:39.602319 n-d-858383-15 devstack@n-api.service[120425]: action_args: {} Oct 24 10:24:39.602319 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:39.603013 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:39.604015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:39.604015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:39.604015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:39.604015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:39.604015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:39.604015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:39.604015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 24 10:24:39.604015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:39.604015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:39.604015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:39.604015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:39.604015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:39.604015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:39.604015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:39.604015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:39.604015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 24 10:24:39.604015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:39.605948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-133f4399-b745-4a7e-bba7-97dce8f6e0ec tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:39.605948 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-133f4399-b745-4a7e-bba7-97dce8f6e0ec tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.012130 Oct 24 10:24:39.622385 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 78/159] 10.222.0.50 () {58 vars in 1179 bytes} [Mon Oct 24 10:24:39 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:39.629799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:39.906050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-49c8ccd6-e810-4894-8437-1203aacf95f3 tempest-ServersWithSpecificFlavorTestJSON-117358791 tempest-ServersWithSpecificFlavorTestJSON-117358791-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-669916772", "id": 1113362990, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:39.946827 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-49c8ccd6-e810-4894-8437-1203aacf95f3 tempest-ServersWithSpecificFlavorTestJSON-117358791 tempest-ServersWithSpecificFlavorTestJSON-117358791-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.523636 Oct 24 10:24:39.948537 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 82/160] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:24:39 2022] POST /compute/v2.1/flavors => generated 424 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:39.956674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-96f16eb4-c75f-4e28-adbb-4ea5b67e1e84 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:39.961165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-96f16eb4-c75f-4e28-adbb-4ea5b67e1e84 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:39.974885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=7,nova_api:SAVEPOINT=4,nova_api:INSERT=4,nova_api:RELEASE=4,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:39.978384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96f16eb4-c75f-4e28-adbb-4ea5b67e1e84 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:39.981605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96f16eb4-c75f-4e28-adbb-4ea5b67e1e84 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:39.985285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96f16eb4-c75f-4e28-adbb-4ea5b67e1e84 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:39.986211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96f16eb4-c75f-4e28-adbb-4ea5b67e1e84 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:39.986828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96f16eb4-c75f-4e28-adbb-4ea5b67e1e84 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:39.987952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96f16eb4-c75f-4e28-adbb-4ea5b67e1e84 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:40.107144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:40.142266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0b73d2e1-c471-4ea6-af55-1a6ca7983e16 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Calling method '.version_select at 0x7f04d16d64c0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:40.149906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b73d2e1-c471-4ea6-af55-1a6ca7983e16 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:40.151422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b73d2e1-c471-4ea6-af55-1a6ca7983e16 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:40.153767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b73d2e1-c471-4ea6-af55-1a6ca7983e16 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:40.197240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b73d2e1-c471-4ea6-af55-1a6ca7983e16 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:40.201379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b73d2e1-c471-4ea6-af55-1a6ca7983e16 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:40.201946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b73d2e1-c471-4ea6-af55-1a6ca7983e16 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:40.231016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b73d2e1-c471-4ea6-af55-1a6ca7983e16 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:40.232537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b73d2e1-c471-4ea6-af55-1a6ca7983e16 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:40.233333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b73d2e1-c471-4ea6-af55-1a6ca7983e16 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:40.255387 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0b73d2e1-c471-4ea6-af55-1a6ca7983e16 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.631254 Oct 24 10:24:40.265181 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 79/161] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:24:39 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:40.270667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9e3a0b4e-8a7b-4356-857f-dd10de48540d tempest-ServersWithSpecificFlavorTestJSON-117358791 tempest-ServersWithSpecificFlavorTestJSON-117358791-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:40.295176 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9e3a0b4e-8a7b-4356-857f-dd10de48540d tempest-ServersWithSpecificFlavorTestJSON-117358791 tempest-ServersWithSpecificFlavorTestJSON-117358791-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028641 Oct 24 10:24:40.297680 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 80/162] 10.222.0.50 () {58 vars in 1182 bytes} [Mon Oct 24 10:24:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:24:40.310129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0060c155-3491-43b7-ba67-e30d5db99c7d tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Calling method '.version_select at 0x7f04d16cdc10>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:40.316606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0060c155-3491-43b7-ba67-e30d5db99c7d tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '5a0c2878540047f6898f4fece816a705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3214eb0feea4667a4910a568980e20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0060c155-3491-43b7-ba67-e30d5db99c7d tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Request method failure captured: Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfkHba7RqAjVJgSWg2mikhLQac4-PEs98I6QoMy1MEL9QkpvdKVzzud-nlEC521Sy-_s2MHTo4j5jzXx0ENvBU_e43cKO_d2IQ3OmDkPb50ip45q2nckMX9utfmw5iGW3YNsLywOFntac6M1gMfYIBugFY2OgzzTdFjlsOrpRhR39E Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: e3214eb0feea4667a4910a568980e20c Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1644836438 Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:24:40.319063 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:24:40.320230 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e3214eb0feea4667a4910a568980e20c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e3214eb0feea4667a4910a568980e20c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e3214eb0feea4667a4910a568980e20c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e3214eb0feea4667a4910a568980e20c", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:40.320230 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1644836438 Oct 24 10:24:40.320230 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: e3214eb0feea4667a4910a568980e20c Oct 24 10:24:40.320230 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1644836438 Oct 24 10:24:40.320230 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-HypervisorAdminNegativeTestJSON-1644836438-project Oct 24 10:24:40.320230 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:40.320230 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:40.320230 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5a0c2878540047f6898f4fece816a705 Oct 24 10:24:40.320230 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1644836438-project Oct 24 10:24:40.320230 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:24:40.320230 n-d-858383-15 devstack@n-api.service[120425]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 24 10:24:40.320230 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '1'} Oct 24 10:24:40.320230 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:40.320942 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:40.321912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:40.321912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:40.321912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:40.321912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:40.321912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:40.321912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:40.321912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 24 10:24:40.321912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.321912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:40.321912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.321912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:40.321912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:40.321912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:40.321912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:40.321912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:40.321912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 24 10:24:40.321912 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.325388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0060c155-3491-43b7-ba67-e30d5db99c7d tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:40.326470 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0060c155-3491-43b7-ba67-e30d5db99c7d tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.027470 Oct 24 10:24:40.333181 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 81/163] 10.222.0.50 () {58 vars in 1173 bytes} [Mon Oct 24 10:24:40 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:40.338501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-276c9827-aa6c-430c-b3d7-acdf123c8adc tempest-ServersWithSpecificFlavorTestJSON-117358791 tempest-ServersWithSpecificFlavorTestJSON-117358791-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-589493057", "id": 428163285, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:40.384654 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-276c9827-aa6c-430c-b3d7-acdf123c8adc tempest-ServersWithSpecificFlavorTestJSON-117358791 tempest-ServersWithSpecificFlavorTestJSON-117358791-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.049992 Oct 24 10:24:40.390092 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 82/164] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:24:40 2022] POST /compute/v2.1/flavors => generated 421 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:40.404937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-42c8893f-246a-4431-b161-03dec208ad31 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Calling method '.version_select at 0x7f04d16d6820>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:40.411658 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-42c8893f-246a-4431-b161-03dec208ad31 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] HTTP exception thrown: Hypervisor with ID '739b0fec-f622-4843-8c54-248f6356d842' could not be found. Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-42c8893f-246a-4431-b161-03dec208ad31 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Request method failure captured: Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-hypervisors/739b0fec-f622-4843-8c54-248f6356d842/uptime HTTP/1.1 Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfmK6Sy4UIeSJ0RAQby5p6cq7FIQYhtwf8Y_C5mMsIhE44w-5sCGhn3G8ssvakVnRjsGA0bN6v49qhGXcpP8kngSDLejR5WuAf9072gngUF_BLvvo_SaxCuENgI2tw76KPOJ8A_n3egnrUAlGF9OqF5cQeNNGw4gol9idmFsY1IaWk Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: c5684d485a7a4739a930018afff8448e Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-198734385 Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:24:40.427706 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:24:40.429181 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c5684d485a7a4739a930018afff8448e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c5684d485a7a4739a930018afff8448e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c5684d485a7a4739a930018afff8448e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c5684d485a7a4739a930018afff8448e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:40.429181 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-198734385 Oct 24 10:24:40.429181 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: c5684d485a7a4739a930018afff8448e Oct 24 10:24:40.429181 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-198734385 Oct 24 10:24:40.429181 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin Oct 24 10:24:40.429181 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:40.429181 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:40.429181 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 8943d30e59b04f64b63958573cdf8e26 Oct 24 10:24:40.429181 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin Oct 24 10:24:40.429181 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:24:40.429181 n-d-858383-15 devstack@n-api.service[120425]: exception: Hypervisor with ID '739b0fec-f622-4843-8c54-248f6356d842' could not be found. Oct 24 10:24:40.429181 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '739b0fec-f622-4843-8c54-248f6356d842'} Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '739b0fec-f622-4843-8c54-248f6356d842' Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 24 10:24:40.430004 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '739b0fec-f622-4843-8c54-248f6356d842' could not be found. Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:40.431364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.432704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:40.432704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:40.432704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:40.432704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:40.432704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:40.432704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '739b0fec-f622-4843-8c54-248f6356d842' could not be found. Oct 24 10:24:40.432704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.433394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-42c8893f-246a-4431-b161-03dec208ad31 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Returning 404 to user: Hypervisor with ID '739b0fec-f622-4843-8c54-248f6356d842' could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:40.434366 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-42c8893f-246a-4431-b161-03dec208ad31 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/739b0fec-f622-4843-8c54-248f6356d842/uptime" status: 404 len: 123 microversion: 2.1 time: 0.043096 Oct 24 10:24:40.439218 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 83/165] 10.222.0.50 () {58 vars in 1278 bytes} [Mon Oct 24 10:24:40 2022] GET /compute/v2.1/os-hypervisors/739b0fec-f622-4843-8c54-248f6356d842/uptime => generated 123 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:40.444569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-930812ca-d49b-4524-a461-c02e473260e1 tempest-ServersWithSpecificFlavorTestJSON-117358791 tempest-ServersWithSpecificFlavorTestJSON-117358791-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:40.463052 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-930812ca-d49b-4524-a461-c02e473260e1 tempest-ServersWithSpecificFlavorTestJSON-117358791 tempest-ServersWithSpecificFlavorTestJSON-117358791-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020763 Oct 24 10:24:40.466041 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 84/166] 10.222.0.50 () {58 vars in 1182 bytes} [Mon Oct 24 10:24:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:24:40.477190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2c3e9490-312e-4c76-bc35-83a827482b8d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:40.478018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2c3e9490-312e-4c76-bc35-83a827482b8d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:40.485223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c3e9490-312e-4c76-bc35-83a827482b8d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:40.485883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c3e9490-312e-4c76-bc35-83a827482b8d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:40.486697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c3e9490-312e-4c76-bc35-83a827482b8d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:40.487987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c3e9490-312e-4c76-bc35-83a827482b8d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:40.488731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c3e9490-312e-4c76-bc35-83a827482b8d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:40.490168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c3e9490-312e-4c76-bc35-83a827482b8d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:40.745442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-96f16eb4-c75f-4e28-adbb-4ea5b67e1e84 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:40.760086 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-96f16eb4-c75f-4e28-adbb-4ea5b67e1e84 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1336 microversion: 2.1 time: 0.806838 Oct 24 10:24:40.762261 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 83/167] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:39 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1336 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:40.772491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c5685daf-8d4e-46bf-b4d0-ae671d3caba3 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Calling method '.version_select at 0x7f04d1721310>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:40.774574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5685daf-8d4e-46bf-b4d0-ae671d3caba3 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:40.775231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5685daf-8d4e-46bf-b4d0-ae671d3caba3 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:40.775849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5685daf-8d4e-46bf-b4d0-ae671d3caba3 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:40.799059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5685daf-8d4e-46bf-b4d0-ae671d3caba3 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:40.800646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5685daf-8d4e-46bf-b4d0-ae671d3caba3 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:40.801334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5685daf-8d4e-46bf-b4d0-ae671d3caba3 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:40.818662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5685daf-8d4e-46bf-b4d0-ae671d3caba3 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:40.819411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5685daf-8d4e-46bf-b4d0-ae671d3caba3 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:40.819859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5685daf-8d4e-46bf-b4d0-ae671d3caba3 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:40.828807 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c5685daf-8d4e-46bf-b4d0-ae671d3caba3 tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.065204 Oct 24 10:24:40.829624 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 84/168] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:24:40 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:40.836617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ce92e082-e400-49f4-8b70-bd85ca70004a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Action: 'create', calling method: .version_select at 0x7f04d1721280>, body: {"keypair": {"name": "tempest-keypair-1839762585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEP8KNKSQtzbY4IeTFHrk6zXH5B9oMgbsmwUSkanUMu7hv8KPC7PYtuD6JXF2dOlw99VFbYxEQl5QwB1ndMJrOpOVa+pv8Y1lq1DYQ504Wa9aRiaPgvjt6yw1sWGYeGyAw=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:40.864770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c3e9490-312e-4c76-bc35-83a827482b8d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:40.867751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-ce92e082-e400-49f4-8b70-bd85ca70004a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Getting quotas for project 3db1d316f8d547919156c576461ed607. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:24:40.872610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-ce92e082-e400-49f4-8b70-bd85ca70004a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Getting quotas for user 6a4e7f9ab1cc4c3f81d40b2c4391619f and project 3db1d316f8d547919156c576461ed607. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:24:40.874904 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2c3e9490-312e-4c76-bc35-83a827482b8d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1312 microversion: 2.1 time: 0.407703 Oct 24 10:24:40.881734 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 85/169] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:40 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1312 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:40.921319 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ce92e082-e400-49f4-8b70-bd85ca70004a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.090513 Oct 24 10:24:40.922092 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 85/170] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:24:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:40.931256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ba1b5430-310c-47c2-b3fc-1e492845a49e tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Calling method '.version_select at 0x7f04d19d4dc0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:40.933343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ba1b5430-310c-47c2-b3fc-1e492845a49e tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '5a0c2878540047f6898f4fece816a705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3214eb0feea4667a4910a568980e20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ba1b5430-310c-47c2-b3fc-1e492845a49e tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Request method failure captured: Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfkHba7RqAjVJgSWg2mikhLQac4-PEs98I6QoMy1MEL9QkpvdKVzzud-nlEC521Sy-_s2MHTo4j5jzXx0ENvBU_e43cKO_d2IQ3OmDkPb50ip45q2nckMX9utfmw5iGW3YNsLywOFntac6M1gMfYIBugFY2OgzzTdFjlsOrpRhR39E Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: e3214eb0feea4667a4910a568980e20c Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1644836438 Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:24:40.935271 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:24:40.936421 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e3214eb0feea4667a4910a568980e20c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e3214eb0feea4667a4910a568980e20c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e3214eb0feea4667a4910a568980e20c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e3214eb0feea4667a4910a568980e20c", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:40.936421 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1644836438 Oct 24 10:24:40.936421 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: e3214eb0feea4667a4910a568980e20c Oct 24 10:24:40.936421 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1644836438 Oct 24 10:24:40.936421 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-HypervisorAdminNegativeTestJSON-1644836438-project Oct 24 10:24:40.936421 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:40.936421 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:40.936421 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 5a0c2878540047f6898f4fece816a705 Oct 24 10:24:40.936421 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1644836438-project Oct 24 10:24:40.936421 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:24:40.936421 n-d-858383-15 devstack@n-api.service[120426]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 24 10:24:40.936421 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '1'} Oct 24 10:24:40.936421 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:40.937137 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 24 10:24:40.938196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.939158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ba1b5430-310c-47c2-b3fc-1e492845a49e tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:40.939158 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ba1b5430-310c-47c2-b3fc-1e492845a49e tempest-HypervisorAdminNegativeTestJSON-1644836438 tempest-HypervisorAdminNegativeTestJSON-1644836438-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.015575 Oct 24 10:24:40.945484 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 86/171] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:24:40 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:40.951723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-53dfbb81-6c78-46c2-87c3-aa78f341928f tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Calling method '.version_select at 0x7f04d17b39d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:40.954632 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-53dfbb81-6c78-46c2-87c3-aa78f341928f tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] HTTP exception thrown: Hypervisor with ID 'a09926c6-289e-4e50-a1a4-72c973f18994' could not be found. Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-53dfbb81-6c78-46c2-87c3-aa78f341928f tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Request method failure captured: Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-hypervisors/a09926c6-289e-4e50-a1a4-72c973f18994 HTTP/1.1 Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfmK6Sy4UIeSJ0RAQby5p6cq7FIQYhtwf8Y_C5mMsIhE44w-5sCGhn3G8ssvakVnRjsGA0bN6v49qhGXcpP8kngSDLejR5WuAf9072gngUF_BLvvo_SaxCuENgI2tw76KPOJ8A_n3egnrUAlGF9OqF5cQeNNGw4gol9idmFsY1IaWk Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: c5684d485a7a4739a930018afff8448e Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-198734385 Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:24:40.959300 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:24:40.960696 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c5684d485a7a4739a930018afff8448e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c5684d485a7a4739a930018afff8448e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c5684d485a7a4739a930018afff8448e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c5684d485a7a4739a930018afff8448e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:40.960696 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-198734385 Oct 24 10:24:40.960696 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: c5684d485a7a4739a930018afff8448e Oct 24 10:24:40.960696 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-198734385 Oct 24 10:24:40.960696 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin Oct 24 10:24:40.960696 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:40.960696 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:40.960696 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 8943d30e59b04f64b63958573cdf8e26 Oct 24 10:24:40.960696 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin Oct 24 10:24:40.960696 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:24:40.960696 n-d-858383-15 devstack@n-api.service[120426]: exception: Hypervisor with ID 'a09926c6-289e-4e50-a1a4-72c973f18994' could not be found. Oct 24 10:24:40.960696 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'a09926c6-289e-4e50-a1a4-72c973f18994'} Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'a09926c6-289e-4e50-a1a4-72c973f18994' Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 24 10:24:40.961405 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 10:24:40.963946 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'a09926c6-289e-4e50-a1a4-72c973f18994' could not be found. Oct 24 10:24:40.965035 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.965035 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:40.965035 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.965035 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:40.965035 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:40.965035 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:40.965035 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:40.965035 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:40.965035 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'a09926c6-289e-4e50-a1a4-72c973f18994' could not be found. Oct 24 10:24:40.965035 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:40.969269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-53dfbb81-6c78-46c2-87c3-aa78f341928f tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] Returning 404 to user: Hypervisor with ID 'a09926c6-289e-4e50-a1a4-72c973f18994' could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:40.970793 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-53dfbb81-6c78-46c2-87c3-aa78f341928f tempest-HypervisorAdminNegativeTestJSON-198734385 tempest-HypervisorAdminNegativeTestJSON-198734385-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/a09926c6-289e-4e50-a1a4-72c973f18994" status: 404 len: 123 microversion: 2.1 time: 0.023309 Oct 24 10:24:40.971890 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 87/172] 10.222.0.50 () {58 vars in 1257 bytes} [Mon Oct 24 10:24:40 2022] GET /compute/v2.1/os-hypervisors/a09926c6-289e-4e50-a1a4-72c973f18994 => generated 123 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:41.231709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-aff93e15-6faa-4c69-a56b-e86f5fa143eb req-a7a03930-2d1f-456e-bb4c-510584600a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8cb09c-21cc-4d82-ab6a-ea07747f898e", "name": "network-vif-plugged", "status": "completed", "tag": "3126420a-5024-4d6d-a97f-0626a6360fb0"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:41.252081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-aff93e15-6faa-4c69-a56b-e86f5fa143eb req-a7a03930-2d1f-456e-bb4c-510584600a8a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:41.252791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-aff93e15-6faa-4c69-a56b-e86f5fa143eb req-a7a03930-2d1f-456e-bb4c-510584600a8a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:41.253691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-aff93e15-6faa-4c69-a56b-e86f5fa143eb req-a7a03930-2d1f-456e-bb4c-510584600a8a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:41.282231 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-aff93e15-6faa-4c69-a56b-e86f5fa143eb req-a7a03930-2d1f-456e-bb4c-510584600a8a service nova] Creating event network-vif-plugged:3126420a-5024-4d6d-a97f-0626a6360fb0 for instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e on n-h1-858383-15 Oct 24 10:24:41.283054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-aff93e15-6faa-4c69-a56b-e86f5fa143eb req-a7a03930-2d1f-456e-bb4c-510584600a8a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 10:24:41.283667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-aff93e15-6faa-4c69-a56b-e86f5fa143eb req-a7a03930-2d1f-456e-bb4c-510584600a8a service nova] Acquired lock "compute-rpcapi-router" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 10:24:41.285174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ec92324-73ca-49f4-bc78-8294fbde8264 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:41.285862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ec92324-73ca-49f4-bc78-8294fbde8264 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:41.286843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ec92324-73ca-49f4-bc78-8294fbde8264 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:41.289600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ec92324-73ca-49f4-bc78-8294fbde8264 None None] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:41.290337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ec92324-73ca-49f4-bc78-8294fbde8264 None None] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:41.291634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ec92324-73ca-49f4-bc78-8294fbde8264 None None] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:41.310572 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.compute.rpcapi [None req-7ec92324-73ca-49f4-bc78-8294fbde8264 None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 24 10:24:41.312198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ec92324-73ca-49f4-bc78-8294fbde8264 None None] Releasing lock "compute-rpcapi-router" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 10:24:41.338559 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7ec92324-73ca-49f4-bc78-8294fbde8264 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.453571 Oct 24 10:24:41.340531 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 86/173] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:41.947333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f3d34015-a013-4bb0-b650-5dcc3856fffb tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] Action: 'create', calling method: .version_select at 0x7f04d16880d0>, body: {"keypair": {"name": "tempest-keypair-1291235207", "type": "ssh", "user_id": "5c70621af15f44a99b2eeba6a4571dcd", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrzdprYia2+Yo63HD/MoAun57OYztBRl09/CwKR2kYhxnF1+6K+zrFjrrssSTg25zDfOoTN0eJ+hzmQTnrhYo9fvCcZgBw3EllbbelPxGeWR5PNzvwLscPzQnvI+viplw=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:41.982354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c672740f-0167-4ddb-8edf-1b94b0ebfc74 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Calling method '.version_select at 0x7f04d17b38b0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:41.993188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c672740f-0167-4ddb-8edf-1b94b0ebfc74 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:41.993850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c672740f-0167-4ddb-8edf-1b94b0ebfc74 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:41.994307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c672740f-0167-4ddb-8edf-1b94b0ebfc74 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:42.013378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-f3d34015-a013-4bb0-b650-5dcc3856fffb tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] Getting quotas for project f1c540d5b72041749603cc5ebb1654ae. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:24:42.022483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-f3d34015-a013-4bb0-b650-5dcc3856fffb tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] Getting quotas for user d37f5bdcfb714e8ba7a2d8981dc015e6 and project f1c540d5b72041749603cc5ebb1654ae. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:24:42.039356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c672740f-0167-4ddb-8edf-1b94b0ebfc74 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:42.039855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c672740f-0167-4ddb-8edf-1b94b0ebfc74 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:42.040331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c672740f-0167-4ddb-8edf-1b94b0ebfc74 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:42.068316 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f3d34015-a013-4bb0-b650-5dcc3856fffb tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.369854 Oct 24 10:24:42.069397 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 87/174] 10.222.0.50 () {62 vars in 1200 bytes} [Mon Oct 24 10:24:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 373 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 24 10:24:42.078625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b53ee84a-6c14-454e-a1a9-bce6e78dade0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:42.081617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b53ee84a-6c14-454e-a1a9-bce6e78dade0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:42.083204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c672740f-0167-4ddb-8edf-1b94b0ebfc74 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:42.084768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c672740f-0167-4ddb-8edf-1b94b0ebfc74 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:42.085433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c672740f-0167-4ddb-8edf-1b94b0ebfc74 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:42.096461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b53ee84a-6c14-454e-a1a9-bce6e78dade0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:42.101865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b53ee84a-6c14-454e-a1a9-bce6e78dade0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:42.102491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b53ee84a-6c14-454e-a1a9-bce6e78dade0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:42.103349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b53ee84a-6c14-454e-a1a9-bce6e78dade0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:42.106255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b53ee84a-6c14-454e-a1a9-bce6e78dade0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:42.107416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b53ee84a-6c14-454e-a1a9-bce6e78dade0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:42.121996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c672740f-0167-4ddb-8edf-1b94b0ebfc74 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:42.122495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c672740f-0167-4ddb-8edf-1b94b0ebfc74 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:42.123201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c672740f-0167-4ddb-8edf-1b94b0ebfc74 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:42.172785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c672740f-0167-4ddb-8edf-1b94b0ebfc74 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:42.173365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c672740f-0167-4ddb-8edf-1b94b0ebfc74 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:42.173809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c672740f-0167-4ddb-8edf-1b94b0ebfc74 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:42.183833 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c672740f-0167-4ddb-8edf-1b94b0ebfc74 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1761 microversion: 2.53 time: 0.655397 Oct 24 10:24:42.185536 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 88/175] 10.222.0.50 () {60 vars in 1243 bytes} [Mon Oct 24 10:24:41 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1761 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:24:42.191538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a2105a58-d591-433d-8c25-30cec1575ae3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:42.192401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a2105a58-d591-433d-8c25-30cec1575ae3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:42.200601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2105a58-d591-433d-8c25-30cec1575ae3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:42.201527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2105a58-d591-433d-8c25-30cec1575ae3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:42.202747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2105a58-d591-433d-8c25-30cec1575ae3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:42.204466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2105a58-d591-433d-8c25-30cec1575ae3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:42.205177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2105a58-d591-433d-8c25-30cec1575ae3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:42.205925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2105a58-d591-433d-8c25-30cec1575ae3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:42.887337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b53ee84a-6c14-454e-a1a9-bce6e78dade0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:42.898134 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b53ee84a-6c14-454e-a1a9-bce6e78dade0 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1336 microversion: 2.1 time: 0.827675 Oct 24 10:24:42.901112 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 88/176] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:42 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1336 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:42.913855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-54865964-0fde-44dd-8be5-b454cc273bad tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] Action: 'create', calling method: .version_select at 0x7f04d15fdc10>, body: {"keypair": {"name": "tempest-keypair-2085160923", "type": "ssh", "user_id": "5c70621af15f44a99b2eeba6a4571dcd", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE5V2LQ1ZKMjQdkIuPGHSloymL8JQrwIkwH1wGXjtT3k3+ICUg8BMk9O0EP2E1/gwtVzNUPh3MhsA6I/S1eKEEvOGhxLD54htVUCd262gmMhq0jiWzBI+sUHXPKUs8i/g=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:42.961602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-54865964-0fde-44dd-8be5-b454cc273bad tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] Getting quotas for project f1c540d5b72041749603cc5ebb1654ae. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:24:42.976479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-54865964-0fde-44dd-8be5-b454cc273bad tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] Getting quotas for user d37f5bdcfb714e8ba7a2d8981dc015e6 and project f1c540d5b72041749603cc5ebb1654ae. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:24:42.994220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a2105a58-d591-433d-8c25-30cec1575ae3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:43.007765 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a2105a58-d591-433d-8c25-30cec1575ae3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1312 microversion: 2.1 time: 0.820550 Oct 24 10:24:43.014733 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 89/177] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:42 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1312 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:43.024953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-330a85b6-e067-4704-9077-db0aa6fd5663 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Calling method '.version_select at 0x7f04d16af790>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:43.031924 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-54865964-0fde-44dd-8be5-b454cc273bad tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.129280 Oct 24 10:24:43.032919 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 89/178] 10.222.0.50 () {62 vars in 1200 bytes} [Mon Oct 24 10:24:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 10:24:43.044936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330a85b6-e067-4704-9077-db0aa6fd5663 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:43.045487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330a85b6-e067-4704-9077-db0aa6fd5663 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:43.046300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330a85b6-e067-4704-9077-db0aa6fd5663 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:43.049997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a299932d-fb2a-4b1f-82e4-848b1e8fa500 tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] Calling method '.version_select at 0x7f04d15f88b0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:43.064132 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a299932d-fb2a-4b1f-82e4-848b1e8fa500 tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-1291235207?user_id=5c70621af15f44a99b2eeba6a4571dcd" status: 200 len: 512 microversion: 2.10 time: 0.023820 Oct 24 10:24:43.065309 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 90/179] 10.222.0.50 () {60 vars in 1340 bytes} [Mon Oct 24 10:24:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1291235207?user_id=5c70621af15f44a99b2eeba6a4571dcd => generated 512 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 10:24:43.074991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330a85b6-e067-4704-9077-db0aa6fd5663 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:43.080219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330a85b6-e067-4704-9077-db0aa6fd5663 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:43.081042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330a85b6-e067-4704-9077-db0aa6fd5663 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:43.081855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-537e5927-821e-45d1-9308-5770a12d7eb0 tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] Action: 'create', calling method: .version_select at 0x7f04d15f89d0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-405478796", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHlsBjWRRKCfHv2oRhSNgGFAO/nBO+UEDLnPV05af8nQQ0qO1TA71icT6jJec503jL06CFyQx61sdKh+JhrvTgDi/1de4QHvDJX58XExFdZEMOiR2Cmt5BJnSxI8OH0/A=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:43.128281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330a85b6-e067-4704-9077-db0aa6fd5663 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:43.135125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330a85b6-e067-4704-9077-db0aa6fd5663 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:43.137228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-537e5927-821e-45d1-9308-5770a12d7eb0 tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] Getting quotas for project f1c540d5b72041749603cc5ebb1654ae. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:24:43.137953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330a85b6-e067-4704-9077-db0aa6fd5663 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:43.143104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-537e5927-821e-45d1-9308-5770a12d7eb0 tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] Getting quotas for user d37f5bdcfb714e8ba7a2d8981dc015e6 and project f1c540d5b72041749603cc5ebb1654ae. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:24:43.175427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330a85b6-e067-4704-9077-db0aa6fd5663 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:43.176076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330a85b6-e067-4704-9077-db0aa6fd5663 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:43.176793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330a85b6-e067-4704-9077-db0aa6fd5663 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:43.197036 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-537e5927-821e-45d1-9308-5770a12d7eb0 tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.119515 Oct 24 10:24:43.207739 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 91/180] 10.222.0.50 () {62 vars in 1200 bytes} [Mon Oct 24 10:24:43 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 10:24:43.220441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330a85b6-e067-4704-9077-db0aa6fd5663 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:43.221902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330a85b6-e067-4704-9077-db0aa6fd5663 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:43.223857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330a85b6-e067-4704-9077-db0aa6fd5663 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:43.231496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7d61db8f-df83-4ccd-843d-f107875f30d9 tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] Calling method '.version_select at 0x7f04d16885e0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:43.238147 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-330a85b6-e067-4704-9077-db0aa6fd5663 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 451 microversion: 2.53 time: 0.221111 Oct 24 10:24:43.238934 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 90/181] 10.222.0.50 () {60 vars in 1222 bytes} [Mon Oct 24 10:24:43 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 451 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:24:43.242515 n-d-858383-15 devstack@n-api.service[120425]: WARNING oslo_db.sqlalchemy.utils [None req-7d61db8f-df83-4ccd-843d-f107875f30d9 tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 24 10:24:43.252194 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7d61db8f-df83-4ccd-843d-f107875f30d9 tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] 10.222.0.50 "GET /compute/v2.1/os-keypairs?user_id=5c70621af15f44a99b2eeba6a4571dcd" status: 200 len: 726 microversion: 2.10 time: 0.036421 Oct 24 10:24:43.253175 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 92/182] 10.222.0.50 () {60 vars in 1259 bytes} [Mon Oct 24 10:24:43 2022] GET /compute/v2.1/os-keypairs?user_id=5c70621af15f44a99b2eeba6a4571dcd => generated 726 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:24:43.264284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-12047e38-b447-4a5d-8aa2-85a2f9cd63a1 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Calling method '.version_select at 0x7f04d16afdc0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:43.267502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be7c6beb-97dd-4f7c-a455-2cb3e3311e51 tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] Calling method '.version_select at 0x7f04d15c30d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:43.272587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-12047e38-b447-4a5d-8aa2-85a2f9cd63a1 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:43.274507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-12047e38-b447-4a5d-8aa2-85a2f9cd63a1 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:43.275214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-12047e38-b447-4a5d-8aa2-85a2f9cd63a1 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:43.311171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-12047e38-b447-4a5d-8aa2-85a2f9cd63a1 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:43.312485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-12047e38-b447-4a5d-8aa2-85a2f9cd63a1 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:43.313616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-12047e38-b447-4a5d-8aa2-85a2f9cd63a1 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:43.330321 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-12047e38-b447-4a5d-8aa2-85a2f9cd63a1 tempest-HypervisorAdminV253TestBase-2126672138 tempest-HypervisorAdminV253TestBase-2126672138-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/9142f424-d4d9-4e1c-8e09-a827e95085cd" status: 200 len: 794 microversion: 2.53 time: 0.080257 Oct 24 10:24:43.331452 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 91/183] 10.222.0.50 () {60 vars in 1298 bytes} [Mon Oct 24 10:24:43 2022] GET /compute/v2.1/os-hypervisors/9142f424-d4d9-4e1c-8e09-a827e95085cd => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:24:43.357403 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-be7c6beb-97dd-4f7c-a455-2cb3e3311e51 tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-405478796" status: 204 len: 0 microversion: 2.10 time: 0.095766 Oct 24 10:24:43.361762 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 93/184] 10.222.0.50 () {60 vars in 1322 bytes} [Mon Oct 24 10:24:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-405478796 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 24 10:24:43.373505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7ca67423-533f-4228-b939-0ce919d059d4 tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] Calling method '.version_select at 0x7f04d16af670>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:43.437489 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7ca67423-533f-4228-b939-0ce919d059d4 tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085160923?user_id=5c70621af15f44a99b2eeba6a4571dcd" status: 204 len: 0 microversion: 2.10 time: 0.073928 Oct 24 10:24:43.443120 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 92/185] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:24:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085160923?user_id=5c70621af15f44a99b2eeba6a4571dcd => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:24:43.450419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d27e7220-9c1b-44d8-9697-86a0d99bd586 tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] Calling method '.version_select at 0x7f04d15ebf70>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:43.479347 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d27e7220-9c1b-44d8-9697-86a0d99bd586 tempest-KeyPairsV210TestJSON-609898180 tempest-KeyPairsV210TestJSON-609898180-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1291235207?user_id=5c70621af15f44a99b2eeba6a4571dcd" status: 204 len: 0 microversion: 2.10 time: 0.033240 Oct 24 10:24:43.480036 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 94/186] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:24:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1291235207?user_id=5c70621af15f44a99b2eeba6a4571dcd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:24:43.726609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-07c1697c-45e2-498b-8328-24b7707be471 req-d3807181-5eb1-4074-a61d-ffc8bbe89b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b52c962-e95e-465b-a898-0cb4fffe0ba0", "tag": "eb4f598e-dc19-47d1-99f7-93994ac25681"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:43.757967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-07c1697c-45e2-498b-8328-24b7707be471 req-d3807181-5eb1-4074-a61d-ffc8bbe89b0f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:43.760468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-07c1697c-45e2-498b-8328-24b7707be471 req-d3807181-5eb1-4074-a61d-ffc8bbe89b0f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:43.761101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-07c1697c-45e2-498b-8328-24b7707be471 req-d3807181-5eb1-4074-a61d-ffc8bbe89b0f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:43.797114 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-07c1697c-45e2-498b-8328-24b7707be471 req-d3807181-5eb1-4074-a61d-ffc8bbe89b0f service nova] Creating event network-changed:eb4f598e-dc19-47d1-99f7-93994ac25681 for instance 1b52c962-e95e-465b-a898-0cb4fffe0ba0 on n-h2-858383-15 Oct 24 10:24:43.810616 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-07c1697c-45e2-498b-8328-24b7707be471 req-d3807181-5eb1-4074-a61d-ffc8bbe89b0f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090932 Oct 24 10:24:43.811713 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 93/187] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:43.927258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-171603c6-62a6-4916-94d2-685757e01166 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:43.928638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-171603c6-62a6-4916-94d2-685757e01166 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:43.944205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-171603c6-62a6-4916-94d2-685757e01166 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:43.945460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-171603c6-62a6-4916-94d2-685757e01166 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:43.945893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-171603c6-62a6-4916-94d2-685757e01166 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:43.949804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-171603c6-62a6-4916-94d2-685757e01166 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:43.950995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-171603c6-62a6-4916-94d2-685757e01166 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:43.954049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-171603c6-62a6-4916-94d2-685757e01166 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:44.045563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c0933a5b-65eb-4609-b694-1639f0ec5519 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:44.049626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c0933a5b-65eb-4609-b694-1639f0ec5519 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:44.067081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0933a5b-65eb-4609-b694-1639f0ec5519 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:44.068231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0933a5b-65eb-4609-b694-1639f0ec5519 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:44.068784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0933a5b-65eb-4609-b694-1639f0ec5519 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:44.069830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0933a5b-65eb-4609-b694-1639f0ec5519 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:44.070398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0933a5b-65eb-4609-b694-1639f0ec5519 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:44.070932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0933a5b-65eb-4609-b694-1639f0ec5519 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:44.549872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-171603c6-62a6-4916-94d2-685757e01166 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:44.566767 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-171603c6-62a6-4916-94d2-685757e01166 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1336 microversion: 2.1 time: 0.637351 Oct 24 10:24:44.568399 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 95/188] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:43 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1336 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:44.587198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d9378176-ad66-410b-a00e-7582c354bb5c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-527640281", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "428163285", "adminPass": "***", "networks": [{"uuid": "336ccfea-283a-4469-ae69-bad4be20f8eb"}], "security_groups": [{"name": "tempest-securitygroup--600605418"}], "key_name": "tempest-keypair-1839762585", "user_data": "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:45.243487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c0933a5b-65eb-4609-b694-1639f0ec5519 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:45.265204 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c0933a5b-65eb-4609-b694-1639f0ec5519 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1312 microversion: 2.1 time: 1.220045 Oct 24 10:24:45.266113 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 94/189] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:44 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1312 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:24:45.478768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-d9378176-ad66-410b-a00e-7582c354bb5c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] validate_networks() for [('336ccfea-283a-4469-ae69-bad4be20f8eb', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:24:45.594712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e1ea6722-0dae-4473-aa6f-f42184171ad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:45.596075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e1ea6722-0dae-4473-aa6f-f42184171ad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:45.621780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1ea6722-0dae-4473-aa6f-f42184171ad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:45.622721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1ea6722-0dae-4473-aa6f-f42184171ad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:45.625034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1ea6722-0dae-4473-aa6f-f42184171ad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:45.627792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1ea6722-0dae-4473-aa6f-f42184171ad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:45.628448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1ea6722-0dae-4473-aa6f-f42184171ad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:45.631223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1ea6722-0dae-4473-aa6f-f42184171ad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:46.155411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e1ea6722-0dae-4473-aa6f-f42184171ad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:46.163933 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e1ea6722-0dae-4473-aa6f-f42184171ad1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1484 microversion: 2.1 time: 0.573848 Oct 24 10:24:46.164518 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 95/190] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:45 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1484 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:46.190411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-099617b7-de40-4888-bb0c-94bff0b4ba46 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:46.191032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-099617b7-de40-4888-bb0c-94bff0b4ba46 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:46.206703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-099617b7-de40-4888-bb0c-94bff0b4ba46 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:46.207525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-099617b7-de40-4888-bb0c-94bff0b4ba46 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:46.208281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-099617b7-de40-4888-bb0c-94bff0b4ba46 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:46.209915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-099617b7-de40-4888-bb0c-94bff0b4ba46 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:46.210811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-099617b7-de40-4888-bb0c-94bff0b4ba46 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:46.211404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-099617b7-de40-4888-bb0c-94bff0b4ba46 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:47.301446 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-099617b7-de40-4888-bb0c-94bff0b4ba46 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1637 microversion: 2.1 time: 1.114637 Oct 24 10:24:47.305393 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 96/191] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:46 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1637 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:47.314166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8b05d503-16e0-4a4d-81c0-6e8313e72900 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:47.314797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8b05d503-16e0-4a4d-81c0-6e8313e72900 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:47.334130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b05d503-16e0-4a4d-81c0-6e8313e72900 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:47.334918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b05d503-16e0-4a4d-81c0-6e8313e72900 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:47.337350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b05d503-16e0-4a4d-81c0-6e8313e72900 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:47.341247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b05d503-16e0-4a4d-81c0-6e8313e72900 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:47.342189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b05d503-16e0-4a4d-81c0-6e8313e72900 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:47.344139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b05d503-16e0-4a4d-81c0-6e8313e72900 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:47.418694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:47.882752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8b05d503-16e0-4a4d-81c0-6e8313e72900 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:47.898017 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8b05d503-16e0-4a4d-81c0-6e8313e72900 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1312 microversion: 2.1 time: 0.591516 Oct 24 10:24:47.899543 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 97/192] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:47 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1312 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:47.907015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cf71474a-8403-41c1-b2e2-4f51772cb50b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:47.907768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cf71474a-8403-41c1-b2e2-4f51772cb50b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:47.919141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf71474a-8403-41c1-b2e2-4f51772cb50b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:47.920054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf71474a-8403-41c1-b2e2-4f51772cb50b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:47.920649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf71474a-8403-41c1-b2e2-4f51772cb50b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:47.921637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf71474a-8403-41c1-b2e2-4f51772cb50b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:47.922737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf71474a-8403-41c1-b2e2-4f51772cb50b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:47.923360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf71474a-8403-41c1-b2e2-4f51772cb50b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:47.964000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cf71474a-8403-41c1-b2e2-4f51772cb50b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:24:48.213005 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cf71474a-8403-41c1-b2e2-4f51772cb50b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 204 len: 0 microversion: 2.1 time: 0.311611 Oct 24 10:24:48.215298 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 98/193] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:24:47 2022] DELETE /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:24:48.232504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-51037601-5b2a-4229-b012-00b661717ca1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:48.233977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-51037601-5b2a-4229-b012-00b661717ca1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:48.254520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51037601-5b2a-4229-b012-00b661717ca1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:48.255288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51037601-5b2a-4229-b012-00b661717ca1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:48.257800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51037601-5b2a-4229-b012-00b661717ca1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:48.258959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51037601-5b2a-4229-b012-00b661717ca1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:48.260235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51037601-5b2a-4229-b012-00b661717ca1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:48.261869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51037601-5b2a-4229-b012-00b661717ca1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:48.331027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d9378176-ad66-410b-a00e-7582c354bb5c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:24:48.332007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d9378176-ad66-410b-a00e-7582c354bb5c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:24:48.332670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d9378176-ad66-410b-a00e-7582c354bb5c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:24:48.333879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d9378176-ad66-410b-a00e-7582c354bb5c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:24:48.334756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d9378176-ad66-410b-a00e-7582c354bb5c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:24:48.357856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9378176-ad66-410b-a00e-7582c354bb5c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:48.359180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9378176-ad66-410b-a00e-7582c354bb5c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:48.360730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9378176-ad66-410b-a00e-7582c354bb5c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:48.362473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9378176-ad66-410b-a00e-7582c354bb5c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:48.364983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9378176-ad66-410b-a00e-7582c354bb5c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:48.370833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9378176-ad66-410b-a00e-7582c354bb5c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:48.401130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-d9378176-ad66-410b-a00e-7582c354bb5c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Getting quotas for project 3db1d316f8d547919156c576461ed607. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:24:48.406663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-d9378176-ad66-410b-a00e-7582c354bb5c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Getting quotas for user 6a4e7f9ab1cc4c3f81d40b2c4391619f and project 3db1d316f8d547919156c576461ed607. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:24:48.424632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d9378176-ad66-410b-a00e-7582c354bb5c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:24:48.427379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d9378176-ad66-410b-a00e-7582c354bb5c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:24:48.499629 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d9378176-ad66-410b-a00e-7582c354bb5c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.929643 Oct 24 10:24:48.500369 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 96/194] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:24:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 3931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:24:48.514917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7cc6e748-fb27-4de2-a4a5-6f6e4672aead tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:48.516085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7cc6e748-fb27-4de2-a4a5-6f6e4672aead tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:48.647213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7cc6e748-fb27-4de2-a4a5-6f6e4672aead tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:48.670627 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7cc6e748-fb27-4de2-a4a5-6f6e4672aead tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 200 len: 1262 microversion: 2.1 time: 0.161071 Oct 24 10:24:48.673351 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 97/195] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:48 2022] GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 1262 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:24:49.012200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-51037601-5b2a-4229-b012-00b661717ca1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:49.025950 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-51037601-5b2a-4229-b012-00b661717ca1 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1490 microversion: 2.1 time: 0.803427 Oct 24 10:24:49.026858 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 99/196] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:48 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1490 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:49.034520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3565e881-b0de-4b7e-9816-85d217ba6a3a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:49.037454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3565e881-b0de-4b7e-9816-85d217ba6a3a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:49.050403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3565e881-b0de-4b7e-9816-85d217ba6a3a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:49.052640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3565e881-b0de-4b7e-9816-85d217ba6a3a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:49.054442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3565e881-b0de-4b7e-9816-85d217ba6a3a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:49.055304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3565e881-b0de-4b7e-9816-85d217ba6a3a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:49.057343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3565e881-b0de-4b7e-9816-85d217ba6a3a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:49.057955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3565e881-b0de-4b7e-9816-85d217ba6a3a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:49.291969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c7905a65-81dd-4830-be35-d02976dcaf43 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Action: 'update', calling method: .version_select at 0x7f04d15c3280>, body: {"quota_set": {"ram": "5120"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:49.594268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3565e881-b0de-4b7e-9816-85d217ba6a3a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:49.603770 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3565e881-b0de-4b7e-9816-85d217ba6a3a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1312 microversion: 2.1 time: 0.574418 Oct 24 10:24:49.605720 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 100/197] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:49 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1312 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:49.701057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e2bf609f-3069-4e03-a102-51d27362d599 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:49.701688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e2bf609f-3069-4e03-a102-51d27362d599 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:49.717963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2bf609f-3069-4e03-a102-51d27362d599 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:49.718661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2bf609f-3069-4e03-a102-51d27362d599 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:49.719867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2bf609f-3069-4e03-a102-51d27362d599 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:49.720927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2bf609f-3069-4e03-a102-51d27362d599 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:49.721394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2bf609f-3069-4e03-a102-51d27362d599 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:49.721826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2bf609f-3069-4e03-a102-51d27362d599 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:49.844710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7905a65-81dd-4830-be35-d02976dcaf43 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:49.846180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7905a65-81dd-4830-be35-d02976dcaf43 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:49.846629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7905a65-81dd-4830-be35-d02976dcaf43 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:49.848450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7905a65-81dd-4830-be35-d02976dcaf43 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:49.850970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7905a65-81dd-4830-be35-d02976dcaf43 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:49.853262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7905a65-81dd-4830-be35-d02976dcaf43 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:49.936192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e2bf609f-3069-4e03-a102-51d27362d599 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:49.945177 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e2bf609f-3069-4e03-a102-51d27362d599 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 200 len: 1314 microversion: 2.1 time: 0.248584 Oct 24 10:24:49.948872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:49.967237 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 101/198] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:49 2022] GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:49.977401 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c7905a65-81dd-4830-be35-d02976dcaf43 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/381aad94e5e14bcc93e46879a7d6617e" status: 200 len: 148 microversion: 2.57 time: 1.136721 Oct 24 10:24:49.978305 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 98/199] 10.222.0.50 () {62 vars in 1303 bytes} [Mon Oct 24 10:24:48 2022] PUT /compute/v2.1/os-quota-sets/381aad94e5e14bcc93e46879a7d6617e => generated 148 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 10:24:49.989927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-953aa9ca-b9e2-4808-b04c-08146ef44dd3 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Calling method '.version_select at 0x7f04d17b34c0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:50.051092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9afc8350-711e-44ab-a259-67b244ad2d18 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:50.055073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9afc8350-711e-44ab-a259-67b244ad2d18 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:50.068006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9afc8350-711e-44ab-a259-67b244ad2d18 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:50.072195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9afc8350-711e-44ab-a259-67b244ad2d18 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:50.072751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9afc8350-711e-44ab-a259-67b244ad2d18 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:50.074279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9afc8350-711e-44ab-a259-67b244ad2d18 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:50.074945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9afc8350-711e-44ab-a259-67b244ad2d18 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:50.075598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9afc8350-711e-44ab-a259-67b244ad2d18 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:50.507410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9afc8350-711e-44ab-a259-67b244ad2d18 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:50.523235 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9afc8350-711e-44ab-a259-67b244ad2d18 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1490 microversion: 2.1 time: 0.476932 Oct 24 10:24:50.528324 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 99/200] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:50 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1490 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:50.631909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b1457cb5-406d-4cd4-88af-edf4f1895a3d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:50.633036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b1457cb5-406d-4cd4-88af-edf4f1895a3d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:50.652126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1457cb5-406d-4cd4-88af-edf4f1895a3d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:50.654031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1457cb5-406d-4cd4-88af-edf4f1895a3d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:50.655106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1457cb5-406d-4cd4-88af-edf4f1895a3d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:50.658101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1457cb5-406d-4cd4-88af-edf4f1895a3d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:50.660219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1457cb5-406d-4cd4-88af-edf4f1895a3d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:50.662523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1457cb5-406d-4cd4-88af-edf4f1895a3d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:50.734404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-953aa9ca-b9e2-4808-b04c-08146ef44dd3 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:50.735675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-953aa9ca-b9e2-4808-b04c-08146ef44dd3 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:50.736378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-953aa9ca-b9e2-4808-b04c-08146ef44dd3 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:50.737774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-953aa9ca-b9e2-4808-b04c-08146ef44dd3 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:50.738622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-953aa9ca-b9e2-4808-b04c-08146ef44dd3 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:50.741240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-953aa9ca-b9e2-4808-b04c-08146ef44dd3 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:50.776690 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-953aa9ca-b9e2-4808-b04c-08146ef44dd3 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/381aad94e5e14bcc93e46879a7d6617e/detail" status: 200 len: 463 microversion: 2.57 time: 0.790776 Oct 24 10:24:50.788933 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 102/201] 10.222.0.50 () {60 vars in 1304 bytes} [Mon Oct 24 10:24:49 2022] GET /compute/v2.1/os-quota-sets/381aad94e5e14bcc93e46879a7d6617e/detail => generated 463 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:24:50.979527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e6f74e92-3691-450c-87e0-143258d25f47 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:50.980331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e6f74e92-3691-450c-87e0-143258d25f47 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:50.988733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6f74e92-3691-450c-87e0-143258d25f47 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:50.990716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6f74e92-3691-450c-87e0-143258d25f47 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:51.005893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6f74e92-3691-450c-87e0-143258d25f47 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:51.010680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6f74e92-3691-450c-87e0-143258d25f47 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:51.013156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6f74e92-3691-450c-87e0-143258d25f47 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:51.014481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6f74e92-3691-450c-87e0-143258d25f47 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:51.021368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b1457cb5-406d-4cd4-88af-edf4f1895a3d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:51.029797 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b1457cb5-406d-4cd4-88af-edf4f1895a3d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1312 microversion: 2.1 time: 0.404001 Oct 24 10:24:51.037225 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 100/202] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:50 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1312 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:51.085522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7ef52533-00e0-40c0-8da7-d87d5e9c5520 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Action: 'update', calling method: .version_select at 0x7f04d16d6a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:51.221138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e6f74e92-3691-450c-87e0-143258d25f47 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:51.231472 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e6f74e92-3691-450c-87e0-143258d25f47 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 200 len: 1320 microversion: 2.1 time: 0.259373 Oct 24 10:24:51.232526 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 103/203] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:50 2022] GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 1320 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:51.346663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-dd722886-a5c6-4652-a497-6687a09a8764 req-e221ac25-1b5a-4b5f-a4e0-97c49d4a51f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8cb09c-21cc-4d82-ab6a-ea07747f898e", "name": "network-vif-deleted", "tag": "3126420a-5024-4d6d-a97f-0626a6360fb0"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:51.373494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dd722886-a5c6-4652-a497-6687a09a8764 req-e221ac25-1b5a-4b5f-a4e0-97c49d4a51f3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:51.374031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dd722886-a5c6-4652-a497-6687a09a8764 req-e221ac25-1b5a-4b5f-a4e0-97c49d4a51f3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:51.374471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dd722886-a5c6-4652-a497-6687a09a8764 req-e221ac25-1b5a-4b5f-a4e0-97c49d4a51f3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:51.391533 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-dd722886-a5c6-4652-a497-6687a09a8764 req-e221ac25-1b5a-4b5f-a4e0-97c49d4a51f3 service nova] Creating event network-vif-deleted:3126420a-5024-4d6d-a97f-0626a6360fb0 for instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e on n-h1-858383-15 Oct 24 10:24:51.397951 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-dd722886-a5c6-4652-a497-6687a09a8764 req-e221ac25-1b5a-4b5f-a4e0-97c49d4a51f3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056424 Oct 24 10:24:51.399181 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 104/204] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:24:51.459684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ef52533-00e0-40c0-8da7-d87d5e9c5520 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:51.460299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ef52533-00e0-40c0-8da7-d87d5e9c5520 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:51.461027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ef52533-00e0-40c0-8da7-d87d5e9c5520 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:51.462739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ef52533-00e0-40c0-8da7-d87d5e9c5520 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:51.463493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ef52533-00e0-40c0-8da7-d87d5e9c5520 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:51.464134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ef52533-00e0-40c0-8da7-d87d5e9c5520 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:51.530817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ef52533-00e0-40c0-8da7-d87d5e9c5520 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:51.531768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ef52533-00e0-40c0-8da7-d87d5e9c5520 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:51.532395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ef52533-00e0-40c0-8da7-d87d5e9c5520 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:51.533597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ef52533-00e0-40c0-8da7-d87d5e9c5520 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:51.534245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ef52533-00e0-40c0-8da7-d87d5e9c5520 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:51.534981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ef52533-00e0-40c0-8da7-d87d5e9c5520 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:51.685674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4721120a-c990-402c-88da-206157c8d021 tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Calling method '.version_select at 0x7f04d14da550>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:51.688786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4721120a-c990-402c-88da-206157c8d021 tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:51.689623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4721120a-c990-402c-88da-206157c8d021 tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:51.690605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4721120a-c990-402c-88da-206157c8d021 tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:51.720298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4721120a-c990-402c-88da-206157c8d021 tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:51.721956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4721120a-c990-402c-88da-206157c8d021 tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:51.722412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4721120a-c990-402c-88da-206157c8d021 tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:51.735719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4721120a-c990-402c-88da-206157c8d021 tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:51.736398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4721120a-c990-402c-88da-206157c8d021 tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:51.736642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4721120a-c990-402c-88da-206157c8d021 tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:51.744355 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4721120a-c990-402c-88da-206157c8d021 tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.304078 Oct 24 10:24:51.744990 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 105/205] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:24:51 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:51.754562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-31d7372a-faa1-4673-b698-7627e451b312 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:51.755501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-31d7372a-faa1-4673-b698-7627e451b312 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:51.763391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31d7372a-faa1-4673-b698-7627e451b312 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:51.763982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31d7372a-faa1-4673-b698-7627e451b312 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:51.765601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31d7372a-faa1-4673-b698-7627e451b312 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:51.766741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31d7372a-faa1-4673-b698-7627e451b312 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:51.774569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31d7372a-faa1-4673-b698-7627e451b312 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:51.774880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31d7372a-faa1-4673-b698-7627e451b312 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:51.818900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31d7372a-faa1-4673-b698-7627e451b312 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:51.819591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31d7372a-faa1-4673-b698-7627e451b312 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:51.820186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31d7372a-faa1-4673-b698-7627e451b312 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:51.820948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-31d7372a-faa1-4673-b698-7627e451b312 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lazy-loading 'fault' on Instance uuid 3a8cb09c-21cc-4d82-ab6a-ea07747f898e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:24:51.942837 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7ef52533-00e0-40c0-8da7-d87d5e9c5520 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/381aad94e5e14bcc93e46879a7d6617e?user_id=c1b1d6478d844f4384521e25a85c5a3d" status: 200 len: 148 microversion: 2.57 time: 0.861568 Oct 24 10:24:51.944661 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 101/206] 10.222.0.50 () {62 vars in 1384 bytes} [Mon Oct 24 10:24:51 2022] PUT /compute/v2.1/os-quota-sets/381aad94e5e14bcc93e46879a7d6617e?user_id=c1b1d6478d844f4384521e25a85c5a3d => generated 148 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 10:24:51.983813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-31d7372a-faa1-4673-b698-7627e451b312 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6e751686ba42339301446509eb8a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc7632d3e704c27abeeedb0e3fab434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:52.006751 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-31d7372a-faa1-4673-b698-7627e451b312 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 200 len: 1326 microversion: 2.1 time: 0.260433 Oct 24 10:24:52.009211 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 106/207] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:51 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 1326 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:52.043351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-dd62a749-6aa2-4ecd-87aa-c5cb4261f4b4 req-34202633-7325-47c3-a37a-c7cf77ee8af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b52c962-e95e-465b-a898-0cb4fffe0ba0", "name": "network-vif-plugged", "status": "completed", "tag": "eb4f598e-dc19-47d1-99f7-93994ac25681"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:52.055351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dd62a749-6aa2-4ecd-87aa-c5cb4261f4b4 req-34202633-7325-47c3-a37a-c7cf77ee8af5 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:52.056235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dd62a749-6aa2-4ecd-87aa-c5cb4261f4b4 req-34202633-7325-47c3-a37a-c7cf77ee8af5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:52.057081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dd62a749-6aa2-4ecd-87aa-c5cb4261f4b4 req-34202633-7325-47c3-a37a-c7cf77ee8af5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:52.076822 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-dd62a749-6aa2-4ecd-87aa-c5cb4261f4b4 req-34202633-7325-47c3-a37a-c7cf77ee8af5 service nova] Creating event network-vif-plugged:eb4f598e-dc19-47d1-99f7-93994ac25681 for instance 1b52c962-e95e-465b-a898-0cb4fffe0ba0 on n-h2-858383-15 Oct 24 10:24:52.088533 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-dd62a749-6aa2-4ecd-87aa-c5cb4261f4b4 req-34202633-7325-47c3-a37a-c7cf77ee8af5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058293 Oct 24 10:24:52.090788 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 107/208] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:52.103461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1cf16c8d-20db-470f-a3aa-3b3ed49f8224 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] Calling method '.version_select at 0x7f04d1530670>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:52.129296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f1371ba9-af33-4d21-a692-17c148db0550 tempest-HypervisorAdminNegativeUnderV252Test-1165511359 tempest-HypervisorAdminNegativeUnderV252Test-1165511359-project] Calling method '.version_select at 0x7f04d15fdb80>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:52.132302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f1371ba9-af33-4d21-a692-17c148db0550 tempest-HypervisorAdminNegativeUnderV252Test-1165511359 tempest-HypervisorAdminNegativeUnderV252Test-1165511359-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'dadee23cddeb4a63babe9c8b9c8e45ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464a67422e0416586c56d7bdec610ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f1371ba9-af33-4d21-a692-17c148db0550 tempest-HypervisorAdminNegativeUnderV252Test-1165511359 tempest-HypervisorAdminNegativeUnderV252Test-1165511359-project] Request method failure captured: Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-hypervisors/n-h1-858383-15/search HTTP/1.1 Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfysD2eyG7-DMIp6mLZYVXMjBhLiDB1Dkvfu0VSR1_7FuaI2siRLSnl4f89UCj88KvY1TPG2uGTzWrtx7yzXrbQtoseG1D31LVP17w5v86YNx_S7BX2qCc862bsZJlHuzKpGywtdSo7X_NT3edQYm3__nljpyfoqPesIxJGa7R6fhY Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4464a67422e0416586c56d7bdec610ad Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1165511359 Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:24:52.137761 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:24:52.138984 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4464a67422e0416586c56d7bdec610ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4464a67422e0416586c56d7bdec610ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4464a67422e0416586c56d7bdec610ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4464a67422e0416586c56d7bdec610ad", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:52.138984 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1165511359 Oct 24 10:24:52.138984 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4464a67422e0416586c56d7bdec610ad Oct 24 10:24:52.138984 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1165511359 Oct 24 10:24:52.138984 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1165511359-project Oct 24 10:24:52.138984 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:52.138984 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:52.138984 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: dadee23cddeb4a63babe9c8b9c8e45ed Oct 24 10:24:52.138984 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1165511359-project Oct 24 10:24:52.138984 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:24:52.138984 n-d-858383-15 devstack@n-api.service[120425]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 24 10:24:52.138984 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'n-h1-858383-15'} Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:52.139625 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:52.140595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:52.140595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:52.140595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:52.140595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:52.140595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:52.140595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:52.140595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:52.140595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 24 10:24:52.140595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:52.140595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:52.140595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:52.140595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:52.140595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:52.140595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:52.140595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:52.140595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:52.140595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 24 10:24:52.140595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:52.147881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f1371ba9-af33-4d21-a692-17c148db0550 tempest-HypervisorAdminNegativeUnderV252Test-1165511359 tempest-HypervisorAdminNegativeUnderV252Test-1165511359-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:52.148893 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f1371ba9-af33-4d21-a692-17c148db0550 tempest-HypervisorAdminNegativeUnderV252Test-1165511359 tempest-HypervisorAdminNegativeUnderV252Test-1165511359-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/n-h1-858383-15/search" status: 403 len: 117 microversion: 2.1 time: 0.202964 Oct 24 10:24:52.152573 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 102/209] 10.222.0.50 () {58 vars in 1212 bytes} [Mon Oct 24 10:24:51 2022] GET /compute/v2.1/os-hypervisors/n-h1-858383-15/search => generated 117 bytes in 207 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:52.170656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f1734bf6-9ac2-4e5a-b5c9-fc4fbc9d0b57 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:52.173202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f1734bf6-9ac2-4e5a-b5c9-fc4fbc9d0b57 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:52.196048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1734bf6-9ac2-4e5a-b5c9-fc4fbc9d0b57 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:52.196458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1734bf6-9ac2-4e5a-b5c9-fc4fbc9d0b57 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:52.199954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1734bf6-9ac2-4e5a-b5c9-fc4fbc9d0b57 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:52.202509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1734bf6-9ac2-4e5a-b5c9-fc4fbc9d0b57 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:52.203062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1734bf6-9ac2-4e5a-b5c9-fc4fbc9d0b57 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:52.207375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1734bf6-9ac2-4e5a-b5c9-fc4fbc9d0b57 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:52.285844 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1cf16c8d-20db-470f-a3aa-3b3ed49f8224 tempest-QuotasAdminTestV257-1092042308 tempest-QuotasAdminTestV257-1092042308-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/381aad94e5e14bcc93e46879a7d6617e?user_id=c1b1d6478d844f4384521e25a85c5a3d" status: 200 len: 190 microversion: 2.57 time: 0.192081 Oct 24 10:24:52.286481 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 108/210] 10.222.0.50 () {60 vars in 1364 bytes} [Mon Oct 24 10:24:52 2022] GET /compute/v2.1/os-quota-sets/381aad94e5e14bcc93e46879a7d6617e?user_id=c1b1d6478d844f4384521e25a85c5a3d => generated 190 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:24:52.318293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f43a9d98-47f4-48fc-b2fc-cbb42a1329ef tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Calling method '.version_select at 0x7f04d1525430>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:52.322905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f43a9d98-47f4-48fc-b2fc-cbb42a1329ef tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:52.323384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f43a9d98-47f4-48fc-b2fc-cbb42a1329ef tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:52.323833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f43a9d98-47f4-48fc-b2fc-cbb42a1329ef tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:52.352123 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-f43a9d98-47f4-48fc-b2fc-cbb42a1329ef tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f43a9d98-47f4-48fc-b2fc-cbb42a1329ef tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Request method failure captured: Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfzdqH8ZiUFzwrCXnKUm1l3ycLOJ6DEwLCxLicIsfYmVexA9855mVG_6odvpNIEprIPYY4VXt8BOGamZW-UHADT0qGqC1MZFQGpKW7HuBTXkDPlIlcJTi1nfvxFNsnBXU_D3ib2F37lYdqwDF0ZvvBDrQ7BTTYpDGRHknHL2LO3H54 Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 422d6e2ee0bc4dcf8c7f613dccf82e73 Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1419584615 Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:24:52.353666 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:24:52.354877 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/422d6e2ee0bc4dcf8c7f613dccf82e73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/422d6e2ee0bc4dcf8c7f613dccf82e73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/422d6e2ee0bc4dcf8c7f613dccf82e73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_422d6e2ee0bc4dcf8c7f613dccf82e73", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:52.354877 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1419584615 Oct 24 10:24:52.354877 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 422d6e2ee0bc4dcf8c7f613dccf82e73 Oct 24 10:24:52.354877 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1419584615 Oct 24 10:24:52.354877 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin Oct 24 10:24:52.354877 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:52.354877 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:52.354877 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: add60708d8174382929b301453b91961 Oct 24 10:24:52.354877 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin Oct 24 10:24:52.354877 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:24:52.354877 n-d-858383-15 devstack@n-api.service[120426]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 24 10:24:52.354877 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:52.355522 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:52.356565 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:52.356565 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:52.356565 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:52.356565 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 24 10:24:52.356565 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:52.359530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f43a9d98-47f4-48fc-b2fc-cbb42a1329ef tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:52.362702 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f43a9d98-47f4-48fc-b2fc-cbb42a1329ef tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.075195 Oct 24 10:24:52.363284 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 109/211] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Oct 24 10:24:52 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:52.377280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7a3c782e-79ca-4670-88c1-f768e5d453c8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:52.378029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7a3c782e-79ca-4670-88c1-f768e5d453c8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:52.405121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a3c782e-79ca-4670-88c1-f768e5d453c8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:52.407305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a3c782e-79ca-4670-88c1-f768e5d453c8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:52.407900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a3c782e-79ca-4670-88c1-f768e5d453c8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:52.412404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a3c782e-79ca-4670-88c1-f768e5d453c8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:52.413414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a3c782e-79ca-4670-88c1-f768e5d453c8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:52.416270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a3c782e-79ca-4670-88c1-f768e5d453c8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:52.595587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f1734bf6-9ac2-4e5a-b5c9-fc4fbc9d0b57 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:52.619661 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f1734bf6-9ac2-4e5a-b5c9-fc4fbc9d0b57 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1312 microversion: 2.1 time: 0.460602 Oct 24 10:24:52.621903 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 103/212] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:52 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1312 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:52.634099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5cd149d7-a91b-4f3b-926a-3df7e0079dae tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Calling method '.version_select at 0x7f04d1665940>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:52.638567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cd149d7-a91b-4f3b-926a-3df7e0079dae tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:52.641461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cd149d7-a91b-4f3b-926a-3df7e0079dae tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:52.642094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cd149d7-a91b-4f3b-926a-3df7e0079dae tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:52.656988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7a3c782e-79ca-4670-88c1-f768e5d453c8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:52.673910 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7a3c782e-79ca-4670-88c1-f768e5d453c8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 200 len: 1320 microversion: 2.1 time: 0.309176 Oct 24 10:24:52.674708 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 110/213] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:52 2022] GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 1320 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:52.686860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cd149d7-a91b-4f3b-926a-3df7e0079dae tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:52.687734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cd149d7-a91b-4f3b-926a-3df7e0079dae tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:52.696097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cd149d7-a91b-4f3b-926a-3df7e0079dae tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:52.699730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:52.709356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cd149d7-a91b-4f3b-926a-3df7e0079dae tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:52.710694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cd149d7-a91b-4f3b-926a-3df7e0079dae tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:52.710694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cd149d7-a91b-4f3b-926a-3df7e0079dae tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:52.717091 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5cd149d7-a91b-4f3b-926a-3df7e0079dae tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.093809 Oct 24 10:24:52.723361 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 104/214] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:24:52 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:52.729239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a64b8f8b-8bd2-47ff-9788-77da002ac49d tempest-HypervisorAdminNegativeUnderV252Test-1165511359 tempest-HypervisorAdminNegativeUnderV252Test-1165511359-project] Calling method '.version_select at 0x7f04d16af0d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:52.731194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a64b8f8b-8bd2-47ff-9788-77da002ac49d tempest-HypervisorAdminNegativeUnderV252Test-1165511359 tempest-HypervisorAdminNegativeUnderV252Test-1165511359-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'dadee23cddeb4a63babe9c8b9c8e45ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4464a67422e0416586c56d7bdec610ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a64b8f8b-8bd2-47ff-9788-77da002ac49d tempest-HypervisorAdminNegativeUnderV252Test-1165511359 tempest-HypervisorAdminNegativeUnderV252Test-1165511359-project] Request method failure captured: Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfysD2eyG7-DMIp6mLZYVXMjBhLiDB1Dkvfu0VSR1_7FuaI2siRLSnl4f89UCj88KvY1TPG2uGTzWrtx7yzXrbQtoseG1D31LVP17w5v86YNx_S7BX2qCc862bsZJlHuzKpGywtdSo7X_NT3edQYm3__nljpyfoqPesIxJGa7R6fhY Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4464a67422e0416586c56d7bdec610ad Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1165511359 Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:24:52.733078 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:24:52.734246 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4464a67422e0416586c56d7bdec610ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4464a67422e0416586c56d7bdec610ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4464a67422e0416586c56d7bdec610ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4464a67422e0416586c56d7bdec610ad", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:52.734246 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1165511359 Oct 24 10:24:52.734246 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4464a67422e0416586c56d7bdec610ad Oct 24 10:24:52.734246 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1165511359 Oct 24 10:24:52.734246 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1165511359-project Oct 24 10:24:52.734246 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:52.734246 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:52.734246 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: dadee23cddeb4a63babe9c8b9c8e45ed Oct 24 10:24:52.734246 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1165511359-project Oct 24 10:24:52.734246 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:24:52.734246 n-d-858383-15 devstack@n-api.service[120426]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 24 10:24:52.734246 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '1'} Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:52.734877 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:52.736333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:52.736333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:52.736333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:52.736333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:52.736333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:52.736333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:52.736333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:52.736333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 24 10:24:52.736333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:52.736333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:52.736333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:52.736333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:52.736333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:52.736333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:52.736333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:52.736333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:52.736333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 24 10:24:52.736333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:52.737303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a64b8f8b-8bd2-47ff-9788-77da002ac49d tempest-HypervisorAdminNegativeUnderV252Test-1165511359 tempest-HypervisorAdminNegativeUnderV252Test-1165511359-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:52.737599 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a64b8f8b-8bd2-47ff-9788-77da002ac49d tempest-HypervisorAdminNegativeUnderV252Test-1165511359 tempest-HypervisorAdminNegativeUnderV252Test-1165511359-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.013120 Oct 24 10:24:52.746360 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 111/215] 10.222.0.50 () {58 vars in 1176 bytes} [Mon Oct 24 10:24:52 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:24:52.752587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b1e7773f-9049-4c79-b28f-00c73c72032e tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Calling method '.version_select at 0x7f04d15fdc10>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:52.758839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1e7773f-9049-4c79-b28f-00c73c72032e tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:52.760265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1e7773f-9049-4c79-b28f-00c73c72032e tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:52.761406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1e7773f-9049-4c79-b28f-00c73c72032e tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:52.801001 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-b1e7773f-9049-4c79-b28f-00c73c72032e tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] HTTP exception thrown: No hypervisor matching '31e00015-5e3b-42a0-8034-b5c1b4560e4a' could be found. Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b1e7773f-9049-4c79-b28f-00c73c72032e tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Request method failure captured: Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-hypervisors/31e00015-5e3b-42a0-8034-b5c1b4560e4a/servers HTTP/1.1 Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfzdqH8ZiUFzwrCXnKUm1l3ycLOJ6DEwLCxLicIsfYmVexA9855mVG_6odvpNIEprIPYY4VXt8BOGamZW-UHADT0qGqC1MZFQGpKW7HuBTXkDPlIlcJTi1nfvxFNsnBXU_D3ib2F37lYdqwDF0ZvvBDrQ7BTTYpDGRHknHL2LO3H54 Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 422d6e2ee0bc4dcf8c7f613dccf82e73 Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1419584615 Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:24:52.806464 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:24:52.808086 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/422d6e2ee0bc4dcf8c7f613dccf82e73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/422d6e2ee0bc4dcf8c7f613dccf82e73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/422d6e2ee0bc4dcf8c7f613dccf82e73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_422d6e2ee0bc4dcf8c7f613dccf82e73", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:52.808086 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1419584615 Oct 24 10:24:52.808086 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 422d6e2ee0bc4dcf8c7f613dccf82e73 Oct 24 10:24:52.808086 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1419584615 Oct 24 10:24:52.808086 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin Oct 24 10:24:52.808086 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:52.808086 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:52.808086 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: add60708d8174382929b301453b91961 Oct 24 10:24:52.808086 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin Oct 24 10:24:52.808086 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:24:52.808086 n-d-858383-15 devstack@n-api.service[120425]: exception: No hypervisor matching '31e00015-5e3b-42a0-8034-b5c1b4560e4a' could be found. Oct 24 10:24:52.808086 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '31e00015-5e3b-42a0-8034-b5c1b4560e4a'} Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '31e00015-5e3b-42a0-8034-b5c1b4560e4a' could be found. Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:52.808887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:52.810104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:52.810104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:52.810104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:52.810104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:52.810104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '31e00015-5e3b-42a0-8034-b5c1b4560e4a' could be found. Oct 24 10:24:52.810104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:52.812099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b1e7773f-9049-4c79-b28f-00c73c72032e tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] Returning 404 to user: No hypervisor matching '31e00015-5e3b-42a0-8034-b5c1b4560e4a' could be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:52.814235 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b1e7773f-9049-4c79-b28f-00c73c72032e tempest-HypervisorAdminNegativeUnderV252Test-1419584615 tempest-HypervisorAdminNegativeUnderV252Test-1419584615-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/31e00015-5e3b-42a0-8034-b5c1b4560e4a/servers" status: 404 len: 123 microversion: 2.1 time: 0.068943 Oct 24 10:24:52.823201 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 105/216] 10.222.0.50 () {58 vars in 1281 bytes} [Mon Oct 24 10:24:52 2022] GET /compute/v2.1/os-hypervisors/31e00015-5e3b-42a0-8034-b5c1b4560e4a/servers => generated 123 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:53.036002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8d15d4c4-c508-4dc3-a676-4bf531571391 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:53.037200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8d15d4c4-c508-4dc3-a676-4bf531571391 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:53.046271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d15d4c4-c508-4dc3-a676-4bf531571391 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:53.047379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d15d4c4-c508-4dc3-a676-4bf531571391 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:53.048423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d15d4c4-c508-4dc3-a676-4bf531571391 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:53.050160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d15d4c4-c508-4dc3-a676-4bf531571391 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:53.053707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d15d4c4-c508-4dc3-a676-4bf531571391 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:53.055412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d15d4c4-c508-4dc3-a676-4bf531571391 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:53.080501 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-8d15d4c4-c508-4dc3-a676-4bf531571391 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] HTTP exception thrown: Instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e could not be found. Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8d15d4c4-c508-4dc3-a676-4bf531571391 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Request method failure captured: Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e HTTP/1.1 Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVme-ddGURpt7y0gEaEHLB9lbaFgM9fsSLp3ClsicWof7KFEqQ_IpRXb_Wv3mHxMjG48TRmOA3a6VhMRloiqmKZMv8a67SL9Fnbmk8UfQxxzhoBZMuC1NWZ7yvg80_Of0ZdrMQ8DrLTMICUF99FXo1NWeY87dla6LG3XJbjQ767pkaNQ Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: bdc7632d3e704c27abeeedb0e3fab434 Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AggregatesAdminTestJSON-1079858962 Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:24:53.084400 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:24:53.085681 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bdc7632d3e704c27abeeedb0e3fab434"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bdc7632d3e704c27abeeedb0e3fab434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bdc7632d3e704c27abeeedb0e3fab434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bdc7632d3e704c27abeeedb0e3fab434", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:53.085681 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AggregatesAdminTestJSON-1079858962 Oct 24 10:24:53.085681 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: bdc7632d3e704c27abeeedb0e3fab434 Oct 24 10:24:53.085681 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1079858962 Oct 24 10:24:53.085681 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AggregatesAdminTestJSON-1079858962-project Oct 24 10:24:53.085681 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:53.085681 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:53.085681 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 8c6e751686ba42339301446509eb8a5b Oct 24 10:24:53.085681 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AggregatesAdminTestJSON-1079858962-project Oct 24 10:24:53.085681 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:53.085681 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e could not be found. Oct 24 10:24:53.085681 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '3a8cb09c-21cc-4d82-ab6a-ea07747f898e'} Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e could not be found. Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:53.086323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:53.087411 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:53.087411 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:24:53.087411 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:24:53.087411 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:24:53.087411 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:24:53.087411 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:24:53.087411 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:24:53.087411 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e could not be found. Oct 24 10:24:53.087411 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:53.087411 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:53.087411 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:53.087411 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:53.087411 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:53.087411 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:53.087411 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:53.087411 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:53.087411 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e could not be found. Oct 24 10:24:53.087411 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:53.090105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8d15d4c4-c508-4dc3-a676-4bf531571391 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Returning 404 to user: Instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:53.091667 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8d15d4c4-c508-4dc3-a676-4bf531571391 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 404 len: 111 microversion: 2.1 time: 0.059875 Oct 24 10:24:53.096728 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 112/217] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:53 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:53.101808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-04d0c451-4f9e-42f1-9c06-c3691088987f tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-15"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:53.122989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04d0c451-4f9e-42f1-9c06-c3691088987f tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:53.124762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04d0c451-4f9e-42f1-9c06-c3691088987f tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:53.125479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04d0c451-4f9e-42f1-9c06-c3691088987f tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:53.416672 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-04d0c451-4f9e-42f1-9c06-c3691088987f tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 300 microversion: 2.1 time: 0.319135 Oct 24 10:24:53.418321 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 106/218] 10.222.0.50 () {60 vars in 1191 bytes} [Mon Oct 24 10:24:53 2022] POST /compute/v2.1/os-aggregates/4/action => generated 300 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:53.433233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e3bc0180-319a-4ca2-8c73-3ce6722fbbd7 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:53.480254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:53.500927 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e3bc0180-319a-4ca2-8c73-3ce6722fbbd7 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.073431 Oct 24 10:24:53.513694 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 113/219] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:24:53 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:24:53.518308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ba7a3521-e268-42ad-ad2d-775d55cd069f tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1043860718"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:53.522219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.aggregate [None req-ba7a3521-e268-42ad-ad2d-775d55cd069f tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Generated uuid 56b08f00-97de-44ee-a621-75bbe39afe90 for aggregate {{(pid=120425) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:53.578689 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ba7a3521-e268-42ad-ad2d-775d55cd069f tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064058 Oct 24 10:24:53.589776 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 107/220] 10.222.0.50 () {60 vars in 1164 bytes} [Mon Oct 24 10:24:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:53.593705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-536a058c-4fe4-49f5-8c22-c0b6590d288f tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-15"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:53.615554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-536a058c-4fe4-49f5-8c22-c0b6590d288f tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:53.616667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-536a058c-4fe4-49f5-8c22-c0b6590d288f tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:53.617349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-536a058c-4fe4-49f5-8c22-c0b6590d288f tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:53.644655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bfa24676-e619-41fa-ada5-a6ff0330090d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:53.646052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bfa24676-e619-41fa-ada5-a6ff0330090d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:53.665434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfa24676-e619-41fa-ada5-a6ff0330090d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:53.665939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfa24676-e619-41fa-ada5-a6ff0330090d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:53.666405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfa24676-e619-41fa-ada5-a6ff0330090d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:53.667107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfa24676-e619-41fa-ada5-a6ff0330090d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:53.667571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfa24676-e619-41fa-ada5-a6ff0330090d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:53.669478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfa24676-e619-41fa-ada5-a6ff0330090d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:53.850967 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-536a058c-4fe4-49f5-8c22-c0b6590d288f tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 243 microversion: 2.1 time: 0.261930 Oct 24 10:24:53.866286 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 114/221] 10.222.0.50 () {60 vars in 1191 bytes} [Mon Oct 24 10:24:53 2022] POST /compute/v2.1/os-aggregates/9/action => generated 243 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:53.876297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ffecebc3-3fe3-446d-bc73-84df975c4c44 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:53.878144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ffecebc3-3fe3-446d-bc73-84df975c4c44 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:53.899707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffecebc3-3fe3-446d-bc73-84df975c4c44 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:53.900604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffecebc3-3fe3-446d-bc73-84df975c4c44 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:53.906082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffecebc3-3fe3-446d-bc73-84df975c4c44 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:53.908339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffecebc3-3fe3-446d-bc73-84df975c4c44 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:53.909813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffecebc3-3fe3-446d-bc73-84df975c4c44 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:53.913480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffecebc3-3fe3-446d-bc73-84df975c4c44 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:54.300587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bfa24676-e619-41fa-ada5-a6ff0330090d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:54.309347 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bfa24676-e619-41fa-ada5-a6ff0330090d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1312 microversion: 2.1 time: 0.668969 Oct 24 10:24:54.309945 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 108/222] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:53 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1312 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:24:54.324589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-316063bf-967f-4bbf-b26c-711fac56671f tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:54.338792 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-316063bf-967f-4bbf-b26c-711fac56671f tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 243 microversion: 2.1 time: 0.027791 Oct 24 10:24:54.347974 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 109/223] 10.222.0.50 () {58 vars in 1149 bytes} [Mon Oct 24 10:24:54 2022] GET /compute/v2.1/os-aggregates/9 => generated 243 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:54.365736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-59b03f4f-99f0-4a00-8281-de188a1a4578 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-15"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:54.386041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59b03f4f-99f0-4a00-8281-de188a1a4578 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:54.386783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59b03f4f-99f0-4a00-8281-de188a1a4578 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:54.387791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59b03f4f-99f0-4a00-8281-de188a1a4578 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:54.697922 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-59b03f4f-99f0-4a00-8281-de188a1a4578 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.343920 Oct 24 10:24:54.698908 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 110/224] 10.222.0.50 () {60 vars in 1191 bytes} [Mon Oct 24 10:24:54 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:54.723112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2fe6c96f-ba55-4a2b-9d4a-30f0df02ff1c tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:54.811034 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2fe6c96f-ba55-4a2b-9d4a-30f0df02ff1c tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.104602 Oct 24 10:24:54.811636 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 111/225] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:24:54 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:24:54.834575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-925f6cc3-845c-43c8-a474-cbefaaaa28f8 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1857593496"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:54.839568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.aggregate [None req-925f6cc3-845c-43c8-a474-cbefaaaa28f8 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Generated uuid 4124ce09-1eed-41b9-a6fe-42665effc302 for aggregate {{(pid=120425) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:54.902622 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-925f6cc3-845c-43c8-a474-cbefaaaa28f8 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.082367 Oct 24 10:24:54.905432 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 112/226] 10.222.0.50 () {60 vars in 1164 bytes} [Mon Oct 24 10:24:54 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:54.919788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bc9d3df0-0e01-45b2-8410-19a276bda7cf tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-15"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:54.953186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc9d3df0-0e01-45b2-8410-19a276bda7cf tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:54.955105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc9d3df0-0e01-45b2-8410-19a276bda7cf tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:54.957586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc9d3df0-0e01-45b2-8410-19a276bda7cf tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:55.094746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ffecebc3-3fe3-446d-bc73-84df975c4c44 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:55.109515 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bc9d3df0-0e01-45b2-8410-19a276bda7cf tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 244 microversion: 2.1 time: 0.195544 Oct 24 10:24:55.110635 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 113/227] 10.222.0.50 () {60 vars in 1194 bytes} [Mon Oct 24 10:24:54 2022] POST /compute/v2.1/os-aggregates/10/action => generated 244 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:55.111833 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ffecebc3-3fe3-446d-bc73-84df975c4c44 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 200 len: 1387 microversion: 2.1 time: 1.244072 Oct 24 10:24:55.112424 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 115/228] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:53 2022] GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 1387 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:55.123318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb57fa1e-1fc5-47a3-834e-a12db955212e tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:55.152017 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bb57fa1e-1fc5-47a3-834e-a12db955212e tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.1 time: 0.032453 Oct 24 10:24:55.152919 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 114/229] 10.222.0.50 () {58 vars in 1143 bytes} [Mon Oct 24 10:24:55 2022] GET /compute/v2.1/os-aggregates => generated 247 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:55.166346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c19c362f-1c33-4f8d-be17-199d694fb26d tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-15"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:55.179388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c19c362f-1c33-4f8d-be17-199d694fb26d tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:55.180678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c19c362f-1c33-4f8d-be17-199d694fb26d tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:55.182315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c19c362f-1c33-4f8d-be17-199d694fb26d tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:55.340220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-25caca6b-da71-4bce-8e93-a6a701aa3267 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:55.341462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-25caca6b-da71-4bce-8e93-a6a701aa3267 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:55.358815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25caca6b-da71-4bce-8e93-a6a701aa3267 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:55.359611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25caca6b-da71-4bce-8e93-a6a701aa3267 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:55.360232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25caca6b-da71-4bce-8e93-a6a701aa3267 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:55.363047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25caca6b-da71-4bce-8e93-a6a701aa3267 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:55.365005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25caca6b-da71-4bce-8e93-a6a701aa3267 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:55.366925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25caca6b-da71-4bce-8e93-a6a701aa3267 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:55.440535 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c19c362f-1c33-4f8d-be17-199d694fb26d tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.279619 Oct 24 10:24:55.453404 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 116/230] 10.222.0.50 () {60 vars in 1194 bytes} [Mon Oct 24 10:24:55 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:55.466678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-98f63a83-6890-4753-9ec6-0a32d4db5771 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:55.511131 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-98f63a83-6890-4753-9ec6-0a32d4db5771 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.054271 Oct 24 10:24:55.520014 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 117/231] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Oct 24 10:24:55 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:24:55.534137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-738d2a4d-50e0-49fd-8318-197351d9bb53 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-973027970"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:55.548560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.aggregate [None req-738d2a4d-50e0-49fd-8318-197351d9bb53 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Generated uuid 74826a89-4157-48ea-9745-9e289df95f05 for aggregate {{(pid=120426) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:55.598302 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-738d2a4d-50e0-49fd-8318-197351d9bb53 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.075395 Oct 24 10:24:55.600343 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 118/232] 10.222.0.50 () {60 vars in 1164 bytes} [Mon Oct 24 10:24:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:55.612453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ab5c676f-a393-4519-9ceb-7ac682cdab72 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-15"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:55.643235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab5c676f-a393-4519-9ceb-7ac682cdab72 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:55.643705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab5c676f-a393-4519-9ceb-7ac682cdab72 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:55.644134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab5c676f-a393-4519-9ceb-7ac682cdab72 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:55.871644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-25caca6b-da71-4bce-8e93-a6a701aa3267 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:55.900958 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-25caca6b-da71-4bce-8e93-a6a701aa3267 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1462 microversion: 2.1 time: 0.559487 Oct 24 10:24:55.902142 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 115/233] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:55 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1462 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:55.930662 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ab5c676f-a393-4519-9ceb-7ac682cdab72 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.323043 Oct 24 10:24:55.931250 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 119/234] 10.222.0.50 () {60 vars in 1194 bytes} [Mon Oct 24 10:24:55 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:24:55.943525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a7b6be4c-0c87-460f-a43d-fae386b20b87 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-15"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:55.971653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7b6be4c-0c87-460f-a43d-fae386b20b87 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:55.972964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7b6be4c-0c87-460f-a43d-fae386b20b87 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:55.976101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7b6be4c-0c87-460f-a43d-fae386b20b87 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:56.227066 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a7b6be4c-0c87-460f-a43d-fae386b20b87 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.287904 Oct 24 10:24:56.227758 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 120/235] 10.222.0.50 () {60 vars in 1194 bytes} [Mon Oct 24 10:24:55 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:56.238112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-06a2fae0-4fee-4bd6-a647-4eb7f2e900b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:56.238737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-06a2fae0-4fee-4bd6-a647-4eb7f2e900b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:56.252915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06a2fae0-4fee-4bd6-a647-4eb7f2e900b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:56.253420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06a2fae0-4fee-4bd6-a647-4eb7f2e900b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:56.253859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06a2fae0-4fee-4bd6-a647-4eb7f2e900b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:56.254626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06a2fae0-4fee-4bd6-a647-4eb7f2e900b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:56.255550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06a2fae0-4fee-4bd6-a647-4eb7f2e900b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:56.257643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06a2fae0-4fee-4bd6-a647-4eb7f2e900b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:56.308435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:56.714700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dca2ba19-84d4-40bc-a70b-b2ee12d69b49 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:56.715409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dca2ba19-84d4-40bc-a70b-b2ee12d69b49 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:56.727710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dca2ba19-84d4-40bc-a70b-b2ee12d69b49 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:56.728230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dca2ba19-84d4-40bc-a70b-b2ee12d69b49 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:56.728677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dca2ba19-84d4-40bc-a70b-b2ee12d69b49 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:56.734982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dca2ba19-84d4-40bc-a70b-b2ee12d69b49 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:56.735788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dca2ba19-84d4-40bc-a70b-b2ee12d69b49 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:56.736434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dca2ba19-84d4-40bc-a70b-b2ee12d69b49 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:56.914700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-06a2fae0-4fee-4bd6-a647-4eb7f2e900b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:56.924614 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-06a2fae0-4fee-4bd6-a647-4eb7f2e900b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 200 len: 1387 microversion: 2.1 time: 0.695813 Oct 24 10:24:56.925240 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 121/236] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:56 2022] GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 1387 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:56.930283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b1c1dda5-1590-4dd2-a936-ea9cff77d7fc tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:56.954865 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b1c1dda5-1590-4dd2-a936-ea9cff77d7fc tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.028468 Oct 24 10:24:56.955781 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 122/237] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Oct 24 10:24:56 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:24:56.967301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-89889431-34b8-40fe-9ab5-43ddec89a439 req-a75f5e9f-e67a-4025-8929-792e3daa4880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad6067c8-26ae-4e5f-a747-8d9e5f720a4f", "tag": "57ea9058-b25f-4a68-bff8-4ffcfca66d5f"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:56.986191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-89889431-34b8-40fe-9ab5-43ddec89a439 req-a75f5e9f-e67a-4025-8929-792e3daa4880 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:56.986985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-89889431-34b8-40fe-9ab5-43ddec89a439 req-a75f5e9f-e67a-4025-8929-792e3daa4880 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:56.987610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-89889431-34b8-40fe-9ab5-43ddec89a439 req-a75f5e9f-e67a-4025-8929-792e3daa4880 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:57.006803 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-89889431-34b8-40fe-9ab5-43ddec89a439 req-a75f5e9f-e67a-4025-8929-792e3daa4880 service nova] Creating event network-changed:57ea9058-b25f-4a68-bff8-4ffcfca66d5f for instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f on n-h2-858383-15 Oct 24 10:24:57.021231 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-89889431-34b8-40fe-9ab5-43ddec89a439 req-a75f5e9f-e67a-4025-8929-792e3daa4880 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063462 Oct 24 10:24:57.022309 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 123/238] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:57.028125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0ec22205-ffb8-4bf7-9b30-7e050dfc6f5b tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1773839126"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:57.031927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.aggregate [None req-0ec22205-ffb8-4bf7-9b30-7e050dfc6f5b tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Generated uuid 44084550-a3cb-4e51-9547-441793999dc2 for aggregate {{(pid=120426) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:57.060726 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0ec22205-ffb8-4bf7-9b30-7e050dfc6f5b tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.037002 Oct 24 10:24:57.061511 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 124/239] 10.222.0.50 () {60 vars in 1164 bytes} [Mon Oct 24 10:24:57 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:57.066625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-63a51f68-dd41-4008-bae4-234db1eb915a tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-302563095"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:57.071176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.aggregate [None req-63a51f68-dd41-4008-bae4-234db1eb915a tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Generated uuid 1b206d14-614f-4c38-a0b2-e261682b6927 for aggregate {{(pid=120426) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:57.105330 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-63a51f68-dd41-4008-bae4-234db1eb915a tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041474 Oct 24 10:24:57.107146 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 125/240] 10.222.0.50 () {60 vars in 1164 bytes} [Mon Oct 24 10:24:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:57.115310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-51e42e6d-545d-4a75-8a04-a25ff802da55 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:57.151545 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-51e42e6d-545d-4a75-8a04-a25ff802da55 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.042725 Oct 24 10:24:57.152148 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 126/241] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Oct 24 10:24:57 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:24:57.157478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b08612a3-dd9e-4aae-a1e5-39fefbcda2fa tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-15"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:57.170315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b08612a3-dd9e-4aae-a1e5-39fefbcda2fa tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:57.170821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b08612a3-dd9e-4aae-a1e5-39fefbcda2fa tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:57.171261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b08612a3-dd9e-4aae-a1e5-39fefbcda2fa tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:57.347120 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b08612a3-dd9e-4aae-a1e5-39fefbcda2fa tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.191489 Oct 24 10:24:57.356305 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 127/242] 10.222.0.50 () {60 vars in 1194 bytes} [Mon Oct 24 10:24:57 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:57.362300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2be536a2-79a3-4f47-b398-a9f9e287c901 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:57.374446 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-2be536a2-79a3-4f47-b398-a9f9e287c901 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2be536a2-79a3-4f47-b398-a9f9e287c901 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Request method failure captured: Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfA_77-IDMFsWlPhYCPuP-jf1pm49Va4hoYyAI7R9rhMQtji-klcknecILuxAcyizs5Sq1cS1vTUGN2G54he8RXX0B4TPlQTL-iqWYWDMFhfarLClfpybLaEgzYpvK5gkwZkuEMMGfNdIENs_i-cISmVeisD6OAAyFeqrQ-PhAz56Y Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4e70f3327ebb400da4f8dcfcd1ee1325 Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AggregatesAdminTestJSON-748730731 Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:24:57.376916 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:24:57.378342 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4e70f3327ebb400da4f8dcfcd1ee1325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4e70f3327ebb400da4f8dcfcd1ee1325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4e70f3327ebb400da4f8dcfcd1ee1325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4e70f3327ebb400da4f8dcfcd1ee1325", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:57.378342 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AggregatesAdminTestJSON-748730731 Oct 24 10:24:57.378342 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4e70f3327ebb400da4f8dcfcd1ee1325 Oct 24 10:24:57.378342 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-748730731 Oct 24 10:24:57.378342 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AggregatesAdminTestJSON-748730731-project-admin Oct 24 10:24:57.378342 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:57.378342 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:57.378342 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 18968a354bf44585bae988c3ff33bbc3 Oct 24 10:24:57.378342 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AggregatesAdminTestJSON-748730731-project-admin Oct 24 10:24:57.378342 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:57.378342 n-d-858383-15 devstack@n-api.service[120426]: exception: Aggregate 12 could not be found. Oct 24 10:24:57.378342 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '12'} Oct 24 10:24:57.378342 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:57.379124 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:57.381239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:57.381239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:57.381239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:57.381239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:57.381239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:57.381239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 24 10:24:57.381239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:24:57.381239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 24 10:24:57.381239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:57.381239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:57.381239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:57.381239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:57.381239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:57.381239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:57.381239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:57.381239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:57.381239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 24 10:24:57.381239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:57.382703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2be536a2-79a3-4f47-b398-a9f9e287c901 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:57.385660 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2be536a2-79a3-4f47-b398-a9f9e287c901 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.027757 Oct 24 10:24:57.386952 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 128/243] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:24:57 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:24:57.394523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7b1ee93a-b468-4861-a113-eb63e3c9cb1c tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-15"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:57.399211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7b1ee93a-b468-4861-a113-eb63e3c9cb1c tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '579ff076ba0242369042cbadcc806aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581cecbb5efb45e4b48bca78f37498f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7b1ee93a-b468-4861-a113-eb63e3c9cb1c tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Request method failure captured: Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 43 Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVme-PPKkmxASlg69UtdoomfOXdFifBcxm_XPojQ4Zjy2tLTpu00Ky-GrOHJ0K502yerf7W1amENxUxHuJdUGk9bmsVHMioPz_9i5U9YbihcdG-_6KB31jfY3nqQPAmGPhJ6WtqiUhfnJWuZTniQ-2xB8Lp6qY22kzbWmq3MVrRl8PH0 Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 581cecbb5efb45e4b48bca78f37498f4 Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1824377028 Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:24:57.401611 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:24:57.403115 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/581cecbb5efb45e4b48bca78f37498f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/581cecbb5efb45e4b48bca78f37498f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/581cecbb5efb45e4b48bca78f37498f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_581cecbb5efb45e4b48bca78f37498f4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:57.403115 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1824377028 Oct 24 10:24:57.403115 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 581cecbb5efb45e4b48bca78f37498f4 Oct 24 10:24:57.403115 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1824377028 Oct 24 10:24:57.403115 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AggregatesAdminNegativeTestJSON-1824377028-project Oct 24 10:24:57.403115 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:57.403115 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:57.403115 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 579ff076ba0242369042cbadcc806aef Oct 24 10:24:57.403115 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1824377028-project Oct 24 10:24:57.403115 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:24:57.403115 n-d-858383-15 devstack@n-api.service[120426]: {"remove_host": {"host": "n-h1-858383-15"}} Oct 24 10:24:57.403115 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:57.403115 n-d-858383-15 devstack@n-api.service[120426]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-858383-15'}}} Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:57.404546 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 24 10:24:57.405607 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:57.407934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7b1ee93a-b468-4861-a113-eb63e3c9cb1c tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:57.409156 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7b1ee93a-b468-4861-a113-eb63e3c9cb1c tempest-AggregatesAdminNegativeTestJSON-1824377028 tempest-AggregatesAdminNegativeTestJSON-1824377028-project] 10.222.0.50 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.020678 Oct 24 10:24:57.420985 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 129/244] 10.222.0.50 () {60 vars in 1194 bytes} [Mon Oct 24 10:24:57 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:57.428003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3b3f2e91-572e-4700-a5ef-a58f3042df38 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:57.444269 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-3b3f2e91-572e-4700-a5ef-a58f3042df38 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3b3f2e91-572e-4700-a5ef-a58f3042df38 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Request method failure captured: Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfA_77-IDMFsWlPhYCPuP-jf1pm49Va4hoYyAI7R9rhMQtji-klcknecILuxAcyizs5Sq1cS1vTUGN2G54he8RXX0B4TPlQTL-iqWYWDMFhfarLClfpybLaEgzYpvK5gkwZkuEMMGfNdIENs_i-cISmVeisD6OAAyFeqrQ-PhAz56Y Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4e70f3327ebb400da4f8dcfcd1ee1325 Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AggregatesAdminTestJSON-748730731 Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:24:57.446275 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:24:57.447660 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4e70f3327ebb400da4f8dcfcd1ee1325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4e70f3327ebb400da4f8dcfcd1ee1325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4e70f3327ebb400da4f8dcfcd1ee1325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4e70f3327ebb400da4f8dcfcd1ee1325", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:57.447660 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AggregatesAdminTestJSON-748730731 Oct 24 10:24:57.447660 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4e70f3327ebb400da4f8dcfcd1ee1325 Oct 24 10:24:57.447660 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-748730731 Oct 24 10:24:57.447660 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AggregatesAdminTestJSON-748730731-project-admin Oct 24 10:24:57.447660 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:57.447660 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:57.447660 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 18968a354bf44585bae988c3ff33bbc3 Oct 24 10:24:57.447660 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AggregatesAdminTestJSON-748730731-project-admin Oct 24 10:24:57.447660 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:57.447660 n-d-858383-15 devstack@n-api.service[120426]: exception: Aggregate 12 could not be found. Oct 24 10:24:57.447660 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '12'} Oct 24 10:24:57.447660 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:24:57.448489 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:57.449855 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:57.451245 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:57.451245 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:57.451245 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:57.451245 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 24 10:24:57.451245 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:57.453603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3b3f2e91-572e-4700-a5ef-a58f3042df38 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:57.454836 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3b3f2e91-572e-4700-a5ef-a58f3042df38 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.032485 Oct 24 10:24:57.456093 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 130/245] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Oct 24 10:24:57 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:24:57.466545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d65369bc-ad76-4d77-8786-dabdb425cb39 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-15"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:57.482083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d65369bc-ad76-4d77-8786-dabdb425cb39 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:57.483572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d65369bc-ad76-4d77-8786-dabdb425cb39 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:57.484193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d65369bc-ad76-4d77-8786-dabdb425cb39 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:57.837039 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d65369bc-ad76-4d77-8786-dabdb425cb39 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.377637 Oct 24 10:24:57.839625 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 131/246] 10.222.0.50 () {60 vars in 1194 bytes} [Mon Oct 24 10:24:57 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:57.850775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-17c4bee2-092f-4c08-be06-2d6d9980dc29 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-837588147", "name": "tempest-test_aggregate-118372863"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:57.882165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.aggregate [None req-17c4bee2-092f-4c08-be06-2d6d9980dc29 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Generated uuid bfe39177-dcaa-437c-b216-4c369305ee43 for aggregate {{(pid=120426) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:57.921806 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-17c4bee2-092f-4c08-be06-2d6d9980dc29 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.080438 Oct 24 10:24:57.930097 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 132/247] 10.222.0.50 () {60 vars in 1165 bytes} [Mon Oct 24 10:24:57 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:57.934967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a4b6d26a-1ade-4d32-8806-83879eaa2528 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:57.968872 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a4b6d26a-1ade-4d32-8806-83879eaa2528 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.037384 Oct 24 10:24:57.969767 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 133/248] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Oct 24 10:24:57 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:24:57.977589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e3e4ee9f-053b-40d1-88e6-645fb86f2590 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:58.006230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=8,nova_api:DELETE=13 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:58.027580 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e3e4ee9f-053b-40d1-88e6-645fb86f2590 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.056753 Oct 24 10:24:58.029195 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 134/249] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Oct 24 10:24:57 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:24:58.034161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dc3c9b07-57be-476b-9029-b553d33bf82c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:58.035098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dc3c9b07-57be-476b-9029-b553d33bf82c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:58.044628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc3c9b07-57be-476b-9029-b553d33bf82c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:58.045053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc3c9b07-57be-476b-9029-b553d33bf82c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:58.045788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc3c9b07-57be-476b-9029-b553d33bf82c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:58.046612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc3c9b07-57be-476b-9029-b553d33bf82c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:58.047452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc3c9b07-57be-476b-9029-b553d33bf82c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:58.047704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc3c9b07-57be-476b-9029-b553d33bf82c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:58.750568 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dca2ba19-84d4-40bc-a70b-b2ee12d69b49 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1615 microversion: 2.1 time: 2.824270 Oct 24 10:24:58.753291 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 116/250] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:55 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1615 bytes in 2830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:58.767129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-941fa3fa-efae-44b5-b8e2-1454bebce891 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-348200676"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:58.775712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.aggregate [None req-941fa3fa-efae-44b5-b8e2-1454bebce891 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Generated uuid 45a5baec-b556-4cd6-9142-e388ebe5d928 for aggregate {{(pid=120425) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:58.824235 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-941fa3fa-efae-44b5-b8e2-1454bebce891 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068754 Oct 24 10:24:58.826176 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 117/251] 10.222.0.50 () {60 vars in 1164 bytes} [Mon Oct 24 10:24:58 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:58.836826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5323fee2-80cf-4c49-bf09-e8bb37d8d9c0 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:58.851400 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-5323fee2-80cf-4c49-bf09-e8bb37d8d9c0 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5323fee2-80cf-4c49-bf09-e8bb37d8d9c0 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Request method failure captured: Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfA_77-IDMFsWlPhYCPuP-jf1pm49Va4hoYyAI7R9rhMQtji-klcknecILuxAcyizs5Sq1cS1vTUGN2G54he8RXX0B4TPlQTL-iqWYWDMFhfarLClfpybLaEgzYpvK5gkwZkuEMMGfNdIENs_i-cISmVeisD6OAAyFeqrQ-PhAz56Y Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4e70f3327ebb400da4f8dcfcd1ee1325 Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AggregatesAdminTestJSON-748730731 Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:24:58.854166 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:24:58.855399 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4e70f3327ebb400da4f8dcfcd1ee1325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4e70f3327ebb400da4f8dcfcd1ee1325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4e70f3327ebb400da4f8dcfcd1ee1325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4e70f3327ebb400da4f8dcfcd1ee1325", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:58.855399 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AggregatesAdminTestJSON-748730731 Oct 24 10:24:58.855399 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4e70f3327ebb400da4f8dcfcd1ee1325 Oct 24 10:24:58.855399 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-748730731 Oct 24 10:24:58.855399 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AggregatesAdminTestJSON-748730731-project-admin Oct 24 10:24:58.855399 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:58.855399 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:58.855399 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 18968a354bf44585bae988c3ff33bbc3 Oct 24 10:24:58.855399 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AggregatesAdminTestJSON-748730731-project-admin Oct 24 10:24:58.855399 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:24:58.855399 n-d-858383-15 devstack@n-api.service[120425]: exception: Aggregate 14 could not be found. Oct 24 10:24:58.855399 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '14'} Oct 24 10:24:58.855399 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:58.856250 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:58.859575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:58.859575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:58.859575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:58.859575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:58.859575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:58.859575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 24 10:24:58.859575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:24:58.859575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 24 10:24:58.859575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:58.859575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:58.859575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:58.859575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:58.859575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:58.859575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:58.859575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:58.859575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:58.859575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 24 10:24:58.859575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:58.862511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5323fee2-80cf-4c49-bf09-e8bb37d8d9c0 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:58.869599 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5323fee2-80cf-4c49-bf09-e8bb37d8d9c0 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.041542 Oct 24 10:24:58.876191 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 118/252] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:24:58 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:24:58.885601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1104fdb3-7499-4987-a55e-6cf4df631e1f tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:58.893403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1104fdb3-7499-4987-a55e-6cf4df631e1f tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:58.907946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1104fdb3-7499-4987-a55e-6cf4df631e1f tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:58.909358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1104fdb3-7499-4987-a55e-6cf4df631e1f tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:58.910326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1104fdb3-7499-4987-a55e-6cf4df631e1f tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:58.911258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1104fdb3-7499-4987-a55e-6cf4df631e1f tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:58.912639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1104fdb3-7499-4987-a55e-6cf4df631e1f tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:58.913261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1104fdb3-7499-4987-a55e-6cf4df631e1f tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:58.959071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dc3c9b07-57be-476b-9029-b553d33bf82c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:58.968310 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dc3c9b07-57be-476b-9029-b553d33bf82c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 200 len: 1387 microversion: 2.1 time: 0.937962 Oct 24 10:24:58.971517 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 135/253] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:58 2022] GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 1387 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:58.979186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a2a27172-43f3-44f2-aee3-88785063f1b8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:59.006017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2a27172-43f3-44f2-aee3-88785063f1b8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:59.008044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2a27172-43f3-44f2-aee3-88785063f1b8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:59.008505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2a27172-43f3-44f2-aee3-88785063f1b8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:59.024871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2a27172-43f3-44f2-aee3-88785063f1b8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:59.025984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2a27172-43f3-44f2-aee3-88785063f1b8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:59.026754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2a27172-43f3-44f2-aee3-88785063f1b8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:59.036295 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.compute.aggregates [None req-a2a27172-43f3-44f2-aee3-88785063f1b8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 24 10:24:59.037160 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-a2a27172-43f3-44f2-aee3-88785063f1b8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a2a27172-43f3-44f2-aee3-88785063f1b8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Request method failure captured: Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 42 Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfA48W2RXlFYPfdKqb8r_nHINmQwJGF39j8kzLHpavwwHU6XqshPkFBHsyagxHy988VOmL_1dG6CY-Wg-YyFF3ftJBudJ22H_fPhqxowj3G14jpqizf-T-eaoo_4M8iZsP7GH-GR3AkkKNJf2n5BeazeRftoqyZuaDn7m-8qWL7Hn0 Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 374e5d25c2884ae2a7e0cb9b4a15bf6a Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:24:59.039407 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:24:59.040797 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/374e5d25c2884ae2a7e0cb9b4a15bf6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_374e5d25c2884ae2a7e0cb9b4a15bf6a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:59.040797 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:59.040797 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 374e5d25c2884ae2a7e0cb9b4a15bf6a Oct 24 10:24:59.040797 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-960274200 Oct 24 10:24:59.040797 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin Oct 24 10:24:59.040797 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:59.040797 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:59.040797 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 1002979e5f6841f880feee4608ac23a6 Oct 24 10:24:59.040797 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin Oct 24 10:24:59.040797 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:24:59.040797 n-d-858383-15 devstack@n-api.service[120426]: {"remove_host": {"host": "nonexist_host"}} Oct 24 10:24:59.040797 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:59.040797 n-d-858383-15 devstack@n-api.service[120426]: exception: Cannot remove host nonexist_host in aggregate 15 Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6008, in _get_service_in_cell_by_host Oct 24 10:24:59.041713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6686, in remove_host_from_aggregate Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 24 10:24:59.043540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6010, in _get_service_in_cell_by_host Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.044683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:59.045828 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:59.045828 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:59.045828 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:59.045828 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:59.045828 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Oct 24 10:24:59.045828 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.045828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a2a27172-43f3-44f2-aee3-88785063f1b8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:59.045828 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a2a27172-43f3-44f2-aee3-88785063f1b8 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.069856 Oct 24 10:24:59.045828 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 136/254] 10.222.0.50 () {60 vars in 1194 bytes} [Mon Oct 24 10:24:58 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:24:59.052305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-51fbcf10-38f4-4a64-8eff-5f32c05711f8 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:59.063726 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-51fbcf10-38f4-4a64-8eff-5f32c05711f8 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-51fbcf10-38f4-4a64-8eff-5f32c05711f8 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Request method failure captured: Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfA_77-IDMFsWlPhYCPuP-jf1pm49Va4hoYyAI7R9rhMQtji-klcknecILuxAcyizs5Sq1cS1vTUGN2G54he8RXX0B4TPlQTL-iqWYWDMFhfarLClfpybLaEgzYpvK5gkwZkuEMMGfNdIENs_i-cISmVeisD6OAAyFeqrQ-PhAz56Y Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4e70f3327ebb400da4f8dcfcd1ee1325 Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AggregatesAdminTestJSON-748730731 Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:24:59.065548 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:24:59.066739 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4e70f3327ebb400da4f8dcfcd1ee1325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4e70f3327ebb400da4f8dcfcd1ee1325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4e70f3327ebb400da4f8dcfcd1ee1325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4e70f3327ebb400da4f8dcfcd1ee1325", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:59.066739 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AggregatesAdminTestJSON-748730731 Oct 24 10:24:59.066739 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4e70f3327ebb400da4f8dcfcd1ee1325 Oct 24 10:24:59.066739 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-748730731 Oct 24 10:24:59.066739 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AggregatesAdminTestJSON-748730731-project-admin Oct 24 10:24:59.066739 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:24:59.066739 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:24:59.066739 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 18968a354bf44585bae988c3ff33bbc3 Oct 24 10:24:59.066739 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AggregatesAdminTestJSON-748730731-project-admin Oct 24 10:24:59.066739 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:24:59.066739 n-d-858383-15 devstack@n-api.service[120426]: exception: Aggregate 14 could not be found. Oct 24 10:24:59.066739 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '14'} Oct 24 10:24:59.066739 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:24:59.068007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:59.069030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:59.075462 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:59.075462 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:59.075462 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:59.075462 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 24 10:24:59.075462 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.075462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-51fbcf10-38f4-4a64-8eff-5f32c05711f8 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:59.075462 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-51fbcf10-38f4-4a64-8eff-5f32c05711f8 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.020827 Oct 24 10:24:59.075462 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 137/255] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Oct 24 10:24:59 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:24:59.075462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f82305b3-3f22-41c5-af3c-3152cf4f41d0 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:59.103802 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f82305b3-3f22-41c5-af3c-3152cf4f41d0 tempest-AggregatesAdminNegativeTestJSON-960274200 tempest-AggregatesAdminNegativeTestJSON-960274200-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.033360 Oct 24 10:24:59.105008 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 138/256] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Oct 24 10:24:59 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:24:59.110720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-626f1798-574c-4dc8-b5db-96a89ad860c2 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-873674314"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:59.115908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.aggregate [None req-626f1798-574c-4dc8-b5db-96a89ad860c2 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Generated uuid 5c6b00d4-dfc0-44fe-bdd2-fd28c375916d for aggregate {{(pid=120426) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:59.136912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1104fdb3-7499-4987-a55e-6cf4df631e1f tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9a13f80d5cf8421781351e88c248c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2ca01d7aeb4f5e8730aa1023f3601e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:59.137921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1104fdb3-7499-4987-a55e-6cf4df631e1f tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] flavor_id is None. Assuming migration. {{(pid=120425) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 24 10:24:59.138524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1104fdb3-7499-4987-a55e-6cf4df631e1f tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120425) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 24 10:24:59.150115 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-626f1798-574c-4dc8-b5db-96a89ad860c2 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.042973 Oct 24 10:24:59.152512 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 139/257] 10.222.0.50 () {60 vars in 1164 bytes} [Mon Oct 24 10:24:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:59.164064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1a7eec69-d67b-4797-bc73-dde2c47aaff5 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:59.186526 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1a7eec69-d67b-4797-bc73-dde2c47aaff5 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 227 microversion: 2.1 time: 0.023698 Oct 24 10:24:59.188870 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 140/258] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:24:59 2022] GET /compute/v2.1/os-aggregates/16 => generated 227 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:24:59.206678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-48c68609-64f3-4daa-a2a8-158f6f1b0ec0 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:59.266296 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-48c68609-64f3-4daa-a2a8-158f6f1b0ec0 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 265 microversion: 2.1 time: 0.068312 Oct 24 10:24:59.275096 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 141/259] 10.222.0.50 () {60 vars in 1194 bytes} [Mon Oct 24 10:24:59 2022] POST /compute/v2.1/os-aggregates/16/action => generated 265 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:59.306840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d365a53e-6b11-45d9-ac9e-3838caf3f896 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:59.337747 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d365a53e-6b11-45d9-ac9e-3838caf3f896 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 241 microversion: 2.1 time: 0.057413 Oct 24 10:24:59.339775 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 142/260] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:24:59 2022] GET /compute/v2.1/os-aggregates/16 => generated 241 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:59.353243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7e0063c6-9f4a-47fa-9b69-e8ed17dcbf78 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:59.400466 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7e0063c6-9f4a-47fa-9b69-e8ed17dcbf78 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.053747 Oct 24 10:24:59.401884 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 143/261] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Oct 24 10:24:59 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:24:59.418914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bd15b8db-9194-4fc8-8a55-5b427ce7836e tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-148777736", "availability_zone": "tempest-test_az-1831196664"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:59.434905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.aggregate [None req-bd15b8db-9194-4fc8-8a55-5b427ce7836e tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Generated uuid 918dd0d4-53f4-471a-bb0d-aa3792a1b998 for aggregate {{(pid=120426) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:59.444354 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1104fdb3-7499-4987-a55e-6cf4df631e1f tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0/action" status: 202 len: 0 microversion: 2.1 time: 0.567196 Oct 24 10:24:59.448763 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 119/262] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:24:58 2022] POST /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:24:59.454204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43e571dc-fafe-4e19-8fd0-d5b9ec24c61e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:59.455867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-43e571dc-fafe-4e19-8fd0-d5b9ec24c61e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:59.463248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43e571dc-fafe-4e19-8fd0-d5b9ec24c61e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:59.464174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43e571dc-fafe-4e19-8fd0-d5b9ec24c61e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:59.464778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43e571dc-fafe-4e19-8fd0-d5b9ec24c61e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:59.465779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43e571dc-fafe-4e19-8fd0-d5b9ec24c61e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:59.466406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43e571dc-fafe-4e19-8fd0-d5b9ec24c61e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:59.466991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43e571dc-fafe-4e19-8fd0-d5b9ec24c61e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:59.484912 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bd15b8db-9194-4fc8-8a55-5b427ce7836e tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.074536 Oct 24 10:24:59.486884 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 144/263] 10.222.0.50 () {60 vars in 1165 bytes} [Mon Oct 24 10:24:59 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:59.506242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-01b7111a-9c0f-4270-90e1-43f13b4d5de6 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-148777736_new", "availability_zone": "tempest-test_az-1831196664_new"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:59.649473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01b7111a-9c0f-4270-90e1-43f13b4d5de6 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:59.649473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01b7111a-9c0f-4270-90e1-43f13b4d5de6 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:59.649473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01b7111a-9c0f-4270-90e1-43f13b4d5de6 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:59.699494 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-01b7111a-9c0f-4270-90e1-43f13b4d5de6 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 336 microversion: 2.1 time: 0.203005 Oct 24 10:24:59.700352 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 145/264] 10.222.0.50 () {60 vars in 1173 bytes} [Mon Oct 24 10:24:59 2022] PUT /compute/v2.1/os-aggregates/17 => generated 336 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:59.714317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-41153b71-aa85-4375-9d2f-84fb313fe932 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:59.722862 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-41153b71-aa85-4375-9d2f-84fb313fe932 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.013386 Oct 24 10:24:59.724556 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 146/265] 10.222.0.50 () {58 vars in 1143 bytes} [Mon Oct 24 10:24:59 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:59.744397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e57a822-e89c-4c7c-810e-4a74530aa09f tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:59.782291 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3e57a822-e89c-4c7c-810e-4a74530aa09f tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.049340 Oct 24 10:24:59.782638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-43e571dc-fafe-4e19-8fd0-d5b9ec24c61e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:24:59.784275 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 147/266] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Oct 24 10:24:59 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:24:59.794292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e9c4af84-a452-479e-b194-899fe95fb3bb tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1871979364"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:24:59.795481 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-43e571dc-fafe-4e19-8fd0-d5b9ec24c61e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1471 microversion: 2.1 time: 0.345557 Oct 24 10:24:59.796174 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 120/267] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:59 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1471 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:24:59.798915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.aggregate [None req-e9c4af84-a452-479e-b194-899fe95fb3bb tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Generated uuid 567310a5-8f57-4050-acd2-73684ae6df1f for aggregate {{(pid=120426) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:24:59.827900 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e9c4af84-a452-479e-b194-899fe95fb3bb tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.038041 Oct 24 10:24:59.828700 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 148/268] 10.222.0.50 () {60 vars in 1164 bytes} [Mon Oct 24 10:24:59 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:59.840122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9ab497d8-586f-42b9-9531-15ef20b978e7 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:59.844584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=90,nova_api:DELETE=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:24:59.851594 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9ab497d8-586f-42b9-9531-15ef20b978e7 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.015548 Oct 24 10:24:59.852234 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 121/269] 10.222.0.50 () {58 vars in 1143 bytes} [Mon Oct 24 10:24:59 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:24:59.863755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-13a5b639-a24c-4b6e-9c51-7de2fc9ea288 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:59.895596 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-13a5b639-a24c-4b6e-9c51-7de2fc9ea288 tempest-AggregatesAdminTestJSON-748730731 tempest-AggregatesAdminTestJSON-748730731-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.034801 Oct 24 10:24:59.899660 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 149/270] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Oct 24 10:24:59 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:24:59.907891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d65fa3c8-469e-44ad-b306-1d951e72e34b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:59.908889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d65fa3c8-469e-44ad-b306-1d951e72e34b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:59.920018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d65fa3c8-469e-44ad-b306-1d951e72e34b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:59.921041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d65fa3c8-469e-44ad-b306-1d951e72e34b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:59.921635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d65fa3c8-469e-44ad-b306-1d951e72e34b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:59.927646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d65fa3c8-469e-44ad-b306-1d951e72e34b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:59.928562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d65fa3c8-469e-44ad-b306-1d951e72e34b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:24:59.929322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d65fa3c8-469e-44ad-b306-1d951e72e34b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:24:59.949469 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-d65fa3c8-469e-44ad-b306-1d951e72e34b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] HTTP exception thrown: Instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e could not be found. Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d65fa3c8-469e-44ad-b306-1d951e72e34b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Request method failure captured: Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e HTTP/1.1 Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVme-ddGURpt7y0gEaEHLB9lbaFgM9fsSLp3ClsicWof7KFEqQ_IpRXb_Wv3mHxMjG48TRmOA3a6VhMRloiqmKZMv8a67SL9Fnbmk8UfQxxzhoBZMuC1NWZ7yvg80_Of0ZdrMQ8DrLTMICUF99FXo1NWeY87dla6LG3XJbjQ767pkaNQ Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: bdc7632d3e704c27abeeedb0e3fab434 Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AggregatesAdminTestJSON-1079858962 Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:24:59.953118 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:24:59.954695 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bdc7632d3e704c27abeeedb0e3fab434"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bdc7632d3e704c27abeeedb0e3fab434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bdc7632d3e704c27abeeedb0e3fab434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bdc7632d3e704c27abeeedb0e3fab434", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:24:59.954695 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AggregatesAdminTestJSON-1079858962 Oct 24 10:24:59.954695 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: bdc7632d3e704c27abeeedb0e3fab434 Oct 24 10:24:59.954695 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1079858962 Oct 24 10:24:59.954695 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AggregatesAdminTestJSON-1079858962-project Oct 24 10:24:59.954695 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:24:59.954695 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:24:59.954695 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 8c6e751686ba42339301446509eb8a5b Oct 24 10:24:59.954695 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AggregatesAdminTestJSON-1079858962-project Oct 24 10:24:59.954695 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:24:59.954695 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e could not be found. Oct 24 10:24:59.954695 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '3a8cb09c-21cc-4d82-ab6a-ea07747f898e'} Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e could not be found. Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:24:59.955450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e could not be found. Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e could not be found. Oct 24 10:24:59.960165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:24:59.961997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d65fa3c8-469e-44ad-b306-1d951e72e34b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Returning 404 to user: Instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:24:59.963317 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d65fa3c8-469e-44ad-b306-1d951e72e34b tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 404 len: 111 microversion: 2.1 time: 0.061795 Oct 24 10:24:59.977408 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 122/271] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:24:59 2022] DELETE /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:24:59.979873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-95289fdc-b26c-47b1-a467-f8cbb13cfeb2 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:24:59.980332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-95289fdc-b26c-47b1-a467-f8cbb13cfeb2 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] [instance: 3a8cb09c-21cc-4d82-ab6a-ea07747f898e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:24:59.998316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95289fdc-b26c-47b1-a467-f8cbb13cfeb2 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:24:59.998914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95289fdc-b26c-47b1-a467-f8cbb13cfeb2 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:00.000628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95289fdc-b26c-47b1-a467-f8cbb13cfeb2 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:00.001442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95289fdc-b26c-47b1-a467-f8cbb13cfeb2 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:00.001844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3c9ebcb3-17f1-4eaf-9661-fcc9350a8405 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:00.002652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95289fdc-b26c-47b1-a467-f8cbb13cfeb2 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:00.003049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3c9ebcb3-17f1-4eaf-9661-fcc9350a8405 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:00.003566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95289fdc-b26c-47b1-a467-f8cbb13cfeb2 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:00.020209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c9ebcb3-17f1-4eaf-9661-fcc9350a8405 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:00.024312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c9ebcb3-17f1-4eaf-9661-fcc9350a8405 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:00.025003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c9ebcb3-17f1-4eaf-9661-fcc9350a8405 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:00.028483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c9ebcb3-17f1-4eaf-9661-fcc9350a8405 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:00.029305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c9ebcb3-17f1-4eaf-9661-fcc9350a8405 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:00.029942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c9ebcb3-17f1-4eaf-9661-fcc9350a8405 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:00.038914 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-95289fdc-b26c-47b1-a467-f8cbb13cfeb2 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] HTTP exception thrown: Instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e could not be found. Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-95289fdc-b26c-47b1-a467-f8cbb13cfeb2 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Request method failure captured: Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e HTTP/1.1 Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVme-ddGURpt7y0gEaEHLB9lbaFgM9fsSLp3ClsicWof7KFEqQ_IpRXb_Wv3mHxMjG48TRmOA3a6VhMRloiqmKZMv8a67SL9Fnbmk8UfQxxzhoBZMuC1NWZ7yvg80_Of0ZdrMQ8DrLTMICUF99FXo1NWeY87dla6LG3XJbjQ767pkaNQ Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: bdc7632d3e704c27abeeedb0e3fab434 Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AggregatesAdminTestJSON-1079858962 Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:25:00.043611 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:25:00.045149 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bdc7632d3e704c27abeeedb0e3fab434"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bdc7632d3e704c27abeeedb0e3fab434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bdc7632d3e704c27abeeedb0e3fab434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bdc7632d3e704c27abeeedb0e3fab434", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:25:00.045149 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AggregatesAdminTestJSON-1079858962 Oct 24 10:25:00.045149 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: bdc7632d3e704c27abeeedb0e3fab434 Oct 24 10:25:00.045149 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1079858962 Oct 24 10:25:00.045149 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AggregatesAdminTestJSON-1079858962-project Oct 24 10:25:00.045149 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:25:00.045149 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:25:00.045149 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 8c6e751686ba42339301446509eb8a5b Oct 24 10:25:00.045149 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AggregatesAdminTestJSON-1079858962-project Oct 24 10:25:00.045149 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:25:00.045149 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e could not be found. Oct 24 10:25:00.045149 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '3a8cb09c-21cc-4d82-ab6a-ea07747f898e'} Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e could not be found. Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:25:00.045952 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:25:00.047293 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:25:00.047293 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:25:00.047293 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:25:00.047293 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:25:00.047293 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:25:00.047293 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:25:00.047293 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:25:00.047293 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e could not be found. Oct 24 10:25:00.047293 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:00.047293 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:00.047293 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:00.047293 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:00.047293 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:00.047293 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:00.047293 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:25:00.047293 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:25:00.047293 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e could not be found. Oct 24 10:25:00.047293 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:00.050541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-95289fdc-b26c-47b1-a467-f8cbb13cfeb2 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] Returning 404 to user: Instance 3a8cb09c-21cc-4d82-ab6a-ea07747f898e could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:25:00.056294 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-95289fdc-b26c-47b1-a467-f8cbb13cfeb2 tempest-AggregatesAdminTestJSON-1079858962 tempest-AggregatesAdminTestJSON-1079858962-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e" status: 404 len: 111 microversion: 2.1 time: 0.081198 Oct 24 10:25:00.060170 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 150/272] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:59 2022] GET /compute/v2.1/servers/3a8cb09c-21cc-4d82-ab6a-ea07747f898e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:25:00.290075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c9ebcb3-17f1-4eaf-9661-fcc9350a8405 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:00.297773 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3c9ebcb3-17f1-4eaf-9661-fcc9350a8405 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 200 len: 1387 microversion: 2.1 time: 0.301527 Oct 24 10:25:00.313471 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 123/273] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:24:59 2022] GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 1387 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:25:00.828515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-36d1a367-8d69-4afc-956d-4e02d002ea95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:00.829541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-36d1a367-8d69-4afc-956d-4e02d002ea95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:00.841979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36d1a367-8d69-4afc-956d-4e02d002ea95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:00.844916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36d1a367-8d69-4afc-956d-4e02d002ea95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:00.846257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36d1a367-8d69-4afc-956d-4e02d002ea95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:00.849265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36d1a367-8d69-4afc-956d-4e02d002ea95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:00.850694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36d1a367-8d69-4afc-956d-4e02d002ea95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:00.852499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36d1a367-8d69-4afc-956d-4e02d002ea95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:01.322038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0f514339-b5cb-4e1f-9af0-d5ca5a7c762a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:01.322658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0f514339-b5cb-4e1f-9af0-d5ca5a7c762a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:01.335366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f514339-b5cb-4e1f-9af0-d5ca5a7c762a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:01.336645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f514339-b5cb-4e1f-9af0-d5ca5a7c762a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:01.340119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f514339-b5cb-4e1f-9af0-d5ca5a7c762a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:01.341447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f514339-b5cb-4e1f-9af0-d5ca5a7c762a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:01.344260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f514339-b5cb-4e1f-9af0-d5ca5a7c762a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:01.345404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f514339-b5cb-4e1f-9af0-d5ca5a7c762a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:01.561148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=11 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:01.776742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-36d1a367-8d69-4afc-956d-4e02d002ea95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:01.788618 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-36d1a367-8d69-4afc-956d-4e02d002ea95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1471 microversion: 2.1 time: 0.966080 Oct 24 10:25:01.789408 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 151/274] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:00 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1471 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:01.937942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=40 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:01.955248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0f514339-b5cb-4e1f-9af0-d5ca5a7c762a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:01.966288 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0f514339-b5cb-4e1f-9af0-d5ca5a7c762a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 200 len: 1387 microversion: 2.1 time: 0.649179 Oct 24 10:25:01.967506 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 124/275] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:01 2022] GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 1387 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:02.816604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e371f543-1d3e-4383-810e-2816889ddffe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:02.819163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e371f543-1d3e-4383-810e-2816889ddffe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:02.825829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=10 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:02.837473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e371f543-1d3e-4383-810e-2816889ddffe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:02.838056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e371f543-1d3e-4383-810e-2816889ddffe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:02.839581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e371f543-1d3e-4383-810e-2816889ddffe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:02.840361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e371f543-1d3e-4383-810e-2816889ddffe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:02.840813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e371f543-1d3e-4383-810e-2816889ddffe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:02.841324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e371f543-1d3e-4383-810e-2816889ddffe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:03.001654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7bbd12cb-a2cd-41c7-bc4a-7207ebbdb58e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:03.003496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7bbd12cb-a2cd-41c7-bc4a-7207ebbdb58e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:03.019298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bbd12cb-a2cd-41c7-bc4a-7207ebbdb58e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:03.021513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bbd12cb-a2cd-41c7-bc4a-7207ebbdb58e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:03.022296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bbd12cb-a2cd-41c7-bc4a-7207ebbdb58e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:03.024566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bbd12cb-a2cd-41c7-bc4a-7207ebbdb58e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:03.026471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bbd12cb-a2cd-41c7-bc4a-7207ebbdb58e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:03.027096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bbd12cb-a2cd-41c7-bc4a-7207ebbdb58e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:03.283958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e371f543-1d3e-4383-810e-2816889ddffe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:03.295506 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e371f543-1d3e-4383-810e-2816889ddffe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1471 microversion: 2.1 time: 0.483780 Oct 24 10:25:03.299094 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 152/276] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:02 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1471 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:25:03.435535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7bbd12cb-a2cd-41c7-bc4a-7207ebbdb58e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:03.451224 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7bbd12cb-a2cd-41c7-bc4a-7207ebbdb58e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 200 len: 1387 microversion: 2.1 time: 0.453117 Oct 24 10:25:03.452186 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 125/277] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:02 2022] GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 1387 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:25:04.325735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09328d95-47a0-4722-a4d0-3428a94a4b11 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:04.327749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09328d95-47a0-4722-a4d0-3428a94a4b11 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:04.338159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09328d95-47a0-4722-a4d0-3428a94a4b11 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:04.338978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09328d95-47a0-4722-a4d0-3428a94a4b11 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:04.340349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09328d95-47a0-4722-a4d0-3428a94a4b11 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:04.343703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09328d95-47a0-4722-a4d0-3428a94a4b11 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:04.344417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09328d95-47a0-4722-a4d0-3428a94a4b11 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:04.345119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09328d95-47a0-4722-a4d0-3428a94a4b11 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:04.357375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cae96310-7799-4e99-b72b-f2d14a96193d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1225920830", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:04.461231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-cae96310-7799-4e99-b72b-f2d14a96193d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:25:04.737452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-09328d95-47a0-4722-a4d0-3428a94a4b11 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:04.747069 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-09328d95-47a0-4722-a4d0-3428a94a4b11 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1471 microversion: 2.1 time: 0.427650 Oct 24 10:25:04.748581 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 126/278] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:04 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1471 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:25:04.761606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c84110f3-9e6b-4334-85d5-25c1bded99ae tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:04.762586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c84110f3-9e6b-4334-85d5-25c1bded99ae tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:04.776178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c84110f3-9e6b-4334-85d5-25c1bded99ae tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:04.776890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c84110f3-9e6b-4334-85d5-25c1bded99ae tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:04.778732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c84110f3-9e6b-4334-85d5-25c1bded99ae tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:04.779668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c84110f3-9e6b-4334-85d5-25c1bded99ae tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:04.782740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c84110f3-9e6b-4334-85d5-25c1bded99ae tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:04.783367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c84110f3-9e6b-4334-85d5-25c1bded99ae tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:05.109571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-cae96310-7799-4e99-b72b-f2d14a96193d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:25:05.109994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-cae96310-7799-4e99-b72b-f2d14a96193d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:25:05.110474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-cae96310-7799-4e99-b72b-f2d14a96193d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:25:05.110893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-cae96310-7799-4e99-b72b-f2d14a96193d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:25:05.111314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-cae96310-7799-4e99-b72b-f2d14a96193d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:25:05.133985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae96310-7799-4e99-b72b-f2d14a96193d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:05.134650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae96310-7799-4e99-b72b-f2d14a96193d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:05.135254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae96310-7799-4e99-b72b-f2d14a96193d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:05.136150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae96310-7799-4e99-b72b-f2d14a96193d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:05.136787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae96310-7799-4e99-b72b-f2d14a96193d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:05.137397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae96310-7799-4e99-b72b-f2d14a96193d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:05.157912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c84110f3-9e6b-4334-85d5-25c1bded99ae tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:05.165944 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c84110f3-9e6b-4334-85d5-25c1bded99ae tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 200 len: 1387 microversion: 2.1 time: 0.415117 Oct 24 10:25:05.173710 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 127/279] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:04 2022] GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 1387 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:05.201570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-cae96310-7799-4e99-b72b-f2d14a96193d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Getting quotas for project dabaf79a7d42463ea67fd9b5f7a12951. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:25:05.209145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-cae96310-7799-4e99-b72b-f2d14a96193d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Getting quotas for user c2ecfd950eeb40409aaaff59f782d1f4 and project dabaf79a7d42463ea67fd9b5f7a12951. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:25:05.226015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cae96310-7799-4e99-b72b-f2d14a96193d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:25:05.229606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cae96310-7799-4e99-b72b-f2d14a96193d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:25:05.343936 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cae96310-7799-4e99-b72b-f2d14a96193d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.662063 Oct 24 10:25:05.345587 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 153/280] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:25:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:25:05.358874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-94118916-0fdd-4c27-9e6f-ccbd4cf3788a tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:05.363394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-94118916-0fdd-4c27-9e6f-ccbd4cf3788a tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:05.577586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94118916-0fdd-4c27-9e6f-ccbd4cf3788a tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:05.589169 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-94118916-0fdd-4c27-9e6f-ccbd4cf3788a tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 200 len: 1222 microversion: 2.1 time: 0.232891 Oct 24 10:25:05.592370 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 154/281] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:05 2022] GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 1222 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:05.774176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-797c54ca-7342-423a-8c51-38cd826cc49c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Action: 'update', calling method: .version_select at 0x7f04d13a2940>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:05.775476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3818e03-b26a-4aeb-b7f9-01ba4c767d0a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:05.776479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f3818e03-b26a-4aeb-b7f9-01ba4c767d0a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:05.782923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-797c54ca-7342-423a-8c51-38cd826cc49c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:05.783245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3818e03-b26a-4aeb-b7f9-01ba4c767d0a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:05.783429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-797c54ca-7342-423a-8c51-38cd826cc49c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:05.784052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3818e03-b26a-4aeb-b7f9-01ba4c767d0a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:05.784626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3818e03-b26a-4aeb-b7f9-01ba4c767d0a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:05.785520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3818e03-b26a-4aeb-b7f9-01ba4c767d0a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:05.786426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3818e03-b26a-4aeb-b7f9-01ba4c767d0a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:05.786547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-797c54ca-7342-423a-8c51-38cd826cc49c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:05.787158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3818e03-b26a-4aeb-b7f9-01ba4c767d0a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:05.808196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-797c54ca-7342-423a-8c51-38cd826cc49c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:05.809557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-797c54ca-7342-423a-8c51-38cd826cc49c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:05.810769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-797c54ca-7342-423a-8c51-38cd826cc49c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:05.832925 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-797c54ca-7342-423a-8c51-38cd826cc49c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] HTTP exception thrown: Service a733a9fc-9e3e-495f-ba0f-b0342c93557f could not be found. Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-797c54ca-7342-423a-8c51-38cd826cc49c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Request method failure captured: Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: request: PUT /compute/v2.1/os-services/a733a9fc-9e3e-495f-ba0f-b0342c93557f HTTP/1.1 Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 56 Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmgBfFvBWQ8Ku7bT1-zRSR4GMp5VxFbybbNfyb-aD-JoLA5UUx4g5chv-3YRm1lQOwYlaPfpgGJ8KgvYllkso_BeKIMzE-AbOrXjb9JnIky22hY3muRaLUYAUZ92u9_U3LpXAZ7wrM6nVaZBaO9cRv3ZCoEhaKFTrpXTwBYDG-JLE6o Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.53 Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 849f7fb527a84421bc6c1a6d35b73716 Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1397718389 Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:25:05.837302 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:25:05.839220 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/849f7fb527a84421bc6c1a6d35b73716"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/849f7fb527a84421bc6c1a6d35b73716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/849f7fb527a84421bc6c1a6d35b73716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_849f7fb527a84421bc6c1a6d35b73716", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:25:05.839220 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1397718389 Oct 24 10:25:05.839220 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 849f7fb527a84421bc6c1a6d35b73716 Oct 24 10:25:05.839220 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1397718389 Oct 24 10:25:05.839220 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin Oct 24 10:25:05.839220 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:25:05.839220 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:25:05.839220 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5e8720cb05764ff98683cc5efb99432c Oct 24 10:25:05.839220 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin Oct 24 10:25:05.839220 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:25:05.839220 n-d-858383-15 devstack@n-api.service[120425]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 24 10:25:05.839220 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:25:05.839220 n-d-858383-15 devstack@n-api.service[120425]: exception: Service a733a9fc-9e3e-495f-ba0f-b0342c93557f could not be found. Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'a733a9fc-9e3e-495f-ba0f-b0342c93557f', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a733a9fc-9e3e-495f-ba0f-b0342c93557f could not be found. Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:05.840180 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a733a9fc-9e3e-495f-ba0f-b0342c93557f could not be found. Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:05.841537 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:25:05.842790 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:25:05.842790 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a733a9fc-9e3e-495f-ba0f-b0342c93557f could not be found. Oct 24 10:25:05.842790 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:05.851241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-797c54ca-7342-423a-8c51-38cd826cc49c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Returning 404 to user: Service a733a9fc-9e3e-495f-ba0f-b0342c93557f could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:25:05.852267 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-797c54ca-7342-423a-8c51-38cd826cc49c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-services/a733a9fc-9e3e-495f-ba0f-b0342c93557f" status: 404 len: 110 microversion: 2.53 time: 0.677245 Oct 24 10:25:05.860963 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 128/282] 10.222.0.50 () {62 vars in 1309 bytes} [Mon Oct 24 10:25:05 2022] PUT /compute/v2.1/os-services/a733a9fc-9e3e-495f-ba0f-b0342c93557f => generated 110 bytes in 685 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:25:05.873127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80e7e8c5-4463-49a7-bdd3-4e74264a77c1 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Action: 'update', calling method: .version_select at 0x7f04d14908b0>, body: {"status": "disabled"} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:05.899297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80e7e8c5-4463-49a7-bdd3-4e74264a77c1 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:05.912068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80e7e8c5-4463-49a7-bdd3-4e74264a77c1 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:05.916077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80e7e8c5-4463-49a7-bdd3-4e74264a77c1 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:05.932576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80e7e8c5-4463-49a7-bdd3-4e74264a77c1 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:05.933105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80e7e8c5-4463-49a7-bdd3-4e74264a77c1 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:05.934268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80e7e8c5-4463-49a7-bdd3-4e74264a77c1 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:05.951221 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-80e7e8c5-4463-49a7-bdd3-4e74264a77c1 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] HTTP exception thrown: Service a733a9fc-9e3e-495f-ba0f-b0342c93557f could not be found. Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80e7e8c5-4463-49a7-bdd3-4e74264a77c1 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Request method failure captured: Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: request: PUT /compute/v2.1/os-services/a733a9fc-9e3e-495f-ba0f-b0342c93557f HTTP/1.1 Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 22 Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmgBfFvBWQ8Ku7bT1-zRSR4GMp5VxFbybbNfyb-aD-JoLA5UUx4g5chv-3YRm1lQOwYlaPfpgGJ8KgvYllkso_BeKIMzE-AbOrXjb9JnIky22hY3muRaLUYAUZ92u9_U3LpXAZ7wrM6nVaZBaO9cRv3ZCoEhaKFTrpXTwBYDG-JLE6o Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.53 Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 849f7fb527a84421bc6c1a6d35b73716 Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1397718389 Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:25:05.956405 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:25:05.957726 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/849f7fb527a84421bc6c1a6d35b73716"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/849f7fb527a84421bc6c1a6d35b73716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/849f7fb527a84421bc6c1a6d35b73716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_849f7fb527a84421bc6c1a6d35b73716", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:25:05.957726 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1397718389 Oct 24 10:25:05.957726 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 849f7fb527a84421bc6c1a6d35b73716 Oct 24 10:25:05.957726 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1397718389 Oct 24 10:25:05.957726 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin Oct 24 10:25:05.957726 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:25:05.957726 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:25:05.957726 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5e8720cb05764ff98683cc5efb99432c Oct 24 10:25:05.957726 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin Oct 24 10:25:05.957726 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:25:05.957726 n-d-858383-15 devstack@n-api.service[120425]: {"status": "disabled"} Oct 24 10:25:05.957726 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:25:05.957726 n-d-858383-15 devstack@n-api.service[120425]: exception: Service a733a9fc-9e3e-495f-ba0f-b0342c93557f could not be found. Oct 24 10:25:05.957726 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'a733a9fc-9e3e-495f-ba0f-b0342c93557f', 'body': {'status': 'disabled'}} Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a733a9fc-9e3e-495f-ba0f-b0342c93557f could not be found. Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:05.959040 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a733a9fc-9e3e-495f-ba0f-b0342c93557f could not be found. Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:25:05.960122 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:25:05.961173 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a733a9fc-9e3e-495f-ba0f-b0342c93557f could not be found. Oct 24 10:25:05.961173 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:05.961173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80e7e8c5-4463-49a7-bdd3-4e74264a77c1 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Returning 404 to user: Service a733a9fc-9e3e-495f-ba0f-b0342c93557f could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:25:05.961173 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-80e7e8c5-4463-49a7-bdd3-4e74264a77c1 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-services/a733a9fc-9e3e-495f-ba0f-b0342c93557f" status: 404 len: 110 microversion: 2.53 time: 0.096422 Oct 24 10:25:05.962846 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 129/283] 10.222.0.50 () {62 vars in 1309 bytes} [Mon Oct 24 10:25:05 2022] PUT /compute/v2.1/os-services/a733a9fc-9e3e-495f-ba0f-b0342c93557f => generated 110 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:25:05.978730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e579380f-cddb-4cdb-ae66-44c61ac805d6 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Action: 'update', calling method: .version_select at 0x7f04d13ce550>, body: {"status": "enabled"} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:05.996468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e579380f-cddb-4cdb-ae66-44c61ac805d6 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:05.999066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e579380f-cddb-4cdb-ae66-44c61ac805d6 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.000231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e579380f-cddb-4cdb-ae66-44c61ac805d6 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.021831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e579380f-cddb-4cdb-ae66-44c61ac805d6 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:06.022281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e579380f-cddb-4cdb-ae66-44c61ac805d6 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.023590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e579380f-cddb-4cdb-ae66-44c61ac805d6 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.034761 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-e579380f-cddb-4cdb-ae66-44c61ac805d6 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] HTTP exception thrown: Service a733a9fc-9e3e-495f-ba0f-b0342c93557f could not be found. Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e579380f-cddb-4cdb-ae66-44c61ac805d6 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Request method failure captured: Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: request: PUT /compute/v2.1/os-services/a733a9fc-9e3e-495f-ba0f-b0342c93557f HTTP/1.1 Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 21 Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmgBfFvBWQ8Ku7bT1-zRSR4GMp5VxFbybbNfyb-aD-JoLA5UUx4g5chv-3YRm1lQOwYlaPfpgGJ8KgvYllkso_BeKIMzE-AbOrXjb9JnIky22hY3muRaLUYAUZ92u9_U3LpXAZ7wrM6nVaZBaO9cRv3ZCoEhaKFTrpXTwBYDG-JLE6o Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.53 Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 849f7fb527a84421bc6c1a6d35b73716 Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1397718389 Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:25:06.046748 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:25:06.048285 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/849f7fb527a84421bc6c1a6d35b73716"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/849f7fb527a84421bc6c1a6d35b73716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/849f7fb527a84421bc6c1a6d35b73716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_849f7fb527a84421bc6c1a6d35b73716", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:25:06.048285 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1397718389 Oct 24 10:25:06.048285 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 849f7fb527a84421bc6c1a6d35b73716 Oct 24 10:25:06.048285 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1397718389 Oct 24 10:25:06.048285 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin Oct 24 10:25:06.048285 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:25:06.048285 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:25:06.048285 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5e8720cb05764ff98683cc5efb99432c Oct 24 10:25:06.048285 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin Oct 24 10:25:06.048285 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:25:06.048285 n-d-858383-15 devstack@n-api.service[120425]: {"status": "enabled"} Oct 24 10:25:06.048285 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:25:06.048285 n-d-858383-15 devstack@n-api.service[120425]: exception: Service a733a9fc-9e3e-495f-ba0f-b0342c93557f could not be found. Oct 24 10:25:06.048285 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'a733a9fc-9e3e-495f-ba0f-b0342c93557f', 'body': {'status': 'enabled'}} Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a733a9fc-9e3e-495f-ba0f-b0342c93557f could not be found. Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:06.049220 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a733a9fc-9e3e-495f-ba0f-b0342c93557f could not be found. Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:25:06.050580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:25:06.052516 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a733a9fc-9e3e-495f-ba0f-b0342c93557f could not be found. Oct 24 10:25:06.052516 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:06.053485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e579380f-cddb-4cdb-ae66-44c61ac805d6 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Returning 404 to user: Service a733a9fc-9e3e-495f-ba0f-b0342c93557f could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:25:06.054671 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e579380f-cddb-4cdb-ae66-44c61ac805d6 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-services/a733a9fc-9e3e-495f-ba0f-b0342c93557f" status: 404 len: 110 microversion: 2.53 time: 0.086017 Oct 24 10:25:06.056125 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 130/284] 10.222.0.50 () {62 vars in 1309 bytes} [Mon Oct 24 10:25:05 2022] PUT /compute/v2.1/os-services/a733a9fc-9e3e-495f-ba0f-b0342c93557f => generated 110 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:25:06.064551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b0116b5b-9a46-4d12-915c-6181dc8aba56 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:06.094061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0116b5b-9a46-4d12-915c-6181dc8aba56 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:06.094786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0116b5b-9a46-4d12-915c-6181dc8aba56 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.096929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0116b5b-9a46-4d12-915c-6181dc8aba56 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.100078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0116b5b-9a46-4d12-915c-6181dc8aba56 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:06.100723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0116b5b-9a46-4d12-915c-6181dc8aba56 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.101329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0116b5b-9a46-4d12-915c-6181dc8aba56 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.157184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3818e03-b26a-4aeb-b7f9-01ba4c767d0a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:06.172466 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f3818e03-b26a-4aeb-b7f9-01ba4c767d0a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1471 microversion: 2.1 time: 0.398302 Oct 24 10:25:06.173052 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b0116b5b-9a46-4d12-915c-6181dc8aba56 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.111762 Oct 24 10:25:06.174359 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 131/285] 10.222.0.50 () {60 vars in 1178 bytes} [Mon Oct 24 10:25:06 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:25:06.191879 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 155/286] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:05 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1471 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:06.195588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5456ec5e-43a5-45ba-985c-aca59c7d881d tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:06.208991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5456ec5e-43a5-45ba-985c-aca59c7d881d tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:06.212171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5456ec5e-43a5-45ba-985c-aca59c7d881d tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.213883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5456ec5e-43a5-45ba-985c-aca59c7d881d tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.214856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5456ec5e-43a5-45ba-985c-aca59c7d881d tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:06.217933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5456ec5e-43a5-45ba-985c-aca59c7d881d tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.218567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5456ec5e-43a5-45ba-985c-aca59c7d881d tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.231761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-94b6afdc-0ffb-4330-b6be-5113305cd9aa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:06.232571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-94b6afdc-0ffb-4330-b6be-5113305cd9aa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:06.249618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94b6afdc-0ffb-4330-b6be-5113305cd9aa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:06.250113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94b6afdc-0ffb-4330-b6be-5113305cd9aa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.250596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94b6afdc-0ffb-4330-b6be-5113305cd9aa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.251251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94b6afdc-0ffb-4330-b6be-5113305cd9aa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:06.251706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94b6afdc-0ffb-4330-b6be-5113305cd9aa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.258900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94b6afdc-0ffb-4330-b6be-5113305cd9aa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.278618 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5456ec5e-43a5-45ba-985c-aca59c7d881d tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.094721 Oct 24 10:25:06.303363 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 132/287] 10.222.0.50 () {60 vars in 1211 bytes} [Mon Oct 24 10:25:06 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:25:06.308463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c3542847-f131-4dc5-a5a8-a539912dfbb9 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:06.312350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3542847-f131-4dc5-a5a8-a539912dfbb9 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:06.312927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3542847-f131-4dc5-a5a8-a539912dfbb9 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.316134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3542847-f131-4dc5-a5a8-a539912dfbb9 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.317130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3542847-f131-4dc5-a5a8-a539912dfbb9 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:06.318555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3542847-f131-4dc5-a5a8-a539912dfbb9 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.321432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3542847-f131-4dc5-a5a8-a539912dfbb9 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.327151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:06.389897 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c3542847-f131-4dc5-a5a8-a539912dfbb9 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.085372 Oct 24 10:25:06.401654 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 133/288] 10.222.0.50 () {60 vars in 1178 bytes} [Mon Oct 24 10:25:06 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:25:06.416561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-20ed169f-87fb-4862-9181-f984fa9e6d5b tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:06.430778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20ed169f-87fb-4862-9181-f984fa9e6d5b tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:06.431585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20ed169f-87fb-4862-9181-f984fa9e6d5b tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.432290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20ed169f-87fb-4862-9181-f984fa9e6d5b tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.438224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20ed169f-87fb-4862-9181-f984fa9e6d5b tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:06.438726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20ed169f-87fb-4862-9181-f984fa9e6d5b tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.439168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20ed169f-87fb-4862-9181-f984fa9e6d5b tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.490433 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-20ed169f-87fb-4862-9181-f984fa9e6d5b tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=n-d-858383-15&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.078032 Oct 24 10:25:06.501048 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 134/289] 10.222.0.50 () {60 vars in 1237 bytes} [Mon Oct 24 10:25:06 2022] GET /compute/v2.1/os-services?host=n-d-858383-15&binary=xxx => generated 16 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:06.513139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5ec8c97-9052-49c2-860f-eb7b32a20099 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:06.517004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ec8c97-9052-49c2-860f-eb7b32a20099 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:06.522092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ec8c97-9052-49c2-860f-eb7b32a20099 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.522858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ec8c97-9052-49c2-860f-eb7b32a20099 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.523925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ec8c97-9052-49c2-860f-eb7b32a20099 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:06.524624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ec8c97-9052-49c2-860f-eb7b32a20099 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.525296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ec8c97-9052-49c2-860f-eb7b32a20099 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.593990 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d5ec8c97-9052-49c2-860f-eb7b32a20099 tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.092630 Oct 24 10:25:06.605454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94b6afdc-0ffb-4330-b6be-5113305cd9aa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:06.607616 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 135/290] 10.222.0.50 () {60 vars in 1178 bytes} [Mon Oct 24 10:25:06 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:25:06.614242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8797d4d9-3318-4317-906e-21f7872265e4 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:06.615318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8797d4d9-3318-4317-906e-21f7872265e4 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:06.620659 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-94b6afdc-0ffb-4330-b6be-5113305cd9aa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 200 len: 1387 microversion: 2.1 time: 0.407848 Oct 24 10:25:06.629642 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 156/291] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:06 2022] GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 1387 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:06.635138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8797d4d9-3318-4317-906e-21f7872265e4 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:06.635853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8797d4d9-3318-4317-906e-21f7872265e4 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.636494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8797d4d9-3318-4317-906e-21f7872265e4 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.637509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8797d4d9-3318-4317-906e-21f7872265e4 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:06.638672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8797d4d9-3318-4317-906e-21f7872265e4 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.639310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8797d4d9-3318-4317-906e-21f7872265e4 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.647815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ea68e3c8-8132-40f0-b809-44141ccaf50c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:06.657628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea68e3c8-8132-40f0-b809-44141ccaf50c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:06.658146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea68e3c8-8132-40f0-b809-44141ccaf50c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.658596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea68e3c8-8132-40f0-b809-44141ccaf50c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.661965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea68e3c8-8132-40f0-b809-44141ccaf50c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:06.662458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea68e3c8-8132-40f0-b809-44141ccaf50c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.662899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea68e3c8-8132-40f0-b809-44141ccaf50c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.728569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=8,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:06.764938 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ea68e3c8-8132-40f0-b809-44141ccaf50c tempest-ServicesAdminNegativeV253TestJSON-1397718389 tempest-ServicesAdminNegativeV253TestJSON-1397718389-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.130961 Oct 24 10:25:06.768190 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 157/292] 10.222.0.50 () {60 vars in 1239 bytes} [Mon Oct 24 10:25:06 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:06.781387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8797d4d9-3318-4317-906e-21f7872265e4 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:06.794053 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8797d4d9-3318-4317-906e-21f7872265e4 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 200 len: 1218 microversion: 2.1 time: 0.184683 Oct 24 10:25:06.794665 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 136/293] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:06 2022] GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:06.808541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-95c38b9c-f67a-468d-a606-3fe586b6c87d req-01306a43-209a-4ea5-8ee0-f1bf32b7460b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad6067c8-26ae-4e5f-a747-8d9e5f720a4f", "name": "network-vif-plugged", "status": "completed", "tag": "57ea9058-b25f-4a68-bff8-4ffcfca66d5f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:06.842227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-95c38b9c-f67a-468d-a606-3fe586b6c87d req-01306a43-209a-4ea5-8ee0-f1bf32b7460b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:06.842943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-95c38b9c-f67a-468d-a606-3fe586b6c87d req-01306a43-209a-4ea5-8ee0-f1bf32b7460b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:06.843532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-95c38b9c-f67a-468d-a606-3fe586b6c87d req-01306a43-209a-4ea5-8ee0-f1bf32b7460b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:06.877919 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-95c38b9c-f67a-468d-a606-3fe586b6c87d req-01306a43-209a-4ea5-8ee0-f1bf32b7460b service nova] Creating event network-vif-plugged:57ea9058-b25f-4a68-bff8-4ffcfca66d5f for instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f on n-h2-858383-15 Oct 24 10:25:06.891193 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-95c38b9c-f67a-468d-a606-3fe586b6c87d req-01306a43-209a-4ea5-8ee0-f1bf32b7460b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087860 Oct 24 10:25:06.892354 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 137/294] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:07.207468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2aeb5978-1d06-466b-8f51-f81b10ec4469 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:07.208363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2aeb5978-1d06-466b-8f51-f81b10ec4469 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:07.219283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aeb5978-1d06-466b-8f51-f81b10ec4469 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:07.219978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aeb5978-1d06-466b-8f51-f81b10ec4469 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:07.220612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aeb5978-1d06-466b-8f51-f81b10ec4469 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:07.221804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aeb5978-1d06-466b-8f51-f81b10ec4469 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:07.222554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aeb5978-1d06-466b-8f51-f81b10ec4469 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:07.223327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aeb5978-1d06-466b-8f51-f81b10ec4469 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:07.482774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8c4777ed-6b02-4783-9684-850b7d2f5d75 tempest-ServicesAdminNegativeV253TestJSON-1838308977 tempest-ServicesAdminNegativeV253TestJSON-1838308977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:07.487241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8c4777ed-6b02-4783-9684-850b7d2f5d75 tempest-ServicesAdminNegativeV253TestJSON-1838308977 tempest-ServicesAdminNegativeV253TestJSON-1838308977-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '7d35ce999ef04e4caf9c7bd5bd6234c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031fbc8a10154229b77c881058abf1c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8c4777ed-6b02-4783-9684-850b7d2f5d75 tempest-ServicesAdminNegativeV253TestJSON-1838308977 tempest-ServicesAdminNegativeV253TestJSON-1838308977-project] Request method failure captured: Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmf9Spicc2VDc-1OMYqxU73r5A-Ew5FAP9YZmwhGbzOvPz1yBaX6UqY8lG1wGj7ZUQ9Tw4vihbfc0PJBOL_ukaI7SbniBujHfxFw1QftyVBuiYr_fRwV3NuGxqzf_0MnLZYFTvOaby2WE2ifiC5wnLU1P62E_b6UNPkfP8tCl4ymexw Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: X-Openstack-Nova-Api-Version: 2.53 Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 031fbc8a10154229b77c881058abf1c7 Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1838308977 Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:25:07.489663 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:25:07.491091 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/031fbc8a10154229b77c881058abf1c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/031fbc8a10154229b77c881058abf1c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/031fbc8a10154229b77c881058abf1c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_031fbc8a10154229b77c881058abf1c7", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:25:07.491091 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1838308977 Oct 24 10:25:07.491091 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 031fbc8a10154229b77c881058abf1c7 Oct 24 10:25:07.491091 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1838308977 Oct 24 10:25:07.491091 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1838308977-project Oct 24 10:25:07.491091 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:25:07.491091 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:25:07.491091 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 7d35ce999ef04e4caf9c7bd5bd6234c2 Oct 24 10:25:07.491091 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1838308977-project Oct 24 10:25:07.491091 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:25:07.491091 n-d-858383-15 devstack@n-api.service[120426]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 24 10:25:07.491091 n-d-858383-15 devstack@n-api.service[120426]: action_args: {} Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:25:07.492030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 24 10:25:07.493088 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:07.495457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8c4777ed-6b02-4783-9684-850b7d2f5d75 tempest-ServicesAdminNegativeV253TestJSON-1838308977 tempest-ServicesAdminNegativeV253TestJSON-1838308977-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:25:07.497875 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8c4777ed-6b02-4783-9684-850b7d2f5d75 tempest-ServicesAdminNegativeV253TestJSON-1838308977 tempest-ServicesAdminNegativeV253TestJSON-1838308977-project] 10.222.0.50 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.718414 Oct 24 10:25:07.507418 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 158/295] 10.222.0.50 () {60 vars in 1178 bytes} [Mon Oct 24 10:25:06 2022] GET /compute/v2.1/os-services => generated 112 bytes in 724 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:25:07.643774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2aeb5978-1d06-466b-8f51-f81b10ec4469 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:07.649611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-94e9f2dc-127d-4e8c-a867-11a2fbccad12 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:07.650909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-94e9f2dc-127d-4e8c-a867-11a2fbccad12 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:07.655857 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2aeb5978-1d06-466b-8f51-f81b10ec4469 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1476 microversion: 2.1 time: 0.450818 Oct 24 10:25:07.667595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94e9f2dc-127d-4e8c-a867-11a2fbccad12 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:07.669251 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 138/296] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:07 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1476 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:25:07.671184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94e9f2dc-127d-4e8c-a867-11a2fbccad12 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:07.674660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94e9f2dc-127d-4e8c-a867-11a2fbccad12 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:07.675768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94e9f2dc-127d-4e8c-a867-11a2fbccad12 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:07.681435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94e9f2dc-127d-4e8c-a867-11a2fbccad12 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:07.684358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94e9f2dc-127d-4e8c-a867-11a2fbccad12 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:07.820978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3b9ebcb2-5094-4738-82a5-22301ac2ad7d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:07.821785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3b9ebcb2-5094-4738-82a5-22301ac2ad7d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:07.830276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b9ebcb2-5094-4738-82a5-22301ac2ad7d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:07.831058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b9ebcb2-5094-4738-82a5-22301ac2ad7d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:07.832448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b9ebcb2-5094-4738-82a5-22301ac2ad7d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:07.833737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b9ebcb2-5094-4738-82a5-22301ac2ad7d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:07.834472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b9ebcb2-5094-4738-82a5-22301ac2ad7d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:07.835602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b9ebcb2-5094-4738-82a5-22301ac2ad7d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:08.013798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3b9ebcb2-5094-4738-82a5-22301ac2ad7d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:08.030835 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3b9ebcb2-5094-4738-82a5-22301ac2ad7d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 200 len: 1280 microversion: 2.1 time: 0.216308 Oct 24 10:25:08.033019 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 139/297] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:07 2022] GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 1280 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:25:08.167708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94e9f2dc-127d-4e8c-a867-11a2fbccad12 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:08.191676 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-94e9f2dc-127d-4e8c-a867-11a2fbccad12 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 200 len: 1387 microversion: 2.1 time: 0.541386 Oct 24 10:25:08.195464 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 159/298] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:07 2022] GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 1387 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:08.685109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-48069887-79f4-437c-bb37-4f604d9133b1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:08.686331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-48069887-79f4-437c-bb37-4f604d9133b1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:08.711792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48069887-79f4-437c-bb37-4f604d9133b1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:08.712316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48069887-79f4-437c-bb37-4f604d9133b1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:08.712806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48069887-79f4-437c-bb37-4f604d9133b1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:08.713555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48069887-79f4-437c-bb37-4f604d9133b1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:08.714109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48069887-79f4-437c-bb37-4f604d9133b1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:08.714427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48069887-79f4-437c-bb37-4f604d9133b1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:08.958515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ce05cf73-e253-487c-ad81-f9dfc4b6393f tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Calling method '.version_select at 0x7f04d2f45ca0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:09.151830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-48069887-79f4-437c-bb37-4f604d9133b1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:09.164410 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-48069887-79f4-437c-bb37-4f604d9133b1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1476 microversion: 2.1 time: 0.483829 Oct 24 10:25:09.185661 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 160/299] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:08 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1476 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:25:09.200861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f06136d1-f2b9-4743-a828-5261726fae13 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:09.202146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f06136d1-f2b9-4743-a828-5261726fae13 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:09.212205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f06136d1-f2b9-4743-a828-5261726fae13 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:09.214245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f06136d1-f2b9-4743-a828-5261726fae13 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:09.215192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f06136d1-f2b9-4743-a828-5261726fae13 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:09.223532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f06136d1-f2b9-4743-a828-5261726fae13 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:09.224931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f06136d1-f2b9-4743-a828-5261726fae13 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:09.225646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f06136d1-f2b9-4743-a828-5261726fae13 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:09.311577 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ce05cf73-e253-487c-ad81-f9dfc4b6393f tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/587d578e59db45ca8f9870015af65870" status: 200 len: 371 microversion: 2.1 time: 0.838701 Oct 24 10:25:09.320560 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 140/300] 10.222.0.50 () {58 vars in 1242 bytes} [Mon Oct 24 10:25:08 2022] GET /compute/v2.1/os-quota-sets/587d578e59db45ca8f9870015af65870 => generated 371 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:09.331066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ebcc9d8d-07eb-4766-9d6d-41b3c94a8090 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:09.333663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ebcc9d8d-07eb-4766-9d6d-41b3c94a8090 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:09.354655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebcc9d8d-07eb-4766-9d6d-41b3c94a8090 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:09.355148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebcc9d8d-07eb-4766-9d6d-41b3c94a8090 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:09.355763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebcc9d8d-07eb-4766-9d6d-41b3c94a8090 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:09.356485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebcc9d8d-07eb-4766-9d6d-41b3c94a8090 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:09.356964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebcc9d8d-07eb-4766-9d6d-41b3c94a8090 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:09.357392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebcc9d8d-07eb-4766-9d6d-41b3c94a8090 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:09.387102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f06136d1-f2b9-4743-a828-5261726fae13 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:09.395926 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f06136d1-f2b9-4743-a828-5261726fae13 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 200 len: 1280 microversion: 2.1 time: 0.208565 Oct 24 10:25:09.400808 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 161/301] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:09 2022] GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 1280 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:09.412650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6115a5ee-d0cd-41b1-858b-1c69c7a3b593 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Action: 'update', calling method: .version_select at 0x7f04d1530820>, body: {"quota_set": {"ram": "5120"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:09.843880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6115a5ee-d0cd-41b1-858b-1c69c7a3b593 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:09.844564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6115a5ee-d0cd-41b1-858b-1c69c7a3b593 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:09.845105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6115a5ee-d0cd-41b1-858b-1c69c7a3b593 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:09.846696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6115a5ee-d0cd-41b1-858b-1c69c7a3b593 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:09.847196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6115a5ee-d0cd-41b1-858b-1c69c7a3b593 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:09.847916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6115a5ee-d0cd-41b1-858b-1c69c7a3b593 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:09.941234 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6115a5ee-d0cd-41b1-858b-1c69c7a3b593 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/587d578e59db45ca8f9870015af65870" status: 200 len: 328 microversion: 2.1 time: 0.538036 Oct 24 10:25:09.945003 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 162/302] 10.222.0.50 () {60 vars in 1262 bytes} [Mon Oct 24 10:25:09 2022] PUT /compute/v2.1/os-quota-sets/587d578e59db45ca8f9870015af65870 => generated 328 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:09.993258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ebcc9d8d-07eb-4766-9d6d-41b3c94a8090 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:10.007546 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ebcc9d8d-07eb-4766-9d6d-41b3c94a8090 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 200 len: 1586 microversion: 2.1 time: 0.685182 Oct 24 10:25:10.008598 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 141/303] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:09 2022] GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 1586 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:10.013109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-16c8a2e9-7332-4bba-b02e-3417c84e2fb0 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:10.061753 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-16c8a2e9-7332-4bba-b02e-3417c84e2fb0 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-quota-sets/587d578e59db45ca8f9870015af65870" status: 202 len: 0 microversion: 2.1 time: 0.051302 Oct 24 10:25:10.063668 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 142/304] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 10:25:10 2022] DELETE /compute/v2.1/os-quota-sets/587d578e59db45ca8f9870015af65870 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:25:10.078208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b542b846-c308-4cca-81da-bb15fdc2d9b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:10.080095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b542b846-c308-4cca-81da-bb15fdc2d9b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:10.093347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b542b846-c308-4cca-81da-bb15fdc2d9b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:10.098466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b542b846-c308-4cca-81da-bb15fdc2d9b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:10.100238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b542b846-c308-4cca-81da-bb15fdc2d9b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:10.102642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b542b846-c308-4cca-81da-bb15fdc2d9b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:10.103276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b542b846-c308-4cca-81da-bb15fdc2d9b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:10.104824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b542b846-c308-4cca-81da-bb15fdc2d9b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:10.414457 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b542b846-c308-4cca-81da-bb15fdc2d9b2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.349458 Oct 24 10:25:10.416529 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 143/305] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 10:25:10 2022] GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f/os-interface => generated 284 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:10.420782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5892a6ca-b19b-4615-b28c-2f7080d5ee19 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Calling method '.version_select at 0x7f04d13dc820>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:10.497095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cf2472bd-17cc-499d-bf40-9de625723f89 tempest-AZAdminNegativeTestJSON-1971995714 tempest-AZAdminNegativeTestJSON-1971995714-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:10.501470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cf2472bd-17cc-499d-bf40-9de625723f89 tempest-AZAdminNegativeTestJSON-1971995714 tempest-AZAdminNegativeTestJSON-1971995714-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '2b102923f7624fec936a649801a49471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b04b9e1547c47c7b1a6c4001244ba8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cf2472bd-17cc-499d-bf40-9de625723f89 tempest-AZAdminNegativeTestJSON-1971995714 tempest-AZAdminNegativeTestJSON-1971995714-project] Request method failure captured: Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmgE8wmYk3SCT9AvNwEcuUGD-8msbKEqKUHw5dA9ZyZvqE8K7iiFN3Qz4Dr9PKalSQuH2RDRihMFTOkNWbH1dc22xXTgDaOae1Ar4TY6HpPgUtBWhahkUwF3M3X9Qpl5cSikXaG2il4rlkbFy4_6p-vAa3vmr20uhz2bSgFCrtWjpXA Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4b04b9e1547c47c7b1a6c4001244ba8a Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1971995714 Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:25:10.502107 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:25:10.504730 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b04b9e1547c47c7b1a6c4001244ba8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4b04b9e1547c47c7b1a6c4001244ba8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4b04b9e1547c47c7b1a6c4001244ba8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4b04b9e1547c47c7b1a6c4001244ba8a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:25:10.504730 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AZAdminNegativeTestJSON-1971995714 Oct 24 10:25:10.504730 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4b04b9e1547c47c7b1a6c4001244ba8a Oct 24 10:25:10.504730 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1971995714 Oct 24 10:25:10.504730 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AZAdminNegativeTestJSON-1971995714-project Oct 24 10:25:10.504730 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:25:10.504730 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:25:10.504730 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 2b102923f7624fec936a649801a49471 Oct 24 10:25:10.504730 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AZAdminNegativeTestJSON-1971995714-project Oct 24 10:25:10.504730 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:25:10.504730 n-d-858383-15 devstack@n-api.service[120426]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 24 10:25:10.504730 n-d-858383-15 devstack@n-api.service[120426]: action_args: {} Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:25:10.506921 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:25:10.510696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:25:10.510696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:25:10.510696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:25:10.510696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:25:10.510696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:25:10.510696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 24 10:25:10.510696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:10.510696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:10.510696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:10.510696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:10.510696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:10.510696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:10.510696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:25:10.510696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:25:10.510696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 24 10:25:10.510696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:10.518837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cf2472bd-17cc-499d-bf40-9de625723f89 tempest-AZAdminNegativeTestJSON-1971995714 tempest-AZAdminNegativeTestJSON-1971995714-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:25:10.522405 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cf2472bd-17cc-499d-bf40-9de625723f89 tempest-AZAdminNegativeTestJSON-1971995714 tempest-AZAdminNegativeTestJSON-1971995714-project] 10.222.0.50 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.576398 Oct 24 10:25:10.525443 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 163/306] 10.222.0.50 () {58 vars in 1185 bytes} [Mon Oct 24 10:25:09 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 580 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:25:10.544935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-daffab0a-66b9-4680-87fd-f135843cb226 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:10.546845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-daffab0a-66b9-4680-87fd-f135843cb226 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:10.562391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-daffab0a-66b9-4680-87fd-f135843cb226 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:10.565228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-daffab0a-66b9-4680-87fd-f135843cb226 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:10.567482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-daffab0a-66b9-4680-87fd-f135843cb226 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:10.569058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-daffab0a-66b9-4680-87fd-f135843cb226 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:10.570319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-daffab0a-66b9-4680-87fd-f135843cb226 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:10.574524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-daffab0a-66b9-4680-87fd-f135843cb226 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:11.235939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-daffab0a-66b9-4680-87fd-f135843cb226 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:11.247216 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-daffab0a-66b9-4680-87fd-f135843cb226 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1476 microversion: 2.1 time: 0.720532 Oct 24 10:25:11.266903 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 164/307] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:10 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1476 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:11.275497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e2f526dd-da61-476e-9cb8-879a8be82ef9 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:11.276085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e2f526dd-da61-476e-9cb8-879a8be82ef9 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:11.282206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2f526dd-da61-476e-9cb8-879a8be82ef9 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:11.282806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2f526dd-da61-476e-9cb8-879a8be82ef9 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:11.283108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2f526dd-da61-476e-9cb8-879a8be82ef9 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:11.283813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2f526dd-da61-476e-9cb8-879a8be82ef9 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:11.284261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2f526dd-da61-476e-9cb8-879a8be82ef9 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:11.284677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2f526dd-da61-476e-9cb8-879a8be82ef9 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:11.462369 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5892a6ca-b19b-4615-b28c-2f7080d5ee19 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/587d578e59db45ca8f9870015af65870" status: 200 len: 371 microversion: 2.1 time: 1.044643 Oct 24 10:25:11.463517 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 144/308] 10.222.0.50 () {58 vars in 1242 bytes} [Mon Oct 24 10:25:10 2022] GET /compute/v2.1/os-quota-sets/587d578e59db45ca8f9870015af65870 => generated 371 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:11.683878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4cdd9b37-e057-4e17-9dcf-297088eac6f3 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Calling method '.version_select at 0x7f04d13a8550>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:11.937239 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4cdd9b37-e057-4e17-9dcf-297088eac6f3 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/ebb7903a5f1f42778c989ee406ebf439/defaults" status: 200 len: 371 microversion: 2.1 time: 0.253806 Oct 24 10:25:11.940801 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 145/309] 10.222.0.50 () {58 vars in 1269 bytes} [Mon Oct 24 10:25:11 2022] GET /compute/v2.1/os-quota-sets/ebb7903a5f1f42778c989ee406ebf439/defaults => generated 371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:25:12.281001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fc651c0c-3104-4e6b-894c-d2194821712c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:12.282782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fc651c0c-3104-4e6b-894c-d2194821712c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:12.296465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc651c0c-3104-4e6b-894c-d2194821712c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:12.298447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc651c0c-3104-4e6b-894c-d2194821712c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:12.298922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc651c0c-3104-4e6b-894c-d2194821712c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:12.299691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc651c0c-3104-4e6b-894c-d2194821712c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:12.300163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc651c0c-3104-4e6b-894c-d2194821712c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:12.300594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc651c0c-3104-4e6b-894c-d2194821712c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:12.665674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e2f526dd-da61-476e-9cb8-879a8be82ef9 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:12.679603 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e2f526dd-da61-476e-9cb8-879a8be82ef9 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 200 len: 1322 microversion: 2.1 time: 1.410264 Oct 24 10:25:12.680397 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 165/310] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:11 2022] GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 1322 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:12.690722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-470512e6-0c42-4a88-a1e3-e04f46dc91e1 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Action: 'update', calling method: .version_select at 0x7f04d168e550>, body: {"quota_set": {"ram": "5120"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:13.194639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fc651c0c-3104-4e6b-894c-d2194821712c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:13.213716 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fc651c0c-3104-4e6b-894c-d2194821712c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1476 microversion: 2.1 time: 0.933880 Oct 24 10:25:13.215091 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 146/311] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:12 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1476 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:13.294227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-470512e6-0c42-4a88-a1e3-e04f46dc91e1 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:13.294726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-470512e6-0c42-4a88-a1e3-e04f46dc91e1 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:13.295164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-470512e6-0c42-4a88-a1e3-e04f46dc91e1 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:13.295889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-470512e6-0c42-4a88-a1e3-e04f46dc91e1 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:13.296343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-470512e6-0c42-4a88-a1e3-e04f46dc91e1 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:13.301257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-470512e6-0c42-4a88-a1e3-e04f46dc91e1 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:13.416460 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-470512e6-0c42-4a88-a1e3-e04f46dc91e1 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/345d54e51bc94f6dbbcb5b28ac6db2c8" status: 200 len: 328 microversion: 2.1 time: 0.733611 Oct 24 10:25:13.424742 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 166/312] 10.222.0.50 () {60 vars in 1262 bytes} [Mon Oct 24 10:25:12 2022] PUT /compute/v2.1/os-quota-sets/345d54e51bc94f6dbbcb5b28ac6db2c8 => generated 328 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:13.438484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bac1ffda-ccb1-4014-87ea-4a5d8ed198c9 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Calling method '.version_select at 0x7f04d13a8af0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:13.704554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-46830bf1-d48a-43d2-ac5c-b27d8151c46c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:13.705255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-46830bf1-d48a-43d2-ac5c-b27d8151c46c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:13.720778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46830bf1-d48a-43d2-ac5c-b27d8151c46c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:13.721325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46830bf1-d48a-43d2-ac5c-b27d8151c46c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:13.721768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46830bf1-d48a-43d2-ac5c-b27d8151c46c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:13.722469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46830bf1-d48a-43d2-ac5c-b27d8151c46c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:13.722928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46830bf1-d48a-43d2-ac5c-b27d8151c46c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:13.727644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46830bf1-d48a-43d2-ac5c-b27d8151c46c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:14.068511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bac1ffda-ccb1-4014-87ea-4a5d8ed198c9 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:14.072520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bac1ffda-ccb1-4014-87ea-4a5d8ed198c9 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:14.073263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bac1ffda-ccb1-4014-87ea-4a5d8ed198c9 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:14.074254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bac1ffda-ccb1-4014-87ea-4a5d8ed198c9 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:14.074929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bac1ffda-ccb1-4014-87ea-4a5d8ed198c9 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:14.075554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bac1ffda-ccb1-4014-87ea-4a5d8ed198c9 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:14.130860 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bac1ffda-ccb1-4014-87ea-4a5d8ed198c9 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/345d54e51bc94f6dbbcb5b28ac6db2c8/detail" status: 200 len: 916 microversion: 2.1 time: 0.697510 Oct 24 10:25:14.133923 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 147/313] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:25:13 2022] GET /compute/v2.1/os-quota-sets/345d54e51bc94f6dbbcb5b28ac6db2c8/detail => generated 916 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:14.240235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-666e9433-2b08-4a13-91d2-21d8ae9d3fae tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:14.242042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-666e9433-2b08-4a13-91d2-21d8ae9d3fae tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:14.253877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-666e9433-2b08-4a13-91d2-21d8ae9d3fae tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:14.266452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-666e9433-2b08-4a13-91d2-21d8ae9d3fae tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:14.267363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-666e9433-2b08-4a13-91d2-21d8ae9d3fae tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:14.269124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-666e9433-2b08-4a13-91d2-21d8ae9d3fae tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:14.269884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-666e9433-2b08-4a13-91d2-21d8ae9d3fae tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:14.270521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-666e9433-2b08-4a13-91d2-21d8ae9d3fae tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:14.922534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-46830bf1-d48a-43d2-ac5c-b27d8151c46c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:14.965128 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-46830bf1-d48a-43d2-ac5c-b27d8151c46c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 200 len: 1322 microversion: 2.1 time: 1.264152 Oct 24 10:25:14.966799 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 167/314] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:13 2022] GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 1322 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:14.975937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9ce248c6-6c78-490e-96b2-134d10fef81c tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Action: 'update', calling method: .version_select at 0x7f04d14f3d30>, body: {"quota_set": {"ram": "2048"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:15.221482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-666e9433-2b08-4a13-91d2-21d8ae9d3fae tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:15.234141 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-666e9433-2b08-4a13-91d2-21d8ae9d3fae tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1476 microversion: 2.1 time: 0.998209 Oct 24 10:25:15.234643 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 148/315] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:14 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1476 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:25:15.270150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31828cef-c1e7-4cd0-b220-d4a32340bd04 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:15.271430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31828cef-c1e7-4cd0-b220-d4a32340bd04 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:15.289125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31828cef-c1e7-4cd0-b220-d4a32340bd04 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:15.290114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31828cef-c1e7-4cd0-b220-d4a32340bd04 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:15.290802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31828cef-c1e7-4cd0-b220-d4a32340bd04 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:15.291858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31828cef-c1e7-4cd0-b220-d4a32340bd04 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:15.295195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31828cef-c1e7-4cd0-b220-d4a32340bd04 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:15.295548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31828cef-c1e7-4cd0-b220-d4a32340bd04 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:15.452435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce248c6-6c78-490e-96b2-134d10fef81c tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:15.462587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce248c6-6c78-490e-96b2-134d10fef81c tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:15.463210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce248c6-6c78-490e-96b2-134d10fef81c tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:15.468413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce248c6-6c78-490e-96b2-134d10fef81c tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:15.469110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce248c6-6c78-490e-96b2-134d10fef81c tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:15.477763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce248c6-6c78-490e-96b2-134d10fef81c tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:15.596307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce248c6-6c78-490e-96b2-134d10fef81c tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:15.597093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce248c6-6c78-490e-96b2-134d10fef81c tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:15.597784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce248c6-6c78-490e-96b2-134d10fef81c tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:15.598823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce248c6-6c78-490e-96b2-134d10fef81c tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:15.599618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce248c6-6c78-490e-96b2-134d10fef81c tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:15.600235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce248c6-6c78-490e-96b2-134d10fef81c tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:15.716957 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9ce248c6-6c78-490e-96b2-134d10fef81c tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/345d54e51bc94f6dbbcb5b28ac6db2c8?user_id=d00e63a1332542d3ad6cf45de98fa7c4" status: 200 len: 328 microversion: 2.1 time: 0.748797 Oct 24 10:25:15.728112 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 168/316] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:25:14 2022] PUT /compute/v2.1/os-quota-sets/345d54e51bc94f6dbbcb5b28ac6db2c8?user_id=d00e63a1332542d3ad6cf45de98fa7c4 => generated 328 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:15.742779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-52521937-38d7-4edb-8613-0858991105af req-c0fa701c-ebd4-4e39-9427-949a24317af0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad6067c8-26ae-4e5f-a747-8d9e5f720a4f", "tag": "57ea9058-b25f-4a68-bff8-4ffcfca66d5f"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:15.765264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-52521937-38d7-4edb-8613-0858991105af req-c0fa701c-ebd4-4e39-9427-949a24317af0 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:15.768476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-52521937-38d7-4edb-8613-0858991105af req-c0fa701c-ebd4-4e39-9427-949a24317af0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:15.769549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-52521937-38d7-4edb-8613-0858991105af req-c0fa701c-ebd4-4e39-9427-949a24317af0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:15.798123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:15.802883 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-52521937-38d7-4edb-8613-0858991105af req-c0fa701c-ebd4-4e39-9427-949a24317af0 service nova] Creating event network-changed:57ea9058-b25f-4a68-bff8-4ffcfca66d5f for instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f on n-h2-858383-15 Oct 24 10:25:15.817834 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-52521937-38d7-4edb-8613-0858991105af req-c0fa701c-ebd4-4e39-9427-949a24317af0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086600 Oct 24 10:25:15.819814 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 169/317] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:15.836475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0d5052a3-9c26-498d-ae8b-76ac47ca87c3 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Calling method '.version_select at 0x7f04d14f3430>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:15.927892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-31828cef-c1e7-4cd0-b220-d4a32340bd04 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:15.943720 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31828cef-c1e7-4cd0-b220-d4a32340bd04 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 200 len: 1586 microversion: 2.1 time: 0.694161 Oct 24 10:25:15.947283 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 149/318] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:15 2022] GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 1586 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:15.993616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9dc2b514-ca09-4714-a5bc-016e17e0b6ce tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:15.994349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9dc2b514-ca09-4714-a5bc-016e17e0b6ce tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:16.007268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dc2b514-ca09-4714-a5bc-016e17e0b6ce tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:16.007640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dc2b514-ca09-4714-a5bc-016e17e0b6ce tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:16.008076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dc2b514-ca09-4714-a5bc-016e17e0b6ce tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:16.008806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dc2b514-ca09-4714-a5bc-016e17e0b6ce tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:16.009345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dc2b514-ca09-4714-a5bc-016e17e0b6ce tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:16.009700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dc2b514-ca09-4714-a5bc-016e17e0b6ce tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:16.559882 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0d5052a3-9c26-498d-ae8b-76ac47ca87c3 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/345d54e51bc94f6dbbcb5b28ac6db2c8?user_id=d00e63a1332542d3ad6cf45de98fa7c4" status: 200 len: 370 microversion: 2.1 time: 0.737255 Oct 24 10:25:16.579051 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 170/319] 10.222.0.50 () {58 vars in 1323 bytes} [Mon Oct 24 10:25:15 2022] GET /compute/v2.1/os-quota-sets/345d54e51bc94f6dbbcb5b28ac6db2c8?user_id=d00e63a1332542d3ad6cf45de98fa7c4 => generated 370 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:16.597350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c7fcde97-fc38-4fb3-97ff-beea3ee86402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:16.612123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c7fcde97-fc38-4fb3-97ff-beea3ee86402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:16.631860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7fcde97-fc38-4fb3-97ff-beea3ee86402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:16.633576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7fcde97-fc38-4fb3-97ff-beea3ee86402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:16.634997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7fcde97-fc38-4fb3-97ff-beea3ee86402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:16.636790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7fcde97-fc38-4fb3-97ff-beea3ee86402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:16.637523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7fcde97-fc38-4fb3-97ff-beea3ee86402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:16.638480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7fcde97-fc38-4fb3-97ff-beea3ee86402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:16.665232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9dc2b514-ca09-4714-a5bc-016e17e0b6ce tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:16.682359 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9dc2b514-ca09-4714-a5bc-016e17e0b6ce tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 200 len: 1322 microversion: 2.1 time: 0.693377 Oct 24 10:25:16.696865 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 150/320] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:15 2022] GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 1322 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:25:17.013087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c7fcde97-fc38-4fb3-97ff-beea3ee86402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:17.026338 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c7fcde97-fc38-4fb3-97ff-beea3ee86402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1476 microversion: 2.1 time: 0.445707 Oct 24 10:25:17.027841 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 171/321] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:16 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1476 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:17.771309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68a2e4b9-b959-467f-82c4-26b5b147a60b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-689551402", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "65c79d3e-bb06-4408-bcb0-99f943a08544"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:17.876437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-263ad7f3-2dab-41f5-81c9-2b05c92c10c9 tempest-AZAdminV2TestJSON-1675174939 tempest-AZAdminV2TestJSON-1675174939-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:17.886553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-263ad7f3-2dab-41f5-81c9-2b05c92c10c9 tempest-AZAdminV2TestJSON-1675174939 tempest-AZAdminV2TestJSON-1675174939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:17.887335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-263ad7f3-2dab-41f5-81c9-2b05c92c10c9 tempest-AZAdminV2TestJSON-1675174939 tempest-AZAdminV2TestJSON-1675174939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:17.888099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-263ad7f3-2dab-41f5-81c9-2b05c92c10c9 tempest-AZAdminV2TestJSON-1675174939 tempest-AZAdminV2TestJSON-1675174939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:17.889257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-263ad7f3-2dab-41f5-81c9-2b05c92c10c9 tempest-AZAdminV2TestJSON-1675174939 tempest-AZAdminV2TestJSON-1675174939-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:17.890074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-263ad7f3-2dab-41f5-81c9-2b05c92c10c9 tempest-AZAdminV2TestJSON-1675174939 tempest-AZAdminV2TestJSON-1675174939-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:17.890780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-263ad7f3-2dab-41f5-81c9-2b05c92c10c9 tempest-AZAdminV2TestJSON-1675174939 tempest-AZAdminV2TestJSON-1675174939-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:17.899454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-68a2e4b9-b959-467f-82c4-26b5b147a60b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] validate_networks() for [('65c79d3e-bb06-4408-bcb0-99f943a08544', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:25:17.961984 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-263ad7f3-2dab-41f5-81c9-2b05c92c10c9 tempest-AZAdminV2TestJSON-1675174939 tempest-AZAdminV2TestJSON-1675174939-project-admin] 10.222.0.50 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.677940 Oct 24 10:25:17.963566 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 172/322] 10.222.0.50 () {58 vars in 1164 bytes} [Mon Oct 24 10:25:17 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 10:25:17.973527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-59e1d618-254a-4099-a8a2-6f88e07dbaaa tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Calling method '.version_select at 0x7f04d2bbc160>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:18.384216 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-59e1d618-254a-4099-a8a2-6f88e07dbaaa tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/ebb7903a5f1f42778c989ee406ebf439/defaults" status: 200 len: 371 microversion: 2.1 time: 0.419149 Oct 24 10:25:18.385747 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 173/323] 10.222.0.50 () {58 vars in 1269 bytes} [Mon Oct 24 10:25:17 2022] GET /compute/v2.1/os-quota-sets/ebb7903a5f1f42778c989ee406ebf439/defaults => generated 371 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:18.397294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-01c3c958-129c-40b8-8a8a-27c48b6b50cb tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:18.397869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-01c3c958-129c-40b8-8a8a-27c48b6b50cb tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:18.412161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01c3c958-129c-40b8-8a8a-27c48b6b50cb tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:18.413186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01c3c958-129c-40b8-8a8a-27c48b6b50cb tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:18.415518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01c3c958-129c-40b8-8a8a-27c48b6b50cb tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:18.416548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01c3c958-129c-40b8-8a8a-27c48b6b50cb tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:18.418580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01c3c958-129c-40b8-8a8a-27c48b6b50cb tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:18.419275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01c3c958-129c-40b8-8a8a-27c48b6b50cb tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:18.825139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-01c3c958-129c-40b8-8a8a-27c48b6b50cb tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:18.833172 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-01c3c958-129c-40b8-8a8a-27c48b6b50cb tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 200 len: 1322 microversion: 2.1 time: 0.446255 Oct 24 10:25:18.833750 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 174/324] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:18 2022] GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 1322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:18.847480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-6679fd8e-ac7c-4ae0-bee9-36f798c71444 req-c0f52bb4-3412-48fe-ac3c-7b8bbd5af666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "012048e0-d21f-4bff-8616-81d284df270e", "tag": "5902c93d-246e-4e8c-b4f3-5da471a2a551"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:18.872580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6679fd8e-ac7c-4ae0-bee9-36f798c71444 req-c0f52bb4-3412-48fe-ac3c-7b8bbd5af666 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:18.876976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6679fd8e-ac7c-4ae0-bee9-36f798c71444 req-c0f52bb4-3412-48fe-ac3c-7b8bbd5af666 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:18.878701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6679fd8e-ac7c-4ae0-bee9-36f798c71444 req-c0f52bb4-3412-48fe-ac3c-7b8bbd5af666 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:18.896163 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-6679fd8e-ac7c-4ae0-bee9-36f798c71444 req-c0f52bb4-3412-48fe-ac3c-7b8bbd5af666 service nova] Creating event network-changed:5902c93d-246e-4e8c-b4f3-5da471a2a551 for instance 012048e0-d21f-4bff-8616-81d284df270e on n-h1-858383-15 Oct 24 10:25:18.902757 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-6679fd8e-ac7c-4ae0-bee9-36f798c71444 req-c0f52bb4-3412-48fe-ac3c-7b8bbd5af666 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065441 Oct 24 10:25:18.903990 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 175/325] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:18.909079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c13e628a-480a-4c52-b673-e4e8b1e9e3e9 tempest-AZAdminV2TestJSON-1675174939 tempest-AZAdminV2TestJSON-1675174939-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:18.911020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c13e628a-480a-4c52-b673-e4e8b1e9e3e9 tempest-AZAdminV2TestJSON-1675174939 tempest-AZAdminV2TestJSON-1675174939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:18.916766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c13e628a-480a-4c52-b673-e4e8b1e9e3e9 tempest-AZAdminV2TestJSON-1675174939 tempest-AZAdminV2TestJSON-1675174939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:18.921831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c13e628a-480a-4c52-b673-e4e8b1e9e3e9 tempest-AZAdminV2TestJSON-1675174939 tempest-AZAdminV2TestJSON-1675174939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:18.924391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c13e628a-480a-4c52-b673-e4e8b1e9e3e9 tempest-AZAdminV2TestJSON-1675174939 tempest-AZAdminV2TestJSON-1675174939-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:18.925121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c13e628a-480a-4c52-b673-e4e8b1e9e3e9 tempest-AZAdminV2TestJSON-1675174939 tempest-AZAdminV2TestJSON-1675174939-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:18.925775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c13e628a-480a-4c52-b673-e4e8b1e9e3e9 tempest-AZAdminV2TestJSON-1675174939 tempest-AZAdminV2TestJSON-1675174939-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:18.941726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-68a2e4b9-b959-467f-82c4-26b5b147a60b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:25:18.942320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-68a2e4b9-b959-467f-82c4-26b5b147a60b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:25:18.943373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-68a2e4b9-b959-467f-82c4-26b5b147a60b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:25:18.943909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-68a2e4b9-b959-467f-82c4-26b5b147a60b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:25:18.944336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-68a2e4b9-b959-467f-82c4-26b5b147a60b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:25:18.961009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68a2e4b9-b959-467f-82c4-26b5b147a60b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:18.961009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68a2e4b9-b959-467f-82c4-26b5b147a60b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:18.961362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68a2e4b9-b959-467f-82c4-26b5b147a60b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:18.961965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68a2e4b9-b959-467f-82c4-26b5b147a60b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:18.962424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68a2e4b9-b959-467f-82c4-26b5b147a60b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:18.962852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68a2e4b9-b959-467f-82c4-26b5b147a60b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:18.967828 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c13e628a-480a-4c52-b673-e4e8b1e9e3e9 tempest-AZAdminV2TestJSON-1675174939 tempest-AZAdminV2TestJSON-1675174939-project-admin] 10.222.0.50 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.062372 Oct 24 10:25:18.983828 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 176/326] 10.222.0.50 () {58 vars in 1185 bytes} [Mon Oct 24 10:25:18 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:18.991744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-88e6c32d-39fb-4ae6-aaf9-c1f64183ff92 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:18.993856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-88e6c32d-39fb-4ae6-aaf9-c1f64183ff92 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:19.009969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88e6c32d-39fb-4ae6-aaf9-c1f64183ff92 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:19.011679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88e6c32d-39fb-4ae6-aaf9-c1f64183ff92 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:19.012369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88e6c32d-39fb-4ae6-aaf9-c1f64183ff92 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:19.013315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88e6c32d-39fb-4ae6-aaf9-c1f64183ff92 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:19.014173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88e6c32d-39fb-4ae6-aaf9-c1f64183ff92 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:19.014806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88e6c32d-39fb-4ae6-aaf9-c1f64183ff92 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:19.022047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-68a2e4b9-b959-467f-82c4-26b5b147a60b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Getting quotas for project 115025f23db94a71b74b6adbc536792f. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:25:19.033726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-68a2e4b9-b959-467f-82c4-26b5b147a60b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Getting quotas for user 176a68ea281e4f65bbeac67cc304468d and project 115025f23db94a71b74b6adbc536792f. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:25:19.064095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-68a2e4b9-b959-467f-82c4-26b5b147a60b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:25:19.066620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-68a2e4b9-b959-467f-82c4-26b5b147a60b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:25:19.216002 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-68a2e4b9-b959-467f-82c4-26b5b147a60b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.137187 Oct 24 10:25:19.226703 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 151/327] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:25:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:25:19.244908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-44f3cc1f-50df-4f03-9127-cd1c56ac18ab tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Action: 'update', calling method: .version_select at 0x7f04d13dc3a0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:19.757487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44f3cc1f-50df-4f03-9127-cd1c56ac18ab tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:19.758388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44f3cc1f-50df-4f03-9127-cd1c56ac18ab tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:19.759277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44f3cc1f-50df-4f03-9127-cd1c56ac18ab tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:19.760122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44f3cc1f-50df-4f03-9127-cd1c56ac18ab tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:19.760678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44f3cc1f-50df-4f03-9127-cd1c56ac18ab tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:19.761226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44f3cc1f-50df-4f03-9127-cd1c56ac18ab tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:19.836469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=5 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:20.202569 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-44f3cc1f-50df-4f03-9127-cd1c56ac18ab tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/ebb7903a5f1f42778c989ee406ebf439" status: 200 len: 329 microversion: 2.1 time: 0.974248 Oct 24 10:25:20.210105 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 152/328] 10.222.0.50 () {60 vars in 1263 bytes} [Mon Oct 24 10:25:19 2022] PUT /compute/v2.1/os-quota-sets/ebb7903a5f1f42778c989ee406ebf439 => generated 329 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:20.210105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4ea79bed-4e4a-4257-9f60-36e49aa61bce tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:20.210105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4ea79bed-4e4a-4257-9f60-36e49aa61bce tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:20.222764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-88e6c32d-39fb-4ae6-aaf9-c1f64183ff92 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:20.231728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ea79bed-4e4a-4257-9f60-36e49aa61bce tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:20.232226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ea79bed-4e4a-4257-9f60-36e49aa61bce tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:20.232664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ea79bed-4e4a-4257-9f60-36e49aa61bce tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:20.233407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ea79bed-4e4a-4257-9f60-36e49aa61bce tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:20.233862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ea79bed-4e4a-4257-9f60-36e49aa61bce tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:20.234416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ea79bed-4e4a-4257-9f60-36e49aa61bce tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:20.235956 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-88e6c32d-39fb-4ae6-aaf9-c1f64183ff92 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1476 microversion: 2.1 time: 1.249149 Oct 24 10:25:20.237499 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 177/329] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:18 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1476 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:20.575307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4ea79bed-4e4a-4257-9f60-36e49aa61bce tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:20.598043 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4ea79bed-4e4a-4257-9f60-36e49aa61bce tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1214 microversion: 2.1 time: 0.393378 Oct 24 10:25:20.599812 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 153/330] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:20 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1214 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:20.606367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6ae1e753-feca-453b-96a4-9abf52bcd5f3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:20.607329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6ae1e753-feca-453b-96a4-9abf52bcd5f3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:20.614398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae1e753-feca-453b-96a4-9abf52bcd5f3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:20.615271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae1e753-feca-453b-96a4-9abf52bcd5f3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:20.616054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae1e753-feca-453b-96a4-9abf52bcd5f3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:20.626857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae1e753-feca-453b-96a4-9abf52bcd5f3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:20.629315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae1e753-feca-453b-96a4-9abf52bcd5f3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:20.631668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae1e753-feca-453b-96a4-9abf52bcd5f3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:20.664359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b2c513f7-1b0c-4804-9c1d-eadcbc86472d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1166701145", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:20.779095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-b2c513f7-1b0c-4804-9c1d-eadcbc86472d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:25:21.414452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ae1e753-feca-453b-96a4-9abf52bcd5f3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:21.430687 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6ae1e753-feca-453b-96a4-9abf52bcd5f3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 200 len: 1322 microversion: 2.1 time: 0.828466 Oct 24 10:25:21.431521 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 154/331] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:20 2022] GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 1322 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:21.437719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5db54280-fb61-45d9-b956-ef091e3ab5e3 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Action: 'update', calling method: .version_select at 0x7f04d16cd160>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:21.485113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b2c513f7-1b0c-4804-9c1d-eadcbc86472d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:25:21.486235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b2c513f7-1b0c-4804-9c1d-eadcbc86472d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:25:21.487474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b2c513f7-1b0c-4804-9c1d-eadcbc86472d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:25:21.488211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b2c513f7-1b0c-4804-9c1d-eadcbc86472d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:25:21.488787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b2c513f7-1b0c-4804-9c1d-eadcbc86472d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:25:21.509290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2c513f7-1b0c-4804-9c1d-eadcbc86472d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:21.510066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2c513f7-1b0c-4804-9c1d-eadcbc86472d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:21.510670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2c513f7-1b0c-4804-9c1d-eadcbc86472d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:21.515433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2c513f7-1b0c-4804-9c1d-eadcbc86472d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:21.516155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2c513f7-1b0c-4804-9c1d-eadcbc86472d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:21.516764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2c513f7-1b0c-4804-9c1d-eadcbc86472d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:21.539800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=22 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:21.565690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-b2c513f7-1b0c-4804-9c1d-eadcbc86472d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Getting quotas for project 4bcc92db3323454f9d56d34a11fbe540. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:25:21.575212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-b2c513f7-1b0c-4804-9c1d-eadcbc86472d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Getting quotas for user e2fad079a57e4c36896955386e6f31ef and project 4bcc92db3323454f9d56d34a11fbe540. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:25:21.606258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:21.607723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b2c513f7-1b0c-4804-9c1d-eadcbc86472d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:25:21.613289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b2c513f7-1b0c-4804-9c1d-eadcbc86472d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:25:21.702480 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b2c513f7-1b0c-4804-9c1d-eadcbc86472d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.463530 Oct 24 10:25:21.703608 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 178/332] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:25:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:25:21.709811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0ba21f48-40d3-48b1-bc89-9a0164e12a1d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:21.710881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0ba21f48-40d3-48b1-bc89-9a0164e12a1d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:21.718858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ba21f48-40d3-48b1-bc89-9a0164e12a1d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:21.719841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ba21f48-40d3-48b1-bc89-9a0164e12a1d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:21.720439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ba21f48-40d3-48b1-bc89-9a0164e12a1d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:21.721473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ba21f48-40d3-48b1-bc89-9a0164e12a1d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:21.722076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ba21f48-40d3-48b1-bc89-9a0164e12a1d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:21.722653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ba21f48-40d3-48b1-bc89-9a0164e12a1d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:22.002996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5db54280-fb61-45d9-b956-ef091e3ab5e3 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:22.005967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5db54280-fb61-45d9-b956-ef091e3ab5e3 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:22.007318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5db54280-fb61-45d9-b956-ef091e3ab5e3 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:22.010048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5db54280-fb61-45d9-b956-ef091e3ab5e3 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:22.010903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5db54280-fb61-45d9-b956-ef091e3ab5e3 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:22.012528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5db54280-fb61-45d9-b956-ef091e3ab5e3 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:22.345061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0ba21f48-40d3-48b1-bc89-9a0164e12a1d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:22.355049 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0ba21f48-40d3-48b1-bc89-9a0164e12a1d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1476 microversion: 2.1 time: 0.650172 Oct 24 10:25:22.357805 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 179/333] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:21 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1476 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:22.373866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d2c9d217-040e-4983-abb1-83da7a191acd tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:22.374848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d2c9d217-040e-4983-abb1-83da7a191acd tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:22.383732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2c9d217-040e-4983-abb1-83da7a191acd tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:22.384223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2c9d217-040e-4983-abb1-83da7a191acd tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:22.387395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2c9d217-040e-4983-abb1-83da7a191acd tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:22.388344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2c9d217-040e-4983-abb1-83da7a191acd tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:22.388793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2c9d217-040e-4983-abb1-83da7a191acd tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:22.389250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2c9d217-040e-4983-abb1-83da7a191acd tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:22.651154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d2c9d217-040e-4983-abb1-83da7a191acd tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:22.664408 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d2c9d217-040e-4983-abb1-83da7a191acd tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1268 microversion: 2.1 time: 0.302384 Oct 24 10:25:22.665375 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 180/334] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:22 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1268 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:22.671949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-46bbc211-3664-4e40-90e3-5c85dc98f4a1 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:22.672544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-46bbc211-3664-4e40-90e3-5c85dc98f4a1 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:22.676404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=26,nova_api:UPDATE=14 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:22.683912 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5db54280-fb61-45d9-b956-ef091e3ab5e3 tempest-QuotasAdminTestJSON-1294522281 tempest-QuotasAdminTestJSON-1294522281-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/ebb7903a5f1f42778c989ee406ebf439" status: 200 len: 329 microversion: 2.1 time: 1.248453 Oct 24 10:25:22.687769 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 155/335] 10.222.0.50 () {60 vars in 1263 bytes} [Mon Oct 24 10:25:21 2022] PUT /compute/v2.1/os-quota-sets/ebb7903a5f1f42778c989ee406ebf439 => generated 329 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:22.720857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c29aa18a-16c5-4ed6-97e2-d70e3212ed52 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:22.723099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c29aa18a-16c5-4ed6-97e2-d70e3212ed52 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:22.747563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c29aa18a-16c5-4ed6-97e2-d70e3212ed52 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:22.749232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c29aa18a-16c5-4ed6-97e2-d70e3212ed52 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:22.752201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c29aa18a-16c5-4ed6-97e2-d70e3212ed52 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:22.756195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c29aa18a-16c5-4ed6-97e2-d70e3212ed52 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:22.759829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c29aa18a-16c5-4ed6-97e2-d70e3212ed52 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:22.761032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c29aa18a-16c5-4ed6-97e2-d70e3212ed52 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:22.927967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-46bbc211-3664-4e40-90e3-5c85dc98f4a1 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:22.946015 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-46bbc211-3664-4e40-90e3-5c85dc98f4a1 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 200 len: 1220 microversion: 2.1 time: 0.276213 Oct 24 10:25:22.948588 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 181/336] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:22 2022] GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 1220 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:23.386044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2fb52e36-b337-4182-acd3-3da72c1bcd4f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:23.386929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2fb52e36-b337-4182-acd3-3da72c1bcd4f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:23.402673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fb52e36-b337-4182-acd3-3da72c1bcd4f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:23.407993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fb52e36-b337-4182-acd3-3da72c1bcd4f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:23.409783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fb52e36-b337-4182-acd3-3da72c1bcd4f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:23.410815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fb52e36-b337-4182-acd3-3da72c1bcd4f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:23.427783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fb52e36-b337-4182-acd3-3da72c1bcd4f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:23.431875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fb52e36-b337-4182-acd3-3da72c1bcd4f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:23.795799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c29aa18a-16c5-4ed6-97e2-d70e3212ed52 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:23.808862 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c29aa18a-16c5-4ed6-97e2-d70e3212ed52 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 200 len: 1322 microversion: 2.1 time: 1.104666 Oct 24 10:25:23.809452 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 156/337] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:22 2022] GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 1322 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:23.825785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7f5df4f8-60d9-4d60-969c-0e1c6e0891a0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:23.826394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7f5df4f8-60d9-4d60-969c-0e1c6e0891a0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:23.835859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f5df4f8-60d9-4d60-969c-0e1c6e0891a0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:23.836349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f5df4f8-60d9-4d60-969c-0e1c6e0891a0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:23.836784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f5df4f8-60d9-4d60-969c-0e1c6e0891a0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:23.839834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f5df4f8-60d9-4d60-969c-0e1c6e0891a0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:23.840356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f5df4f8-60d9-4d60-969c-0e1c6e0891a0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:23.840814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f5df4f8-60d9-4d60-969c-0e1c6e0891a0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:24.563788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2fb52e36-b337-4182-acd3-3da72c1bcd4f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:24.574521 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2fb52e36-b337-4182-acd3-3da72c1bcd4f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1476 microversion: 2.1 time: 1.194307 Oct 24 10:25:24.577450 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 182/338] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:23 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1476 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:25:24.594581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dbc91c8d-1d4b-4229-9de3-13ff31abd511 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:24.600919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dbc91c8d-1d4b-4229-9de3-13ff31abd511 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:24.614009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7f5df4f8-60d9-4d60-969c-0e1c6e0891a0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:24.618888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbc91c8d-1d4b-4229-9de3-13ff31abd511 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:24.620689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbc91c8d-1d4b-4229-9de3-13ff31abd511 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:24.624326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbc91c8d-1d4b-4229-9de3-13ff31abd511 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:24.627056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbc91c8d-1d4b-4229-9de3-13ff31abd511 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:24.630352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbc91c8d-1d4b-4229-9de3-13ff31abd511 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:24.631402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbc91c8d-1d4b-4229-9de3-13ff31abd511 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:24.633176 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7f5df4f8-60d9-4d60-969c-0e1c6e0891a0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1310 microversion: 2.1 time: 0.822647 Oct 24 10:25:24.633762 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 157/339] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:23 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1310 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:24.645238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-24f1780d-8dd4-48e3-9487-dfddd10c778e req-0801cc76-f0b8-4e5e-bdd6-d0123d990504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "012048e0-d21f-4bff-8616-81d284df270e", "name": "network-vif-plugged", "status": "completed", "tag": "5902c93d-246e-4e8c-b4f3-5da471a2a551"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:24.658838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-24f1780d-8dd4-48e3-9487-dfddd10c778e req-0801cc76-f0b8-4e5e-bdd6-d0123d990504 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:24.659212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-24f1780d-8dd4-48e3-9487-dfddd10c778e req-0801cc76-f0b8-4e5e-bdd6-d0123d990504 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:24.659639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-24f1780d-8dd4-48e3-9487-dfddd10c778e req-0801cc76-f0b8-4e5e-bdd6-d0123d990504 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:24.680349 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-24f1780d-8dd4-48e3-9487-dfddd10c778e req-0801cc76-f0b8-4e5e-bdd6-d0123d990504 service nova] Creating event network-vif-plugged:5902c93d-246e-4e8c-b4f3-5da471a2a551 for instance 012048e0-d21f-4bff-8616-81d284df270e on n-h1-858383-15 Oct 24 10:25:24.688190 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-24f1780d-8dd4-48e3-9487-dfddd10c778e req-0801cc76-f0b8-4e5e-bdd6-d0123d990504 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053037 Oct 24 10:25:24.689597 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 158/340] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:24.763748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dbc91c8d-1d4b-4229-9de3-13ff31abd511 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:24.776950 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dbc91c8d-1d4b-4229-9de3-13ff31abd511 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 200 len: 1278 microversion: 2.1 time: 0.197601 Oct 24 10:25:24.790911 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 183/341] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:24 2022] GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 1278 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:24.835953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4d1613d9-f88d-431d-b908-4a95e00d6f81 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:24.837545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4d1613d9-f88d-431d-b908-4a95e00d6f81 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:24.854886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d1613d9-f88d-431d-b908-4a95e00d6f81 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:24.855794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d1613d9-f88d-431d-b908-4a95e00d6f81 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:24.856740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d1613d9-f88d-431d-b908-4a95e00d6f81 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:24.857757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d1613d9-f88d-431d-b908-4a95e00d6f81 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:24.859730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d1613d9-f88d-431d-b908-4a95e00d6f81 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:24.860419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d1613d9-f88d-431d-b908-4a95e00d6f81 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:25.154635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b71081d4-e87e-454a-be26-702002a609a4 tempest-FlavorsAccessTestJSON-1367917463 tempest-FlavorsAccessTestJSON-1367917463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-71614802", "id": 1790841374, "os-flavor-access:is_public": "False"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:25.193902 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b71081d4-e87e-454a-be26-702002a609a4 tempest-FlavorsAccessTestJSON-1367917463 tempest-FlavorsAccessTestJSON-1367917463-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.222543 Oct 24 10:25:25.196371 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 184/342] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:25:24 2022] POST /compute/v2.1/flavors => generated 429 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:25:25.209344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0e760fdf-2d36-481c-83a0-0f084e5e8d8e tempest-FlavorsAccessTestJSON-1367917463 tempest-FlavorsAccessTestJSON-1367917463-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "24ae686f9dde48d0b81617514410c32c"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:25.313962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4d1613d9-f88d-431d-b908-4a95e00d6f81 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:25.351903 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4d1613d9-f88d-431d-b908-4a95e00d6f81 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 200 len: 1322 microversion: 2.1 time: 0.517661 Oct 24 10:25:25.352913 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 159/343] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:24 2022] GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:25.394796 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0e760fdf-2d36-481c-83a0-0f084e5e8d8e tempest-FlavorsAccessTestJSON-1367917463 tempest-FlavorsAccessTestJSON-1367917463-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1790841374/action" status: 200 len: 97 microversion: 2.1 time: 0.190866 Oct 24 10:25:25.396639 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 185/344] 10.222.0.50 () {60 vars in 1200 bytes} [Mon Oct 24 10:25:25 2022] POST /compute/v2.1/flavors/1790841374/action => generated 97 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 10:25:25.558729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f35c7f51-e3a8-450f-804b-dcc508abc396 tempest-FlavorsAccessTestJSON-1321297597 tempest-FlavorsAccessTestJSON-1321297597-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:25.601905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b29a7f1c-9964-4e32-9b29-b21e01279d06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:25.602522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b29a7f1c-9964-4e32-9b29-b21e01279d06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:25.610956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b29a7f1c-9964-4e32-9b29-b21e01279d06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:25.614111 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f35c7f51-e3a8-450f-804b-dcc508abc396 tempest-FlavorsAccessTestJSON-1321297597 tempest-FlavorsAccessTestJSON-1321297597-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 6235 microversion: 2.1 time: 0.211494 Oct 24 10:25:25.615281 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 160/345] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:25:25 2022] GET /compute/v2.1/flavors/detail => generated 6235 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:25.626668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b29a7f1c-9964-4e32-9b29-b21e01279d06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:25.627501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b29a7f1c-9964-4e32-9b29-b21e01279d06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:25.629767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b29a7f1c-9964-4e32-9b29-b21e01279d06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:25.632633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b29a7f1c-9964-4e32-9b29-b21e01279d06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:25.637318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b29a7f1c-9964-4e32-9b29-b21e01279d06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:25.643529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dc6e29b4-bd29-4ac3-b273-b0c10baa3d66 tempest-FlavorsAccessTestJSON-1367917463 tempest-FlavorsAccessTestJSON-1367917463-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "24ae686f9dde48d0b81617514410c32c"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:26.075968 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dc6e29b4-bd29-4ac3-b273-b0c10baa3d66 tempest-FlavorsAccessTestJSON-1367917463 tempest-FlavorsAccessTestJSON-1367917463-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1790841374/action" status: 200 len: 21 microversion: 2.1 time: 0.444400 Oct 24 10:25:26.083139 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 161/346] 10.222.0.50 () {60 vars in 1200 bytes} [Mon Oct 24 10:25:25 2022] POST /compute/v2.1/flavors/1790841374/action => generated 21 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:25:26.089194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-acf5cabd-8824-400b-aecf-3dc7da7e4499 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:26.090038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-acf5cabd-8824-400b-aecf-3dc7da7e4499 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:26.111400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acf5cabd-8824-400b-aecf-3dc7da7e4499 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:26.111900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acf5cabd-8824-400b-aecf-3dc7da7e4499 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:26.112450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acf5cabd-8824-400b-aecf-3dc7da7e4499 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:26.113325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acf5cabd-8824-400b-aecf-3dc7da7e4499 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:26.113946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acf5cabd-8824-400b-aecf-3dc7da7e4499 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:26.114464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acf5cabd-8824-400b-aecf-3dc7da7e4499 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:26.122609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:26.202696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b29a7f1c-9964-4e32-9b29-b21e01279d06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:26.213558 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b29a7f1c-9964-4e32-9b29-b21e01279d06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1476 microversion: 2.1 time: 0.615645 Oct 24 10:25:26.214152 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 186/347] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:25 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1476 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:25:26.401342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-8f725d5a-3885-4a47-a202-a9ae83279478 req-a4b004f0-cb93-49a7-aea2-011734d88939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb", "tag": "91ca1e13-d23d-4153-8e07-b972532258b3"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:26.413887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8f725d5a-3885-4a47-a202-a9ae83279478 req-a4b004f0-cb93-49a7-aea2-011734d88939 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:26.414882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8f725d5a-3885-4a47-a202-a9ae83279478 req-a4b004f0-cb93-49a7-aea2-011734d88939 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:26.415453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8f725d5a-3885-4a47-a202-a9ae83279478 req-a4b004f0-cb93-49a7-aea2-011734d88939 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:26.427821 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-8f725d5a-3885-4a47-a202-a9ae83279478 req-a4b004f0-cb93-49a7-aea2-011734d88939 service nova] Creating event network-changed:91ca1e13-d23d-4153-8e07-b972532258b3 for instance 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb on n-h1-858383-15 Oct 24 10:25:26.433599 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-8f725d5a-3885-4a47-a202-a9ae83279478 req-a4b004f0-cb93-49a7-aea2-011734d88939 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207190 Oct 24 10:25:26.436029 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 187/348] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:26.443017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-68b4d02e-cece-45ea-865e-4b2d6c55e31e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:26.444222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-68b4d02e-cece-45ea-865e-4b2d6c55e31e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:26.453352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68b4d02e-cece-45ea-865e-4b2d6c55e31e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:26.454004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68b4d02e-cece-45ea-865e-4b2d6c55e31e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:26.454760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68b4d02e-cece-45ea-865e-4b2d6c55e31e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:26.455614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68b4d02e-cece-45ea-865e-4b2d6c55e31e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:26.456226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68b4d02e-cece-45ea-865e-4b2d6c55e31e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:26.456642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68b4d02e-cece-45ea-865e-4b2d6c55e31e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:26.653888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-68b4d02e-cece-45ea-865e-4b2d6c55e31e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:26.664661 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-68b4d02e-cece-45ea-865e-4b2d6c55e31e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 200 len: 1278 microversion: 2.1 time: 0.227043 Oct 24 10:25:26.665633 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 188/349] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:26 2022] GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 1278 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:26.672562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-487972aa-0a25-4ace-ac49-2ed45c04f6ba tempest-FlavorsAccessTestJSON-1321297597 tempest-FlavorsAccessTestJSON-1321297597-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:26.701125 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-487972aa-0a25-4ace-ac49-2ed45c04f6ba tempest-FlavorsAccessTestJSON-1321297597 tempest-FlavorsAccessTestJSON-1321297597-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.033231 Oct 24 10:25:26.702376 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 189/350] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:25:26 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:26.707898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a8c6394e-d986-4ca6-8b4a-c0668f6aca62 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:26.708942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a8c6394e-d986-4ca6-8b4a-c0668f6aca62 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:26.732076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8c6394e-d986-4ca6-8b4a-c0668f6aca62 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:26.732912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8c6394e-d986-4ca6-8b4a-c0668f6aca62 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:26.733948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8c6394e-d986-4ca6-8b4a-c0668f6aca62 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:26.735292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8c6394e-d986-4ca6-8b4a-c0668f6aca62 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:26.736287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8c6394e-d986-4ca6-8b4a-c0668f6aca62 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:26.738318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8c6394e-d986-4ca6-8b4a-c0668f6aca62 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:26.761310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-acf5cabd-8824-400b-aecf-3dc7da7e4499 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:26.769389 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-acf5cabd-8824-400b-aecf-3dc7da7e4499 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1310 microversion: 2.1 time: 0.684277 Oct 24 10:25:26.785149 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 162/351] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:26 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1310 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:26.802603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c937377a-02bd-4017-9f04-b2d841f7633f tempest-FlavorsAccessTestJSON-1367917463 tempest-FlavorsAccessTestJSON-1367917463-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:26.830923 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c937377a-02bd-4017-9f04-b2d841f7633f tempest-FlavorsAccessTestJSON-1367917463 tempest-FlavorsAccessTestJSON-1367917463-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1790841374" status: 202 len: 0 microversion: 2.1 time: 0.044398 Oct 24 10:25:26.835353 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 163/352] 10.222.0.50 () {58 vars in 1161 bytes} [Mon Oct 24 10:25:26 2022] DELETE /compute/v2.1/flavors/1790841374 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:25:26.841947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5884d544-29fe-44d6-b84e-45784e7a02b9 tempest-FlavorsAccessTestJSON-1367917463 tempest-FlavorsAccessTestJSON-1367917463-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:26.898704 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5884d544-29fe-44d6-b84e-45784e7a02b9 tempest-FlavorsAccessTestJSON-1367917463 tempest-FlavorsAccessTestJSON-1367917463-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.062023 Oct 24 10:25:26.899523 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 164/353] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:25:26 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:26.932322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-02b8e854-c153-4121-9f39-611b8cfa0741 tempest-FlavorsAccessTestJSON-1367917463 tempest-FlavorsAccessTestJSON-1367917463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1601103616", "id": 1096018235, "os-flavor-access:is_public": "False"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:26.969183 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-02b8e854-c153-4121-9f39-611b8cfa0741 tempest-FlavorsAccessTestJSON-1367917463 tempest-FlavorsAccessTestJSON-1367917463-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.046008 Oct 24 10:25:26.972392 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 165/354] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:25:26 2022] POST /compute/v2.1/flavors => generated 431 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:25:26.985144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c010a4d-4278-4f4d-a6bf-6d1b37f0d45e tempest-FlavorsAccessTestJSON-1367917463 tempest-FlavorsAccessTestJSON-1367917463-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:27.011497 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1c010a4d-4278-4f4d-a6bf-6d1b37f0d45e tempest-FlavorsAccessTestJSON-1367917463 tempest-FlavorsAccessTestJSON-1367917463-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1096018235/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.030098 Oct 24 10:25:27.013013 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 166/355] 10.222.0.50 () {58 vars in 1209 bytes} [Mon Oct 24 10:25:26 2022] GET /compute/v2.1/flavors/1096018235/os-flavor-access => generated 21 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:25:27.027142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-21f7f654-507c-4dcf-a092-7242066dcf83 tempest-FlavorsAccessTestJSON-1367917463 tempest-FlavorsAccessTestJSON-1367917463-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:27.061949 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-21f7f654-507c-4dcf-a092-7242066dcf83 tempest-FlavorsAccessTestJSON-1367917463 tempest-FlavorsAccessTestJSON-1367917463-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1096018235" status: 202 len: 0 microversion: 2.1 time: 0.042506 Oct 24 10:25:27.067433 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 167/356] 10.222.0.50 () {58 vars in 1161 bytes} [Mon Oct 24 10:25:27 2022] DELETE /compute/v2.1/flavors/1096018235 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:25:27.086628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1ecb3276-cc88-4f32-b3c7-3da3d00f2d05 tempest-FlavorsAccessTestJSON-1367917463 tempest-FlavorsAccessTestJSON-1367917463-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:27.153298 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1ecb3276-cc88-4f32-b3c7-3da3d00f2d05 tempest-FlavorsAccessTestJSON-1367917463 tempest-FlavorsAccessTestJSON-1367917463-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.079967 Oct 24 10:25:27.162920 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 168/357] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:25:27 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:27.168482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a8c6394e-d986-4ca6-8b4a-c0668f6aca62 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:27.179472 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a8c6394e-d986-4ca6-8b4a-c0668f6aca62 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 200 len: 1322 microversion: 2.1 time: 0.475759 Oct 24 10:25:27.183482 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 190/358] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:26 2022] GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 1322 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:27.241080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-871e861e-e2ad-463a-85fc-374578161291 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:27.242049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-871e861e-e2ad-463a-85fc-374578161291 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:27.257116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-871e861e-e2ad-463a-85fc-374578161291 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:27.258393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-871e861e-e2ad-463a-85fc-374578161291 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:27.259911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-871e861e-e2ad-463a-85fc-374578161291 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:27.261008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-871e861e-e2ad-463a-85fc-374578161291 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:27.263164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-871e861e-e2ad-463a-85fc-374578161291 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:27.263783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-871e861e-e2ad-463a-85fc-374578161291 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:27.644159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-871e861e-e2ad-463a-85fc-374578161291 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:27.658882 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-871e861e-e2ad-463a-85fc-374578161291 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1476 microversion: 2.1 time: 0.422455 Oct 24 10:25:27.659594 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 169/359] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:27 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1476 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:27.688247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1f2283b3-f82c-4fcb-9076-142e902cf6bd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:27.688899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1f2283b3-f82c-4fcb-9076-142e902cf6bd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:27.696757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f2283b3-f82c-4fcb-9076-142e902cf6bd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:27.707526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f2283b3-f82c-4fcb-9076-142e902cf6bd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:27.708822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f2283b3-f82c-4fcb-9076-142e902cf6bd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:27.710046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f2283b3-f82c-4fcb-9076-142e902cf6bd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:27.710821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f2283b3-f82c-4fcb-9076-142e902cf6bd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:27.711421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f2283b3-f82c-4fcb-9076-142e902cf6bd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:27.791743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-95fe363b-07b3-4ca4-a119-8c464c18d71d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:27.792353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-95fe363b-07b3-4ca4-a119-8c464c18d71d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:27.800274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95fe363b-07b3-4ca4-a119-8c464c18d71d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:27.801653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95fe363b-07b3-4ca4-a119-8c464c18d71d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:27.803106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95fe363b-07b3-4ca4-a119-8c464c18d71d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:27.804201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95fe363b-07b3-4ca4-a119-8c464c18d71d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:27.804808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95fe363b-07b3-4ca4-a119-8c464c18d71d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:27.805489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95fe363b-07b3-4ca4-a119-8c464c18d71d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:28.078299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1f2283b3-f82c-4fcb-9076-142e902cf6bd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:28.087960 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1f2283b3-f82c-4fcb-9076-142e902cf6bd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 200 len: 1320 microversion: 2.1 time: 0.403442 Oct 24 10:25:28.091914 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 191/360] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:27 2022] GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 1320 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:28.160009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-95fe363b-07b3-4ca4-a119-8c464c18d71d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:28.177148 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-95fe363b-07b3-4ca4-a119-8c464c18d71d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1310 microversion: 2.1 time: 0.388946 Oct 24 10:25:28.177754 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 170/361] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:27 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1310 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:25:28.211674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8f17a738-27b7-4e7d-9fb4-c15067714fa5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:28.212304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8f17a738-27b7-4e7d-9fb4-c15067714fa5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:28.219055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f17a738-27b7-4e7d-9fb4-c15067714fa5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:28.219549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f17a738-27b7-4e7d-9fb4-c15067714fa5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:28.220167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f17a738-27b7-4e7d-9fb4-c15067714fa5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:28.221083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f17a738-27b7-4e7d-9fb4-c15067714fa5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:28.221551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f17a738-27b7-4e7d-9fb4-c15067714fa5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:28.221981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f17a738-27b7-4e7d-9fb4-c15067714fa5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:28.690618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6d294c69-4830-4a0d-938c-77bb7c7a6707 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:28.692022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6d294c69-4830-4a0d-938c-77bb7c7a6707 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:28.701912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d294c69-4830-4a0d-938c-77bb7c7a6707 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:28.702853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d294c69-4830-4a0d-938c-77bb7c7a6707 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:28.703816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d294c69-4830-4a0d-938c-77bb7c7a6707 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:28.706290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d294c69-4830-4a0d-938c-77bb7c7a6707 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:28.706972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d294c69-4830-4a0d-938c-77bb7c7a6707 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:28.707609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d294c69-4830-4a0d-938c-77bb7c7a6707 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:28.810293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8f17a738-27b7-4e7d-9fb4-c15067714fa5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:28.819444 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8f17a738-27b7-4e7d-9fb4-c15067714fa5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 200 len: 1472 microversion: 2.1 time: 0.616434 Oct 24 10:25:28.820755 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 192/362] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:28 2022] GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 1472 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:29.086431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2853b264-8743-45f7-aa3d-fd84db7b9800 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:29.087269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2853b264-8743-45f7-aa3d-fd84db7b9800 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] [instance: 6faee7ef-d101-4f93-a619-3130593f548b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:29.093218 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-2853b264-8743-45f7-aa3d-fd84db7b9800 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] HTTP exception thrown: Instance 6faee7ef-d101-4f93-a619-3130593f548b could not be found. Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2853b264-8743-45f7-aa3d-fd84db7b9800 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Request method failure captured: Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/6faee7ef-d101-4f93-a619-3130593f548b/action HTTP/1.1 Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 15 Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmf-iJMf-xkxwpA4hOnuDQ3XLjFQx3sh8zCo3hWzHIEPufcBoqDTfnb9tPSpPc3ZzZOwhOn0yEJc4_PddiGqY3Xc1WokrUJzsI2k99QfZAnX49j06Cn2JlfARc02kF81pfNMC06HK-hQyNamDZs2xpM-JgzpIl3KIz3KeB1eCRMG6-8 Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: b486c05e7b1d40bab8433eaea3c54843 Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1104205387 Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:25:29.095143 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:25:29.096651 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b486c05e7b1d40bab8433eaea3c54843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b486c05e7b1d40bab8433eaea3c54843"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b486c05e7b1d40bab8433eaea3c54843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b486c05e7b1d40bab8433eaea3c54843", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:25:29.096651 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1104205387 Oct 24 10:25:29.096651 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: b486c05e7b1d40bab8433eaea3c54843 Oct 24 10:25:29.096651 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1104205387 Oct 24 10:25:29.096651 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersAdminNegativeTestJSON-1104205387-project-admin Oct 24 10:25:29.096651 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:25:29.096651 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:25:29.096651 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 8f00ff0c95884b7b9ff5547c841976a0 Oct 24 10:25:29.096651 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1104205387-project-admin Oct 24 10:25:29.096651 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:25:29.096651 n-d-858383-15 devstack@n-api.service[120426]: {"migrate": {}} Oct 24 10:25:29.096651 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:25:29.096651 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 6faee7ef-d101-4f93-a619-3130593f548b could not be found. Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '6faee7ef-d101-4f93-a619-3130593f548b', 'body': {'migrate': {}}} Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6faee7ef-d101-4f93-a619-3130593f548b could not be found. Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:25:29.098113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:25:29.099689 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:25:29.099689 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:25:29.099689 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 24 10:25:29.099689 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 24 10:25:29.099689 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:25:29.099689 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:25:29.099689 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6faee7ef-d101-4f93-a619-3130593f548b could not be found. Oct 24 10:25:29.099689 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:29.099689 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:29.099689 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:29.099689 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:29.099689 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:29.099689 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:29.099689 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:25:29.099689 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:25:29.099689 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6faee7ef-d101-4f93-a619-3130593f548b could not be found. Oct 24 10:25:29.099689 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:29.100742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2853b264-8743-45f7-aa3d-fd84db7b9800 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Returning 404 to user: Instance 6faee7ef-d101-4f93-a619-3130593f548b could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:25:29.100742 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2853b264-8743-45f7-aa3d-fd84db7b9800 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/6faee7ef-d101-4f93-a619-3130593f548b/action" status: 404 len: 111 microversion: 2.1 time: 0.253520 Oct 24 10:25:29.100742 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 193/363] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:25:28 2022] POST /compute/v2.1/servers/6faee7ef-d101-4f93-a619-3130593f548b/action => generated 111 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:25:29.137843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d25f8b57-38a5-4991-a027-a2d27a8b00fa tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:29.138651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d25f8b57-38a5-4991-a027-a2d27a8b00fa tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:29.148282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d25f8b57-38a5-4991-a027-a2d27a8b00fa tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:29.149322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d25f8b57-38a5-4991-a027-a2d27a8b00fa tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:29.150074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d25f8b57-38a5-4991-a027-a2d27a8b00fa tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:29.150994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d25f8b57-38a5-4991-a027-a2d27a8b00fa tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:29.151648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d25f8b57-38a5-4991-a027-a2d27a8b00fa tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:29.152271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d25f8b57-38a5-4991-a027-a2d27a8b00fa tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:29.196864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6d294c69-4830-4a0d-938c-77bb7c7a6707 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:29.211251 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6d294c69-4830-4a0d-938c-77bb7c7a6707 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1476 microversion: 2.1 time: 0.525814 Oct 24 10:25:29.212152 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 171/364] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:28 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1476 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:25:29.220063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a9e1385b-17bf-4de8-93fc-33c752cdfb5b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:29.221120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a9e1385b-17bf-4de8-93fc-33c752cdfb5b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:29.228687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9e1385b-17bf-4de8-93fc-33c752cdfb5b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:29.229572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9e1385b-17bf-4de8-93fc-33c752cdfb5b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:29.230264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9e1385b-17bf-4de8-93fc-33c752cdfb5b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:29.231907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9e1385b-17bf-4de8-93fc-33c752cdfb5b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:29.233608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9e1385b-17bf-4de8-93fc-33c752cdfb5b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:29.234279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9e1385b-17bf-4de8-93fc-33c752cdfb5b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:29.624490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d25f8b57-38a5-4991-a027-a2d27a8b00fa tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:29.641429 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d25f8b57-38a5-4991-a027-a2d27a8b00fa tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 200 len: 1320 microversion: 2.1 time: 0.508059 Oct 24 10:25:29.643120 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 194/365] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:29 2022] GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 1320 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:29.731283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a9e1385b-17bf-4de8-93fc-33c752cdfb5b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:29.742885 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a9e1385b-17bf-4de8-93fc-33c752cdfb5b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1310 microversion: 2.1 time: 0.529106 Oct 24 10:25:29.743491 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 172/366] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:29 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1310 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:29.819075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-723a8629-22e0-4305-9c72-622f049aa477 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Calling method '.version_select at 0x7f04d141c5e0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:29.869389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c2e0c70a-1e49-4531-8d78-daefceea4def tempest-FloatingIPsNegativeTestJSON-572026776 tempest-FloatingIPsNegativeTestJSON-572026776-project] Calling method '.version_select at 0x7f04d127eb80>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:29.938298 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-723a8629-22e0-4305-9c72-622f049aa477 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507" status: 200 len: 371 microversion: 2.1 time: 0.292743 Oct 24 10:25:29.939536 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 195/367] 10.222.0.50 () {58 vars in 1242 bytes} [Mon Oct 24 10:25:29 2022] GET /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507 => generated 371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:29.951948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aaed74ff-94ac-4bba-9d1a-c83269dd503b tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1964053865", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:30.013387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-aaed74ff-94ac-4bba-9d1a-c83269dd503b tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:25:30.023619 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c2e0c70a-1e49-4531-8d78-daefceea4def tempest-FloatingIPsNegativeTestJSON-572026776 tempest-FloatingIPsNegativeTestJSON-572026776-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.265277 Oct 24 10:25:30.024356 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 173/368] 10.222.0.50 () {58 vars in 1149 bytes} [Mon Oct 24 10:25:29 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:25:30.032433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6d9fc25e-f15c-45ea-a11f-cb160389af32 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Action: 'update', calling method: .version_select at 0x7f04d127e0d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:30.125903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d9fc25e-f15c-45ea-a11f-cb160389af32 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:30.131147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d9fc25e-f15c-45ea-a11f-cb160389af32 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:30.131776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d9fc25e-f15c-45ea-a11f-cb160389af32 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:30.136170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d9fc25e-f15c-45ea-a11f-cb160389af32 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:30.136867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d9fc25e-f15c-45ea-a11f-cb160389af32 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:30.137499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d9fc25e-f15c-45ea-a11f-cb160389af32 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:30.222867 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6d9fc25e-f15c-45ea-a11f-cb160389af32 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507" status: 200 len: 328 microversion: 2.1 time: 0.197469 Oct 24 10:25:30.237729 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 174/369] 10.222.0.50 () {60 vars in 1262 bytes} [Mon Oct 24 10:25:30 2022] PUT /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507 => generated 328 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:30.261693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-81bec937-8f9d-46d2-8e46-72220348dd4b tempest-FloatingIPsNegativeTestJSON-572026776 tempest-FloatingIPsNegativeTestJSON-572026776-project] Action: 'create', calling method: .version_select at 0x7f04d133ce50>, body: {"pool": "non_exist_pool"} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:30.366553 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-81bec937-8f9d-46d2-8e46-72220348dd4b tempest-FloatingIPsNegativeTestJSON-572026776 tempest-FloatingIPsNegativeTestJSON-572026776-project] HTTP exception thrown: Floating IP pool not found. Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-81bec937-8f9d-46d2-8e46-72220348dd4b tempest-FloatingIPsNegativeTestJSON-572026776 tempest-FloatingIPsNegativeTestJSON-572026776-project] Request method failure captured: Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 26 Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmgZSggJK1nwq3U5Wyvc8PU9yribacE8fHj5-HOzicFQb43XGOA25iuPq1si_lyE9fzM3dYd4zSHsGG2EoLbY7UD7Nvch5-Bx6jOdUvaAXLkeakPFVGCAL8rXKnO4IPLW_LD8qwwOxBqvHzgUodqhO0OHUlBfvVg4TyEpFc3sxoOMYw Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 03fd910e40584efbaacfa0f77800cd47 Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-572026776 Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:25:30.372360 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:25:30.373894 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/03fd910e40584efbaacfa0f77800cd47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/03fd910e40584efbaacfa0f77800cd47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/03fd910e40584efbaacfa0f77800cd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_03fd910e40584efbaacfa0f77800cd47", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:25:30.373894 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-572026776 Oct 24 10:25:30.373894 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 03fd910e40584efbaacfa0f77800cd47 Oct 24 10:25:30.373894 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-572026776 Oct 24 10:25:30.373894 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-FloatingIPsNegativeTestJSON-572026776-project Oct 24 10:25:30.373894 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:25:30.373894 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:25:30.373894 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 1f0b36fc10e74721b4646a8e99cacdbb Oct 24 10:25:30.373894 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-572026776-project Oct 24 10:25:30.373894 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:25:30.373894 n-d-858383-15 devstack@n-api.service[120425]: {"pool": "non_exist_pool"} Oct 24 10:25:30.373894 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:25:30.373894 n-d-858383-15 devstack@n-api.service[120425]: exception: Floating IP pool not found. Oct 24 10:25:30.373894 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 24 10:25:30.373894 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:25:30.374927 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:25:30.376278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 24 10:25:30.376278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:25:30.376278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 24 10:25:30.376278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:30.376278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:30.376278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:30.376278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:30.376278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:30.376278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:30.376278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:25:30.376278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:25:30.376278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 24 10:25:30.376278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:30.376278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-81bec937-8f9d-46d2-8e46-72220348dd4b tempest-FloatingIPsNegativeTestJSON-572026776 tempest-FloatingIPsNegativeTestJSON-572026776-project] Returning 404 to user: Floating IP pool not found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:25:30.376278 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-81bec937-8f9d-46d2-8e46-72220348dd4b tempest-FloatingIPsNegativeTestJSON-572026776 tempest-FloatingIPsNegativeTestJSON-572026776-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.127872 Oct 24 10:25:30.377300 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 175/370] 10.222.0.50 () {60 vars in 1170 bytes} [Mon Oct 24 10:25:30 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:25:30.384525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b000d414-9469-4906-b663-42999f80417a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:30.385190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b000d414-9469-4906-b663-42999f80417a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:30.401081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b000d414-9469-4906-b663-42999f80417a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:30.403045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b000d414-9469-4906-b663-42999f80417a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:30.403659 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b000d414-9469-4906-b663-42999f80417a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:30.405239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b000d414-9469-4906-b663-42999f80417a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:30.406794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b000d414-9469-4906-b663-42999f80417a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:30.408192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b000d414-9469-4906-b663-42999f80417a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:31.053085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-aaed74ff-94ac-4bba-9d1a-c83269dd503b tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:25:31.053571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-aaed74ff-94ac-4bba-9d1a-c83269dd503b tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:25:31.053959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-aaed74ff-94ac-4bba-9d1a-c83269dd503b tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:25:31.054361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-aaed74ff-94ac-4bba-9d1a-c83269dd503b tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:25:31.054764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-aaed74ff-94ac-4bba-9d1a-c83269dd503b tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:25:31.063929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aaed74ff-94ac-4bba-9d1a-c83269dd503b tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:31.064415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aaed74ff-94ac-4bba-9d1a-c83269dd503b tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:31.064868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aaed74ff-94ac-4bba-9d1a-c83269dd503b tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:31.065599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aaed74ff-94ac-4bba-9d1a-c83269dd503b tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:31.066049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aaed74ff-94ac-4bba-9d1a-c83269dd503b tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:31.066472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aaed74ff-94ac-4bba-9d1a-c83269dd503b tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:31.079544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b000d414-9469-4906-b663-42999f80417a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:31.094875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-aaed74ff-94ac-4bba-9d1a-c83269dd503b tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Getting quotas for project dabaf79a7d42463ea67fd9b5f7a12951. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:25:31.098702 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b000d414-9469-4906-b663-42999f80417a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1475 microversion: 2.1 time: 0.717333 Oct 24 10:25:31.101297 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 176/371] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:30 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1475 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:31.101525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-aaed74ff-94ac-4bba-9d1a-c83269dd503b tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Getting quotas for user c2ecfd950eeb40409aaaff59f782d1f4 and project dabaf79a7d42463ea67fd9b5f7a12951. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:25:31.113078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2dbcbec3-a4b3-4f4e-ae48-abe9cf7c2b24 tempest-FloatingIPsNegativeTestJSON-572026776 tempest-FloatingIPsNegativeTestJSON-572026776-project] Calling method '.version_select at 0x7f04d12089d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:31.120147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aaed74ff-94ac-4bba-9d1a-c83269dd503b tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:25:31.122490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aaed74ff-94ac-4bba-9d1a-c83269dd503b tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:25:31.196766 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aaed74ff-94ac-4bba-9d1a-c83269dd503b tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.256081 Oct 24 10:25:31.199359 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 196/372] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:25:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:25:31.202293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG neutronclient.v2_0.client [None req-2dbcbec3-a4b3-4f4e-ae48-abe9cf7c2b24 tempest-FloatingIPsNegativeTestJSON-572026776 tempest-FloatingIPsNegativeTestJSON-572026776-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f7d6996c-2de1-493a-8dfc-9e533b67b7cd could not be found", "detail": ""}} {{(pid=120425) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:25:31.203179 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-2dbcbec3-a4b3-4f4e-ae48-abe9cf7c2b24 tempest-FloatingIPsNegativeTestJSON-572026776 tempest-FloatingIPsNegativeTestJSON-572026776-project] HTTP exception thrown: Floating IP not found for ID f7d6996c-2de1-493a-8dfc-9e533b67b7cd Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2dbcbec3-a4b3-4f4e-ae48-abe9cf7c2b24 tempest-FloatingIPsNegativeTestJSON-572026776 tempest-FloatingIPsNegativeTestJSON-572026776-project] Request method failure captured: Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/os-floating-ips/f7d6996c-2de1-493a-8dfc-9e533b67b7cd HTTP/1.1 Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmgZSggJK1nwq3U5Wyvc8PU9yribacE8fHj5-HOzicFQb43XGOA25iuPq1si_lyE9fzM3dYd4zSHsGG2EoLbY7UD7Nvch5-Bx6jOdUvaAXLkeakPFVGCAL8rXKnO4IPLW_LD8qwwOxBqvHzgUodqhO0OHUlBfvVg4TyEpFc3sxoOMYw Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 03fd910e40584efbaacfa0f77800cd47 Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-572026776 Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:25:31.213741 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:25:31.215207 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/03fd910e40584efbaacfa0f77800cd47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/03fd910e40584efbaacfa0f77800cd47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/03fd910e40584efbaacfa0f77800cd47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_03fd910e40584efbaacfa0f77800cd47", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:25:31.215207 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-572026776 Oct 24 10:25:31.215207 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 03fd910e40584efbaacfa0f77800cd47 Oct 24 10:25:31.215207 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-572026776 Oct 24 10:25:31.215207 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-FloatingIPsNegativeTestJSON-572026776-project Oct 24 10:25:31.215207 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:25:31.215207 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:25:31.215207 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 1f0b36fc10e74721b4646a8e99cacdbb Oct 24 10:25:31.215207 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-572026776-project Oct 24 10:25:31.215207 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:25:31.215207 n-d-858383-15 devstack@n-api.service[120425]: exception: Floating IP not found for ID f7d6996c-2de1-493a-8dfc-9e533b67b7cd Oct 24 10:25:31.215207 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'f7d6996c-2de1-493a-8dfc-9e533b67b7cd'} Oct 24 10:25:31.215207 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:25:31.216418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f7d6996c-2de1-493a-8dfc-9e533b67b7cd could not be found Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-428b5478-1fe7-4387-bac1-d51916d993ec'] Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f7d6996c-2de1-493a-8dfc-9e533b67b7cd. Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:31.217705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f7d6996c-2de1-493a-8dfc-9e533b67b7cd Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:25:31.219002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:25:31.220880 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f7d6996c-2de1-493a-8dfc-9e533b67b7cd Oct 24 10:25:31.220880 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:31.223034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2dbcbec3-a4b3-4f4e-ae48-abe9cf7c2b24 tempest-FloatingIPsNegativeTestJSON-572026776 tempest-FloatingIPsNegativeTestJSON-572026776-project] Returning 404 to user: Floating IP not found for ID f7d6996c-2de1-493a-8dfc-9e533b67b7cd {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:25:31.225065 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2dbcbec3-a4b3-4f4e-ae48-abe9cf7c2b24 tempest-FloatingIPsNegativeTestJSON-572026776 tempest-FloatingIPsNegativeTestJSON-572026776-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/f7d6996c-2de1-493a-8dfc-9e533b67b7cd" status: 404 len: 111 microversion: 2.1 time: 0.122249 Oct 24 10:25:31.225966 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 177/373] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:25:31 2022] DELETE /compute/v2.1/os-floating-ips/f7d6996c-2de1-493a-8dfc-9e533b67b7cd => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:25:31.230903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c4282b8-cb0c-482a-a618-be3292e7b05a tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:31.233178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1c4282b8-cb0c-482a-a618-be3292e7b05a tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:31.257271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c4282b8-cb0c-482a-a618-be3292e7b05a tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:31.258041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c4282b8-cb0c-482a-a618-be3292e7b05a tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:31.258776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c4282b8-cb0c-482a-a618-be3292e7b05a tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:31.259992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c4282b8-cb0c-482a-a618-be3292e7b05a tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:31.260744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c4282b8-cb0c-482a-a618-be3292e7b05a tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:31.261377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c4282b8-cb0c-482a-a618-be3292e7b05a tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:31.691078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1c4282b8-cb0c-482a-a618-be3292e7b05a tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:31.702668 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1c4282b8-cb0c-482a-a618-be3292e7b05a tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 200 len: 1320 microversion: 2.1 time: 0.473251 Oct 24 10:25:31.704343 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 178/374] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:31 2022] GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 1320 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:31.712534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3d809adc-b01d-44f9-b2de-fda4629b000d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:31.718233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3d809adc-b01d-44f9-b2de-fda4629b000d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:31.733179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d809adc-b01d-44f9-b2de-fda4629b000d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:31.733932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d809adc-b01d-44f9-b2de-fda4629b000d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:31.734556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d809adc-b01d-44f9-b2de-fda4629b000d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:31.735477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d809adc-b01d-44f9-b2de-fda4629b000d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:31.740562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d809adc-b01d-44f9-b2de-fda4629b000d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:31.741139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d809adc-b01d-44f9-b2de-fda4629b000d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:31.749005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-551820450", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:31.861696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:25:32.378351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3d809adc-b01d-44f9-b2de-fda4629b000d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:32.393332 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3d809adc-b01d-44f9-b2de-fda4629b000d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1310 microversion: 2.1 time: 0.683947 Oct 24 10:25:32.394215 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 179/375] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:31 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1310 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:32.404421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d168a0b9-d174-4d72-b074-7832bf0acf93 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:32.406612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d168a0b9-d174-4d72-b074-7832bf0acf93 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:32.434058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d168a0b9-d174-4d72-b074-7832bf0acf93 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:32.435166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d168a0b9-d174-4d72-b074-7832bf0acf93 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:32.435658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d168a0b9-d174-4d72-b074-7832bf0acf93 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:32.436534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d168a0b9-d174-4d72-b074-7832bf0acf93 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:32.437022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d168a0b9-d174-4d72-b074-7832bf0acf93 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:32.437965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d168a0b9-d174-4d72-b074-7832bf0acf93 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:32.666038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d168a0b9-d174-4d72-b074-7832bf0acf93 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:32.673984 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d168a0b9-d174-4d72-b074-7832bf0acf93 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 200 len: 1274 microversion: 2.1 time: 0.278429 Oct 24 10:25:32.679121 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 180/376] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:32 2022] GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 1274 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:32.684192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-7bbfebf1-88a5-4361-8e95-e4eaaeed31b8 req-6986bcae-e840-4beb-a329-f94b58de4d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b52c962-e95e-465b-a898-0cb4fffe0ba0", "name": "network-vif-unplugged", "status": "completed", "tag": "eb4f598e-dc19-47d1-99f7-93994ac25681"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:32.722215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7bbfebf1-88a5-4361-8e95-e4eaaeed31b8 req-6986bcae-e840-4beb-a329-f94b58de4d3e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:32.722940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7bbfebf1-88a5-4361-8e95-e4eaaeed31b8 req-6986bcae-e840-4beb-a329-f94b58de4d3e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:32.723542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7bbfebf1-88a5-4361-8e95-e4eaaeed31b8 req-6986bcae-e840-4beb-a329-f94b58de4d3e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:32.764267 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-7bbfebf1-88a5-4361-8e95-e4eaaeed31b8 req-6986bcae-e840-4beb-a329-f94b58de4d3e service nova] Creating event network-vif-unplugged:eb4f598e-dc19-47d1-99f7-93994ac25681 for instance 1b52c962-e95e-465b-a898-0cb4fffe0ba0 on n-h1-858383-15 Oct 24 10:25:32.795926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-7bbfebf1-88a5-4361-8e95-e4eaaeed31b8 req-6986bcae-e840-4beb-a329-f94b58de4d3e service nova] Instance 1b52c962-e95e-465b-a898-0cb4fffe0ba0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:25:32.826020 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-7bbfebf1-88a5-4361-8e95-e4eaaeed31b8 req-6986bcae-e840-4beb-a329-f94b58de4d3e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145346 Oct 24 10:25:32.826926 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 181/377] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:32.832055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-951322e1-3899-4d74-81be-8813f1371ef5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:32.833049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-951322e1-3899-4d74-81be-8813f1371ef5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:32.840612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-951322e1-3899-4d74-81be-8813f1371ef5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:32.841127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-951322e1-3899-4d74-81be-8813f1371ef5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:32.841571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-951322e1-3899-4d74-81be-8813f1371ef5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:32.842270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-951322e1-3899-4d74-81be-8813f1371ef5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:32.843058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-951322e1-3899-4d74-81be-8813f1371ef5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:32.843640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-951322e1-3899-4d74-81be-8813f1371ef5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:33.020131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:25:33.021610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:25:33.022177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:25:33.022756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:25:33.023985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:25:33.042185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=57 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:33.046879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:33.047586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:33.050789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:33.051791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:33.061005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:33.061392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:33.117127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Getting quotas for project 97fb1649ad744b80bf1b1f5036db5507. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:25:33.124200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Getting quotas for user 8fcf8449b8304183b18f6bf687a135c0 and project 97fb1649ad744b80bf1b1f5036db5507. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:25:33.165170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.utils [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] cores quota exceeded for 97fb1649ad744b80bf1b1f5036db5507, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120426) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 24 10:25:33.166337 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Request method failure captured: Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 144 Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmgYtuKFSjFBLHFbWM7-J2j8esym7lI8Eeksl168y_8nmAQYn6-0_5cWnJgQ7Z6vLjboILyWvO_oyWRrk0vnYDDGDNKwlBXV1rP3r2UbF12MJm2BPLI8h9nz7427YvAEK6hyvIPQT9fE9eK4Iho9P4chlNI2f86gyCoRXDeErUMy9Sg Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 97fb1649ad744b80bf1b1f5036db5507 Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-QuotasAdminNegativeTest-1334947309 Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:25:33.171873 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:25:33.173415 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/97fb1649ad744b80bf1b1f5036db5507"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/97fb1649ad744b80bf1b1f5036db5507"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/97fb1649ad744b80bf1b1f5036db5507"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_97fb1649ad744b80bf1b1f5036db5507", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:25:33.173415 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-QuotasAdminNegativeTest-1334947309 Oct 24 10:25:33.173415 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 97fb1649ad744b80bf1b1f5036db5507 Oct 24 10:25:33.173415 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1334947309 Oct 24 10:25:33.173415 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-QuotasAdminNegativeTest-1334947309-project Oct 24 10:25:33.173415 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:25:33.173415 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:25:33.173415 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 8fcf8449b8304183b18f6bf687a135c0 Oct 24 10:25:33.173415 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-QuotasAdminNegativeTest-1334947309-project Oct 24 10:25:33.173415 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:25:33.173415 n-d-858383-15 devstack@n-api.service[120426]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-551820450", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} Oct 24 10:25:33.173415 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:25:33.174239 n-d-858383-15 devstack@n-api.service[120426]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 24 10:25:33.174239 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-551820450', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452'}}} Oct 24 10:25:33.174239 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:25:33.174239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:33.174239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 24 10:25:33.174239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 24 10:25:33.174239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:25:33.174239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:25:33.174239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 24 10:25:33.174239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc Oct 24 10:25:33.174239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 24 10:25:33.174239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 24 10:25:33.174239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:25:33.174239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:25:33.174239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 24 10:25:33.174239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 24 10:25:33.174239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 24 10:25:33.174239 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:33.175444 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:33.176823 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:33.180315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:33.180315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:33.180315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:25:33.180315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:25:33.180315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 24 10:25:33.180315 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:33.195565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:25:33.196452 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-95e3cde2-3ecc-494c-8203-f30403684c0b tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.995944 Oct 24 10:25:33.200739 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 197/378] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:25:31 2022] POST /compute/v2.1/servers => generated 111 bytes in 2000 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:25:33.358059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-951322e1-3899-4d74-81be-8813f1371ef5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:33.373188 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-951322e1-3899-4d74-81be-8813f1371ef5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1475 microversion: 2.1 time: 0.540471 Oct 24 10:25:33.374593 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 182/379] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:32 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1475 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:33.391462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-777d936a-62b1-4ea9-acf3-bb7fba1eadc7 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:33.393989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-777d936a-62b1-4ea9-acf3-bb7fba1eadc7 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:33.409709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-777d936a-62b1-4ea9-acf3-bb7fba1eadc7 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:33.410404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-777d936a-62b1-4ea9-acf3-bb7fba1eadc7 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:33.411014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-777d936a-62b1-4ea9-acf3-bb7fba1eadc7 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:33.412175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-777d936a-62b1-4ea9-acf3-bb7fba1eadc7 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:33.412934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-777d936a-62b1-4ea9-acf3-bb7fba1eadc7 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:33.413517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-777d936a-62b1-4ea9-acf3-bb7fba1eadc7 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:33.438001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d8760b59-d6ae-43f5-b44d-f035b7a61df1 tempest-NetworksTest-1864661287 tempest-NetworksTest-1864661287-project-admin] Calling method '.version_select at 0x7f04d1380e50>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:33.819561 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d8760b59-d6ae-43f5-b44d-f035b7a61df1 tempest-NetworksTest-1864661287 tempest-NetworksTest-1864661287-project-admin] 10.222.0.50 "GET /compute/v2.1/os-networks" status: 200 len: 5370 microversion: 2.1 time: 0.616336 Oct 24 10:25:33.820732 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 198/380] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:25:33 2022] GET /compute/v2.1/os-networks => generated 5370 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:33.826954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-777d936a-62b1-4ea9-acf3-bb7fba1eadc7 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:33.829353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0e98591b-79cd-4f80-8ff6-3e4df2a335d5 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Action: 'update', calling method: .version_select at 0x7f04d16af040>, body: {"quota_set": {"cores": 20}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:33.836819 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-777d936a-62b1-4ea9-acf3-bb7fba1eadc7 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 200 len: 1320 microversion: 2.1 time: 0.459817 Oct 24 10:25:33.840066 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 183/381] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:33 2022] GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 1320 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:33.846336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-05675ebf-2856-4e7c-aae2-981333bffe79 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:33.847532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-05675ebf-2856-4e7c-aae2-981333bffe79 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:33.862426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05675ebf-2856-4e7c-aae2-981333bffe79 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:33.863049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05675ebf-2856-4e7c-aae2-981333bffe79 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:33.863552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05675ebf-2856-4e7c-aae2-981333bffe79 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:33.866051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05675ebf-2856-4e7c-aae2-981333bffe79 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:33.866961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05675ebf-2856-4e7c-aae2-981333bffe79 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:33.868928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05675ebf-2856-4e7c-aae2-981333bffe79 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:34.075036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e98591b-79cd-4f80-8ff6-3e4df2a335d5 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:34.075597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e98591b-79cd-4f80-8ff6-3e4df2a335d5 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:34.077946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e98591b-79cd-4f80-8ff6-3e4df2a335d5 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:34.080874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e98591b-79cd-4f80-8ff6-3e4df2a335d5 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:34.081364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e98591b-79cd-4f80-8ff6-3e4df2a335d5 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:34.081803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e98591b-79cd-4f80-8ff6-3e4df2a335d5 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:34.206540 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0e98591b-79cd-4f80-8ff6-3e4df2a335d5 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507" status: 200 len: 329 microversion: 2.1 time: 0.384242 Oct 24 10:25:34.207976 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 199/382] 10.222.0.50 () {60 vars in 1262 bytes} [Mon Oct 24 10:25:33 2022] PUT /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507 => generated 329 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:34.214683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d234f5a2-fd71-48cb-a81a-ca490a40cac6 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:34.216060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d234f5a2-fd71-48cb-a81a-ca490a40cac6 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:34.223753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d234f5a2-fd71-48cb-a81a-ca490a40cac6 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:34.224930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d234f5a2-fd71-48cb-a81a-ca490a40cac6 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:34.225776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d234f5a2-fd71-48cb-a81a-ca490a40cac6 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:34.226732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d234f5a2-fd71-48cb-a81a-ca490a40cac6 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:34.227452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d234f5a2-fd71-48cb-a81a-ca490a40cac6 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:34.228287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d234f5a2-fd71-48cb-a81a-ca490a40cac6 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:34.256201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-05675ebf-2856-4e7c-aae2-981333bffe79 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:34.264552 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-05675ebf-2856-4e7c-aae2-981333bffe79 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1310 microversion: 2.1 time: 0.422177 Oct 24 10:25:34.265182 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 184/383] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:33 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1310 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:34.293739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c719e9b6-e4fb-44a8-b901-c2e70bb9f0d9 tempest-NetworksTest-1864661287 tempest-NetworksTest-1864661287-project-admin] Calling method '.version_select at 0x7f04d120c550>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:34.576827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d234f5a2-fd71-48cb-a81a-ca490a40cac6 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:34.584820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:34.599555 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d234f5a2-fd71-48cb-a81a-ca490a40cac6 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 200 len: 1280 microversion: 2.1 time: 0.389341 Oct 24 10:25:34.601648 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 200/384] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:34 2022] GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 1280 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:34.615287 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c719e9b6-e4fb-44a8-b901-c2e70bb9f0d9 tempest-NetworksTest-1864661287 tempest-NetworksTest-1864661287-project-admin] 10.222.0.50 "GET /compute/v2.1/os-networks/305071bc-8358-45a9-b0bc-51f65747bb90" status: 200 len: 652 microversion: 2.1 time: 0.324708 Oct 24 10:25:34.616202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-da08c283-7991-455b-a0a0-536295e89c2d tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Calling method '.version_select at 0x7f04d15d5790>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:34.616638 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 185/385] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Oct 24 10:25:34 2022] GET /compute/v2.1/os-networks/305071bc-8358-45a9-b0bc-51f65747bb90 => generated 652 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:34.625420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b62399cd-cbd2-49da-a198-3214c207b153 req-9307f2ad-75f1-4707-8fdd-8262fd3730d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb", "name": "network-vif-plugged", "status": "completed", "tag": "91ca1e13-d23d-4153-8e07-b972532258b3"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:34.640606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b62399cd-cbd2-49da-a198-3214c207b153 req-9307f2ad-75f1-4707-8fdd-8262fd3730d2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:34.641584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b62399cd-cbd2-49da-a198-3214c207b153 req-9307f2ad-75f1-4707-8fdd-8262fd3730d2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:34.642267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b62399cd-cbd2-49da-a198-3214c207b153 req-9307f2ad-75f1-4707-8fdd-8262fd3730d2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:34.661040 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b62399cd-cbd2-49da-a198-3214c207b153 req-9307f2ad-75f1-4707-8fdd-8262fd3730d2 service nova] Creating event network-vif-plugged:91ca1e13-d23d-4153-8e07-b972532258b3 for instance 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb on n-h1-858383-15 Oct 24 10:25:34.667728 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b62399cd-cbd2-49da-a198-3214c207b153 req-9307f2ad-75f1-4707-8fdd-8262fd3730d2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049090 Oct 24 10:25:34.668916 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 186/386] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:34.675313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8e4605db-cb95-4d57-8ef3-704c2411bd91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:34.676365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8e4605db-cb95-4d57-8ef3-704c2411bd91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:34.686322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e4605db-cb95-4d57-8ef3-704c2411bd91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:34.687045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e4605db-cb95-4d57-8ef3-704c2411bd91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:34.687642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e4605db-cb95-4d57-8ef3-704c2411bd91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:34.688898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e4605db-cb95-4d57-8ef3-704c2411bd91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:34.689518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e4605db-cb95-4d57-8ef3-704c2411bd91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:34.690101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e4605db-cb95-4d57-8ef3-704c2411bd91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:34.794233 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-da08c283-7991-455b-a0a0-536295e89c2d tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507" status: 200 len: 371 microversion: 2.1 time: 0.191058 Oct 24 10:25:34.795406 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 201/387] 10.222.0.50 () {58 vars in 1242 bytes} [Mon Oct 24 10:25:34 2022] GET /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507 => generated 371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:34.800233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0bc3652c-c6ec-42be-b585-b1a3f623dafb tempest-NetworksTest-1864661287 tempest-NetworksTest-1864661287-project-admin] Calling method '.version_select at 0x7f04d134d5e0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:35.000125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8e4605db-cb95-4d57-8ef3-704c2411bd91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:35.021920 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8e4605db-cb95-4d57-8ef3-704c2411bd91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1475 microversion: 2.1 time: 0.350222 Oct 24 10:25:35.023024 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 187/388] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:34 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1475 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:35.028675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-056c0737-cbfc-4b46-a922-0802067bd30c tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Action: 'update', calling method: .version_select at 0x7f04d11d0430>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:35.056130 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0bc3652c-c6ec-42be-b585-b1a3f623dafb tempest-NetworksTest-1864661287 tempest-NetworksTest-1864661287-project-admin] 10.222.0.50 "GET /compute/v2.1/os-networks" status: 200 len: 5370 microversion: 2.1 time: 0.259520 Oct 24 10:25:35.056699 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 202/389] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:25:34 2022] GET /compute/v2.1/os-networks => generated 5370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:35.061412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e8ad0e52-28e3-453e-81b6-4bc9af8f9533 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:35.062313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e8ad0e52-28e3-453e-81b6-4bc9af8f9533 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:35.065224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:35.074329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8ad0e52-28e3-453e-81b6-4bc9af8f9533 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:35.075034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8ad0e52-28e3-453e-81b6-4bc9af8f9533 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:35.076205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8ad0e52-28e3-453e-81b6-4bc9af8f9533 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:35.077666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8ad0e52-28e3-453e-81b6-4bc9af8f9533 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:35.078272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8ad0e52-28e3-453e-81b6-4bc9af8f9533 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:35.078842 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8ad0e52-28e3-453e-81b6-4bc9af8f9533 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:35.120334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=89 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:35.125775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-056c0737-cbfc-4b46-a922-0802067bd30c tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:35.128422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-056c0737-cbfc-4b46-a922-0802067bd30c tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:35.128945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-056c0737-cbfc-4b46-a922-0802067bd30c tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:35.129706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-056c0737-cbfc-4b46-a922-0802067bd30c tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:35.133830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-056c0737-cbfc-4b46-a922-0802067bd30c tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:35.134538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-056c0737-cbfc-4b46-a922-0802067bd30c tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:35.152051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=27 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:35.206154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=7,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:35.210500 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-056c0737-cbfc-4b46-a922-0802067bd30c tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507" status: 200 len: 328 microversion: 2.1 time: 0.186190 Oct 24 10:25:35.217355 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 188/390] 10.222.0.50 () {60 vars in 1262 bytes} [Mon Oct 24 10:25:35 2022] PUT /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507 => generated 328 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:35.238882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-9007ad19-5025-4c52-8716-3e392d7605dc req-a9ca8fba-da25-48a6-a3e4-1e25f27f1639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2942efdb-333c-47f7-8f37-3487f6228236", "tag": "dc89dfa6-4a12-46e1-b75a-cc3060ebb6b5"}, {"name": "network-changed", "server_uuid": "1b52c962-e95e-465b-a898-0cb4fffe0ba0", "tag": "eb4f598e-dc19-47d1-99f7-93994ac25681"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:35.278204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9007ad19-5025-4c52-8716-3e392d7605dc req-a9ca8fba-da25-48a6-a3e4-1e25f27f1639 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:35.279267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9007ad19-5025-4c52-8716-3e392d7605dc req-a9ca8fba-da25-48a6-a3e4-1e25f27f1639 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:35.279712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9007ad19-5025-4c52-8716-3e392d7605dc req-a9ca8fba-da25-48a6-a3e4-1e25f27f1639 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:35.308518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e8ad0e52-28e3-453e-81b6-4bc9af8f9533 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:35.322490 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e8ad0e52-28e3-453e-81b6-4bc9af8f9533 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 200 len: 1320 microversion: 2.1 time: 0.264406 Oct 24 10:25:35.323844 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 203/391] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:35 2022] GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 1320 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:35.335881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a66535a4-dd14-4f3d-b6b4-a9bf482197f0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:35.336488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a66535a4-dd14-4f3d-b6b4-a9bf482197f0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:35.357465 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-9007ad19-5025-4c52-8716-3e392d7605dc req-a9ca8fba-da25-48a6-a3e4-1e25f27f1639 service nova] Creating event network-changed:dc89dfa6-4a12-46e1-b75a-cc3060ebb6b5 for instance 2942efdb-333c-47f7-8f37-3487f6228236 on n-h2-858383-15 Oct 24 10:25:35.359177 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-9007ad19-5025-4c52-8716-3e392d7605dc req-a9ca8fba-da25-48a6-a3e4-1e25f27f1639 service nova] Creating event network-changed:eb4f598e-dc19-47d1-99f7-93994ac25681 for instance 1b52c962-e95e-465b-a898-0cb4fffe0ba0 on n-h1-858383-15 Oct 24 10:25:35.364194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a66535a4-dd14-4f3d-b6b4-a9bf482197f0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:35.365631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a66535a4-dd14-4f3d-b6b4-a9bf482197f0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:35.366275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a66535a4-dd14-4f3d-b6b4-a9bf482197f0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:35.369495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a66535a4-dd14-4f3d-b6b4-a9bf482197f0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:35.373646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a66535a4-dd14-4f3d-b6b4-a9bf482197f0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:35.374293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a66535a4-dd14-4f3d-b6b4-a9bf482197f0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:35.379841 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-9007ad19-5025-4c52-8716-3e392d7605dc req-a9ca8fba-da25-48a6-a3e4-1e25f27f1639 service nova] Instance 1b52c962-e95e-465b-a898-0cb4fffe0ba0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:25:35.420650 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-9007ad19-5025-4c52-8716-3e392d7605dc req-a9ca8fba-da25-48a6-a3e4-1e25f27f1639 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.201123 Oct 24 10:25:35.421813 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 189/392] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:35.427976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-690123277", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:35.509117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] validate_networks() for None {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:25:36.049252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a66535a4-dd14-4f3d-b6b4-a9bf482197f0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:36.058431 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a66535a4-dd14-4f3d-b6b4-a9bf482197f0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1310 microversion: 2.1 time: 0.733549 Oct 24 10:25:36.059179 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 204/393] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:35 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1310 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:36.064104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-402487dc-5302-4e6d-80de-d6a223991c67 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:36.065003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-402487dc-5302-4e6d-80de-d6a223991c67 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:36.072231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-402487dc-5302-4e6d-80de-d6a223991c67 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:36.073054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-402487dc-5302-4e6d-80de-d6a223991c67 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:36.073982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-402487dc-5302-4e6d-80de-d6a223991c67 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:36.074918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-402487dc-5302-4e6d-80de-d6a223991c67 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:36.075585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-402487dc-5302-4e6d-80de-d6a223991c67 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:36.076239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-402487dc-5302-4e6d-80de-d6a223991c67 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:36.327781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:25:36.329025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:25:36.329811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:25:36.330362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:25:36.331027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:25:36.341693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:36.342346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:36.342954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:36.343817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:36.344414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:36.345016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:36.368250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Getting quotas for project 97fb1649ad744b80bf1b1f5036db5507. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:25:36.373383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Getting quotas for user 8fcf8449b8304183b18f6bf687a135c0 and project 97fb1649ad744b80bf1b1f5036db5507. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:25:36.388999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.utils [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] instances quota exceeded for 97fb1649ad744b80bf1b1f5036db5507, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120425) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 24 10:25:36.390007 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Request method failure captured: Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 144 Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmgYtuKFSjFBLHFbWM7-J2j8esym7lI8Eeksl168y_8nmAQYn6-0_5cWnJgQ7Z6vLjboILyWvO_oyWRrk0vnYDDGDNKwlBXV1rP3r2UbF12MJm2BPLI8h9nz7427YvAEK6hyvIPQT9fE9eK4Iho9P4chlNI2f86gyCoRXDeErUMy9Sg Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 97fb1649ad744b80bf1b1f5036db5507 Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-QuotasAdminNegativeTest-1334947309 Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:25:36.395010 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:25:36.397096 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/97fb1649ad744b80bf1b1f5036db5507"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/97fb1649ad744b80bf1b1f5036db5507"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/97fb1649ad744b80bf1b1f5036db5507"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_97fb1649ad744b80bf1b1f5036db5507", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:25:36.397096 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-QuotasAdminNegativeTest-1334947309 Oct 24 10:25:36.397096 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 97fb1649ad744b80bf1b1f5036db5507 Oct 24 10:25:36.397096 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1334947309 Oct 24 10:25:36.397096 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-QuotasAdminNegativeTest-1334947309-project Oct 24 10:25:36.397096 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:25:36.397096 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:25:36.397096 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 8fcf8449b8304183b18f6bf687a135c0 Oct 24 10:25:36.397096 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-QuotasAdminNegativeTest-1334947309-project Oct 24 10:25:36.397096 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:25:36.397096 n-d-858383-15 devstack@n-api.service[120425]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-690123277", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} Oct 24 10:25:36.397096 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:25:36.397896 n-d-858383-15 devstack@n-api.service[120425]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 24 10:25:36.397896 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-690123277', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452'}}} Oct 24 10:25:36.397896 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:25:36.397896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:36.397896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 24 10:25:36.397896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 24 10:25:36.397896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:25:36.397896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:25:36.397896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 24 10:25:36.397896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc Oct 24 10:25:36.397896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 24 10:25:36.397896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 24 10:25:36.397896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:25:36.397896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:25:36.397896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 24 10:25:36.397896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 24 10:25:36.397896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 24 10:25:36.397896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:36.399051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:36.400382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:36.402146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:36.402146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:36.402146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:25:36.402146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:25:36.402146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 24 10:25:36.402146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:25:36.403503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:25:36.404629 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a769cd89-de50-4c8d-b84c-93708952d21c tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.981729 Oct 24 10:25:36.406064 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 190/394] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:25:35 2022] POST /compute/v2.1/servers => generated 119 bytes in 984 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:25:36.427862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e2ccfd08-85a3-44d6-a160-ee95770bfe18 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:36.428618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e2ccfd08-85a3-44d6-a160-ee95770bfe18 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:36.449329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2ccfd08-85a3-44d6-a160-ee95770bfe18 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:36.449818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2ccfd08-85a3-44d6-a160-ee95770bfe18 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:36.455737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2ccfd08-85a3-44d6-a160-ee95770bfe18 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:36.456898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2ccfd08-85a3-44d6-a160-ee95770bfe18 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:36.457537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2ccfd08-85a3-44d6-a160-ee95770bfe18 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:36.458896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2ccfd08-85a3-44d6-a160-ee95770bfe18 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:36.564034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-402487dc-5302-4e6d-80de-d6a223991c67 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:36.579829 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-402487dc-5302-4e6d-80de-d6a223991c67 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 200 len: 1322 microversion: 2.1 time: 0.519360 Oct 24 10:25:36.587389 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 205/395] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:36 2022] GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 1322 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:36.607160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b2c3e7f3-b886-4ffe-8cbb-68394be75995 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:36.608154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b2c3e7f3-b886-4ffe-8cbb-68394be75995 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:36.633306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2c3e7f3-b886-4ffe-8cbb-68394be75995 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:36.634656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2c3e7f3-b886-4ffe-8cbb-68394be75995 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:36.635385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2c3e7f3-b886-4ffe-8cbb-68394be75995 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:36.636342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2c3e7f3-b886-4ffe-8cbb-68394be75995 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:36.636985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2c3e7f3-b886-4ffe-8cbb-68394be75995 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:36.637544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2c3e7f3-b886-4ffe-8cbb-68394be75995 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:36.801492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e2ccfd08-85a3-44d6-a160-ee95770bfe18 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:36.817745 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e2ccfd08-85a3-44d6-a160-ee95770bfe18 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1473 microversion: 2.1 time: 0.410344 Oct 24 10:25:36.832939 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 191/396] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:36 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1473 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:36.832939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0bef99b8-0fbc-4272-90c2-0834cc3e7d26 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Action: 'update', calling method: .version_select at 0x7f04d1208d30>, body: {"quota_set": {"instances": 10}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:37.037910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b2c3e7f3-b886-4ffe-8cbb-68394be75995 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:37.054834 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b2c3e7f3-b886-4ffe-8cbb-68394be75995 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 200 len: 1320 microversion: 2.1 time: 0.465904 Oct 24 10:25:37.057216 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 206/397] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:36 2022] GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 1320 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:37.084025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8258d617-9f47-4673-bee6-bac94dae845d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:37.084674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8258d617-9f47-4673-bee6-bac94dae845d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:37.098861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8258d617-9f47-4673-bee6-bac94dae845d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:37.100613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8258d617-9f47-4673-bee6-bac94dae845d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:37.101100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8258d617-9f47-4673-bee6-bac94dae845d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:37.101830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8258d617-9f47-4673-bee6-bac94dae845d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:37.102292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8258d617-9f47-4673-bee6-bac94dae845d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:37.103811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8258d617-9f47-4673-bee6-bac94dae845d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:37.202236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bef99b8-0fbc-4272-90c2-0834cc3e7d26 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:37.204826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bef99b8-0fbc-4272-90c2-0834cc3e7d26 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:37.205339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bef99b8-0fbc-4272-90c2-0834cc3e7d26 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:37.207581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bef99b8-0fbc-4272-90c2-0834cc3e7d26 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:37.208057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bef99b8-0fbc-4272-90c2-0834cc3e7d26 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:37.210241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bef99b8-0fbc-4272-90c2-0834cc3e7d26 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:37.223545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:37.293573 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0bef99b8-0fbc-4272-90c2-0834cc3e7d26 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507" status: 200 len: 329 microversion: 2.1 time: 0.473704 Oct 24 10:25:37.294153 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 192/398] 10.222.0.50 () {60 vars in 1262 bytes} [Mon Oct 24 10:25:36 2022] PUT /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507 => generated 329 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:37.308311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dcfe1490-9ce6-4f5b-bcfa-f8211f3702c1 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Calling method '.version_select at 0x7f04d1208430>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:37.382388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8258d617-9f47-4673-bee6-bac94dae845d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:37.393333 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8258d617-9f47-4673-bee6-bac94dae845d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1310 microversion: 2.1 time: 0.313458 Oct 24 10:25:37.414263 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 207/399] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:37 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1310 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:37.612854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5e7be3b1-0fda-4e78-8193-008d8721417d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:37.613836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5e7be3b1-0fda-4e78-8193-008d8721417d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:37.624215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e7be3b1-0fda-4e78-8193-008d8721417d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:37.625038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e7be3b1-0fda-4e78-8193-008d8721417d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:37.626347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e7be3b1-0fda-4e78-8193-008d8721417d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:37.627048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e7be3b1-0fda-4e78-8193-008d8721417d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:37.627904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e7be3b1-0fda-4e78-8193-008d8721417d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:37.628414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e7be3b1-0fda-4e78-8193-008d8721417d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:37.650737 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dcfe1490-9ce6-4f5b-bcfa-f8211f3702c1 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507" status: 200 len: 371 microversion: 2.1 time: 0.347763 Oct 24 10:25:37.652050 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 193/400] 10.222.0.50 () {58 vars in 1242 bytes} [Mon Oct 24 10:25:37 2022] GET /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507 => generated 371 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:37.669680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c92d41dc-44e8-4fe6-94c4-86f4ccd98539 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Action: 'update', calling method: .version_select at 0x7f04d12a8ca0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:37.922979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c92d41dc-44e8-4fe6-94c4-86f4ccd98539 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:37.924400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c92d41dc-44e8-4fe6-94c4-86f4ccd98539 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:37.924983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c92d41dc-44e8-4fe6-94c4-86f4ccd98539 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:37.926111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c92d41dc-44e8-4fe6-94c4-86f4ccd98539 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:37.926581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c92d41dc-44e8-4fe6-94c4-86f4ccd98539 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:37.927102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c92d41dc-44e8-4fe6-94c4-86f4ccd98539 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:37.959706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5e7be3b1-0fda-4e78-8193-008d8721417d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:37.972626 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5e7be3b1-0fda-4e78-8193-008d8721417d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 200 len: 1322 microversion: 2.1 time: 0.364635 Oct 24 10:25:37.973558 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 208/401] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:37 2022] GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:25:37.983977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6badd15f-a85c-44f3-a7a7-dfc63919a9ca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:37.987602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6badd15f-a85c-44f3-a7a7-dfc63919a9ca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:38.006117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6badd15f-a85c-44f3-a7a7-dfc63919a9ca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:38.007295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6badd15f-a85c-44f3-a7a7-dfc63919a9ca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:38.007945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6badd15f-a85c-44f3-a7a7-dfc63919a9ca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:38.008936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6badd15f-a85c-44f3-a7a7-dfc63919a9ca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:38.009621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6badd15f-a85c-44f3-a7a7-dfc63919a9ca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:38.010253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6badd15f-a85c-44f3-a7a7-dfc63919a9ca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:38.090269 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c92d41dc-44e8-4fe6-94c4-86f4ccd98539 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507" status: 200 len: 325 microversion: 2.1 time: 0.424891 Oct 24 10:25:38.103281 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 194/402] 10.222.0.50 () {60 vars in 1262 bytes} [Mon Oct 24 10:25:37 2022] PUT /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507 => generated 325 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:38.118973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-305f7393-12ad-46a4-aeed-f02e774d97f5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:38.122044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-305f7393-12ad-46a4-aeed-f02e774d97f5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:38.133771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-305f7393-12ad-46a4-aeed-f02e774d97f5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:38.134660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-305f7393-12ad-46a4-aeed-f02e774d97f5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:38.134793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-305f7393-12ad-46a4-aeed-f02e774d97f5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:38.135527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-305f7393-12ad-46a4-aeed-f02e774d97f5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:38.140170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-305f7393-12ad-46a4-aeed-f02e774d97f5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:38.140647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-305f7393-12ad-46a4-aeed-f02e774d97f5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:38.437216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6badd15f-a85c-44f3-a7a7-dfc63919a9ca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:38.446598 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6badd15f-a85c-44f3-a7a7-dfc63919a9ca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1473 microversion: 2.1 time: 0.471332 Oct 24 10:25:38.446829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-305f7393-12ad-46a4-aeed-f02e774d97f5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:38.447198 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 209/403] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:37 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1473 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:38.453976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1143303801", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:38.470985 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-305f7393-12ad-46a4-aeed-f02e774d97f5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 200 len: 1320 microversion: 2.1 time: 0.372353 Oct 24 10:25:38.473381 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 195/404] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:38 2022] GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 1320 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:38.479336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9afc1a14-7eb1-42f8-8e3e-e02086abfca7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:38.480153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9afc1a14-7eb1-42f8-8e3e-e02086abfca7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:38.490684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9afc1a14-7eb1-42f8-8e3e-e02086abfca7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:38.491283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9afc1a14-7eb1-42f8-8e3e-e02086abfca7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:38.500998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9afc1a14-7eb1-42f8-8e3e-e02086abfca7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:38.502489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9afc1a14-7eb1-42f8-8e3e-e02086abfca7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:38.503495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9afc1a14-7eb1-42f8-8e3e-e02086abfca7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:38.504580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9afc1a14-7eb1-42f8-8e3e-e02086abfca7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:38.563805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:25:39.041491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:25:39.041905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:25:39.043330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:25:39.043967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:25:39.044593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:25:39.073789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:39.075033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:39.076663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:39.079201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:39.079783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:39.081193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:39.134107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9afc1a14-7eb1-42f8-8e3e-e02086abfca7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:39.146920 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9afc1a14-7eb1-42f8-8e3e-e02086abfca7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1310 microversion: 2.1 time: 0.670621 Oct 24 10:25:39.147648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Getting quotas for project 97fb1649ad744b80bf1b1f5036db5507. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:25:39.149968 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 196/405] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:38 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1310 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:39.156514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Getting quotas for user 8fcf8449b8304183b18f6bf687a135c0 and project 97fb1649ad744b80bf1b1f5036db5507. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:25:39.163255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-40c9b903-5f6d-44c5-975b-fce09b07cf50 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:39.164103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-40c9b903-5f6d-44c5-975b-fce09b07cf50 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:39.181390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40c9b903-5f6d-44c5-975b-fce09b07cf50 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:39.182174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40c9b903-5f6d-44c5-975b-fce09b07cf50 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:39.183639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40c9b903-5f6d-44c5-975b-fce09b07cf50 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:39.189152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.utils [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] ram quota exceeded for 97fb1649ad744b80bf1b1f5036db5507, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120426) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 24 10:25:39.189560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40c9b903-5f6d-44c5-975b-fce09b07cf50 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:39.190411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40c9b903-5f6d-44c5-975b-fce09b07cf50 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:39.191607 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 24 10:25:39.191861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40c9b903-5f6d-44c5-975b-fce09b07cf50 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Request method failure captured: Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 145 Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmgYtuKFSjFBLHFbWM7-J2j8esym7lI8Eeksl168y_8nmAQYn6-0_5cWnJgQ7Z6vLjboILyWvO_oyWRrk0vnYDDGDNKwlBXV1rP3r2UbF12MJm2BPLI8h9nz7427YvAEK6hyvIPQT9fE9eK4Iho9P4chlNI2f86gyCoRXDeErUMy9Sg Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 97fb1649ad744b80bf1b1f5036db5507 Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-QuotasAdminNegativeTest-1334947309 Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:25:39.198478 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:25:39.199899 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/97fb1649ad744b80bf1b1f5036db5507"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/97fb1649ad744b80bf1b1f5036db5507"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/97fb1649ad744b80bf1b1f5036db5507"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_97fb1649ad744b80bf1b1f5036db5507", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:25:39.199899 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-QuotasAdminNegativeTest-1334947309 Oct 24 10:25:39.199899 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 97fb1649ad744b80bf1b1f5036db5507 Oct 24 10:25:39.199899 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1334947309 Oct 24 10:25:39.199899 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-QuotasAdminNegativeTest-1334947309-project Oct 24 10:25:39.199899 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:25:39.199899 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:25:39.199899 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 8fcf8449b8304183b18f6bf687a135c0 Oct 24 10:25:39.199899 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-QuotasAdminNegativeTest-1334947309-project Oct 24 10:25:39.199899 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:25:39.199899 n-d-858383-15 devstack@n-api.service[120426]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1143303801", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} Oct 24 10:25:39.199899 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:25:39.200584 n-d-858383-15 devstack@n-api.service[120426]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 24 10:25:39.200584 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1143303801', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452'}}} Oct 24 10:25:39.200584 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:25:39.200584 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:39.200584 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 24 10:25:39.200584 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 24 10:25:39.200584 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:25:39.200584 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:25:39.200584 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 24 10:25:39.200584 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc Oct 24 10:25:39.200584 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 24 10:25:39.200584 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 24 10:25:39.200584 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:25:39.200584 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:25:39.200584 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 24 10:25:39.200584 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 24 10:25:39.200584 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 24 10:25:39.200584 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:39.201657 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:39.202893 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:39.204075 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:39.204075 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:39.204075 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:25:39.204075 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:25:39.204075 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 24 10:25:39.204075 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:39.204075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:25:39.205990 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-95129764-aef4-4fe4-9e06-9dc8d98d229d tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.756803 Oct 24 10:25:39.206809 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 210/406] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:25:38 2022] POST /compute/v2.1/servers => generated 110 bytes in 759 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:25:39.217216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-72453cd8-ef66-4c98-a0cb-b26cd65bf413 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Action: 'update', calling method: .version_select at 0x7f04d13800d0>, body: {"quota_set": {"ram": 51200}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:39.421448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-40c9b903-5f6d-44c5-975b-fce09b07cf50 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:39.434775 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-40c9b903-5f6d-44c5-975b-fce09b07cf50 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 200 len: 1322 microversion: 2.1 time: 0.283584 Oct 24 10:25:39.436158 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 197/407] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:39 2022] GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:39.473671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0519a988-63cb-4c72-96db-02403a7aa722 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:39.475076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0519a988-63cb-4c72-96db-02403a7aa722 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:39.483060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0519a988-63cb-4c72-96db-02403a7aa722 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:39.485463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0519a988-63cb-4c72-96db-02403a7aa722 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:39.486029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0519a988-63cb-4c72-96db-02403a7aa722 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:39.486989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0519a988-63cb-4c72-96db-02403a7aa722 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:39.487682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0519a988-63cb-4c72-96db-02403a7aa722 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:39.488401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0519a988-63cb-4c72-96db-02403a7aa722 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:39.664190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0519a988-63cb-4c72-96db-02403a7aa722 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:39.677063 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0519a988-63cb-4c72-96db-02403a7aa722 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1470 microversion: 2.1 time: 0.207017 Oct 24 10:25:39.677805 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 198/408] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:39 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:39.683256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f15d88db-749c-470b-b433-6a8e34c8cd65 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:39.684027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f15d88db-749c-470b-b433-6a8e34c8cd65 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:39.690039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f15d88db-749c-470b-b433-6a8e34c8cd65 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:39.690708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f15d88db-749c-470b-b433-6a8e34c8cd65 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:39.691322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f15d88db-749c-470b-b433-6a8e34c8cd65 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:39.692163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f15d88db-749c-470b-b433-6a8e34c8cd65 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:39.693443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f15d88db-749c-470b-b433-6a8e34c8cd65 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:39.694183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f15d88db-749c-470b-b433-6a8e34c8cd65 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:39.719386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72453cd8-ef66-4c98-a0cb-b26cd65bf413 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:39.719947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72453cd8-ef66-4c98-a0cb-b26cd65bf413 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:39.720516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72453cd8-ef66-4c98-a0cb-b26cd65bf413 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:39.721486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72453cd8-ef66-4c98-a0cb-b26cd65bf413 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:39.722091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72453cd8-ef66-4c98-a0cb-b26cd65bf413 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:39.722857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72453cd8-ef66-4c98-a0cb-b26cd65bf413 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:39.821197 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-72453cd8-ef66-4c98-a0cb-b26cd65bf413 tempest-QuotasAdminNegativeTest-37523827 tempest-QuotasAdminNegativeTest-37523827-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507" status: 200 len: 329 microversion: 2.1 time: 0.607042 Oct 24 10:25:39.823458 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 211/409] 10.222.0.50 () {60 vars in 1262 bytes} [Mon Oct 24 10:25:39 2022] PUT /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507 => generated 329 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:25:39.839703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-3eaba7f8-45a2-44b5-8531-27a6b6c639a0 req-523b419a-bd16-4d4d-9df7-1025caf6c988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78163a08-193b-424a-b63c-28148c3aa4d6", "tag": "521590e6-41d5-4de2-80cb-62ebdd4d5ab8"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:39.859447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f15d88db-749c-470b-b433-6a8e34c8cd65 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:39.871813 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f15d88db-749c-470b-b433-6a8e34c8cd65 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 200 len: 1320 microversion: 2.1 time: 0.192379 Oct 24 10:25:39.875260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3eaba7f8-45a2-44b5-8531-27a6b6c639a0 req-523b419a-bd16-4d4d-9df7-1025caf6c988 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:39.875968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3eaba7f8-45a2-44b5-8531-27a6b6c639a0 req-523b419a-bd16-4d4d-9df7-1025caf6c988 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:39.876564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3eaba7f8-45a2-44b5-8531-27a6b6c639a0 req-523b419a-bd16-4d4d-9df7-1025caf6c988 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:39.881517 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 199/410] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:39 2022] GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 1320 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:39.898106 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-3eaba7f8-45a2-44b5-8531-27a6b6c639a0 req-523b419a-bd16-4d4d-9df7-1025caf6c988 service nova] Creating event network-changed:521590e6-41d5-4de2-80cb-62ebdd4d5ab8 for instance 78163a08-193b-424a-b63c-28148c3aa4d6 on n-h1-858383-15 Oct 24 10:25:39.900104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9e3b9af-2fb9-4fce-8742-271bd887d9fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:39.902433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f9e3b9af-2fb9-4fce-8742-271bd887d9fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:39.904943 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-3eaba7f8-45a2-44b5-8531-27a6b6c639a0 req-523b419a-bd16-4d4d-9df7-1025caf6c988 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078485 Oct 24 10:25:39.908950 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 212/411] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:39.915421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cdd847ec-5872-4e02-9275-bdf9946dcac8 tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Action: 'update', calling method: .version_select at 0x7f04d13dd9d0>, body: {"quota_set": {"ram": 0}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:39.921144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9e3b9af-2fb9-4fce-8742-271bd887d9fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:39.921481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cdd847ec-5872-4e02-9275-bdf9946dcac8 tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '8fcf8449b8304183b18f6bf687a135c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fb1649ad744b80bf1b1f5036db5507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:39.921892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9e3b9af-2fb9-4fce-8742-271bd887d9fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:39.923681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9e3b9af-2fb9-4fce-8742-271bd887d9fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cdd847ec-5872-4e02-9275-bdf9946dcac8 tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Request method failure captured: Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: request: PUT /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507 HTTP/1.1 Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 25 Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmgYtuKFSjFBLHFbWM7-J2j8esym7lI8Eeksl168y_8nmAQYn6-0_5cWnJgQ7Z6vLjboILyWvO_oyWRrk0vnYDDGDNKwlBXV1rP3r2UbF12MJm2BPLI8h9nz7427YvAEK6hyvIPQT9fE9eK4Iho9P4chlNI2f86gyCoRXDeErUMy9Sg Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 97fb1649ad744b80bf1b1f5036db5507 Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-QuotasAdminNegativeTest-1334947309 Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:25:39.924142 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:25:39.925675 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/97fb1649ad744b80bf1b1f5036db5507"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/97fb1649ad744b80bf1b1f5036db5507"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/97fb1649ad744b80bf1b1f5036db5507"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_97fb1649ad744b80bf1b1f5036db5507", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:25:39.925675 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-QuotasAdminNegativeTest-1334947309 Oct 24 10:25:39.925675 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 97fb1649ad744b80bf1b1f5036db5507 Oct 24 10:25:39.925675 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1334947309 Oct 24 10:25:39.925675 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-QuotasAdminNegativeTest-1334947309-project Oct 24 10:25:39.925675 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:25:39.925675 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:25:39.925675 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 8fcf8449b8304183b18f6bf687a135c0 Oct 24 10:25:39.925675 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-QuotasAdminNegativeTest-1334947309-project Oct 24 10:25:39.925675 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:25:39.925675 n-d-858383-15 devstack@n-api.service[120426]: {"quota_set": {"ram": 0}} Oct 24 10:25:39.925675 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:25:39.925675 n-d-858383-15 devstack@n-api.service[120426]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 24 10:25:39.925675 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '97fb1649ad744b80bf1b1f5036db5507', 'body': {'quota_set': {'ram': 0}}} Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:25:39.926741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:39.929511 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:39.931997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:39.931997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:39.931997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:25:39.931997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:25:39.931997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 24 10:25:39.931997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:39.933302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9e3b9af-2fb9-4fce-8742-271bd887d9fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:39.933302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9e3b9af-2fb9-4fce-8742-271bd887d9fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:39.933302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9e3b9af-2fb9-4fce-8742-271bd887d9fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:39.934592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cdd847ec-5872-4e02-9275-bdf9946dcac8 tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:25:39.935802 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cdd847ec-5872-4e02-9275-bdf9946dcac8 tempest-QuotasAdminNegativeTest-1334947309 tempest-QuotasAdminNegativeTest-1334947309-project] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507" status: 403 len: 116 microversion: 2.1 time: 0.025292 Oct 24 10:25:39.940231 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 213/412] 10.222.0.50 () {60 vars in 1262 bytes} [Mon Oct 24 10:25:39 2022] PUT /compute/v2.1/os-quota-sets/97fb1649ad744b80bf1b1f5036db5507 => generated 116 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:25:40.050154 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f9e3b9af-2fb9-4fce-8742-271bd887d9fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "POST /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0/action" status: 204 len: 0 microversion: 2.1 time: 0.163666 Oct 24 10:25:40.053560 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 200/413] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:25:39 2022] POST /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0/action => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:25:40.063184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-756b627e-73c7-4f58-8e46-ada41a4c615b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:40.064187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-756b627e-73c7-4f58-8e46-ada41a4c615b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:40.084300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-756b627e-73c7-4f58-8e46-ada41a4c615b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:40.085805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-756b627e-73c7-4f58-8e46-ada41a4c615b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:40.086768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-756b627e-73c7-4f58-8e46-ada41a4c615b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:40.089211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-756b627e-73c7-4f58-8e46-ada41a4c615b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:40.090788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-756b627e-73c7-4f58-8e46-ada41a4c615b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:40.091625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-756b627e-73c7-4f58-8e46-ada41a4c615b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:40.173510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-40553d55-acdd-49c5-9a17-09bdffa04924 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:40.174226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-40553d55-acdd-49c5-9a17-09bdffa04924 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:40.186537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40553d55-acdd-49c5-9a17-09bdffa04924 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:40.187038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40553d55-acdd-49c5-9a17-09bdffa04924 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:40.187482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40553d55-acdd-49c5-9a17-09bdffa04924 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:40.188210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40553d55-acdd-49c5-9a17-09bdffa04924 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:40.188648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40553d55-acdd-49c5-9a17-09bdffa04924 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:40.189103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40553d55-acdd-49c5-9a17-09bdffa04924 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:40.706482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-756b627e-73c7-4f58-8e46-ada41a4c615b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:40.717293 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-756b627e-73c7-4f58-8e46-ada41a4c615b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1470 microversion: 2.1 time: 0.659100 Oct 24 10:25:40.718172 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 214/414] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:40 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1470 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:40.736402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-c1cc6027-6f79-4a15-8665-c267e6ca329b req-46f98a93-e779-45dd-8e12-216c6e94fc20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2942efdb-333c-47f7-8f37-3487f6228236", "name": "network-vif-plugged", "status": "completed", "tag": "dc89dfa6-4a12-46e1-b75a-cc3060ebb6b5"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:40.745202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-40553d55-acdd-49c5-9a17-09bdffa04924 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:40.751018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c1cc6027-6f79-4a15-8665-c267e6ca329b req-46f98a93-e779-45dd-8e12-216c6e94fc20 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:40.751500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c1cc6027-6f79-4a15-8665-c267e6ca329b req-46f98a93-e779-45dd-8e12-216c6e94fc20 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:40.752061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c1cc6027-6f79-4a15-8665-c267e6ca329b req-46f98a93-e779-45dd-8e12-216c6e94fc20 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:40.753076 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-40553d55-acdd-49c5-9a17-09bdffa04924 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1493 microversion: 2.1 time: 0.584014 Oct 24 10:25:40.754272 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 201/415] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:40 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1493 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:25:40.762444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ea8ee45-0030-4263-ab2b-6f7e70e9ea90 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:40.763730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ea8ee45-0030-4263-ab2b-6f7e70e9ea90 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:40.766130 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-c1cc6027-6f79-4a15-8665-c267e6ca329b req-46f98a93-e779-45dd-8e12-216c6e94fc20 service nova] Creating event network-vif-plugged:dc89dfa6-4a12-46e1-b75a-cc3060ebb6b5 for instance 2942efdb-333c-47f7-8f37-3487f6228236 on n-h2-858383-15 Oct 24 10:25:40.773501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ea8ee45-0030-4263-ab2b-6f7e70e9ea90 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:40.774272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ea8ee45-0030-4263-ab2b-6f7e70e9ea90 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:40.774956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ea8ee45-0030-4263-ab2b-6f7e70e9ea90 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:40.776109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ea8ee45-0030-4263-ab2b-6f7e70e9ea90 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:40.776932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ea8ee45-0030-4263-ab2b-6f7e70e9ea90 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:40.777607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ea8ee45-0030-4263-ab2b-6f7e70e9ea90 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:40.795722 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-c1cc6027-6f79-4a15-8665-c267e6ca329b req-46f98a93-e779-45dd-8e12-216c6e94fc20 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075850 Oct 24 10:25:40.800273 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 215/416] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:40.971551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c295ecb5-12e8-4a11-b1d1-9673a398c27c tempest-QuotaClassesAdminTestJSON-2063381763 tempest-QuotaClassesAdminTestJSON-2063381763-project-admin] Calling method '.version_select at 0x7f04d14503a0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:40.986599 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c295ecb5-12e8-4a11-b1d1-9673a398c27c tempest-QuotaClassesAdminTestJSON-2063381763 tempest-QuotaClassesAdminTestJSON-2063381763-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.185758 Oct 24 10:25:40.987420 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 216/417] 10.222.0.50 () {58 vars in 1185 bytes} [Mon Oct 24 10:25:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:41.104427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2ea8ee45-0030-4263-ab2b-6f7e70e9ea90 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:41.156487 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ea8ee45-0030-4263-ab2b-6f7e70e9ea90 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 200 len: 1322 microversion: 2.1 time: 0.399666 Oct 24 10:25:41.157514 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 202/418] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:40 2022] GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:41.160265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5679094a-f092-425b-963e-d5d46a659907 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:41.161030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5679094a-f092-425b-963e-d5d46a659907 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:41.162778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9718bd97-fdd8-4960-ae33-07e0f3fb42ab tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:41.163968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9718bd97-fdd8-4960-ae33-07e0f3fb42ab tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:41.168779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5679094a-f092-425b-963e-d5d46a659907 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:41.169293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5679094a-f092-425b-963e-d5d46a659907 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:41.169734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5679094a-f092-425b-963e-d5d46a659907 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:41.170279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9718bd97-fdd8-4960-ae33-07e0f3fb42ab tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:41.170414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5679094a-f092-425b-963e-d5d46a659907 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:41.170763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9718bd97-fdd8-4960-ae33-07e0f3fb42ab tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:41.170877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5679094a-f092-425b-963e-d5d46a659907 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:41.171190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9718bd97-fdd8-4960-ae33-07e0f3fb42ab tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:41.171312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5679094a-f092-425b-963e-d5d46a659907 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:41.171971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9718bd97-fdd8-4960-ae33-07e0f3fb42ab tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:41.172427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9718bd97-fdd8-4960-ae33-07e0f3fb42ab tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:41.175784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9718bd97-fdd8-4960-ae33-07e0f3fb42ab tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:41.515150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9718bd97-fdd8-4960-ae33-07e0f3fb42ab tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:41.523538 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9718bd97-fdd8-4960-ae33-07e0f3fb42ab tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 200 len: 1320 microversion: 2.1 time: 0.364920 Oct 24 10:25:41.524123 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 203/419] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:41 2022] GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 1320 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:41.524701 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5679094a-f092-425b-963e-d5d46a659907 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1646 microversion: 2.1 time: 0.534412 Oct 24 10:25:41.525879 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 217/420] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:40 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1646 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:41.547208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-58f4f0e9-84b1-4233-b425-52e2aaa6a999 tempest-QuotaClassesAdminTestJSON-2063381763 tempest-QuotaClassesAdminTestJSON-2063381763-project-admin] Action: 'update', calling method: .version_select at 0x7f04d1208c10>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:41.552653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1fa673d1-5bf2-4eb4-899d-a49a59f06753 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:41.554427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1fa673d1-5bf2-4eb4-899d-a49a59f06753 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:41.562131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1fa673d1-5bf2-4eb4-899d-a49a59f06753 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:41.562630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1fa673d1-5bf2-4eb4-899d-a49a59f06753 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:41.563075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1fa673d1-5bf2-4eb4-899d-a49a59f06753 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:41.564654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1fa673d1-5bf2-4eb4-899d-a49a59f06753 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:41.565769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1fa673d1-5bf2-4eb4-899d-a49a59f06753 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:41.566682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1fa673d1-5bf2-4eb4-899d-a49a59f06753 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:41.782876 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1fa673d1-5bf2-4eb4-899d-a49a59f06753 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1646 microversion: 2.1 time: 0.236027 Oct 24 10:25:41.784357 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 218/421] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:41 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1646 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:41.791178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5e749d3b-5542-4877-b4a4-66074ec8dbb1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:41.792855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5e749d3b-5542-4877-b4a4-66074ec8dbb1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:41.798729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:UPDATE=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:41.800526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e749d3b-5542-4877-b4a4-66074ec8dbb1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:41.801283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e749d3b-5542-4877-b4a4-66074ec8dbb1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:41.803034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e749d3b-5542-4877-b4a4-66074ec8dbb1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:41.804055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e749d3b-5542-4877-b4a4-66074ec8dbb1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:41.804530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e749d3b-5542-4877-b4a4-66074ec8dbb1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:41.804994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e749d3b-5542-4877-b4a4-66074ec8dbb1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:41.987148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5e749d3b-5542-4877-b4a4-66074ec8dbb1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:41.993326 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-58f4f0e9-84b1-4233-b425-52e2aaa6a999 tempest-QuotaClassesAdminTestJSON-2063381763 tempest-QuotaClassesAdminTestJSON-2063381763-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.450845 Oct 24 10:25:41.996050 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5e749d3b-5542-4877-b4a4-66074ec8dbb1 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1470 microversion: 2.1 time: 0.210297 Oct 24 10:25:41.996624 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 219/422] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:41 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1470 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:42.000922 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 204/423] 10.222.0.50 () {60 vars in 1206 bytes} [Mon Oct 24 10:25:41 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:42.002189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-40d0a92f-67ea-4c01-8cb5-858f215fb898 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:42.005932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-83afcc5b-a62e-4b62-bee4-b0c0b7d7d2a2 tempest-QuotaClassesAdminTestJSON-2063381763 tempest-QuotaClassesAdminTestJSON-2063381763-project-admin] Calling method '.version_select at 0x7f04d11d28b0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:42.018431 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-83afcc5b-a62e-4b62-bee4-b0c0b7d7d2a2 tempest-QuotaClassesAdminTestJSON-2063381763 tempest-QuotaClassesAdminTestJSON-2063381763-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.016364 Oct 24 10:25:42.019258 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 205/424] 10.222.0.50 () {58 vars in 1185 bytes} [Mon Oct 24 10:25:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:42.020897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40d0a92f-67ea-4c01-8cb5-858f215fb898 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:42.021372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40d0a92f-67ea-4c01-8cb5-858f215fb898 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:42.021813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40d0a92f-67ea-4c01-8cb5-858f215fb898 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:42.025505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40d0a92f-67ea-4c01-8cb5-858f215fb898 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:42.027526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40d0a92f-67ea-4c01-8cb5-858f215fb898 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:42.030386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40d0a92f-67ea-4c01-8cb5-858f215fb898 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:42.033138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fc8c7636-c3f3-42f2-9a72-bc5d7b23c983 tempest-QuotaClassesAdminTestJSON-2063381763 tempest-QuotaClassesAdminTestJSON-2063381763-project-admin] Action: 'update', calling method: .version_select at 0x7f04d11b25e0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:42.070467 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-40d0a92f-67ea-4c01-8cb5-858f215fb898 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.072582 Oct 24 10:25:42.071806 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 220/425] 10.222.0.50 () {58 vars in 1176 bytes} [Mon Oct 24 10:25:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:42.090652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-674df2c4-8cb2-47ad-b71c-f4700703e517 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-15", "block_migration": true, "disk_over_commit": false}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:42.095538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-674df2c4-8cb2-47ad-b71c-f4700703e517 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:42.104794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-674df2c4-8cb2-47ad-b71c-f4700703e517 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:42.105683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-674df2c4-8cb2-47ad-b71c-f4700703e517 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:42.106318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-674df2c4-8cb2-47ad-b71c-f4700703e517 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:42.107321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-674df2c4-8cb2-47ad-b71c-f4700703e517 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:42.108103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-674df2c4-8cb2-47ad-b71c-f4700703e517 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:42.108880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-674df2c4-8cb2-47ad-b71c-f4700703e517 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:42.196698 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fc8c7636-c3f3-42f2-9a72-bc5d7b23c983 tempest-QuotaClassesAdminTestJSON-2063381763 tempest-QuotaClassesAdminTestJSON-2063381763-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.168264 Oct 24 10:25:42.203703 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 206/426] 10.222.0.50 () {60 vars in 1206 bytes} [Mon Oct 24 10:25:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:42.216278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1f1e7da9-f62c-447d-91c3-40b81c1fb7ba tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:42.216920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1f1e7da9-f62c-447d-91c3-40b81c1fb7ba tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:42.231247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f1e7da9-f62c-447d-91c3-40b81c1fb7ba tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:42.232235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f1e7da9-f62c-447d-91c3-40b81c1fb7ba tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:42.232235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f1e7da9-f62c-447d-91c3-40b81c1fb7ba tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:42.232937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f1e7da9-f62c-447d-91c3-40b81c1fb7ba tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:42.233396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f1e7da9-f62c-447d-91c3-40b81c1fb7ba tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:42.245287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f1e7da9-f62c-447d-91c3-40b81c1fb7ba tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:42.892149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1f1e7da9-f62c-447d-91c3-40b81c1fb7ba tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:42.903880 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1f1e7da9-f62c-447d-91c3-40b81c1fb7ba tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 200 len: 1322 microversion: 2.1 time: 0.696865 Oct 24 10:25:42.904706 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 207/427] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:42 2022] GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 1322 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:42.909900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e6a6fba9-2653-4f5e-a120-69e31bfab495 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:42.910801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e6a6fba9-2653-4f5e-a120-69e31bfab495 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:42.917503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6a6fba9-2653-4f5e-a120-69e31bfab495 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:42.918307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6a6fba9-2653-4f5e-a120-69e31bfab495 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:42.919222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6a6fba9-2653-4f5e-a120-69e31bfab495 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:42.920413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6a6fba9-2653-4f5e-a120-69e31bfab495 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:42.921173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6a6fba9-2653-4f5e-a120-69e31bfab495 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:42.921816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6a6fba9-2653-4f5e-a120-69e31bfab495 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:43.015089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-674df2c4-8cb2-47ad-b71c-f4700703e517 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lazy-loading 'flavor' on Instance uuid 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:25:43.109612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-674df2c4-8cb2-47ad-b71c-f4700703e517 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Going to try to live migrate instance to n-h2-858383-15 {{(pid=120426) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 24 10:25:43.342376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e6a6fba9-2653-4f5e-a120-69e31bfab495 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:43.356201 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e6a6fba9-2653-4f5e-a120-69e31bfab495 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 200 len: 1469 microversion: 2.1 time: 0.449990 Oct 24 10:25:43.357128 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 208/428] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:42 2022] GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 1469 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:43.361884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a0d5d420-262e-427a-8e53-47f99e28814b req-3aa39760-c234-4b4d-a7ed-e656d7e9eccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b52c962-e95e-465b-a898-0cb4fffe0ba0", "name": "network-vif-plugged", "status": "completed", "tag": "eb4f598e-dc19-47d1-99f7-93994ac25681"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:43.387388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a0d5d420-262e-427a-8e53-47f99e28814b req-3aa39760-c234-4b4d-a7ed-e656d7e9eccb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:43.388052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a0d5d420-262e-427a-8e53-47f99e28814b req-3aa39760-c234-4b4d-a7ed-e656d7e9eccb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:43.389460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a0d5d420-262e-427a-8e53-47f99e28814b req-3aa39760-c234-4b4d-a7ed-e656d7e9eccb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:43.414726 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a0d5d420-262e-427a-8e53-47f99e28814b req-3aa39760-c234-4b4d-a7ed-e656d7e9eccb service nova] Creating event network-vif-plugged:eb4f598e-dc19-47d1-99f7-93994ac25681 for instance 1b52c962-e95e-465b-a898-0cb4fffe0ba0 on n-h1-858383-15 Oct 24 10:25:43.424875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-a0d5d420-262e-427a-8e53-47f99e28814b req-3aa39760-c234-4b4d-a7ed-e656d7e9eccb service nova] Instance 1b52c962-e95e-465b-a898-0cb4fffe0ba0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:25:43.440036 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a0d5d420-262e-427a-8e53-47f99e28814b req-3aa39760-c234-4b4d-a7ed-e656d7e9eccb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081439 Oct 24 10:25:43.440652 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 209/429] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:43.450628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-46613009-007f-4db7-8008-f54a984512df tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:43.450840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-46613009-007f-4db7-8008-f54a984512df tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:43.457322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46613009-007f-4db7-8008-f54a984512df tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:43.457745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46613009-007f-4db7-8008-f54a984512df tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:43.458244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46613009-007f-4db7-8008-f54a984512df tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:43.459583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46613009-007f-4db7-8008-f54a984512df tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:43.460068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46613009-007f-4db7-8008-f54a984512df tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:43.460499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46613009-007f-4db7-8008-f54a984512df tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:43.714527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-46613009-007f-4db7-8008-f54a984512df tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:43.727871 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-46613009-007f-4db7-8008-f54a984512df tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1470 microversion: 2.1 time: 0.282013 Oct 24 10:25:43.728490 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 210/430] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:43 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1470 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:44.247119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c0c25b7f-6d6b-4de5-bce2-874044579237 tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:44.247947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c0c25b7f-6d6b-4de5-bce2-874044579237 tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:44.256452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0c25b7f-6d6b-4de5-bce2-874044579237 tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:44.261244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0c25b7f-6d6b-4de5-bce2-874044579237 tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:44.261820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0c25b7f-6d6b-4de5-bce2-874044579237 tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:44.262633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0c25b7f-6d6b-4de5-bce2-874044579237 tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:44.263334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0c25b7f-6d6b-4de5-bce2-874044579237 tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:44.263966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0c25b7f-6d6b-4de5-bce2-874044579237 tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:44.317531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c0c25b7f-6d6b-4de5-bce2-874044579237 tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:25:44.533508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:44.642949 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c0c25b7f-6d6b-4de5-bce2-874044579237 tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] 10.222.0.50 "DELETE /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 204 len: 0 microversion: 2.1 time: 0.912943 Oct 24 10:25:44.644452 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 211/431] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:25:43 2022] DELETE /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 0 bytes in 915 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:25:44.651560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c6054466-0dd1-4617-ad9a-2305f3a41e6c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:44.652587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c6054466-0dd1-4617-ad9a-2305f3a41e6c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:44.666542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6054466-0dd1-4617-ad9a-2305f3a41e6c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:44.667033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6054466-0dd1-4617-ad9a-2305f3a41e6c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:44.667467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6054466-0dd1-4617-ad9a-2305f3a41e6c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:44.668400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6054466-0dd1-4617-ad9a-2305f3a41e6c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:44.669054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6054466-0dd1-4617-ad9a-2305f3a41e6c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:44.669518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6054466-0dd1-4617-ad9a-2305f3a41e6c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:44.940429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c6054466-0dd1-4617-ad9a-2305f3a41e6c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:44.954011 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c6054466-0dd1-4617-ad9a-2305f3a41e6c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 200 len: 1322 microversion: 2.1 time: 0.307025 Oct 24 10:25:44.957735 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 212/432] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:44 2022] GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:44.969523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-291a3fcf-3527-4361-ace2-86b038e1e748 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:44.972791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-291a3fcf-3527-4361-ace2-86b038e1e748 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:44.985811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-291a3fcf-3527-4361-ace2-86b038e1e748 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:44.988042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-291a3fcf-3527-4361-ace2-86b038e1e748 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:44.988913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-291a3fcf-3527-4361-ace2-86b038e1e748 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:44.990909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-291a3fcf-3527-4361-ace2-86b038e1e748 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:44.991747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-291a3fcf-3527-4361-ace2-86b038e1e748 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:44.993438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-291a3fcf-3527-4361-ace2-86b038e1e748 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:45.264320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-291a3fcf-3527-4361-ace2-86b038e1e748 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:45.276505 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-291a3fcf-3527-4361-ace2-86b038e1e748 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 200 len: 1475 microversion: 2.1 time: 0.317052 Oct 24 10:25:45.279834 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 213/433] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:44 2022] GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 1475 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:45.285382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f07f10fb-3a2a-4a31-a790-6c0ac0bd93b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:45.285982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f07f10fb-3a2a-4a31-a790-6c0ac0bd93b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:45.297639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f07f10fb-3a2a-4a31-a790-6c0ac0bd93b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:45.308510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f07f10fb-3a2a-4a31-a790-6c0ac0bd93b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:45.309288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f07f10fb-3a2a-4a31-a790-6c0ac0bd93b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:45.311207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f07f10fb-3a2a-4a31-a790-6c0ac0bd93b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:45.313049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f07f10fb-3a2a-4a31-a790-6c0ac0bd93b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:45.313516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f07f10fb-3a2a-4a31-a790-6c0ac0bd93b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:45.515767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f07f10fb-3a2a-4a31-a790-6c0ac0bd93b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:45.527204 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f07f10fb-3a2a-4a31-a790-6c0ac0bd93b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1462 microversion: 2.1 time: 0.246251 Oct 24 10:25:45.528504 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 214/434] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:45 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1462 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:45.556300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c405fa23-e232-47f2-9677-da10d7b2ff58 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:45.556991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c405fa23-e232-47f2-9677-da10d7b2ff58 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:45.568599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c405fa23-e232-47f2-9677-da10d7b2ff58 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:45.570037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c405fa23-e232-47f2-9677-da10d7b2ff58 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:45.571806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c405fa23-e232-47f2-9677-da10d7b2ff58 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:45.573662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c405fa23-e232-47f2-9677-da10d7b2ff58 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:45.574349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c405fa23-e232-47f2-9677-da10d7b2ff58 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:45.575899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c405fa23-e232-47f2-9677-da10d7b2ff58 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:45.763132 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c405fa23-e232-47f2-9677-da10d7b2ff58 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1615 microversion: 2.1 time: 0.211601 Oct 24 10:25:45.764064 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 215/435] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:45 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1615 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:45.795401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a97dae19-358f-4903-985c-3de3ab026492 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Calling method '.version_select at 0x7f04d110cb80>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:45.800018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a97dae19-358f-4903-985c-3de3ab026492 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:45.800733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a97dae19-358f-4903-985c-3de3ab026492 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:45.801530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a97dae19-358f-4903-985c-3de3ab026492 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:45.816517 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a97dae19-358f-4903-985c-3de3ab026492 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 752 microversion: 2.1 time: 0.024903 Oct 24 10:25:45.818035 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 216/436] 10.222.0.50 () {58 vars in 1143 bytes} [Mon Oct 24 10:25:45 2022] GET /compute/v2.1/os-migrations => generated 752 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:25:45.991917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fb69dcc2-1cf7-4ffd-9f82-4828e1dd3510 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:45.993738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fb69dcc2-1cf7-4ffd-9f82-4828e1dd3510 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:46.007166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb69dcc2-1cf7-4ffd-9f82-4828e1dd3510 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:46.012638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb69dcc2-1cf7-4ffd-9f82-4828e1dd3510 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:46.013215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb69dcc2-1cf7-4ffd-9f82-4828e1dd3510 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:46.014225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb69dcc2-1cf7-4ffd-9f82-4828e1dd3510 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:46.014769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb69dcc2-1cf7-4ffd-9f82-4828e1dd3510 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:46.015415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb69dcc2-1cf7-4ffd-9f82-4828e1dd3510 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:46.439009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fb69dcc2-1cf7-4ffd-9f82-4828e1dd3510 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:46.454324 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fb69dcc2-1cf7-4ffd-9f82-4828e1dd3510 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 200 len: 1322 microversion: 2.1 time: 0.470314 Oct 24 10:25:46.469442 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 217/437] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:45 2022] GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 1322 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:25:46.476235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ec04ac1c-e49d-41b1-8a94-6336b4b188c8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-989979192", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:46.572472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-ec04ac1c-e49d-41b1-8a94-6336b4b188c8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] validate_networks() for None {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:25:47.066472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ec04ac1c-e49d-41b1-8a94-6336b4b188c8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:25:47.067178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ec04ac1c-e49d-41b1-8a94-6336b4b188c8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:25:47.067729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ec04ac1c-e49d-41b1-8a94-6336b4b188c8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:25:47.068160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ec04ac1c-e49d-41b1-8a94-6336b4b188c8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:25:47.068586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ec04ac1c-e49d-41b1-8a94-6336b4b188c8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:25:47.087695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec04ac1c-e49d-41b1-8a94-6336b4b188c8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:47.088231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec04ac1c-e49d-41b1-8a94-6336b4b188c8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:47.088648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec04ac1c-e49d-41b1-8a94-6336b4b188c8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:47.089574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec04ac1c-e49d-41b1-8a94-6336b4b188c8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:47.090182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec04ac1c-e49d-41b1-8a94-6336b4b188c8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:47.090760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec04ac1c-e49d-41b1-8a94-6336b4b188c8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:47.126164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ec04ac1c-e49d-41b1-8a94-6336b4b188c8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Getting quotas for project ac5f703504204b91a5c7e895964ec985. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:25:47.136990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ec04ac1c-e49d-41b1-8a94-6336b4b188c8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Getting quotas for user b684c865fc9e4abb8e0e55616087b92e and project ac5f703504204b91a5c7e895964ec985. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:25:47.161285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ec04ac1c-e49d-41b1-8a94-6336b4b188c8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:25:47.166519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ec04ac1c-e49d-41b1-8a94-6336b4b188c8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:25:47.225329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=9,nova_api:UPDATE=18 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:47.269112 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ec04ac1c-e49d-41b1-8a94-6336b4b188c8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.809174 Oct 24 10:25:47.269784 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 218/438] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:25:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:25:47.283525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6a121f1e-30b6-4cf0-8b32-fa77119e08c8 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:47.284151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6a121f1e-30b6-4cf0-8b32-fa77119e08c8 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:47.313811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a121f1e-30b6-4cf0-8b32-fa77119e08c8 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:47.314089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a121f1e-30b6-4cf0-8b32-fa77119e08c8 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:47.314979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a121f1e-30b6-4cf0-8b32-fa77119e08c8 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:47.315907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a121f1e-30b6-4cf0-8b32-fa77119e08c8 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:47.316404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a121f1e-30b6-4cf0-8b32-fa77119e08c8 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:47.318725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a121f1e-30b6-4cf0-8b32-fa77119e08c8 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:47.781223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6a121f1e-30b6-4cf0-8b32-fa77119e08c8 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:47.792252 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6a121f1e-30b6-4cf0-8b32-fa77119e08c8 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 200 len: 1475 microversion: 2.1 time: 0.521418 Oct 24 10:25:47.799879 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 219/439] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:47 2022] GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 1475 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:47.810640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-187b4c10-92af-4830-9f4f-8dcedaf09e72 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:47.811943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-187b4c10-92af-4830-9f4f-8dcedaf09e72 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:48.018210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-187b4c10-92af-4830-9f4f-8dcedaf09e72 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:48.030880 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-187b4c10-92af-4830-9f4f-8dcedaf09e72 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1212 microversion: 2.1 time: 0.229584 Oct 24 10:25:48.031619 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 220/440] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:47 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1212 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:48.046621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-065f240a-cd2d-4909-841d-37a3bdd1bafa tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:48.047027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-065f240a-cd2d-4909-841d-37a3bdd1bafa tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:48.078851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-065f240a-cd2d-4909-841d-37a3bdd1bafa tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:48.079375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-065f240a-cd2d-4909-841d-37a3bdd1bafa tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:48.079817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-065f240a-cd2d-4909-841d-37a3bdd1bafa tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:48.080524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-065f240a-cd2d-4909-841d-37a3bdd1bafa tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:48.081993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-065f240a-cd2d-4909-841d-37a3bdd1bafa tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:48.082598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-065f240a-cd2d-4909-841d-37a3bdd1bafa tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:48.323564 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-674df2c4-8cb2-47ad-b71c-f4700703e517 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb/action" status: 202 len: 0 microversion: 2.1 time: 6.243628 Oct 24 10:25:48.325387 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 221/441] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:25:42 2022] POST /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb/action => generated 0 bytes in 6246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:25:48.331943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-171bbe3f-c0c0-4bab-b897-df4c4a374cfe tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:48.332852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-171bbe3f-c0c0-4bab-b897-df4c4a374cfe tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:48.362975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-171bbe3f-c0c0-4bab-b897-df4c4a374cfe tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:48.363676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-171bbe3f-c0c0-4bab-b897-df4c4a374cfe tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:48.365817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-171bbe3f-c0c0-4bab-b897-df4c4a374cfe tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:48.366816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-171bbe3f-c0c0-4bab-b897-df4c4a374cfe tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:48.367584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-171bbe3f-c0c0-4bab-b897-df4c4a374cfe tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:48.368809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-171bbe3f-c0c0-4bab-b897-df4c4a374cfe tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:48.399743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-171bbe3f-c0c0-4bab-b897-df4c4a374cfe tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:25:48.419602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:48.613030 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-171bbe3f-c0c0-4bab-b897-df4c4a374cfe tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 204 len: 0 microversion: 2.1 time: 0.284982 Oct 24 10:25:48.614176 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 222/442] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:25:48 2022] DELETE /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:25:48.667694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-065f240a-cd2d-4909-841d-37a3bdd1bafa tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:48.686179 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-065f240a-cd2d-4909-841d-37a3bdd1bafa tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 200 len: 1322 microversion: 2.1 time: 0.647812 Oct 24 10:25:48.687746 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 221/443] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:48 2022] GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 1322 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:48.704739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-34bb0f81-f9af-4b83-a90c-5565f6b57e69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:48.705384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-34bb0f81-f9af-4b83-a90c-5565f6b57e69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:48.725951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34bb0f81-f9af-4b83-a90c-5565f6b57e69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:48.727847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34bb0f81-f9af-4b83-a90c-5565f6b57e69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:48.728515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34bb0f81-f9af-4b83-a90c-5565f6b57e69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:48.730648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34bb0f81-f9af-4b83-a90c-5565f6b57e69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:48.731350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34bb0f81-f9af-4b83-a90c-5565f6b57e69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:48.731970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34bb0f81-f9af-4b83-a90c-5565f6b57e69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:48.980673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3d42efd-0987-4679-b783-48b50e461b70 tempest-SecurityGroupsTestAdminJSON-683265230 tempest-SecurityGroupsTestAdminJSON-683265230-project] Action: 'create', calling method: .version_select at 0x7f04d1220160>, body: {"security_group": {"name": "tempest-securitygroup-230281456", "description": "tempest-description-114707079"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:48.998836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-34bb0f81-f9af-4b83-a90c-5565f6b57e69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:49.007643 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-34bb0f81-f9af-4b83-a90c-5565f6b57e69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1503 microversion: 2.1 time: 0.318583 Oct 24 10:25:49.008227 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 222/444] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:48 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1503 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:49.012980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-02a6ae67-5438-43c6-a1ed-f2c3356e139e req-64e6a0b3-4259-48fd-beaa-6964eed4162f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2942efdb-333c-47f7-8f37-3487f6228236", "name": "network-vif-deleted", "tag": "dc89dfa6-4a12-46e1-b75a-cc3060ebb6b5"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:49.027477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-02a6ae67-5438-43c6-a1ed-f2c3356e139e req-64e6a0b3-4259-48fd-beaa-6964eed4162f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:49.027964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-02a6ae67-5438-43c6-a1ed-f2c3356e139e req-64e6a0b3-4259-48fd-beaa-6964eed4162f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:49.028387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-02a6ae67-5438-43c6-a1ed-f2c3356e139e req-64e6a0b3-4259-48fd-beaa-6964eed4162f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:49.066167 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-02a6ae67-5438-43c6-a1ed-f2c3356e139e req-64e6a0b3-4259-48fd-beaa-6964eed4162f service nova] Creating event network-vif-deleted:dc89dfa6-4a12-46e1-b75a-cc3060ebb6b5 for instance 2942efdb-333c-47f7-8f37-3487f6228236 on n-h2-858383-15 Oct 24 10:25:49.066167 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-02a6ae67-5438-43c6-a1ed-f2c3356e139e req-64e6a0b3-4259-48fd-beaa-6964eed4162f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047864 Oct 24 10:25:49.066167 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 223/445] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:49.316891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d22223cc-3222-4bea-b3fa-d148659b7461 tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] Action: 'create', calling method: .version_select at 0x7f04d1118550>, body: {"pool": null} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:49.404876 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f3d42efd-0987-4679-b783-48b50e461b70 tempest-SecurityGroupsTestAdminJSON-683265230 tempest-SecurityGroupsTestAdminJSON-683265230-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.788992 Oct 24 10:25:49.414831 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 223/446] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:25:48 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:49.420666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a7750a98-9238-4851-8240-053daec22c29 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-172027346", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "1113362990", "adminPass": "***", "networks": [{"uuid": "336ccfea-283a-4469-ae69-bad4be20f8eb"}], "security_groups": [{"name": "tempest-securitygroup--600605418"}], "key_name": "tempest-keypair-1839762585", "user_data": "}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:49.671052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-a7750a98-9238-4851-8240-053daec22c29 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] validate_networks() for [('336ccfea-283a-4469-ae69-bad4be20f8eb', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:25:50.814858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a7750a98-9238-4851-8240-053daec22c29 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:25:50.815941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a7750a98-9238-4851-8240-053daec22c29 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:25:50.816575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a7750a98-9238-4851-8240-053daec22c29 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:25:50.817197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a7750a98-9238-4851-8240-053daec22c29 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:25:50.817849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a7750a98-9238-4851-8240-053daec22c29 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:25:50.832251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7750a98-9238-4851-8240-053daec22c29 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:50.860400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7750a98-9238-4851-8240-053daec22c29 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:50.867688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7750a98-9238-4851-8240-053daec22c29 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:50.872523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7750a98-9238-4851-8240-053daec22c29 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:50.873331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7750a98-9238-4851-8240-053daec22c29 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:50.874861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7750a98-9238-4851-8240-053daec22c29 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:50.948326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-a7750a98-9238-4851-8240-053daec22c29 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Getting quotas for project 3db1d316f8d547919156c576461ed607. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:25:50.956426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-a7750a98-9238-4851-8240-053daec22c29 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Getting quotas for user 6a4e7f9ab1cc4c3f81d40b2c4391619f and project 3db1d316f8d547919156c576461ed607. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:25:51.003353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a7750a98-9238-4851-8240-053daec22c29 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:25:51.008153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a7750a98-9238-4851-8240-053daec22c29 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:25:51.079149 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a7750a98-9238-4851-8240-053daec22c29 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.662786 Oct 24 10:25:51.080075 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 224/447] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:25:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:25:51.088748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9e484160-d0c0-4f0b-b465-62d8385eaadc tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:51.090647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9e484160-d0c0-4f0b-b465-62d8385eaadc tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:51.101951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e484160-d0c0-4f0b-b465-62d8385eaadc tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:51.102688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e484160-d0c0-4f0b-b465-62d8385eaadc tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:51.103301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e484160-d0c0-4f0b-b465-62d8385eaadc tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:51.104471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e484160-d0c0-4f0b-b465-62d8385eaadc tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:51.105110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e484160-d0c0-4f0b-b465-62d8385eaadc tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:51.105690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e484160-d0c0-4f0b-b465-62d8385eaadc tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:51.173702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e484160-d0c0-4f0b-b465-62d8385eaadc tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:51.174252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e484160-d0c0-4f0b-b465-62d8385eaadc tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:51.174693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e484160-d0c0-4f0b-b465-62d8385eaadc tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:51.176290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-9e484160-d0c0-4f0b-b465-62d8385eaadc tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lazy-loading 'fault' on Instance uuid 2942efdb-333c-47f7-8f37-3487f6228236 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:25:51.313136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9e484160-d0c0-4f0b-b465-62d8385eaadc tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:51.327473 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9e484160-d0c0-4f0b-b465-62d8385eaadc tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 200 len: 1310 microversion: 2.1 time: 0.246205 Oct 24 10:25:51.329478 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 225/448] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:51 2022] GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 1310 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:51.339221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-febffccd-9702-44d5-8aaa-3c0385c0e925 req-505236a6-d4f3-4502-85b0-f8e6e7f2fbae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78163a08-193b-424a-b63c-28148c3aa4d6", "name": "network-vif-plugged", "status": "completed", "tag": "521590e6-41d5-4de2-80cb-62ebdd4d5ab8"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:51.355297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-febffccd-9702-44d5-8aaa-3c0385c0e925 req-505236a6-d4f3-4502-85b0-f8e6e7f2fbae service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:51.356730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-febffccd-9702-44d5-8aaa-3c0385c0e925 req-505236a6-d4f3-4502-85b0-f8e6e7f2fbae service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:51.357547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-febffccd-9702-44d5-8aaa-3c0385c0e925 req-505236a6-d4f3-4502-85b0-f8e6e7f2fbae service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:51.385961 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-febffccd-9702-44d5-8aaa-3c0385c0e925 req-505236a6-d4f3-4502-85b0-f8e6e7f2fbae service nova] Creating event network-vif-plugged:521590e6-41d5-4de2-80cb-62ebdd4d5ab8 for instance 78163a08-193b-424a-b63c-28148c3aa4d6 on n-h1-858383-15 Oct 24 10:25:51.393781 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-febffccd-9702-44d5-8aaa-3c0385c0e925 req-505236a6-d4f3-4502-85b0-f8e6e7f2fbae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061994 Oct 24 10:25:51.397371 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 226/449] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:51.408540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-543c93d9-208f-43d9-b5ed-a1167efecf60 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:51.409269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-543c93d9-208f-43d9-b5ed-a1167efecf60 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:51.430230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-543c93d9-208f-43d9-b5ed-a1167efecf60 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:51.430736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-543c93d9-208f-43d9-b5ed-a1167efecf60 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:51.431185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-543c93d9-208f-43d9-b5ed-a1167efecf60 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:51.431905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-543c93d9-208f-43d9-b5ed-a1167efecf60 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:51.432365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-543c93d9-208f-43d9-b5ed-a1167efecf60 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:51.432791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-543c93d9-208f-43d9-b5ed-a1167efecf60 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:51.610200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-543c93d9-208f-43d9-b5ed-a1167efecf60 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:51.619097 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-543c93d9-208f-43d9-b5ed-a1167efecf60 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1270 microversion: 2.1 time: 0.219614 Oct 24 10:25:51.641254 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 227/450] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:51 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1270 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:51.657035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2f229325-b926-4f84-83a3-b2c3babea29e tempest-SecurityGroupsTestAdminJSON-683265230 tempest-SecurityGroupsTestAdminJSON-683265230-project] Action: 'create', calling method: .version_select at 0x7f04d11d3d30>, body: {"security_group": {"name": "tempest-securitygroup-885192958", "description": "tempest-description-365094960"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:52.604166 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2f229325-b926-4f84-83a3-b2c3babea29e tempest-SecurityGroupsTestAdminJSON-683265230 tempest-SecurityGroupsTestAdminJSON-683265230-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.961646 Oct 24 10:25:52.606342 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 228/451] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:25:51 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:52.618709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-76c5eb11-cb8c-47ce-b44d-665b6e63a053 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:52.619496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-76c5eb11-cb8c-47ce-b44d-665b6e63a053 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:52.627498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76c5eb11-cb8c-47ce-b44d-665b6e63a053 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:52.632960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76c5eb11-cb8c-47ce-b44d-665b6e63a053 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:52.633486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76c5eb11-cb8c-47ce-b44d-665b6e63a053 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:52.634242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76c5eb11-cb8c-47ce-b44d-665b6e63a053 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:52.634709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76c5eb11-cb8c-47ce-b44d-665b6e63a053 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:52.635483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76c5eb11-cb8c-47ce-b44d-665b6e63a053 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:53.593885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-76c5eb11-cb8c-47ce-b44d-665b6e63a053 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:53.605600 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-76c5eb11-cb8c-47ce-b44d-665b6e63a053 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 200 len: 1322 microversion: 2.1 time: 0.997769 Oct 24 10:25:53.607156 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 229/452] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:52 2022] GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 1322 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:53.611665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-857c3196-31b6-429a-b8c0-9fd7315e2e56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:53.612273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-857c3196-31b6-429a-b8c0-9fd7315e2e56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:53.633520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:53.648141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-857c3196-31b6-429a-b8c0-9fd7315e2e56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:53.648996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-857c3196-31b6-429a-b8c0-9fd7315e2e56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:53.649748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-857c3196-31b6-429a-b8c0-9fd7315e2e56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:53.650894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-857c3196-31b6-429a-b8c0-9fd7315e2e56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:53.651690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-857c3196-31b6-429a-b8c0-9fd7315e2e56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:53.652270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-857c3196-31b6-429a-b8c0-9fd7315e2e56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:54.170090 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d22223cc-3222-4bea-b3fa-d148659b7461 tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.108596 Oct 24 10:25:54.171928 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 224/453] 10.222.0.50 () {60 vars in 1170 bytes} [Mon Oct 24 10:25:49 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:54.178077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fb6faedd-7418-4053-bdf0-67973f5a25af tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:54.179094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fb6faedd-7418-4053-bdf0-67973f5a25af tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:54.191257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb6faedd-7418-4053-bdf0-67973f5a25af tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:54.194486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-857c3196-31b6-429a-b8c0-9fd7315e2e56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:54.195289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb6faedd-7418-4053-bdf0-67973f5a25af tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:54.195907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb6faedd-7418-4053-bdf0-67973f5a25af tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:54.198001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb6faedd-7418-4053-bdf0-67973f5a25af tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:54.199243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb6faedd-7418-4053-bdf0-67973f5a25af tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:54.200757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb6faedd-7418-4053-bdf0-67973f5a25af tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:54.212918 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-857c3196-31b6-429a-b8c0-9fd7315e2e56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1503 microversion: 2.1 time: 0.596647 Oct 24 10:25:54.213781 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 230/454] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:53 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1503 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:54.229723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e9c8009-e1c0-466b-8043-6ec408851dcb tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:54.230691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1e9c8009-e1c0-466b-8043-6ec408851dcb tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:54.238365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e9c8009-e1c0-466b-8043-6ec408851dcb tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:54.239176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e9c8009-e1c0-466b-8043-6ec408851dcb tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:54.241361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e9c8009-e1c0-466b-8043-6ec408851dcb tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:54.242364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e9c8009-e1c0-466b-8043-6ec408851dcb tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:54.246424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e9c8009-e1c0-466b-8043-6ec408851dcb tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:54.248428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e9c8009-e1c0-466b-8043-6ec408851dcb tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:54.280727 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-1e9c8009-e1c0-466b-8043-6ec408851dcb tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] HTTP exception thrown: Instance 2942efdb-333c-47f7-8f37-3487f6228236 could not be found. Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e9c8009-e1c0-466b-8043-6ec408851dcb tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Request method failure captured: Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 HTTP/1.1 Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmgOX3Ujtr9hYTDHc1vhI_CdHgAemoXfzxvPyqH5jkdLE1gQ5oLSxv8Wqx_YFuf_2TdnjV6gmc5GAToe6Otj7aYUz1RCgOo7wjuY42vNzZSKiQiB9sY991dZLpEwGzgJi8S2VmWbxAySpZr0GYKMJ23fhfj0Ojhb4tRUD7gwGq9dF6Q Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4bcc92db3323454f9d56d34a11fbe540 Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-DeleteServersAdminTestJSON-875278464 Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:25:54.283984 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:25:54.285435 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bcc92db3323454f9d56d34a11fbe540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bcc92db3323454f9d56d34a11fbe540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4bcc92db3323454f9d56d34a11fbe540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4bcc92db3323454f9d56d34a11fbe540", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:25:54.285435 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-DeleteServersAdminTestJSON-875278464 Oct 24 10:25:54.285435 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4bcc92db3323454f9d56d34a11fbe540 Oct 24 10:25:54.285435 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-875278464 Oct 24 10:25:54.285435 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-DeleteServersAdminTestJSON-875278464-project Oct 24 10:25:54.285435 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:25:54.285435 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:25:54.285435 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: e2fad079a57e4c36896955386e6f31ef Oct 24 10:25:54.285435 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-DeleteServersAdminTestJSON-875278464-project Oct 24 10:25:54.285435 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:25:54.285435 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 2942efdb-333c-47f7-8f37-3487f6228236 could not be found. Oct 24 10:25:54.285435 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '2942efdb-333c-47f7-8f37-3487f6228236'} Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2942efdb-333c-47f7-8f37-3487f6228236 could not be found. Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:25:54.286182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:25:54.288222 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:25:54.288222 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:25:54.288222 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:25:54.288222 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:25:54.288222 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:25:54.288222 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:25:54.288222 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:25:54.288222 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2942efdb-333c-47f7-8f37-3487f6228236 could not be found. Oct 24 10:25:54.288222 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:54.288222 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:25:54.288222 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:54.288222 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:25:54.288222 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:25:54.288222 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:25:54.288222 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:25:54.288222 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:25:54.288222 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2942efdb-333c-47f7-8f37-3487f6228236 could not be found. Oct 24 10:25:54.288222 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:25:54.291600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e9c8009-e1c0-466b-8043-6ec408851dcb tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Returning 404 to user: Instance 2942efdb-333c-47f7-8f37-3487f6228236 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:25:54.291600 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1e9c8009-e1c0-466b-8043-6ec408851dcb tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 404 len: 111 microversion: 2.1 time: 0.070890 Oct 24 10:25:54.301189 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 231/455] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:54 2022] GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:25:54.473786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fb6faedd-7418-4053-bdf0-67973f5a25af tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:54.494964 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fb6faedd-7418-4053-bdf0-67973f5a25af tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424" status: 200 len: 1322 microversion: 2.1 time: 0.310067 Oct 24 10:25:54.505021 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 225/456] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:54 2022] GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:54.516471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3bb7343f-57a2-4197-b4d7-e2be3473a8a6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:54.517194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3bb7343f-57a2-4197-b4d7-e2be3473a8a6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:54.541001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bb7343f-57a2-4197-b4d7-e2be3473a8a6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:54.541511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bb7343f-57a2-4197-b4d7-e2be3473a8a6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:54.542451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bb7343f-57a2-4197-b4d7-e2be3473a8a6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:54.545600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bb7343f-57a2-4197-b4d7-e2be3473a8a6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:54.546547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bb7343f-57a2-4197-b4d7-e2be3473a8a6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:54.547931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bb7343f-57a2-4197-b4d7-e2be3473a8a6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:54.764384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4805cbad-1329-407c-8f07-71cb7e9f5a11 tempest-SecurityGroupsTestAdminJSON-16391522 tempest-SecurityGroupsTestAdminJSON-16391522-project-admin] Action: 'create', calling method: .version_select at 0x7f04d11e6550>, body: {"security_group": {"name": "tempest-securitygroup-1591270912", "description": "tempest-description-1011153989"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:55.059425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3bb7343f-57a2-4197-b4d7-e2be3473a8a6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:55.077911 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3bb7343f-57a2-4197-b4d7-e2be3473a8a6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1312 microversion: 2.1 time: 0.580322 Oct 24 10:25:55.078506 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 226/457] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:54 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1312 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:55.109457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-45c4ad0b-baab-4cce-811e-7ffc57e1b38a req-ef8dc2ec-46ff-4ff0-b40d-89d00c973cfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d4f83cc-06a0-4a8e-b480-1878d348e1d1", "tag": "fbe95751-507c-435d-b75f-b10bd1579493"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:55.134980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-45c4ad0b-baab-4cce-811e-7ffc57e1b38a req-ef8dc2ec-46ff-4ff0-b40d-89d00c973cfe service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:55.135704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-45c4ad0b-baab-4cce-811e-7ffc57e1b38a req-ef8dc2ec-46ff-4ff0-b40d-89d00c973cfe service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:55.136290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-45c4ad0b-baab-4cce-811e-7ffc57e1b38a req-ef8dc2ec-46ff-4ff0-b40d-89d00c973cfe service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:55.152238 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-45c4ad0b-baab-4cce-811e-7ffc57e1b38a req-ef8dc2ec-46ff-4ff0-b40d-89d00c973cfe service nova] Creating event network-changed:fbe95751-507c-435d-b75f-b10bd1579493 for instance 9d4f83cc-06a0-4a8e-b480-1878d348e1d1 on n-h2-858383-15 Oct 24 10:25:55.158526 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-45c4ad0b-baab-4cce-811e-7ffc57e1b38a req-ef8dc2ec-46ff-4ff0-b40d-89d00c973cfe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059266 Oct 24 10:25:55.163851 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 227/458] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:55.170696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aed40c5e-9d01-422b-8d45-5e228664876a tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] Action: 'create', calling method: .version_select at 0x7f04d1118550>, body: {"pool": null} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:56.188907 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4805cbad-1329-407c-8f07-71cb7e9f5a11 tempest-SecurityGroupsTestAdminJSON-16391522 tempest-SecurityGroupsTestAdminJSON-16391522-project-admin] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.886390 Oct 24 10:25:56.189803 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 232/459] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:25:54 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:56.196542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d9833aed-8917-4072-977d-3f98f204832e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-407977433", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:56.269551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-d9833aed-8917-4072-977d-3f98f204832e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:25:57.108994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=9 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:57.258205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d9833aed-8917-4072-977d-3f98f204832e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:25:57.258638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d9833aed-8917-4072-977d-3f98f204832e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:25:57.259363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d9833aed-8917-4072-977d-3f98f204832e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:25:57.259969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d9833aed-8917-4072-977d-3f98f204832e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:25:57.260571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d9833aed-8917-4072-977d-3f98f204832e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:25:57.305407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9833aed-8917-4072-977d-3f98f204832e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:57.305909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9833aed-8917-4072-977d-3f98f204832e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:57.306349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9833aed-8917-4072-977d-3f98f204832e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:57.307082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9833aed-8917-4072-977d-3f98f204832e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:57.307802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9833aed-8917-4072-977d-3f98f204832e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:57.308612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9833aed-8917-4072-977d-3f98f204832e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:57.328744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=16 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:57.357744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d9833aed-8917-4072-977d-3f98f204832e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Getting quotas for project 4bcc92db3323454f9d56d34a11fbe540. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:25:57.366058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d9833aed-8917-4072-977d-3f98f204832e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Getting quotas for user e2fad079a57e4c36896955386e6f31ef and project 4bcc92db3323454f9d56d34a11fbe540. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:25:57.386951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d9833aed-8917-4072-977d-3f98f204832e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:25:57.393183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d9833aed-8917-4072-977d-3f98f204832e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:25:57.483521 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d9833aed-8917-4072-977d-3f98f204832e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.292401 Oct 24 10:25:57.484404 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 233/460] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:25:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:25:57.495953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-007ebdeb-7c2c-4f52-ba25-c73534f1192e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:57.497007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-007ebdeb-7c2c-4f52-ba25-c73534f1192e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:57.504500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-007ebdeb-7c2c-4f52-ba25-c73534f1192e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:57.505953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-007ebdeb-7c2c-4f52-ba25-c73534f1192e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:57.506639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-007ebdeb-7c2c-4f52-ba25-c73534f1192e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:57.507707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-007ebdeb-7c2c-4f52-ba25-c73534f1192e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:57.508392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-007ebdeb-7c2c-4f52-ba25-c73534f1192e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:57.509743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-007ebdeb-7c2c-4f52-ba25-c73534f1192e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:58.023803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=81,nova_cell0:UPDATE=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:58.045904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-007ebdeb-7c2c-4f52-ba25-c73534f1192e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:58.059250 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-007ebdeb-7c2c-4f52-ba25-c73534f1192e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 200 len: 1472 microversion: 2.1 time: 0.566546 Oct 24 10:25:58.060869 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 234/461] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:57 2022] GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 1472 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:58.067817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-d4198d6f-98b5-43ce-8d80-a959efef7daf req-bae4e754-21df-471c-ab5d-d3b0a822d04a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad6067c8-26ae-4e5f-a747-8d9e5f720a4f", "name": "network-vif-deleted", "tag": "57ea9058-b25f-4a68-bff8-4ffcfca66d5f"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:25:58.077914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d4198d6f-98b5-43ce-8d80-a959efef7daf req-bae4e754-21df-471c-ab5d-d3b0a822d04a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:58.078710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d4198d6f-98b5-43ce-8d80-a959efef7daf req-bae4e754-21df-471c-ab5d-d3b0a822d04a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:58.079512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d4198d6f-98b5-43ce-8d80-a959efef7daf req-bae4e754-21df-471c-ab5d-d3b0a822d04a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:58.093695 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-d4198d6f-98b5-43ce-8d80-a959efef7daf req-bae4e754-21df-471c-ab5d-d3b0a822d04a service nova] Creating event network-vif-deleted:57ea9058-b25f-4a68-bff8-4ffcfca66d5f for instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f on n-h2-858383-15 Oct 24 10:25:58.100941 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-d4198d6f-98b5-43ce-8d80-a959efef7daf req-bae4e754-21df-471c-ab5d-d3b0a822d04a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038371 Oct 24 10:25:58.102294 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 235/462] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:25:58.111311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d251c732-0253-4895-bd7d-871d7cd8872c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:58.113275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d251c732-0253-4895-bd7d-871d7cd8872c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:58.132783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d251c732-0253-4895-bd7d-871d7cd8872c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:58.133321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d251c732-0253-4895-bd7d-871d7cd8872c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:58.133835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d251c732-0253-4895-bd7d-871d7cd8872c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:58.134636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d251c732-0253-4895-bd7d-871d7cd8872c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:58.135096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d251c732-0253-4895-bd7d-871d7cd8872c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:58.135525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d251c732-0253-4895-bd7d-871d7cd8872c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:58.666033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d251c732-0253-4895-bd7d-871d7cd8872c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:58.679195 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d251c732-0253-4895-bd7d-871d7cd8872c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1503 microversion: 2.1 time: 0.575311 Oct 24 10:25:58.680351 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 236/463] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:58 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1503 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:58.686251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0e428052-dffd-431e-953a-2a4875855cbf tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:58.687135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0e428052-dffd-431e-953a-2a4875855cbf tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:58.695397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e428052-dffd-431e-953a-2a4875855cbf tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:58.696339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e428052-dffd-431e-953a-2a4875855cbf tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:58.697050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e428052-dffd-431e-953a-2a4875855cbf tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:58.698572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e428052-dffd-431e-953a-2a4875855cbf tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:58.699534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e428052-dffd-431e-953a-2a4875855cbf tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:58.700207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e428052-dffd-431e-953a-2a4875855cbf tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:59.241239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0e428052-dffd-431e-953a-2a4875855cbf tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:59.250677 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0e428052-dffd-431e-953a-2a4875855cbf tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424" status: 200 len: 1389 microversion: 2.1 time: 0.568306 Oct 24 10:25:59.251257 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 237/464] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:58 2022] GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 => generated 1389 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:59.258079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9553645c-8b5d-4020-851e-eaaa30deef67 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:25:59.258913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9553645c-8b5d-4020-851e-eaaa30deef67 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:25:59.265004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9553645c-8b5d-4020-851e-eaaa30deef67 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:59.265729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9553645c-8b5d-4020-851e-eaaa30deef67 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:59.266174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9553645c-8b5d-4020-851e-eaaa30deef67 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:59.266949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9553645c-8b5d-4020-851e-eaaa30deef67 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:25:59.267409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9553645c-8b5d-4020-851e-eaaa30deef67 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:25:59.268026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9553645c-8b5d-4020-851e-eaaa30deef67 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:25:59.715542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9553645c-8b5d-4020-851e-eaaa30deef67 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:25:59.729089 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9553645c-8b5d-4020-851e-eaaa30deef67 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1312 microversion: 2.1 time: 0.475949 Oct 24 10:25:59.730180 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 238/465] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:25:59 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1312 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:25:59.737160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a9d0d0f6-6b45-4361-a26b-3bb9c88169a2 tempest-SecurityGroupsTestAdminJSON-16391522 tempest-SecurityGroupsTestAdminJSON-16391522-project-admin] Action: 'create', calling method: .version_select at 0x7f04d12e8790>, body: {"security_group": {"name": "tempest-securitygroup-1941383446", "description": "tempest-description-468464064"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:00.176752 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aed40c5e-9d01-422b-8d45-5e228664876a tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.011683 Oct 24 10:26:00.182928 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 228/466] 10.222.0.50 () {60 vars in 1170 bytes} [Mon Oct 24 10:25:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:00.195037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-8f3f907b-cd32-4a58-85b4-de266c49e0e5 req-f8333cee-c175-455b-b7c8-84e6b2289de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb", "name": "network-vif-unplugged", "status": "completed", "tag": "91ca1e13-d23d-4153-8e07-b972532258b3"}, {"name": "network-changed", "server_uuid": "0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb", "tag": "91ca1e13-d23d-4153-8e07-b972532258b3"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:00.206526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8f3f907b-cd32-4a58-85b4-de266c49e0e5 req-f8333cee-c175-455b-b7c8-84e6b2289de7 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:00.207376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8f3f907b-cd32-4a58-85b4-de266c49e0e5 req-f8333cee-c175-455b-b7c8-84e6b2289de7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:00.208095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8f3f907b-cd32-4a58-85b4-de266c49e0e5 req-f8333cee-c175-455b-b7c8-84e6b2289de7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:00.222430 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-8f3f907b-cd32-4a58-85b4-de266c49e0e5 req-f8333cee-c175-455b-b7c8-84e6b2289de7 service nova] Creating event network-vif-unplugged:91ca1e13-d23d-4153-8e07-b972532258b3 for instance 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb on n-h1-858383-15 Oct 24 10:26:00.223234 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-8f3f907b-cd32-4a58-85b4-de266c49e0e5 req-f8333cee-c175-455b-b7c8-84e6b2289de7 service nova] Creating event network-changed:91ca1e13-d23d-4153-8e07-b972532258b3 for instance 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb on n-h1-858383-15 Oct 24 10:26:00.229874 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-8f3f907b-cd32-4a58-85b4-de266c49e0e5 req-f8333cee-c175-455b-b7c8-84e6b2289de7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.044734 Oct 24 10:26:00.231458 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 229/467] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:00.237492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3631cafe-354d-420b-8f64-1f97c9389d62 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:00.238742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3631cafe-354d-420b-8f64-1f97c9389d62 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:00.247124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3631cafe-354d-420b-8f64-1f97c9389d62 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:00.248350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3631cafe-354d-420b-8f64-1f97c9389d62 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:00.249113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3631cafe-354d-420b-8f64-1f97c9389d62 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:00.250128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3631cafe-354d-420b-8f64-1f97c9389d62 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:00.250968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3631cafe-354d-420b-8f64-1f97c9389d62 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:00.251811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3631cafe-354d-420b-8f64-1f97c9389d62 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:00.391610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3631cafe-354d-420b-8f64-1f97c9389d62 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:00.400654 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3631cafe-354d-420b-8f64-1f97c9389d62 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148" status: 200 len: 1277 microversion: 2.1 time: 0.167721 Oct 24 10:26:00.401814 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 230/468] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:00 2022] GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:00.407728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0fc642f3-a7c7-4ba8-9c53-c7420b8da273 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:00.408485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0fc642f3-a7c7-4ba8-9c53-c7420b8da273 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:00.416407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fc642f3-a7c7-4ba8-9c53-c7420b8da273 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:00.417359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fc642f3-a7c7-4ba8-9c53-c7420b8da273 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:00.418018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fc642f3-a7c7-4ba8-9c53-c7420b8da273 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:00.418947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fc642f3-a7c7-4ba8-9c53-c7420b8da273 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:00.419799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fc642f3-a7c7-4ba8-9c53-c7420b8da273 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:00.421195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fc642f3-a7c7-4ba8-9c53-c7420b8da273 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:00.452467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-0fc642f3-a7c7-4ba8-9c53-c7420b8da273 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Lazy-loading 'flavor' on Instance uuid 78163a08-193b-424a-b63c-28148c3aa4d6 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:26:00.642792 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0fc642f3-a7c7-4ba8-9c53-c7420b8da273 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6/action" status: 202 len: 0 microversion: 2.1 time: 0.239282 Oct 24 10:26:00.644271 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 231/469] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:26:00 2022] POST /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:00.652513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-88a688b5-6f8a-4a6c-bf7b-c563cf1e5cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:00.653553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-88a688b5-6f8a-4a6c-bf7b-c563cf1e5cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:00.662225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88a688b5-6f8a-4a6c-bf7b-c563cf1e5cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:00.662950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88a688b5-6f8a-4a6c-bf7b-c563cf1e5cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:00.663559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88a688b5-6f8a-4a6c-bf7b-c563cf1e5cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:00.664632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88a688b5-6f8a-4a6c-bf7b-c563cf1e5cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:00.665256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88a688b5-6f8a-4a6c-bf7b-c563cf1e5cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:00.667144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88a688b5-6f8a-4a6c-bf7b-c563cf1e5cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:00.800821 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a9d0d0f6-6b45-4361-a26b-3bb9c88169a2 tempest-SecurityGroupsTestAdminJSON-16391522 tempest-SecurityGroupsTestAdminJSON-16391522-project-admin] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.067196 Oct 24 10:26:00.803275 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 239/470] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:25:59 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:00.813097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-e5a34011-8968-4d42-b13b-6006c9a23420 req-f15ad719-def5-4e8d-808c-173a48c318ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4f83cc-06a0-4a8e-b480-1878d348e1d1", "name": "network-vif-plugged", "status": "completed", "tag": "fbe95751-507c-435d-b75f-b10bd1579493"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:00.840648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e5a34011-8968-4d42-b13b-6006c9a23420 req-f15ad719-def5-4e8d-808c-173a48c318ea service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:00.843248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e5a34011-8968-4d42-b13b-6006c9a23420 req-f15ad719-def5-4e8d-808c-173a48c318ea service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:00.845062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e5a34011-8968-4d42-b13b-6006c9a23420 req-f15ad719-def5-4e8d-808c-173a48c318ea service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:00.866774 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-e5a34011-8968-4d42-b13b-6006c9a23420 req-f15ad719-def5-4e8d-808c-173a48c318ea service nova] Creating event network-vif-plugged:fbe95751-507c-435d-b75f-b10bd1579493 for instance 9d4f83cc-06a0-4a8e-b480-1878d348e1d1 on n-h2-858383-15 Oct 24 10:26:00.872620 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-e5a34011-8968-4d42-b13b-6006c9a23420 req-f15ad719-def5-4e8d-808c-173a48c318ea service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067735 Oct 24 10:26:00.873673 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 240/471] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:00.881530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d172f28d-15b1-49d3-a0dc-ee40852ebc07 tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] Action: 'create', calling method: .version_select at 0x7f04d12203a0>, body: {"pool": null} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:01.057578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-88a688b5-6f8a-4a6c-bf7b-c563cf1e5cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:01.068397 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-88a688b5-6f8a-4a6c-bf7b-c563cf1e5cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1503 microversion: 2.1 time: 0.422615 Oct 24 10:26:01.077629 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 232/472] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:00 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1503 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:01.086748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d8bed996-ecdd-43e2-813d-aaa077f1b7b4 req-04770ca1-c2fb-4aeb-bfde-2edd30640f90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b0b8d04-8d85-4df1-a921-2ff9ef9d6424", "tag": "ff6086af-6880-43bf-9ea1-7af1f73f488a"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:01.097924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d8bed996-ecdd-43e2-813d-aaa077f1b7b4 req-04770ca1-c2fb-4aeb-bfde-2edd30640f90 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:01.098784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d8bed996-ecdd-43e2-813d-aaa077f1b7b4 req-04770ca1-c2fb-4aeb-bfde-2edd30640f90 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:01.100219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d8bed996-ecdd-43e2-813d-aaa077f1b7b4 req-04770ca1-c2fb-4aeb-bfde-2edd30640f90 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:01.105774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:01.117788 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d8bed996-ecdd-43e2-813d-aaa077f1b7b4 req-04770ca1-c2fb-4aeb-bfde-2edd30640f90 service nova] Creating event network-changed:ff6086af-6880-43bf-9ea1-7af1f73f488a for instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 on n-h2-858383-15 Oct 24 10:26:01.125949 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d8bed996-ecdd-43e2-813d-aaa077f1b7b4 req-04770ca1-c2fb-4aeb-bfde-2edd30640f90 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045775 Oct 24 10:26:01.127166 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 233/473] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:01.136468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7d6da94f-0011-4613-9cbe-c71dedaab320 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:01.137460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7d6da94f-0011-4613-9cbe-c71dedaab320 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:01.151535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d6da94f-0011-4613-9cbe-c71dedaab320 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:01.152334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d6da94f-0011-4613-9cbe-c71dedaab320 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:01.153003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d6da94f-0011-4613-9cbe-c71dedaab320 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:01.153795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d6da94f-0011-4613-9cbe-c71dedaab320 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:01.154318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d6da94f-0011-4613-9cbe-c71dedaab320 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:01.154814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d6da94f-0011-4613-9cbe-c71dedaab320 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:01.637678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7d6da94f-0011-4613-9cbe-c71dedaab320 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:01.653804 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7d6da94f-0011-4613-9cbe-c71dedaab320 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424" status: 200 len: 1389 microversion: 2.1 time: 0.523329 Oct 24 10:26:01.672391 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 234/474] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:01 2022] GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 => generated 1389 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:01.685679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-39f16e0c-fc10-4494-9a5f-c3389b3ae9c8 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:01.686748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-39f16e0c-fc10-4494-9a5f-c3389b3ae9c8 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:01.698762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39f16e0c-fc10-4494-9a5f-c3389b3ae9c8 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:01.699730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39f16e0c-fc10-4494-9a5f-c3389b3ae9c8 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:01.700422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39f16e0c-fc10-4494-9a5f-c3389b3ae9c8 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:01.703935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39f16e0c-fc10-4494-9a5f-c3389b3ae9c8 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:01.705432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39f16e0c-fc10-4494-9a5f-c3389b3ae9c8 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:01.706111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39f16e0c-fc10-4494-9a5f-c3389b3ae9c8 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:02.853989 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-39f16e0c-fc10-4494-9a5f-c3389b3ae9c8 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 200 len: 1633 microversion: 2.1 time: 1.176659 Oct 24 10:26:02.856716 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 235/475] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:01 2022] GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 1633 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:02.869846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3692a733-2c73-4e62-bb31-30636c56579f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:02.870493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3692a733-2c73-4e62-bb31-30636c56579f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:02.877327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3692a733-2c73-4e62-bb31-30636c56579f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:02.877983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3692a733-2c73-4e62-bb31-30636c56579f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:02.878424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3692a733-2c73-4e62-bb31-30636c56579f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:02.879127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3692a733-2c73-4e62-bb31-30636c56579f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:02.879582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3692a733-2c73-4e62-bb31-30636c56579f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:02.880004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3692a733-2c73-4e62-bb31-30636c56579f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:03.311443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3692a733-2c73-4e62-bb31-30636c56579f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:03.320037 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3692a733-2c73-4e62-bb31-30636c56579f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1312 microversion: 2.1 time: 0.461586 Oct 24 10:26:03.320623 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 236/476] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:02 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1312 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:03.326044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6e65bde6-1809-4225-8bbc-526b6154ce9e tempest-SecurityGroupsTestAdminJSON-16391522 tempest-SecurityGroupsTestAdminJSON-16391522-project-admin] Calling method '.version_select at 0x7f04d11b2e50>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:05.230919 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d172f28d-15b1-49d3-a0dc-ee40852ebc07 tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.355619 Oct 24 10:26:05.231597 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 241/477] 10.222.0.50 () {60 vars in 1170 bytes} [Mon Oct 24 10:26:00 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:05.238047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aff775b5-53bb-45bf-bcef-02991426f844 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:05.238989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aff775b5-53bb-45bf-bcef-02991426f844 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:05.248801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aff775b5-53bb-45bf-bcef-02991426f844 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:05.249616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aff775b5-53bb-45bf-bcef-02991426f844 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:05.250212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aff775b5-53bb-45bf-bcef-02991426f844 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:05.251094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aff775b5-53bb-45bf-bcef-02991426f844 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:05.251709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aff775b5-53bb-45bf-bcef-02991426f844 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:05.252354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aff775b5-53bb-45bf-bcef-02991426f844 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:05.570677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aff775b5-53bb-45bf-bcef-02991426f844 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:05.580893 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aff775b5-53bb-45bf-bcef-02991426f844 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148" status: 200 len: 1319 microversion: 2.1 time: 0.347644 Oct 24 10:26:05.592909 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 242/478] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:05 2022] GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:05.606435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c8a71df6-5778-490f-ae89-32394d888b19 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:05.607066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c8a71df6-5778-490f-ae89-32394d888b19 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:05.615349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8a71df6-5778-490f-ae89-32394d888b19 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:05.616644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8a71df6-5778-490f-ae89-32394d888b19 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:05.617268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8a71df6-5778-490f-ae89-32394d888b19 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:05.618894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8a71df6-5778-490f-ae89-32394d888b19 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:05.620667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8a71df6-5778-490f-ae89-32394d888b19 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:05.621369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8a71df6-5778-490f-ae89-32394d888b19 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:05.912720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c8a71df6-5778-490f-ae89-32394d888b19 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:05.921220 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c8a71df6-5778-490f-ae89-32394d888b19 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1503 microversion: 2.1 time: 0.327003 Oct 24 10:26:05.930289 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 243/479] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:05 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1503 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:05.937242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-4ddff457-d818-4a12-ac94-6162fb5c842f req-7a82b3be-dc89-4245-b798-abb60616add9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "425fa2bd-76f6-419a-a7be-64d6703f2148", "tag": "d55a3b43-f0e3-4eae-9037-b14ac2478139"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:05.947020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4ddff457-d818-4a12-ac94-6162fb5c842f req-7a82b3be-dc89-4245-b798-abb60616add9 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:05.947649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4ddff457-d818-4a12-ac94-6162fb5c842f req-7a82b3be-dc89-4245-b798-abb60616add9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:05.948185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4ddff457-d818-4a12-ac94-6162fb5c842f req-7a82b3be-dc89-4245-b798-abb60616add9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:05.965771 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-4ddff457-d818-4a12-ac94-6162fb5c842f req-7a82b3be-dc89-4245-b798-abb60616add9 service nova] Creating event network-changed:d55a3b43-f0e3-4eae-9037-b14ac2478139 for instance 425fa2bd-76f6-419a-a7be-64d6703f2148 on n-h1-858383-15 Oct 24 10:26:05.970472 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-4ddff457-d818-4a12-ac94-6162fb5c842f req-7a82b3be-dc89-4245-b798-abb60616add9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037597 Oct 24 10:26:05.971414 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 244/480] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:05.977588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fa82afce-89a3-4f2f-8176-f98f4463e26a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:05.981211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fa82afce-89a3-4f2f-8176-f98f4463e26a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:05.987576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa82afce-89a3-4f2f-8176-f98f4463e26a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:05.988278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa82afce-89a3-4f2f-8176-f98f4463e26a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:05.988769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa82afce-89a3-4f2f-8176-f98f4463e26a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:05.989462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa82afce-89a3-4f2f-8176-f98f4463e26a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:05.990681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa82afce-89a3-4f2f-8176-f98f4463e26a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:05.991122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa82afce-89a3-4f2f-8176-f98f4463e26a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:06.389159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fa82afce-89a3-4f2f-8176-f98f4463e26a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:06.399382 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fa82afce-89a3-4f2f-8176-f98f4463e26a tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424" status: 200 len: 1389 microversion: 2.1 time: 0.426617 Oct 24 10:26:06.400212 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 245/481] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:05 2022] GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 => generated 1389 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:06.404766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9acf5940-b156-4311-b4f0-426584a036b9 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:06.405671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9acf5940-b156-4311-b4f0-426584a036b9 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:06.412391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9acf5940-b156-4311-b4f0-426584a036b9 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:06.413026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9acf5940-b156-4311-b4f0-426584a036b9 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:06.413684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9acf5940-b156-4311-b4f0-426584a036b9 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:06.414507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9acf5940-b156-4311-b4f0-426584a036b9 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:06.415189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9acf5940-b156-4311-b4f0-426584a036b9 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:06.415711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9acf5940-b156-4311-b4f0-426584a036b9 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:06.705156 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9acf5940-b156-4311-b4f0-426584a036b9 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 200 len: 1616 microversion: 2.1 time: 0.303743 Oct 24 10:26:06.709832 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 246/482] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:06 2022] GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 1616 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:06.745466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-036e5939-918d-474e-a12a-fbf2bacb8c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:06.749210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-036e5939-918d-474e-a12a-fbf2bacb8c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:06.792171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-036e5939-918d-474e-a12a-fbf2bacb8c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:06.795087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-036e5939-918d-474e-a12a-fbf2bacb8c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:06.798016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-036e5939-918d-474e-a12a-fbf2bacb8c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:06.801694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-036e5939-918d-474e-a12a-fbf2bacb8c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:06.805030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-036e5939-918d-474e-a12a-fbf2bacb8c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:06.806044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-036e5939-918d-474e-a12a-fbf2bacb8c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:06.836454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:07.196716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-036e5939-918d-474e-a12a-fbf2bacb8c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:07.206386 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-036e5939-918d-474e-a12a-fbf2bacb8c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1461 microversion: 2.1 time: 0.492324 Oct 24 10:26:07.207314 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 247/483] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:06 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1461 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:07.225405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a61755aa-6631-4ec2-bd08-85c42c162844 tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] Action: 'create', calling method: .version_select at 0x7f04d11d3700>, body: {"pool": null} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:07.336371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:07.377077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=43 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:08.729812 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6e65bde6-1809-4225-8bbc-526b6154ce9e tempest-SecurityGroupsTestAdminJSON-16391522 tempest-SecurityGroupsTestAdminJSON-16391522-project-admin] 10.222.0.50 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12425 microversion: 2.1 time: 5.407158 Oct 24 10:26:08.731023 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 237/484] 10.222.0.50 () {58 vars in 1191 bytes} [Mon Oct 24 10:26:03 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12425 bytes in 5410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:26:08.741391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e5d71271-1128-4097-8aed-a421f3a16928 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:08.742642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e5d71271-1128-4097-8aed-a421f3a16928 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:08.753274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5d71271-1128-4097-8aed-a421f3a16928 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:08.754118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5d71271-1128-4097-8aed-a421f3a16928 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:08.754799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5d71271-1128-4097-8aed-a421f3a16928 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:08.755904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5d71271-1128-4097-8aed-a421f3a16928 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:08.756961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5d71271-1128-4097-8aed-a421f3a16928 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:08.757737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5d71271-1128-4097-8aed-a421f3a16928 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:09.282586 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a61755aa-6631-4ec2-bd08-85c42c162844 tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.071905 Oct 24 10:26:09.283605 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 248/485] 10.222.0.50 () {60 vars in 1170 bytes} [Mon Oct 24 10:26:07 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:09.286664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e5d71271-1128-4097-8aed-a421f3a16928 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:09.290027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-33d9df95-ef2f-400c-83f9-d903dffb0a2c tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:09.292042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-33d9df95-ef2f-400c-83f9-d903dffb0a2c tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:09.295219 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e5d71271-1128-4097-8aed-a421f3a16928 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148" status: 200 len: 1319 microversion: 2.1 time: 0.562808 Oct 24 10:26:09.295841 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 238/486] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:08 2022] GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 => generated 1319 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:09.299679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33d9df95-ef2f-400c-83f9-d903dffb0a2c tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:09.300433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33d9df95-ef2f-400c-83f9-d903dffb0a2c tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:09.301197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33d9df95-ef2f-400c-83f9-d903dffb0a2c tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:09.302873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33d9df95-ef2f-400c-83f9-d903dffb0a2c tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:09.303811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33d9df95-ef2f-400c-83f9-d903dffb0a2c tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:09.304388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33d9df95-ef2f-400c-83f9-d903dffb0a2c tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:09.360781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-28b9acb8-7547-4317-97f1-7100b05a7adf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-239593012", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "ec1a4d9a-2e78-407d-b33a-563721c9877e"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:09.393628 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-33d9df95-ef2f-400c-83f9-d903dffb0a2c tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] HTTP exception thrown: Cannot 'migrate' instance 78163a08-193b-424a-b63c-28148c3aa4d6 while it is in vm_state suspended Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-33d9df95-ef2f-400c-83f9-d903dffb0a2c tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Request method failure captured: Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6/action HTTP/1.1 Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 15 Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmf-iJMf-xkxwpA4hOnuDQ3XLjFQx3sh8zCo3hWzHIEPufcBoqDTfnb9tPSpPc3ZzZOwhOn0yEJc4_PddiGqY3Xc1WokrUJzsI2k99QfZAnX49j06Cn2JlfARc02kF81pfNMC06HK-hQyNamDZs2xpM-JgzpIl3KIz3KeB1eCRMG6-8 Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: b486c05e7b1d40bab8433eaea3c54843 Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1104205387 Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:26:09.395405 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:26:09.397132 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b486c05e7b1d40bab8433eaea3c54843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b486c05e7b1d40bab8433eaea3c54843"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b486c05e7b1d40bab8433eaea3c54843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b486c05e7b1d40bab8433eaea3c54843", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:09.397132 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1104205387 Oct 24 10:26:09.397132 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: b486c05e7b1d40bab8433eaea3c54843 Oct 24 10:26:09.397132 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1104205387 Oct 24 10:26:09.397132 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersAdminNegativeTestJSON-1104205387-project-admin Oct 24 10:26:09.397132 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:26:09.397132 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:26:09.397132 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 8f00ff0c95884b7b9ff5547c841976a0 Oct 24 10:26:09.397132 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1104205387-project-admin Oct 24 10:26:09.397132 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:26:09.397132 n-d-858383-15 devstack@n-api.service[120426]: {"migrate": {}} Oct 24 10:26:09.397132 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:26:09.397132 n-d-858383-15 devstack@n-api.service[120426]: exception: Cannot 'migrate' instance 78163a08-193b-424a-b63c-28148c3aa4d6 while it is in vm_state suspended Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '78163a08-193b-424a-b63c-28148c3aa4d6', 'body': {'migrate': {}}} Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 78163a08-193b-424a-b63c-28148c3aa4d6 in vm_state suspended. Cannot resize while the instance is in this state. Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:09.398112 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 78163a08-193b-424a-b63c-28148c3aa4d6 while it is in vm_state suspended Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:09.399567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:09.405091 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:09.405091 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:09.405091 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 78163a08-193b-424a-b63c-28148c3aa4d6 while it is in vm_state suspended Oct 24 10:26:09.405091 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:09.405091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-33d9df95-ef2f-400c-83f9-d903dffb0a2c tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Returning 409 to user: Cannot 'migrate' instance 78163a08-193b-424a-b63c-28148c3aa4d6 while it is in vm_state suspended {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:09.405091 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-33d9df95-ef2f-400c-83f9-d903dffb0a2c tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6/action" status: 409 len: 148 microversion: 2.1 time: 0.112125 Oct 24 10:26:09.405091 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 249/487] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:26:09 2022] POST /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6/action => generated 148 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:26:09.408037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2b5416ea-46c7-42a5-8289-7596284f9729 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:09.409132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2b5416ea-46c7-42a5-8289-7596284f9729 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:09.415186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b5416ea-46c7-42a5-8289-7596284f9729 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:09.415675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b5416ea-46c7-42a5-8289-7596284f9729 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:09.416111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b5416ea-46c7-42a5-8289-7596284f9729 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:09.416810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b5416ea-46c7-42a5-8289-7596284f9729 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:09.417381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b5416ea-46c7-42a5-8289-7596284f9729 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:09.417849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b5416ea-46c7-42a5-8289-7596284f9729 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:09.420278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-28b9acb8-7547-4317-97f1-7100b05a7adf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] validate_networks() for [('ec1a4d9a-2e78-407d-b33a-563721c9877e', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:26:09.622479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2b5416ea-46c7-42a5-8289-7596284f9729 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:09.630410 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2b5416ea-46c7-42a5-8289-7596284f9729 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1493 microversion: 2.1 time: 0.226025 Oct 24 10:26:09.630994 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 250/488] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:09 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1493 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:09.635582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a3dbb849-9a34-4301-9150-f976de07be59 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:09.637896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a3dbb849-9a34-4301-9150-f976de07be59 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:09.643863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3dbb849-9a34-4301-9150-f976de07be59 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:09.644361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3dbb849-9a34-4301-9150-f976de07be59 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:09.644804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3dbb849-9a34-4301-9150-f976de07be59 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:09.645534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3dbb849-9a34-4301-9150-f976de07be59 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:09.646001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3dbb849-9a34-4301-9150-f976de07be59 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:09.646428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3dbb849-9a34-4301-9150-f976de07be59 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:09.735960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a3dbb849-9a34-4301-9150-f976de07be59 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:09.744058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a3dbb849-9a34-4301-9150-f976de07be59 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Old instance type m1.heat2, new instance type m1.heat {{(pid=120426) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 24 10:26:09.752189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a3dbb849-9a34-4301-9150-f976de07be59 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:26:09.752569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a3dbb849-9a34-4301-9150-f976de07be59 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:26:09.753071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a3dbb849-9a34-4301-9150-f976de07be59 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:26:09.753500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a3dbb849-9a34-4301-9150-f976de07be59 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:26:09.754453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a3dbb849-9a34-4301-9150-f976de07be59 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:26:09.870679 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a3dbb849-9a34-4301-9150-f976de07be59 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "POST /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1/action" status: 202 len: 0 microversion: 2.1 time: 0.238622 Oct 24 10:26:09.874420 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 251/489] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:26:09 2022] POST /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:09.878186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7d18b81f-a4d7-43be-8061-580d05ddd8e8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:09.878800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7d18b81f-a4d7-43be-8061-580d05ddd8e8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:09.883077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-28b9acb8-7547-4317-97f1-7100b05a7adf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:26:09.883538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-28b9acb8-7547-4317-97f1-7100b05a7adf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:26:09.884881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d18b81f-a4d7-43be-8061-580d05ddd8e8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:09.885373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d18b81f-a4d7-43be-8061-580d05ddd8e8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:09.885804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d18b81f-a4d7-43be-8061-580d05ddd8e8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:09.886500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d18b81f-a4d7-43be-8061-580d05ddd8e8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:09.886646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-28b9acb8-7547-4317-97f1-7100b05a7adf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:26:09.886945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d18b81f-a4d7-43be-8061-580d05ddd8e8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:09.887053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-28b9acb8-7547-4317-97f1-7100b05a7adf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:26:09.887364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d18b81f-a4d7-43be-8061-580d05ddd8e8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:09.887481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-28b9acb8-7547-4317-97f1-7100b05a7adf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:26:09.905199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28b9acb8-7547-4317-97f1-7100b05a7adf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:09.905987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28b9acb8-7547-4317-97f1-7100b05a7adf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:09.907475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28b9acb8-7547-4317-97f1-7100b05a7adf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:09.908417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28b9acb8-7547-4317-97f1-7100b05a7adf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:09.909095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28b9acb8-7547-4317-97f1-7100b05a7adf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:09.909676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28b9acb8-7547-4317-97f1-7100b05a7adf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:09.929325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-28b9acb8-7547-4317-97f1-7100b05a7adf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Getting quotas for project 2afb2a59a2134fe0a2903b9591cc522b. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:26:09.934907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-28b9acb8-7547-4317-97f1-7100b05a7adf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Getting quotas for user ef304f0a2ef54385b985dd16fa1b35c8 and project 2afb2a59a2134fe0a2903b9591cc522b. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:26:09.947967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-28b9acb8-7547-4317-97f1-7100b05a7adf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:26:09.950278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-28b9acb8-7547-4317-97f1-7100b05a7adf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:26:09.998762 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-28b9acb8-7547-4317-97f1-7100b05a7adf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701572 Oct 24 10:26:10.005150 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 239/490] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:26:10.005150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-fc306b57-8ab6-4edf-98d5-d0da55899e9e req-e93b502f-a63c-453c-b4a2-b4152fba2347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0b8d04-8d85-4df1-a921-2ff9ef9d6424", "name": "network-vif-plugged", "status": "completed", "tag": "ff6086af-6880-43bf-9ea1-7af1f73f488a"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:10.014817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fc306b57-8ab6-4edf-98d5-d0da55899e9e req-e93b502f-a63c-453c-b4a2-b4152fba2347 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:10.015300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fc306b57-8ab6-4edf-98d5-d0da55899e9e req-e93b502f-a63c-453c-b4a2-b4152fba2347 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:10.015730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fc306b57-8ab6-4edf-98d5-d0da55899e9e req-e93b502f-a63c-453c-b4a2-b4152fba2347 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:10.027549 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-fc306b57-8ab6-4edf-98d5-d0da55899e9e req-e93b502f-a63c-453c-b4a2-b4152fba2347 service nova] Creating event network-vif-plugged:ff6086af-6880-43bf-9ea1-7af1f73f488a for instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 on n-h2-858383-15 Oct 24 10:26:10.032912 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-fc306b57-8ab6-4edf-98d5-d0da55899e9e req-e93b502f-a63c-453c-b4a2-b4152fba2347 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032372 Oct 24 10:26:10.039247 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 240/491] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:10.045563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-89e12118-3f5f-410c-9d8a-6c6cda1c26c9 tempest-SecurityGroupsTestAdminJSON-683265230 tempest-SecurityGroupsTestAdminJSON-683265230-project] Calling method '.version_select at 0x7f04d1174d30>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:10.109168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7d18b81f-a4d7-43be-8061-580d05ddd8e8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:10.124318 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7d18b81f-a4d7-43be-8061-580d05ddd8e8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424" status: 200 len: 1389 microversion: 2.1 time: 0.251638 Oct 24 10:26:10.124923 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 252/492] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:09 2022] GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 => generated 1389 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:10.131461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-68f179c6-f375-461d-9933-ecae5e4c5dbf tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] Calling method '.version_select at 0x7f04d12201f0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:10.423040 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-68f179c6-f375-461d-9933-ecae5e4c5dbf tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/a497019d-58ca-4733-8df0-061f763286fa" status: 200 len: 142 microversion: 2.1 time: 0.296907 Oct 24 10:26:10.423821 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 253/493] 10.222.0.50 () {58 vars in 1260 bytes} [Mon Oct 24 10:26:10 2022] GET /compute/v2.1/os-floating-ips/a497019d-58ca-4733-8df0-061f763286fa => generated 142 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:10.426599 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-89e12118-3f5f-410c-9d8a-6c6cda1c26c9 tempest-SecurityGroupsTestAdminJSON-683265230 tempest-SecurityGroupsTestAdminJSON-683265230-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 0.385173 Oct 24 10:26:10.427950 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 241/494] 10.222.0.50 () {58 vars in 1191 bytes} [Mon Oct 24 10:26:10 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:10.432797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5171ccd2-2ab8-4221-b244-5d280368e699 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '.version_select at 0x7f04d12a8dc0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:10.439214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5171ccd2-2ab8-4221-b244-5d280368e699 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:10.445527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5171ccd2-2ab8-4221-b244-5d280368e699 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:10.446628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a7f62a37-12a8-4502-afa7-bfa09480e69f tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a7f62a37-12a8-4502-afa7-bfa09480e69f tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Request method failure captured: Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e/action HTTP/1.1 Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 39 Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmf-iJMf-xkxwpA4hOnuDQ3XLjFQx3sh8zCo3hWzHIEPufcBoqDTfnb9tPSpPc3ZzZOwhOn0yEJc4_PddiGqY3Xc1WokrUJzsI2k99QfZAnX49j06Cn2JlfARc02kF81pfNMC06HK-hQyNamDZs2xpM-JgzpIl3KIz3KeB1eCRMG6-8 Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: b486c05e7b1d40bab8433eaea3c54843 Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1104205387 Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:26:10.450300 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:26:10.451608 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b486c05e7b1d40bab8433eaea3c54843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b486c05e7b1d40bab8433eaea3c54843"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b486c05e7b1d40bab8433eaea3c54843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b486c05e7b1d40bab8433eaea3c54843", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:10.451608 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1104205387 Oct 24 10:26:10.451608 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: b486c05e7b1d40bab8433eaea3c54843 Oct 24 10:26:10.451608 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1104205387 Oct 24 10:26:10.451608 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersAdminNegativeTestJSON-1104205387-project-admin Oct 24 10:26:10.451608 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:26:10.451608 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:26:10.451608 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 8f00ff0c95884b7b9ff5547c841976a0 Oct 24 10:26:10.451608 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1104205387-project-admin Oct 24 10:26:10.451608 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:26:10.451608 n-d-858383-15 devstack@n-api.service[120426]: {"os-resetState": {"state": "invalid"}} Oct 24 10:26:10.451608 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '012048e0-d21f-4bff-8616-81d284df270e', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'invalid' Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:10.452282 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:26:10.453683 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 24 10:26:10.456630 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:10.456630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a7f62a37-12a8-4502-afa7-bfa09480e69f tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:10.456956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5171ccd2-2ab8-4221-b244-5d280368e699 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:10.457122 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a7f62a37-12a8-4502-afa7-bfa09480e69f tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e/action" status: 400 len: 144 microversion: 2.1 time: 0.015748 Oct 24 10:26:10.457122 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 254/495] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:26:10 2022] POST /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e/action => generated 144 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:26:10.467163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-058c5eca-9d46-4c0e-8434-975207f0dc94 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:10.469063 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5171ccd2-2ab8-4221-b244-5d280368e699 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1145 microversion: 2.1 time: 0.039604 Oct 24 10:26:10.470101 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 242/496] 10.222.0.50 () {58 vars in 1143 bytes} [Mon Oct 24 10:26:10 2022] GET /compute/v2.1/os-migrations => generated 1145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:10.475919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-058c5eca-9d46-4c0e-8434-975207f0dc94 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:10.479532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-32b27095-b8ea-4e86-942d-bec2b1657d7b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:10.481727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-32b27095-b8ea-4e86-942d-bec2b1657d7b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:10.487263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-058c5eca-9d46-4c0e-8434-975207f0dc94 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:10.487811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-058c5eca-9d46-4c0e-8434-975207f0dc94 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:10.488254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-058c5eca-9d46-4c0e-8434-975207f0dc94 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:10.488992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-058c5eca-9d46-4c0e-8434-975207f0dc94 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:10.489453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-058c5eca-9d46-4c0e-8434-975207f0dc94 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:10.490783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-058c5eca-9d46-4c0e-8434-975207f0dc94 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:10.564169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-32b27095-b8ea-4e86-942d-bec2b1657d7b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:10.573636 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-32b27095-b8ea-4e86-942d-bec2b1657d7b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 200 len: 1223 microversion: 2.1 time: 0.102422 Oct 24 10:26:10.574940 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 243/497] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:10 2022] GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:10.579586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5c9b0125-51b8-484d-99cc-5c73d584dbc9 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:10.580404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c9b0125-51b8-484d-99cc-5c73d584dbc9 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:10.587469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c9b0125-51b8-484d-99cc-5c73d584dbc9 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:10.588033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c9b0125-51b8-484d-99cc-5c73d584dbc9 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:10.588543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c9b0125-51b8-484d-99cc-5c73d584dbc9 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:10.589357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c9b0125-51b8-484d-99cc-5c73d584dbc9 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:10.589813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c9b0125-51b8-484d-99cc-5c73d584dbc9 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:10.590237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c9b0125-51b8-484d-99cc-5c73d584dbc9 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:10.722798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-058c5eca-9d46-4c0e-8434-975207f0dc94 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:10.731475 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-058c5eca-9d46-4c0e-8434-975207f0dc94 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1470 microversion: 2.1 time: 0.274289 Oct 24 10:26:10.732097 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 255/498] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:10 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1470 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:10.754939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ab540936-98bb-48d7-9d58-178a7206c825 tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] Calling method '.version_select at 0x7f04d12184c0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:10.877978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5c9b0125-51b8-484d-99cc-5c73d584dbc9 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:10.889541 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5c9b0125-51b8-484d-99cc-5c73d584dbc9 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148" status: 200 len: 1319 microversion: 2.1 time: 0.313102 Oct 24 10:26:10.905837 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 244/499] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:10 2022] GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:10.910968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9c5602f5-71fe-4c83-9b35-ca4589718521 tempest-SecurityGroupsTestAdminJSON-16391522 tempest-SecurityGroupsTestAdminJSON-16391522-project-admin] Calling method '.version_select at 0x7f04d11d2b80>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:11.318004 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9c5602f5-71fe-4c83-9b35-ca4589718521 tempest-SecurityGroupsTestAdminJSON-16391522 tempest-SecurityGroupsTestAdminJSON-16391522-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/a310310e-cf84-466d-9b19-d5053c90cdd5" status: 202 len: 0 microversion: 2.1 time: 0.410851 Oct 24 10:26:11.318761 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 245/500] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:26:10 2022] DELETE /compute/v2.1/os-security-groups/a310310e-cf84-466d-9b19-d5053c90cdd5 => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:11.324372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a08ddfca-fcf4-4b64-9f13-b017ba59a293 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a08ddfca-fcf4-4b64-9f13-b017ba59a293 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Request method failure captured: Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e/action HTTP/1.1 Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 31 Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmf-iJMf-xkxwpA4hOnuDQ3XLjFQx3sh8zCo3hWzHIEPufcBoqDTfnb9tPSpPc3ZzZOwhOn0yEJc4_PddiGqY3Xc1WokrUJzsI2k99QfZAnX49j06Cn2JlfARc02kF81pfNMC06HK-hQyNamDZs2xpM-JgzpIl3KIz3KeB1eCRMG6-8 Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: b486c05e7b1d40bab8433eaea3c54843 Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1104205387 Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:26:11.328159 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:26:11.329738 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b486c05e7b1d40bab8433eaea3c54843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b486c05e7b1d40bab8433eaea3c54843"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b486c05e7b1d40bab8433eaea3c54843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b486c05e7b1d40bab8433eaea3c54843", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:11.329738 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1104205387 Oct 24 10:26:11.329738 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: b486c05e7b1d40bab8433eaea3c54843 Oct 24 10:26:11.329738 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1104205387 Oct 24 10:26:11.329738 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersAdminNegativeTestJSON-1104205387-project-admin Oct 24 10:26:11.329738 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:26:11.329738 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:26:11.329738 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 8f00ff0c95884b7b9ff5547c841976a0 Oct 24 10:26:11.329738 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1104205387-project-admin Oct 24 10:26:11.329738 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:26:11.329738 n-d-858383-15 devstack@n-api.service[120425]: {"os-resetState": {"state": 1}} Oct 24 10:26:11.329738 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:26:11.329738 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '012048e0-d21f-4bff-8616-81d284df270e', 'body': {'os-resetState': {'state': 1}}} Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 1 Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:11.330894 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 24 10:26:11.332260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:11.334357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a08ddfca-fcf4-4b64-9f13-b017ba59a293 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:11.334357 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a08ddfca-fcf4-4b64-9f13-b017ba59a293 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e/action" status: 400 len: 120 microversion: 2.1 time: 0.010901 Oct 24 10:26:11.334357 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 246/501] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:26:11 2022] POST /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e/action => generated 120 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:26:11.336766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-35b0ba4c-b596-4e2f-b0c1-83047141917b tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:11.336766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-35b0ba4c-b596-4e2f-b0c1-83047141917b tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:11.344889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35b0ba4c-b596-4e2f-b0c1-83047141917b tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:11.345525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35b0ba4c-b596-4e2f-b0c1-83047141917b tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:11.346673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35b0ba4c-b596-4e2f-b0c1-83047141917b tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:11.346789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35b0ba4c-b596-4e2f-b0c1-83047141917b tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:11.347306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35b0ba4c-b596-4e2f-b0c1-83047141917b tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:11.347792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35b0ba4c-b596-4e2f-b0c1-83047141917b tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:11.564426 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-35b0ba4c-b596-4e2f-b0c1-83047141917b tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1646 microversion: 2.1 time: 0.231537 Oct 24 10:26:11.565097 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 247/502] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:11 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1646 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:11.570425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f699f0b8-fbb5-457b-9792-975d39a3809c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:11.571238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f699f0b8-fbb5-457b-9792-975d39a3809c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:11.577076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f699f0b8-fbb5-457b-9792-975d39a3809c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:11.577732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f699f0b8-fbb5-457b-9792-975d39a3809c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:11.578362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f699f0b8-fbb5-457b-9792-975d39a3809c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:11.579061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f699f0b8-fbb5-457b-9792-975d39a3809c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:11.579720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f699f0b8-fbb5-457b-9792-975d39a3809c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:11.580139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f699f0b8-fbb5-457b-9792-975d39a3809c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:11.866009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f699f0b8-fbb5-457b-9792-975d39a3809c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:11.876070 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f699f0b8-fbb5-457b-9792-975d39a3809c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424" status: 200 len: 1389 microversion: 2.1 time: 0.309802 Oct 24 10:26:11.876649 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 248/503] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:11 2022] GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 => generated 1389 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:11.883260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d6a89980-f122-4732-8556-ee959e644f66 tempest-SecurityGroupsTestAdminJSON-16391522 tempest-SecurityGroupsTestAdminJSON-16391522-project-admin] Calling method '.version_select at 0x7f04d10acf70>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:12.074452 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ab540936-98bb-48d7-9d58-178a7206c825 tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/a497019d-58ca-4733-8df0-061f763286fa" status: 202 len: 0 microversion: 2.1 time: 1.341304 Oct 24 10:26:12.075088 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 256/504] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:26:10 2022] DELETE /compute/v2.1/os-floating-ips/a497019d-58ca-4733-8df0-061f763286fa => generated 0 bytes in 1342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:12.079753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d8755aa-fb8b-49f3-b741-a6a84a1292e9 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:12.082500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2d8755aa-fb8b-49f3-b741-a6a84a1292e9 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Failed to fetch instance by id 999 {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 24 10:26:12.083040 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-2d8755aa-fb8b-49f3-b741-a6a84a1292e9 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d8755aa-fb8b-49f3-b741-a6a84a1292e9 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Request method failure captured: Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 37 Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmf-iJMf-xkxwpA4hOnuDQ3XLjFQx3sh8zCo3hWzHIEPufcBoqDTfnb9tPSpPc3ZzZOwhOn0yEJc4_PddiGqY3Xc1WokrUJzsI2k99QfZAnX49j06Cn2JlfARc02kF81pfNMC06HK-hQyNamDZs2xpM-JgzpIl3KIz3KeB1eCRMG6-8 Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: b486c05e7b1d40bab8433eaea3c54843 Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1104205387 Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:26:12.084791 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:26:12.086493 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b486c05e7b1d40bab8433eaea3c54843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b486c05e7b1d40bab8433eaea3c54843"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b486c05e7b1d40bab8433eaea3c54843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b486c05e7b1d40bab8433eaea3c54843", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:12.086493 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1104205387 Oct 24 10:26:12.086493 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: b486c05e7b1d40bab8433eaea3c54843 Oct 24 10:26:12.086493 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1104205387 Oct 24 10:26:12.086493 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersAdminNegativeTestJSON-1104205387-project-admin Oct 24 10:26:12.086493 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:26:12.086493 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:26:12.086493 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 8f00ff0c95884b7b9ff5547c841976a0 Oct 24 10:26:12.086493 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1104205387-project-admin Oct 24 10:26:12.086493 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:26:12.086493 n-d-858383-15 devstack@n-api.service[120426]: {"os-resetState": {"state": "error"}} Oct 24 10:26:12.086493 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:26:12.086493 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 999 could not be found. Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:26:12.087542 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 24 10:26:12.088974 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 24 10:26:12.088974 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:26:12.088974 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:26:12.088974 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 24 10:26:12.088974 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:12.088974 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:12.088974 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:12.088974 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:12.088974 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:12.088974 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:12.088974 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:12.088974 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:12.088974 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 24 10:26:12.088974 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:12.088974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d8755aa-fb8b-49f3-b741-a6a84a1292e9 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:12.088974 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2d8755aa-fb8b-49f3-b741-a6a84a1292e9 tempest-ServersAdminNegativeTestJSON-1104205387 tempest-ServersAdminNegativeTestJSON-1104205387-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.010162 Oct 24 10:26:12.089993 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 257/505] 10.222.0.50 () {60 vars in 1179 bytes} [Mon Oct 24 10:26:12 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:26:12.094185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-482b8a24-261b-46d4-9699-6a7f00c3b69d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:12.094793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-482b8a24-261b-46d4-9699-6a7f00c3b69d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:12.101106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-482b8a24-261b-46d4-9699-6a7f00c3b69d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:12.101588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-482b8a24-261b-46d4-9699-6a7f00c3b69d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:12.102022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-482b8a24-261b-46d4-9699-6a7f00c3b69d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:12.102723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-482b8a24-261b-46d4-9699-6a7f00c3b69d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:12.103170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-482b8a24-261b-46d4-9699-6a7f00c3b69d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:12.103883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-482b8a24-261b-46d4-9699-6a7f00c3b69d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:12.192480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-482b8a24-261b-46d4-9699-6a7f00c3b69d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:12.201033 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-482b8a24-261b-46d4-9699-6a7f00c3b69d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 200 len: 1281 microversion: 2.1 time: 0.112736 Oct 24 10:26:12.201790 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 258/506] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:12 2022] GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 1281 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:12.206354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-716d528f-9588-4b9e-9607-d5fff33d3099 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2111623168", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "65c79d3e-bb06-4408-bcb0-99f943a08544"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:12.265131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-716d528f-9588-4b9e-9607-d5fff33d3099 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] validate_networks() for [('65c79d3e-bb06-4408-bcb0-99f943a08544', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:26:12.410650 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d6a89980-f122-4732-8556-ee959e644f66 tempest-SecurityGroupsTestAdminJSON-16391522 tempest-SecurityGroupsTestAdminJSON-16391522-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/b080186c-c939-4950-a029-6fcf13251438" status: 202 len: 0 microversion: 2.1 time: 0.531857 Oct 24 10:26:12.413813 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 249/507] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:26:11 2022] DELETE /compute/v2.1/os-security-groups/b080186c-c939-4950-a029-6fcf13251438 => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:12.419056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d8bb3d36-b509-4b79-8435-3ecad035200a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:12.419901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d8bb3d36-b509-4b79-8435-3ecad035200a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:12.426279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8bb3d36-b509-4b79-8435-3ecad035200a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:12.426990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8bb3d36-b509-4b79-8435-3ecad035200a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:12.427979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8bb3d36-b509-4b79-8435-3ecad035200a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:12.428894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8bb3d36-b509-4b79-8435-3ecad035200a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:12.429351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8bb3d36-b509-4b79-8435-3ecad035200a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:12.430251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8bb3d36-b509-4b79-8435-3ecad035200a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:12.740687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d8bb3d36-b509-4b79-8435-3ecad035200a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:12.749519 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d8bb3d36-b509-4b79-8435-3ecad035200a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1470 microversion: 2.1 time: 0.334402 Oct 24 10:26:12.750099 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 250/508] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:12 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1470 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:12.754951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d852fa7-a12c-4c7a-a7c5-faf023e038cd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:12.756321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0d852fa7-a12c-4c7a-a7c5-faf023e038cd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:12.782101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d852fa7-a12c-4c7a-a7c5-faf023e038cd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:12.782769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d852fa7-a12c-4c7a-a7c5-faf023e038cd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:12.783322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d852fa7-a12c-4c7a-a7c5-faf023e038cd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:12.784130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d852fa7-a12c-4c7a-a7c5-faf023e038cd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:12.784723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d852fa7-a12c-4c7a-a7c5-faf023e038cd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:12.785265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d852fa7-a12c-4c7a-a7c5-faf023e038cd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:13.060402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0d852fa7-a12c-4c7a-a7c5-faf023e038cd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:13.070408 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0d852fa7-a12c-4c7a-a7c5-faf023e038cd tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148" status: 200 len: 1319 microversion: 2.1 time: 0.319009 Oct 24 10:26:13.071756 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 251/509] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:12 2022] GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:13.076403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-debb03a7-3ac1-42ca-8139-a8d5c6db230b req-d19aa992-9d0b-4f49-b6d3-169c91e1c310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425fa2bd-76f6-419a-a7be-64d6703f2148", "name": "network-vif-plugged", "status": "completed", "tag": "d55a3b43-f0e3-4eae-9037-b14ac2478139"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:13.087501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-debb03a7-3ac1-42ca-8139-a8d5c6db230b req-d19aa992-9d0b-4f49-b6d3-169c91e1c310 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:13.088016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-debb03a7-3ac1-42ca-8139-a8d5c6db230b req-d19aa992-9d0b-4f49-b6d3-169c91e1c310 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:13.088448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-debb03a7-3ac1-42ca-8139-a8d5c6db230b req-d19aa992-9d0b-4f49-b6d3-169c91e1c310 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:13.100759 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-debb03a7-3ac1-42ca-8139-a8d5c6db230b req-d19aa992-9d0b-4f49-b6d3-169c91e1c310 service nova] Creating event network-vif-plugged:d55a3b43-f0e3-4eae-9037-b14ac2478139 for instance 425fa2bd-76f6-419a-a7be-64d6703f2148 on n-h1-858383-15 Oct 24 10:26:13.105825 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-debb03a7-3ac1-42ca-8139-a8d5c6db230b req-d19aa992-9d0b-4f49-b6d3-169c91e1c310 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032841 Oct 24 10:26:13.106754 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 252/510] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:13.113898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-716d528f-9588-4b9e-9607-d5fff33d3099 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:26:13.114357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-716d528f-9588-4b9e-9607-d5fff33d3099 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:26:13.114908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-716d528f-9588-4b9e-9607-d5fff33d3099 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:26:13.115725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-716d528f-9588-4b9e-9607-d5fff33d3099 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:26:13.116404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-716d528f-9588-4b9e-9607-d5fff33d3099 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:26:13.119931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-90eb01c7-6138-46ac-8e02-f10eafd7cefe tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] Calling method '.version_select at 0x7f04d108aa60>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:13.134658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-716d528f-9588-4b9e-9607-d5fff33d3099 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:13.135162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-716d528f-9588-4b9e-9607-d5fff33d3099 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:13.135602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-716d528f-9588-4b9e-9607-d5fff33d3099 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:13.136330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-716d528f-9588-4b9e-9607-d5fff33d3099 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:13.136786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-716d528f-9588-4b9e-9607-d5fff33d3099 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:13.137281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-716d528f-9588-4b9e-9607-d5fff33d3099 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:13.161567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-716d528f-9588-4b9e-9607-d5fff33d3099 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Getting quotas for project 115025f23db94a71b74b6adbc536792f. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:26:13.168569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-716d528f-9588-4b9e-9607-d5fff33d3099 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Getting quotas for user 176a68ea281e4f65bbeac67cc304468d and project 115025f23db94a71b74b6adbc536792f. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:26:13.186876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-716d528f-9588-4b9e-9607-d5fff33d3099 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:26:13.189540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-716d528f-9588-4b9e-9607-d5fff33d3099 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:26:13.256438 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-716d528f-9588-4b9e-9607-d5fff33d3099 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.052673 Oct 24 10:26:13.257514 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 259/511] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:26:13.262732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0f613dd6-0bad-428f-bff6-e614e95363f1 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:13.263462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0f613dd6-0bad-428f-bff6-e614e95363f1 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:13.273024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f613dd6-0bad-428f-bff6-e614e95363f1 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:13.273858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f613dd6-0bad-428f-bff6-e614e95363f1 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:13.274769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f613dd6-0bad-428f-bff6-e614e95363f1 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:13.275663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f613dd6-0bad-428f-bff6-e614e95363f1 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:13.276461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f613dd6-0bad-428f-bff6-e614e95363f1 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:13.277138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f613dd6-0bad-428f-bff6-e614e95363f1 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:13.330462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0f613dd6-0bad-428f-bff6-e614e95363f1 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:26:13.421982 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-90eb01c7-6138-46ac-8e02-f10eafd7cefe tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.313410 Oct 24 10:26:13.424005 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 253/512] 10.222.0.50 () {58 vars in 1164 bytes} [Mon Oct 24 10:26:13 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:26:13.429396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-18523ad3-2754-4698-8fd3-c75d7f566870 tempest-SecurityGroupsTestAdminJSON-683265230 tempest-SecurityGroupsTestAdminJSON-683265230-project] Calling method '.version_select at 0x7f04d10ac280>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:13.463029 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0f613dd6-0bad-428f-bff6-e614e95363f1 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "DELETE /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 204 len: 0 microversion: 2.1 time: 0.203769 Oct 24 10:26:13.467068 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 260/513] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:26:13 2022] DELETE /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:26:13.473452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-622219d2-bd55-4b75-9fa1-58665362ddd0 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:13.474750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-622219d2-bd55-4b75-9fa1-58665362ddd0 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:13.481689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-622219d2-bd55-4b75-9fa1-58665362ddd0 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:13.482433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-622219d2-bd55-4b75-9fa1-58665362ddd0 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:13.482973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-622219d2-bd55-4b75-9fa1-58665362ddd0 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:13.484238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-622219d2-bd55-4b75-9fa1-58665362ddd0 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:13.484994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-622219d2-bd55-4b75-9fa1-58665362ddd0 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:13.485449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-622219d2-bd55-4b75-9fa1-58665362ddd0 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:13.980789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-622219d2-bd55-4b75-9fa1-58665362ddd0 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:13.991940 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-622219d2-bd55-4b75-9fa1-58665362ddd0 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424" status: 200 len: 1589 microversion: 2.1 time: 0.523069 Oct 24 10:26:13.993126 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 261/514] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:13 2022] GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 => generated 1589 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:13.998083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6ddb2bc7-92b6-481e-8445-6ef57253f5a9 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:13.998772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6ddb2bc7-92b6-481e-8445-6ef57253f5a9 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:14.006641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ddb2bc7-92b6-481e-8445-6ef57253f5a9 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:14.006950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ddb2bc7-92b6-481e-8445-6ef57253f5a9 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:14.007679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ddb2bc7-92b6-481e-8445-6ef57253f5a9 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:14.008946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ddb2bc7-92b6-481e-8445-6ef57253f5a9 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:14.009473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ddb2bc7-92b6-481e-8445-6ef57253f5a9 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:14.009973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ddb2bc7-92b6-481e-8445-6ef57253f5a9 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:14.062375 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-18523ad3-2754-4698-8fd3-c75d7f566870 tempest-SecurityGroupsTestAdminJSON-683265230 tempest-SecurityGroupsTestAdminJSON-683265230-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/c7f5858d-2a33-4770-a2ac-a19a6faba12b" status: 202 len: 0 microversion: 2.1 time: 0.637309 Oct 24 10:26:14.066535 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 254/515] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:26:13 2022] DELETE /compute/v2.1/os-security-groups/c7f5858d-2a33-4770-a2ac-a19a6faba12b => generated 0 bytes in 642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:14.071956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b97efd3b-76e7-4562-a05d-22712753776d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:14.072685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b97efd3b-76e7-4562-a05d-22712753776d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:14.089780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b97efd3b-76e7-4562-a05d-22712753776d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:14.090625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b97efd3b-76e7-4562-a05d-22712753776d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:14.091064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b97efd3b-76e7-4562-a05d-22712753776d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:14.091773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b97efd3b-76e7-4562-a05d-22712753776d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:14.092233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b97efd3b-76e7-4562-a05d-22712753776d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:14.092641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b97efd3b-76e7-4562-a05d-22712753776d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:14.225719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b97efd3b-76e7-4562-a05d-22712753776d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:14.233374 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b97efd3b-76e7-4562-a05d-22712753776d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1207 microversion: 2.1 time: 0.165645 Oct 24 10:26:14.233944 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 255/516] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:14 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1207 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:14.238475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d9799aa8-19be-4806-9800-ba92eecd41e0 tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] Calling method '.version_select at 0x7f04d10acf70>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:14.375648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6ddb2bc7-92b6-481e-8445-6ef57253f5a9 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:14.384174 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6ddb2bc7-92b6-481e-8445-6ef57253f5a9 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 200 len: 1323 microversion: 2.1 time: 0.390059 Oct 24 10:26:14.384758 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 262/517] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:13 2022] GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 1323 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:14.389516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-083694dd-8dcd-4a21-a3f7-5f5f563ce499 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:14.390254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-083694dd-8dcd-4a21-a3f7-5f5f563ce499 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:14.396525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-083694dd-8dcd-4a21-a3f7-5f5f563ce499 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:14.397252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-083694dd-8dcd-4a21-a3f7-5f5f563ce499 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:14.397696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-083694dd-8dcd-4a21-a3f7-5f5f563ce499 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:14.399149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-083694dd-8dcd-4a21-a3f7-5f5f563ce499 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:14.399609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-083694dd-8dcd-4a21-a3f7-5f5f563ce499 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:14.400188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-083694dd-8dcd-4a21-a3f7-5f5f563ce499 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:14.617599 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d9799aa8-19be-4806-9800-ba92eecd41e0 tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.382402 Oct 24 10:26:14.618264 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 256/518] 10.222.0.50 () {58 vars in 1149 bytes} [Mon Oct 24 10:26:14 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:14.622909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6c4dec1e-0f68-45c5-9b06-58252033162d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:14.623871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6c4dec1e-0f68-45c5-9b06-58252033162d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:14.630251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c4dec1e-0f68-45c5-9b06-58252033162d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:14.630886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c4dec1e-0f68-45c5-9b06-58252033162d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:14.631498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c4dec1e-0f68-45c5-9b06-58252033162d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:14.632202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c4dec1e-0f68-45c5-9b06-58252033162d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:14.632658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c4dec1e-0f68-45c5-9b06-58252033162d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:14.633108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c4dec1e-0f68-45c5-9b06-58252033162d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:14.671370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-083694dd-8dcd-4a21-a3f7-5f5f563ce499 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:14.680057 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-083694dd-8dcd-4a21-a3f7-5f5f563ce499 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 200 len: 1469 microversion: 2.1 time: 0.294294 Oct 24 10:26:14.680627 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 263/519] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:14 2022] GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 1469 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:14.686803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8a8af7e2-f12a-4122-be76-880d269adf15 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:14.687306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8a8af7e2-f12a-4122-be76-880d269adf15 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:14.693645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a8af7e2-f12a-4122-be76-880d269adf15 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:14.694127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a8af7e2-f12a-4122-be76-880d269adf15 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:14.694557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a8af7e2-f12a-4122-be76-880d269adf15 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:14.695249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a8af7e2-f12a-4122-be76-880d269adf15 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:14.695698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a8af7e2-f12a-4122-be76-880d269adf15 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:14.696130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a8af7e2-f12a-4122-be76-880d269adf15 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:14.876363 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8a8af7e2-f12a-4122-be76-880d269adf15 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.194601 Oct 24 10:26:14.877191 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 264/520] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 10:26:14 2022] GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424/os-interface => generated 285 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:14.892827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ed1351a4-541c-4669-9b76-4ccb4a5cd7ef tempest-SecurityGroupsTestAdminJSON-683265230 tempest-SecurityGroupsTestAdminJSON-683265230-project] Calling method '.version_select at 0x7f04d10669d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:14.979346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6c4dec1e-0f68-45c5-9b06-58252033162d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:14.991020 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6c4dec1e-0f68-45c5-9b06-58252033162d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1475 microversion: 2.1 time: 0.371241 Oct 24 10:26:15.008579 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 257/521] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:14 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1475 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:15.008579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9be9ced9-4a56-4dce-bc36-6072a74f879b tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:15.008579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9be9ced9-4a56-4dce-bc36-6072a74f879b tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:15.008579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9be9ced9-4a56-4dce-bc36-6072a74f879b tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:15.009502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9be9ced9-4a56-4dce-bc36-6072a74f879b tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:15.009502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9be9ced9-4a56-4dce-bc36-6072a74f879b tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:15.010150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9be9ced9-4a56-4dce-bc36-6072a74f879b tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:15.010581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9be9ced9-4a56-4dce-bc36-6072a74f879b tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:15.011035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9be9ced9-4a56-4dce-bc36-6072a74f879b tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:15.386988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9be9ced9-4a56-4dce-bc36-6072a74f879b tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:15.394887 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9be9ced9-4a56-4dce-bc36-6072a74f879b tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148" status: 200 len: 1319 microversion: 2.1 time: 0.401087 Oct 24 10:26:15.395463 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 258/522] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:14 2022] GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:15.400809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4e1c53e0-649a-44ed-93c9-59767da9e0d2 tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] Calling method '.version_select at 0x7f04d1118b80>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:15.759735 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ed1351a4-541c-4669-9b76-4ccb4a5cd7ef tempest-SecurityGroupsTestAdminJSON-683265230 tempest-SecurityGroupsTestAdminJSON-683265230-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/c5c345a3-2bfb-4045-82f2-cc717cac9713" status: 202 len: 0 microversion: 2.1 time: 0.872155 Oct 24 10:26:15.761274 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 265/523] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:26:14 2022] DELETE /compute/v2.1/os-security-groups/c5c345a3-2bfb-4045-82f2-cc717cac9713 => generated 0 bytes in 883 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:15.776364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-55b32d9c-50ff-4c41-bcfa-0d43e4f3e983 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:15.777462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-55b32d9c-50ff-4c41-bcfa-0d43e4f3e983 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:15.815893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55b32d9c-50ff-4c41-bcfa-0d43e4f3e983 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:15.816344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55b32d9c-50ff-4c41-bcfa-0d43e4f3e983 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:15.819464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55b32d9c-50ff-4c41-bcfa-0d43e4f3e983 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:15.825381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55b32d9c-50ff-4c41-bcfa-0d43e4f3e983 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:15.830007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55b32d9c-50ff-4c41-bcfa-0d43e4f3e983 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:15.831781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55b32d9c-50ff-4c41-bcfa-0d43e4f3e983 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:16.599355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-55b32d9c-50ff-4c41-bcfa-0d43e4f3e983 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:16.608005 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-55b32d9c-50ff-4c41-bcfa-0d43e4f3e983 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1311 microversion: 2.1 time: 0.844573 Oct 24 10:26:16.609352 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 266/524] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:15 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1311 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:16.629256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dca1f639-b018-4720-8491-081eb1a8abf0 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:16.631263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dca1f639-b018-4720-8491-081eb1a8abf0 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:16.639907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dca1f639-b018-4720-8491-081eb1a8abf0 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:16.640404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dca1f639-b018-4720-8491-081eb1a8abf0 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:16.640987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dca1f639-b018-4720-8491-081eb1a8abf0 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:16.641673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dca1f639-b018-4720-8491-081eb1a8abf0 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:16.642251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dca1f639-b018-4720-8491-081eb1a8abf0 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:16.643039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dca1f639-b018-4720-8491-081eb1a8abf0 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:17.109436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dca1f639-b018-4720-8491-081eb1a8abf0 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:17.149017 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dca1f639-b018-4720-8491-081eb1a8abf0 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 200 len: 1323 microversion: 2.1 time: 0.536733 Oct 24 10:26:17.160861 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 267/525] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:16 2022] GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 1323 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:17.171011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5bd8e048-1931-48c1-bd64-b97c09ad26e3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:17.172352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5bd8e048-1931-48c1-bd64-b97c09ad26e3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:17.216381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bd8e048-1931-48c1-bd64-b97c09ad26e3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:17.218065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bd8e048-1931-48c1-bd64-b97c09ad26e3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:17.223352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bd8e048-1931-48c1-bd64-b97c09ad26e3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:17.226579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bd8e048-1931-48c1-bd64-b97c09ad26e3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:17.228381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bd8e048-1931-48c1-bd64-b97c09ad26e3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:17.229926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bd8e048-1931-48c1-bd64-b97c09ad26e3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:17.243334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:17.498901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5bd8e048-1931-48c1-bd64-b97c09ad26e3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:17.507281 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5bd8e048-1931-48c1-bd64-b97c09ad26e3 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 200 len: 1427 microversion: 2.1 time: 0.352110 Oct 24 10:26:17.507861 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 268/526] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:17 2022] GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 1427 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:17.515087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-8633bf05-ecdc-484a-8099-c5aed36185bc req-029b0a9e-a18c-496f-8898-645ba6779f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00d34420-321b-4914-a4e0-d03965e049b3", "tag": "3da84e0c-5c52-4ffa-8616-0781a71c3874"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:17.526674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8633bf05-ecdc-484a-8099-c5aed36185bc req-029b0a9e-a18c-496f-8898-645ba6779f2d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:17.527773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8633bf05-ecdc-484a-8099-c5aed36185bc req-029b0a9e-a18c-496f-8898-645ba6779f2d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:17.528396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8633bf05-ecdc-484a-8099-c5aed36185bc req-029b0a9e-a18c-496f-8898-645ba6779f2d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:17.542066 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-8633bf05-ecdc-484a-8099-c5aed36185bc req-029b0a9e-a18c-496f-8898-645ba6779f2d service nova] Creating event network-changed:3da84e0c-5c52-4ffa-8616-0781a71c3874 for instance 00d34420-321b-4914-a4e0-d03965e049b3 on n-h1-858383-15 Oct 24 10:26:17.555183 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-8633bf05-ecdc-484a-8099-c5aed36185bc req-029b0a9e-a18c-496f-8898-645ba6779f2d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045190 Oct 24 10:26:17.556735 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 269/527] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:17.564192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e9945673-d554-4277-8ccb-ff10345302cf tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:17.565172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e9945673-d554-4277-8ccb-ff10345302cf tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:17.567515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:17.575181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9945673-d554-4277-8ccb-ff10345302cf tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:17.576082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9945673-d554-4277-8ccb-ff10345302cf tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:17.576803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9945673-d554-4277-8ccb-ff10345302cf tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:17.577793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9945673-d554-4277-8ccb-ff10345302cf tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:17.578460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9945673-d554-4277-8ccb-ff10345302cf tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:17.579095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9945673-d554-4277-8ccb-ff10345302cf tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:18.012420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e9945673-d554-4277-8ccb-ff10345302cf tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:18.020364 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e9945673-d554-4277-8ccb-ff10345302cf tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1475 microversion: 2.1 time: 0.462083 Oct 24 10:26:18.023411 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4e1c53e0-649a-44ed-93c9-59767da9e0d2 tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/515ba73b-652d-4db7-8de2-9a038326e2b2" status: 202 len: 0 microversion: 2.1 time: 2.626217 Oct 24 10:26:18.027092 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 259/528] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:26:15 2022] DELETE /compute/v2.1/os-floating-ips/515ba73b-652d-4db7-8de2-9a038326e2b2 => generated 0 bytes in 2631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:18.032096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d0f37987-9416-44d9-b9d1-6a6355e50466 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:18.032716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d0f37987-9416-44d9-b9d1-6a6355e50466 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:18.037342 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 270/529] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:17 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1475 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:18.042114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:18.042836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-6661684a-df9d-4e0c-bf73-bb99b1d3fcb0 req-184b2d11-fd2e-41cd-af2a-f1e3a1ae8329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ef26c4-a579-469e-b5db-bc2b0e17e99d", "tag": "7b8b4301-4ceb-4f7a-a75e-0a52614ad84f"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:18.044635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0f37987-9416-44d9-b9d1-6a6355e50466 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:18.045165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0f37987-9416-44d9-b9d1-6a6355e50466 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:18.046239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0f37987-9416-44d9-b9d1-6a6355e50466 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:18.047062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0f37987-9416-44d9-b9d1-6a6355e50466 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:18.047529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0f37987-9416-44d9-b9d1-6a6355e50466 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:18.047963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0f37987-9416-44d9-b9d1-6a6355e50466 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:18.054633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6661684a-df9d-4e0c-bf73-bb99b1d3fcb0 req-184b2d11-fd2e-41cd-af2a-f1e3a1ae8329 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:18.055967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6661684a-df9d-4e0c-bf73-bb99b1d3fcb0 req-184b2d11-fd2e-41cd-af2a-f1e3a1ae8329 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:18.056580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6661684a-df9d-4e0c-bf73-bb99b1d3fcb0 req-184b2d11-fd2e-41cd-af2a-f1e3a1ae8329 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:18.074661 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-6661684a-df9d-4e0c-bf73-bb99b1d3fcb0 req-184b2d11-fd2e-41cd-af2a-f1e3a1ae8329 service nova] Creating event network-changed:7b8b4301-4ceb-4f7a-a75e-0a52614ad84f for instance e0ef26c4-a579-469e-b5db-bc2b0e17e99d on n-h2-858383-15 Oct 24 10:26:18.080807 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-6661684a-df9d-4e0c-bf73-bb99b1d3fcb0 req-184b2d11-fd2e-41cd-af2a-f1e3a1ae8329 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041822 Oct 24 10:26:18.082125 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 271/530] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:18.089951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2ef421ee-54dc-45dc-b813-c641f0663ddc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:18.090926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2ef421ee-54dc-45dc-b813-c641f0663ddc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:18.097888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ef421ee-54dc-45dc-b813-c641f0663ddc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:18.098656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ef421ee-54dc-45dc-b813-c641f0663ddc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:18.100936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ef421ee-54dc-45dc-b813-c641f0663ddc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:18.101896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ef421ee-54dc-45dc-b813-c641f0663ddc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:18.102362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ef421ee-54dc-45dc-b813-c641f0663ddc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:18.102792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ef421ee-54dc-45dc-b813-c641f0663ddc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:18.311762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d0f37987-9416-44d9-b9d1-6a6355e50466 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:18.315172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2ef421ee-54dc-45dc-b813-c641f0663ddc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:18.324381 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2ef421ee-54dc-45dc-b813-c641f0663ddc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1311 microversion: 2.1 time: 0.240856 Oct 24 10:26:18.336860 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 272/531] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:18 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1311 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:18.336860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2eac09a3-5de5-43bd-8947-7b2ce0cdcdd2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:18.336860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2eac09a3-5de5-43bd-8947-7b2ce0cdcdd2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:18.340058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2eac09a3-5de5-43bd-8947-7b2ce0cdcdd2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:18.340058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2eac09a3-5de5-43bd-8947-7b2ce0cdcdd2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:18.340058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2eac09a3-5de5-43bd-8947-7b2ce0cdcdd2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:18.340521 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d0f37987-9416-44d9-b9d1-6a6355e50466 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148" status: 200 len: 1468 microversion: 2.1 time: 0.310298 Oct 24 10:26:18.341116 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 260/532] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:18 2022] GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 => generated 1468 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:18.347208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2eac09a3-5de5-43bd-8947-7b2ce0cdcdd2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:18.347208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2eac09a3-5de5-43bd-8947-7b2ce0cdcdd2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:18.347208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2eac09a3-5de5-43bd-8947-7b2ce0cdcdd2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:18.350231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1678edca-5721-48b2-98b5-e6d3ad2dbfbb tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] Calling method '.version_select at 0x7f04d11b2e50>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:18.624215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2eac09a3-5de5-43bd-8947-7b2ce0cdcdd2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:18.638022 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2eac09a3-5de5-43bd-8947-7b2ce0cdcdd2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424" status: 200 len: 1589 microversion: 2.1 time: 0.311556 Oct 24 10:26:18.638969 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 273/533] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:18 2022] GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 => generated 1589 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:18.644507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0a0228c1-7111-47a3-b7ab-2b3168a93cd3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:18.645144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0a0228c1-7111-47a3-b7ab-2b3168a93cd3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:18.660089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a0228c1-7111-47a3-b7ab-2b3168a93cd3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:18.660583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a0228c1-7111-47a3-b7ab-2b3168a93cd3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:18.661049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a0228c1-7111-47a3-b7ab-2b3168a93cd3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:18.661807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a0228c1-7111-47a3-b7ab-2b3168a93cd3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:18.662332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a0228c1-7111-47a3-b7ab-2b3168a93cd3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:18.662777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a0228c1-7111-47a3-b7ab-2b3168a93cd3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:18.961611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0a0228c1-7111-47a3-b7ab-2b3168a93cd3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:18.970771 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0a0228c1-7111-47a3-b7ab-2b3168a93cd3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 200 len: 1323 microversion: 2.1 time: 0.330657 Oct 24 10:26:18.981093 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 274/534] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:18 2022] GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 1323 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:18.995222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-61a45a03-1c12-40db-8327-b915b70a494f tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:18.997690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-61a45a03-1c12-40db-8327-b915b70a494f tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:19.004416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61a45a03-1c12-40db-8327-b915b70a494f tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:19.005153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61a45a03-1c12-40db-8327-b915b70a494f tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:19.005790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61a45a03-1c12-40db-8327-b915b70a494f tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:19.006690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61a45a03-1c12-40db-8327-b915b70a494f tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:19.007306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61a45a03-1c12-40db-8327-b915b70a494f tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:19.007989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61a45a03-1c12-40db-8327-b915b70a494f tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:19.147266 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-61a45a03-1c12-40db-8327-b915b70a494f tempest-DeleteServersAdminTestJSON-880734483 tempest-DeleteServersAdminTestJSON-880734483-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148/action" status: 202 len: 0 microversion: 2.1 time: 0.163400 Oct 24 10:26:19.151207 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 275/535] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:26:18 2022] POST /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:19.155104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fd66f76c-f630-4a28-bb9d-315f496f9b7e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:19.155963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fd66f76c-f630-4a28-bb9d-315f496f9b7e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:19.163781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd66f76c-f630-4a28-bb9d-315f496f9b7e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:19.164611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd66f76c-f630-4a28-bb9d-315f496f9b7e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:19.165506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd66f76c-f630-4a28-bb9d-315f496f9b7e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:19.166484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd66f76c-f630-4a28-bb9d-315f496f9b7e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:19.167099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd66f76c-f630-4a28-bb9d-315f496f9b7e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:19.167895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd66f76c-f630-4a28-bb9d-315f496f9b7e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:19.221304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd66f76c-f630-4a28-bb9d-315f496f9b7e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:19.222053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd66f76c-f630-4a28-bb9d-315f496f9b7e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:19.223091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd66f76c-f630-4a28-bb9d-315f496f9b7e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:19.223730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-fd66f76c-f630-4a28-bb9d-315f496f9b7e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lazy-loading 'fault' on Instance uuid 78163a08-193b-424a-b63c-28148c3aa4d6 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:26:19.284120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fd66f76c-f630-4a28-bb9d-315f496f9b7e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:19.294302 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fd66f76c-f630-4a28-bb9d-315f496f9b7e tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 200 len: 1312 microversion: 2.1 time: 0.145215 Oct 24 10:26:19.295175 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 276/536] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:19 2022] GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 1312 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:19.446143 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1678edca-5721-48b2-98b5-e6d3ad2dbfbb tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/2583098c-db0c-49a2-a317-458add8313e9" status: 202 len: 0 microversion: 2.1 time: 1.103281 Oct 24 10:26:19.446722 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 261/537] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:26:18 2022] DELETE /compute/v2.1/os-floating-ips/2583098c-db0c-49a2-a317-458add8313e9 => generated 0 bytes in 1105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:19.449559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-50e4ab21-e8f5-4a04-9e91-9889a730b6f1 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:19.451375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-05540366-ee45-4f0d-ad90-0aa20e7d2f8b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:19.452016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-05540366-ee45-4f0d-ad90-0aa20e7d2f8b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:19.457984 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-50e4ab21-e8f5-4a04-9e91-9889a730b6f1 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.161502 Oct 24 10:26:19.458599 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 277/538] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:26:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:19.459662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05540366-ee45-4f0d-ad90-0aa20e7d2f8b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:19.460153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05540366-ee45-4f0d-ad90-0aa20e7d2f8b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:19.460640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05540366-ee45-4f0d-ad90-0aa20e7d2f8b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:19.461362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05540366-ee45-4f0d-ad90-0aa20e7d2f8b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:19.461817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05540366-ee45-4f0d-ad90-0aa20e7d2f8b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:19.462241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05540366-ee45-4f0d-ad90-0aa20e7d2f8b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:19.463342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fd70b24b-db55-4bbc-aa34-7008984ceb96 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:19.463970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fd70b24b-db55-4bbc-aa34-7008984ceb96 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:19.470904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd70b24b-db55-4bbc-aa34-7008984ceb96 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:19.471398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd70b24b-db55-4bbc-aa34-7008984ceb96 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:19.471840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd70b24b-db55-4bbc-aa34-7008984ceb96 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:19.472539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd70b24b-db55-4bbc-aa34-7008984ceb96 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:19.473028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd70b24b-db55-4bbc-aa34-7008984ceb96 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:19.473530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd70b24b-db55-4bbc-aa34-7008984ceb96 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:19.507646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd70b24b-db55-4bbc-aa34-7008984ceb96 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:19.508126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd70b24b-db55-4bbc-aa34-7008984ceb96 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:19.508565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd70b24b-db55-4bbc-aa34-7008984ceb96 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:19.509047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-fd70b24b-db55-4bbc-aa34-7008984ceb96 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lazy-loading 'fault' on Instance uuid 425fa2bd-76f6-419a-a7be-64d6703f2148 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:26:19.675676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-05540366-ee45-4f0d-ad90-0aa20e7d2f8b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:19.683638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fd70b24b-db55-4bbc-aa34-7008984ceb96 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:19.685117 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-05540366-ee45-4f0d-ad90-0aa20e7d2f8b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1475 microversion: 2.1 time: 0.237209 Oct 24 10:26:19.685698 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 262/539] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:19 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1475 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:19.701390 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fd70b24b-db55-4bbc-aa34-7008984ceb96 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148" status: 200 len: 1451 microversion: 2.1 time: 0.232363 Oct 24 10:26:19.701390 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 278/540] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:19 2022] GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 => generated 1451 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:19.701390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-463e669b-8946-4c90-8f64-78d3c5f5b425 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:19.701390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-463e669b-8946-4c90-8f64-78d3c5f5b425 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:19.706863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-463e669b-8946-4c90-8f64-78d3c5f5b425 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:19.707557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-463e669b-8946-4c90-8f64-78d3c5f5b425 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:19.708153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-463e669b-8946-4c90-8f64-78d3c5f5b425 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:19.708934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-02b91047-f934-41cd-9c1e-ecabe4ae9a8c tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] Calling method '.version_select at 0x7f04d10ac790>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:19.709531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-463e669b-8946-4c90-8f64-78d3c5f5b425 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:19.710102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-463e669b-8946-4c90-8f64-78d3c5f5b425 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:19.710633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-463e669b-8946-4c90-8f64-78d3c5f5b425 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:19.918026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:20.204368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-463e669b-8946-4c90-8f64-78d3c5f5b425 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:20.212629 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-463e669b-8946-4c90-8f64-78d3c5f5b425 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1311 microversion: 2.1 time: 0.517793 Oct 24 10:26:20.213246 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 279/541] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:19 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1311 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:20.217581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d222aea1-98c7-41ef-adaf-b69fa721b1b9 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:20.238740 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d222aea1-98c7-41ef-adaf-b69fa721b1b9 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors" status: 200 len: 3077 microversion: 2.1 time: 0.024452 Oct 24 10:26:20.239309 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 280/542] 10.222.0.50 () {58 vars in 1125 bytes} [Mon Oct 24 10:26:20 2022] GET /compute/v2.1/flavors => generated 3077 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:20.248997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-b1c919c9-320c-4835-b56e-1d4115712a17 req-ca2dd6f4-4e15-454a-801d-3b392e864639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b0b8d04-8d85-4df1-a921-2ff9ef9d6424", "tag": "ff6086af-6880-43bf-9ea1-7af1f73f488a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:20.254928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b1c919c9-320c-4835-b56e-1d4115712a17 req-ca2dd6f4-4e15-454a-801d-3b392e864639 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:20.255772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b1c919c9-320c-4835-b56e-1d4115712a17 req-ca2dd6f4-4e15-454a-801d-3b392e864639 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:20.256239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b1c919c9-320c-4835-b56e-1d4115712a17 req-ca2dd6f4-4e15-454a-801d-3b392e864639 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:20.267116 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-b1c919c9-320c-4835-b56e-1d4115712a17 req-ca2dd6f4-4e15-454a-801d-3b392e864639 service nova] Creating event network-changed:ff6086af-6880-43bf-9ea1-7af1f73f488a for instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 on n-h2-858383-15 Oct 24 10:26:20.272200 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-b1c919c9-320c-4835-b56e-1d4115712a17 req-ca2dd6f4-4e15-454a-801d-3b392e864639 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030826 Oct 24 10:26:20.272795 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 281/543] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:20.277715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c628c7d1-b421-4d3f-ba3f-eec073322e6e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:20.278289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c628c7d1-b421-4d3f-ba3f-eec073322e6e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:20.284138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c628c7d1-b421-4d3f-ba3f-eec073322e6e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:20.284621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c628c7d1-b421-4d3f-ba3f-eec073322e6e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:20.285086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c628c7d1-b421-4d3f-ba3f-eec073322e6e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:20.285776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c628c7d1-b421-4d3f-ba3f-eec073322e6e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:20.286223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c628c7d1-b421-4d3f-ba3f-eec073322e6e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:20.287186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c628c7d1-b421-4d3f-ba3f-eec073322e6e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:20.314786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c628c7d1-b421-4d3f-ba3f-eec073322e6e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:26:20.412984 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c628c7d1-b421-4d3f-ba3f-eec073322e6e tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "DELETE /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148" status: 204 len: 0 microversion: 2.1 time: 0.138546 Oct 24 10:26:20.414505 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 282/544] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:26:20 2022] DELETE /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:26:20.420098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5b194682-080d-4e81-9fdc-e9a44d2dc58b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:20.420827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5b194682-080d-4e81-9fdc-e9a44d2dc58b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:20.428247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b194682-080d-4e81-9fdc-e9a44d2dc58b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:20.429089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b194682-080d-4e81-9fdc-e9a44d2dc58b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:20.429239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b194682-080d-4e81-9fdc-e9a44d2dc58b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:20.429879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b194682-080d-4e81-9fdc-e9a44d2dc58b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:20.430335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b194682-080d-4e81-9fdc-e9a44d2dc58b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:20.430957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b194682-080d-4e81-9fdc-e9a44d2dc58b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:20.568965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:20.710881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5b194682-080d-4e81-9fdc-e9a44d2dc58b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:20.719445 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5b194682-080d-4e81-9fdc-e9a44d2dc58b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 200 len: 1323 microversion: 2.1 time: 0.303400 Oct 24 10:26:20.720033 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 283/545] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:20 2022] GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 1323 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:20.725856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-be06f8e1-9bfa-4c85-93d8-b9af3004cb67 req-c874596b-4962-41fc-822a-1d966fcd219e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78163a08-193b-424a-b63c-28148c3aa4d6", "name": "network-vif-deleted", "tag": "521590e6-41d5-4de2-80cb-62ebdd4d5ab8"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:20.737581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-be06f8e1-9bfa-4c85-93d8-b9af3004cb67 req-c874596b-4962-41fc-822a-1d966fcd219e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:20.738228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-be06f8e1-9bfa-4c85-93d8-b9af3004cb67 req-c874596b-4962-41fc-822a-1d966fcd219e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:20.738656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-be06f8e1-9bfa-4c85-93d8-b9af3004cb67 req-c874596b-4962-41fc-822a-1d966fcd219e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:20.751908 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-be06f8e1-9bfa-4c85-93d8-b9af3004cb67 req-c874596b-4962-41fc-822a-1d966fcd219e service nova] Creating event network-vif-deleted:521590e6-41d5-4de2-80cb-62ebdd4d5ab8 for instance 78163a08-193b-424a-b63c-28148c3aa4d6 on n-h1-858383-15 Oct 24 10:26:20.757788 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-be06f8e1-9bfa-4c85-93d8-b9af3004cb67 req-c874596b-4962-41fc-822a-1d966fcd219e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036061 Oct 24 10:26:20.758379 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 284/546] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:20.764043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4c94ba85-879f-4f16-b4e5-e287e1e7ef34 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:20.773313 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4c94ba85-879f-4f16-b4e5-e287e1e7ef34 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013619 Oct 24 10:26:20.774226 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 285/547] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:26:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:20.778641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fbdbfc59-3257-4aa9-879d-bdd479b2ee56 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:20.779346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fbdbfc59-3257-4aa9-879d-bdd479b2ee56 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 78163a08-193b-424a-b63c-28148c3aa4d6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:20.785961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbdbfc59-3257-4aa9-879d-bdd479b2ee56 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:20.787115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbdbfc59-3257-4aa9-879d-bdd479b2ee56 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:20.787714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbdbfc59-3257-4aa9-879d-bdd479b2ee56 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:20.788413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbdbfc59-3257-4aa9-879d-bdd479b2ee56 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:20.788884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbdbfc59-3257-4aa9-879d-bdd479b2ee56 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:20.789310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbdbfc59-3257-4aa9-879d-bdd479b2ee56 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:20.806101 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-fbdbfc59-3257-4aa9-879d-bdd479b2ee56 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] HTTP exception thrown: Instance 78163a08-193b-424a-b63c-28148c3aa4d6 could not be found. Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fbdbfc59-3257-4aa9-879d-bdd479b2ee56 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Request method failure captured: Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 HTTP/1.1 Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmf7qhCdlLUccJOoyLysekLhd8iClpa5jCIu-tZeg-axyVbg5YhZV4iBB4XxsWDPZqgV6tdKfGR25HG74RiIESvavmg7KcQQ443J7JZQGOD2cdXS0NpVKTPfeCHn0Bsm3a9XOBMWixHsik0olrt-cMn_S7DHE5YAVca8yh8ZsPiRMIw Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: dabaf79a7d42463ea67fd9b5f7a12951 Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1449172068 Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:26:20.808083 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:26:20.809840 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dabaf79a7d42463ea67fd9b5f7a12951"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dabaf79a7d42463ea67fd9b5f7a12951"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dabaf79a7d42463ea67fd9b5f7a12951"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dabaf79a7d42463ea67fd9b5f7a12951", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:20.809840 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1449172068 Oct 24 10:26:20.809840 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: dabaf79a7d42463ea67fd9b5f7a12951 Oct 24 10:26:20.809840 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1449172068 Oct 24 10:26:20.809840 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersAdminNegativeTestJSON-1449172068-project Oct 24 10:26:20.809840 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:26:20.809840 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:26:20.809840 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: c2ecfd950eeb40409aaaff59f782d1f4 Oct 24 10:26:20.809840 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1449172068-project Oct 24 10:26:20.809840 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:26:20.809840 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 78163a08-193b-424a-b63c-28148c3aa4d6 could not be found. Oct 24 10:26:20.809840 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '78163a08-193b-424a-b63c-28148c3aa4d6'} Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78163a08-193b-424a-b63c-28148c3aa4d6 could not be found. Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:20.810750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:20.812368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:20.812368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:26:20.812368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:26:20.812368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:26:20.812368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:26:20.812368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:26:20.812368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:26:20.812368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78163a08-193b-424a-b63c-28148c3aa4d6 could not be found. Oct 24 10:26:20.812368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:20.812368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:20.812368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:20.812368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:20.812368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:20.812368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:20.812368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:20.812368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:20.812368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78163a08-193b-424a-b63c-28148c3aa4d6 could not be found. Oct 24 10:26:20.812368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:20.814780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fbdbfc59-3257-4aa9-879d-bdd479b2ee56 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Returning 404 to user: Instance 78163a08-193b-424a-b63c-28148c3aa4d6 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:20.814780 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fbdbfc59-3257-4aa9-879d-bdd479b2ee56 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6" status: 404 len: 111 microversion: 2.1 time: 0.034858 Oct 24 10:26:20.814780 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 286/548] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:20 2022] GET /compute/v2.1/servers/78163a08-193b-424a-b63c-28148c3aa4d6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:26:20.818131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f01580fb-feb5-4421-a418-ae8593b7e757 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:20.818954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f01580fb-feb5-4421-a418-ae8593b7e757 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:20.825377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f01580fb-feb5-4421-a418-ae8593b7e757 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:20.825860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f01580fb-feb5-4421-a418-ae8593b7e757 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:20.826286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f01580fb-feb5-4421-a418-ae8593b7e757 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:20.826983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f01580fb-feb5-4421-a418-ae8593b7e757 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:20.827427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f01580fb-feb5-4421-a418-ae8593b7e757 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:20.827840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f01580fb-feb5-4421-a418-ae8593b7e757 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:20.843398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:20.865771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f01580fb-feb5-4421-a418-ae8593b7e757 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:20.866350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f01580fb-feb5-4421-a418-ae8593b7e757 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:20.866788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f01580fb-feb5-4421-a418-ae8593b7e757 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:20.867234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-f01580fb-feb5-4421-a418-ae8593b7e757 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lazy-loading 'fault' on Instance uuid 425fa2bd-76f6-419a-a7be-64d6703f2148 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:26:20.976451 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-02b91047-f934-41cd-9c1e-ecabe4ae9a8c tempest-FloatingIPDetailsTestJSON-1054480281 tempest-FloatingIPDetailsTestJSON-1054480281-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/547c5992-2934-4f1c-8aee-8fa245346d36" status: 202 len: 0 microversion: 2.1 time: 1.272036 Oct 24 10:26:20.977623 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 263/549] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:26:19 2022] DELETE /compute/v2.1/os-floating-ips/547c5992-2934-4f1c-8aee-8fa245346d36 => generated 0 bytes in 1274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:20.982809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-51eb57a6-0b3e-495b-87d5-9e35e0464e36 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:20.983515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-51eb57a6-0b3e-495b-87d5-9e35e0464e36 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:20.993385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51eb57a6-0b3e-495b-87d5-9e35e0464e36 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:20.994385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51eb57a6-0b3e-495b-87d5-9e35e0464e36 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:20.995018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51eb57a6-0b3e-495b-87d5-9e35e0464e36 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:20.995729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51eb57a6-0b3e-495b-87d5-9e35e0464e36 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:20.996178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51eb57a6-0b3e-495b-87d5-9e35e0464e36 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:20.996760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51eb57a6-0b3e-495b-87d5-9e35e0464e36 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:21.033239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f01580fb-feb5-4421-a418-ae8593b7e757 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:21.045832 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f01580fb-feb5-4421-a418-ae8593b7e757 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148" status: 200 len: 1457 microversion: 2.1 time: 0.231233 Oct 24 10:26:21.046572 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 287/550] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:20 2022] GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 => generated 1457 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:21.051677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-206e2f96-c3b4-4f3b-8c5d-54fc865cd7bf tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.069180 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-206e2f96-c3b4-4f3b-8c5d-54fc865cd7bf tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013536 Oct 24 10:26:21.070166 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 288/551] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:21.075654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-82ad11e6-2207-423e-8d83-2c3abb88d6e5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.076441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-82ad11e6-2207-423e-8d83-2c3abb88d6e5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:21.083033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82ad11e6-2207-423e-8d83-2c3abb88d6e5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:21.084334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82ad11e6-2207-423e-8d83-2c3abb88d6e5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:21.085283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82ad11e6-2207-423e-8d83-2c3abb88d6e5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:21.086226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82ad11e6-2207-423e-8d83-2c3abb88d6e5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:21.086884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82ad11e6-2207-423e-8d83-2c3abb88d6e5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:21.087478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82ad11e6-2207-423e-8d83-2c3abb88d6e5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:21.115880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-82ad11e6-2207-423e-8d83-2c3abb88d6e5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:26:21.160090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-51eb57a6-0b3e-495b-87d5-9e35e0464e36 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:21.168260 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-51eb57a6-0b3e-495b-87d5-9e35e0464e36 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1475 microversion: 2.1 time: 0.189530 Oct 24 10:26:21.181259 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 264/552] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:20 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1475 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:21.190975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-44b9fd93-d7df-4f32-8ab5-3bf1cd06960d tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.208272 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-82ad11e6-2207-423e-8d83-2c3abb88d6e5 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "DELETE /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 204 len: 0 microversion: 2.1 time: 0.136267 Oct 24 10:26:21.209370 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 289/553] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:26:21 2022] DELETE /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:26:21.218643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-df420942-4be2-4c16-9193-d0b2b86a635c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.219396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-df420942-4be2-4c16-9193-d0b2b86a635c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:21.219542 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-44b9fd93-d7df-4f32-8ab5-3bf1cd06960d tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.036943 Oct 24 10:26:21.220342 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 265/554] 10.222.0.50 () {58 vars in 1165 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:21.226791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df420942-4be2-4c16-9193-d0b2b86a635c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:21.227359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df420942-4be2-4c16-9193-d0b2b86a635c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:21.228196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df420942-4be2-4c16-9193-d0b2b86a635c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:21.228644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df420942-4be2-4c16-9193-d0b2b86a635c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:21.229196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df420942-4be2-4c16-9193-d0b2b86a635c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:21.229690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df420942-4be2-4c16-9193-d0b2b86a635c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:21.238186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fa35c3c8-50bd-44ea-881e-2b1d4a002f3f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.239057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fa35c3c8-50bd-44ea-881e-2b1d4a002f3f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:21.246720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa35c3c8-50bd-44ea-881e-2b1d4a002f3f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:21.247455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa35c3c8-50bd-44ea-881e-2b1d4a002f3f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:21.248043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa35c3c8-50bd-44ea-881e-2b1d4a002f3f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:21.248928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa35c3c8-50bd-44ea-881e-2b1d4a002f3f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:21.249536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa35c3c8-50bd-44ea-881e-2b1d4a002f3f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:21.250228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa35c3c8-50bd-44ea-881e-2b1d4a002f3f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:21.254466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:21.444690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-df420942-4be2-4c16-9193-d0b2b86a635c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:21.449953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fa35c3c8-50bd-44ea-881e-2b1d4a002f3f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:21.453967 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-df420942-4be2-4c16-9193-d0b2b86a635c tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 200 len: 1478 microversion: 2.1 time: 0.239565 Oct 24 10:26:21.454665 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 290/555] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 1478 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:21.460510 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fa35c3c8-50bd-44ea-881e-2b1d4a002f3f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1311 microversion: 2.1 time: 0.226611 Oct 24 10:26:21.461690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-518f964d-d218-4b45-aa5e-d6d149893059 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.467750 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 266/556] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1311 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:21.471049 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-518f964d-d218-4b45-aa5e-d6d149893059 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015051 Oct 24 10:26:21.471804 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 291/557] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:21.483330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ddc3af39-57d2-45bd-9920-346e6ebdbe2a tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.508765 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ddc3af39-57d2-45bd-9920-346e6ebdbe2a tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.028901 Oct 24 10:26:21.509566 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 267/558] 10.222.0.50 () {58 vars in 1169 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:21.527166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bd5891f2-2505-4001-985d-8b64a9495a7b tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.541025 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bd5891f2-2505-4001-985d-8b64a9495a7b tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.019965 Oct 24 10:26:21.541829 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 292/559] 10.222.0.50 () {58 vars in 1161 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:21.555822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9b169bd2-f748-4891-b6fd-839b829f4b3d tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.563231 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9b169bd2-f748-4891-b6fd-839b829f4b3d tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011840 Oct 24 10:26:21.563783 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 268/560] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:21.576272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-66b16d22-dd06-41a5-a5f8-6418496d4230 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.612600 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-66b16d22-dd06-41a5-a5f8-6418496d4230 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.039967 Oct 24 10:26:21.613197 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 293/561] 10.222.0.50 () {58 vars in 1167 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:21.629469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1280ffd0-0404-4115-a5bd-1096c66365de tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.639092 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1280ffd0-0404-4115-a5bd-1096c66365de tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013592 Oct 24 10:26:21.639650 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 269/562] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:21.651842 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a1548668-e889-434b-b0df-1ff3f3921aeb tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.676796 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a1548668-e889-434b-b0df-1ff3f3921aeb tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.028648 Oct 24 10:26:21.677519 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 294/563] 10.222.0.50 () {58 vars in 1144 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:26:21.691804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a64f4dcf-7170-4be8-bd20-629340e4bba5 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.701293 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a64f4dcf-7170-4be8-bd20-629340e4bba5 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013265 Oct 24 10:26:21.702595 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 270/564] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:21.714844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ea8cc039-7b0a-49a5-a258-ec33d7e023f3 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.739235 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ea8cc039-7b0a-49a5-a258-ec33d7e023f3 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.028084 Oct 24 10:26:21.740055 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 295/565] 10.222.0.50 () {58 vars in 1148 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:21.757071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d243f0d0-8ba5-48e0-9f04-cd7e86737ed8 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.763647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a44cecf6-5d08-4eb1-8331-74be9cd0c252 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.764570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a44cecf6-5d08-4eb1-8331-74be9cd0c252 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:21.773178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a44cecf6-5d08-4eb1-8331-74be9cd0c252 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:21.773905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a44cecf6-5d08-4eb1-8331-74be9cd0c252 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:21.774608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a44cecf6-5d08-4eb1-8331-74be9cd0c252 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:21.775685 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d243f0d0-8ba5-48e0-9f04-cd7e86737ed8 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.024906 Oct 24 10:26:21.775816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a44cecf6-5d08-4eb1-8331-74be9cd0c252 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:21.776345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a44cecf6-5d08-4eb1-8331-74be9cd0c252 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:21.777780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a44cecf6-5d08-4eb1-8331-74be9cd0c252 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:21.784524 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 296/566] 10.222.0.50 () {58 vars in 1140 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:21.789443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b1366d6d-6d9b-4beb-a798-2f4329f929e8 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.797146 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b1366d6d-6d9b-4beb-a798-2f4329f929e8 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011447 Oct 24 10:26:21.805246 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 297/567] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:21.810403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-91f05a02-5181-4f1e-871e-78df41013d5d tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.831411 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-91f05a02-5181-4f1e-871e-78df41013d5d tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.024564 Oct 24 10:26:21.832184 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 298/568] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:26:21.846591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-09bf6b6c-8742-46ad-8e22-b2729d6ffd67 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.868626 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-09bf6b6c-8742-46ad-8e22-b2729d6ffd67 tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.025898 Oct 24 10:26:21.872984 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 299/569] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:26:21.888621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f86f40e1-3db5-4ee2-aef2-635ab66ee5df tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:21.896823 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f86f40e1-3db5-4ee2-aef2-635ab66ee5df tempest-FlavorsV2TestJSON-362537735 tempest-FlavorsV2TestJSON-362537735-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011346 Oct 24 10:26:21.898846 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 300/570] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:21.956317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a44cecf6-5d08-4eb1-8331-74be9cd0c252 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:21.970750 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a44cecf6-5d08-4eb1-8331-74be9cd0c252 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 200 len: 1323 microversion: 2.1 time: 0.223374 Oct 24 10:26:21.972565 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 271/571] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:21 2022] GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 1323 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:22.069310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-952861a0-49ea-443a-a74f-77a69bcbf0d6 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:22.069936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-952861a0-49ea-443a-a74f-77a69bcbf0d6 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:22.076885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-952861a0-49ea-443a-a74f-77a69bcbf0d6 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:22.077394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-952861a0-49ea-443a-a74f-77a69bcbf0d6 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:22.077848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-952861a0-49ea-443a-a74f-77a69bcbf0d6 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:22.079836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-952861a0-49ea-443a-a74f-77a69bcbf0d6 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:22.080857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-952861a0-49ea-443a-a74f-77a69bcbf0d6 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:22.081432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-952861a0-49ea-443a-a74f-77a69bcbf0d6 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:22.150283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-952861a0-49ea-443a-a74f-77a69bcbf0d6 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:22.150789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-952861a0-49ea-443a-a74f-77a69bcbf0d6 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:22.151237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-952861a0-49ea-443a-a74f-77a69bcbf0d6 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:22.151702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-952861a0-49ea-443a-a74f-77a69bcbf0d6 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lazy-loading 'fault' on Instance uuid 425fa2bd-76f6-419a-a7be-64d6703f2148 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:26:22.196767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7e3cf7c4-e366-41ed-b9ba-8739e4eeef6c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:22.204633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7e3cf7c4-e366-41ed-b9ba-8739e4eeef6c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:22.221303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e3cf7c4-e366-41ed-b9ba-8739e4eeef6c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:22.222419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e3cf7c4-e366-41ed-b9ba-8739e4eeef6c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:22.223078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e3cf7c4-e366-41ed-b9ba-8739e4eeef6c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:22.224015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e3cf7c4-e366-41ed-b9ba-8739e4eeef6c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:22.226439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e3cf7c4-e366-41ed-b9ba-8739e4eeef6c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:22.227091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e3cf7c4-e366-41ed-b9ba-8739e4eeef6c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:22.356491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-952861a0-49ea-443a-a74f-77a69bcbf0d6 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:22.365352 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-952861a0-49ea-443a-a74f-77a69bcbf0d6 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148" status: 200 len: 1457 microversion: 2.1 time: 0.300267 Oct 24 10:26:22.366494 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 301/572] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:22 2022] GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 => generated 1457 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:22.412925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7e3cf7c4-e366-41ed-b9ba-8739e4eeef6c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:22.422398 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7e3cf7c4-e366-41ed-b9ba-8739e4eeef6c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1475 microversion: 2.1 time: 0.229922 Oct 24 10:26:22.423520 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 272/573] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:22 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1475 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:22.484663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-72902eeb-8597-4fd7-9a92-8ab1aa6bd91f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:22.487583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-241c9f0a-5417-4c63-b333-ea88f1eed36f tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:22.488471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-72902eeb-8597-4fd7-9a92-8ab1aa6bd91f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:22.489327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-241c9f0a-5417-4c63-b333-ea88f1eed36f tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:22.501884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72902eeb-8597-4fd7-9a92-8ab1aa6bd91f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:22.502714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72902eeb-8597-4fd7-9a92-8ab1aa6bd91f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:22.504246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-241c9f0a-5417-4c63-b333-ea88f1eed36f tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:22.504954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72902eeb-8597-4fd7-9a92-8ab1aa6bd91f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:22.506980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-241c9f0a-5417-4c63-b333-ea88f1eed36f tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:22.507664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-241c9f0a-5417-4c63-b333-ea88f1eed36f tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:22.508284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72902eeb-8597-4fd7-9a92-8ab1aa6bd91f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:22.509762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-241c9f0a-5417-4c63-b333-ea88f1eed36f tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:22.510582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72902eeb-8597-4fd7-9a92-8ab1aa6bd91f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:22.511232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72902eeb-8597-4fd7-9a92-8ab1aa6bd91f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:22.511904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-241c9f0a-5417-4c63-b333-ea88f1eed36f tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:22.517076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-241c9f0a-5417-4c63-b333-ea88f1eed36f tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:22.726101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-241c9f0a-5417-4c63-b333-ea88f1eed36f tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:22.734029 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-241c9f0a-5417-4c63-b333-ea88f1eed36f tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 200 len: 1478 microversion: 2.1 time: 0.257885 Oct 24 10:26:22.752942 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 302/574] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:22 2022] GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 1478 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:22.769204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-72902eeb-8597-4fd7-9a92-8ab1aa6bd91f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:22.779299 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-72902eeb-8597-4fd7-9a92-8ab1aa6bd91f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1311 microversion: 2.1 time: 0.299649 Oct 24 10:26:22.780646 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 273/575] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:22 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1311 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:22.994943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-37870304-6d43-4f06-9229-2aa448ab0396 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:22.995565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-37870304-6d43-4f06-9229-2aa448ab0396 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:23.002214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37870304-6d43-4f06-9229-2aa448ab0396 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:23.002895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37870304-6d43-4f06-9229-2aa448ab0396 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:23.003564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37870304-6d43-4f06-9229-2aa448ab0396 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:23.004482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37870304-6d43-4f06-9229-2aa448ab0396 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:23.004967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37870304-6d43-4f06-9229-2aa448ab0396 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:23.005607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37870304-6d43-4f06-9229-2aa448ab0396 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:23.150551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:23.179605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:23.325895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-37870304-6d43-4f06-9229-2aa448ab0396 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:23.338741 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-37870304-6d43-4f06-9229-2aa448ab0396 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 200 len: 1323 microversion: 2.1 time: 0.348388 Oct 24 10:26:23.341781 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 303/576] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:22 2022] GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 1323 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:23.391502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa9be9c7-af8b-4fe7-a2eb-6f517b39f806 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:23.393324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa9be9c7-af8b-4fe7-a2eb-6f517b39f806 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:23.406833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa9be9c7-af8b-4fe7-a2eb-6f517b39f806 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:23.407992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa9be9c7-af8b-4fe7-a2eb-6f517b39f806 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:23.411987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa9be9c7-af8b-4fe7-a2eb-6f517b39f806 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:23.433314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa9be9c7-af8b-4fe7-a2eb-6f517b39f806 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:23.434196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa9be9c7-af8b-4fe7-a2eb-6f517b39f806 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:23.434755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa9be9c7-af8b-4fe7-a2eb-6f517b39f806 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:23.446218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-43accf27-fb77-485d-8ab1-bf89c6a61f9f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:23.447950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-43accf27-fb77-485d-8ab1-bf89c6a61f9f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:23.479318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43accf27-fb77-485d-8ab1-bf89c6a61f9f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:23.487490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43accf27-fb77-485d-8ab1-bf89c6a61f9f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:23.488213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43accf27-fb77-485d-8ab1-bf89c6a61f9f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:23.489335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43accf27-fb77-485d-8ab1-bf89c6a61f9f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:23.490703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43accf27-fb77-485d-8ab1-bf89c6a61f9f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:23.491982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43accf27-fb77-485d-8ab1-bf89c6a61f9f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:23.530643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa9be9c7-af8b-4fe7-a2eb-6f517b39f806 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:23.531553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa9be9c7-af8b-4fe7-a2eb-6f517b39f806 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:23.532229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa9be9c7-af8b-4fe7-a2eb-6f517b39f806 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:23.533510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-aa9be9c7-af8b-4fe7-a2eb-6f517b39f806 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lazy-loading 'fault' on Instance uuid 425fa2bd-76f6-419a-a7be-64d6703f2148 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:26:23.859079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa9be9c7-af8b-4fe7-a2eb-6f517b39f806 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:23.874815 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa9be9c7-af8b-4fe7-a2eb-6f517b39f806 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148" status: 200 len: 1457 microversion: 2.1 time: 0.488299 Oct 24 10:26:23.876005 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 274/577] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:23 2022] GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 => generated 1457 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:23.882274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31d5ee31-0c57-4b4b-b301-8d4b6d238566 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:23.883226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31d5ee31-0c57-4b4b-b301-8d4b6d238566 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:23.892700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31d5ee31-0c57-4b4b-b301-8d4b6d238566 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:23.894413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31d5ee31-0c57-4b4b-b301-8d4b6d238566 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:23.895015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31d5ee31-0c57-4b4b-b301-8d4b6d238566 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:23.896159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31d5ee31-0c57-4b4b-b301-8d4b6d238566 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:23.896774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31d5ee31-0c57-4b4b-b301-8d4b6d238566 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:23.898956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31d5ee31-0c57-4b4b-b301-8d4b6d238566 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:23.948145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-43accf27-fb77-485d-8ab1-bf89c6a61f9f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:23.958217 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-43accf27-fb77-485d-8ab1-bf89c6a61f9f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1475 microversion: 2.1 time: 0.515606 Oct 24 10:26:23.959377 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 304/578] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:23 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1475 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:26:23.971801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0123c77c-3bf8-4dca-9cb3-5719020a7b56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:23.972599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0123c77c-3bf8-4dca-9cb3-5719020a7b56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:23.987472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0123c77c-3bf8-4dca-9cb3-5719020a7b56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:23.988719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0123c77c-3bf8-4dca-9cb3-5719020a7b56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:23.994716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0123c77c-3bf8-4dca-9cb3-5719020a7b56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:23.995751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0123c77c-3bf8-4dca-9cb3-5719020a7b56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:23.996428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0123c77c-3bf8-4dca-9cb3-5719020a7b56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:23.997276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0123c77c-3bf8-4dca-9cb3-5719020a7b56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:24.240625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-31d5ee31-0c57-4b4b-b301-8d4b6d238566 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:24.249689 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31d5ee31-0c57-4b4b-b301-8d4b6d238566 tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 200 len: 1478 microversion: 2.1 time: 0.372236 Oct 24 10:26:24.252280 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 275/579] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:23 2022] GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 1478 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:24.294278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0123c77c-3bf8-4dca-9cb3-5719020a7b56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:24.308016 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0123c77c-3bf8-4dca-9cb3-5719020a7b56 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1311 microversion: 2.1 time: 0.342226 Oct 24 10:26:24.308717 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 305/580] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:23 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1311 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:24.368485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-23527463-f9c1-4787-957e-43df033a3756 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:24.368900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-23527463-f9c1-4787-957e-43df033a3756 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:24.383799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23527463-f9c1-4787-957e-43df033a3756 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:24.384658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23527463-f9c1-4787-957e-43df033a3756 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:24.385133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23527463-f9c1-4787-957e-43df033a3756 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:24.385835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23527463-f9c1-4787-957e-43df033a3756 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:24.386284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23527463-f9c1-4787-957e-43df033a3756 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:24.386879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23527463-f9c1-4787-957e-43df033a3756 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:24.553334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-5ed5d81a-84db-4c1d-954e-d47b677534d3 req-548ca4ef-3a94-4858-8588-d2f4de7961ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425fa2bd-76f6-419a-a7be-64d6703f2148", "name": "network-vif-deleted", "tag": "d55a3b43-f0e3-4eae-9037-b14ac2478139"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:24.564053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5ed5d81a-84db-4c1d-954e-d47b677534d3 req-548ca4ef-3a94-4858-8588-d2f4de7961ee service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:24.571107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5ed5d81a-84db-4c1d-954e-d47b677534d3 req-548ca4ef-3a94-4858-8588-d2f4de7961ee service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:24.571656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5ed5d81a-84db-4c1d-954e-d47b677534d3 req-548ca4ef-3a94-4858-8588-d2f4de7961ee service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:24.593156 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-5ed5d81a-84db-4c1d-954e-d47b677534d3 req-548ca4ef-3a94-4858-8588-d2f4de7961ee service nova] Creating event network-vif-deleted:d55a3b43-f0e3-4eae-9037-b14ac2478139 for instance 425fa2bd-76f6-419a-a7be-64d6703f2148 on n-h1-858383-15 Oct 24 10:26:24.600098 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-5ed5d81a-84db-4c1d-954e-d47b677534d3 req-548ca4ef-3a94-4858-8588-d2f4de7961ee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050595 Oct 24 10:26:24.602362 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 306/581] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:26:24.639464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-23527463-f9c1-4787-957e-43df033a3756 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:24.648695 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-23527463-f9c1-4787-957e-43df033a3756 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 200 len: 1323 microversion: 2.1 time: 0.284172 Oct 24 10:26:24.649353 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 276/582] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:24 2022] GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 1323 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:24.900168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ad2716f1-1471-454c-93fd-3a672730c09d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:24.901349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ad2716f1-1471-454c-93fd-3a672730c09d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:24.914962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad2716f1-1471-454c-93fd-3a672730c09d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:24.915458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad2716f1-1471-454c-93fd-3a672730c09d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:24.915890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad2716f1-1471-454c-93fd-3a672730c09d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:24.916592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad2716f1-1471-454c-93fd-3a672730c09d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:24.923010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad2716f1-1471-454c-93fd-3a672730c09d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:24.923663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad2716f1-1471-454c-93fd-3a672730c09d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:24.975722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad2716f1-1471-454c-93fd-3a672730c09d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:24.976934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad2716f1-1471-454c-93fd-3a672730c09d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:24.977675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad2716f1-1471-454c-93fd-3a672730c09d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:24.978650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-ad2716f1-1471-454c-93fd-3a672730c09d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lazy-loading 'fault' on Instance uuid 425fa2bd-76f6-419a-a7be-64d6703f2148 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:26:24.985989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8e3da45c-ca19-4575-902a-ae49a94d02d0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:24.986603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8e3da45c-ca19-4575-902a-ae49a94d02d0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:24.996634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e3da45c-ca19-4575-902a-ae49a94d02d0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:24.997341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e3da45c-ca19-4575-902a-ae49a94d02d0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:24.997946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e3da45c-ca19-4575-902a-ae49a94d02d0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:24.999271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e3da45c-ca19-4575-902a-ae49a94d02d0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:25.005141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e3da45c-ca19-4575-902a-ae49a94d02d0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:25.005845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e3da45c-ca19-4575-902a-ae49a94d02d0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:25.125983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ad2716f1-1471-454c-93fd-3a672730c09d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fad079a57e4c36896955386e6f31ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bcc92db3323454f9d56d34a11fbe540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:25.137341 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ad2716f1-1471-454c-93fd-3a672730c09d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148" status: 200 len: 1309 microversion: 2.1 time: 0.243259 Oct 24 10:26:25.139058 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 307/583] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:24 2022] GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 => generated 1309 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:25.282638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3040ca6e-2abb-4a7d-818e-0f9017c41d0d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:25.290899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3040ca6e-2abb-4a7d-818e-0f9017c41d0d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:25.300204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:25.305280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3040ca6e-2abb-4a7d-818e-0f9017c41d0d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:25.306108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3040ca6e-2abb-4a7d-818e-0f9017c41d0d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:25.308138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3040ca6e-2abb-4a7d-818e-0f9017c41d0d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:25.309127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3040ca6e-2abb-4a7d-818e-0f9017c41d0d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:25.310683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3040ca6e-2abb-4a7d-818e-0f9017c41d0d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:25.312826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3040ca6e-2abb-4a7d-818e-0f9017c41d0d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:25.354280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8e3da45c-ca19-4575-902a-ae49a94d02d0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:25.367016 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8e3da45c-ca19-4575-902a-ae49a94d02d0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1475 microversion: 2.1 time: 0.385156 Oct 24 10:26:25.373311 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 277/584] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:24 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1475 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:25.378525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c6e18d2f-a939-45ec-8000-e452c3ef7290 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:25.392641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c6e18d2f-a939-45ec-8000-e452c3ef7290 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:25.415370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6e18d2f-a939-45ec-8000-e452c3ef7290 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:25.416090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6e18d2f-a939-45ec-8000-e452c3ef7290 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:25.418773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6e18d2f-a939-45ec-8000-e452c3ef7290 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:25.419406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6e18d2f-a939-45ec-8000-e452c3ef7290 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:25.420653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6e18d2f-a939-45ec-8000-e452c3ef7290 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:25.421279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6e18d2f-a939-45ec-8000-e452c3ef7290 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:25.447250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3040ca6e-2abb-4a7d-818e-0f9017c41d0d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:25.448061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3040ca6e-2abb-4a7d-818e-0f9017c41d0d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:25.448888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3040ca6e-2abb-4a7d-818e-0f9017c41d0d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:25.451073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-3040ca6e-2abb-4a7d-818e-0f9017c41d0d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lazy-loading 'fault' on Instance uuid 012048e0-d21f-4bff-8616-81d284df270e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:26:25.591736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3040ca6e-2abb-4a7d-818e-0f9017c41d0d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2ecfd950eeb40409aaaff59f782d1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabaf79a7d42463ea67fd9b5f7a12951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:25.605481 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3040ca6e-2abb-4a7d-818e-0f9017c41d0d tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 200 len: 1312 microversion: 2.1 time: 0.330179 Oct 24 10:26:25.606117 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 308/585] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:25 2022] GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 1312 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:25.674678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0515f873-5970-4c01-bf11-da96dbdccf9d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:25.675321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0515f873-5970-4c01-bf11-da96dbdccf9d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:25.682933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0515f873-5970-4c01-bf11-da96dbdccf9d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:25.683428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0515f873-5970-4c01-bf11-da96dbdccf9d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:25.683863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0515f873-5970-4c01-bf11-da96dbdccf9d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:25.684868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0515f873-5970-4c01-bf11-da96dbdccf9d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:25.685333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0515f873-5970-4c01-bf11-da96dbdccf9d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:25.685755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0515f873-5970-4c01-bf11-da96dbdccf9d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:25.877511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c6e18d2f-a939-45ec-8000-e452c3ef7290 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:25.891237 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c6e18d2f-a939-45ec-8000-e452c3ef7290 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1311 microversion: 2.1 time: 0.511150 Oct 24 10:26:25.892562 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 278/586] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:25 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1311 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:26.052812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0515f873-5970-4c01-bf11-da96dbdccf9d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:26.062028 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0515f873-5970-4c01-bf11-da96dbdccf9d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 200 len: 1323 microversion: 2.1 time: 0.394217 Oct 24 10:26:26.077285 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 309/587] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:25 2022] GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 1323 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:26:26.163889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-64786cae-94bf-4b69-bd9d-8e592daa966d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:26.164876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-64786cae-94bf-4b69-bd9d-8e592daa966d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:26.176259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64786cae-94bf-4b69-bd9d-8e592daa966d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:26.178353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64786cae-94bf-4b69-bd9d-8e592daa966d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:26.178982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64786cae-94bf-4b69-bd9d-8e592daa966d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:26.181429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64786cae-94bf-4b69-bd9d-8e592daa966d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:26.182499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64786cae-94bf-4b69-bd9d-8e592daa966d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:26.183383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64786cae-94bf-4b69-bd9d-8e592daa966d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:26.202322 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-64786cae-94bf-4b69-bd9d-8e592daa966d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] HTTP exception thrown: Instance 425fa2bd-76f6-419a-a7be-64d6703f2148 could not be found. Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-64786cae-94bf-4b69-bd9d-8e592daa966d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Request method failure captured: Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 HTTP/1.1 Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmgOX3Ujtr9hYTDHc1vhI_CdHgAemoXfzxvPyqH5jkdLE1gQ5oLSxv8Wqx_YFuf_2TdnjV6gmc5GAToe6Otj7aYUz1RCgOo7wjuY42vNzZSKiQiB9sY991dZLpEwGzgJi8S2VmWbxAySpZr0GYKMJ23fhfj0Ojhb4tRUD7gwGq9dF6Q Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4bcc92db3323454f9d56d34a11fbe540 Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersAdminTestJSON-875278464 Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:26:26.204972 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:26:26.206259 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bcc92db3323454f9d56d34a11fbe540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bcc92db3323454f9d56d34a11fbe540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4bcc92db3323454f9d56d34a11fbe540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4bcc92db3323454f9d56d34a11fbe540", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:26.206259 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersAdminTestJSON-875278464 Oct 24 10:26:26.206259 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4bcc92db3323454f9d56d34a11fbe540 Oct 24 10:26:26.206259 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-875278464 Oct 24 10:26:26.206259 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersAdminTestJSON-875278464-project Oct 24 10:26:26.206259 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:26:26.206259 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:26:26.206259 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: e2fad079a57e4c36896955386e6f31ef Oct 24 10:26:26.206259 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersAdminTestJSON-875278464-project Oct 24 10:26:26.206259 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:26:26.206259 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 425fa2bd-76f6-419a-a7be-64d6703f2148 could not be found. Oct 24 10:26:26.206259 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '425fa2bd-76f6-419a-a7be-64d6703f2148'} Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425fa2bd-76f6-419a-a7be-64d6703f2148 could not be found. Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:26.207018 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:26.209026 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:26.209026 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:26:26.209026 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:26:26.209026 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:26:26.209026 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:26:26.209026 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:26:26.209026 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:26:26.209026 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425fa2bd-76f6-419a-a7be-64d6703f2148 could not be found. Oct 24 10:26:26.209026 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.209026 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:26.209026 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.209026 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:26.209026 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:26.209026 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:26.209026 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:26.209026 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:26.209026 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425fa2bd-76f6-419a-a7be-64d6703f2148 could not be found. Oct 24 10:26:26.209026 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.211601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-64786cae-94bf-4b69-bd9d-8e592daa966d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Returning 404 to user: Instance 425fa2bd-76f6-419a-a7be-64d6703f2148 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:26.212671 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-64786cae-94bf-4b69-bd9d-8e592daa966d tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148" status: 404 len: 111 microversion: 2.1 time: 0.054672 Oct 24 10:26:26.217928 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 279/588] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:26 2022] GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:26:26.222982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e93948c-82a0-43a2-8ee2-c2153a97e092 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:26.223751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3e93948c-82a0-43a2-8ee2-c2153a97e092 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:26.230967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e93948c-82a0-43a2-8ee2-c2153a97e092 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:26.231669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e93948c-82a0-43a2-8ee2-c2153a97e092 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:26.232316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e93948c-82a0-43a2-8ee2-c2153a97e092 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:26.233223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e93948c-82a0-43a2-8ee2-c2153a97e092 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:26.233826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e93948c-82a0-43a2-8ee2-c2153a97e092 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:26.234592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e93948c-82a0-43a2-8ee2-c2153a97e092 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:26.257865 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-3e93948c-82a0-43a2-8ee2-c2153a97e092 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] HTTP exception thrown: Instance 425fa2bd-76f6-419a-a7be-64d6703f2148 could not be found. Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e93948c-82a0-43a2-8ee2-c2153a97e092 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Request method failure captured: Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 HTTP/1.1 Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmgOX3Ujtr9hYTDHc1vhI_CdHgAemoXfzxvPyqH5jkdLE1gQ5oLSxv8Wqx_YFuf_2TdnjV6gmc5GAToe6Otj7aYUz1RCgOo7wjuY42vNzZSKiQiB9sY991dZLpEwGzgJi8S2VmWbxAySpZr0GYKMJ23fhfj0Ojhb4tRUD7gwGq9dF6Q Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4bcc92db3323454f9d56d34a11fbe540 Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-DeleteServersAdminTestJSON-875278464 Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:26:26.259880 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:26:26.261305 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bcc92db3323454f9d56d34a11fbe540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bcc92db3323454f9d56d34a11fbe540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4bcc92db3323454f9d56d34a11fbe540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4bcc92db3323454f9d56d34a11fbe540", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:26.261305 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-DeleteServersAdminTestJSON-875278464 Oct 24 10:26:26.261305 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4bcc92db3323454f9d56d34a11fbe540 Oct 24 10:26:26.261305 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-875278464 Oct 24 10:26:26.261305 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-DeleteServersAdminTestJSON-875278464-project Oct 24 10:26:26.261305 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:26:26.261305 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:26:26.261305 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: e2fad079a57e4c36896955386e6f31ef Oct 24 10:26:26.261305 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-DeleteServersAdminTestJSON-875278464-project Oct 24 10:26:26.261305 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:26:26.261305 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 425fa2bd-76f6-419a-a7be-64d6703f2148 could not be found. Oct 24 10:26:26.261305 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '425fa2bd-76f6-419a-a7be-64d6703f2148'} Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425fa2bd-76f6-419a-a7be-64d6703f2148 could not be found. Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:26.262252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425fa2bd-76f6-419a-a7be-64d6703f2148 could not be found. Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425fa2bd-76f6-419a-a7be-64d6703f2148 could not be found. Oct 24 10:26:26.263510 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.265880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e93948c-82a0-43a2-8ee2-c2153a97e092 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Returning 404 to user: Instance 425fa2bd-76f6-419a-a7be-64d6703f2148 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:26.266883 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3e93948c-82a0-43a2-8ee2-c2153a97e092 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "DELETE /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148" status: 404 len: 111 microversion: 2.1 time: 0.047860 Oct 24 10:26:26.267875 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 310/589] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:26:26 2022] DELETE /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:26:26.276710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a5c3729-4680-4c7a-8918-ce56587ba0e5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:26.277381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0a5c3729-4680-4c7a-8918-ce56587ba0e5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 425fa2bd-76f6-419a-a7be-64d6703f2148] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:26.284730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a5c3729-4680-4c7a-8918-ce56587ba0e5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:26.285440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a5c3729-4680-4c7a-8918-ce56587ba0e5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:26.286188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a5c3729-4680-4c7a-8918-ce56587ba0e5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:26.287709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a5c3729-4680-4c7a-8918-ce56587ba0e5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:26.288352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a5c3729-4680-4c7a-8918-ce56587ba0e5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:26.289284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a5c3729-4680-4c7a-8918-ce56587ba0e5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:26.308043 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-0a5c3729-4680-4c7a-8918-ce56587ba0e5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] HTTP exception thrown: Instance 425fa2bd-76f6-419a-a7be-64d6703f2148 could not be found. Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a5c3729-4680-4c7a-8918-ce56587ba0e5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Request method failure captured: Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 HTTP/1.1 Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmgOX3Ujtr9hYTDHc1vhI_CdHgAemoXfzxvPyqH5jkdLE1gQ5oLSxv8Wqx_YFuf_2TdnjV6gmc5GAToe6Otj7aYUz1RCgOo7wjuY42vNzZSKiQiB9sY991dZLpEwGzgJi8S2VmWbxAySpZr0GYKMJ23fhfj0Ojhb4tRUD7gwGq9dF6Q Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4bcc92db3323454f9d56d34a11fbe540 Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersAdminTestJSON-875278464 Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:26:26.309750 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:26:26.311038 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bcc92db3323454f9d56d34a11fbe540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bcc92db3323454f9d56d34a11fbe540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4bcc92db3323454f9d56d34a11fbe540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4bcc92db3323454f9d56d34a11fbe540", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:26.311038 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersAdminTestJSON-875278464 Oct 24 10:26:26.311038 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4bcc92db3323454f9d56d34a11fbe540 Oct 24 10:26:26.311038 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-875278464 Oct 24 10:26:26.311038 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersAdminTestJSON-875278464-project Oct 24 10:26:26.311038 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:26:26.311038 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:26:26.311038 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: e2fad079a57e4c36896955386e6f31ef Oct 24 10:26:26.311038 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersAdminTestJSON-875278464-project Oct 24 10:26:26.311038 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:26:26.311038 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 425fa2bd-76f6-419a-a7be-64d6703f2148 could not be found. Oct 24 10:26:26.311038 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '425fa2bd-76f6-419a-a7be-64d6703f2148'} Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425fa2bd-76f6-419a-a7be-64d6703f2148 could not be found. Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:26.311744 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:26.312890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:26.312890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:26:26.312890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:26:26.312890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:26:26.312890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:26:26.312890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:26:26.312890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:26:26.312890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425fa2bd-76f6-419a-a7be-64d6703f2148 could not be found. Oct 24 10:26:26.312890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.312890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:26.312890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.312890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:26.312890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:26.312890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:26.312890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:26.312890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:26.312890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425fa2bd-76f6-419a-a7be-64d6703f2148 could not be found. Oct 24 10:26:26.312890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.313976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a5c3729-4680-4c7a-8918-ce56587ba0e5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Returning 404 to user: Instance 425fa2bd-76f6-419a-a7be-64d6703f2148 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:26.313976 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0a5c3729-4680-4c7a-8918-ce56587ba0e5 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148" status: 404 len: 111 microversion: 2.1 time: 0.039022 Oct 24 10:26:26.315981 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 280/590] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:26 2022] GET /compute/v2.1/servers/425fa2bd-76f6-419a-a7be-64d6703f2148 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:26:26.320813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2b0eb221-f1e4-4f90-a94f-a1509c136f71 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:26.321584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2b0eb221-f1e4-4f90-a94f-a1509c136f71 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:26.331985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b0eb221-f1e4-4f90-a94f-a1509c136f71 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:26.333353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b0eb221-f1e4-4f90-a94f-a1509c136f71 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:26.334788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b0eb221-f1e4-4f90-a94f-a1509c136f71 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:26.336540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b0eb221-f1e4-4f90-a94f-a1509c136f71 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:26.337191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b0eb221-f1e4-4f90-a94f-a1509c136f71 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:26.337779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b0eb221-f1e4-4f90-a94f-a1509c136f71 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:26.356432 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-2b0eb221-f1e4-4f90-a94f-a1509c136f71 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] HTTP exception thrown: Instance 2942efdb-333c-47f7-8f37-3487f6228236 could not be found. Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2b0eb221-f1e4-4f90-a94f-a1509c136f71 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Request method failure captured: Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 HTTP/1.1 Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmgOX3Ujtr9hYTDHc1vhI_CdHgAemoXfzxvPyqH5jkdLE1gQ5oLSxv8Wqx_YFuf_2TdnjV6gmc5GAToe6Otj7aYUz1RCgOo7wjuY42vNzZSKiQiB9sY991dZLpEwGzgJi8S2VmWbxAySpZr0GYKMJ23fhfj0Ojhb4tRUD7gwGq9dF6Q Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4bcc92db3323454f9d56d34a11fbe540 Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-DeleteServersAdminTestJSON-875278464 Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:26:26.358239 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:26:26.359552 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bcc92db3323454f9d56d34a11fbe540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bcc92db3323454f9d56d34a11fbe540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4bcc92db3323454f9d56d34a11fbe540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4bcc92db3323454f9d56d34a11fbe540", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:26.359552 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-DeleteServersAdminTestJSON-875278464 Oct 24 10:26:26.359552 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4bcc92db3323454f9d56d34a11fbe540 Oct 24 10:26:26.359552 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-875278464 Oct 24 10:26:26.359552 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-DeleteServersAdminTestJSON-875278464-project Oct 24 10:26:26.359552 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:26:26.359552 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:26:26.359552 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: e2fad079a57e4c36896955386e6f31ef Oct 24 10:26:26.359552 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-DeleteServersAdminTestJSON-875278464-project Oct 24 10:26:26.359552 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:26:26.359552 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 2942efdb-333c-47f7-8f37-3487f6228236 could not be found. Oct 24 10:26:26.359552 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '2942efdb-333c-47f7-8f37-3487f6228236'} Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2942efdb-333c-47f7-8f37-3487f6228236 could not be found. Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:26.360255 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2942efdb-333c-47f7-8f37-3487f6228236 could not be found. Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2942efdb-333c-47f7-8f37-3487f6228236 could not be found. Oct 24 10:26:26.361913 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.363467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2b0eb221-f1e4-4f90-a94f-a1509c136f71 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Returning 404 to user: Instance 2942efdb-333c-47f7-8f37-3487f6228236 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:26.363467 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2b0eb221-f1e4-4f90-a94f-a1509c136f71 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 404 len: 111 microversion: 2.1 time: 0.043347 Oct 24 10:26:26.363467 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 311/591] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:26:26 2022] DELETE /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:26:26.371356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d2fe6915-224e-45ea-812c-a4839b747877 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:26.371995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d2fe6915-224e-45ea-812c-a4839b747877 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] [instance: 2942efdb-333c-47f7-8f37-3487f6228236] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:26.379739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2fe6915-224e-45ea-812c-a4839b747877 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:26.380176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2fe6915-224e-45ea-812c-a4839b747877 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:26.381791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2fe6915-224e-45ea-812c-a4839b747877 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:26.382601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2fe6915-224e-45ea-812c-a4839b747877 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:26.383671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2fe6915-224e-45ea-812c-a4839b747877 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:26.384113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2fe6915-224e-45ea-812c-a4839b747877 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:26.400813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bd7a9efc-5922-420e-a0a4-370081bec99e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:26.401722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bd7a9efc-5922-420e-a0a4-370081bec99e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:26.402231 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-d2fe6915-224e-45ea-812c-a4839b747877 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] HTTP exception thrown: Instance 2942efdb-333c-47f7-8f37-3487f6228236 could not be found. Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d2fe6915-224e-45ea-812c-a4839b747877 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Request method failure captured: Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 HTTP/1.1 Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmgOX3Ujtr9hYTDHc1vhI_CdHgAemoXfzxvPyqH5jkdLE1gQ5oLSxv8Wqx_YFuf_2TdnjV6gmc5GAToe6Otj7aYUz1RCgOo7wjuY42vNzZSKiQiB9sY991dZLpEwGzgJi8S2VmWbxAySpZr0GYKMJ23fhfj0Ojhb4tRUD7gwGq9dF6Q Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4bcc92db3323454f9d56d34a11fbe540 Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersAdminTestJSON-875278464 Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:26:26.403883 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:26:26.405344 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bcc92db3323454f9d56d34a11fbe540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bcc92db3323454f9d56d34a11fbe540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4bcc92db3323454f9d56d34a11fbe540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4bcc92db3323454f9d56d34a11fbe540", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:26.405344 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersAdminTestJSON-875278464 Oct 24 10:26:26.405344 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4bcc92db3323454f9d56d34a11fbe540 Oct 24 10:26:26.405344 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-875278464 Oct 24 10:26:26.405344 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersAdminTestJSON-875278464-project Oct 24 10:26:26.405344 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:26:26.405344 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:26:26.405344 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: e2fad079a57e4c36896955386e6f31ef Oct 24 10:26:26.405344 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersAdminTestJSON-875278464-project Oct 24 10:26:26.405344 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:26:26.405344 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 2942efdb-333c-47f7-8f37-3487f6228236 could not be found. Oct 24 10:26:26.405344 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '2942efdb-333c-47f7-8f37-3487f6228236'} Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2942efdb-333c-47f7-8f37-3487f6228236 could not be found. Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:26.406117 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:26.407481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:26.407481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:26:26.407481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:26:26.407481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:26:26.407481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:26:26.407481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:26:26.407481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:26:26.407481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2942efdb-333c-47f7-8f37-3487f6228236 could not be found. Oct 24 10:26:26.407481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.407481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:26.407481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.407481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:26.407481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:26.407481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:26.407481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:26.407481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:26.407481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2942efdb-333c-47f7-8f37-3487f6228236 could not be found. Oct 24 10:26:26.407481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.408509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d2fe6915-224e-45ea-812c-a4839b747877 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] Returning 404 to user: Instance 2942efdb-333c-47f7-8f37-3487f6228236 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:26.408509 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d2fe6915-224e-45ea-812c-a4839b747877 tempest-DeleteServersAdminTestJSON-875278464 tempest-DeleteServersAdminTestJSON-875278464-project] 10.222.0.50 "GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236" status: 404 len: 111 microversion: 2.1 time: 0.040697 Oct 24 10:26:26.409602 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 281/592] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:26 2022] GET /compute/v2.1/servers/2942efdb-333c-47f7-8f37-3487f6228236 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:26:26.414868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd7a9efc-5922-420e-a0a4-370081bec99e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:26.415628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd7a9efc-5922-420e-a0a4-370081bec99e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:26.416418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd7a9efc-5922-420e-a0a4-370081bec99e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:26.417519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd7a9efc-5922-420e-a0a4-370081bec99e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:26.418195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd7a9efc-5922-420e-a0a4-370081bec99e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:26.418841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd7a9efc-5922-420e-a0a4-370081bec99e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:26.498722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-04a70098-de7e-471c-9cd0-1c32cabb0ddf req-2deaaf3d-778f-4884-8a49-49671a53802d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ef26c4-a579-469e-b5db-bc2b0e17e99d", "name": "network-vif-plugged", "status": "completed", "tag": "7b8b4301-4ceb-4f7a-a75e-0a52614ad84f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:26.523463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-04a70098-de7e-471c-9cd0-1c32cabb0ddf req-2deaaf3d-778f-4884-8a49-49671a53802d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:26.524000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-04a70098-de7e-471c-9cd0-1c32cabb0ddf req-2deaaf3d-778f-4884-8a49-49671a53802d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:26.526128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-04a70098-de7e-471c-9cd0-1c32cabb0ddf req-2deaaf3d-778f-4884-8a49-49671a53802d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:26.560325 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-04a70098-de7e-471c-9cd0-1c32cabb0ddf req-2deaaf3d-778f-4884-8a49-49671a53802d service nova] Creating event network-vif-plugged:7b8b4301-4ceb-4f7a-a75e-0a52614ad84f for instance e0ef26c4-a579-469e-b5db-bc2b0e17e99d on n-h2-858383-15 Oct 24 10:26:26.571317 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-04a70098-de7e-471c-9cd0-1c32cabb0ddf req-2deaaf3d-778f-4884-8a49-49671a53802d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078103 Oct 24 10:26:26.573096 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 282/593] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:26.631640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-61145c8c-7d13-4f4f-9cdf-27ed30121aaf tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:26.632620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-61145c8c-7d13-4f4f-9cdf-27ed30121aaf tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] [instance: 012048e0-d21f-4bff-8616-81d284df270e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:26.646740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61145c8c-7d13-4f4f-9cdf-27ed30121aaf tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:26.647242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61145c8c-7d13-4f4f-9cdf-27ed30121aaf tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:26.647688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61145c8c-7d13-4f4f-9cdf-27ed30121aaf tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:26.648398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61145c8c-7d13-4f4f-9cdf-27ed30121aaf tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:26.654676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61145c8c-7d13-4f4f-9cdf-27ed30121aaf tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:26.655050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61145c8c-7d13-4f4f-9cdf-27ed30121aaf tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:26.700673 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-61145c8c-7d13-4f4f-9cdf-27ed30121aaf tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] HTTP exception thrown: Instance 012048e0-d21f-4bff-8616-81d284df270e could not be found. Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-61145c8c-7d13-4f4f-9cdf-27ed30121aaf tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Request method failure captured: Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e HTTP/1.1 Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmf7qhCdlLUccJOoyLysekLhd8iClpa5jCIu-tZeg-axyVbg5YhZV4iBB4XxsWDPZqgV6tdKfGR25HG74RiIESvavmg7KcQQ443J7JZQGOD2cdXS0NpVKTPfeCHn0Bsm3a9XOBMWixHsik0olrt-cMn_S7DHE5YAVca8yh8ZsPiRMIw Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: dabaf79a7d42463ea67fd9b5f7a12951 Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1449172068 Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:26:26.710051 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:26:26.711507 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dabaf79a7d42463ea67fd9b5f7a12951"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dabaf79a7d42463ea67fd9b5f7a12951"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dabaf79a7d42463ea67fd9b5f7a12951"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dabaf79a7d42463ea67fd9b5f7a12951", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:26.711507 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1449172068 Oct 24 10:26:26.711507 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: dabaf79a7d42463ea67fd9b5f7a12951 Oct 24 10:26:26.711507 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1449172068 Oct 24 10:26:26.711507 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersAdminNegativeTestJSON-1449172068-project Oct 24 10:26:26.711507 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:26:26.711507 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:26:26.711507 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: c2ecfd950eeb40409aaaff59f782d1f4 Oct 24 10:26:26.711507 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1449172068-project Oct 24 10:26:26.711507 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:26:26.711507 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 012048e0-d21f-4bff-8616-81d284df270e could not be found. Oct 24 10:26:26.711507 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '012048e0-d21f-4bff-8616-81d284df270e'} Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 012048e0-d21f-4bff-8616-81d284df270e could not be found. Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:26.712236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:26.713816 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:26.713816 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:26:26.713816 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:26:26.713816 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:26:26.713816 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:26:26.713816 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:26:26.713816 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:26:26.713816 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 012048e0-d21f-4bff-8616-81d284df270e could not be found. Oct 24 10:26:26.713816 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.713816 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:26.713816 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.713816 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:26.713816 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:26.713816 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:26.713816 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:26.713816 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:26.713816 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 012048e0-d21f-4bff-8616-81d284df270e could not be found. Oct 24 10:26:26.713816 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:26.715237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-61145c8c-7d13-4f4f-9cdf-27ed30121aaf tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] Returning 404 to user: Instance 012048e0-d21f-4bff-8616-81d284df270e could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:26.715237 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-61145c8c-7d13-4f4f-9cdf-27ed30121aaf tempest-ServersAdminNegativeTestJSON-1449172068 tempest-ServersAdminNegativeTestJSON-1449172068-project] 10.222.0.50 "GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e" status: 404 len: 111 microversion: 2.1 time: 0.085238 Oct 24 10:26:26.715237 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 283/594] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:26 2022] GET /compute/v2.1/servers/012048e0-d21f-4bff-8616-81d284df270e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:26:26.774020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bd7a9efc-5922-420e-a0a4-370081bec99e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:26.790417 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bd7a9efc-5922-420e-a0a4-370081bec99e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1475 microversion: 2.1 time: 0.394804 Oct 24 10:26:26.793564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-71f3cb32-ba4b-4ee8-bfc4-b0eed16a0298 req-d5067acb-0ec3-4ecf-92f5-7cc8f4ad46a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "012048e0-d21f-4bff-8616-81d284df270e", "name": "network-vif-deleted", "tag": "5902c93d-246e-4e8c-b4f3-5da471a2a551"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:26.795818 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 312/595] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:26 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1475 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:26:26.826200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-71f3cb32-ba4b-4ee8-bfc4-b0eed16a0298 req-d5067acb-0ec3-4ecf-92f5-7cc8f4ad46a2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:26.831719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-71f3cb32-ba4b-4ee8-bfc4-b0eed16a0298 req-d5067acb-0ec3-4ecf-92f5-7cc8f4ad46a2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:26.832624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-71f3cb32-ba4b-4ee8-bfc4-b0eed16a0298 req-d5067acb-0ec3-4ecf-92f5-7cc8f4ad46a2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:26.866320 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-71f3cb32-ba4b-4ee8-bfc4-b0eed16a0298 req-d5067acb-0ec3-4ecf-92f5-7cc8f4ad46a2 service nova] Creating event network-vif-deleted:5902c93d-246e-4e8c-b4f3-5da471a2a551 for instance 012048e0-d21f-4bff-8616-81d284df270e on n-h1-858383-15 Oct 24 10:26:26.878800 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-71f3cb32-ba4b-4ee8-bfc4-b0eed16a0298 req-d5067acb-0ec3-4ecf-92f5-7cc8f4ad46a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122485 Oct 24 10:26:26.881700 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 284/596] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:26.920122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-10f4e058-d5fc-4516-ba7b-b3e9f294c824 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:26.921308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-10f4e058-d5fc-4516-ba7b-b3e9f294c824 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:26.935534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10f4e058-d5fc-4516-ba7b-b3e9f294c824 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:26.936600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10f4e058-d5fc-4516-ba7b-b3e9f294c824 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:26.937373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10f4e058-d5fc-4516-ba7b-b3e9f294c824 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:26.939033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10f4e058-d5fc-4516-ba7b-b3e9f294c824 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:26.940117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10f4e058-d5fc-4516-ba7b-b3e9f294c824 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:26.940810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10f4e058-d5fc-4516-ba7b-b3e9f294c824 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:27.089109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b71d3b08-67ff-4b73-8cdb-2f9bbfa37049 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:27.089828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b71d3b08-67ff-4b73-8cdb-2f9bbfa37049 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:27.104556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b71d3b08-67ff-4b73-8cdb-2f9bbfa37049 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:27.109066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b71d3b08-67ff-4b73-8cdb-2f9bbfa37049 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:27.110249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b71d3b08-67ff-4b73-8cdb-2f9bbfa37049 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:27.114399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b71d3b08-67ff-4b73-8cdb-2f9bbfa37049 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:27.122068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b71d3b08-67ff-4b73-8cdb-2f9bbfa37049 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:27.122068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b71d3b08-67ff-4b73-8cdb-2f9bbfa37049 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:27.308127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-10f4e058-d5fc-4516-ba7b-b3e9f294c824 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:27.320989 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-10f4e058-d5fc-4516-ba7b-b3e9f294c824 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1311 microversion: 2.1 time: 0.406254 Oct 24 10:26:27.325521 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 313/597] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:26 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1311 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:27.525115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b71d3b08-67ff-4b73-8cdb-2f9bbfa37049 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:27.540931 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b71d3b08-67ff-4b73-8cdb-2f9bbfa37049 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 200 len: 1323 microversion: 2.1 time: 0.453872 Oct 24 10:26:27.543069 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 285/598] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:27 2022] GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 1323 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:26:27.821160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-13d685b6-9afe-476b-8893-3b74a6db0c27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:27.822042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-13d685b6-9afe-476b-8893-3b74a6db0c27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:27.831302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13d685b6-9afe-476b-8893-3b74a6db0c27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:27.832002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13d685b6-9afe-476b-8893-3b74a6db0c27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:27.833197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13d685b6-9afe-476b-8893-3b74a6db0c27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:27.834934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13d685b6-9afe-476b-8893-3b74a6db0c27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:27.835412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13d685b6-9afe-476b-8893-3b74a6db0c27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:27.835967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13d685b6-9afe-476b-8893-3b74a6db0c27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:27.846209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:28.066122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-13d685b6-9afe-476b-8893-3b74a6db0c27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:28.075636 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-13d685b6-9afe-476b-8893-3b74a6db0c27 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1475 microversion: 2.1 time: 0.260024 Oct 24 10:26:28.077358 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 314/599] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:27 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1475 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:28.353192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5bffaa32-dd81-4b69-a00b-1b9f67602710 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:28.354235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5bffaa32-dd81-4b69-a00b-1b9f67602710 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:28.366108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bffaa32-dd81-4b69-a00b-1b9f67602710 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:28.367009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bffaa32-dd81-4b69-a00b-1b9f67602710 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:28.368936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bffaa32-dd81-4b69-a00b-1b9f67602710 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:28.372106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bffaa32-dd81-4b69-a00b-1b9f67602710 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:28.372888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bffaa32-dd81-4b69-a00b-1b9f67602710 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:28.377337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bffaa32-dd81-4b69-a00b-1b9f67602710 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:28.571481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0b4bc76d-7f6f-421d-9e66-9600e18c308b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:28.572114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0b4bc76d-7f6f-421d-9e66-9600e18c308b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:28.592775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b4bc76d-7f6f-421d-9e66-9600e18c308b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:28.593304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b4bc76d-7f6f-421d-9e66-9600e18c308b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:28.593742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b4bc76d-7f6f-421d-9e66-9600e18c308b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:28.594482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b4bc76d-7f6f-421d-9e66-9600e18c308b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:28.595044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b4bc76d-7f6f-421d-9e66-9600e18c308b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:28.595353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b4bc76d-7f6f-421d-9e66-9600e18c308b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:29.197459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5bffaa32-dd81-4b69-a00b-1b9f67602710 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:29.209143 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5bffaa32-dd81-4b69-a00b-1b9f67602710 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1311 microversion: 2.1 time: 0.861961 Oct 24 10:26:29.210819 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 286/600] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:28 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1311 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:29.218893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-07d7273c-9173-4683-a9be-3f54002be1a0 req-54135de3-dae4-421b-98f3-de67ce0207ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d34420-321b-4914-a4e0-d03965e049b3", "name": "network-vif-plugged", "status": "completed", "tag": "3da84e0c-5c52-4ffa-8616-0781a71c3874"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:29.232123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-07d7273c-9173-4683-a9be-3f54002be1a0 req-54135de3-dae4-421b-98f3-de67ce0207ea service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:29.234390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-07d7273c-9173-4683-a9be-3f54002be1a0 req-54135de3-dae4-421b-98f3-de67ce0207ea service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:29.235128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-07d7273c-9173-4683-a9be-3f54002be1a0 req-54135de3-dae4-421b-98f3-de67ce0207ea service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:29.268356 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-07d7273c-9173-4683-a9be-3f54002be1a0 req-54135de3-dae4-421b-98f3-de67ce0207ea service nova] Creating event network-vif-plugged:3da84e0c-5c52-4ffa-8616-0781a71c3874 for instance 00d34420-321b-4914-a4e0-d03965e049b3 on n-h1-858383-15 Oct 24 10:26:29.287252 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-07d7273c-9173-4683-a9be-3f54002be1a0 req-54135de3-dae4-421b-98f3-de67ce0207ea service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073562 Oct 24 10:26:29.288163 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 287/601] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:29.300157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0b4bc76d-7f6f-421d-9e66-9600e18c308b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:29.305120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6fa525fa-135c-4f74-b622-3a4fa75b8584 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:29.306885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6fa525fa-135c-4f74-b622-3a4fa75b8584 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:29.313590 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0b4bc76d-7f6f-421d-9e66-9600e18c308b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 200 len: 1323 microversion: 2.1 time: 0.746162 Oct 24 10:26:29.314859 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 315/602] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:28 2022] GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 1323 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:29.323415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fa525fa-135c-4f74-b622-3a4fa75b8584 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:29.324819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fa525fa-135c-4f74-b622-3a4fa75b8584 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:29.330370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fa525fa-135c-4f74-b622-3a4fa75b8584 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:29.332145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fa525fa-135c-4f74-b622-3a4fa75b8584 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:29.332868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fa525fa-135c-4f74-b622-3a4fa75b8584 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:29.334148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fa525fa-135c-4f74-b622-3a4fa75b8584 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:29.588556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6fa525fa-135c-4f74-b622-3a4fa75b8584 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:29.602147 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6fa525fa-135c-4f74-b622-3a4fa75b8584 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1475 microversion: 2.1 time: 0.306194 Oct 24 10:26:29.614233 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 288/603] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:29 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1475 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:30.237892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5fc1191c-34dd-4bc2-bef2-8d908be7644e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:30.239302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5fc1191c-34dd-4bc2-bef2-8d908be7644e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:30.248216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fc1191c-34dd-4bc2-bef2-8d908be7644e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:30.248714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fc1191c-34dd-4bc2-bef2-8d908be7644e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:30.249199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fc1191c-34dd-4bc2-bef2-8d908be7644e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:30.249908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fc1191c-34dd-4bc2-bef2-8d908be7644e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:30.255451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fc1191c-34dd-4bc2-bef2-8d908be7644e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:30.255989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fc1191c-34dd-4bc2-bef2-8d908be7644e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:30.345387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7f3e6b8f-9a08-49c4-8f4c-29eb3a69adda tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:30.346042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7f3e6b8f-9a08-49c4-8f4c-29eb3a69adda tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:30.365887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f3e6b8f-9a08-49c4-8f4c-29eb3a69adda tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:30.366396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f3e6b8f-9a08-49c4-8f4c-29eb3a69adda tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:30.366832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f3e6b8f-9a08-49c4-8f4c-29eb3a69adda tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:30.367809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f3e6b8f-9a08-49c4-8f4c-29eb3a69adda tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:30.368277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f3e6b8f-9a08-49c4-8f4c-29eb3a69adda tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:30.368700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f3e6b8f-9a08-49c4-8f4c-29eb3a69adda tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:30.650022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5fc1191c-34dd-4bc2-bef2-8d908be7644e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:30.664423 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5fc1191c-34dd-4bc2-bef2-8d908be7644e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1495 microversion: 2.1 time: 0.427251 Oct 24 10:26:30.665140 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 316/604] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:30 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1495 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:30.678374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b2d7ae43-4d65-4ebd-a5bc-ef0f9e4830be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:30.679695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b2d7ae43-4d65-4ebd-a5bc-ef0f9e4830be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:30.707438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2d7ae43-4d65-4ebd-a5bc-ef0f9e4830be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:30.711852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7f3e6b8f-9a08-49c4-8f4c-29eb3a69adda tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:30.715486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2d7ae43-4d65-4ebd-a5bc-ef0f9e4830be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:30.725055 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7f3e6b8f-9a08-49c4-8f4c-29eb3a69adda tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 200 len: 1323 microversion: 2.1 time: 0.384521 Oct 24 10:26:30.725876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2d7ae43-4d65-4ebd-a5bc-ef0f9e4830be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:30.726812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2d7ae43-4d65-4ebd-a5bc-ef0f9e4830be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:30.727291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2d7ae43-4d65-4ebd-a5bc-ef0f9e4830be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:30.727721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2d7ae43-4d65-4ebd-a5bc-ef0f9e4830be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:30.737039 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 289/605] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:30 2022] GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 1323 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:30.744052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-282dcec1-0d3f-4399-8be2-86a8ab53760f tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:30.761103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-282dcec1-0d3f-4399-8be2-86a8ab53760f tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:30.780959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-282dcec1-0d3f-4399-8be2-86a8ab53760f tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:30.781685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-282dcec1-0d3f-4399-8be2-86a8ab53760f tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:30.783409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-282dcec1-0d3f-4399-8be2-86a8ab53760f tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:30.786391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-282dcec1-0d3f-4399-8be2-86a8ab53760f tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:30.787646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-282dcec1-0d3f-4399-8be2-86a8ab53760f tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:30.788277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-282dcec1-0d3f-4399-8be2-86a8ab53760f tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:31.129093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b2d7ae43-4d65-4ebd-a5bc-ef0f9e4830be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:31.151653 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b2d7ae43-4d65-4ebd-a5bc-ef0f9e4830be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1475 microversion: 2.1 time: 0.485437 Oct 24 10:26:31.155224 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-282dcec1-0d3f-4399-8be2-86a8ab53760f tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1648 microversion: 2.1 time: 0.413143 Oct 24 10:26:31.157158 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 317/606] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:30 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1475 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:31.157552 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 290/607] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:30 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1648 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:31.183265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c948e5ea-6d07-47fb-af57-e33e1b2567ed tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:31.183888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c948e5ea-6d07-47fb-af57-e33e1b2567ed tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:31.191528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c948e5ea-6d07-47fb-af57-e33e1b2567ed tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:31.192065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c948e5ea-6d07-47fb-af57-e33e1b2567ed tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:31.192512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c948e5ea-6d07-47fb-af57-e33e1b2567ed tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:31.194797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c948e5ea-6d07-47fb-af57-e33e1b2567ed tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:31.196893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c948e5ea-6d07-47fb-af57-e33e1b2567ed tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:31.198323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c948e5ea-6d07-47fb-af57-e33e1b2567ed tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:31.428875 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c948e5ea-6d07-47fb-af57-e33e1b2567ed tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1648 microversion: 2.1 time: 0.249754 Oct 24 10:26:31.445128 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 318/608] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:31 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1648 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:31.452500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a14b249c-5d74-4e84-b544-d12b685e9c57 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:31.456345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a14b249c-5d74-4e84-b544-d12b685e9c57 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:31.456883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a14b249c-5d74-4e84-b544-d12b685e9c57 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:31.457336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a14b249c-5d74-4e84-b544-d12b685e9c57 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:31.458075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a14b249c-5d74-4e84-b544-d12b685e9c57 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:31.458629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a14b249c-5d74-4e84-b544-d12b685e9c57 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:31.459065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a14b249c-5d74-4e84-b544-d12b685e9c57 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:31.464261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:31.490368 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a14b249c-5d74-4e84-b544-d12b685e9c57 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.041949 Oct 24 10:26:31.499308 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 291/609] 10.222.0.50 () {58 vars in 1176 bytes} [Mon Oct 24 10:26:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:31.506256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e8d69e52-f914-46cd-9971-19768d466d44 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:31.507399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e8d69e52-f914-46cd-9971-19768d466d44 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:31.523129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8d69e52-f914-46cd-9971-19768d466d44 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:31.523799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8d69e52-f914-46cd-9971-19768d466d44 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:31.524334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8d69e52-f914-46cd-9971-19768d466d44 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:31.525419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8d69e52-f914-46cd-9971-19768d466d44 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:31.525926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8d69e52-f914-46cd-9971-19768d466d44 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:31.528070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8d69e52-f914-46cd-9971-19768d466d44 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:31.691462 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e8d69e52-f914-46cd-9971-19768d466d44 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d/action" status: 202 len: 0 microversion: 2.1 time: 0.191302 Oct 24 10:26:31.692650 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 319/610] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:26:31 2022] POST /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:26:31.700861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ddccd7f2-3d15-4c7a-b9c3-33beffc8a1b2 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:31.701808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ddccd7f2-3d15-4c7a-b9c3-33beffc8a1b2 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:31.712927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddccd7f2-3d15-4c7a-b9c3-33beffc8a1b2 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:31.713426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddccd7f2-3d15-4c7a-b9c3-33beffc8a1b2 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:31.714498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddccd7f2-3d15-4c7a-b9c3-33beffc8a1b2 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:31.716200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddccd7f2-3d15-4c7a-b9c3-33beffc8a1b2 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:31.717708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddccd7f2-3d15-4c7a-b9c3-33beffc8a1b2 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:31.718484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddccd7f2-3d15-4c7a-b9c3-33beffc8a1b2 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:31.775760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7aa68468-e674-4953-8d9c-5ec9cf0bc7d1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:31.777648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7aa68468-e674-4953-8d9c-5ec9cf0bc7d1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:31.789639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7aa68468-e674-4953-8d9c-5ec9cf0bc7d1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:31.790515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7aa68468-e674-4953-8d9c-5ec9cf0bc7d1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:31.791970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7aa68468-e674-4953-8d9c-5ec9cf0bc7d1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:31.795723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7aa68468-e674-4953-8d9c-5ec9cf0bc7d1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:31.796471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7aa68468-e674-4953-8d9c-5ec9cf0bc7d1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:31.797114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7aa68468-e674-4953-8d9c-5ec9cf0bc7d1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:32.202353 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ddccd7f2-3d15-4c7a-b9c3-33beffc8a1b2 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1653 microversion: 2.1 time: 0.505302 Oct 24 10:26:32.204193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7aa68468-e674-4953-8d9c-5ec9cf0bc7d1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:32.205029 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 292/611] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:31 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1653 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:32.209943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bad53e02-32ff-4c21-b282-94e95991321b tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0fcf4c0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:32.219964 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7aa68468-e674-4953-8d9c-5ec9cf0bc7d1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 200 len: 1518 microversion: 2.1 time: 0.452256 Oct 24 10:26:32.221073 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 320/612] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:31 2022] GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 1518 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:32.235328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aef8b543-d819-496c-a58e-ee074ec5a653 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:32.236174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aef8b543-d819-496c-a58e-ee074ec5a653 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:32.244008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aef8b543-d819-496c-a58e-ee074ec5a653 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:32.246266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aef8b543-d819-496c-a58e-ee074ec5a653 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:32.247122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aef8b543-d819-496c-a58e-ee074ec5a653 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:32.248327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aef8b543-d819-496c-a58e-ee074ec5a653 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:32.249078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aef8b543-d819-496c-a58e-ee074ec5a653 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:32.249749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aef8b543-d819-496c-a58e-ee074ec5a653 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:32.297727 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bad53e02-32ff-4c21-b282-94e95991321b tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/1a5ca8b1-4b29-42b8-97f9-11629a24c485" status: 200 len: 661 microversion: 2.1 time: 0.090649 Oct 24 10:26:32.298560 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 293/613] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:26:32 2022] GET /compute/v2.1/images/1a5ca8b1-4b29-42b8-97f9-11629a24c485 => generated 661 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:32.310813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-32c99ca2-9d54-4eec-a9aa-1887276339f3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Action: 'create', calling method: .version_select at 0x7f04d1018c10>, body: {"pool": null} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:32.595113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aef8b543-d819-496c-a58e-ee074ec5a653 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:32.605969 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aef8b543-d819-496c-a58e-ee074ec5a653 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1475 microversion: 2.1 time: 0.383504 Oct 24 10:26:32.606755 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 321/614] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:32 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1475 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:32.624752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7dbd53b9-8398-4dee-bee3-827811fc3ba5 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0f56700>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:32.717955 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7dbd53b9-8398-4dee-bee3-827811fc3ba5 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/1a5ca8b1-4b29-42b8-97f9-11629a24c485" status: 200 len: 661 microversion: 2.1 time: 0.109871 Oct 24 10:26:32.720471 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 322/615] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:26:32 2022] GET /compute/v2.1/images/1a5ca8b1-4b29-42b8-97f9-11629a24c485 => generated 661 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:33.069468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-82b7325d-7148-4366-a60b-c0728080585d tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1122929686", "id": 1353682344, "os-flavor-access:is_public": "True"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:33.094841 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-82b7325d-7148-4366-a60b-c0728080585d tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.373055 Oct 24 10:26:33.096172 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 323/616] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:32 2022] POST /compute/v2.1/flavors => generated 430 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:33.162948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9a3bd1d6-c17f-4fe5-8862-53ef6893dd8a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-67318520", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:33.223818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-9a3bd1d6-c17f-4fe5-8862-53ef6893dd8a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:26:33.539242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-9a3bd1d6-c17f-4fe5-8862-53ef6893dd8a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:26:33.539865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-9a3bd1d6-c17f-4fe5-8862-53ef6893dd8a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:26:33.540447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-9a3bd1d6-c17f-4fe5-8862-53ef6893dd8a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:26:33.540910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-9a3bd1d6-c17f-4fe5-8862-53ef6893dd8a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:26:33.541434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-9a3bd1d6-c17f-4fe5-8862-53ef6893dd8a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:26:33.550137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a3bd1d6-c17f-4fe5-8862-53ef6893dd8a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:33.550614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a3bd1d6-c17f-4fe5-8862-53ef6893dd8a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:33.551042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a3bd1d6-c17f-4fe5-8862-53ef6893dd8a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:33.551893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a3bd1d6-c17f-4fe5-8862-53ef6893dd8a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:33.552396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a3bd1d6-c17f-4fe5-8862-53ef6893dd8a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:33.552816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a3bd1d6-c17f-4fe5-8862-53ef6893dd8a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:33.569694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-9a3bd1d6-c17f-4fe5-8862-53ef6893dd8a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for project b565572c0c8c4871af02471a328bd1af. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:26:33.574746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-9a3bd1d6-c17f-4fe5-8862-53ef6893dd8a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for user 9aa572f1e5014e10bed0abe34dfad43f and project b565572c0c8c4871af02471a328bd1af. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:26:33.587290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9a3bd1d6-c17f-4fe5-8862-53ef6893dd8a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:26:33.589555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9a3bd1d6-c17f-4fe5-8862-53ef6893dd8a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:26:33.637313 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9a3bd1d6-c17f-4fe5-8862-53ef6893dd8a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539886 Oct 24 10:26:33.638331 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 324/617] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:26:33.704697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-09fa4cb0-fedd-4b53-aa6a-c81e4d8432dc tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] Action: 'create', calling method: .version_select at 0x7f04d0fad3a0>, body: {"pool": null} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:34.274777 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-32c99ca2-9d54-4eec-a9aa-1887276339f3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.974870 Oct 24 10:26:34.276096 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 294/618] 10.222.0.50 () {60 vars in 1170 bytes} [Mon Oct 24 10:26:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:34.281300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a51345ae-39e7-436c-9fa0-c1cdb92d2bb4 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:34.309098 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a51345ae-39e7-436c-9fa0-c1cdb92d2bb4 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1353682344" status: 202 len: 0 microversion: 2.1 time: 0.031173 Oct 24 10:26:34.309796 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 295/619] 10.222.0.50 () {58 vars in 1161 bytes} [Mon Oct 24 10:26:34 2022] DELETE /compute/v2.1/flavors/1353682344 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:34.315641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-74cd8728-50fe-4899-838e-b9d8bf87e489 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:34.316381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-74cd8728-50fe-4899-838e-b9d8bf87e489 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:34.336343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74cd8728-50fe-4899-838e-b9d8bf87e489 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:34.338201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74cd8728-50fe-4899-838e-b9d8bf87e489 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:34.341903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74cd8728-50fe-4899-838e-b9d8bf87e489 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:34.343217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74cd8728-50fe-4899-838e-b9d8bf87e489 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:34.343822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74cd8728-50fe-4899-838e-b9d8bf87e489 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:34.345053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74cd8728-50fe-4899-838e-b9d8bf87e489 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:34.634399 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-74cd8728-50fe-4899-838e-b9d8bf87e489 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1633 microversion: 2.1 time: 0.322037 Oct 24 10:26:34.637189 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 296/620] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:34 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1633 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:34.652814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-74068f48-b88a-4a95-b468-b96649615dc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:34.653932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-74068f48-b88a-4a95-b468-b96649615dc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:34.660115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74068f48-b88a-4a95-b468-b96649615dc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:34.661059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74068f48-b88a-4a95-b468-b96649615dc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:34.661749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74068f48-b88a-4a95-b468-b96649615dc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:34.663307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74068f48-b88a-4a95-b468-b96649615dc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:34.663950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74068f48-b88a-4a95-b468-b96649615dc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:34.664538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74068f48-b88a-4a95-b468-b96649615dc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:34.919431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-74068f48-b88a-4a95-b468-b96649615dc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:34.928706 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-74068f48-b88a-4a95-b468-b96649615dc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1475 microversion: 2.1 time: 0.289921 Oct 24 10:26:34.929388 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 297/621] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:34 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1475 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:34.934468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a109dd2e-343d-4524-9f1d-0d96e310546b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:34.935246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a109dd2e-343d-4524-9f1d-0d96e310546b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:34.941363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a109dd2e-343d-4524-9f1d-0d96e310546b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:34.941847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a109dd2e-343d-4524-9f1d-0d96e310546b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:34.942283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a109dd2e-343d-4524-9f1d-0d96e310546b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:34.943412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a109dd2e-343d-4524-9f1d-0d96e310546b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:34.943936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a109dd2e-343d-4524-9f1d-0d96e310546b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:34.944365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a109dd2e-343d-4524-9f1d-0d96e310546b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:35.060246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a109dd2e-343d-4524-9f1d-0d96e310546b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:35.070372 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a109dd2e-343d-4524-9f1d-0d96e310546b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404" status: 200 len: 1267 microversion: 2.1 time: 0.139569 Oct 24 10:26:35.072154 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 298/622] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:34 2022] GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:35.077680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf081fbf-e4f4-44b6-8103-51c080489154 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:35.110416 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bf081fbf-e4f4-44b6-8103-51c080489154 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.036566 Oct 24 10:26:35.125383 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 299/623] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:26:35 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:35.136667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf425c45-1d6f-44ce-bbc4-dd0c2a9c6535 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1005782940", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "ec1a4d9a-2e78-407d-b33a-563721c9877e"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:35.224099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-cf425c45-1d6f-44ce-bbc4-dd0c2a9c6535 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] validate_networks() for [('ec1a4d9a-2e78-407d-b33a-563721c9877e', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:26:35.806020 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-09fa4cb0-fedd-4b53-aa6a-c81e4d8432dc tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.166387 Oct 24 10:26:35.817370 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 325/624] 10.222.0.50 () {60 vars in 1170 bytes} [Mon Oct 24 10:26:33 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:35.826147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c1767b7b-d595-4e78-972b-617dd591be5a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0fad280>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:35.879080 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c1767b7b-d595-4e78-972b-617dd591be5a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/e93fb24e-d5d2-47b8-92c0-f2b3845a8d20" status: 200 len: 661 microversion: 2.1 time: 0.060298 Oct 24 10:26:35.889585 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 326/625] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:26:35 2022] GET /compute/v2.1/images/e93fb24e-d5d2-47b8-92c0-f2b3845a8d20 => generated 661 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:35.895341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2dd08110-d380-4bb3-9bbf-653f596347b8 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-15", "block_migration": true, "disk_over_commit": false}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:35.899914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2dd08110-d380-4bb3-9bbf-653f596347b8 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:35.907742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2dd08110-d380-4bb3-9bbf-653f596347b8 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:35.909123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2dd08110-d380-4bb3-9bbf-653f596347b8 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:35.910060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2dd08110-d380-4bb3-9bbf-653f596347b8 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:35.911545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2dd08110-d380-4bb3-9bbf-653f596347b8 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:35.912914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2dd08110-d380-4bb3-9bbf-653f596347b8 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:35.913593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2dd08110-d380-4bb3-9bbf-653f596347b8 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:35.934292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-cf425c45-1d6f-44ce-bbc4-dd0c2a9c6535 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:26:35.935516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-cf425c45-1d6f-44ce-bbc4-dd0c2a9c6535 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:26:35.936013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-cf425c45-1d6f-44ce-bbc4-dd0c2a9c6535 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:26:35.936420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-cf425c45-1d6f-44ce-bbc4-dd0c2a9c6535 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:26:35.936852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-cf425c45-1d6f-44ce-bbc4-dd0c2a9c6535 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:26:35.944395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-2dd08110-d380-4bb3-9bbf-653f596347b8 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lazy-loading 'flavor' on Instance uuid e0ef26c4-a579-469e-b5db-bc2b0e17e99d {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:26:35.950190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf425c45-1d6f-44ce-bbc4-dd0c2a9c6535 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:35.951717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf425c45-1d6f-44ce-bbc4-dd0c2a9c6535 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:35.952631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf425c45-1d6f-44ce-bbc4-dd0c2a9c6535 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:35.953974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf425c45-1d6f-44ce-bbc4-dd0c2a9c6535 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:35.954779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf425c45-1d6f-44ce-bbc4-dd0c2a9c6535 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:35.955988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf425c45-1d6f-44ce-bbc4-dd0c2a9c6535 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:35.957299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2dd08110-d380-4bb3-9bbf-653f596347b8 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Going to try to live migrate instance to n-h1-858383-15 {{(pid=120426) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 24 10:26:35.992573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-cf425c45-1d6f-44ce-bbc4-dd0c2a9c6535 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Getting quotas for project 2afb2a59a2134fe0a2903b9591cc522b. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:26:35.999183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-cf425c45-1d6f-44ce-bbc4-dd0c2a9c6535 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Getting quotas for user ef304f0a2ef54385b985dd16fa1b35c8 and project 2afb2a59a2134fe0a2903b9591cc522b. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:26:36.044264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf425c45-1d6f-44ce-bbc4-dd0c2a9c6535 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:26:36.047353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf425c45-1d6f-44ce-bbc4-dd0c2a9c6535 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:26:36.128265 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf425c45-1d6f-44ce-bbc4-dd0c2a9c6535 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.995825 Oct 24 10:26:36.129069 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 300/626] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:26:36.141505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c8d381da-cc8b-4527-8dae-ec3a94377593 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-229878329", "id": 984088416, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:36.176970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:36.180353 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c8d381da-cc8b-4527-8dae-ec3a94377593 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.050015 Oct 24 10:26:36.181604 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 301/627] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:36 2022] POST /compute/v2.1/flavors => generated 413 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:36.201750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8506f461-de1d-4b28-86c0-a2cec75542da tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] Calling method '.version_select at 0x7f04d0fcf700>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:36.469424 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8506f461-de1d-4b28-86c0-a2cec75542da tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/dfd95fd7-e982-427e-a64e-0fdcbf8c21de" status: 200 len: 141 microversion: 2.1 time: 0.286702 Oct 24 10:26:36.480686 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 302/628] 10.222.0.50 () {58 vars in 1260 bytes} [Mon Oct 24 10:26:36 2022] GET /compute/v2.1/os-floating-ips/dfd95fd7-e982-427e-a64e-0fdcbf8c21de => generated 141 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:36.492883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e8f36daf-1982-45a5-bd9c-750fa2276b71 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d10181f0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:36.561809 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e8f36daf-1982-45a5-bd9c-750fa2276b71 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/e93fb24e-d5d2-47b8-92c0-f2b3845a8d20" status: 200 len: 661 microversion: 2.1 time: 0.079338 Oct 24 10:26:36.574608 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 303/629] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:26:36 2022] GET /compute/v2.1/images/e93fb24e-d5d2-47b8-92c0-f2b3845a8d20 => generated 661 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:36.579470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2d260334-29a5-40c0-a5ad-ac8aad39f3e7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:36.595349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2d260334-29a5-40c0-a5ad-ac8aad39f3e7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:36.607024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d260334-29a5-40c0-a5ad-ac8aad39f3e7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:36.607788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d260334-29a5-40c0-a5ad-ac8aad39f3e7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:36.608376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d260334-29a5-40c0-a5ad-ac8aad39f3e7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:36.609459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d260334-29a5-40c0-a5ad-ac8aad39f3e7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:36.610201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d260334-29a5-40c0-a5ad-ac8aad39f3e7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:36.610777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d260334-29a5-40c0-a5ad-ac8aad39f3e7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:36.886920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2d260334-29a5-40c0-a5ad-ac8aad39f3e7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:36.902210 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2d260334-29a5-40c0-a5ad-ac8aad39f3e7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1474 microversion: 2.1 time: 0.325463 Oct 24 10:26:36.918189 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 304/630] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:36 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1474 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:36.925250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-935373ae-e097-4928-998b-46c5da5fa23b req-086663b3-eed2-4632-887f-7fa51888d416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4f83cc-06a0-4a8e-b480-1878d348e1d1", "name": "network-vif-unplugged", "status": "completed", "tag": "fbe95751-507c-435d-b75f-b10bd1579493"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:36.937596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-935373ae-e097-4928-998b-46c5da5fa23b req-086663b3-eed2-4632-887f-7fa51888d416 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:36.938357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-935373ae-e097-4928-998b-46c5da5fa23b req-086663b3-eed2-4632-887f-7fa51888d416 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:36.938797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-935373ae-e097-4928-998b-46c5da5fa23b req-086663b3-eed2-4632-887f-7fa51888d416 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:36.954824 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-935373ae-e097-4928-998b-46c5da5fa23b req-086663b3-eed2-4632-887f-7fa51888d416 service nova] Creating event network-vif-unplugged:fbe95751-507c-435d-b75f-b10bd1579493 for instance 9d4f83cc-06a0-4a8e-b480-1878d348e1d1 on n-h1-858383-15 Oct 24 10:26:36.962566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-935373ae-e097-4928-998b-46c5da5fa23b req-086663b3-eed2-4632-887f-7fa51888d416 service nova] Instance 9d4f83cc-06a0-4a8e-b480-1878d348e1d1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:26:36.977570 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-935373ae-e097-4928-998b-46c5da5fa23b req-086663b3-eed2-4632-887f-7fa51888d416 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057758 Oct 24 10:26:36.978281 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 305/631] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:36.984086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d846cabb-7c3d-47df-a33b-9a4da2f8692c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:36.985072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d846cabb-7c3d-47df-a33b-9a4da2f8692c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:36.993063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d846cabb-7c3d-47df-a33b-9a4da2f8692c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:36.994040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d846cabb-7c3d-47df-a33b-9a4da2f8692c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:36.994455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d846cabb-7c3d-47df-a33b-9a4da2f8692c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:36.995736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d846cabb-7c3d-47df-a33b-9a4da2f8692c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:36.996593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d846cabb-7c3d-47df-a33b-9a4da2f8692c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:36.997070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d846cabb-7c3d-47df-a33b-9a4da2f8692c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:37.261374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d846cabb-7c3d-47df-a33b-9a4da2f8692c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:37.269205 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d846cabb-7c3d-47df-a33b-9a4da2f8692c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404" status: 200 len: 1315 microversion: 2.1 time: 0.289690 Oct 24 10:26:37.271438 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 306/632] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:36 2022] GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:37.276353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6d045ae3-1d9a-44ea-a005-2731f96b55a4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:37.283331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6d045ae3-1d9a-44ea-a005-2731f96b55a4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:37.290508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d045ae3-1d9a-44ea-a005-2731f96b55a4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:37.301612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d045ae3-1d9a-44ea-a005-2731f96b55a4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:37.302908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d045ae3-1d9a-44ea-a005-2731f96b55a4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:37.303950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d045ae3-1d9a-44ea-a005-2731f96b55a4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:37.306863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d045ae3-1d9a-44ea-a005-2731f96b55a4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:37.307632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d045ae3-1d9a-44ea-a005-2731f96b55a4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:37.402868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6d045ae3-1d9a-44ea-a005-2731f96b55a4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:37.412174 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6d045ae3-1d9a-44ea-a005-2731f96b55a4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8" status: 200 len: 1220 microversion: 2.1 time: 0.138647 Oct 24 10:26:37.413236 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 307/633] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:37 2022] GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 => generated 1220 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:37.431791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f8aa5fa1-14b3-49c6-ae13-2a47a7d1745c tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:37.470061 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f8aa5fa1-14b3-49c6-ae13-2a47a7d1745c tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 6219 microversion: 2.1 time: 0.047406 Oct 24 10:26:37.470669 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 308/634] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:26:37 2022] GET /compute/v2.1/flavors/detail => generated 6219 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:37.476571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-879a6045-4f64-4ce0-bd2c-16fae0afe550 tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] Calling method '.version_select at 0x7f04d12a8ca0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:38.063028 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-879a6045-4f64-4ce0-bd2c-16fae0afe550 tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.591067 Oct 24 10:26:38.063596 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 309/635] 10.222.0.50 () {58 vars in 1149 bytes} [Mon Oct 24 10:26:37 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:38.076111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d8266524-7c42-4808-84ce-4857c91ea4e1 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:38.111609 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d8266524-7c42-4808-84ce-4857c91ea4e1 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/984088416" status: 202 len: 0 microversion: 2.1 time: 0.039149 Oct 24 10:26:38.118525 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 310/636] 10.222.0.50 () {58 vars in 1158 bytes} [Mon Oct 24 10:26:38 2022] DELETE /compute/v2.1/flavors/984088416 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:38.124976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5ef82df0-1e7a-42cc-be40-0dd330224cc2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:38.125765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5ef82df0-1e7a-42cc-be40-0dd330224cc2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:38.135642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ef82df0-1e7a-42cc-be40-0dd330224cc2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:38.136223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ef82df0-1e7a-42cc-be40-0dd330224cc2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:38.136737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ef82df0-1e7a-42cc-be40-0dd330224cc2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:38.139865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ef82df0-1e7a-42cc-be40-0dd330224cc2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:38.140426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ef82df0-1e7a-42cc-be40-0dd330224cc2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:38.140887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ef82df0-1e7a-42cc-be40-0dd330224cc2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:38.461516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5ef82df0-1e7a-42cc-be40-0dd330224cc2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:38.471198 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5ef82df0-1e7a-42cc-be40-0dd330224cc2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1474 microversion: 2.1 time: 0.351413 Oct 24 10:26:38.473035 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 311/637] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:38 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1474 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:38.482103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0c847ed3-c778-41b8-adb4-52615793a24a tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] Calling method '.version_select at 0x7f04d10aca60>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:38.744005 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2dd08110-d380-4bb3-9bbf-653f596347b8 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d/action" status: 202 len: 0 microversion: 2.1 time: 2.852610 Oct 24 10:26:38.746674 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 327/638] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:26:35 2022] POST /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d/action => generated 0 bytes in 2856 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:38.759965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3aaac07c-ad62-4bad-9bff-4e207f3aa325 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d10663a0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:38.860808 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3aaac07c-ad62-4bad-9bff-4e207f3aa325 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/22445ba3-7ddd-4406-8555-fcb399e68de8" status: 200 len: 661 microversion: 2.1 time: 0.110561 Oct 24 10:26:38.862823 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 328/639] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:26:38 2022] GET /compute/v2.1/images/22445ba3-7ddd-4406-8555-fcb399e68de8 => generated 661 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:38.869433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f474aadd-0727-42a4-bc2b-4f6c2952a511 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:38.905564 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f474aadd-0727-42a4-bc2b-4f6c2952a511 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.041000 Oct 24 10:26:38.920862 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 329/640] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:26:38 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:38.920862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-01142140-1dbf-4d7a-9385-0dca250b6f93 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:38.920862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-01142140-1dbf-4d7a-9385-0dca250b6f93 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:38.920862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01142140-1dbf-4d7a-9385-0dca250b6f93 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:38.920862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01142140-1dbf-4d7a-9385-0dca250b6f93 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:38.922529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01142140-1dbf-4d7a-9385-0dca250b6f93 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:38.923542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01142140-1dbf-4d7a-9385-0dca250b6f93 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:38.924396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01142140-1dbf-4d7a-9385-0dca250b6f93 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:38.925055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01142140-1dbf-4d7a-9385-0dca250b6f93 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:39.235641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-01142140-1dbf-4d7a-9385-0dca250b6f93 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:39.245248 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-01142140-1dbf-4d7a-9385-0dca250b6f93 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404" status: 200 len: 1315 microversion: 2.1 time: 0.337110 Oct 24 10:26:39.260868 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 330/641] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:38 2022] GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:39.260868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4ef4119a-92a1-4fd5-bff6-83050eb8c499 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:39.260868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4ef4119a-92a1-4fd5-bff6-83050eb8c499 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:39.260868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ef4119a-92a1-4fd5-bff6-83050eb8c499 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:39.261324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ef4119a-92a1-4fd5-bff6-83050eb8c499 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:39.261324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ef4119a-92a1-4fd5-bff6-83050eb8c499 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:39.261324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ef4119a-92a1-4fd5-bff6-83050eb8c499 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:39.261324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ef4119a-92a1-4fd5-bff6-83050eb8c499 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:39.261627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ef4119a-92a1-4fd5-bff6-83050eb8c499 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:39.373551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4ef4119a-92a1-4fd5-bff6-83050eb8c499 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:39.382320 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4ef4119a-92a1-4fd5-bff6-83050eb8c499 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8" status: 200 len: 1282 microversion: 2.1 time: 0.135479 Oct 24 10:26:39.382900 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 331/642] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:39 2022] GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 => generated 1282 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:39.387619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a689922c-d140-452e-ad52-dff528f3a7d3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:39.388232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a689922c-d140-452e-ad52-dff528f3a7d3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:39.394372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a689922c-d140-452e-ad52-dff528f3a7d3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:39.394862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a689922c-d140-452e-ad52-dff528f3a7d3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:39.395303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a689922c-d140-452e-ad52-dff528f3a7d3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:39.395997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a689922c-d140-452e-ad52-dff528f3a7d3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:39.396891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a689922c-d140-452e-ad52-dff528f3a7d3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:39.397512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a689922c-d140-452e-ad52-dff528f3a7d3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:39.651041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a689922c-d140-452e-ad52-dff528f3a7d3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:39.661484 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a689922c-d140-452e-ad52-dff528f3a7d3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1505 microversion: 2.1 time: 0.277602 Oct 24 10:26:39.662573 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 332/643] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:39 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1505 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:39.668536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-36a2b63c-f7ba-43f5-81c1-6beeb93faf22 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d1323ca0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:39.736975 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-36a2b63c-f7ba-43f5-81c1-6beeb93faf22 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/22445ba3-7ddd-4406-8555-fcb399e68de8" status: 200 len: 661 microversion: 2.1 time: 0.073292 Oct 24 10:26:39.737758 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 333/644] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:26:39 2022] GET /compute/v2.1/images/22445ba3-7ddd-4406-8555-fcb399e68de8 => generated 661 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:39.743767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-36d5ae11-ff28-441e-b833-d321fc54858d tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-90943699", "id": 1265832641, "os-flavor-access:is_public": "True"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:39.791077 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-36d5ae11-ff28-441e-b833-d321fc54858d tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.051838 Oct 24 10:26:39.791758 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 334/645] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:39 2022] POST /compute/v2.1/flavors => generated 427 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:39.807592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-1c002c11-fc33-4011-8af3-1dbf18163a4e req-93eb7899-ade8-4c7c-acfd-36a7faceb3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d4f83cc-06a0-4a8e-b480-1878d348e1d1", "tag": "fbe95751-507c-435d-b75f-b10bd1579493"}, {"name": "network-changed", "server_uuid": "2a8bcf29-893c-4ca8-82cb-636c2bb6f404", "tag": "60b5819c-0c14-41c1-9eb8-bedff7e720a0"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:39.830840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1c002c11-fc33-4011-8af3-1dbf18163a4e req-93eb7899-ade8-4c7c-acfd-36a7faceb3b9 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:39.831798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1c002c11-fc33-4011-8af3-1dbf18163a4e req-93eb7899-ade8-4c7c-acfd-36a7faceb3b9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:39.832398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1c002c11-fc33-4011-8af3-1dbf18163a4e req-93eb7899-ade8-4c7c-acfd-36a7faceb3b9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:39.857794 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-1c002c11-fc33-4011-8af3-1dbf18163a4e req-93eb7899-ade8-4c7c-acfd-36a7faceb3b9 service nova] Creating event network-changed:fbe95751-507c-435d-b75f-b10bd1579493 for instance 9d4f83cc-06a0-4a8e-b480-1878d348e1d1 on n-h1-858383-15 Oct 24 10:26:39.858300 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-1c002c11-fc33-4011-8af3-1dbf18163a4e req-93eb7899-ade8-4c7c-acfd-36a7faceb3b9 service nova] Creating event network-changed:60b5819c-0c14-41c1-9eb8-bedff7e720a0 for instance 2a8bcf29-893c-4ca8-82cb-636c2bb6f404 on n-h1-858383-15 Oct 24 10:26:39.879493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [req-1c002c11-fc33-4011-8af3-1dbf18163a4e req-93eb7899-ade8-4c7c-acfd-36a7faceb3b9 service nova] Instance 9d4f83cc-06a0-4a8e-b480-1878d348e1d1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120426) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:26:39.897293 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-1c002c11-fc33-4011-8af3-1dbf18163a4e req-93eb7899-ade8-4c7c-acfd-36a7faceb3b9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.103136 Oct 24 10:26:39.898135 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 335/646] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:39.905347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-12e969c6-bd20-4eb8-9adc-10ff7c166a24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:39.906376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-12e969c6-bd20-4eb8-9adc-10ff7c166a24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:39.915206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-12e969c6-bd20-4eb8-9adc-10ff7c166a24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:39.915850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-12e969c6-bd20-4eb8-9adc-10ff7c166a24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:39.916424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-12e969c6-bd20-4eb8-9adc-10ff7c166a24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:39.917190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-12e969c6-bd20-4eb8-9adc-10ff7c166a24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:39.917656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-12e969c6-bd20-4eb8-9adc-10ff7c166a24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:39.918220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-12e969c6-bd20-4eb8-9adc-10ff7c166a24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:40.043107 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0c847ed3-c778-41b8-adb4-52615793a24a tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/dfd95fd7-e982-427e-a64e-0fdcbf8c21de" status: 202 len: 0 microversion: 2.1 time: 1.564769 Oct 24 10:26:40.043883 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 312/647] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:26:38 2022] DELETE /compute/v2.1/os-floating-ips/dfd95fd7-e982-427e-a64e-0fdcbf8c21de => generated 0 bytes in 1570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:40.048534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2048f8ec-5350-42e2-9213-fc8c6eebdfe5 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:40.069106 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2048f8ec-5350-42e2-9213-fc8c6eebdfe5 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1265832641" status: 202 len: 0 microversion: 2.1 time: 0.023276 Oct 24 10:26:40.069950 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 313/648] 10.222.0.50 () {58 vars in 1161 bytes} [Mon Oct 24 10:26:40 2022] DELETE /compute/v2.1/flavors/1265832641 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:40.076388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5bbebd1f-a08a-41a9-86c8-55d0feffbc3c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1447061099", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:40.112263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-12e969c6-bd20-4eb8-9adc-10ff7c166a24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:40.116751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:40.133693 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-12e969c6-bd20-4eb8-9adc-10ff7c166a24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1472 microversion: 2.1 time: 0.233870 Oct 24 10:26:40.134794 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 336/649] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:39 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1472 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:40.140068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0a716b1d-5dbe-49bd-b75b-a60d31148a38 tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] Action: 'create', calling method: .version_select at 0x7f04d0fc6b80>, body: {"pool": null} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:40.163499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-5bbebd1f-a08a-41a9-86c8-55d0feffbc3c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] validate_networks() for None {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:26:40.506256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5bbebd1f-a08a-41a9-86c8-55d0feffbc3c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:26:40.506686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5bbebd1f-a08a-41a9-86c8-55d0feffbc3c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:26:40.507551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5bbebd1f-a08a-41a9-86c8-55d0feffbc3c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:26:40.508459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5bbebd1f-a08a-41a9-86c8-55d0feffbc3c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:26:40.508912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5bbebd1f-a08a-41a9-86c8-55d0feffbc3c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:26:40.518646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bbebd1f-a08a-41a9-86c8-55d0feffbc3c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:40.519456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bbebd1f-a08a-41a9-86c8-55d0feffbc3c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:40.520316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bbebd1f-a08a-41a9-86c8-55d0feffbc3c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:40.521118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bbebd1f-a08a-41a9-86c8-55d0feffbc3c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:40.521580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bbebd1f-a08a-41a9-86c8-55d0feffbc3c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:40.522102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bbebd1f-a08a-41a9-86c8-55d0feffbc3c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:40.542285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-5bbebd1f-a08a-41a9-86c8-55d0feffbc3c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Getting quotas for project 1f301001adb14e80ac92b2ed20b1c383. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:26:40.548117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-5bbebd1f-a08a-41a9-86c8-55d0feffbc3c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Getting quotas for user a8549ee547f74419ab10b074f15fe80a and project 1f301001adb14e80ac92b2ed20b1c383. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:26:40.564578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5bbebd1f-a08a-41a9-86c8-55d0feffbc3c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:26:40.568758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5bbebd1f-a08a-41a9-86c8-55d0feffbc3c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: a8f749f9-5771-4ecb-8a06-30a8f69dd848] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:26:40.626053 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5bbebd1f-a08a-41a9-86c8-55d0feffbc3c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554856 Oct 24 10:26:40.626721 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 314/650] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:26:40.633247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-72ae3a13-735b-478b-aa73-2ada620182ee tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:40.668057 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-72ae3a13-735b-478b-aa73-2ada620182ee tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.040045 Oct 24 10:26:40.669369 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 315/651] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:26:40 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:40.686187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-98ec6b3c-cdff-4aaa-bd17-6780c7cca48d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:40.687278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-98ec6b3c-cdff-4aaa-bd17-6780c7cca48d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:40.696541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98ec6b3c-cdff-4aaa-bd17-6780c7cca48d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:40.697199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98ec6b3c-cdff-4aaa-bd17-6780c7cca48d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:40.697741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98ec6b3c-cdff-4aaa-bd17-6780c7cca48d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:40.698619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98ec6b3c-cdff-4aaa-bd17-6780c7cca48d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:40.699344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98ec6b3c-cdff-4aaa-bd17-6780c7cca48d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:40.699864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98ec6b3c-cdff-4aaa-bd17-6780c7cca48d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:40.953692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-98ec6b3c-cdff-4aaa-bd17-6780c7cca48d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:40.964680 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-98ec6b3c-cdff-4aaa-bd17-6780c7cca48d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404" status: 200 len: 1315 microversion: 2.1 time: 0.294241 Oct 24 10:26:40.981213 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 316/652] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:40 2022] GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:40.988207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2522d3d0-8d32-4381-90c8-a7a9289b2ce3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:40.989013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2522d3d0-8d32-4381-90c8-a7a9289b2ce3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:41.000001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2522d3d0-8d32-4381-90c8-a7a9289b2ce3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:41.000495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2522d3d0-8d32-4381-90c8-a7a9289b2ce3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:41.001028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2522d3d0-8d32-4381-90c8-a7a9289b2ce3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:41.001764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2522d3d0-8d32-4381-90c8-a7a9289b2ce3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:41.002353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2522d3d0-8d32-4381-90c8-a7a9289b2ce3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:41.002782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2522d3d0-8d32-4381-90c8-a7a9289b2ce3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:41.246575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2522d3d0-8d32-4381-90c8-a7a9289b2ce3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:41.256807 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2522d3d0-8d32-4381-90c8-a7a9289b2ce3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8" status: 200 len: 1324 microversion: 2.1 time: 0.274265 Oct 24 10:26:41.257562 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 317/653] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:40 2022] GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 => generated 1324 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:41.263187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d0fbdc28-5aee-4901-b078-62b135e576cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:41.263865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d0fbdc28-5aee-4901-b078-62b135e576cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:41.278479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0fbdc28-5aee-4901-b078-62b135e576cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:41.278989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0fbdc28-5aee-4901-b078-62b135e576cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:41.279614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0fbdc28-5aee-4901-b078-62b135e576cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:41.280549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0fbdc28-5aee-4901-b078-62b135e576cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:41.281057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0fbdc28-5aee-4901-b078-62b135e576cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:41.281767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0fbdc28-5aee-4901-b078-62b135e576cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:41.504424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d0fbdc28-5aee-4901-b078-62b135e576cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:41.513056 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d0fbdc28-5aee-4901-b078-62b135e576cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1505 microversion: 2.1 time: 0.254003 Oct 24 10:26:41.513680 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 318/654] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:41 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:41.518230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0dcd9d39-8afb-41e4-a1d5-498993f5a368 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1251804147", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:41.543104 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0dcd9d39-8afb-41e4-a1d5-498993f5a368 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.028352 Oct 24 10:26:41.543889 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 319/655] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:41 2022] POST /compute/v2.1/flavors => generated 507 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:41.548684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-05fafe82-96b3-41a0-9f38-32d3a7399f9e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1928221433", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:41.611183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-05fafe82-96b3-41a0-9f38-32d3a7399f9e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] validate_networks() for None {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:26:42.321630 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0a716b1d-5dbe-49bd-b75b-a60d31148a38 tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.185423 Oct 24 10:26:42.324011 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 337/656] 10.222.0.50 () {60 vars in 1170 bytes} [Mon Oct 24 10:26:40 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:42.329796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-05fafe82-96b3-41a0-9f38-32d3a7399f9e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:26:42.331204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-05fafe82-96b3-41a0-9f38-32d3a7399f9e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:26:42.334246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-05fafe82-96b3-41a0-9f38-32d3a7399f9e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:26:42.335336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-05fafe82-96b3-41a0-9f38-32d3a7399f9e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:26:42.337588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-05fafe82-96b3-41a0-9f38-32d3a7399f9e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:26:42.344994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-604fa2df-6c21-49fd-8bb4-9c9ef1b608b8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:42.345921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-604fa2df-6c21-49fd-8bb4-9c9ef1b608b8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:42.351530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05fafe82-96b3-41a0-9f38-32d3a7399f9e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:42.352106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05fafe82-96b3-41a0-9f38-32d3a7399f9e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:42.352932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05fafe82-96b3-41a0-9f38-32d3a7399f9e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:42.353745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05fafe82-96b3-41a0-9f38-32d3a7399f9e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:42.354328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05fafe82-96b3-41a0-9f38-32d3a7399f9e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:42.354893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05fafe82-96b3-41a0-9f38-32d3a7399f9e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:42.355212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-604fa2df-6c21-49fd-8bb4-9c9ef1b608b8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:42.355915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-604fa2df-6c21-49fd-8bb4-9c9ef1b608b8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:42.356507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-604fa2df-6c21-49fd-8bb4-9c9ef1b608b8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:42.357830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-604fa2df-6c21-49fd-8bb4-9c9ef1b608b8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:42.358492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-604fa2df-6c21-49fd-8bb4-9c9ef1b608b8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:42.359076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-604fa2df-6c21-49fd-8bb4-9c9ef1b608b8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:42.377153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-05fafe82-96b3-41a0-9f38-32d3a7399f9e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Getting quotas for project 1f301001adb14e80ac92b2ed20b1c383. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:26:42.382676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-05fafe82-96b3-41a0-9f38-32d3a7399f9e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Getting quotas for user a8549ee547f74419ab10b074f15fe80a and project 1f301001adb14e80ac92b2ed20b1c383. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:26:42.400085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-05fafe82-96b3-41a0-9f38-32d3a7399f9e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:26:42.403131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-05fafe82-96b3-41a0-9f38-32d3a7399f9e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:26:42.459400 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-05fafe82-96b3-41a0-9f38-32d3a7399f9e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.914136 Oct 24 10:26:42.460172 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 320/657] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:26:42.464983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-799c69c8-af6f-4ab1-8a8c-a1069a1554a7 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:42.495675 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-799c69c8-af6f-4ab1-8a8c-a1069a1554a7 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/da39bab1-8f92-4072-9c78-e9759ff7ed2f" status: 202 len: 0 microversion: 2.1 time: 0.034162 Oct 24 10:26:42.497607 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 321/658] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:26:42 2022] DELETE /compute/v2.1/flavors/da39bab1-8f92-4072-9c78-e9759ff7ed2f => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:42.503989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-92122f6f-2d0a-45d5-94b1-3834dc87ada5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:42.504794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-92122f6f-2d0a-45d5-94b1-3834dc87ada5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:42.513243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92122f6f-2d0a-45d5-94b1-3834dc87ada5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:42.513938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92122f6f-2d0a-45d5-94b1-3834dc87ada5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:42.514519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92122f6f-2d0a-45d5-94b1-3834dc87ada5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:42.515360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92122f6f-2d0a-45d5-94b1-3834dc87ada5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:42.515989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92122f6f-2d0a-45d5-94b1-3834dc87ada5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:42.516558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92122f6f-2d0a-45d5-94b1-3834dc87ada5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:42.685510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-604fa2df-6c21-49fd-8bb4-9c9ef1b608b8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:42.693910 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-604fa2df-6c21-49fd-8bb4-9c9ef1b608b8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1469 microversion: 2.1 time: 0.368005 Oct 24 10:26:42.694467 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 338/659] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:42 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1469 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:42.708500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b1f657c3-52d1-446c-a898-e1a77dd2fd71 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:42.709729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b1f657c3-52d1-446c-a898-e1a77dd2fd71 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:42.717575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b1f657c3-52d1-446c-a898-e1a77dd2fd71 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:42.718345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b1f657c3-52d1-446c-a898-e1a77dd2fd71 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:42.718986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b1f657c3-52d1-446c-a898-e1a77dd2fd71 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:42.719854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b1f657c3-52d1-446c-a898-e1a77dd2fd71 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:42.720515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b1f657c3-52d1-446c-a898-e1a77dd2fd71 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:42.721166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b1f657c3-52d1-446c-a898-e1a77dd2fd71 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:42.847078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-92122f6f-2d0a-45d5-94b1-3834dc87ada5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:42.866281 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-92122f6f-2d0a-45d5-94b1-3834dc87ada5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404" status: 200 len: 1315 microversion: 2.1 time: 0.366114 Oct 24 10:26:42.869365 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 322/660] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:42 2022] GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:42.880573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-edfd0117-7f11-48b6-9aa5-d295edf68fa3 tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] Calling method '.version_select at 0x7f04d10184c0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:43.104550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b1f657c3-52d1-446c-a898-e1a77dd2fd71 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:43.115744 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b1f657c3-52d1-446c-a898-e1a77dd2fd71 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8" status: 200 len: 1324 microversion: 2.1 time: 0.410777 Oct 24 10:26:43.116633 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 339/661] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:42 2022] GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 => generated 1324 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:43.139893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-739abd4b-48a5-4f2d-8fbd-b9538a6ea1a9 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:43.141323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-739abd4b-48a5-4f2d-8fbd-b9538a6ea1a9 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:43.149172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-739abd4b-48a5-4f2d-8fbd-b9538a6ea1a9 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:43.149669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-739abd4b-48a5-4f2d-8fbd-b9538a6ea1a9 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:43.150105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-739abd4b-48a5-4f2d-8fbd-b9538a6ea1a9 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:43.150816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-739abd4b-48a5-4f2d-8fbd-b9538a6ea1a9 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:43.151267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-739abd4b-48a5-4f2d-8fbd-b9538a6ea1a9 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:43.151688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-739abd4b-48a5-4f2d-8fbd-b9538a6ea1a9 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:43.504444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-739abd4b-48a5-4f2d-8fbd-b9538a6ea1a9 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:43.514778 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-739abd4b-48a5-4f2d-8fbd-b9538a6ea1a9 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1222 microversion: 2.1 time: 0.378805 Oct 24 10:26:43.519440 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 340/662] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:43 2022] GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 1222 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:43.530896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-214faf92-26f2-4059-923c-66b351db21b9 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:43.562795 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-214faf92-26f2-4059-923c-66b351db21b9 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.041936 Oct 24 10:26:43.564092 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 341/663] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:26:43 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:43.565860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:43.582101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:43.592156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0b3b5a5d-b6b8-4c1e-85e4-3e3f770fa697 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:43.593073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0b3b5a5d-b6b8-4c1e-85e4-3e3f770fa697 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:43.605882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b3b5a5d-b6b8-4c1e-85e4-3e3f770fa697 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:43.606662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b3b5a5d-b6b8-4c1e-85e4-3e3f770fa697 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:43.607410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b3b5a5d-b6b8-4c1e-85e4-3e3f770fa697 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:43.608436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b3b5a5d-b6b8-4c1e-85e4-3e3f770fa697 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:43.609076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b3b5a5d-b6b8-4c1e-85e4-3e3f770fa697 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:43.609660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b3b5a5d-b6b8-4c1e-85e4-3e3f770fa697 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:43.918223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0b3b5a5d-b6b8-4c1e-85e4-3e3f770fa697 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:43.928209 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0b3b5a5d-b6b8-4c1e-85e4-3e3f770fa697 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1505 microversion: 2.1 time: 0.362268 Oct 24 10:26:43.929354 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 342/664] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:43 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:43.944524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-23fe6e21-76da-4945-b834-1a6570290cd5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:43.945339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-23fe6e21-76da-4945-b834-1a6570290cd5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:43.953041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23fe6e21-76da-4945-b834-1a6570290cd5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:43.953533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23fe6e21-76da-4945-b834-1a6570290cd5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:43.954162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23fe6e21-76da-4945-b834-1a6570290cd5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:43.955050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23fe6e21-76da-4945-b834-1a6570290cd5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:43.956155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23fe6e21-76da-4945-b834-1a6570290cd5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:43.956583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23fe6e21-76da-4945-b834-1a6570290cd5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:44.026239 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-23fe6e21-76da-4945-b834-1a6570290cd5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "POST /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1/action" status: 204 len: 0 microversion: 2.1 time: 0.085897 Oct 24 10:26:44.027188 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 343/665] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:26:43 2022] POST /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1/action => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:26:44.044828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a63b18bb-d69c-4f0b-85b5-1b158ec641b1 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-619724844", "id": "fa7cee9c-8e7a-499f-9ee7-8fc0ec8ed5b9", "os-flavor-access:is_public": "True"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:44.067339 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a63b18bb-d69c-4f0b-85b5-1b158ec641b1 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.038742 Oct 24 10:26:44.068488 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 344/666] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:44 2022] POST /compute/v2.1/flavors => generated 506 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:44.081019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-9e9f254f-c5ff-4c87-af59-830e46e0cfbf req-3c6b43b2-b408-4223-bd14-239224495da4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c4889ce-5a69-43f8-856a-a51289323fa8", "tag": "9102e5e7-84d8-4adf-b9b1-351fa06523c7"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:44.094787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9e9f254f-c5ff-4c87-af59-830e46e0cfbf req-3c6b43b2-b408-4223-bd14-239224495da4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:44.095278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9e9f254f-c5ff-4c87-af59-830e46e0cfbf req-3c6b43b2-b408-4223-bd14-239224495da4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:44.095708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9e9f254f-c5ff-4c87-af59-830e46e0cfbf req-3c6b43b2-b408-4223-bd14-239224495da4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:44.109365 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-9e9f254f-c5ff-4c87-af59-830e46e0cfbf req-3c6b43b2-b408-4223-bd14-239224495da4 service nova] Creating event network-changed:9102e5e7-84d8-4adf-b9b1-351fa06523c7 for instance 2c4889ce-5a69-43f8-856a-a51289323fa8 on n-h1-858383-15 Oct 24 10:26:44.117891 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-9e9f254f-c5ff-4c87-af59-830e46e0cfbf req-3c6b43b2-b408-4223-bd14-239224495da4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040524 Oct 24 10:26:44.118854 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 345/667] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:44.124302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e6fb48a-a4b6-4aca-86be-77ef7b259560 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:44.125051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1e6fb48a-a4b6-4aca-86be-77ef7b259560 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:44.134067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e6fb48a-a4b6-4aca-86be-77ef7b259560 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:44.134555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e6fb48a-a4b6-4aca-86be-77ef7b259560 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:44.134986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e6fb48a-a4b6-4aca-86be-77ef7b259560 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:44.137182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e6fb48a-a4b6-4aca-86be-77ef7b259560 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:44.137182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e6fb48a-a4b6-4aca-86be-77ef7b259560 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:44.137182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e6fb48a-a4b6-4aca-86be-77ef7b259560 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:44.180924 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-edfd0117-7f11-48b6-9aa5-d295edf68fa3 tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/085734b9-8005-4d0e-9c13-95d8787c9d71" status: 202 len: 0 microversion: 2.1 time: 1.309920 Oct 24 10:26:44.181973 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 323/668] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:26:42 2022] DELETE /compute/v2.1/os-floating-ips/085734b9-8005-4d0e-9c13-95d8787c9d71 => generated 0 bytes in 1312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:44.187086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ddae4d7-8e11-404c-878f-9122f7cac366 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:44.187774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ddae4d7-8e11-404c-878f-9122f7cac366 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:44.195237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ddae4d7-8e11-404c-878f-9122f7cac366 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:44.195810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ddae4d7-8e11-404c-878f-9122f7cac366 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:44.196317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ddae4d7-8e11-404c-878f-9122f7cac366 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:44.197124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ddae4d7-8e11-404c-878f-9122f7cac366 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:44.197638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ddae4d7-8e11-404c-878f-9122f7cac366 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:44.198319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ddae4d7-8e11-404c-878f-9122f7cac366 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:44.453596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1e6fb48a-a4b6-4aca-86be-77ef7b259560 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:44.456510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2ddae4d7-8e11-404c-878f-9122f7cac366 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:44.465231 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ddae4d7-8e11-404c-878f-9122f7cac366 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1469 microversion: 2.1 time: 0.281855 Oct 24 10:26:44.465456 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1e6fb48a-a4b6-4aca-86be-77ef7b259560 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404" status: 200 len: 1315 microversion: 2.1 time: 0.345035 Oct 24 10:26:44.466006 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 346/669] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:44 2022] GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:44.472632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d1bfc321-8591-4e6f-b3f6-003ea69c59ad tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:44.485828 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 324/670] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:44 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1469 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:44.492583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4800d62e-20d0-49f7-bbb3-4588e6e85f66 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:44.493233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4800d62e-20d0-49f7-bbb3-4588e6e85f66 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:44.500741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4800d62e-20d0-49f7-bbb3-4588e6e85f66 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:44.501308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4800d62e-20d0-49f7-bbb3-4588e6e85f66 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:44.501744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4800d62e-20d0-49f7-bbb3-4588e6e85f66 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:44.502514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4800d62e-20d0-49f7-bbb3-4588e6e85f66 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:44.502960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4800d62e-20d0-49f7-bbb3-4588e6e85f66 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:44.503751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4800d62e-20d0-49f7-bbb3-4588e6e85f66 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:44.509086 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d1bfc321-8591-4e6f-b3f6-003ea69c59ad tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/fa7cee9c-8e7a-499f-9ee7-8fc0ec8ed5b9" status: 202 len: 0 microversion: 2.1 time: 0.040418 Oct 24 10:26:44.509691 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 347/671] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:26:44 2022] DELETE /compute/v2.1/flavors/fa7cee9c-8e7a-499f-9ee7-8fc0ec8ed5b9 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:44.515997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ddb4f811-2ad4-4f92-bdba-6b9233a9e4b1 tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] Calling method '.version_select at 0x7f04d0efda60>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:44.568747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG neutronclient.v2_0.client [None req-ddb4f811-2ad4-4f92-bdba-6b9233a9e4b1 tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 085734b9-8005-4d0e-9c13-95d8787c9d71 could not be found", "detail": ""}} {{(pid=120426) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:26:44.569534 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-ddb4f811-2ad4-4f92-bdba-6b9233a9e4b1 tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] HTTP exception thrown: Floating IP not found for ID 085734b9-8005-4d0e-9c13-95d8787c9d71 Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ddb4f811-2ad4-4f92-bdba-6b9233a9e4b1 tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] Request method failure captured: Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-floating-ips/085734b9-8005-4d0e-9c13-95d8787c9d71 HTTP/1.1 Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmhYHLtzhK4vDEcdMYGfvaXNM3-bxaHeFWBwbYgYlaW-rEpTBXIcTHHp8OBkGmp0BPYuOpOEtDj_l0n3j7v1MqUvLFkMpI-8aTOip02Kno2ZAQBmLPG7b7LWAvkTP6V6xMZ5Dy545lT87-yGEXHC-dkC31IP8dcNCmi3NDan0czLgiM Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 117a6906a06f45a3bfa55807d646b359 Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-FloatingIPsTestJSON-939139962 Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:26:44.574213 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:26:44.575874 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/117a6906a06f45a3bfa55807d646b359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/117a6906a06f45a3bfa55807d646b359"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/117a6906a06f45a3bfa55807d646b359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_117a6906a06f45a3bfa55807d646b359", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:44.575874 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-FloatingIPsTestJSON-939139962 Oct 24 10:26:44.575874 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 117a6906a06f45a3bfa55807d646b359 Oct 24 10:26:44.575874 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-FloatingIPsTestJSON-939139962 Oct 24 10:26:44.575874 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-FloatingIPsTestJSON-939139962-project Oct 24 10:26:44.575874 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:26:44.575874 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:26:44.575874 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 8e7f399372ae43e2a002013c8f4b7996 Oct 24 10:26:44.575874 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-FloatingIPsTestJSON-939139962-project Oct 24 10:26:44.575874 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:26:44.575874 n-d-858383-15 devstack@n-api.service[120426]: exception: Floating IP not found for ID 085734b9-8005-4d0e-9c13-95d8787c9d71 Oct 24 10:26:44.575874 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '085734b9-8005-4d0e-9c13-95d8787c9d71'} Oct 24 10:26:44.575874 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:26:44.576707 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 085734b9-8005-4d0e-9c13-95d8787c9d71 could not be found Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ca74f0e-bcd0-47f7-93d8-219d09cf2a2f'] Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 085734b9-8005-4d0e-9c13-95d8787c9d71. Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:44.578051 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 085734b9-8005-4d0e-9c13-95d8787c9d71 Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:44.579231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:44.580433 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 085734b9-8005-4d0e-9c13-95d8787c9d71 Oct 24 10:26:44.580433 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:44.583005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ddb4f811-2ad4-4f92-bdba-6b9233a9e4b1 tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] Returning 404 to user: Floating IP not found for ID 085734b9-8005-4d0e-9c13-95d8787c9d71 {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:44.585251 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ddb4f811-2ad4-4f92-bdba-6b9233a9e4b1 tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/085734b9-8005-4d0e-9c13-95d8787c9d71" status: 404 len: 111 microversion: 2.1 time: 0.072395 Oct 24 10:26:44.586196 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 348/672] 10.222.0.50 () {58 vars in 1260 bytes} [Mon Oct 24 10:26:44 2022] GET /compute/v2.1/os-floating-ips/085734b9-8005-4d0e-9c13-95d8787c9d71 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:26:44.594103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-526d9029-436f-414a-8c01-a80363bca6eb tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:44.617795 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-526d9029-436f-414a-8c01-a80363bca6eb tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.027469 Oct 24 10:26:44.618618 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 349/673] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:26:44 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:44.623611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9992451c-8398-4e22-9bcd-45fceaf9cd9f tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:44.624426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9992451c-8398-4e22-9bcd-45fceaf9cd9f tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:44.629897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:44.632150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9992451c-8398-4e22-9bcd-45fceaf9cd9f tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:44.632864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9992451c-8398-4e22-9bcd-45fceaf9cd9f tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:44.633642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9992451c-8398-4e22-9bcd-45fceaf9cd9f tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:44.634577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9992451c-8398-4e22-9bcd-45fceaf9cd9f tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:44.635249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9992451c-8398-4e22-9bcd-45fceaf9cd9f tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:44.635990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9992451c-8398-4e22-9bcd-45fceaf9cd9f tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:44.745915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9992451c-8398-4e22-9bcd-45fceaf9cd9f tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:44.757403 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9992451c-8398-4e22-9bcd-45fceaf9cd9f tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1270 microversion: 2.1 time: 0.137440 Oct 24 10:26:44.773674 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 350/674] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:44 2022] GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:44.779672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-18af8f5a-2677-469b-a3af-0ef7e76dda36 tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] Calling method '.version_select at 0x7f04d12204c0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:44.842352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4800d62e-20d0-49f7-bbb3-4588e6e85f66 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:44.842643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG neutronclient.v2_0.client [None req-18af8f5a-2677-469b-a3af-0ef7e76dda36 tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 085734b9-8005-4d0e-9c13-95d8787c9d71 could not be found", "detail": ""}} {{(pid=120426) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:26:44.843483 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-18af8f5a-2677-469b-a3af-0ef7e76dda36 tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] HTTP exception thrown: Floating IP not found for ID 085734b9-8005-4d0e-9c13-95d8787c9d71 Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-18af8f5a-2677-469b-a3af-0ef7e76dda36 tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] Request method failure captured: Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/os-floating-ips/085734b9-8005-4d0e-9c13-95d8787c9d71 HTTP/1.1 Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmhYHLtzhK4vDEcdMYGfvaXNM3-bxaHeFWBwbYgYlaW-rEpTBXIcTHHp8OBkGmp0BPYuOpOEtDj_l0n3j7v1MqUvLFkMpI-8aTOip02Kno2ZAQBmLPG7b7LWAvkTP6V6xMZ5Dy545lT87-yGEXHC-dkC31IP8dcNCmi3NDan0czLgiM Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 117a6906a06f45a3bfa55807d646b359 Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-FloatingIPsTestJSON-939139962 Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:26:44.845241 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:26:44.847397 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/117a6906a06f45a3bfa55807d646b359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/117a6906a06f45a3bfa55807d646b359"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/117a6906a06f45a3bfa55807d646b359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_117a6906a06f45a3bfa55807d646b359", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:44.847397 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-FloatingIPsTestJSON-939139962 Oct 24 10:26:44.847397 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 117a6906a06f45a3bfa55807d646b359 Oct 24 10:26:44.847397 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-FloatingIPsTestJSON-939139962 Oct 24 10:26:44.847397 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-FloatingIPsTestJSON-939139962-project Oct 24 10:26:44.847397 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:26:44.847397 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:26:44.847397 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 8e7f399372ae43e2a002013c8f4b7996 Oct 24 10:26:44.847397 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-FloatingIPsTestJSON-939139962-project Oct 24 10:26:44.847397 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:26:44.847397 n-d-858383-15 devstack@n-api.service[120426]: exception: Floating IP not found for ID 085734b9-8005-4d0e-9c13-95d8787c9d71 Oct 24 10:26:44.847397 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '085734b9-8005-4d0e-9c13-95d8787c9d71'} Oct 24 10:26:44.847397 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:26:44.848613 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 085734b9-8005-4d0e-9c13-95d8787c9d71 could not be found Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b362a404-72a7-4eba-ac0e-a41c81b61f25'] Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 085734b9-8005-4d0e-9c13-95d8787c9d71. Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:44.851029 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 085734b9-8005-4d0e-9c13-95d8787c9d71 Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:44.852647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:44.855686 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 085734b9-8005-4d0e-9c13-95d8787c9d71 Oct 24 10:26:44.855686 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:44.855686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-18af8f5a-2677-469b-a3af-0ef7e76dda36 tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] Returning 404 to user: Floating IP not found for ID 085734b9-8005-4d0e-9c13-95d8787c9d71 {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:44.855686 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-18af8f5a-2677-469b-a3af-0ef7e76dda36 tempest-FloatingIPsTestJSON-939139962 tempest-FloatingIPsTestJSON-939139962-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/085734b9-8005-4d0e-9c13-95d8787c9d71" status: 404 len: 111 microversion: 2.1 time: 0.071654 Oct 24 10:26:44.855686 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 351/675] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:26:44 2022] DELETE /compute/v2.1/os-floating-ips/085734b9-8005-4d0e-9c13-95d8787c9d71 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:26:44.859364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d37a00b1-d683-4e6f-93a7-e8586fb3d146 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1940817129", "id": 1860491051, "os-flavor-access:is_public": "True"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:44.862940 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4800d62e-20d0-49f7-bbb3-4588e6e85f66 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8" status: 200 len: 1324 microversion: 2.1 time: 0.375923 Oct 24 10:26:44.864172 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 325/676] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:44 2022] GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 => generated 1324 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:44.892049 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d37a00b1-d683-4e6f-93a7-e8586fb3d146 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.037379 Oct 24 10:26:44.894001 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 352/677] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:44 2022] POST /compute/v2.1/flavors => generated 414 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:44.906375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f82a1d43-8b84-45e0-904b-a35d353fbc0a tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:44.913687 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f82a1d43-8b84-45e0-904b-a35d353fbc0a tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1860491051" status: 200 len: 414 microversion: 2.1 time: 0.011413 Oct 24 10:26:44.939372 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 326/678] 10.222.0.50 () {58 vars in 1158 bytes} [Mon Oct 24 10:26:44 2022] GET /compute/v2.1/flavors/1860491051 => generated 414 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:44.954886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-62187e50-fefe-44f8-946b-53962132559f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:44.960787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-62187e50-fefe-44f8-946b-53962132559f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:44.978918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62187e50-fefe-44f8-946b-53962132559f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:44.980281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62187e50-fefe-44f8-946b-53962132559f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:44.980741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62187e50-fefe-44f8-946b-53962132559f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:44.981505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62187e50-fefe-44f8-946b-53962132559f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:44.981966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62187e50-fefe-44f8-946b-53962132559f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:44.982400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62187e50-fefe-44f8-946b-53962132559f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:45.092371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-234650d9-6611-49e6-abf0-975c328feca1 tempest-FlavorsAdminTestJSON-1553544500 tempest-FlavorsAdminTestJSON-1553544500-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:45.116254 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-234650d9-6611-49e6-abf0-975c328feca1 tempest-FlavorsAdminTestJSON-1553544500 tempest-FlavorsAdminTestJSON-1553544500-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 6220 microversion: 2.1 time: 0.192864 Oct 24 10:26:45.133852 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 353/679] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:26:44 2022] GET /compute/v2.1/flavors/detail => generated 6220 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:45.139276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-88b64af8-f707-41d3-93f5-52f59c9341b1 req-bc2c5ce9-b481-4724-806a-5f4c0b700697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4f83cc-06a0-4a8e-b480-1878d348e1d1", "name": "network-vif-plugged", "status": "completed", "tag": "fbe95751-507c-435d-b75f-b10bd1579493"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:45.151794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-88b64af8-f707-41d3-93f5-52f59c9341b1 req-bc2c5ce9-b481-4724-806a-5f4c0b700697 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:45.152358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-88b64af8-f707-41d3-93f5-52f59c9341b1 req-bc2c5ce9-b481-4724-806a-5f4c0b700697 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:45.152804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-88b64af8-f707-41d3-93f5-52f59c9341b1 req-bc2c5ce9-b481-4724-806a-5f4c0b700697 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:45.166660 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-88b64af8-f707-41d3-93f5-52f59c9341b1 req-bc2c5ce9-b481-4724-806a-5f4c0b700697 service nova] Creating event network-vif-plugged:fbe95751-507c-435d-b75f-b10bd1579493 for instance 9d4f83cc-06a0-4a8e-b480-1878d348e1d1 on n-h1-858383-15 Oct 24 10:26:45.174306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [req-88b64af8-f707-41d3-93f5-52f59c9341b1 req-bc2c5ce9-b481-4724-806a-5f4c0b700697 service nova] Instance 9d4f83cc-06a0-4a8e-b480-1878d348e1d1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120426) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:26:45.185700 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-88b64af8-f707-41d3-93f5-52f59c9341b1 req-bc2c5ce9-b481-4724-806a-5f4c0b700697 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051245 Oct 24 10:26:45.186297 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 354/680] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:45.191614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2796b6b8-0165-4fc0-aef4-28292e3f8305 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:45.211596 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2796b6b8-0165-4fc0-aef4-28292e3f8305 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1860491051" status: 202 len: 0 microversion: 2.1 time: 0.023917 Oct 24 10:26:45.215397 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 355/681] 10.222.0.50 () {58 vars in 1161 bytes} [Mon Oct 24 10:26:45 2022] DELETE /compute/v2.1/flavors/1860491051 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:45.220316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9047fc08-af56-4135-9f97-c1101d65a019 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:45.245170 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9047fc08-af56-4135-9f97-c1101d65a019 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.028222 Oct 24 10:26:45.246450 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 356/682] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:26:45 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:45.260152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-2edaf6f7-44d4-4064-ad0a-f91ee2b7174d req-4d718786-f776-4dd2-b0f4-9f7c1caecb08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8f749f9-5771-4ecb-8a06-30a8f69dd848", "tag": "f48a3bd1-58ab-47af-934b-bea589ab9a0b"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:45.275464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2edaf6f7-44d4-4064-ad0a-f91ee2b7174d req-4d718786-f776-4dd2-b0f4-9f7c1caecb08 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:45.276293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2edaf6f7-44d4-4064-ad0a-f91ee2b7174d req-4d718786-f776-4dd2-b0f4-9f7c1caecb08 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:45.276924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2edaf6f7-44d4-4064-ad0a-f91ee2b7174d req-4d718786-f776-4dd2-b0f4-9f7c1caecb08 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:45.290071 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-2edaf6f7-44d4-4064-ad0a-f91ee2b7174d req-4d718786-f776-4dd2-b0f4-9f7c1caecb08 service nova] Creating event network-changed:f48a3bd1-58ab-47af-934b-bea589ab9a0b for instance a8f749f9-5771-4ecb-8a06-30a8f69dd848 on n-h2-858383-15 Oct 24 10:26:45.295384 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-2edaf6f7-44d4-4064-ad0a-f91ee2b7174d req-4d718786-f776-4dd2-b0f4-9f7c1caecb08 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040199 Oct 24 10:26:45.296289 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 357/683] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:45.301459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5f6df1da-ff23-4104-9c05-dce55747e5bd tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-608220223", "id": 586745525, "os-flavor-access:is_public": "False"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:45.325135 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5f6df1da-ff23-4104-9c05-dce55747e5bd tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.027320 Oct 24 10:26:45.325738 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 358/684] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:45 2022] POST /compute/v2.1/flavors => generated 426 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:45.338356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4d54e735-6ffe-4dbd-90e9-68d73efd10b9 tempest-FlavorsAdminTestJSON-1553544500 tempest-FlavorsAdminTestJSON-1553544500-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "586745525"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:45.341015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-62187e50-fefe-44f8-946b-53962132559f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:45.345223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:45.351226 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-4d54e735-6ffe-4dbd-90e9-68d73efd10b9 tempest-FlavorsAdminTestJSON-1553544500 tempest-FlavorsAdminTestJSON-1553544500-project] HTTP exception thrown: Flavor 586745525 could not be found. Oct 24 10:26:45.351407 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-62187e50-fefe-44f8-946b-53962132559f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1505 microversion: 2.1 time: 0.402828 Oct 24 10:26:45.352259 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 327/685] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:44 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1505 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4d54e735-6ffe-4dbd-90e9-68d73efd10b9 tempest-FlavorsAdminTestJSON-1553544500 tempest-FlavorsAdminTestJSON-1553544500-project] Request method failure captured: Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 106 Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmhWagfu3mAVd2VnvlJEDUnBYFEH9JQo1aXC7rRn95Zq57UpbaLgXZcpZ8UYbkVXw_Hf4mjs0plWbinOfYbxQc1bHlnMOu0wm3jp3awRTsN04Cvolw8vwaIYYeM_oeSl9K4xzF0G2HuCczJY7f4LjKAhSauTTkdBIZ6xpcisNKQ6DoU Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: d66074734ede4c48a5999602a50f42b0 Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-FlavorsAdminTestJSON-1553544500 Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:26:45.354110 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:26:45.355480 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d66074734ede4c48a5999602a50f42b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d66074734ede4c48a5999602a50f42b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d66074734ede4c48a5999602a50f42b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d66074734ede4c48a5999602a50f42b0", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:45.355480 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-FlavorsAdminTestJSON-1553544500 Oct 24 10:26:45.355480 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: d66074734ede4c48a5999602a50f42b0 Oct 24 10:26:45.355480 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1553544500 Oct 24 10:26:45.355480 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-FlavorsAdminTestJSON-1553544500-project Oct 24 10:26:45.355480 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:26:45.355480 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:26:45.355480 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 3fc89ebd0ebb4138b128b68046253ac5 Oct 24 10:26:45.355480 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-FlavorsAdminTestJSON-1553544500-project Oct 24 10:26:45.355480 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:26:45.355480 n-d-858383-15 devstack@n-api.service[120426]: {"server": {"name": "test", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "586745525"}} Oct 24 10:26:45.355480 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:26:45.355480 n-d-858383-15 devstack@n-api.service[120426]: exception: Flavor 586745525 could not be found. Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '586745525'}}} Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 586745525 could not be found. Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:45.356300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 586745525 could not be found. Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:45.357579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:45.362520 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:45.362520 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:45.362520 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:45.362520 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 586745525 could not be found. Oct 24 10:26:45.362520 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:45.365648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4d54e735-6ffe-4dbd-90e9-68d73efd10b9 tempest-FlavorsAdminTestJSON-1553544500 tempest-FlavorsAdminTestJSON-1553544500-project] Returning 400 to user: Flavor 586745525 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:45.366813 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4d54e735-6ffe-4dbd-90e9-68d73efd10b9 tempest-FlavorsAdminTestJSON-1553544500 tempest-FlavorsAdminTestJSON-1553544500-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.032202 Oct 24 10:26:45.367690 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 359/686] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:45 2022] POST /compute/v2.1/servers => generated 80 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 24 10:26:45.376396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-06e6aeb7-abc1-4075-98b3-dcc24266d421 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:45.395940 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-06e6aeb7-abc1-4075-98b3-dcc24266d421 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/586745525" status: 202 len: 0 microversion: 2.1 time: 0.023486 Oct 24 10:26:45.396907 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 328/687] 10.222.0.50 () {58 vars in 1158 bytes} [Mon Oct 24 10:26:45 2022] DELETE /compute/v2.1/flavors/586745525 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:45.404942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b8697a4c-677f-4ea2-85a3-5007295d8899 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:45.428594 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b8697a4c-677f-4ea2-85a3-5007295d8899 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.026655 Oct 24 10:26:45.429310 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 360/688] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:26:45 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:45.450012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2a1b6d6c-633c-410c-a3cb-b6fc06f2965c tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-835962761", "id": 1073298403, "os-flavor-access:is_public": "False"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:45.470253 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2a1b6d6c-633c-410c-a3cb-b6fc06f2965c tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.024003 Oct 24 10:26:45.470861 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 329/689] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:45 2022] POST /compute/v2.1/flavors => generated 414 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:45.483573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4437d71b-d219-405b-8add-e773c7f26ef7 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-403750808", "id": 623605426, "os-flavor-access:is_public": "True"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:45.489684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-78442510-4b25-4407-8f62-823b11a91c02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:45.497362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-78442510-4b25-4407-8f62-823b11a91c02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:45.505135 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4437d71b-d219-405b-8add-e773c7f26ef7 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.024911 Oct 24 10:26:45.506991 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 361/690] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:45 2022] POST /compute/v2.1/flavors => generated 410 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:45.508892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=12,nova_api:INSERT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:45.512561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78442510-4b25-4407-8f62-823b11a91c02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:45.512767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4f8dd5a7-0d73-4e38-bd63-be13b3a34f13 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:45.513456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78442510-4b25-4407-8f62-823b11a91c02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:45.514032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78442510-4b25-4407-8f62-823b11a91c02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:45.514593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4f8dd5a7-0d73-4e38-bd63-be13b3a34f13 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:45.515259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78442510-4b25-4407-8f62-823b11a91c02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:45.515938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78442510-4b25-4407-8f62-823b11a91c02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:45.516595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78442510-4b25-4407-8f62-823b11a91c02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:45.523702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f8dd5a7-0d73-4e38-bd63-be13b3a34f13 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:45.524212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f8dd5a7-0d73-4e38-bd63-be13b3a34f13 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:45.524649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f8dd5a7-0d73-4e38-bd63-be13b3a34f13 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:45.526110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f8dd5a7-0d73-4e38-bd63-be13b3a34f13 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:45.526955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f8dd5a7-0d73-4e38-bd63-be13b3a34f13 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:45.528489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f8dd5a7-0d73-4e38-bd63-be13b3a34f13 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:46.188545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-78442510-4b25-4407-8f62-823b11a91c02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:46.198973 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-78442510-4b25-4407-8f62-823b11a91c02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404" status: 200 len: 1315 microversion: 2.1 time: 0.712949 Oct 24 10:26:46.200152 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 330/691] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:45 2022] GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:26:46.204857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eb4a19e2-7c11-41eb-9941-c07ca13b772a tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:46.230867 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eb4a19e2-7c11-41eb-9941-c07ca13b772a tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.029494 Oct 24 10:26:46.231588 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 331/692] 10.222.0.50 () {58 vars in 1169 bytes} [Mon Oct 24 10:26:46 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:46.236552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-24f81f29-9b32-4839-90d5-029ca3c24e98 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:46.237292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-24f81f29-9b32-4839-90d5-029ca3c24e98 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:46.239703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4f8dd5a7-0d73-4e38-bd63-be13b3a34f13 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:46.244147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24f81f29-9b32-4839-90d5-029ca3c24e98 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:46.244776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24f81f29-9b32-4839-90d5-029ca3c24e98 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:46.245762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24f81f29-9b32-4839-90d5-029ca3c24e98 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:46.246533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24f81f29-9b32-4839-90d5-029ca3c24e98 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:46.247057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24f81f29-9b32-4839-90d5-029ca3c24e98 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:46.247681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24f81f29-9b32-4839-90d5-029ca3c24e98 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:46.258261 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4f8dd5a7-0d73-4e38-bd63-be13b3a34f13 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1469 microversion: 2.1 time: 0.749951 Oct 24 10:26:46.259400 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 362/693] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:45 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1469 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:46.264325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d73ccd8c-4fe5-45f5-bcab-1ae8cf65eda2 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:46.264969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d73ccd8c-4fe5-45f5-bcab-1ae8cf65eda2 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:46.271339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d73ccd8c-4fe5-45f5-bcab-1ae8cf65eda2 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:46.272185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d73ccd8c-4fe5-45f5-bcab-1ae8cf65eda2 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:46.272795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d73ccd8c-4fe5-45f5-bcab-1ae8cf65eda2 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:46.273690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d73ccd8c-4fe5-45f5-bcab-1ae8cf65eda2 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:46.274337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d73ccd8c-4fe5-45f5-bcab-1ae8cf65eda2 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:46.274931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d73ccd8c-4fe5-45f5-bcab-1ae8cf65eda2 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:46.337693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-24f81f29-9b32-4839-90d5-029ca3c24e98 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:46.345869 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-24f81f29-9b32-4839-90d5-029ca3c24e98 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1270 microversion: 2.1 time: 0.113080 Oct 24 10:26:46.347462 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 332/694] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:46 2022] GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 1270 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:46.352479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-73f4fde3-1a5b-4f0f-84f1-ccc174b7f3ba tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:46.362474 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-73f4fde3-1a5b-4f0f-84f1-ccc174b7f3ba tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.013754 Oct 24 10:26:46.363358 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 333/695] 10.222.0.50 () {58 vars in 1177 bytes} [Mon Oct 24 10:26:46 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:46.376588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3c8fb861-a0da-4a23-b88c-2cf736d1544d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:46.377294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3c8fb861-a0da-4a23-b88c-2cf736d1544d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:46.384249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c8fb861-a0da-4a23-b88c-2cf736d1544d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:46.384735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c8fb861-a0da-4a23-b88c-2cf736d1544d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:46.385233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c8fb861-a0da-4a23-b88c-2cf736d1544d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:46.385929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c8fb861-a0da-4a23-b88c-2cf736d1544d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:46.386571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c8fb861-a0da-4a23-b88c-2cf736d1544d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:46.386995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c8fb861-a0da-4a23-b88c-2cf736d1544d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:46.662483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d73ccd8c-4fe5-45f5-bcab-1ae8cf65eda2 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:46.675665 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d73ccd8c-4fe5-45f5-bcab-1ae8cf65eda2 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8" status: 200 len: 1324 microversion: 2.1 time: 0.414989 Oct 24 10:26:46.689770 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 363/696] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:46 2022] GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 => generated 1324 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:46.698649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f4f4347c-143d-4294-a7d0-136378ff37ee tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:46.707201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c8fb861-a0da-4a23-b88c-2cf736d1544d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:46.716675 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3c8fb861-a0da-4a23-b88c-2cf736d1544d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1505 microversion: 2.1 time: 0.344136 Oct 24 10:26:46.720336 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f4f4347c-143d-4294-a7d0-136378ff37ee tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.029207 Oct 24 10:26:46.721564 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 364/697] 10.222.0.50 () {58 vars in 1171 bytes} [Mon Oct 24 10:26:46 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:46.730018 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 334/698] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:46 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:26:46.744868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5fe7de17-b9e0-4fc2-a314-32c80c776d52 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:46.766118 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5fe7de17-b9e0-4fc2-a314-32c80c776d52 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.034731 Oct 24 10:26:46.767511 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 365/699] 10.222.0.50 () {58 vars in 1169 bytes} [Mon Oct 24 10:26:46 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:46.780511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a2e70377-a20d-4a60-9ff1-3280a54ff384 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:46.815001 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a2e70377-a20d-4a60-9ff1-3280a54ff384 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6216 microversion: 2.1 time: 0.037570 Oct 24 10:26:46.819373 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 335/700] 10.222.0.50 () {58 vars in 1169 bytes} [Mon Oct 24 10:26:46 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6216 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:46.837188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8799460a-5682-41d9-b776-2540683883a2 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:46.862789 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8799460a-5682-41d9-b776-2540683883a2 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6216 microversion: 2.1 time: 0.029706 Oct 24 10:26:46.865387 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 366/701] 10.222.0.50 () {58 vars in 1175 bytes} [Mon Oct 24 10:26:46 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6216 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:46.885394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1313733f-523e-42be-b003-a09a98ad99b8 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:46.907871 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1313733f-523e-42be-b003-a09a98ad99b8 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6216 microversion: 2.1 time: 0.025962 Oct 24 10:26:46.921995 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 336/702] 10.222.0.50 () {58 vars in 1173 bytes} [Mon Oct 24 10:26:46 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6216 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:46.930370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a54f760e-923c-4b13-8040-9227b8297099 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:46.956661 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a54f760e-923c-4b13-8040-9227b8297099 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6216 microversion: 2.1 time: 0.030875 Oct 24 10:26:46.957638 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 367/703] 10.222.0.50 () {58 vars in 1169 bytes} [Mon Oct 24 10:26:46 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6216 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:46.977917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9ccd15e4-adb9-4961-90d7-9746900bad20 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:47.003261 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9ccd15e4-adb9-4961-90d7-9746900bad20 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/623605426" status: 202 len: 0 microversion: 2.1 time: 0.030008 Oct 24 10:26:47.004197 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 337/704] 10.222.0.50 () {58 vars in 1158 bytes} [Mon Oct 24 10:26:46 2022] DELETE /compute/v2.1/flavors/623605426 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:47.012509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ad5f1154-1b1f-4869-a80d-74fe46c508d1 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:47.037231 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ad5f1154-1b1f-4869-a80d-74fe46c508d1 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.026342 Oct 24 10:26:47.050076 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 368/705] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:26:47 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:47.058755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b14c1ad7-24e6-4df7-b07d-a40a6e4b7253 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:47.076263 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b14c1ad7-24e6-4df7-b07d-a40a6e4b7253 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1073298403" status: 202 len: 0 microversion: 2.1 time: 0.021541 Oct 24 10:26:47.077589 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 338/706] 10.222.0.50 () {58 vars in 1161 bytes} [Mon Oct 24 10:26:47 2022] DELETE /compute/v2.1/flavors/1073298403 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:47.086871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f692fbb3-55d6-43a2-afba-e64fa81d9656 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:47.112761 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f692fbb3-55d6-43a2-afba-e64fa81d9656 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.030622 Oct 24 10:26:47.114603 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 369/707] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:26:47 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:47.140756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0b800785-c0dd-4f2f-a10e-214bfe8efe91 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1306130006", "id": 76294946, "os-flavor-access:is_public": "False"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:47.163482 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0b800785-c0dd-4f2f-a10e-214bfe8efe91 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.027654 Oct 24 10:26:47.171472 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 339/708] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:47.178424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eccd21c0-3138-4973-b059-bd8dda9bb33d tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:47.203967 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-eccd21c0-3138-4973-b059-bd8dda9bb33d tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.030897 Oct 24 10:26:47.208890 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 370/709] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:26:47 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:47.222175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9c6506be-43fd-4192-9446-7b3027add8a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:47.223487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9c6506be-43fd-4192-9446-7b3027add8a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:47.226853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3449e8ef-abf2-4ab8-a0f8-9478ce55b31d tempest-FlavorsAdminTestJSON-1553544500 tempest-FlavorsAdminTestJSON-1553544500-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:47.233013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c6506be-43fd-4192-9446-7b3027add8a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:47.235249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c6506be-43fd-4192-9446-7b3027add8a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:47.235923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c6506be-43fd-4192-9446-7b3027add8a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:47.236968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c6506be-43fd-4192-9446-7b3027add8a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:47.238435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c6506be-43fd-4192-9446-7b3027add8a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:47.239306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c6506be-43fd-4192-9446-7b3027add8a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:47.261849 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3449e8ef-abf2-4ab8-a0f8-9478ce55b31d tempest-FlavorsAdminTestJSON-1553544500 tempest-FlavorsAdminTestJSON-1553544500-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.039663 Oct 24 10:26:47.280099 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 371/710] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:26:47 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:47.285885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1cd7d8da-d0a1-471a-99a5-dac2abca57e0 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:47.310534 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1cd7d8da-d0a1-471a-99a5-dac2abca57e0 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/76294946" status: 202 len: 0 microversion: 2.1 time: 0.030157 Oct 24 10:26:47.312647 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 372/711] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Oct 24 10:26:47 2022] DELETE /compute/v2.1/flavors/76294946 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:47.320058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8b726342-8491-43bc-8890-a32621e5829f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:47.321043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8b726342-8491-43bc-8890-a32621e5829f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:47.329924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b726342-8491-43bc-8890-a32621e5829f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:47.330758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b726342-8491-43bc-8890-a32621e5829f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:47.330880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b726342-8491-43bc-8890-a32621e5829f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:47.332981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b726342-8491-43bc-8890-a32621e5829f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:47.333537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b726342-8491-43bc-8890-a32621e5829f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:47.334606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b726342-8491-43bc-8890-a32621e5829f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:47.768467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9c6506be-43fd-4192-9446-7b3027add8a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:47.780072 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9c6506be-43fd-4192-9446-7b3027add8a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404" status: 200 len: 1315 microversion: 2.1 time: 0.562729 Oct 24 10:26:47.793949 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 340/712] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:47 2022] GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:47.803089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-970ed952-210f-4688-a4b3-5ef2476447e5 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:47.829761 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-970ed952-210f-4688-a4b3-5ef2476447e5 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.034025 Oct 24 10:26:47.831171 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 341/713] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:26:47 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:47.838350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7ca9fb7d-ee03-4a65-8945-6ee793d26244 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:47.839112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7ca9fb7d-ee03-4a65-8945-6ee793d26244 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:47.845844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ca9fb7d-ee03-4a65-8945-6ee793d26244 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:47.846835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ca9fb7d-ee03-4a65-8945-6ee793d26244 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:47.847617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ca9fb7d-ee03-4a65-8945-6ee793d26244 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:47.848988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ca9fb7d-ee03-4a65-8945-6ee793d26244 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:47.850489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ca9fb7d-ee03-4a65-8945-6ee793d26244 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:47.851885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ca9fb7d-ee03-4a65-8945-6ee793d26244 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:47.899296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8b726342-8491-43bc-8890-a32621e5829f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:47.907960 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8b726342-8491-43bc-8890-a32621e5829f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1469 microversion: 2.1 time: 0.593801 Oct 24 10:26:47.920397 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 373/714] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:47 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1469 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:47.920397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-706a2d80-0891-4574-a258-e5a85c2a03e2 req-4159c264-cae5-4c1d-beec-8095baf6aeb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ef26c4-a579-469e-b5db-bc2b0e17e99d", "name": "network-vif-unplugged", "status": "completed", "tag": "7b8b4301-4ceb-4f7a-a75e-0a52614ad84f"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:47.924127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-706a2d80-0891-4574-a258-e5a85c2a03e2 req-4159c264-cae5-4c1d-beec-8095baf6aeb3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:47.924899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-706a2d80-0891-4574-a258-e5a85c2a03e2 req-4159c264-cae5-4c1d-beec-8095baf6aeb3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:47.925711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-706a2d80-0891-4574-a258-e5a85c2a03e2 req-4159c264-cae5-4c1d-beec-8095baf6aeb3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:47.942201 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-706a2d80-0891-4574-a258-e5a85c2a03e2 req-4159c264-cae5-4c1d-beec-8095baf6aeb3 service nova] Creating event network-vif-unplugged:7b8b4301-4ceb-4f7a-a75e-0a52614ad84f for instance e0ef26c4-a579-469e-b5db-bc2b0e17e99d on n-h2-858383-15 Oct 24 10:26:47.948942 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-706a2d80-0891-4574-a258-e5a85c2a03e2 req-4159c264-cae5-4c1d-beec-8095baf6aeb3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038916 Oct 24 10:26:47.950257 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 374/715] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:47.955613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-299ba051-2f8f-423f-809c-7a426cfb4aa3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:47.956648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-299ba051-2f8f-423f-809c-7a426cfb4aa3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:47.965034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-299ba051-2f8f-423f-809c-7a426cfb4aa3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:47.965880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-299ba051-2f8f-423f-809c-7a426cfb4aa3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:47.966421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-299ba051-2f8f-423f-809c-7a426cfb4aa3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:47.967173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-299ba051-2f8f-423f-809c-7a426cfb4aa3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:47.967703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-299ba051-2f8f-423f-809c-7a426cfb4aa3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:47.968203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-299ba051-2f8f-423f-809c-7a426cfb4aa3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:48.037431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7ca9fb7d-ee03-4a65-8945-6ee793d26244 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:48.056136 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7ca9fb7d-ee03-4a65-8945-6ee793d26244 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1276 microversion: 2.1 time: 0.223521 Oct 24 10:26:48.073783 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 342/716] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:47 2022] GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 1276 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:48.083040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3ac034ec-1687-48ab-9343-e9cc7d3d4865 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:48.086405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3ac034ec-1687-48ab-9343-e9cc7d3d4865 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:48.094704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ac034ec-1687-48ab-9343-e9cc7d3d4865 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:48.095792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ac034ec-1687-48ab-9343-e9cc7d3d4865 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:48.096507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ac034ec-1687-48ab-9343-e9cc7d3d4865 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:48.098351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ac034ec-1687-48ab-9343-e9cc7d3d4865 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:48.099037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ac034ec-1687-48ab-9343-e9cc7d3d4865 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:48.100029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ac034ec-1687-48ab-9343-e9cc7d3d4865 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:48.408815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-299ba051-2f8f-423f-809c-7a426cfb4aa3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:48.418926 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-299ba051-2f8f-423f-809c-7a426cfb4aa3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8" status: 200 len: 1324 microversion: 2.1 time: 0.467148 Oct 24 10:26:48.433879 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 375/717] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:47 2022] GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 => generated 1324 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:48.442807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d3f8fc85-18d6-4359-812a-e2f479994daa tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1075546898", "id": 1714613841, "os-flavor-access:is_public": "True"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:48.465914 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d3f8fc85-18d6-4359-812a-e2f479994daa tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.030695 Oct 24 10:26:48.466750 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 376/718] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:48 2022] POST /compute/v2.1/flavors => generated 414 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:48.481898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a4b0d586-c0ee-45ae-99b2-c9fd4738d016 tempest-FlavorsAdminTestJSON-1553544500 tempest-FlavorsAdminTestJSON-1553544500-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:48.518344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3ac034ec-1687-48ab-9343-e9cc7d3d4865 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:48.526681 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a4b0d586-c0ee-45ae-99b2-c9fd4738d016 tempest-FlavorsAdminTestJSON-1553544500 tempest-FlavorsAdminTestJSON-1553544500-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 6220 microversion: 2.1 time: 0.050959 Oct 24 10:26:48.531137 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3ac034ec-1687-48ab-9343-e9cc7d3d4865 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1505 microversion: 2.1 time: 0.460924 Oct 24 10:26:48.532135 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 343/719] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:48 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1505 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:48.540914 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 377/720] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:26:48 2022] GET /compute/v2.1/flavors/detail => generated 6220 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:48.558171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d21212d-2cb6-417d-8df8-44f98f3a8c80 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:48.585194 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0d21212d-2cb6-417d-8df8-44f98f3a8c80 tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1714613841" status: 202 len: 0 microversion: 2.1 time: 0.029691 Oct 24 10:26:48.586507 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 344/721] 10.222.0.50 () {58 vars in 1161 bytes} [Mon Oct 24 10:26:48 2022] DELETE /compute/v2.1/flavors/1714613841 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:26:48.600730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-39bbcf9f-0988-4f2d-bd3d-fa1d33bb748a tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:48.632611 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-39bbcf9f-0988-4f2d-bd3d-fa1d33bb748a tempest-FlavorsAdminTestJSON-1455796192 tempest-FlavorsAdminTestJSON-1455796192-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.042016 Oct 24 10:26:48.637661 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 378/722] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:26:48 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:48.809603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-42436700-70a4-4a08-ac9d-24f13da29cf8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:48.810373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-42436700-70a4-4a08-ac9d-24f13da29cf8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:48.819512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42436700-70a4-4a08-ac9d-24f13da29cf8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:48.820517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42436700-70a4-4a08-ac9d-24f13da29cf8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:48.821207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42436700-70a4-4a08-ac9d-24f13da29cf8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:48.822270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42436700-70a4-4a08-ac9d-24f13da29cf8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:48.823159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42436700-70a4-4a08-ac9d-24f13da29cf8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:48.824109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42436700-70a4-4a08-ac9d-24f13da29cf8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:48.939983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ade11c0f-3b20-498b-9873-dd63b99697be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:48.940624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ade11c0f-3b20-498b-9873-dd63b99697be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:48.953698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ade11c0f-3b20-498b-9873-dd63b99697be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:48.954523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ade11c0f-3b20-498b-9873-dd63b99697be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:48.955320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ade11c0f-3b20-498b-9873-dd63b99697be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:48.956429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ade11c0f-3b20-498b-9873-dd63b99697be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:48.957138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ade11c0f-3b20-498b-9873-dd63b99697be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:48.957785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ade11c0f-3b20-498b-9873-dd63b99697be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:49.356396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-42436700-70a4-4a08-ac9d-24f13da29cf8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:49.380135 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-42436700-70a4-4a08-ac9d-24f13da29cf8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404" status: 200 len: 1315 microversion: 2.1 time: 0.575645 Oct 24 10:26:49.383137 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 345/723] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:48 2022] GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:49.388747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8fb67540-2e37-465d-b6b2-28a0fc98a157 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:49.389386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8fb67540-2e37-465d-b6b2-28a0fc98a157 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:49.393240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ade11c0f-3b20-498b-9873-dd63b99697be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:49.396354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb67540-2e37-465d-b6b2-28a0fc98a157 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:49.397133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb67540-2e37-465d-b6b2-28a0fc98a157 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:49.397673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb67540-2e37-465d-b6b2-28a0fc98a157 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:49.398582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb67540-2e37-465d-b6b2-28a0fc98a157 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:49.399196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb67540-2e37-465d-b6b2-28a0fc98a157 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:49.399780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb67540-2e37-465d-b6b2-28a0fc98a157 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:49.403019 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ade11c0f-3b20-498b-9873-dd63b99697be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1461 microversion: 2.1 time: 0.469039 Oct 24 10:26:49.403605 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 379/724] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:48 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1461 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:49.425942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2af0fcb4-153c-419a-b2b7-ba2364d06a07 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:49.427059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2af0fcb4-153c-419a-b2b7-ba2364d06a07 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:49.434250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2af0fcb4-153c-419a-b2b7-ba2364d06a07 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:49.435035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2af0fcb4-153c-419a-b2b7-ba2364d06a07 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:49.435655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2af0fcb4-153c-419a-b2b7-ba2364d06a07 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:49.436538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2af0fcb4-153c-419a-b2b7-ba2364d06a07 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:49.437229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2af0fcb4-153c-419a-b2b7-ba2364d06a07 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:49.438079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2af0fcb4-153c-419a-b2b7-ba2364d06a07 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:49.738197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8fb67540-2e37-465d-b6b2-28a0fc98a157 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:49.754640 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8fb67540-2e37-465d-b6b2-28a0fc98a157 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1318 microversion: 2.1 time: 0.365388 Oct 24 10:26:49.755400 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 346/725] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:49 2022] GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:49.766560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80401868-928f-4c43-97eb-177879fe97cf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:49.770296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-80401868-928f-4c43-97eb-177879fe97cf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:49.789223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80401868-928f-4c43-97eb-177879fe97cf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:49.791439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80401868-928f-4c43-97eb-177879fe97cf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:49.792719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80401868-928f-4c43-97eb-177879fe97cf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:49.793914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80401868-928f-4c43-97eb-177879fe97cf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:49.794912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80401868-928f-4c43-97eb-177879fe97cf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:49.795580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80401868-928f-4c43-97eb-177879fe97cf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:49.894805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2af0fcb4-153c-419a-b2b7-ba2364d06a07 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:49.903844 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2af0fcb4-153c-419a-b2b7-ba2364d06a07 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1461 microversion: 2.1 time: 0.481737 Oct 24 10:26:49.905112 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 380/726] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:49 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1461 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:26:49.910012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e5db0ddb-165f-4719-94b9-5ceca4c4a9a8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:49.910905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e5db0ddb-165f-4719-94b9-5ceca4c4a9a8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:49.917409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5db0ddb-165f-4719-94b9-5ceca4c4a9a8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:49.918184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5db0ddb-165f-4719-94b9-5ceca4c4a9a8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:49.918838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5db0ddb-165f-4719-94b9-5ceca4c4a9a8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:49.919767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5db0ddb-165f-4719-94b9-5ceca4c4a9a8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:49.920434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5db0ddb-165f-4719-94b9-5ceca4c4a9a8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:49.921135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5db0ddb-165f-4719-94b9-5ceca4c4a9a8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:49.946035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:50.109405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-80401868-928f-4c43-97eb-177879fe97cf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:50.119022 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-80401868-928f-4c43-97eb-177879fe97cf tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8" status: 200 len: 1324 microversion: 2.1 time: 0.361708 Oct 24 10:26:50.119785 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 347/727] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:49 2022] GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 => generated 1324 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:50.132699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-154e3b7c-d642-4750-a438-18ce5c0d9160 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Action: 'create', calling method: .version_select at 0x7f04d1018b80>, body: {"keypair": {"name": "tempest-keypair-2049449881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIW2LxZfXtN/De0WE0Drntk8uY8OQtFJSEN+yxOqkDjyARGotA0PCVv5zzf6u7yChtyl4Fx2SUiV08sAX54NS20tphtTT3RsOi3b0n2RDX25QkeQIZnE2d0nCuxNvOukgA=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:50.169442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-154e3b7c-d642-4750-a438-18ce5c0d9160 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Getting quotas for project ac5f703504204b91a5c7e895964ec985. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:26:50.183578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e5db0ddb-165f-4719-94b9-5ceca4c4a9a8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:50.190167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-154e3b7c-d642-4750-a438-18ce5c0d9160 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Getting quotas for user b684c865fc9e4abb8e0e55616087b92e and project ac5f703504204b91a5c7e895964ec985. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:26:50.195294 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e5db0ddb-165f-4719-94b9-5ceca4c4a9a8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1505 microversion: 2.1 time: 0.288768 Oct 24 10:26:50.196885 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 381/728] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:49 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:50.203640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-4748db41-0b90-47c1-8164-95fe27d02b1a req-046a1988-8c79-4d38-914e-585356d9e72e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ef26c4-a579-469e-b5db-bc2b0e17e99d", "tag": "7b8b4301-4ceb-4f7a-a75e-0a52614ad84f"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:50.233862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4748db41-0b90-47c1-8164-95fe27d02b1a req-046a1988-8c79-4d38-914e-585356d9e72e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:50.234320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4748db41-0b90-47c1-8164-95fe27d02b1a req-046a1988-8c79-4d38-914e-585356d9e72e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:50.234757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4748db41-0b90-47c1-8164-95fe27d02b1a req-046a1988-8c79-4d38-914e-585356d9e72e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:50.245652 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-154e3b7c-d642-4750-a438-18ce5c0d9160 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124441 Oct 24 10:26:50.246260 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 348/729] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:26:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:50.264146 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-4748db41-0b90-47c1-8164-95fe27d02b1a req-046a1988-8c79-4d38-914e-585356d9e72e service nova] Creating event network-changed:7b8b4301-4ceb-4f7a-a75e-0a52614ad84f for instance e0ef26c4-a579-469e-b5db-bc2b0e17e99d on n-h2-858383-15 Oct 24 10:26:50.273760 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-4748db41-0b90-47c1-8164-95fe27d02b1a req-046a1988-8c79-4d38-914e-585356d9e72e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076652 Oct 24 10:26:50.276703 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 382/730] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:50.403955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-08b78c1e-7e63-40ec-82a5-001231299f6c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:50.404577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-08b78c1e-7e63-40ec-82a5-001231299f6c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:50.412915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08b78c1e-7e63-40ec-82a5-001231299f6c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:50.413418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08b78c1e-7e63-40ec-82a5-001231299f6c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:50.424766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08b78c1e-7e63-40ec-82a5-001231299f6c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:50.431229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08b78c1e-7e63-40ec-82a5-001231299f6c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:50.433182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08b78c1e-7e63-40ec-82a5-001231299f6c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:50.434029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08b78c1e-7e63-40ec-82a5-001231299f6c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:50.790521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4ede83e9-a572-4581-a4b8-10e2e641b85a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:50.794695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4ede83e9-a572-4581-a4b8-10e2e641b85a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:50.807691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ede83e9-a572-4581-a4b8-10e2e641b85a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:50.808991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ede83e9-a572-4581-a4b8-10e2e641b85a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:50.809538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ede83e9-a572-4581-a4b8-10e2e641b85a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:50.810541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ede83e9-a572-4581-a4b8-10e2e641b85a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:50.811194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ede83e9-a572-4581-a4b8-10e2e641b85a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:50.812018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ede83e9-a572-4581-a4b8-10e2e641b85a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:50.862221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-08b78c1e-7e63-40ec-82a5-001231299f6c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:50.882997 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-08b78c1e-7e63-40ec-82a5-001231299f6c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404" status: 200 len: 1315 microversion: 2.1 time: 0.480898 Oct 24 10:26:50.884976 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 349/731] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:50 2022] GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:51.048288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4ede83e9-a572-4581-a4b8-10e2e641b85a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:51.063038 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4ede83e9-a572-4581-a4b8-10e2e641b85a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1318 microversion: 2.1 time: 0.283550 Oct 24 10:26:51.063973 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 383/732] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:50 2022] GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:51.147040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-92721f98-5edd-41c1-bedb-7cf6f7422962 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:51.148445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-92721f98-5edd-41c1-bedb-7cf6f7422962 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:51.159404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92721f98-5edd-41c1-bedb-7cf6f7422962 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:51.160154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92721f98-5edd-41c1-bedb-7cf6f7422962 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:51.160762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92721f98-5edd-41c1-bedb-7cf6f7422962 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:51.169682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92721f98-5edd-41c1-bedb-7cf6f7422962 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:51.170472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92721f98-5edd-41c1-bedb-7cf6f7422962 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:51.171090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92721f98-5edd-41c1-bedb-7cf6f7422962 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:51.223082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2b1c83a7-9082-4084-89ba-ef97d7b1bba6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:51.225196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2b1c83a7-9082-4084-89ba-ef97d7b1bba6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:51.235530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1c83a7-9082-4084-89ba-ef97d7b1bba6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:51.236381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1c83a7-9082-4084-89ba-ef97d7b1bba6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:51.236846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1c83a7-9082-4084-89ba-ef97d7b1bba6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:51.237583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1c83a7-9082-4084-89ba-ef97d7b1bba6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:51.238076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1c83a7-9082-4084-89ba-ef97d7b1bba6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:51.238663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1c83a7-9082-4084-89ba-ef97d7b1bba6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:51.371029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-92721f98-5edd-41c1-bedb-7cf6f7422962 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:51.379168 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-92721f98-5edd-41c1-bedb-7cf6f7422962 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8" status: 200 len: 1324 microversion: 2.1 time: 0.236710 Oct 24 10:26:51.379835 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 350/733] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:51 2022] GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 => generated 1324 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:51.393802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-6637aa9f-52d6-43ab-b3c3-935a9384ed83 req-3fb1809a-e48e-41a9-bead-23c075bcdfc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8bcf29-893c-4ca8-82cb-636c2bb6f404", "name": "network-vif-plugged", "status": "completed", "tag": "60b5819c-0c14-41c1-9eb8-bedff7e720a0"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:51.403988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6637aa9f-52d6-43ab-b3c3-935a9384ed83 req-3fb1809a-e48e-41a9-bead-23c075bcdfc7 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:51.404651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6637aa9f-52d6-43ab-b3c3-935a9384ed83 req-3fb1809a-e48e-41a9-bead-23c075bcdfc7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:51.405118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6637aa9f-52d6-43ab-b3c3-935a9384ed83 req-3fb1809a-e48e-41a9-bead-23c075bcdfc7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:51.417603 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-6637aa9f-52d6-43ab-b3c3-935a9384ed83 req-3fb1809a-e48e-41a9-bead-23c075bcdfc7 service nova] Creating event network-vif-plugged:60b5819c-0c14-41c1-9eb8-bedff7e720a0 for instance 2a8bcf29-893c-4ca8-82cb-636c2bb6f404 on n-h1-858383-15 Oct 24 10:26:51.422974 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-6637aa9f-52d6-43ab-b3c3-935a9384ed83 req-3fb1809a-e48e-41a9-bead-23c075bcdfc7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032828 Oct 24 10:26:51.424200 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 351/734] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:51.487990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2b1c83a7-9082-4084-89ba-ef97d7b1bba6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:51.504338 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2b1c83a7-9082-4084-89ba-ef97d7b1bba6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1505 microversion: 2.1 time: 0.286346 Oct 24 10:26:51.516138 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 384/735] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:51 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:26:51.981285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dd539be6-62a8-49c5-a2ea-2e75242b65b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:51.982045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dd539be6-62a8-49c5-a2ea-2e75242b65b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:52.000463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd539be6-62a8-49c5-a2ea-2e75242b65b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:52.000992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd539be6-62a8-49c5-a2ea-2e75242b65b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:52.001424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd539be6-62a8-49c5-a2ea-2e75242b65b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:52.016019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd539be6-62a8-49c5-a2ea-2e75242b65b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:52.019960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd539be6-62a8-49c5-a2ea-2e75242b65b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:52.022243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd539be6-62a8-49c5-a2ea-2e75242b65b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:52.105311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a51cea80-6934-4571-b7ff-c3637eb6cd91 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:52.110879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a51cea80-6934-4571-b7ff-c3637eb6cd91 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:52.133607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a51cea80-6934-4571-b7ff-c3637eb6cd91 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:52.134148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a51cea80-6934-4571-b7ff-c3637eb6cd91 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:52.134594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a51cea80-6934-4571-b7ff-c3637eb6cd91 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:52.136235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a51cea80-6934-4571-b7ff-c3637eb6cd91 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:52.136744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a51cea80-6934-4571-b7ff-c3637eb6cd91 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:52.137216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a51cea80-6934-4571-b7ff-c3637eb6cd91 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:52.366317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:52.476635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dd539be6-62a8-49c5-a2ea-2e75242b65b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:52.489556 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dd539be6-62a8-49c5-a2ea-2e75242b65b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404" status: 200 len: 1315 microversion: 2.1 time: 0.524433 Oct 24 10:26:52.505182 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 352/736] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:51 2022] GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 => generated 1315 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:52.518655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e3bda10-9557-4a8f-86bb-063df56eeca4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:52.523006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5e3bda10-9557-4a8f-86bb-063df56eeca4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:52.537849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e3bda10-9557-4a8f-86bb-063df56eeca4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:52.539078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e3bda10-9557-4a8f-86bb-063df56eeca4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:52.541548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e3bda10-9557-4a8f-86bb-063df56eeca4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:52.542792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e3bda10-9557-4a8f-86bb-063df56eeca4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:52.545032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e3bda10-9557-4a8f-86bb-063df56eeca4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:52.547716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e3bda10-9557-4a8f-86bb-063df56eeca4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:52.673426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a51cea80-6934-4571-b7ff-c3637eb6cd91 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:52.683010 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a51cea80-6934-4571-b7ff-c3637eb6cd91 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1318 microversion: 2.1 time: 0.587767 Oct 24 10:26:52.683879 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 385/737] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:52 2022] GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 1318 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:52.689430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ed226764-eebe-471a-b9aa-a2f6b453a54e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:52.690942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ed226764-eebe-471a-b9aa-a2f6b453a54e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:52.703590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed226764-eebe-471a-b9aa-a2f6b453a54e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:52.704336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed226764-eebe-471a-b9aa-a2f6b453a54e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:52.704988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed226764-eebe-471a-b9aa-a2f6b453a54e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:52.707520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed226764-eebe-471a-b9aa-a2f6b453a54e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:52.708408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed226764-eebe-471a-b9aa-a2f6b453a54e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:52.709970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed226764-eebe-471a-b9aa-a2f6b453a54e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:52.999144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ed226764-eebe-471a-b9aa-a2f6b453a54e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:53.037844 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ed226764-eebe-471a-b9aa-a2f6b453a54e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1505 microversion: 2.1 time: 0.351650 Oct 24 10:26:53.049491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5e3bda10-9557-4a8f-86bb-063df56eeca4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:53.055122 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5e3bda10-9557-4a8f-86bb-063df56eeca4 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8" status: 200 len: 1324 microversion: 2.1 time: 0.544193 Oct 24 10:26:53.060062 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 353/738] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:52 2022] GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 => generated 1324 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:53.065528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f1c18cbf-68ee-4a63-95f4-c94a8a6f9112 req-9c7fc4aa-3b6b-4054-9476-14a90fb17817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94278005-1d71-4976-b673-ad2d105385e0", "tag": "9691a054-3d8c-4b1b-b4f4-09af40c934d5"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:53.069109 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 386/739] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:52 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:53.107017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f1c18cbf-68ee-4a63-95f4-c94a8a6f9112 req-9c7fc4aa-3b6b-4054-9476-14a90fb17817 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:53.111397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f1c18cbf-68ee-4a63-95f4-c94a8a6f9112 req-9c7fc4aa-3b6b-4054-9476-14a90fb17817 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:53.112039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f1c18cbf-68ee-4a63-95f4-c94a8a6f9112 req-9c7fc4aa-3b6b-4054-9476-14a90fb17817 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:53.149136 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f1c18cbf-68ee-4a63-95f4-c94a8a6f9112 req-9c7fc4aa-3b6b-4054-9476-14a90fb17817 service nova] Creating event network-changed:9691a054-3d8c-4b1b-b4f4-09af40c934d5 for instance 94278005-1d71-4976-b673-ad2d105385e0 on n-h1-858383-15 Oct 24 10:26:53.162564 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f1c18cbf-68ee-4a63-95f4-c94a8a6f9112 req-9c7fc4aa-3b6b-4054-9476-14a90fb17817 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096533 Oct 24 10:26:53.175931 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 354/740] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:53.465019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-5005183e-e784-48e3-b245-5d893e217801 req-2c7fc103-10cf-42e7-b5a5-0611ad066a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f749f9-5771-4ecb-8a06-30a8f69dd848", "name": "network-vif-plugged", "status": "completed", "tag": "f48a3bd1-58ab-47af-934b-bea589ab9a0b"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:53.491062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5005183e-e784-48e3-b245-5d893e217801 req-2c7fc103-10cf-42e7-b5a5-0611ad066a1f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:53.492146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5005183e-e784-48e3-b245-5d893e217801 req-2c7fc103-10cf-42e7-b5a5-0611ad066a1f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:53.494041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5005183e-e784-48e3-b245-5d893e217801 req-2c7fc103-10cf-42e7-b5a5-0611ad066a1f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:53.512472 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-5005183e-e784-48e3-b245-5d893e217801 req-2c7fc103-10cf-42e7-b5a5-0611ad066a1f service nova] Creating event network-vif-plugged:f48a3bd1-58ab-47af-934b-bea589ab9a0b for instance a8f749f9-5771-4ecb-8a06-30a8f69dd848 on n-h2-858383-15 Oct 24 10:26:53.517642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8dfd8b5a-e49d-498a-8f4b-d24de02ceefe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:53.519154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8dfd8b5a-e49d-498a-8f4b-d24de02ceefe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:53.520501 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-5005183e-e784-48e3-b245-5d893e217801 req-2c7fc103-10cf-42e7-b5a5-0611ad066a1f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062028 Oct 24 10:26:53.522627 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 387/741] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:53.526306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dfd8b5a-e49d-498a-8f4b-d24de02ceefe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:53.526982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dfd8b5a-e49d-498a-8f4b-d24de02ceefe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:53.527422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dfd8b5a-e49d-498a-8f4b-d24de02ceefe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:53.528128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dfd8b5a-e49d-498a-8f4b-d24de02ceefe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:53.528958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dfd8b5a-e49d-498a-8f4b-d24de02ceefe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:53.529550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8dfd8b5a-e49d-498a-8f4b-d24de02ceefe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:53.666078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9cc2d819-5c8e-49db-8e46-1b1442da9d46 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:53.666877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9cc2d819-5c8e-49db-8e46-1b1442da9d46 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:53.693841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cc2d819-5c8e-49db-8e46-1b1442da9d46 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:53.694425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cc2d819-5c8e-49db-8e46-1b1442da9d46 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:53.694857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cc2d819-5c8e-49db-8e46-1b1442da9d46 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:53.697768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cc2d819-5c8e-49db-8e46-1b1442da9d46 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:53.698313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cc2d819-5c8e-49db-8e46-1b1442da9d46 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:53.698756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cc2d819-5c8e-49db-8e46-1b1442da9d46 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:53.741037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9cc2d819-5c8e-49db-8e46-1b1442da9d46 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:26:53.886293 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9cc2d819-5c8e-49db-8e46-1b1442da9d46 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424" status: 204 len: 0 microversion: 2.1 time: 0.226298 Oct 24 10:26:53.887239 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 388/742] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:26:53 2022] DELETE /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 10:26:53.894906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-257fe2a3-1bd0-4015-bd4d-4f1ea060b662 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:53.895786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-257fe2a3-1bd0-4015-bd4d-4f1ea060b662 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:53.898504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8dfd8b5a-e49d-498a-8f4b-d24de02ceefe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:53.902090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:53.904180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-257fe2a3-1bd0-4015-bd4d-4f1ea060b662 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:53.904670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-257fe2a3-1bd0-4015-bd4d-4f1ea060b662 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:53.906228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-257fe2a3-1bd0-4015-bd4d-4f1ea060b662 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:53.907530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-257fe2a3-1bd0-4015-bd4d-4f1ea060b662 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:53.908435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-257fe2a3-1bd0-4015-bd4d-4f1ea060b662 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:53.908908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-257fe2a3-1bd0-4015-bd4d-4f1ea060b662 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:53.910606 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8dfd8b5a-e49d-498a-8f4b-d24de02ceefe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404" status: 200 len: 1315 microversion: 2.1 time: 0.397292 Oct 24 10:26:53.913696 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 355/743] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:53 2022] GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:53.922646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9507d81a-f580-4135-906b-15a8f13eead1 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Calling method '.version_select at 0x7f04d0f5c160>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:53.931349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9507d81a-f580-4135-906b-15a8f13eead1 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:53.933742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9507d81a-f580-4135-906b-15a8f13eead1 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:53.936937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9507d81a-f580-4135-906b-15a8f13eead1 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:53.959471 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9507d81a-f580-4135-906b-15a8f13eead1 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1584 microversion: 2.1 time: 0.042194 Oct 24 10:26:53.960209 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 356/744] 10.222.0.50 () {58 vars in 1143 bytes} [Mon Oct 24 10:26:53 2022] GET /compute/v2.1/os-migrations => generated 1584 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:53.971454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aae511d3-7d16-4895-afda-b40d75d6d486 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:53.975275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aae511d3-7d16-4895-afda-b40d75d6d486 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:53.990365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aae511d3-7d16-4895-afda-b40d75d6d486 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:53.992545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aae511d3-7d16-4895-afda-b40d75d6d486 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:53.993744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aae511d3-7d16-4895-afda-b40d75d6d486 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:53.996926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aae511d3-7d16-4895-afda-b40d75d6d486 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:53.997566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aae511d3-7d16-4895-afda-b40d75d6d486 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:53.998170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aae511d3-7d16-4895-afda-b40d75d6d486 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:54.230846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aae511d3-7d16-4895-afda-b40d75d6d486 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:54.234226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-257fe2a3-1bd0-4015-bd4d-4f1ea060b662 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:54.242829 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-257fe2a3-1bd0-4015-bd4d-4f1ea060b662 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1318 microversion: 2.1 time: 0.354402 Oct 24 10:26:54.244356 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 389/745] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:53 2022] GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:54.248389 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aae511d3-7d16-4895-afda-b40d75d6d486 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424" status: 200 len: 1714 microversion: 2.1 time: 0.279977 Oct 24 10:26:54.249810 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 357/746] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:53 2022] GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 => generated 1714 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:54.255330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6d004d2c-4be6-40ed-8169-722b340a9b40 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:54.257304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e3da60e0-8db4-4309-a341-181e6134f62a tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:54.260045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6d004d2c-4be6-40ed-8169-722b340a9b40 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:54.269214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d004d2c-4be6-40ed-8169-722b340a9b40 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:54.269938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d004d2c-4be6-40ed-8169-722b340a9b40 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:54.270542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d004d2c-4be6-40ed-8169-722b340a9b40 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:54.272355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d004d2c-4be6-40ed-8169-722b340a9b40 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:54.273237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d004d2c-4be6-40ed-8169-722b340a9b40 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:54.273471 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e3da60e0-8db4-4309-a341-181e6134f62a tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028018 Oct 24 10:26:54.274023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d004d2c-4be6-40ed-8169-722b340a9b40 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:54.281606 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 390/747] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:26:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:54.288151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-51181b67-5c75-4cae-b7e0-c475152a8582 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:54.288610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-51181b67-5c75-4cae-b7e0-c475152a8582 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:54.294690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51181b67-5c75-4cae-b7e0-c475152a8582 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:54.295172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51181b67-5c75-4cae-b7e0-c475152a8582 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:54.295890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51181b67-5c75-4cae-b7e0-c475152a8582 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:54.296515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51181b67-5c75-4cae-b7e0-c475152a8582 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:54.297006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51181b67-5c75-4cae-b7e0-c475152a8582 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:54.297428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51181b67-5c75-4cae-b7e0-c475152a8582 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:54.312902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:54.525163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-51181b67-5c75-4cae-b7e0-c475152a8582 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:54.532860 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-51181b67-5c75-4cae-b7e0-c475152a8582 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8" status: 200 len: 1324 microversion: 2.1 time: 0.250147 Oct 24 10:26:54.533820 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 391/748] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:54 2022] GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 => generated 1324 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:54.539026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f8029836-1ccc-4d93-84d3-0cd0bde9ca81 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-736689442", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:54.560138 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f8029836-1ccc-4d93-84d3-0cd0bde9ca81 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.025133 Oct 24 10:26:54.560871 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 392/749] 10.222.0.50 () {60 vars in 1146 bytes} [Mon Oct 24 10:26:54 2022] POST /compute/v2.1/flavors => generated 498 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:54.566031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6d004d2c-4be6-40ed-8169-722b340a9b40 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:54.575984 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6d004d2c-4be6-40ed-8169-722b340a9b40 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1505 microversion: 2.1 time: 0.324945 Oct 24 10:26:54.576748 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 358/750] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:54 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:54.582984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-63791a9c-3653-4fa3-a5b5-210578476001 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:54.590572 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-63791a9c-3653-4fa3-a5b5-210578476001 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011790 Oct 24 10:26:54.591152 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 359/751] 10.222.0.50 () {58 vars in 1182 bytes} [Mon Oct 24 10:26:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:26:54.780305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0c1ec0ca-f7ce-4750-9b34-14923bc6dfe8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1270959768", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "e638442e-1d17-423c-8a72-107bfe635574"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:54.830029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9b8952b0-e4ae-485e-ab28-a943c34ef35f tempest-InstanceUsageAuditLogNegativeTestJSON-120874156 tempest-InstanceUsageAuditLogNegativeTestJSON-120874156-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:54.833104 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-9b8952b0-e4ae-485e-ab28-a943c34ef35f tempest-InstanceUsageAuditLogNegativeTestJSON-120874156 tempest-InstanceUsageAuditLogNegativeTestJSON-120874156-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 24 10:26:54.839497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-0c1ec0ca-f7ce-4750-9b34-14923bc6dfe8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] validate_networks() for None {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9b8952b0-e4ae-485e-ab28-a943c34ef35f tempest-InstanceUsageAuditLogNegativeTestJSON-120874156 tempest-InstanceUsageAuditLogNegativeTestJSON-120874156-project-admin] Request method failure captured: Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmhu5ZPQ3jWBowTsjdIj9kG8wsC-19_NNiBRw3LzC6nUmSO_cgLb29huyo8S64Yu8GDz-bd5VeYVd62k_dqNp5pfFA7eOvp0etZrE86EVIxmQBjMPLZJu9FW-FTYKvauilwwNRBxSiz7OPPn0ZsiKrSz2UEMJdFBitliFE8d6qev7qs Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: a60101b5deed41118485a3a9a1310a43 Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-120874156 Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:26:54.843555 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:26:54.845076 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a60101b5deed41118485a3a9a1310a43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a60101b5deed41118485a3a9a1310a43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a60101b5deed41118485a3a9a1310a43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a60101b5deed41118485a3a9a1310a43", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:54.845076 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-120874156 Oct 24 10:26:54.845076 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: a60101b5deed41118485a3a9a1310a43 Oct 24 10:26:54.845076 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-120874156 Oct 24 10:26:54.845076 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-120874156-project-admin Oct 24 10:26:54.845076 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:26:54.845076 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:26:54.845076 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 93f5b574e67d4322a9002082ee40e1cb Oct 24 10:26:54.845076 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-120874156-project-admin Oct 24 10:26:54.845076 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:26:54.845076 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid timestamp for date invalid_time Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'invalid_time'} Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:54.845779 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:54.846954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 24 10:26:54.846954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 24 10:26:54.846954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 24 10:26:54.846954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:54.846954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:54.846954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:54.846954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:54.846954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:54.846954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:54.846954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:54.846954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:54.846954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 24 10:26:54.846954 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:54.846954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9b8952b0-e4ae-485e-ab28-a943c34ef35f tempest-InstanceUsageAuditLogNegativeTestJSON-120874156 tempest-InstanceUsageAuditLogNegativeTestJSON-120874156-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:54.846954 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9b8952b0-e4ae-485e-ab28-a943c34ef35f tempest-InstanceUsageAuditLogNegativeTestJSON-120874156 tempest-InstanceUsageAuditLogNegativeTestJSON-120874156-project-admin] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.282501 Oct 24 10:26:54.847930 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 393/752] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Oct 24 10:26:54 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 285 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 10:26:54.973926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-33c6f086-80cf-4189-983f-f69aa01942c1 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:54.976603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-33c6f086-80cf-4189-983f-f69aa01942c1 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'e3c83384a1f44462a8067f7da21cadbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4c0fb41dc0b46babbab150bcd9bc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-33c6f086-80cf-4189-983f-f69aa01942c1 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620-project] Request method failure captured: Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmhtzPuDHm1UrU3ibsBsVFRUIX0l15d39QCOpSZtyoQRgDny92zYTEoLe1l1TgMDidSmEGualpxJw1HYfW7bYxdkHoVThxtF_-lQNXamJgSrH_cgoW7gRDOiQe-wHGAuERtb6y5Xrqw8P7Tha1mGFsREBOM4SP9KPmDX_6EO3ikDZXY Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: d4c0fb41dc0b46babbab150bcd9bc637 Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620 Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:26:54.978339 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:26:54.979824 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d4c0fb41dc0b46babbab150bcd9bc637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d4c0fb41dc0b46babbab150bcd9bc637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d4c0fb41dc0b46babbab150bcd9bc637"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d4c0fb41dc0b46babbab150bcd9bc637", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:54.979824 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620 Oct 24 10:26:54.979824 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: d4c0fb41dc0b46babbab150bcd9bc637 Oct 24 10:26:54.979824 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620 Oct 24 10:26:54.979824 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620-project Oct 24 10:26:54.979824 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:26:54.979824 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:26:54.979824 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: e3c83384a1f44462a8067f7da21cadbe Oct 24 10:26:54.979824 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620-project Oct 24 10:26:54.979824 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: action_args: {} Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:26:54.980570 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:26:54.982147 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:26:54.982147 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:26:54.982147 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:26:54.982147 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:26:54.982147 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:26:54.982147 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:26:54.982147 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 24 10:26:54.982147 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:54.982147 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:54.982147 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:54.982147 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:54.982147 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:54.982147 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:54.982147 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:26:54.982147 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:26:54.982147 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 24 10:26:54.982147 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:54.984251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-33c6f086-80cf-4189-983f-f69aa01942c1 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:54.985412 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-33c6f086-80cf-4189-983f-f69aa01942c1 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620-project] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.133936 Oct 24 10:26:54.989739 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 394/753] 10.222.0.50 () {58 vars in 1185 bytes} [Mon Oct 24 10:26:54 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 139 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:26:54.997588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-40664050-127f-487c-80ce-2fc74cd2b0b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:54.998201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-40664050-127f-487c-80ce-2fc74cd2b0b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:55.004408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40664050-127f-487c-80ce-2fc74cd2b0b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:55.004937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40664050-127f-487c-80ce-2fc74cd2b0b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:55.005364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40664050-127f-487c-80ce-2fc74cd2b0b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:55.006461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40664050-127f-487c-80ce-2fc74cd2b0b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:55.006953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40664050-127f-487c-80ce-2fc74cd2b0b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:55.007551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40664050-127f-487c-80ce-2fc74cd2b0b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:55.138848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0c1ec0ca-f7ce-4750-9b34-14923bc6dfe8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:26:55.139397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0c1ec0ca-f7ce-4750-9b34-14923bc6dfe8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:26:55.139968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0c1ec0ca-f7ce-4750-9b34-14923bc6dfe8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:26:55.140469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0c1ec0ca-f7ce-4750-9b34-14923bc6dfe8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:26:55.141032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0c1ec0ca-f7ce-4750-9b34-14923bc6dfe8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:26:55.151236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c1ec0ca-f7ce-4750-9b34-14923bc6dfe8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:55.151841 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c1ec0ca-f7ce-4750-9b34-14923bc6dfe8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:55.152451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c1ec0ca-f7ce-4750-9b34-14923bc6dfe8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:55.153365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c1ec0ca-f7ce-4750-9b34-14923bc6dfe8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:55.153813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c1ec0ca-f7ce-4750-9b34-14923bc6dfe8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:55.154408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c1ec0ca-f7ce-4750-9b34-14923bc6dfe8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:55.171899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0c1ec0ca-f7ce-4750-9b34-14923bc6dfe8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Getting quotas for project ac5f703504204b91a5c7e895964ec985. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:26:55.177109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0c1ec0ca-f7ce-4750-9b34-14923bc6dfe8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Getting quotas for user b684c865fc9e4abb8e0e55616087b92e and project ac5f703504204b91a5c7e895964ec985. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:26:55.190283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0c1ec0ca-f7ce-4750-9b34-14923bc6dfe8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:26:55.192575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0c1ec0ca-f7ce-4750-9b34-14923bc6dfe8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:26:55.192896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-40664050-127f-487c-80ce-2fc74cd2b0b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:55.201465 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-40664050-127f-487c-80ce-2fc74cd2b0b2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404" status: 200 len: 1465 microversion: 2.1 time: 0.207889 Oct 24 10:26:55.202032 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 395/754] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:54 2022] GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 => generated 1465 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:55.207127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ca5f7f14-4bba-4b68-bce5-bb227f1fe565 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:55.209280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ca5f7f14-4bba-4b68-bce5-bb227f1fe565 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'e3c83384a1f44462a8067f7da21cadbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4c0fb41dc0b46babbab150bcd9bc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ca5f7f14-4bba-4b68-bce5-bb227f1fe565 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620-project] Request method failure captured: Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-24%2010:26:54 HTTP/1.1 Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmhtzPuDHm1UrU3ibsBsVFRUIX0l15d39QCOpSZtyoQRgDny92zYTEoLe1l1TgMDidSmEGualpxJw1HYfW7bYxdkHoVThxtF_-lQNXamJgSrH_cgoW7gRDOiQe-wHGAuERtb6y5Xrqw8P7Tha1mGFsREBOM4SP9KPmDX_6EO3ikDZXY Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: d4c0fb41dc0b46babbab150bcd9bc637 Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620 Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:26:55.211129 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:26:55.212612 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d4c0fb41dc0b46babbab150bcd9bc637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d4c0fb41dc0b46babbab150bcd9bc637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d4c0fb41dc0b46babbab150bcd9bc637"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d4c0fb41dc0b46babbab150bcd9bc637", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:55.212612 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620 Oct 24 10:26:55.212612 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: d4c0fb41dc0b46babbab150bcd9bc637 Oct 24 10:26:55.212612 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620 Oct 24 10:26:55.212612 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620-project Oct 24 10:26:55.212612 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:26:55.212612 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:26:55.212612 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: e3c83384a1f44462a8067f7da21cadbe Oct 24 10:26:55.212612 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620-project Oct 24 10:26:55.212612 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '2022-10-24 10:26:54'} Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:26:55.213240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:26:55.214371 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:26:55.214371 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:26:55.214371 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:26:55.214371 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:26:55.214371 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:26:55.214371 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:26:55.214371 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 24 10:26:55.214371 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:55.214371 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:55.214371 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:55.214371 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:55.214371 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:55.214371 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:55.214371 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:26:55.214371 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:26:55.214371 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 24 10:26:55.214371 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:26:55.216730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ca5f7f14-4bba-4b68-bce5-bb227f1fe565 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:55.217802 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ca5f7f14-4bba-4b68-bce5-bb227f1fe565 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620 tempest-InstanceUsageAuditLogNegativeTestJSON-2009340620-project] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-24 10:26:54" status: 403 len: 128 microversion: 2.1 time: 0.014704 Oct 24 10:26:55.218639 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 396/755] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Oct 24 10:26:55 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-24%2010%3A26%3A54 => generated 128 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:26:55.252926 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0c1ec0ca-f7ce-4750-9b34-14923bc6dfe8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.476411 Oct 24 10:26:55.253775 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 360/756] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 10:26:55.266684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f396c74b-7954-40fb-91f1-6f953f26277d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:55.267577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f396c74b-7954-40fb-91f1-6f953f26277d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:55.270855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=5 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:55.341662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f396c74b-7954-40fb-91f1-6f953f26277d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:55.353995 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f396c74b-7954-40fb-91f1-6f953f26277d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1279 microversion: 2.1 time: 0.090935 Oct 24 10:26:55.354839 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 361/757] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:55 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1279 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:55.360731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7dd272c9-7460-44a7-8ee2-08431d41eba0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:55.362125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7dd272c9-7460-44a7-8ee2-08431d41eba0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:55.369982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dd272c9-7460-44a7-8ee2-08431d41eba0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:55.370731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dd272c9-7460-44a7-8ee2-08431d41eba0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:55.371168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dd272c9-7460-44a7-8ee2-08431d41eba0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:55.371867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dd272c9-7460-44a7-8ee2-08431d41eba0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:55.372319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dd272c9-7460-44a7-8ee2-08431d41eba0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:55.372943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dd272c9-7460-44a7-8ee2-08431d41eba0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:55.539151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7dd272c9-7460-44a7-8ee2-08431d41eba0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:55.547418 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7dd272c9-7460-44a7-8ee2-08431d41eba0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1318 microversion: 2.1 time: 0.191183 Oct 24 10:26:55.550654 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 362/758] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:55 2022] GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:55.555912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fb6d7613-c4be-4eb2-b308-593d4c960428 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:55.556793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fb6d7613-c4be-4eb2-b308-593d4c960428 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:55.563368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb6d7613-c4be-4eb2-b308-593d4c960428 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:55.564120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb6d7613-c4be-4eb2-b308-593d4c960428 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:55.564825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb6d7613-c4be-4eb2-b308-593d4c960428 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:55.565770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb6d7613-c4be-4eb2-b308-593d4c960428 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:55.566451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb6d7613-c4be-4eb2-b308-593d4c960428 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:55.567849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb6d7613-c4be-4eb2-b308-593d4c960428 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:55.573777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-68d8a35d-9fdc-4eaa-8910-dd9206e97ef5 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:55.574461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-68d8a35d-9fdc-4eaa-8910-dd9206e97ef5 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:55.582128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68d8a35d-9fdc-4eaa-8910-dd9206e97ef5 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:55.582625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68d8a35d-9fdc-4eaa-8910-dd9206e97ef5 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:55.583223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68d8a35d-9fdc-4eaa-8910-dd9206e97ef5 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:55.584872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68d8a35d-9fdc-4eaa-8910-dd9206e97ef5 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:55.585594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68d8a35d-9fdc-4eaa-8910-dd9206e97ef5 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:55.586129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68d8a35d-9fdc-4eaa-8910-dd9206e97ef5 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:55.780694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fb6d7613-c4be-4eb2-b308-593d4c960428 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:55.790845 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fb6d7613-c4be-4eb2-b308-593d4c960428 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424" status: 200 len: 1714 microversion: 2.1 time: 0.238838 Oct 24 10:26:55.791919 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 363/759] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:55 2022] GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 => generated 1714 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:55.980068 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-68d8a35d-9fdc-4eaa-8910-dd9206e97ef5 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404" status: 200 len: 1618 microversion: 2.1 time: 0.759425 Oct 24 10:26:55.981463 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 397/760] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:55 2022] GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 => generated 1618 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:55.987305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9197ae9c-3085-45d7-a90b-fde10de3c463 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:55.988075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9197ae9c-3085-45d7-a90b-fde10de3c463 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:55.998723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9197ae9c-3085-45d7-a90b-fde10de3c463 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:55.999443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9197ae9c-3085-45d7-a90b-fde10de3c463 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:56.000138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9197ae9c-3085-45d7-a90b-fde10de3c463 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:56.001010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9197ae9c-3085-45d7-a90b-fde10de3c463 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:56.001658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9197ae9c-3085-45d7-a90b-fde10de3c463 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:56.002294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9197ae9c-3085-45d7-a90b-fde10de3c463 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:56.092441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3ca3ecba-960d-4aca-8d0c-b3c7660af9b3 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] Calling method '.version_select at 0x7f04d1018b80>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:56.120084 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-3ca3ecba-960d-4aca-8d0c-b3c7660af9b3 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] HTTP exception thrown: Image not found. Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3ca3ecba-960d-4aca-8d0c-b3c7660af9b3 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] Request method failure captured: Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/images/2b3709a7-e015-43e6-8305-a0314a5bb7f8/metadata/os_distro HTTP/1.1 Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmhv9wkot7CVim9P5AVg-ocbBcm8_H6lKbXRxm8WS633d0IoDmzeO_mXplXl8BZtKz2Eav9woJMuo28dz_YXMJavSepCj8gpjFyKNaZEEbv386YZUt2gj7rpLUF-8_ZFcoIg06Js-Tm4gsAfR8TyZvn873o2QowcNpEiPPtfbt7U7HY Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: f7663c0f618e4ada9bc2f35c1ea4e7f6 Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-193024736 Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:26:56.144625 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:26:56.146475 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f7663c0f618e4ada9bc2f35c1ea4e7f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f7663c0f618e4ada9bc2f35c1ea4e7f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f7663c0f618e4ada9bc2f35c1ea4e7f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f7663c0f618e4ada9bc2f35c1ea4e7f6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:56.146475 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-193024736 Oct 24 10:26:56.146475 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: f7663c0f618e4ada9bc2f35c1ea4e7f6 Oct 24 10:26:56.146475 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-193024736 Oct 24 10:26:56.146475 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesMetadataNegativeTestJSON-193024736-project Oct 24 10:26:56.146475 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:26:56.146475 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:26:56.146475 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5eb5f6f1c060474886174220746f788c Oct 24 10:26:56.146475 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-193024736-project Oct 24 10:26:56.146475 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:26:56.146475 n-d-858383-15 devstack@n-api.service[120425]: exception: Image not found. Oct 24 10:26:56.146475 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'image_id': '2b3709a7-e015-43e6-8305-a0314a5bb7f8', 'id': 'os_distro'} Oct 24 10:26:56.146475 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:56.147418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.147418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:26:56.147418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:26:56.147418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:26:56.147418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:26:56.147418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:26:56.147418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:26:56.147418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:26:56.147418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:26:56.147418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:26:56.147418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:26:56.147418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:26:56.147418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:26:56.147418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:26:56.147418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:26:56.147418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:26:56.147418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:26:56.147418 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2b3709a7-e015-43e6-8305-a0314a5bb7f8 Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:26:56.148725 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2b3709a7-e015-43e6-8305-a0314a5bb7f8 could not be found. Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:26:56.150228 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:26:56.151456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:56.151456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:56.151456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 24 10:26:56.151456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 24 10:26:56.151456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 24 10:26:56.151456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 10:26:56.151456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:26:56.151456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.151456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:56.151456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.151456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.151456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:56.151456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:56.151456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:56.151456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:56.151456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:26:56.151456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.154676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3ca3ecba-960d-4aca-8d0c-b3c7660af9b3 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] Returning 404 to user: Image not found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:56.156480 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3ca3ecba-960d-4aca-8d0c-b3c7660af9b3 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] 10.222.0.50 "DELETE /compute/v2.1/images/2b3709a7-e015-43e6-8305-a0314a5bb7f8/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.362845 Oct 24 10:26:56.164525 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 364/761] 10.222.0.50 () {58 vars in 1293 bytes} [Mon Oct 24 10:26:55 2022] DELETE /compute/v2.1/images/2b3709a7-e015-43e6-8305-a0314a5bb7f8/metadata/os_distro => generated 62 bytes in 364 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:26:56.165136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9197ae9c-3085-45d7-a90b-fde10de3c463 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:56.167881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8fb2de2c-3a26-490a-97de-c8e192a96e72 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:56.169745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8fb2de2c-3a26-490a-97de-c8e192a96e72 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:56.173975 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9197ae9c-3085-45d7-a90b-fde10de3c463 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8" status: 200 len: 1324 microversion: 2.1 time: 0.190973 Oct 24 10:26:56.175134 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 398/762] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:55 2022] GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 => generated 1324 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:56.179750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb2de2c-3a26-490a-97de-c8e192a96e72 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:56.180321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb2de2c-3a26-490a-97de-c8e192a96e72 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:56.181060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb2de2c-3a26-490a-97de-c8e192a96e72 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:56.181845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb2de2c-3a26-490a-97de-c8e192a96e72 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:56.182375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb2de2c-3a26-490a-97de-c8e192a96e72 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:56.183012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb2de2c-3a26-490a-97de-c8e192a96e72 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:56.190762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d0e9775c-692d-4bbf-8707-077a77871d97 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Action: 'create', calling method: .version_select at 0x7f04d0efd550>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1925805086", "policies": ["affinity"]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:56.235457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d0e9775c-692d-4bbf-8707-077a77871d97 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for project b565572c0c8c4871af02471a328bd1af. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:26:56.241608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d0e9775c-692d-4bbf-8707-077a77871d97 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for user 9aa572f1e5014e10bed0abe34dfad43f and project b565572c0c8c4871af02471a328bd1af. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:26:56.314744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d0e9775c-692d-4bbf-8707-077a77871d97 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for project b565572c0c8c4871af02471a328bd1af. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:26:56.321081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d0e9775c-692d-4bbf-8707-077a77871d97 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for user 9aa572f1e5014e10bed0abe34dfad43f and project b565572c0c8c4871af02471a328bd1af. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:26:56.335547 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d0e9775c-692d-4bbf-8707-077a77871d97 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.149137 Oct 24 10:26:56.336170 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 399/763] 10.222.0.50 () {60 vars in 1174 bytes} [Mon Oct 24 10:26:56 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:56.341292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-6e4e3599-f708-4419-aad1-a9ed4e56397b req-20a8e27e-f4a7-4d51-b933-e7603fab719f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4889ce-5a69-43f8-856a-a51289323fa8", "name": "network-vif-plugged", "status": "completed", "tag": "9102e5e7-84d8-4adf-b9b1-351fa06523c7"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:56.351411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8fb2de2c-3a26-490a-97de-c8e192a96e72 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:56.351628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6e4e3599-f708-4419-aad1-a9ed4e56397b req-20a8e27e-f4a7-4d51-b933-e7603fab719f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:56.352104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6e4e3599-f708-4419-aad1-a9ed4e56397b req-20a8e27e-f4a7-4d51-b933-e7603fab719f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:56.352530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6e4e3599-f708-4419-aad1-a9ed4e56397b req-20a8e27e-f4a7-4d51-b933-e7603fab719f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:56.361345 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8fb2de2c-3a26-490a-97de-c8e192a96e72 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1505 microversion: 2.1 time: 0.203041 Oct 24 10:26:56.361926 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 365/764] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:56 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:56.368149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a1416d89-a1fd-4bf3-8b85-2d49c5380065 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] Calling method '.version_select at 0x7f04d1018af0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:56.377057 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-6e4e3599-f708-4419-aad1-a9ed4e56397b req-20a8e27e-f4a7-4d51-b933-e7603fab719f service nova] Creating event network-vif-plugged:9102e5e7-84d8-4adf-b9b1-351fa06523c7 for instance 2c4889ce-5a69-43f8-856a-a51289323fa8 on n-h1-858383-15 Oct 24 10:26:56.384096 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-6e4e3599-f708-4419-aad1-a9ed4e56397b req-20a8e27e-f4a7-4d51-b933-e7603fab719f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046681 Oct 24 10:26:56.385413 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 400/765] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:26:56.390841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d6cabedb-98af-4e3c-9c34-1f0099708356 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:56.391655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d6cabedb-98af-4e3c-9c34-1f0099708356 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:56.395705 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-a1416d89-a1fd-4bf3-8b85-2d49c5380065 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] HTTP exception thrown: Image not found. Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a1416d89-a1fd-4bf3-8b85-2d49c5380065 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] Request method failure captured: Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/images/26e70e4b-2c61-442e-ae83-56f9346e8c85/metadata/os_version HTTP/1.1 Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmhv9wkot7CVim9P5AVg-ocbBcm8_H6lKbXRxm8WS633d0IoDmzeO_mXplXl8BZtKz2Eav9woJMuo28dz_YXMJavSepCj8gpjFyKNaZEEbv386YZUt2gj7rpLUF-8_ZFcoIg06Js-Tm4gsAfR8TyZvn873o2QowcNpEiPPtfbt7U7HY Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: f7663c0f618e4ada9bc2f35c1ea4e7f6 Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-193024736 Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:26:56.398704 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:26:56.399972 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f7663c0f618e4ada9bc2f35c1ea4e7f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f7663c0f618e4ada9bc2f35c1ea4e7f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f7663c0f618e4ada9bc2f35c1ea4e7f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f7663c0f618e4ada9bc2f35c1ea4e7f6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:56.399972 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-193024736 Oct 24 10:26:56.399972 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: f7663c0f618e4ada9bc2f35c1ea4e7f6 Oct 24 10:26:56.399972 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-193024736 Oct 24 10:26:56.399972 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesMetadataNegativeTestJSON-193024736-project Oct 24 10:26:56.399972 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:26:56.399972 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:26:56.399972 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5eb5f6f1c060474886174220746f788c Oct 24 10:26:56.399972 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-193024736-project Oct 24 10:26:56.399972 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:26:56.399972 n-d-858383-15 devstack@n-api.service[120425]: exception: Image not found. Oct 24 10:26:56.399972 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'image_id': '26e70e4b-2c61-442e-ae83-56f9346e8c85', 'id': 'os_version'} Oct 24 10:26:56.399972 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:56.400734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.400734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:26:56.400734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:26:56.400734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:26:56.400734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:26:56.400734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:26:56.400734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:26:56.400734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:26:56.400734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:26:56.400734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:26:56.400734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:26:56.400734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:26:56.400734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:26:56.400734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:26:56.400734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:26:56.400734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:26:56.400734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:26:56.400734 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 26e70e4b-2c61-442e-ae83-56f9346e8c85 Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:26:56.401806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 26e70e4b-2c61-442e-ae83-56f9346e8c85 could not be found. Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:26:56.403017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:26:56.404185 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:56.404185 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:56.404185 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 24 10:26:56.404185 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 24 10:26:56.404185 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 24 10:26:56.404185 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 10:26:56.404185 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:26:56.404185 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.404185 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:56.404185 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.404185 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.404185 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:56.404185 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:56.404185 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:56.404185 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:56.404185 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:26:56.404185 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.407153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6cabedb-98af-4e3c-9c34-1f0099708356 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:56.407153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6cabedb-98af-4e3c-9c34-1f0099708356 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:56.407153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6cabedb-98af-4e3c-9c34-1f0099708356 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:56.407153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6cabedb-98af-4e3c-9c34-1f0099708356 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:56.407689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6cabedb-98af-4e3c-9c34-1f0099708356 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:56.407689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6cabedb-98af-4e3c-9c34-1f0099708356 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:56.409061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a1416d89-a1fd-4bf3-8b85-2d49c5380065 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] Returning 404 to user: Image not found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:56.409616 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a1416d89-a1fd-4bf3-8b85-2d49c5380065 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] 10.222.0.50 "GET /compute/v2.1/images/26e70e4b-2c61-442e-ae83-56f9346e8c85/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.046535 Oct 24 10:26:56.410174 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 366/766] 10.222.0.50 () {58 vars in 1293 bytes} [Mon Oct 24 10:26:56 2022] GET /compute/v2.1/images/26e70e4b-2c61-442e-ae83-56f9346e8c85/metadata/os_version => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:26:56.421689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d4576287-9782-48a0-bcc7-67ea820ef1a3 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] Calling method '.version_select at 0x7f04d0f5c9d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:56.451931 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-d4576287-9782-48a0-bcc7-67ea820ef1a3 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] HTTP exception thrown: Image not found. Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d4576287-9782-48a0-bcc7-67ea820ef1a3 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] Request method failure captured: Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/images/bd03cb7f-f38d-4b11-95d2-d1721f672f95/metadata HTTP/1.1 Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmhv9wkot7CVim9P5AVg-ocbBcm8_H6lKbXRxm8WS633d0IoDmzeO_mXplXl8BZtKz2Eav9woJMuo28dz_YXMJavSepCj8gpjFyKNaZEEbv386YZUt2gj7rpLUF-8_ZFcoIg06Js-Tm4gsAfR8TyZvn873o2QowcNpEiPPtfbt7U7HY Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: f7663c0f618e4ada9bc2f35c1ea4e7f6 Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-193024736 Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:26:56.457824 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:26:56.460398 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f7663c0f618e4ada9bc2f35c1ea4e7f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f7663c0f618e4ada9bc2f35c1ea4e7f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f7663c0f618e4ada9bc2f35c1ea4e7f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f7663c0f618e4ada9bc2f35c1ea4e7f6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:56.460398 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-193024736 Oct 24 10:26:56.460398 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: f7663c0f618e4ada9bc2f35c1ea4e7f6 Oct 24 10:26:56.460398 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-193024736 Oct 24 10:26:56.460398 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesMetadataNegativeTestJSON-193024736-project Oct 24 10:26:56.460398 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:26:56.460398 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:26:56.460398 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5eb5f6f1c060474886174220746f788c Oct 24 10:26:56.460398 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-193024736-project Oct 24 10:26:56.460398 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:26:56.460398 n-d-858383-15 devstack@n-api.service[120425]: exception: Image not found. Oct 24 10:26:56.460398 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'image_id': 'bd03cb7f-f38d-4b11-95d2-d1721f672f95'} Oct 24 10:26:56.460398 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:56.461796 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.461796 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:26:56.461796 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:26:56.461796 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:26:56.461796 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:26:56.461796 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:26:56.461796 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:26:56.461796 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:26:56.461796 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:26:56.461796 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:26:56.461796 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:26:56.461796 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:26:56.461796 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:26:56.461796 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:26:56.461796 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:26:56.461796 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:26:56.461796 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:26:56.461796 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bd03cb7f-f38d-4b11-95d2-d1721f672f95 Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:26:56.463752 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bd03cb7f-f38d-4b11-95d2-d1721f672f95 could not be found. Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:26:56.465230 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:26:56.468286 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:56.468286 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:56.468286 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 24 10:26:56.468286 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 24 10:26:56.468286 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 24 10:26:56.468286 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 10:26:56.468286 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:26:56.468286 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.468286 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:56.468286 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.468286 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.468286 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:56.468286 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:56.468286 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:56.468286 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:56.468286 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:26:56.468286 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.468286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d4576287-9782-48a0-bcc7-67ea820ef1a3 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] Returning 404 to user: Image not found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:56.471287 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d4576287-9782-48a0-bcc7-67ea820ef1a3 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] 10.222.0.50 "GET /compute/v2.1/images/bd03cb7f-f38d-4b11-95d2-d1721f672f95/metadata" status: 404 len: 62 microversion: 2.1 time: 0.044266 Oct 24 10:26:56.471287 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 367/767] 10.222.0.50 () {58 vars in 1260 bytes} [Mon Oct 24 10:26:56 2022] GET /compute/v2.1/images/bd03cb7f-f38d-4b11-95d2-d1721f672f95/metadata => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:26:56.475258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-329eee36-2362-4303-8712-3267e246410f tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] Action: 'update_all', calling method: .version_select at 0x7f04d0f5cb80>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:56.491737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d6cabedb-98af-4e3c-9c34-1f0099708356 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:56.502993 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d6cabedb-98af-4e3c-9c34-1f0099708356 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1283 microversion: 2.1 time: 0.116374 Oct 24 10:26:56.511996 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 401/768] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:56 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1283 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:56.511996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2037152025", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "06e41963-2e3b-471c-80dc-b907a8cef0a2"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:56.513632 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-329eee36-2362-4303-8712-3267e246410f tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] HTTP exception thrown: Image not found. Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-329eee36-2362-4303-8712-3267e246410f tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] Request method failure captured: Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: request: PUT /compute/v2.1/images/2f23ebf6-8681-4598-881c-1257ed3bd46a/metadata HTTP/1.1 Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 57 Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmhv9wkot7CVim9P5AVg-ocbBcm8_H6lKbXRxm8WS633d0IoDmzeO_mXplXl8BZtKz2Eav9woJMuo28dz_YXMJavSepCj8gpjFyKNaZEEbv386YZUt2gj7rpLUF-8_ZFcoIg06Js-Tm4gsAfR8TyZvn873o2QowcNpEiPPtfbt7U7HY Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: f7663c0f618e4ada9bc2f35c1ea4e7f6 Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-193024736 Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:26:56.521892 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:26:56.523761 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f7663c0f618e4ada9bc2f35c1ea4e7f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f7663c0f618e4ada9bc2f35c1ea4e7f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f7663c0f618e4ada9bc2f35c1ea4e7f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f7663c0f618e4ada9bc2f35c1ea4e7f6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:56.523761 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-193024736 Oct 24 10:26:56.523761 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: f7663c0f618e4ada9bc2f35c1ea4e7f6 Oct 24 10:26:56.523761 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-193024736 Oct 24 10:26:56.523761 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesMetadataNegativeTestJSON-193024736-project Oct 24 10:26:56.523761 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:26:56.523761 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:26:56.523761 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5eb5f6f1c060474886174220746f788c Oct 24 10:26:56.523761 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-193024736-project Oct 24 10:26:56.523761 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:26:56.523761 n-d-858383-15 devstack@n-api.service[120425]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 24 10:26:56.523761 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:26:56.523761 n-d-858383-15 devstack@n-api.service[120425]: exception: Image not found. Oct 24 10:26:56.523761 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'image_id': '2f23ebf6-8681-4598-881c-1257ed3bd46a', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 24 10:26:56.524753 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:56.524753 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.524753 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:26:56.524753 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:26:56.524753 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:26:56.524753 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:26:56.524753 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:26:56.524753 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:26:56.524753 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:26:56.524753 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:26:56.524753 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:26:56.524753 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:26:56.524753 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:26:56.524753 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:26:56.524753 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:26:56.524753 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:26:56.524753 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:26:56.524753 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2f23ebf6-8681-4598-881c-1257ed3bd46a Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:26:56.529045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2f23ebf6-8681-4598-881c-1257ed3bd46a could not be found. Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:56.531202 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:26:56.533395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.535788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-329eee36-2362-4303-8712-3267e246410f tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] Returning 404 to user: Image not found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:56.535788 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-329eee36-2362-4303-8712-3267e246410f tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] 10.222.0.50 "PUT /compute/v2.1/images/2f23ebf6-8681-4598-881c-1257ed3bd46a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.049700 Oct 24 10:26:56.535788 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 368/769] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:26:56 2022] PUT /compute/v2.1/images/2f23ebf6-8681-4598-881c-1257ed3bd46a/metadata => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 24 10:26:56.535788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-46f12dd8-2c8c-4759-a0b6-7ba7fd77cf6d tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] Action: 'update', calling method: .version_select at 0x7f04d127e820>, body: {"meta": {"os_distro": "alt"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:56.556006 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-46f12dd8-2c8c-4759-a0b6-7ba7fd77cf6d tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] HTTP exception thrown: Image not found. Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-46f12dd8-2c8c-4759-a0b6-7ba7fd77cf6d tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] Request method failure captured: Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: request: PUT /compute/v2.1/images/1efe38a6-95d1-4ba1-b789-fcb89af303b8/metadata/os_distro HTTP/1.1 Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 30 Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmhv9wkot7CVim9P5AVg-ocbBcm8_H6lKbXRxm8WS633d0IoDmzeO_mXplXl8BZtKz2Eav9woJMuo28dz_YXMJavSepCj8gpjFyKNaZEEbv386YZUt2gj7rpLUF-8_ZFcoIg06Js-Tm4gsAfR8TyZvn873o2QowcNpEiPPtfbt7U7HY Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: f7663c0f618e4ada9bc2f35c1ea4e7f6 Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-193024736 Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:26:56.558178 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:26:56.559602 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f7663c0f618e4ada9bc2f35c1ea4e7f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f7663c0f618e4ada9bc2f35c1ea4e7f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f7663c0f618e4ada9bc2f35c1ea4e7f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f7663c0f618e4ada9bc2f35c1ea4e7f6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:56.559602 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-193024736 Oct 24 10:26:56.559602 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: f7663c0f618e4ada9bc2f35c1ea4e7f6 Oct 24 10:26:56.559602 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-193024736 Oct 24 10:26:56.559602 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesMetadataNegativeTestJSON-193024736-project Oct 24 10:26:56.559602 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:26:56.559602 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:26:56.559602 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5eb5f6f1c060474886174220746f788c Oct 24 10:26:56.559602 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-193024736-project Oct 24 10:26:56.559602 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:26:56.559602 n-d-858383-15 devstack@n-api.service[120425]: {"meta": {"os_distro": "alt"}} Oct 24 10:26:56.559602 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:26:56.559602 n-d-858383-15 devstack@n-api.service[120425]: exception: Image not found. Oct 24 10:26:56.559602 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'image_id': '1efe38a6-95d1-4ba1-b789-fcb89af303b8', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 24 10:26:56.560704 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:56.560704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.560704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:26:56.560704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:26:56.560704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:26:56.560704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:26:56.560704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:26:56.560704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:26:56.560704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:26:56.560704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:26:56.560704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:26:56.560704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:26:56.560704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:26:56.560704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:26:56.560704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:26:56.560704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:26:56.560704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:26:56.560704 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1efe38a6-95d1-4ba1-b789-fcb89af303b8 Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:26:56.561852 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1efe38a6-95d1-4ba1-b789-fcb89af303b8 could not be found. Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:56.563387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:26:56.565431 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.568872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-46f12dd8-2c8c-4759-a0b6-7ba7fd77cf6d tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] Returning 404 to user: Image not found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:56.568872 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-46f12dd8-2c8c-4759-a0b6-7ba7fd77cf6d tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] 10.222.0.50 "PUT /compute/v2.1/images/1efe38a6-95d1-4ba1-b789-fcb89af303b8/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.034662 Oct 24 10:26:56.568872 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 369/770] 10.222.0.50 () {60 vars in 1310 bytes} [Mon Oct 24 10:26:56 2022] PUT /compute/v2.1/images/1efe38a6-95d1-4ba1-b789-fcb89af303b8/metadata/os_distro => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:26:56.572322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-01ceacb7-a087-4800-a94d-885403e193b6 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] Action: 'create', calling method: .version_select at 0x7f04d1174430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:26:56.573277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:26:56.602186 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-01ceacb7-a087-4800-a94d-885403e193b6 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] HTTP exception thrown: Image not found. Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-01ceacb7-a087-4800-a94d-885403e193b6 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] Request method failure captured: Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/images/4fdd18a9-64e0-426e-83f1-7ab7bdc5b1c3/metadata HTTP/1.1 Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 57 Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmhv9wkot7CVim9P5AVg-ocbBcm8_H6lKbXRxm8WS633d0IoDmzeO_mXplXl8BZtKz2Eav9woJMuo28dz_YXMJavSepCj8gpjFyKNaZEEbv386YZUt2gj7rpLUF-8_ZFcoIg06Js-Tm4gsAfR8TyZvn873o2QowcNpEiPPtfbt7U7HY Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: f7663c0f618e4ada9bc2f35c1ea4e7f6 Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-193024736 Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:26:56.605120 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:26:56.606474 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f7663c0f618e4ada9bc2f35c1ea4e7f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f7663c0f618e4ada9bc2f35c1ea4e7f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f7663c0f618e4ada9bc2f35c1ea4e7f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f7663c0f618e4ada9bc2f35c1ea4e7f6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:26:56.606474 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-193024736 Oct 24 10:26:56.606474 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: f7663c0f618e4ada9bc2f35c1ea4e7f6 Oct 24 10:26:56.606474 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-193024736 Oct 24 10:26:56.606474 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesMetadataNegativeTestJSON-193024736-project Oct 24 10:26:56.606474 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:26:56.606474 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:26:56.606474 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5eb5f6f1c060474886174220746f788c Oct 24 10:26:56.606474 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-193024736-project Oct 24 10:26:56.606474 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:26:56.606474 n-d-858383-15 devstack@n-api.service[120425]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 24 10:26:56.606474 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:26:56.606474 n-d-858383-15 devstack@n-api.service[120425]: exception: Image not found. Oct 24 10:26:56.606474 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'image_id': '4fdd18a9-64e0-426e-83f1-7ab7bdc5b1c3', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 24 10:26:56.607318 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:26:56.607318 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.607318 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:26:56.607318 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:26:56.607318 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:26:56.607318 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:26:56.607318 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:26:56.607318 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:26:56.607318 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:26:56.607318 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:26:56.607318 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:26:56.607318 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:26:56.607318 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:26:56.607318 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:26:56.607318 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:26:56.607318 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:26:56.607318 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:26:56.607318 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4fdd18a9-64e0-426e-83f1-7ab7bdc5b1c3 Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:26:56.608363 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4fdd18a9-64e0-426e-83f1-7ab7bdc5b1c3 could not be found. Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:26:56.610029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:26:56.611190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:26:56.612437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-01ceacb7-a087-4800-a94d-885403e193b6 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] Returning 404 to user: Image not found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:26:56.612437 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-01ceacb7-a087-4800-a94d-885403e193b6 tempest-ImagesMetadataNegativeTestJSON-193024736 tempest-ImagesMetadataNegativeTestJSON-193024736-project] 10.222.0.50 "POST /compute/v2.1/images/4fdd18a9-64e0-426e-83f1-7ab7bdc5b1c3/metadata" status: 404 len: 62 microversion: 2.1 time: 0.039995 Oct 24 10:26:56.612437 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 370/771] 10.222.0.50 () {60 vars in 1281 bytes} [Mon Oct 24 10:26:56 2022] POST /compute/v2.1/images/4fdd18a9-64e0-426e-83f1-7ab7bdc5b1c3/metadata => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:26:56.618932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aafbb538-c216-4f4d-9baa-21aafa4005fc tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:56.619560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aafbb538-c216-4f4d-9baa-21aafa4005fc tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:56.626066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aafbb538-c216-4f4d-9baa-21aafa4005fc tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:56.626657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aafbb538-c216-4f4d-9baa-21aafa4005fc tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:56.627650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aafbb538-c216-4f4d-9baa-21aafa4005fc tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:56.629383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aafbb538-c216-4f4d-9baa-21aafa4005fc tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:56.629383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aafbb538-c216-4f4d-9baa-21aafa4005fc tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:56.629575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aafbb538-c216-4f4d-9baa-21aafa4005fc tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:57.299443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aafbb538-c216-4f4d-9baa-21aafa4005fc tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:57.308825 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aafbb538-c216-4f4d-9baa-21aafa4005fc tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1318 microversion: 2.1 time: 0.698386 Oct 24 10:26:57.312991 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 371/772] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:56 2022] GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 1318 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:57.349685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e8cebf2e-e12c-4e18-aac4-a47265c6c18c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:57.353186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e8cebf2e-e12c-4e18-aac4-a47265c6c18c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:57.364642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8cebf2e-e12c-4e18-aac4-a47265c6c18c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:57.367059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8cebf2e-e12c-4e18-aac4-a47265c6c18c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:57.367854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8cebf2e-e12c-4e18-aac4-a47265c6c18c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:57.368791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8cebf2e-e12c-4e18-aac4-a47265c6c18c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:57.369469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8cebf2e-e12c-4e18-aac4-a47265c6c18c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:57.371654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8cebf2e-e12c-4e18-aac4-a47265c6c18c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:57.383030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:26:57.383558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:26:57.384749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:26:57.385764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:26:57.386253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:26:57.452408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:57.454380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:57.457388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:57.458408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:57.459408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:57.471497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:57.529957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for project b565572c0c8c4871af02471a328bd1af. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:26:57.546131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for user 9aa572f1e5014e10bed0abe34dfad43f and project b565572c0c8c4871af02471a328bd1af. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:26:57.572149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Going to run 2 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:26:57.574999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: a867d805-6462-410b-9486-bffcf7a9425c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:26:57.636337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120426) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 24 10:26:57.705947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for project b565572c0c8c4871af02471a328bd1af. Resources: {'server_group_members'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:26:57.725738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for user 9aa572f1e5014e10bed0abe34dfad43f and project b565572c0c8c4871af02471a328bd1af. Resources: {'server_group_members'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:26:57.823699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e8cebf2e-e12c-4e18-aac4-a47265c6c18c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:57.848825 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e8cebf2e-e12c-4e18-aac4-a47265c6c18c tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424" status: 200 len: 1714 microversion: 2.1 time: 0.525584 Oct 24 10:26:57.853077 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 372/773] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:57 2022] GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 => generated 1714 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:57.868233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f546d3b6-681b-4fa6-969c-4caecb3a01b7 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:57.870679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f546d3b6-681b-4fa6-969c-4caecb3a01b7 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:57.889085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f546d3b6-681b-4fa6-969c-4caecb3a01b7 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:57.890649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f546d3b6-681b-4fa6-969c-4caecb3a01b7 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:57.893243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f546d3b6-681b-4fa6-969c-4caecb3a01b7 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:57.895374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f546d3b6-681b-4fa6-969c-4caecb3a01b7 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:57.899437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f546d3b6-681b-4fa6-969c-4caecb3a01b7 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:57.900216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f546d3b6-681b-4fa6-969c-4caecb3a01b7 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:57.932020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for project b565572c0c8c4871af02471a328bd1af. Resources: {'server_group_members'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:26:57.938431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for user 9aa572f1e5014e10bed0abe34dfad43f and project b565572c0c8c4871af02471a328bd1af. Resources: {'server_group_members'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:26:57.955616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 0d5c6e34-f247-4f26-b237-26fc89ffc2bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=a867d805-6462-410b-9486-bffcf7a9425c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:26:58.024754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for project b565572c0c8c4871af02471a328bd1af. Resources: {'server_group_members'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:26:58.028589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:58.034841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for user 9aa572f1e5014e10bed0abe34dfad43f and project b565572c0c8c4871af02471a328bd1af. Resources: {'server_group_members'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:26:58.137573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for project b565572c0c8c4871af02471a328bd1af. Resources: {'server_group_members'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:26:58.145170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for user 9aa572f1e5014e10bed0abe34dfad43f and project b565572c0c8c4871af02471a328bd1af. Resources: {'server_group_members'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:26:58.203749 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-48204dff-f9fc-4585-b971-cabbf9f0d065 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.698550 Oct 24 10:26:58.209579 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 402/774] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:26:56 2022] POST /compute/v2.1/servers => generated 32 bytes in 1704 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 24 10:26:58.216182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-14864b91-b80c-4f8c-bbac-8e036f7e6755 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:58.217751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-14864b91-b80c-4f8c-bbac-8e036f7e6755 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:58.227747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14864b91-b80c-4f8c-bbac-8e036f7e6755 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:58.228369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14864b91-b80c-4f8c-bbac-8e036f7e6755 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:58.229471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14864b91-b80c-4f8c-bbac-8e036f7e6755 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:58.232187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14864b91-b80c-4f8c-bbac-8e036f7e6755 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:58.233095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14864b91-b80c-4f8c-bbac-8e036f7e6755 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:58.233577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14864b91-b80c-4f8c-bbac-8e036f7e6755 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:58.575104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f546d3b6-681b-4fa6-969c-4caecb3a01b7 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:58.612369 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f546d3b6-681b-4fa6-969c-4caecb3a01b7 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8" status: 200 len: 1324 microversion: 2.1 time: 0.757626 Oct 24 10:26:58.624242 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 373/775] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:57 2022] GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 => generated 1324 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:58.636751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ead38db4-37bf-48d4-ab2c-bafea41cf4c2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:58.637541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ead38db4-37bf-48d4-ab2c-bafea41cf4c2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:58.650133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ead38db4-37bf-48d4-ab2c-bafea41cf4c2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:58.652632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ead38db4-37bf-48d4-ab2c-bafea41cf4c2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:58.654423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ead38db4-37bf-48d4-ab2c-bafea41cf4c2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:58.655394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ead38db4-37bf-48d4-ab2c-bafea41cf4c2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:58.657863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-14864b91-b80c-4f8c-bbac-8e036f7e6755 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:58.658493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ead38db4-37bf-48d4-ab2c-bafea41cf4c2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:58.659177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ead38db4-37bf-48d4-ab2c-bafea41cf4c2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:58.666502 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-14864b91-b80c-4f8c-bbac-8e036f7e6755 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1505 microversion: 2.1 time: 0.455765 Oct 24 10:26:58.672213 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 403/776] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:58 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:58.676896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4d0dcf9e-ce9d-4bd0-abde-7c03a5f2422c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:58.686538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4d0dcf9e-ce9d-4bd0-abde-7c03a5f2422c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:58.687185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4d0dcf9e-ce9d-4bd0-abde-7c03a5f2422c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Searching by: {'deleted': False, 'project_id': 'b565572c0c8c4871af02471a328bd1af'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:26:58.781537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d0dcf9e-ce9d-4bd0-abde-7c03a5f2422c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:58.782366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d0dcf9e-ce9d-4bd0-abde-7c03a5f2422c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:58.782891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d0dcf9e-ce9d-4bd0-abde-7c03a5f2422c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:58.784129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d0dcf9e-ce9d-4bd0-abde-7c03a5f2422c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:58.784603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d0dcf9e-ce9d-4bd0-abde-7c03a5f2422c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:58.785102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d0dcf9e-ce9d-4bd0-abde-7c03a5f2422c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:58.888530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ead38db4-37bf-48d4-ab2c-bafea41cf4c2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:58.901743 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ead38db4-37bf-48d4-ab2c-bafea41cf4c2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1331 microversion: 2.1 time: 0.278907 Oct 24 10:26:58.924449 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 374/777] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:58 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1331 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:58.939950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2b1131c1-1dd3-4fa5-a4ac-f173ee24cd66 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:58.949215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2b1131c1-1dd3-4fa5-a4ac-f173ee24cd66 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:58.970130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b1131c1-1dd3-4fa5-a4ac-f173ee24cd66 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:58.970717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b1131c1-1dd3-4fa5-a4ac-f173ee24cd66 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:58.971044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b1131c1-1dd3-4fa5-a4ac-f173ee24cd66 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:58.971750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b1131c1-1dd3-4fa5-a4ac-f173ee24cd66 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:58.979011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b1131c1-1dd3-4fa5-a4ac-f173ee24cd66 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:58.979495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b1131c1-1dd3-4fa5-a4ac-f173ee24cd66 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:59.016282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-4d0dcf9e-ce9d-4bd0-abde-7c03a5f2422c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:26:59.218817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:26:59.240444 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4d0dcf9e-ce9d-4bd0-abde-7c03a5f2422c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.567063 Oct 24 10:26:59.254132 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 404/778] 10.222.0.50 () {58 vars in 1125 bytes} [Mon Oct 24 10:26:58 2022] GET /compute/v2.1/servers => generated 1002 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:59.260262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-85047ce7-6874-4633-aa68-67b07ef862fa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:59.263096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-85047ce7-6874-4633-aa68-67b07ef862fa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:59.280514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85047ce7-6874-4633-aa68-67b07ef862fa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:59.281980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85047ce7-6874-4633-aa68-67b07ef862fa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:59.282585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85047ce7-6874-4633-aa68-67b07ef862fa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:59.283529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85047ce7-6874-4633-aa68-67b07ef862fa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:59.284522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85047ce7-6874-4633-aa68-67b07ef862fa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:59.284946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85047ce7-6874-4633-aa68-67b07ef862fa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:59.480772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2b1131c1-1dd3-4fa5-a4ac-f173ee24cd66 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:59.492874 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2b1131c1-1dd3-4fa5-a4ac-f173ee24cd66 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1318 microversion: 2.1 time: 0.565942 Oct 24 10:26:59.497155 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 375/779] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:58 2022] GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 1318 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:59.501878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4ae08268-48c7-40fa-a95a-6c8c866ffa55 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:59.502370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4ae08268-48c7-40fa-a95a-6c8c866ffa55 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 0d5c6e34-f247-4f26-b237-26fc89ffc2bb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:59.594827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-85047ce7-6874-4633-aa68-67b07ef862fa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:59.611099 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-85047ce7-6874-4633-aa68-67b07ef862fa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424" status: 200 len: 1647 microversion: 2.1 time: 0.355372 Oct 24 10:26:59.611905 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 405/780] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:59 2022] GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 => generated 1647 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:59.646944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2591756d-ff67-4982-bd20-f0c05168a43e tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:59.647689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2591756d-ff67-4982-bd20-f0c05168a43e tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:59.658444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2591756d-ff67-4982-bd20-f0c05168a43e tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:59.659049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2591756d-ff67-4982-bd20-f0c05168a43e tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:59.659365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2591756d-ff67-4982-bd20-f0c05168a43e tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:59.663854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2591756d-ff67-4982-bd20-f0c05168a43e tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:59.664444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2591756d-ff67-4982-bd20-f0c05168a43e tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:59.672017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2591756d-ff67-4982-bd20-f0c05168a43e tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:59.733947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4ae08268-48c7-40fa-a95a-6c8c866ffa55 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:26:59.744740 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4ae08268-48c7-40fa-a95a-6c8c866ffa55 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb" status: 200 len: 1219 microversion: 2.1 time: 0.246471 Oct 24 10:26:59.769174 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 376/781] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:59 2022] GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb => generated 1219 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:26:59.786773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9ce9643d-0b9c-4d36-954b-4e066f20ca9f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:26:59.797739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9ce9643d-0b9c-4d36-954b-4e066f20ca9f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:26:59.825289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce9643d-0b9c-4d36-954b-4e066f20ca9f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:59.826078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce9643d-0b9c-4d36-954b-4e066f20ca9f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:59.827014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce9643d-0b9c-4d36-954b-4e066f20ca9f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:26:59.827393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce9643d-0b9c-4d36-954b-4e066f20ca9f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:26:59.827842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce9643d-0b9c-4d36-954b-4e066f20ca9f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:26:59.828380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce9643d-0b9c-4d36-954b-4e066f20ca9f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:00.234360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2591756d-ff67-4982-bd20-f0c05168a43e tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:00.247439 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2591756d-ff67-4982-bd20-f0c05168a43e tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8" status: 200 len: 1324 microversion: 2.1 time: 0.606741 Oct 24 10:27:00.264574 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 406/782] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:59 2022] GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 => generated 1324 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:00.276266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cfb9b70c-5c1f-4abb-bb7f-c48a92a086ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:00.278002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cfb9b70c-5c1f-4abb-bb7f-c48a92a086ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:00.288542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfb9b70c-5c1f-4abb-bb7f-c48a92a086ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:00.289713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfb9b70c-5c1f-4abb-bb7f-c48a92a086ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:00.290356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfb9b70c-5c1f-4abb-bb7f-c48a92a086ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:00.291228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfb9b70c-5c1f-4abb-bb7f-c48a92a086ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:00.291921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfb9b70c-5c1f-4abb-bb7f-c48a92a086ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:00.292519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfb9b70c-5c1f-4abb-bb7f-c48a92a086ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:00.479086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9ce9643d-0b9c-4d36-954b-4e066f20ca9f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:00.488350 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9ce9643d-0b9c-4d36-954b-4e066f20ca9f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1505 microversion: 2.1 time: 0.717751 Oct 24 10:27:00.489281 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 377/783] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:26:59 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1505 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:00.517773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d83b6697-d649-43b4-8570-37e81d26d639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:00.518970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d83b6697-d649-43b4-8570-37e81d26d639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:00.527259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d83b6697-d649-43b4-8570-37e81d26d639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:00.527802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d83b6697-d649-43b4-8570-37e81d26d639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:00.529138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d83b6697-d649-43b4-8570-37e81d26d639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:00.530097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d83b6697-d649-43b4-8570-37e81d26d639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:00.530797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d83b6697-d649-43b4-8570-37e81d26d639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:00.531484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d83b6697-d649-43b4-8570-37e81d26d639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:00.555060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cfb9b70c-5c1f-4abb-bb7f-c48a92a086ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:00.565245 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cfb9b70c-5c1f-4abb-bb7f-c48a92a086ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1337 microversion: 2.1 time: 0.298905 Oct 24 10:27:00.572142 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 407/784] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:00 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1337 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:00.650896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-71700524-3982-4611-9f0e-bb150e5b4df8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:00.651669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-71700524-3982-4611-9f0e-bb150e5b4df8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:00.659784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71700524-3982-4611-9f0e-bb150e5b4df8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:00.661144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71700524-3982-4611-9f0e-bb150e5b4df8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:00.662465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71700524-3982-4611-9f0e-bb150e5b4df8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:00.663867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71700524-3982-4611-9f0e-bb150e5b4df8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:00.664595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71700524-3982-4611-9f0e-bb150e5b4df8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:00.665457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71700524-3982-4611-9f0e-bb150e5b4df8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:01.077435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-71700524-3982-4611-9f0e-bb150e5b4df8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:01.090615 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-71700524-3982-4611-9f0e-bb150e5b4df8 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424" status: 200 len: 1647 microversion: 2.1 time: 0.441616 Oct 24 10:27:01.095729 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 408/785] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:00 2022] GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 => generated 1647 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:01.110683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-4c03281c-0e64-48a5-8840-4fc3b96b2a3c req-d43ce196-7d5e-49de-b4ab-f032d32cae20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94278005-1d71-4976-b673-ad2d105385e0", "name": "network-vif-plugged", "status": "completed", "tag": "9691a054-3d8c-4b1b-b4f4-09af40c934d5"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:01.133028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4c03281c-0e64-48a5-8840-4fc3b96b2a3c req-d43ce196-7d5e-49de-b4ab-f032d32cae20 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:01.135250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4c03281c-0e64-48a5-8840-4fc3b96b2a3c req-d43ce196-7d5e-49de-b4ab-f032d32cae20 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:01.137388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4c03281c-0e64-48a5-8840-4fc3b96b2a3c req-d43ce196-7d5e-49de-b4ab-f032d32cae20 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:01.162729 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-4c03281c-0e64-48a5-8840-4fc3b96b2a3c req-d43ce196-7d5e-49de-b4ab-f032d32cae20 service nova] Creating event network-vif-plugged:9691a054-3d8c-4b1b-b4f4-09af40c934d5 for instance 94278005-1d71-4976-b673-ad2d105385e0 on n-h1-858383-15 Oct 24 10:27:01.169645 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-4c03281c-0e64-48a5-8840-4fc3b96b2a3c req-d43ce196-7d5e-49de-b4ab-f032d32cae20 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072333 Oct 24 10:27:01.171197 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 409/786] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:01.180896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c46128d9-0791-475f-86b1-0d0b3a58be22 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:01.182647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c46128d9-0791-475f-86b1-0d0b3a58be22 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 0d5c6e34-f247-4f26-b237-26fc89ffc2bb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:01.204219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c46128d9-0791-475f-86b1-0d0b3a58be22 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:01.206014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c46128d9-0791-475f-86b1-0d0b3a58be22 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:01.206669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c46128d9-0791-475f-86b1-0d0b3a58be22 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:01.230319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c46128d9-0791-475f-86b1-0d0b3a58be22 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:01.232541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c46128d9-0791-475f-86b1-0d0b3a58be22 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:01.238378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c46128d9-0791-475f-86b1-0d0b3a58be22 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:01.264033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d83b6697-d649-43b4-8570-37e81d26d639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:01.280626 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d83b6697-d649-43b4-8570-37e81d26d639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1318 microversion: 2.1 time: 0.765641 Oct 24 10:27:01.283887 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 378/787] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:00 2022] GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 1318 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:01.325446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-bd796546-0b26-42c0-b8f7-fbb674a8fdb9 req-79514092-18e0-4c8b-a881-1dce18407963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0b8d04-8d85-4df1-a921-2ff9ef9d6424", "name": "network-vif-deleted", "tag": "ff6086af-6880-43bf-9ea1-7af1f73f488a"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:01.347713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-bd796546-0b26-42c0-b8f7-fbb674a8fdb9 req-79514092-18e0-4c8b-a881-1dce18407963 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:01.348199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-bd796546-0b26-42c0-b8f7-fbb674a8fdb9 req-79514092-18e0-4c8b-a881-1dce18407963 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:01.348624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-bd796546-0b26-42c0-b8f7-fbb674a8fdb9 req-79514092-18e0-4c8b-a881-1dce18407963 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:01.402819 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-bd796546-0b26-42c0-b8f7-fbb674a8fdb9 req-79514092-18e0-4c8b-a881-1dce18407963 service nova] Creating event network-vif-deleted:ff6086af-6880-43bf-9ea1-7af1f73f488a for instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 on n-h2-858383-15 Oct 24 10:27:01.410975 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-bd796546-0b26-42c0-b8f7-fbb674a8fdb9 req-79514092-18e0-4c8b-a881-1dce18407963 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117669 Oct 24 10:27:01.412587 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 379/788] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:01.419837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0b695019-fb43-4519-92fc-f6d526aed567 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:01.434103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0b695019-fb43-4519-92fc-f6d526aed567 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:01.454372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b695019-fb43-4519-92fc-f6d526aed567 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:01.455440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b695019-fb43-4519-92fc-f6d526aed567 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:01.456970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b695019-fb43-4519-92fc-f6d526aed567 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:01.460096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b695019-fb43-4519-92fc-f6d526aed567 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:01.461019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b695019-fb43-4519-92fc-f6d526aed567 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:01.463960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b695019-fb43-4519-92fc-f6d526aed567 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:01.665400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c46128d9-0791-475f-86b1-0d0b3a58be22 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:01.675086 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c46128d9-0791-475f-86b1-0d0b3a58be22 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb" status: 200 len: 1271 microversion: 2.1 time: 0.502096 Oct 24 10:27:01.676596 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 410/789] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:01 2022] GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb => generated 1271 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:01.683331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c3761c8e-bf4d-48df-a97e-72224589fb77 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:01.684148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c3761c8e-bf4d-48df-a97e-72224589fb77 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:01.698321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3761c8e-bf4d-48df-a97e-72224589fb77 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:01.701981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3761c8e-bf4d-48df-a97e-72224589fb77 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:01.703329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3761c8e-bf4d-48df-a97e-72224589fb77 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:01.705849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3761c8e-bf4d-48df-a97e-72224589fb77 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:01.706656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3761c8e-bf4d-48df-a97e-72224589fb77 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:01.707293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3761c8e-bf4d-48df-a97e-72224589fb77 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:02.108460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0b695019-fb43-4519-92fc-f6d526aed567 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:02.135034 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0b695019-fb43-4519-92fc-f6d526aed567 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8" status: 200 len: 1520 microversion: 2.1 time: 0.720637 Oct 24 10:27:02.135517 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 380/790] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:01 2022] GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 => generated 1520 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:02.150065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b27f36aa-8ece-4968-b690-a217c212cf8c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:02.150944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b27f36aa-8ece-4968-b690-a217c212cf8c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:02.167063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b27f36aa-8ece-4968-b690-a217c212cf8c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:02.167607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b27f36aa-8ece-4968-b690-a217c212cf8c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:02.168052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b27f36aa-8ece-4968-b690-a217c212cf8c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:02.168761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b27f36aa-8ece-4968-b690-a217c212cf8c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:02.169256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b27f36aa-8ece-4968-b690-a217c212cf8c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:02.169681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b27f36aa-8ece-4968-b690-a217c212cf8c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:02.222121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c3761c8e-bf4d-48df-a97e-72224589fb77 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:02.234809 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c3761c8e-bf4d-48df-a97e-72224589fb77 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1505 microversion: 2.1 time: 0.555107 Oct 24 10:27:02.237772 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 411/791] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:01 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:02.253050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7071b30c-7abf-45c6-9e5c-985545853421 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:02.255218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7071b30c-7abf-45c6-9e5c-985545853421 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:02.274311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7071b30c-7abf-45c6-9e5c-985545853421 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:02.275188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7071b30c-7abf-45c6-9e5c-985545853421 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:02.277980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7071b30c-7abf-45c6-9e5c-985545853421 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:02.279044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7071b30c-7abf-45c6-9e5c-985545853421 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:02.280647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7071b30c-7abf-45c6-9e5c-985545853421 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:02.282832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7071b30c-7abf-45c6-9e5c-985545853421 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:02.352962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7071b30c-7abf-45c6-9e5c-985545853421 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:02.355446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7071b30c-7abf-45c6-9e5c-985545853421 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:02.361199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7071b30c-7abf-45c6-9e5c-985545853421 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:02.361859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-7071b30c-7abf-45c6-9e5c-985545853421 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lazy-loading 'fault' on Instance uuid 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:27:02.487048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7071b30c-7abf-45c6-9e5c-985545853421 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4e7f9ab1cc4c3f81d40b2c4391619f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db1d316f8d547919156c576461ed607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:02.500138 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7071b30c-7abf-45c6-9e5c-985545853421 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424" status: 200 len: 1354 microversion: 2.1 time: 0.260589 Oct 24 10:27:02.501452 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 412/792] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:02 2022] GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 => generated 1354 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:02.506904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f320a987-69d0-4173-b797-0f6c62ea4081 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Action: 'action', calling method: .version_select at 0x7f04d2bac3a0>, body: {"addFloatingIp": {"address": "172.25.1.200"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:02.509934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f320a987-69d0-4173-b797-0f6c62ea4081 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:02.517409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f320a987-69d0-4173-b797-0f6c62ea4081 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:02.518089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f320a987-69d0-4173-b797-0f6c62ea4081 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:02.518756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f320a987-69d0-4173-b797-0f6c62ea4081 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:02.519648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f320a987-69d0-4173-b797-0f6c62ea4081 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:02.520702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f320a987-69d0-4173-b797-0f6c62ea4081 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:02.521908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f320a987-69d0-4173-b797-0f6c62ea4081 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:02.609404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f320a987-69d0-4173-b797-0f6c62ea4081 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "refresh_cache-00d34420-321b-4914-a4e0-d03965e049b3" {{(pid=120426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 10:27:02.610045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f320a987-69d0-4173-b797-0f6c62ea4081 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquired lock "refresh_cache-00d34420-321b-4914-a4e0-d03965e049b3" {{(pid=120426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 10:27:03.376914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b27f36aa-8ece-4968-b690-a217c212cf8c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:03.387034 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b27f36aa-8ece-4968-b690-a217c212cf8c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1379 microversion: 2.1 time: 1.248003 Oct 24 10:27:03.402227 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 381/793] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:02 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1379 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:03.410423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-153750dd-d662-41d0-b151-798e170a4ca2 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:03.411269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-153750dd-d662-41d0-b151-798e170a4ca2 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:03.418472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-153750dd-d662-41d0-b151-798e170a4ca2 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:03.419093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-153750dd-d662-41d0-b151-798e170a4ca2 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:03.419636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-153750dd-d662-41d0-b151-798e170a4ca2 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:03.420679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-153750dd-d662-41d0-b151-798e170a4ca2 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:03.421444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-153750dd-d662-41d0-b151-798e170a4ca2 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:03.422277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-153750dd-d662-41d0-b151-798e170a4ca2 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:03.764242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-153750dd-d662-41d0-b151-798e170a4ca2 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:03.776174 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-153750dd-d662-41d0-b151-798e170a4ca2 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1318 microversion: 2.1 time: 0.372919 Oct 24 10:27:03.783005 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 382/794] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:03 2022] GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:03.798153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7d844963-d1c6-435e-91f3-1927e7e23648 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:03.799121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7d844963-d1c6-435e-91f3-1927e7e23648 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 0d5c6e34-f247-4f26-b237-26fc89ffc2bb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:03.815655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d844963-d1c6-435e-91f3-1927e7e23648 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:03.817784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d844963-d1c6-435e-91f3-1927e7e23648 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:03.819146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d844963-d1c6-435e-91f3-1927e7e23648 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:03.822695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d844963-d1c6-435e-91f3-1927e7e23648 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:03.823277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d844963-d1c6-435e-91f3-1927e7e23648 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:03.824871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d844963-d1c6-435e-91f3-1927e7e23648 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:03.947794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7d844963-d1c6-435e-91f3-1927e7e23648 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:03.967853 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7d844963-d1c6-435e-91f3-1927e7e23648 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb" status: 200 len: 1277 microversion: 2.1 time: 0.180424 Oct 24 10:27:03.969174 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 383/795] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:03 2022] GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:03.977303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-412bb395-16af-4a41-b494-894aec4ae71e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:03.978327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-412bb395-16af-4a41-b494-894aec4ae71e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:03.985915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-412bb395-16af-4a41-b494-894aec4ae71e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:03.987388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-412bb395-16af-4a41-b494-894aec4ae71e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:03.988203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-412bb395-16af-4a41-b494-894aec4ae71e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:03.989190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-412bb395-16af-4a41-b494-894aec4ae71e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:03.989930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-412bb395-16af-4a41-b494-894aec4ae71e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:03.991191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-412bb395-16af-4a41-b494-894aec4ae71e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:04.526514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-412bb395-16af-4a41-b494-894aec4ae71e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:04.536242 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-412bb395-16af-4a41-b494-894aec4ae71e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1480 microversion: 2.1 time: 0.564526 Oct 24 10:27:04.539508 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 384/796] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:03 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1480 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:04.544478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0226e6fb-f79e-45d8-8c45-5a344483c51e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:04.557810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0226e6fb-f79e-45d8-8c45-5a344483c51e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:04.564559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0226e6fb-f79e-45d8-8c45-5a344483c51e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:04.577666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0226e6fb-f79e-45d8-8c45-5a344483c51e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:04.578709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0226e6fb-f79e-45d8-8c45-5a344483c51e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:04.579101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0226e6fb-f79e-45d8-8c45-5a344483c51e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:04.579554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0226e6fb-f79e-45d8-8c45-5a344483c51e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:04.579977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0226e6fb-f79e-45d8-8c45-5a344483c51e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:04.595180 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-0226e6fb-f79e-45d8-8c45-5a344483c51e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] HTTP exception thrown: Instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 could not be found. Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0226e6fb-f79e-45d8-8c45-5a344483c51e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Request method failure captured: Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 HTTP/1.1 Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfWUeKzRN0TVNe25axJ80ssrODxROcyoYegQAdEaRF5R0RESt4d6kgM_8wEROfwyfTwepzBt0xV05qV7EyYeKxkqttUkKawruqTtAjJwg7JOIqn1bvx1dGiv3qtO7nFHU7sNjFsHq0JCuuewF_c1fur5hPEWZEPqe4xEIAuLKFjLIo Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 3db1d316f8d547919156c576461ed607 Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:27:04.596796 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:27:04.598544 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3db1d316f8d547919156c576461ed607"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3db1d316f8d547919156c576461ed607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3db1d316f8d547919156c576461ed607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3db1d316f8d547919156c576461ed607", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:27:04.598544 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:04.598544 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 3db1d316f8d547919156c576461ed607 Oct 24 10:27:04.598544 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:04.598544 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersWithSpecificFlavorTestJSON-961641977-project Oct 24 10:27:04.598544 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:27:04.598544 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:27:04.598544 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6a4e7f9ab1cc4c3f81d40b2c4391619f Oct 24 10:27:04.598544 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977-project Oct 24 10:27:04.598544 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:27:04.598544 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 could not be found. Oct 24 10:27:04.598544 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '5b0b8d04-8d85-4df1-a921-2ff9ef9d6424'} Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 could not be found. Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:27:04.599560 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:27:04.601612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:27:04.601612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:27:04.601612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:27:04.601612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:27:04.601612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:27:04.601612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:27:04.601612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:27:04.601612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 could not be found. Oct 24 10:27:04.601612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:04.601612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:04.601612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:04.601612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:04.601612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:04.601612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:04.601612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:27:04.601612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:27:04.601612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 could not be found. Oct 24 10:27:04.601612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:04.609712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0226e6fb-f79e-45d8-8c45-5a344483c51e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Returning 404 to user: Instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:27:04.610584 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0226e6fb-f79e-45d8-8c45-5a344483c51e tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424" status: 404 len: 111 microversion: 2.1 time: 0.069879 Oct 24 10:27:04.611479 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 385/797] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:04 2022] GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:27:04.618744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-09fc1123-2c0d-4cb0-9478-23b20c108b11 req-a98a0c48-3c04-425e-8254-0c8613948515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98c18a9a-ad67-4d8e-abd2-349766d8a002", "tag": "0782d6f6-5f17-49c4-9ee3-4c8b802a9588"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:04.641378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-09fc1123-2c0d-4cb0-9478-23b20c108b11 req-a98a0c48-3c04-425e-8254-0c8613948515 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:04.643404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-09fc1123-2c0d-4cb0-9478-23b20c108b11 req-a98a0c48-3c04-425e-8254-0c8613948515 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:04.643918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-09fc1123-2c0d-4cb0-9478-23b20c108b11 req-a98a0c48-3c04-425e-8254-0c8613948515 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:04.675540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:04.681834 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-09fc1123-2c0d-4cb0-9478-23b20c108b11 req-a98a0c48-3c04-425e-8254-0c8613948515 service nova] Creating event network-changed:0782d6f6-5f17-49c4-9ee3-4c8b802a9588 for instance 98c18a9a-ad67-4d8e-abd2-349766d8a002 on n-h2-858383-15 Oct 24 10:27:04.698750 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-09fc1123-2c0d-4cb0-9478-23b20c108b11 req-a98a0c48-3c04-425e-8254-0c8613948515 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085835 Oct 24 10:27:04.699350 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 386/798] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:04.711266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d793a3b6-3fad-48f2-9e0c-010a85fc2f35 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:04.715405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d793a3b6-3fad-48f2-9e0c-010a85fc2f35 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:04.729250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d793a3b6-3fad-48f2-9e0c-010a85fc2f35 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:04.730370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d793a3b6-3fad-48f2-9e0c-010a85fc2f35 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:04.733799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d793a3b6-3fad-48f2-9e0c-010a85fc2f35 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:04.736998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d793a3b6-3fad-48f2-9e0c-010a85fc2f35 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:04.738730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d793a3b6-3fad-48f2-9e0c-010a85fc2f35 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:04.739560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d793a3b6-3fad-48f2-9e0c-010a85fc2f35 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:05.167491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:05.374903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d793a3b6-3fad-48f2-9e0c-010a85fc2f35 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:05.387686 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d793a3b6-3fad-48f2-9e0c-010a85fc2f35 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1379 microversion: 2.1 time: 0.686873 Oct 24 10:27:05.388275 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 387/799] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:04 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1379 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:05.393064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dd3a2811-9b83-469a-8af0-41300de4f72b tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '.version_select at 0x7f04d0f5c430>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:05.405481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd3a2811-9b83-469a-8af0-41300de4f72b tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:05.413661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd3a2811-9b83-469a-8af0-41300de4f72b tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:05.414284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd3a2811-9b83-469a-8af0-41300de4f72b tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:05.425931 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dd3a2811-9b83-469a-8af0-41300de4f72b tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1584 microversion: 2.1 time: 0.036347 Oct 24 10:27:05.434745 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 388/800] 10.222.0.50 () {58 vars in 1143 bytes} [Mon Oct 24 10:27:05 2022] GET /compute/v2.1/os-migrations => generated 1584 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:05.448601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0fe599db-4db5-4b61-903d-a1042b14b6c3 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:05.449389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0fe599db-4db5-4b61-903d-a1042b14b6c3 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:05.456209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fe599db-4db5-4b61-903d-a1042b14b6c3 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:05.459653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fe599db-4db5-4b61-903d-a1042b14b6c3 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:05.469570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fe599db-4db5-4b61-903d-a1042b14b6c3 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:05.470724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fe599db-4db5-4b61-903d-a1042b14b6c3 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:05.471388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fe599db-4db5-4b61-903d-a1042b14b6c3 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:05.471972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fe599db-4db5-4b61-903d-a1042b14b6c3 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:05.489726 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-0fe599db-4db5-4b61-903d-a1042b14b6c3 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] HTTP exception thrown: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0fe599db-4db5-4b61-903d-a1042b14b6c3 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Request method failure captured: Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f HTTP/1.1 Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfWUeKzRN0TVNe25axJ80ssrODxROcyoYegQAdEaRF5R0RESt4d6kgM_8wEROfwyfTwepzBt0xV05qV7EyYeKxkqttUkKawruqTtAjJwg7JOIqn1bvx1dGiv3qtO7nFHU7sNjFsHq0JCuuewF_c1fur5hPEWZEPqe4xEIAuLKFjLIo Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 3db1d316f8d547919156c576461ed607 Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:27:05.501052 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:27:05.502632 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3db1d316f8d547919156c576461ed607"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3db1d316f8d547919156c576461ed607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3db1d316f8d547919156c576461ed607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3db1d316f8d547919156c576461ed607", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:27:05.502632 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:05.502632 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 3db1d316f8d547919156c576461ed607 Oct 24 10:27:05.502632 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:05.502632 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersWithSpecificFlavorTestJSON-961641977-project Oct 24 10:27:05.502632 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:27:05.502632 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:27:05.502632 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6a4e7f9ab1cc4c3f81d40b2c4391619f Oct 24 10:27:05.502632 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977-project Oct 24 10:27:05.502632 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:27:05.502632 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:05.502632 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'ad6067c8-26ae-4e5f-a747-8d9e5f720a4f'} Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:27:05.503492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:05.504893 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:05.507302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0fe599db-4db5-4b61-903d-a1042b14b6c3 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Returning 404 to user: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:27:05.508529 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0fe599db-4db5-4b61-903d-a1042b14b6c3 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 404 len: 111 microversion: 2.1 time: 0.072250 Oct 24 10:27:05.512159 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 389/801] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:27:05 2022] DELETE /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:27:05.519445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2b5d3900-48f4-48f3-9aba-c08e805a1676 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:05.523308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2b5d3900-48f4-48f3-9aba-c08e805a1676 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:05.535878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b5d3900-48f4-48f3-9aba-c08e805a1676 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:05.537907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b5d3900-48f4-48f3-9aba-c08e805a1676 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:05.539208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b5d3900-48f4-48f3-9aba-c08e805a1676 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:05.540170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b5d3900-48f4-48f3-9aba-c08e805a1676 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:05.540826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b5d3900-48f4-48f3-9aba-c08e805a1676 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:05.541478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b5d3900-48f4-48f3-9aba-c08e805a1676 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:06.226754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2b5d3900-48f4-48f3-9aba-c08e805a1676 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:06.243369 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2b5d3900-48f4-48f3-9aba-c08e805a1676 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1468 microversion: 2.1 time: 0.729853 Oct 24 10:27:06.245030 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 390/802] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:05 2022] GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 1468 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:06.267405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-499f23b9-a2b0-4fe1-80f0-20137a6dc7f7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:06.268684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-499f23b9-a2b0-4fe1-80f0-20137a6dc7f7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 0d5c6e34-f247-4f26-b237-26fc89ffc2bb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:06.286079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-499f23b9-a2b0-4fe1-80f0-20137a6dc7f7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:06.287739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-499f23b9-a2b0-4fe1-80f0-20137a6dc7f7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:06.288446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-499f23b9-a2b0-4fe1-80f0-20137a6dc7f7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:06.289396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-499f23b9-a2b0-4fe1-80f0-20137a6dc7f7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:06.290845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-499f23b9-a2b0-4fe1-80f0-20137a6dc7f7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:06.291597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-499f23b9-a2b0-4fe1-80f0-20137a6dc7f7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:06.852624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-499f23b9-a2b0-4fe1-80f0-20137a6dc7f7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:06.874209 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-499f23b9-a2b0-4fe1-80f0-20137a6dc7f7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb" status: 200 len: 1277 microversion: 2.1 time: 0.627579 Oct 24 10:27:06.890681 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 391/803] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:06 2022] GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb => generated 1277 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:06.902033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7795a919-3863-4876-82a2-3e7bca45f501 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:06.903134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7795a919-3863-4876-82a2-3e7bca45f501 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:06.911804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7795a919-3863-4876-82a2-3e7bca45f501 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:06.912642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7795a919-3863-4876-82a2-3e7bca45f501 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:06.913298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7795a919-3863-4876-82a2-3e7bca45f501 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:06.914392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7795a919-3863-4876-82a2-3e7bca45f501 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:06.914994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7795a919-3863-4876-82a2-3e7bca45f501 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:06.915581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7795a919-3863-4876-82a2-3e7bca45f501 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:07.243710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-f320a987-69d0-4173-b797-0f6c62ea4081 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Building network info cache for instance {{(pid=120426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 10:27:07.541724 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7795a919-3863-4876-82a2-3e7bca45f501 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1633 microversion: 2.1 time: 0.645664 Oct 24 10:27:07.548672 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 392/804] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:06 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1633 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:07.560582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2090bb26-38ac-4872-9d57-2042898ebdfa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:07.562135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2090bb26-38ac-4872-9d57-2042898ebdfa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:07.577703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2090bb26-38ac-4872-9d57-2042898ebdfa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:07.578679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2090bb26-38ac-4872-9d57-2042898ebdfa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:07.580209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2090bb26-38ac-4872-9d57-2042898ebdfa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:07.581509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2090bb26-38ac-4872-9d57-2042898ebdfa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:07.582541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2090bb26-38ac-4872-9d57-2042898ebdfa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:07.583591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2090bb26-38ac-4872-9d57-2042898ebdfa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:07.614091 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-2090bb26-38ac-4872-9d57-2042898ebdfa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] HTTP exception thrown: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2090bb26-38ac-4872-9d57-2042898ebdfa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Request method failure captured: Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f HTTP/1.1 Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfWUeKzRN0TVNe25axJ80ssrODxROcyoYegQAdEaRF5R0RESt4d6kgM_8wEROfwyfTwepzBt0xV05qV7EyYeKxkqttUkKawruqTtAjJwg7JOIqn1bvx1dGiv3qtO7nFHU7sNjFsHq0JCuuewF_c1fur5hPEWZEPqe4xEIAuLKFjLIo Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 3db1d316f8d547919156c576461ed607 Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:27:07.616471 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:27:07.617880 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3db1d316f8d547919156c576461ed607"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3db1d316f8d547919156c576461ed607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3db1d316f8d547919156c576461ed607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3db1d316f8d547919156c576461ed607", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:27:07.617880 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:07.617880 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 3db1d316f8d547919156c576461ed607 Oct 24 10:27:07.617880 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:07.617880 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersWithSpecificFlavorTestJSON-961641977-project Oct 24 10:27:07.617880 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:27:07.617880 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:27:07.617880 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6a4e7f9ab1cc4c3f81d40b2c4391619f Oct 24 10:27:07.617880 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977-project Oct 24 10:27:07.617880 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:27:07.617880 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:07.617880 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'ad6067c8-26ae-4e5f-a747-8d9e5f720a4f'} Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:27:07.618583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:27:07.619741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:27:07.619741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:27:07.619741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:27:07.619741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:27:07.619741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:27:07.619741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:27:07.619741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:27:07.619741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:07.619741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:07.619741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:07.619741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:07.619741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:07.619741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:07.619741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:07.619741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:27:07.619741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:27:07.619741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:07.619741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:07.624479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2090bb26-38ac-4872-9d57-2042898ebdfa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Returning 404 to user: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:27:07.626699 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2090bb26-38ac-4872-9d57-2042898ebdfa tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 404 len: 111 microversion: 2.1 time: 0.076473 Oct 24 10:27:07.628122 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 393/805] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:07 2022] GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:27:07.634325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4e2c88eb-e4e9-44be-a5d4-570fbd2bfc37 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:07.635201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4e2c88eb-e4e9-44be-a5d4-570fbd2bfc37 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: a8f749f9-5771-4ecb-8a06-30a8f69dd848] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:07.641918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e2c88eb-e4e9-44be-a5d4-570fbd2bfc37 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:07.642747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e2c88eb-e4e9-44be-a5d4-570fbd2bfc37 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:07.644932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e2c88eb-e4e9-44be-a5d4-570fbd2bfc37 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:07.645959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e2c88eb-e4e9-44be-a5d4-570fbd2bfc37 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:07.647411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e2c88eb-e4e9-44be-a5d4-570fbd2bfc37 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:07.648060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e2c88eb-e4e9-44be-a5d4-570fbd2bfc37 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:08.141989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4e2c88eb-e4e9-44be-a5d4-570fbd2bfc37 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:08.155835 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4e2c88eb-e4e9-44be-a5d4-570fbd2bfc37 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848" status: 200 len: 1466 microversion: 2.1 time: 0.526293 Oct 24 10:27:08.159311 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 394/806] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:07 2022] GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848 => generated 1466 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:08.160165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=30 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:08.177350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b1be69ba-be3b-4dc8-863d-784e9a31682c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:08.179742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b1be69ba-be3b-4dc8-863d-784e9a31682c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:08.195629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1be69ba-be3b-4dc8-863d-784e9a31682c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:08.196200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1be69ba-be3b-4dc8-863d-784e9a31682c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:08.196656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1be69ba-be3b-4dc8-863d-784e9a31682c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:08.197465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1be69ba-be3b-4dc8-863d-784e9a31682c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:08.198455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1be69ba-be3b-4dc8-863d-784e9a31682c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:08.203684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1be69ba-be3b-4dc8-863d-784e9a31682c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:08.757517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b1be69ba-be3b-4dc8-863d-784e9a31682c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:08.770324 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b1be69ba-be3b-4dc8-863d-784e9a31682c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1379 microversion: 2.1 time: 0.606178 Oct 24 10:27:08.771276 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 395/807] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:08 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1379 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:08.780448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3bbf6702-40f9-46fd-ba43-55ed0f7a08e1 req-58b4f13b-2694-4671-b7d1-d302ed59b3bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a867d805-6462-410b-9486-bffcf7a9425c", "tag": "e435d6a8-8b24-4eb0-9ebb-53775303b942"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:08.801913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3bbf6702-40f9-46fd-ba43-55ed0f7a08e1 req-58b4f13b-2694-4671-b7d1-d302ed59b3bb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:08.802857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3bbf6702-40f9-46fd-ba43-55ed0f7a08e1 req-58b4f13b-2694-4671-b7d1-d302ed59b3bb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:08.803832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3bbf6702-40f9-46fd-ba43-55ed0f7a08e1 req-58b4f13b-2694-4671-b7d1-d302ed59b3bb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:08.831312 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3bbf6702-40f9-46fd-ba43-55ed0f7a08e1 req-58b4f13b-2694-4671-b7d1-d302ed59b3bb service nova] Creating event network-changed:e435d6a8-8b24-4eb0-9ebb-53775303b942 for instance a867d805-6462-410b-9486-bffcf7a9425c on n-h2-858383-15 Oct 24 10:27:08.843469 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3bbf6702-40f9-46fd-ba43-55ed0f7a08e1 req-58b4f13b-2694-4671-b7d1-d302ed59b3bb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067574 Oct 24 10:27:08.844451 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 396/808] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:08.857676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-29de33f6-ed5d-4062-b995-c41a47ce3279 req-4c7cb12e-7a81-464c-a82a-b26a6a1ca7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00d34420-321b-4914-a4e0-d03965e049b3", "tag": "3da84e0c-5c52-4ffa-8616-0781a71c3874"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:08.859441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:08.885652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-29de33f6-ed5d-4062-b995-c41a47ce3279 req-4c7cb12e-7a81-464c-a82a-b26a6a1ca7a0 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:08.886323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-29de33f6-ed5d-4062-b995-c41a47ce3279 req-4c7cb12e-7a81-464c-a82a-b26a6a1ca7a0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:08.887771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-29de33f6-ed5d-4062-b995-c41a47ce3279 req-4c7cb12e-7a81-464c-a82a-b26a6a1ca7a0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:08.916541 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-29de33f6-ed5d-4062-b995-c41a47ce3279 req-4c7cb12e-7a81-464c-a82a-b26a6a1ca7a0 service nova] Creating event network-changed:3da84e0c-5c52-4ffa-8616-0781a71c3874 for instance 00d34420-321b-4914-a4e0-d03965e049b3 on n-h1-858383-15 Oct 24 10:27:08.926954 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-29de33f6-ed5d-4062-b995-c41a47ce3279 req-4c7cb12e-7a81-464c-a82a-b26a6a1ca7a0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080886 Oct 24 10:27:08.932282 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 397/809] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:08.938669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1f80fbbe-b148-414a-8dd6-81de8c193aa3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Action: 'create', calling method: .version_select at 0x7f04d0f09ca0>, body: {"keypair": {"name": "tempest-keypair-45616671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWzMXIVanUJGEhE7BCip50CubRmnDJllVgWAl3EtcJolnOLI7IpUyAUKT0zV5I5ih37sCyrUQbkt3hlzv0I++KAeygtyISBMC8PSTRg6A0VI2whSYULQ4wnWM9jDTs9PA=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:08.968708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=33 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:08.970140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-1f80fbbe-b148-414a-8dd6-81de8c193aa3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Getting quotas for project 115025f23db94a71b74b6adbc536792f. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:27:08.980458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-1f80fbbe-b148-414a-8dd6-81de8c193aa3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Getting quotas for user 176a68ea281e4f65bbeac67cc304468d and project 115025f23db94a71b74b6adbc536792f. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:27:09.014949 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1f80fbbe-b148-414a-8dd6-81de8c193aa3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.080942 Oct 24 10:27:09.016009 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 398/810] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:27:08 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:09.021698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e58c19b5-fe0f-4883-909c-eb7f205f8698 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '.version_select at 0x7f04d10184c0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:09.057911 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e58c19b5-fe0f-4883-909c-eb7f205f8698 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1839762585" status: 202 len: 0 microversion: 2.1 time: 0.040280 Oct 24 10:27:09.058829 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 399/811] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Oct 24 10:27:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1839762585 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:27:09.064684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3648ed64-e64a-415e-bf32-3b195c537213 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:09.067164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3648ed64-e64a-415e-bf32-3b195c537213 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 0d5c6e34-f247-4f26-b237-26fc89ffc2bb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:09.086107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3648ed64-e64a-415e-bf32-3b195c537213 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:09.086983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3648ed64-e64a-415e-bf32-3b195c537213 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:09.087643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3648ed64-e64a-415e-bf32-3b195c537213 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:09.090572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3648ed64-e64a-415e-bf32-3b195c537213 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:09.091433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3648ed64-e64a-415e-bf32-3b195c537213 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:09.092908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3648ed64-e64a-415e-bf32-3b195c537213 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:09.742857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3648ed64-e64a-415e-bf32-3b195c537213 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:09.757582 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3648ed64-e64a-415e-bf32-3b195c537213 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb" status: 200 len: 1319 microversion: 2.1 time: 0.693629 Oct 24 10:27:09.768874 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 400/812] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:09 2022] GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb => generated 1319 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:09.770922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cd664d28-2fd0-4e95-bfff-a3c20c5b050c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-881184622"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:09.784864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cd664d28-2fd0-4e95-bfff-a3c20c5b050c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: a8f749f9-5771-4ecb-8a06-30a8f69dd848] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:09.807478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd664d28-2fd0-4e95-bfff-a3c20c5b050c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:09.807986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd664d28-2fd0-4e95-bfff-a3c20c5b050c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:09.810105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd664d28-2fd0-4e95-bfff-a3c20c5b050c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:09.810904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd664d28-2fd0-4e95-bfff-a3c20c5b050c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:09.812542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd664d28-2fd0-4e95-bfff-a3c20c5b050c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:09.813506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd664d28-2fd0-4e95-bfff-a3c20c5b050c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:09.818389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-f320a987-69d0-4173-b797-0f6c62ea4081 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Updating instance_info_cache with network_info: [{"id": "3da84e0c-5c52-4ffa-8616-0781a71c3874", "address": "fa:16:3e:c4:e3:16", "network": {"id": "ec1a4d9a-2e78-407d-b33a-563721c9877e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-994583523-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2afb2a59a2134fe0a2903b9591cc522b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3da84e0c-5c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 10:27:09.857541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f320a987-69d0-4173-b797-0f6c62ea4081 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Releasing lock "refresh_cache-00d34420-321b-4914-a4e0-d03965e049b3" {{(pid=120426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 10:27:09.861614 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f320a987-69d0-4173-b797-0f6c62ea4081 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "POST /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3/action" status: 202 len: 0 microversion: 2.1 time: 7.357285 Oct 24 10:27:09.866043 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 413/813] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:27:02 2022] POST /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3/action => generated 0 bytes in 7364 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 24 10:27:09.898538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-82dfc94d-d82b-44dd-88bb-bb6c8b394bc5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:09.900116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-82dfc94d-d82b-44dd-88bb-bb6c8b394bc5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:09.920644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82dfc94d-d82b-44dd-88bb-bb6c8b394bc5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:09.921500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82dfc94d-d82b-44dd-88bb-bb6c8b394bc5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:09.923606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82dfc94d-d82b-44dd-88bb-bb6c8b394bc5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:09.924489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82dfc94d-d82b-44dd-88bb-bb6c8b394bc5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:09.926913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82dfc94d-d82b-44dd-88bb-bb6c8b394bc5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:09.927370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82dfc94d-d82b-44dd-88bb-bb6c8b394bc5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:10.245074 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cd664d28-2fd0-4e95-bfff-a3c20c5b050c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "POST /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848/action" status: 202 len: 0 microversion: 2.1 time: 0.482512 Oct 24 10:27:10.246484 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 401/814] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:27:09 2022] POST /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 10:27:10.253476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-923392ff-4095-4f74-a95c-1097dd9ecdbb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Action: 'action', calling method: .version_select at 0x7f04d330adc0>, body: {"addFloatingIp": {"address": "172.25.1.200"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:10.257900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-923392ff-4095-4f74-a95c-1097dd9ecdbb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:10.275697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923392ff-4095-4f74-a95c-1097dd9ecdbb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:10.276209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923392ff-4095-4f74-a95c-1097dd9ecdbb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:10.277548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923392ff-4095-4f74-a95c-1097dd9ecdbb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:10.279150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923392ff-4095-4f74-a95c-1097dd9ecdbb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:10.279273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923392ff-4095-4f74-a95c-1097dd9ecdbb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:10.280206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923392ff-4095-4f74-a95c-1097dd9ecdbb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:10.549683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923392ff-4095-4f74-a95c-1097dd9ecdbb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "refresh_cache-2c4889ce-5a69-43f8-856a-a51289323fa8" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 10:27:10.550346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923392ff-4095-4f74-a95c-1097dd9ecdbb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquired lock "refresh_cache-2c4889ce-5a69-43f8-856a-a51289323fa8" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 10:27:11.409477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-82dfc94d-d82b-44dd-88bb-bb6c8b394bc5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:11.419949 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-82dfc94d-d82b-44dd-88bb-bb6c8b394bc5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1379 microversion: 2.1 time: 1.550088 Oct 24 10:27:11.421378 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 414/815] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:09 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1379 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:11.429711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-71f64783-48ce-4a93-bee0-f98c4866719e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d11d39d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:11.499162 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-71f64783-48ce-4a93-bee0-f98c4866719e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272" status: 200 len: 1452 microversion: 2.1 time: 0.073291 Oct 24 10:27:11.499783 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 415/816] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:11 2022] GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272 => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:11.513179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-28e538ea-a912-4e66-becd-5fbbc8784e27 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:11.514058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-28e538ea-a912-4e66-becd-5fbbc8784e27 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 0d5c6e34-f247-4f26-b237-26fc89ffc2bb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:11.521047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28e538ea-a912-4e66-becd-5fbbc8784e27 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:11.523198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28e538ea-a912-4e66-becd-5fbbc8784e27 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:11.523854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28e538ea-a912-4e66-becd-5fbbc8784e27 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:11.524811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28e538ea-a912-4e66-becd-5fbbc8784e27 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:11.525518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28e538ea-a912-4e66-becd-5fbbc8784e27 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:11.526168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28e538ea-a912-4e66-becd-5fbbc8784e27 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:12.177160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-28e538ea-a912-4e66-becd-5fbbc8784e27 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:12.187878 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-28e538ea-a912-4e66-becd-5fbbc8784e27 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb" status: 200 len: 1319 microversion: 2.1 time: 0.679106 Oct 24 10:27:12.189154 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 416/817] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:11 2022] GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb => generated 1319 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:12.256868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-ed7abb59-6d64-4be1-b76e-944400af6f2b req-a9ecbb02-cbef-4fde-9134-f55f96dd00fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d5c6e34-f247-4f26-b237-26fc89ffc2bb", "tag": "46205a92-e3a8-4bbd-95c2-a49c14bc701b"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:12.267215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ed7abb59-6d64-4be1-b76e-944400af6f2b req-a9ecbb02-cbef-4fde-9134-f55f96dd00fb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:12.267716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ed7abb59-6d64-4be1-b76e-944400af6f2b req-a9ecbb02-cbef-4fde-9134-f55f96dd00fb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:12.268130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ed7abb59-6d64-4be1-b76e-944400af6f2b req-a9ecbb02-cbef-4fde-9134-f55f96dd00fb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:12.282475 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ed7abb59-6d64-4be1-b76e-944400af6f2b req-a9ecbb02-cbef-4fde-9134-f55f96dd00fb service nova] Creating event network-changed:46205a92-e3a8-4bbd-95c2-a49c14bc701b for instance 0d5c6e34-f247-4f26-b237-26fc89ffc2bb on n-h2-858383-15 Oct 24 10:27:12.288805 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-ed7abb59-6d64-4be1-b76e-944400af6f2b req-a9ecbb02-cbef-4fde-9134-f55f96dd00fb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039207 Oct 24 10:27:12.289692 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 417/818] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:27:12.445611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bc5bb520-fbf2-4706-9670-4582753ffa06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:12.446314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bc5bb520-fbf2-4706-9670-4582753ffa06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:12.461375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc5bb520-fbf2-4706-9670-4582753ffa06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:12.463973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc5bb520-fbf2-4706-9670-4582753ffa06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:12.466413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc5bb520-fbf2-4706-9670-4582753ffa06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:12.468551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc5bb520-fbf2-4706-9670-4582753ffa06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:12.469492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc5bb520-fbf2-4706-9670-4582753ffa06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:12.470507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc5bb520-fbf2-4706-9670-4582753ffa06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:13.222076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bc5bb520-fbf2-4706-9670-4582753ffa06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:13.236421 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bc5bb520-fbf2-4706-9670-4582753ffa06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1379 microversion: 2.1 time: 0.796430 Oct 24 10:27:13.238934 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 418/819] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:12 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1379 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:27:13.251361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-98e41100-a15f-4517-98f7-4d8bcf04aacd tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d1030160>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:13.325220 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-98e41100-a15f-4517-98f7-4d8bcf04aacd tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272" status: 200 len: 1452 microversion: 2.1 time: 0.079150 Oct 24 10:27:13.325988 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 419/820] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:13 2022] GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272 => generated 1452 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:13.337970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-418a51a5-1e79-4f95-9370-c65355d93072 req-48502c08-7a22-4019-89ff-5e10e6d5b5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c18a9a-ad67-4d8e-abd2-349766d8a002", "name": "network-vif-plugged", "status": "completed", "tag": "0782d6f6-5f17-49c4-9ee3-4c8b802a9588"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:13.359284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-418a51a5-1e79-4f95-9370-c65355d93072 req-48502c08-7a22-4019-89ff-5e10e6d5b5e3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:13.359930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-418a51a5-1e79-4f95-9370-c65355d93072 req-48502c08-7a22-4019-89ff-5e10e6d5b5e3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:13.360474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-418a51a5-1e79-4f95-9370-c65355d93072 req-48502c08-7a22-4019-89ff-5e10e6d5b5e3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:13.379737 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-418a51a5-1e79-4f95-9370-c65355d93072 req-48502c08-7a22-4019-89ff-5e10e6d5b5e3 service nova] Creating event network-vif-plugged:0782d6f6-5f17-49c4-9ee3-4c8b802a9588 for instance 98c18a9a-ad67-4d8e-abd2-349766d8a002 on n-h2-858383-15 Oct 24 10:27:13.395729 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-418a51a5-1e79-4f95-9370-c65355d93072 req-48502c08-7a22-4019-89ff-5e10e6d5b5e3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061412 Oct 24 10:27:13.399126 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 420/821] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:13.698433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e97116ab-eb04-47b9-aa92-aaddeb850e65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-968593472", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "c0c03a0b-80ac-4629-802c-40f648b11429"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:13.823637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-e97116ab-eb04-47b9-aa92-aaddeb850e65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] validate_networks() for [('c0c03a0b-80ac-4629-802c-40f648b11429', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:27:16.739750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e97116ab-eb04-47b9-aa92-aaddeb850e65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:27:16.741955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e97116ab-eb04-47b9-aa92-aaddeb850e65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:27:16.742678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e97116ab-eb04-47b9-aa92-aaddeb850e65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:27:16.743353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e97116ab-eb04-47b9-aa92-aaddeb850e65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:27:16.743940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e97116ab-eb04-47b9-aa92-aaddeb850e65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:27:16.755005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e97116ab-eb04-47b9-aa92-aaddeb850e65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:16.758198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e97116ab-eb04-47b9-aa92-aaddeb850e65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:16.758997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e97116ab-eb04-47b9-aa92-aaddeb850e65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:16.759936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e97116ab-eb04-47b9-aa92-aaddeb850e65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:16.765097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e97116ab-eb04-47b9-aa92-aaddeb850e65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:16.765792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e97116ab-eb04-47b9-aa92-aaddeb850e65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:16.810262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-e97116ab-eb04-47b9-aa92-aaddeb850e65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Getting quotas for project 8a3ff02c01a64c9a940de444ca1197c4. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:27:16.822226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-e97116ab-eb04-47b9-aa92-aaddeb850e65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Getting quotas for user 43fd0499bc224bd8b190701a811ee204 and project 8a3ff02c01a64c9a940de444ca1197c4. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:27:16.858999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e97116ab-eb04-47b9-aa92-aaddeb850e65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:27:16.864615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e97116ab-eb04-47b9-aa92-aaddeb850e65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: c828266b-d510-4a99-9b08-476e19b057a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:27:16.961217 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e97116ab-eb04-47b9-aa92-aaddeb850e65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.560623 Oct 24 10:27:16.962259 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 421/822] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:27:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:27:16.967027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3f5b162a-ea0e-4891-aa4f-cde902f7d263 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:16.967654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3f5b162a-ea0e-4891-aa4f-cde902f7d263 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 0d5c6e34-f247-4f26-b237-26fc89ffc2bb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:16.974393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f5b162a-ea0e-4891-aa4f-cde902f7d263 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:16.975621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f5b162a-ea0e-4891-aa4f-cde902f7d263 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:16.976264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f5b162a-ea0e-4891-aa4f-cde902f7d263 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:16.977029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f5b162a-ea0e-4891-aa4f-cde902f7d263 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:16.977510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f5b162a-ea0e-4891-aa4f-cde902f7d263 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:16.977932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f5b162a-ea0e-4891-aa4f-cde902f7d263 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:17.893976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3f5b162a-ea0e-4891-aa4f-cde902f7d263 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:17.902714 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3f5b162a-ea0e-4891-aa4f-cde902f7d263 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb" status: 200 len: 1319 microversion: 2.1 time: 0.939289 Oct 24 10:27:17.906907 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 422/823] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:16 2022] GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb => generated 1319 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:17.912596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-20f93d00-1fc6-4e8a-88f6-917bf4013042 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:17.913546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-20f93d00-1fc6-4e8a-88f6-917bf4013042 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:17.942760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20f93d00-1fc6-4e8a-88f6-917bf4013042 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:17.943300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20f93d00-1fc6-4e8a-88f6-917bf4013042 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:17.943945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20f93d00-1fc6-4e8a-88f6-917bf4013042 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:17.947764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20f93d00-1fc6-4e8a-88f6-917bf4013042 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:17.949237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20f93d00-1fc6-4e8a-88f6-917bf4013042 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:17.950432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20f93d00-1fc6-4e8a-88f6-917bf4013042 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:18.993753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:19.170675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-20f93d00-1fc6-4e8a-88f6-917bf4013042 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:19.181280 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-20f93d00-1fc6-4e8a-88f6-917bf4013042 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1529 microversion: 2.1 time: 1.272447 Oct 24 10:27:19.208553 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 423/824] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:17 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1529 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:19.214552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-393aa4bb-f5d4-4d4e-8bd7-4517271f42a1 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0d50310>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:19.368696 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-393aa4bb-f5d4-4d4e-8bd7-4517271f42a1 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272" status: 200 len: 1452 microversion: 2.1 time: 0.157996 Oct 24 10:27:19.377729 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 424/825] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:19 2022] GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:19.383228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-afde11de-23f0-4633-a5d1-3a8114dd0c48 tempest-ServersWithSpecificFlavorTestJSON-117358791 tempest-ServersWithSpecificFlavorTestJSON-117358791-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:19.418180 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-afde11de-23f0-4633-a5d1-3a8114dd0c48 tempest-ServersWithSpecificFlavorTestJSON-117358791 tempest-ServersWithSpecificFlavorTestJSON-117358791-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/428163285" status: 202 len: 0 microversion: 2.1 time: 0.039184 Oct 24 10:27:19.425517 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 425/826] 10.222.0.50 () {58 vars in 1158 bytes} [Mon Oct 24 10:27:19 2022] DELETE /compute/v2.1/flavors/428163285 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:27:19.439011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-cb91a216-dfc4-4c70-8eb5-7436f2df87ef req-ac41af0c-eefe-44d6-b807-d1c4e2df347d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a867d805-6462-410b-9486-bffcf7a9425c", "name": "network-vif-plugged", "status": "completed", "tag": "e435d6a8-8b24-4eb0-9ebb-53775303b942"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:19.486640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cb91a216-dfc4-4c70-8eb5-7436f2df87ef req-ac41af0c-eefe-44d6-b807-d1c4e2df347d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:19.487128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cb91a216-dfc4-4c70-8eb5-7436f2df87ef req-ac41af0c-eefe-44d6-b807-d1c4e2df347d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:19.487564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cb91a216-dfc4-4c70-8eb5-7436f2df87ef req-ac41af0c-eefe-44d6-b807-d1c4e2df347d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:19.543515 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-cb91a216-dfc4-4c70-8eb5-7436f2df87ef req-ac41af0c-eefe-44d6-b807-d1c4e2df347d service nova] Creating event network-vif-plugged:e435d6a8-8b24-4eb0-9ebb-53775303b942 for instance a867d805-6462-410b-9486-bffcf7a9425c on n-h2-858383-15 Oct 24 10:27:19.555182 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-cb91a216-dfc4-4c70-8eb5-7436f2df87ef req-ac41af0c-eefe-44d6-b807-d1c4e2df347d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125309 Oct 24 10:27:19.559573 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 426/827] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:19.573597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c790c0bd-34b2-49fa-8a68-bfd952cdc94e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1388055277", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "65c79d3e-bb06-4408-bcb0-99f943a08544"}], "security_groups": [{"name": "tempest-securitygroup--1724515795"}], "key_name": "tempest-keypair-45616671", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:19.947937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-c790c0bd-34b2-49fa-8a68-bfd952cdc94e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] validate_networks() for [('65c79d3e-bb06-4408-bcb0-99f943a08544', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:27:20.242261 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.network.neutron [None req-923392ff-4095-4f74-a95c-1097dd9ecdbb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] re-assign floating IP 172.25.1.200 from instance 00d34420-321b-4914-a4e0-d03965e049b3 Oct 24 10:27:20.360022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:20.366495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-923392ff-4095-4f74-a95c-1097dd9ecdbb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Building network info cache for instance {{(pid=120425) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 10:27:21.795262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-c790c0bd-34b2-49fa-8a68-bfd952cdc94e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:27:21.795766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-c790c0bd-34b2-49fa-8a68-bfd952cdc94e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:27:21.796355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-c790c0bd-34b2-49fa-8a68-bfd952cdc94e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:27:21.796893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-c790c0bd-34b2-49fa-8a68-bfd952cdc94e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:27:21.797444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-c790c0bd-34b2-49fa-8a68-bfd952cdc94e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:27:21.818517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c790c0bd-34b2-49fa-8a68-bfd952cdc94e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:21.819961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c790c0bd-34b2-49fa-8a68-bfd952cdc94e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:21.821694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c790c0bd-34b2-49fa-8a68-bfd952cdc94e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:21.822519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c790c0bd-34b2-49fa-8a68-bfd952cdc94e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:21.822981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c790c0bd-34b2-49fa-8a68-bfd952cdc94e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:21.828635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c790c0bd-34b2-49fa-8a68-bfd952cdc94e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:21.912710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-923392ff-4095-4f74-a95c-1097dd9ecdbb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Updating instance_info_cache with network_info: [{"id": "3da84e0c-5c52-4ffa-8616-0781a71c3874", "address": "fa:16:3e:c4:e3:16", "network": {"id": "ec1a4d9a-2e78-407d-b33a-563721c9877e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-994583523-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2afb2a59a2134fe0a2903b9591cc522b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3da84e0c-5c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120425) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 10:27:21.929308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-c790c0bd-34b2-49fa-8a68-bfd952cdc94e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Getting quotas for project 115025f23db94a71b74b6adbc536792f. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:27:21.941088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-c790c0bd-34b2-49fa-8a68-bfd952cdc94e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Getting quotas for user 176a68ea281e4f65bbeac67cc304468d and project 115025f23db94a71b74b6adbc536792f. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:27:21.949395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-923392ff-4095-4f74-a95c-1097dd9ecdbb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Building network info cache for instance {{(pid=120425) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 10:27:21.973093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c790c0bd-34b2-49fa-8a68-bfd952cdc94e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:27:21.977213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c790c0bd-34b2-49fa-8a68-bfd952cdc94e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:27:22.194910 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c790c0bd-34b2-49fa-8a68-bfd952cdc94e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.633971 Oct 24 10:27:22.195571 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 427/828] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:27:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 2635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:27:22.211520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a17e981c-67da-4e39-8f87-9383b60602a6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:22.216654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a17e981c-67da-4e39-8f87-9383b60602a6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: c828266b-d510-4a99-9b08-476e19b057a7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:22.261091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:22.266553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a17e981c-67da-4e39-8f87-9383b60602a6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:22.267173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a17e981c-67da-4e39-8f87-9383b60602a6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:22.267852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a17e981c-67da-4e39-8f87-9383b60602a6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:22.269848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a17e981c-67da-4e39-8f87-9383b60602a6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:22.272500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a17e981c-67da-4e39-8f87-9383b60602a6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:22.273458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a17e981c-67da-4e39-8f87-9383b60602a6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:22.305088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:22.418230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a17e981c-67da-4e39-8f87-9383b60602a6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:22.456702 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a17e981c-67da-4e39-8f87-9383b60602a6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7" status: 200 len: 1265 microversion: 2.1 time: 0.259674 Oct 24 10:27:22.462079 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 428/829] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:22 2022] GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:22.490741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e1daea81-6376-461b-bd8d-34eae07e7d30 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:22.501276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e1daea81-6376-461b-bd8d-34eae07e7d30 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 0d5c6e34-f247-4f26-b237-26fc89ffc2bb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:22.538948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1daea81-6376-461b-bd8d-34eae07e7d30 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:22.542555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1daea81-6376-461b-bd8d-34eae07e7d30 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:22.546960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1daea81-6376-461b-bd8d-34eae07e7d30 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:22.548425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1daea81-6376-461b-bd8d-34eae07e7d30 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:22.561958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1daea81-6376-461b-bd8d-34eae07e7d30 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:22.567226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1daea81-6376-461b-bd8d-34eae07e7d30 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:22.915706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e1daea81-6376-461b-bd8d-34eae07e7d30 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:22.929720 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e1daea81-6376-461b-bd8d-34eae07e7d30 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb" status: 200 len: 1319 microversion: 2.1 time: 0.465455 Oct 24 10:27:22.946721 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 429/830] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:22 2022] GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb => generated 1319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:22.960798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-50ecf9a8-286d-4724-8e20-fb7ba6daca03 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:22.962166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-50ecf9a8-286d-4724-8e20-fb7ba6daca03 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:22.969007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50ecf9a8-286d-4724-8e20-fb7ba6daca03 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:22.969699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50ecf9a8-286d-4724-8e20-fb7ba6daca03 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:22.971112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50ecf9a8-286d-4724-8e20-fb7ba6daca03 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:22.982014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50ecf9a8-286d-4724-8e20-fb7ba6daca03 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:22.988441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50ecf9a8-286d-4724-8e20-fb7ba6daca03 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:22.992587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50ecf9a8-286d-4724-8e20-fb7ba6daca03 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:23.241579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-50ecf9a8-286d-4724-8e20-fb7ba6daca03 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:23.253733 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-50ecf9a8-286d-4724-8e20-fb7ba6daca03 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1529 microversion: 2.1 time: 0.305829 Oct 24 10:27:23.255575 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 430/831] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:22 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1529 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:23.272206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1fcbe160-b94d-4c7d-964b-4e114171dcca tempest-ServersWithSpecificFlavorTestJSON-117358791 tempest-ServersWithSpecificFlavorTestJSON-117358791-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:23.356478 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1fcbe160-b94d-4c7d-964b-4e114171dcca tempest-ServersWithSpecificFlavorTestJSON-117358791 tempest-ServersWithSpecificFlavorTestJSON-117358791-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5893 microversion: 2.1 time: 0.099000 Oct 24 10:27:23.359730 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 431/832] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:27:23 2022] GET /compute/v2.1/flavors/detail => generated 5893 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:23.367528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-e6290f2f-dcc7-4210-9c5f-bf1774239fb9 req-84594753-b912-493f-891a-3b6326ab5fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00d34420-321b-4914-a4e0-d03965e049b3", "tag": "3da84e0c-5c52-4ffa-8616-0781a71c3874"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:23.406681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e6290f2f-dcc7-4210-9c5f-bf1774239fb9 req-84594753-b912-493f-891a-3b6326ab5fc4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:23.407173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e6290f2f-dcc7-4210-9c5f-bf1774239fb9 req-84594753-b912-493f-891a-3b6326ab5fc4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:23.408005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e6290f2f-dcc7-4210-9c5f-bf1774239fb9 req-84594753-b912-493f-891a-3b6326ab5fc4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:23.424016 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-e6290f2f-dcc7-4210-9c5f-bf1774239fb9 req-84594753-b912-493f-891a-3b6326ab5fc4 service nova] Creating event network-changed:3da84e0c-5c52-4ffa-8616-0781a71c3874 for instance 00d34420-321b-4914-a4e0-d03965e049b3 on n-h1-858383-15 Oct 24 10:27:23.442953 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-e6290f2f-dcc7-4210-9c5f-bf1774239fb9 req-84594753-b912-493f-891a-3b6326ab5fc4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081697 Oct 24 10:27:23.443841 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 432/833] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:23.460114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0c34b490-3a15-43ff-895f-c9c8cfa944ad tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0e6c430>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:23.607225 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0c34b490-3a15-43ff-895f-c9c8cfa944ad tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272" status: 200 len: 1452 microversion: 2.1 time: 0.158459 Oct 24 10:27:23.610214 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 433/834] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:23 2022] GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:23.638214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-ee521343-48da-43e9-af2b-2b6e1f7ede39 req-8b4d05db-0d77-4185-852d-fc0c16d84677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f749f9-5771-4ecb-8a06-30a8f69dd848", "name": "network-vif-plugged", "status": "completed", "tag": "f48a3bd1-58ab-47af-934b-bea589ab9a0b"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:23.657722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ee521343-48da-43e9-af2b-2b6e1f7ede39 req-8b4d05db-0d77-4185-852d-fc0c16d84677 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:23.658839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ee521343-48da-43e9-af2b-2b6e1f7ede39 req-8b4d05db-0d77-4185-852d-fc0c16d84677 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:23.659739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-923392ff-4095-4f74-a95c-1097dd9ecdbb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Updating instance_info_cache with network_info: [{"id": "9102e5e7-84d8-4adf-b9b1-351fa06523c7", "address": "fa:16:3e:c7:c9:fc", "network": {"id": "ec1a4d9a-2e78-407d-b33a-563721c9877e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-994583523-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2afb2a59a2134fe0a2903b9591cc522b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9102e5e7-84", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120425) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 10:27:23.660504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ee521343-48da-43e9-af2b-2b6e1f7ede39 req-8b4d05db-0d77-4185-852d-fc0c16d84677 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:23.677367 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ee521343-48da-43e9-af2b-2b6e1f7ede39 req-8b4d05db-0d77-4185-852d-fc0c16d84677 service nova] Creating event network-vif-plugged:f48a3bd1-58ab-47af-934b-bea589ab9a0b for instance a8f749f9-5771-4ecb-8a06-30a8f69dd848 on n-h2-858383-15 Oct 24 10:27:23.686932 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-ee521343-48da-43e9-af2b-2b6e1f7ede39 req-8b4d05db-0d77-4185-852d-fc0c16d84677 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073122 Oct 24 10:27:23.688145 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 434/835] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:23.699694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-01d3996c-9246-4235-bb99-853a81ae8ac6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:23.700694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-01d3996c-9246-4235-bb99-853a81ae8ac6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:23.708779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-923392ff-4095-4f74-a95c-1097dd9ecdbb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Releasing lock "refresh_cache-2c4889ce-5a69-43f8-856a-a51289323fa8" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 10:27:23.709414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01d3996c-9246-4235-bb99-853a81ae8ac6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:23.710925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01d3996c-9246-4235-bb99-853a81ae8ac6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:23.711808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01d3996c-9246-4235-bb99-853a81ae8ac6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:23.713153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01d3996c-9246-4235-bb99-853a81ae8ac6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:23.714336 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-923392ff-4095-4f74-a95c-1097dd9ecdbb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "POST /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8/action" status: 202 len: 0 microversion: 2.1 time: 13.466234 Oct 24 10:27:23.714501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01d3996c-9246-4235-bb99-853a81ae8ac6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:23.714968 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 402/836] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:27:10 2022] POST /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8/action => generated 0 bytes in 13468 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 24 10:27:23.715270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01d3996c-9246-4235-bb99-853a81ae8ac6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:23.743328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e84c26e7-b01a-493a-b04f-a4b2a30108e7 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:23.799344 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e84c26e7-b01a-493a-b04f-a4b2a30108e7 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/e638442e-1d17-423c-8a72-107bfe635574" status: 202 len: 0 microversion: 2.1 time: 0.075905 Oct 24 10:27:23.800433 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 403/837] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:27:23 2022] DELETE /compute/v2.1/flavors/e638442e-1d17-423c-8a72-107bfe635574 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:27:23.821416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-828c5a83-2d9d-443d-8d11-78f006f8030a tempest-ServersWithSpecificFlavorTestJSON-117358791 tempest-ServersWithSpecificFlavorTestJSON-117358791-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:23.835299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-01d3996c-9246-4235-bb99-853a81ae8ac6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:23.848213 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-01d3996c-9246-4235-bb99-853a81ae8ac6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1229 microversion: 2.1 time: 0.157415 Oct 24 10:27:23.849073 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 435/838] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:23 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1229 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:23.866473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-36068251-675a-42d9-94eb-e8231a964a5e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:23.867588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-36068251-675a-42d9-94eb-e8231a964a5e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: c828266b-d510-4a99-9b08-476e19b057a7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:23.878403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36068251-675a-42d9-94eb-e8231a964a5e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:23.879261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36068251-675a-42d9-94eb-e8231a964a5e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:23.880489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36068251-675a-42d9-94eb-e8231a964a5e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:23.881683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36068251-675a-42d9-94eb-e8231a964a5e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:23.883157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36068251-675a-42d9-94eb-e8231a964a5e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:23.883980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36068251-675a-42d9-94eb-e8231a964a5e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:23.898145 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-828c5a83-2d9d-443d-8d11-78f006f8030a tempest-ServersWithSpecificFlavorTestJSON-117358791 tempest-ServersWithSpecificFlavorTestJSON-117358791-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1113362990" status: 202 len: 0 microversion: 2.1 time: 0.089475 Oct 24 10:27:23.900875 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 404/839] 10.222.0.50 () {58 vars in 1161 bytes} [Mon Oct 24 10:27:23 2022] DELETE /compute/v2.1/flavors/1113362990 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:27:23.917326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4a6defd7-1f51-4cfe-9fe9-7d58b22a4fe3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Action: 'action', calling method: .version_select at 0x7f04d31fd3a0>, body: {"removeFloatingIp": {"address": "172.25.1.200"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:24.237363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4a6defd7-1f51-4cfe-9fe9-7d58b22a4fe3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:24.246173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a6defd7-1f51-4cfe-9fe9-7d58b22a4fe3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:24.247213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a6defd7-1f51-4cfe-9fe9-7d58b22a4fe3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:24.248352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a6defd7-1f51-4cfe-9fe9-7d58b22a4fe3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:24.251269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a6defd7-1f51-4cfe-9fe9-7d58b22a4fe3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:24.253678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a6defd7-1f51-4cfe-9fe9-7d58b22a4fe3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:24.254321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a6defd7-1f51-4cfe-9fe9-7d58b22a4fe3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:24.264373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-36068251-675a-42d9-94eb-e8231a964a5e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:24.275167 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-36068251-675a-42d9-94eb-e8231a964a5e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7" status: 200 len: 1307 microversion: 2.1 time: 0.423838 Oct 24 10:27:24.279926 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 436/840] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:23 2022] GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7 => generated 1307 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:24.294004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6ad44f05-be43-44ab-8ebe-8acbaa5720bd tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:24.373994 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6ad44f05-be43-44ab-8ebe-8acbaa5720bd tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077302 Oct 24 10:27:24.374913 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 437/841] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:27:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:24.392334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-30661d4c-1c4b-4527-8304-705b8ae619f1 tempest-ServersWithSpecificFlavorTestJSON-117358791 tempest-ServersWithSpecificFlavorTestJSON-117358791-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:24.445047 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-30661d4c-1c4b-4527-8304-705b8ae619f1 tempest-ServersWithSpecificFlavorTestJSON-117358791 tempest-ServersWithSpecificFlavorTestJSON-117358791-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064312 Oct 24 10:27:24.446487 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 438/842] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:27:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:24.455262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ba07b088-0a18-444e-9684-2248c237a385 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:24.460637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ba07b088-0a18-444e-9684-2248c237a385 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 0d5c6e34-f247-4f26-b237-26fc89ffc2bb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:24.485840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba07b088-0a18-444e-9684-2248c237a385 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:24.488450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba07b088-0a18-444e-9684-2248c237a385 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:24.489583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba07b088-0a18-444e-9684-2248c237a385 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:24.493217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba07b088-0a18-444e-9684-2248c237a385 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:24.494489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba07b088-0a18-444e-9684-2248c237a385 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:24.495093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba07b088-0a18-444e-9684-2248c237a385 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:24.930527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ba07b088-0a18-444e-9684-2248c237a385 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:24.942045 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ba07b088-0a18-444e-9684-2248c237a385 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb" status: 200 len: 1319 microversion: 2.1 time: 0.490348 Oct 24 10:27:24.962388 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 439/843] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:24 2022] GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb => generated 1319 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:24.978374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-393f3f34-97a2-41a4-bb66-5bb5045199ff tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:24.985822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-393f3f34-97a2-41a4-bb66-5bb5045199ff tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:24.989437 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-4a6defd7-1f51-4cfe-9fe9-7d58b22a4fe3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] HTTP exception thrown: Floating IP 172.25.1.200 is not associated with instance 00d34420-321b-4914-a4e0-d03965e049b3. Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4a6defd7-1f51-4cfe-9fe9-7d58b22a4fe3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Request method failure captured: Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3/action HTTP/1.1 Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 49 Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmg-iAS81ByMIK8-9bLAdLa0SJt2i-vBS9i36AKrRJqZVAhGTrFdARQrrICb7Rz8SKYBFwK1FZ2c-N2gPJKnFwiQM_HXpZInwJNBgkMc1rEA2oZzHdC4_EpHvpYs33zMYC0zNK0brx_wHU-UVAfyhyXQJVko2Kk1IngPq6gSfy6k1Eo Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 2afb2a59a2134fe0a2903b9591cc522b Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1389855451 Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:27:24.992128 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:27:24.993906 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2afb2a59a2134fe0a2903b9591cc522b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2afb2a59a2134fe0a2903b9591cc522b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2afb2a59a2134fe0a2903b9591cc522b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2afb2a59a2134fe0a2903b9591cc522b", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:27:24.993906 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1389855451 Oct 24 10:27:24.993906 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 2afb2a59a2134fe0a2903b9591cc522b Oct 24 10:27:24.993906 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1389855451 Oct 24 10:27:24.993906 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-FloatingIPsAssociationTestJSON-1389855451-project Oct 24 10:27:24.993906 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:27:24.993906 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:27:24.993906 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ef304f0a2ef54385b985dd16fa1b35c8 Oct 24 10:27:24.993906 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1389855451-project Oct 24 10:27:24.993906 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:27:24.993906 n-d-858383-15 devstack@n-api.service[120425]: {"removeFloatingIp": {"address": "172.25.1.200"}} Oct 24 10:27:24.993906 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:27:24.993906 n-d-858383-15 devstack@n-api.service[120425]: exception: Floating IP 172.25.1.200 is not associated with instance 00d34420-321b-4914-a4e0-d03965e049b3. Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '00d34420-321b-4914-a4e0-d03965e049b3', 'body': {'removeFloatingIp': {'address': '172.25.1.200'}}} Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.1.200 is not associated with instance 00d34420-321b-4914-a4e0-d03965e049b3. Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:24.994800 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:24.996193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:24.996193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:24.996193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:27:24.996193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:27:24.996193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.1.200 is not associated with instance 00d34420-321b-4914-a4e0-d03965e049b3. Oct 24 10:27:24.996193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:24.996193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4a6defd7-1f51-4cfe-9fe9-7d58b22a4fe3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Returning 409 to user: Floating IP 172.25.1.200 is not associated with instance 00d34420-321b-4914-a4e0-d03965e049b3. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:27:24.996193 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4a6defd7-1f51-4cfe-9fe9-7d58b22a4fe3 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "POST /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3/action" status: 409 len: 146 microversion: 2.1 time: 1.091367 Oct 24 10:27:24.996193 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 405/844] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:27:23 2022] POST /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3/action => generated 146 bytes in 1093 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:27:25.005546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1041a500-edef-433b-9e16-cc979d731af2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:25.006326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1041a500-edef-433b-9e16-cc979d731af2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:25.023531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-393f3f34-97a2-41a4-bb66-5bb5045199ff tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:25.026115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-393f3f34-97a2-41a4-bb66-5bb5045199ff tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:25.026603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-393f3f34-97a2-41a4-bb66-5bb5045199ff tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:25.027335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-393f3f34-97a2-41a4-bb66-5bb5045199ff tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:25.027792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-393f3f34-97a2-41a4-bb66-5bb5045199ff tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:25.030031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1041a500-edef-433b-9e16-cc979d731af2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:25.030512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1041a500-edef-433b-9e16-cc979d731af2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:25.030938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1041a500-edef-433b-9e16-cc979d731af2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:25.034466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-393f3f34-97a2-41a4-bb66-5bb5045199ff tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:25.040394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1041a500-edef-433b-9e16-cc979d731af2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:25.044401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1041a500-edef-433b-9e16-cc979d731af2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:25.048752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1041a500-edef-433b-9e16-cc979d731af2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:25.116932 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-1041a500-edef-433b-9e16-cc979d731af2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] HTTP exception thrown: Instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 could not be found. Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1041a500-edef-433b-9e16-cc979d731af2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Request method failure captured: Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 HTTP/1.1 Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfWUeKzRN0TVNe25axJ80ssrODxROcyoYegQAdEaRF5R0RESt4d6kgM_8wEROfwyfTwepzBt0xV05qV7EyYeKxkqttUkKawruqTtAjJwg7JOIqn1bvx1dGiv3qtO7nFHU7sNjFsHq0JCuuewF_c1fur5hPEWZEPqe4xEIAuLKFjLIo Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 3db1d316f8d547919156c576461ed607 Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:27:25.120379 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:27:25.122283 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3db1d316f8d547919156c576461ed607"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3db1d316f8d547919156c576461ed607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3db1d316f8d547919156c576461ed607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3db1d316f8d547919156c576461ed607", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:27:25.122283 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:25.122283 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 3db1d316f8d547919156c576461ed607 Oct 24 10:27:25.122283 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:25.122283 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersWithSpecificFlavorTestJSON-961641977-project Oct 24 10:27:25.122283 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:27:25.122283 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:27:25.122283 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6a4e7f9ab1cc4c3f81d40b2c4391619f Oct 24 10:27:25.122283 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977-project Oct 24 10:27:25.122283 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:27:25.122283 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 could not be found. Oct 24 10:27:25.122283 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '5b0b8d04-8d85-4df1-a921-2ff9ef9d6424'} Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 could not be found. Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:27:25.123154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 could not be found. Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 could not be found. Oct 24 10:27:25.124645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:25.126120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1041a500-edef-433b-9e16-cc979d731af2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Returning 404 to user: Instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:27:25.127997 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1041a500-edef-433b-9e16-cc979d731af2 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424" status: 404 len: 111 microversion: 2.1 time: 0.132453 Oct 24 10:27:25.131806 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 406/845] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:27:24 2022] DELETE /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:27:25.150371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b077c245-49df-49c0-91f5-cc491b8bbb42 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0f09ee0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:25.166735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-393f3f34-97a2-41a4-bb66-5bb5045199ff tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:25.188494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-393f3f34-97a2-41a4-bb66-5bb5045199ff tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Old instance type tempest-test_resize_flavor_-736689442, new instance type m1.heat {{(pid=120426) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 24 10:27:25.212484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-393f3f34-97a2-41a4-bb66-5bb5045199ff tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:27:25.212933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-393f3f34-97a2-41a4-bb66-5bb5045199ff tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:27:25.213411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-393f3f34-97a2-41a4-bb66-5bb5045199ff tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:27:25.215140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-393f3f34-97a2-41a4-bb66-5bb5045199ff tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:27:25.216866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-393f3f34-97a2-41a4-bb66-5bb5045199ff tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:27:25.263633 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b077c245-49df-49c0-91f5-cc491b8bbb42 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272" status: 200 len: 1452 microversion: 2.1 time: 0.129276 Oct 24 10:27:25.274776 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 407/846] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:25 2022] GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272 => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:25.283187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7717407c-e2ce-466d-bcfd-44637ab4e515 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:25.286060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7717407c-e2ce-466d-bcfd-44637ab4e515 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:25.313707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7717407c-e2ce-466d-bcfd-44637ab4e515 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:25.314223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7717407c-e2ce-466d-bcfd-44637ab4e515 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:25.314663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7717407c-e2ce-466d-bcfd-44637ab4e515 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:25.319532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7717407c-e2ce-466d-bcfd-44637ab4e515 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:25.321270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7717407c-e2ce-466d-bcfd-44637ab4e515 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:25.321839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7717407c-e2ce-466d-bcfd-44637ab4e515 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:25.432540 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-393f3f34-97a2-41a4-bb66-5bb5045199ff tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "POST /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002/action" status: 202 len: 0 microversion: 2.1 time: 0.465762 Oct 24 10:27:25.433630 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 440/847] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:27:24 2022] POST /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:27:25.439524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d6d9079f-f16c-4a92-818c-370e15853839 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Action: 'action', calling method: .version_select at 0x7f04d2945e50>, body: {"removeFloatingIp": {"address": "172.25.1.200"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:25.975576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7717407c-e2ce-466d-bcfd-44637ab4e515 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:25.986648 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7717407c-e2ce-466d-bcfd-44637ab4e515 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1291 microversion: 2.1 time: 0.717009 Oct 24 10:27:25.992335 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 408/848] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:25 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1291 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:26.011455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-15ad436e-751f-4b97-893f-d8dbbb9574cc tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:26.013143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-15ad436e-751f-4b97-893f-d8dbbb9574cc tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:26.036457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15ad436e-751f-4b97-893f-d8dbbb9574cc tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:26.042149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15ad436e-751f-4b97-893f-d8dbbb9574cc tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:26.043126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15ad436e-751f-4b97-893f-d8dbbb9574cc tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:26.044114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15ad436e-751f-4b97-893f-d8dbbb9574cc tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:26.044425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15ad436e-751f-4b97-893f-d8dbbb9574cc tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:26.049226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15ad436e-751f-4b97-893f-d8dbbb9574cc tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:26.071870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:26.153516 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-15ad436e-751f-4b97-893f-d8dbbb9574cc tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] HTTP exception thrown: Instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 could not be found. Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-15ad436e-751f-4b97-893f-d8dbbb9574cc tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Request method failure captured: Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 HTTP/1.1 Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfWUeKzRN0TVNe25axJ80ssrODxROcyoYegQAdEaRF5R0RESt4d6kgM_8wEROfwyfTwepzBt0xV05qV7EyYeKxkqttUkKawruqTtAjJwg7JOIqn1bvx1dGiv3qtO7nFHU7sNjFsHq0JCuuewF_c1fur5hPEWZEPqe4xEIAuLKFjLIo Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 3db1d316f8d547919156c576461ed607 Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:27:26.159698 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:27:26.161325 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3db1d316f8d547919156c576461ed607"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3db1d316f8d547919156c576461ed607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3db1d316f8d547919156c576461ed607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3db1d316f8d547919156c576461ed607", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:27:26.161325 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:26.161325 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 3db1d316f8d547919156c576461ed607 Oct 24 10:27:26.161325 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:26.161325 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersWithSpecificFlavorTestJSON-961641977-project Oct 24 10:27:26.161325 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:27:26.161325 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:27:26.161325 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6a4e7f9ab1cc4c3f81d40b2c4391619f Oct 24 10:27:26.161325 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977-project Oct 24 10:27:26.161325 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:27:26.161325 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 could not be found. Oct 24 10:27:26.161325 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '5b0b8d04-8d85-4df1-a921-2ff9ef9d6424'} Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 could not be found. Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:27:26.162319 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:27:26.163988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:27:26.163988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:27:26.163988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:27:26.163988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:27:26.163988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:27:26.163988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:27:26.163988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:27:26.163988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 could not be found. Oct 24 10:27:26.163988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:26.163988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:26.163988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:26.163988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:26.163988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:26.163988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:26.163988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:27:26.163988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:27:26.163988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 could not be found. Oct 24 10:27:26.163988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:26.167379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-15ad436e-751f-4b97-893f-d8dbbb9574cc tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Returning 404 to user: Instance 5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:27:26.171330 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-15ad436e-751f-4b97-893f-d8dbbb9574cc tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424" status: 404 len: 111 microversion: 2.1 time: 0.176738 Oct 24 10:27:26.172581 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 409/849] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:25 2022] GET /compute/v2.1/servers/5b0b8d04-8d85-4df1-a921-2ff9ef9d6424 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:27:26.181746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b3e8fb5a-024e-44b8-b863-d239ade64d08 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:26.205927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b3e8fb5a-024e-44b8-b863-d239ade64d08 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: c828266b-d510-4a99-9b08-476e19b057a7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:26.246161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3e8fb5a-024e-44b8-b863-d239ade64d08 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:26.247251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3e8fb5a-024e-44b8-b863-d239ade64d08 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:26.253717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3e8fb5a-024e-44b8-b863-d239ade64d08 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:26.259101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3e8fb5a-024e-44b8-b863-d239ade64d08 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:26.259773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3e8fb5a-024e-44b8-b863-d239ade64d08 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:26.260327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3e8fb5a-024e-44b8-b863-d239ade64d08 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:26.625303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d6d9079f-f16c-4a92-818c-370e15853839 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:26.654841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6d9079f-f16c-4a92-818c-370e15853839 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:26.655374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6d9079f-f16c-4a92-818c-370e15853839 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:26.656736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6d9079f-f16c-4a92-818c-370e15853839 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:26.658475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6d9079f-f16c-4a92-818c-370e15853839 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:26.659388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6d9079f-f16c-4a92-818c-370e15853839 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:26.661192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6d9079f-f16c-4a92-818c-370e15853839 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:27.860055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b3e8fb5a-024e-44b8-b863-d239ade64d08 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:27.874112 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b3e8fb5a-024e-44b8-b863-d239ade64d08 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7" status: 200 len: 1307 microversion: 2.1 time: 1.697460 Oct 24 10:27:27.877458 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 410/850] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:26 2022] GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7 => generated 1307 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:27.897306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-92d146bc-c8fc-459b-9028-e91b2e639c58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:27.898200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-92d146bc-c8fc-459b-9028-e91b2e639c58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:27.920892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92d146bc-c8fc-459b-9028-e91b2e639c58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:27.921851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92d146bc-c8fc-459b-9028-e91b2e639c58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:27.923549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92d146bc-c8fc-459b-9028-e91b2e639c58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:27.924316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92d146bc-c8fc-459b-9028-e91b2e639c58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:27.925813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92d146bc-c8fc-459b-9028-e91b2e639c58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:27.929653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92d146bc-c8fc-459b-9028-e91b2e639c58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:28.300394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6d9079f-f16c-4a92-818c-370e15853839 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "refresh_cache-2c4889ce-5a69-43f8-856a-a51289323fa8" {{(pid=120426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 10:27:28.301102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6d9079f-f16c-4a92-818c-370e15853839 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquired lock "refresh_cache-2c4889ce-5a69-43f8-856a-a51289323fa8" {{(pid=120426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 10:27:28.422671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-92d146bc-c8fc-459b-9028-e91b2e639c58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:28.438908 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-92d146bc-c8fc-459b-9028-e91b2e639c58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1538 microversion: 2.1 time: 0.559462 Oct 24 10:27:28.439989 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 411/851] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:27 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1538 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:28.448905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ca853852-0f0e-4d56-8811-03e89cd56f2e req-6be88909-5352-4033-85bd-36f7655a8c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c4889ce-5a69-43f8-856a-a51289323fa8", "tag": "9102e5e7-84d8-4adf-b9b1-351fa06523c7"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:28.473591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ca853852-0f0e-4d56-8811-03e89cd56f2e req-6be88909-5352-4033-85bd-36f7655a8c71 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:28.477279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ca853852-0f0e-4d56-8811-03e89cd56f2e req-6be88909-5352-4033-85bd-36f7655a8c71 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:28.480041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ca853852-0f0e-4d56-8811-03e89cd56f2e req-6be88909-5352-4033-85bd-36f7655a8c71 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:28.503395 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ca853852-0f0e-4d56-8811-03e89cd56f2e req-6be88909-5352-4033-85bd-36f7655a8c71 service nova] Creating event network-changed:9102e5e7-84d8-4adf-b9b1-351fa06523c7 for instance 2c4889ce-5a69-43f8-856a-a51289323fa8 on n-h1-858383-15 Oct 24 10:27:28.538957 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ca853852-0f0e-4d56-8811-03e89cd56f2e req-6be88909-5352-4033-85bd-36f7655a8c71 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096191 Oct 24 10:27:28.540000 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 412/852] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:28.558809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-70c623ba-99d9-402e-9de2-cd6562278e80 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:28.561798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-70c623ba-99d9-402e-9de2-cd6562278e80 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 0d5c6e34-f247-4f26-b237-26fc89ffc2bb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:28.577313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70c623ba-99d9-402e-9de2-cd6562278e80 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:28.583157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70c623ba-99d9-402e-9de2-cd6562278e80 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:28.584674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70c623ba-99d9-402e-9de2-cd6562278e80 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:28.585997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70c623ba-99d9-402e-9de2-cd6562278e80 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:28.607413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70c623ba-99d9-402e-9de2-cd6562278e80 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:28.608405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70c623ba-99d9-402e-9de2-cd6562278e80 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:30.336896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-70c623ba-99d9-402e-9de2-cd6562278e80 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:30.344745 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-70c623ba-99d9-402e-9de2-cd6562278e80 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb" status: 200 len: 1319 microversion: 2.1 time: 1.801476 Oct 24 10:27:30.350997 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 413/853] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:28 2022] GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb => generated 1319 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:30.360029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f024aa72-54e4-43e8-b39d-c88f0bc8dd4d tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:30.365143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f024aa72-54e4-43e8-b39d-c88f0bc8dd4d tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:30.374315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f024aa72-54e4-43e8-b39d-c88f0bc8dd4d tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:30.385571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f024aa72-54e4-43e8-b39d-c88f0bc8dd4d tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:30.386139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f024aa72-54e4-43e8-b39d-c88f0bc8dd4d tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:30.387261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f024aa72-54e4-43e8-b39d-c88f0bc8dd4d tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:30.387805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f024aa72-54e4-43e8-b39d-c88f0bc8dd4d tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:30.388323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f024aa72-54e4-43e8-b39d-c88f0bc8dd4d tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:30.404914 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-f024aa72-54e4-43e8-b39d-c88f0bc8dd4d tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] HTTP exception thrown: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f024aa72-54e4-43e8-b39d-c88f0bc8dd4d tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Request method failure captured: Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f HTTP/1.1 Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfWUeKzRN0TVNe25axJ80ssrODxROcyoYegQAdEaRF5R0RESt4d6kgM_8wEROfwyfTwepzBt0xV05qV7EyYeKxkqttUkKawruqTtAjJwg7JOIqn1bvx1dGiv3qtO7nFHU7sNjFsHq0JCuuewF_c1fur5hPEWZEPqe4xEIAuLKFjLIo Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 3db1d316f8d547919156c576461ed607 Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:27:30.408866 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:27:30.410158 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3db1d316f8d547919156c576461ed607"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3db1d316f8d547919156c576461ed607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3db1d316f8d547919156c576461ed607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3db1d316f8d547919156c576461ed607", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:27:30.410158 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:30.410158 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 3db1d316f8d547919156c576461ed607 Oct 24 10:27:30.410158 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:30.410158 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersWithSpecificFlavorTestJSON-961641977-project Oct 24 10:27:30.410158 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:27:30.410158 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:27:30.410158 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6a4e7f9ab1cc4c3f81d40b2c4391619f Oct 24 10:27:30.410158 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977-project Oct 24 10:27:30.410158 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:27:30.410158 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:30.410158 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'ad6067c8-26ae-4e5f-a747-8d9e5f720a4f'} Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:27:30.410943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:30.412539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:30.415345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f024aa72-54e4-43e8-b39d-c88f0bc8dd4d tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Returning 404 to user: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:27:30.417596 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f024aa72-54e4-43e8-b39d-c88f0bc8dd4d tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 404 len: 111 microversion: 2.1 time: 0.064378 Oct 24 10:27:30.421535 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 414/854] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:27:30 2022] DELETE /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:27:30.433527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e59298b-841f-4a1e-8bb4-90171be7f53a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d12c5940>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:30.530307 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5e59298b-841f-4a1e-8bb4-90171be7f53a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272" status: 200 len: 1452 microversion: 2.1 time: 0.107390 Oct 24 10:27:30.530881 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 415/855] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:30 2022] GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:30.553463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b18c2b74-8196-4f96-a516-ec4eaecbea1c req-92c610e9-c82e-4734-84f9-e2a7ee991080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c828266b-d510-4a99-9b08-476e19b057a7", "tag": "08217d41-f854-428a-9793-2feb95de04df"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:30.571953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b18c2b74-8196-4f96-a516-ec4eaecbea1c req-92c610e9-c82e-4734-84f9-e2a7ee991080 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:30.572675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b18c2b74-8196-4f96-a516-ec4eaecbea1c req-92c610e9-c82e-4734-84f9-e2a7ee991080 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:30.573311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b18c2b74-8196-4f96-a516-ec4eaecbea1c req-92c610e9-c82e-4734-84f9-e2a7ee991080 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:30.595383 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b18c2b74-8196-4f96-a516-ec4eaecbea1c req-92c610e9-c82e-4734-84f9-e2a7ee991080 service nova] Creating event network-changed:08217d41-f854-428a-9793-2feb95de04df for instance c828266b-d510-4a99-9b08-476e19b057a7 on n-h1-858383-15 Oct 24 10:27:30.604925 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b18c2b74-8196-4f96-a516-ec4eaecbea1c req-92c610e9-c82e-4734-84f9-e2a7ee991080 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059721 Oct 24 10:27:30.605844 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 416/856] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:30.610872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-263e0528-c271-46b8-b7c8-02543c7b6f24 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:30.612197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-263e0528-c271-46b8-b7c8-02543c7b6f24 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:30.622993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-263e0528-c271-46b8-b7c8-02543c7b6f24 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:30.623486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-263e0528-c271-46b8-b7c8-02543c7b6f24 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:30.623923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-263e0528-c271-46b8-b7c8-02543c7b6f24 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:30.628525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-263e0528-c271-46b8-b7c8-02543c7b6f24 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:30.629705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-263e0528-c271-46b8-b7c8-02543c7b6f24 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:30.630307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-263e0528-c271-46b8-b7c8-02543c7b6f24 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:31.039767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-263e0528-c271-46b8-b7c8-02543c7b6f24 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:31.063485 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-263e0528-c271-46b8-b7c8-02543c7b6f24 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1359 microversion: 2.1 time: 0.456395 Oct 24 10:27:31.083136 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 417/857] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:30 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1359 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:31.111149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-247cf9b7-297a-4568-a8b5-0f6bfc96b964 req-94ac8b72-7916-4bba-adca-9acc261777d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5c6e34-f247-4f26-b237-26fc89ffc2bb", "name": "network-vif-plugged", "status": "completed", "tag": "46205a92-e3a8-4bbd-95c2-a49c14bc701b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:31.143314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-247cf9b7-297a-4568-a8b5-0f6bfc96b964 req-94ac8b72-7916-4bba-adca-9acc261777d8 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:31.144215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-247cf9b7-297a-4568-a8b5-0f6bfc96b964 req-94ac8b72-7916-4bba-adca-9acc261777d8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:31.144668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-247cf9b7-297a-4568-a8b5-0f6bfc96b964 req-94ac8b72-7916-4bba-adca-9acc261777d8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:31.180578 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-247cf9b7-297a-4568-a8b5-0f6bfc96b964 req-94ac8b72-7916-4bba-adca-9acc261777d8 service nova] Creating event network-vif-plugged:46205a92-e3a8-4bbd-95c2-a49c14bc701b for instance 0d5c6e34-f247-4f26-b237-26fc89ffc2bb on n-h2-858383-15 Oct 24 10:27:31.196785 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-247cf9b7-297a-4568-a8b5-0f6bfc96b964 req-94ac8b72-7916-4bba-adca-9acc261777d8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108936 Oct 24 10:27:31.197991 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 418/858] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:31.213900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eaf5ec66-8562-4b1d-bfa0-2d1cd069be11 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:31.215450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eaf5ec66-8562-4b1d-bfa0-2d1cd069be11 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: c828266b-d510-4a99-9b08-476e19b057a7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:31.239137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eaf5ec66-8562-4b1d-bfa0-2d1cd069be11 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:31.239875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eaf5ec66-8562-4b1d-bfa0-2d1cd069be11 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:31.241241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eaf5ec66-8562-4b1d-bfa0-2d1cd069be11 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:31.242178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eaf5ec66-8562-4b1d-bfa0-2d1cd069be11 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:31.242938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eaf5ec66-8562-4b1d-bfa0-2d1cd069be11 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:31.243513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eaf5ec66-8562-4b1d-bfa0-2d1cd069be11 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:31.586584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eaf5ec66-8562-4b1d-bfa0-2d1cd069be11 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:31.596822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-d6d9079f-f16c-4a92-818c-370e15853839 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Building network info cache for instance {{(pid=120426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 10:27:31.598822 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eaf5ec66-8562-4b1d-bfa0-2d1cd069be11 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7" status: 200 len: 1307 microversion: 2.1 time: 0.398411 Oct 24 10:27:31.617271 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 419/859] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:31 2022] GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7 => generated 1307 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:31.632716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1dfe9be4-ed8f-4330-943d-37ce51910829 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:31.633627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1dfe9be4-ed8f-4330-943d-37ce51910829 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:31.682900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dfe9be4-ed8f-4330-943d-37ce51910829 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:31.683692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dfe9be4-ed8f-4330-943d-37ce51910829 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:31.684315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dfe9be4-ed8f-4330-943d-37ce51910829 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:31.685234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dfe9be4-ed8f-4330-943d-37ce51910829 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:31.685835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dfe9be4-ed8f-4330-943d-37ce51910829 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:31.686405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dfe9be4-ed8f-4330-943d-37ce51910829 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:31.883825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:31.966515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=12 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:32.216386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1dfe9be4-ed8f-4330-943d-37ce51910829 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:32.227982 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1dfe9be4-ed8f-4330-943d-37ce51910829 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1538 microversion: 2.1 time: 0.609252 Oct 24 10:27:32.230541 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 420/860] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:31 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1538 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:32.266089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c33b3b68-227f-49fc-88bb-c3d34c1ed298 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:32.267376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c33b3b68-227f-49fc-88bb-c3d34c1ed298 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] [instance: ad6067c8-26ae-4e5f-a747-8d9e5f720a4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:32.274951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c33b3b68-227f-49fc-88bb-c3d34c1ed298 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:32.276575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c33b3b68-227f-49fc-88bb-c3d34c1ed298 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:32.280502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c33b3b68-227f-49fc-88bb-c3d34c1ed298 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:32.281604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c33b3b68-227f-49fc-88bb-c3d34c1ed298 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:32.282396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c33b3b68-227f-49fc-88bb-c3d34c1ed298 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:32.283048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c33b3b68-227f-49fc-88bb-c3d34c1ed298 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:32.319685 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-c33b3b68-227f-49fc-88bb-c3d34c1ed298 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] HTTP exception thrown: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c33b3b68-227f-49fc-88bb-c3d34c1ed298 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Request method failure captured: Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f HTTP/1.1 Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfWUeKzRN0TVNe25axJ80ssrODxROcyoYegQAdEaRF5R0RESt4d6kgM_8wEROfwyfTwepzBt0xV05qV7EyYeKxkqttUkKawruqTtAjJwg7JOIqn1bvx1dGiv3qtO7nFHU7sNjFsHq0JCuuewF_c1fur5hPEWZEPqe4xEIAuLKFjLIo Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 3db1d316f8d547919156c576461ed607 Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:27:32.322248 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:27:32.323705 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3db1d316f8d547919156c576461ed607"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3db1d316f8d547919156c576461ed607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3db1d316f8d547919156c576461ed607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3db1d316f8d547919156c576461ed607", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:27:32.323705 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:32.323705 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 3db1d316f8d547919156c576461ed607 Oct 24 10:27:32.323705 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977 Oct 24 10:27:32.323705 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersWithSpecificFlavorTestJSON-961641977-project Oct 24 10:27:32.323705 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:27:32.323705 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:27:32.323705 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6a4e7f9ab1cc4c3f81d40b2c4391619f Oct 24 10:27:32.323705 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-961641977-project Oct 24 10:27:32.323705 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:27:32.323705 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:32.323705 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'ad6067c8-26ae-4e5f-a747-8d9e5f720a4f'} Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:27:32.324649 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:27:32.325930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:27:32.325930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:27:32.325930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:27:32.325930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:27:32.325930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:27:32.325930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:27:32.325930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:27:32.325930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:32.325930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:32.325930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:32.325930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:32.325930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:32.325930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:32.325930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:32.325930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:27:32.325930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:27:32.325930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. Oct 24 10:27:32.325930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:32.330309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c33b3b68-227f-49fc-88bb-c3d34c1ed298 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] Returning 404 to user: Instance ad6067c8-26ae-4e5f-a747-8d9e5f720a4f could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:27:32.331415 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c33b3b68-227f-49fc-88bb-c3d34c1ed298 tempest-ServersWithSpecificFlavorTestJSON-961641977 tempest-ServersWithSpecificFlavorTestJSON-961641977-project] 10.222.0.50 "GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f" status: 404 len: 111 microversion: 2.1 time: 0.080982 Oct 24 10:27:32.332560 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 421/861] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:32 2022] GET /compute/v2.1/servers/ad6067c8-26ae-4e5f-a747-8d9e5f720a4f => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:27:32.337547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-12497f29-8250-4c4f-b2c2-25a70ad0a83a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:32.338937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-12497f29-8250-4c4f-b2c2-25a70ad0a83a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 0d5c6e34-f247-4f26-b237-26fc89ffc2bb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:32.346584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12497f29-8250-4c4f-b2c2-25a70ad0a83a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:32.347361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12497f29-8250-4c4f-b2c2-25a70ad0a83a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:32.348018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12497f29-8250-4c4f-b2c2-25a70ad0a83a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:32.349481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12497f29-8250-4c4f-b2c2-25a70ad0a83a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:32.350214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12497f29-8250-4c4f-b2c2-25a70ad0a83a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:32.350854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12497f29-8250-4c4f-b2c2-25a70ad0a83a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:33.504728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-12497f29-8250-4c4f-b2c2-25a70ad0a83a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:33.516664 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-12497f29-8250-4c4f-b2c2-25a70ad0a83a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb" status: 200 len: 1319 microversion: 2.1 time: 1.182744 Oct 24 10:27:33.519030 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 422/862] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:32 2022] GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb => generated 1319 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:33.529425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa38f86b-ae87-41cd-96ed-71dd555d6fab tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d114c040>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:33.614104 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa38f86b-ae87-41cd-96ed-71dd555d6fab tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272" status: 200 len: 1452 microversion: 2.1 time: 0.093917 Oct 24 10:27:33.615139 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 423/863] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:33 2022] GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272 => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:33.626878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b587b2ed-a38d-4a1e-939b-57495693b979 req-89df3ab3-3ae1-41e5-bbb7-8f0e4542180b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c4889ce-5a69-43f8-856a-a51289323fa8", "tag": "9102e5e7-84d8-4adf-b9b1-351fa06523c7"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:33.667262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b587b2ed-a38d-4a1e-939b-57495693b979 req-89df3ab3-3ae1-41e5-bbb7-8f0e4542180b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:33.668474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b587b2ed-a38d-4a1e-939b-57495693b979 req-89df3ab3-3ae1-41e5-bbb7-8f0e4542180b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:33.669229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b587b2ed-a38d-4a1e-939b-57495693b979 req-89df3ab3-3ae1-41e5-bbb7-8f0e4542180b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:33.687653 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b587b2ed-a38d-4a1e-939b-57495693b979 req-89df3ab3-3ae1-41e5-bbb7-8f0e4542180b service nova] Creating event network-changed:9102e5e7-84d8-4adf-b9b1-351fa06523c7 for instance 2c4889ce-5a69-43f8-856a-a51289323fa8 on n-h1-858383-15 Oct 24 10:27:33.706580 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b587b2ed-a38d-4a1e-939b-57495693b979 req-89df3ab3-3ae1-41e5-bbb7-8f0e4542180b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087817 Oct 24 10:27:33.711301 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 424/864] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:33.717452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-11f59a99-71f8-4bde-88d9-e366e85e566f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:33.718548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-11f59a99-71f8-4bde-88d9-e366e85e566f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:33.732424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11f59a99-71f8-4bde-88d9-e366e85e566f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:33.735204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11f59a99-71f8-4bde-88d9-e366e85e566f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:33.735905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11f59a99-71f8-4bde-88d9-e366e85e566f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:33.737404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11f59a99-71f8-4bde-88d9-e366e85e566f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:33.738391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11f59a99-71f8-4bde-88d9-e366e85e566f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:33.739098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11f59a99-71f8-4bde-88d9-e366e85e566f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:34.107047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-d6d9079f-f16c-4a92-818c-370e15853839 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Updating instance_info_cache with network_info: [{"id": "9102e5e7-84d8-4adf-b9b1-351fa06523c7", "address": "fa:16:3e:c7:c9:fc", "network": {"id": "ec1a4d9a-2e78-407d-b33a-563721c9877e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-994583523-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2afb2a59a2134fe0a2903b9591cc522b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9102e5e7-84", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 10:27:34.116264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6d9079f-f16c-4a92-818c-370e15853839 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Releasing lock "refresh_cache-2c4889ce-5a69-43f8-856a-a51289323fa8" {{(pid=120426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 10:27:34.117158 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d6d9079f-f16c-4a92-818c-370e15853839 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "POST /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8/action" status: 202 len: 0 microversion: 2.1 time: 8.681842 Oct 24 10:27:34.117781 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 441/865] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:27:25 2022] POST /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8/action => generated 0 bytes in 8684 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 24 10:27:34.129764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cb3eba65-f6b2-4dbd-a0f5-b8aae8ede34f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:34.130606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cb3eba65-f6b2-4dbd-a0f5-b8aae8ede34f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: c828266b-d510-4a99-9b08-476e19b057a7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:34.142942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-11f59a99-71f8-4bde-88d9-e366e85e566f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:34.151057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb3eba65-f6b2-4dbd-a0f5-b8aae8ede34f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:34.152007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb3eba65-f6b2-4dbd-a0f5-b8aae8ede34f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:34.152610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb3eba65-f6b2-4dbd-a0f5-b8aae8ede34f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:34.154567 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-11f59a99-71f8-4bde-88d9-e366e85e566f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1359 microversion: 2.1 time: 0.441373 Oct 24 10:27:34.155479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb3eba65-f6b2-4dbd-a0f5-b8aae8ede34f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:34.156129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb3eba65-f6b2-4dbd-a0f5-b8aae8ede34f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:34.157417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb3eba65-f6b2-4dbd-a0f5-b8aae8ede34f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:34.159517 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 425/866] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:33 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1359 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:34.164577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d07a8951-61df-4eab-ab8d-9f17aea9af47 req-3abd7599-dcab-4025-9175-e810c63ab6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9eff099-cc37-4432-8741-4e7d179b9ff0", "tag": "e5f5ae43-f478-4bd6-8b05-04ea1b1ab6c2"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:34.191683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d07a8951-61df-4eab-ab8d-9f17aea9af47 req-3abd7599-dcab-4025-9175-e810c63ab6a2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:34.194169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d07a8951-61df-4eab-ab8d-9f17aea9af47 req-3abd7599-dcab-4025-9175-e810c63ab6a2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:34.196085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d07a8951-61df-4eab-ab8d-9f17aea9af47 req-3abd7599-dcab-4025-9175-e810c63ab6a2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:34.215595 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d07a8951-61df-4eab-ab8d-9f17aea9af47 req-3abd7599-dcab-4025-9175-e810c63ab6a2 service nova] Creating event network-changed:e5f5ae43-f478-4bd6-8b05-04ea1b1ab6c2 for instance b9eff099-cc37-4432-8741-4e7d179b9ff0 on n-h2-858383-15 Oct 24 10:27:34.221450 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d07a8951-61df-4eab-ab8d-9f17aea9af47 req-3abd7599-dcab-4025-9175-e810c63ab6a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060364 Oct 24 10:27:34.222996 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 426/867] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:34.229466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a6c1a728-a3ae-4d4e-9667-20e787f33ce5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:34.230398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a6c1a728-a3ae-4d4e-9667-20e787f33ce5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:34.238416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6c1a728-a3ae-4d4e-9667-20e787f33ce5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:34.239221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6c1a728-a3ae-4d4e-9667-20e787f33ce5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:34.239909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6c1a728-a3ae-4d4e-9667-20e787f33ce5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:34.241616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6c1a728-a3ae-4d4e-9667-20e787f33ce5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:34.242510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6c1a728-a3ae-4d4e-9667-20e787f33ce5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:34.243162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6c1a728-a3ae-4d4e-9667-20e787f33ce5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:34.755187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a6c1a728-a3ae-4d4e-9667-20e787f33ce5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:34.770298 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a6c1a728-a3ae-4d4e-9667-20e787f33ce5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1538 microversion: 2.1 time: 0.545691 Oct 24 10:27:34.773051 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 427/868] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:34 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1538 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:34.783252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-82f70758-5fd3-4b7e-bbf4-626832ab616d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:34.784569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-82f70758-5fd3-4b7e-bbf4-626832ab616d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:34.796512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82f70758-5fd3-4b7e-bbf4-626832ab616d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:34.800749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82f70758-5fd3-4b7e-bbf4-626832ab616d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:34.802054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82f70758-5fd3-4b7e-bbf4-626832ab616d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:34.804492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82f70758-5fd3-4b7e-bbf4-626832ab616d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:34.806193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82f70758-5fd3-4b7e-bbf4-626832ab616d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:34.808602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82f70758-5fd3-4b7e-bbf4-626832ab616d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:34.825029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cb3eba65-f6b2-4dbd-a0f5-b8aae8ede34f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:34.839152 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cb3eba65-f6b2-4dbd-a0f5-b8aae8ede34f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7" status: 200 len: 1307 microversion: 2.1 time: 0.720217 Oct 24 10:27:34.843630 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 442/869] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:34 2022] GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7 => generated 1307 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:34.861753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-82f70758-5fd3-4b7e-bbf4-626832ab616d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:27:35.043962 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-82f70758-5fd3-4b7e-bbf4-626832ab616d tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8" status: 204 len: 0 microversion: 2.1 time: 0.268669 Oct 24 10:27:35.044696 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 428/870] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:27:34 2022] DELETE /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:27:35.062852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9bcfe3a0-debb-4aeb-8907-940844ecacbd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:35.065080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9bcfe3a0-debb-4aeb-8907-940844ecacbd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 0d5c6e34-f247-4f26-b237-26fc89ffc2bb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:35.085941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bcfe3a0-debb-4aeb-8907-940844ecacbd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:35.092428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bcfe3a0-debb-4aeb-8907-940844ecacbd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:35.093148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bcfe3a0-debb-4aeb-8907-940844ecacbd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:35.096018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bcfe3a0-debb-4aeb-8907-940844ecacbd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:35.096639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bcfe3a0-debb-4aeb-8907-940844ecacbd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:35.099237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bcfe3a0-debb-4aeb-8907-940844ecacbd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:35.135985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cc661ef6-7ecb-4b2f-8cc7-9aa060e987eb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-750746254", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "979ef371-392f-454f-8dbb-ad9320d9a120"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:35.265829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-cc661ef6-7ecb-4b2f-8cc7-9aa060e987eb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] validate_networks() for [('979ef371-392f-454f-8dbb-ad9320d9a120', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:27:36.101305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9bcfe3a0-debb-4aeb-8907-940844ecacbd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:36.114105 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9bcfe3a0-debb-4aeb-8907-940844ecacbd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb" status: 200 len: 1469 microversion: 2.1 time: 1.068116 Oct 24 10:27:36.118132 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 429/871] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:35 2022] GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb => generated 1469 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:36.132914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-007337b1-47b9-4655-82a6-fbfe89251645 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0f933a0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:36.253322 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-007337b1-47b9-4655-82a6-fbfe89251645 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272" status: 200 len: 1452 microversion: 2.1 time: 0.133318 Oct 24 10:27:36.254040 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 430/872] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:36 2022] GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272 => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:36.269588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-cc661ef6-7ecb-4b2f-8cc7-9aa060e987eb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:27:36.270139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-cc661ef6-7ecb-4b2f-8cc7-9aa060e987eb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:27:36.271324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-cc661ef6-7ecb-4b2f-8cc7-9aa060e987eb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:27:36.273051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-cc661ef6-7ecb-4b2f-8cc7-9aa060e987eb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:27:36.273735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-cc661ef6-7ecb-4b2f-8cc7-9aa060e987eb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:27:36.301820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad366ffc-61f4-4500-889f-860b42604366 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.200"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:36.329434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad366ffc-61f4-4500-889f-860b42604366 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:36.330811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc661ef6-7ecb-4b2f-8cc7-9aa060e987eb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:36.333472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc661ef6-7ecb-4b2f-8cc7-9aa060e987eb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:36.334203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc661ef6-7ecb-4b2f-8cc7-9aa060e987eb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:36.345837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc661ef6-7ecb-4b2f-8cc7-9aa060e987eb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:36.346334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc661ef6-7ecb-4b2f-8cc7-9aa060e987eb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:36.347283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc661ef6-7ecb-4b2f-8cc7-9aa060e987eb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:36.348892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad366ffc-61f4-4500-889f-860b42604366 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:36.349879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad366ffc-61f4-4500-889f-860b42604366 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:36.350524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad366ffc-61f4-4500-889f-860b42604366 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:36.353293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad366ffc-61f4-4500-889f-860b42604366 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:36.354182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad366ffc-61f4-4500-889f-860b42604366 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:36.354802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad366ffc-61f4-4500-889f-860b42604366 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:36.395250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-cc661ef6-7ecb-4b2f-8cc7-9aa060e987eb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Getting quotas for project 9f2d317e42584b41b11c1668de6657bd. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:27:36.404120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-cc661ef6-7ecb-4b2f-8cc7-9aa060e987eb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Getting quotas for user 66ca4f9e7ffb447ebf740c52f6a098c2 and project 9f2d317e42584b41b11c1668de6657bd. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:27:36.421297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad366ffc-61f4-4500-889f-860b42604366 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "refresh_cache-00d34420-321b-4914-a4e0-d03965e049b3" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 10:27:36.421702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad366ffc-61f4-4500-889f-860b42604366 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquired lock "refresh_cache-00d34420-321b-4914-a4e0-d03965e049b3" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 10:27:36.425077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cc661ef6-7ecb-4b2f-8cc7-9aa060e987eb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:27:36.433313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cc661ef6-7ecb-4b2f-8cc7-9aa060e987eb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:27:36.515838 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cc661ef6-7ecb-4b2f-8cc7-9aa060e987eb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.670460 Oct 24 10:27:36.516802 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 443/873] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Oct 24 10:27:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1672 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 10:27:36.530632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9a56efa9-dbcc-4bb2-81c6-398d0a57ac2d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:36.531634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9a56efa9-dbcc-4bb2-81c6-398d0a57ac2d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:36.549116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a56efa9-dbcc-4bb2-81c6-398d0a57ac2d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:36.551774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a56efa9-dbcc-4bb2-81c6-398d0a57ac2d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:36.552521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a56efa9-dbcc-4bb2-81c6-398d0a57ac2d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:36.554074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a56efa9-dbcc-4bb2-81c6-398d0a57ac2d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:36.557114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a56efa9-dbcc-4bb2-81c6-398d0a57ac2d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:36.561175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a56efa9-dbcc-4bb2-81c6-398d0a57ac2d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:37.801116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9a56efa9-dbcc-4bb2-81c6-398d0a57ac2d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:37.825277 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9a56efa9-dbcc-4bb2-81c6-398d0a57ac2d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1359 microversion: 2.1 time: 1.304867 Oct 24 10:27:37.843447 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 444/874] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:36 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1359 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:37.850013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fc6679e2-ce15-44d5-bb09-39a8574b980f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:37.854885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fc6679e2-ce15-44d5-bb09-39a8574b980f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:37.870861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fc6679e2-ce15-44d5-bb09-39a8574b980f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:37.872417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fc6679e2-ce15-44d5-bb09-39a8574b980f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:37.874170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fc6679e2-ce15-44d5-bb09-39a8574b980f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:37.877225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fc6679e2-ce15-44d5-bb09-39a8574b980f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:37.878291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fc6679e2-ce15-44d5-bb09-39a8574b980f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:37.879979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fc6679e2-ce15-44d5-bb09-39a8574b980f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:38.573382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fc6679e2-ce15-44d5-bb09-39a8574b980f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:38.585892 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fc6679e2-ce15-44d5-bb09-39a8574b980f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1543 microversion: 2.1 time: 0.740716 Oct 24 10:27:38.592307 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 445/875] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:37 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1543 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:38.611031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8c8a64a0-2aeb-4559-9778-d683f9581e9c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:38.612341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8c8a64a0-2aeb-4559-9778-d683f9581e9c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: c828266b-d510-4a99-9b08-476e19b057a7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:38.630473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c8a64a0-2aeb-4559-9778-d683f9581e9c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:38.631331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c8a64a0-2aeb-4559-9778-d683f9581e9c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:38.633367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c8a64a0-2aeb-4559-9778-d683f9581e9c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:38.634260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c8a64a0-2aeb-4559-9778-d683f9581e9c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:38.637043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c8a64a0-2aeb-4559-9778-d683f9581e9c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:38.639033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c8a64a0-2aeb-4559-9778-d683f9581e9c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:39.107909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8c8a64a0-2aeb-4559-9778-d683f9581e9c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:39.124705 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8c8a64a0-2aeb-4559-9778-d683f9581e9c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7" status: 200 len: 1307 microversion: 2.1 time: 0.527904 Oct 24 10:27:39.125939 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 446/876] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:38 2022] GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7 => generated 1307 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:39.144108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54478c39-9cde-4ee0-b6ec-424f9f92dfdb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:39.145176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-54478c39-9cde-4ee0-b6ec-424f9f92dfdb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: a867d805-6462-410b-9486-bffcf7a9425c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:39.160273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54478c39-9cde-4ee0-b6ec-424f9f92dfdb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:39.161077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54478c39-9cde-4ee0-b6ec-424f9f92dfdb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:39.163921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54478c39-9cde-4ee0-b6ec-424f9f92dfdb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:39.165099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54478c39-9cde-4ee0-b6ec-424f9f92dfdb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:39.166230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54478c39-9cde-4ee0-b6ec-424f9f92dfdb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:39.168312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54478c39-9cde-4ee0-b6ec-424f9f92dfdb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:39.514022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-54478c39-9cde-4ee0-b6ec-424f9f92dfdb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:39.528663 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-54478c39-9cde-4ee0-b6ec-424f9f92dfdb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/a867d805-6462-410b-9486-bffcf7a9425c" status: 200 len: 1469 microversion: 2.1 time: 0.399482 Oct 24 10:27:39.535071 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 447/877] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:39 2022] GET /compute/v2.1/servers/a867d805-6462-410b-9486-bffcf7a9425c => generated 1469 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:39.547223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-94bad376-b08f-443b-8312-8d50ffd6d6ae tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:39.548247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-94bad376-b08f-443b-8312-8d50ffd6d6ae tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:39.555470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-ad366ffc-61f4-4500-889f-860b42604366 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Building network info cache for instance {{(pid=120425) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 10:27:39.584712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94bad376-b08f-443b-8312-8d50ffd6d6ae tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:39.585607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94bad376-b08f-443b-8312-8d50ffd6d6ae tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:39.587485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94bad376-b08f-443b-8312-8d50ffd6d6ae tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:39.591734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94bad376-b08f-443b-8312-8d50ffd6d6ae tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:39.592544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94bad376-b08f-443b-8312-8d50ffd6d6ae tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:39.593381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94bad376-b08f-443b-8312-8d50ffd6d6ae tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:39.719329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94bad376-b08f-443b-8312-8d50ffd6d6ae tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:39.729914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94bad376-b08f-443b-8312-8d50ffd6d6ae tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:39.743542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94bad376-b08f-443b-8312-8d50ffd6d6ae tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:39.748848 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-94bad376-b08f-443b-8312-8d50ffd6d6ae tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 200 len: 1319 microversion: 2.25 time: 0.210010 Oct 24 10:27:39.766447 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 448/878] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:27:39 2022] GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:27:39.801251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-0d80179f-4e62-4a09-9df3-29630affa211 req-9e3726ae-1778-43cc-a545-4ae077632ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c828266b-d510-4a99-9b08-476e19b057a7", "name": "network-vif-plugged", "status": "completed", "tag": "08217d41-f854-428a-9793-2feb95de04df"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:39.833410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-0d80179f-4e62-4a09-9df3-29630affa211 req-9e3726ae-1778-43cc-a545-4ae077632ceb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:39.838326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-0d80179f-4e62-4a09-9df3-29630affa211 req-9e3726ae-1778-43cc-a545-4ae077632ceb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:39.840396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-0d80179f-4e62-4a09-9df3-29630affa211 req-9e3726ae-1778-43cc-a545-4ae077632ceb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:39.844939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:39.890690 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-0d80179f-4e62-4a09-9df3-29630affa211 req-9e3726ae-1778-43cc-a545-4ae077632ceb service nova] Creating event network-vif-plugged:08217d41-f854-428a-9793-2feb95de04df for instance c828266b-d510-4a99-9b08-476e19b057a7 on n-h1-858383-15 Oct 24 10:27:39.904120 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-0d80179f-4e62-4a09-9df3-29630affa211 req-9e3726ae-1778-43cc-a545-4ae077632ceb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135953 Oct 24 10:27:39.907461 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 449/879] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:39.922505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f9b7c597-14ef-4d21-89f6-419541f2df02 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0cc0550>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:40.044327 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f9b7c597-14ef-4d21-89f6-419541f2df02 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272" status: 200 len: 1452 microversion: 2.1 time: 0.122972 Oct 24 10:27:40.046483 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 450/880] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:39 2022] GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272 => generated 1452 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:40.062769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6b7b8984-b009-4bca-87b9-ef012af65028 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:40.068774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6b7b8984-b009-4bca-87b9-ef012af65028 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:40.083677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b7b8984-b009-4bca-87b9-ef012af65028 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:40.084624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b7b8984-b009-4bca-87b9-ef012af65028 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:40.085533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b7b8984-b009-4bca-87b9-ef012af65028 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:40.086459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b7b8984-b009-4bca-87b9-ef012af65028 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:40.088191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b7b8984-b009-4bca-87b9-ef012af65028 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:40.090186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b7b8984-b009-4bca-87b9-ef012af65028 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:40.569813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6b7b8984-b009-4bca-87b9-ef012af65028 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:40.582221 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6b7b8984-b009-4bca-87b9-ef012af65028 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1359 microversion: 2.1 time: 0.534604 Oct 24 10:27:40.592114 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 451/881] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:40 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1359 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:40.593197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-83ca35cf-fd9f-42ed-892a-f96a4123a338 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:40.618294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-83ca35cf-fd9f-42ed-892a-f96a4123a338 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:40.623593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-83ca35cf-fd9f-42ed-892a-f96a4123a338 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Searching by: {'reservation_id': 'r-981ycqkj', 'deleted': False, 'project_id': 'b565572c0c8c4871af02471a328bd1af'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:27:40.634203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83ca35cf-fd9f-42ed-892a-f96a4123a338 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:40.641373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83ca35cf-fd9f-42ed-892a-f96a4123a338 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:40.644781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83ca35cf-fd9f-42ed-892a-f96a4123a338 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:40.646881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83ca35cf-fd9f-42ed-892a-f96a4123a338 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:40.647524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83ca35cf-fd9f-42ed-892a-f96a4123a338 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:40.647975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83ca35cf-fd9f-42ed-892a-f96a4123a338 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:40.891046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-83ca35cf-fd9f-42ed-892a-f96a4123a338 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:27:41.000587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-ad366ffc-61f4-4500-889f-860b42604366 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Updating instance_info_cache with network_info: [{"id": "3da84e0c-5c52-4ffa-8616-0781a71c3874", "address": "fa:16:3e:c4:e3:16", "network": {"id": "ec1a4d9a-2e78-407d-b33a-563721c9877e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-994583523-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2afb2a59a2134fe0a2903b9591cc522b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3da84e0c-5c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120425) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 10:27:41.006651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:41.023004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad366ffc-61f4-4500-889f-860b42604366 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Releasing lock "refresh_cache-00d34420-321b-4914-a4e0-d03965e049b3" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 10:27:41.026307 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad366ffc-61f4-4500-889f-860b42604366 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "POST /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3/action" status: 202 len: 0 microversion: 2.1 time: 4.737308 Oct 24 10:27:41.027935 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 431/882] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:27:36 2022] POST /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3/action => generated 0 bytes in 4773 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 24 10:27:41.036643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fc2122bd-bef4-464f-8cd3-ac3f619dbf34 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:41.040601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fc2122bd-bef4-464f-8cd3-ac3f619dbf34 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:41.055124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-83ca35cf-fd9f-42ed-892a-f96a4123a338 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:41.063285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc2122bd-bef4-464f-8cd3-ac3f619dbf34 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:41.063805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc2122bd-bef4-464f-8cd3-ac3f619dbf34 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:41.064226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc2122bd-bef4-464f-8cd3-ac3f619dbf34 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:41.066008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc2122bd-bef4-464f-8cd3-ac3f619dbf34 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:41.070085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83ca35cf-fd9f-42ed-892a-f96a4123a338 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:41.070577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83ca35cf-fd9f-42ed-892a-f96a4123a338 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:41.072100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc2122bd-bef4-464f-8cd3-ac3f619dbf34 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:41.072849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc2122bd-bef4-464f-8cd3-ac3f619dbf34 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:41.078829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83ca35cf-fd9f-42ed-892a-f96a4123a338 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:42.445297 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-83ca35cf-fd9f-42ed-892a-f96a4123a338 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?reservation_id=r-981ycqkj" status: 200 len: 2931 microversion: 2.1 time: 1.856600 Oct 24 10:27:42.450408 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 452/883] 10.222.0.50 () {58 vars in 1197 bytes} [Mon Oct 24 10:27:40 2022] GET /compute/v2.1/servers/detail?reservation_id=r-981ycqkj => generated 2931 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:42.459302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-93863114-abcf-4eed-8a5c-51075316a1b0 req-85baedd2-bd44-4768-959c-e1d51c65d72c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00d34420-321b-4914-a4e0-d03965e049b3", "tag": "3da84e0c-5c52-4ffa-8616-0781a71c3874"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:42.477063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-93863114-abcf-4eed-8a5c-51075316a1b0 req-85baedd2-bd44-4768-959c-e1d51c65d72c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:42.477890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-93863114-abcf-4eed-8a5c-51075316a1b0 req-85baedd2-bd44-4768-959c-e1d51c65d72c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:42.479502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-93863114-abcf-4eed-8a5c-51075316a1b0 req-85baedd2-bd44-4768-959c-e1d51c65d72c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:42.499708 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-93863114-abcf-4eed-8a5c-51075316a1b0 req-85baedd2-bd44-4768-959c-e1d51c65d72c service nova] Creating event network-changed:3da84e0c-5c52-4ffa-8616-0781a71c3874 for instance 00d34420-321b-4914-a4e0-d03965e049b3 on n-h1-858383-15 Oct 24 10:27:42.527360 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-93863114-abcf-4eed-8a5c-51075316a1b0 req-85baedd2-bd44-4768-959c-e1d51c65d72c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056722 Oct 24 10:27:42.530392 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 453/884] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:42.534935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fc2122bd-bef4-464f-8cd3-ac3f619dbf34 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:42.539667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-59083398-e990-4a40-847e-7120e7ffeb70 req-978e0b18-c264-479a-a6e9-eae61903cccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4889ce-5a69-43f8-856a-a51289323fa8", "name": "network-vif-deleted", "tag": "9102e5e7-84d8-4adf-b9b1-351fa06523c7"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:42.551158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-59083398-e990-4a40-847e-7120e7ffeb70 req-978e0b18-c264-479a-a6e9-eae61903cccb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:42.552530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-59083398-e990-4a40-847e-7120e7ffeb70 req-978e0b18-c264-479a-a6e9-eae61903cccb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:42.553616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-59083398-e990-4a40-847e-7120e7ffeb70 req-978e0b18-c264-479a-a6e9-eae61903cccb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:42.565463 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fc2122bd-bef4-464f-8cd3-ac3f619dbf34 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1543 microversion: 2.1 time: 1.533315 Oct 24 10:27:42.571163 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 432/885] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:41 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1543 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:42.585403 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-59083398-e990-4a40-847e-7120e7ffeb70 req-978e0b18-c264-479a-a6e9-eae61903cccb service nova] Creating event network-vif-deleted:9102e5e7-84d8-4adf-b9b1-351fa06523c7 for instance 2c4889ce-5a69-43f8-856a-a51289323fa8 on n-h1-858383-15 Oct 24 10:27:42.588963 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-59083398-e990-4a40-847e-7120e7ffeb70 req-978e0b18-c264-479a-a6e9-eae61903cccb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055949 Oct 24 10:27:42.595987 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 454/886] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:42.603795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-22221514-493f-4cd7-918c-492c2dae4bc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:42.604431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-22221514-493f-4cd7-918c-492c2dae4bc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: c828266b-d510-4a99-9b08-476e19b057a7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:42.610951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22221514-493f-4cd7-918c-492c2dae4bc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:42.611656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22221514-493f-4cd7-918c-492c2dae4bc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:42.612278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22221514-493f-4cd7-918c-492c2dae4bc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:42.613713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22221514-493f-4cd7-918c-492c2dae4bc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:42.614349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22221514-493f-4cd7-918c-492c2dae4bc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:42.614935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22221514-493f-4cd7-918c-492c2dae4bc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:42.615059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-681ba6c9-52c6-4a8c-a75c-f7b9f20b72d8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:42.623803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-681ba6c9-52c6-4a8c-a75c-f7b9f20b72d8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:42.636543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-681ba6c9-52c6-4a8c-a75c-f7b9f20b72d8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:42.637098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-681ba6c9-52c6-4a8c-a75c-f7b9f20b72d8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:42.637535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-681ba6c9-52c6-4a8c-a75c-f7b9f20b72d8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:42.638345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-681ba6c9-52c6-4a8c-a75c-f7b9f20b72d8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:42.638798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-681ba6c9-52c6-4a8c-a75c-f7b9f20b72d8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:42.639222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-681ba6c9-52c6-4a8c-a75c-f7b9f20b72d8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:42.926933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-681ba6c9-52c6-4a8c-a75c-f7b9f20b72d8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:42.935556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-22221514-493f-4cd7-918c-492c2dae4bc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:42.937208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-681ba6c9-52c6-4a8c-a75c-f7b9f20b72d8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:42.939896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-681ba6c9-52c6-4a8c-a75c-f7b9f20b72d8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:42.941293 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-681ba6c9-52c6-4a8c-a75c-f7b9f20b72d8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 200 len: 1361 microversion: 2.25 time: 0.334722 Oct 24 10:27:42.953273 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-22221514-493f-4cd7-918c-492c2dae4bc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7" status: 200 len: 1487 microversion: 2.1 time: 0.364530 Oct 24 10:27:42.953530 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 433/887] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:42 2022] GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7 => generated 1487 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:42.954718 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 455/888] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:27:42 2022] GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 1361 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:27:42.967720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f2356e02-431b-4062-b4d3-a63f945af7f6 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '.version_select at 0x7f04d0ca7dc0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:42.971966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-029e0e8f-96f2-47c7-843b-ebcc3b553869 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0f5c5e0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:43.030231 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-029e0e8f-96f2-47c7-843b-ebcc3b553869 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272" status: 200 len: 1461 microversion: 2.1 time: 0.063527 Oct 24 10:27:43.032215 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 434/889] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:42 2022] GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272 => generated 1461 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:43.051073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-df17897b-9862-4d53-86d1-38c3776278b0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:43.051867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-df17897b-9862-4d53-86d1-38c3776278b0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:43.059053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df17897b-9862-4d53-86d1-38c3776278b0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:43.059525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df17897b-9862-4d53-86d1-38c3776278b0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:43.059957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df17897b-9862-4d53-86d1-38c3776278b0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:43.060662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df17897b-9862-4d53-86d1-38c3776278b0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:43.061155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df17897b-9862-4d53-86d1-38c3776278b0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:43.061724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df17897b-9862-4d53-86d1-38c3776278b0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:43.306816 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f2356e02-431b-4062-b4d3-a63f945af7f6 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/8c4ba785-69f9-4c66-beb4-08114716c3aa" status: 200 len: 184 microversion: 2.1 time: 0.350753 Oct 24 10:27:43.307434 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 456/890] 10.222.0.50 () {58 vars in 1260 bytes} [Mon Oct 24 10:27:42 2022] GET /compute/v2.1/os-floating-ips/8c4ba785-69f9-4c66-beb4-08114716c3aa => generated 184 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:43.313334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-6fb3d124-5239-4e64-8990-f298dc0121bd req-c4f2e391-013f-4a68-a145-ecc465ea4e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9eff099-cc37-4432-8741-4e7d179b9ff0", "name": "network-vif-plugged", "status": "completed", "tag": "e5f5ae43-f478-4bd6-8b05-04ea1b1ab6c2"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:43.323816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6fb3d124-5239-4e64-8990-f298dc0121bd req-c4f2e391-013f-4a68-a145-ecc465ea4e98 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:43.324298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6fb3d124-5239-4e64-8990-f298dc0121bd req-c4f2e391-013f-4a68-a145-ecc465ea4e98 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:43.324722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6fb3d124-5239-4e64-8990-f298dc0121bd req-c4f2e391-013f-4a68-a145-ecc465ea4e98 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:43.342301 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-6fb3d124-5239-4e64-8990-f298dc0121bd req-c4f2e391-013f-4a68-a145-ecc465ea4e98 service nova] Creating event network-vif-plugged:e5f5ae43-f478-4bd6-8b05-04ea1b1ab6c2 for instance b9eff099-cc37-4432-8741-4e7d179b9ff0 on n-h2-858383-15 Oct 24 10:27:43.347999 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-6fb3d124-5239-4e64-8990-f298dc0121bd req-c4f2e391-013f-4a68-a145-ecc465ea4e98 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038042 Oct 24 10:27:43.350380 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 457/891] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:43.357300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f86f3bbc-fdac-4035-99df-cb06f371f587 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:43.375455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.compute.server_groups [None req-f86f3bbc-fdac-4035-99df-cb06f371f587 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Querying cell 75e76125-592d-4292-bea1-3b51451d7165(cell1) for 2 instances {{(pid=120426) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 24 10:27:43.376329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f86f3bbc-fdac-4035-99df-cb06f371f587 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:43.376958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f86f3bbc-fdac-4035-99df-cb06f371f587 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:43.377653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f86f3bbc-fdac-4035-99df-cb06f371f587 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:43.379464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-df17897b-9862-4d53-86d1-38c3776278b0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:43.387798 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-df17897b-9862-4d53-86d1-38c3776278b0 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1359 microversion: 2.1 time: 0.345393 Oct 24 10:27:43.403521 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 435/892] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:43 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1359 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:43.408827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-12fc5150-156b-4d44-b8b8-8e27994effaf tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:43.409618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-12fc5150-156b-4d44-b8b8-8e27994effaf tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: c828266b-d510-4a99-9b08-476e19b057a7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:43.416473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12fc5150-156b-4d44-b8b8-8e27994effaf tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:43.417344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12fc5150-156b-4d44-b8b8-8e27994effaf tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:43.418042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12fc5150-156b-4d44-b8b8-8e27994effaf tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:43.418943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12fc5150-156b-4d44-b8b8-8e27994effaf tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:43.419559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12fc5150-156b-4d44-b8b8-8e27994effaf tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:43.420141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12fc5150-156b-4d44-b8b8-8e27994effaf tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:43.433837 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f86f3bbc-fdac-4035-99df-cb06f371f587 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/06e41963-2e3b-471c-80dc-b907a8cef0a2" status: 200 len: 266 microversion: 2.1 time: 0.081885 Oct 24 10:27:43.435164 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 458/893] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:27:43 2022] GET /compute/v2.1/os-server-groups/06e41963-2e3b-471c-80dc-b907a8cef0a2 => generated 266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:43.440000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2dce26d4-0a8a-4617-b44c-f3ac97573e06 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0ce9b80>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:43.512072 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2dce26d4-0a8a-4617-b44c-f3ac97573e06 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272" status: 200 len: 1461 microversion: 2.1 time: 0.075230 Oct 24 10:27:43.513867 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 459/894] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:43 2022] GET /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272 => generated 1461 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:43.521127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f444552c-9707-48dc-951b-bd9dcbea6a2f tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.200"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:43.527850 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-12fc5150-156b-4d44-b8b8-8e27994effaf tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "POST /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7/action" status: 202 len: 0 microversion: 2.1 time: 0.122582 Oct 24 10:27:43.529111 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 436/895] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:27:43 2022] POST /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:27:43.534878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4d5ebddc-ae37-4481-90b0-f4f5b822e14c tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:43.535813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4d5ebddc-ae37-4481-90b0-f4f5b822e14c tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] [instance: 0d5c6e34-f247-4f26-b237-26fc89ffc2bb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:43.543841 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d5ebddc-ae37-4481-90b0-f4f5b822e14c tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:43.544911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d5ebddc-ae37-4481-90b0-f4f5b822e14c tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:43.545678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d5ebddc-ae37-4481-90b0-f4f5b822e14c tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:43.546397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d5ebddc-ae37-4481-90b0-f4f5b822e14c tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:43.547206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d5ebddc-ae37-4481-90b0-f4f5b822e14c tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:43.547637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d5ebddc-ae37-4481-90b0-f4f5b822e14c tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:43.818312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f444552c-9707-48dc-951b-bd9dcbea6a2f tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:43.833759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f444552c-9707-48dc-951b-bd9dcbea6a2f tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:43.834769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f444552c-9707-48dc-951b-bd9dcbea6a2f tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:43.836261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f444552c-9707-48dc-951b-bd9dcbea6a2f tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:43.837606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f444552c-9707-48dc-951b-bd9dcbea6a2f tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:43.838172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f444552c-9707-48dc-951b-bd9dcbea6a2f tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:43.838865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f444552c-9707-48dc-951b-bd9dcbea6a2f tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:43.873293 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4d5ebddc-ae37-4481-90b0-f4f5b822e14c tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb" status: 200 len: 1622 microversion: 2.1 time: 0.340776 Oct 24 10:27:43.873917 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 437/896] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:43 2022] GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb => generated 1622 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:43.878477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c56ac8c1-2800-4927-aead-aecedb7965cb tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:43.879276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c56ac8c1-2800-4927-aead-aecedb7965cb tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: a8f749f9-5771-4ecb-8a06-30a8f69dd848] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:43.886440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c56ac8c1-2800-4927-aead-aecedb7965cb tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:43.887122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c56ac8c1-2800-4927-aead-aecedb7965cb tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:43.887735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c56ac8c1-2800-4927-aead-aecedb7965cb tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:43.888586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c56ac8c1-2800-4927-aead-aecedb7965cb tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:43.889269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c56ac8c1-2800-4927-aead-aecedb7965cb tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:43.889857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c56ac8c1-2800-4927-aead-aecedb7965cb tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:44.183283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c56ac8c1-2800-4927-aead-aecedb7965cb tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:44.205102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f444552c-9707-48dc-951b-bd9dcbea6a2f tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "refresh_cache-00d34420-321b-4914-a4e0-d03965e049b3" {{(pid=120426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 10:27:44.205678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f444552c-9707-48dc-951b-bd9dcbea6a2f tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquired lock "refresh_cache-00d34420-321b-4914-a4e0-d03965e049b3" {{(pid=120426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 10:27:44.211222 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c56ac8c1-2800-4927-aead-aecedb7965cb tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848" status: 200 len: 1466 microversion: 2.1 time: 0.336004 Oct 24 10:27:44.211841 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 438/897] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:43 2022] GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848 => generated 1466 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:44.217050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6716dea0-ce30-438b-95b5-f01592cc5712 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:44.217659 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6716dea0-ce30-438b-95b5-f01592cc5712 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: c828266b-d510-4a99-9b08-476e19b057a7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:44.225493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6716dea0-ce30-438b-95b5-f01592cc5712 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:44.228480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6716dea0-ce30-438b-95b5-f01592cc5712 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:44.229420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6716dea0-ce30-438b-95b5-f01592cc5712 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:44.230633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6716dea0-ce30-438b-95b5-f01592cc5712 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:44.231255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6716dea0-ce30-438b-95b5-f01592cc5712 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:44.231854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6716dea0-ce30-438b-95b5-f01592cc5712 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:44.665936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6716dea0-ce30-438b-95b5-f01592cc5712 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:44.673825 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6716dea0-ce30-438b-95b5-f01592cc5712 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7" status: 200 len: 1472 microversion: 2.1 time: 0.460663 Oct 24 10:27:44.674544 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 439/898] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:44 2022] GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7 => generated 1472 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:44.680095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-96bdb440-d60a-4962-a914-d8eed7af71e5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:44.680934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-96bdb440-d60a-4962-a914-d8eed7af71e5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:44.687651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96bdb440-d60a-4962-a914-d8eed7af71e5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:44.688453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96bdb440-d60a-4962-a914-d8eed7af71e5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:44.688931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96bdb440-d60a-4962-a914-d8eed7af71e5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:44.689637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96bdb440-d60a-4962-a914-d8eed7af71e5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:44.690261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96bdb440-d60a-4962-a914-d8eed7af71e5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:44.690696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96bdb440-d60a-4962-a914-d8eed7af71e5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:45.328303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-96bdb440-d60a-4962-a914-d8eed7af71e5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:45.336175 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-96bdb440-d60a-4962-a914-d8eed7af71e5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1542 microversion: 2.1 time: 0.660426 Oct 24 10:27:45.336776 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 440/899] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:44 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1542 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:45.341535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9114abfb-0631-458e-9af5-6c4d5cd0ccfa tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:45.342146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9114abfb-0631-458e-9af5-6c4d5cd0ccfa tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] [instance: a867d805-6462-410b-9486-bffcf7a9425c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:45.347991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9114abfb-0631-458e-9af5-6c4d5cd0ccfa tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:45.348477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9114abfb-0631-458e-9af5-6c4d5cd0ccfa tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:45.348960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9114abfb-0631-458e-9af5-6c4d5cd0ccfa tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:45.349679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9114abfb-0631-458e-9af5-6c4d5cd0ccfa tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:45.350209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9114abfb-0631-458e-9af5-6c4d5cd0ccfa tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:45.350640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9114abfb-0631-458e-9af5-6c4d5cd0ccfa tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:45.680019 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9114abfb-0631-458e-9af5-6c4d5cd0ccfa tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a867d805-6462-410b-9486-bffcf7a9425c" status: 200 len: 1622 microversion: 2.1 time: 0.342116 Oct 24 10:27:45.680926 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 441/900] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:45 2022] GET /compute/v2.1/servers/a867d805-6462-410b-9486-bffcf7a9425c => generated 1622 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:45.685827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9eac395f-1f25-477a-9028-19c268dc4930 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:45.686442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9eac395f-1f25-477a-9028-19c268dc4930 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:45.692275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eac395f-1f25-477a-9028-19c268dc4930 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:45.692758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eac395f-1f25-477a-9028-19c268dc4930 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:45.693245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eac395f-1f25-477a-9028-19c268dc4930 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:45.694271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eac395f-1f25-477a-9028-19c268dc4930 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:45.694823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eac395f-1f25-477a-9028-19c268dc4930 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:45.695256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eac395f-1f25-477a-9028-19c268dc4930 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:45.993638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9eac395f-1f25-477a-9028-19c268dc4930 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:46.003661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9eac395f-1f25-477a-9028-19c268dc4930 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:46.005567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9eac395f-1f25-477a-9028-19c268dc4930 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:46.007312 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9eac395f-1f25-477a-9028-19c268dc4930 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 200 len: 1361 microversion: 2.25 time: 0.325531 Oct 24 10:27:46.020870 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 442/901] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:27:45 2022] GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 1361 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:27:46.020870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-153bf47e-bbcc-4169-833d-d82262e90c2b tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1306299146"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:46.021392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-f444552c-9707-48dc-951b-bd9dcbea6a2f tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Building network info cache for instance {{(pid=120426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 10:27:46.026890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-153bf47e-bbcc-4169-833d-d82262e90c2b tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:46.033528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-153bf47e-bbcc-4169-833d-d82262e90c2b tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:46.034158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-153bf47e-bbcc-4169-833d-d82262e90c2b tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:46.034837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-153bf47e-bbcc-4169-833d-d82262e90c2b tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:46.036295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-153bf47e-bbcc-4169-833d-d82262e90c2b tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:46.037007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-153bf47e-bbcc-4169-833d-d82262e90c2b tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:46.038406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-153bf47e-bbcc-4169-833d-d82262e90c2b tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:46.281192 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-153bf47e-bbcc-4169-833d-d82262e90c2b tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "POST /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0/action" status: 202 len: 0 microversion: 2.1 time: 0.265413 Oct 24 10:27:46.282345 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 443/902] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:27:46 2022] POST /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 10:27:46.294728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-92e45f9e-228a-403e-848c-2a951d72e92e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:46.295561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-92e45f9e-228a-403e-848c-2a951d72e92e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:46.303400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92e45f9e-228a-403e-848c-2a951d72e92e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:46.304068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92e45f9e-228a-403e-848c-2a951d72e92e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:46.304636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92e45f9e-228a-403e-848c-2a951d72e92e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:46.305476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92e45f9e-228a-403e-848c-2a951d72e92e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:46.306387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92e45f9e-228a-403e-848c-2a951d72e92e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:46.306911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92e45f9e-228a-403e-848c-2a951d72e92e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:46.624694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-92e45f9e-228a-403e-848c-2a951d72e92e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:46.634465 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-92e45f9e-228a-403e-848c-2a951d72e92e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1359 microversion: 2.1 time: 0.344538 Oct 24 10:27:46.635353 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 444/903] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:46 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1359 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:46.639834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-8194ba66-0132-440f-83c7-a3bdc8910155 req-60b18be6-d9d7-465c-ba9e-cf3f71318632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c264bc-70a7-4b1b-a29a-d5bbb2884809", "tag": "8db04e7c-b441-4bfb-89ad-0f6839db6290"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:46.649431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8194ba66-0132-440f-83c7-a3bdc8910155 req-60b18be6-d9d7-465c-ba9e-cf3f71318632 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:46.649904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8194ba66-0132-440f-83c7-a3bdc8910155 req-60b18be6-d9d7-465c-ba9e-cf3f71318632 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:46.650332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8194ba66-0132-440f-83c7-a3bdc8910155 req-60b18be6-d9d7-465c-ba9e-cf3f71318632 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:46.663215 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-8194ba66-0132-440f-83c7-a3bdc8910155 req-60b18be6-d9d7-465c-ba9e-cf3f71318632 service nova] Creating event network-changed:8db04e7c-b441-4bfb-89ad-0f6839db6290 for instance 77c264bc-70a7-4b1b-a29a-d5bbb2884809 on n-h1-858383-15 Oct 24 10:27:46.668075 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-8194ba66-0132-440f-83c7-a3bdc8910155 req-60b18be6-d9d7-465c-ba9e-cf3f71318632 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031577 Oct 24 10:27:46.668671 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 445/904] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:46.674417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-57eedb25-e391-4a4b-8d5e-4d962f97e71f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-100324911"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:46.676783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-57eedb25-e391-4a4b-8d5e-4d962f97e71f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: c828266b-d510-4a99-9b08-476e19b057a7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:46.683782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57eedb25-e391-4a4b-8d5e-4d962f97e71f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:46.684954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57eedb25-e391-4a4b-8d5e-4d962f97e71f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:46.685569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57eedb25-e391-4a4b-8d5e-4d962f97e71f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:46.686462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57eedb25-e391-4a4b-8d5e-4d962f97e71f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:46.687078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57eedb25-e391-4a4b-8d5e-4d962f97e71f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:46.687563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57eedb25-e391-4a4b-8d5e-4d962f97e71f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:46.894915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:46.945711 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-57eedb25-e391-4a4b-8d5e-4d962f97e71f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "POST /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7/action" status: 202 len: 0 microversion: 2.1 time: 0.275593 Oct 24 10:27:46.946707 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 446/905] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:27:46 2022] POST /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 10:27:46.958273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-58b5bcb7-32dd-48c7-b112-082696c8ab10 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Action: 'create', calling method: .version_select at 0x7f04d1174dc0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-735889331", "policies": ["anti-affinity"]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:46.978844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-58b5bcb7-32dd-48c7-b112-082696c8ab10 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for project b565572c0c8c4871af02471a328bd1af. Resources: {'server_groups'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:27:46.980781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:46.986003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-58b5bcb7-32dd-48c7-b112-082696c8ab10 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for user 9aa572f1e5014e10bed0abe34dfad43f and project b565572c0c8c4871af02471a328bd1af. Resources: {'server_groups'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:27:47.056122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-58b5bcb7-32dd-48c7-b112-082696c8ab10 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for project b565572c0c8c4871af02471a328bd1af. Resources: {'server_groups'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:27:47.063236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-58b5bcb7-32dd-48c7-b112-082696c8ab10 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for user 9aa572f1e5014e10bed0abe34dfad43f and project b565572c0c8c4871af02471a328bd1af. Resources: {'server_groups'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:27:47.081600 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-58b5bcb7-32dd-48c7-b112-082696c8ab10 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.133579 Oct 24 10:27:47.089033 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 447/906] 10.222.0.50 () {60 vars in 1174 bytes} [Mon Oct 24 10:27:46 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:47.095809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-19204eec-6a16-4fe8-9157-22d97ed0d1b3 req-8f7ae16b-c899-4f57-a775-1097721b519c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00d34420-321b-4914-a4e0-d03965e049b3", "tag": "3da84e0c-5c52-4ffa-8616-0781a71c3874"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:47.104722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-f444552c-9707-48dc-951b-bd9dcbea6a2f tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Updating instance_info_cache with network_info: [{"id": "3da84e0c-5c52-4ffa-8616-0781a71c3874", "address": "fa:16:3e:c4:e3:16", "network": {"id": "ec1a4d9a-2e78-407d-b33a-563721c9877e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-994583523-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2afb2a59a2134fe0a2903b9591cc522b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3da84e0c-5c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 10:27:47.109138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-19204eec-6a16-4fe8-9157-22d97ed0d1b3 req-8f7ae16b-c899-4f57-a775-1097721b519c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:47.109679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-19204eec-6a16-4fe8-9157-22d97ed0d1b3 req-8f7ae16b-c899-4f57-a775-1097721b519c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:47.110459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-19204eec-6a16-4fe8-9157-22d97ed0d1b3 req-8f7ae16b-c899-4f57-a775-1097721b519c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:47.124977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f444552c-9707-48dc-951b-bd9dcbea6a2f tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Releasing lock "refresh_cache-00d34420-321b-4914-a4e0-d03965e049b3" {{(pid=120426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 10:27:47.126346 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f444552c-9707-48dc-951b-bd9dcbea6a2f tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "POST /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3/action" status: 202 len: 0 microversion: 2.1 time: 3.609373 Oct 24 10:27:47.133299 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-19204eec-6a16-4fe8-9157-22d97ed0d1b3 req-8f7ae16b-c899-4f57-a775-1097721b519c service nova] Creating event network-changed:3da84e0c-5c52-4ffa-8616-0781a71c3874 for instance 00d34420-321b-4914-a4e0-d03965e049b3 on n-h1-858383-15 Oct 24 10:27:47.143082 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-19204eec-6a16-4fe8-9157-22d97ed0d1b3 req-8f7ae16b-c899-4f57-a775-1097721b519c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051050 Oct 24 10:27:47.143897 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 448/907] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:47.145710 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 460/908] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:27:43 2022] POST /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3/action => generated 0 bytes in 3631 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 24 10:27:47.155105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-73a254fe-5716-4c1c-bb21-fe7e9c3b2b8c req-559f2ab4-0cff-4d00-a9f1-aa894e6018ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f749f9-5771-4ecb-8a06-30a8f69dd848", "name": "network-vif-unplugged", "status": "completed", "tag": "f48a3bd1-58ab-47af-934b-bea589ab9a0b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:47.160094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a36015ee-d3a4-4af1-a91e-d93b94b4eb75 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0df7940>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:47.183673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-73a254fe-5716-4c1c-bb21-fe7e9c3b2b8c req-559f2ab4-0cff-4d00-a9f1-aa894e6018ad service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:47.184510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-73a254fe-5716-4c1c-bb21-fe7e9c3b2b8c req-559f2ab4-0cff-4d00-a9f1-aa894e6018ad service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:47.185008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-73a254fe-5716-4c1c-bb21-fe7e9c3b2b8c req-559f2ab4-0cff-4d00-a9f1-aa894e6018ad service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:47.209670 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-73a254fe-5716-4c1c-bb21-fe7e9c3b2b8c req-559f2ab4-0cff-4d00-a9f1-aa894e6018ad service nova] Creating event network-vif-unplugged:f48a3bd1-58ab-47af-934b-bea589ab9a0b for instance a8f749f9-5771-4ecb-8a06-30a8f69dd848 on n-h2-858383-15 Oct 24 10:27:47.219731 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-73a254fe-5716-4c1c-bb21-fe7e9c3b2b8c req-559f2ab4-0cff-4d00-a9f1-aa894e6018ad service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072553 Oct 24 10:27:47.220354 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 449/909] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:47.230015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6fe9ae8f-41d6-4344-a497-37ec936f5b46 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:47.230732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6fe9ae8f-41d6-4344-a497-37ec936f5b46 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:47.250716 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a36015ee-d3a4-4af1-a91e-d93b94b4eb75 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb" status: 200 len: 1453 microversion: 2.1 time: 0.103743 Oct 24 10:27:47.251594 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 461/910] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:47 2022] GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:47.257023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-22c2f867-1f39-4e23-8f89-96b7fb4a4c61 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0cc0790>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:47.260984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fe9ae8f-41d6-4344-a497-37ec936f5b46 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:47.261499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fe9ae8f-41d6-4344-a497-37ec936f5b46 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:47.261945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fe9ae8f-41d6-4344-a497-37ec936f5b46 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:47.262665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fe9ae8f-41d6-4344-a497-37ec936f5b46 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:47.263127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fe9ae8f-41d6-4344-a497-37ec936f5b46 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:47.263560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fe9ae8f-41d6-4344-a497-37ec936f5b46 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:47.338688 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-22c2f867-1f39-4e23-8f89-96b7fb4a4c61 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69" status: 200 len: 1413 microversion: 2.1 time: 0.085745 Oct 24 10:27:47.339230 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 462/911] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:47 2022] GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:47.356910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3b478948-fde0-4d4d-886a-dfb16410529b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:47.357561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3b478948-fde0-4d4d-886a-dfb16410529b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:47.370650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b478948-fde0-4d4d-886a-dfb16410529b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:47.383207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b478948-fde0-4d4d-886a-dfb16410529b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:47.384223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b478948-fde0-4d4d-886a-dfb16410529b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:47.386047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b478948-fde0-4d4d-886a-dfb16410529b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:47.386772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b478948-fde0-4d4d-886a-dfb16410529b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:47.387524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b478948-fde0-4d4d-886a-dfb16410529b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:47.634854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6fe9ae8f-41d6-4344-a497-37ec936f5b46 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:47.644192 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6fe9ae8f-41d6-4344-a497-37ec936f5b46 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1474 microversion: 2.1 time: 0.421258 Oct 24 10:27:47.650980 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 450/912] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:47 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1474 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:47.667365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68b1e429-9228-4ada-982d-6bf08d9253b1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:47.667883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-68b1e429-9228-4ada-982d-6bf08d9253b1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:47.683056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68b1e429-9228-4ada-982d-6bf08d9253b1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:47.683791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68b1e429-9228-4ada-982d-6bf08d9253b1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:47.685300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68b1e429-9228-4ada-982d-6bf08d9253b1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:47.686645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68b1e429-9228-4ada-982d-6bf08d9253b1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:47.687342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68b1e429-9228-4ada-982d-6bf08d9253b1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:47.687943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68b1e429-9228-4ada-982d-6bf08d9253b1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:47.708343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3b478948-fde0-4d4d-886a-dfb16410529b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:47.721887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3b478948-fde0-4d4d-886a-dfb16410529b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:47.723421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3b478948-fde0-4d4d-886a-dfb16410529b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:47.727647 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3b478948-fde0-4d4d-886a-dfb16410529b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 200 len: 1361 microversion: 2.25 time: 0.381484 Oct 24 10:27:47.729253 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-68b1e429-9228-4ada-982d-6bf08d9253b1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] HTTP exception thrown: Instance 2c4889ce-5a69-43f8-856a-a51289323fa8 could not be found. Oct 24 10:27:47.729885 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 463/913] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:27:47 2022] GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 1361 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68b1e429-9228-4ada-982d-6bf08d9253b1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Request method failure captured: Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 HTTP/1.1 Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmg-iAS81ByMIK8-9bLAdLa0SJt2i-vBS9i36AKrRJqZVAhGTrFdARQrrICb7Rz8SKYBFwK1FZ2c-N2gPJKnFwiQM_HXpZInwJNBgkMc1rEA2oZzHdC4_EpHvpYs33zMYC0zNK0brx_wHU-UVAfyhyXQJVko2Kk1IngPq6gSfy6k1Eo Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 2afb2a59a2134fe0a2903b9591cc522b Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1389855451 Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:27:47.731207 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:27:47.732975 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2afb2a59a2134fe0a2903b9591cc522b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2afb2a59a2134fe0a2903b9591cc522b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2afb2a59a2134fe0a2903b9591cc522b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2afb2a59a2134fe0a2903b9591cc522b", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:27:47.732975 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1389855451 Oct 24 10:27:47.732975 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 2afb2a59a2134fe0a2903b9591cc522b Oct 24 10:27:47.732975 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1389855451 Oct 24 10:27:47.732975 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-FloatingIPsAssociationTestJSON-1389855451-project Oct 24 10:27:47.732975 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:27:47.732975 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:27:47.732975 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ef304f0a2ef54385b985dd16fa1b35c8 Oct 24 10:27:47.732975 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1389855451-project Oct 24 10:27:47.732975 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:27:47.732975 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 2c4889ce-5a69-43f8-856a-a51289323fa8 could not be found. Oct 24 10:27:47.732975 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '2c4889ce-5a69-43f8-856a-a51289323fa8'} Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c4889ce-5a69-43f8-856a-a51289323fa8 could not be found. Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:27:47.733898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c4889ce-5a69-43f8-856a-a51289323fa8 could not be found. Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c4889ce-5a69-43f8-856a-a51289323fa8 could not be found. Oct 24 10:27:47.735379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:47.740107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68b1e429-9228-4ada-982d-6bf08d9253b1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Returning 404 to user: Instance 2c4889ce-5a69-43f8-856a-a51289323fa8 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:27:47.740107 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-68b1e429-9228-4ada-982d-6bf08d9253b1 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8" status: 404 len: 111 microversion: 2.1 time: 0.087339 Oct 24 10:27:47.740107 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 451/914] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:27:47 2022] DELETE /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:27:47.745061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-122686117", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "0d6a7907-764b-402a-8228-682fb6b4a6a5"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:47.750770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bbd96d9d-07f1-4105-a9e9-5fdf59d018ff tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:47.754541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bbd96d9d-07f1-4105-a9e9-5fdf59d018ff tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:47.774103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbd96d9d-07f1-4105-a9e9-5fdf59d018ff tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:47.774952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbd96d9d-07f1-4105-a9e9-5fdf59d018ff tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:47.775600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbd96d9d-07f1-4105-a9e9-5fdf59d018ff tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:47.776603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbd96d9d-07f1-4105-a9e9-5fdf59d018ff tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:47.777357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbd96d9d-07f1-4105-a9e9-5fdf59d018ff tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:47.778238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bbd96d9d-07f1-4105-a9e9-5fdf59d018ff tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:47.820818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:27:48.111856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bbd96d9d-07f1-4105-a9e9-5fdf59d018ff tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:48.126788 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bbd96d9d-07f1-4105-a9e9-5fdf59d018ff tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1543 microversion: 2.1 time: 0.384049 Oct 24 10:27:48.133209 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 452/915] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:47 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1543 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:48.156825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-df59c64b-b5cd-4433-8f65-55bd7060db75 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:48.157708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-df59c64b-b5cd-4433-8f65-55bd7060db75 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 2c4889ce-5a69-43f8-856a-a51289323fa8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:48.190524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df59c64b-b5cd-4433-8f65-55bd7060db75 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:48.191027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df59c64b-b5cd-4433-8f65-55bd7060db75 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:48.191469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df59c64b-b5cd-4433-8f65-55bd7060db75 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:48.192195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df59c64b-b5cd-4433-8f65-55bd7060db75 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:48.192655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df59c64b-b5cd-4433-8f65-55bd7060db75 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:48.193385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df59c64b-b5cd-4433-8f65-55bd7060db75 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:48.232737 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-df59c64b-b5cd-4433-8f65-55bd7060db75 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] HTTP exception thrown: Instance 2c4889ce-5a69-43f8-856a-a51289323fa8 could not be found. Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-df59c64b-b5cd-4433-8f65-55bd7060db75 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Request method failure captured: Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 HTTP/1.1 Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmg-iAS81ByMIK8-9bLAdLa0SJt2i-vBS9i36AKrRJqZVAhGTrFdARQrrICb7Rz8SKYBFwK1FZ2c-N2gPJKnFwiQM_HXpZInwJNBgkMc1rEA2oZzHdC4_EpHvpYs33zMYC0zNK0brx_wHU-UVAfyhyXQJVko2Kk1IngPq6gSfy6k1Eo Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 2afb2a59a2134fe0a2903b9591cc522b Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1389855451 Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:27:48.250145 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:27:48.251672 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2afb2a59a2134fe0a2903b9591cc522b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2afb2a59a2134fe0a2903b9591cc522b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2afb2a59a2134fe0a2903b9591cc522b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2afb2a59a2134fe0a2903b9591cc522b", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:27:48.251672 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1389855451 Oct 24 10:27:48.251672 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 2afb2a59a2134fe0a2903b9591cc522b Oct 24 10:27:48.251672 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1389855451 Oct 24 10:27:48.251672 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-FloatingIPsAssociationTestJSON-1389855451-project Oct 24 10:27:48.251672 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:27:48.251672 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:27:48.251672 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ef304f0a2ef54385b985dd16fa1b35c8 Oct 24 10:27:48.251672 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1389855451-project Oct 24 10:27:48.251672 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:27:48.251672 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 2c4889ce-5a69-43f8-856a-a51289323fa8 could not be found. Oct 24 10:27:48.251672 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '2c4889ce-5a69-43f8-856a-a51289323fa8'} Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c4889ce-5a69-43f8-856a-a51289323fa8 could not be found. Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:27:48.252395 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:27:48.253636 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:27:48.253636 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:27:48.253636 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:27:48.253636 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:27:48.253636 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:27:48.253636 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:27:48.253636 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:27:48.253636 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c4889ce-5a69-43f8-856a-a51289323fa8 could not be found. Oct 24 10:27:48.253636 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:48.253636 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:48.253636 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:48.253636 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:48.253636 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:48.253636 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:48.253636 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:27:48.253636 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:27:48.253636 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c4889ce-5a69-43f8-856a-a51289323fa8 could not be found. Oct 24 10:27:48.253636 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:27:48.254703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-df59c64b-b5cd-4433-8f65-55bd7060db75 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Returning 404 to user: Instance 2c4889ce-5a69-43f8-856a-a51289323fa8 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:27:48.254703 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-df59c64b-b5cd-4433-8f65-55bd7060db75 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8" status: 404 len: 111 microversion: 2.1 time: 0.117266 Oct 24 10:27:48.254703 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 453/916] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:48 2022] GET /compute/v2.1/servers/2c4889ce-5a69-43f8-856a-a51289323fa8 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:27:48.273730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ce3a261-f583-429c-a42f-7f44859149f6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:48.274232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0ce3a261-f583-429c-a42f-7f44859149f6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:48.295482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ce3a261-f583-429c-a42f-7f44859149f6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:48.295482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ce3a261-f583-429c-a42f-7f44859149f6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:48.295764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ce3a261-f583-429c-a42f-7f44859149f6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:48.296496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ce3a261-f583-429c-a42f-7f44859149f6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:48.296996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ce3a261-f583-429c-a42f-7f44859149f6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:48.315753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ce3a261-f583-429c-a42f-7f44859149f6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:48.361296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:27:48.362335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:27:48.363282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:27:48.365122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:27:48.365886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:27:48.391172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:48.392157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:48.392814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:48.394311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:48.395006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:48.396112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:48.426392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for project b565572c0c8c4871af02471a328bd1af. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:27:48.433276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for user 9aa572f1e5014e10bed0abe34dfad43f and project b565572c0c8c4871af02471a328bd1af. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:27:48.461664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Going to run 2 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:27:48.466221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:27:48.479951 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0ce3a261-f583-429c-a42f-7f44859149f6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.225844 Oct 24 10:27:48.488442 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 454/917] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 10:27:48 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-interface => generated 285 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:48.494791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-40e48679-75b2-4e4a-b1bf-fbe2ecc6e260 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '.version_select at 0x7f04d0f09790>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:48.543451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:48.557634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for project b565572c0c8c4871af02471a328bd1af. Resources: {'server_group_members'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:27:48.565666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for user 9aa572f1e5014e10bed0abe34dfad43f and project b565572c0c8c4871af02471a328bd1af. Resources: {'server_group_members'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:27:48.623488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for project b565572c0c8c4871af02471a328bd1af. Resources: {'server_group_members'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:27:48.629917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for user 9aa572f1e5014e10bed0abe34dfad43f and project b565572c0c8c4871af02471a328bd1af. Resources: {'server_group_members'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:27:48.648117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: d4958f64-a776-423b-8544-b0918c30d25e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=294c2f53-e675-40b8-a91f-634939781010,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:27:48.723832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for project b565572c0c8c4871af02471a328bd1af. Resources: {'server_group_members'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:27:48.730974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for user 9aa572f1e5014e10bed0abe34dfad43f and project b565572c0c8c4871af02471a328bd1af. Resources: {'server_group_members'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:27:48.781801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for project b565572c0c8c4871af02471a328bd1af. Resources: {'server_group_members'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:27:48.791131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for user 9aa572f1e5014e10bed0abe34dfad43f and project b565572c0c8c4871af02471a328bd1af. Resources: {'server_group_members'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:27:48.834894 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-59731ae4-021d-4926-8493-2012eb455212 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.101500 Oct 24 10:27:48.836305 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 464/918] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:27:47 2022] POST /compute/v2.1/servers => generated 32 bytes in 1104 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 24 10:27:48.842196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-efa79e6c-f64f-4433-9a62-60f3055d7dbe tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0caf550>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:48.917192 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-efa79e6c-f64f-4433-9a62-60f3055d7dbe tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb" status: 200 len: 1453 microversion: 2.1 time: 0.079443 Oct 24 10:27:48.926806 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 465/919] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:48 2022] GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:48.931857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a0e86ddc-53b6-4778-a8ad-e468d9a60521 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0caf040>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:49.009587 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a0e86ddc-53b6-4778-a8ad-e468d9a60521 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69" status: 200 len: 1413 microversion: 2.1 time: 0.081550 Oct 24 10:27:49.019967 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 466/920] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:48 2022] GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 => generated 1413 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:49.026849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-14eaf506-883a-4af7-8f12-ffbd68de2fab tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:49.027465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-14eaf506-883a-4af7-8f12-ffbd68de2fab tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:49.052904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14eaf506-883a-4af7-8f12-ffbd68de2fab tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:49.053561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14eaf506-883a-4af7-8f12-ffbd68de2fab tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:49.054005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14eaf506-883a-4af7-8f12-ffbd68de2fab tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:49.054729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14eaf506-883a-4af7-8f12-ffbd68de2fab tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:49.055184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14eaf506-883a-4af7-8f12-ffbd68de2fab tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:49.055606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14eaf506-883a-4af7-8f12-ffbd68de2fab tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:49.540222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-14eaf506-883a-4af7-8f12-ffbd68de2fab tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:49.550089 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-14eaf506-883a-4af7-8f12-ffbd68de2fab tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1471 microversion: 2.1 time: 0.528241 Oct 24 10:27:49.551826 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 467/921] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:49 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1471 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:49.558333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-39c21197-3bf2-4540-b4ce-7d8a5ae5d5e8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:49.559220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-39c21197-3bf2-4540-b4ce-7d8a5ae5d5e8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:49.570157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-39c21197-3bf2-4540-b4ce-7d8a5ae5d5e8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:49.570907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-39c21197-3bf2-4540-b4ce-7d8a5ae5d5e8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:49.571695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-39c21197-3bf2-4540-b4ce-7d8a5ae5d5e8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:49.579397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-39c21197-3bf2-4540-b4ce-7d8a5ae5d5e8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:49.580192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-39c21197-3bf2-4540-b4ce-7d8a5ae5d5e8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:49.581081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-39c21197-3bf2-4540-b4ce-7d8a5ae5d5e8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:50.244195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-39c21197-3bf2-4540-b4ce-7d8a5ae5d5e8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:50.255769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-39c21197-3bf2-4540-b4ce-7d8a5ae5d5e8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:50.263390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-39c21197-3bf2-4540-b4ce-7d8a5ae5d5e8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:50.279378 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-39c21197-3bf2-4540-b4ce-7d8a5ae5d5e8 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 200 len: 1361 microversion: 2.25 time: 0.726264 Oct 24 10:27:50.284307 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 468/922] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:27:49 2022] GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 1361 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:27:50.298675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2963d366-f48b-4609-ba6b-f91aa868e2c5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:50.326225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2963d366-f48b-4609-ba6b-f91aa868e2c5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:50.330444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2963d366-f48b-4609-ba6b-f91aa868e2c5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Searching by: {'deleted': False, 'project_id': 'b565572c0c8c4871af02471a328bd1af'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:27:50.344257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2963d366-f48b-4609-ba6b-f91aa868e2c5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:50.345200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2963d366-f48b-4609-ba6b-f91aa868e2c5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:50.346055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2963d366-f48b-4609-ba6b-f91aa868e2c5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:50.347019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2963d366-f48b-4609-ba6b-f91aa868e2c5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:50.347698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2963d366-f48b-4609-ba6b-f91aa868e2c5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:50.348613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2963d366-f48b-4609-ba6b-f91aa868e2c5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:50.392398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-2963d366-f48b-4609-ba6b-f91aa868e2c5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:27:50.452885 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2963d366-f48b-4609-ba6b-f91aa868e2c5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.166198 Oct 24 10:27:50.454129 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 469/923] 10.222.0.50 () {58 vars in 1125 bytes} [Mon Oct 24 10:27:50 2022] GET /compute/v2.1/servers => generated 1662 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:50.461085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-b0a4bce1-3b1a-4815-9fb0-3e7825ac45a2 req-ae1e224c-d1c4-447f-8751-3f59d5f91594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c18a9a-ad67-4d8e-abd2-349766d8a002", "name": "network-vif-unplugged", "status": "completed", "tag": "0782d6f6-5f17-49c4-9ee3-4c8b802a9588"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:50.484559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b0a4bce1-3b1a-4815-9fb0-3e7825ac45a2 req-ae1e224c-d1c4-447f-8751-3f59d5f91594 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:50.487041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b0a4bce1-3b1a-4815-9fb0-3e7825ac45a2 req-ae1e224c-d1c4-447f-8751-3f59d5f91594 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:50.489382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b0a4bce1-3b1a-4815-9fb0-3e7825ac45a2 req-ae1e224c-d1c4-447f-8751-3f59d5f91594 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:50.512997 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-b0a4bce1-3b1a-4815-9fb0-3e7825ac45a2 req-ae1e224c-d1c4-447f-8751-3f59d5f91594 service nova] Creating event network-vif-unplugged:0782d6f6-5f17-49c4-9ee3-4c8b802a9588 for instance 98c18a9a-ad67-4d8e-abd2-349766d8a002 on n-h2-858383-15 Oct 24 10:27:50.529731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [req-b0a4bce1-3b1a-4815-9fb0-3e7825ac45a2 req-ae1e224c-d1c4-447f-8751-3f59d5f91594 service nova] Instance 98c18a9a-ad67-4d8e-abd2-349766d8a002 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-15'} {{(pid=120426) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:27:50.542099 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-b0a4bce1-3b1a-4815-9fb0-3e7825ac45a2 req-ae1e224c-d1c4-447f-8751-3f59d5f91594 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086398 Oct 24 10:27:50.547029 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 470/924] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:50.554772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-58f7fca2-e603-42e1-a321-b40258919432 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:50.555413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-58f7fca2-e603-42e1-a321-b40258919432 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:50.581297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58f7fca2-e603-42e1-a321-b40258919432 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:50.581802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58f7fca2-e603-42e1-a321-b40258919432 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:50.587652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58f7fca2-e603-42e1-a321-b40258919432 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:50.588611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58f7fca2-e603-42e1-a321-b40258919432 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:50.589316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58f7fca2-e603-42e1-a321-b40258919432 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:50.589921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58f7fca2-e603-42e1-a321-b40258919432 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:50.646608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58f7fca2-e603-42e1-a321-b40258919432 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:50.647580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58f7fca2-e603-42e1-a321-b40258919432 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:50.648454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58f7fca2-e603-42e1-a321-b40258919432 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:50.649467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58f7fca2-e603-42e1-a321-b40258919432 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:50.650153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58f7fca2-e603-42e1-a321-b40258919432 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:50.650818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58f7fca2-e603-42e1-a321-b40258919432 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:50.679297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-58f7fca2-e603-42e1-a321-b40258919432 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Getting quotas for project ac5f703504204b91a5c7e895964ec985. Resources: {'cores', 'ram'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:27:50.685366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-58f7fca2-e603-42e1-a321-b40258919432 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Getting quotas for user b684c865fc9e4abb8e0e55616087b92e and project ac5f703504204b91a5c7e895964ec985. Resources: {'cores', 'ram'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:27:50.820018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:50.850357 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-58f7fca2-e603-42e1-a321-b40258919432 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "POST /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002/action" status: 202 len: 0 microversion: 2.1 time: 0.300116 Oct 24 10:27:50.855084 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 471/925] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:27:50 2022] POST /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:27:50.874622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ad74ff1c-c0e0-4e96-837b-dab5472be1da tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0ca7c10>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:50.944792 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ad74ff1c-c0e0-4e96-837b-dab5472be1da tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb" status: 200 len: 1453 microversion: 2.1 time: 0.087245 Oct 24 10:27:50.952824 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 472/926] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:50 2022] GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:50.953572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ea365341-e921-4fe5-acb4-05816194bb37 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0fdce50>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:51.024288 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ea365341-e921-4fe5-acb4-05816194bb37 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69" status: 200 len: 1413 microversion: 2.1 time: 0.076037 Oct 24 10:27:51.024934 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 473/927] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:50 2022] GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 => generated 1413 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:51.032801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9c60cacf-4663-440d-8f87-dae9c791a3da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:51.033753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9c60cacf-4663-440d-8f87-dae9c791a3da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:51.043891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c60cacf-4663-440d-8f87-dae9c791a3da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:51.044194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c60cacf-4663-440d-8f87-dae9c791a3da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:51.045068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c60cacf-4663-440d-8f87-dae9c791a3da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:51.047701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c60cacf-4663-440d-8f87-dae9c791a3da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:51.048184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c60cacf-4663-440d-8f87-dae9c791a3da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:51.048625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c60cacf-4663-440d-8f87-dae9c791a3da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:51.243258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9c60cacf-4663-440d-8f87-dae9c791a3da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:51.261162 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9c60cacf-4663-440d-8f87-dae9c791a3da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010" status: 200 len: 1270 microversion: 2.1 time: 0.234913 Oct 24 10:27:51.262723 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 474/928] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:51 2022] GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 => generated 1270 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:51.270026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ea905a34-2e1b-4495-b50a-11d11f0d0b66 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:51.271191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ea905a34-2e1b-4495-b50a-11d11f0d0b66 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:51.282554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea905a34-2e1b-4495-b50a-11d11f0d0b66 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:51.284105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea905a34-2e1b-4495-b50a-11d11f0d0b66 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:51.285843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea905a34-2e1b-4495-b50a-11d11f0d0b66 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:51.293516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea905a34-2e1b-4495-b50a-11d11f0d0b66 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:51.294817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea905a34-2e1b-4495-b50a-11d11f0d0b66 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:51.295527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea905a34-2e1b-4495-b50a-11d11f0d0b66 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:51.554103 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-40e48679-75b2-4e4a-b1bf-fbe2ecc6e260 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/8c4ba785-69f9-4c66-beb4-08114716c3aa" status: 202 len: 0 microversion: 2.1 time: 3.072134 Oct 24 10:27:51.558586 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 455/929] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:27:48 2022] DELETE /compute/v2.1/os-floating-ips/8c4ba785-69f9-4c66-beb4-08114716c3aa => generated 0 bytes in 3077 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:27:51.574530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-71617b8e-a6ec-47e9-9db9-7e3854f1346a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:51.577480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-71617b8e-a6ec-47e9-9db9-7e3854f1346a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:51.588663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71617b8e-a6ec-47e9-9db9-7e3854f1346a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:51.589644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71617b8e-a6ec-47e9-9db9-7e3854f1346a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:51.590343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71617b8e-a6ec-47e9-9db9-7e3854f1346a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:51.591679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71617b8e-a6ec-47e9-9db9-7e3854f1346a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:51.592361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71617b8e-a6ec-47e9-9db9-7e3854f1346a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:51.593922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71617b8e-a6ec-47e9-9db9-7e3854f1346a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:51.723751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ea905a34-2e1b-4495-b50a-11d11f0d0b66 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:51.734432 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ea905a34-2e1b-4495-b50a-11d11f0d0b66 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1470 microversion: 2.1 time: 0.470006 Oct 24 10:27:51.752687 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 475/930] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:51 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1470 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:51.759080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-221f6b95-94c3-4acd-b3f8-d7b0a9dc2628 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:51.759846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-221f6b95-94c3-4acd-b3f8-d7b0a9dc2628 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:51.767788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-221f6b95-94c3-4acd-b3f8-d7b0a9dc2628 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:51.768289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-221f6b95-94c3-4acd-b3f8-d7b0a9dc2628 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:51.768953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-221f6b95-94c3-4acd-b3f8-d7b0a9dc2628 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:51.770048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-221f6b95-94c3-4acd-b3f8-d7b0a9dc2628 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:51.770889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-221f6b95-94c3-4acd-b3f8-d7b0a9dc2628 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:51.772875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-221f6b95-94c3-4acd-b3f8-d7b0a9dc2628 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:51.800956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-221f6b95-94c3-4acd-b3f8-d7b0a9dc2628 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:27:51.908898 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-221f6b95-94c3-4acd-b3f8-d7b0a9dc2628 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "DELETE /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 204 len: 0 microversion: 2.1 time: 0.153703 Oct 24 10:27:51.914204 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 476/931] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:27:51 2022] DELETE /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:27:51.922781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-92a27e03-181a-4209-aa24-b76f86d7e3fb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:51.923926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-92a27e03-181a-4209-aa24-b76f86d7e3fb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:51.932749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92a27e03-181a-4209-aa24-b76f86d7e3fb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:51.933679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92a27e03-181a-4209-aa24-b76f86d7e3fb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:51.934129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92a27e03-181a-4209-aa24-b76f86d7e3fb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:51.935165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92a27e03-181a-4209-aa24-b76f86d7e3fb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:51.935952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92a27e03-181a-4209-aa24-b76f86d7e3fb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:51.936976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92a27e03-181a-4209-aa24-b76f86d7e3fb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:52.292022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-71617b8e-a6ec-47e9-9db9-7e3854f1346a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:52.300337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-71617b8e-a6ec-47e9-9db9-7e3854f1346a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:52.309691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-71617b8e-a6ec-47e9-9db9-7e3854f1346a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:52.310874 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-71617b8e-a6ec-47e9-9db9-7e3854f1346a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 200 len: 1361 microversion: 2.25 time: 0.750806 Oct 24 10:27:52.311995 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 456/932] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:27:51 2022] GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 1361 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:27:52.328747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-58d326b5-7fdb-4d06-97aa-1c667a204c03 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d127e5e0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:52.394689 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-58d326b5-7fdb-4d06-97aa-1c667a204c03 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb" status: 200 len: 1453 microversion: 2.1 time: 0.080640 Oct 24 10:27:52.401529 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 457/933] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:52 2022] GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:52.406818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0ff98ad-1ff0-499d-ab6a-291c2907fca5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d13dc1f0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:52.428903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-92a27e03-181a-4209-aa24-b76f86d7e3fb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:52.440422 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-92a27e03-181a-4209-aa24-b76f86d7e3fb tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 200 len: 1524 microversion: 2.1 time: 0.523191 Oct 24 10:27:52.448867 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 477/934] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:51 2022] GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 1524 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:27:52.448867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b1e2fbec-96d8-4a38-9f8f-04fe77086e54 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:52.449171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b1e2fbec-96d8-4a38-9f8f-04fe77086e54 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:52.477809 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f0ff98ad-1ff0-499d-ab6a-291c2907fca5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69" status: 200 len: 1413 microversion: 2.1 time: 0.074881 Oct 24 10:27:52.478883 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 458/935] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:52 2022] GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 => generated 1413 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:52.481649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b1e2fbec-96d8-4a38-9f8f-04fe77086e54 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:52.482137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b1e2fbec-96d8-4a38-9f8f-04fe77086e54 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:52.482567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b1e2fbec-96d8-4a38-9f8f-04fe77086e54 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:52.487675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b1e2fbec-96d8-4a38-9f8f-04fe77086e54 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:52.488131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b1e2fbec-96d8-4a38-9f8f-04fe77086e54 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:52.488559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b1e2fbec-96d8-4a38-9f8f-04fe77086e54 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:52.490213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-208c1383-85a7-4c61-bb42-9fab9a5f34f5 req-885364f6-80af-46af-aa1e-2d160552e6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9eff099-cc37-4432-8741-4e7d179b9ff0", "tag": "e5f5ae43-f478-4bd6-8b05-04ea1b1ab6c2"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:52.510665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-208c1383-85a7-4c61-bb42-9fab9a5f34f5 req-885364f6-80af-46af-aa1e-2d160552e6a6 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:52.512091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-208c1383-85a7-4c61-bb42-9fab9a5f34f5 req-885364f6-80af-46af-aa1e-2d160552e6a6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:52.512521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-208c1383-85a7-4c61-bb42-9fab9a5f34f5 req-885364f6-80af-46af-aa1e-2d160552e6a6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:52.547887 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-208c1383-85a7-4c61-bb42-9fab9a5f34f5 req-885364f6-80af-46af-aa1e-2d160552e6a6 service nova] Creating event network-changed:e5f5ae43-f478-4bd6-8b05-04ea1b1ab6c2 for instance b9eff099-cc37-4432-8741-4e7d179b9ff0 on n-h2-858383-15 Oct 24 10:27:52.556131 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-208c1383-85a7-4c61-bb42-9fab9a5f34f5 req-885364f6-80af-46af-aa1e-2d160552e6a6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072206 Oct 24 10:27:52.561123 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 459/936] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:52.568220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f65ce790-67a1-4faf-bc5a-48c227b4ee22 req-72f85d1c-b082-4240-b762-fe2d518835a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c18a9a-ad67-4d8e-abd2-349766d8a002", "name": "network-vif-plugged", "status": "completed", "tag": "0782d6f6-5f17-49c4-9ee3-4c8b802a9588"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:52.579160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f65ce790-67a1-4faf-bc5a-48c227b4ee22 req-72f85d1c-b082-4240-b762-fe2d518835a8 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:52.580019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f65ce790-67a1-4faf-bc5a-48c227b4ee22 req-72f85d1c-b082-4240-b762-fe2d518835a8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:52.580613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f65ce790-67a1-4faf-bc5a-48c227b4ee22 req-72f85d1c-b082-4240-b762-fe2d518835a8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:52.594988 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f65ce790-67a1-4faf-bc5a-48c227b4ee22 req-72f85d1c-b082-4240-b762-fe2d518835a8 service nova] Creating event network-vif-plugged:0782d6f6-5f17-49c4-9ee3-4c8b802a9588 for instance 98c18a9a-ad67-4d8e-abd2-349766d8a002 on n-h2-858383-15 Oct 24 10:27:52.601794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-f65ce790-67a1-4faf-bc5a-48c227b4ee22 req-72f85d1c-b082-4240-b762-fe2d518835a8 service nova] Instance 98c18a9a-ad67-4d8e-abd2-349766d8a002 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:27:52.609072 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f65ce790-67a1-4faf-bc5a-48c227b4ee22 req-72f85d1c-b082-4240-b762-fe2d518835a8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046193 Oct 24 10:27:52.610380 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 460/937] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:52.663192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b1e2fbec-96d8-4a38-9f8f-04fe77086e54 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:52.673924 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b1e2fbec-96d8-4a38-9f8f-04fe77086e54 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010" status: 200 len: 1270 microversion: 2.1 time: 0.231246 Oct 24 10:27:52.674656 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 478/938] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:52 2022] GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 => generated 1270 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:52.759870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b8adcba7-0ece-45a3-95e2-cf9c100731c5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:52.760998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b8adcba7-0ece-45a3-95e2-cf9c100731c5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:52.770963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8adcba7-0ece-45a3-95e2-cf9c100731c5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:52.774309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8adcba7-0ece-45a3-95e2-cf9c100731c5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:52.774829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8adcba7-0ece-45a3-95e2-cf9c100731c5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:52.776775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8adcba7-0ece-45a3-95e2-cf9c100731c5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:52.778288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8adcba7-0ece-45a3-95e2-cf9c100731c5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:52.780249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8adcba7-0ece-45a3-95e2-cf9c100731c5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:53.141718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b8adcba7-0ece-45a3-95e2-cf9c100731c5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:53.161068 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b8adcba7-0ece-45a3-95e2-cf9c100731c5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1470 microversion: 2.1 time: 0.403427 Oct 24 10:27:53.162623 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 461/939] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:52 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1470 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:53.339981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d5763217-0472-4002-bd82-f4364041917a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:53.340546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d5763217-0472-4002-bd82-f4364041917a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:53.356555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5763217-0472-4002-bd82-f4364041917a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:53.357077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5763217-0472-4002-bd82-f4364041917a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:53.357516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5763217-0472-4002-bd82-f4364041917a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:53.358234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5763217-0472-4002-bd82-f4364041917a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:53.358687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5763217-0472-4002-bd82-f4364041917a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:53.359110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5763217-0472-4002-bd82-f4364041917a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:53.423650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9476a6ac-836f-4c71-8857-40f74739b6e0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d12c5430>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:53.492254 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9476a6ac-836f-4c71-8857-40f74739b6e0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb" status: 200 len: 1453 microversion: 2.1 time: 0.079372 Oct 24 10:27:53.501843 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 462/940] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:53 2022] GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:27:53.508857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f1f8dd68-e784-49ea-8669-f7b19dec17d6 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:53.509733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f1f8dd68-e784-49ea-8669-f7b19dec17d6 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:53.519407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1f8dd68-e784-49ea-8669-f7b19dec17d6 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:53.519908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1f8dd68-e784-49ea-8669-f7b19dec17d6 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:53.520354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1f8dd68-e784-49ea-8669-f7b19dec17d6 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:53.529261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1f8dd68-e784-49ea-8669-f7b19dec17d6 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:53.530236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1f8dd68-e784-49ea-8669-f7b19dec17d6 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:53.530391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1f8dd68-e784-49ea-8669-f7b19dec17d6 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:53.631687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d5763217-0472-4002-bd82-f4364041917a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:53.656624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d5763217-0472-4002-bd82-f4364041917a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:53.665933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d5763217-0472-4002-bd82-f4364041917a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:53.669696 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d5763217-0472-4002-bd82-f4364041917a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 200 len: 1361 microversion: 2.25 time: 0.333783 Oct 24 10:27:53.674892 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 479/941] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:27:53 2022] GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 1361 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:27:53.690518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-07de3794-647c-4685-b82a-4eb91eb7648b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0bb78b0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:53.804156 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-07de3794-647c-4685-b82a-4eb91eb7648b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69" status: 200 len: 1413 microversion: 2.1 time: 0.126505 Oct 24 10:27:53.811549 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 480/942] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:53 2022] GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 => generated 1413 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:53.815725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f1f8dd68-e784-49ea-8669-f7b19dec17d6 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:53.827106 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f1f8dd68-e784-49ea-8669-f7b19dec17d6 tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 200 len: 1524 microversion: 2.1 time: 0.321691 Oct 24 10:27:53.828910 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 463/943] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:53 2022] GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 1524 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:53.833075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2b409dd5-88fa-41e4-8c14-72b03ce72446 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:53.835201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2b409dd5-88fa-41e4-8c14-72b03ce72446 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:53.850951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b409dd5-88fa-41e4-8c14-72b03ce72446 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:53.852013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b409dd5-88fa-41e4-8c14-72b03ce72446 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:53.852622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b409dd5-88fa-41e4-8c14-72b03ce72446 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:53.853552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b409dd5-88fa-41e4-8c14-72b03ce72446 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:53.854017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b409dd5-88fa-41e4-8c14-72b03ce72446 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:53.854442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b409dd5-88fa-41e4-8c14-72b03ce72446 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:53.978338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2b409dd5-88fa-41e4-8c14-72b03ce72446 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:53.992269 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2b409dd5-88fa-41e4-8c14-72b03ce72446 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010" status: 200 len: 1276 microversion: 2.1 time: 0.179297 Oct 24 10:27:54.007607 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 481/944] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:53 2022] GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 => generated 1276 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:54.188319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f7d7e7db-8fb2-49bd-9196-70957b23a82b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:54.188319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f7d7e7db-8fb2-49bd-9196-70957b23a82b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:54.198344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7d7e7db-8fb2-49bd-9196-70957b23a82b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:54.200680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7d7e7db-8fb2-49bd-9196-70957b23a82b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:54.201375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7d7e7db-8fb2-49bd-9196-70957b23a82b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:54.202309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7d7e7db-8fb2-49bd-9196-70957b23a82b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:54.204069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7d7e7db-8fb2-49bd-9196-70957b23a82b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:54.207470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7d7e7db-8fb2-49bd-9196-70957b23a82b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:54.429891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f7d7e7db-8fb2-49bd-9196-70957b23a82b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:54.440583 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f7d7e7db-8fb2-49bd-9196-70957b23a82b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1470 microversion: 2.1 time: 0.257893 Oct 24 10:27:54.457974 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 464/945] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:54 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1470 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:54.507924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f99dac3a-60fb-45f9-92e6-d1e9f6669b3b tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0cc01f0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:54.558516 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f99dac3a-60fb-45f9-92e6-d1e9f6669b3b tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb" status: 200 len: 1453 microversion: 2.1 time: 0.054716 Oct 24 10:27:54.559216 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 482/946] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:54 2022] GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb => generated 1453 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:54.626287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f132ffc5-4758-4ea1-ad03-405bd10c09fc req-67b4e2f4-4e4c-49bf-848f-5afa84176b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c264bc-70a7-4b1b-a29a-d5bbb2884809", "name": "network-vif-plugged", "status": "completed", "tag": "8db04e7c-b441-4bfb-89ad-0f6839db6290"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:54.637868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f132ffc5-4758-4ea1-ad03-405bd10c09fc req-67b4e2f4-4e4c-49bf-848f-5afa84176b23 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:54.638343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f132ffc5-4758-4ea1-ad03-405bd10c09fc req-67b4e2f4-4e4c-49bf-848f-5afa84176b23 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:54.639025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f132ffc5-4758-4ea1-ad03-405bd10c09fc req-67b4e2f4-4e4c-49bf-848f-5afa84176b23 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:54.652432 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f132ffc5-4758-4ea1-ad03-405bd10c09fc req-67b4e2f4-4e4c-49bf-848f-5afa84176b23 service nova] Creating event network-vif-plugged:8db04e7c-b441-4bfb-89ad-0f6839db6290 for instance 77c264bc-70a7-4b1b-a29a-d5bbb2884809 on n-h1-858383-15 Oct 24 10:27:54.657612 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f132ffc5-4758-4ea1-ad03-405bd10c09fc req-67b4e2f4-4e4c-49bf-848f-5afa84176b23 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035826 Oct 24 10:27:54.659078 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 465/947] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:54.711357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-36789b12-ee29-4ca0-845b-b1f1d71f16d1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:54.711954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-36789b12-ee29-4ca0-845b-b1f1d71f16d1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:54.721976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36789b12-ee29-4ca0-845b-b1f1d71f16d1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:54.722690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36789b12-ee29-4ca0-845b-b1f1d71f16d1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:54.723229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36789b12-ee29-4ca0-845b-b1f1d71f16d1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:54.724158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36789b12-ee29-4ca0-845b-b1f1d71f16d1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:54.724826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36789b12-ee29-4ca0-845b-b1f1d71f16d1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:54.725436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36789b12-ee29-4ca0-845b-b1f1d71f16d1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:54.766265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-903dec4b-feec-4ed5-b186-d008240c2369 req-93d5c899-d7b0-4777-8ea8-a5f10e3328f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d34420-321b-4914-a4e0-d03965e049b3", "name": "network-vif-deleted", "tag": "3da84e0c-5c52-4ffa-8616-0781a71c3874"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:54.786145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-903dec4b-feec-4ed5-b186-d008240c2369 req-93d5c899-d7b0-4777-8ea8-a5f10e3328f5 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:54.786604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-903dec4b-feec-4ed5-b186-d008240c2369 req-93d5c899-d7b0-4777-8ea8-a5f10e3328f5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:54.787038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-903dec4b-feec-4ed5-b186-d008240c2369 req-93d5c899-d7b0-4777-8ea8-a5f10e3328f5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:54.831788 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-903dec4b-feec-4ed5-b186-d008240c2369 req-93d5c899-d7b0-4777-8ea8-a5f10e3328f5 service nova] Creating event network-vif-deleted:3da84e0c-5c52-4ffa-8616-0781a71c3874 for instance 00d34420-321b-4914-a4e0-d03965e049b3 on n-h1-858383-15 Oct 24 10:27:54.841987 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-903dec4b-feec-4ed5-b186-d008240c2369 req-93d5c899-d7b0-4777-8ea8-a5f10e3328f5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081975 Oct 24 10:27:54.847240 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 466/948] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:27:54.860167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-df57fdcd-99b3-482e-9403-ce989df47340 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0f091f0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:54.945267 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-df57fdcd-99b3-482e-9403-ce989df47340 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69" status: 200 len: 1413 microversion: 2.1 time: 0.095407 Oct 24 10:27:54.959930 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 467/949] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:54 2022] GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:54.973596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0398db00-b60b-4a6f-8edd-69b8fc5178ee tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:54.974670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0398db00-b60b-4a6f-8edd-69b8fc5178ee tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:54.986007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0398db00-b60b-4a6f-8edd-69b8fc5178ee tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:54.988337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0398db00-b60b-4a6f-8edd-69b8fc5178ee tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:54.991860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0398db00-b60b-4a6f-8edd-69b8fc5178ee tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:54.992959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0398db00-b60b-4a6f-8edd-69b8fc5178ee tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:54.994737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0398db00-b60b-4a6f-8edd-69b8fc5178ee tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:54.995394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0398db00-b60b-4a6f-8edd-69b8fc5178ee tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:55.059903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-36789b12-ee29-4ca0-845b-b1f1d71f16d1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:55.070391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-36789b12-ee29-4ca0-845b-b1f1d71f16d1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:55.072731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-36789b12-ee29-4ca0-845b-b1f1d71f16d1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:55.074360 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-36789b12-ee29-4ca0-845b-b1f1d71f16d1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 200 len: 1361 microversion: 2.25 time: 0.368121 Oct 24 10:27:55.075437 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 483/950] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:27:54 2022] GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 1361 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:27:55.080661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d30ad1a8-5a95-432f-9565-33836707d735 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:55.081509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d30ad1a8-5a95-432f-9565-33836707d735 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:55.085861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0398db00-b60b-4a6f-8edd-69b8fc5178ee tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:55.086948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0398db00-b60b-4a6f-8edd-69b8fc5178ee tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:55.087403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0398db00-b60b-4a6f-8edd-69b8fc5178ee tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:55.087863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-0398db00-b60b-4a6f-8edd-69b8fc5178ee tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lazy-loading 'fault' on Instance uuid 00d34420-321b-4914-a4e0-d03965e049b3 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:27:55.090831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d30ad1a8-5a95-432f-9565-33836707d735 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:55.092592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d30ad1a8-5a95-432f-9565-33836707d735 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:55.093527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d30ad1a8-5a95-432f-9565-33836707d735 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:55.094630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d30ad1a8-5a95-432f-9565-33836707d735 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:55.095570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d30ad1a8-5a95-432f-9565-33836707d735 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:55.096239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d30ad1a8-5a95-432f-9565-33836707d735 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:55.200773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0398db00-b60b-4a6f-8edd-69b8fc5178ee tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef304f0a2ef54385b985dd16fa1b35c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb2a59a2134fe0a2903b9591cc522b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:55.211735 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0398db00-b60b-4a6f-8edd-69b8fc5178ee tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 200 len: 1313 microversion: 2.1 time: 0.250415 Oct 24 10:27:55.214542 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 468/951] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:54 2022] GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:55.406602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d30ad1a8-5a95-432f-9565-33836707d735 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:55.419189 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d30ad1a8-5a95-432f-9565-33836707d735 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010" status: 200 len: 1318 microversion: 2.1 time: 0.342229 Oct 24 10:27:55.420699 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 484/952] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:55 2022] GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:55.473614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5cdcc362-a6a0-49d7-a41d-fea39e042e53 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:55.474612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5cdcc362-a6a0-49d7-a41d-fea39e042e53 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:55.488888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cdcc362-a6a0-49d7-a41d-fea39e042e53 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:55.491907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cdcc362-a6a0-49d7-a41d-fea39e042e53 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:55.493031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cdcc362-a6a0-49d7-a41d-fea39e042e53 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:55.493808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cdcc362-a6a0-49d7-a41d-fea39e042e53 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:55.495702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cdcc362-a6a0-49d7-a41d-fea39e042e53 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:55.496147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cdcc362-a6a0-49d7-a41d-fea39e042e53 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:55.574719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1b613ef7-d5f4-4dfe-934f-282b6cce841e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0b725e0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:55.649865 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1b613ef7-d5f4-4dfe-934f-282b6cce841e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb" status: 200 len: 1453 microversion: 2.1 time: 0.078813 Oct 24 10:27:55.658502 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 485/953] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:55 2022] GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:55.843949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5cdcc362-a6a0-49d7-a41d-fea39e042e53 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:55.858578 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5cdcc362-a6a0-49d7-a41d-fea39e042e53 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1470 microversion: 2.1 time: 0.393194 Oct 24 10:27:55.861377 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 469/954] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:55 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1470 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:55.966331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-afe92cb9-2f7a-4c22-81d0-e4f271a319f6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d133c040>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:56.025329 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-afe92cb9-2f7a-4c22-81d0-e4f271a319f6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69" status: 200 len: 1413 microversion: 2.1 time: 0.062084 Oct 24 10:27:56.025607 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 470/955] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:55 2022] GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 => generated 1413 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:56.105138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6ba58804-4446-4116-ba5f-72cdceab1b2a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:56.105897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6ba58804-4446-4116-ba5f-72cdceab1b2a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:56.115308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ba58804-4446-4116-ba5f-72cdceab1b2a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.119084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ba58804-4446-4116-ba5f-72cdceab1b2a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.119853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ba58804-4446-4116-ba5f-72cdceab1b2a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.120822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ba58804-4446-4116-ba5f-72cdceab1b2a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.121547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ba58804-4446-4116-ba5f-72cdceab1b2a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.122226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ba58804-4446-4116-ba5f-72cdceab1b2a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.215356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a26c8a3c-0b8c-4a95-8433-316e8e371d98 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Calling method '.version_select at 0x7f04d0cc0940>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:56.223075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a26c8a3c-0b8c-4a95-8433-316e8e371d98 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.224007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a26c8a3c-0b8c-4a95-8433-316e8e371d98 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.224900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a26c8a3c-0b8c-4a95-8433-316e8e371d98 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.226098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a26c8a3c-0b8c-4a95-8433-316e8e371d98 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.226815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a26c8a3c-0b8c-4a95-8433-316e8e371d98 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.227530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a26c8a3c-0b8c-4a95-8433-316e8e371d98 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.260367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:56.282718 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a26c8a3c-0b8c-4a95-8433-316e8e371d98 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.356399 Oct 24 10:27:56.283673 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 486/956] 10.222.0.50 () {58 vars in 1128 bytes} [Mon Oct 24 10:27:55 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:56.292774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-054a287b-2dbe-41ba-911d-7c6cb1ab6f1b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:56.293776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-054a287b-2dbe-41ba-911d-7c6cb1ab6f1b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] [instance: 00d34420-321b-4914-a4e0-d03965e049b3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:56.300704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-054a287b-2dbe-41ba-911d-7c6cb1ab6f1b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.301190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-054a287b-2dbe-41ba-911d-7c6cb1ab6f1b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.301922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-054a287b-2dbe-41ba-911d-7c6cb1ab6f1b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.302841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-054a287b-2dbe-41ba-911d-7c6cb1ab6f1b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.304387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-054a287b-2dbe-41ba-911d-7c6cb1ab6f1b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.305207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-054a287b-2dbe-41ba-911d-7c6cb1ab6f1b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.323387 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-054a287b-2dbe-41ba-911d-7c6cb1ab6f1b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] HTTP exception thrown: Instance 00d34420-321b-4914-a4e0-d03965e049b3 could not be found. Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-054a287b-2dbe-41ba-911d-7c6cb1ab6f1b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Request method failure captured: Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 HTTP/1.1 Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmg-iAS81ByMIK8-9bLAdLa0SJt2i-vBS9i36AKrRJqZVAhGTrFdARQrrICb7Rz8SKYBFwK1FZ2c-N2gPJKnFwiQM_HXpZInwJNBgkMc1rEA2oZzHdC4_EpHvpYs33zMYC0zNK0brx_wHU-UVAfyhyXQJVko2Kk1IngPq6gSfy6k1Eo Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 2afb2a59a2134fe0a2903b9591cc522b Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1389855451 Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:27:56.326022 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:27:56.327345 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2afb2a59a2134fe0a2903b9591cc522b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2afb2a59a2134fe0a2903b9591cc522b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2afb2a59a2134fe0a2903b9591cc522b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2afb2a59a2134fe0a2903b9591cc522b", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:27:56.327345 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1389855451 Oct 24 10:27:56.327345 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 2afb2a59a2134fe0a2903b9591cc522b Oct 24 10:27:56.327345 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1389855451 Oct 24 10:27:56.327345 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-FloatingIPsAssociationTestJSON-1389855451-project Oct 24 10:27:56.327345 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:27:56.327345 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:27:56.327345 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ef304f0a2ef54385b985dd16fa1b35c8 Oct 24 10:27:56.327345 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1389855451-project Oct 24 10:27:56.327345 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:27:56.327345 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 00d34420-321b-4914-a4e0-d03965e049b3 could not be found. Oct 24 10:27:56.327345 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '00d34420-321b-4914-a4e0-d03965e049b3'} Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00d34420-321b-4914-a4e0-d03965e049b3 could not be found. Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:27:56.328065 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:27:56.329286 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:27:56.329286 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:27:56.329286 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:27:56.329286 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:27:56.329286 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:27:56.329286 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:27:56.329286 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:27:56.329286 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00d34420-321b-4914-a4e0-d03965e049b3 could not be found. Oct 24 10:27:56.329286 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:27:56.329286 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:27:56.329286 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:27:56.329286 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:27:56.329286 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:27:56.329286 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:27:56.329286 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:27:56.329286 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:27:56.329286 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00d34420-321b-4914-a4e0-d03965e049b3 could not be found. Oct 24 10:27:56.329286 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:27:56.336420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-054a287b-2dbe-41ba-911d-7c6cb1ab6f1b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] Returning 404 to user: Instance 00d34420-321b-4914-a4e0-d03965e049b3 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:27:56.337557 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-054a287b-2dbe-41ba-911d-7c6cb1ab6f1b tempest-FloatingIPsAssociationTestJSON-1389855451 tempest-FloatingIPsAssociationTestJSON-1389855451-project] 10.222.0.50 "GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3" status: 404 len: 111 microversion: 2.1 time: 0.052784 Oct 24 10:27:56.338649 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 487/957] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:56 2022] GET /compute/v2.1/servers/00d34420-321b-4914-a4e0-d03965e049b3 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:27:56.343401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ab09c038-111f-4bde-a01f-3125fe9c1bdb tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Calling method '.version_select at 0x7f04d0b628b0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:56.347280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab09c038-111f-4bde-a01f-3125fe9c1bdb tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.348005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab09c038-111f-4bde-a01f-3125fe9c1bdb tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.348660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab09c038-111f-4bde-a01f-3125fe9c1bdb tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.349692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab09c038-111f-4bde-a01f-3125fe9c1bdb tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.350556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab09c038-111f-4bde-a01f-3125fe9c1bdb tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.351416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab09c038-111f-4bde-a01f-3125fe9c1bdb tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.366262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ba58804-4446-4116-ba5f-72cdceab1b2a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:56.376716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ba58804-4446-4116-ba5f-72cdceab1b2a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:56.387230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ba58804-4446-4116-ba5f-72cdceab1b2a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:56.388657 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6ba58804-4446-4116-ba5f-72cdceab1b2a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 200 len: 1361 microversion: 2.25 time: 0.287696 Oct 24 10:27:56.389114 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ab09c038-111f-4bde-a01f-3125fe9c1bdb tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.049084 Oct 24 10:27:56.390654 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 488/958] 10.222.0.50 () {58 vars in 1139 bytes} [Mon Oct 24 10:27:56 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:56.394962 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 471/959] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:27:56 2022] GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 1361 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:27:56.405050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bd8f9811-1329-4b58-addc-f3100321038f tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Calling method '.version_select at 0x7f04d0ca7310>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:56.410540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd8f9811-1329-4b58-addc-f3100321038f tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.411380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd8f9811-1329-4b58-addc-f3100321038f tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.412577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd8f9811-1329-4b58-addc-f3100321038f tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.414166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd8f9811-1329-4b58-addc-f3100321038f tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.414960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd8f9811-1329-4b58-addc-f3100321038f tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.415616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd8f9811-1329-4b58-addc-f3100321038f tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.445767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-db17642e-8b92-4bb7-86c7-ada8cab6f99c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:56.447382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-db17642e-8b92-4bb7-86c7-ada8cab6f99c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:56.455253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db17642e-8b92-4bb7-86c7-ada8cab6f99c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.455469 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bd8f9811-1329-4b58-addc-f3100321038f tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.055354 Oct 24 10:27:56.456210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db17642e-8b92-4bb7-86c7-ada8cab6f99c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.456888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db17642e-8b92-4bb7-86c7-ada8cab6f99c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.457824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db17642e-8b92-4bb7-86c7-ada8cab6f99c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.458504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db17642e-8b92-4bb7-86c7-ada8cab6f99c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.459425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db17642e-8b92-4bb7-86c7-ada8cab6f99c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.461420 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 489/960] 10.222.0.50 () {58 vars in 1145 bytes} [Mon Oct 24 10:27:56 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:27:56.477533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f9e9f273-11fb-40fa-bfa7-b9a11fc564cc tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Calling method '.version_select at 0x7f04d0b62dc0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:56.482723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9e9f273-11fb-40fa-bfa7-b9a11fc564cc tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.483223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9e9f273-11fb-40fa-bfa7-b9a11fc564cc tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.483666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9e9f273-11fb-40fa-bfa7-b9a11fc564cc tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.484403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9e9f273-11fb-40fa-bfa7-b9a11fc564cc tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.489108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9e9f273-11fb-40fa-bfa7-b9a11fc564cc tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.489576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9e9f273-11fb-40fa-bfa7-b9a11fc564cc tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.522742 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f9e9f273-11fb-40fa-bfa7-b9a11fc564cc tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.052300 Oct 24 10:27:56.524451 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 490/961] 10.222.0.50 () {58 vars in 1128 bytes} [Mon Oct 24 10:27:56 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:27:56.534935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-078b61e3-20fb-4a2a-bcf2-8b6525d2c03d tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Calling method '.version_select at 0x7f04d0be5e50>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:56.540694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-078b61e3-20fb-4a2a-bcf2-8b6525d2c03d tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.542091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-078b61e3-20fb-4a2a-bcf2-8b6525d2c03d tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.543230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-078b61e3-20fb-4a2a-bcf2-8b6525d2c03d tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.544198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-078b61e3-20fb-4a2a-bcf2-8b6525d2c03d tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.545057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-078b61e3-20fb-4a2a-bcf2-8b6525d2c03d tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.545654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-078b61e3-20fb-4a2a-bcf2-8b6525d2c03d tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.579562 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-078b61e3-20fb-4a2a-bcf2-8b6525d2c03d tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.048234 Oct 24 10:27:56.589347 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 491/962] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Oct 24 10:27:56 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:27:56.596975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c7b3249f-5224-4616-8427-dcdb730b8202 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Calling method '.version_select at 0x7f04d15251f0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:56.601834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7b3249f-5224-4616-8427-dcdb730b8202 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.602565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7b3249f-5224-4616-8427-dcdb730b8202 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.603752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7b3249f-5224-4616-8427-dcdb730b8202 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.605241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7b3249f-5224-4616-8427-dcdb730b8202 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.606384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7b3249f-5224-4616-8427-dcdb730b8202 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.607020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7b3249f-5224-4616-8427-dcdb730b8202 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.644893 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c7b3249f-5224-4616-8427-dcdb730b8202 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.052744 Oct 24 10:27:56.645746 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 492/963] 10.222.0.50 () {58 vars in 1128 bytes} [Mon Oct 24 10:27:56 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:56.657986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9d03ff0f-207b-4689-bc13-34f2f2df6511 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Calling method '.version_select at 0x7f04d0df79d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:56.668226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d03ff0f-207b-4689-bc13-34f2f2df6511 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.668787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d03ff0f-207b-4689-bc13-34f2f2df6511 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.669331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d03ff0f-207b-4689-bc13-34f2f2df6511 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.689638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d03ff0f-207b-4689-bc13-34f2f2df6511 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.690874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d03ff0f-207b-4689-bc13-34f2f2df6511 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.691419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d03ff0f-207b-4689-bc13-34f2f2df6511 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.723913 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9d03ff0f-207b-4689-bc13-34f2f2df6511 tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-h1-858383-15" status: 200 len: 1131 microversion: 2.1 time: 0.070639 Oct 24 10:27:56.724594 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 493/964] 10.222.0.50 () {58 vars in 1173 bytes} [Mon Oct 24 10:27:56 2022] GET /compute/v2.1/os-hosts/n-h1-858383-15 => generated 1131 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:56.734084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f9ab8ace-e487-4442-91d6-ae663a3b7939 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0b624c0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:56.786508 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f9ab8ace-e487-4442-91d6-ae663a3b7939 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb" status: 200 len: 1453 microversion: 2.1 time: 0.059529 Oct 24 10:27:56.787081 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 494/965] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:56 2022] GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb => generated 1453 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:56.797984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-342d3651-1161-4643-b17d-abded6e20f0b tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Calling method '.version_select at 0x7f04d0b62820>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:56.808485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-342d3651-1161-4643-b17d-abded6e20f0b tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.809341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-342d3651-1161-4643-b17d-abded6e20f0b tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.810006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-342d3651-1161-4643-b17d-abded6e20f0b tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.824746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-342d3651-1161-4643-b17d-abded6e20f0b tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.825613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-342d3651-1161-4643-b17d-abded6e20f0b tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.826311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-342d3651-1161-4643-b17d-abded6e20f0b tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.890873 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-342d3651-1161-4643-b17d-abded6e20f0b tempest-HostsAdminTestJSON-1469254575 tempest-HostsAdminTestJSON-1469254575-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-h2-858383-15" status: 200 len: 866 microversion: 2.1 time: 0.100739 Oct 24 10:27:56.891633 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 495/966] 10.222.0.50 () {58 vars in 1173 bytes} [Mon Oct 24 10:27:56 2022] GET /compute/v2.1/os-hosts/n-h2-858383-15 => generated 866 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:56.897533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9aed6925-e42f-490e-8f58-8b0b82cfb72f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:56.899455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9aed6925-e42f-490e-8f58-8b0b82cfb72f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:56.910056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9aed6925-e42f-490e-8f58-8b0b82cfb72f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.910929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9aed6925-e42f-490e-8f58-8b0b82cfb72f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.911599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9aed6925-e42f-490e-8f58-8b0b82cfb72f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.913911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9aed6925-e42f-490e-8f58-8b0b82cfb72f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:56.914756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9aed6925-e42f-490e-8f58-8b0b82cfb72f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:56.915435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9aed6925-e42f-490e-8f58-8b0b82cfb72f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:56.916645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-db17642e-8b92-4bb7-86c7-ada8cab6f99c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:56.943856 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-db17642e-8b92-4bb7-86c7-ada8cab6f99c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010" status: 200 len: 1318 microversion: 2.1 time: 0.503654 Oct 24 10:27:56.946917 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 472/967] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:56 2022] GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 => generated 1318 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:57.041590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-94cf015c-56c4-47c0-900a-3d2a873da001 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d11184c0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:57.076624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:57.111949 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-94cf015c-56c4-47c0-900a-3d2a873da001 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69" status: 200 len: 1413 microversion: 2.1 time: 0.075659 Oct 24 10:27:57.113204 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 473/968] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:57 2022] GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 => generated 1413 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:27:57.187819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-fa06172b-cfa9-4be3-ba94-869f7b5fc349 req-1788580d-5280-4034-afc2-1388633c36d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c828266b-d510-4a99-9b08-476e19b057a7", "name": "network-vif-plugged", "status": "completed", "tag": "08217d41-f854-428a-9793-2feb95de04df"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:57.214626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fa06172b-cfa9-4be3-ba94-869f7b5fc349 req-1788580d-5280-4034-afc2-1388633c36d4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:57.215396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fa06172b-cfa9-4be3-ba94-869f7b5fc349 req-1788580d-5280-4034-afc2-1388633c36d4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:57.216925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fa06172b-cfa9-4be3-ba94-869f7b5fc349 req-1788580d-5280-4034-afc2-1388633c36d4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:57.235759 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-fa06172b-cfa9-4be3-ba94-869f7b5fc349 req-1788580d-5280-4034-afc2-1388633c36d4 service nova] Creating event network-vif-plugged:08217d41-f854-428a-9793-2feb95de04df for instance c828266b-d510-4a99-9b08-476e19b057a7 on n-h1-858383-15 Oct 24 10:27:57.243226 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-fa06172b-cfa9-4be3-ba94-869f7b5fc349 req-1788580d-5280-4034-afc2-1388633c36d4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060449 Oct 24 10:27:57.244601 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 474/969] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:27:57.289733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9aed6925-e42f-490e-8f58-8b0b82cfb72f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:57.303960 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9aed6925-e42f-490e-8f58-8b0b82cfb72f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1470 microversion: 2.1 time: 0.410299 Oct 24 10:27:57.315819 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 496/970] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:56 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1470 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:57.347621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-0740aa18-4a33-4807-9a92-10a62f6cca33 req-95606658-04b9-40e3-a352-639f326070e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4958f64-a776-423b-8544-b0918c30d25e", "tag": "7cb75069-1936-455b-9d3e-e39ef3915249"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:57.358917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0740aa18-4a33-4807-9a92-10a62f6cca33 req-95606658-04b9-40e3-a352-639f326070e7 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:57.359665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0740aa18-4a33-4807-9a92-10a62f6cca33 req-95606658-04b9-40e3-a352-639f326070e7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:57.360329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0740aa18-4a33-4807-9a92-10a62f6cca33 req-95606658-04b9-40e3-a352-639f326070e7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:57.375626 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-0740aa18-4a33-4807-9a92-10a62f6cca33 req-95606658-04b9-40e3-a352-639f326070e7 service nova] Creating event network-changed:7cb75069-1936-455b-9d3e-e39ef3915249 for instance d4958f64-a776-423b-8544-b0918c30d25e on n-h2-858383-15 Oct 24 10:27:57.384131 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-0740aa18-4a33-4807-9a92-10a62f6cca33 req-95606658-04b9-40e3-a352-639f326070e7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040729 Oct 24 10:27:57.385433 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 475/971] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:57.427341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5f7e3d91-e990-4177-be30-485ad090fa36 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:57.428602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5f7e3d91-e990-4177-be30-485ad090fa36 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:57.446124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f7e3d91-e990-4177-be30-485ad090fa36 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:57.449539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f7e3d91-e990-4177-be30-485ad090fa36 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:57.449539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f7e3d91-e990-4177-be30-485ad090fa36 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:57.453139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f7e3d91-e990-4177-be30-485ad090fa36 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:57.460808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f7e3d91-e990-4177-be30-485ad090fa36 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:57.461314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f7e3d91-e990-4177-be30-485ad090fa36 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:57.520266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:57.803922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b653d010-d818-4ada-adcb-4e42542b6d24 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d13a2940>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:57.813299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5f7e3d91-e990-4177-be30-485ad090fa36 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:57.835205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5f7e3d91-e990-4177-be30-485ad090fa36 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:57.841902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5f7e3d91-e990-4177-be30-485ad090fa36 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:57.847088 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5f7e3d91-e990-4177-be30-485ad090fa36 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 200 len: 1361 microversion: 2.25 time: 0.424949 Oct 24 10:27:57.848706 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 497/972] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:27:57 2022] GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 1361 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:27:57.884617 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b653d010-d818-4ada-adcb-4e42542b6d24 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb" status: 200 len: 1453 microversion: 2.1 time: 0.085975 Oct 24 10:27:57.902881 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 476/973] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:57 2022] GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:57.972674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-236970a1-fcbd-4c95-9378-b64a4232d1ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:57.973746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-236970a1-fcbd-4c95-9378-b64a4232d1ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:57.982653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-236970a1-fcbd-4c95-9378-b64a4232d1ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:57.985413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-236970a1-fcbd-4c95-9378-b64a4232d1ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:57.987649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-236970a1-fcbd-4c95-9378-b64a4232d1ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:57.988459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-236970a1-fcbd-4c95-9378-b64a4232d1ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:57.989432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-236970a1-fcbd-4c95-9378-b64a4232d1ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:57.989865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-236970a1-fcbd-4c95-9378-b64a4232d1ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:58.130224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-82e46e46-89eb-4264-8cff-a4ceae76faee tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d13dc550>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:58.215297 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-82e46e46-89eb-4264-8cff-a4ceae76faee tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69" status: 200 len: 1413 microversion: 2.1 time: 0.090886 Oct 24 10:27:58.215960 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 477/974] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:58 2022] GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 => generated 1413 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:58.332160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2f7f31be-a9f9-4eac-b47e-662f4925ecc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:58.333596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2f7f31be-a9f9-4eac-b47e-662f4925ecc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:58.345288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f7f31be-a9f9-4eac-b47e-662f4925ecc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:58.346246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f7f31be-a9f9-4eac-b47e-662f4925ecc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:58.346900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f7f31be-a9f9-4eac-b47e-662f4925ecc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:58.348026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f7f31be-a9f9-4eac-b47e-662f4925ecc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:58.348741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f7f31be-a9f9-4eac-b47e-662f4925ecc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:58.349434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f7f31be-a9f9-4eac-b47e-662f4925ecc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:58.364959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-236970a1-fcbd-4c95-9378-b64a4232d1ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:58.374858 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-236970a1-fcbd-4c95-9378-b64a4232d1ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010" status: 200 len: 1318 microversion: 2.1 time: 0.406260 Oct 24 10:27:58.381329 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 498/975] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:57 2022] GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:58.699025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2f7f31be-a9f9-4eac-b47e-662f4925ecc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:58.707794 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2f7f31be-a9f9-4eac-b47e-662f4925ecc0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1536 microversion: 2.1 time: 0.380046 Oct 24 10:27:58.729355 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 478/976] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:58 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1536 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:27:58.876565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-784b1d9a-e7b0-4790-ac53-0fd950c253f1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:58.877358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-784b1d9a-e7b0-4790-ac53-0fd950c253f1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:58.880254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=30 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:58.890643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-784b1d9a-e7b0-4790-ac53-0fd950c253f1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:58.893435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-784b1d9a-e7b0-4790-ac53-0fd950c253f1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:58.894115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-784b1d9a-e7b0-4790-ac53-0fd950c253f1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:58.904268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-784b1d9a-e7b0-4790-ac53-0fd950c253f1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:58.905041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-784b1d9a-e7b0-4790-ac53-0fd950c253f1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:58.905692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-784b1d9a-e7b0-4790-ac53-0fd950c253f1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:58.911846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8c2c5000-ef2e-4668-95e4-85ccac5a1635 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d12a84c0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:58.985757 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8c2c5000-ef2e-4668-95e4-85ccac5a1635 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb" status: 200 len: 1453 microversion: 2.1 time: 0.079702 Oct 24 10:27:58.986502 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 479/977] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:58 2022] GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:27:59.212181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-784b1d9a-e7b0-4790-ac53-0fd950c253f1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:59.223046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-784b1d9a-e7b0-4790-ac53-0fd950c253f1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:59.226133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-784b1d9a-e7b0-4790-ac53-0fd950c253f1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:27:59.227588 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-784b1d9a-e7b0-4790-ac53-0fd950c253f1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 200 len: 1557 microversion: 2.25 time: 0.355693 Oct 24 10:27:59.241436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fe29f6e0-d605-4c12-84a2-20afea0814c4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d16cd160>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:59.248144 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 499/978] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:27:58 2022] GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 1557 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:27:59.335029 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fe29f6e0-d605-4c12-84a2-20afea0814c4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69" status: 200 len: 1413 microversion: 2.1 time: 0.104492 Oct 24 10:27:59.335511 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 480/979] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:27:59 2022] GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:27:59.357680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-55ab5eee-58f3-49f7-a663-c52c7a81e651 req-6b9b025b-f997-4949-b51b-b22ef95be38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94278005-1d71-4976-b673-ad2d105385e0", "name": "network-vif-plugged", "status": "completed", "tag": "9691a054-3d8c-4b1b-b4f4-09af40c934d5"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:27:59.385777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-55ab5eee-58f3-49f7-a663-c52c7a81e651 req-6b9b025b-f997-4949-b51b-b22ef95be38c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:59.386889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-55ab5eee-58f3-49f7-a663-c52c7a81e651 req-6b9b025b-f997-4949-b51b-b22ef95be38c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:59.387567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-55ab5eee-58f3-49f7-a663-c52c7a81e651 req-6b9b025b-f997-4949-b51b-b22ef95be38c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:59.392527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:59.406082 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-55ab5eee-58f3-49f7-a663-c52c7a81e651 req-6b9b025b-f997-4949-b51b-b22ef95be38c service nova] Creating event network-vif-plugged:9691a054-3d8c-4b1b-b4f4-09af40c934d5 for instance 94278005-1d71-4976-b673-ad2d105385e0 on n-h1-858383-15 Oct 24 10:27:59.418855 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-55ab5eee-58f3-49f7-a663-c52c7a81e651 req-6b9b025b-f997-4949-b51b-b22ef95be38c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081300 Oct 24 10:27:59.421161 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 481/980] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:27:59.432570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c34bcfd-7bcc-41cd-ac3e-743059bdb5ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:59.433734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1c34bcfd-7bcc-41cd-ac3e-743059bdb5ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:59.450501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c34bcfd-7bcc-41cd-ac3e-743059bdb5ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:59.451283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c34bcfd-7bcc-41cd-ac3e-743059bdb5ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:59.451919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c34bcfd-7bcc-41cd-ac3e-743059bdb5ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:59.452819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c34bcfd-7bcc-41cd-ac3e-743059bdb5ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:59.453457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c34bcfd-7bcc-41cd-ac3e-743059bdb5ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:59.454575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c34bcfd-7bcc-41cd-ac3e-743059bdb5ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:59.642019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0f55a5d2-e342-4e1b-8441-0237ebaa0898 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:27:59.642635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0f55a5d2-e342-4e1b-8441-0237ebaa0898 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:27:59.655575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f55a5d2-e342-4e1b-8441-0237ebaa0898 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:59.657460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f55a5d2-e342-4e1b-8441-0237ebaa0898 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:59.657929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f55a5d2-e342-4e1b-8441-0237ebaa0898 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:27:59.661991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f55a5d2-e342-4e1b-8441-0237ebaa0898 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:27:59.662964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f55a5d2-e342-4e1b-8441-0237ebaa0898 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:27:59.663426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f55a5d2-e342-4e1b-8441-0237ebaa0898 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:00.437437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-0f55a5d2-e342-4e1b-8441-0237ebaa0898 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'services' on Instance uuid 77c264bc-70a7-4b1b-a29a-d5bbb2884809 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:28:00.458125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1c34bcfd-7bcc-41cd-ac3e-743059bdb5ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:00.471437 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1c34bcfd-7bcc-41cd-ac3e-743059bdb5ea tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010" status: 200 len: 1318 microversion: 2.1 time: 1.045541 Oct 24 10:28:00.472353 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 482/981] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:27:59 2022] GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 => generated 1318 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:00.480560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-49af0b08-a875-44b0-a132-4b0c9025602e req-3ccde2f1-0106-4521-9302-393a075553fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "294c2f53-e675-40b8-a91f-634939781010", "tag": "0bf4ef00-3ca4-480f-a144-3400a6a043f5"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:00.514422 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0f55a5d2-e342-4e1b-8441-0237ebaa0898 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 200 len: 2051 microversion: 2.25 time: 1.263014 Oct 24 10:28:00.514603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-49af0b08-a875-44b0-a132-4b0c9025602e req-3ccde2f1-0106-4521-9302-393a075553fc service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:00.532474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-49af0b08-a875-44b0-a132-4b0c9025602e req-3ccde2f1-0106-4521-9302-393a075553fc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:00.532741 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 500/982] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:27:59 2022] GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 2051 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:28:00.532880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-49af0b08-a875-44b0-a132-4b0c9025602e req-3ccde2f1-0106-4521-9302-393a075553fc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:00.532990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-980f0a30-0157-485c-b1d2-089c1dd4c0fb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:00.532990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-980f0a30-0157-485c-b1d2-089c1dd4c0fb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:00.532990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-980f0a30-0157-485c-b1d2-089c1dd4c0fb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:00.532990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-980f0a30-0157-485c-b1d2-089c1dd4c0fb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:00.533376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-980f0a30-0157-485c-b1d2-089c1dd4c0fb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:00.533376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-980f0a30-0157-485c-b1d2-089c1dd4c0fb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:00.533376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-980f0a30-0157-485c-b1d2-089c1dd4c0fb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:00.533376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-980f0a30-0157-485c-b1d2-089c1dd4c0fb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:00.546889 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-49af0b08-a875-44b0-a132-4b0c9025602e req-3ccde2f1-0106-4521-9302-393a075553fc service nova] Creating event network-changed:0bf4ef00-3ca4-480f-a144-3400a6a043f5 for instance 294c2f53-e675-40b8-a91f-634939781010 on n-h1-858383-15 Oct 24 10:28:00.553531 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-49af0b08-a875-44b0-a132-4b0c9025602e req-3ccde2f1-0106-4521-9302-393a075553fc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078988 Oct 24 10:28:00.554513 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 483/983] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:00.562842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e69c355c-41d5-4f89-b7fb-3c17e0d23e0e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0fcf820>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:00.612017 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e69c355c-41d5-4f89-b7fb-3c17e0d23e0e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb" status: 200 len: 1453 microversion: 2.1 time: 0.055840 Oct 24 10:28:00.612598 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 484/984] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:00 2022] GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb => generated 1453 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:00.617403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-363073c5-7083-4fcd-8c3e-a00f9934092f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d13dc550>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:00.668717 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-363073c5-7083-4fcd-8c3e-a00f9934092f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69" status: 200 len: 1413 microversion: 2.1 time: 0.054852 Oct 24 10:28:00.669338 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 485/985] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:00 2022] GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 => generated 1413 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:00.674002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-89c70228-e7c9-4d97-a9a4-4c43baefe5a1 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:00.674878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-89c70228-e7c9-4d97-a9a4-4c43baefe5a1 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:00.682141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89c70228-e7c9-4d97-a9a4-4c43baefe5a1 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:00.682856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89c70228-e7c9-4d97-a9a4-4c43baefe5a1 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:00.683559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89c70228-e7c9-4d97-a9a4-4c43baefe5a1 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:00.684493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89c70228-e7c9-4d97-a9a4-4c43baefe5a1 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:00.685178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89c70228-e7c9-4d97-a9a4-4c43baefe5a1 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:00.685610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89c70228-e7c9-4d97-a9a4-4c43baefe5a1 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:00.827494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-980f0a30-0157-485c-b1d2-089c1dd4c0fb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:00.837515 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-980f0a30-0157-485c-b1d2-089c1dd4c0fb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1536 microversion: 2.1 time: 0.320785 Oct 24 10:28:00.838490 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 501/986] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:00 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1536 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:00.953535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-89c70228-e7c9-4d97-a9a4-4c43baefe5a1 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'services' on Instance uuid 77c264bc-70a7-4b1b-a29a-d5bbb2884809 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:28:01.018645 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-89c70228-e7c9-4d97-a9a4-4c43baefe5a1 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 200 len: 2051 microversion: 2.25 time: 0.348050 Oct 24 10:28:01.019538 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 486/987] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:00 2022] GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 2051 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:01.045451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0b0c33c5-fcb0-4728-8f2d-89a33d811f0e tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:01.050358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b0c33c5-fcb0-4728-8f2d-89a33d811f0e tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:01.050904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b0c33c5-fcb0-4728-8f2d-89a33d811f0e tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:01.051267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b0c33c5-fcb0-4728-8f2d-89a33d811f0e tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:01.052077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b0c33c5-fcb0-4728-8f2d-89a33d811f0e tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:01.057486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b0c33c5-fcb0-4728-8f2d-89a33d811f0e tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:01.057927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b0c33c5-fcb0-4728-8f2d-89a33d811f0e tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:01.091070 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0b0c33c5-fcb0-4728-8f2d-89a33d811f0e tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.049865 Oct 24 10:28:01.092307 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 502/988] 10.222.0.50 () {60 vars in 1217 bytes} [Mon Oct 24 10:28:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:28:01.112185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b75d8a0-0b11-4cf1-984a-44805785a7cf tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-15", "block_migration": "auto"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:01.112185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8b75d8a0-0b11-4cf1-984a-44805785a7cf tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:01.114646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b75d8a0-0b11-4cf1-984a-44805785a7cf tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:01.115111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b75d8a0-0b11-4cf1-984a-44805785a7cf tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:01.115585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b75d8a0-0b11-4cf1-984a-44805785a7cf tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:01.116281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b75d8a0-0b11-4cf1-984a-44805785a7cf tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:01.117016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b75d8a0-0b11-4cf1-984a-44805785a7cf tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:01.117671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b75d8a0-0b11-4cf1-984a-44805785a7cf tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:01.186686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-8b75d8a0-0b11-4cf1-984a-44805785a7cf tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'flavor' on Instance uuid 77c264bc-70a7-4b1b-a29a-d5bbb2884809 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:28:01.201904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8b75d8a0-0b11-4cf1-984a-44805785a7cf tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Going to try to live migrate instance to n-h2-858383-15 {{(pid=120425) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 24 10:28:01.450018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-88f23651-a8f5-481a-a253-5e4344cccacc req-6f497571-286a-4b43-866f-596da0f53a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c18a9a-ad67-4d8e-abd2-349766d8a002", "name": "network-vif-unplugged", "status": "completed", "tag": "0782d6f6-5f17-49c4-9ee3-4c8b802a9588"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:01.467303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-88f23651-a8f5-481a-a253-5e4344cccacc req-6f497571-286a-4b43-866f-596da0f53a32 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:01.469096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-88f23651-a8f5-481a-a253-5e4344cccacc req-6f497571-286a-4b43-866f-596da0f53a32 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:01.469732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-88f23651-a8f5-481a-a253-5e4344cccacc req-6f497571-286a-4b43-866f-596da0f53a32 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:01.521295 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-88f23651-a8f5-481a-a253-5e4344cccacc req-6f497571-286a-4b43-866f-596da0f53a32 service nova] Creating event network-vif-unplugged:0782d6f6-5f17-49c4-9ee3-4c8b802a9588 for instance 98c18a9a-ad67-4d8e-abd2-349766d8a002 on n-h2-858383-15 Oct 24 10:28:01.549313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [req-88f23651-a8f5-481a-a253-5e4344cccacc req-6f497571-286a-4b43-866f-596da0f53a32 service nova] Instance 98c18a9a-ad67-4d8e-abd2-349766d8a002 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-15'} {{(pid=120426) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:28:01.566517 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-88f23651-a8f5-481a-a253-5e4344cccacc req-6f497571-286a-4b43-866f-596da0f53a32 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129085 Oct 24 10:28:01.567858 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 503/989] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:28:01.576197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-954e1764-f060-48f9-b696-85036563c3fe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:01.577486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-954e1764-f060-48f9-b696-85036563c3fe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:01.586399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-954e1764-f060-48f9-b696-85036563c3fe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:01.587182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-954e1764-f060-48f9-b696-85036563c3fe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:01.587878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-954e1764-f060-48f9-b696-85036563c3fe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:01.588937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-954e1764-f060-48f9-b696-85036563c3fe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:01.589592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-954e1764-f060-48f9-b696-85036563c3fe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:01.590347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-954e1764-f060-48f9-b696-85036563c3fe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:01.798855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-954e1764-f060-48f9-b696-85036563c3fe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:01.810338 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-954e1764-f060-48f9-b696-85036563c3fe tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010" status: 200 len: 1318 microversion: 2.1 time: 0.240298 Oct 24 10:28:01.811863 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 504/990] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:01 2022] GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:01.817378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d86ee80d-b74f-4544-8f17-c8b6ca452ead tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0b7a3a0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:01.901052 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d86ee80d-b74f-4544-8f17-c8b6ca452ead tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb" status: 200 len: 1453 microversion: 2.1 time: 0.087558 Oct 24 10:28:01.901637 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 505/991] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:01 2022] GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:01.907282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c47d2c1b-88bf-4410-a072-6fcbfe63e2e7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0b33670>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:01.961086 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c47d2c1b-88bf-4410-a072-6fcbfe63e2e7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69" status: 200 len: 1413 microversion: 2.1 time: 0.057693 Oct 24 10:28:01.961671 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 506/992] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:01 2022] GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 => generated 1413 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:01.977478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d243a50d-2634-4139-b974-a8bd0cb6d9e8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:01.977478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d243a50d-2634-4139-b974-a8bd0cb6d9e8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:01.987378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d243a50d-2634-4139-b974-a8bd0cb6d9e8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:01.987909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d243a50d-2634-4139-b974-a8bd0cb6d9e8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:01.988345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d243a50d-2634-4139-b974-a8bd0cb6d9e8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:01.989085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d243a50d-2634-4139-b974-a8bd0cb6d9e8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:01.989539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d243a50d-2634-4139-b974-a8bd0cb6d9e8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:01.989961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d243a50d-2634-4139-b974-a8bd0cb6d9e8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.184448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d243a50d-2634-4139-b974-a8bd0cb6d9e8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:02.194149 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d243a50d-2634-4139-b974-a8bd0cb6d9e8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1536 microversion: 2.1 time: 0.226239 Oct 24 10:28:02.194737 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 507/993] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:01 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1536 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:02.471105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-58a1df88-6e8e-4cb1-ab8a-414db6b7cc31 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Calling method '.version_select at 0x7f04d0d2ab80>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:02.472971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58a1df88-6e8e-4cb1-ab8a-414db6b7cc31 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.473470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58a1df88-6e8e-4cb1-ab8a-414db6b7cc31 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.474003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58a1df88-6e8e-4cb1-ab8a-414db6b7cc31 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.489020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58a1df88-6e8e-4cb1-ab8a-414db6b7cc31 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.489505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58a1df88-6e8e-4cb1-ab8a-414db6b7cc31 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.489938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58a1df88-6e8e-4cb1-ab8a-414db6b7cc31 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.500418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58a1df88-6e8e-4cb1-ab8a-414db6b7cc31 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.500938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58a1df88-6e8e-4cb1-ab8a-414db6b7cc31 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.501378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-58a1df88-6e8e-4cb1-ab8a-414db6b7cc31 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.507957 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-58a1df88-6e8e-4cb1-ab8a-414db6b7cc31 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.180996 Oct 24 10:28:02.508746 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 508/994] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:28:02 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:28:02.527020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-95e6df23-e6b8-4f33-a42d-a9413b3438f5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Calling method '.version_select at 0x7f04d0b33dc0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:02.527020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95e6df23-e6b8-4f33-a42d-a9413b3438f5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.527294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95e6df23-e6b8-4f33-a42d-a9413b3438f5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.527653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95e6df23-e6b8-4f33-a42d-a9413b3438f5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.543672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95e6df23-e6b8-4f33-a42d-a9413b3438f5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.544163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95e6df23-e6b8-4f33-a42d-a9413b3438f5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.544609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95e6df23-e6b8-4f33-a42d-a9413b3438f5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.555372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95e6df23-e6b8-4f33-a42d-a9413b3438f5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.555852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95e6df23-e6b8-4f33-a42d-a9413b3438f5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.556294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95e6df23-e6b8-4f33-a42d-a9413b3438f5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.562266 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-95e6df23-e6b8-4f33-a42d-a9413b3438f5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.046055 Oct 24 10:28:02.562858 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 509/995] 10.222.0.50 () {58 vars in 1167 bytes} [Mon Oct 24 10:28:02 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:02.579403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-47be156f-9759-4a1d-8806-3851580b0fb5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Calling method '.version_select at 0x7f04d0b72b80>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:02.581618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47be156f-9759-4a1d-8806-3851580b0fb5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.582255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47be156f-9759-4a1d-8806-3851580b0fb5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.582698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47be156f-9759-4a1d-8806-3851580b0fb5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.597471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47be156f-9759-4a1d-8806-3851580b0fb5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.597866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47be156f-9759-4a1d-8806-3851580b0fb5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.598363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47be156f-9759-4a1d-8806-3851580b0fb5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.609510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47be156f-9759-4a1d-8806-3851580b0fb5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.609990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47be156f-9759-4a1d-8806-3851580b0fb5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.610425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47be156f-9759-4a1d-8806-3851580b0fb5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.616296 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-47be156f-9759-4a1d-8806-3851580b0fb5 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.040293 Oct 24 10:28:02.617068 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 510/996] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:28:02 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:28:02.627542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d5ff722a-bb56-4a6b-b6ee-5eb5f5d78627 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Calling method '.version_select at 0x7f04d0b335e0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:02.629343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5ff722a-bb56-4a6b-b6ee-5eb5f5d78627 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.629821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5ff722a-bb56-4a6b-b6ee-5eb5f5d78627 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.630261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5ff722a-bb56-4a6b-b6ee-5eb5f5d78627 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.648784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5ff722a-bb56-4a6b-b6ee-5eb5f5d78627 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.649226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5ff722a-bb56-4a6b-b6ee-5eb5f5d78627 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.649660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5ff722a-bb56-4a6b-b6ee-5eb5f5d78627 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.656994 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d5ff722a-bb56-4a6b-b6ee-5eb5f5d78627 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.032987 Oct 24 10:28:02.658104 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 511/997] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:28:02 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:28:02.674087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-09acb947-49f8-4f78-bcf8-b19ca2c5079f tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Calling method '.version_select at 0x7f04d0b72940>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:02.675841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09acb947-49f8-4f78-bcf8-b19ca2c5079f tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.676323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09acb947-49f8-4f78-bcf8-b19ca2c5079f tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.676770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09acb947-49f8-4f78-bcf8-b19ca2c5079f tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.694228 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-09acb947-49f8-4f78-bcf8-b19ca2c5079f tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.023365 Oct 24 10:28:02.701341 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 512/998] 10.222.0.50 () {58 vars in 1179 bytes} [Mon Oct 24 10:28:02 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:28:02.710172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0d2d6a99-a02a-426d-ba6f-1b85cda8b45e tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Calling method '.version_select at 0x7f04d0be50d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:02.711640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d2d6a99-a02a-426d-ba6f-1b85cda8b45e tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.712122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d2d6a99-a02a-426d-ba6f-1b85cda8b45e tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.712563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d2d6a99-a02a-426d-ba6f-1b85cda8b45e tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.727073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d2d6a99-a02a-426d-ba6f-1b85cda8b45e tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.727482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d2d6a99-a02a-426d-ba6f-1b85cda8b45e tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.727920 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d2d6a99-a02a-426d-ba6f-1b85cda8b45e tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.737863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d2d6a99-a02a-426d-ba6f-1b85cda8b45e tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.738346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d2d6a99-a02a-426d-ba6f-1b85cda8b45e tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.738789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d2d6a99-a02a-426d-ba6f-1b85cda8b45e tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.745366 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0d2d6a99-a02a-426d-ba6f-1b85cda8b45e tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.039383 Oct 24 10:28:02.745969 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 513/999] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:28:02 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:02.756566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ff4f830a-895e-466a-8f8e-73af067f4250 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Calling method '.version_select at 0x7f04d0b33700>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:02.758818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff4f830a-895e-466a-8f8e-73af067f4250 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.759301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff4f830a-895e-466a-8f8e-73af067f4250 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.759739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff4f830a-895e-466a-8f8e-73af067f4250 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.773408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff4f830a-895e-466a-8f8e-73af067f4250 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.773898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff4f830a-895e-466a-8f8e-73af067f4250 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.774426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff4f830a-895e-466a-8f8e-73af067f4250 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.784354 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ff4f830a-895e-466a-8f8e-73af067f4250 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.031661 Oct 24 10:28:02.785331 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 514/1000] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:28:02 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:28:02.800011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f30d1f74-3ca1-47d4-8e73-f718dcede936 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Calling method '.version_select at 0x7f04d0b330d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:02.802323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f30d1f74-3ca1-47d4-8e73-f718dcede936 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.802873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f30d1f74-3ca1-47d4-8e73-f718dcede936 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.804292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f30d1f74-3ca1-47d4-8e73-f718dcede936 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.817281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f30d1f74-3ca1-47d4-8e73-f718dcede936 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.817761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f30d1f74-3ca1-47d4-8e73-f718dcede936 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.818238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f30d1f74-3ca1-47d4-8e73-f718dcede936 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.826198 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f30d1f74-3ca1-47d4-8e73-f718dcede936 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.029790 Oct 24 10:28:02.826795 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 515/1001] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:28:02 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:28:02.840966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-db4ca0ba-5687-4a76-93bb-d30b86ff312a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:02.842531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-db4ca0ba-5687-4a76-93bb-d30b86ff312a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:02.848772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db4ca0ba-5687-4a76-93bb-d30b86ff312a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.849311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db4ca0ba-5687-4a76-93bb-d30b86ff312a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.849748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db4ca0ba-5687-4a76-93bb-d30b86ff312a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:02.851138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db4ca0ba-5687-4a76-93bb-d30b86ff312a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:02.851595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db4ca0ba-5687-4a76-93bb-d30b86ff312a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:02.852030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db4ca0ba-5687-4a76-93bb-d30b86ff312a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:03.028381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-db4ca0ba-5687-4a76-93bb-d30b86ff312a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:03.036097 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-db4ca0ba-5687-4a76-93bb-d30b86ff312a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010" status: 200 len: 1318 microversion: 2.1 time: 0.203072 Oct 24 10:28:03.036769 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 516/1002] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:02 2022] GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:03.056757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-23ea06d1-e1f9-4f0b-944b-964124bed875 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Calling method '.version_select at 0x7f04d0b62700>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:03.059142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ea06d1-e1f9-4f0b-944b-964124bed875 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:03.059863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ea06d1-e1f9-4f0b-944b-964124bed875 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:03.060549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ea06d1-e1f9-4f0b-944b-964124bed875 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:03.074910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ea06d1-e1f9-4f0b-944b-964124bed875 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:03.075780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ea06d1-e1f9-4f0b-944b-964124bed875 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:03.076665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ea06d1-e1f9-4f0b-944b-964124bed875 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:03.090070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ea06d1-e1f9-4f0b-944b-964124bed875 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:03.091023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ea06d1-e1f9-4f0b-944b-964124bed875 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:03.091700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ea06d1-e1f9-4f0b-944b-964124bed875 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:03.122052 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-23ea06d1-e1f9-4f0b-944b-964124bed875 tempest-HypervisorAdminTestJSON-1104859464 tempest-HypervisorAdminTestJSON-1104859464-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.071913 Oct 24 10:28:03.123574 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 517/1003] 10.222.0.50 () {58 vars in 1173 bytes} [Mon Oct 24 10:28:03 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:03.150751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-62158d30-271c-407b-ad68-a68577a35162 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0cc09d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:03.244127 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-62158d30-271c-407b-ad68-a68577a35162 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb" status: 200 len: 1453 microversion: 2.1 time: 0.119029 Oct 24 10:28:03.253569 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 518/1004] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:03 2022] GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb => generated 1453 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:03.260486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c4c03f96-a4c0-4c0f-8e84-927e092c92b0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0ca7310>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:03.321823 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c4c03f96-a4c0-4c0f-8e84-927e092c92b0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69" status: 200 len: 1413 microversion: 2.1 time: 0.065456 Oct 24 10:28:03.330582 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 519/1005] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:03 2022] GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 => generated 1413 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:03.337697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5ba27645-f5af-49cd-853a-6ac67b42c4f2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:03.338705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5ba27645-f5af-49cd-853a-6ac67b42c4f2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:03.346578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ba27645-f5af-49cd-853a-6ac67b42c4f2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:03.347806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ba27645-f5af-49cd-853a-6ac67b42c4f2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:03.348495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ba27645-f5af-49cd-853a-6ac67b42c4f2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:03.349643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ba27645-f5af-49cd-853a-6ac67b42c4f2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:03.351627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ba27645-f5af-49cd-853a-6ac67b42c4f2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:03.352152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ba27645-f5af-49cd-853a-6ac67b42c4f2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:03.376796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:03.542524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5ba27645-f5af-49cd-853a-6ac67b42c4f2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:03.556071 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5ba27645-f5af-49cd-853a-6ac67b42c4f2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1536 microversion: 2.1 time: 0.222445 Oct 24 10:28:03.557666 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 520/1006] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:03 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1536 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:04.064722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ec3083ea-a28f-4ef0-9310-e85629156192 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:04.065440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ec3083ea-a28f-4ef0-9310-e85629156192 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:04.100752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec3083ea-a28f-4ef0-9310-e85629156192 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:04.101534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec3083ea-a28f-4ef0-9310-e85629156192 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:04.102154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec3083ea-a28f-4ef0-9310-e85629156192 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:04.104054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec3083ea-a28f-4ef0-9310-e85629156192 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:04.104986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec3083ea-a28f-4ef0-9310-e85629156192 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:04.105608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec3083ea-a28f-4ef0-9310-e85629156192 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:04.496268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ec3083ea-a28f-4ef0-9310-e85629156192 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:04.505319 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ec3083ea-a28f-4ef0-9310-e85629156192 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010" status: 200 len: 1318 microversion: 2.1 time: 0.444762 Oct 24 10:28:04.509927 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 521/1007] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:04 2022] GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:28:04.516716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-44117a68-8aaa-4a44-82a4-3284359a9406 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0b628b0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:04.801520 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-44117a68-8aaa-4a44-82a4-3284359a9406 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb" status: 200 len: 1453 microversion: 2.1 time: 0.288142 Oct 24 10:28:04.803138 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 522/1008] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:04 2022] GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb => generated 1453 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:04.817583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-919be47c-c5a3-4133-b032-90c128e47ee9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0b7a1f0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:04.892622 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-919be47c-c5a3-4133-b032-90c128e47ee9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69" status: 200 len: 1413 microversion: 2.1 time: 0.086403 Oct 24 10:28:04.894270 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 523/1009] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:04 2022] GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 => generated 1413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:04.908500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d20e42f0-eebe-4b76-8ade-f5db81cde335 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:04.909272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d20e42f0-eebe-4b76-8ade-f5db81cde335 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:04.924275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d20e42f0-eebe-4b76-8ade-f5db81cde335 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:04.926675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d20e42f0-eebe-4b76-8ade-f5db81cde335 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:04.928411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d20e42f0-eebe-4b76-8ade-f5db81cde335 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:04.929452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d20e42f0-eebe-4b76-8ade-f5db81cde335 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:04.929624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d20e42f0-eebe-4b76-8ade-f5db81cde335 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:04.931047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d20e42f0-eebe-4b76-8ade-f5db81cde335 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:05.536779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d20e42f0-eebe-4b76-8ade-f5db81cde335 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:05.554761 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d20e42f0-eebe-4b76-8ade-f5db81cde335 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1529 microversion: 2.1 time: 0.657842 Oct 24 10:28:05.555396 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 524/1010] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:04 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1529 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:05.571481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6b11c385-c928-4a1f-8df3-e9d0116fc125 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:05.585763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6b11c385-c928-4a1f-8df3-e9d0116fc125 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:05.608638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b11c385-c928-4a1f-8df3-e9d0116fc125 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:05.619920 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b11c385-c928-4a1f-8df3-e9d0116fc125 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:05.621807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b11c385-c928-4a1f-8df3-e9d0116fc125 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:05.624755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b11c385-c928-4a1f-8df3-e9d0116fc125 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:05.625483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b11c385-c928-4a1f-8df3-e9d0116fc125 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:05.630765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b11c385-c928-4a1f-8df3-e9d0116fc125 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:06.034910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6b11c385-c928-4a1f-8df3-e9d0116fc125 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:06.070818 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6b11c385-c928-4a1f-8df3-e9d0116fc125 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010" status: 200 len: 1318 microversion: 2.1 time: 0.504925 Oct 24 10:28:06.071428 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 525/1011] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:05 2022] GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:06.084163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d2d5ef0f-c754-4a1f-b87f-2f74fb9102b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:06.085728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d2d5ef0f-c754-4a1f-b87f-2f74fb9102b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:06.144148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2d5ef0f-c754-4a1f-b87f-2f74fb9102b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:06.144548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2d5ef0f-c754-4a1f-b87f-2f74fb9102b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:06.145108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2d5ef0f-c754-4a1f-b87f-2f74fb9102b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:06.145843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2d5ef0f-c754-4a1f-b87f-2f74fb9102b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:06.146360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2d5ef0f-c754-4a1f-b87f-2f74fb9102b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:06.147358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2d5ef0f-c754-4a1f-b87f-2f74fb9102b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:06.287845 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b75d8a0-0b11-4cf1-984a-44805785a7cf tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809/action" status: 202 len: 0 microversion: 2.25 time: 5.186203 Oct 24 10:28:06.291835 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 487/1012] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Oct 24 10:28:01 2022] POST /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809/action => generated 0 bytes in 5192 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:28:06.300601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bfde02d7-39bf-481e-a6d5-137402b3f29c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d13a24c0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:07.019071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d2d5ef0f-c754-4a1f-b87f-2f74fb9102b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:07.040709 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d2d5ef0f-c754-4a1f-b87f-2f74fb9102b9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1529 microversion: 2.1 time: 0.966329 Oct 24 10:28:07.044574 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 526/1013] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:06 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1529 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:07.061867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6f740a8d-daae-444c-ae12-2b1256ee313d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0bb7ca0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:11.071177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=25 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:11.214162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:11.274570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:16.143678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=93 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:17.025912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=26 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:21.424292 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bfde02d7-39bf-481e-a6d5-137402b3f29c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb" status: 200 len: 1453 microversion: 2.1 time: 15.130788 Oct 24 10:28:21.433189 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 488/1014] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:06 2022] GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb => generated 1453 bytes in 15140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:21.437988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ae04fcc4-bbc0-40fa-89d2-1146c6403414 req-4f1862b7-8ce3-48fe-9d07-1723acefbaa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "294c2f53-e675-40b8-a91f-634939781010", "name": "network-vif-plugged", "status": "completed", "tag": "0bf4ef00-3ca4-480f-a144-3400a6a043f5"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:21.457777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ae04fcc4-bbc0-40fa-89d2-1146c6403414 req-4f1862b7-8ce3-48fe-9d07-1723acefbaa0 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:21.458253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ae04fcc4-bbc0-40fa-89d2-1146c6403414 req-4f1862b7-8ce3-48fe-9d07-1723acefbaa0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:21.458689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ae04fcc4-bbc0-40fa-89d2-1146c6403414 req-4f1862b7-8ce3-48fe-9d07-1723acefbaa0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:21.467934 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6f740a8d-daae-444c-ae12-2b1256ee313d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69" status: 200 len: 1422 microversion: 2.1 time: 14.422191 Oct 24 10:28:21.471723 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 527/1015] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:07 2022] GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 => generated 1422 bytes in 14426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:21.494599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8d3ebcd9-e11b-46a2-b298-114b5e9d3476 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:21.495351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8d3ebcd9-e11b-46a2-b298-114b5e9d3476 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:21.496684 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ae04fcc4-bbc0-40fa-89d2-1146c6403414 req-4f1862b7-8ce3-48fe-9d07-1723acefbaa0 service nova] Creating event network-vif-plugged:0bf4ef00-3ca4-480f-a144-3400a6a043f5 for instance 294c2f53-e675-40b8-a91f-634939781010 on n-h1-858383-15 Oct 24 10:28:21.502248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d3ebcd9-e11b-46a2-b298-114b5e9d3476 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:21.504595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d3ebcd9-e11b-46a2-b298-114b5e9d3476 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:21.505359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d3ebcd9-e11b-46a2-b298-114b5e9d3476 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:21.507193 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ae04fcc4-bbc0-40fa-89d2-1146c6403414 req-4f1862b7-8ce3-48fe-9d07-1723acefbaa0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071762 Oct 24 10:28:21.508744 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 489/1016] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:21.511955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d3ebcd9-e11b-46a2-b298-114b5e9d3476 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:21.512437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d3ebcd9-e11b-46a2-b298-114b5e9d3476 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:21.512902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d3ebcd9-e11b-46a2-b298-114b5e9d3476 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:21.536493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-54e6a25a-bf11-4e23-998b-933cb9ef612c tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:21.549967 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-54e6a25a-bf11-4e23-998b-933cb9ef612c tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] HTTP exception thrown: Flavor e638442e-1d17-423c-8a72-107bfe635574 could not be found. Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-54e6a25a-bf11-4e23-998b-933cb9ef612c tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Request method failure captured: Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/flavors/e638442e-1d17-423c-8a72-107bfe635574 HTTP/1.1 Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfX8RiWIiGJRI1t9OxsQgIfN3Qbf-UFsBlDEs_PZBuAl81XqPewYDpYnEd33wZt2LX8UGZPvNUAaAf6olIUHqTP2iqt5K-c-NSUQPdsgu3rw1e0P9Cd-m1AehQikRdEH_AqkPy2zivUPzTUpaobF0agUzgKGfETcE3HV6W68Vmzy60 Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: ad2ca01d7aeb4f5e8730aa1023f3601e Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-MigrationsAdminTest-1821588795 Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:28:21.559995 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:28:21.561589 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ad2ca01d7aeb4f5e8730aa1023f3601e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ad2ca01d7aeb4f5e8730aa1023f3601e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ad2ca01d7aeb4f5e8730aa1023f3601e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ad2ca01d7aeb4f5e8730aa1023f3601e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:28:21.561589 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-MigrationsAdminTest-1821588795 Oct 24 10:28:21.561589 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: ad2ca01d7aeb4f5e8730aa1023f3601e Oct 24 10:28:21.561589 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-MigrationsAdminTest-1821588795 Oct 24 10:28:21.561589 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-MigrationsAdminTest-1821588795-project-admin Oct 24 10:28:21.561589 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:28:21.561589 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:28:21.561589 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 9a13f80d5cf8421781351e88c248c68a Oct 24 10:28:21.561589 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-MigrationsAdminTest-1821588795-project-admin Oct 24 10:28:21.561589 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:28:21.561589 n-d-858383-15 devstack@n-api.service[120425]: exception: Flavor e638442e-1d17-423c-8a72-107bfe635574 could not be found. Oct 24 10:28:21.561589 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'e638442e-1d17-423c-8a72-107bfe635574'} Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor e638442e-1d17-423c-8a72-107bfe635574 could not be found. Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:28:21.562414 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:28:21.563801 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:28:21.563801 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:28:21.563801 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:28:21.563801 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:28:21.563801 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:28:21.563801 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 24 10:28:21.563801 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:28:21.563801 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor e638442e-1d17-423c-8a72-107bfe635574 could not be found. Oct 24 10:28:21.563801 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:28:21.563801 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:28:21.563801 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:28:21.563801 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:28:21.563801 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:28:21.563801 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:28:21.563801 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:28:21.563801 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:28:21.563801 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor e638442e-1d17-423c-8a72-107bfe635574 could not be found. Oct 24 10:28:21.563801 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:28:21.567150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-54e6a25a-bf11-4e23-998b-933cb9ef612c tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Returning 404 to user: Flavor e638442e-1d17-423c-8a72-107bfe635574 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:28:21.567150 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-54e6a25a-bf11-4e23-998b-933cb9ef612c tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/e638442e-1d17-423c-8a72-107bfe635574" status: 404 len: 109 microversion: 2.1 time: 0.051805 Oct 24 10:28:21.567150 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 490/1017] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:28:21 2022] DELETE /compute/v2.1/flavors/e638442e-1d17-423c-8a72-107bfe635574 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:28:21.572677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c9fa10d9-7e01-48ae-b6f9-822ed4843bcd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:21.573450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c9fa10d9-7e01-48ae-b6f9-822ed4843bcd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:21.587984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9fa10d9-7e01-48ae-b6f9-822ed4843bcd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:21.589098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9fa10d9-7e01-48ae-b6f9-822ed4843bcd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:21.589515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9fa10d9-7e01-48ae-b6f9-822ed4843bcd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:21.590687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9fa10d9-7e01-48ae-b6f9-822ed4843bcd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:21.591372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9fa10d9-7e01-48ae-b6f9-822ed4843bcd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:21.591845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9fa10d9-7e01-48ae-b6f9-822ed4843bcd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:21.800012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d3ebcd9-e11b-46a2-b298-114b5e9d3476 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:21.809824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d3ebcd9-e11b-46a2-b298-114b5e9d3476 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:21.811554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d3ebcd9-e11b-46a2-b298-114b5e9d3476 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:21.813687 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8d3ebcd9-e11b-46a2-b298-114b5e9d3476 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 200 len: 1557 microversion: 2.25 time: 0.340811 Oct 24 10:28:21.814685 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 528/1018] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:21 2022] GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 1557 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:21.829084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c9fa10d9-7e01-48ae-b6f9-822ed4843bcd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:21.840733 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c9fa10d9-7e01-48ae-b6f9-822ed4843bcd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010" status: 200 len: 1318 microversion: 2.1 time: 0.272831 Oct 24 10:28:21.841287 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 491/1019] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:21 2022] GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:21.846729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3ad67eda-a90e-4cd6-877b-af510f53e01d req-2c3cac50-64a1-4907-b342-5aa5481a65e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c264bc-70a7-4b1b-a29a-d5bbb2884809", "name": "network-vif-unplugged", "status": "completed", "tag": "8db04e7c-b441-4bfb-89ad-0f6839db6290"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:21.866997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3ad67eda-a90e-4cd6-877b-af510f53e01d req-2c3cac50-64a1-4907-b342-5aa5481a65e4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:21.867635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3ad67eda-a90e-4cd6-877b-af510f53e01d req-2c3cac50-64a1-4907-b342-5aa5481a65e4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:21.868239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3ad67eda-a90e-4cd6-877b-af510f53e01d req-2c3cac50-64a1-4907-b342-5aa5481a65e4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:21.881044 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3ad67eda-a90e-4cd6-877b-af510f53e01d req-2c3cac50-64a1-4907-b342-5aa5481a65e4 service nova] Creating event network-vif-unplugged:8db04e7c-b441-4bfb-89ad-0f6839db6290 for instance 77c264bc-70a7-4b1b-a29a-d5bbb2884809 on n-h2-858383-15 Oct 24 10:28:21.887073 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3ad67eda-a90e-4cd6-877b-af510f53e01d req-2c3cac50-64a1-4907-b342-5aa5481a65e4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044558 Oct 24 10:28:21.888067 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 492/1020] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:21.963469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4a3203c9-b222-44fd-918b-de4820c85b91 tempest-QuotaClassesAdmin257Test-1226394138 tempest-QuotaClassesAdmin257Test-1226394138-project-admin] Calling method '.version_select at 0x7f04d0b72940>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:21.974815 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4a3203c9-b222-44fd-918b-de4820c85b91 tempest-QuotaClassesAdmin257Test-1226394138 tempest-QuotaClassesAdmin257Test-1226394138-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.158769 Oct 24 10:28:21.975943 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 529/1021] 10.222.0.50 () {60 vars in 1226 bytes} [Mon Oct 24 10:28:21 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:28:21.980319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ae12c280-335a-4a5c-9f32-5f4cefdd6bbb tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0b7a790>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:22.008749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1017338968", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "764d65e7-2cd6-484d-a7f4-f21087e0ed28"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:22.025979 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ae12c280-335a-4a5c-9f32-5f4cefdd6bbb tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69" status: 200 len: 1422 microversion: 2.1 time: 0.048978 Oct 24 10:28:22.026587 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 530/1022] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:21 2022] GET /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 => generated 1422 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:22.031436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9d28a145-c057-4605-b276-bb0f095e5ddb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1021143169", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:22.069472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] validate_networks() for [('764d65e7-2cd6-484d-a7f4-f21087e0ed28', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:28:22.083444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-9d28a145-c057-4605-b276-bb0f095e5ddb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:28:22.510620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-9d28a145-c057-4605-b276-bb0f095e5ddb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:28:22.511842 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-9d28a145-c057-4605-b276-bb0f095e5ddb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:28:22.511842 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-9d28a145-c057-4605-b276-bb0f095e5ddb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:28:22.512325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-9d28a145-c057-4605-b276-bb0f095e5ddb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:28:22.512929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-9d28a145-c057-4605-b276-bb0f095e5ddb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:28:22.523121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d28a145-c057-4605-b276-bb0f095e5ddb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:22.523696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d28a145-c057-4605-b276-bb0f095e5ddb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:22.524209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d28a145-c057-4605-b276-bb0f095e5ddb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:22.525059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d28a145-c057-4605-b276-bb0f095e5ddb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:22.525587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d28a145-c057-4605-b276-bb0f095e5ddb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:22.526110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d28a145-c057-4605-b276-bb0f095e5ddb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:22.543891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-9d28a145-c057-4605-b276-bb0f095e5ddb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Getting quotas for project ac5f703504204b91a5c7e895964ec985. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:28:22.549033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-9d28a145-c057-4605-b276-bb0f095e5ddb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Getting quotas for user b684c865fc9e4abb8e0e55616087b92e and project ac5f703504204b91a5c7e895964ec985. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:28:22.564133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9d28a145-c057-4605-b276-bb0f095e5ddb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:28:22.566958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9d28a145-c057-4605-b276-bb0f095e5ddb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:28:22.616192 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9d28a145-c057-4605-b276-bb0f095e5ddb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588025 Oct 24 10:28:22.617110 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 531/1023] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:28:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:28:22.621874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c3a12599-a613-4fdd-95cb-cadb42bbb43b tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '.version_select at 0x7f04d0aaa310>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:22.625876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3a12599-a613-4fdd-95cb-cadb42bbb43b tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:22.626597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3a12599-a613-4fdd-95cb-cadb42bbb43b tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:22.627045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3a12599-a613-4fdd-95cb-cadb42bbb43b tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:22.642058 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c3a12599-a613-4fdd-95cb-cadb42bbb43b tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 2809 microversion: 2.25 time: 0.023738 Oct 24 10:28:22.642840 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 532/1024] 10.222.0.50 () {60 vars in 1184 bytes} [Mon Oct 24 10:28:22 2022] GET /compute/v2.1/os-migrations => generated 2809 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:22.647660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4d759b56-5f10-4ba4-a6ce-4c8faaada272 tempest-QuotaClassesAdmin257Test-1226394138 tempest-QuotaClassesAdmin257Test-1226394138-project-admin] Action: 'update', calling method: .version_select at 0x7f04d0b7aee0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:22.660559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:28:22.661050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:28:22.661486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:28:22.661886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:28:22.662648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:28:22.672558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:22.673384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:22.674121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:22.675106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:22.675911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:22.676502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:22.698738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Getting quotas for project 71c8dc3d203642269466444b34a31285. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:28:22.704280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Getting quotas for user 30108371eb394d148babe9e2f36c9454 and project 71c8dc3d203642269466444b34a31285. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:28:22.719030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:28:22.721623 n-d-858383-15 devstack@n-api.service[120425]: WARNING nova.utils [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1017338968 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-101733896 Oct 24 10:28:22.723170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:28:22.762064 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4d759b56-5f10-4ba4-a6ce-4c8faaada272 tempest-QuotaClassesAdmin257Test-1226394138 tempest-QuotaClassesAdmin257Test-1226394138-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.117906 Oct 24 10:28:22.762911 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 533/1025] 10.222.0.50 () {62 vars in 1247 bytes} [Mon Oct 24 10:28:22 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:28:22.767606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-264a9bdc-c897-4bd3-a74d-f86a0cbfb177 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0b7a160>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:22.775325 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9d6dd6f6-f8c9-4551-a483-cdebe22254b2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886050 Oct 24 10:28:22.782239 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 493/1026] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:28:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:28:22.783552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-de9a266b-8a93-441d-ae70-9cc8b1f14f6d tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0f093a0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:22.846137 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-de9a266b-8a93-441d-ae70-9cc8b1f14f6d tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb" status: 200 len: 1462 microversion: 2.1 time: 0.068181 Oct 24 10:28:22.847056 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 494/1027] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:22 2022] GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb => generated 1462 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:22.856674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5ec9c284-a844-4d4b-be29-427dd8825372 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:22.859588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5ec9c284-a844-4d4b-be29-427dd8825372 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:22.923861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5ec9c284-a844-4d4b-be29-427dd8825372 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:22.934591 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5ec9c284-a844-4d4b-be29-427dd8825372 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1213 microversion: 2.1 time: 0.084524 Oct 24 10:28:22.935725 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 495/1028] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:22 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:22.940350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-15ac5fef-4d8b-4edd-bac3-9e216120ac44 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:22.940990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-15ac5fef-4d8b-4edd-bac3-9e216120ac44 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:22.949760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15ac5fef-4d8b-4edd-bac3-9e216120ac44 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:22.950254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15ac5fef-4d8b-4edd-bac3-9e216120ac44 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:22.950896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15ac5fef-4d8b-4edd-bac3-9e216120ac44 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:22.951611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15ac5fef-4d8b-4edd-bac3-9e216120ac44 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:22.952067 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15ac5fef-4d8b-4edd-bac3-9e216120ac44 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:22.952502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15ac5fef-4d8b-4edd-bac3-9e216120ac44 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:23.122704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-15ac5fef-4d8b-4edd-bac3-9e216120ac44 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'services' on Instance uuid 77c264bc-70a7-4b1b-a29a-d5bbb2884809 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:28:23.138897 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-15ac5fef-4d8b-4edd-bac3-9e216120ac44 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 200 len: 2051 microversion: 2.25 time: 0.202016 Oct 24 10:28:23.139737 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 496/1029] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:22 2022] GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 2051 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:23.173984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-81f397d5-6dd1-44bf-8e39-002f71b64159 tempest-QuotaClassesAdmin257Test-1226394138 tempest-QuotaClassesAdmin257Test-1226394138-project-admin] Calling method '.version_select at 0x7f04d0f09e50>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:23.187563 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-81f397d5-6dd1-44bf-8e39-002f71b64159 tempest-QuotaClassesAdmin257Test-1226394138 tempest-QuotaClassesAdmin257Test-1226394138-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.033282 Oct 24 10:28:23.188696 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 497/1030] 10.222.0.50 () {60 vars in 1226 bytes} [Mon Oct 24 10:28:23 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:28:23.194650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b2404471-06a6-4d30-91c1-06cf8b15a1f2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:23.195481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b2404471-06a6-4d30-91c1-06cf8b15a1f2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:23.254184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b2404471-06a6-4d30-91c1-06cf8b15a1f2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:23.262378 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b2404471-06a6-4d30-91c1-06cf8b15a1f2 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1232 microversion: 2.1 time: 0.072235 Oct 24 10:28:23.262846 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 498/1031] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:23 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1232 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:23.279856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e22493a5-374c-4a5c-8e4f-7a0595c1ebd5 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0de3550>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:23.335866 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e22493a5-374c-4a5c-8e4f-7a0595c1ebd5 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb" status: 200 len: 1462 microversion: 2.1 time: 0.060651 Oct 24 10:28:23.338012 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 499/1032] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:23 2022] GET /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb => generated 1462 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:23.344120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-45d91358-cfb8-445f-9176-2e54fd0a69d0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:23.344780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-45d91358-cfb8-445f-9176-2e54fd0a69d0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:23.356085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45d91358-cfb8-445f-9176-2e54fd0a69d0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:23.356571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45d91358-cfb8-445f-9176-2e54fd0a69d0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:23.357056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45d91358-cfb8-445f-9176-2e54fd0a69d0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:23.357794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45d91358-cfb8-445f-9176-2e54fd0a69d0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:23.358457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45d91358-cfb8-445f-9176-2e54fd0a69d0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:23.358932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45d91358-cfb8-445f-9176-2e54fd0a69d0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:23.536068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-45d91358-cfb8-445f-9176-2e54fd0a69d0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:23.544439 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-45d91358-cfb8-445f-9176-2e54fd0a69d0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010" status: 200 len: 1318 microversion: 2.1 time: 0.205062 Oct 24 10:28:23.545526 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 500/1033] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:23 2022] GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:23.550625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4b9ab4ef-b1aa-4acd-99d7-3135f2f13905 tempest-QuotaClassesAdmin257Test-1226394138 tempest-QuotaClassesAdmin257Test-1226394138-project-admin] Action: 'update', calling method: .version_select at 0x7f04d0de39d0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:23.638551 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4b9ab4ef-b1aa-4acd-99d7-3135f2f13905 tempest-QuotaClassesAdmin257Test-1226394138 tempest-QuotaClassesAdmin257Test-1226394138-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.091289 Oct 24 10:28:23.639344 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 501/1034] 10.222.0.50 () {62 vars in 1247 bytes} [Mon Oct 24 10:28:23 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:28:23.645873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ba98f1c8-f9fe-40a7-a66f-e362f8be0627 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:23.647313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ba98f1c8-f9fe-40a7-a66f-e362f8be0627 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:23.658862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba98f1c8-f9fe-40a7-a66f-e362f8be0627 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:23.659723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba98f1c8-f9fe-40a7-a66f-e362f8be0627 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:23.660497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba98f1c8-f9fe-40a7-a66f-e362f8be0627 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:23.661651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba98f1c8-f9fe-40a7-a66f-e362f8be0627 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:23.663032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba98f1c8-f9fe-40a7-a66f-e362f8be0627 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:23.664055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba98f1c8-f9fe-40a7-a66f-e362f8be0627 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:23.667199 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-264a9bdc-c897-4bd3-a74d-f86a0cbfb177 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69" status: 204 len: 0 microversion: 2.1 time: 0.902906 Oct 24 10:28:23.671628 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 534/1035] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:22 2022] DELETE /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 => generated 0 bytes in 904 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:28:23.678015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0cf5ebf7-e97a-4c56-8165-74f95d91e734 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-71536511", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "979ef371-392f-454f-8dbb-ad9320d9a120"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:23.780076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-0cf5ebf7-e97a-4c56-8165-74f95d91e734 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] validate_networks() for [('979ef371-392f-454f-8dbb-ad9320d9a120', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:28:23.918110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ba98f1c8-f9fe-40a7-a66f-e362f8be0627 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:23.930370 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ba98f1c8-f9fe-40a7-a66f-e362f8be0627 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1468 microversion: 2.1 time: 0.289656 Oct 24 10:28:23.931239 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 502/1036] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:23 2022] GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 1468 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:23.936113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-5f80c10d-852e-453f-a24d-fdb8b6ea945c req-b6451fa9-d07c-4d45-94c0-319d0764c459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c18a9a-ad67-4d8e-abd2-349766d8a002", "name": "network-vif-plugged", "status": "completed", "tag": "0782d6f6-5f17-49c4-9ee3-4c8b802a9588"}, {"server_uuid": "d4958f64-a776-423b-8544-b0918c30d25e", "name": "network-vif-plugged", "status": "completed", "tag": "7cb75069-1936-455b-9d3e-e39ef3915249"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:23.947067 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5f80c10d-852e-453f-a24d-fdb8b6ea945c req-b6451fa9-d07c-4d45-94c0-319d0764c459 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:23.947906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5f80c10d-852e-453f-a24d-fdb8b6ea945c req-b6451fa9-d07c-4d45-94c0-319d0764c459 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:23.948815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5f80c10d-852e-453f-a24d-fdb8b6ea945c req-b6451fa9-d07c-4d45-94c0-319d0764c459 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:23.968428 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-5f80c10d-852e-453f-a24d-fdb8b6ea945c req-b6451fa9-d07c-4d45-94c0-319d0764c459 service nova] Creating event network-vif-plugged:0782d6f6-5f17-49c4-9ee3-4c8b802a9588 for instance 98c18a9a-ad67-4d8e-abd2-349766d8a002 on n-h2-858383-15 Oct 24 10:28:23.969682 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-5f80c10d-852e-453f-a24d-fdb8b6ea945c req-b6451fa9-d07c-4d45-94c0-319d0764c459 service nova] Creating event network-vif-plugged:7cb75069-1936-455b-9d3e-e39ef3915249 for instance d4958f64-a776-423b-8544-b0918c30d25e on n-h2-858383-15 Oct 24 10:28:23.984257 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-5f80c10d-852e-453f-a24d-fdb8b6ea945c req-b6451fa9-d07c-4d45-94c0-319d0764c459 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051404 Oct 24 10:28:23.985334 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 503/1037] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:23.996447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8bb9fe1a-380d-46de-870e-794ec34b4ec5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:23.997078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8bb9fe1a-380d-46de-870e-794ec34b4ec5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: c828266b-d510-4a99-9b08-476e19b057a7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:24.004497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bb9fe1a-380d-46de-870e-794ec34b4ec5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:24.005025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bb9fe1a-380d-46de-870e-794ec34b4ec5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:24.005584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bb9fe1a-380d-46de-870e-794ec34b4ec5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:24.006459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bb9fe1a-380d-46de-870e-794ec34b4ec5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:24.006926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bb9fe1a-380d-46de-870e-794ec34b4ec5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:24.007464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bb9fe1a-380d-46de-870e-794ec34b4ec5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:24.043803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8bb9fe1a-380d-46de-870e-794ec34b4ec5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: c828266b-d510-4a99-9b08-476e19b057a7] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:28:24.161864 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8bb9fe1a-380d-46de-870e-794ec34b4ec5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7" status: 204 len: 0 microversion: 2.1 time: 0.173871 Oct 24 10:28:24.162470 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 504/1038] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:28:23 2022] DELETE /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:28:24.177160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-8f9376ec-4458-4269-b7e2-1e86b2155bae req-63f9e94c-ca89-4471-b7a8-897a3c3d03f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c264bc-70a7-4b1b-a29a-d5bbb2884809", "tag": "8db04e7c-b441-4bfb-89ad-0f6839db6290"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:24.199475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8f9376ec-4458-4269-b7e2-1e86b2155bae req-63f9e94c-ca89-4471-b7a8-897a3c3d03f2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:24.199950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8f9376ec-4458-4269-b7e2-1e86b2155bae req-63f9e94c-ca89-4471-b7a8-897a3c3d03f2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:24.200383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8f9376ec-4458-4269-b7e2-1e86b2155bae req-63f9e94c-ca89-4471-b7a8-897a3c3d03f2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:24.220487 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-8f9376ec-4458-4269-b7e2-1e86b2155bae req-63f9e94c-ca89-4471-b7a8-897a3c3d03f2 service nova] Creating event network-changed:8db04e7c-b441-4bfb-89ad-0f6839db6290 for instance 77c264bc-70a7-4b1b-a29a-d5bbb2884809 on n-h2-858383-15 Oct 24 10:28:24.234403 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-8f9376ec-4458-4269-b7e2-1e86b2155bae req-63f9e94c-ca89-4471-b7a8-897a3c3d03f2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068024 Oct 24 10:28:24.237614 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 505/1039] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:24.251922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68841f38-7494-4363-8161-a8a48e1792d6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-724168297"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:24.261520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-68841f38-7494-4363-8161-a8a48e1792d6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: a8f749f9-5771-4ecb-8a06-30a8f69dd848] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:24.292516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68841f38-7494-4363-8161-a8a48e1792d6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:24.293142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68841f38-7494-4363-8161-a8a48e1792d6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:24.293594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68841f38-7494-4363-8161-a8a48e1792d6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:24.302062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68841f38-7494-4363-8161-a8a48e1792d6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:24.302453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68841f38-7494-4363-8161-a8a48e1792d6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:24.302946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68841f38-7494-4363-8161-a8a48e1792d6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:24.455714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0cf5ebf7-e97a-4c56-8165-74f95d91e734 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:28:24.456164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0cf5ebf7-e97a-4c56-8165-74f95d91e734 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:28:24.456621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0cf5ebf7-e97a-4c56-8165-74f95d91e734 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:28:24.457058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0cf5ebf7-e97a-4c56-8165-74f95d91e734 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:28:24.457667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0cf5ebf7-e97a-4c56-8165-74f95d91e734 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:28:24.475440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0cf5ebf7-e97a-4c56-8165-74f95d91e734 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:24.476380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0cf5ebf7-e97a-4c56-8165-74f95d91e734 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:24.478243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0cf5ebf7-e97a-4c56-8165-74f95d91e734 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:24.479224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0cf5ebf7-e97a-4c56-8165-74f95d91e734 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:24.479973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0cf5ebf7-e97a-4c56-8165-74f95d91e734 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:24.480468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0cf5ebf7-e97a-4c56-8165-74f95d91e734 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:24.511421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-0cf5ebf7-e97a-4c56-8165-74f95d91e734 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Getting quotas for project 9f2d317e42584b41b11c1668de6657bd. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:28:24.519391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-0cf5ebf7-e97a-4c56-8165-74f95d91e734 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Getting quotas for user 66ca4f9e7ffb447ebf740c52f6a098c2 and project 9f2d317e42584b41b11c1668de6657bd. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:28:24.538099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0cf5ebf7-e97a-4c56-8165-74f95d91e734 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:28:24.540340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0cf5ebf7-e97a-4c56-8165-74f95d91e734 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:28:24.612382 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0cf5ebf7-e97a-4c56-8165-74f95d91e734 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.939512 Oct 24 10:28:24.613278 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 535/1040] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Oct 24 10:28:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 10:28:24.624588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-94625a4c-ef88-4609-8b91-ae2897e42c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:24.625589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-94625a4c-ef88-4609-8b91-ae2897e42c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:24.634489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94625a4c-ef88-4609-8b91-ae2897e42c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:24.634997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94625a4c-ef88-4609-8b91-ae2897e42c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:24.635496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94625a4c-ef88-4609-8b91-ae2897e42c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:24.636489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94625a4c-ef88-4609-8b91-ae2897e42c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:24.637189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94625a4c-ef88-4609-8b91-ae2897e42c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:24.637680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94625a4c-ef88-4609-8b91-ae2897e42c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:24.661746 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-68841f38-7494-4363-8161-a8a48e1792d6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "POST /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848/action" status: 202 len: 0 microversion: 2.1 time: 0.417699 Oct 24 10:28:24.663643 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 506/1041] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:28:24 2022] POST /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 10:28:24.672383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6cd19f5f-04c9-4397-b583-c8c25d3f4cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:24.674833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6cd19f5f-04c9-4397-b583-c8c25d3f4cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:24.683778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cd19f5f-04c9-4397-b583-c8c25d3f4cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:24.687576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cd19f5f-04c9-4397-b583-c8c25d3f4cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:24.688393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cd19f5f-04c9-4397-b583-c8c25d3f4cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:24.689808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cd19f5f-04c9-4397-b583-c8c25d3f4cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:24.690508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cd19f5f-04c9-4397-b583-c8c25d3f4cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:24.691385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cd19f5f-04c9-4397-b583-c8c25d3f4cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:24.936801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6cd19f5f-04c9-4397-b583-c8c25d3f4cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:24.944855 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6cd19f5f-04c9-4397-b583-c8c25d3f4cb5 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1228 microversion: 2.1 time: 0.279604 Oct 24 10:28:24.966247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94625a4c-ef88-4609-8b91-ae2897e42c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:24.971034 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 507/1042] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:24 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1228 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:24.977255 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-94625a4c-ef88-4609-8b91-ae2897e42c24 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1265 microversion: 2.1 time: 0.362480 Oct 24 10:28:24.977927 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 536/1043] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:24 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1265 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:24.986195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5f2d58b9-100e-40e7-9dde-d564eca68c25 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1255539827", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "c0c03a0b-80ac-4629-802c-40f648b11429"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:24.997780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-06be15ba-881b-4090-a0d7-ba98343b26a1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:24.998397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-06be15ba-881b-4090-a0d7-ba98343b26a1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:25.021881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06be15ba-881b-4090-a0d7-ba98343b26a1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:25.022925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06be15ba-881b-4090-a0d7-ba98343b26a1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:25.023366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06be15ba-881b-4090-a0d7-ba98343b26a1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:25.024175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06be15ba-881b-4090-a0d7-ba98343b26a1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:25.024753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06be15ba-881b-4090-a0d7-ba98343b26a1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:25.025198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06be15ba-881b-4090-a0d7-ba98343b26a1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:25.075456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-5f2d58b9-100e-40e7-9dde-d564eca68c25 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] validate_networks() for [('c0c03a0b-80ac-4629-802c-40f648b11429', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:28:25.287163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-06be15ba-881b-4090-a0d7-ba98343b26a1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:25.302865 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-06be15ba-881b-4090-a0d7-ba98343b26a1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010" status: 200 len: 1467 microversion: 2.1 time: 0.308740 Oct 24 10:28:25.303815 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 537/1044] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:24 2022] GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 => generated 1467 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:25.308718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-30c0e8b8-1272-43a8-9684-abfbec8927a0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:25.309353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-30c0e8b8-1272-43a8-9684-abfbec8927a0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:25.315741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30c0e8b8-1272-43a8-9684-abfbec8927a0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:25.316402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30c0e8b8-1272-43a8-9684-abfbec8927a0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:25.317221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30c0e8b8-1272-43a8-9684-abfbec8927a0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:25.318341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30c0e8b8-1272-43a8-9684-abfbec8927a0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:25.319694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30c0e8b8-1272-43a8-9684-abfbec8927a0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:25.320603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30c0e8b8-1272-43a8-9684-abfbec8927a0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:25.408966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-30c0e8b8-1272-43a8-9684-abfbec8927a0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:25.418297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-30c0e8b8-1272-43a8-9684-abfbec8927a0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:25.419784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-30c0e8b8-1272-43a8-9684-abfbec8927a0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:25.420915 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-30c0e8b8-1272-43a8-9684-abfbec8927a0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1264 microversion: 2.25 time: 0.116034 Oct 24 10:28:25.421789 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 538/1045] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:25 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1264 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:25.426235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a05d8a6f-d8a7-4ae5-a77c-184c23d3ed7a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0b7aee0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:25.504947 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a05d8a6f-d8a7-4ae5-a77c-184c23d3ed7a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.081995 Oct 24 10:28:25.505689 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 539/1046] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:25 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:25.514478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-940ea242-a516-4fff-af31-34fff1220210 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:25.515360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-940ea242-a516-4fff-af31-34fff1220210 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: d4958f64-a776-423b-8544-b0918c30d25e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:25.524758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-940ea242-a516-4fff-af31-34fff1220210 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:25.526060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-940ea242-a516-4fff-af31-34fff1220210 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:25.526690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-940ea242-a516-4fff-af31-34fff1220210 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:25.527625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-940ea242-a516-4fff-af31-34fff1220210 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:25.528285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-940ea242-a516-4fff-af31-34fff1220210 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:25.528937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-940ea242-a516-4fff-af31-34fff1220210 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:26.061862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-940ea242-a516-4fff-af31-34fff1220210 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:26.080673 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-940ea242-a516-4fff-af31-34fff1220210 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e" status: 200 len: 1318 microversion: 2.1 time: 0.573767 Oct 24 10:28:26.092617 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 540/1047] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:25 2022] GET /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e => generated 1318 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:26.092617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4835879d-f78f-4063-b9f5-1a00bf966400 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:26.092617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4835879d-f78f-4063-b9f5-1a00bf966400 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:26.094484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4835879d-f78f-4063-b9f5-1a00bf966400 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:26.094965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4835879d-f78f-4063-b9f5-1a00bf966400 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:26.095827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4835879d-f78f-4063-b9f5-1a00bf966400 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:26.096527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4835879d-f78f-4063-b9f5-1a00bf966400 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:26.097018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4835879d-f78f-4063-b9f5-1a00bf966400 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:26.097453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4835879d-f78f-4063-b9f5-1a00bf966400 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:26.101459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5f2d58b9-100e-40e7-9dde-d564eca68c25 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:28:26.101972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5f2d58b9-100e-40e7-9dde-d564eca68c25 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:28:26.102227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5f2d58b9-100e-40e7-9dde-d564eca68c25 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:28:26.102626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5f2d58b9-100e-40e7-9dde-d564eca68c25 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:28:26.103027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5f2d58b9-100e-40e7-9dde-d564eca68c25 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:28:26.116432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f2d58b9-100e-40e7-9dde-d564eca68c25 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:26.128480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f2d58b9-100e-40e7-9dde-d564eca68c25 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:26.128996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f2d58b9-100e-40e7-9dde-d564eca68c25 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:26.129806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f2d58b9-100e-40e7-9dde-d564eca68c25 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:26.130464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f2d58b9-100e-40e7-9dde-d564eca68c25 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:26.131044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f2d58b9-100e-40e7-9dde-d564eca68c25 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:26.150527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-5f2d58b9-100e-40e7-9dde-d564eca68c25 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Getting quotas for project 8a3ff02c01a64c9a940de444ca1197c4. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:28:26.156127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-5f2d58b9-100e-40e7-9dde-d564eca68c25 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Getting quotas for user 43fd0499bc224bd8b190701a811ee204 and project 8a3ff02c01a64c9a940de444ca1197c4. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:28:26.172177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5f2d58b9-100e-40e7-9dde-d564eca68c25 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:28:26.175899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5f2d58b9-100e-40e7-9dde-d564eca68c25 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:28:26.192537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4835879d-f78f-4063-b9f5-1a00bf966400 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:26.208767 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4835879d-f78f-4063-b9f5-1a00bf966400 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1284 microversion: 2.1 time: 0.126205 Oct 24 10:28:26.210674 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 541/1048] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:26 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:26.215495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9935b72c-60fc-49be-843e-af57c875b263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:26.216339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9935b72c-60fc-49be-843e-af57c875b263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:26.223533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9935b72c-60fc-49be-843e-af57c875b263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:26.228053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9935b72c-60fc-49be-843e-af57c875b263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:26.230328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9935b72c-60fc-49be-843e-af57c875b263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:26.231521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9935b72c-60fc-49be-843e-af57c875b263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:26.232228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9935b72c-60fc-49be-843e-af57c875b263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:26.232888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9935b72c-60fc-49be-843e-af57c875b263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:26.265372 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5f2d58b9-100e-40e7-9dde-d564eca68c25 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.285922 Oct 24 10:28:26.266986 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 508/1049] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:28:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:28:26.273528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-5652ce59-da0b-4d2a-b411-6367779d337b req-2478a462-8865-4141-97c4-a1ad54c70745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c828266b-d510-4a99-9b08-476e19b057a7", "name": "network-vif-unplugged", "status": "completed", "tag": "08217d41-f854-428a-9793-2feb95de04df"}, {"server_uuid": "94278005-1d71-4976-b673-ad2d105385e0", "name": "network-vif-unplugged", "status": "completed", "tag": "9691a054-3d8c-4b1b-b4f4-09af40c934d5"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:26.295861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5652ce59-da0b-4d2a-b411-6367779d337b req-2478a462-8865-4141-97c4-a1ad54c70745 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:26.297389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5652ce59-da0b-4d2a-b411-6367779d337b req-2478a462-8865-4141-97c4-a1ad54c70745 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:26.297829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5652ce59-da0b-4d2a-b411-6367779d337b req-2478a462-8865-4141-97c4-a1ad54c70745 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:26.326082 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-5652ce59-da0b-4d2a-b411-6367779d337b req-2478a462-8865-4141-97c4-a1ad54c70745 service nova] Creating event network-vif-unplugged:08217d41-f854-428a-9793-2feb95de04df for instance c828266b-d510-4a99-9b08-476e19b057a7 on n-h1-858383-15 Oct 24 10:28:26.326812 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-5652ce59-da0b-4d2a-b411-6367779d337b req-2478a462-8865-4141-97c4-a1ad54c70745 service nova] Creating event network-vif-unplugged:9691a054-3d8c-4b1b-b4f4-09af40c934d5 for instance 94278005-1d71-4976-b673-ad2d105385e0 on n-h1-858383-15 Oct 24 10:28:26.338209 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-5652ce59-da0b-4d2a-b411-6367779d337b req-2478a462-8865-4141-97c4-a1ad54c70745 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.069330 Oct 24 10:28:26.339115 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 509/1050] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:26.346030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9935b72c-60fc-49be-843e-af57c875b263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:26.348475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d1e2ed6f-f5a9-4d21-83bd-324f43aeec14 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:26.349221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d1e2ed6f-f5a9-4d21-83bd-324f43aeec14 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:26.359738 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9935b72c-60fc-49be-843e-af57c875b263 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1271 microversion: 2.1 time: 0.147132 Oct 24 10:28:26.361071 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 542/1051] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:26 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1271 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:26.444564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d1e2ed6f-f5a9-4d21-83bd-324f43aeec14 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:26.448276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d3688b59-1881-4aac-a2ec-6f0014605938 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:26.448926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d3688b59-1881-4aac-a2ec-6f0014605938 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:26.460360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3688b59-1881-4aac-a2ec-6f0014605938 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:26.461193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3688b59-1881-4aac-a2ec-6f0014605938 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:26.462519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3688b59-1881-4aac-a2ec-6f0014605938 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:26.463537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3688b59-1881-4aac-a2ec-6f0014605938 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:26.464171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3688b59-1881-4aac-a2ec-6f0014605938 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:26.464576 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d1e2ed6f-f5a9-4d21-83bd-324f43aeec14 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1208 microversion: 2.1 time: 0.124005 Oct 24 10:28:26.464979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3688b59-1881-4aac-a2ec-6f0014605938 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:26.465397 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 510/1052] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:26 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1208 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:26.522923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-450b2612-1291-4b71-8935-d528336c3a19 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0de3e50>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:26.597274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d3688b59-1881-4aac-a2ec-6f0014605938 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:26.612603 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-450b2612-1291-4b71-8935-d528336c3a19 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.095235 Oct 24 10:28:26.622982 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 511/1053] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:26 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:26.643758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d3688b59-1881-4aac-a2ec-6f0014605938 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:26.646719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d3688b59-1881-4aac-a2ec-6f0014605938 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:26.656042 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d3688b59-1881-4aac-a2ec-6f0014605938 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1256 microversion: 2.25 time: 0.212933 Oct 24 10:28:26.656602 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 543/1054] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:26 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1256 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:28:27.104750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d29c8f8c-a7fa-412d-8468-a10f5628c70e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:27.105400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d29c8f8c-a7fa-412d-8468-a10f5628c70e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: d4958f64-a776-423b-8544-b0918c30d25e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:27.132130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d29c8f8c-a7fa-412d-8468-a10f5628c70e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:27.133811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d29c8f8c-a7fa-412d-8468-a10f5628c70e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:27.135827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d29c8f8c-a7fa-412d-8468-a10f5628c70e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:27.140096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d29c8f8c-a7fa-412d-8468-a10f5628c70e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:27.141187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d29c8f8c-a7fa-412d-8468-a10f5628c70e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:27.141637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d29c8f8c-a7fa-412d-8468-a10f5628c70e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:27.233494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f708204e-eb2f-452a-90ec-b15af6b0e9fb tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:27.234195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f708204e-eb2f-452a-90ec-b15af6b0e9fb tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:27.242610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f708204e-eb2f-452a-90ec-b15af6b0e9fb tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:27.243138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f708204e-eb2f-452a-90ec-b15af6b0e9fb tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:27.243955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f708204e-eb2f-452a-90ec-b15af6b0e9fb tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:27.244926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f708204e-eb2f-452a-90ec-b15af6b0e9fb tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:27.245619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f708204e-eb2f-452a-90ec-b15af6b0e9fb tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:27.246117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f708204e-eb2f-452a-90ec-b15af6b0e9fb tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:27.336352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f708204e-eb2f-452a-90ec-b15af6b0e9fb tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:27.345274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d29c8f8c-a7fa-412d-8468-a10f5628c70e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:27.353355 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f708204e-eb2f-452a-90ec-b15af6b0e9fb tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1284 microversion: 2.1 time: 0.123039 Oct 24 10:28:27.354272 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 544/1055] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:27 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:28:27.355217 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d29c8f8c-a7fa-412d-8468-a10f5628c70e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e" status: 200 len: 1468 microversion: 2.1 time: 0.255064 Oct 24 10:28:27.356910 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 512/1056] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:27 2022] GET /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e => generated 1468 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:27.379222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-137b18d0-ea51-45b1-a4f6-cdb3fd083236 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:27.386326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-137b18d0-ea51-45b1-a4f6-cdb3fd083236 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:27.387257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-137b18d0-ea51-45b1-a4f6-cdb3fd083236 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Searching by: {'reservation_id': 'r-5hee0vjg', 'deleted': False, 'project_id': 'b565572c0c8c4871af02471a328bd1af'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:28:27.390937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c7b1c165-1e94-4419-bcee-b8696d4c1068 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:27.391859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c7b1c165-1e94-4419-bcee-b8696d4c1068 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:27.393222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-137b18d0-ea51-45b1-a4f6-cdb3fd083236 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:27.393569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-137b18d0-ea51-45b1-a4f6-cdb3fd083236 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:27.394003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-137b18d0-ea51-45b1-a4f6-cdb3fd083236 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:27.395026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-137b18d0-ea51-45b1-a4f6-cdb3fd083236 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:27.395778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-137b18d0-ea51-45b1-a4f6-cdb3fd083236 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:27.396474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-137b18d0-ea51-45b1-a4f6-cdb3fd083236 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:27.407104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7b1c165-1e94-4419-bcee-b8696d4c1068 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:27.407603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7b1c165-1e94-4419-bcee-b8696d4c1068 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:27.408043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7b1c165-1e94-4419-bcee-b8696d4c1068 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:27.408765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7b1c165-1e94-4419-bcee-b8696d4c1068 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:27.409251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7b1c165-1e94-4419-bcee-b8696d4c1068 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:27.409675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7b1c165-1e94-4419-bcee-b8696d4c1068 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:27.502192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-137b18d0-ea51-45b1-a4f6-cdb3fd083236 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:28:27.619758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-137b18d0-ea51-45b1-a4f6-cdb3fd083236 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:27.629643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-137b18d0-ea51-45b1-a4f6-cdb3fd083236 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:27.630453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-137b18d0-ea51-45b1-a4f6-cdb3fd083236 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:27.635712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-137b18d0-ea51-45b1-a4f6-cdb3fd083236 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:27.768687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c7b1c165-1e94-4419-bcee-b8696d4c1068 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:27.791046 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c7b1c165-1e94-4419-bcee-b8696d4c1068 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1313 microversion: 2.1 time: 0.400967 Oct 24 10:28:27.794221 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 513/1057] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:27 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:28:27.834589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c4a32639-f493-4375-9eb9-753588b587df tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:27.838215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c4a32639-f493-4375-9eb9-753588b587df tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:27.871284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:UPDATE=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:27.875816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4a32639-f493-4375-9eb9-753588b587df tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:27.876752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4a32639-f493-4375-9eb9-753588b587df tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:27.877483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4a32639-f493-4375-9eb9-753588b587df tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:27.880473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4a32639-f493-4375-9eb9-753588b587df tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:27.883765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4a32639-f493-4375-9eb9-753588b587df tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:27.885161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4a32639-f493-4375-9eb9-753588b587df tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:28.102037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c4a32639-f493-4375-9eb9-753588b587df tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:28.117345 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c4a32639-f493-4375-9eb9-753588b587df tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1260 microversion: 2.1 time: 0.321364 Oct 24 10:28:28.118922 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 514/1058] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:27 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1260 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:28.138321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eea60683-444a-4dc4-b776-1896276ae4f3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0de3700>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:28.140743 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-137b18d0-ea51-45b1-a4f6-cdb3fd083236 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?reservation_id=r-5hee0vjg" status: 200 len: 2928 microversion: 2.1 time: 0.765535 Oct 24 10:28:28.142082 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 545/1059] 10.222.0.50 () {58 vars in 1197 bytes} [Mon Oct 24 10:28:27 2022] GET /compute/v2.1/servers/detail?reservation_id=r-5hee0vjg => generated 2928 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:28.146799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7d7c377b-ac7e-493b-b210-d35403024d3b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:28.148559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7d7c377b-ac7e-493b-b210-d35403024d3b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:28.180050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d7c377b-ac7e-493b-b210-d35403024d3b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:28.181542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d7c377b-ac7e-493b-b210-d35403024d3b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:28.182191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d7c377b-ac7e-493b-b210-d35403024d3b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:28.183029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d7c377b-ac7e-493b-b210-d35403024d3b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:28.184012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d7c377b-ac7e-493b-b210-d35403024d3b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:28.184545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d7c377b-ac7e-493b-b210-d35403024d3b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:28.246190 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eea60683-444a-4dc4-b776-1896276ae4f3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.125873 Oct 24 10:28:28.246972 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 515/1060] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:28 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:28.262291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ae5dbe96-2700-4fde-be68-b07d24daf4d4 req-ad930f77-2c20-4e65-875a-5f90e506e968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c828266b-d510-4a99-9b08-476e19b057a7", "name": "network-vif-deleted", "tag": "08217d41-f854-428a-9793-2feb95de04df"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:28.299745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ae5dbe96-2700-4fde-be68-b07d24daf4d4 req-ad930f77-2c20-4e65-875a-5f90e506e968 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:28.302184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ae5dbe96-2700-4fde-be68-b07d24daf4d4 req-ad930f77-2c20-4e65-875a-5f90e506e968 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:28.304819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ae5dbe96-2700-4fde-be68-b07d24daf4d4 req-ad930f77-2c20-4e65-875a-5f90e506e968 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:28.310066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7d7c377b-ac7e-493b-b210-d35403024d3b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:28.319782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7d7c377b-ac7e-493b-b210-d35403024d3b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:28.326618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7d7c377b-ac7e-493b-b210-d35403024d3b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:28.331530 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7d7c377b-ac7e-493b-b210-d35403024d3b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1318 microversion: 2.25 time: 0.188294 Oct 24 10:28:28.332757 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 546/1061] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:28 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:28.344048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ef28d2ab-cef2-4e05-bbca-78488d1e25a6 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:28.344708 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ae5dbe96-2700-4fde-be68-b07d24daf4d4 req-ad930f77-2c20-4e65-875a-5f90e506e968 service nova] Creating event network-vif-deleted:08217d41-f854-428a-9793-2feb95de04df for instance c828266b-d510-4a99-9b08-476e19b057a7 on n-h1-858383-15 Oct 24 10:28:28.367830 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ae5dbe96-2700-4fde-be68-b07d24daf4d4 req-ad930f77-2c20-4e65-875a-5f90e506e968 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119093 Oct 24 10:28:28.373517 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 516/1062] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:28.380402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d3c9588c-782f-4c10-8006-111fbb7b2e95 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:28.386498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d3c9588c-782f-4c10-8006-111fbb7b2e95 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:28.403080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.compute.server_groups [None req-ef28d2ab-cef2-4e05-bbca-78488d1e25a6 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Querying cell 75e76125-592d-4292-bea1-3b51451d7165(cell1) for 2 instances {{(pid=120426) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 24 10:28:28.404167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef28d2ab-cef2-4e05-bbca-78488d1e25a6 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:28.404915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef28d2ab-cef2-4e05-bbca-78488d1e25a6 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:28.405581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef28d2ab-cef2-4e05-bbca-78488d1e25a6 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:28.406050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3c9588c-782f-4c10-8006-111fbb7b2e95 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:28.406550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3c9588c-782f-4c10-8006-111fbb7b2e95 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:28.406992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3c9588c-782f-4c10-8006-111fbb7b2e95 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:28.407888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3c9588c-782f-4c10-8006-111fbb7b2e95 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:28.408354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3c9588c-782f-4c10-8006-111fbb7b2e95 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:28.408783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3c9588c-782f-4c10-8006-111fbb7b2e95 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:28.430210 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ef28d2ab-cef2-4e05-bbca-78488d1e25a6 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/0d6a7907-764b-402a-8228-682fb6b4a6a5" status: 200 len: 270 microversion: 2.1 time: 0.095800 Oct 24 10:28:28.431141 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 547/1063] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:28:28 2022] GET /compute/v2.1/os-server-groups/0d6a7907-764b-402a-8228-682fb6b4a6a5 => generated 270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:28.433481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:28.441583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-10bc1f84-72f9-4d2c-98f5-eaa1f4c65d10 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:28.442277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-10bc1f84-72f9-4d2c-98f5-eaa1f4c65d10 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] [instance: 294c2f53-e675-40b8-a91f-634939781010] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:28.448865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10bc1f84-72f9-4d2c-98f5-eaa1f4c65d10 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:28.449463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10bc1f84-72f9-4d2c-98f5-eaa1f4c65d10 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:28.450160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10bc1f84-72f9-4d2c-98f5-eaa1f4c65d10 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:28.450817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10bc1f84-72f9-4d2c-98f5-eaa1f4c65d10 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:28.451269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10bc1f84-72f9-4d2c-98f5-eaa1f4c65d10 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:28.451690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10bc1f84-72f9-4d2c-98f5-eaa1f4c65d10 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:28.510131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d3c9588c-782f-4c10-8006-111fbb7b2e95 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:28.521207 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d3c9588c-782f-4c10-8006-111fbb7b2e95 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1284 microversion: 2.1 time: 0.145882 Oct 24 10:28:28.521793 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 517/1064] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:28 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:28.615901 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-10bc1f84-72f9-4d2c-98f5-eaa1f4c65d10 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010" status: 200 len: 1620 microversion: 2.1 time: 0.177688 Oct 24 10:28:28.616857 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 548/1065] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:28 2022] GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 => generated 1620 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:28:28.638265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-add0fab0-695c-40cc-9b30-469e2f1e9c9e tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:28.638891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-add0fab0-695c-40cc-9b30-469e2f1e9c9e tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] [instance: d4958f64-a776-423b-8544-b0918c30d25e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:28.645107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-add0fab0-695c-40cc-9b30-469e2f1e9c9e tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:28.645606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-add0fab0-695c-40cc-9b30-469e2f1e9c9e tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:28.646048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-add0fab0-695c-40cc-9b30-469e2f1e9c9e tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:28.646753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-add0fab0-695c-40cc-9b30-469e2f1e9c9e tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:28.647977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-add0fab0-695c-40cc-9b30-469e2f1e9c9e tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:28.648416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-add0fab0-695c-40cc-9b30-469e2f1e9c9e tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:28.816783 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-add0fab0-695c-40cc-9b30-469e2f1e9c9e tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e" status: 200 len: 1621 microversion: 2.1 time: 0.182112 Oct 24 10:28:28.820584 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 518/1066] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:28 2022] GET /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e => generated 1621 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:28.855285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b5d3e95e-e609-450c-8da6-f4ee6b33d31a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:28.855913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b5d3e95e-e609-450c-8da6-f4ee6b33d31a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:28.874153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5d3e95e-e609-450c-8da6-f4ee6b33d31a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:28.874710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5d3e95e-e609-450c-8da6-f4ee6b33d31a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:28.875115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5d3e95e-e609-450c-8da6-f4ee6b33d31a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:28.875839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5d3e95e-e609-450c-8da6-f4ee6b33d31a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:28.877788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5d3e95e-e609-450c-8da6-f4ee6b33d31a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:28.880099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5d3e95e-e609-450c-8da6-f4ee6b33d31a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:28.975712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cf79cd0e-105d-40c6-ab33-38ed96b76f12 tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Action: 'update', calling method: .version_select at 0x7f04d0a929d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:29.091072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf79cd0e-105d-40c6-ab33-38ed96b76f12 tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:29.091554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf79cd0e-105d-40c6-ab33-38ed96b76f12 tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:29.091982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf79cd0e-105d-40c6-ab33-38ed96b76f12 tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:29.092737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf79cd0e-105d-40c6-ab33-38ed96b76f12 tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:29.093169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf79cd0e-105d-40c6-ab33-38ed96b76f12 tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:29.105680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf79cd0e-105d-40c6-ab33-38ed96b76f12 tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:29.145565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b5d3e95e-e609-450c-8da6-f4ee6b33d31a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:29.155221 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b5d3e95e-e609-450c-8da6-f4ee6b33d31a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1313 microversion: 2.1 time: 0.320069 Oct 24 10:28:29.160141 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 519/1067] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:28 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:29.166399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a6192345-91e1-45d8-a6be-3f4ba2ecb975 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2134044670", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "2a8bcf29-893c-4ca8-82cb-636c2bb6f404"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:29.267942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9,nova_api:UPDATE=7 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:29.282573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-a6192345-91e1-45d8-a6be-3f4ba2ecb975 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] validate_networks() for None {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:28:29.283705 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cf79cd0e-105d-40c6-ab33-38ed96b76f12 tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/5e8a47b51f314887a9d725c3a6f7a558" status: 200 len: 240 microversion: 2.36 time: 0.589706 Oct 24 10:28:29.285885 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 549/1068] 10.222.0.50 () {62 vars in 1303 bytes} [Mon Oct 24 10:28:28 2022] PUT /compute/v2.1/os-quota-sets/5e8a47b51f314887a9d725c3a6f7a558 => generated 240 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 10:28:29.294422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f29ee15f-5262-4319-8a77-64102f38d220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:29.297774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f29ee15f-5262-4319-8a77-64102f38d220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:29.309366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f29ee15f-5262-4319-8a77-64102f38d220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:29.309750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f29ee15f-5262-4319-8a77-64102f38d220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:29.310371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f29ee15f-5262-4319-8a77-64102f38d220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:29.311960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f29ee15f-5262-4319-8a77-64102f38d220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:29.313112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f29ee15f-5262-4319-8a77-64102f38d220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:29.314765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f29ee15f-5262-4319-8a77-64102f38d220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:29.498011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f29ee15f-5262-4319-8a77-64102f38d220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:29.511864 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f29ee15f-5262-4319-8a77-64102f38d220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1278 microversion: 2.1 time: 0.224163 Oct 24 10:28:29.521903 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 550/1069] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:29 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1278 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:29.532149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b3fcb617-9c29-4a0b-941d-3874d542a619 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0aaab80>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:29.582280 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b3fcb617-9c29-4a0b-941d-3874d542a619 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.065110 Oct 24 10:28:29.583040 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 551/1070] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:29 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:29.588372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8ec1b3df-9785-4d19-bc40-a63cba268424 tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Calling method '.version_select at 0x7f04d0b7ae50>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:29.661143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a6192345-91e1-45d8-a6be-3f4ba2ecb975 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:28:29.661639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a6192345-91e1-45d8-a6be-3f4ba2ecb975 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:28:29.663809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a6192345-91e1-45d8-a6be-3f4ba2ecb975 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:28:29.664341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a6192345-91e1-45d8-a6be-3f4ba2ecb975 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:28:29.664760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a6192345-91e1-45d8-a6be-3f4ba2ecb975 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:28:29.674215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ec1b3df-9785-4d19-bc40-a63cba268424 tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:29.674935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ec1b3df-9785-4d19-bc40-a63cba268424 tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:29.675361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6192345-91e1-45d8-a6be-3f4ba2ecb975 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:29.675560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ec1b3df-9785-4d19-bc40-a63cba268424 tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:29.675852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6192345-91e1-45d8-a6be-3f4ba2ecb975 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:29.676294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6192345-91e1-45d8-a6be-3f4ba2ecb975 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:29.676805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ec1b3df-9785-4d19-bc40-a63cba268424 tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:29.677054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6192345-91e1-45d8-a6be-3f4ba2ecb975 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:29.677654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6192345-91e1-45d8-a6be-3f4ba2ecb975 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:29.677923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ec1b3df-9785-4d19-bc40-a63cba268424 tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:29.678081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6192345-91e1-45d8-a6be-3f4ba2ecb975 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:29.679631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ec1b3df-9785-4d19-bc40-a63cba268424 tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:29.701421 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8ec1b3df-9785-4d19-bc40-a63cba268424 tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/5e8a47b51f314887a9d725c3a6f7a558/detail" status: 200 len: 672 microversion: 2.36 time: 0.117303 Oct 24 10:28:29.702238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-a6192345-91e1-45d8-a6be-3f4ba2ecb975 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for project b565572c0c8c4871af02471a328bd1af. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:28:29.708820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-a6192345-91e1-45d8-a6be-3f4ba2ecb975 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for user 9aa572f1e5014e10bed0abe34dfad43f and project b565572c0c8c4871af02471a328bd1af. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:28:29.713402 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 552/1071] 10.222.0.50 () {60 vars in 1304 bytes} [Mon Oct 24 10:28:29 2022] GET /compute/v2.1/os-quota-sets/5e8a47b51f314887a9d725c3a6f7a558/detail => generated 672 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:28:29.723168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0fad48db-adb7-41b8-b8b9-6ab4a5f8ca84 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:29.724326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0fad48db-adb7-41b8-b8b9-6ab4a5f8ca84 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:29.728070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a6192345-91e1-45d8-a6be-3f4ba2ecb975 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:28:29.732007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a6192345-91e1-45d8-a6be-3f4ba2ecb975 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:28:29.734832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fad48db-adb7-41b8-b8b9-6ab4a5f8ca84 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:29.735621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fad48db-adb7-41b8-b8b9-6ab4a5f8ca84 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:29.736199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fad48db-adb7-41b8-b8b9-6ab4a5f8ca84 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:29.737151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fad48db-adb7-41b8-b8b9-6ab4a5f8ca84 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:29.737760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fad48db-adb7-41b8-b8b9-6ab4a5f8ca84 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:29.738409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fad48db-adb7-41b8-b8b9-6ab4a5f8ca84 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:29.768657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:29.819347 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a6192345-91e1-45d8-a6be-3f4ba2ecb975 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657557 Oct 24 10:28:29.830319 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 520/1072] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:28:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:28:29.836234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-df4df7c5-0f66-4f79-aa61-3bb6c78e2df8 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:29.837692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-df4df7c5-0f66-4f79-aa61-3bb6c78e2df8 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:29.861299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df4df7c5-0f66-4f79-aa61-3bb6c78e2df8 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:29.862111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df4df7c5-0f66-4f79-aa61-3bb6c78e2df8 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:29.862762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df4df7c5-0f66-4f79-aa61-3bb6c78e2df8 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:29.864087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df4df7c5-0f66-4f79-aa61-3bb6c78e2df8 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:29.864742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df4df7c5-0f66-4f79-aa61-3bb6c78e2df8 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:29.865401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df4df7c5-0f66-4f79-aa61-3bb6c78e2df8 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:30.009023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-df4df7c5-0f66-4f79-aa61-3bb6c78e2df8 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:30.018132 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-df4df7c5-0f66-4f79-aa61-3bb6c78e2df8 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1284 microversion: 2.1 time: 0.186314 Oct 24 10:28:30.024507 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 521/1073] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:29 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:30.029588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7a8d715f-64d3-4ed5-bd3e-5f6ab83ae349 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:30.033731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7a8d715f-64d3-4ed5-bd3e-5f6ab83ae349 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:30.046445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0fad48db-adb7-41b8-b8b9-6ab4a5f8ca84 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:30.056478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0fad48db-adb7-41b8-b8b9-6ab4a5f8ca84 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:30.057995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0fad48db-adb7-41b8-b8b9-6ab4a5f8ca84 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:30.059122 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0fad48db-adb7-41b8-b8b9-6ab4a5f8ca84 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1360 microversion: 2.25 time: 0.344138 Oct 24 10:28:30.063501 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 553/1074] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:29 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1360 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:30.086160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bbb540f7-f321-4b1c-b6e3-f2e87bf7355d tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Action: 'update', calling method: .version_select at 0x7f04d0a8f790>, body: {"quota_set": {"ram": "2048"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:30.148552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7a8d715f-64d3-4ed5-bd3e-5f6ab83ae349 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:30.156091 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7a8d715f-64d3-4ed5-bd3e-5f6ab83ae349 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1217 microversion: 2.1 time: 0.130202 Oct 24 10:28:30.161738 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 522/1075] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:30 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:30.180703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-29b5f77e-1ba0-48a4-91b8-7660352c9a30 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:30.181371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-29b5f77e-1ba0-48a4-91b8-7660352c9a30 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:30.187396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbb540f7-f321-4b1c-b6e3-f2e87bf7355d tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:30.187880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29b5f77e-1ba0-48a4-91b8-7660352c9a30 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:30.188126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbb540f7-f321-4b1c-b6e3-f2e87bf7355d tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:30.188669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbb540f7-f321-4b1c-b6e3-f2e87bf7355d tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:30.188893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29b5f77e-1ba0-48a4-91b8-7660352c9a30 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:30.189501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29b5f77e-1ba0-48a4-91b8-7660352c9a30 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:30.189686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbb540f7-f321-4b1c-b6e3-f2e87bf7355d tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:30.190309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbb540f7-f321-4b1c-b6e3-f2e87bf7355d tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:30.190693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29b5f77e-1ba0-48a4-91b8-7660352c9a30 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:30.190815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbb540f7-f321-4b1c-b6e3-f2e87bf7355d tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:30.191420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29b5f77e-1ba0-48a4-91b8-7660352c9a30 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:30.192003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29b5f77e-1ba0-48a4-91b8-7660352c9a30 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:30.243393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbb540f7-f321-4b1c-b6e3-f2e87bf7355d tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:30.244065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbb540f7-f321-4b1c-b6e3-f2e87bf7355d tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:30.244710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbb540f7-f321-4b1c-b6e3-f2e87bf7355d tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:30.245997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbb540f7-f321-4b1c-b6e3-f2e87bf7355d tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:30.246511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbb540f7-f321-4b1c-b6e3-f2e87bf7355d tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:30.246953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbb540f7-f321-4b1c-b6e3-f2e87bf7355d tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:30.323866 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bbb540f7-f321-4b1c-b6e3-f2e87bf7355d tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/5e8a47b51f314887a9d725c3a6f7a558?user_id=a8375844bb184cde887cbb42362a1dd1" status: 200 len: 240 microversion: 2.36 time: 0.262871 Oct 24 10:28:30.325957 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 554/1076] 10.222.0.50 () {62 vars in 1384 bytes} [Mon Oct 24 10:28:30 2022] PUT /compute/v2.1/os-quota-sets/5e8a47b51f314887a9d725c3a6f7a558?user_id=a8375844bb184cde887cbb42362a1dd1 => generated 240 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:28:30.337360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-77b5424d-5442-4a41-a711-dd8dc33876d6 tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] Calling method '.version_select at 0x7f04d0b7aee0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:30.401912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-29b5f77e-1ba0-48a4-91b8-7660352c9a30 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:30.411925 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-29b5f77e-1ba0-48a4-91b8-7660352c9a30 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1313 microversion: 2.1 time: 0.235730 Oct 24 10:28:30.418746 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 523/1077] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:30 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:30.447228 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-77b5424d-5442-4a41-a711-dd8dc33876d6 tempest-QuotasAdminTestV236-1607234682 tempest-QuotasAdminTestV236-1607234682-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/5e8a47b51f314887a9d725c3a6f7a558?user_id=a8375844bb184cde887cbb42362a1dd1" status: 200 len: 282 microversion: 2.36 time: 0.114341 Oct 24 10:28:30.447817 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 555/1078] 10.222.0.50 () {60 vars in 1364 bytes} [Mon Oct 24 10:28:30 2022] GET /compute/v2.1/os-quota-sets/5e8a47b51f314887a9d725c3a6f7a558?user_id=a8375844bb184cde887cbb42362a1dd1 => generated 282 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:28:30.539071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-082d2ac5-94fe-4358-b5d5-71376955e254 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:30.540324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-082d2ac5-94fe-4358-b5d5-71376955e254 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:30.547884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-082d2ac5-94fe-4358-b5d5-71376955e254 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:30.548497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-082d2ac5-94fe-4358-b5d5-71376955e254 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:30.549135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-082d2ac5-94fe-4358-b5d5-71376955e254 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:30.550302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-082d2ac5-94fe-4358-b5d5-71376955e254 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:30.550411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-082d2ac5-94fe-4358-b5d5-71376955e254 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:30.550821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-082d2ac5-94fe-4358-b5d5-71376955e254 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:30.598214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ef2afe11-b7ec-4250-847e-63aa3e1c5a74 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0be50d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:30.637902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-082d2ac5-94fe-4358-b5d5-71376955e254 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:30.646064 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-082d2ac5-94fe-4358-b5d5-71376955e254 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1266 microversion: 2.1 time: 0.111257 Oct 24 10:28:30.647025 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 524/1079] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:30 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:30.669836 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ef2afe11-b7ec-4250-847e-63aa3e1c5a74 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.075099 Oct 24 10:28:30.670431 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 556/1080] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:30 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:28:30.870057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-64f97e85-1566-4a7f-a5fc-ca3e0e1b0961 req-4dd770de-d4c2-4fe9-ac0b-60b27f044524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f749f9-5771-4ecb-8a06-30a8f69dd848", "name": "network-vif-plugged", "status": "completed", "tag": "f48a3bd1-58ab-47af-934b-bea589ab9a0b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:30.877485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-e28264a2-57e7-4e88-a9f8-b2151fbf1f41 req-2446d2b1-d47d-4439-93ef-353e9dffa73c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d7180f-82cf-4113-824a-6350d013baf1", "tag": "af23d072-0dd6-45cf-9412-eb509fb3c310"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:30.897708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e28264a2-57e7-4e88-a9f8-b2151fbf1f41 req-2446d2b1-d47d-4439-93ef-353e9dffa73c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:30.901312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e28264a2-57e7-4e88-a9f8-b2151fbf1f41 req-2446d2b1-d47d-4439-93ef-353e9dffa73c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:30.903455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e28264a2-57e7-4e88-a9f8-b2151fbf1f41 req-2446d2b1-d47d-4439-93ef-353e9dffa73c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:30.906791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-64f97e85-1566-4a7f-a5fc-ca3e0e1b0961 req-4dd770de-d4c2-4fe9-ac0b-60b27f044524 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:30.908345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-64f97e85-1566-4a7f-a5fc-ca3e0e1b0961 req-4dd770de-d4c2-4fe9-ac0b-60b27f044524 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:30.909423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-64f97e85-1566-4a7f-a5fc-ca3e0e1b0961 req-4dd770de-d4c2-4fe9-ac0b-60b27f044524 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:30.922822 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-64f97e85-1566-4a7f-a5fc-ca3e0e1b0961 req-4dd770de-d4c2-4fe9-ac0b-60b27f044524 service nova] Creating event network-vif-plugged:f48a3bd1-58ab-47af-934b-bea589ab9a0b for instance a8f749f9-5771-4ecb-8a06-30a8f69dd848 on n-h2-858383-15 Oct 24 10:28:30.929156 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-e28264a2-57e7-4e88-a9f8-b2151fbf1f41 req-2446d2b1-d47d-4439-93ef-353e9dffa73c service nova] Creating event network-changed:af23d072-0dd6-45cf-9412-eb509fb3c310 for instance b9d7180f-82cf-4113-824a-6350d013baf1 on n-h1-858383-15 Oct 24 10:28:30.934985 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-64f97e85-1566-4a7f-a5fc-ca3e0e1b0961 req-4dd770de-d4c2-4fe9-ac0b-60b27f044524 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070014 Oct 24 10:28:30.935998 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 525/1081] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:30.938675 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-e28264a2-57e7-4e88-a9f8-b2151fbf1f41 req-2446d2b1-d47d-4439-93ef-353e9dffa73c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065654 Oct 24 10:28:30.942029 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 557/1082] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:28:31.052291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-704faf63-232f-4978-b26b-4aacca4864cd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:31.053035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-704faf63-232f-4978-b26b-4aacca4864cd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:31.062817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-704faf63-232f-4978-b26b-4aacca4864cd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:31.063341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-704faf63-232f-4978-b26b-4aacca4864cd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:31.063838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-704faf63-232f-4978-b26b-4aacca4864cd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:31.065050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-704faf63-232f-4978-b26b-4aacca4864cd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:31.065673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-704faf63-232f-4978-b26b-4aacca4864cd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:31.067023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-704faf63-232f-4978-b26b-4aacca4864cd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:31.087565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5edf4669-79ce-45c5-8d64-a98c20f9cc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:31.088433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5edf4669-79ce-45c5-8d64-a98c20f9cc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:31.095136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5edf4669-79ce-45c5-8d64-a98c20f9cc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:31.095695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5edf4669-79ce-45c5-8d64-a98c20f9cc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:31.096196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5edf4669-79ce-45c5-8d64-a98c20f9cc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:31.097109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5edf4669-79ce-45c5-8d64-a98c20f9cc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:31.097640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5edf4669-79ce-45c5-8d64-a98c20f9cc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:31.098137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5edf4669-79ce-45c5-8d64-a98c20f9cc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:31.160050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-704faf63-232f-4978-b26b-4aacca4864cd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:31.170200 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-704faf63-232f-4978-b26b-4aacca4864cd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1284 microversion: 2.1 time: 0.123845 Oct 24 10:28:31.171218 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 526/1083] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:31 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:31.193410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c62fdfea-979a-45db-be57-a8c5aa3dce40 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:31.197089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c62fdfea-979a-45db-be57-a8c5aa3dce40 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:31.206603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c62fdfea-979a-45db-be57-a8c5aa3dce40 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:31.207264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c62fdfea-979a-45db-be57-a8c5aa3dce40 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:31.207881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c62fdfea-979a-45db-be57-a8c5aa3dce40 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:31.208804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c62fdfea-979a-45db-be57-a8c5aa3dce40 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:31.210178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c62fdfea-979a-45db-be57-a8c5aa3dce40 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:31.210925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c62fdfea-979a-45db-be57-a8c5aa3dce40 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:31.297050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c62fdfea-979a-45db-be57-a8c5aa3dce40 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:31.305220 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c62fdfea-979a-45db-be57-a8c5aa3dce40 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1221 microversion: 2.1 time: 0.123226 Oct 24 10:28:31.305812 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 527/1084] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:31 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1221 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:31.359715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5edf4669-79ce-45c5-8d64-a98c20f9cc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:31.369345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5edf4669-79ce-45c5-8d64-a98c20f9cc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:31.371168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5edf4669-79ce-45c5-8d64-a98c20f9cc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:31.372611 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5edf4669-79ce-45c5-8d64-a98c20f9cc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1360 microversion: 2.25 time: 0.291443 Oct 24 10:28:31.373349 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 558/1085] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:31 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1360 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:31.442868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0c103c7f-8706-4efb-8740-a1feb2d0ca1c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:31.443489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0c103c7f-8706-4efb-8740-a1feb2d0ca1c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:31.451457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c103c7f-8706-4efb-8740-a1feb2d0ca1c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:31.452194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c103c7f-8706-4efb-8740-a1feb2d0ca1c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:31.453136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c103c7f-8706-4efb-8740-a1feb2d0ca1c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:31.453916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c103c7f-8706-4efb-8740-a1feb2d0ca1c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:31.454442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c103c7f-8706-4efb-8740-a1feb2d0ca1c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:31.454921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c103c7f-8706-4efb-8740-a1feb2d0ca1c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:31.670141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0179461e-b1e7-4893-9758-f37704ad2fad tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:31.671174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0179461e-b1e7-4893-9758-f37704ad2fad tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:31.682974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0179461e-b1e7-4893-9758-f37704ad2fad tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:31.684144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0179461e-b1e7-4893-9758-f37704ad2fad tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:31.684734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0179461e-b1e7-4893-9758-f37704ad2fad tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:31.685810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0179461e-b1e7-4893-9758-f37704ad2fad tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:31.686569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0179461e-b1e7-4893-9758-f37704ad2fad tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:31.686899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0c103c7f-8706-4efb-8740-a1feb2d0ca1c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:31.688326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0179461e-b1e7-4893-9758-f37704ad2fad tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:31.702746 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0c103c7f-8706-4efb-8740-a1feb2d0ca1c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1313 microversion: 2.1 time: 0.271483 Oct 24 10:28:31.717818 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 528/1086] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:31 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:31.725228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ee4c4d8-dbd1-4341-b6bd-068d914d8163 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d133c5e0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:31.778706 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ee4c4d8-dbd1-4341-b6bd-068d914d8163 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.059400 Oct 24 10:28:31.779317 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 529/1087] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:31 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:31.896405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0179461e-b1e7-4893-9758-f37704ad2fad tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:31.906230 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0179461e-b1e7-4893-9758-f37704ad2fad tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1308 microversion: 2.1 time: 0.240401 Oct 24 10:28:31.926728 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 559/1088] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:31 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1308 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:28:32.195645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5f1e571e-e94a-4bd0-99d5-69f2a6aa8cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:32.196414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5f1e571e-e94a-4bd0-99d5-69f2a6aa8cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:32.203035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f1e571e-e94a-4bd0-99d5-69f2a6aa8cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:32.203606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f1e571e-e94a-4bd0-99d5-69f2a6aa8cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:32.204116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f1e571e-e94a-4bd0-99d5-69f2a6aa8cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:32.207635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f1e571e-e94a-4bd0-99d5-69f2a6aa8cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:32.207635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f1e571e-e94a-4bd0-99d5-69f2a6aa8cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:32.207635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f1e571e-e94a-4bd0-99d5-69f2a6aa8cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:32.276740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5f1e571e-e94a-4bd0-99d5-69f2a6aa8cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:32.284592 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5f1e571e-e94a-4bd0-99d5-69f2a6aa8cb3 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1284 microversion: 2.1 time: 0.095036 Oct 24 10:28:32.285423 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 530/1089] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:32 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:32.329443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9b768f7a-9b3f-4243-937a-c1615211c358 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:32.330106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9b768f7a-9b3f-4243-937a-c1615211c358 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:32.336545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b768f7a-9b3f-4243-937a-c1615211c358 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:32.337060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b768f7a-9b3f-4243-937a-c1615211c358 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:32.337490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b768f7a-9b3f-4243-937a-c1615211c358 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:32.338361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b768f7a-9b3f-4243-937a-c1615211c358 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:32.338814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b768f7a-9b3f-4243-937a-c1615211c358 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:32.339234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b768f7a-9b3f-4243-937a-c1615211c358 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:32.399528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ca8c2220-917e-4c61-be5d-5e6246e2eadc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:32.400378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ca8c2220-917e-4c61-be5d-5e6246e2eadc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:32.407323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca8c2220-917e-4c61-be5d-5e6246e2eadc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:32.408116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca8c2220-917e-4c61-be5d-5e6246e2eadc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:32.408921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca8c2220-917e-4c61-be5d-5e6246e2eadc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:32.409985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca8c2220-917e-4c61-be5d-5e6246e2eadc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:32.410607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca8c2220-917e-4c61-be5d-5e6246e2eadc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:32.411198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca8c2220-917e-4c61-be5d-5e6246e2eadc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:32.411820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9b768f7a-9b3f-4243-937a-c1615211c358 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:32.420650 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9b768f7a-9b3f-4243-937a-c1615211c358 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1221 microversion: 2.1 time: 0.095088 Oct 24 10:28:32.421275 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 560/1090] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:32 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:32.554743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ca8c2220-917e-4c61-be5d-5e6246e2eadc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:32.563495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ca8c2220-917e-4c61-be5d-5e6246e2eadc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:32.565199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ca8c2220-917e-4c61-be5d-5e6246e2eadc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:32.566317 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ca8c2220-917e-4c61-be5d-5e6246e2eadc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1360 microversion: 2.25 time: 0.171736 Oct 24 10:28:32.566932 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 531/1091] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:32 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:28:32.730365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-39841098-f0c2-4519-bc2a-387ccd986db9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:32.731175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-39841098-f0c2-4519-bc2a-387ccd986db9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:32.737570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-39841098-f0c2-4519-bc2a-387ccd986db9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:32.738057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-39841098-f0c2-4519-bc2a-387ccd986db9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:32.738498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-39841098-f0c2-4519-bc2a-387ccd986db9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:32.739194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-39841098-f0c2-4519-bc2a-387ccd986db9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:32.739652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-39841098-f0c2-4519-bc2a-387ccd986db9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:32.740082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-39841098-f0c2-4519-bc2a-387ccd986db9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:32.798009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9841f1f8-480b-4b4f-9712-05e159694129 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0eea940>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:32.856084 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9841f1f8-480b-4b4f-9712-05e159694129 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.064430 Oct 24 10:28:32.857058 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 532/1092] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:32 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:32.922917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-39841098-f0c2-4519-bc2a-387ccd986db9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:32.933242 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-39841098-f0c2-4519-bc2a-387ccd986db9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1313 microversion: 2.1 time: 0.206352 Oct 24 10:28:32.933838 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 561/1093] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:32 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:32.955406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9b35ab9c-6e8e-456f-89c9-cc3ca277f21e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:32.956278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9b35ab9c-6e8e-456f-89c9-cc3ca277f21e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:32.964769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b35ab9c-6e8e-456f-89c9-cc3ca277f21e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:32.965616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b35ab9c-6e8e-456f-89c9-cc3ca277f21e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:32.966228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b35ab9c-6e8e-456f-89c9-cc3ca277f21e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:32.967271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b35ab9c-6e8e-456f-89c9-cc3ca277f21e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:32.968345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b35ab9c-6e8e-456f-89c9-cc3ca277f21e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:32.969112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b35ab9c-6e8e-456f-89c9-cc3ca277f21e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:32.990586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-623a6821-06d3-48af-8461-12868a72a097 req-4b5a2f64-c3aa-4e34-bc03-ab0b93969496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a43af20e-f775-4549-9ee3-1560a5b43b7d", "tag": "540ebdb6-65eb-4451-aafd-a3f1d1fd0a82"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:33.011858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-623a6821-06d3-48af-8461-12868a72a097 req-4b5a2f64-c3aa-4e34-bc03-ab0b93969496 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:33.012987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-623a6821-06d3-48af-8461-12868a72a097 req-4b5a2f64-c3aa-4e34-bc03-ab0b93969496 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:33.013582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-623a6821-06d3-48af-8461-12868a72a097 req-4b5a2f64-c3aa-4e34-bc03-ab0b93969496 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:33.040156 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-623a6821-06d3-48af-8461-12868a72a097 req-4b5a2f64-c3aa-4e34-bc03-ab0b93969496 service nova] Creating event network-changed:540ebdb6-65eb-4451-aafd-a3f1d1fd0a82 for instance a43af20e-f775-4549-9ee3-1560a5b43b7d on n-h1-858383-15 Oct 24 10:28:33.045362 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-623a6821-06d3-48af-8461-12868a72a097 req-4b5a2f64-c3aa-4e34-bc03-ab0b93969496 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058838 Oct 24 10:28:33.046479 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 562/1094] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:28:33.191918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9b35ab9c-6e8e-456f-89c9-cc3ca277f21e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:33.201750 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9b35ab9c-6e8e-456f-89c9-cc3ca277f21e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1308 microversion: 2.1 time: 0.255449 Oct 24 10:28:33.203130 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 533/1095] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:32 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:33.308776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dba0ec5e-3cef-4f36-ad46-77bdba73f761 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:33.309545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dba0ec5e-3cef-4f36-ad46-77bdba73f761 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:33.315981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dba0ec5e-3cef-4f36-ad46-77bdba73f761 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:33.316466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dba0ec5e-3cef-4f36-ad46-77bdba73f761 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:33.316926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dba0ec5e-3cef-4f36-ad46-77bdba73f761 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:33.317630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dba0ec5e-3cef-4f36-ad46-77bdba73f761 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:33.318084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dba0ec5e-3cef-4f36-ad46-77bdba73f761 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:33.318697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dba0ec5e-3cef-4f36-ad46-77bdba73f761 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:33.389566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dba0ec5e-3cef-4f36-ad46-77bdba73f761 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:33.399041 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dba0ec5e-3cef-4f36-ad46-77bdba73f761 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1284 microversion: 2.1 time: 0.095095 Oct 24 10:28:33.399731 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 563/1096] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:33 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:33.443357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf17af98-9a30-4451-baf4-474e91b0c0e7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:33.445190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf17af98-9a30-4451-baf4-474e91b0c0e7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:33.451715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf17af98-9a30-4451-baf4-474e91b0c0e7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:33.452195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf17af98-9a30-4451-baf4-474e91b0c0e7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:33.452657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf17af98-9a30-4451-baf4-474e91b0c0e7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:33.453392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf17af98-9a30-4451-baf4-474e91b0c0e7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:33.453954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf17af98-9a30-4451-baf4-474e91b0c0e7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:33.454389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf17af98-9a30-4451-baf4-474e91b0c0e7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:33.521819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cf17af98-9a30-4451-baf4-474e91b0c0e7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:33.530834 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf17af98-9a30-4451-baf4-474e91b0c0e7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1213 microversion: 2.1 time: 0.091394 Oct 24 10:28:33.531501 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 534/1097] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:33 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:33.592696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6e9083e9-13b9-4348-9015-89360e397dcf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:33.593355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6e9083e9-13b9-4348-9015-89360e397dcf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:33.613453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e9083e9-13b9-4348-9015-89360e397dcf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:33.613942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e9083e9-13b9-4348-9015-89360e397dcf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:33.614406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e9083e9-13b9-4348-9015-89360e397dcf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:33.615300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e9083e9-13b9-4348-9015-89360e397dcf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:33.616635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e9083e9-13b9-4348-9015-89360e397dcf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:33.617110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e9083e9-13b9-4348-9015-89360e397dcf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:33.809441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e9083e9-13b9-4348-9015-89360e397dcf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:33.822589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e9083e9-13b9-4348-9015-89360e397dcf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:33.825526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e9083e9-13b9-4348-9015-89360e397dcf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:33.827205 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6e9083e9-13b9-4348-9015-89360e397dcf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1360 microversion: 2.25 time: 0.238585 Oct 24 10:28:33.828585 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 564/1098] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:33 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1360 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:33.871863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-834e9ed9-4766-402e-b94e-441e9394ccdb tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0de3ee0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:33.939974 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-834e9ed9-4766-402e-b94e-441e9394ccdb tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.071936 Oct 24 10:28:33.950013 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 535/1099] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:33 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:33.964126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a6ac2a25-5e26-4e15-a950-8ef8c65da9c9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:33.965250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a6ac2a25-5e26-4e15-a950-8ef8c65da9c9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:33.978133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6ac2a25-5e26-4e15-a950-8ef8c65da9c9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:33.981279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6ac2a25-5e26-4e15-a950-8ef8c65da9c9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:33.982576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6ac2a25-5e26-4e15-a950-8ef8c65da9c9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:33.984730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6ac2a25-5e26-4e15-a950-8ef8c65da9c9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:33.985435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6ac2a25-5e26-4e15-a950-8ef8c65da9c9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:33.986038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6ac2a25-5e26-4e15-a950-8ef8c65da9c9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:34.160226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a6ac2a25-5e26-4e15-a950-8ef8c65da9c9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:34.170550 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a6ac2a25-5e26-4e15-a950-8ef8c65da9c9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1313 microversion: 2.1 time: 0.213152 Oct 24 10:28:34.171806 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 565/1100] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:33 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:34.227010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2587cb1b-d166-4ab1-a271-535d144a1ffc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:34.228381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2587cb1b-d166-4ab1-a271-535d144a1ffc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:34.260538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2587cb1b-d166-4ab1-a271-535d144a1ffc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:34.261075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2587cb1b-d166-4ab1-a271-535d144a1ffc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:34.261515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2587cb1b-d166-4ab1-a271-535d144a1ffc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:34.262248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2587cb1b-d166-4ab1-a271-535d144a1ffc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:34.262763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2587cb1b-d166-4ab1-a271-535d144a1ffc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:34.263280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2587cb1b-d166-4ab1-a271-535d144a1ffc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:34.450842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2587cb1b-d166-4ab1-a271-535d144a1ffc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:34.459326 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2587cb1b-d166-4ab1-a271-535d144a1ffc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1308 microversion: 2.1 time: 0.238024 Oct 24 10:28:34.460132 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 536/1101] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:34 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1308 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:28:34.473288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b681f4a-abd3-4784-84f1-fe4336201208 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:34.474249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8b681f4a-abd3-4784-84f1-fe4336201208 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:34.481902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b681f4a-abd3-4784-84f1-fe4336201208 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:34.482395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b681f4a-abd3-4784-84f1-fe4336201208 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:34.482969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f279fec5-3d7c-48b3-a43e-58e8dd0b25bb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1660679992", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": "none"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:34.483131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b681f4a-abd3-4784-84f1-fe4336201208 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:34.483712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b681f4a-abd3-4784-84f1-fe4336201208 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:34.484171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b681f4a-abd3-4784-84f1-fe4336201208 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:34.484607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b681f4a-abd3-4784-84f1-fe4336201208 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:34.555965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-f279fec5-3d7c-48b3-a43e-58e8dd0b25bb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:28:34.556390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-f279fec5-3d7c-48b3-a43e-58e8dd0b25bb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:28:34.556895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-f279fec5-3d7c-48b3-a43e-58e8dd0b25bb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:28:34.557303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-f279fec5-3d7c-48b3-a43e-58e8dd0b25bb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:28:34.557840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-f279fec5-3d7c-48b3-a43e-58e8dd0b25bb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:28:34.570755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f279fec5-3d7c-48b3-a43e-58e8dd0b25bb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:34.570755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f279fec5-3d7c-48b3-a43e-58e8dd0b25bb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:34.570755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f279fec5-3d7c-48b3-a43e-58e8dd0b25bb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:34.570755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f279fec5-3d7c-48b3-a43e-58e8dd0b25bb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:34.571278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f279fec5-3d7c-48b3-a43e-58e8dd0b25bb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:34.571278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f279fec5-3d7c-48b3-a43e-58e8dd0b25bb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:34.572003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8b681f4a-abd3-4784-84f1-fe4336201208 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:34.581458 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b681f4a-abd3-4784-84f1-fe4336201208 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1290 microversion: 2.1 time: 0.113646 Oct 24 10:28:34.591227 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 537/1102] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:34 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1290 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:34.592741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-f279fec5-3d7c-48b3-a43e-58e8dd0b25bb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Getting quotas for project 58eb5f0cf9bc41c48c0815d5c7905989. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:28:34.598972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-f279fec5-3d7c-48b3-a43e-58e8dd0b25bb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Getting quotas for user 08328a8deb7a4107b30f61c10e92477b and project 58eb5f0cf9bc41c48c0815d5c7905989. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:28:34.606916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3edde5ff-259d-407c-8157-3ed90cd9b815 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:34.607622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3edde5ff-259d-407c-8157-3ed90cd9b815 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:34.613104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f279fec5-3d7c-48b3-a43e-58e8dd0b25bb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:28:34.613600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3edde5ff-259d-407c-8157-3ed90cd9b815 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:34.614071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3edde5ff-259d-407c-8157-3ed90cd9b815 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:34.614506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3edde5ff-259d-407c-8157-3ed90cd9b815 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:34.615592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3edde5ff-259d-407c-8157-3ed90cd9b815 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:34.616553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f279fec5-3d7c-48b3-a43e-58e8dd0b25bb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:28:34.617154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3edde5ff-259d-407c-8157-3ed90cd9b815 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:34.617765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3edde5ff-259d-407c-8157-3ed90cd9b815 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:34.665851 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f279fec5-3d7c-48b3-a43e-58e8dd0b25bb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.332840 Oct 24 10:28:34.666504 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 566/1103] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Oct 24 10:28:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 334 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 10:28:34.677986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6a8c5cd3-9942-44ff-87d6-a6f69d967baa tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:34.681912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6a8c5cd3-9942-44ff-87d6-a6f69d967baa tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:34.714794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3edde5ff-259d-407c-8157-3ed90cd9b815 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:34.726193 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3edde5ff-259d-407c-8157-3ed90cd9b815 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1269 microversion: 2.1 time: 0.133246 Oct 24 10:28:34.727040 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 538/1104] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:34 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1269 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:34.789606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6a8c5cd3-9942-44ff-87d6-a6f69d967baa tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:34.800000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6a8c5cd3-9942-44ff-87d6-a6f69d967baa tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:34.801915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6a8c5cd3-9942-44ff-87d6-a6f69d967baa tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:34.810894 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6a8c5cd3-9942-44ff-87d6-a6f69d967baa tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "PUT /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1359 microversion: 2.75 time: 0.136724 Oct 24 10:28:34.824239 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 567/1105] 10.222.0.50 () {62 vars in 1297 bytes} [Mon Oct 24 10:28:34 2022] PUT /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1359 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:34.838806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5c450ab-573d-4715-b2e7-0539efe7e9e0 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:34.839426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d5c450ab-573d-4715-b2e7-0539efe7e9e0 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:34.856120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9c9c2c58-df2d-4bb2-a61d-171e560664ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:34.857179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9c9c2c58-df2d-4bb2-a61d-171e560664ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:34.868188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c9c2c58-df2d-4bb2-a61d-171e560664ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:34.868719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c9c2c58-df2d-4bb2-a61d-171e560664ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:34.869332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c9c2c58-df2d-4bb2-a61d-171e560664ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:34.870067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c9c2c58-df2d-4bb2-a61d-171e560664ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:34.870729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c9c2c58-df2d-4bb2-a61d-171e560664ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:34.871162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c9c2c58-df2d-4bb2-a61d-171e560664ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:34.901023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d5c450ab-573d-4715-b2e7-0539efe7e9e0 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:34.914161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d5c450ab-573d-4715-b2e7-0539efe7e9e0 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:34.915825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d5c450ab-573d-4715-b2e7-0539efe7e9e0 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:34.923542 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d5c450ab-573d-4715-b2e7-0539efe7e9e0 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1359 microversion: 2.75 time: 0.089102 Oct 24 10:28:34.924504 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 539/1106] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:34 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1359 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:34.963613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8fde9608-93d7-4d43-90f3-fcd5e1451b29 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0e70af0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:35.021154 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8fde9608-93d7-4d43-90f3-fcd5e1451b29 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.068338 Oct 24 10:28:35.021831 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 540/1107] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:34 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:35.043147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9c9c2c58-df2d-4bb2-a61d-171e560664ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:35.055816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9c9c2c58-df2d-4bb2-a61d-171e560664ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:35.057340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9c9c2c58-df2d-4bb2-a61d-171e560664ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:35.058465 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9c9c2c58-df2d-4bb2-a61d-171e560664ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1360 microversion: 2.25 time: 0.208288 Oct 24 10:28:35.059262 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 568/1108] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:34 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1360 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:28:35.091494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-7e4dd11e-7d6a-4d31-b2d7-4dd2928d7957 req-47e8e853-8422-4ea3-8ab5-9cfa193b0237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "651e9e7c-ba1a-4472-b74e-3f14eb862773", "tag": "994f617f-bba6-456d-9bee-7c7fa6c5a409"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:35.102744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7e4dd11e-7d6a-4d31-b2d7-4dd2928d7957 req-47e8e853-8422-4ea3-8ab5-9cfa193b0237 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:35.103140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7e4dd11e-7d6a-4d31-b2d7-4dd2928d7957 req-47e8e853-8422-4ea3-8ab5-9cfa193b0237 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:35.103577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7e4dd11e-7d6a-4d31-b2d7-4dd2928d7957 req-47e8e853-8422-4ea3-8ab5-9cfa193b0237 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:35.115669 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-7e4dd11e-7d6a-4d31-b2d7-4dd2928d7957 req-47e8e853-8422-4ea3-8ab5-9cfa193b0237 service nova] Creating event network-changed:994f617f-bba6-456d-9bee-7c7fa6c5a409 for instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 on n-h2-858383-15 Oct 24 10:28:35.121608 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-7e4dd11e-7d6a-4d31-b2d7-4dd2928d7957 req-47e8e853-8422-4ea3-8ab5-9cfa193b0237 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033858 Oct 24 10:28:35.122224 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 541/1109] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:35.196156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f1dafbcd-14e6-495d-864d-ff87ae71b1f7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:35.196775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f1dafbcd-14e6-495d-864d-ff87ae71b1f7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:35.203859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1dafbcd-14e6-495d-864d-ff87ae71b1f7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:35.204457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1dafbcd-14e6-495d-864d-ff87ae71b1f7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:35.205062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1dafbcd-14e6-495d-864d-ff87ae71b1f7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:35.206015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1dafbcd-14e6-495d-864d-ff87ae71b1f7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:35.206609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1dafbcd-14e6-495d-864d-ff87ae71b1f7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:35.207141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1dafbcd-14e6-495d-864d-ff87ae71b1f7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:35.459025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f1dafbcd-14e6-495d-864d-ff87ae71b1f7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:35.469437 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f1dafbcd-14e6-495d-864d-ff87ae71b1f7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1313 microversion: 2.1 time: 0.277844 Oct 24 10:28:35.470039 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 569/1110] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:35 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:35.486462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa82f01a-3cf8-4894-8750-df346ab7adc4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:35.487079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa82f01a-3cf8-4894-8750-df346ab7adc4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:35.493331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa82f01a-3cf8-4894-8750-df346ab7adc4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:35.494063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa82f01a-3cf8-4894-8750-df346ab7adc4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:35.494497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa82f01a-3cf8-4894-8750-df346ab7adc4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:35.495192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa82f01a-3cf8-4894-8750-df346ab7adc4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:35.495645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa82f01a-3cf8-4894-8750-df346ab7adc4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:35.496068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa82f01a-3cf8-4894-8750-df346ab7adc4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:35.500976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:35.608113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b60111c3-dcca-4977-bb82-8a6844cea171 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:35.609187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b60111c3-dcca-4977-bb82-8a6844cea171 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:35.620143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b60111c3-dcca-4977-bb82-8a6844cea171 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:35.621739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b60111c3-dcca-4977-bb82-8a6844cea171 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:35.636220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b60111c3-dcca-4977-bb82-8a6844cea171 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:35.638609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b60111c3-dcca-4977-bb82-8a6844cea171 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:35.641445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b60111c3-dcca-4977-bb82-8a6844cea171 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:35.642129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b60111c3-dcca-4977-bb82-8a6844cea171 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:35.828750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b60111c3-dcca-4977-bb82-8a6844cea171 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:35.874113 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b60111c3-dcca-4977-bb82-8a6844cea171 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1290 microversion: 2.1 time: 0.269099 Oct 24 10:28:35.893300 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 570/1111] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:35 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1290 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:28:35.902173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ba9b17b5-c601-431d-a36f-75cfba8f0261 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:35.903138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ba9b17b5-c601-431d-a36f-75cfba8f0261 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:35.911015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba9b17b5-c601-431d-a36f-75cfba8f0261 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:35.911768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba9b17b5-c601-431d-a36f-75cfba8f0261 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:35.912364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba9b17b5-c601-431d-a36f-75cfba8f0261 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:35.914217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba9b17b5-c601-431d-a36f-75cfba8f0261 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:35.915039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba9b17b5-c601-431d-a36f-75cfba8f0261 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:35.915878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba9b17b5-c601-431d-a36f-75cfba8f0261 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:35.984247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa82f01a-3cf8-4894-8750-df346ab7adc4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:35.997057 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa82f01a-3cf8-4894-8750-df346ab7adc4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1308 microversion: 2.1 time: 0.515274 Oct 24 10:28:35.998614 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 542/1112] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:35 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1308 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:36.006004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6aafc30a-47ea-4b88-90fb-ae5c7df5ea21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:36.007186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6aafc30a-47ea-4b88-90fb-ae5c7df5ea21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:36.016253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aafc30a-47ea-4b88-90fb-ae5c7df5ea21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:36.017194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aafc30a-47ea-4b88-90fb-ae5c7df5ea21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:36.017858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aafc30a-47ea-4b88-90fb-ae5c7df5ea21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:36.018903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aafc30a-47ea-4b88-90fb-ae5c7df5ea21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:36.019510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aafc30a-47ea-4b88-90fb-ae5c7df5ea21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:36.020086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aafc30a-47ea-4b88-90fb-ae5c7df5ea21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:36.166463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ba9b17b5-c601-431d-a36f-75cfba8f0261 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:36.180223 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ba9b17b5-c601-431d-a36f-75cfba8f0261 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1275 microversion: 2.1 time: 0.285696 Oct 24 10:28:36.181483 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 571/1113] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:35 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1275 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:36.186195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-44195976-d0b1-4f72-99d3-5aa606c8c1c5 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0962550>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:36.193470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6aafc30a-47ea-4b88-90fb-ae5c7df5ea21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:36.209208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6aafc30a-47ea-4b88-90fb-ae5c7df5ea21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:36.212035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6aafc30a-47ea-4b88-90fb-ae5c7df5ea21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:36.221807 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6aafc30a-47ea-4b88-90fb-ae5c7df5ea21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1411 microversion: 2.75 time: 0.221166 Oct 24 10:28:36.223204 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 543/1114] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:35 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1411 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:36.243647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cbf50ccf-56ab-467e-a1c2-03465e40bafc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:36.244760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cbf50ccf-56ab-467e-a1c2-03465e40bafc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:36.263110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbf50ccf-56ab-467e-a1c2-03465e40bafc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:36.263610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbf50ccf-56ab-467e-a1c2-03465e40bafc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:36.264044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbf50ccf-56ab-467e-a1c2-03465e40bafc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:36.264743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbf50ccf-56ab-467e-a1c2-03465e40bafc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:36.265217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbf50ccf-56ab-467e-a1c2-03465e40bafc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:36.265637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbf50ccf-56ab-467e-a1c2-03465e40bafc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:36.268322 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-44195976-d0b1-4f72-99d3-5aa606c8c1c5 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.085546 Oct 24 10:28:36.269004 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 572/1115] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:36 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:36.495053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1fcd433d-bc4d-4cf3-a10d-e43fb0cb6d6b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:36.495691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1fcd433d-bc4d-4cf3-a10d-e43fb0cb6d6b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:36.502101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1fcd433d-bc4d-4cf3-a10d-e43fb0cb6d6b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:36.502587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1fcd433d-bc4d-4cf3-a10d-e43fb0cb6d6b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:36.503015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1fcd433d-bc4d-4cf3-a10d-e43fb0cb6d6b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:36.503707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1fcd433d-bc4d-4cf3-a10d-e43fb0cb6d6b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:36.504267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1fcd433d-bc4d-4cf3-a10d-e43fb0cb6d6b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:36.504579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1fcd433d-bc4d-4cf3-a10d-e43fb0cb6d6b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:36.513639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cbf50ccf-56ab-467e-a1c2-03465e40bafc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:36.521792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cbf50ccf-56ab-467e-a1c2-03465e40bafc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:36.523437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cbf50ccf-56ab-467e-a1c2-03465e40bafc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:36.524558 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cbf50ccf-56ab-467e-a1c2-03465e40bafc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1360 microversion: 2.25 time: 0.299139 Oct 24 10:28:36.525148 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 544/1116] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:36 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1360 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:36.750077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1fcd433d-bc4d-4cf3-a10d-e43fb0cb6d6b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:36.760866 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1fcd433d-bc4d-4cf3-a10d-e43fb0cb6d6b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1313 microversion: 2.1 time: 0.271029 Oct 24 10:28:36.761480 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 573/1117] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:36 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:36.898462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ca09d52c-6457-4e4a-9056-93c8d3d1c27b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:36.899156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ca09d52c-6457-4e4a-9056-93c8d3d1c27b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:36.903638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7d43f213-d794-4949-870b-435bbb9a5c3d tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:36.904251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7d43f213-d794-4949-870b-435bbb9a5c3d tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:36.906033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca09d52c-6457-4e4a-9056-93c8d3d1c27b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:36.906563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca09d52c-6457-4e4a-9056-93c8d3d1c27b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:36.906999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca09d52c-6457-4e4a-9056-93c8d3d1c27b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:36.907882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca09d52c-6457-4e4a-9056-93c8d3d1c27b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:36.908334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca09d52c-6457-4e4a-9056-93c8d3d1c27b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:36.908744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca09d52c-6457-4e4a-9056-93c8d3d1c27b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:36.910229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d43f213-d794-4949-870b-435bbb9a5c3d tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:36.910717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d43f213-d794-4949-870b-435bbb9a5c3d tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:36.911150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d43f213-d794-4949-870b-435bbb9a5c3d tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:36.912038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d43f213-d794-4949-870b-435bbb9a5c3d tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:36.912495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d43f213-d794-4949-870b-435bbb9a5c3d tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:36.915056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d43f213-d794-4949-870b-435bbb9a5c3d tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:37.104990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ca09d52c-6457-4e4a-9056-93c8d3d1c27b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:37.113904 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ca09d52c-6457-4e4a-9056-93c8d3d1c27b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1332 microversion: 2.1 time: 0.220003 Oct 24 10:28:37.114685 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 545/1118] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:36 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1332 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:37.120024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b5528b58-fa6e-43a0-a4c8-2510310d88f3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:37.120634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b5528b58-fa6e-43a0-a4c8-2510310d88f3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:37.127106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5528b58-fa6e-43a0-a4c8-2510310d88f3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:37.127593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5528b58-fa6e-43a0-a4c8-2510310d88f3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:37.128208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5528b58-fa6e-43a0-a4c8-2510310d88f3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:37.128412 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7d43f213-d794-4949-870b-435bbb9a5c3d tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1814 microversion: 2.1 time: 0.227966 Oct 24 10:28:37.129297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5528b58-fa6e-43a0-a4c8-2510310d88f3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:37.129551 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 574/1119] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:36 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1814 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:28:37.130080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5528b58-fa6e-43a0-a4c8-2510310d88f3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:37.130532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5528b58-fa6e-43a0-a4c8-2510310d88f3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:37.151179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e16358d-5c3a-46fb-9111-790ae1734e67 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:37.155625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e16358d-5c3a-46fb-9111-790ae1734e67 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:37.156108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e16358d-5c3a-46fb-9111-790ae1734e67 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:37.156541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e16358d-5c3a-46fb-9111-790ae1734e67 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:37.157289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e16358d-5c3a-46fb-9111-790ae1734e67 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:37.157736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e16358d-5c3a-46fb-9111-790ae1734e67 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:37.158160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e16358d-5c3a-46fb-9111-790ae1734e67 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:37.182820 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3e16358d-5c3a-46fb-9111-790ae1734e67 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.035445 Oct 24 10:28:37.183427 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 575/1120] 10.222.0.50 () {58 vars in 1176 bytes} [Mon Oct 24 10:28:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:28:37.205408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9ad07b74-f7bb-4b17-82ed-52c6dc4ef111 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:37.206021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9ad07b74-f7bb-4b17-82ed-52c6dc4ef111 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:37.209041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:37.213356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ad07b74-f7bb-4b17-82ed-52c6dc4ef111 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:37.213834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ad07b74-f7bb-4b17-82ed-52c6dc4ef111 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:37.214264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ad07b74-f7bb-4b17-82ed-52c6dc4ef111 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:37.214954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ad07b74-f7bb-4b17-82ed-52c6dc4ef111 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:37.215398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ad07b74-f7bb-4b17-82ed-52c6dc4ef111 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:37.215828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ad07b74-f7bb-4b17-82ed-52c6dc4ef111 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:37.295755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b5528b58-fa6e-43a0-a4c8-2510310d88f3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:37.304661 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b5528b58-fa6e-43a0-a4c8-2510310d88f3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1308 microversion: 2.1 time: 0.188866 Oct 24 10:28:37.305352 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 546/1121] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:37 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:37.325849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-95099d85-3005-4d38-8c22-64885f05de91 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:37.326461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-95099d85-3005-4d38-8c22-64885f05de91 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:37.332740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95099d85-3005-4d38-8c22-64885f05de91 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:37.333273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95099d85-3005-4d38-8c22-64885f05de91 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:37.333701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95099d85-3005-4d38-8c22-64885f05de91 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:37.334400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95099d85-3005-4d38-8c22-64885f05de91 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:37.334912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95099d85-3005-4d38-8c22-64885f05de91 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:37.335335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95099d85-3005-4d38-8c22-64885f05de91 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:37.367731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9ad07b74-f7bb-4b17-82ed-52c6dc4ef111 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:37.376009 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9ad07b74-f7bb-4b17-82ed-52c6dc4ef111 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1317 microversion: 2.1 time: 0.174366 Oct 24 10:28:37.388859 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 576/1122] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:37 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:37.388859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-349667bd-6d10-43c5-992c-19ff231162f3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d09408b0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:37.407061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-95099d85-3005-4d38-8c22-64885f05de91 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:37.417349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-95099d85-3005-4d38-8c22-64885f05de91 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:37.419095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-95099d85-3005-4d38-8c22-64885f05de91 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:37.427433 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-95099d85-3005-4d38-8c22-64885f05de91 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1419 microversion: 2.75 time: 0.108851 Oct 24 10:28:37.428109 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 547/1123] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:37 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1419 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:37.430340 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-349667bd-6d10-43c5-992c-19ff231162f3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.052065 Oct 24 10:28:37.431074 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 577/1124] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:37 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:37.550396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-84a32c7a-9298-4d70-81a0-dfec47c93cb6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:37.550992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-84a32c7a-9298-4d70-81a0-dfec47c93cb6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:37.559712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84a32c7a-9298-4d70-81a0-dfec47c93cb6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:37.565898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84a32c7a-9298-4d70-81a0-dfec47c93cb6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:37.566430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84a32c7a-9298-4d70-81a0-dfec47c93cb6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:37.567222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84a32c7a-9298-4d70-81a0-dfec47c93cb6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:37.567760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84a32c7a-9298-4d70-81a0-dfec47c93cb6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:37.574041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84a32c7a-9298-4d70-81a0-dfec47c93cb6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:37.786442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-99940f61-8d54-44ee-ba2e-98067385b0d8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:37.787061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-99940f61-8d54-44ee-ba2e-98067385b0d8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:37.797647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99940f61-8d54-44ee-ba2e-98067385b0d8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:37.798132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99940f61-8d54-44ee-ba2e-98067385b0d8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:37.798568 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99940f61-8d54-44ee-ba2e-98067385b0d8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:37.799279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99940f61-8d54-44ee-ba2e-98067385b0d8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:37.799732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99940f61-8d54-44ee-ba2e-98067385b0d8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:37.800157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99940f61-8d54-44ee-ba2e-98067385b0d8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:37.815542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:38.233846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-99940f61-8d54-44ee-ba2e-98067385b0d8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:38.246823 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-99940f61-8d54-44ee-ba2e-98067385b0d8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1313 microversion: 2.1 time: 0.464200 Oct 24 10:28:38.248891 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 578/1125] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:37 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:28:38.260994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bed39a48-365f-4be4-b26f-642fee00e467 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:38.261573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bed39a48-365f-4be4-b26f-642fee00e467 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:38.277559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bed39a48-365f-4be4-b26f-642fee00e467 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:38.278314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bed39a48-365f-4be4-b26f-642fee00e467 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:38.278919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bed39a48-365f-4be4-b26f-642fee00e467 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:38.285130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bed39a48-365f-4be4-b26f-642fee00e467 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:38.285933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bed39a48-365f-4be4-b26f-642fee00e467 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:38.286514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bed39a48-365f-4be4-b26f-642fee00e467 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:38.325539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-84a32c7a-9298-4d70-81a0-dfec47c93cb6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:38.339628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-84a32c7a-9298-4d70-81a0-dfec47c93cb6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:38.343772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-84a32c7a-9298-4d70-81a0-dfec47c93cb6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:38.348797 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-84a32c7a-9298-4d70-81a0-dfec47c93cb6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1360 microversion: 2.25 time: 0.802152 Oct 24 10:28:38.360651 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 548/1126] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:37 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1360 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:38.367628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-09de0310-2f95-408a-a5a8-8174ce19d04a req-01aa370e-6859-413f-9b4f-2618b14a8eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d7180f-82cf-4113-824a-6350d013baf1", "name": "network-vif-plugged", "status": "completed", "tag": "af23d072-0dd6-45cf-9412-eb509fb3c310"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:38.396755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-09de0310-2f95-408a-a5a8-8174ce19d04a req-01aa370e-6859-413f-9b4f-2618b14a8eec service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:38.398323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-09de0310-2f95-408a-a5a8-8174ce19d04a req-01aa370e-6859-413f-9b4f-2618b14a8eec service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:38.400031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-09de0310-2f95-408a-a5a8-8174ce19d04a req-01aa370e-6859-413f-9b4f-2618b14a8eec service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:38.431143 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-09de0310-2f95-408a-a5a8-8174ce19d04a req-01aa370e-6859-413f-9b4f-2618b14a8eec service nova] Creating event network-vif-plugged:af23d072-0dd6-45cf-9412-eb509fb3c310 for instance b9d7180f-82cf-4113-824a-6350d013baf1 on n-h1-858383-15 Oct 24 10:28:38.447522 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-09de0310-2f95-408a-a5a8-8174ce19d04a req-01aa370e-6859-413f-9b4f-2618b14a8eec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091406 Oct 24 10:28:38.448468 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 549/1127] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:38.459427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9f614648-c2be-4be0-aed1-2e00affcdefc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:38.461049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9f614648-c2be-4be0-aed1-2e00affcdefc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:38.469977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f614648-c2be-4be0-aed1-2e00affcdefc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:38.470654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f614648-c2be-4be0-aed1-2e00affcdefc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:38.471266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f614648-c2be-4be0-aed1-2e00affcdefc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:38.472119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f614648-c2be-4be0-aed1-2e00affcdefc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:38.472867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f614648-c2be-4be0-aed1-2e00affcdefc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:38.474276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f614648-c2be-4be0-aed1-2e00affcdefc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:38.659305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bed39a48-365f-4be4-b26f-642fee00e467 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:38.668236 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bed39a48-365f-4be4-b26f-642fee00e467 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1332 microversion: 2.1 time: 0.417860 Oct 24 10:28:38.670895 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 579/1128] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:38 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1332 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:38.682572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9cfcff19-95a0-4286-897f-7dd96b235998 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:38.689667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9cfcff19-95a0-4286-897f-7dd96b235998 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:38.699630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cfcff19-95a0-4286-897f-7dd96b235998 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:38.705575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cfcff19-95a0-4286-897f-7dd96b235998 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:38.706424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cfcff19-95a0-4286-897f-7dd96b235998 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:38.707328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cfcff19-95a0-4286-897f-7dd96b235998 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:38.708136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cfcff19-95a0-4286-897f-7dd96b235998 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:38.708738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cfcff19-95a0-4286-897f-7dd96b235998 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:39.264763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9f614648-c2be-4be0-aed1-2e00affcdefc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:39.273993 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9f614648-c2be-4be0-aed1-2e00affcdefc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1308 microversion: 2.1 time: 0.823513 Oct 24 10:28:39.291337 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 550/1129] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:38 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1308 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:39.305552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9c68332-b1cf-4ad9-91b5-9f0f6bf1111e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0f09790>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:39.383627 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f9c68332-b1cf-4ad9-91b5-9f0f6bf1111e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.090896 Oct 24 10:28:39.392803 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 551/1130] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:39 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:39.400087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-da6c7885-6335-4759-8608-178f4a876cd4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:39.400990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-da6c7885-6335-4759-8608-178f4a876cd4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:39.407393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da6c7885-6335-4759-8608-178f4a876cd4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:39.408082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da6c7885-6335-4759-8608-178f4a876cd4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:39.408703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da6c7885-6335-4759-8608-178f4a876cd4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:39.409586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da6c7885-6335-4759-8608-178f4a876cd4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:39.410192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da6c7885-6335-4759-8608-178f4a876cd4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:39.410765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da6c7885-6335-4759-8608-178f4a876cd4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:39.417590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9cfcff19-95a0-4286-897f-7dd96b235998 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:39.427421 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9cfcff19-95a0-4286-897f-7dd96b235998 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1317 microversion: 2.1 time: 0.749352 Oct 24 10:28:39.428001 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 580/1131] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:38 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1317 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:39.455091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-edfdca93-efbe-4024-b93c-a4471892352d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:39.455716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-edfdca93-efbe-4024-b93c-a4471892352d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:39.470203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-edfdca93-efbe-4024-b93c-a4471892352d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:39.470661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-edfdca93-efbe-4024-b93c-a4471892352d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:39.479513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-edfdca93-efbe-4024-b93c-a4471892352d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:39.480277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-edfdca93-efbe-4024-b93c-a4471892352d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:39.480752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-edfdca93-efbe-4024-b93c-a4471892352d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:39.481218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-edfdca93-efbe-4024-b93c-a4471892352d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:39.545194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-da6c7885-6335-4759-8608-178f4a876cd4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:39.559727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-da6c7885-6335-4759-8608-178f4a876cd4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:39.567882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-da6c7885-6335-4759-8608-178f4a876cd4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:39.613283 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-da6c7885-6335-4759-8608-178f4a876cd4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1417 microversion: 2.75 time: 0.218336 Oct 24 10:28:39.618430 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 552/1132] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:39 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1417 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:39.635796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-315ee70f-dba5-457d-a484-03c04e45e8b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:39.636417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-315ee70f-dba5-457d-a484-03c04e45e8b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:39.661067 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-315ee70f-dba5-457d-a484-03c04e45e8b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:39.666622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-315ee70f-dba5-457d-a484-03c04e45e8b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:39.669180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-315ee70f-dba5-457d-a484-03c04e45e8b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:39.670789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-315ee70f-dba5-457d-a484-03c04e45e8b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:39.675056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-315ee70f-dba5-457d-a484-03c04e45e8b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:39.677440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-315ee70f-dba5-457d-a484-03c04e45e8b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:39.690918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:39.794641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-edfdca93-efbe-4024-b93c-a4471892352d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:39.804547 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-edfdca93-efbe-4024-b93c-a4471892352d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1313 microversion: 2.1 time: 0.367731 Oct 24 10:28:39.811674 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 581/1133] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:39 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:39.820421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-31123bd8-1dc7-4579-878a-a3916d995ff5 req-79a48d9e-ee85-461e-9b9c-3d390275a2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76cff000-3122-4b18-89a9-c679033be122", "tag": "b8b62cc8-0a2d-4606-bc4b-f89a074e7a49"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:39.831013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-31123bd8-1dc7-4579-878a-a3916d995ff5 req-79a48d9e-ee85-461e-9b9c-3d390275a2b6 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:39.831782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-31123bd8-1dc7-4579-878a-a3916d995ff5 req-79a48d9e-ee85-461e-9b9c-3d390275a2b6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:39.832427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-31123bd8-1dc7-4579-878a-a3916d995ff5 req-79a48d9e-ee85-461e-9b9c-3d390275a2b6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:39.865230 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-31123bd8-1dc7-4579-878a-a3916d995ff5 req-79a48d9e-ee85-461e-9b9c-3d390275a2b6 service nova] Creating event network-changed:b8b62cc8-0a2d-4606-bc4b-f89a074e7a49 for instance 76cff000-3122-4b18-89a9-c679033be122 on n-h2-858383-15 Oct 24 10:28:39.886191 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-31123bd8-1dc7-4579-878a-a3916d995ff5 req-79a48d9e-ee85-461e-9b9c-3d390275a2b6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072717 Oct 24 10:28:39.887090 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 582/1134] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:39.894722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-533f447d-58b5-4ebc-8f91-f22418384953 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:39.901336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-533f447d-58b5-4ebc-8f91-f22418384953 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:39.912464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-533f447d-58b5-4ebc-8f91-f22418384953 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:39.916222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-533f447d-58b5-4ebc-8f91-f22418384953 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:39.916857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-533f447d-58b5-4ebc-8f91-f22418384953 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:39.917735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-533f447d-58b5-4ebc-8f91-f22418384953 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:39.919069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-533f447d-58b5-4ebc-8f91-f22418384953 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:39.920139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-533f447d-58b5-4ebc-8f91-f22418384953 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:40.185440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-315ee70f-dba5-457d-a484-03c04e45e8b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:40.193833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-315ee70f-dba5-457d-a484-03c04e45e8b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:40.200909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-315ee70f-dba5-457d-a484-03c04e45e8b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:40.202317 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-315ee70f-dba5-457d-a484-03c04e45e8b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1360 microversion: 2.25 time: 0.582250 Oct 24 10:28:40.205826 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 553/1135] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:39 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1360 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:40.217441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c94f49a6-8cc1-4dfc-b463-ac1926e569fd req-74444883-d18b-4a77-98c5-01fd19a1afe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d47d8d5-f7d0-49c4-839a-92bababf20e7", "tag": "9d03d2ef-8a17-4594-b487-37b1ca2cc10b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:40.237450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c94f49a6-8cc1-4dfc-b463-ac1926e569fd req-74444883-d18b-4a77-98c5-01fd19a1afe7 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:40.239662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c94f49a6-8cc1-4dfc-b463-ac1926e569fd req-74444883-d18b-4a77-98c5-01fd19a1afe7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:40.240265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c94f49a6-8cc1-4dfc-b463-ac1926e569fd req-74444883-d18b-4a77-98c5-01fd19a1afe7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:40.284164 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c94f49a6-8cc1-4dfc-b463-ac1926e569fd req-74444883-d18b-4a77-98c5-01fd19a1afe7 service nova] Creating event network-changed:9d03d2ef-8a17-4594-b487-37b1ca2cc10b for instance 8d47d8d5-f7d0-49c4-839a-92bababf20e7 on n-h2-858383-15 Oct 24 10:28:40.300741 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c94f49a6-8cc1-4dfc-b463-ac1926e569fd req-74444883-d18b-4a77-98c5-01fd19a1afe7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093385 Oct 24 10:28:40.301999 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 554/1136] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:40.310365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c5ab5bb-c74e-43bb-8ca3-3df6715ee480 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:40.311259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4c5ab5bb-c74e-43bb-8ca3-3df6715ee480 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:40.326675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c5ab5bb-c74e-43bb-8ca3-3df6715ee480 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:40.329792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c5ab5bb-c74e-43bb-8ca3-3df6715ee480 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:40.332689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c5ab5bb-c74e-43bb-8ca3-3df6715ee480 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:40.333763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c5ab5bb-c74e-43bb-8ca3-3df6715ee480 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:40.334379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c5ab5bb-c74e-43bb-8ca3-3df6715ee480 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:40.338312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c5ab5bb-c74e-43bb-8ca3-3df6715ee480 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:40.500411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-533f447d-58b5-4ebc-8f91-f22418384953 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:40.521085 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-533f447d-58b5-4ebc-8f91-f22418384953 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1332 microversion: 2.1 time: 0.630060 Oct 24 10:28:40.522010 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 583/1137] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:39 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1332 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:40.532456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f5f23af7-3299-482e-93f6-48cd07e27747 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0960820>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:40.631077 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f5f23af7-3299-482e-93f6-48cd07e27747 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.107601 Oct 24 10:28:40.633064 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 584/1138] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:40 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:40.637836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-412bf982-63f4-4065-822f-edbf072b0cef tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:40.638755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-412bf982-63f4-4065-822f-edbf072b0cef tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:40.647614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-412bf982-63f4-4065-822f-edbf072b0cef tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:40.648388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-412bf982-63f4-4065-822f-edbf072b0cef tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:40.649274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-412bf982-63f4-4065-822f-edbf072b0cef tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:40.650251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-412bf982-63f4-4065-822f-edbf072b0cef tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:40.650880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-412bf982-63f4-4065-822f-edbf072b0cef tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:40.651479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-412bf982-63f4-4065-822f-edbf072b0cef tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:40.664548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c5ab5bb-c74e-43bb-8ca3-3df6715ee480 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:40.676158 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4c5ab5bb-c74e-43bb-8ca3-3df6715ee480 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1308 microversion: 2.1 time: 0.372688 Oct 24 10:28:40.678006 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 555/1139] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:40 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1308 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:40.684407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-82be0720-2ce0-4bde-b0b6-9b989aa70a08 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:40.685306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-82be0720-2ce0-4bde-b0b6-9b989aa70a08 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:40.692900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82be0720-2ce0-4bde-b0b6-9b989aa70a08 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:40.693684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82be0720-2ce0-4bde-b0b6-9b989aa70a08 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:40.694951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82be0720-2ce0-4bde-b0b6-9b989aa70a08 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:40.696614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82be0720-2ce0-4bde-b0b6-9b989aa70a08 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:40.697276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82be0720-2ce0-4bde-b0b6-9b989aa70a08 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:40.698771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82be0720-2ce0-4bde-b0b6-9b989aa70a08 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:40.872291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-82be0720-2ce0-4bde-b0b6-9b989aa70a08 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:40.884918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-82be0720-2ce0-4bde-b0b6-9b989aa70a08 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:40.887192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-82be0720-2ce0-4bde-b0b6-9b989aa70a08 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:40.893468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:40.896074 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-82be0720-2ce0-4bde-b0b6-9b989aa70a08 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1417 microversion: 2.75 time: 0.215362 Oct 24 10:28:40.897195 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 556/1140] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:40 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1417 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:40.908748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-85c62a67-7b9c-4983-a9a1-28590eafbb21 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:40.910256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-85c62a67-7b9c-4983-a9a1-28590eafbb21 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:40.919661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-85c62a67-7b9c-4983-a9a1-28590eafbb21 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:40.921221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-85c62a67-7b9c-4983-a9a1-28590eafbb21 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:40.922140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-85c62a67-7b9c-4983-a9a1-28590eafbb21 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:40.923296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-85c62a67-7b9c-4983-a9a1-28590eafbb21 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:40.924556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-85c62a67-7b9c-4983-a9a1-28590eafbb21 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:40.925246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-85c62a67-7b9c-4983-a9a1-28590eafbb21 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:41.026331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-412bf982-63f4-4065-822f-edbf072b0cef tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:41.036976 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-412bf982-63f4-4065-822f-edbf072b0cef tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1317 microversion: 2.1 time: 0.402629 Oct 24 10:28:41.037566 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 585/1141] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:40 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:41.114718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-85c62a67-7b9c-4983-a9a1-28590eafbb21 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:41.127539 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-85c62a67-7b9c-4983-a9a1-28590eafbb21 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1313 microversion: 2.1 time: 0.226036 Oct 24 10:28:41.128345 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 557/1142] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:40 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:41.235722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0e44dec3-7f96-4955-bc33-9a8b2917b005 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:41.236334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0e44dec3-7f96-4955-bc33-9a8b2917b005 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:41.244878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e44dec3-7f96-4955-bc33-9a8b2917b005 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:41.245166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e44dec3-7f96-4955-bc33-9a8b2917b005 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:41.245537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e44dec3-7f96-4955-bc33-9a8b2917b005 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:41.246263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e44dec3-7f96-4955-bc33-9a8b2917b005 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:41.246771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e44dec3-7f96-4955-bc33-9a8b2917b005 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:41.247202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e44dec3-7f96-4955-bc33-9a8b2917b005 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:41.399110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0e44dec3-7f96-4955-bc33-9a8b2917b005 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:41.407272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0e44dec3-7f96-4955-bc33-9a8b2917b005 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:41.408856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0e44dec3-7f96-4955-bc33-9a8b2917b005 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:41.410080 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0e44dec3-7f96-4955-bc33-9a8b2917b005 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1360 microversion: 2.25 time: 0.178280 Oct 24 10:28:41.411009 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 586/1143] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:41 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1360 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:41.497954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ec92a465-4934-4cc8-a456-831a64501f62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e4f013f-0f0b-4dfa-8bfd-7fbd73983677", "device": "/dev/xvdb"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:41.501326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ec92a465-4934-4cc8-a456-831a64501f62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:41.507935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec92a465-4934-4cc8-a456-831a64501f62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:41.508446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec92a465-4934-4cc8-a456-831a64501f62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:41.508879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec92a465-4934-4cc8-a456-831a64501f62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:41.509600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec92a465-4934-4cc8-a456-831a64501f62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:41.510097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec92a465-4934-4cc8-a456-831a64501f62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:41.510513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec92a465-4934-4cc8-a456-831a64501f62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:41.546597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4c4e831a-4c66-402b-8054-a4aaa697d45b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:41.549249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4c4e831a-4c66-402b-8054-a4aaa697d45b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:41.558677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c4e831a-4c66-402b-8054-a4aaa697d45b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:41.559314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c4e831a-4c66-402b-8054-a4aaa697d45b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:41.559850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c4e831a-4c66-402b-8054-a4aaa697d45b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:41.560686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c4e831a-4c66-402b-8054-a4aaa697d45b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:41.561264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c4e831a-4c66-402b-8054-a4aaa697d45b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:41.561949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c4e831a-4c66-402b-8054-a4aaa697d45b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:42.064072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4c4e831a-4c66-402b-8054-a4aaa697d45b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:42.075907 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4c4e831a-4c66-402b-8054-a4aaa697d45b tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1332 microversion: 2.1 time: 0.534382 Oct 24 10:28:42.076795 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 587/1144] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:41 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1332 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:28:42.081835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ce13bacc-53b8-4f6c-b1f1-b4e081c9e035 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0aba700>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:42.140282 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ce13bacc-53b8-4f6c-b1f1-b4e081c9e035 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.061982 Oct 24 10:28:42.141050 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 588/1145] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:42 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:42.147104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-89841ecf-238c-4396-ad24-0a34ae6008a4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:42.148173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-89841ecf-238c-4396-ad24-0a34ae6008a4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:42.154991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-89841ecf-238c-4396-ad24-0a34ae6008a4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:42.155473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-89841ecf-238c-4396-ad24-0a34ae6008a4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:42.155904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-89841ecf-238c-4396-ad24-0a34ae6008a4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:42.156634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-89841ecf-238c-4396-ad24-0a34ae6008a4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:42.157129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-89841ecf-238c-4396-ad24-0a34ae6008a4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:42.157550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-89841ecf-238c-4396-ad24-0a34ae6008a4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:42.323279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-89841ecf-238c-4396-ad24-0a34ae6008a4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:42.335961 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-89841ecf-238c-4396-ad24-0a34ae6008a4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1308 microversion: 2.1 time: 0.192683 Oct 24 10:28:42.342703 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 589/1146] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:42 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1308 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:42.342703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-40ccfe69-8fd7-4b87-84dc-1839d39e403b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:42.342703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-40ccfe69-8fd7-4b87-84dc-1839d39e403b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:42.347818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40ccfe69-8fd7-4b87-84dc-1839d39e403b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:42.348314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40ccfe69-8fd7-4b87-84dc-1839d39e403b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:42.348756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40ccfe69-8fd7-4b87-84dc-1839d39e403b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:42.349501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40ccfe69-8fd7-4b87-84dc-1839d39e403b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:42.349962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40ccfe69-8fd7-4b87-84dc-1839d39e403b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:42.350577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40ccfe69-8fd7-4b87-84dc-1839d39e403b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:42.489892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-40ccfe69-8fd7-4b87-84dc-1839d39e403b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:42.501464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-40ccfe69-8fd7-4b87-84dc-1839d39e403b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:42.504041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-40ccfe69-8fd7-4b87-84dc-1839d39e403b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:42.512681 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-40ccfe69-8fd7-4b87-84dc-1839d39e403b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1417 microversion: 2.75 time: 0.174798 Oct 24 10:28:42.513698 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 590/1147] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:42 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1417 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:42.518477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a546ac44-7387-4268-a6e8-cdc2d9154da1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:42.519631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a546ac44-7387-4268-a6e8-cdc2d9154da1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:42.528242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a546ac44-7387-4268-a6e8-cdc2d9154da1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:42.528861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a546ac44-7387-4268-a6e8-cdc2d9154da1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:42.531550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a546ac44-7387-4268-a6e8-cdc2d9154da1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:42.532339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a546ac44-7387-4268-a6e8-cdc2d9154da1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:42.532972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a546ac44-7387-4268-a6e8-cdc2d9154da1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:42.533392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a546ac44-7387-4268-a6e8-cdc2d9154da1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:42.719233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a546ac44-7387-4268-a6e8-cdc2d9154da1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:42.728588 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a546ac44-7387-4268-a6e8-cdc2d9154da1 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1317 microversion: 2.1 time: 0.213786 Oct 24 10:28:42.729862 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 591/1148] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:42 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:42.734887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-f90caf84-4e75-48e5-bfc2-0f55d27a0b65 req-99af4850-dfb7-42bc-a04d-75efe4dea234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651e9e7c-ba1a-4472-b74e-3f14eb862773", "name": "network-vif-plugged", "status": "completed", "tag": "994f617f-bba6-456d-9bee-7c7fa6c5a409"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:42.747374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f90caf84-4e75-48e5-bfc2-0f55d27a0b65 req-99af4850-dfb7-42bc-a04d-75efe4dea234 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:42.747915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f90caf84-4e75-48e5-bfc2-0f55d27a0b65 req-99af4850-dfb7-42bc-a04d-75efe4dea234 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:42.748628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f90caf84-4e75-48e5-bfc2-0f55d27a0b65 req-99af4850-dfb7-42bc-a04d-75efe4dea234 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:42.764962 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f90caf84-4e75-48e5-bfc2-0f55d27a0b65 req-99af4850-dfb7-42bc-a04d-75efe4dea234 service nova] Creating event network-vif-plugged:994f617f-bba6-456d-9bee-7c7fa6c5a409 for instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 on n-h2-858383-15 Oct 24 10:28:42.770191 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-f90caf84-4e75-48e5-bfc2-0f55d27a0b65 req-99af4850-dfb7-42bc-a04d-75efe4dea234 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038750 Oct 24 10:28:42.771210 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 592/1149] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:42.778933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9ad0f905-6767-46dc-ad1d-c7904df7281d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:42.779897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9ad0f905-6767-46dc-ad1d-c7904df7281d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:42.788010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ad0f905-6767-46dc-ad1d-c7904df7281d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:42.788510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ad0f905-6767-46dc-ad1d-c7904df7281d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:42.788997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ad0f905-6767-46dc-ad1d-c7904df7281d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:42.789911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ad0f905-6767-46dc-ad1d-c7904df7281d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:42.790546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ad0f905-6767-46dc-ad1d-c7904df7281d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:42.791290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ad0f905-6767-46dc-ad1d-c7904df7281d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:42.968905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9ad0f905-6767-46dc-ad1d-c7904df7281d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:42.979614 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9ad0f905-6767-46dc-ad1d-c7904df7281d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1313 microversion: 2.1 time: 0.205828 Oct 24 10:28:42.980621 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 593/1150] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:42 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:42.994984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e807c965-1667-4205-93ff-fc1e3411f65c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:42.995961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e807c965-1667-4205-93ff-fc1e3411f65c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:43.006559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e807c965-1667-4205-93ff-fc1e3411f65c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:43.007866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e807c965-1667-4205-93ff-fc1e3411f65c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:43.008508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e807c965-1667-4205-93ff-fc1e3411f65c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:43.010744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e807c965-1667-4205-93ff-fc1e3411f65c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:43.011316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e807c965-1667-4205-93ff-fc1e3411f65c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:43.012855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e807c965-1667-4205-93ff-fc1e3411f65c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:43.190986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e807c965-1667-4205-93ff-fc1e3411f65c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:43.202374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e807c965-1667-4205-93ff-fc1e3411f65c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:43.205169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e807c965-1667-4205-93ff-fc1e3411f65c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:43.206618 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e807c965-1667-4205-93ff-fc1e3411f65c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1360 microversion: 2.25 time: 0.224808 Oct 24 10:28:43.207433 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 594/1151] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:42 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1360 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:43.215638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e9b3c73e-515b-47ef-8015-271ce3fc6269 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:43.216264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e9b3c73e-515b-47ef-8015-271ce3fc6269 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:43.230124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9b3c73e-515b-47ef-8015-271ce3fc6269 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:43.230696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9b3c73e-515b-47ef-8015-271ce3fc6269 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:43.231189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9b3c73e-515b-47ef-8015-271ce3fc6269 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:43.232547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9b3c73e-515b-47ef-8015-271ce3fc6269 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:43.233069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9b3c73e-515b-47ef-8015-271ce3fc6269 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:43.233508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9b3c73e-515b-47ef-8015-271ce3fc6269 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:43.406799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e9b3c73e-515b-47ef-8015-271ce3fc6269 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:43.417540 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e9b3c73e-515b-47ef-8015-271ce3fc6269 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1332 microversion: 2.1 time: 0.208055 Oct 24 10:28:43.419092 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 595/1152] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:43 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1332 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:43.429412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f16b920b-a0da-47ca-8260-deea8093ecfc tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0940940>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:43.489380 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f16b920b-a0da-47ca-8260-deea8093ecfc tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.067141 Oct 24 10:28:43.499783 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 596/1153] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:43 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:43.505126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6a29ded9-6a5c-4a6d-a311-3e1b4b39ad4f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:43.505801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6a29ded9-6a5c-4a6d-a311-3e1b4b39ad4f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:43.513549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a29ded9-6a5c-4a6d-a311-3e1b4b39ad4f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:43.514047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a29ded9-6a5c-4a6d-a311-3e1b4b39ad4f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:43.514489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a29ded9-6a5c-4a6d-a311-3e1b4b39ad4f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:43.515263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a29ded9-6a5c-4a6d-a311-3e1b4b39ad4f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:43.515649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a29ded9-6a5c-4a6d-a311-3e1b4b39ad4f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:43.516085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a29ded9-6a5c-4a6d-a311-3e1b4b39ad4f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:43.708942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6a29ded9-6a5c-4a6d-a311-3e1b4b39ad4f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:43.718140 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6a29ded9-6a5c-4a6d-a311-3e1b4b39ad4f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1308 microversion: 2.1 time: 0.217306 Oct 24 10:28:43.718727 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 597/1154] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:43 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1308 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:43.723657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b50412f3-9509-405d-86d9-3c84b422056f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:43.724255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b50412f3-9509-405d-86d9-3c84b422056f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:43.731713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b50412f3-9509-405d-86d9-3c84b422056f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:43.732470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b50412f3-9509-405d-86d9-3c84b422056f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:43.732809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b50412f3-9509-405d-86d9-3c84b422056f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:43.733460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b50412f3-9509-405d-86d9-3c84b422056f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:43.733935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b50412f3-9509-405d-86d9-3c84b422056f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:43.734363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b50412f3-9509-405d-86d9-3c84b422056f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:43.805189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b50412f3-9509-405d-86d9-3c84b422056f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:43.814261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b50412f3-9509-405d-86d9-3c84b422056f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:43.815651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b50412f3-9509-405d-86d9-3c84b422056f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:43.822080 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b50412f3-9509-405d-86d9-3c84b422056f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1417 microversion: 2.75 time: 0.102307 Oct 24 10:28:43.822865 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 598/1155] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:43 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1417 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:43.827038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-81116021-ff27-445b-b67d-4715df8438b9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:43.827647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-81116021-ff27-445b-b67d-4715df8438b9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:43.833604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81116021-ff27-445b-b67d-4715df8438b9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:43.833976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81116021-ff27-445b-b67d-4715df8438b9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:43.834418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81116021-ff27-445b-b67d-4715df8438b9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:43.835215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81116021-ff27-445b-b67d-4715df8438b9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:43.835857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81116021-ff27-445b-b67d-4715df8438b9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:43.836294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81116021-ff27-445b-b67d-4715df8438b9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:43.839781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:43.986271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-81116021-ff27-445b-b67d-4715df8438b9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:43.998854 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-81116021-ff27-445b-b67d-4715df8438b9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1317 microversion: 2.1 time: 0.174435 Oct 24 10:28:44.009020 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 599/1156] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:43 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:44.015048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-29c64bac-5ace-4a23-8a8b-d44dbd6c1223 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:44.015702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-29c64bac-5ace-4a23-8a8b-d44dbd6c1223 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:44.025165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29c64bac-5ace-4a23-8a8b-d44dbd6c1223 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:44.025888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29c64bac-5ace-4a23-8a8b-d44dbd6c1223 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:44.026503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29c64bac-5ace-4a23-8a8b-d44dbd6c1223 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:44.027214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29c64bac-5ace-4a23-8a8b-d44dbd6c1223 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:44.027671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29c64bac-5ace-4a23-8a8b-d44dbd6c1223 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:44.028093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29c64bac-5ace-4a23-8a8b-d44dbd6c1223 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:44.182879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-29c64bac-5ace-4a23-8a8b-d44dbd6c1223 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:44.193195 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-29c64bac-5ace-4a23-8a8b-d44dbd6c1223 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1313 microversion: 2.1 time: 0.191549 Oct 24 10:28:44.194537 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 600/1157] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:44 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:44.236066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-66eb7daa-b25c-476f-b0da-d22afa3fb423 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:44.237162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-66eb7daa-b25c-476f-b0da-d22afa3fb423 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:44.245211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66eb7daa-b25c-476f-b0da-d22afa3fb423 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:44.245709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66eb7daa-b25c-476f-b0da-d22afa3fb423 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:44.246143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66eb7daa-b25c-476f-b0da-d22afa3fb423 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:44.247113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66eb7daa-b25c-476f-b0da-d22afa3fb423 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:44.247578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66eb7daa-b25c-476f-b0da-d22afa3fb423 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:44.248197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66eb7daa-b25c-476f-b0da-d22afa3fb423 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:44.491539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-66eb7daa-b25c-476f-b0da-d22afa3fb423 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:44.507851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-66eb7daa-b25c-476f-b0da-d22afa3fb423 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:44.509477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-66eb7daa-b25c-476f-b0da-d22afa3fb423 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:44.510977 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-66eb7daa-b25c-476f-b0da-d22afa3fb423 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1557 microversion: 2.25 time: 0.278759 Oct 24 10:28:44.518545 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 601/1158] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:44 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1557 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:28:44.526697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7cfe0ecb-154f-4d25-aa8e-8a2351ee5650 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:44.527366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7cfe0ecb-154f-4d25-aa8e-8a2351ee5650 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:44.546742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cfe0ecb-154f-4d25-aa8e-8a2351ee5650 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:44.547283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cfe0ecb-154f-4d25-aa8e-8a2351ee5650 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:44.547687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cfe0ecb-154f-4d25-aa8e-8a2351ee5650 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:44.548422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cfe0ecb-154f-4d25-aa8e-8a2351ee5650 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:44.549241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cfe0ecb-154f-4d25-aa8e-8a2351ee5650 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:44.549574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cfe0ecb-154f-4d25-aa8e-8a2351ee5650 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:44.661424 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ec92a465-4934-4cc8-a456-831a64501f62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "POST /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.170021 Oct 24 10:28:44.669382 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 558/1159] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 10:28:41 2022] POST /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments => generated 194 bytes in 3179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:44.693662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7c7084d3-ebc7-46cf-bfde-6c201cd0c618 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0c9ddc0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:44.800765 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7c7084d3-ebc7-46cf-bfde-6c201cd0c618 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.129774 Oct 24 10:28:44.802339 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 559/1160] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:44 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:44.808178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a76fb658-ac43-4090-b394-3eee27f6da0b tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:44.822583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a76fb658-ac43-4090-b394-3eee27f6da0b tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:44.830575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a76fb658-ac43-4090-b394-3eee27f6da0b tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:44.831561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a76fb658-ac43-4090-b394-3eee27f6da0b tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:44.832227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a76fb658-ac43-4090-b394-3eee27f6da0b tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:44.833214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a76fb658-ac43-4090-b394-3eee27f6da0b tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:44.833886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a76fb658-ac43-4090-b394-3eee27f6da0b tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:44.834526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a76fb658-ac43-4090-b394-3eee27f6da0b tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:44.869329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=58,nova_cell0:UPDATE=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:44.908472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=32 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:45.064747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:45.065039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7cfe0ecb-154f-4d25-aa8e-8a2351ee5650 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:45.072414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-a76fb658-ac43-4090-b394-3eee27f6da0b tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'services' on Instance uuid b9d7180f-82cf-4113-824a-6350d013baf1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:28:45.081683 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7cfe0ecb-154f-4d25-aa8e-8a2351ee5650 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1332 microversion: 2.1 time: 0.561943 Oct 24 10:28:45.089271 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 602/1161] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:44 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1332 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:45.093059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-87065d0e-02cc-4db7-8270-22067256ad22 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:45.093674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-87065d0e-02cc-4db7-8270-22067256ad22 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:45.095056 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a76fb658-ac43-4090-b394-3eee27f6da0b tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 2050 microversion: 2.25 time: 0.291418 Oct 24 10:28:45.095792 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 560/1162] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:44 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 2050 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:45.102041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-05602d97-2e71-45f1-ac1d-766890e5ce51 req-363770fd-e2fa-4440-9030-df985fc62958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a43af20e-f775-4549-9ee3-1560a5b43b7d", "name": "network-vif-plugged", "status": "completed", "tag": "540ebdb6-65eb-4451-aafd-a3f1d1fd0a82"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:45.112451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87065d0e-02cc-4db7-8270-22067256ad22 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:45.112986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87065d0e-02cc-4db7-8270-22067256ad22 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:45.113432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87065d0e-02cc-4db7-8270-22067256ad22 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:45.114274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87065d0e-02cc-4db7-8270-22067256ad22 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:45.114692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87065d0e-02cc-4db7-8270-22067256ad22 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:45.115496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87065d0e-02cc-4db7-8270-22067256ad22 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:45.150431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-05602d97-2e71-45f1-ac1d-766890e5ce51 req-363770fd-e2fa-4440-9030-df985fc62958 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:45.151294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-05602d97-2e71-45f1-ac1d-766890e5ce51 req-363770fd-e2fa-4440-9030-df985fc62958 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:45.152547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-05602d97-2e71-45f1-ac1d-766890e5ce51 req-363770fd-e2fa-4440-9030-df985fc62958 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:45.193110 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-05602d97-2e71-45f1-ac1d-766890e5ce51 req-363770fd-e2fa-4440-9030-df985fc62958 service nova] Creating event network-vif-plugged:540ebdb6-65eb-4451-aafd-a3f1d1fd0a82 for instance a43af20e-f775-4549-9ee3-1560a5b43b7d on n-h1-858383-15 Oct 24 10:28:45.198660 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-05602d97-2e71-45f1-ac1d-766890e5ce51 req-363770fd-e2fa-4440-9030-df985fc62958 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101433 Oct 24 10:28:45.200085 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 561/1163] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:45.208130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b3cf48b4-e25b-4428-a48d-d917888a7861 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:45.209295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b3cf48b4-e25b-4428-a48d-d917888a7861 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:45.234377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3cf48b4-e25b-4428-a48d-d917888a7861 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:45.240290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3cf48b4-e25b-4428-a48d-d917888a7861 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:45.244051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3cf48b4-e25b-4428-a48d-d917888a7861 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:45.246454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3cf48b4-e25b-4428-a48d-d917888a7861 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:45.249000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3cf48b4-e25b-4428-a48d-d917888a7861 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:45.251056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3cf48b4-e25b-4428-a48d-d917888a7861 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:45.412909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b3cf48b4-e25b-4428-a48d-d917888a7861 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:45.436604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b3cf48b4-e25b-4428-a48d-d917888a7861 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:45.439500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b3cf48b4-e25b-4428-a48d-d917888a7861 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:45.448045 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b3cf48b4-e25b-4428-a48d-d917888a7861 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1438 microversion: 2.75 time: 0.246515 Oct 24 10:28:45.449688 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 562/1164] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:45 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1438 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:45.455301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ae1d0a46-ace5-495b-8f7e-f6b6f4e04991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:45.456031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ae1d0a46-ace5-495b-8f7e-f6b6f4e04991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:45.462724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1d0a46-ace5-495b-8f7e-f6b6f4e04991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:45.463632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1d0a46-ace5-495b-8f7e-f6b6f4e04991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:45.464303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1d0a46-ace5-495b-8f7e-f6b6f4e04991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:45.465449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1d0a46-ace5-495b-8f7e-f6b6f4e04991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:45.466129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1d0a46-ace5-495b-8f7e-f6b6f4e04991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:45.466773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1d0a46-ace5-495b-8f7e-f6b6f4e04991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:45.504084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-87065d0e-02cc-4db7-8270-22067256ad22 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:45.516137 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-87065d0e-02cc-4db7-8270-22067256ad22 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1308 microversion: 2.1 time: 0.432395 Oct 24 10:28:45.520888 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 603/1165] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:45 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1308 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:45.525413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-543572b7-91ea-4877-b22a-8757c5d18e85 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:45.526033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-543572b7-91ea-4877-b22a-8757c5d18e85 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:45.532750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-543572b7-91ea-4877-b22a-8757c5d18e85 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:45.533259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-543572b7-91ea-4877-b22a-8757c5d18e85 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:45.533697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-543572b7-91ea-4877-b22a-8757c5d18e85 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:45.534484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-543572b7-91ea-4877-b22a-8757c5d18e85 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:45.534935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-543572b7-91ea-4877-b22a-8757c5d18e85 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:45.535356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-543572b7-91ea-4877-b22a-8757c5d18e85 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:45.689429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ae1d0a46-ace5-495b-8f7e-f6b6f4e04991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:45.700170 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ae1d0a46-ace5-495b-8f7e-f6b6f4e04991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1317 microversion: 2.1 time: 0.249127 Oct 24 10:28:45.713388 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 563/1166] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:45 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:45.721633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a0f80a4b-88cb-49c4-b81a-490966798de7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:45.722538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a0f80a4b-88cb-49c4-b81a-490966798de7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:45.729217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0f80a4b-88cb-49c4-b81a-490966798de7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:45.729836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0f80a4b-88cb-49c4-b81a-490966798de7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:45.730653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0f80a4b-88cb-49c4-b81a-490966798de7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:45.731218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0f80a4b-88cb-49c4-b81a-490966798de7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:45.731783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0f80a4b-88cb-49c4-b81a-490966798de7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:45.732438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0f80a4b-88cb-49c4-b81a-490966798de7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:45.745605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-543572b7-91ea-4877-b22a-8757c5d18e85 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'services' on Instance uuid b9d7180f-82cf-4113-824a-6350d013baf1 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:28:45.790723 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-543572b7-91ea-4877-b22a-8757c5d18e85 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 2050 microversion: 2.25 time: 0.270747 Oct 24 10:28:45.811186 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 604/1167] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:45 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 2050 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:45.820606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:45.825550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:45.854197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:45.854442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:45.854804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:45.859818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:45.860561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:45.861347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:45.899230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a0f80a4b-88cb-49c4-b81a-490966798de7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:45.908636 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a0f80a4b-88cb-49c4-b81a-490966798de7 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1313 microversion: 2.1 time: 0.193676 Oct 24 10:28:45.909490 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 564/1168] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:45 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:45.932206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-897ff3ec-40bc-43d2-bfe1-8e63b7026130 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0c9b550>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:46.037564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:28:46.039027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:28:46.041140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:28:46.041140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:28:46.041140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:28:46.054452 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-897ff3ec-40bc-43d2-bfe1-8e63b7026130 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.126666 Oct 24 10:28:46.055361 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 565/1169] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:45 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:46.063746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c3a4887c-85de-462e-945d-bf97973b2d94 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:46.072528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3a4887c-85de-462e-945d-bf97973b2d94 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:46.073354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3a4887c-85de-462e-945d-bf97973b2d94 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:46.074525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3a4887c-85de-462e-945d-bf97973b2d94 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:46.075583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3a4887c-85de-462e-945d-bf97973b2d94 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:46.076476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3a4887c-85de-462e-945d-bf97973b2d94 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:46.077152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3a4887c-85de-462e-945d-bf97973b2d94 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:46.110091 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c3a4887c-85de-462e-945d-bf97973b2d94 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.051375 Oct 24 10:28:46.111196 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 566/1170] 10.222.0.50 () {60 vars in 1217 bytes} [Mon Oct 24 10:28:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:28:46.123714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c1008d40-3e41-4215-9308-e49493d95e40 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:46.125634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c1008d40-3e41-4215-9308-e49493d95e40 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:46.134307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1008d40-3e41-4215-9308-e49493d95e40 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:46.134928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1008d40-3e41-4215-9308-e49493d95e40 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:46.135468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1008d40-3e41-4215-9308-e49493d95e40 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:46.136327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1008d40-3e41-4215-9308-e49493d95e40 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:46.136919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1008d40-3e41-4215-9308-e49493d95e40 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:46.137716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1008d40-3e41-4215-9308-e49493d95e40 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:46.182800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:46.205621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:46.212909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:46.219100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:46.222749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:46.223283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:46.226953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:46.484187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:46.501494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:46.505120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:46.511494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c1008d40-3e41-4215-9308-e49493d95e40 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:46.513575 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-097d5688-9398-4c64-9f56-fb9ae017f26a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "POST /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e/action" status: 202 len: 1495 microversion: 2.75 time: 0.700932 Oct 24 10:28:46.520394 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c1008d40-3e41-4215-9308-e49493d95e40 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1332 microversion: 2.1 time: 0.400641 Oct 24 10:28:46.536024 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 605/1171] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Oct 24 10:28:45 2022] POST /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e/action => generated 1495 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 24 10:28:46.540736 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 567/1172] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:46 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1332 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:46.548413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4d827efa-cfa8-423f-b51d-9d34b286ea4a tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:46.548944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4d827efa-cfa8-423f-b51d-9d34b286ea4a tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:46.554622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0c3ccf81-bd49-4bd1-96fc-e74bb930088c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:46.555230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0c3ccf81-bd49-4bd1-96fc-e74bb930088c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:46.558039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d827efa-cfa8-423f-b51d-9d34b286ea4a tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:46.558625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d827efa-cfa8-423f-b51d-9d34b286ea4a tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:46.559077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d827efa-cfa8-423f-b51d-9d34b286ea4a tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:46.559978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d827efa-cfa8-423f-b51d-9d34b286ea4a tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:46.560918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d827efa-cfa8-423f-b51d-9d34b286ea4a tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:46.561344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d827efa-cfa8-423f-b51d-9d34b286ea4a tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:46.567568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c3ccf81-bd49-4bd1-96fc-e74bb930088c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:46.568028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c3ccf81-bd49-4bd1-96fc-e74bb930088c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:46.568529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c3ccf81-bd49-4bd1-96fc-e74bb930088c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:46.573016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c3ccf81-bd49-4bd1-96fc-e74bb930088c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:46.573496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c3ccf81-bd49-4bd1-96fc-e74bb930088c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:46.573939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c3ccf81-bd49-4bd1-96fc-e74bb930088c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:46.654960 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4d827efa-cfa8-423f-b51d-9d34b286ea4a tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1/action" status: 202 len: 0 microversion: 2.25 time: 0.116703 Oct 24 10:28:46.657883 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 606/1173] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Oct 24 10:28:46 2022] POST /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:28:46.679208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5d414672-fb21-4d9b-ba52-955f8aa65ceb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:46.681559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5d414672-fb21-4d9b-ba52-955f8aa65ceb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:46.696628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d414672-fb21-4d9b-ba52-955f8aa65ceb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:46.699532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d414672-fb21-4d9b-ba52-955f8aa65ceb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:46.700981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d414672-fb21-4d9b-ba52-955f8aa65ceb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:46.701938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d414672-fb21-4d9b-ba52-955f8aa65ceb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:46.703190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d414672-fb21-4d9b-ba52-955f8aa65ceb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:46.705229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d414672-fb21-4d9b-ba52-955f8aa65ceb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:46.857890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5d414672-fb21-4d9b-ba52-955f8aa65ceb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:46.877864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5d414672-fb21-4d9b-ba52-955f8aa65ceb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:46.887321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5d414672-fb21-4d9b-ba52-955f8aa65ceb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:46.890086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0c3ccf81-bd49-4bd1-96fc-e74bb930088c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:46.895247 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5d414672-fb21-4d9b-ba52-955f8aa65ceb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.235493 Oct 24 10:28:46.908873 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 607/1174] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:46 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:46.908873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8acfd095-beea-4569-addc-32b33f8bd5f0 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:46.908873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8acfd095-beea-4569-addc-32b33f8bd5f0 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:46.920028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8acfd095-beea-4569-addc-32b33f8bd5f0 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:46.920028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8acfd095-beea-4569-addc-32b33f8bd5f0 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:46.920028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8acfd095-beea-4569-addc-32b33f8bd5f0 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:46.920028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8acfd095-beea-4569-addc-32b33f8bd5f0 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:46.920488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8acfd095-beea-4569-addc-32b33f8bd5f0 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:46.920488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8acfd095-beea-4569-addc-32b33f8bd5f0 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:46.933613 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0c3ccf81-bd49-4bd1-96fc-e74bb930088c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1308 microversion: 2.1 time: 0.390360 Oct 24 10:28:46.934841 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 568/1175] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:46 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1308 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:46.942104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e02c7715-268f-498b-a7e2-90aebdf59686 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:46.942866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e02c7715-268f-498b-a7e2-90aebdf59686 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:46.993849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e02c7715-268f-498b-a7e2-90aebdf59686 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:46.995173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e02c7715-268f-498b-a7e2-90aebdf59686 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:46.996181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e02c7715-268f-498b-a7e2-90aebdf59686 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:47.000669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e02c7715-268f-498b-a7e2-90aebdf59686 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:47.001849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e02c7715-268f-498b-a7e2-90aebdf59686 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:47.004466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e02c7715-268f-498b-a7e2-90aebdf59686 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:47.165246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=19 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:47.309318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-8acfd095-beea-4569-addc-32b33f8bd5f0 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'services' on Instance uuid b9d7180f-82cf-4113-824a-6350d013baf1 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:28:47.352500 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8acfd095-beea-4569-addc-32b33f8bd5f0 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 2055 microversion: 2.25 time: 0.455492 Oct 24 10:28:47.355308 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 608/1176] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:46 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 2055 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:47.361226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9d0dda6c-8fc6-4598-806b-5a648dae95ac tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:47.361824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9d0dda6c-8fc6-4598-806b-5a648dae95ac tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:47.400725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d0dda6c-8fc6-4598-806b-5a648dae95ac tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:47.405321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d0dda6c-8fc6-4598-806b-5a648dae95ac tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:47.406125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d0dda6c-8fc6-4598-806b-5a648dae95ac tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:47.407069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d0dda6c-8fc6-4598-806b-5a648dae95ac tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:47.407554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d0dda6c-8fc6-4598-806b-5a648dae95ac tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:47.407987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d0dda6c-8fc6-4598-806b-5a648dae95ac tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:47.427198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e02c7715-268f-498b-a7e2-90aebdf59686 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:47.470475 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e02c7715-268f-498b-a7e2-90aebdf59686 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1317 microversion: 2.1 time: 0.534316 Oct 24 10:28:47.476498 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 569/1177] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:46 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1317 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:47.505708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-293b4b1a-0da2-4014-a7e4-8248c45318c9 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0c9da60>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:47.610197 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-293b4b1a-0da2-4014-a7e4-8248c45318c9 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.113245 Oct 24 10:28:47.611523 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 570/1178] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:47 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:47.618206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5380a3f-99b9-4882-a356-7fe266b5371a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:47.619269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d5380a3f-99b9-4882-a356-7fe266b5371a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:47.629221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5380a3f-99b9-4882-a356-7fe266b5371a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:47.630032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5380a3f-99b9-4882-a356-7fe266b5371a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:47.631160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5380a3f-99b9-4882-a356-7fe266b5371a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:47.634497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5380a3f-99b9-4882-a356-7fe266b5371a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:47.635229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5380a3f-99b9-4882-a356-7fe266b5371a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:47.635880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5380a3f-99b9-4882-a356-7fe266b5371a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:47.737615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9d0dda6c-8fc6-4598-806b-5a648dae95ac tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:47.753043 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9d0dda6c-8fc6-4598-806b-5a648dae95ac tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1463 microversion: 2.1 time: 0.395916 Oct 24 10:28:47.753735 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 609/1179] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:47 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1463 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:47.780602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e8296dcc-40f7-44ca-9c44-0f3c26a7853b tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:47.782561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e8296dcc-40f7-44ca-9c44-0f3c26a7853b tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:47.790391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8296dcc-40f7-44ca-9c44-0f3c26a7853b tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:47.791029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8296dcc-40f7-44ca-9c44-0f3c26a7853b tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:47.791579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8296dcc-40f7-44ca-9c44-0f3c26a7853b tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:47.792398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8296dcc-40f7-44ca-9c44-0f3c26a7853b tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:47.793357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8296dcc-40f7-44ca-9c44-0f3c26a7853b tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:47.794594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8296dcc-40f7-44ca-9c44-0f3c26a7853b tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:47.890594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d5380a3f-99b9-4882-a356-7fe266b5371a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:47.904828 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d5380a3f-99b9-4882-a356-7fe266b5371a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1332 microversion: 2.1 time: 0.291784 Oct 24 10:28:47.907192 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 571/1180] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:47 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1332 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:47.931677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-baba4265-f082-4619-af91-da8597268abc tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:47.932498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-baba4265-f082-4619-af91-da8597268abc tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:47.940735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-baba4265-f082-4619-af91-da8597268abc tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:47.943896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-baba4265-f082-4619-af91-da8597268abc tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:47.944709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-baba4265-f082-4619-af91-da8597268abc tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:47.947769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-baba4265-f082-4619-af91-da8597268abc tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:47.948455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-baba4265-f082-4619-af91-da8597268abc tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:47.949111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-baba4265-f082-4619-af91-da8597268abc tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:48.055762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-baba4265-f082-4619-af91-da8597268abc tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:48.067226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-baba4265-f082-4619-af91-da8597268abc tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:48.073441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-baba4265-f082-4619-af91-da8597268abc tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:48.085469 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-baba4265-f082-4619-af91-da8597268abc tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.157633 Oct 24 10:28:48.086385 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 572/1181] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:47 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:28:48.091565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5ca5c4c-426f-48ee-b62a-9a0f19b5a23d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:48.092419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d5ca5c4c-426f-48ee-b62a-9a0f19b5a23d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:48.096377 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e8296dcc-40f7-44ca-9c44-0f3c26a7853b tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1616 microversion: 2.1 time: 0.321151 Oct 24 10:28:48.097807 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 610/1182] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:47 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1616 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:28:48.098710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ca5c4c-426f-48ee-b62a-9a0f19b5a23d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:48.099301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ca5c4c-426f-48ee-b62a-9a0f19b5a23d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:48.099842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ca5c4c-426f-48ee-b62a-9a0f19b5a23d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:48.101302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ca5c4c-426f-48ee-b62a-9a0f19b5a23d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:48.101889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ca5c4c-426f-48ee-b62a-9a0f19b5a23d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:48.102530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ca5c4c-426f-48ee-b62a-9a0f19b5a23d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:48.133220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7a1b463f-2857-497a-8cee-498cbf1c16fb tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:48.133827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7a1b463f-2857-497a-8cee-498cbf1c16fb tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:48.144043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a1b463f-2857-497a-8cee-498cbf1c16fb tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:48.146093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a1b463f-2857-497a-8cee-498cbf1c16fb tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:48.146239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a1b463f-2857-497a-8cee-498cbf1c16fb tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:48.148432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a1b463f-2857-497a-8cee-498cbf1c16fb tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:48.149222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a1b463f-2857-497a-8cee-498cbf1c16fb tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:48.149665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a1b463f-2857-497a-8cee-498cbf1c16fb tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:48.215013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7a1b463f-2857-497a-8cee-498cbf1c16fb tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9a13f80d5cf8421781351e88c248c68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2ca01d7aeb4f5e8730aa1023f3601e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:48.215703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7a1b463f-2857-497a-8cee-498cbf1c16fb tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] flavor_id is None. Assuming migration. {{(pid=120426) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 24 10:28:48.216032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7a1b463f-2857-497a-8cee-498cbf1c16fb tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120426) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 24 10:28:48.219177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:48.306302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d5ca5c4c-426f-48ee-b62a-9a0f19b5a23d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:48.330056 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d5ca5c4c-426f-48ee-b62a-9a0f19b5a23d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1487 microversion: 2.1 time: 0.242274 Oct 24 10:28:48.345330 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 573/1183] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:48 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1487 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:48.360207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-901483f5-2013-4b5e-9a95-d0779ad8d75e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:48.374219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-901483f5-2013-4b5e-9a95-d0779ad8d75e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:48.375551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-901483f5-2013-4b5e-9a95-d0779ad8d75e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:48.376076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-901483f5-2013-4b5e-9a95-d0779ad8d75e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:48.458229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-901483f5-2013-4b5e-9a95-d0779ad8d75e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Going to try to stop instance {{(pid=120425) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 10:28:48.501929 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7a1b463f-2857-497a-8cee-498cbf1c16fb tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773/action" status: 202 len: 0 microversion: 2.1 time: 0.373525 Oct 24 10:28:48.506184 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 611/1184] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:28:48 2022] POST /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:28:48.510096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-81842799-2dea-4fcd-9af4-a1bca99e1056 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:48.510787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-81842799-2dea-4fcd-9af4-a1bca99e1056 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:48.517470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81842799-2dea-4fcd-9af4-a1bca99e1056 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:48.517654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81842799-2dea-4fcd-9af4-a1bca99e1056 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:48.518101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81842799-2dea-4fcd-9af4-a1bca99e1056 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:48.518829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81842799-2dea-4fcd-9af4-a1bca99e1056 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:48.519283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81842799-2dea-4fcd-9af4-a1bca99e1056 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:48.519807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81842799-2dea-4fcd-9af4-a1bca99e1056 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:48.529835 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-901483f5-2013-4b5e-9a95-d0779ad8d75e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "POST /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d/action" status: 202 len: 0 microversion: 2.1 time: 0.175790 Oct 24 10:28:48.531332 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 574/1185] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:28:48 2022] POST /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:28:48.552197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ba3faf53-edff-4057-98be-75293f3b80da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:48.554851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ba3faf53-edff-4057-98be-75293f3b80da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:48.566346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba3faf53-edff-4057-98be-75293f3b80da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:48.567198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba3faf53-edff-4057-98be-75293f3b80da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:48.567880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba3faf53-edff-4057-98be-75293f3b80da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:48.568962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba3faf53-edff-4057-98be-75293f3b80da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:48.570209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba3faf53-edff-4057-98be-75293f3b80da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:48.570865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba3faf53-edff-4057-98be-75293f3b80da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:48.828704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-81842799-2dea-4fcd-9af4-a1bca99e1056 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'services' on Instance uuid b9d7180f-82cf-4113-824a-6350d013baf1 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:28:48.860723 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-81842799-2dea-4fcd-9af4-a1bca99e1056 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 2035 microversion: 2.25 time: 0.353371 Oct 24 10:28:48.877050 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 612/1186] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:48 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 2035 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:48.899611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b7283977-9a65-4bd1-9f2b-3f086fecb7fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:48.900499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b7283977-9a65-4bd1-9f2b-3f086fecb7fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:48.911882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ba3faf53-edff-4057-98be-75293f3b80da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:48.916541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7283977-9a65-4bd1-9f2b-3f086fecb7fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:48.917457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7283977-9a65-4bd1-9f2b-3f086fecb7fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:48.922649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7283977-9a65-4bd1-9f2b-3f086fecb7fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:48.923684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7283977-9a65-4bd1-9f2b-3f086fecb7fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:48.923925 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ba3faf53-edff-4057-98be-75293f3b80da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1317 microversion: 2.1 time: 0.388934 Oct 24 10:28:48.924484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7283977-9a65-4bd1-9f2b-3f086fecb7fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:48.925559 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 575/1187] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:48 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:48.933419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7283977-9a65-4bd1-9f2b-3f086fecb7fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:48.940250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1bcdb157-7899-4bd9-bb32-6ad5708d9424 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:48.945223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1bcdb157-7899-4bd9-bb32-6ad5708d9424 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:48.952226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bcdb157-7899-4bd9-bb32-6ad5708d9424 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:48.952722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bcdb157-7899-4bd9-bb32-6ad5708d9424 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:48.953190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bcdb157-7899-4bd9-bb32-6ad5708d9424 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:48.953896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bcdb157-7899-4bd9-bb32-6ad5708d9424 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:48.954361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bcdb157-7899-4bd9-bb32-6ad5708d9424 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:48.954787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bcdb157-7899-4bd9-bb32-6ad5708d9424 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:49.237031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b7283977-9a65-4bd1-9f2b-3f086fecb7fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:49.254753 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b7283977-9a65-4bd1-9f2b-3f086fecb7fc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1472 microversion: 2.1 time: 0.375378 Oct 24 10:28:49.255358 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 613/1188] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:48 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1472 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:49.263056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fe9579ec-db79-432f-b0be-44731e55cddb tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0a3d430>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:49.301213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1bcdb157-7899-4bd9-bb32-6ad5708d9424 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:49.316739 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1bcdb157-7899-4bd9-bb32-6ad5708d9424 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.385329 Oct 24 10:28:49.318397 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 576/1189] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:48 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:49.327553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0717f062-125a-46e9-a813-9257e39fbe02 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-15", "block_migration": "auto"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:49.330103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0717f062-125a-46e9-a813-9257e39fbe02 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:49.336417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0717f062-125a-46e9-a813-9257e39fbe02 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:49.337110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0717f062-125a-46e9-a813-9257e39fbe02 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:49.337399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0717f062-125a-46e9-a813-9257e39fbe02 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:49.338174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0717f062-125a-46e9-a813-9257e39fbe02 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:49.338632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0717f062-125a-46e9-a813-9257e39fbe02 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:49.339051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0717f062-125a-46e9-a813-9257e39fbe02 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:49.365457 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fe9579ec-db79-432f-b0be-44731e55cddb tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.108405 Oct 24 10:28:49.368029 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 614/1190] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:49 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:49.373854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6378950f-2e0c-48d1-83f6-a6a8575961ac tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:49.375421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6378950f-2e0c-48d1-83f6-a6a8575961ac tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:49.392108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6378950f-2e0c-48d1-83f6-a6a8575961ac tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:49.392706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6378950f-2e0c-48d1-83f6-a6a8575961ac tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:49.393385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6378950f-2e0c-48d1-83f6-a6a8575961ac tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:49.394199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6378950f-2e0c-48d1-83f6-a6a8575961ac tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:49.394732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6378950f-2e0c-48d1-83f6-a6a8575961ac tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:49.395298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6378950f-2e0c-48d1-83f6-a6a8575961ac tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:49.399800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-0717f062-125a-46e9-a813-9257e39fbe02 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'flavor' on Instance uuid b9d7180f-82cf-4113-824a-6350d013baf1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:28:49.432485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0717f062-125a-46e9-a813-9257e39fbe02 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Going to try to live migrate instance to n-h2-858383-15 {{(pid=120425) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 24 10:28:49.519154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:49.649964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6378950f-2e0c-48d1-83f6-a6a8575961ac tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:49.660627 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6378950f-2e0c-48d1-83f6-a6a8575961ac tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1332 microversion: 2.1 time: 0.291217 Oct 24 10:28:49.661509 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 615/1191] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:49 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1332 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:49.666860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-46fe7bb5-a254-4c68-87a5-2d3a3c89e554 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:49.667678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-46fe7bb5-a254-4c68-87a5-2d3a3c89e554 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:49.686971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46fe7bb5-a254-4c68-87a5-2d3a3c89e554 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:49.687585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46fe7bb5-a254-4c68-87a5-2d3a3c89e554 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:49.688094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46fe7bb5-a254-4c68-87a5-2d3a3c89e554 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:49.689204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46fe7bb5-a254-4c68-87a5-2d3a3c89e554 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:49.689742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46fe7bb5-a254-4c68-87a5-2d3a3c89e554 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:49.690325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46fe7bb5-a254-4c68-87a5-2d3a3c89e554 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:49.822807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-46fe7bb5-a254-4c68-87a5-2d3a3c89e554 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:49.837051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-46fe7bb5-a254-4c68-87a5-2d3a3c89e554 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:49.841628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-46fe7bb5-a254-4c68-87a5-2d3a3c89e554 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:49.849806 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-46fe7bb5-a254-4c68-87a5-2d3a3c89e554 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.186758 Oct 24 10:28:49.852696 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 616/1192] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:49 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:49.956336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d030469a-5395-48e3-a09d-b80e9c67ca71 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:49.959426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d030469a-5395-48e3-a09d-b80e9c67ca71 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:49.973241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d030469a-5395-48e3-a09d-b80e9c67ca71 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:49.974419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d030469a-5395-48e3-a09d-b80e9c67ca71 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:49.975108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d030469a-5395-48e3-a09d-b80e9c67ca71 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:49.978405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d030469a-5395-48e3-a09d-b80e9c67ca71 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:49.979137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d030469a-5395-48e3-a09d-b80e9c67ca71 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:49.979800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d030469a-5395-48e3-a09d-b80e9c67ca71 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:50.228175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d030469a-5395-48e3-a09d-b80e9c67ca71 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:50.242135 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d030469a-5395-48e3-a09d-b80e9c67ca71 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1317 microversion: 2.1 time: 0.297116 Oct 24 10:28:50.265629 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 617/1193] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:49 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:28:50.281485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1ab763c3-e9b0-4203-b83c-5e1c3310a419 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:50.282519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1ab763c3-e9b0-4203-b83c-5e1c3310a419 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:50.291318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ab763c3-e9b0-4203-b83c-5e1c3310a419 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:50.292131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ab763c3-e9b0-4203-b83c-5e1c3310a419 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:50.294265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ab763c3-e9b0-4203-b83c-5e1c3310a419 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:50.295197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ab763c3-e9b0-4203-b83c-5e1c3310a419 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:50.301761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ab763c3-e9b0-4203-b83c-5e1c3310a419 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:50.302309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ab763c3-e9b0-4203-b83c-5e1c3310a419 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:50.594942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1ab763c3-e9b0-4203-b83c-5e1c3310a419 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:50.609428 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1ab763c3-e9b0-4203-b83c-5e1c3310a419 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1472 microversion: 2.1 time: 0.333206 Oct 24 10:28:50.610150 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 618/1194] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:50 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1472 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:50.615663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-92a09dd6-9e37-4df6-a81f-b9b2191b65a7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:50.616802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-92a09dd6-9e37-4df6-a81f-b9b2191b65a7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:50.642652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92a09dd6-9e37-4df6-a81f-b9b2191b65a7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:50.642807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92a09dd6-9e37-4df6-a81f-b9b2191b65a7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:50.644257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92a09dd6-9e37-4df6-a81f-b9b2191b65a7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:50.645080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92a09dd6-9e37-4df6-a81f-b9b2191b65a7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:50.646485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92a09dd6-9e37-4df6-a81f-b9b2191b65a7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:50.646996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92a09dd6-9e37-4df6-a81f-b9b2191b65a7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:50.901785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-92a09dd6-9e37-4df6-a81f-b9b2191b65a7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:50.915628 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-92a09dd6-9e37-4df6-a81f-b9b2191b65a7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.301161 Oct 24 10:28:50.916398 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 619/1195] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:50 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:50.926375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1025bf7f-8779-4bac-aa4d-5a7b1ac279d7 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0aba5e0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:50.989344 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1025bf7f-8779-4bac-aa4d-5a7b1ac279d7 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.071076 Oct 24 10:28:50.990581 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 620/1196] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:50 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:50.997884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a3cd296e-fee9-4bf2-8968-cf4b945187ed tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:50.999153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a3cd296e-fee9-4bf2-8968-cf4b945187ed tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:51.008532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3cd296e-fee9-4bf2-8968-cf4b945187ed tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:51.009631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3cd296e-fee9-4bf2-8968-cf4b945187ed tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:51.010318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3cd296e-fee9-4bf2-8968-cf4b945187ed tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:51.011306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3cd296e-fee9-4bf2-8968-cf4b945187ed tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:51.011984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3cd296e-fee9-4bf2-8968-cf4b945187ed tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:51.012628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3cd296e-fee9-4bf2-8968-cf4b945187ed tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:51.253241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a3cd296e-fee9-4bf2-8968-cf4b945187ed tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:51.272999 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a3cd296e-fee9-4bf2-8968-cf4b945187ed tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1332 microversion: 2.1 time: 0.279671 Oct 24 10:28:51.274256 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 621/1197] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:50 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1332 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:51.286043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-03f95422-0e99-4606-9dc0-8678b38b1297 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:51.286801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-03f95422-0e99-4606-9dc0-8678b38b1297 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:51.316136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03f95422-0e99-4606-9dc0-8678b38b1297 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:51.318597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03f95422-0e99-4606-9dc0-8678b38b1297 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:51.320486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03f95422-0e99-4606-9dc0-8678b38b1297 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:51.323638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03f95422-0e99-4606-9dc0-8678b38b1297 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:51.326384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03f95422-0e99-4606-9dc0-8678b38b1297 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:51.327016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03f95422-0e99-4606-9dc0-8678b38b1297 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:51.524680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-03f95422-0e99-4606-9dc0-8678b38b1297 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:51.556968 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0717f062-125a-46e9-a813-9257e39fbe02 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1/action" status: 202 len: 0 microversion: 2.25 time: 2.237211 Oct 24 10:28:51.558332 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 577/1198] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Oct 24 10:28:49 2022] POST /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1/action => generated 0 bytes in 2239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:28:51.570912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-94d4180e-9641-4731-ac90-74207cb42f42 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:51.572801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-94d4180e-9641-4731-ac90-74207cb42f42 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:51.577320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-03f95422-0e99-4606-9dc0-8678b38b1297 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:51.579351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-03f95422-0e99-4606-9dc0-8678b38b1297 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:51.600820 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-03f95422-0e99-4606-9dc0-8678b38b1297 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.323620 Oct 24 10:28:51.601810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94d4180e-9641-4731-ac90-74207cb42f42 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:51.602322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94d4180e-9641-4731-ac90-74207cb42f42 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:51.602754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94d4180e-9641-4731-ac90-74207cb42f42 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:51.603482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94d4180e-9641-4731-ac90-74207cb42f42 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:51.603938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94d4180e-9641-4731-ac90-74207cb42f42 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:51.604365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94d4180e-9641-4731-ac90-74207cb42f42 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:51.616605 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 622/1199] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:51 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:51.623472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2e73734a-2f33-4b18-b2f8-6e44d7bd886e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:51.624744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2e73734a-2f33-4b18-b2f8-6e44d7bd886e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:51.638424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:51.653030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e73734a-2f33-4b18-b2f8-6e44d7bd886e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:51.656156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e73734a-2f33-4b18-b2f8-6e44d7bd886e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:51.656875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e73734a-2f33-4b18-b2f8-6e44d7bd886e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:51.662829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e73734a-2f33-4b18-b2f8-6e44d7bd886e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:51.663454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e73734a-2f33-4b18-b2f8-6e44d7bd886e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:51.663946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e73734a-2f33-4b18-b2f8-6e44d7bd886e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:52.387117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-94d4180e-9641-4731-ac90-74207cb42f42 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:52.395853 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-94d4180e-9641-4731-ac90-74207cb42f42 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1317 microversion: 2.1 time: 0.832373 Oct 24 10:28:52.408100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2e73734a-2f33-4b18-b2f8-6e44d7bd886e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:52.416196 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 578/1200] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:51 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1317 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:52.421386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2e73734a-2f33-4b18-b2f8-6e44d7bd886e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:52.422931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2e73734a-2f33-4b18-b2f8-6e44d7bd886e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:52.424260 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2e73734a-2f33-4b18-b2f8-6e44d7bd886e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1567 microversion: 2.25 time: 0.812581 Oct 24 10:28:52.425059 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 623/1201] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:51 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1567 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:52.437830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f43d30f0-50e6-49e4-beb7-073e650833fe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:52.438841 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f43d30f0-50e6-49e4-beb7-073e650833fe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:52.446690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-d8df6cff-fb49-477d-bc67-29ef715b47e0 req-82e37e5b-3889-46f4-a210-d25faa317052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d47d8d5-f7d0-49c4-839a-92bababf20e7", "name": "network-vif-plugged", "status": "completed", "tag": "9d03d2ef-8a17-4594-b487-37b1ca2cc10b"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:52.450753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f43d30f0-50e6-49e4-beb7-073e650833fe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:52.451552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f43d30f0-50e6-49e4-beb7-073e650833fe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:52.455042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f43d30f0-50e6-49e4-beb7-073e650833fe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:52.456156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f43d30f0-50e6-49e4-beb7-073e650833fe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:52.456624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f43d30f0-50e6-49e4-beb7-073e650833fe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:52.457086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f43d30f0-50e6-49e4-beb7-073e650833fe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:52.480874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d8df6cff-fb49-477d-bc67-29ef715b47e0 req-82e37e5b-3889-46f4-a210-d25faa317052 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:52.480874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d8df6cff-fb49-477d-bc67-29ef715b47e0 req-82e37e5b-3889-46f4-a210-d25faa317052 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:52.480874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d8df6cff-fb49-477d-bc67-29ef715b47e0 req-82e37e5b-3889-46f4-a210-d25faa317052 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:52.499675 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-d8df6cff-fb49-477d-bc67-29ef715b47e0 req-82e37e5b-3889-46f4-a210-d25faa317052 service nova] Creating event network-vif-plugged:9d03d2ef-8a17-4594-b487-37b1ca2cc10b for instance 8d47d8d5-f7d0-49c4-839a-92bababf20e7 on n-h2-858383-15 Oct 24 10:28:52.513311 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-d8df6cff-fb49-477d-bc67-29ef715b47e0 req-82e37e5b-3889-46f4-a210-d25faa317052 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072875 Oct 24 10:28:52.514204 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 624/1202] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:52.524696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-756c9e5f-3cb0-4338-87d2-8105cc8e6e39 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:52.525439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-756c9e5f-3cb0-4338-87d2-8105cc8e6e39 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:52.531975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-756c9e5f-3cb0-4338-87d2-8105cc8e6e39 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:52.532471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-756c9e5f-3cb0-4338-87d2-8105cc8e6e39 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:52.532938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-756c9e5f-3cb0-4338-87d2-8105cc8e6e39 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:52.533655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-756c9e5f-3cb0-4338-87d2-8105cc8e6e39 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:52.534111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-756c9e5f-3cb0-4338-87d2-8105cc8e6e39 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:52.534539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-756c9e5f-3cb0-4338-87d2-8105cc8e6e39 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:52.868327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f43d30f0-50e6-49e4-beb7-073e650833fe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:52.877269 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f43d30f0-50e6-49e4-beb7-073e650833fe tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1472 microversion: 2.1 time: 0.459562 Oct 24 10:28:52.882536 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 579/1203] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:52 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1472 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:52.888066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5609094b-3bf1-461a-8611-631a137129ee tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0bbf820>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:52.998564 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5609094b-3bf1-461a-8611-631a137129ee tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.114114 Oct 24 10:28:53.008805 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 580/1204] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:52 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:53.014363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-39ca2a78-61de-43ea-81b5-a9c351da9748 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:53.015410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-39ca2a78-61de-43ea-81b5-a9c351da9748 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:53.023927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39ca2a78-61de-43ea-81b5-a9c351da9748 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:53.024900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39ca2a78-61de-43ea-81b5-a9c351da9748 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:53.025605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39ca2a78-61de-43ea-81b5-a9c351da9748 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:53.027244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39ca2a78-61de-43ea-81b5-a9c351da9748 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:53.028004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39ca2a78-61de-43ea-81b5-a9c351da9748 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:53.028819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39ca2a78-61de-43ea-81b5-a9c351da9748 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:53.037231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-756c9e5f-3cb0-4338-87d2-8105cc8e6e39 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:53.052006 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-756c9e5f-3cb0-4338-87d2-8105cc8e6e39 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.536537 Oct 24 10:28:53.055974 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 625/1205] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:52 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:53.065199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-169bd7dd-2ef6-4d59-b036-f7869206a540 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:53.070139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-169bd7dd-2ef6-4d59-b036-f7869206a540 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:53.084552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-169bd7dd-2ef6-4d59-b036-f7869206a540 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:53.085733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-169bd7dd-2ef6-4d59-b036-f7869206a540 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:53.086181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-169bd7dd-2ef6-4d59-b036-f7869206a540 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:53.086918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-169bd7dd-2ef6-4d59-b036-f7869206a540 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:53.089477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-169bd7dd-2ef6-4d59-b036-f7869206a540 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:53.097283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-169bd7dd-2ef6-4d59-b036-f7869206a540 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:53.222270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-169bd7dd-2ef6-4d59-b036-f7869206a540 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:53.233641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-169bd7dd-2ef6-4d59-b036-f7869206a540 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:53.235403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-169bd7dd-2ef6-4d59-b036-f7869206a540 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:53.242107 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-169bd7dd-2ef6-4d59-b036-f7869206a540 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.183851 Oct 24 10:28:53.243475 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 626/1206] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:53 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:53.302491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-39ca2a78-61de-43ea-81b5-a9c351da9748 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:53.311391 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-39ca2a78-61de-43ea-81b5-a9c351da9748 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1332 microversion: 2.1 time: 0.300998 Oct 24 10:28:53.329128 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 581/1207] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:53 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1332 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:53.424547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-388181a1-1e7c-4ec1-90a3-0cb809f3c8aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:53.426466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-388181a1-1e7c-4ec1-90a3-0cb809f3c8aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:53.434141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-388181a1-1e7c-4ec1-90a3-0cb809f3c8aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:53.434750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-388181a1-1e7c-4ec1-90a3-0cb809f3c8aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:53.435407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-388181a1-1e7c-4ec1-90a3-0cb809f3c8aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:53.436350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-388181a1-1e7c-4ec1-90a3-0cb809f3c8aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:53.436932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-388181a1-1e7c-4ec1-90a3-0cb809f3c8aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:53.437458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-388181a1-1e7c-4ec1-90a3-0cb809f3c8aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:53.455225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-da4f703f-eb4e-42e2-883f-bec7c99b5b38 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:53.456218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-da4f703f-eb4e-42e2-883f-bec7c99b5b38 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:53.470547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da4f703f-eb4e-42e2-883f-bec7c99b5b38 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:53.475906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da4f703f-eb4e-42e2-883f-bec7c99b5b38 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:53.477711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da4f703f-eb4e-42e2-883f-bec7c99b5b38 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:53.480094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da4f703f-eb4e-42e2-883f-bec7c99b5b38 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:53.480741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da4f703f-eb4e-42e2-883f-bec7c99b5b38 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:53.481752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da4f703f-eb4e-42e2-883f-bec7c99b5b38 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:53.758248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-388181a1-1e7c-4ec1-90a3-0cb809f3c8aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:53.771094 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-388181a1-1e7c-4ec1-90a3-0cb809f3c8aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1317 microversion: 2.1 time: 0.354439 Oct 24 10:28:53.771701 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 627/1208] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:53 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:53.793853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-da4f703f-eb4e-42e2-883f-bec7c99b5b38 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:53.802798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-da4f703f-eb4e-42e2-883f-bec7c99b5b38 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:53.805632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-da4f703f-eb4e-42e2-883f-bec7c99b5b38 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:53.807059 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-da4f703f-eb4e-42e2-883f-bec7c99b5b38 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1567 microversion: 2.25 time: 0.356366 Oct 24 10:28:53.808293 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 582/1209] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:53 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1567 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:28:53.908203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a78eda5b-ca8c-4fef-8425-c8595821c2c3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:53.909139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a78eda5b-ca8c-4fef-8425-c8595821c2c3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:53.916586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a78eda5b-ca8c-4fef-8425-c8595821c2c3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:53.917466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a78eda5b-ca8c-4fef-8425-c8595821c2c3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:53.918395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a78eda5b-ca8c-4fef-8425-c8595821c2c3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:53.919367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a78eda5b-ca8c-4fef-8425-c8595821c2c3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:53.919994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a78eda5b-ca8c-4fef-8425-c8595821c2c3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:53.920438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a78eda5b-ca8c-4fef-8425-c8595821c2c3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:54.017772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ba18d91a-7478-4c3f-8f1c-9f37bce40a7f tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0bd7b80>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:54.080660 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ba18d91a-7478-4c3f-8f1c-9f37bce40a7f tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1452 microversion: 2.1 time: 0.068486 Oct 24 10:28:54.081903 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 583/1210] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:54 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1452 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:28:54.088727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-07ee2ab2-f79f-4886-ad6e-dbf0c67aac4d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:54.089451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-07ee2ab2-f79f-4886-ad6e-dbf0c67aac4d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:54.102563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07ee2ab2-f79f-4886-ad6e-dbf0c67aac4d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:54.103386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07ee2ab2-f79f-4886-ad6e-dbf0c67aac4d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:54.104032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07ee2ab2-f79f-4886-ad6e-dbf0c67aac4d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:54.104991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07ee2ab2-f79f-4886-ad6e-dbf0c67aac4d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:54.105652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07ee2ab2-f79f-4886-ad6e-dbf0c67aac4d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:54.106299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07ee2ab2-f79f-4886-ad6e-dbf0c67aac4d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:54.113132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a78eda5b-ca8c-4fef-8425-c8595821c2c3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:54.124463 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a78eda5b-ca8c-4fef-8425-c8595821c2c3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1477 microversion: 2.1 time: 0.220682 Oct 24 10:28:54.130424 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 628/1211] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:53 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1477 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:54.271909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-83f47772-42da-41ee-8f48-203d4da02510 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:54.273707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-83f47772-42da-41ee-8f48-203d4da02510 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:54.280175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83f47772-42da-41ee-8f48-203d4da02510 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:54.280674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83f47772-42da-41ee-8f48-203d4da02510 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:54.281296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83f47772-42da-41ee-8f48-203d4da02510 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:54.282099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83f47772-42da-41ee-8f48-203d4da02510 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:54.282510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83f47772-42da-41ee-8f48-203d4da02510 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:54.283167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83f47772-42da-41ee-8f48-203d4da02510 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:54.286359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:54.403534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-07ee2ab2-f79f-4886-ad6e-dbf0c67aac4d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:54.407474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-83f47772-42da-41ee-8f48-203d4da02510 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:54.411757 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-07ee2ab2-f79f-4886-ad6e-dbf0c67aac4d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.328608 Oct 24 10:28:54.412335 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 584/1212] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:54 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:54.416755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-83f47772-42da-41ee-8f48-203d4da02510 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:54.417369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-387d95fd-cfc9-4e8a-8846-52567b6a524d tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:54.418228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-83f47772-42da-41ee-8f48-203d4da02510 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:54.418678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-387d95fd-cfc9-4e8a-8846-52567b6a524d tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:54.423334 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-83f47772-42da-41ee-8f48-203d4da02510 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.155587 Oct 24 10:28:54.425249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-387d95fd-cfc9-4e8a-8846-52567b6a524d tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:54.425971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-387d95fd-cfc9-4e8a-8846-52567b6a524d tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:54.426670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-387d95fd-cfc9-4e8a-8846-52567b6a524d tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:54.427601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-387d95fd-cfc9-4e8a-8846-52567b6a524d tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:54.428311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-387d95fd-cfc9-4e8a-8846-52567b6a524d tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:54.429185 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 629/1213] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:54 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:54.430129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-387d95fd-cfc9-4e8a-8846-52567b6a524d tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:54.531247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-06096e77-6d85-4c9b-970e-500b88a915fa req-f5433a4b-00d0-4ed5-9dbe-d89fa3849e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76cff000-3122-4b18-89a9-c679033be122", "name": "network-vif-plugged", "status": "completed", "tag": "b8b62cc8-0a2d-4606-bc4b-f89a074e7a49"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:54.542473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-06096e77-6d85-4c9b-970e-500b88a915fa req-f5433a4b-00d0-4ed5-9dbe-d89fa3849e2c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:54.542956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-06096e77-6d85-4c9b-970e-500b88a915fa req-f5433a4b-00d0-4ed5-9dbe-d89fa3849e2c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:54.543468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-06096e77-6d85-4c9b-970e-500b88a915fa req-f5433a4b-00d0-4ed5-9dbe-d89fa3849e2c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:54.555649 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-06096e77-6d85-4c9b-970e-500b88a915fa req-f5433a4b-00d0-4ed5-9dbe-d89fa3849e2c service nova] Creating event network-vif-plugged:b8b62cc8-0a2d-4606-bc4b-f89a074e7a49 for instance 76cff000-3122-4b18-89a9-c679033be122 on n-h2-858383-15 Oct 24 10:28:54.560522 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-06096e77-6d85-4c9b-970e-500b88a915fa req-f5433a4b-00d0-4ed5-9dbe-d89fa3849e2c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033056 Oct 24 10:28:54.561176 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 630/1214] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:28:54.613164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-cf291696-11d5-4926-a8b9-cb54c89a932c req-d0c48f06-f4bf-49d2-8efc-b092b6e3d2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d7180f-82cf-4113-824a-6350d013baf1", "name": "network-vif-unplugged", "status": "completed", "tag": "af23d072-0dd6-45cf-9412-eb509fb3c310"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:54.624509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cf291696-11d5-4926-a8b9-cb54c89a932c req-d0c48f06-f4bf-49d2-8efc-b092b6e3d2e4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:54.625287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cf291696-11d5-4926-a8b9-cb54c89a932c req-d0c48f06-f4bf-49d2-8efc-b092b6e3d2e4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:54.625724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cf291696-11d5-4926-a8b9-cb54c89a932c req-d0c48f06-f4bf-49d2-8efc-b092b6e3d2e4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:54.637463 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-cf291696-11d5-4926-a8b9-cb54c89a932c req-d0c48f06-f4bf-49d2-8efc-b092b6e3d2e4 service nova] Creating event network-vif-unplugged:af23d072-0dd6-45cf-9412-eb509fb3c310 for instance b9d7180f-82cf-4113-824a-6350d013baf1 on n-h1-858383-15 Oct 24 10:28:54.642218 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-cf291696-11d5-4926-a8b9-cb54c89a932c req-d0c48f06-f4bf-49d2-8efc-b092b6e3d2e4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033473 Oct 24 10:28:54.642815 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 631/1215] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:28:54.665614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-387d95fd-cfc9-4e8a-8846-52567b6a524d tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:54.673493 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-387d95fd-cfc9-4e8a-8846-52567b6a524d tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1332 microversion: 2.1 time: 0.259869 Oct 24 10:28:54.673998 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 585/1216] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:54 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1332 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:54.799240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3b1c3b95-fcd8-42a2-88ad-503a4e4852e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:54.799794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3b1c3b95-fcd8-42a2-88ad-503a4e4852e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:54.807892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1c3b95-fcd8-42a2-88ad-503a4e4852e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:54.808379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1c3b95-fcd8-42a2-88ad-503a4e4852e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:54.808809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1c3b95-fcd8-42a2-88ad-503a4e4852e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:54.809590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1c3b95-fcd8-42a2-88ad-503a4e4852e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:54.823505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1c3b95-fcd8-42a2-88ad-503a4e4852e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:54.824072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1c3b95-fcd8-42a2-88ad-503a4e4852e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:54.836773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-29d938d1-5717-4c3e-ba0e-cc552a6b5615 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:54.837511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-29d938d1-5717-4c3e-ba0e-cc552a6b5615 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:54.844041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29d938d1-5717-4c3e-ba0e-cc552a6b5615 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:54.844578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29d938d1-5717-4c3e-ba0e-cc552a6b5615 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:54.845340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29d938d1-5717-4c3e-ba0e-cc552a6b5615 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:54.846107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29d938d1-5717-4c3e-ba0e-cc552a6b5615 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:54.846847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29d938d1-5717-4c3e-ba0e-cc552a6b5615 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:54.847339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29d938d1-5717-4c3e-ba0e-cc552a6b5615 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:55.409927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-29d938d1-5717-4c3e-ba0e-cc552a6b5615 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:55.419024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3b1c3b95-fcd8-42a2-88ad-503a4e4852e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:55.419211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-29d938d1-5717-4c3e-ba0e-cc552a6b5615 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:55.420595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-29d938d1-5717-4c3e-ba0e-cc552a6b5615 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:55.421902 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-29d938d1-5717-4c3e-ba0e-cc552a6b5615 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1567 microversion: 2.25 time: 0.590801 Oct 24 10:28:55.422464 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 586/1217] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:54 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1567 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:28:55.434636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0658187a-b8d4-46a1-ac48-a3bf33877556 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0ca84c0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:55.436293 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3b1c3b95-fcd8-42a2-88ad-503a4e4852e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1317 microversion: 2.1 time: 0.644792 Oct 24 10:28:55.441612 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 632/1218] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:54 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1317 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:55.446336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6b9ead33-b57a-4dfc-b3e6-e8871464d55e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:55.447138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6b9ead33-b57a-4dfc-b3e6-e8871464d55e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:55.453060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b9ead33-b57a-4dfc-b3e6-e8871464d55e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:55.453541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b9ead33-b57a-4dfc-b3e6-e8871464d55e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:55.453975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b9ead33-b57a-4dfc-b3e6-e8871464d55e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:55.454672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b9ead33-b57a-4dfc-b3e6-e8871464d55e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:55.455121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b9ead33-b57a-4dfc-b3e6-e8871464d55e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:55.455542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b9ead33-b57a-4dfc-b3e6-e8871464d55e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:55.476961 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0658187a-b8d4-46a1-ac48-a3bf33877556 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1461 microversion: 2.1 time: 0.051692 Oct 24 10:28:55.477780 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 587/1219] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:55 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1461 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:55.482138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6f64226d-c032-48f5-afea-f7b9693998e1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:55.482735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6f64226d-c032-48f5-afea-f7b9693998e1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:55.489456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f64226d-c032-48f5-afea-f7b9693998e1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:55.489940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f64226d-c032-48f5-afea-f7b9693998e1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:55.490374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f64226d-c032-48f5-afea-f7b9693998e1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:55.491142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f64226d-c032-48f5-afea-f7b9693998e1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:55.492105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f64226d-c032-48f5-afea-f7b9693998e1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:55.492532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f64226d-c032-48f5-afea-f7b9693998e1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:55.643688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6b9ead33-b57a-4dfc-b3e6-e8871464d55e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:55.653890 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6b9ead33-b57a-4dfc-b3e6-e8871464d55e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1477 microversion: 2.1 time: 0.211176 Oct 24 10:28:55.656531 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 633/1220] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:55 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1477 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:55.674371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6f64226d-c032-48f5-afea-f7b9693998e1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:55.676101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-610fe126-90bd-4e90-9b89-66938fca1147 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:55.676713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-610fe126-90bd-4e90-9b89-66938fca1147 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:55.683936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-610fe126-90bd-4e90-9b89-66938fca1147 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:55.684421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-610fe126-90bd-4e90-9b89-66938fca1147 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:55.684884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-610fe126-90bd-4e90-9b89-66938fca1147 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:55.685590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-610fe126-90bd-4e90-9b89-66938fca1147 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:55.686044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-610fe126-90bd-4e90-9b89-66938fca1147 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:55.686467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-610fe126-90bd-4e90-9b89-66938fca1147 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:55.687044 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6f64226d-c032-48f5-afea-f7b9693998e1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.208349 Oct 24 10:28:55.687820 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 588/1221] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:55 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:55.692034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e99fd83-4dcb-4beb-85f2-2da4b422eed3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0bd94c0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:55.740076 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e99fd83-4dcb-4beb-85f2-2da4b422eed3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 200 len: 1461 microversion: 2.1 time: 0.051410 Oct 24 10:28:55.747773 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 589/1222] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:28:55 2022] GET /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 1461 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:55.747773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b7ab6268-4b94-4a81-b562-bc8c279fa504 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:55.747773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b7ab6268-4b94-4a81-b562-bc8c279fa504 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:55.753127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b7ab6268-4b94-4a81-b562-bc8c279fa504 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:55.753609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b7ab6268-4b94-4a81-b562-bc8c279fa504 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:55.754040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b7ab6268-4b94-4a81-b562-bc8c279fa504 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:55.754737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b7ab6268-4b94-4a81-b562-bc8c279fa504 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:55.755192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b7ab6268-4b94-4a81-b562-bc8c279fa504 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:55.755626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b7ab6268-4b94-4a81-b562-bc8c279fa504 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:55.781277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-610fe126-90bd-4e90-9b89-66938fca1147 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:55.790176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-610fe126-90bd-4e90-9b89-66938fca1147 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:55.791613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-610fe126-90bd-4e90-9b89-66938fca1147 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:55.798388 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-610fe126-90bd-4e90-9b89-66938fca1147 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.126355 Oct 24 10:28:55.799171 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 634/1223] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:55 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:55.804759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c85b7446-113e-404c-b928-decb33403639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:55.804759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c85b7446-113e-404c-b928-decb33403639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: a8f749f9-5771-4ecb-8a06-30a8f69dd848] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:55.811102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c85b7446-113e-404c-b928-decb33403639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:55.811588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c85b7446-113e-404c-b928-decb33403639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:55.812023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c85b7446-113e-404c-b928-decb33403639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:55.812745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c85b7446-113e-404c-b928-decb33403639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:55.813328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c85b7446-113e-404c-b928-decb33403639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:55.814822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c85b7446-113e-404c-b928-decb33403639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:55.953861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b7ab6268-4b94-4a81-b562-bc8c279fa504 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:55.962223 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b7ab6268-4b94-4a81-b562-bc8c279fa504 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1534 microversion: 2.1 time: 0.219774 Oct 24 10:28:55.962939 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 590/1224] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:55 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1534 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:55.985705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-04a49192-1e92-47d7-a75d-8fff982b771d tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Action: 'create', calling method: .version_select at 0x7f04d0ca83a0>, body: {"pool": "305071bc-8358-45a9-b0bc-51f65747bb90"} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:55.989433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c85b7446-113e-404c-b928-decb33403639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:55.998018 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c85b7446-113e-404c-b928-decb33403639 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848" status: 200 len: 1466 microversion: 2.1 time: 0.198062 Oct 24 10:28:55.998597 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 635/1225] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:55 2022] GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848 => generated 1466 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:56.020707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5ae00e8c-8cb4-40cb-a28d-ef00458d3aea tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0aba1f0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:56.085659 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:56.128378 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5ae00e8c-8cb4-40cb-a28d-ef00458d3aea tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images?changes-since=2022-10-24T10%3A26%3A37Z" status: 200 len: 1901 microversion: 2.1 time: 0.111301 Oct 24 10:28:56.129035 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 636/1226] 10.222.0.50 () {58 vars in 1199 bytes} [Mon Oct 24 10:28:56 2022] GET /compute/v2.1/images?changes-since=2022-10-24T10%3A26%3A37Z => generated 1901 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:28:56.143618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b31c3574-2b17-45c3-923b-69b48d67b5c3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0b331f0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:56.219795 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b31c3574-2b17-45c3-923b-69b48d67b5c3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-659696993" status: 200 len: 484 microversion: 2.1 time: 0.079005 Oct 24 10:28:56.219795 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 637/1227] 10.222.0.50 () {58 vars in 1229 bytes} [Mon Oct 24 10:28:56 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-659696993 => generated 484 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:28:56.232874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-df4a8b9f-3565-4216-827f-2e82d504e216 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0a8ff70>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:56.323100 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-df4a8b9f-3565-4216-827f-2e82d504e216 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images?server=a8f749f9-5771-4ecb-8a06-30a8f69dd848" status: 200 len: 956 microversion: 2.1 time: 0.093885 Oct 24 10:28:56.323677 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 638/1228] 10.222.0.50 () {58 vars in 1209 bytes} [Mon Oct 24 10:28:56 2022] GET /compute/v2.1/images?server=a8f749f9-5771-4ecb-8a06-30a8f69dd848 => generated 956 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:56.337857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d4ac8986-4fc4-4303-b2a7-ab69a1115cc0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0b33040>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:56.389744 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d4ac8986-4fc4-4303-b2a7-ab69a1115cc0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2F94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 485 microversion: 2.1 time: 0.056238 Oct 24 10:28:56.390310 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 639/1229] 10.222.0.50 () {58 vars in 1317 bytes} [Mon Oct 24 10:28:56 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2F94278005-1d71-4976-b673-ad2d105385e0 => generated 485 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:28:56.402508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0713d2d6-c5a7-49ff-8e02-1ad525158c23 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d092d790>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:56.453137 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0713d2d6-c5a7-49ff-8e02-1ad525158c23 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2F94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 485 microversion: 2.1 time: 0.054107 Oct 24 10:28:56.454604 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 640/1230] 10.222.0.50 () {58 vars in 1303 bytes} [Mon Oct 24 10:28:56 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2F94278005-1d71-4976-b673-ad2d105385e0 => generated 485 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:56.458901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d926faac-f92a-45e7-8a98-e79e9c1242ab tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:56.459589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d926faac-f92a-45e7-8a98-e79e9c1242ab tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:56.466776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d926faac-f92a-45e7-8a98-e79e9c1242ab tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:56.467338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d926faac-f92a-45e7-8a98-e79e9c1242ab tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:56.467864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d926faac-f92a-45e7-8a98-e79e9c1242ab tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:56.468630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d926faac-f92a-45e7-8a98-e79e9c1242ab tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:56.469189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d926faac-f92a-45e7-8a98-e79e9c1242ab tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:56.469621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d926faac-f92a-45e7-8a98-e79e9c1242ab tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:56.675031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d926faac-f92a-45e7-8a98-e79e9c1242ab tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:56.683778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d926faac-f92a-45e7-8a98-e79e9c1242ab tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:56.685312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d926faac-f92a-45e7-8a98-e79e9c1242ab tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:56.686471 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d926faac-f92a-45e7-8a98-e79e9c1242ab tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1567 microversion: 2.25 time: 0.231169 Oct 24 10:28:56.687038 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 641/1231] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:56 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:56.691743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fab1d72f-94c7-44de-b091-7eaa24fe0807 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:56.692579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fab1d72f-94c7-44de-b091-7eaa24fe0807 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:56.698918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fab1d72f-94c7-44de-b091-7eaa24fe0807 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:56.700166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fab1d72f-94c7-44de-b091-7eaa24fe0807 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:56.700624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fab1d72f-94c7-44de-b091-7eaa24fe0807 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:56.701663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fab1d72f-94c7-44de-b091-7eaa24fe0807 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:56.702122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fab1d72f-94c7-44de-b091-7eaa24fe0807 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:56.702550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fab1d72f-94c7-44de-b091-7eaa24fe0807 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:56.891442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fab1d72f-94c7-44de-b091-7eaa24fe0807 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:56.899261 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fab1d72f-94c7-44de-b091-7eaa24fe0807 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1317 microversion: 2.1 time: 0.211240 Oct 24 10:28:56.899849 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 642/1232] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:56 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:56.905522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fa0f29ce-9b14-483a-8ec3-c97d9f805a45 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0a8f4c0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:57.027282 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fa0f29ce-9b14-483a-8ec3-c97d9f805a45 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.126385 Oct 24 10:28:57.028326 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 643/1233] 10.222.0.50 () {58 vars in 1149 bytes} [Mon Oct 24 10:28:56 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:57.032344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-45a02fa7-cc6e-491c-bf4b-9fdf9c4584d3 req-51b71df4-9a28-4380-8d93-c2d709d5cbcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d7180f-82cf-4113-824a-6350d013baf1", "tag": "af23d072-0dd6-45cf-9412-eb509fb3c310"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:57.042317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-45a02fa7-cc6e-491c-bf4b-9fdf9c4584d3 req-51b71df4-9a28-4380-8d93-c2d709d5cbcb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:57.042791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-45a02fa7-cc6e-491c-bf4b-9fdf9c4584d3 req-51b71df4-9a28-4380-8d93-c2d709d5cbcb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:57.043219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-45a02fa7-cc6e-491c-bf4b-9fdf9c4584d3 req-51b71df4-9a28-4380-8d93-c2d709d5cbcb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:57.055613 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-45a02fa7-cc6e-491c-bf4b-9fdf9c4584d3 req-51b71df4-9a28-4380-8d93-c2d709d5cbcb service nova] Creating event network-changed:af23d072-0dd6-45cf-9412-eb509fb3c310 for instance b9d7180f-82cf-4113-824a-6350d013baf1 on n-h1-858383-15 Oct 24 10:28:57.060445 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-45a02fa7-cc6e-491c-bf4b-9fdf9c4584d3 req-51b71df4-9a28-4380-8d93-c2d709d5cbcb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031483 Oct 24 10:28:57.061098 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 644/1234] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:57.066109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4ee6e962-ad5c-400f-866c-d402fd154a70 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:57.066806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4ee6e962-ad5c-400f-866c-d402fd154a70 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:57.073265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ee6e962-ad5c-400f-866c-d402fd154a70 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:57.073755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ee6e962-ad5c-400f-866c-d402fd154a70 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:57.074192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ee6e962-ad5c-400f-866c-d402fd154a70 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:57.074893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ee6e962-ad5c-400f-866c-d402fd154a70 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:57.075351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ee6e962-ad5c-400f-866c-d402fd154a70 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:57.075780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ee6e962-ad5c-400f-866c-d402fd154a70 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:57.337048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4ee6e962-ad5c-400f-866c-d402fd154a70 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:57.347569 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4ee6e962-ad5c-400f-866c-d402fd154a70 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1477 microversion: 2.1 time: 0.285276 Oct 24 10:28:57.357997 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 645/1235] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:57 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1477 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:57.362290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1d617ba0-57c5-49cd-ae50-604577d434ef tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:57.363115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1d617ba0-57c5-49cd-ae50-604577d434ef tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:57.370174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d617ba0-57c5-49cd-ae50-604577d434ef tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:57.370751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d617ba0-57c5-49cd-ae50-604577d434ef tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:57.371512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d617ba0-57c5-49cd-ae50-604577d434ef tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:57.372475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d617ba0-57c5-49cd-ae50-604577d434ef tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:57.373221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d617ba0-57c5-49cd-ae50-604577d434ef tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:57.373883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d617ba0-57c5-49cd-ae50-604577d434ef tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:57.510112 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-04a49192-1e92-47d7-a75d-8fff982b771d tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.528256 Oct 24 10:28:57.511365 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 591/1236] 10.222.0.50 () {60 vars in 1170 bytes} [Mon Oct 24 10:28:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:28:57.516410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2f472cf1-cc43-45ce-bdb3-5e38be347e8a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:57.517242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2f472cf1-cc43-45ce-bdb3-5e38be347e8a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:57.524053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f472cf1-cc43-45ce-bdb3-5e38be347e8a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:57.524550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f472cf1-cc43-45ce-bdb3-5e38be347e8a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:57.525016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f472cf1-cc43-45ce-bdb3-5e38be347e8a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:57.525976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f472cf1-cc43-45ce-bdb3-5e38be347e8a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:57.526436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f472cf1-cc43-45ce-bdb3-5e38be347e8a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:57.526864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f472cf1-cc43-45ce-bdb3-5e38be347e8a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:57.545318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1d617ba0-57c5-49cd-ae50-604577d434ef tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:57.553525 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1d617ba0-57c5-49cd-ae50-604577d434ef tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.204310 Oct 24 10:28:57.554380 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 646/1237] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:57 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:57.558792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8eb70b43-eba6-45b3-ae0c-bf837800a2c8 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d09ab940>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:57.602032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2f472cf1-cc43-45ce-bdb3-5e38be347e8a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:57.612366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2f472cf1-cc43-45ce-bdb3-5e38be347e8a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:57.615592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2f472cf1-cc43-45ce-bdb3-5e38be347e8a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:57.622721 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2f472cf1-cc43-45ce-bdb3-5e38be347e8a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.109866 Oct 24 10:28:57.623618 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 592/1238] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:57 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:57.629118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ff41d61a-ab82-44f7-ad41-4ac1584f4893 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.142"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:28:57.632345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ff41d61a-ab82-44f7-ad41-4ac1584f4893 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:57.638759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff41d61a-ab82-44f7-ad41-4ac1584f4893 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:57.639464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff41d61a-ab82-44f7-ad41-4ac1584f4893 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:57.640132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff41d61a-ab82-44f7-ad41-4ac1584f4893 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:57.640737 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8eb70b43-eba6-45b3-ae0c-bf837800a2c8 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.085500 Oct 24 10:28:57.641273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff41d61a-ab82-44f7-ad41-4ac1584f4893 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:57.641925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff41d61a-ab82-44f7-ad41-4ac1584f4893 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:57.642543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff41d61a-ab82-44f7-ad41-4ac1584f4893 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:57.645287 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 647/1239] 10.222.0.50 () {58 vars in 1149 bytes} [Mon Oct 24 10:28:57 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:57.655631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-02130fc1-5d43-4c66-a7be-bf7354e3ccdb tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0a3d700>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:57.673410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff41d61a-ab82-44f7-ad41-4ac1584f4893 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "refresh_cache-8d47d8d5-f7d0-49c4-839a-92bababf20e7" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 10:28:57.674078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff41d61a-ab82-44f7-ad41-4ac1584f4893 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquired lock "refresh_cache-8d47d8d5-f7d0-49c4-839a-92bababf20e7" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 10:28:57.738224 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-02130fc1-5d43-4c66-a7be-bf7354e3ccdb tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.086455 Oct 24 10:28:57.739000 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 648/1240] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:28:57 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:57.743657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e1e24a11-9b45-4abb-ab7d-26b6047aa567 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:57.744276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e1e24a11-9b45-4abb-ab7d-26b6047aa567 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:57.753024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1e24a11-9b45-4abb-ab7d-26b6047aa567 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:57.753548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1e24a11-9b45-4abb-ab7d-26b6047aa567 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:57.754054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1e24a11-9b45-4abb-ab7d-26b6047aa567 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:57.754774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1e24a11-9b45-4abb-ab7d-26b6047aa567 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:57.755232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1e24a11-9b45-4abb-ab7d-26b6047aa567 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:57.755686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1e24a11-9b45-4abb-ab7d-26b6047aa567 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:57.987180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e1e24a11-9b45-4abb-ab7d-26b6047aa567 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:57.997056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e1e24a11-9b45-4abb-ab7d-26b6047aa567 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:57.998511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e1e24a11-9b45-4abb-ab7d-26b6047aa567 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:57.999683 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e1e24a11-9b45-4abb-ab7d-26b6047aa567 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1567 microversion: 2.25 time: 0.259954 Oct 24 10:28:58.000511 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 649/1241] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:57 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:58.004981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2ba4af16-4219-40e3-8cc8-695a4b8ffc56 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0b33f70>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:58.097708 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2ba4af16-4219-40e3-8cc8-695a4b8ffc56 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/detail?changes-since=2022-10-24T10%3A26%3A29Z" status: 200 len: 6325 microversion: 2.1 time: 0.096102 Oct 24 10:28:58.098569 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 650/1242] 10.222.0.50 () {58 vars in 1220 bytes} [Mon Oct 24 10:28:58 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-24T10%3A26%3A29Z => generated 6325 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:58.103511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-465c93ee-a675-4f21-a8f5-7d9b5495fa0a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:58.104124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-465c93ee-a675-4f21-a8f5-7d9b5495fa0a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:58.111410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-465c93ee-a675-4f21-a8f5-7d9b5495fa0a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:58.111900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-465c93ee-a675-4f21-a8f5-7d9b5495fa0a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:58.112342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-465c93ee-a675-4f21-a8f5-7d9b5495fa0a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:58.113087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-465c93ee-a675-4f21-a8f5-7d9b5495fa0a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:58.113548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-465c93ee-a675-4f21-a8f5-7d9b5495fa0a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:58.113982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-465c93ee-a675-4f21-a8f5-7d9b5495fa0a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:58.402950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-465c93ee-a675-4f21-a8f5-7d9b5495fa0a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:58.410809 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-465c93ee-a675-4f21-a8f5-7d9b5495fa0a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1467 microversion: 2.1 time: 0.311113 Oct 24 10:28:58.411385 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 651/1243] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:58 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1467 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:58.433833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-42b1fe67-c58a-436b-8b5b-d9c78eb7a4d3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0b33f70>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:58.485310 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-42b1fe67-c58a-436b-8b5b-d9c78eb7a4d3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-659696993" status: 200 len: 664 microversion: 2.1 time: 0.055028 Oct 24 10:28:58.487018 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 652/1244] 10.222.0.50 () {58 vars in 1250 bytes} [Mon Oct 24 10:28:58 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-659696993 => generated 664 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:28:58.493187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-49a7b1ad-ae8d-4e04-bb28-b3bfe514a7eb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:58.493985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-49a7b1ad-ae8d-4e04-bb28-b3bfe514a7eb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:58.502630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49a7b1ad-ae8d-4e04-bb28-b3bfe514a7eb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:58.503417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49a7b1ad-ae8d-4e04-bb28-b3bfe514a7eb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:58.503620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49a7b1ad-ae8d-4e04-bb28-b3bfe514a7eb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:58.504749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49a7b1ad-ae8d-4e04-bb28-b3bfe514a7eb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:58.505402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49a7b1ad-ae8d-4e04-bb28-b3bfe514a7eb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:58.506131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49a7b1ad-ae8d-4e04-bb28-b3bfe514a7eb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:58.755603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-49a7b1ad-ae8d-4e04-bb28-b3bfe514a7eb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:58.767796 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-49a7b1ad-ae8d-4e04-bb28-b3bfe514a7eb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1477 microversion: 2.1 time: 0.279726 Oct 24 10:28:58.781636 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 653/1245] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:58 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1477 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:58.781636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bb2edc2a-657c-4eeb-b067-1c3d9509f702 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:58.781636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bb2edc2a-657c-4eeb-b067-1c3d9509f702 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:58.789050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb2edc2a-657c-4eeb-b067-1c3d9509f702 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:58.789050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb2edc2a-657c-4eeb-b067-1c3d9509f702 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:58.789050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb2edc2a-657c-4eeb-b067-1c3d9509f702 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:58.789050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb2edc2a-657c-4eeb-b067-1c3d9509f702 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:58.789556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb2edc2a-657c-4eeb-b067-1c3d9509f702 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:58.789635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb2edc2a-657c-4eeb-b067-1c3d9509f702 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:58.997535 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bb2edc2a-657c-4eeb-b067-1c3d9509f702 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1620 microversion: 2.1 time: 0.226592 Oct 24 10:28:58.998320 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 654/1246] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:58 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1620 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:59.004015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f8860858-e196-4952-9368-0e75a62a5f23 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d1030b80>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:59.096013 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f8860858-e196-4952-9368-0e75a62a5f23 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2F94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1465 microversion: 2.1 time: 0.095301 Oct 24 10:28:59.101656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-ff41d61a-ab82-44f7-ad41-4ac1584f4893 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Building network info cache for instance {{(pid=120425) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 10:28:59.113252 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 655/1247] 10.222.0.50 () {58 vars in 1338 bytes} [Mon Oct 24 10:28:58 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2F94278005-1d71-4976-b673-ad2d105385e0 => generated 1465 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:59.120912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3fa2b64c-e406-468f-b3d7-723b235f2569 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:59.127905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3fa2b64c-e406-468f-b3d7-723b235f2569 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:59.138805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fa2b64c-e406-468f-b3d7-723b235f2569 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:59.139303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fa2b64c-e406-468f-b3d7-723b235f2569 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:59.139848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fa2b64c-e406-468f-b3d7-723b235f2569 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:59.140546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fa2b64c-e406-468f-b3d7-723b235f2569 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:59.140937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fa2b64c-e406-468f-b3d7-723b235f2569 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:59.141440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fa2b64c-e406-468f-b3d7-723b235f2569 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:59.390070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3fa2b64c-e406-468f-b3d7-723b235f2569 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:59.400731 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3fa2b64c-e406-468f-b3d7-723b235f2569 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.285778 Oct 24 10:28:59.402011 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 656/1248] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:28:59 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:28:59.406884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e21205d0-4cf6-46ce-892a-6fa917c31299 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:59.407891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e21205d0-4cf6-46ce-892a-6fa917c31299 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:59.417594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e21205d0-4cf6-46ce-892a-6fa917c31299 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:59.418447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e21205d0-4cf6-46ce-892a-6fa917c31299 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:59.419679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e21205d0-4cf6-46ce-892a-6fa917c31299 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:59.421112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e21205d0-4cf6-46ce-892a-6fa917c31299 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:59.422405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e21205d0-4cf6-46ce-892a-6fa917c31299 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:59.423074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e21205d0-4cf6-46ce-892a-6fa917c31299 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:59.528353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e21205d0-4cf6-46ce-892a-6fa917c31299 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:59.537523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e21205d0-4cf6-46ce-892a-6fa917c31299 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:59.540060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e21205d0-4cf6-46ce-892a-6fa917c31299 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:28:59.545972 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e21205d0-4cf6-46ce-892a-6fa917c31299 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.142569 Oct 24 10:28:59.552891 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 657/1249] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:59 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:28:59.552891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-092bc316-ca06-44cf-a8c6-bcdd615dd447 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:28:59.552891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-092bc316-ca06-44cf-a8c6-bcdd615dd447 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:28:59.560642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-092bc316-ca06-44cf-a8c6-bcdd615dd447 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:59.561164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-092bc316-ca06-44cf-a8c6-bcdd615dd447 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:59.561607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-092bc316-ca06-44cf-a8c6-bcdd615dd447 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:28:59.562316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-092bc316-ca06-44cf-a8c6-bcdd615dd447 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:28:59.563201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-092bc316-ca06-44cf-a8c6-bcdd615dd447 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:28:59.563201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-092bc316-ca06-44cf-a8c6-bcdd615dd447 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:00.131658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-092bc316-ca06-44cf-a8c6-bcdd615dd447 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:00.137717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:00.145876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-092bc316-ca06-44cf-a8c6-bcdd615dd447 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:00.147378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-092bc316-ca06-44cf-a8c6-bcdd615dd447 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:00.148555 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-092bc316-ca06-44cf-a8c6-bcdd615dd447 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1567 microversion: 2.25 time: 0.600421 Oct 24 10:29:00.149368 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 658/1250] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:28:59 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1567 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:00.154643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f0de1a38-de29-44a0-ba48-093ba185c26e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0bb7430>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:00.201342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-ff41d61a-ab82-44f7-ad41-4ac1584f4893 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Updating instance_info_cache with network_info: [{"id": "9d03d2ef-8a17-4594-b487-37b1ca2cc10b", "address": "fa:16:3e:31:2d:23", "network": {"id": "764d65e7-2cd6-484d-a7f4-f21087e0ed28", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-23390703-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "71c8dc3d203642269466444b34a31285", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9d03d2ef-8a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120425) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 10:29:00.235962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff41d61a-ab82-44f7-ad41-4ac1584f4893 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Releasing lock "refresh_cache-8d47d8d5-f7d0-49c4-839a-92bababf20e7" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 10:29:00.237195 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ff41d61a-ab82-44f7-ad41-4ac1584f4893 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "POST /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7/action" status: 202 len: 0 microversion: 2.1 time: 2.612111 Oct 24 10:29:00.237902 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 593/1251] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:28:57 2022] POST /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7/action => generated 0 bytes in 2614 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 24 10:29:00.246588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab5c6abc-0159-43a0-a815-eda63508f8da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1648027242", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["2a8bcf29-893c-4ca8-82cb-636c2bb6f404"]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:00.253199 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f0de1a38-de29-44a0-ba48-093ba185c26e tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2F94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1465 microversion: 2.1 time: 0.101830 Oct 24 10:29:00.254495 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 659/1252] 10.222.0.50 () {58 vars in 1324 bytes} [Mon Oct 24 10:29:00 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2F94278005-1d71-4976-b673-ad2d105385e0 => generated 1465 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:00.260432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-2e0e0fcf-c571-4c92-be49-988feacda038 req-03fa5a53-1636-4f61-b3c1-06026cd72b7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d47d8d5-f7d0-49c4-839a-92bababf20e7", "tag": "9d03d2ef-8a17-4594-b487-37b1ca2cc10b"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:00.270334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2e0e0fcf-c571-4c92-be49-988feacda038 req-03fa5a53-1636-4f61-b3c1-06026cd72b7a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:00.270916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2e0e0fcf-c571-4c92-be49-988feacda038 req-03fa5a53-1636-4f61-b3c1-06026cd72b7a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:00.271542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2e0e0fcf-c571-4c92-be49-988feacda038 req-03fa5a53-1636-4f61-b3c1-06026cd72b7a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:00.304159 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-2e0e0fcf-c571-4c92-be49-988feacda038 req-03fa5a53-1636-4f61-b3c1-06026cd72b7a service nova] Creating event network-changed:9d03d2ef-8a17-4594-b487-37b1ca2cc10b for instance 8d47d8d5-f7d0-49c4-839a-92bababf20e7 on n-h2-858383-15 Oct 24 10:29:00.309743 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-2e0e0fcf-c571-4c92-be49-988feacda038 req-03fa5a53-1636-4f61-b3c1-06026cd72b7a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053963 Oct 24 10:29:00.310990 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 660/1253] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:00.322063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-e28ce819-97ec-4318-8a08-7d8f7faa56dc req-e74265c7-21df-4b89-8a52-6fb671187d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f749f9-5771-4ecb-8a06-30a8f69dd848", "name": "network-vif-unplugged", "status": "completed", "tag": "f48a3bd1-58ab-47af-934b-bea589ab9a0b"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:00.335189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-ab5c6abc-0159-43a0-a815-eda63508f8da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] validate_networks() for None {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:29:00.344011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e28ce819-97ec-4318-8a08-7d8f7faa56dc req-e74265c7-21df-4b89-8a52-6fb671187d9c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:00.344524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e28ce819-97ec-4318-8a08-7d8f7faa56dc req-e74265c7-21df-4b89-8a52-6fb671187d9c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:00.344986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e28ce819-97ec-4318-8a08-7d8f7faa56dc req-e74265c7-21df-4b89-8a52-6fb671187d9c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:00.357350 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-e28ce819-97ec-4318-8a08-7d8f7faa56dc req-e74265c7-21df-4b89-8a52-6fb671187d9c service nova] Creating event network-vif-unplugged:f48a3bd1-58ab-47af-934b-bea589ab9a0b for instance a8f749f9-5771-4ecb-8a06-30a8f69dd848 on n-h2-858383-15 Oct 24 10:29:00.362964 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-e28ce819-97ec-4318-8a08-7d8f7faa56dc req-e74265c7-21df-4b89-8a52-6fb671187d9c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050650 Oct 24 10:29:00.364394 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 661/1254] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:00.374208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-71b7b324-e364-4451-bdfa-3a678eddf2d3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:00.374915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-71b7b324-e364-4451-bdfa-3a678eddf2d3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:00.382478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71b7b324-e364-4451-bdfa-3a678eddf2d3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:00.382973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71b7b324-e364-4451-bdfa-3a678eddf2d3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:00.383415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71b7b324-e364-4451-bdfa-3a678eddf2d3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:00.384123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71b7b324-e364-4451-bdfa-3a678eddf2d3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:00.384580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71b7b324-e364-4451-bdfa-3a678eddf2d3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:00.385043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71b7b324-e364-4451-bdfa-3a678eddf2d3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:00.625833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-71b7b324-e364-4451-bdfa-3a678eddf2d3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:00.635332 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-71b7b324-e364-4451-bdfa-3a678eddf2d3 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1477 microversion: 2.1 time: 0.265274 Oct 24 10:29:00.645540 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 662/1255] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:00 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1477 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:00.658375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-65154805-201b-4010-8e2f-9df1eb81e0df tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Action: 'create', calling method: .version_select at 0x7f04d0970670>, body: {"pool": "305071bc-8358-45a9-b0bc-51f65747bb90"} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:00.702403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ab5c6abc-0159-43a0-a815-eda63508f8da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:29:00.703149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ab5c6abc-0159-43a0-a815-eda63508f8da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:29:00.704047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ab5c6abc-0159-43a0-a815-eda63508f8da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:29:00.704676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ab5c6abc-0159-43a0-a815-eda63508f8da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:29:00.705510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ab5c6abc-0159-43a0-a815-eda63508f8da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:29:00.726296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab5c6abc-0159-43a0-a815-eda63508f8da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:00.727104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab5c6abc-0159-43a0-a815-eda63508f8da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:00.727908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab5c6abc-0159-43a0-a815-eda63508f8da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:00.731248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab5c6abc-0159-43a0-a815-eda63508f8da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:00.731896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab5c6abc-0159-43a0-a815-eda63508f8da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:00.732896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab5c6abc-0159-43a0-a815-eda63508f8da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:00.754412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ab5c6abc-0159-43a0-a815-eda63508f8da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for project b565572c0c8c4871af02471a328bd1af. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:00.761138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ab5c6abc-0159-43a0-a815-eda63508f8da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for user 9aa572f1e5014e10bed0abe34dfad43f and project b565572c0c8c4871af02471a328bd1af. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:00.779338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ab5c6abc-0159-43a0-a815-eda63508f8da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:29:00.781921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ab5c6abc-0159-43a0-a815-eda63508f8da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:29:00.871269 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ab5c6abc-0159-43a0-a815-eda63508f8da tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632019 Oct 24 10:29:00.872636 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 594/1256] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:29:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:29:00.879256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9d00e1f7-db22-490f-bbf3-689ac256ac33 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0ca1280>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:01.026314 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9d00e1f7-db22-490f-bbf3-689ac256ac33 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7100 microversion: 2.1 time: 0.152320 Oct 24 10:29:01.039377 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 595/1257] 10.222.0.50 () {58 vars in 1170 bytes} [Mon Oct 24 10:29:00 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7100 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:01.044636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3739670b-5153-42f3-a787-f438a17b6951 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:01.045555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3739670b-5153-42f3-a787-f438a17b6951 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:01.052467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3739670b-5153-42f3-a787-f438a17b6951 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:01.053168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3739670b-5153-42f3-a787-f438a17b6951 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:01.053673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3739670b-5153-42f3-a787-f438a17b6951 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:01.054529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3739670b-5153-42f3-a787-f438a17b6951 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:01.054984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3739670b-5153-42f3-a787-f438a17b6951 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:01.055407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3739670b-5153-42f3-a787-f438a17b6951 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:01.296986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3739670b-5153-42f3-a787-f438a17b6951 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:01.320811 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3739670b-5153-42f3-a787-f438a17b6951 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.279608 Oct 24 10:29:01.321598 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 596/1258] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:01 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:01.330262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dec99e30-e9ca-49f8-a1cf-c5a9451b3997 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:01.330935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dec99e30-e9ca-49f8-a1cf-c5a9451b3997 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:01.339533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dec99e30-e9ca-49f8-a1cf-c5a9451b3997 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:01.340286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dec99e30-e9ca-49f8-a1cf-c5a9451b3997 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:01.341135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dec99e30-e9ca-49f8-a1cf-c5a9451b3997 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:01.342273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dec99e30-e9ca-49f8-a1cf-c5a9451b3997 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:01.342973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dec99e30-e9ca-49f8-a1cf-c5a9451b3997 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:01.344242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dec99e30-e9ca-49f8-a1cf-c5a9451b3997 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:01.443913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dec99e30-e9ca-49f8-a1cf-c5a9451b3997 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:01.453118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dec99e30-e9ca-49f8-a1cf-c5a9451b3997 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:01.454626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dec99e30-e9ca-49f8-a1cf-c5a9451b3997 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:01.459566 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dec99e30-e9ca-49f8-a1cf-c5a9451b3997 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.136786 Oct 24 10:29:01.460465 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 597/1259] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:01 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:01.464952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-66b1f22a-7c0f-4af1-960e-c151b04fe46a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:01.465548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-66b1f22a-7c0f-4af1-960e-c151b04fe46a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:01.471460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66b1f22a-7c0f-4af1-960e-c151b04fe46a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:01.471824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66b1f22a-7c0f-4af1-960e-c151b04fe46a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:01.472261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66b1f22a-7c0f-4af1-960e-c151b04fe46a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:01.473051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66b1f22a-7c0f-4af1-960e-c151b04fe46a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:01.473608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66b1f22a-7c0f-4af1-960e-c151b04fe46a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:01.474051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66b1f22a-7c0f-4af1-960e-c151b04fe46a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:01.543007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-66b1f22a-7c0f-4af1-960e-c151b04fe46a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:01.551049 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-66b1f22a-7c0f-4af1-960e-c151b04fe46a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 200 len: 1221 microversion: 2.1 time: 0.089533 Oct 24 10:29:01.551630 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 598/1260] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:01 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 1221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:01.557014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-daef7d20-9605-4037-b1dc-d289b1851a83 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0bd40d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:01.625524 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-daef7d20-9605-4037-b1dc-d289b1851a83 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.072572 Oct 24 10:29:01.626107 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 599/1261] 10.222.0.50 () {58 vars in 1170 bytes} [Mon Oct 24 10:29:01 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:01.631024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eeac63b5-9a81-4d54-b609-c62aed559800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:01.631652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eeac63b5-9a81-4d54-b609-c62aed559800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:01.639616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eeac63b5-9a81-4d54-b609-c62aed559800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:01.640108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eeac63b5-9a81-4d54-b609-c62aed559800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:01.640545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eeac63b5-9a81-4d54-b609-c62aed559800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:01.641271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eeac63b5-9a81-4d54-b609-c62aed559800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:01.641725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eeac63b5-9a81-4d54-b609-c62aed559800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:01.642145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eeac63b5-9a81-4d54-b609-c62aed559800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:01.855356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eeac63b5-9a81-4d54-b609-c62aed559800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:01.864034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eeac63b5-9a81-4d54-b609-c62aed559800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:01.865601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eeac63b5-9a81-4d54-b609-c62aed559800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:01.867698 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eeac63b5-9a81-4d54-b609-c62aed559800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1567 microversion: 2.25 time: 0.240258 Oct 24 10:29:01.868866 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 600/1262] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:01 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:01.874391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ba251eac-ebcb-420b-9782-a7d96db5430b tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0ca81f0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:01.923158 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ba251eac-ebcb-420b-9782-a7d96db5430b tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/a9689e0d-06ef-475e-9c75-9e39befd50b7" status: 200 len: 784 microversion: 2.1 time: 0.052917 Oct 24 10:29:01.923765 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 601/1263] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:01 2022] GET /compute/v2.1/images/a9689e0d-06ef-475e-9c75-9e39befd50b7 => generated 784 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:01.929588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-475acd24-ebe3-455f-9994-0e7d53f8afbc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:01.930207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-475acd24-ebe3-455f-9994-0e7d53f8afbc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:01.937512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-475acd24-ebe3-455f-9994-0e7d53f8afbc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:01.938017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-475acd24-ebe3-455f-9994-0e7d53f8afbc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:01.938455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-475acd24-ebe3-455f-9994-0e7d53f8afbc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:01.939362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-475acd24-ebe3-455f-9994-0e7d53f8afbc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:01.939828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-475acd24-ebe3-455f-9994-0e7d53f8afbc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:01.940293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-475acd24-ebe3-455f-9994-0e7d53f8afbc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:01.943114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:02.270645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-475acd24-ebe3-455f-9994-0e7d53f8afbc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:02.289820 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-475acd24-ebe3-455f-9994-0e7d53f8afbc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1477 microversion: 2.1 time: 0.364201 Oct 24 10:29:02.290723 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 602/1264] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:01 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1477 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:02.311455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa8e2723-4d4b-4e93-908a-281d5bad5204 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0ca18b0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:02.367244 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa8e2723-4d4b-4e93-908a-281d5bad5204 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.059829 Oct 24 10:29:02.368175 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 603/1265] 10.222.0.50 () {58 vars in 1158 bytes} [Mon Oct 24 10:29:02 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:02.373419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10a13cdb-7d2a-4af4-8661-10111ccbaa3e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:02.374458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-10a13cdb-7d2a-4af4-8661-10111ccbaa3e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:02.381242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a13cdb-7d2a-4af4-8661-10111ccbaa3e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:02.382654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a13cdb-7d2a-4af4-8661-10111ccbaa3e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:02.383295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a13cdb-7d2a-4af4-8661-10111ccbaa3e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:02.395306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a13cdb-7d2a-4af4-8661-10111ccbaa3e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:02.396042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a13cdb-7d2a-4af4-8661-10111ccbaa3e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:02.396720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a13cdb-7d2a-4af4-8661-10111ccbaa3e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:02.415129 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-65154805-201b-4010-8e2f-9df1eb81e0df tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.768389 Oct 24 10:29:02.416653 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 663/1266] 10.222.0.50 () {60 vars in 1170 bytes} [Mon Oct 24 10:29:00 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:02.430044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-49d6b8b6-a575-49e4-b81f-fe5cf1004ee6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0a92670>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:02.655793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-10a13cdb-7d2a-4af4-8661-10111ccbaa3e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:02.666769 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10a13cdb-7d2a-4af4-8661-10111ccbaa3e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.297259 Oct 24 10:29:02.670229 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 604/1267] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:02 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:02.681703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-beec846e-0b56-492a-8351-669a26e5b186 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.171"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:02.683545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-beec846e-0b56-492a-8351-669a26e5b186 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:02.688888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:02.690276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beec846e-0b56-492a-8351-669a26e5b186 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:02.690768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beec846e-0b56-492a-8351-669a26e5b186 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:02.691206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beec846e-0b56-492a-8351-669a26e5b186 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:02.692008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beec846e-0b56-492a-8351-669a26e5b186 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:02.692577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beec846e-0b56-492a-8351-669a26e5b186 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:02.693190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beec846e-0b56-492a-8351-669a26e5b186 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:02.724939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beec846e-0b56-492a-8351-669a26e5b186 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "refresh_cache-8d47d8d5-f7d0-49c4-839a-92bababf20e7" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 10:29:02.725352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beec846e-0b56-492a-8351-669a26e5b186 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquired lock "refresh_cache-8d47d8d5-f7d0-49c4-839a-92bababf20e7" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 10:29:03.071234 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-49d6b8b6-a575-49e4-b81f-fe5cf1004ee6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "DELETE /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3" status: 204 len: 0 microversion: 2.1 time: 0.645656 Oct 24 10:29:03.072323 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 664/1268] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:02 2022] DELETE /compute/v2.1/images/c4f381b8-bde9-43d1-ae8e-8b201d6ba9b3 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:03.078890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-32e0465d-00ba-4be2-98fe-f7643c68ee85 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:03.079601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-32e0465d-00ba-4be2-98fe-f7643c68ee85 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:03.090767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32e0465d-00ba-4be2-98fe-f7643c68ee85 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:03.091468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32e0465d-00ba-4be2-98fe-f7643c68ee85 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:03.092022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32e0465d-00ba-4be2-98fe-f7643c68ee85 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:03.093131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32e0465d-00ba-4be2-98fe-f7643c68ee85 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:03.093593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32e0465d-00ba-4be2-98fe-f7643c68ee85 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:03.094216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32e0465d-00ba-4be2-98fe-f7643c68ee85 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:03.199044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-32e0465d-00ba-4be2-98fe-f7643c68ee85 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:03.207108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-32e0465d-00ba-4be2-98fe-f7643c68ee85 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:03.208553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-32e0465d-00ba-4be2-98fe-f7643c68ee85 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:03.214358 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-32e0465d-00ba-4be2-98fe-f7643c68ee85 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.140767 Oct 24 10:29:03.214942 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 665/1269] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:03 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:03.219705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-246a3a02-a364-4cbc-979a-9b14ed058d5b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:03.220544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-246a3a02-a364-4cbc-979a-9b14ed058d5b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:03.239794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-246a3a02-a364-4cbc-979a-9b14ed058d5b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:03.240296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-246a3a02-a364-4cbc-979a-9b14ed058d5b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:03.240750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-246a3a02-a364-4cbc-979a-9b14ed058d5b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:03.242033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-246a3a02-a364-4cbc-979a-9b14ed058d5b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:03.242561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-246a3a02-a364-4cbc-979a-9b14ed058d5b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:03.243034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-246a3a02-a364-4cbc-979a-9b14ed058d5b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:03.333355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-246a3a02-a364-4cbc-979a-9b14ed058d5b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:03.341175 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-246a3a02-a364-4cbc-979a-9b14ed058d5b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 200 len: 1269 microversion: 2.1 time: 0.125037 Oct 24 10:29:03.341752 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 666/1270] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:03 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 1269 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:03.346229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7d928931-f7e0-4c7a-adbf-0020a4cc3758 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:03.346834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7d928931-f7e0-4c7a-adbf-0020a4cc3758 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:03.352597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d928931-f7e0-4c7a-adbf-0020a4cc3758 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:03.353120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d928931-f7e0-4c7a-adbf-0020a4cc3758 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:03.353566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d928931-f7e0-4c7a-adbf-0020a4cc3758 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:03.355123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG neutronclient.v2_0.client [None req-beec846e-0b56-492a-8351-669a26e5b186 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.1.171 (f9a69d41-a668-46bf-b486-4f1e7a6ea310) with port 9d03d2ef-8a17-4594-b487-37b1ca2cc10b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 305071bc-8358-45a9-b0bc-51f65747bb90.", "detail": ""}} {{(pid=120425) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:29:03.355701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beec846e-0b56-492a-8351-669a26e5b186 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Releasing lock "refresh_cache-8d47d8d5-f7d0-49c4-839a-92bababf20e7" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 10:29:03.356535 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-beec846e-0b56-492a-8351-669a26e5b186 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] HTTP exception thrown: Cannot associate floating IP 172.25.1.171 (f9a69d41-a668-46bf-b486-4f1e7a6ea310) with port 9d03d2ef-8a17-4594-b487-37b1ca2cc10b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 305071bc-8358-45a9-b0bc-51f65747bb90. Oct 24 10:29:03.356535 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-4d7fbf39-d610-4bc9-be21-4eccb70c9c8a'] Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-beec846e-0b56-492a-8351-669a26e5b186 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Request method failure captured: Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7/action HTTP/1.1 Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 46 Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmi_taZ9SGyfWzaDH6IUvhaYiGC4GobtrVdV0PxVp8Z16RogMUW92m-QtSMAvgNsvx3NjJ0zNNjycJimPPe68fBnwLL3H8T4S5Cr4nGHEe5wjZUVfHINexasG2IrFwz1si5o2_sKgjhAQ-u9O_VnhHya6sNADdrcfmuIsrFe03zvfy0 Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 71c8dc3d203642269466444b34a31285 Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:29:03.358647 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:29:03.360269 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/71c8dc3d203642269466444b34a31285"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/71c8dc3d203642269466444b34a31285"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/71c8dc3d203642269466444b34a31285"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_71c8dc3d203642269466444b34a31285", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:29:03.360269 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 Oct 24 10:29:03.360269 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 71c8dc3d203642269466444b34a31285 Oct 24 10:29:03.360269 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 Oct 24 10:29:03.360269 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project Oct 24 10:29:03.360269 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:29:03.360269 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:29:03.360269 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 30108371eb394d148babe9e2f36c9454 Oct 24 10:29:03.360269 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project Oct 24 10:29:03.360269 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:29:03.360269 n-d-858383-15 devstack@n-api.service[120425]: {"addFloatingIp": {"address": "172.25.1.171"}} Oct 24 10:29:03.360269 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:29:03.361550 n-d-858383-15 devstack@n-api.service[120425]: exception: Cannot associate floating IP 172.25.1.171 (f9a69d41-a668-46bf-b486-4f1e7a6ea310) with port 9d03d2ef-8a17-4594-b487-37b1ca2cc10b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 305071bc-8358-45a9-b0bc-51f65747bb90. Oct 24 10:29:03.361550 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-4d7fbf39-d610-4bc9-be21-4eccb70c9c8a'] Oct 24 10:29:03.361550 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '8d47d8d5-f7d0-49c4-839a-92bababf20e7', 'body': {'addFloatingIp': {'address': '172.25.1.171'}}} Oct 24 10:29:03.361550 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:29:03.361550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:03.361550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 24 10:29:03.361550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 24 10:29:03.361550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:29:03.361550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:29:03.361550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 24 10:29:03.361550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 24 10:29:03.361550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:29:03.361550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:29:03.361550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 24 10:29:03.361550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 24 10:29:03.361550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:29:03.361550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:29:03.362971 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 24 10:29:03.362971 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 24 10:29:03.362971 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:29:03.362971 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:29:03.362971 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:29:03.362971 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:29:03.362971 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:29:03.362971 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:29:03.362971 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:29:03.362971 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:29:03.362971 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:29:03.362971 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:29:03.362971 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:29:03.362971 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:29:03.362971 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:29:03.362971 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:29:03.364551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.1.171 (f9a69d41-a668-46bf-b486-4f1e7a6ea310) with port 9d03d2ef-8a17-4594-b487-37b1ca2cc10b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 305071bc-8358-45a9-b0bc-51f65747bb90. Oct 24 10:29:03.364551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d7fbf39-d610-4bc9-be21-4eccb70c9c8a'] Oct 24 10:29:03.364551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:03.364551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:29:03.364551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:03.364551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:03.364551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 24 10:29:03.364551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 24 10:29:03.364551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 24 10:29:03.364551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 24 10:29:03.364551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 24 10:29:03.364551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 24 10:29:03.364551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.1.171 (f9a69d41-a668-46bf-b486-4f1e7a6ea310) with port 9d03d2ef-8a17-4594-b487-37b1ca2cc10b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 305071bc-8358-45a9-b0bc-51f65747bb90. Oct 24 10:29:03.364551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d7fbf39-d610-4bc9-be21-4eccb70c9c8a'] Oct 24 10:29:03.364551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:03.364551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:29:03.365794 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:03.365794 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:03.365794 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:29:03.365794 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:29:03.365794 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:29:03.365794 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:29:03.365794 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:29:03.365794 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:29:03.365794 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:29:03.365794 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:29:03.365794 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:29:03.365794 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:29:03.365794 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 24 10:29:03.365794 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 10:29:03.365794 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.1.171 (f9a69d41-a668-46bf-b486-4f1e7a6ea310) with port 9d03d2ef-8a17-4594-b487-37b1ca2cc10b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 305071bc-8358-45a9-b0bc-51f65747bb90. Oct 24 10:29:03.365794 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d7fbf39-d610-4bc9-be21-4eccb70c9c8a'] Oct 24 10:29:03.365794 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:03.365794 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:29:03.367917 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:03.367917 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:03.367917 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:29:03.367917 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:29:03.367917 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:29:03.367917 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:29:03.367917 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.1.171 (f9a69d41-a668-46bf-b486-4f1e7a6ea310) with port 9d03d2ef-8a17-4594-b487-37b1ca2cc10b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 305071bc-8358-45a9-b0bc-51f65747bb90. Oct 24 10:29:03.367917 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d7fbf39-d610-4bc9-be21-4eccb70c9c8a'] Oct 24 10:29:03.367917 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:03.367917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-beec846e-0b56-492a-8351-669a26e5b186 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Returning 400 to user: Cannot associate floating IP 172.25.1.171 (f9a69d41-a668-46bf-b486-4f1e7a6ea310) with port 9d03d2ef-8a17-4594-b487-37b1ca2cc10b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 305071bc-8358-45a9-b0bc-51f65747bb90. Oct 24 10:29:03.367917 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-4d7fbf39-d610-4bc9-be21-4eccb70c9c8a'] {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:29:03.368791 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-beec846e-0b56-492a-8351-669a26e5b186 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "POST /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7/action" status: 400 len: 381 microversion: 2.1 time: 0.683488 Oct 24 10:29:03.368791 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 605/1271] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:29:02 2022] POST /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7/action => generated 381 bytes in 690 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:29:03.369005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d928931-f7e0-4c7a-adbf-0020a4cc3758 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:03.369005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d928931-f7e0-4c7a-adbf-0020a4cc3758 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:03.369005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d928931-f7e0-4c7a-adbf-0020a4cc3758 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:03.371183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a1459224-d703-41f5-8626-821b28ce26d3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:03.371812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a1459224-d703-41f5-8626-821b28ce26d3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:03.378827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1459224-d703-41f5-8626-821b28ce26d3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:03.379319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1459224-d703-41f5-8626-821b28ce26d3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:03.379761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1459224-d703-41f5-8626-821b28ce26d3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:03.380468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1459224-d703-41f5-8626-821b28ce26d3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:03.380955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1459224-d703-41f5-8626-821b28ce26d3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:03.381391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1459224-d703-41f5-8626-821b28ce26d3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:03.567151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a1459224-d703-41f5-8626-821b28ce26d3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:03.568292 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7d928931-f7e0-4c7a-adbf-0020a4cc3758 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1860 microversion: 2.1 time: 0.225482 Oct 24 10:29:03.582228 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 667/1272] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:03 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1860 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:03.595337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a1459224-d703-41f5-8626-821b28ce26d3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:03.596165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2dd1e739-c6ff-43d2-8227-3cfb62bdc12c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0b72430>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:03.597011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a1459224-d703-41f5-8626-821b28ce26d3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:03.598933 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a1459224-d703-41f5-8626-821b28ce26d3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1567 microversion: 2.25 time: 0.237322 Oct 24 10:29:03.599563 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 606/1273] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:03 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:03.605057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4213a02f-6884-45d0-95cb-5dd46df0688e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:03.605911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4213a02f-6884-45d0-95cb-5dd46df0688e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:03.613566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4213a02f-6884-45d0-95cb-5dd46df0688e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:03.614881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4213a02f-6884-45d0-95cb-5dd46df0688e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:03.615919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4213a02f-6884-45d0-95cb-5dd46df0688e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:03.616971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4213a02f-6884-45d0-95cb-5dd46df0688e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:03.617673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4213a02f-6884-45d0-95cb-5dd46df0688e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:03.618406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4213a02f-6884-45d0-95cb-5dd46df0688e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:03.858266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4213a02f-6884-45d0-95cb-5dd46df0688e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:03.868190 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4213a02f-6884-45d0-95cb-5dd46df0688e tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1477 microversion: 2.1 time: 0.266977 Oct 24 10:29:03.870018 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 607/1274] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:03 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1477 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:03.876249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6f8cf7bd-b621-4584-9588-e05077b33265 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '.version_select at 0x7f04d0be2940>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:04.115367 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2dd1e739-c6ff-43d2-8227-3cfb62bdc12c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "DELETE /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb" status: 204 len: 0 microversion: 2.1 time: 0.531646 Oct 24 10:29:04.116452 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 668/1275] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:03 2022] DELETE /compute/v2.1/images/17b74e99-010f-4a3e-9e92-e3753ab356eb => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:04.122563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-88455032-4d1f-4118-a3db-364ab046cc6e tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-15", "block_migration": true, "disk_over_commit": false}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:04.125699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-88455032-4d1f-4118-a3db-364ab046cc6e tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:04.133978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88455032-4d1f-4118-a3db-364ab046cc6e tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:04.134482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88455032-4d1f-4118-a3db-364ab046cc6e tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:04.134928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88455032-4d1f-4118-a3db-364ab046cc6e tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:04.135646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88455032-4d1f-4118-a3db-364ab046cc6e tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:04.136136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88455032-4d1f-4118-a3db-364ab046cc6e tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:04.136569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88455032-4d1f-4118-a3db-364ab046cc6e tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:04.162125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-88455032-4d1f-4118-a3db-364ab046cc6e tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lazy-loading 'flavor' on Instance uuid b9eff099-cc37-4432-8741-4e7d179b9ff0 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:04.177632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-88455032-4d1f-4118-a3db-364ab046cc6e tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Going to try to live migrate instance to n-h1-858383-15 {{(pid=120426) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 24 10:29:05.383843 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6f8cf7bd-b621-4584-9588-e05077b33265 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/f9a69d41-a668-46bf-b486-4f1e7a6ea310" status: 202 len: 0 microversion: 2.1 time: 1.512449 Oct 24 10:29:05.385319 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 608/1276] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:29:03 2022] DELETE /compute/v2.1/os-floating-ips/f9a69d41-a668-46bf-b486-4f1e7a6ea310 => generated 0 bytes in 1515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:29:05.392346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-23af17c6-d780-48d1-a8e9-72f1d2486114 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:05.393242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-23af17c6-d780-48d1-a8e9-72f1d2486114 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:05.403181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23af17c6-d780-48d1-a8e9-72f1d2486114 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:05.406423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23af17c6-d780-48d1-a8e9-72f1d2486114 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:05.415686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23af17c6-d780-48d1-a8e9-72f1d2486114 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:05.416637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23af17c6-d780-48d1-a8e9-72f1d2486114 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:05.417296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23af17c6-d780-48d1-a8e9-72f1d2486114 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:05.417892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23af17c6-d780-48d1-a8e9-72f1d2486114 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:05.812636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-23af17c6-d780-48d1-a8e9-72f1d2486114 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:05.824551 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-23af17c6-d780-48d1-a8e9-72f1d2486114 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.437486 Oct 24 10:29:05.846273 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 609/1277] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:05 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:05.853207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f2f8c262-8874-409d-a1d3-9979ca7d420c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0b88ee0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:06.352493 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-88455032-4d1f-4118-a3db-364ab046cc6e tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/action" status: 202 len: 0 microversion: 2.1 time: 2.233920 Oct 24 10:29:06.353807 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 669/1278] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:29:04 2022] POST /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/action => generated 0 bytes in 2237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:29:06.361634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-29aed747-1833-4b06-8be5-a7b193b9d03a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:06.362573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-29aed747-1833-4b06-8be5-a7b193b9d03a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:06.377754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29aed747-1833-4b06-8be5-a7b193b9d03a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:06.378800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29aed747-1833-4b06-8be5-a7b193b9d03a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:06.379340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29aed747-1833-4b06-8be5-a7b193b9d03a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:06.380542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29aed747-1833-4b06-8be5-a7b193b9d03a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:06.381515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29aed747-1833-4b06-8be5-a7b193b9d03a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:06.383012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29aed747-1833-4b06-8be5-a7b193b9d03a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:06.462609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-29aed747-1833-4b06-8be5-a7b193b9d03a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:06.472390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-29aed747-1833-4b06-8be5-a7b193b9d03a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:06.474711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-29aed747-1833-4b06-8be5-a7b193b9d03a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:06.486819 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-29aed747-1833-4b06-8be5-a7b193b9d03a tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.131103 Oct 24 10:29:06.501047 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 670/1279] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:06 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:06.501047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-413ce8d4-b859-4499-8382-3c90aadd16db tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:06.501047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-413ce8d4-b859-4499-8382-3c90aadd16db tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:06.501047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-413ce8d4-b859-4499-8382-3c90aadd16db tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:06.501653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-413ce8d4-b859-4499-8382-3c90aadd16db tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:06.501653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-413ce8d4-b859-4499-8382-3c90aadd16db tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:06.501653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-413ce8d4-b859-4499-8382-3c90aadd16db tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:06.501653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-413ce8d4-b859-4499-8382-3c90aadd16db tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:06.502005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-413ce8d4-b859-4499-8382-3c90aadd16db tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:06.538709 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f2f8c262-8874-409d-a1d3-9979ca7d420c tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "DELETE /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272" status: 204 len: 0 microversion: 2.1 time: 0.690372 Oct 24 10:29:06.540419 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 610/1280] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:05 2022] DELETE /compute/v2.1/images/7c9e6368-6003-4bd8-bfdd-77a54d41e272 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:06.547244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b93a8a3f-3566-45b6-a010-161aff4aa777 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:06.548329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b93a8a3f-3566-45b6-a010-161aff4aa777 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:06.555501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b93a8a3f-3566-45b6-a010-161aff4aa777 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:06.556014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b93a8a3f-3566-45b6-a010-161aff4aa777 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:06.556449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b93a8a3f-3566-45b6-a010-161aff4aa777 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:06.557171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b93a8a3f-3566-45b6-a010-161aff4aa777 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:06.557624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b93a8a3f-3566-45b6-a010-161aff4aa777 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:06.558047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b93a8a3f-3566-45b6-a010-161aff4aa777 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:06.841498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-413ce8d4-b859-4499-8382-3c90aadd16db tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:06.851470 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-413ce8d4-b859-4499-8382-3c90aadd16db tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 200 len: 1317 microversion: 2.1 time: 0.362760 Oct 24 10:29:06.854027 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 671/1281] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:06 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:06.858333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d93f6527-f4f3-4fbe-b402-16d682aa2e96 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:06.859374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d93f6527-f4f3-4fbe-b402-16d682aa2e96 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:06.869632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d93f6527-f4f3-4fbe-b402-16d682aa2e96 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:06.870445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d93f6527-f4f3-4fbe-b402-16d682aa2e96 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:06.871041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d93f6527-f4f3-4fbe-b402-16d682aa2e96 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:06.872123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d93f6527-f4f3-4fbe-b402-16d682aa2e96 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:06.872766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d93f6527-f4f3-4fbe-b402-16d682aa2e96 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:06.873229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d93f6527-f4f3-4fbe-b402-16d682aa2e96 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:06.903328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b93a8a3f-3566-45b6-a010-161aff4aa777 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:06.921045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b93a8a3f-3566-45b6-a010-161aff4aa777 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:06.922832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b93a8a3f-3566-45b6-a010-161aff4aa777 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:06.924159 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b93a8a3f-3566-45b6-a010-161aff4aa777 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1542 microversion: 2.25 time: 0.382450 Oct 24 10:29:06.924857 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 611/1282] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:06 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1542 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:06.930400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3f67504e-97d7-44ec-be0b-6e5b2eac44d1 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.142"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:07.204100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3f67504e-97d7-44ec-be0b-6e5b2eac44d1 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:07.210740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f67504e-97d7-44ec-be0b-6e5b2eac44d1 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:07.211454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f67504e-97d7-44ec-be0b-6e5b2eac44d1 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:07.212053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f67504e-97d7-44ec-be0b-6e5b2eac44d1 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:07.212762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f67504e-97d7-44ec-be0b-6e5b2eac44d1 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:07.213392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f67504e-97d7-44ec-be0b-6e5b2eac44d1 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:07.214154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f67504e-97d7-44ec-be0b-6e5b2eac44d1 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:07.219085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d93f6527-f4f3-4fbe-b402-16d682aa2e96 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:07.232464 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d93f6527-f4f3-4fbe-b402-16d682aa2e96 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1477 microversion: 2.1 time: 0.378196 Oct 24 10:29:07.245707 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 672/1283] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:06 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1477 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:07.254730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-61d595ea-4b13-4854-a8c1-9f96b2300358 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:07.255356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-61d595ea-4b13-4854-a8c1-9f96b2300358 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:07.261691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61d595ea-4b13-4854-a8c1-9f96b2300358 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:07.262189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61d595ea-4b13-4854-a8c1-9f96b2300358 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:07.262633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61d595ea-4b13-4854-a8c1-9f96b2300358 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:07.263349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61d595ea-4b13-4854-a8c1-9f96b2300358 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:07.263810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61d595ea-4b13-4854-a8c1-9f96b2300358 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:07.264240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61d595ea-4b13-4854-a8c1-9f96b2300358 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:07.598658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-61d595ea-4b13-4854-a8c1-9f96b2300358 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:07.607229 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-61d595ea-4b13-4854-a8c1-9f96b2300358 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.360425 Oct 24 10:29:07.607816 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 673/1284] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:07 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:07.619041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e880c5b2-6200-4b09-a5db-1cb88b60ea5a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:07.619811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e880c5b2-6200-4b09-a5db-1cb88b60ea5a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:07.623827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f67504e-97d7-44ec-be0b-6e5b2eac44d1 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "refresh_cache-8d47d8d5-f7d0-49c4-839a-92bababf20e7" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 10:29:07.625142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f67504e-97d7-44ec-be0b-6e5b2eac44d1 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquired lock "refresh_cache-8d47d8d5-f7d0-49c4-839a-92bababf20e7" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 10:29:07.629909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e880c5b2-6200-4b09-a5db-1cb88b60ea5a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:07.630537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e880c5b2-6200-4b09-a5db-1cb88b60ea5a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:07.631017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e880c5b2-6200-4b09-a5db-1cb88b60ea5a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:07.632401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e880c5b2-6200-4b09-a5db-1cb88b60ea5a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:07.632918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e880c5b2-6200-4b09-a5db-1cb88b60ea5a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:07.633358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e880c5b2-6200-4b09-a5db-1cb88b60ea5a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:07.659086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e880c5b2-6200-4b09-a5db-1cb88b60ea5a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:29:07.751188 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e880c5b2-6200-4b09-a5db-1cb88b60ea5a tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "DELETE /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 204 len: 0 microversion: 2.1 time: 0.141804 Oct 24 10:29:07.751792 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 674/1285] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:29:07 2022] DELETE /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:07.757838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-7f619115-c522-4dab-bb4b-83a2b99d6096 req-5b6f0acb-363d-4c86-8d6f-6de0fd46404a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cf77d3a-0153-41cb-aba3-723a2aea3096", "tag": "c8ddb73d-e5b4-40cb-8aa9-348564b976e0"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:07.767400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7f619115-c522-4dab-bb4b-83a2b99d6096 req-5b6f0acb-363d-4c86-8d6f-6de0fd46404a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:07.767818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7f619115-c522-4dab-bb4b-83a2b99d6096 req-5b6f0acb-363d-4c86-8d6f-6de0fd46404a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:07.768257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7f619115-c522-4dab-bb4b-83a2b99d6096 req-5b6f0acb-363d-4c86-8d6f-6de0fd46404a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:07.782152 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-7f619115-c522-4dab-bb4b-83a2b99d6096 req-5b6f0acb-363d-4c86-8d6f-6de0fd46404a service nova] Creating event network-changed:c8ddb73d-e5b4-40cb-8aa9-348564b976e0 for instance 4cf77d3a-0153-41cb-aba3-723a2aea3096 on n-h2-858383-15 Oct 24 10:29:07.787101 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-7f619115-c522-4dab-bb4b-83a2b99d6096 req-5b6f0acb-363d-4c86-8d6f-6de0fd46404a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033979 Oct 24 10:29:07.787887 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 675/1286] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:07.792751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-18006fbc-59dd-42c3-99be-13b0e8f3d810 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:07.793484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-18006fbc-59dd-42c3-99be-13b0e8f3d810 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:07.799521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18006fbc-59dd-42c3-99be-13b0e8f3d810 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:07.800010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18006fbc-59dd-42c3-99be-13b0e8f3d810 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:07.800451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18006fbc-59dd-42c3-99be-13b0e8f3d810 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:07.801179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18006fbc-59dd-42c3-99be-13b0e8f3d810 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:07.801638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18006fbc-59dd-42c3-99be-13b0e8f3d810 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:07.802075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18006fbc-59dd-42c3-99be-13b0e8f3d810 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:08.057595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-18006fbc-59dd-42c3-99be-13b0e8f3d810 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:08.065850 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-18006fbc-59dd-42c3-99be-13b0e8f3d810 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.276972 Oct 24 10:29:08.066668 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 676/1287] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:07 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:08.084407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54a2dcc0-6b62-4d47-ab67-73738dd4d862 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '.version_select at 0x7f04d0caf670>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:08.088705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54a2dcc0-6b62-4d47-ab67-73738dd4d862 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:08.089222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54a2dcc0-6b62-4d47-ab67-73738dd4d862 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:08.089662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54a2dcc0-6b62-4d47-ab67-73738dd4d862 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:08.103926 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-54a2dcc0-6b62-4d47-ab67-73738dd4d862 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 4087 microversion: 2.25 time: 0.036039 Oct 24 10:29:08.104736 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 677/1288] 10.222.0.50 () {60 vars in 1184 bytes} [Mon Oct 24 10:29:08 2022] GET /compute/v2.1/os-migrations => generated 4087 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:08.110156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-42304fd9-7d6d-4a32-8ca7-d3e27c969750 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:08.110771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-42304fd9-7d6d-4a32-8ca7-d3e27c969750 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:08.118055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42304fd9-7d6d-4a32-8ca7-d3e27c969750 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:08.118929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42304fd9-7d6d-4a32-8ca7-d3e27c969750 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:08.119559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42304fd9-7d6d-4a32-8ca7-d3e27c969750 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:08.120458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42304fd9-7d6d-4a32-8ca7-d3e27c969750 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:08.121112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42304fd9-7d6d-4a32-8ca7-d3e27c969750 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:08.121545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42304fd9-7d6d-4a32-8ca7-d3e27c969750 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:08.144255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:08.202752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-42304fd9-7d6d-4a32-8ca7-d3e27c969750 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:08.212373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-42304fd9-7d6d-4a32-8ca7-d3e27c969750 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:08.213844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-42304fd9-7d6d-4a32-8ca7-d3e27c969750 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:08.215791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:08.220731 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-42304fd9-7d6d-4a32-8ca7-d3e27c969750 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.114486 Oct 24 10:29:08.233783 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 678/1289] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:08 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:08.233783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eeea9f92-8aaa-48ed-bf07-66b7a53e96b4 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:08.233783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-eeea9f92-8aaa-48ed-bf07-66b7a53e96b4 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:08.236884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eeea9f92-8aaa-48ed-bf07-66b7a53e96b4 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:08.237299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eeea9f92-8aaa-48ed-bf07-66b7a53e96b4 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:08.237875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eeea9f92-8aaa-48ed-bf07-66b7a53e96b4 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:08.238662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eeea9f92-8aaa-48ed-bf07-66b7a53e96b4 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:08.239115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eeea9f92-8aaa-48ed-bf07-66b7a53e96b4 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:08.239538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eeea9f92-8aaa-48ed-bf07-66b7a53e96b4 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:08.756744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-eeea9f92-8aaa-48ed-bf07-66b7a53e96b4 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:08.765698 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-eeea9f92-8aaa-48ed-bf07-66b7a53e96b4 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1474 microversion: 2.1 time: 0.543288 Oct 24 10:29:08.776930 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 679/1290] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:08 2022] GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 1474 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:08.776930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-83a6a6f2-7e87-46bc-8094-76f3e1094f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:08.776930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-83a6a6f2-7e87-46bc-8094-76f3e1094f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:08.778694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83a6a6f2-7e87-46bc-8094-76f3e1094f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:08.779587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83a6a6f2-7e87-46bc-8094-76f3e1094f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:08.784226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83a6a6f2-7e87-46bc-8094-76f3e1094f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:08.784226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83a6a6f2-7e87-46bc-8094-76f3e1094f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:08.784226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83a6a6f2-7e87-46bc-8094-76f3e1094f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:08.784226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83a6a6f2-7e87-46bc-8094-76f3e1094f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:08.817620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-3f67504e-97d7-44ec-be0b-6e5b2eac44d1 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Building network info cache for instance {{(pid=120425) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 10:29:09.150304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-83a6a6f2-7e87-46bc-8094-76f3e1094f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:09.167351 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-83a6a6f2-7e87-46bc-8094-76f3e1094f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 200 len: 1317 microversion: 2.1 time: 0.399034 Oct 24 10:29:09.182805 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 680/1291] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:08 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 1317 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:09.185551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fd07863f-48de-40cf-9c9b-3270454cd699 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:09.186395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fd07863f-48de-40cf-9c9b-3270454cd699 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:09.192783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd07863f-48de-40cf-9c9b-3270454cd699 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:09.193587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd07863f-48de-40cf-9c9b-3270454cd699 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:09.194423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd07863f-48de-40cf-9c9b-3270454cd699 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:09.195635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd07863f-48de-40cf-9c9b-3270454cd699 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:09.196405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd07863f-48de-40cf-9c9b-3270454cd699 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:09.197099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd07863f-48de-40cf-9c9b-3270454cd699 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:09.481737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-fd07863f-48de-40cf-9c9b-3270454cd699 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'services' on Instance uuid b9d7180f-82cf-4113-824a-6350d013baf1 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:09.502832 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fd07863f-48de-40cf-9c9b-3270454cd699 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 2035 microversion: 2.25 time: 0.324790 Oct 24 10:29:09.503422 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 681/1292] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:09 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 2035 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:09.509160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-31a732ad-eaba-47aa-9a50-c594905cfc47 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:09.510970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-31a732ad-eaba-47aa-9a50-c594905cfc47 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:09.520701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31a732ad-eaba-47aa-9a50-c594905cfc47 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:09.521783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31a732ad-eaba-47aa-9a50-c594905cfc47 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:09.523042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31a732ad-eaba-47aa-9a50-c594905cfc47 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:09.524019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31a732ad-eaba-47aa-9a50-c594905cfc47 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:09.524731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31a732ad-eaba-47aa-9a50-c594905cfc47 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:09.525477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31a732ad-eaba-47aa-9a50-c594905cfc47 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:09.657525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-3f67504e-97d7-44ec-be0b-6e5b2eac44d1 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Updating instance_info_cache with network_info: [{"id": "9d03d2ef-8a17-4594-b487-37b1ca2cc10b", "address": "fa:16:3e:31:2d:23", "network": {"id": "764d65e7-2cd6-484d-a7f4-f21087e0ed28", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-23390703-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "71c8dc3d203642269466444b34a31285", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9d03d2ef-8a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120425) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 10:29:09.674567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f67504e-97d7-44ec-be0b-6e5b2eac44d1 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Releasing lock "refresh_cache-8d47d8d5-f7d0-49c4-839a-92bababf20e7" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 10:29:09.676569 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3f67504e-97d7-44ec-be0b-6e5b2eac44d1 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "POST /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7/action" status: 202 len: 0 microversion: 2.1 time: 2.749787 Oct 24 10:29:09.677783 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 612/1293] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:29:06 2022] POST /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7/action => generated 0 bytes in 2752 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 24 10:29:09.683924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b5f97579-b0f9-4402-b6b9-15294a9638a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:09.685313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b5f97579-b0f9-4402-b6b9-15294a9638a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:09.695732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5f97579-b0f9-4402-b6b9-15294a9638a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:09.696537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5f97579-b0f9-4402-b6b9-15294a9638a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:09.697266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5f97579-b0f9-4402-b6b9-15294a9638a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:09.698174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5f97579-b0f9-4402-b6b9-15294a9638a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:09.698792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5f97579-b0f9-4402-b6b9-15294a9638a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:09.699378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5f97579-b0f9-4402-b6b9-15294a9638a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:09.862111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-31a732ad-eaba-47aa-9a50-c594905cfc47 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:09.877983 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-31a732ad-eaba-47aa-9a50-c594905cfc47 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1477 microversion: 2.1 time: 0.373298 Oct 24 10:29:09.888956 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 682/1294] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:09 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1477 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:09.895614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c2bb4aab-3e19-462a-8a88-2936c4d80d9e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:09.895614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c2bb4aab-3e19-462a-8a88-2936c4d80d9e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:09.901940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2bb4aab-3e19-462a-8a88-2936c4d80d9e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:09.902436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2bb4aab-3e19-462a-8a88-2936c4d80d9e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:09.902874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2bb4aab-3e19-462a-8a88-2936c4d80d9e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:09.903599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2bb4aab-3e19-462a-8a88-2936c4d80d9e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:09.904052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2bb4aab-3e19-462a-8a88-2936c4d80d9e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:09.904473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2bb4aab-3e19-462a-8a88-2936c4d80d9e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:10.027543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b5f97579-b0f9-4402-b6b9-15294a9638a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:10.047610 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b5f97579-b0f9-4402-b6b9-15294a9638a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.368526 Oct 24 10:29:10.048731 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 613/1295] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:09 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:10.055484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33580aa5-7837-44cd-82f5-c4afc084cbdb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:10.056361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-33580aa5-7837-44cd-82f5-c4afc084cbdb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:10.064632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33580aa5-7837-44cd-82f5-c4afc084cbdb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:10.065447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33580aa5-7837-44cd-82f5-c4afc084cbdb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:10.066206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33580aa5-7837-44cd-82f5-c4afc084cbdb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:10.068169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33580aa5-7837-44cd-82f5-c4afc084cbdb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:10.071462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33580aa5-7837-44cd-82f5-c4afc084cbdb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:10.072360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33580aa5-7837-44cd-82f5-c4afc084cbdb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:10.196078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c2bb4aab-3e19-462a-8a88-2936c4d80d9e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:10.207675 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c2bb4aab-3e19-462a-8a88-2936c4d80d9e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.320812 Oct 24 10:29:10.218949 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 683/1296] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:09 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:10.218949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1deb3a1e-4ad6-4d56-8a85-88eae99d89e5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Action: 'create', calling method: .version_select at 0x7f04d0caf820>, body: {"keypair": {"name": "tempest-keypair-1852502053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIEh2V9R//a02D0bXFVe1RsriOmrrCdwhGsvTZZm/8Lb4piFaiePLwle6BmXoXwz0H/AeMNDscriibvaGi6sIBZ7Pbkh5+ZLEiFw68Kj2n8hewTb6mch4oTxmPZ0tnZtg=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:10.228182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-33580aa5-7837-44cd-82f5-c4afc084cbdb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:10.234929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-1deb3a1e-4ad6-4d56-8a85-88eae99d89e5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Getting quotas for project 9f2d317e42584b41b11c1668de6657bd. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:10.237380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-33580aa5-7837-44cd-82f5-c4afc084cbdb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:10.238854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-33580aa5-7837-44cd-82f5-c4afc084cbdb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:10.242147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-1deb3a1e-4ad6-4d56-8a85-88eae99d89e5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Getting quotas for user 66ca4f9e7ffb447ebf740c52f6a098c2 and project 9f2d317e42584b41b11c1668de6657bd. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:10.246123 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-33580aa5-7837-44cd-82f5-c4afc084cbdb tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.196033 Oct 24 10:29:10.246816 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 614/1297] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:10 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:10.252774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8e28d0d1-06ca-4e68-80f3-e8f6ee9c575d tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '.version_select at 0x7f04d0bd9280>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:10.272564 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1deb3a1e-4ad6-4d56-8a85-88eae99d89e5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.062543 Oct 24 10:29:10.273495 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 684/1298] 10.222.0.50 () {62 vars in 1200 bytes} [Mon Oct 24 10:29:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 10:29:10.283195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8a08f10c-ae46-4216-8e35-5689efc530ec tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:10.283873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8a08f10c-ae46-4216-8e35-5689efc530ec tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:10.293393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a08f10c-ae46-4216-8e35-5689efc530ec tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:10.293838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a08f10c-ae46-4216-8e35-5689efc530ec tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:10.294482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a08f10c-ae46-4216-8e35-5689efc530ec tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:10.295638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a08f10c-ae46-4216-8e35-5689efc530ec tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:10.297744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a08f10c-ae46-4216-8e35-5689efc530ec tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:10.298286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a08f10c-ae46-4216-8e35-5689efc530ec tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:10.595916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8a08f10c-ae46-4216-8e35-5689efc530ec tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:10.614289 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8a08f10c-ae46-4216-8e35-5689efc530ec tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 200 len: 1474 microversion: 2.1 time: 0.338987 Oct 24 10:29:10.616966 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 685/1299] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:10 2022] GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 1474 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:10.623193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-97661b0d-c1c2-4d15-b3b2-822bc75ce5f1 req-28aefce9-f732-4cbb-84f8-15a16e97501d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d47d8d5-f7d0-49c4-839a-92bababf20e7", "tag": "9d03d2ef-8a17-4594-b487-37b1ca2cc10b"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:10.640366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-97661b0d-c1c2-4d15-b3b2-822bc75ce5f1 req-28aefce9-f732-4cbb-84f8-15a16e97501d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:10.643041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-97661b0d-c1c2-4d15-b3b2-822bc75ce5f1 req-28aefce9-f732-4cbb-84f8-15a16e97501d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:10.643729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-97661b0d-c1c2-4d15-b3b2-822bc75ce5f1 req-28aefce9-f732-4cbb-84f8-15a16e97501d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:10.663485 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-97661b0d-c1c2-4d15-b3b2-822bc75ce5f1 req-28aefce9-f732-4cbb-84f8-15a16e97501d service nova] Creating event network-changed:9d03d2ef-8a17-4594-b487-37b1ca2cc10b for instance 8d47d8d5-f7d0-49c4-839a-92bababf20e7 on n-h2-858383-15 Oct 24 10:29:10.670682 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-97661b0d-c1c2-4d15-b3b2-822bc75ce5f1 req-28aefce9-f732-4cbb-84f8-15a16e97501d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051801 Oct 24 10:29:10.671659 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 686/1300] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:10.682124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bf44540b-fda1-412f-bd4c-7976625d6076 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:10.683050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bf44540b-fda1-412f-bd4c-7976625d6076 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:10.691376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf44540b-fda1-412f-bd4c-7976625d6076 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:10.692338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf44540b-fda1-412f-bd4c-7976625d6076 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:10.693058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf44540b-fda1-412f-bd4c-7976625d6076 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:10.693996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf44540b-fda1-412f-bd4c-7976625d6076 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:10.695295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf44540b-fda1-412f-bd4c-7976625d6076 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:10.696028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf44540b-fda1-412f-bd4c-7976625d6076 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:10.745427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:10.769574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:11.138339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bf44540b-fda1-412f-bd4c-7976625d6076 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:11.146166 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bf44540b-fda1-412f-bd4c-7976625d6076 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 200 len: 1317 microversion: 2.1 time: 0.473111 Oct 24 10:29:11.161378 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 687/1301] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:10 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 1317 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:11.169060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0eca1c19-bf63-4f9b-9b0d-1eb31585b46c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:11.169375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0eca1c19-bf63-4f9b-9b0d-1eb31585b46c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:11.176463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0eca1c19-bf63-4f9b-9b0d-1eb31585b46c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:11.177116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0eca1c19-bf63-4f9b-9b0d-1eb31585b46c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:11.177563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0eca1c19-bf63-4f9b-9b0d-1eb31585b46c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:11.178326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0eca1c19-bf63-4f9b-9b0d-1eb31585b46c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:11.179667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0eca1c19-bf63-4f9b-9b0d-1eb31585b46c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:11.180262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0eca1c19-bf63-4f9b-9b0d-1eb31585b46c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:11.683457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0eca1c19-bf63-4f9b-9b0d-1eb31585b46c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:11.698648 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0eca1c19-bf63-4f9b-9b0d-1eb31585b46c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1477 microversion: 2.1 time: 0.536006 Oct 24 10:29:11.705297 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 688/1302] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:11 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1477 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:11.712178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-06944765-accb-45ef-8741-03c688b330e5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:11.713772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-06944765-accb-45ef-8741-03c688b330e5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:11.720728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06944765-accb-45ef-8741-03c688b330e5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:11.721265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06944765-accb-45ef-8741-03c688b330e5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:11.721738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06944765-accb-45ef-8741-03c688b330e5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:11.722441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06944765-accb-45ef-8741-03c688b330e5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:11.722899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06944765-accb-45ef-8741-03c688b330e5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:11.723329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06944765-accb-45ef-8741-03c688b330e5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:12.127653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-06944765-accb-45ef-8741-03c688b330e5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:12.145653 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-06944765-accb-45ef-8741-03c688b330e5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.438826 Oct 24 10:29:12.159059 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 689/1303] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:11 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:12.169841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-2039b5d5-4ae4-45a7-8cb5-96af76dbc03c req-433b0ac1-6d19-4b0e-83d7-b5957671a420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94278005-1d71-4976-b673-ad2d105385e0", "name": "network-vif-deleted", "tag": "9691a054-3d8c-4b1b-b4f4-09af40c934d5"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:12.180547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2039b5d5-4ae4-45a7-8cb5-96af76dbc03c req-433b0ac1-6d19-4b0e-83d7-b5957671a420 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:12.180963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2039b5d5-4ae4-45a7-8cb5-96af76dbc03c req-433b0ac1-6d19-4b0e-83d7-b5957671a420 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:12.181394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2039b5d5-4ae4-45a7-8cb5-96af76dbc03c req-433b0ac1-6d19-4b0e-83d7-b5957671a420 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:12.193570 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-2039b5d5-4ae4-45a7-8cb5-96af76dbc03c req-433b0ac1-6d19-4b0e-83d7-b5957671a420 service nova] Creating event network-vif-deleted:9691a054-3d8c-4b1b-b4f4-09af40c934d5 for instance 94278005-1d71-4976-b673-ad2d105385e0 on n-h1-858383-15 Oct 24 10:29:12.199812 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-2039b5d5-4ae4-45a7-8cb5-96af76dbc03c req-433b0ac1-6d19-4b0e-83d7-b5957671a420 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038736 Oct 24 10:29:12.200447 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 690/1304] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:12.209080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3aa3492d-b42a-4783-9fa2-5cfed83f68db tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:12.209816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3aa3492d-b42a-4783-9fa2-5cfed83f68db tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:12.216945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3aa3492d-b42a-4783-9fa2-5cfed83f68db tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:12.217438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3aa3492d-b42a-4783-9fa2-5cfed83f68db tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:12.217873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3aa3492d-b42a-4783-9fa2-5cfed83f68db tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:12.218793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3aa3492d-b42a-4783-9fa2-5cfed83f68db tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:12.219243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3aa3492d-b42a-4783-9fa2-5cfed83f68db tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:12.219666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3aa3492d-b42a-4783-9fa2-5cfed83f68db tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:12.637590 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8e28d0d1-06ca-4e68-80f3-e8f6ee9c575d tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/234f743c-f1f6-4938-8989-0f0706a6642e" status: 202 len: 0 microversion: 2.1 time: 2.389432 Oct 24 10:29:12.644021 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 615/1305] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:29:10 2022] DELETE /compute/v2.1/os-floating-ips/234f743c-f1f6-4938-8989-0f0706a6642e => generated 0 bytes in 2396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:29:12.649728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0b1096c2-ece0-44a0-a3f7-3be272a3ff87 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:12.650339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0b1096c2-ece0-44a0-a3f7-3be272a3ff87 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:12.657466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b1096c2-ece0-44a0-a3f7-3be272a3ff87 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:12.658049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b1096c2-ece0-44a0-a3f7-3be272a3ff87 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:12.658599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b1096c2-ece0-44a0-a3f7-3be272a3ff87 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:12.659343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b1096c2-ece0-44a0-a3f7-3be272a3ff87 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:12.659907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b1096c2-ece0-44a0-a3f7-3be272a3ff87 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:12.660519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b1096c2-ece0-44a0-a3f7-3be272a3ff87 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:12.755494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0b1096c2-ece0-44a0-a3f7-3be272a3ff87 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:12.765966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0b1096c2-ece0-44a0-a3f7-3be272a3ff87 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:12.767515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0b1096c2-ece0-44a0-a3f7-3be272a3ff87 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:12.773442 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0b1096c2-ece0-44a0-a3f7-3be272a3ff87 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.127460 Oct 24 10:29:12.774539 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 616/1306] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:12 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:12.779424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9ee8af5e-fdde-4f22-a590-79e30179e207 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:12.780032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9ee8af5e-fdde-4f22-a590-79e30179e207 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: 94278005-1d71-4976-b673-ad2d105385e0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:12.786325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ee8af5e-fdde-4f22-a590-79e30179e207 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:12.787021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ee8af5e-fdde-4f22-a590-79e30179e207 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:12.787614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ee8af5e-fdde-4f22-a590-79e30179e207 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:12.788979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ee8af5e-fdde-4f22-a590-79e30179e207 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:12.789666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ee8af5e-fdde-4f22-a590-79e30179e207 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:12.790327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ee8af5e-fdde-4f22-a590-79e30179e207 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:12.793880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3aa3492d-b42a-4783-9fa2-5cfed83f68db tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:12.802879 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3aa3492d-b42a-4783-9fa2-5cfed83f68db tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.598124 Oct 24 10:29:12.819185 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 691/1307] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:12 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:12.820424 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-9ee8af5e-fdde-4f22-a590-79e30179e207 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] HTTP exception thrown: Instance 94278005-1d71-4976-b673-ad2d105385e0 could not be found. Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9ee8af5e-fdde-4f22-a590-79e30179e207 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Request method failure captured: Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 HTTP/1.1 Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmhU-UEcpqfOgJOdtDrTXQgP8rLgco0SwoQWMQxBBj_WR8WIoqne9dA7KS-glPVNeGb_gTgodPlmFWObkr6EoU6vyQ3H3GxtpVY6ecnwNTqAloavo-E9C8cIVyS8OT_oCK0uETyCUa7k7DhT3a0p1yBN52UndU6aoHBbI8mlyEdTQkE Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 1f301001adb14e80ac92b2ed20b1c383 Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ListImageFiltersTestJSON-727503360 Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:29:12.823832 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:29:12.826529 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1f301001adb14e80ac92b2ed20b1c383"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1f301001adb14e80ac92b2ed20b1c383"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1f301001adb14e80ac92b2ed20b1c383"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1f301001adb14e80ac92b2ed20b1c383", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:29:12.826529 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ListImageFiltersTestJSON-727503360 Oct 24 10:29:12.826529 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 1f301001adb14e80ac92b2ed20b1c383 Oct 24 10:29:12.826529 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-727503360 Oct 24 10:29:12.826529 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ListImageFiltersTestJSON-727503360-project Oct 24 10:29:12.826529 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:29:12.826529 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:29:12.826529 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a8549ee547f74419ab10b074f15fe80a Oct 24 10:29:12.826529 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ListImageFiltersTestJSON-727503360-project Oct 24 10:29:12.826529 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:29:12.826529 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 94278005-1d71-4976-b673-ad2d105385e0 could not be found. Oct 24 10:29:12.826529 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '94278005-1d71-4976-b673-ad2d105385e0'} Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94278005-1d71-4976-b673-ad2d105385e0 could not be found. Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:29:12.827956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:29:12.830110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:29:12.830110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:29:12.830110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:29:12.830110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:29:12.830110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:29:12.830110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:29:12.830110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:29:12.830110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94278005-1d71-4976-b673-ad2d105385e0 could not be found. Oct 24 10:29:12.830110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:12.830110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:29:12.830110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:12.830110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:12.830110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:29:12.830110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:29:12.830110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:29:12.830110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:29:12.830110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94278005-1d71-4976-b673-ad2d105385e0 could not be found. Oct 24 10:29:12.830110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:12.832498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d27d12b7-3d51-44e0-ad5e-ed545a92f18c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:12.832498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d27d12b7-3d51-44e0-ad5e-ed545a92f18c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:12.834510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9ee8af5e-fdde-4f22-a590-79e30179e207 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Returning 404 to user: Instance 94278005-1d71-4976-b673-ad2d105385e0 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:29:12.835103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d27d12b7-3d51-44e0-ad5e-ed545a92f18c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:12.835865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d27d12b7-3d51-44e0-ad5e-ed545a92f18c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:12.836271 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9ee8af5e-fdde-4f22-a590-79e30179e207 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0" status: 404 len: 111 microversion: 2.1 time: 0.060313 Oct 24 10:29:12.836482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d27d12b7-3d51-44e0-ad5e-ed545a92f18c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:12.837247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d27d12b7-3d51-44e0-ad5e-ed545a92f18c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:12.837724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d27d12b7-3d51-44e0-ad5e-ed545a92f18c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:12.838084 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 617/1308] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:12 2022] GET /compute/v2.1/servers/94278005-1d71-4976-b673-ad2d105385e0 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:29:12.841243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d27d12b7-3d51-44e0-ad5e-ed545a92f18c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:12.844173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dd1df5c7-8c26-4b6a-a221-597f44bfa597 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dd1df5c7-8c26-4b6a-a221-597f44bfa597 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Request method failure captured: Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7/action HTTP/1.1 Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 34 Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmi_taZ9SGyfWzaDH6IUvhaYiGC4GobtrVdV0PxVp8Z16RogMUW92m-QtSMAvgNsvx3NjJ0zNNjycJimPPe68fBnwLL3H8T4S5Cr4nGHEe5wjZUVfHINexasG2IrFwz1si5o2_sKgjhAQ-u9O_VnhHya6sNADdrcfmuIsrFe03zvfy0 Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 71c8dc3d203642269466444b34a31285 Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:29:12.858026 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:29:12.859663 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/71c8dc3d203642269466444b34a31285"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/71c8dc3d203642269466444b34a31285"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/71c8dc3d203642269466444b34a31285"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_71c8dc3d203642269466444b34a31285", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:29:12.859663 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 Oct 24 10:29:12.859663 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 71c8dc3d203642269466444b34a31285 Oct 24 10:29:12.859663 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 Oct 24 10:29:12.859663 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project Oct 24 10:29:12.859663 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:29:12.859663 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:29:12.859663 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 30108371eb394d148babe9e2f36c9454 Oct 24 10:29:12.859663 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project Oct 24 10:29:12.859663 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:29:12.859663 n-d-858383-15 devstack@n-api.service[120425]: {"addFloatingIp": {"address": ""}} Oct 24 10:29:12.859663 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:29:12.859663 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '8d47d8d5-f7d0-49c4-839a-92bababf20e7', 'body': {'addFloatingIp': {'address': ''}}} Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi '' Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:29:12.860669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:29:12.863215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:29:12.864717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 24 10:29:12.864717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:12.868998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dd1df5c7-8c26-4b6a-a221-597f44bfa597 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:29:12.871033 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dd1df5c7-8c26-4b6a-a221-597f44bfa597 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "POST /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7/action" status: 400 len: 142 microversion: 2.1 time: 0.031827 Oct 24 10:29:12.878147 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 618/1309] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:29:12 2022] POST /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7/action => generated 142 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:29:12.885354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-50fccb56-516e-49bd-842a-cc8c824eaf58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:12.886243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-50fccb56-516e-49bd-842a-cc8c824eaf58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:12.894748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50fccb56-516e-49bd-842a-cc8c824eaf58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:12.895510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50fccb56-516e-49bd-842a-cc8c824eaf58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:12.895944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50fccb56-516e-49bd-842a-cc8c824eaf58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:12.896654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50fccb56-516e-49bd-842a-cc8c824eaf58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:12.897145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50fccb56-516e-49bd-842a-cc8c824eaf58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:12.897639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50fccb56-516e-49bd-842a-cc8c824eaf58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:13.153953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d27d12b7-3d51-44e0-ad5e-ed545a92f18c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:13.171352 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d27d12b7-3d51-44e0-ad5e-ed545a92f18c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 200 len: 1317 microversion: 2.1 time: 0.349709 Oct 24 10:29:13.172590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-50fccb56-516e-49bd-842a-cc8c824eaf58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:13.185512 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 692/1310] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:12 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:13.191310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-985ae00e-1742-443a-91ff-cb7f2e3101df tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:13.192117 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-50fccb56-516e-49bd-842a-cc8c824eaf58 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1477 microversion: 2.1 time: 0.312593 Oct 24 10:29:13.192905 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 619/1311] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:12 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1477 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:13.195110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-985ae00e-1742-443a-91ff-cb7f2e3101df tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: a8f749f9-5771-4ecb-8a06-30a8f69dd848] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:13.201684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-22250745-bba8-4c96-ab7a-25d269f5d3d4 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:13.201881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-985ae00e-1742-443a-91ff-cb7f2e3101df tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:13.202321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-985ae00e-1742-443a-91ff-cb7f2e3101df tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:13.202767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-985ae00e-1742-443a-91ff-cb7f2e3101df tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:13.206059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-985ae00e-1742-443a-91ff-cb7f2e3101df tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:13.206569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-985ae00e-1742-443a-91ff-cb7f2e3101df tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:13.207011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-985ae00e-1742-443a-91ff-cb7f2e3101df tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:13.210577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-22250745-bba8-4c96-ab7a-25d269f5d3d4 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:13.233687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22250745-bba8-4c96-ab7a-25d269f5d3d4 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:13.234342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22250745-bba8-4c96-ab7a-25d269f5d3d4 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:13.234899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22250745-bba8-4c96-ab7a-25d269f5d3d4 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:13.235706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22250745-bba8-4c96-ab7a-25d269f5d3d4 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:13.236264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22250745-bba8-4c96-ab7a-25d269f5d3d4 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:13.237085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22250745-bba8-4c96-ab7a-25d269f5d3d4 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:13.240944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-985ae00e-1742-443a-91ff-cb7f2e3101df tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: a8f749f9-5771-4ecb-8a06-30a8f69dd848] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:29:13.271435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22250745-bba8-4c96-ab7a-25d269f5d3d4 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "refresh_cache-8d47d8d5-f7d0-49c4-839a-92bababf20e7" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 10:29:13.271799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22250745-bba8-4c96-ab7a-25d269f5d3d4 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquired lock "refresh_cache-8d47d8d5-f7d0-49c4-839a-92bababf20e7" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 10:29:13.342937 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-985ae00e-1742-443a-91ff-cb7f2e3101df tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848" status: 204 len: 0 microversion: 2.1 time: 0.153707 Oct 24 10:29:13.343939 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 693/1312] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:29:13 2022] DELETE /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:13.351587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-94b77095-b5ef-42a7-9051-67e3b3b4b6b6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:13.352574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-94b77095-b5ef-42a7-9051-67e3b3b4b6b6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:13.359269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94b77095-b5ef-42a7-9051-67e3b3b4b6b6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:13.360105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94b77095-b5ef-42a7-9051-67e3b3b4b6b6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:13.360538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94b77095-b5ef-42a7-9051-67e3b3b4b6b6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:13.361353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94b77095-b5ef-42a7-9051-67e3b3b4b6b6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:13.362123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94b77095-b5ef-42a7-9051-67e3b3b4b6b6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:13.362558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94b77095-b5ef-42a7-9051-67e3b3b4b6b6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:13.437231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22250745-bba8-4c96-ab7a-25d269f5d3d4 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Releasing lock "refresh_cache-8d47d8d5-f7d0-49c4-839a-92bababf20e7" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 10:29:13.437792 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-22250745-bba8-4c96-ab7a-25d269f5d3d4 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] HTTP exception thrown: floating IP not found Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-22250745-bba8-4c96-ab7a-25d269f5d3d4 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Request method failure captured: Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7/action HTTP/1.1 Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 41 Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmi_taZ9SGyfWzaDH6IUvhaYiGC4GobtrVdV0PxVp8Z16RogMUW92m-QtSMAvgNsvx3NjJ0zNNjycJimPPe68fBnwLL3H8T4S5Cr4nGHEe5wjZUVfHINexasG2IrFwz1si5o2_sKgjhAQ-u9O_VnhHya6sNADdrcfmuIsrFe03zvfy0 Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 71c8dc3d203642269466444b34a31285 Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:29:13.439351 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:29:13.440967 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/71c8dc3d203642269466444b34a31285"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/71c8dc3d203642269466444b34a31285"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/71c8dc3d203642269466444b34a31285"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_71c8dc3d203642269466444b34a31285", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:29:13.440967 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 Oct 24 10:29:13.440967 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 71c8dc3d203642269466444b34a31285 Oct 24 10:29:13.440967 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 Oct 24 10:29:13.440967 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project Oct 24 10:29:13.440967 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:29:13.440967 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:29:13.440967 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 30108371eb394d148babe9e2f36c9454 Oct 24 10:29:13.440967 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project Oct 24 10:29:13.440967 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:29:13.440967 n-d-858383-15 devstack@n-api.service[120425]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 24 10:29:13.440967 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:29:13.440967 n-d-858383-15 devstack@n-api.service[120425]: exception: floating IP not found Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '8d47d8d5-f7d0-49c4-839a-92bababf20e7', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:29:13.442034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 24 10:29:13.443278 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:13.444543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-22250745-bba8-4c96-ab7a-25d269f5d3d4 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Returning 404 to user: floating IP not found {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:29:13.444543 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-22250745-bba8-4c96-ab7a-25d269f5d3d4 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "POST /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7/action" status: 404 len: 67 microversion: 2.1 time: 0.244486 Oct 24 10:29:13.444543 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 620/1313] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:29:13 2022] POST /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7/action => generated 67 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:29:13.448476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d319cb74-30ad-4089-ae16-9c3d34b56712 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:13.449110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d319cb74-30ad-4089-ae16-9c3d34b56712 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: a8f749f9-5771-4ecb-8a06-30a8f69dd848] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:13.455137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d319cb74-30ad-4089-ae16-9c3d34b56712 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:13.455614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d319cb74-30ad-4089-ae16-9c3d34b56712 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:13.456038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d319cb74-30ad-4089-ae16-9c3d34b56712 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:13.456745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d319cb74-30ad-4089-ae16-9c3d34b56712 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:13.457218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d319cb74-30ad-4089-ae16-9c3d34b56712 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:13.457642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d319cb74-30ad-4089-ae16-9c3d34b56712 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:13.678602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94b77095-b5ef-42a7-9051-67e3b3b4b6b6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:13.687627 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-94b77095-b5ef-42a7-9051-67e3b3b4b6b6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.341561 Oct 24 10:29:13.688210 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 694/1314] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:13 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:13.693183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ceb1e567-bf7c-40f6-bc8b-7aed6e9243ce tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:13.751967 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-ceb1e567-bf7c-40f6-bc8b-7aed6e9243ce tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ceb1e567-bf7c-40f6-bc8b-7aed6e9243ce tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Request method failure captured: Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7/action HTTP/1.1 Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 44 Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmi_taZ9SGyfWzaDH6IUvhaYiGC4GobtrVdV0PxVp8Z16RogMUW92m-QtSMAvgNsvx3NjJ0zNNjycJimPPe68fBnwLL3H8T4S5Cr4nGHEe5wjZUVfHINexasG2IrFwz1si5o2_sKgjhAQ-u9O_VnhHya6sNADdrcfmuIsrFe03zvfy0 Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 71c8dc3d203642269466444b34a31285 Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:29:13.754361 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:29:13.755686 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/71c8dc3d203642269466444b34a31285"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/71c8dc3d203642269466444b34a31285"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/71c8dc3d203642269466444b34a31285"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_71c8dc3d203642269466444b34a31285", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:29:13.755686 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 Oct 24 10:29:13.755686 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 71c8dc3d203642269466444b34a31285 Oct 24 10:29:13.755686 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 Oct 24 10:29:13.755686 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project Oct 24 10:29:13.755686 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:29:13.755686 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:29:13.755686 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 30108371eb394d148babe9e2f36c9454 Oct 24 10:29:13.755686 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project Oct 24 10:29:13.755686 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:29:13.755686 n-d-858383-15 devstack@n-api.service[120426]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 24 10:29:13.755686 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:29:13.755686 n-d-858383-15 devstack@n-api.service[120426]: exception: Floating IP not found for address 0.0.0.0. Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '8d47d8d5-f7d0-49c4-839a-92bababf20e7', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:29:13.756481 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 24 10:29:13.758368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:29:13.759555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ceb1e567-bf7c-40f6-bc8b-7aed6e9243ce tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:29:13.759555 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ceb1e567-bf7c-40f6-bc8b-7aed6e9243ce tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "POST /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7/action" status: 404 len: 88 microversion: 2.1 time: 0.066703 Oct 24 10:29:13.759701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d319cb74-30ad-4089-ae16-9c3d34b56712 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:13.762252 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 695/1315] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:29:13 2022] POST /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7/action => generated 88 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:29:13.766037 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d319cb74-30ad-4089-ae16-9c3d34b56712 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848" status: 200 len: 1472 microversion: 2.1 time: 0.323112 Oct 24 10:29:13.766760 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 621/1316] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:13 2022] GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848 => generated 1472 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:13.767517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-01c452ce-5e2e-4c74-8704-3ba9199be09e tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:13.768390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-01c452ce-5e2e-4c74-8704-3ba9199be09e tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:13.776065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01c452ce-5e2e-4c74-8704-3ba9199be09e tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:13.777303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01c452ce-5e2e-4c74-8704-3ba9199be09e tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:13.777767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01c452ce-5e2e-4c74-8704-3ba9199be09e tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:13.778472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01c452ce-5e2e-4c74-8704-3ba9199be09e tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:13.778925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01c452ce-5e2e-4c74-8704-3ba9199be09e tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:13.779351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01c452ce-5e2e-4c74-8704-3ba9199be09e tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:13.795351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:13.801925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-425f376d-7fb1-47dc-8086-8b5d28ba5731 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:13.802674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-425f376d-7fb1-47dc-8086-8b5d28ba5731 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:13.809411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-01c452ce-5e2e-4c74-8704-3ba9199be09e tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:29:13.809747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-425f376d-7fb1-47dc-8086-8b5d28ba5731 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:13.810245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-425f376d-7fb1-47dc-8086-8b5d28ba5731 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:13.810682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-425f376d-7fb1-47dc-8086-8b5d28ba5731 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:13.811379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-425f376d-7fb1-47dc-8086-8b5d28ba5731 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:13.811836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-425f376d-7fb1-47dc-8086-8b5d28ba5731 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:13.812264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-425f376d-7fb1-47dc-8086-8b5d28ba5731 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:13.880486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-425f376d-7fb1-47dc-8086-8b5d28ba5731 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:13.891713 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-01c452ce-5e2e-4c74-8704-3ba9199be09e tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 204 len: 0 microversion: 2.1 time: 0.128228 Oct 24 10:29:13.891992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-425f376d-7fb1-47dc-8086-8b5d28ba5731 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:13.892510 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 696/1317] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:29:13 2022] DELETE /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:13.896560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-425f376d-7fb1-47dc-8086-8b5d28ba5731 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:13.897812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-205ad933-276e-4dcd-b457-d194f8d7d70e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-173535452", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "979ef371-392f-454f-8dbb-ad9320d9a120"}], "security_groups": [{"name": "tempest-securitygroup--10438471"}], "key_name": "tempest-keypair-1852502053", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:13.901953 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-425f376d-7fb1-47dc-8086-8b5d28ba5731 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.104167 Oct 24 10:29:13.902515 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 622/1318] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:13 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:13.907253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-002d26d3-6de2-4ca2-bc59-30473c71c411 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:13.908819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-002d26d3-6de2-4ca2-bc59-30473c71c411 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:13.915372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-002d26d3-6de2-4ca2-bc59-30473c71c411 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:13.915903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-002d26d3-6de2-4ca2-bc59-30473c71c411 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:13.916339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-002d26d3-6de2-4ca2-bc59-30473c71c411 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:13.917053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-002d26d3-6de2-4ca2-bc59-30473c71c411 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:13.917506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-002d26d3-6de2-4ca2-bc59-30473c71c411 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:13.917925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-002d26d3-6de2-4ca2-bc59-30473c71c411 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:14.011500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-205ad933-276e-4dcd-b457-d194f8d7d70e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] validate_networks() for [('979ef371-392f-454f-8dbb-ad9320d9a120', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:29:14.192616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-002d26d3-6de2-4ca2-bc59-30473c71c411 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:14.200879 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-002d26d3-6de2-4ca2-bc59-30473c71c411 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.297194 Oct 24 10:29:14.201553 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 623/1319] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:13 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:14.206161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7b697383-8086-48f3-9e93-fa798bf1bd8a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:14.206761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7b697383-8086-48f3-9e93-fa798bf1bd8a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:14.212722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b697383-8086-48f3-9e93-fa798bf1bd8a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:14.213742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b697383-8086-48f3-9e93-fa798bf1bd8a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:14.214181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b697383-8086-48f3-9e93-fa798bf1bd8a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:14.214873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b697383-8086-48f3-9e93-fa798bf1bd8a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:14.215321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b697383-8086-48f3-9e93-fa798bf1bd8a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:14.215741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b697383-8086-48f3-9e93-fa798bf1bd8a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:14.219902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:14.434355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7b697383-8086-48f3-9e93-fa798bf1bd8a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:14.442075 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7b697383-8086-48f3-9e93-fa798bf1bd8a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1540 microversion: 2.1 time: 0.239499 Oct 24 10:29:14.442650 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 624/1320] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:14 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1540 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:14.447472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4b4010d4-fe0f-4d45-99fb-09d0b39f44c4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:14.448081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4b4010d4-fe0f-4d45-99fb-09d0b39f44c4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:14.453852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b4010d4-fe0f-4d45-99fb-09d0b39f44c4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:14.454330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b4010d4-fe0f-4d45-99fb-09d0b39f44c4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:14.454759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b4010d4-fe0f-4d45-99fb-09d0b39f44c4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:14.455453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b4010d4-fe0f-4d45-99fb-09d0b39f44c4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:14.456493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b4010d4-fe0f-4d45-99fb-09d0b39f44c4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:14.456493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b4010d4-fe0f-4d45-99fb-09d0b39f44c4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:14.567040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-205ad933-276e-4dcd-b457-d194f8d7d70e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:29:14.567584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-205ad933-276e-4dcd-b457-d194f8d7d70e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:29:14.567935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-205ad933-276e-4dcd-b457-d194f8d7d70e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:29:14.568374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-205ad933-276e-4dcd-b457-d194f8d7d70e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:29:14.568788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-205ad933-276e-4dcd-b457-d194f8d7d70e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:29:14.577843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-205ad933-276e-4dcd-b457-d194f8d7d70e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:14.578336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-205ad933-276e-4dcd-b457-d194f8d7d70e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:14.578784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-205ad933-276e-4dcd-b457-d194f8d7d70e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:14.579524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-205ad933-276e-4dcd-b457-d194f8d7d70e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:14.579988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-205ad933-276e-4dcd-b457-d194f8d7d70e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:14.580422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-205ad933-276e-4dcd-b457-d194f8d7d70e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:14.598283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-205ad933-276e-4dcd-b457-d194f8d7d70e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Getting quotas for project 9f2d317e42584b41b11c1668de6657bd. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:14.604261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-205ad933-276e-4dcd-b457-d194f8d7d70e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Getting quotas for user 66ca4f9e7ffb447ebf740c52f6a098c2 and project 9f2d317e42584b41b11c1668de6657bd. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:14.611275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4b4010d4-fe0f-4d45-99fb-09d0b39f44c4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:14.617408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-205ad933-276e-4dcd-b457-d194f8d7d70e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:29:14.619866 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4b4010d4-fe0f-4d45-99fb-09d0b39f44c4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 200 len: 1317 microversion: 2.1 time: 0.176261 Oct 24 10:29:14.619988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-205ad933-276e-4dcd-b457-d194f8d7d70e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:29:14.620439 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 625/1321] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:14 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:14.624773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4587ee5f-fe2d-4e26-8510-f11582700054 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:14.625411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4587ee5f-fe2d-4e26-8510-f11582700054 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:14.631421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4587ee5f-fe2d-4e26-8510-f11582700054 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:14.632647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4587ee5f-fe2d-4e26-8510-f11582700054 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:14.633116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4587ee5f-fe2d-4e26-8510-f11582700054 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:14.633800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4587ee5f-fe2d-4e26-8510-f11582700054 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:14.634244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4587ee5f-fe2d-4e26-8510-f11582700054 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:14.634836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4587ee5f-fe2d-4e26-8510-f11582700054 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:14.668563 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-205ad933-276e-4dcd-b457-d194f8d7d70e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.25 time: 0.774870 Oct 24 10:29:14.669647 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 697/1322] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Oct 24 10:29:13 2022] POST /compute/v2.1/servers => generated 404 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 10:29:14.681596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-51936b17-c7de-44a7-a5a3-d6f00e094731 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:14.682492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-51936b17-c7de-44a7-a5a3-d6f00e094731 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:14.757574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-51936b17-c7de-44a7-a5a3-d6f00e094731 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:14.766092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-51936b17-c7de-44a7-a5a3-d6f00e094731 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:14.767545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-51936b17-c7de-44a7-a5a3-d6f00e094731 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:14.768730 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-51936b17-c7de-44a7-a5a3-d6f00e094731 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1285 microversion: 2.25 time: 0.092087 Oct 24 10:29:14.769327 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 698/1323] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:14 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:29:14.774243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8f30e5e8-5aae-4946-8f20-64ac16375825 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:14.775201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8f30e5e8-5aae-4946-8f20-64ac16375825 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:14.782855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f30e5e8-5aae-4946-8f20-64ac16375825 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:14.783274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f30e5e8-5aae-4946-8f20-64ac16375825 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:14.783803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f30e5e8-5aae-4946-8f20-64ac16375825 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:14.784867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f30e5e8-5aae-4946-8f20-64ac16375825 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:14.785359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f30e5e8-5aae-4946-8f20-64ac16375825 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:14.785801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f30e5e8-5aae-4946-8f20-64ac16375825 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:14.808112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4587ee5f-fe2d-4e26-8510-f11582700054 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:14.817041 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4587ee5f-fe2d-4e26-8510-f11582700054 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1477 microversion: 2.1 time: 0.195551 Oct 24 10:29:14.820008 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 626/1324] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:14 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1477 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:14.831588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9e404976-6fdc-434d-bb37-7ec13bb56241 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:14.833606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9e404976-6fdc-434d-bb37-7ec13bb56241 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: a8f749f9-5771-4ecb-8a06-30a8f69dd848] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:14.841141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e404976-6fdc-434d-bb37-7ec13bb56241 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:14.841975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e404976-6fdc-434d-bb37-7ec13bb56241 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:14.842581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e404976-6fdc-434d-bb37-7ec13bb56241 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:14.849914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e404976-6fdc-434d-bb37-7ec13bb56241 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:14.850245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e404976-6fdc-434d-bb37-7ec13bb56241 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:14.851376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e404976-6fdc-434d-bb37-7ec13bb56241 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:15.000729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8f30e5e8-5aae-4946-8f20-64ac16375825 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:15.013331 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8f30e5e8-5aae-4946-8f20-64ac16375825 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.242916 Oct 24 10:29:15.014317 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 699/1325] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:14 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:15.027772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-89e67f83-cc00-4c0a-9f60-8d14ba3388a7 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:15.028808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-89e67f83-cc00-4c0a-9f60-8d14ba3388a7 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:15.031905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9e404976-6fdc-434d-bb37-7ec13bb56241 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:15.039955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-89e67f83-cc00-4c0a-9f60-8d14ba3388a7 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:15.040668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-89e67f83-cc00-4c0a-9f60-8d14ba3388a7 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:15.041241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-89e67f83-cc00-4c0a-9f60-8d14ba3388a7 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:15.042095 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9e404976-6fdc-434d-bb37-7ec13bb56241 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848" status: 200 len: 1472 microversion: 2.1 time: 0.216194 Oct 24 10:29:15.042506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-89e67f83-cc00-4c0a-9f60-8d14ba3388a7 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:15.042673 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 627/1326] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:14 2022] GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848 => generated 1472 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:15.043126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-89e67f83-cc00-4c0a-9f60-8d14ba3388a7 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:15.043699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-89e67f83-cc00-4c0a-9f60-8d14ba3388a7 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:15.126357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-89e67f83-cc00-4c0a-9f60-8d14ba3388a7 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:15.136406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-89e67f83-cc00-4c0a-9f60-8d14ba3388a7 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:15.138122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-89e67f83-cc00-4c0a-9f60-8d14ba3388a7 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:15.143908 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-89e67f83-cc00-4c0a-9f60-8d14ba3388a7 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.121432 Oct 24 10:29:15.144514 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 700/1327] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:15 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:15.168486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a24a42b1-c5f8-4edd-b0f9-b3d20e0aec3d req-fb92db86-643a-4227-8e19-aa435923a01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf77d3a-0153-41cb-aba3-723a2aea3096", "name": "network-vif-plugged", "status": "completed", "tag": "c8ddb73d-e5b4-40cb-8aa9-348564b976e0"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:15.181014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a24a42b1-c5f8-4edd-b0f9-b3d20e0aec3d req-fb92db86-643a-4227-8e19-aa435923a01c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:15.181855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a24a42b1-c5f8-4edd-b0f9-b3d20e0aec3d req-fb92db86-643a-4227-8e19-aa435923a01c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:15.182655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a24a42b1-c5f8-4edd-b0f9-b3d20e0aec3d req-fb92db86-643a-4227-8e19-aa435923a01c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:15.202438 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a24a42b1-c5f8-4edd-b0f9-b3d20e0aec3d req-fb92db86-643a-4227-8e19-aa435923a01c service nova] Creating event network-vif-plugged:c8ddb73d-e5b4-40cb-8aa9-348564b976e0 for instance 4cf77d3a-0153-41cb-aba3-723a2aea3096 on n-h2-858383-15 Oct 24 10:29:15.208881 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a24a42b1-c5f8-4edd-b0f9-b3d20e0aec3d req-fb92db86-643a-4227-8e19-aa435923a01c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046195 Oct 24 10:29:15.209555 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 628/1328] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:15.223690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-206d6397-146b-4544-b239-fd9908ba14c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:15.224596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-206d6397-146b-4544-b239-fd9908ba14c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:15.233428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-206d6397-146b-4544-b239-fd9908ba14c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:15.234560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-206d6397-146b-4544-b239-fd9908ba14c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:15.235190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-206d6397-146b-4544-b239-fd9908ba14c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:15.236127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-206d6397-146b-4544-b239-fd9908ba14c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:15.236789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-206d6397-146b-4544-b239-fd9908ba14c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:15.238042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-206d6397-146b-4544-b239-fd9908ba14c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:15.374110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-206d6397-146b-4544-b239-fd9908ba14c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:15.383835 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-206d6397-146b-4544-b239-fd9908ba14c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.164038 Oct 24 10:29:15.384456 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 701/1329] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:15 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:15.466320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-04bfc078-24a6-4e46-b0c3-64b68585fd45 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:15.467010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-04bfc078-24a6-4e46-b0c3-64b68585fd45 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:15.473138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04bfc078-24a6-4e46-b0c3-64b68585fd45 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:15.473615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04bfc078-24a6-4e46-b0c3-64b68585fd45 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:15.474045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04bfc078-24a6-4e46-b0c3-64b68585fd45 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:15.474721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04bfc078-24a6-4e46-b0c3-64b68585fd45 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:15.475167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04bfc078-24a6-4e46-b0c3-64b68585fd45 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:15.476262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04bfc078-24a6-4e46-b0c3-64b68585fd45 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:15.612059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-04bfc078-24a6-4e46-b0c3-64b68585fd45 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:15.620925 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-04bfc078-24a6-4e46-b0c3-64b68585fd45 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1540 microversion: 2.1 time: 0.158831 Oct 24 10:29:15.621504 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 629/1330] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:15 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1540 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:15.643647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4aab8168-1e85-4eab-8490-79a71ad71341 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:15.644276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4aab8168-1e85-4eab-8490-79a71ad71341 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:15.651208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4aab8168-1e85-4eab-8490-79a71ad71341 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:15.651705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4aab8168-1e85-4eab-8490-79a71ad71341 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:15.652188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4aab8168-1e85-4eab-8490-79a71ad71341 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:15.652947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4aab8168-1e85-4eab-8490-79a71ad71341 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:15.653399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4aab8168-1e85-4eab-8490-79a71ad71341 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:15.653833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4aab8168-1e85-4eab-8490-79a71ad71341 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:15.796157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e13151f-2377-4062-8cc7-354c8d4661f0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:15.796572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5e13151f-2377-4062-8cc7-354c8d4661f0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:15.799038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4aab8168-1e85-4eab-8490-79a71ad71341 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:15.805167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e13151f-2377-4062-8cc7-354c8d4661f0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:15.805553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e13151f-2377-4062-8cc7-354c8d4661f0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:15.805983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e13151f-2377-4062-8cc7-354c8d4661f0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:15.806672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e13151f-2377-4062-8cc7-354c8d4661f0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:15.807136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e13151f-2377-4062-8cc7-354c8d4661f0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:15.807535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e13151f-2377-4062-8cc7-354c8d4661f0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:15.808050 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4aab8168-1e85-4eab-8490-79a71ad71341 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 200 len: 1317 microversion: 2.1 time: 0.168292 Oct 24 10:29:15.808631 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 702/1331] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:15 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:15.842650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1cc99873-01a1-4ae6-9854-8a5d57721fa2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:15.843593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1cc99873-01a1-4ae6-9854-8a5d57721fa2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:15.850241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1cc99873-01a1-4ae6-9854-8a5d57721fa2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:15.851560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1cc99873-01a1-4ae6-9854-8a5d57721fa2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:15.852298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1cc99873-01a1-4ae6-9854-8a5d57721fa2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:15.853219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1cc99873-01a1-4ae6-9854-8a5d57721fa2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:15.853960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1cc99873-01a1-4ae6-9854-8a5d57721fa2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:15.854569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1cc99873-01a1-4ae6-9854-8a5d57721fa2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:15.870939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5e13151f-2377-4062-8cc7-354c8d4661f0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:15.882129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5e13151f-2377-4062-8cc7-354c8d4661f0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:15.883940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5e13151f-2377-4062-8cc7-354c8d4661f0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:15.885325 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5e13151f-2377-4062-8cc7-354c8d4661f0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1337 microversion: 2.25 time: 0.093679 Oct 24 10:29:15.893908 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 630/1332] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:15 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1337 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:29:15.992904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1cc99873-01a1-4ae6-9854-8a5d57721fa2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:16.000674 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1cc99873-01a1-4ae6-9854-8a5d57721fa2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1477 microversion: 2.1 time: 0.162393 Oct 24 10:29:16.001532 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 703/1333] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:15 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1477 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:16.037474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dccabfae-77ff-4115-a56e-40f8d6d17ca8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:16.038775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dccabfae-77ff-4115-a56e-40f8d6d17ca8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:16.045443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dccabfae-77ff-4115-a56e-40f8d6d17ca8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:16.045924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dccabfae-77ff-4115-a56e-40f8d6d17ca8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:16.046357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dccabfae-77ff-4115-a56e-40f8d6d17ca8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:16.047052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dccabfae-77ff-4115-a56e-40f8d6d17ca8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:16.047506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dccabfae-77ff-4115-a56e-40f8d6d17ca8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:16.047935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dccabfae-77ff-4115-a56e-40f8d6d17ca8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:16.066025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7e409382-0c58-4b4c-b8cb-7457c8c8c6e6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:16.066655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7e409382-0c58-4b4c-b8cb-7457c8c8c6e6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: a8f749f9-5771-4ecb-8a06-30a8f69dd848] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:16.072734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e409382-0c58-4b4c-b8cb-7457c8c8c6e6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:16.073264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e409382-0c58-4b4c-b8cb-7457c8c8c6e6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:16.073705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e409382-0c58-4b4c-b8cb-7457c8c8c6e6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:16.074413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e409382-0c58-4b4c-b8cb-7457c8c8c6e6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:16.074870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e409382-0c58-4b4c-b8cb-7457c8c8c6e6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:16.075299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e409382-0c58-4b4c-b8cb-7457c8c8c6e6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:16.249513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dccabfae-77ff-4115-a56e-40f8d6d17ca8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:16.254119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7e409382-0c58-4b4c-b8cb-7457c8c8c6e6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:16.259785 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dccabfae-77ff-4115-a56e-40f8d6d17ca8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.226050 Oct 24 10:29:16.261043 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 631/1334] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:16 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:16.265991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3064696f-b666-4015-b1fb-097fbf1594de tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:16.266865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3064696f-b666-4015-b1fb-097fbf1594de tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:16.274069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3064696f-b666-4015-b1fb-097fbf1594de tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:16.274557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3064696f-b666-4015-b1fb-097fbf1594de tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:16.274998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3064696f-b666-4015-b1fb-097fbf1594de tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:16.275706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3064696f-b666-4015-b1fb-097fbf1594de tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:16.276167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3064696f-b666-4015-b1fb-097fbf1594de tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:16.277220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3064696f-b666-4015-b1fb-097fbf1594de tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:16.278725 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7e409382-0c58-4b4c-b8cb-7457c8c8c6e6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848" status: 200 len: 1472 microversion: 2.1 time: 0.216525 Oct 24 10:29:16.281287 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 704/1335] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:16 2022] GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848 => generated 1472 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:16.362915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3064696f-b666-4015-b1fb-097fbf1594de tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:16.373027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3064696f-b666-4015-b1fb-097fbf1594de tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:16.374560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3064696f-b666-4015-b1fb-097fbf1594de tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:16.380116 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3064696f-b666-4015-b1fb-097fbf1594de tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.117683 Oct 24 10:29:16.380773 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 632/1336] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:16 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:16.407909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ce998ccd-0c2d-424b-9fc8-26cc93d52ad9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:16.408822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ce998ccd-0c2d-424b-9fc8-26cc93d52ad9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:16.416019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce998ccd-0c2d-424b-9fc8-26cc93d52ad9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:16.416977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce998ccd-0c2d-424b-9fc8-26cc93d52ad9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:16.417596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce998ccd-0c2d-424b-9fc8-26cc93d52ad9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:16.418476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce998ccd-0c2d-424b-9fc8-26cc93d52ad9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:16.419126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce998ccd-0c2d-424b-9fc8-26cc93d52ad9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:16.419614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce998ccd-0c2d-424b-9fc8-26cc93d52ad9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:16.558757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ce998ccd-0c2d-424b-9fc8-26cc93d52ad9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:16.566743 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ce998ccd-0c2d-424b-9fc8-26cc93d52ad9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.163633 Oct 24 10:29:16.567330 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 705/1337] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:16 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:16.644766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-433c206f-7355-43a8-97a4-ac5d0917892f tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:16.645597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-433c206f-7355-43a8-97a4-ac5d0917892f tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:16.652159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-433c206f-7355-43a8-97a4-ac5d0917892f tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:16.652648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-433c206f-7355-43a8-97a4-ac5d0917892f tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:16.653123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-433c206f-7355-43a8-97a4-ac5d0917892f tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:16.653822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-433c206f-7355-43a8-97a4-ac5d0917892f tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:16.654276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-433c206f-7355-43a8-97a4-ac5d0917892f tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:16.654701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-433c206f-7355-43a8-97a4-ac5d0917892f tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:16.785797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-433c206f-7355-43a8-97a4-ac5d0917892f tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:16.793808 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-433c206f-7355-43a8-97a4-ac5d0917892f tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1540 microversion: 2.1 time: 0.152919 Oct 24 10:29:16.794377 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 633/1338] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:16 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1540 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:16.830460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b584aa6d-ec30-4802-8bfa-73096f3812aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:16.831159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b584aa6d-ec30-4802-8bfa-73096f3812aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:16.838479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b584aa6d-ec30-4802-8bfa-73096f3812aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:16.839073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b584aa6d-ec30-4802-8bfa-73096f3812aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:16.839579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b584aa6d-ec30-4802-8bfa-73096f3812aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:16.840342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b584aa6d-ec30-4802-8bfa-73096f3812aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:16.840883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b584aa6d-ec30-4802-8bfa-73096f3812aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:16.841380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b584aa6d-ec30-4802-8bfa-73096f3812aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:16.911092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f72e8db9-d4cf-4f49-900e-e1dba774806f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:16.911842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f72e8db9-d4cf-4f49-900e-e1dba774806f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:16.919315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f72e8db9-d4cf-4f49-900e-e1dba774806f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:16.919879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f72e8db9-d4cf-4f49-900e-e1dba774806f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:16.920377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f72e8db9-d4cf-4f49-900e-e1dba774806f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:16.921235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f72e8db9-d4cf-4f49-900e-e1dba774806f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:16.921688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f72e8db9-d4cf-4f49-900e-e1dba774806f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:16.922108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f72e8db9-d4cf-4f49-900e-e1dba774806f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:17.001477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f72e8db9-d4cf-4f49-900e-e1dba774806f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:17.011629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f72e8db9-d4cf-4f49-900e-e1dba774806f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:17.013238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f72e8db9-d4cf-4f49-900e-e1dba774806f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:17.014206 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f72e8db9-d4cf-4f49-900e-e1dba774806f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1343 microversion: 2.25 time: 0.107349 Oct 24 10:29:17.017651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b584aa6d-ec30-4802-8bfa-73096f3812aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:17.029110 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b584aa6d-ec30-4802-8bfa-73096f3812aa tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 200 len: 1317 microversion: 2.1 time: 0.202492 Oct 24 10:29:17.029325 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 634/1339] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:16 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1343 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:29:17.030102 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 706/1340] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:16 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:17.038333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-30aea41d-aebe-41b6-9daf-af24a6ab7be8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:17.038882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-30aea41d-aebe-41b6-9daf-af24a6ab7be8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:17.045972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30aea41d-aebe-41b6-9daf-af24a6ab7be8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:17.046460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30aea41d-aebe-41b6-9daf-af24a6ab7be8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:17.046891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30aea41d-aebe-41b6-9daf-af24a6ab7be8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:17.047585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30aea41d-aebe-41b6-9daf-af24a6ab7be8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:17.048032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30aea41d-aebe-41b6-9daf-af24a6ab7be8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:17.048451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30aea41d-aebe-41b6-9daf-af24a6ab7be8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:17.199293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-30aea41d-aebe-41b6-9daf-af24a6ab7be8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:17.207293 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-30aea41d-aebe-41b6-9daf-af24a6ab7be8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1477 microversion: 2.1 time: 0.176827 Oct 24 10:29:17.207883 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 635/1341] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:17 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1477 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:17.286032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ff7090af-da7b-42a2-98d8-8d8f761dd0ca tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:17.286968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ff7090af-da7b-42a2-98d8-8d8f761dd0ca tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:17.294274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff7090af-da7b-42a2-98d8-8d8f761dd0ca tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:17.295226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff7090af-da7b-42a2-98d8-8d8f761dd0ca tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:17.296044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff7090af-da7b-42a2-98d8-8d8f761dd0ca tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:17.297082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff7090af-da7b-42a2-98d8-8d8f761dd0ca tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:17.297805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff7090af-da7b-42a2-98d8-8d8f761dd0ca tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:17.298730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff7090af-da7b-42a2-98d8-8d8f761dd0ca tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:17.304860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-363349ae-3db1-460a-84eb-0899b708a943 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:17.305639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-363349ae-3db1-460a-84eb-0899b708a943 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: a8f749f9-5771-4ecb-8a06-30a8f69dd848] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:17.328023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-363349ae-3db1-460a-84eb-0899b708a943 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:17.328787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-363349ae-3db1-460a-84eb-0899b708a943 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:17.329407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-363349ae-3db1-460a-84eb-0899b708a943 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:17.330276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-363349ae-3db1-460a-84eb-0899b708a943 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:17.330892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-363349ae-3db1-460a-84eb-0899b708a943 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:17.331493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-363349ae-3db1-460a-84eb-0899b708a943 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:17.509367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ff7090af-da7b-42a2-98d8-8d8f761dd0ca tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:17.517494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-363349ae-3db1-460a-84eb-0899b708a943 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:17.519288 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ff7090af-da7b-42a2-98d8-8d8f761dd0ca tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.237165 Oct 24 10:29:17.520466 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 707/1342] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:17 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:17.526788 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-363349ae-3db1-460a-84eb-0899b708a943 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848" status: 200 len: 1472 microversion: 2.1 time: 0.226857 Oct 24 10:29:17.527528 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 636/1343] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:17 2022] GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848 => generated 1472 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:17.549018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2bad73fb-6db5-4046-862b-dab672ec3040 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:17.549305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2bad73fb-6db5-4046-862b-dab672ec3040 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:17.551767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:17.558449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bad73fb-6db5-4046-862b-dab672ec3040 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:17.559196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bad73fb-6db5-4046-862b-dab672ec3040 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:17.559896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bad73fb-6db5-4046-862b-dab672ec3040 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:17.560972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bad73fb-6db5-4046-862b-dab672ec3040 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:17.561712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bad73fb-6db5-4046-862b-dab672ec3040 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:17.562308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bad73fb-6db5-4046-862b-dab672ec3040 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:17.591019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0f7d97f8-2e1c-4c2c-ac15-7c47c3629195 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:17.591765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0f7d97f8-2e1c-4c2c-ac15-7c47c3629195 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:17.598709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f7d97f8-2e1c-4c2c-ac15-7c47c3629195 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:17.599299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f7d97f8-2e1c-4c2c-ac15-7c47c3629195 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:17.599743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f7d97f8-2e1c-4c2c-ac15-7c47c3629195 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:17.600438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f7d97f8-2e1c-4c2c-ac15-7c47c3629195 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:17.601035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f7d97f8-2e1c-4c2c-ac15-7c47c3629195 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:17.601475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f7d97f8-2e1c-4c2c-ac15-7c47c3629195 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:17.645470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2bad73fb-6db5-4046-862b-dab672ec3040 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:17.656635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2bad73fb-6db5-4046-862b-dab672ec3040 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:17.658179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2bad73fb-6db5-4046-862b-dab672ec3040 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:17.664570 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2bad73fb-6db5-4046-862b-dab672ec3040 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.130303 Oct 24 10:29:17.669324 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 708/1344] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:17 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:17.753668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0f7d97f8-2e1c-4c2c-ac15-7c47c3629195 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:17.761604 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0f7d97f8-2e1c-4c2c-ac15-7c47c3629195 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.174741 Oct 24 10:29:17.762324 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 637/1345] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:17 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:17.818574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6c305193-e3dd-4f1c-a567-5c857d010a7a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:17.819193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6c305193-e3dd-4f1c-a567-5c857d010a7a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:17.825790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c305193-e3dd-4f1c-a567-5c857d010a7a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:17.826283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c305193-e3dd-4f1c-a567-5c857d010a7a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:17.826718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c305193-e3dd-4f1c-a567-5c857d010a7a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:17.827432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c305193-e3dd-4f1c-a567-5c857d010a7a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:17.827877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c305193-e3dd-4f1c-a567-5c857d010a7a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:17.828390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c305193-e3dd-4f1c-a567-5c857d010a7a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:17.842681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d6d8b58b-9bf9-476b-be33-fdb1fc6e833b req-67c2f96f-f00d-4318-9fe2-99b49ef7079b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e4585f-945b-462a-aac7-5a7af22f160d", "tag": "37825a2f-34ee-4e53-ae99-2a22e0da2d1b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:17.853319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d6d8b58b-9bf9-476b-be33-fdb1fc6e833b req-67c2f96f-f00d-4318-9fe2-99b49ef7079b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:17.854049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d6d8b58b-9bf9-476b-be33-fdb1fc6e833b req-67c2f96f-f00d-4318-9fe2-99b49ef7079b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:17.854711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d6d8b58b-9bf9-476b-be33-fdb1fc6e833b req-67c2f96f-f00d-4318-9fe2-99b49ef7079b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:17.869448 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d6d8b58b-9bf9-476b-be33-fdb1fc6e833b req-67c2f96f-f00d-4318-9fe2-99b49ef7079b service nova] Creating event network-changed:37825a2f-34ee-4e53-ae99-2a22e0da2d1b for instance 07e4585f-945b-462a-aac7-5a7af22f160d on n-h1-858383-15 Oct 24 10:29:17.877190 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d6d8b58b-9bf9-476b-be33-fdb1fc6e833b req-67c2f96f-f00d-4318-9fe2-99b49ef7079b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036316 Oct 24 10:29:17.877190 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 638/1346] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:29:18.010832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6c305193-e3dd-4f1c-a567-5c857d010a7a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:18.019181 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6c305193-e3dd-4f1c-a567-5c857d010a7a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1540 microversion: 2.1 time: 0.204466 Oct 24 10:29:18.019848 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 709/1347] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:17 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1540 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:18.045029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b4db2b63-d7f0-4e1b-b1a7-595e823a1bc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:18.046291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b4db2b63-d7f0-4e1b-b1a7-595e823a1bc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:18.053352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4db2b63-d7f0-4e1b-b1a7-595e823a1bc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:18.053633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6f123087-110b-47d1-a4f8-7d0220430f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:18.054439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4db2b63-d7f0-4e1b-b1a7-595e823a1bc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:18.054838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6f123087-110b-47d1-a4f8-7d0220430f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:18.055005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4db2b63-d7f0-4e1b-b1a7-595e823a1bc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:18.055558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4db2b63-d7f0-4e1b-b1a7-595e823a1bc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:18.056004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4db2b63-d7f0-4e1b-b1a7-595e823a1bc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:18.056423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4db2b63-d7f0-4e1b-b1a7-595e823a1bc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:18.061371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f123087-110b-47d1-a4f8-7d0220430f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:18.061869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f123087-110b-47d1-a4f8-7d0220430f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:18.062305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f123087-110b-47d1-a4f8-7d0220430f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:18.063013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f123087-110b-47d1-a4f8-7d0220430f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:18.063471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f123087-110b-47d1-a4f8-7d0220430f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:18.063901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f123087-110b-47d1-a4f8-7d0220430f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:18.253053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b4db2b63-d7f0-4e1b-b1a7-595e823a1bc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:18.255995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6f123087-110b-47d1-a4f8-7d0220430f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:18.262102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b4db2b63-d7f0-4e1b-b1a7-595e823a1bc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:18.263526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b4db2b63-d7f0-4e1b-b1a7-595e823a1bc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:18.264618 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b4db2b63-d7f0-4e1b-b1a7-595e823a1bc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1409 microversion: 2.25 time: 0.224467 Oct 24 10:29:18.265048 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6f123087-110b-47d1-a4f8-7d0220430f43 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 200 len: 1317 microversion: 2.1 time: 0.215157 Oct 24 10:29:18.272920 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 639/1348] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:18 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1409 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:29:18.273081 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 710/1349] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:18 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:18.273193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-353baf3b-9880-4347-bdd2-255069d96029 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:18.273193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-353baf3b-9880-4347-bdd2-255069d96029 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:18.276445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-353baf3b-9880-4347-bdd2-255069d96029 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:18.277041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-353baf3b-9880-4347-bdd2-255069d96029 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:18.277482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-353baf3b-9880-4347-bdd2-255069d96029 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:18.278275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-353baf3b-9880-4347-bdd2-255069d96029 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:18.278617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-353baf3b-9880-4347-bdd2-255069d96029 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:18.279041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-353baf3b-9880-4347-bdd2-255069d96029 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:18.520795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-353baf3b-9880-4347-bdd2-255069d96029 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:18.528919 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-353baf3b-9880-4347-bdd2-255069d96029 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1477 microversion: 2.1 time: 0.262489 Oct 24 10:29:18.529683 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 640/1350] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:18 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1477 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:18.556286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-72207425-9151-4b4f-af47-0515e5fc94b3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:18.558681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-72207425-9151-4b4f-af47-0515e5fc94b3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: a8f749f9-5771-4ecb-8a06-30a8f69dd848] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:18.565516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c5fc1175-079d-43da-a0b4-281f18846581 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:18.565797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72207425-9151-4b4f-af47-0515e5fc94b3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:18.566474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72207425-9151-4b4f-af47-0515e5fc94b3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:18.566806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c5fc1175-079d-43da-a0b4-281f18846581 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:18.567255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72207425-9151-4b4f-af47-0515e5fc94b3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:18.568120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72207425-9151-4b4f-af47-0515e5fc94b3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:18.568740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72207425-9151-4b4f-af47-0515e5fc94b3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:18.569362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72207425-9151-4b4f-af47-0515e5fc94b3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:18.575394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5fc1175-079d-43da-a0b4-281f18846581 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:18.576700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5fc1175-079d-43da-a0b4-281f18846581 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:18.577278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5fc1175-079d-43da-a0b4-281f18846581 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:18.578404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5fc1175-079d-43da-a0b4-281f18846581 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:18.579436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5fc1175-079d-43da-a0b4-281f18846581 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:18.580178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5fc1175-079d-43da-a0b4-281f18846581 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:18.866404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-72207425-9151-4b4f-af47-0515e5fc94b3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:18.874301 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-72207425-9151-4b4f-af47-0515e5fc94b3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848" status: 200 len: 1472 microversion: 2.1 time: 0.322560 Oct 24 10:29:18.880638 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 711/1351] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:18 2022] GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848 => generated 1472 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:18.885594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d187903e-b412-4a7e-b805-0ca0f1922e5d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:18.886218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d187903e-b412-4a7e-b805-0ca0f1922e5d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:18.893843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d187903e-b412-4a7e-b805-0ca0f1922e5d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:18.894346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d187903e-b412-4a7e-b805-0ca0f1922e5d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:18.894794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d187903e-b412-4a7e-b805-0ca0f1922e5d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:18.896114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d187903e-b412-4a7e-b805-0ca0f1922e5d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:18.896114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d187903e-b412-4a7e-b805-0ca0f1922e5d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:18.896431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d187903e-b412-4a7e-b805-0ca0f1922e5d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:18.896777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c5fc1175-079d-43da-a0b4-281f18846581 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:18.907452 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c5fc1175-079d-43da-a0b4-281f18846581 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.347399 Oct 24 10:29:18.912970 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 641/1352] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:18 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:18.918899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-130f3fdf-f35c-4e19-9fbe-eb9f4956cbb0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:18.920543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-130f3fdf-f35c-4e19-9fbe-eb9f4956cbb0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:18.938133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-130f3fdf-f35c-4e19-9fbe-eb9f4956cbb0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:18.938648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-130f3fdf-f35c-4e19-9fbe-eb9f4956cbb0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:18.939092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-130f3fdf-f35c-4e19-9fbe-eb9f4956cbb0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:18.939912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-130f3fdf-f35c-4e19-9fbe-eb9f4956cbb0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:18.940372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-130f3fdf-f35c-4e19-9fbe-eb9f4956cbb0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:18.941513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-130f3fdf-f35c-4e19-9fbe-eb9f4956cbb0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:18.946827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:19.042781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d187903e-b412-4a7e-b805-0ca0f1922e5d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:19.050992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d187903e-b412-4a7e-b805-0ca0f1922e5d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:19.052440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d187903e-b412-4a7e-b805-0ca0f1922e5d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:19.057771 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d187903e-b412-4a7e-b805-0ca0f1922e5d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1447 microversion: 2.75 time: 0.176055 Oct 24 10:29:19.058484 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 712/1353] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:18 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1447 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:19.062983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a6d7fc6b-563b-4a3d-8941-44681b23e5bd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:19.063592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a6d7fc6b-563b-4a3d-8941-44681b23e5bd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:19.069585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6d7fc6b-563b-4a3d-8941-44681b23e5bd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:19.070071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6d7fc6b-563b-4a3d-8941-44681b23e5bd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:19.070509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6d7fc6b-563b-4a3d-8941-44681b23e5bd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:19.071208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6d7fc6b-563b-4a3d-8941-44681b23e5bd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:19.071661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6d7fc6b-563b-4a3d-8941-44681b23e5bd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:19.072086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6d7fc6b-563b-4a3d-8941-44681b23e5bd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:19.076207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:19.143275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a6d7fc6b-563b-4a3d-8941-44681b23e5bd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:19.152020 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a6d7fc6b-563b-4a3d-8941-44681b23e5bd tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1498 microversion: 2.1 time: 0.092398 Oct 24 10:29:19.152612 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 713/1354] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:19 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1498 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:19.157107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-dc0cab1c-f51d-46c1-8bcc-ded2b504e51e req-daf5665f-a923-4b5c-825e-cad1ca4cc770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f749f9-5771-4ecb-8a06-30a8f69dd848", "name": "network-vif-deleted", "tag": "f48a3bd1-58ab-47af-934b-bea589ab9a0b"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:19.166216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-130f3fdf-f35c-4e19-9fbe-eb9f4956cbb0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:19.167269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dc0cab1c-f51d-46c1-8bcc-ded2b504e51e req-daf5665f-a923-4b5c-825e-cad1ca4cc770 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:19.167762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dc0cab1c-f51d-46c1-8bcc-ded2b504e51e req-daf5665f-a923-4b5c-825e-cad1ca4cc770 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:19.168201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dc0cab1c-f51d-46c1-8bcc-ded2b504e51e req-daf5665f-a923-4b5c-825e-cad1ca4cc770 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:19.174094 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-130f3fdf-f35c-4e19-9fbe-eb9f4956cbb0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.264889 Oct 24 10:29:19.174667 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 642/1355] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:18 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:19.180124 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-dc0cab1c-f51d-46c1-8bcc-ded2b504e51e req-daf5665f-a923-4b5c-825e-cad1ca4cc770 service nova] Creating event network-vif-deleted:f48a3bd1-58ab-47af-934b-bea589ab9a0b for instance a8f749f9-5771-4ecb-8a06-30a8f69dd848 on n-h2-858383-15 Oct 24 10:29:19.185232 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-dc0cab1c-f51d-46c1-8bcc-ded2b504e51e req-daf5665f-a923-4b5c-825e-cad1ca4cc770 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031395 Oct 24 10:29:19.185762 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 714/1356] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:19.287732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1431958a-a2c0-4ff7-93d5-5faafa2da5e5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:19.288885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1431958a-a2c0-4ff7-93d5-5faafa2da5e5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:19.292919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a06ad32d-4b2e-491d-8473-6079e39d2fba tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:19.293632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a06ad32d-4b2e-491d-8473-6079e39d2fba tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:19.295792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1431958a-a2c0-4ff7-93d5-5faafa2da5e5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:19.296668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1431958a-a2c0-4ff7-93d5-5faafa2da5e5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:19.296804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1431958a-a2c0-4ff7-93d5-5faafa2da5e5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:19.297447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1431958a-a2c0-4ff7-93d5-5faafa2da5e5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:19.297954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1431958a-a2c0-4ff7-93d5-5faafa2da5e5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:19.298384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1431958a-a2c0-4ff7-93d5-5faafa2da5e5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:19.300042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a06ad32d-4b2e-491d-8473-6079e39d2fba tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:19.300531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a06ad32d-4b2e-491d-8473-6079e39d2fba tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:19.301003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a06ad32d-4b2e-491d-8473-6079e39d2fba tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:19.301703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a06ad32d-4b2e-491d-8473-6079e39d2fba tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:19.302155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a06ad32d-4b2e-491d-8473-6079e39d2fba tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:19.302928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a06ad32d-4b2e-491d-8473-6079e39d2fba tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:19.502958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a06ad32d-4b2e-491d-8473-6079e39d2fba tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:19.505754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1431958a-a2c0-4ff7-93d5-5faafa2da5e5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:19.512659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a06ad32d-4b2e-491d-8473-6079e39d2fba tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:19.514090 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1431958a-a2c0-4ff7-93d5-5faafa2da5e5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 200 len: 1317 microversion: 2.1 time: 0.230391 Oct 24 10:29:19.514213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a06ad32d-4b2e-491d-8473-6079e39d2fba tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:19.514664 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 643/1357] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:19 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:19.515249 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a06ad32d-4b2e-491d-8473-6079e39d2fba tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1409 microversion: 2.25 time: 0.228510 Oct 24 10:29:19.515798 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 715/1358] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:19 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1409 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:29:19.552306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-03af318d-6b81-4526-ac11-69f8a04ad8ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:19.552880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-03af318d-6b81-4526-ac11-69f8a04ad8ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:19.559663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03af318d-6b81-4526-ac11-69f8a04ad8ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:19.560152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03af318d-6b81-4526-ac11-69f8a04ad8ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:19.560590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03af318d-6b81-4526-ac11-69f8a04ad8ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:19.561410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03af318d-6b81-4526-ac11-69f8a04ad8ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:19.561876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03af318d-6b81-4526-ac11-69f8a04ad8ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:19.562303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03af318d-6b81-4526-ac11-69f8a04ad8ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:19.691631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-03af318d-6b81-4526-ac11-69f8a04ad8ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:19.700054 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-03af318d-6b81-4526-ac11-69f8a04ad8ce tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1477 microversion: 2.1 time: 0.151704 Oct 24 10:29:19.700633 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 644/1359] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:19 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1477 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:19.896043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-5a0ddf36-d6b3-4a5e-9b35-53a289a02b8c req-eda03c45-df3e-4c37-962a-66750a7c91e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d47d8d5-f7d0-49c4-839a-92bababf20e7", "name": "network-vif-deleted", "tag": "9d03d2ef-8a17-4594-b487-37b1ca2cc10b"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:19.904070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab9ccceb-068e-49b8-8bcf-ed9bb2f60dd3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:19.904681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ab9ccceb-068e-49b8-8bcf-ed9bb2f60dd3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: a8f749f9-5771-4ecb-8a06-30a8f69dd848] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:19.907304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5a0ddf36-d6b3-4a5e-9b35-53a289a02b8c req-eda03c45-df3e-4c37-962a-66750a7c91e5 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:19.907759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5a0ddf36-d6b3-4a5e-9b35-53a289a02b8c req-eda03c45-df3e-4c37-962a-66750a7c91e5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:19.908179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5a0ddf36-d6b3-4a5e-9b35-53a289a02b8c req-eda03c45-df3e-4c37-962a-66750a7c91e5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:19.910646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab9ccceb-068e-49b8-8bcf-ed9bb2f60dd3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:19.911129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab9ccceb-068e-49b8-8bcf-ed9bb2f60dd3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:19.911572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab9ccceb-068e-49b8-8bcf-ed9bb2f60dd3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:19.912260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab9ccceb-068e-49b8-8bcf-ed9bb2f60dd3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:19.912714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab9ccceb-068e-49b8-8bcf-ed9bb2f60dd3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:19.913196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab9ccceb-068e-49b8-8bcf-ed9bb2f60dd3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:19.919277 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-5a0ddf36-d6b3-4a5e-9b35-53a289a02b8c req-eda03c45-df3e-4c37-962a-66750a7c91e5 service nova] Creating event network-vif-deleted:9d03d2ef-8a17-4594-b487-37b1ca2cc10b for instance 8d47d8d5-f7d0-49c4-839a-92bababf20e7 on n-h2-858383-15 Oct 24 10:29:19.924273 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-5a0ddf36-d6b3-4a5e-9b35-53a289a02b8c req-eda03c45-df3e-4c37-962a-66750a7c91e5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031888 Oct 24 10:29:19.924881 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 716/1360] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:19.934541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d19f8cd0-dc61-483e-9ded-4206ec486d23 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:19.935238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d19f8cd0-dc61-483e-9ded-4206ec486d23 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:19.941587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d19f8cd0-dc61-483e-9ded-4206ec486d23 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:19.942088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d19f8cd0-dc61-483e-9ded-4206ec486d23 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:19.942520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d19f8cd0-dc61-483e-9ded-4206ec486d23 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:19.943273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d19f8cd0-dc61-483e-9ded-4206ec486d23 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:19.943723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d19f8cd0-dc61-483e-9ded-4206ec486d23 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:19.944145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d19f8cd0-dc61-483e-9ded-4206ec486d23 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:19.977406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ab9ccceb-068e-49b8-8bcf-ed9bb2f60dd3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:19.985164 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ab9ccceb-068e-49b8-8bcf-ed9bb2f60dd3 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848" status: 200 len: 1430 microversion: 2.1 time: 0.084797 Oct 24 10:29:19.985736 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 645/1361] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:19 2022] GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848 => generated 1430 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:20.074904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d19f8cd0-dc61-483e-9ded-4206ec486d23 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:20.083404 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d19f8cd0-dc61-483e-9ded-4206ec486d23 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.152861 Oct 24 10:29:20.084040 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 717/1362] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:19 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:20.086598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2176e0b1-d133-4231-8fa1-53a513f99ee6 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:20.087425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2176e0b1-d133-4231-8fa1-53a513f99ee6 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:20.094421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2176e0b1-d133-4231-8fa1-53a513f99ee6 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:20.094937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2176e0b1-d133-4231-8fa1-53a513f99ee6 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:20.095390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2176e0b1-d133-4231-8fa1-53a513f99ee6 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:20.096069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2176e0b1-d133-4231-8fa1-53a513f99ee6 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:20.096522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2176e0b1-d133-4231-8fa1-53a513f99ee6 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:20.096974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2176e0b1-d133-4231-8fa1-53a513f99ee6 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:20.160734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2176e0b1-d133-4231-8fa1-53a513f99ee6 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:20.169404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2176e0b1-d133-4231-8fa1-53a513f99ee6 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:20.171572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2176e0b1-d133-4231-8fa1-53a513f99ee6 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:20.175447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-42a0f598-df07-4b44-b825-ddbc24bc6c96 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:20.176076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-42a0f598-df07-4b44-b825-ddbc24bc6c96 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:20.176851 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2176e0b1-d133-4231-8fa1-53a513f99ee6 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1465 microversion: 2.75 time: 0.094882 Oct 24 10:29:20.177448 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 646/1363] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:20 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1465 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:29:20.182972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42a0f598-df07-4b44-b825-ddbc24bc6c96 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:20.183452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42a0f598-df07-4b44-b825-ddbc24bc6c96 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:20.183890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42a0f598-df07-4b44-b825-ddbc24bc6c96 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:20.184584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42a0f598-df07-4b44-b825-ddbc24bc6c96 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:20.185064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42a0f598-df07-4b44-b825-ddbc24bc6c96 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:20.185488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42a0f598-df07-4b44-b825-ddbc24bc6c96 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:20.197436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2a17dd3a-3bb4-430c-80d5-11b2d67ccbba tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:20.198046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2a17dd3a-3bb4-430c-80d5-11b2d67ccbba tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:20.203963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a17dd3a-3bb4-430c-80d5-11b2d67ccbba tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:20.204479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a17dd3a-3bb4-430c-80d5-11b2d67ccbba tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:20.204946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a17dd3a-3bb4-430c-80d5-11b2d67ccbba tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:20.205643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a17dd3a-3bb4-430c-80d5-11b2d67ccbba tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:20.206097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a17dd3a-3bb4-430c-80d5-11b2d67ccbba tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:20.206526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a17dd3a-3bb4-430c-80d5-11b2d67ccbba tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:20.252078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-42a0f598-df07-4b44-b825-ddbc24bc6c96 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:20.261488 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-42a0f598-df07-4b44-b825-ddbc24bc6c96 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1498 microversion: 2.1 time: 0.090261 Oct 24 10:29:20.262632 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 718/1364] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:20 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1498 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:20.361209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2a17dd3a-3bb4-430c-80d5-11b2d67ccbba tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:20.370925 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2a17dd3a-3bb4-430c-80d5-11b2d67ccbba tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1497 microversion: 2.1 time: 0.177386 Oct 24 10:29:20.371748 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 647/1365] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:20 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:20.536939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5551070c-d92e-4d27-949d-c0a06d93791a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:20.537562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5551070c-d92e-4d27-949d-c0a06d93791a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:20.540023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-05b537ce-067c-46b8-a7f8-0ecd30fe26c6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:20.540997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-05b537ce-067c-46b8-a7f8-0ecd30fe26c6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:20.544542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5551070c-d92e-4d27-949d-c0a06d93791a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:20.545192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5551070c-d92e-4d27-949d-c0a06d93791a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:20.545694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5551070c-d92e-4d27-949d-c0a06d93791a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:20.546607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5551070c-d92e-4d27-949d-c0a06d93791a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:20.547178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05b537ce-067c-46b8-a7f8-0ecd30fe26c6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:20.547362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5551070c-d92e-4d27-949d-c0a06d93791a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:20.547665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5551070c-d92e-4d27-949d-c0a06d93791a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:20.548095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05b537ce-067c-46b8-a7f8-0ecd30fe26c6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:20.548644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05b537ce-067c-46b8-a7f8-0ecd30fe26c6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:20.549578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05b537ce-067c-46b8-a7f8-0ecd30fe26c6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:20.550247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05b537ce-067c-46b8-a7f8-0ecd30fe26c6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:20.550865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05b537ce-067c-46b8-a7f8-0ecd30fe26c6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:20.752592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5551070c-d92e-4d27-949d-c0a06d93791a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:20.755850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-05b537ce-067c-46b8-a7f8-0ecd30fe26c6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:20.760719 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5551070c-d92e-4d27-949d-c0a06d93791a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 200 len: 1317 microversion: 2.1 time: 0.227673 Oct 24 10:29:20.761428 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 719/1366] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:20 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:20.764306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-05b537ce-067c-46b8-a7f8-0ecd30fe26c6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:20.765794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-05b537ce-067c-46b8-a7f8-0ecd30fe26c6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:20.766297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a8335d2a-69e5-4871-8b3a-550f7a8baf06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:20.766881 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-05b537ce-067c-46b8-a7f8-0ecd30fe26c6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1409 microversion: 2.25 time: 0.231002 Oct 24 10:29:20.767096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a8335d2a-69e5-4871-8b3a-550f7a8baf06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:20.767563 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 648/1367] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:20 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1409 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:20.773721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8335d2a-69e5-4871-8b3a-550f7a8baf06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:20.774053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8335d2a-69e5-4871-8b3a-550f7a8baf06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:20.774631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8335d2a-69e5-4871-8b3a-550f7a8baf06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:20.775446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8335d2a-69e5-4871-8b3a-550f7a8baf06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:20.776006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8335d2a-69e5-4871-8b3a-550f7a8baf06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:20.776536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8335d2a-69e5-4871-8b3a-550f7a8baf06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:20.914533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a8335d2a-69e5-4871-8b3a-550f7a8baf06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:20.922243 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a8335d2a-69e5-4871-8b3a-550f7a8baf06 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1477 microversion: 2.1 time: 0.159752 Oct 24 10:29:20.922834 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 720/1368] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:20 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1477 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:21.008905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad06b49a-5e45-4327-b81e-8ea6a5428640 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:21.009526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad06b49a-5e45-4327-b81e-8ea6a5428640 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: a8f749f9-5771-4ecb-8a06-30a8f69dd848] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:21.016251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad06b49a-5e45-4327-b81e-8ea6a5428640 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:21.016767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad06b49a-5e45-4327-b81e-8ea6a5428640 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:21.017237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad06b49a-5e45-4327-b81e-8ea6a5428640 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:21.017926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad06b49a-5e45-4327-b81e-8ea6a5428640 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:21.018374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad06b49a-5e45-4327-b81e-8ea6a5428640 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:21.018792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad06b49a-5e45-4327-b81e-8ea6a5428640 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:21.081465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ad06b49a-5e45-4327-b81e-8ea6a5428640 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:21.089538 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad06b49a-5e45-4327-b81e-8ea6a5428640 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848" status: 200 len: 1303 microversion: 2.1 time: 0.084652 Oct 24 10:29:21.090177 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 649/1369] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:21 2022] GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848 => generated 1303 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:21.107487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3a3a9435-3f2b-4afc-9fd4-ef6c58b25cd2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:21.108156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3a3a9435-3f2b-4afc-9fd4-ef6c58b25cd2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:21.114304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a3a9435-3f2b-4afc-9fd4-ef6c58b25cd2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:21.114787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a3a9435-3f2b-4afc-9fd4-ef6c58b25cd2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:21.115221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a3a9435-3f2b-4afc-9fd4-ef6c58b25cd2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:21.115916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a3a9435-3f2b-4afc-9fd4-ef6c58b25cd2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:21.123084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a3a9435-3f2b-4afc-9fd4-ef6c58b25cd2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:21.123084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a3a9435-3f2b-4afc-9fd4-ef6c58b25cd2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:21.206550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f6e196d8-a6e9-4bfc-ae63-8dbda195253c tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:21.207164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f6e196d8-a6e9-4bfc-ae63-8dbda195253c tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:21.214328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6e196d8-a6e9-4bfc-ae63-8dbda195253c tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:21.214815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6e196d8-a6e9-4bfc-ae63-8dbda195253c tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:21.215255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6e196d8-a6e9-4bfc-ae63-8dbda195253c tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:21.215957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6e196d8-a6e9-4bfc-ae63-8dbda195253c tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:21.216410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6e196d8-a6e9-4bfc-ae63-8dbda195253c tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:21.216848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6e196d8-a6e9-4bfc-ae63-8dbda195253c tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:21.277107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3a3a9435-3f2b-4afc-9fd4-ef6c58b25cd2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:21.286692 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3a3a9435-3f2b-4afc-9fd4-ef6c58b25cd2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.183191 Oct 24 10:29:21.287390 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 721/1370] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:21 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:21.292677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1dcd744b-77f6-4a01-8a1f-a9a76bd9d889 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:21.293665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1dcd744b-77f6-4a01-8a1f-a9a76bd9d889 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:21.300066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dcd744b-77f6-4a01-8a1f-a9a76bd9d889 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:21.300256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f6e196d8-a6e9-4bfc-ae63-8dbda195253c tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:21.301239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dcd744b-77f6-4a01-8a1f-a9a76bd9d889 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:21.302625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dcd744b-77f6-4a01-8a1f-a9a76bd9d889 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:21.303688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dcd744b-77f6-4a01-8a1f-a9a76bd9d889 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:21.304945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dcd744b-77f6-4a01-8a1f-a9a76bd9d889 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:21.305732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dcd744b-77f6-4a01-8a1f-a9a76bd9d889 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:21.310240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f6e196d8-a6e9-4bfc-ae63-8dbda195253c tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:21.311668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f6e196d8-a6e9-4bfc-ae63-8dbda195253c tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:21.319185 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f6e196d8-a6e9-4bfc-ae63-8dbda195253c tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1453 microversion: 2.75 time: 0.116758 Oct 24 10:29:21.321810 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 650/1371] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:21 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:29:21.342110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dcd744b-77f6-4a01-8a1f-a9a76bd9d889 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:21.342611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dcd744b-77f6-4a01-8a1f-a9a76bd9d889 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:21.343122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dcd744b-77f6-4a01-8a1f-a9a76bd9d889 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:21.343665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-1dcd744b-77f6-4a01-8a1f-a9a76bd9d889 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lazy-loading 'fault' on Instance uuid 8d47d8d5-f7d0-49c4-839a-92bababf20e7 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:21.394946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7b188558-726b-4751-a501-189c29ae263c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:21.396107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7b188558-726b-4751-a501-189c29ae263c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:21.399487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1dcd744b-77f6-4a01-8a1f-a9a76bd9d889 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30108371eb394d148babe9e2f36c9454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c8dc3d203642269466444b34a31285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:21.404977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b188558-726b-4751-a501-189c29ae263c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:21.405847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b188558-726b-4751-a501-189c29ae263c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:21.406480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b188558-726b-4751-a501-189c29ae263c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:21.407519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b188558-726b-4751-a501-189c29ae263c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:21.408203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b188558-726b-4751-a501-189c29ae263c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:21.409616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b188558-726b-4751-a501-189c29ae263c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:21.411857 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1dcd744b-77f6-4a01-8a1f-a9a76bd9d889 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 200 len: 1322 microversion: 2.1 time: 0.123148 Oct 24 10:29:21.413944 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 722/1372] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:21 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 1322 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:21.542832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7b188558-726b-4751-a501-189c29ae263c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:21.550522 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7b188558-726b-4751-a501-189c29ae263c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 200 len: 1474 microversion: 2.1 time: 0.159705 Oct 24 10:29:21.551184 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 651/1373] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:21 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 1474 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:21.574321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-06a98c0a-bbbb-4a1a-bcc3-b4ff0dc505d9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-916202752"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:21.577065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-06a98c0a-bbbb-4a1a-bcc3-b4ff0dc505d9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:21.583116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06a98c0a-bbbb-4a1a-bcc3-b4ff0dc505d9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:21.583602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06a98c0a-bbbb-4a1a-bcc3-b4ff0dc505d9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:21.584040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06a98c0a-bbbb-4a1a-bcc3-b4ff0dc505d9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:21.584739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06a98c0a-bbbb-4a1a-bcc3-b4ff0dc505d9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:21.586036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06a98c0a-bbbb-4a1a-bcc3-b4ff0dc505d9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:21.586763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06a98c0a-bbbb-4a1a-bcc3-b4ff0dc505d9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:21.783595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fbb89d76-0da2-44ea-bdf7-2680b9f4aca2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:21.784193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fbb89d76-0da2-44ea-bdf7-2680b9f4aca2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:21.790796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbb89d76-0da2-44ea-bdf7-2680b9f4aca2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:21.791284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbb89d76-0da2-44ea-bdf7-2680b9f4aca2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:21.791720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbb89d76-0da2-44ea-bdf7-2680b9f4aca2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:21.792423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbb89d76-0da2-44ea-bdf7-2680b9f4aca2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:21.792893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbb89d76-0da2-44ea-bdf7-2680b9f4aca2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:21.793317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbb89d76-0da2-44ea-bdf7-2680b9f4aca2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:21.812358 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-06a98c0a-bbbb-4a1a-bcc3-b4ff0dc505d9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "POST /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d/action" status: 202 len: 0 microversion: 2.1 time: 0.242593 Oct 24 10:29:21.813991 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 723/1374] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:29:21 2022] POST /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 10:29:21.820180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6dbff510-2c55-44e1-8324-d212f880af20 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:21.821243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6dbff510-2c55-44e1-8324-d212f880af20 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:21.828049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6dbff510-2c55-44e1-8324-d212f880af20 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:21.828539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6dbff510-2c55-44e1-8324-d212f880af20 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:21.829023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6dbff510-2c55-44e1-8324-d212f880af20 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:21.829733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6dbff510-2c55-44e1-8324-d212f880af20 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:21.830192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6dbff510-2c55-44e1-8324-d212f880af20 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:21.830621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6dbff510-2c55-44e1-8324-d212f880af20 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:21.984644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fbb89d76-0da2-44ea-bdf7-2680b9f4aca2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:21.993079 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fbb89d76-0da2-44ea-bdf7-2680b9f4aca2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 200 len: 1466 microversion: 2.1 time: 0.213406 Oct 24 10:29:21.993662 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 652/1375] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:21 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 1466 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:21.998326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-54930f1c-b09d-47b2-82b7-3bac2c1ceff8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0ca8d30>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:22.013731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6dbff510-2c55-44e1-8324-d212f880af20 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:22.023475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6dbff510-2c55-44e1-8324-d212f880af20 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:22.025203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6dbff510-2c55-44e1-8324-d212f880af20 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:22.026326 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6dbff510-2c55-44e1-8324-d212f880af20 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1409 microversion: 2.25 time: 0.211053 Oct 24 10:29:22.026888 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 724/1376] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:21 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1409 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:22.031645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-115f828c-e0b3-4f24-b1ed-e0a8c16fdb63 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:22.032316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-115f828c-e0b3-4f24-b1ed-e0a8c16fdb63 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:22.039074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-115f828c-e0b3-4f24-b1ed-e0a8c16fdb63 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:22.039707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-115f828c-e0b3-4f24-b1ed-e0a8c16fdb63 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:22.040259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-115f828c-e0b3-4f24-b1ed-e0a8c16fdb63 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:22.040997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-115f828c-e0b3-4f24-b1ed-e0a8c16fdb63 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:22.041449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-115f828c-e0b3-4f24-b1ed-e0a8c16fdb63 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:22.041874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-115f828c-e0b3-4f24-b1ed-e0a8c16fdb63 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:22.049575 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-54930f1c-b09d-47b2-82b7-3bac2c1ceff8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.054887 Oct 24 10:29:22.050149 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 653/1377] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:21 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:22.055013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-21575f2d-d7d9-4cc0-a36d-2895ad8e9683 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:22.055625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-21575f2d-d7d9-4cc0-a36d-2895ad8e9683 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:22.058594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:22.062409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21575f2d-d7d9-4cc0-a36d-2895ad8e9683 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:22.062899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21575f2d-d7d9-4cc0-a36d-2895ad8e9683 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:22.063339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21575f2d-d7d9-4cc0-a36d-2895ad8e9683 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:22.064043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21575f2d-d7d9-4cc0-a36d-2895ad8e9683 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:22.064505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21575f2d-d7d9-4cc0-a36d-2895ad8e9683 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:22.064966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21575f2d-d7d9-4cc0-a36d-2895ad8e9683 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:22.239348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-115f828c-e0b3-4f24-b1ed-e0a8c16fdb63 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:22.247695 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-115f828c-e0b3-4f24-b1ed-e0a8c16fdb63 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1476 microversion: 2.1 time: 0.219824 Oct 24 10:29:22.248296 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 725/1378] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:22 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1476 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:22.248755 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-21575f2d-d7d9-4cc0-a36d-2895ad8e9683 tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 200 len: 1619 microversion: 2.1 time: 0.197584 Oct 24 10:29:22.249346 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 654/1379] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:22 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 1619 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:22.253294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-06c5d25e-f070-4c71-a5a0-8c021734b9c0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:22.254025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-06c5d25e-f070-4c71-a5a0-8c021734b9c0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: a8f749f9-5771-4ecb-8a06-30a8f69dd848] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:22.260699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06c5d25e-f070-4c71-a5a0-8c021734b9c0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:22.261210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06c5d25e-f070-4c71-a5a0-8c021734b9c0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:22.261646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06c5d25e-f070-4c71-a5a0-8c021734b9c0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:22.262343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06c5d25e-f070-4c71-a5a0-8c021734b9c0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:22.262796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06c5d25e-f070-4c71-a5a0-8c021734b9c0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:22.263222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06c5d25e-f070-4c71-a5a0-8c021734b9c0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:22.296566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06c5d25e-f070-4c71-a5a0-8c021734b9c0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:22.297083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06c5d25e-f070-4c71-a5a0-8c021734b9c0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:22.297518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06c5d25e-f070-4c71-a5a0-8c021734b9c0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:22.297964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-06c5d25e-f070-4c71-a5a0-8c021734b9c0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lazy-loading 'fault' on Instance uuid a8f749f9-5771-4ecb-8a06-30a8f69dd848 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:22.314755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5a1f8af3-fd78-4232-8fe5-101aed6e621b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:22.315680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5a1f8af3-fd78-4232-8fe5-101aed6e621b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:22.322221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a1f8af3-fd78-4232-8fe5-101aed6e621b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:22.322709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a1f8af3-fd78-4232-8fe5-101aed6e621b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:22.323142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a1f8af3-fd78-4232-8fe5-101aed6e621b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:22.323847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a1f8af3-fd78-4232-8fe5-101aed6e621b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:22.324296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a1f8af3-fd78-4232-8fe5-101aed6e621b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:22.324718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a1f8af3-fd78-4232-8fe5-101aed6e621b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:22.342238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-06c5d25e-f070-4c71-a5a0-8c021734b9c0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:22.350428 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-06c5d25e-f070-4c71-a5a0-8c021734b9c0 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848" status: 200 len: 1308 microversion: 2.1 time: 0.101152 Oct 24 10:29:22.351717 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 726/1380] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:22 2022] GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:22.356194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-02fd06b8-71a2-46a5-9952-63d82c822991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1931484799", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "2a8bcf29-893c-4ca8-82cb-636c2bb6f404"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:22.421334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-02fd06b8-71a2-46a5-9952-63d82c822991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:29:22.517896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5a1f8af3-fd78-4232-8fe5-101aed6e621b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:22.529769 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5a1f8af3-fd78-4232-8fe5-101aed6e621b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.219420 Oct 24 10:29:22.530465 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 655/1381] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:22 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:22.537765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a2dbd29-221e-446a-86f7-65130054a253 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:22.539081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0a2dbd29-221e-446a-86f7-65130054a253 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:22.547802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a2dbd29-221e-446a-86f7-65130054a253 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:22.550244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a2dbd29-221e-446a-86f7-65130054a253 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:22.550573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a2dbd29-221e-446a-86f7-65130054a253 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:22.551549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a2dbd29-221e-446a-86f7-65130054a253 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:22.551949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a2dbd29-221e-446a-86f7-65130054a253 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:22.552763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a2dbd29-221e-446a-86f7-65130054a253 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:22.629141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0a2dbd29-221e-446a-86f7-65130054a253 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:22.638297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0a2dbd29-221e-446a-86f7-65130054a253 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:22.639616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0a2dbd29-221e-446a-86f7-65130054a253 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:22.644665 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0a2dbd29-221e-446a-86f7-65130054a253 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1453 microversion: 2.75 time: 0.113247 Oct 24 10:29:22.645559 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 656/1382] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:22 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:22.651199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-83655c8e-dd5d-4627-b3e6-f34bb5c7649a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:22.651803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-83655c8e-dd5d-4627-b3e6-f34bb5c7649a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] [instance: 8d47d8d5-f7d0-49c4-839a-92bababf20e7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:22.658290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83655c8e-dd5d-4627-b3e6-f34bb5c7649a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:22.658973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83655c8e-dd5d-4627-b3e6-f34bb5c7649a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:22.659595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83655c8e-dd5d-4627-b3e6-f34bb5c7649a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:22.660471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83655c8e-dd5d-4627-b3e6-f34bb5c7649a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:22.661110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83655c8e-dd5d-4627-b3e6-f34bb5c7649a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:22.661688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83655c8e-dd5d-4627-b3e6-f34bb5c7649a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:22.678547 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-83655c8e-dd5d-4627-b3e6-f34bb5c7649a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] HTTP exception thrown: Instance 8d47d8d5-f7d0-49c4-839a-92bababf20e7 could not be found. Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-83655c8e-dd5d-4627-b3e6-f34bb5c7649a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Request method failure captured: Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 HTTP/1.1 Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmi_taZ9SGyfWzaDH6IUvhaYiGC4GobtrVdV0PxVp8Z16RogMUW92m-QtSMAvgNsvx3NjJ0zNNjycJimPPe68fBnwLL3H8T4S5Cr4nGHEe5wjZUVfHINexasG2IrFwz1si5o2_sKgjhAQ-u9O_VnhHya6sNADdrcfmuIsrFe03zvfy0 Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 71c8dc3d203642269466444b34a31285 Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:29:22.681175 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:29:22.682764 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/71c8dc3d203642269466444b34a31285"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/71c8dc3d203642269466444b34a31285"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/71c8dc3d203642269466444b34a31285"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_71c8dc3d203642269466444b34a31285", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:29:22.682764 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 Oct 24 10:29:22.682764 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 71c8dc3d203642269466444b34a31285 Oct 24 10:29:22.682764 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 Oct 24 10:29:22.682764 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project Oct 24 10:29:22.682764 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:29:22.682764 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:29:22.682764 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 30108371eb394d148babe9e2f36c9454 Oct 24 10:29:22.682764 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project Oct 24 10:29:22.682764 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:29:22.682764 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 8d47d8d5-f7d0-49c4-839a-92bababf20e7 could not be found. Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '8d47d8d5-f7d0-49c4-839a-92bababf20e7'} Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d47d8d5-f7d0-49c4-839a-92bababf20e7 could not be found. Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:29:22.683531 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d47d8d5-f7d0-49c4-839a-92bababf20e7 could not be found. Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d47d8d5-f7d0-49c4-839a-92bababf20e7 could not be found. Oct 24 10:29:22.685544 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:22.687470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-83655c8e-dd5d-4627-b3e6-f34bb5c7649a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] Returning 404 to user: Instance 8d47d8d5-f7d0-49c4-839a-92bababf20e7 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:29:22.687470 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-83655c8e-dd5d-4627-b3e6-f34bb5c7649a tempest-FloatingIPsAssociationNegativeTestJSON-1528992455 tempest-FloatingIPsAssociationNegativeTestJSON-1528992455-project] 10.222.0.50 "GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7" status: 404 len: 111 microversion: 2.1 time: 0.035919 Oct 24 10:29:22.687470 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 657/1383] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:22 2022] GET /compute/v2.1/servers/8d47d8d5-f7d0-49c4-839a-92bababf20e7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:29:22.729454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-02fd06b8-71a2-46a5-9952-63d82c822991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:29:22.729880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-02fd06b8-71a2-46a5-9952-63d82c822991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:29:22.730358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-02fd06b8-71a2-46a5-9952-63d82c822991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:29:22.730804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-02fd06b8-71a2-46a5-9952-63d82c822991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:29:22.731224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-02fd06b8-71a2-46a5-9952-63d82c822991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:29:22.740017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02fd06b8-71a2-46a5-9952-63d82c822991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:22.740503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02fd06b8-71a2-46a5-9952-63d82c822991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:22.740997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02fd06b8-71a2-46a5-9952-63d82c822991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:22.742288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02fd06b8-71a2-46a5-9952-63d82c822991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:22.742832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02fd06b8-71a2-46a5-9952-63d82c822991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:22.743492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02fd06b8-71a2-46a5-9952-63d82c822991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:22.762314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-02fd06b8-71a2-46a5-9952-63d82c822991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for project b565572c0c8c4871af02471a328bd1af. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:22.767742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-02fd06b8-71a2-46a5-9952-63d82c822991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Getting quotas for user 9aa572f1e5014e10bed0abe34dfad43f and project b565572c0c8c4871af02471a328bd1af. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:22.780519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-02fd06b8-71a2-46a5-9952-63d82c822991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:29:22.782904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-02fd06b8-71a2-46a5-9952-63d82c822991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:29:22.830150 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-02fd06b8-71a2-46a5-9952-63d82c822991 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.477223 Oct 24 10:29:22.830968 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 727/1384] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:29:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:29:22.842072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a8d767b1-b074-4234-82ff-f3cd6b39af33 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:22.842687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a8d767b1-b074-4234-82ff-f3cd6b39af33 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:22.901868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a8d767b1-b074-4234-82ff-f3cd6b39af33 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:22.909635 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a8d767b1-b074-4234-82ff-f3cd6b39af33 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1217 microversion: 2.1 time: 0.071327 Oct 24 10:29:22.910339 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 658/1385] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:22 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:23.051881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-613b9775-f6c8-4362-9f31-a9460791d3bd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:23.053167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-613b9775-f6c8-4362-9f31-a9460791d3bd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:23.066016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-331f1e9d-4fd3-4680-ae2e-3999f0f945c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0b88160>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:23.066632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-613b9775-f6c8-4362-9f31-a9460791d3bd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:23.067331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-613b9775-f6c8-4362-9f31-a9460791d3bd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:23.067963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-613b9775-f6c8-4362-9f31-a9460791d3bd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:23.068901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-613b9775-f6c8-4362-9f31-a9460791d3bd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:23.070335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-613b9775-f6c8-4362-9f31-a9460791d3bd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:23.070994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-613b9775-f6c8-4362-9f31-a9460791d3bd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:23.136954 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-331f1e9d-4fd3-4680-ae2e-3999f0f945c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.075723 Oct 24 10:29:23.145789 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 659/1386] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:23 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:23.151861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-4ed664f3-6534-4a8e-85b8-ec0474d1793f req-603c9f73-1478-4f5e-8ed8-2333dcb9a544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651e9e7c-ba1a-4472-b74e-3f14eb862773", "name": "network-vif-unplugged", "status": "completed", "tag": "994f617f-bba6-456d-9bee-7c7fa6c5a409"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:23.172043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4ed664f3-6534-4a8e-85b8-ec0474d1793f req-603c9f73-1478-4f5e-8ed8-2333dcb9a544 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:23.172532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4ed664f3-6534-4a8e-85b8-ec0474d1793f req-603c9f73-1478-4f5e-8ed8-2333dcb9a544 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:23.173204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4ed664f3-6534-4a8e-85b8-ec0474d1793f req-603c9f73-1478-4f5e-8ed8-2333dcb9a544 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:23.188592 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-4ed664f3-6534-4a8e-85b8-ec0474d1793f req-603c9f73-1478-4f5e-8ed8-2333dcb9a544 service nova] Creating event network-vif-unplugged:994f617f-bba6-456d-9bee-7c7fa6c5a409 for instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 on n-h1-858383-15 Oct 24 10:29:23.195162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-4ed664f3-6534-4a8e-85b8-ec0474d1793f req-603c9f73-1478-4f5e-8ed8-2333dcb9a544 service nova] Instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:29:23.207289 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-4ed664f3-6534-4a8e-85b8-ec0474d1793f req-603c9f73-1478-4f5e-8ed8-2333dcb9a544 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064915 Oct 24 10:29:23.209133 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 660/1387] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:23.268048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-613b9775-f6c8-4362-9f31-a9460791d3bd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:23.273789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4f4f5709-eb0c-411c-8703-a67c977d6402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:23.275188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4f4f5709-eb0c-411c-8703-a67c977d6402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:23.279692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-613b9775-f6c8-4362-9f31-a9460791d3bd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:23.281265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-613b9775-f6c8-4362-9f31-a9460791d3bd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:23.284050 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-613b9775-f6c8-4362-9f31-a9460791d3bd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1409 microversion: 2.25 time: 0.235071 Oct 24 10:29:23.285020 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 728/1388] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:23 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1409 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:23.297052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f4f5709-eb0c-411c-8703-a67c977d6402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:23.297052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f4f5709-eb0c-411c-8703-a67c977d6402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:23.297052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f4f5709-eb0c-411c-8703-a67c977d6402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:23.297052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f4f5709-eb0c-411c-8703-a67c977d6402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:23.297520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f4f5709-eb0c-411c-8703-a67c977d6402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:23.297520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f4f5709-eb0c-411c-8703-a67c977d6402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:23.375220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e1db8b8b-2240-448e-aa2a-f290a1b1db50 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:23.376362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e1db8b8b-2240-448e-aa2a-f290a1b1db50 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: a8f749f9-5771-4ecb-8a06-30a8f69dd848] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:23.384437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1db8b8b-2240-448e-aa2a-f290a1b1db50 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:23.386481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1db8b8b-2240-448e-aa2a-f290a1b1db50 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:23.392094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1db8b8b-2240-448e-aa2a-f290a1b1db50 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:23.393066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1db8b8b-2240-448e-aa2a-f290a1b1db50 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:23.393533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1db8b8b-2240-448e-aa2a-f290a1b1db50 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:23.393962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1db8b8b-2240-448e-aa2a-f290a1b1db50 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:23.443199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1db8b8b-2240-448e-aa2a-f290a1b1db50 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:23.443782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1db8b8b-2240-448e-aa2a-f290a1b1db50 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:23.444481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1db8b8b-2240-448e-aa2a-f290a1b1db50 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:23.446338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-e1db8b8b-2240-448e-aa2a-f290a1b1db50 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lazy-loading 'fault' on Instance uuid a8f749f9-5771-4ecb-8a06-30a8f69dd848 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:23.449553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:23.463100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4f4f5709-eb0c-411c-8703-a67c977d6402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:23.471332 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4f4f5709-eb0c-411c-8703-a67c977d6402 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1476 microversion: 2.1 time: 0.203331 Oct 24 10:29:23.472137 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 661/1389] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:23 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1476 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:23.499214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e1db8b8b-2240-448e-aa2a-f290a1b1db50 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8549ee547f74419ab10b074f15fe80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f301001adb14e80ac92b2ed20b1c383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:23.508452 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e1db8b8b-2240-448e-aa2a-f290a1b1db50 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848" status: 200 len: 1308 microversion: 2.1 time: 0.136661 Oct 24 10:29:23.509076 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 729/1390] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:23 2022] GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848 => generated 1308 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:23.556432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d2599c0a-74d6-459f-9910-be19ea16fa51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:23.557089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d2599c0a-74d6-459f-9910-be19ea16fa51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:23.563039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2599c0a-74d6-459f-9910-be19ea16fa51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:23.563522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2599c0a-74d6-459f-9910-be19ea16fa51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:23.563956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2599c0a-74d6-459f-9910-be19ea16fa51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:23.564643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2599c0a-74d6-459f-9910-be19ea16fa51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:23.565197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2599c0a-74d6-459f-9910-be19ea16fa51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:23.565621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2599c0a-74d6-459f-9910-be19ea16fa51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:23.675026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c93ba641-610f-4190-933b-927ec1149038 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:23.675786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c93ba641-610f-4190-933b-927ec1149038 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:23.682200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c93ba641-610f-4190-933b-927ec1149038 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:23.682685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c93ba641-610f-4190-933b-927ec1149038 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:23.683119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c93ba641-610f-4190-933b-927ec1149038 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:23.683811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c93ba641-610f-4190-933b-927ec1149038 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:23.684263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c93ba641-610f-4190-933b-927ec1149038 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:23.684687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c93ba641-610f-4190-933b-927ec1149038 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:23.701508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d2599c0a-74d6-459f-9910-be19ea16fa51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:23.706137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:23.712583 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d2599c0a-74d6-459f-9910-be19ea16fa51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.160861 Oct 24 10:29:23.713335 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 662/1391] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:23 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:23.754808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c93ba641-610f-4190-933b-927ec1149038 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:23.764385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c93ba641-610f-4190-933b-927ec1149038 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:23.766016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c93ba641-610f-4190-933b-927ec1149038 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:23.771402 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c93ba641-610f-4190-933b-927ec1149038 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1453 microversion: 2.75 time: 0.100448 Oct 24 10:29:23.771991 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 730/1392] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:23 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:29:23.946995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0c9b1ea8-8e87-4086-8a4d-7715c2ab65a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:23.947949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0c9b1ea8-8e87-4086-8a4d-7715c2ab65a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:23.957735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c9b1ea8-8e87-4086-8a4d-7715c2ab65a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:23.957833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c9b1ea8-8e87-4086-8a4d-7715c2ab65a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:23.958217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c9b1ea8-8e87-4086-8a4d-7715c2ab65a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:23.959037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c9b1ea8-8e87-4086-8a4d-7715c2ab65a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:23.959498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c9b1ea8-8e87-4086-8a4d-7715c2ab65a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:23.959930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c9b1ea8-8e87-4086-8a4d-7715c2ab65a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:24.024701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0c9b1ea8-8e87-4086-8a4d-7715c2ab65a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:24.033184 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0c9b1ea8-8e87-4086-8a4d-7715c2ab65a0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1221 microversion: 2.1 time: 0.094043 Oct 24 10:29:24.045292 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 663/1393] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:23 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:24.154730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ba880ee0-4dfa-4d6d-8241-c43d30eeae62 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0d67b80>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:24.219586 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ba880ee0-4dfa-4d6d-8241-c43d30eeae62 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.068702 Oct 24 10:29:24.223178 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 731/1394] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:24 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:24.316911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cd140dfe-4051-426a-8297-88332544f483 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:24.317574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cd140dfe-4051-426a-8297-88332544f483 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:24.335828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd140dfe-4051-426a-8297-88332544f483 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:24.336647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd140dfe-4051-426a-8297-88332544f483 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:24.338358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd140dfe-4051-426a-8297-88332544f483 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:24.341463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd140dfe-4051-426a-8297-88332544f483 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:24.342125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd140dfe-4051-426a-8297-88332544f483 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:24.356063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd140dfe-4051-426a-8297-88332544f483 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:24.495230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2c776c50-b69b-4d0d-93eb-385052b24dd2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:24.495915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2c776c50-b69b-4d0d-93eb-385052b24dd2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:24.503010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c776c50-b69b-4d0d-93eb-385052b24dd2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:24.503754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c776c50-b69b-4d0d-93eb-385052b24dd2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:24.504530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c776c50-b69b-4d0d-93eb-385052b24dd2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:24.505439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c776c50-b69b-4d0d-93eb-385052b24dd2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:24.506404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c776c50-b69b-4d0d-93eb-385052b24dd2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:24.507543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c776c50-b69b-4d0d-93eb-385052b24dd2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:24.721123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cd140dfe-4051-426a-8297-88332544f483 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:24.735014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cd140dfe-4051-426a-8297-88332544f483 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:24.747586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cd140dfe-4051-426a-8297-88332544f483 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:24.750429 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cd140dfe-4051-426a-8297-88332544f483 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1409 microversion: 2.25 time: 0.443287 Oct 24 10:29:24.753222 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 664/1395] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:24 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1409 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:24.762430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c19bac5-1220-4faa-8467-186ff44093c8 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:24.763613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1c19bac5-1220-4faa-8467-186ff44093c8 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] [instance: a8f749f9-5771-4ecb-8a06-30a8f69dd848] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:24.773493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c19bac5-1220-4faa-8467-186ff44093c8 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:24.780866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c19bac5-1220-4faa-8467-186ff44093c8 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:24.797609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c19bac5-1220-4faa-8467-186ff44093c8 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:24.798560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c19bac5-1220-4faa-8467-186ff44093c8 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:24.799153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c19bac5-1220-4faa-8467-186ff44093c8 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:24.799684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c19bac5-1220-4faa-8467-186ff44093c8 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:24.815634 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-1c19bac5-1220-4faa-8467-186ff44093c8 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] HTTP exception thrown: Instance a8f749f9-5771-4ecb-8a06-30a8f69dd848 could not be found. Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c19bac5-1220-4faa-8467-186ff44093c8 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Request method failure captured: Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848 HTTP/1.1 Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmhU-UEcpqfOgJOdtDrTXQgP8rLgco0SwoQWMQxBBj_WR8WIoqne9dA7KS-glPVNeGb_gTgodPlmFWObkr6EoU6vyQ3H3GxtpVY6ecnwNTqAloavo-E9C8cIVyS8OT_oCK0uETyCUa7k7DhT3a0p1yBN52UndU6aoHBbI8mlyEdTQkE Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 1f301001adb14e80ac92b2ed20b1c383 Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ListImageFiltersTestJSON-727503360 Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:29:24.817783 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:29:24.819160 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1f301001adb14e80ac92b2ed20b1c383"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1f301001adb14e80ac92b2ed20b1c383"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1f301001adb14e80ac92b2ed20b1c383"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1f301001adb14e80ac92b2ed20b1c383", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:29:24.819160 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ListImageFiltersTestJSON-727503360 Oct 24 10:29:24.819160 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 1f301001adb14e80ac92b2ed20b1c383 Oct 24 10:29:24.819160 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-727503360 Oct 24 10:29:24.819160 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ListImageFiltersTestJSON-727503360-project Oct 24 10:29:24.819160 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:29:24.819160 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:29:24.819160 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a8549ee547f74419ab10b074f15fe80a Oct 24 10:29:24.819160 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ListImageFiltersTestJSON-727503360-project Oct 24 10:29:24.819160 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:29:24.819160 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance a8f749f9-5771-4ecb-8a06-30a8f69dd848 could not be found. Oct 24 10:29:24.819160 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'a8f749f9-5771-4ecb-8a06-30a8f69dd848'} Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8f749f9-5771-4ecb-8a06-30a8f69dd848 could not be found. Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:29:24.820925 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:29:24.822256 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:29:24.822256 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:29:24.822256 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:29:24.822256 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:29:24.822256 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:29:24.822256 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:29:24.822256 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:29:24.822256 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8f749f9-5771-4ecb-8a06-30a8f69dd848 could not be found. Oct 24 10:29:24.822256 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:24.822256 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:29:24.822256 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:24.822256 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:29:24.822256 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:29:24.822256 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:29:24.822256 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:29:24.822256 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:29:24.822256 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8f749f9-5771-4ecb-8a06-30a8f69dd848 could not be found. Oct 24 10:29:24.822256 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:29:24.825162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c19bac5-1220-4faa-8467-186ff44093c8 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Returning 404 to user: Instance a8f749f9-5771-4ecb-8a06-30a8f69dd848 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:29:24.826354 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1c19bac5-1220-4faa-8467-186ff44093c8 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848" status: 404 len: 111 microversion: 2.1 time: 0.067651 Oct 24 10:29:24.827453 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 665/1396] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:24 2022] GET /compute/v2.1/servers/a8f749f9-5771-4ecb-8a06-30a8f69dd848 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:29:24.832297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7980f953-7cb5-4299-a7cb-17181fff50a5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:24.833242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7980f953-7cb5-4299-a7cb-17181fff50a5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:24.839716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7980f953-7cb5-4299-a7cb-17181fff50a5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:24.840600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7980f953-7cb5-4299-a7cb-17181fff50a5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:24.841346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7980f953-7cb5-4299-a7cb-17181fff50a5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:24.842293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7980f953-7cb5-4299-a7cb-17181fff50a5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:24.842981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7980f953-7cb5-4299-a7cb-17181fff50a5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:24.843611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7980f953-7cb5-4299-a7cb-17181fff50a5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:24.887032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2c776c50-b69b-4d0d-93eb-385052b24dd2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:24.901220 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2c776c50-b69b-4d0d-93eb-385052b24dd2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1476 microversion: 2.1 time: 0.410018 Oct 24 10:29:24.902626 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 732/1397] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:24 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1476 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:24.907726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-504f539e-63aa-40cc-914b-539cbefcd2a1 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:24.908370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-504f539e-63aa-40cc-914b-539cbefcd2a1 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:24.921486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-504f539e-63aa-40cc-914b-539cbefcd2a1 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:24.921986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-504f539e-63aa-40cc-914b-539cbefcd2a1 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:24.922431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-504f539e-63aa-40cc-914b-539cbefcd2a1 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:24.923141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-504f539e-63aa-40cc-914b-539cbefcd2a1 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:24.937117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-504f539e-63aa-40cc-914b-539cbefcd2a1 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:24.938013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-504f539e-63aa-40cc-914b-539cbefcd2a1 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:25.057885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-504f539e-63aa-40cc-914b-539cbefcd2a1 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:25.069424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-504f539e-63aa-40cc-914b-539cbefcd2a1 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:25.071327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-504f539e-63aa-40cc-914b-539cbefcd2a1 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:25.079860 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-504f539e-63aa-40cc-914b-539cbefcd2a1 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1453 microversion: 2.75 time: 0.176152 Oct 24 10:29:25.092390 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 733/1398] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:24 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1453 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:25.103236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fa603968-9fda-4342-972e-2e7b21f97447 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d13ed160>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:25.438091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7980f953-7cb5-4299-a7cb-17181fff50a5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:25.446719 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7980f953-7cb5-4299-a7cb-17181fff50a5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.617999 Oct 24 10:29:25.447294 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 666/1399] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:24 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:25.458118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4b694797-cf9f-4610-be96-968444366134 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:25.459617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4b694797-cf9f-4610-be96-968444366134 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:25.468797 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fa603968-9fda-4342-972e-2e7b21f97447 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "DELETE /compute/v2.1/images/22445ba3-7ddd-4406-8555-fcb399e68de8" status: 204 len: 0 microversion: 2.1 time: 0.375107 Oct 24 10:29:25.469694 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 734/1400] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:25 2022] DELETE /compute/v2.1/images/22445ba3-7ddd-4406-8555-fcb399e68de8 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:25.474005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b694797-cf9f-4610-be96-968444366134 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:25.474420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b694797-cf9f-4610-be96-968444366134 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:25.474860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b694797-cf9f-4610-be96-968444366134 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:25.476160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b694797-cf9f-4610-be96-968444366134 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:25.476471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2caf2818-fc46-4249-b7f2-fd39f30ec24c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d1450820>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:25.476603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b694797-cf9f-4610-be96-968444366134 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:25.477102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b694797-cf9f-4610-be96-968444366134 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:25.529997 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2caf2818-fc46-4249-b7f2-fd39f30ec24c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.059175 Oct 24 10:29:25.531359 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 735/1401] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:25 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:25.553083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-29de5914-1644-49d1-becd-f871779230f6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d0901f70>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:25.622371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4b694797-cf9f-4610-be96-968444366134 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:25.631026 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4b694797-cf9f-4610-be96-968444366134 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1213 microversion: 2.1 time: 0.176646 Oct 24 10:29:25.637602 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 667/1402] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:25 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1213 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:25.782861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-87265363-a277-412d-8a27-c292163f6c88 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:25.783477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-87265363-a277-412d-8a27-c292163f6c88 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:25.789693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87265363-a277-412d-8a27-c292163f6c88 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:25.790230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87265363-a277-412d-8a27-c292163f6c88 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:25.790889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87265363-a277-412d-8a27-c292163f6c88 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:25.791622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87265363-a277-412d-8a27-c292163f6c88 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:25.792089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87265363-a277-412d-8a27-c292163f6c88 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:25.792570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87265363-a277-412d-8a27-c292163f6c88 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:25.904946 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-29de5914-1644-49d1-becd-f871779230f6 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "DELETE /compute/v2.1/images/e93fb24e-d5d2-47b8-92c0-f2b3845a8d20" status: 204 len: 0 microversion: 2.1 time: 0.372309 Oct 24 10:29:25.906091 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 736/1403] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:25 2022] DELETE /compute/v2.1/images/e93fb24e-d5d2-47b8-92c0-f2b3845a8d20 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:25.917402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eff36322-c248-4865-8498-c2c6c1d1c761 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] Calling method '.version_select at 0x7f04d259daf0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:26.090336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-87265363-a277-412d-8a27-c292163f6c88 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:26.108963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-87265363-a277-412d-8a27-c292163f6c88 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:26.111774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-87265363-a277-412d-8a27-c292163f6c88 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:26.113365 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-87265363-a277-412d-8a27-c292163f6c88 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1409 microversion: 2.25 time: 0.334170 Oct 24 10:29:26.114368 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 668/1404] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:25 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1409 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:29:26.247145 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-eff36322-c248-4865-8498-c2c6c1d1c761 tempest-ListImageFiltersTestJSON-727503360 tempest-ListImageFiltersTestJSON-727503360-project] 10.222.0.50 "DELETE /compute/v2.1/images/1a5ca8b1-4b29-42b8-97f9-11629a24c485" status: 204 len: 0 microversion: 2.1 time: 0.336159 Oct 24 10:29:26.248402 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 737/1405] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:25 2022] DELETE /compute/v2.1/images/1a5ca8b1-4b29-42b8-97f9-11629a24c485 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:26.272065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-38351db3-e43c-4ff5-878e-39c43eabb03d req-8b184ac5-3fe2-4e8f-bc32-75fea9486bbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "651e9e7c-ba1a-4472-b74e-3f14eb862773", "tag": "994f617f-bba6-456d-9bee-7c7fa6c5a409"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:26.299344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-38351db3-e43c-4ff5-878e-39c43eabb03d req-8b184ac5-3fe2-4e8f-bc32-75fea9486bbb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:26.300068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-38351db3-e43c-4ff5-878e-39c43eabb03d req-8b184ac5-3fe2-4e8f-bc32-75fea9486bbb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:26.300684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-38351db3-e43c-4ff5-878e-39c43eabb03d req-8b184ac5-3fe2-4e8f-bc32-75fea9486bbb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:26.312664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c238d0e5-9da2-47e5-a206-25b5bc9bbfd9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:26.314093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c238d0e5-9da2-47e5-a206-25b5bc9bbfd9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:26.322009 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-38351db3-e43c-4ff5-878e-39c43eabb03d req-8b184ac5-3fe2-4e8f-bc32-75fea9486bbb service nova] Creating event network-changed:994f617f-bba6-456d-9bee-7c7fa6c5a409 for instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 on n-h1-858383-15 Oct 24 10:29:26.323584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c238d0e5-9da2-47e5-a206-25b5bc9bbfd9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:26.327794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c238d0e5-9da2-47e5-a206-25b5bc9bbfd9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:26.329257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [req-38351db3-e43c-4ff5-878e-39c43eabb03d req-8b184ac5-3fe2-4e8f-bc32-75fea9486bbb service nova] Instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120426) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:29:26.331116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c238d0e5-9da2-47e5-a206-25b5bc9bbfd9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:26.333620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c238d0e5-9da2-47e5-a206-25b5bc9bbfd9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:26.334109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c238d0e5-9da2-47e5-a206-25b5bc9bbfd9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:26.334563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c238d0e5-9da2-47e5-a206-25b5bc9bbfd9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:26.343250 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-38351db3-e43c-4ff5-878e-39c43eabb03d req-8b184ac5-3fe2-4e8f-bc32-75fea9486bbb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092692 Oct 24 10:29:26.344436 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 738/1406] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:26.354583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0560c33f-1654-4542-ab47-dc3b1eae546f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:26.355459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0560c33f-1654-4542-ab47-dc3b1eae546f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:26.364431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0560c33f-1654-4542-ab47-dc3b1eae546f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:26.365454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0560c33f-1654-4542-ab47-dc3b1eae546f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:26.366214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0560c33f-1654-4542-ab47-dc3b1eae546f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:26.367864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0560c33f-1654-4542-ab47-dc3b1eae546f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:26.369007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0560c33f-1654-4542-ab47-dc3b1eae546f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:26.369937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0560c33f-1654-4542-ab47-dc3b1eae546f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:26.484808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0560c33f-1654-4542-ab47-dc3b1eae546f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:26.500160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0560c33f-1654-4542-ab47-dc3b1eae546f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:26.505698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0560c33f-1654-4542-ab47-dc3b1eae546f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:26.514693 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0560c33f-1654-4542-ab47-dc3b1eae546f tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1453 microversion: 2.75 time: 0.167034 Oct 24 10:29:26.521947 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 739/1407] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:26 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:26.531113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-88b9d114-b9d3-416b-a7e4-233f3ebf8cf6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:26.536078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-88b9d114-b9d3-416b-a7e4-233f3ebf8cf6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:26.548849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88b9d114-b9d3-416b-a7e4-233f3ebf8cf6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:26.549363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88b9d114-b9d3-416b-a7e4-233f3ebf8cf6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:26.549803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88b9d114-b9d3-416b-a7e4-233f3ebf8cf6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:26.550518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88b9d114-b9d3-416b-a7e4-233f3ebf8cf6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:26.556147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88b9d114-b9d3-416b-a7e4-233f3ebf8cf6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:26.556606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88b9d114-b9d3-416b-a7e4-233f3ebf8cf6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:26.624002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c238d0e5-9da2-47e5-a206-25b5bc9bbfd9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:26.637287 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c238d0e5-9da2-47e5-a206-25b5bc9bbfd9 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1476 microversion: 2.1 time: 0.521502 Oct 24 10:29:26.648862 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 669/1408] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:26 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1476 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:26.648862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7277cf11-1998-4657-a55c-7ea7ce2b812e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0bb31f0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:26.720249 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7277cf11-1998-4657-a55c-7ea7ce2b812e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.080990 Oct 24 10:29:26.723073 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 670/1409] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:26 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:26.738889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f86c1c08-8299-456c-957f-e8dcfc7ce42a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:26.739533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f86c1c08-8299-456c-957f-e8dcfc7ce42a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:26.765501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f86c1c08-8299-456c-957f-e8dcfc7ce42a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:26.772022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f86c1c08-8299-456c-957f-e8dcfc7ce42a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:26.772594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f86c1c08-8299-456c-957f-e8dcfc7ce42a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:26.773384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f86c1c08-8299-456c-957f-e8dcfc7ce42a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:26.777108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f86c1c08-8299-456c-957f-e8dcfc7ce42a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:26.777555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f86c1c08-8299-456c-957f-e8dcfc7ce42a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:26.996897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f86c1c08-8299-456c-957f-e8dcfc7ce42a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:27.012146 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f86c1c08-8299-456c-957f-e8dcfc7ce42a tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1213 microversion: 2.1 time: 0.280103 Oct 24 10:29:27.014497 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 671/1410] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:26 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1213 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:27.018713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-88b9d114-b9d3-416b-a7e4-233f3ebf8cf6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:27.031879 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-88b9d114-b9d3-416b-a7e4-233f3ebf8cf6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.507794 Oct 24 10:29:27.035099 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 740/1411] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:26 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:27.148255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d77f1c9b-ca9b-4123-a28c-22a8622c97e1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:27.149273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d77f1c9b-ca9b-4123-a28c-22a8622c97e1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:27.161591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d77f1c9b-ca9b-4123-a28c-22a8622c97e1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:27.163961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d77f1c9b-ca9b-4123-a28c-22a8622c97e1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:27.164631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d77f1c9b-ca9b-4123-a28c-22a8622c97e1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:27.166150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d77f1c9b-ca9b-4123-a28c-22a8622c97e1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:27.168974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d77f1c9b-ca9b-4123-a28c-22a8622c97e1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:27.170113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d77f1c9b-ca9b-4123-a28c-22a8622c97e1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:27.428098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d77f1c9b-ca9b-4123-a28c-22a8622c97e1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:27.438515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d77f1c9b-ca9b-4123-a28c-22a8622c97e1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:27.439946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d77f1c9b-ca9b-4123-a28c-22a8622c97e1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:27.441308 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d77f1c9b-ca9b-4123-a28c-22a8622c97e1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1409 microversion: 2.25 time: 0.301706 Oct 24 10:29:27.442603 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 672/1412] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:27 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1409 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:27.546498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-16657930-c337-44d4-9de0-aa427c0219d4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:27.547121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-16657930-c337-44d4-9de0-aa427c0219d4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:27.559231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16657930-c337-44d4-9de0-aa427c0219d4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:27.559877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16657930-c337-44d4-9de0-aa427c0219d4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:27.560926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16657930-c337-44d4-9de0-aa427c0219d4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:27.562012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16657930-c337-44d4-9de0-aa427c0219d4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:27.562641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16657930-c337-44d4-9de0-aa427c0219d4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:27.563223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16657930-c337-44d4-9de0-aa427c0219d4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:27.656302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-16657930-c337-44d4-9de0-aa427c0219d4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:27.661739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-249853b3-a692-4915-bb1f-4101f9bee39a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:27.662887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-249853b3-a692-4915-bb1f-4101f9bee39a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:27.666745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-16657930-c337-44d4-9de0-aa427c0219d4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:27.669134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-16657930-c337-44d4-9de0-aa427c0219d4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:27.670353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-249853b3-a692-4915-bb1f-4101f9bee39a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:27.671013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-249853b3-a692-4915-bb1f-4101f9bee39a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:27.671642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-249853b3-a692-4915-bb1f-4101f9bee39a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:27.672513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-249853b3-a692-4915-bb1f-4101f9bee39a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:27.673153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-249853b3-a692-4915-bb1f-4101f9bee39a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:27.673743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-249853b3-a692-4915-bb1f-4101f9bee39a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:27.676068 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-16657930-c337-44d4-9de0-aa427c0219d4 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1453 microversion: 2.75 time: 0.133557 Oct 24 10:29:27.692863 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 741/1413] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:27 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1453 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:27.738897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f75ab427-d704-4338-9383-ff6bca004468 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0d67b80>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:27.786441 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f75ab427-d704-4338-9383-ff6bca004468 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.053707 Oct 24 10:29:27.795331 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 742/1414] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:27 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:27.889302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-249853b3-a692-4915-bb1f-4101f9bee39a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:27.898896 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-249853b3-a692-4915-bb1f-4101f9bee39a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1476 microversion: 2.1 time: 0.240792 Oct 24 10:29:27.899989 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 673/1415] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:27 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1476 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:28.041830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-78cf2201-b505-4075-8c17-c490f242ab29 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:28.042599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-78cf2201-b505-4075-8c17-c490f242ab29 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:28.059439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78cf2201-b505-4075-8c17-c490f242ab29 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:28.062898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c1c6707c-0eab-4dfd-8169-67743055a8fe req-2c75d3ce-b8fb-49fe-a46a-0b50302e339b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9eff099-cc37-4432-8741-4e7d179b9ff0", "name": "network-vif-unplugged", "status": "completed", "tag": "e5f5ae43-f478-4bd6-8b05-04ea1b1ab6c2"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:28.073039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78cf2201-b505-4075-8c17-c490f242ab29 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:28.075709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78cf2201-b505-4075-8c17-c490f242ab29 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:28.079320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78cf2201-b505-4075-8c17-c490f242ab29 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:28.081540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78cf2201-b505-4075-8c17-c490f242ab29 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:28.082029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78cf2201-b505-4075-8c17-c490f242ab29 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:28.086554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c1c6707c-0eab-4dfd-8169-67743055a8fe req-2c75d3ce-b8fb-49fe-a46a-0b50302e339b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:28.087099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c1c6707c-0eab-4dfd-8169-67743055a8fe req-2c75d3ce-b8fb-49fe-a46a-0b50302e339b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:28.088074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c1c6707c-0eab-4dfd-8169-67743055a8fe req-2c75d3ce-b8fb-49fe-a46a-0b50302e339b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:28.120914 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c1c6707c-0eab-4dfd-8169-67743055a8fe req-2c75d3ce-b8fb-49fe-a46a-0b50302e339b service nova] Creating event network-vif-unplugged:e5f5ae43-f478-4bd6-8b05-04ea1b1ab6c2 for instance b9eff099-cc37-4432-8741-4e7d179b9ff0 on n-h2-858383-15 Oct 24 10:29:28.138418 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c1c6707c-0eab-4dfd-8169-67743055a8fe req-2c75d3ce-b8fb-49fe-a46a-0b50302e339b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087762 Oct 24 10:29:28.141744 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 674/1416] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:29:28.157993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-94bd2594-e9b6-42ba-b86c-881e60844ea2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:28.160443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-94bd2594-e9b6-42ba-b86c-881e60844ea2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:28.179930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94bd2594-e9b6-42ba-b86c-881e60844ea2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:28.180523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94bd2594-e9b6-42ba-b86c-881e60844ea2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:28.181232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94bd2594-e9b6-42ba-b86c-881e60844ea2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:28.181820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94bd2594-e9b6-42ba-b86c-881e60844ea2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:28.182282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94bd2594-e9b6-42ba-b86c-881e60844ea2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:28.182711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94bd2594-e9b6-42ba-b86c-881e60844ea2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:28.240770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-78cf2201-b505-4075-8c17-c490f242ab29 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:28.253206 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-78cf2201-b505-4075-8c17-c490f242ab29 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1269 microversion: 2.1 time: 0.218830 Oct 24 10:29:28.254085 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 743/1417] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:28 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1269 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:28.468469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3159c9bf-cf3c-459e-b2ab-89e63436774a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:28.469120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3159c9bf-cf3c-459e-b2ab-89e63436774a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:28.483867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3159c9bf-cf3c-459e-b2ab-89e63436774a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:28.485515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3159c9bf-cf3c-459e-b2ab-89e63436774a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:28.487460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3159c9bf-cf3c-459e-b2ab-89e63436774a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:28.489373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3159c9bf-cf3c-459e-b2ab-89e63436774a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:28.490935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3159c9bf-cf3c-459e-b2ab-89e63436774a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:28.491835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3159c9bf-cf3c-459e-b2ab-89e63436774a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:28.637454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-94bd2594-e9b6-42ba-b86c-881e60844ea2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:28.645724 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-94bd2594-e9b6-42ba-b86c-881e60844ea2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.502766 Oct 24 10:29:28.649702 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 675/1418] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:28 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:28.708758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3c583566-03c0-4709-98d4-df3cb823fc21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:28.709436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3c583566-03c0-4709-98d4-df3cb823fc21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:28.724442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c583566-03c0-4709-98d4-df3cb823fc21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:28.724866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c583566-03c0-4709-98d4-df3cb823fc21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:28.725430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c583566-03c0-4709-98d4-df3cb823fc21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:28.726107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c583566-03c0-4709-98d4-df3cb823fc21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:28.726848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c583566-03c0-4709-98d4-df3cb823fc21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:28.727279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c583566-03c0-4709-98d4-df3cb823fc21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:28.763816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3159c9bf-cf3c-459e-b2ab-89e63436774a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:28.800976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3159c9bf-cf3c-459e-b2ab-89e63436774a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:28.802727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3159c9bf-cf3c-459e-b2ab-89e63436774a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:28.804915 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3159c9bf-cf3c-459e-b2ab-89e63436774a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1409 microversion: 2.25 time: 0.340373 Oct 24 10:29:28.805424 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 744/1419] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:28 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1409 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:29:28.825136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2b886403-f1f2-4460-9ee2-611907a9793f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0f390d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:28.834597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c583566-03c0-4709-98d4-df3cb823fc21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:28.843739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c583566-03c0-4709-98d4-df3cb823fc21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:28.846324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c583566-03c0-4709-98d4-df3cb823fc21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:28.851863 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3c583566-03c0-4709-98d4-df3cb823fc21 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1453 microversion: 2.75 time: 0.148173 Oct 24 10:29:28.852605 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 676/1420] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:28 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:29:28.914317 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2b886403-f1f2-4460-9ee2-611907a9793f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.107024 Oct 24 10:29:28.915123 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 745/1421] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:28 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:28.923044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0bc37cf0-5389-4eaf-a63c-c0a7387df19c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:28.924253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0bc37cf0-5389-4eaf-a63c-c0a7387df19c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:28.937484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bc37cf0-5389-4eaf-a63c-c0a7387df19c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:28.938324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bc37cf0-5389-4eaf-a63c-c0a7387df19c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:28.938922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bc37cf0-5389-4eaf-a63c-c0a7387df19c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:28.940283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bc37cf0-5389-4eaf-a63c-c0a7387df19c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:28.943073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bc37cf0-5389-4eaf-a63c-c0a7387df19c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:28.943530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bc37cf0-5389-4eaf-a63c-c0a7387df19c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:29.283259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-00d981fd-ec69-4cef-8383-2278e171f2fb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:29.285020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-00d981fd-ec69-4cef-8383-2278e171f2fb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:29.293567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00d981fd-ec69-4cef-8383-2278e171f2fb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:29.294087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00d981fd-ec69-4cef-8383-2278e171f2fb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:29.294979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00d981fd-ec69-4cef-8383-2278e171f2fb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:29.296058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00d981fd-ec69-4cef-8383-2278e171f2fb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:29.296520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00d981fd-ec69-4cef-8383-2278e171f2fb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:29.297273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00d981fd-ec69-4cef-8383-2278e171f2fb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:29.323170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0bc37cf0-5389-4eaf-a63c-c0a7387df19c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:29.332856 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0bc37cf0-5389-4eaf-a63c-c0a7387df19c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1476 microversion: 2.1 time: 0.414159 Oct 24 10:29:29.344861 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 677/1422] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:28 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1476 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:29.383565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-00d981fd-ec69-4cef-8383-2278e171f2fb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:29.394979 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-00d981fd-ec69-4cef-8383-2278e171f2fb tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1269 microversion: 2.1 time: 0.117493 Oct 24 10:29:29.395692 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 746/1423] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:29 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1269 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:29.673361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4f60bedd-7069-477b-a82f-dfce3642b627 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:29.674135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4f60bedd-7069-477b-a82f-dfce3642b627 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:29.685955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f60bedd-7069-477b-a82f-dfce3642b627 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:29.686551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f60bedd-7069-477b-a82f-dfce3642b627 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:29.687309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f60bedd-7069-477b-a82f-dfce3642b627 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:29.688567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f60bedd-7069-477b-a82f-dfce3642b627 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:29.689315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f60bedd-7069-477b-a82f-dfce3642b627 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:29.690834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f60bedd-7069-477b-a82f-dfce3642b627 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:29.833544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8ddd4b8d-0f0a-49c6-9d94-b1a774700112 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:29.834976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8ddd4b8d-0f0a-49c6-9d94-b1a774700112 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:29.844803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ddd4b8d-0f0a-49c6-9d94-b1a774700112 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:29.846214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ddd4b8d-0f0a-49c6-9d94-b1a774700112 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:29.846915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ddd4b8d-0f0a-49c6-9d94-b1a774700112 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:29.848186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ddd4b8d-0f0a-49c6-9d94-b1a774700112 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:29.848879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ddd4b8d-0f0a-49c6-9d94-b1a774700112 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:29.850597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ddd4b8d-0f0a-49c6-9d94-b1a774700112 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:30.175685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8ddd4b8d-0f0a-49c6-9d94-b1a774700112 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:30.187138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8ddd4b8d-0f0a-49c6-9d94-b1a774700112 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:30.195790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8ddd4b8d-0f0a-49c6-9d94-b1a774700112 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:30.197067 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8ddd4b8d-0f0a-49c6-9d94-b1a774700112 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1409 microversion: 2.25 time: 0.367526 Oct 24 10:29:30.198274 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 747/1424] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:29 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1409 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:29:30.223964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5aa38201-6351-4791-a3e9-1890b453a039 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:30.224928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5aa38201-6351-4791-a3e9-1890b453a039 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:30.232452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5aa38201-6351-4791-a3e9-1890b453a039 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:30.233226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5aa38201-6351-4791-a3e9-1890b453a039 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:30.233855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5aa38201-6351-4791-a3e9-1890b453a039 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:30.235160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5aa38201-6351-4791-a3e9-1890b453a039 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:30.235782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5aa38201-6351-4791-a3e9-1890b453a039 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:30.236463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5aa38201-6351-4791-a3e9-1890b453a039 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:30.258492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4f60bedd-7069-477b-a82f-dfce3642b627 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:30.272775 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4f60bedd-7069-477b-a82f-dfce3642b627 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.605558 Oct 24 10:29:30.275282 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 678/1425] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:29 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:30.302181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c53483a-4c80-4ffb-aff4-6af1d199fa2c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0be25e0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:30.381290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5aa38201-6351-4791-a3e9-1890b453a039 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:30.391657 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4c53483a-4c80-4ffb-aff4-6af1d199fa2c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.113870 Oct 24 10:29:30.392243 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 679/1426] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:30 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:30.402131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5aa38201-6351-4791-a3e9-1890b453a039 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:30.403773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-641153d5-fcdc-4881-9d91-892f78ca7dca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:30.404048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5aa38201-6351-4791-a3e9-1890b453a039 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:30.405562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-641153d5-fcdc-4881-9d91-892f78ca7dca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:30.410679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:30.415326 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5aa38201-6351-4791-a3e9-1890b453a039 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1438 microversion: 2.75 time: 0.200117 Oct 24 10:29:30.416213 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 748/1427] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:30 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1438 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:30.423492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-641153d5-fcdc-4881-9d91-892f78ca7dca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:30.424386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-641153d5-fcdc-4881-9d91-892f78ca7dca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:30.425552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-641153d5-fcdc-4881-9d91-892f78ca7dca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:30.426634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-641153d5-fcdc-4881-9d91-892f78ca7dca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:30.427304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-641153d5-fcdc-4881-9d91-892f78ca7dca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:30.428054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-641153d5-fcdc-4881-9d91-892f78ca7dca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:30.437153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-621d5e95-cc99-4c9f-9674-1d95849d38f5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:30.438137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-621d5e95-cc99-4c9f-9674-1d95849d38f5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:30.454981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-621d5e95-cc99-4c9f-9674-1d95849d38f5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:30.455454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-621d5e95-cc99-4c9f-9674-1d95849d38f5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:30.458416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-621d5e95-cc99-4c9f-9674-1d95849d38f5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:30.462499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-621d5e95-cc99-4c9f-9674-1d95849d38f5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:30.462997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-621d5e95-cc99-4c9f-9674-1d95849d38f5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:30.464093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-621d5e95-cc99-4c9f-9674-1d95849d38f5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:30.619718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-641153d5-fcdc-4881-9d91-892f78ca7dca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:30.635034 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-641153d5-fcdc-4881-9d91-892f78ca7dca tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1474 microversion: 2.1 time: 0.241699 Oct 24 10:29:30.637110 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 680/1428] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:30 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1474 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:30.658635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-621d5e95-cc99-4c9f-9674-1d95849d38f5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:30.695015 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-621d5e95-cc99-4c9f-9674-1d95849d38f5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1275 microversion: 2.1 time: 0.274938 Oct 24 10:29:30.709625 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 749/1429] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:30 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1275 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:30.719823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-3bd1bb07-c058-446a-af28-5e38d7735e43 req-f6372902-1d82-4ad0-9975-4bdb30a9de05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9eff099-cc37-4432-8741-4e7d179b9ff0", "tag": "e5f5ae43-f478-4bd6-8b05-04ea1b1ab6c2"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:30.731467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3bd1bb07-c058-446a-af28-5e38d7735e43 req-f6372902-1d82-4ad0-9975-4bdb30a9de05 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:30.731763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3bd1bb07-c058-446a-af28-5e38d7735e43 req-f6372902-1d82-4ad0-9975-4bdb30a9de05 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:30.732969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3bd1bb07-c058-446a-af28-5e38d7735e43 req-f6372902-1d82-4ad0-9975-4bdb30a9de05 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:30.774066 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-3bd1bb07-c058-446a-af28-5e38d7735e43 req-f6372902-1d82-4ad0-9975-4bdb30a9de05 service nova] Creating event network-changed:e5f5ae43-f478-4bd6-8b05-04ea1b1ab6c2 for instance b9eff099-cc37-4432-8741-4e7d179b9ff0 on n-h2-858383-15 Oct 24 10:29:30.786674 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-3bd1bb07-c058-446a-af28-5e38d7735e43 req-f6372902-1d82-4ad0-9975-4bdb30a9de05 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071092 Oct 24 10:29:30.787760 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 750/1430] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:30.801514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-eac8f84e-2f9e-4204-a9a9-b601f746dcbc req-3f5caa2d-c1e1-4533-9276-bba095876ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e4585f-945b-462a-aac7-5a7af22f160d", "name": "network-vif-plugged", "status": "completed", "tag": "37825a2f-34ee-4e53-ae99-2a22e0da2d1b"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:30.819505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-eac8f84e-2f9e-4204-a9a9-b601f746dcbc req-3f5caa2d-c1e1-4533-9276-bba095876ef1 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:30.821032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-eac8f84e-2f9e-4204-a9a9-b601f746dcbc req-3f5caa2d-c1e1-4533-9276-bba095876ef1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:30.822782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-eac8f84e-2f9e-4204-a9a9-b601f746dcbc req-3f5caa2d-c1e1-4533-9276-bba095876ef1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:30.841651 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-eac8f84e-2f9e-4204-a9a9-b601f746dcbc req-3f5caa2d-c1e1-4533-9276-bba095876ef1 service nova] Creating event network-vif-plugged:37825a2f-34ee-4e53-ae99-2a22e0da2d1b for instance 07e4585f-945b-462a-aac7-5a7af22f160d on n-h1-858383-15 Oct 24 10:29:30.848474 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-eac8f84e-2f9e-4204-a9a9-b601f746dcbc req-3f5caa2d-c1e1-4533-9276-bba095876ef1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058517 Oct 24 10:29:30.849249 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 751/1431] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:30.863624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cadd2e6b-cd70-4c82-9de0-f4673d02e948 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Calling method '.version_select at 0x7f04d1450a60>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:30.952864 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cadd2e6b-cd70-4c82-9de0-f4673d02e948 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] 10.222.0.50 "GET /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1" status: 200 len: 636 microversion: 2.1 time: 0.092492 Oct 24 10:29:30.954589 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 752/1432] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:30 2022] GET /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1 => generated 636 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:30.960813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:30.963767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:30.973322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:30.974379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:30.975105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:30.976643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:30.977217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:30.977665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:30.979759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b8b985ce-ea7f-401b-8f3e-2fecb73aca88 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Action: 'update_all', calling method: .version_select at 0x7f04d08a1d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:31.077292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-b8b985ce-ea7f-401b-8f3e-2fecb73aca88 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Getting quotas for project 5cabe09fe1ba4124ba5e963feed67f01. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:31.084092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-b8b985ce-ea7f-401b-8f3e-2fecb73aca88 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Getting quotas for user 2767b44077b0480cbee4bb038d58f90b and project 5cabe09fe1ba4124ba5e963feed67f01. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:31.117614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:29:31.118795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:29:31.120719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:29:31.121219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:29:31.122484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:29:31.195567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:31.276965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:31.315889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:31.317134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:31.318244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:31.322538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:31.326399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:31.328790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:31.634725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:31.653756 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-707fe275-6fd3-48b1-b3e9-5544f9ae8a06 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e/action" status: 202 len: 1944 microversion: 2.75 time: 1.015392 Oct 24 10:29:31.654769 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 681/1433] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Oct 24 10:29:30 2022] POST /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e/action => generated 1944 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 24 10:29:31.664195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3a991d1a-4dfd-476f-96ae-f99021961fd5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:31.665276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3a991d1a-4dfd-476f-96ae-f99021961fd5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:31.666537 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b8b985ce-ea7f-401b-8f3e-2fecb73aca88 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] 10.222.0.50 "PUT /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.700224 Oct 24 10:29:31.667471 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 753/1434] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:29:30 2022] PUT /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata => generated 61 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:29:31.674116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-84110b08-7c6f-47ad-985f-a845ba1c2ef3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:31.674885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-84110b08-7c6f-47ad-985f-a845ba1c2ef3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:31.677887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a991d1a-4dfd-476f-96ae-f99021961fd5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:31.678493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a991d1a-4dfd-476f-96ae-f99021961fd5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:31.679580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a991d1a-4dfd-476f-96ae-f99021961fd5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:31.689087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a991d1a-4dfd-476f-96ae-f99021961fd5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:31.689799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a991d1a-4dfd-476f-96ae-f99021961fd5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:31.690538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a991d1a-4dfd-476f-96ae-f99021961fd5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:31.696077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84110b08-7c6f-47ad-985f-a845ba1c2ef3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:31.699214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84110b08-7c6f-47ad-985f-a845ba1c2ef3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:31.700947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84110b08-7c6f-47ad-985f-a845ba1c2ef3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:31.703286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84110b08-7c6f-47ad-985f-a845ba1c2ef3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:31.709131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84110b08-7c6f-47ad-985f-a845ba1c2ef3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:31.709831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84110b08-7c6f-47ad-985f-a845ba1c2ef3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:32.035741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3a991d1a-4dfd-476f-96ae-f99021961fd5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:32.042895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-84110b08-7c6f-47ad-985f-a845ba1c2ef3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:32.057563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3a991d1a-4dfd-476f-96ae-f99021961fd5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:32.059488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3a991d1a-4dfd-476f-96ae-f99021961fd5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:32.061121 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3a991d1a-4dfd-476f-96ae-f99021961fd5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1409 microversion: 2.25 time: 0.405257 Oct 24 10:29:32.061843 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 682/1435] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:31 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1409 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:32.062099 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-84110b08-7c6f-47ad-985f-a845ba1c2ef3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.393318 Oct 24 10:29:32.063124 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 754/1436] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:31 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:32.068008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-95bfeece-3f98-4cfb-a2fd-1865e8015203 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0b12c10>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:32.068181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7e3327f5-6f32-404b-96bb-266bcd6d9734 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:32.068752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7e3327f5-6f32-404b-96bb-266bcd6d9734 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:32.076093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e3327f5-6f32-404b-96bb-266bcd6d9734 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:32.076899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e3327f5-6f32-404b-96bb-266bcd6d9734 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:32.077364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e3327f5-6f32-404b-96bb-266bcd6d9734 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:32.078409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e3327f5-6f32-404b-96bb-266bcd6d9734 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:32.078868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e3327f5-6f32-404b-96bb-266bcd6d9734 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:32.079290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e3327f5-6f32-404b-96bb-266bcd6d9734 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:32.139279 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-95bfeece-3f98-4cfb-a2fd-1865e8015203 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.075366 Oct 24 10:29:32.140523 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 683/1437] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:32 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:32.145188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2fe0e7b6-482b-4170-8545-6b1f13526ab9 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Calling method '.version_select at 0x7f04d0ae50d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:32.293151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7e3327f5-6f32-404b-96bb-266bcd6d9734 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:32.306002 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7e3327f5-6f32-404b-96bb-266bcd6d9734 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1474 microversion: 2.1 time: 0.241764 Oct 24 10:29:32.309278 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 755/1438] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:32 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1474 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:32.318547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-644ee5be-ceed-4532-ba2b-b5c6df9618ad tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:32.320359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-644ee5be-ceed-4532-ba2b-b5c6df9618ad tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:32.330532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-644ee5be-ceed-4532-ba2b-b5c6df9618ad tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:32.331104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-644ee5be-ceed-4532-ba2b-b5c6df9618ad tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:32.331624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-644ee5be-ceed-4532-ba2b-b5c6df9618ad tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:32.332791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-644ee5be-ceed-4532-ba2b-b5c6df9618ad tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:32.333383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-644ee5be-ceed-4532-ba2b-b5c6df9618ad tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:32.333821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-644ee5be-ceed-4532-ba2b-b5c6df9618ad tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:32.498157 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2fe0e7b6-482b-4170-8545-6b1f13526ab9 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] 10.222.0.50 "DELETE /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.356196 Oct 24 10:29:32.498950 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 684/1439] 10.222.0.50 () {58 vars in 1296 bytes} [Mon Oct 24 10:29:32 2022] DELETE /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata/os_version => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:32.504740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8454bdce-b3da-4e96-8ec8-738bb2bea206 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:32.505860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8454bdce-b3da-4e96-8ec8-738bb2bea206 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:32.513793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8454bdce-b3da-4e96-8ec8-738bb2bea206 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:32.514957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8454bdce-b3da-4e96-8ec8-738bb2bea206 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:32.515554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8454bdce-b3da-4e96-8ec8-738bb2bea206 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:32.516931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8454bdce-b3da-4e96-8ec8-738bb2bea206 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:32.517767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8454bdce-b3da-4e96-8ec8-738bb2bea206 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:32.518857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8454bdce-b3da-4e96-8ec8-738bb2bea206 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:32.523303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:32.537983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-644ee5be-ceed-4532-ba2b-b5c6df9618ad tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:32.565799 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-644ee5be-ceed-4532-ba2b-b5c6df9618ad tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.255099 Oct 24 10:29:32.566678 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 756/1440] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:32 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:32.585046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-75cc4b95-1ab9-4cfb-9918-b8843d525678 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Calling method '.version_select at 0x7f04d0901d30>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:32.636736 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-75cc4b95-1ab9-4cfb-9918-b8843d525678 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] 10.222.0.50 "GET /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata" status: 200 len: 37 microversion: 2.1 time: 0.068819 Oct 24 10:29:32.638303 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 757/1441] 10.222.0.50 () {58 vars in 1260 bytes} [Mon Oct 24 10:29:32 2022] GET /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata => generated 37 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:29:32.652407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-11f562e3-e79f-4c67-b3d8-a843b4201d6c tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Action: 'update_all', calling method: .version_select at 0x7f04d08a1f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:32.715333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-11f562e3-e79f-4c67-b3d8-a843b4201d6c tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Getting quotas for project 5cabe09fe1ba4124ba5e963feed67f01. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:32.721196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-11f562e3-e79f-4c67-b3d8-a843b4201d6c tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Getting quotas for user 2767b44077b0480cbee4bb038d58f90b and project 5cabe09fe1ba4124ba5e963feed67f01. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:32.752492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:32.862837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8454bdce-b3da-4e96-8ec8-738bb2bea206 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:32.875619 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8454bdce-b3da-4e96-8ec8-738bb2bea206 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1317 microversion: 2.1 time: 0.375374 Oct 24 10:29:32.877255 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 685/1442] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:32 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:33.090101 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-11f562e3-e79f-4c67-b3d8-a843b4201d6c tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] 10.222.0.50 "PUT /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.442975 Oct 24 10:29:33.091078 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 758/1443] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:29:32 2022] PUT /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata => generated 61 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:29:33.096893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f44fcc9b-7ea7-4fea-8618-b244a305f66e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:33.097501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f44fcc9b-7ea7-4fea-8618-b244a305f66e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:33.099335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:33.100588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e010af39-3a67-4bdc-baf4-bb841cb7c739 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Calling method '.version_select at 0x7f04d09ab940>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:33.105451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f44fcc9b-7ea7-4fea-8618-b244a305f66e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:33.105925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f44fcc9b-7ea7-4fea-8618-b244a305f66e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:33.106357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f44fcc9b-7ea7-4fea-8618-b244a305f66e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:33.107058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f44fcc9b-7ea7-4fea-8618-b244a305f66e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:33.107507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f44fcc9b-7ea7-4fea-8618-b244a305f66e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:33.108014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f44fcc9b-7ea7-4fea-8618-b244a305f66e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:33.158311 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e010af39-3a67-4bdc-baf4-bb841cb7c739 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] 10.222.0.50 "GET /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.062080 Oct 24 10:29:33.159015 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 759/1444] 10.222.0.50 () {58 vars in 1290 bytes} [Mon Oct 24 10:29:33 2022] GET /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata/os_distro => generated 33 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 10:29:33.164203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-77605cd2-4eb1-43c4-9698-95f69bfa1d62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:33.164358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-77605cd2-4eb1-43c4-9698-95f69bfa1d62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:33.171297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77605cd2-4eb1-43c4-9698-95f69bfa1d62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:33.171820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77605cd2-4eb1-43c4-9698-95f69bfa1d62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:33.172254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77605cd2-4eb1-43c4-9698-95f69bfa1d62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:33.172999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77605cd2-4eb1-43c4-9698-95f69bfa1d62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:33.173450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77605cd2-4eb1-43c4-9698-95f69bfa1d62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:33.173869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77605cd2-4eb1-43c4-9698-95f69bfa1d62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:33.424756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f44fcc9b-7ea7-4fea-8618-b244a305f66e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:33.436542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f44fcc9b-7ea7-4fea-8618-b244a305f66e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:33.438231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f44fcc9b-7ea7-4fea-8618-b244a305f66e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:33.439611 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f44fcc9b-7ea7-4fea-8618-b244a305f66e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1409 microversion: 2.25 time: 0.348279 Oct 24 10:29:33.440372 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 686/1445] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:33 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1409 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:29:33.448457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-77605cd2-4eb1-43c4-9698-95f69bfa1d62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:33.457035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-720b27b4-40a7-432a-a7d4-60d3a40fba64 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0caa280>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:33.464299 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-77605cd2-4eb1-43c4-9698-95f69bfa1d62 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.304239 Oct 24 10:29:33.465198 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 760/1446] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:33 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:33.470130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7d771a6d-4e01-4b4b-8079-d51494614d34 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Action: 'update_all', calling method: .version_select at 0x7f04d13ed160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:33.520434 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-720b27b4-40a7-432a-a7d4-60d3a40fba64 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.078756 Oct 24 10:29:33.521033 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 687/1447] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:33 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:33.526844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4b9e68a9-b7d0-4350-9026-bfd78d52b6c0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:33.527682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4b9e68a9-b7d0-4350-9026-bfd78d52b6c0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:33.534192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b9e68a9-b7d0-4350-9026-bfd78d52b6c0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:33.535232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b9e68a9-b7d0-4350-9026-bfd78d52b6c0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:33.535849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b9e68a9-b7d0-4350-9026-bfd78d52b6c0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:33.536743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b9e68a9-b7d0-4350-9026-bfd78d52b6c0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:33.537568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b9e68a9-b7d0-4350-9026-bfd78d52b6c0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:33.538594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b9e68a9-b7d0-4350-9026-bfd78d52b6c0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:33.540234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-7d771a6d-4e01-4b4b-8079-d51494614d34 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Getting quotas for project 5cabe09fe1ba4124ba5e963feed67f01. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:33.548609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-7d771a6d-4e01-4b4b-8079-d51494614d34 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Getting quotas for user 2767b44077b0480cbee4bb038d58f90b and project 5cabe09fe1ba4124ba5e963feed67f01. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:33.733969 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7d771a6d-4e01-4b4b-8079-d51494614d34 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] 10.222.0.50 "PUT /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.267771 Oct 24 10:29:33.734714 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 761/1448] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:29:33 2022] PUT /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata => generated 61 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:29:33.740052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a0ba97a6-f781-4591-8266-4838491523e9 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:33.741175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a0ba97a6-f781-4591-8266-4838491523e9 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:33.752521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0ba97a6-f781-4591-8266-4838491523e9 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:33.753430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0ba97a6-f781-4591-8266-4838491523e9 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:33.754094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0ba97a6-f781-4591-8266-4838491523e9 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:33.755032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0ba97a6-f781-4591-8266-4838491523e9 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:33.755874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0ba97a6-f781-4591-8266-4838491523e9 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:33.756574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0ba97a6-f781-4591-8266-4838491523e9 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:33.885713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-a0ba97a6-f781-4591-8266-4838491523e9 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:33.910545 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a0ba97a6-f781-4591-8266-4838491523e9 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.174036 Oct 24 10:29:33.932984 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 762/1449] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:33 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:33.935094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-be11f26a-dc69-47f7-8d51-1fdbb6a1dab1 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Calling method '.version_select at 0x7f04d0efd670>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:33.943544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4b9e68a9-b7d0-4350-9026-bfd78d52b6c0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:33.953375 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4b9e68a9-b7d0-4350-9026-bfd78d52b6c0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1474 microversion: 2.1 time: 0.431113 Oct 24 10:29:33.953968 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 688/1450] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:33 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1474 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:33.961713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6e08c749-8b50-4e09-b3fe-36d9e571f272 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:33.962344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6e08c749-8b50-4e09-b3fe-36d9e571f272 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:33.973125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e08c749-8b50-4e09-b3fe-36d9e571f272 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:33.973626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e08c749-8b50-4e09-b3fe-36d9e571f272 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:33.974068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e08c749-8b50-4e09-b3fe-36d9e571f272 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:33.974785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e08c749-8b50-4e09-b3fe-36d9e571f272 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:33.975243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e08c749-8b50-4e09-b3fe-36d9e571f272 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:33.975671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e08c749-8b50-4e09-b3fe-36d9e571f272 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:34.005634 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-be11f26a-dc69-47f7-8d51-1fdbb6a1dab1 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] 10.222.0.50 "GET /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.076301 Oct 24 10:29:34.006216 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 763/1451] 10.222.0.50 () {58 vars in 1260 bytes} [Mon Oct 24 10:29:33 2022] GET /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata => generated 61 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:29:34.017363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b8a6ec9e-37a6-4562-b26a-e3e7b23f73e0 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Action: 'update_all', calling method: .version_select at 0x7f04d0f39040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:34.097697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-b8a6ec9e-37a6-4562-b26a-e3e7b23f73e0 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Getting quotas for project 5cabe09fe1ba4124ba5e963feed67f01. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:34.108205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-b8a6ec9e-37a6-4562-b26a-e3e7b23f73e0 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Getting quotas for user 2767b44077b0480cbee4bb038d58f90b and project 5cabe09fe1ba4124ba5e963feed67f01. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:34.347869 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b8a6ec9e-37a6-4562-b26a-e3e7b23f73e0 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] 10.222.0.50 "PUT /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.334089 Oct 24 10:29:34.352931 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 764/1452] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:29:34 2022] PUT /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata => generated 61 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:29:34.365638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cb0f5609-10b6-4aff-8c28-5c6b4136b269 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Action: 'update_all', calling method: .version_select at 0x7f04d085f160>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:34.447002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-cb0f5609-10b6-4aff-8c28-5c6b4136b269 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Getting quotas for project 5cabe09fe1ba4124ba5e963feed67f01. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:34.454097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-cb0f5609-10b6-4aff-8c28-5c6b4136b269 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Getting quotas for user 2767b44077b0480cbee4bb038d58f90b and project 5cabe09fe1ba4124ba5e963feed67f01. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:34.742378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6e08c749-8b50-4e09-b3fe-36d9e571f272 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:34.755925 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6e08c749-8b50-4e09-b3fe-36d9e571f272 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1317 microversion: 2.1 time: 0.800881 Oct 24 10:29:34.772858 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 689/1453] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:33 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1317 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:34.774911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1911c1c9-31a5-4e78-bb06-4c62c4d085ea tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:34.779499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1911c1c9-31a5-4e78-bb06-4c62c4d085ea tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:34.782446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1911c1c9-31a5-4e78-bb06-4c62c4d085ea tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:34.782948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1911c1c9-31a5-4e78-bb06-4c62c4d085ea tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:34.783394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1911c1c9-31a5-4e78-bb06-4c62c4d085ea tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:34.789612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1911c1c9-31a5-4e78-bb06-4c62c4d085ea tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:34.790316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1911c1c9-31a5-4e78-bb06-4c62c4d085ea tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:34.790982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1911c1c9-31a5-4e78-bb06-4c62c4d085ea tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:35.085949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1911c1c9-31a5-4e78-bb06-4c62c4d085ea tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:35.096371 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cb0f5609-10b6-4aff-8c28-5c6b4136b269 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] 10.222.0.50 "PUT /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata" status: 200 len: 64 microversion: 2.1 time: 0.737571 Oct 24 10:29:35.098260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1911c1c9-31a5-4e78-bb06-4c62c4d085ea tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:35.099730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1911c1c9-31a5-4e78-bb06-4c62c4d085ea tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:35.102170 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 765/1454] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:29:34 2022] PUT /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata => generated 64 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:29:35.105048 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1911c1c9-31a5-4e78-bb06-4c62c4d085ea tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1409 microversion: 2.25 time: 0.336920 Oct 24 10:29:35.106124 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 690/1455] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:34 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1409 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:35.118922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-20241d3b-3bc3-4170-9ffd-353f563f8eac tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0b29790>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:35.125641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9e296ac9-48b5-41eb-96a5-6192c04ec08b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:35.127597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9e296ac9-48b5-41eb-96a5-6192c04ec08b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:35.151659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e296ac9-48b5-41eb-96a5-6192c04ec08b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:35.152172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e296ac9-48b5-41eb-96a5-6192c04ec08b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:35.152604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e296ac9-48b5-41eb-96a5-6192c04ec08b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:35.157045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e296ac9-48b5-41eb-96a5-6192c04ec08b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:35.157602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e296ac9-48b5-41eb-96a5-6192c04ec08b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:35.158061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e296ac9-48b5-41eb-96a5-6192c04ec08b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:35.236663 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-20241d3b-3bc3-4170-9ffd-353f563f8eac tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.129372 Oct 24 10:29:35.238595 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 691/1456] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:35 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:35.244632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9a30b47e-dda9-48dd-892f-0fac34a93b40 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:35.245569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9a30b47e-dda9-48dd-892f-0fac34a93b40 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:35.253296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a30b47e-dda9-48dd-892f-0fac34a93b40 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:35.254029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a30b47e-dda9-48dd-892f-0fac34a93b40 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:35.254674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a30b47e-dda9-48dd-892f-0fac34a93b40 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:35.255565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a30b47e-dda9-48dd-892f-0fac34a93b40 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:35.256392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a30b47e-dda9-48dd-892f-0fac34a93b40 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:35.257640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a30b47e-dda9-48dd-892f-0fac34a93b40 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:35.454403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-9a30b47e-dda9-48dd-892f-0fac34a93b40 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:35.479878 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9a30b47e-dda9-48dd-892f-0fac34a93b40 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.239972 Oct 24 10:29:35.490148 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 692/1457] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:35 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:35.510603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7bcb0b99-7a25-40f4-97d9-3e8a143fa008 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:35.511233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7bcb0b99-7a25-40f4-97d9-3e8a143fa008 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:35.519596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bcb0b99-7a25-40f4-97d9-3e8a143fa008 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:35.520369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bcb0b99-7a25-40f4-97d9-3e8a143fa008 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:35.521197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bcb0b99-7a25-40f4-97d9-3e8a143fa008 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:35.523893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bcb0b99-7a25-40f4-97d9-3e8a143fa008 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:35.524685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bcb0b99-7a25-40f4-97d9-3e8a143fa008 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:35.526529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bcb0b99-7a25-40f4-97d9-3e8a143fa008 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:35.557283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9e296ac9-48b5-41eb-96a5-6192c04ec08b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:35.579386 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9e296ac9-48b5-41eb-96a5-6192c04ec08b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.475908 Oct 24 10:29:35.597669 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 766/1458] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:35 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:35.604100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-85e58704-310c-41b9-930b-32c2a29d0aff tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Calling method '.version_select at 0x7f04d0efdca0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:35.658818 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-85e58704-310c-41b9-930b-32c2a29d0aff tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] 10.222.0.50 "GET /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata" status: 200 len: 64 microversion: 2.1 time: 0.059276 Oct 24 10:29:35.659951 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 767/1459] 10.222.0.50 () {58 vars in 1260 bytes} [Mon Oct 24 10:29:35 2022] GET /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata => generated 64 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:29:35.672445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e4f9d12e-b91d-4442-8b7e-7a18caf5e1c5 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Action: 'update_all', calling method: .version_select at 0x7f04d0ca78b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:35.735356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=39 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:35.738926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-e4f9d12e-b91d-4442-8b7e-7a18caf5e1c5 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Getting quotas for project 5cabe09fe1ba4124ba5e963feed67f01. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:35.746871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-e4f9d12e-b91d-4442-8b7e-7a18caf5e1c5 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Getting quotas for user 2767b44077b0480cbee4bb038d58f90b and project 5cabe09fe1ba4124ba5e963feed67f01. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:35.831146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7bcb0b99-7a25-40f4-97d9-3e8a143fa008 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:35.852191 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7bcb0b99-7a25-40f4-97d9-3e8a143fa008 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1471 microversion: 2.1 time: 0.360619 Oct 24 10:29:35.852778 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 693/1460] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:35 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1471 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:35.871624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b38612cb-d7ad-4179-b170-d5b2f9e4e94c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:35.872242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b38612cb-d7ad-4179-b170-d5b2f9e4e94c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:35.880279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b38612cb-d7ad-4179-b170-d5b2f9e4e94c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:35.881318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b38612cb-d7ad-4179-b170-d5b2f9e4e94c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:35.881484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b38612cb-d7ad-4179-b170-d5b2f9e4e94c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:35.883053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b38612cb-d7ad-4179-b170-d5b2f9e4e94c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:35.883948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b38612cb-d7ad-4179-b170-d5b2f9e4e94c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:35.884553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b38612cb-d7ad-4179-b170-d5b2f9e4e94c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:36.230992 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e4f9d12e-b91d-4442-8b7e-7a18caf5e1c5 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] 10.222.0.50 "PUT /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.563067 Oct 24 10:29:36.231608 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 768/1461] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:29:35 2022] PUT /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata => generated 61 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 10:29:36.238071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-3a91f88b-9683-48ca-b695-84a8d99cb40a req-f6ffd8b3-3a8c-4c06-a665-8402787a95a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785efa4b-0de5-42e3-9310-ffd0f6a23a10", "tag": "c67b6a2d-14b0-4c1f-8c0e-3a2e6db0f440"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:36.252038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3a91f88b-9683-48ca-b695-84a8d99cb40a req-f6ffd8b3-3a8c-4c06-a665-8402787a95a5 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:36.252780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3a91f88b-9683-48ca-b695-84a8d99cb40a req-f6ffd8b3-3a8c-4c06-a665-8402787a95a5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:36.253482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3a91f88b-9683-48ca-b695-84a8d99cb40a req-f6ffd8b3-3a8c-4c06-a665-8402787a95a5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:36.266733 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-3a91f88b-9683-48ca-b695-84a8d99cb40a req-f6ffd8b3-3a8c-4c06-a665-8402787a95a5 service nova] Creating event network-changed:c67b6a2d-14b0-4c1f-8c0e-3a2e6db0f440 for instance 785efa4b-0de5-42e3-9310-ffd0f6a23a10 on n-h1-858383-15 Oct 24 10:29:36.272866 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-3a91f88b-9683-48ca-b695-84a8d99cb40a req-f6ffd8b3-3a8c-4c06-a665-8402787a95a5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039117 Oct 24 10:29:36.274021 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 769/1462] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:36.274765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b38612cb-d7ad-4179-b170-d5b2f9e4e94c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:36.280659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fe17552f-5d3a-41bd-bd21-07a594c4912f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:36.282718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fe17552f-5d3a-41bd-bd21-07a594c4912f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:36.283670 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b38612cb-d7ad-4179-b170-d5b2f9e4e94c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1317 microversion: 2.1 time: 0.419702 Oct 24 10:29:36.291567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe17552f-5d3a-41bd-bd21-07a594c4912f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:36.292065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe17552f-5d3a-41bd-bd21-07a594c4912f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:36.292514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe17552f-5d3a-41bd-bd21-07a594c4912f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:36.293421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe17552f-5d3a-41bd-bd21-07a594c4912f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:36.294091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe17552f-5d3a-41bd-bd21-07a594c4912f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:36.294690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe17552f-5d3a-41bd-bd21-07a594c4912f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:36.299915 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 694/1463] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:35 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1317 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:36.307698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d42a25a1-dfdd-4651-a9ee-53601e6d2ead tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:36.308604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d42a25a1-dfdd-4651-a9ee-53601e6d2ead tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:36.315812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42a25a1-dfdd-4651-a9ee-53601e6d2ead tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:36.317030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42a25a1-dfdd-4651-a9ee-53601e6d2ead tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:36.318798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42a25a1-dfdd-4651-a9ee-53601e6d2ead tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:36.320326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42a25a1-dfdd-4651-a9ee-53601e6d2ead tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:36.321304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42a25a1-dfdd-4651-a9ee-53601e6d2ead tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:36.321958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42a25a1-dfdd-4651-a9ee-53601e6d2ead tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:36.482163 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fe17552f-5d3a-41bd-bd21-07a594c4912f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "POST /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773/action" status: 202 len: 0 microversion: 2.1 time: 0.206291 Oct 24 10:29:36.482790 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 770/1464] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:29:36 2022] POST /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:29:36.497092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7aff11b5-b043-4b52-ab65-c15506a1b89f tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Action: 'update', calling method: .version_select at 0x7f04d12209d0>, body: {"meta": {"os_version": "alt"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:36.586964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-7aff11b5-b043-4b52-ab65-c15506a1b89f tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Getting quotas for project 5cabe09fe1ba4124ba5e963feed67f01. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:36.592927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-7aff11b5-b043-4b52-ab65-c15506a1b89f tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Getting quotas for user 2767b44077b0480cbee4bb038d58f90b and project 5cabe09fe1ba4124ba5e963feed67f01. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:36.607170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d42a25a1-dfdd-4651-a9ee-53601e6d2ead tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:36.615478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d42a25a1-dfdd-4651-a9ee-53601e6d2ead tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:36.622271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d42a25a1-dfdd-4651-a9ee-53601e6d2ead tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:36.623536 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d42a25a1-dfdd-4651-a9ee-53601e6d2ead tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1409 microversion: 2.25 time: 0.322287 Oct 24 10:29:36.624131 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 695/1465] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:36 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1409 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:36.636712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a2e5e2f6-9576-45ee-b64e-3e02777a8ad4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0abc5e0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:36.707623 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a2e5e2f6-9576-45ee-b64e-3e02777a8ad4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.075725 Oct 24 10:29:36.708472 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 696/1466] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:36 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:36.718877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3dc2eb1b-d2da-434f-9265-31c04ca85839 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:36.719493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3dc2eb1b-d2da-434f-9265-31c04ca85839 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:36.733881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dc2eb1b-d2da-434f-9265-31c04ca85839 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:36.734706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dc2eb1b-d2da-434f-9265-31c04ca85839 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:36.737628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dc2eb1b-d2da-434f-9265-31c04ca85839 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:36.740381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dc2eb1b-d2da-434f-9265-31c04ca85839 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:36.741498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dc2eb1b-d2da-434f-9265-31c04ca85839 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:36.741956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dc2eb1b-d2da-434f-9265-31c04ca85839 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:36.971692 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7aff11b5-b043-4b52-ab65-c15506a1b89f tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] 10.222.0.50 "PUT /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.480649 Oct 24 10:29:36.973488 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 771/1467] 10.222.0.50 () {60 vars in 1313 bytes} [Mon Oct 24 10:29:36 2022] PUT /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata/os_version => generated 31 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:29:36.981373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4d0d4739-dcd6-4175-b4cc-587b090ae0aa tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:36.983912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4d0d4739-dcd6-4175-b4cc-587b090ae0aa tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:36.996688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d0d4739-dcd6-4175-b4cc-587b090ae0aa tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:36.997867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d0d4739-dcd6-4175-b4cc-587b090ae0aa tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:36.998518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d0d4739-dcd6-4175-b4cc-587b090ae0aa tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:36.999370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d0d4739-dcd6-4175-b4cc-587b090ae0aa tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:36.999836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d0d4739-dcd6-4175-b4cc-587b090ae0aa tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:37.000348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d0d4739-dcd6-4175-b4cc-587b090ae0aa tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:37.045347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3dc2eb1b-d2da-434f-9265-31c04ca85839 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:37.061730 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3dc2eb1b-d2da-434f-9265-31c04ca85839 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1470 microversion: 2.1 time: 0.345457 Oct 24 10:29:37.062531 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 697/1468] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:36 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1470 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:37.068284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0229b76c-0c68-4e82-866a-1a7003f53a45 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:37.069549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0229b76c-0c68-4e82-866a-1a7003f53a45 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:37.082909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0229b76c-0c68-4e82-866a-1a7003f53a45 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:37.083928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0229b76c-0c68-4e82-866a-1a7003f53a45 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:37.084723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0229b76c-0c68-4e82-866a-1a7003f53a45 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:37.086425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0229b76c-0c68-4e82-866a-1a7003f53a45 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:37.087235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0229b76c-0c68-4e82-866a-1a7003f53a45 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:37.087892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0229b76c-0c68-4e82-866a-1a7003f53a45 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:37.171689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-4d0d4739-dcd6-4175-b4cc-587b090ae0aa tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:37.190031 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4d0d4739-dcd6-4175-b4cc-587b090ae0aa tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.214584 Oct 24 10:29:37.190812 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 772/1469] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:36 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:37.196184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a1d04647-abff-4e39-a968-64be53d43f5f tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Calling method '.version_select at 0x7f04d085fee0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:37.252666 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a1d04647-abff-4e39-a968-64be53d43f5f tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] 10.222.0.50 "GET /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata" status: 200 len: 58 microversion: 2.1 time: 0.060800 Oct 24 10:29:37.254024 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 773/1470] 10.222.0.50 () {58 vars in 1260 bytes} [Mon Oct 24 10:29:37 2022] GET /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata => generated 58 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:29:37.265343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-ffe8a034-de3a-4f48-bf89-95de5a6b6ec9 req-cff67f51-9276-4011-ae74-b02d5ba576ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a43af20e-f775-4549-9ee3-1560a5b43b7d", "name": "network-vif-plugged", "status": "completed", "tag": "540ebdb6-65eb-4451-aafd-a3f1d1fd0a82"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:37.278367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ffe8a034-de3a-4f48-bf89-95de5a6b6ec9 req-cff67f51-9276-4011-ae74-b02d5ba576ee service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:37.279091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ffe8a034-de3a-4f48-bf89-95de5a6b6ec9 req-cff67f51-9276-4011-ae74-b02d5ba576ee service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:37.279891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ffe8a034-de3a-4f48-bf89-95de5a6b6ec9 req-cff67f51-9276-4011-ae74-b02d5ba576ee service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:37.295228 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ffe8a034-de3a-4f48-bf89-95de5a6b6ec9 req-cff67f51-9276-4011-ae74-b02d5ba576ee service nova] Creating event network-vif-plugged:540ebdb6-65eb-4451-aafd-a3f1d1fd0a82 for instance a43af20e-f775-4549-9ee3-1560a5b43b7d on n-h1-858383-15 Oct 24 10:29:37.300494 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-ffe8a034-de3a-4f48-bf89-95de5a6b6ec9 req-cff67f51-9276-4011-ae74-b02d5ba576ee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038655 Oct 24 10:29:37.304407 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 774/1471] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:37.310037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0cec1804-e4b6-4f76-ba82-088472a77b7f tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Action: 'update_all', calling method: .version_select at 0x7f04d1220280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:37.367995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-0cec1804-e4b6-4f76-ba82-088472a77b7f tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Getting quotas for project 5cabe09fe1ba4124ba5e963feed67f01. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:37.374973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-0cec1804-e4b6-4f76-ba82-088472a77b7f tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Getting quotas for user 2767b44077b0480cbee4bb038d58f90b and project 5cabe09fe1ba4124ba5e963feed67f01. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:37.375396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0229b76c-0c68-4e82-866a-1a7003f53a45 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:37.392888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:37.420034 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0229b76c-0c68-4e82-866a-1a7003f53a45 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.356220 Oct 24 10:29:37.426468 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 698/1472] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:37 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:37.436203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-198047c6-8700-4850-939a-93b840a426dd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:37.441082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-198047c6-8700-4850-939a-93b840a426dd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:37.456647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-198047c6-8700-4850-939a-93b840a426dd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:37.457311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-198047c6-8700-4850-939a-93b840a426dd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:37.461572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-198047c6-8700-4850-939a-93b840a426dd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:37.462679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-198047c6-8700-4850-939a-93b840a426dd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:37.463362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-198047c6-8700-4850-939a-93b840a426dd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:37.464231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-198047c6-8700-4850-939a-93b840a426dd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:37.724074 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0cec1804-e4b6-4f76-ba82-088472a77b7f tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] 10.222.0.50 "PUT /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.418299 Oct 24 10:29:37.725851 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 775/1473] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:29:37 2022] PUT /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata => generated 61 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:29:37.732597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e34bc40-3a6a-4738-bf73-5ecdbde763cd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:37.734283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3e34bc40-3a6a-4738-bf73-5ecdbde763cd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:37.746880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e34bc40-3a6a-4738-bf73-5ecdbde763cd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:37.747350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e34bc40-3a6a-4738-bf73-5ecdbde763cd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:37.747825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e34bc40-3a6a-4738-bf73-5ecdbde763cd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:37.748681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e34bc40-3a6a-4738-bf73-5ecdbde763cd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:37.749210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e34bc40-3a6a-4738-bf73-5ecdbde763cd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:37.749712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e34bc40-3a6a-4738-bf73-5ecdbde763cd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:37.846519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-198047c6-8700-4850-939a-93b840a426dd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:37.855251 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-198047c6-8700-4850-939a-93b840a426dd tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1317 microversion: 2.1 time: 0.425169 Oct 24 10:29:37.856474 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 699/1474] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:37 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:37.861408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-82d08560-e3d3-4db2-8b08-01edee16db6b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0b350d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:37.920363 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-82d08560-e3d3-4db2-8b08-01edee16db6b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.062379 Oct 24 10:29:37.921075 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 700/1475] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:37 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:37.928484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3e34bc40-3a6a-4738-bf73-5ecdbde763cd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:37.935696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3e34bc40-3a6a-4738-bf73-5ecdbde763cd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:37.936945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6e046719-72f1-4db3-bd21-5eec7e550102 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Action: 'create', calling method: .version_select at 0x7f04d0b0b8b0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:37.937431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3e34bc40-3a6a-4738-bf73-5ecdbde763cd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:37.938837 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3e34bc40-3a6a-4738-bf73-5ecdbde763cd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1409 microversion: 2.25 time: 0.211813 Oct 24 10:29:37.940916 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 776/1476] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:37 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1409 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:38.005133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-6e046719-72f1-4db3-bd21-5eec7e550102 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Getting quotas for project 5cabe09fe1ba4124ba5e963feed67f01. Resources: dict_keys(['metadata_items']) {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:38.008859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4c9d151d-016f-47cd-bdd0-b1478384236b tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Action: 'create', calling method: .version_select at 0x7f04d07f6040>, body: {"keypair": {"name": "tempest-keypair-291368310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZqIs+c/xJ2psHfWB5wkSqRTAqbt9firYch5KIXLCZUIgob5mZM6oJYmMpwIP+fmNVtJTF33JXHoCVlTa2UgaiBQ9esuSBQdwS8/t042Sm+lrEQVv/H+NM3BolBZnzZTw=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:38.010712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-6e046719-72f1-4db3-bd21-5eec7e550102 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Getting quotas for user 2767b44077b0480cbee4bb038d58f90b and project 5cabe09fe1ba4124ba5e963feed67f01. Resources: dict_keys(['metadata_items']) {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:38.025467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-4c9d151d-016f-47cd-bdd0-b1478384236b tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Getting quotas for project f78b0d6e2588499b8daf4607043f892d. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:38.030938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-4c9d151d-016f-47cd-bdd0-b1478384236b tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Getting quotas for user 6f2788374fc24904a24a485432028c17 and project f78b0d6e2588499b8daf4607043f892d. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:38.057874 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4c9d151d-016f-47cd-bdd0-b1478384236b tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.115108 Oct 24 10:29:38.058561 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 777/1477] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:29:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:38.099969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6595b239-69a4-465c-896a-095b508b29bc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:38.100667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6595b239-69a4-465c-896a-095b508b29bc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:38.108643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6595b239-69a4-465c-896a-095b508b29bc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:38.114187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6595b239-69a4-465c-896a-095b508b29bc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:38.117640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6595b239-69a4-465c-896a-095b508b29bc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:38.120199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6595b239-69a4-465c-896a-095b508b29bc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:38.121550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6595b239-69a4-465c-896a-095b508b29bc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:38.122633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6595b239-69a4-465c-896a-095b508b29bc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:38.369198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6595b239-69a4-465c-896a-095b508b29bc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:38.386751 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6595b239-69a4-465c-896a-095b508b29bc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1470 microversion: 2.1 time: 0.290806 Oct 24 10:29:38.393323 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6e046719-72f1-4db3-bd21-5eec7e550102 tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] 10.222.0.50 "POST /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata" status: 200 len: 85 microversion: 2.1 time: 0.462259 Oct 24 10:29:38.393919 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 701/1478] 10.222.0.50 () {60 vars in 1281 bytes} [Mon Oct 24 10:29:37 2022] POST /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata => generated 85 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:29:38.399273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7f3c3a70-8b18-41ea-9576-2d8314cdb34c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:38.407048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7f3c3a70-8b18-41ea-9576-2d8314cdb34c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:38.407261 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 778/1479] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:38 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1470 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:38.407357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f3c3a70-8b18-41ea-9576-2d8314cdb34c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:38.407357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f3c3a70-8b18-41ea-9576-2d8314cdb34c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:38.407357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f3c3a70-8b18-41ea-9576-2d8314cdb34c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:38.408052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f3c3a70-8b18-41ea-9576-2d8314cdb34c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:38.408969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f3c3a70-8b18-41ea-9576-2d8314cdb34c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:38.409537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f3c3a70-8b18-41ea-9576-2d8314cdb34c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:38.420977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-17117c74-a568-4868-853a-539a4ac5994c tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] Calling method '.version_select at 0x7f04d07f68b0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:38.492268 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-17117c74-a568-4868-853a-539a4ac5994c tempest-ImagesMetadataTestJSON-2073425160 tempest-ImagesMetadataTestJSON-2073425160-project] 10.222.0.50 "GET /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata" status: 200 len: 85 microversion: 2.1 time: 0.090313 Oct 24 10:29:38.492911 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 779/1480] 10.222.0.50 () {58 vars in 1260 bytes} [Mon Oct 24 10:29:38 2022] GET /compute/v2.1/images/7cf1b41e-2ac1-43d7-86a1-8964614153e1/metadata => generated 85 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:29:38.502616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8b98d220-a7e9-47e6-8340-827fb59020b3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:38.503234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8b98d220-a7e9-47e6-8340-827fb59020b3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:38.510241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b98d220-a7e9-47e6-8340-827fb59020b3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:38.510726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b98d220-a7e9-47e6-8340-827fb59020b3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:38.511372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b98d220-a7e9-47e6-8340-827fb59020b3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:38.513125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b98d220-a7e9-47e6-8340-827fb59020b3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:38.513749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b98d220-a7e9-47e6-8340-827fb59020b3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:38.514335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b98d220-a7e9-47e6-8340-827fb59020b3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:38.597721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-7f3c3a70-8b18-41ea-9576-2d8314cdb34c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:38.618527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:38.620485 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7f3c3a70-8b18-41ea-9576-2d8314cdb34c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.225613 Oct 24 10:29:38.621711 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 702/1481] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:38 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:38.886087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d8e58670-6252-4211-81ac-636a8f5b13f2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:38.886749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d8e58670-6252-4211-81ac-636a8f5b13f2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:38.917668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8e58670-6252-4211-81ac-636a8f5b13f2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:38.919340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8e58670-6252-4211-81ac-636a8f5b13f2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:38.921245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8e58670-6252-4211-81ac-636a8f5b13f2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:38.921807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8b98d220-a7e9-47e6-8340-827fb59020b3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:38.922875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8e58670-6252-4211-81ac-636a8f5b13f2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:38.928530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8e58670-6252-4211-81ac-636a8f5b13f2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:38.933193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8e58670-6252-4211-81ac-636a8f5b13f2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:38.939493 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8b98d220-a7e9-47e6-8340-827fb59020b3 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.444255 Oct 24 10:29:38.941366 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 780/1482] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:38 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:38.957533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-960cfeaa-6995-4f6c-a44a-b99e56569cc6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0cc0670>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:38.966178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:39.073957 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-960cfeaa-6995-4f6c-a44a-b99e56569cc6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.131057 Oct 24 10:29:39.086177 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 781/1483] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:38 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:39.094072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a0ddc766-a5ea-43cb-9acc-00eb4b7ded3e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:39.100707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a0ddc766-a5ea-43cb-9acc-00eb4b7ded3e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:39.142280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0ddc766-a5ea-43cb-9acc-00eb4b7ded3e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:39.143915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0ddc766-a5ea-43cb-9acc-00eb4b7ded3e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:39.145387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0ddc766-a5ea-43cb-9acc-00eb4b7ded3e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:39.146301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0ddc766-a5ea-43cb-9acc-00eb4b7ded3e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:39.146946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0ddc766-a5ea-43cb-9acc-00eb4b7ded3e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:39.149600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0ddc766-a5ea-43cb-9acc-00eb4b7ded3e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:39.323766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d8e58670-6252-4211-81ac-636a8f5b13f2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:39.334240 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d8e58670-6252-4211-81ac-636a8f5b13f2 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1317 microversion: 2.1 time: 0.455079 Oct 24 10:29:39.337164 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 703/1484] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:38 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:39.425010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-775786c5-ef6b-49cd-871d-cc2ce4ea4988 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:39.426596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-775786c5-ef6b-49cd-871d-cc2ce4ea4988 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:39.445807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-775786c5-ef6b-49cd-871d-cc2ce4ea4988 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:39.446444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-775786c5-ef6b-49cd-871d-cc2ce4ea4988 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:39.446902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-775786c5-ef6b-49cd-871d-cc2ce4ea4988 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:39.447646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-775786c5-ef6b-49cd-871d-cc2ce4ea4988 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:39.447773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a0ddc766-a5ea-43cb-9acc-00eb4b7ded3e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:39.448368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-775786c5-ef6b-49cd-871d-cc2ce4ea4988 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:39.448804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-775786c5-ef6b-49cd-871d-cc2ce4ea4988 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:39.463946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a0ddc766-a5ea-43cb-9acc-00eb4b7ded3e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:39.465564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a0ddc766-a5ea-43cb-9acc-00eb4b7ded3e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:39.466779 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a0ddc766-a5ea-43cb-9acc-00eb4b7ded3e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1606 microversion: 2.25 time: 0.377702 Oct 24 10:29:39.468175 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 782/1485] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:39 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1606 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:39.495183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-528f1515-fd56-4629-95a5-185538ba5687 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:39.495737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-528f1515-fd56-4629-95a5-185538ba5687 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:39.502336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-528f1515-fd56-4629-95a5-185538ba5687 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:39.502874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-528f1515-fd56-4629-95a5-185538ba5687 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:39.503490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-528f1515-fd56-4629-95a5-185538ba5687 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:39.504403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-528f1515-fd56-4629-95a5-185538ba5687 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:39.505097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-528f1515-fd56-4629-95a5-185538ba5687 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:39.505681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-528f1515-fd56-4629-95a5-185538ba5687 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:39.736863 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-528f1515-fd56-4629-95a5-185538ba5687 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.246938 Oct 24 10:29:39.737747 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 783/1486] 10.222.0.50 () {60 vars in 1316 bytes} [Mon Oct 24 10:29:39 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-interface => generated 285 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:29:39.751257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-58d4afce-54fe-47f6-a8c4-a7811b696683 req-d87d887a-b3f0-4925-bda2-2f91f25a926c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651e9e7c-ba1a-4472-b74e-3f14eb862773", "name": "network-vif-plugged", "status": "completed", "tag": "994f617f-bba6-456d-9bee-7c7fa6c5a409"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:39.764486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-58d4afce-54fe-47f6-a8c4-a7811b696683 req-d87d887a-b3f0-4925-bda2-2f91f25a926c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:39.765400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-58d4afce-54fe-47f6-a8c4-a7811b696683 req-d87d887a-b3f0-4925-bda2-2f91f25a926c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:39.766132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-58d4afce-54fe-47f6-a8c4-a7811b696683 req-d87d887a-b3f0-4925-bda2-2f91f25a926c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:39.781540 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-58d4afce-54fe-47f6-a8c4-a7811b696683 req-d87d887a-b3f0-4925-bda2-2f91f25a926c service nova] Creating event network-vif-plugged:994f617f-bba6-456d-9bee-7c7fa6c5a409 for instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 on n-h1-858383-15 Oct 24 10:29:39.788145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [req-58d4afce-54fe-47f6-a8c4-a7811b696683 req-d87d887a-b3f0-4925-bda2-2f91f25a926c service nova] Instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120426) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:29:39.805200 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-58d4afce-54fe-47f6-a8c4-a7811b696683 req-d87d887a-b3f0-4925-bda2-2f91f25a926c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056775 Oct 24 10:29:39.806187 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 784/1487] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:39.813010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fca29519-e690-4472-b7ec-4ccbaf20fdbb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:39.814149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fca29519-e690-4472-b7ec-4ccbaf20fdbb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:39.825705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fca29519-e690-4472-b7ec-4ccbaf20fdbb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:39.826911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fca29519-e690-4472-b7ec-4ccbaf20fdbb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:39.827575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fca29519-e690-4472-b7ec-4ccbaf20fdbb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:39.828536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fca29519-e690-4472-b7ec-4ccbaf20fdbb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:39.829231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fca29519-e690-4472-b7ec-4ccbaf20fdbb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:39.830603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fca29519-e690-4472-b7ec-4ccbaf20fdbb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:40.260229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-775786c5-ef6b-49cd-871d-cc2ce4ea4988 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:40.272050 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-775786c5-ef6b-49cd-871d-cc2ce4ea4988 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1470 microversion: 2.1 time: 0.852043 Oct 24 10:29:40.279846 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 704/1488] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:39 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1470 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:40.285079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-18b8c052-7306-4459-928e-677f05a76c7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:40.289947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-18b8c052-7306-4459-928e-677f05a76c7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:40.301260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18b8c052-7306-4459-928e-677f05a76c7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:40.302010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18b8c052-7306-4459-928e-677f05a76c7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:40.303870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18b8c052-7306-4459-928e-677f05a76c7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:40.309342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18b8c052-7306-4459-928e-677f05a76c7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:40.310172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18b8c052-7306-4459-928e-677f05a76c7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:40.311340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18b8c052-7306-4459-928e-677f05a76c7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:40.428770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-fca29519-e690-4472-b7ec-4ccbaf20fdbb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:40.468155 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fca29519-e690-4472-b7ec-4ccbaf20fdbb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.660217 Oct 24 10:29:40.469615 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 785/1489] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:39 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:40.474527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-913cae08-c238-4df4-a1d7-e5ed553f0091 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0ca7f70>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:40.566932 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-913cae08-c238-4df4-a1d7-e5ed553f0091 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.095828 Oct 24 10:29:40.567637 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 786/1490] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:40 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:40.574815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cefd9c04-a5db-41a0-abe5-e1d430b5c674 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:40.584437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cefd9c04-a5db-41a0-abe5-e1d430b5c674 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:40.599502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cefd9c04-a5db-41a0-abe5-e1d430b5c674 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:40.606165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cefd9c04-a5db-41a0-abe5-e1d430b5c674 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:40.608236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cefd9c04-a5db-41a0-abe5-e1d430b5c674 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:40.608847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cefd9c04-a5db-41a0-abe5-e1d430b5c674 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:40.609549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cefd9c04-a5db-41a0-abe5-e1d430b5c674 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:40.610500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cefd9c04-a5db-41a0-abe5-e1d430b5c674 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:40.751658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-18b8c052-7306-4459-928e-677f05a76c7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:40.765846 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-18b8c052-7306-4459-928e-677f05a76c7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.483700 Oct 24 10:29:40.767835 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 705/1491] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:40 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:40.955706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cefd9c04-a5db-41a0-abe5-e1d430b5c674 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:40.966845 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cefd9c04-a5db-41a0-abe5-e1d430b5c674 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1317 microversion: 2.1 time: 0.397895 Oct 24 10:29:40.968758 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 787/1492] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:40 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:41.303127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd6010f1-0f8d-47e3-87e6-636730074633 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:41.303739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bd6010f1-0f8d-47e3-87e6-636730074633 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:41.320636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd6010f1-0f8d-47e3-87e6-636730074633 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:41.321168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd6010f1-0f8d-47e3-87e6-636730074633 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:41.321601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd6010f1-0f8d-47e3-87e6-636730074633 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:41.322318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd6010f1-0f8d-47e3-87e6-636730074633 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:41.322773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd6010f1-0f8d-47e3-87e6-636730074633 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:41.323199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd6010f1-0f8d-47e3-87e6-636730074633 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:41.503700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5f1d11fe-2a5a-43ed-ae93-31686302e8f3 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:41.504341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5f1d11fe-2a5a-43ed-ae93-31686302e8f3 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:41.513867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f1d11fe-2a5a-43ed-ae93-31686302e8f3 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:41.545325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f1d11fe-2a5a-43ed-ae93-31686302e8f3 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:41.545810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f1d11fe-2a5a-43ed-ae93-31686302e8f3 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:41.546765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f1d11fe-2a5a-43ed-ae93-31686302e8f3 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:41.549675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f1d11fe-2a5a-43ed-ae93-31686302e8f3 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:41.550429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f1d11fe-2a5a-43ed-ae93-31686302e8f3 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:41.627705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:42.209945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-5f1d11fe-2a5a-43ed-ae93-31686302e8f3 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:42.275625 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5f1d11fe-2a5a-43ed-ae93-31686302e8f3 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.776036 Oct 24 10:29:42.278447 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 788/1493] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:41 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:42.293220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-67f4c146-aee5-4bfa-9838-d240c23e52c5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d08a1700>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:42.300440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bd6010f1-0f8d-47e3-87e6-636730074633 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:42.315605 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bd6010f1-0f8d-47e3-87e6-636730074633 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1470 microversion: 2.1 time: 1.014563 Oct 24 10:29:42.320225 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 706/1494] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:41 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1470 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:42.334985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5de2daed-ac4d-49ce-a178-9398eebefdf0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "1b14c1ae-47bb-44ae-9a83-fc8e6e6311af"}], "security_groups": [{"name": "tempest-securitygroup--690594708"}], "key_name": "tempest-keypair-291368310", "user_data": "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:42.556889 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-67f4c146-aee5-4bfa-9838-d240c23e52c5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.276980 Oct 24 10:29:42.557947 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 789/1495] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:42 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:42.571209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-89ba886e-5344-4ae3-929f-5c792b3d56bf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:42.582450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-89ba886e-5344-4ae3-929f-5c792b3d56bf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:42.600694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-89ba886e-5344-4ae3-929f-5c792b3d56bf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:42.609452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-89ba886e-5344-4ae3-929f-5c792b3d56bf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:42.610252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-89ba886e-5344-4ae3-929f-5c792b3d56bf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:42.611127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-89ba886e-5344-4ae3-929f-5c792b3d56bf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:42.611708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-89ba886e-5344-4ae3-929f-5c792b3d56bf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:42.612248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-89ba886e-5344-4ae3-929f-5c792b3d56bf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:43.070429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-5de2daed-ac4d-49ce-a178-9398eebefdf0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] validate_networks() for [('1b14c1ae-47bb-44ae-9a83-fc8e6e6311af', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:29:43.617902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-89ba886e-5344-4ae3-929f-5c792b3d56bf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:43.628611 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-89ba886e-5344-4ae3-929f-5c792b3d56bf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 1.068542 Oct 24 10:29:43.637516 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 790/1496] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:42 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:43.644244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eed86e0c-8dfe-4c10-aaab-969396d0e711 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:43.660453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-eed86e0c-8dfe-4c10-aaab-969396d0e711 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:43.676312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eed86e0c-8dfe-4c10-aaab-969396d0e711 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:43.677101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eed86e0c-8dfe-4c10-aaab-969396d0e711 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:43.681533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eed86e0c-8dfe-4c10-aaab-969396d0e711 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:43.683292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eed86e0c-8dfe-4c10-aaab-969396d0e711 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:43.684018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eed86e0c-8dfe-4c10-aaab-969396d0e711 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:43.684698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eed86e0c-8dfe-4c10-aaab-969396d0e711 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:43.978070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-eed86e0c-8dfe-4c10-aaab-969396d0e711 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:43.989941 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-eed86e0c-8dfe-4c10-aaab-969396d0e711 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1317 microversion: 2.1 time: 0.348994 Oct 24 10:29:44.012582 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 791/1497] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:43 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:44.207820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5de2daed-ac4d-49ce-a178-9398eebefdf0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:29:44.209047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5de2daed-ac4d-49ce-a178-9398eebefdf0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:29:44.209716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5de2daed-ac4d-49ce-a178-9398eebefdf0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:29:44.210560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5de2daed-ac4d-49ce-a178-9398eebefdf0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:29:44.211124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5de2daed-ac4d-49ce-a178-9398eebefdf0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:29:44.223574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5de2daed-ac4d-49ce-a178-9398eebefdf0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:44.224239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5de2daed-ac4d-49ce-a178-9398eebefdf0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:44.224856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5de2daed-ac4d-49ce-a178-9398eebefdf0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:44.225757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5de2daed-ac4d-49ce-a178-9398eebefdf0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:44.227234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5de2daed-ac4d-49ce-a178-9398eebefdf0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:44.228047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5de2daed-ac4d-49ce-a178-9398eebefdf0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:44.254434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-5de2daed-ac4d-49ce-a178-9398eebefdf0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Getting quotas for project f78b0d6e2588499b8daf4607043f892d. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:44.262070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-5de2daed-ac4d-49ce-a178-9398eebefdf0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Getting quotas for user 6f2788374fc24904a24a485432028c17 and project f78b0d6e2588499b8daf4607043f892d. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:44.281402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5de2daed-ac4d-49ce-a178-9398eebefdf0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:29:44.284284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5de2daed-ac4d-49ce-a178-9398eebefdf0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:29:44.329931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3de91602-d2c9-4e69-9d3a-277e28706e9d tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Action: 'create', calling method: .version_select at 0x7f04d0efd670>, body: {"keypair": {"name": "tempest-keypair-1000520521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKZMXOJ4rk432mfDl5y0BLtrVX1x1o0OQCH5gUwIDbbXdv7o2RCihdMwjym5o75a4dPdbQC56Mf2bmNGoojUut7FwDLRKRDREVEvergUwLFGMtuKG3M07bcGkppUAnsXA=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:44.385639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-3de91602-d2c9-4e69-9d3a-277e28706e9d tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Getting quotas for project 5590a778aa374e188549c755f9fdad3a. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:44.408040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-3de91602-d2c9-4e69-9d3a-277e28706e9d tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Getting quotas for user e3c8251bdcfb43ccad51d0d95dee5111 and project 5590a778aa374e188549c755f9fdad3a. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:44.423841 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5de2daed-ac4d-49ce-a178-9398eebefdf0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.094167 Oct 24 10:29:44.428259 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 707/1498] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:29:42 2022] POST /compute/v2.1/servers => generated 408 bytes in 2107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:29:44.495739 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3de91602-d2c9-4e69-9d3a-277e28706e9d tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.479894 Oct 24 10:29:44.499798 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 792/1499] 10.222.0.50 () {62 vars in 1199 bytes} [Mon Oct 24 10:29:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 486 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 24 10:29:44.519299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-27628337-8b7b-4d2d-b375-2f084bfd8822 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:44.528883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-27628337-8b7b-4d2d-b375-2f084bfd8822 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:44.558931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27628337-8b7b-4d2d-b375-2f084bfd8822 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:44.559503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27628337-8b7b-4d2d-b375-2f084bfd8822 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:44.559963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27628337-8b7b-4d2d-b375-2f084bfd8822 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:44.565790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27628337-8b7b-4d2d-b375-2f084bfd8822 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:44.566356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27628337-8b7b-4d2d-b375-2f084bfd8822 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:44.566811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27628337-8b7b-4d2d-b375-2f084bfd8822 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:44.614068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-958bdc50-cf9c-4fc2-a92c-a6a221e44ec2 req-82628a0d-374c-4670-a58f-e279f3c99b11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e4585f-945b-462a-aac7-5a7af22f160d", "tag": "37825a2f-34ee-4e53-ae99-2a22e0da2d1b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:44.671571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-958bdc50-cf9c-4fc2-a92c-a6a221e44ec2 req-82628a0d-374c-4670-a58f-e279f3c99b11 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:44.672404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-958bdc50-cf9c-4fc2-a92c-a6a221e44ec2 req-82628a0d-374c-4670-a58f-e279f3c99b11 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:44.673183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-958bdc50-cf9c-4fc2-a92c-a6a221e44ec2 req-82628a0d-374c-4670-a58f-e279f3c99b11 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:44.729476 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-958bdc50-cf9c-4fc2-a92c-a6a221e44ec2 req-82628a0d-374c-4670-a58f-e279f3c99b11 service nova] Creating event network-changed:37825a2f-34ee-4e53-ae99-2a22e0da2d1b for instance 07e4585f-945b-462a-aac7-5a7af22f160d on n-h1-858383-15 Oct 24 10:29:44.747975 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-958bdc50-cf9c-4fc2-a92c-a6a221e44ec2 req-82628a0d-374c-4670-a58f-e279f3c99b11 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.314571 Oct 24 10:29:44.749732 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 708/1500] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:44.763205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8d56e8b1-9f82-4159-b84f-f5dc608bd78d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:44.769322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8d56e8b1-9f82-4159-b84f-f5dc608bd78d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:44.786731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d56e8b1-9f82-4159-b84f-f5dc608bd78d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:44.790746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d56e8b1-9f82-4159-b84f-f5dc608bd78d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:44.792647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d56e8b1-9f82-4159-b84f-f5dc608bd78d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:44.794365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d56e8b1-9f82-4159-b84f-f5dc608bd78d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:44.795943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d56e8b1-9f82-4159-b84f-f5dc608bd78d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:44.797870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d56e8b1-9f82-4159-b84f-f5dc608bd78d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:44.814426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-27628337-8b7b-4d2d-b375-2f084bfd8822 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:44.892446 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-27628337-8b7b-4d2d-b375-2f084bfd8822 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.391098 Oct 24 10:29:44.907959 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 793/1501] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:44 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:44.907959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f5371627-bb3d-425c-aa5d-360accf52172 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d1220f70>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:45.037186 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f5371627-bb3d-425c-aa5d-360accf52172 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.138870 Oct 24 10:29:45.037783 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 794/1502] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:44 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:45.049580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-115641cc-3a7b-4e81-8a6d-42fbe610d0b9 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:45.051191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-115641cc-3a7b-4e81-8a6d-42fbe610d0b9 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:45.199129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-115641cc-3a7b-4e81-8a6d-42fbe610d0b9 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:45.220179 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-115641cc-3a7b-4e81-8a6d-42fbe610d0b9 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1225 microversion: 2.1 time: 0.177194 Oct 24 10:29:45.232867 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 795/1503] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:45 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1225 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:45.238420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7a5b5423-1d80-4eb3-b2a2-c3acfcdbf533 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Calling method '.version_select at 0x7f04d085f8b0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:45.271695 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7a5b5423-1d80-4eb3-b2a2-c3acfcdbf533 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-1000520521" status: 200 len: 512 microversion: 2.2 time: 0.048514 Oct 24 10:29:45.280395 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 796/1504] 10.222.0.50 () {60 vars in 1258 bytes} [Mon Oct 24 10:29:45 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1000520521 => generated 512 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:45.284582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8d56e8b1-9f82-4159-b84f-f5dc608bd78d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:45.297561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-888d86ce-fed1-4f94-aaf8-4c3d7294a94d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:45.297957 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8d56e8b1-9f82-4159-b84f-f5dc608bd78d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1470 microversion: 2.1 time: 0.543533 Oct 24 10:29:45.300218 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 709/1505] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:44 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1470 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:45.301704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-888d86ce-fed1-4f94-aaf8-4c3d7294a94d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:45.309677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33d28c64-a010-4e2c-853d-5a65128d550c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:45.314091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-33d28c64-a010-4e2c-853d-5a65128d550c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:45.325846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-888d86ce-fed1-4f94-aaf8-4c3d7294a94d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:45.326972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-888d86ce-fed1-4f94-aaf8-4c3d7294a94d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:45.327650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-888d86ce-fed1-4f94-aaf8-4c3d7294a94d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:45.328623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-888d86ce-fed1-4f94-aaf8-4c3d7294a94d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:45.332009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-888d86ce-fed1-4f94-aaf8-4c3d7294a94d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:45.333943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-888d86ce-fed1-4f94-aaf8-4c3d7294a94d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:45.336350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33d28c64-a010-4e2c-853d-5a65128d550c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:45.339153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33d28c64-a010-4e2c-853d-5a65128d550c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:45.339854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33d28c64-a010-4e2c-853d-5a65128d550c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:45.342464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33d28c64-a010-4e2c-853d-5a65128d550c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:45.345364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33d28c64-a010-4e2c-853d-5a65128d550c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:45.346134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33d28c64-a010-4e2c-853d-5a65128d550c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:45.739066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-888d86ce-fed1-4f94-aaf8-4c3d7294a94d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:45.754002 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-888d86ce-fed1-4f94-aaf8-4c3d7294a94d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.478752 Oct 24 10:29:45.756421 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 797/1506] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:45 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:45.788074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e3ebeabf-fc63-489c-a7d3-efbcac93b0ee tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Calling method '.version_select at 0x7f04d08a13a0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:45.844365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-33d28c64-a010-4e2c-853d-5a65128d550c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:45.862952 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-33d28c64-a010-4e2c-853d-5a65128d550c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1317 microversion: 2.1 time: 0.561240 Oct 24 10:29:45.865522 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 710/1507] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:45 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:45.886810 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e3ebeabf-fc63-489c-a7d3-efbcac93b0ee tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1000520521" status: 204 len: 0 microversion: 2.2 time: 0.115804 Oct 24 10:29:45.887671 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 798/1508] 10.222.0.50 () {60 vars in 1261 bytes} [Mon Oct 24 10:29:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1000520521 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:45.903085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-069a0253-ff3d-4c19-9d66-3335b29814cf tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Action: 'create', calling method: .version_select at 0x7f04d0aa3310>, body: {"keypair": {"name": "tempest-keypair-1094334472", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqK2FMXd/vuwW12y2lpbhyUHRDOjbK9mIK4Wh4BwemBdORbkWyoLu3JKeMPgqbzOkqr0qCN/kZaLU8UQT+3gOZJtDeGY7sHnxyuBmklIllFrBxDM+ZYWJZhvcxa2DPzkQ=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:45.924704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-069a0253-ff3d-4c19-9d66-3335b29814cf tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Getting quotas for project 5590a778aa374e188549c755f9fdad3a. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:45.933716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-069a0253-ff3d-4c19-9d66-3335b29814cf tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Getting quotas for user e3c8251bdcfb43ccad51d0d95dee5111 and project 5590a778aa374e188549c755f9fdad3a. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:45.935831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-55d11b74-2445-4dfd-83e0-465f97bd1070 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:45.936548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-55d11b74-2445-4dfd-83e0-465f97bd1070 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:45.970417 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-069a0253-ff3d-4c19-9d66-3335b29814cf tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.073538 Oct 24 10:29:45.971866 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 711/1509] 10.222.0.50 () {62 vars in 1199 bytes} [Mon Oct 24 10:29:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 24 10:29:45.974142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55d11b74-2445-4dfd-83e0-465f97bd1070 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:45.974635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55d11b74-2445-4dfd-83e0-465f97bd1070 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:45.980460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55d11b74-2445-4dfd-83e0-465f97bd1070 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:45.984493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dd73779e-029f-4ca4-b06d-9df3a0d0112c tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Calling method '.version_select at 0x7f04d0a76c10>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:45.985666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55d11b74-2445-4dfd-83e0-465f97bd1070 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:45.987478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55d11b74-2445-4dfd-83e0-465f97bd1070 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:45.987925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55d11b74-2445-4dfd-83e0-465f97bd1070 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:46.028027 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dd73779e-029f-4ca4-b06d-9df3a0d0112c tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094334472" status: 204 len: 0 microversion: 2.2 time: 0.048130 Oct 24 10:29:46.029788 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 712/1510] 10.222.0.50 () {60 vars in 1261 bytes} [Mon Oct 24 10:29:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094334472 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:46.044740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c8d144a0-889b-46c5-8fb2-9730aa71114a tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Action: 'create', calling method: .version_select at 0x7f04d0a02430>, body: {"keypair": {"name": "tempest-keypair-584253831", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:46.067877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c8d144a0-889b-46c5-8fb2-9730aa71114a tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Getting quotas for project 5590a778aa374e188549c755f9fdad3a. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:46.074853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c8d144a0-889b-46c5-8fb2-9730aa71114a tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Getting quotas for user e3c8251bdcfb43ccad51d0d95dee5111 and project 5590a778aa374e188549c755f9fdad3a. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:46.143763 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c8d144a0-889b-46c5-8fb2-9730aa71114a tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.095799 Oct 24 10:29:46.144909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-55d11b74-2445-4dfd-83e0-465f97bd1070 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:46.146867 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 713/1511] 10.222.0.50 () {62 vars in 1199 bytes} [Mon Oct 24 10:29:46 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 24 10:29:46.154195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ac014089-f9c0-4702-a15e-e54708178e1f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0a02790>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:46.191976 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-55d11b74-2445-4dfd-83e0-465f97bd1070 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.262671 Oct 24 10:29:46.230114 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 799/1512] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:45 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:29:46.236019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c877e161-1f39-4cfa-b99c-f81cf739d533 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Calling method '.version_select at 0x7f04d0ca7b80>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:46.247409 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ac014089-f9c0-4702-a15e-e54708178e1f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.098570 Oct 24 10:29:46.259723 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 714/1513] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:46 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:46.273044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-39957fcc-f0bd-4b54-a72d-8144da2242e0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:46.274678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-39957fcc-f0bd-4b54-a72d-8144da2242e0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:46.294919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39957fcc-f0bd-4b54-a72d-8144da2242e0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:46.295566 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c877e161-1f39-4cfa-b99c-f81cf739d533 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-584253831" status: 204 len: 0 microversion: 2.2 time: 0.063692 Oct 24 10:29:46.296538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39957fcc-f0bd-4b54-a72d-8144da2242e0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:46.297943 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 800/1514] 10.222.0.50 () {60 vars in 1258 bytes} [Mon Oct 24 10:29:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-584253831 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:46.302409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39957fcc-f0bd-4b54-a72d-8144da2242e0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:46.303418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39957fcc-f0bd-4b54-a72d-8144da2242e0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:46.304124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39957fcc-f0bd-4b54-a72d-8144da2242e0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:46.305056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39957fcc-f0bd-4b54-a72d-8144da2242e0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:46.338016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-252cb0db-36cc-42f4-8524-5dcba16828f6 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Action: 'create', calling method: .version_select at 0x7f04d08a1f70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-909163225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwAzYVkgttNkWDQ+hO6wLJq0oSxhBfsfbtALXU8imRvidKieIuM1P3PiLYACtuR7U7wNG4eZ/zOfumzPw96mJspVlHFgezrp+MBRj7zbZdpaGLWH7lpHhi3QXjgGWN3sw=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:46.374176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-252cb0db-36cc-42f4-8524-5dcba16828f6 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Getting quotas for project 5590a778aa374e188549c755f9fdad3a. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:46.381481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-252cb0db-36cc-42f4-8524-5dcba16828f6 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Getting quotas for user e3c8251bdcfb43ccad51d0d95dee5111 and project 5590a778aa374e188549c755f9fdad3a. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:46.398802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-39957fcc-f0bd-4b54-a72d-8144da2242e0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:46.406942 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-39957fcc-f0bd-4b54-a72d-8144da2242e0 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1221 microversion: 2.1 time: 0.145816 Oct 24 10:29:46.407760 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 715/1515] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:46 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1221 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:46.413201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1f6c6620-5bd0-4a19-8b23-7c8ade874e12 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:46.414455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1f6c6620-5bd0-4a19-8b23-7c8ade874e12 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:46.420301 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-252cb0db-36cc-42f4-8524-5dcba16828f6 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.098919 Oct 24 10:29:46.431963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f6c6620-5bd0-4a19-8b23-7c8ade874e12 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:46.431963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f6c6620-5bd0-4a19-8b23-7c8ade874e12 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:46.431963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f6c6620-5bd0-4a19-8b23-7c8ade874e12 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:46.431963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f6c6620-5bd0-4a19-8b23-7c8ade874e12 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:46.432416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f6c6620-5bd0-4a19-8b23-7c8ade874e12 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:46.432416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f6c6620-5bd0-4a19-8b23-7c8ade874e12 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:46.433158 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 801/1516] 10.222.0.50 () {62 vars in 1199 bytes} [Mon Oct 24 10:29:46 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 24 10:29:46.446794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-68ad5e36-5237-4e29-88a2-11a884982bd9 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Action: 'create', calling method: .version_select at 0x7f04d07faaf0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-94207721", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMl7T8j+1PRpPN4BlzWM5dW3UVLlxTKh3RqHxDuy7YrbxWi6I2YyurXsCRqy8QQFuuj44dgLtj81C7g4IVqWni06r5cjUURlY4PW93RFkvT8fnTHdz3X15WoWFOtZlQy1w=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:46.478887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-68ad5e36-5237-4e29-88a2-11a884982bd9 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Getting quotas for project 5590a778aa374e188549c755f9fdad3a. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:46.494342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-68ad5e36-5237-4e29-88a2-11a884982bd9 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Getting quotas for user e3c8251bdcfb43ccad51d0d95dee5111 and project 5590a778aa374e188549c755f9fdad3a. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:46.528092 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-68ad5e36-5237-4e29-88a2-11a884982bd9 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.2 time: 0.093916 Oct 24 10:29:46.529054 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 802/1517] 10.222.0.50 () {62 vars in 1199 bytes} [Mon Oct 24 10:29:46 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 24 10:29:46.551044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d2298e26-ea15-4f43-a74b-52629bd126dd tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Action: 'create', calling method: .version_select at 0x7f04d077c280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-499327639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBLGt5o9YhaaDWqsVSqGFONqndqtzDzDAG2jX9tCKjYx7qVM8zfYsgWYaBr1qn4ASJ0NKLCP9P2EoCoK47rIGxsWzQFG/JItQCtOGRoeu9MseX/PHdeur+/eFUcoxtwog=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:46.560856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:46.577185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d2298e26-ea15-4f43-a74b-52629bd126dd tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Getting quotas for project 5590a778aa374e188549c755f9fdad3a. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:46.583306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d2298e26-ea15-4f43-a74b-52629bd126dd tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Getting quotas for user e3c8251bdcfb43ccad51d0d95dee5111 and project 5590a778aa374e188549c755f9fdad3a. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:46.607866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1f6c6620-5bd0-4a19-8b23-7c8ade874e12 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:46.617871 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1f6c6620-5bd0-4a19-8b23-7c8ade874e12 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1470 microversion: 2.1 time: 0.208756 Oct 24 10:29:46.618925 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 716/1518] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:46 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1470 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:46.625466 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d2298e26-ea15-4f43-a74b-52629bd126dd tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.078876 Oct 24 10:29:46.626560 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 803/1519] 10.222.0.50 () {62 vars in 1199 bytes} [Mon Oct 24 10:29:46 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 24 10:29:46.647032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-79049e66-abbb-4680-b001-29198b641668 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Calling method '.version_select at 0x7f04d0a76670>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:46.652795 n-d-858383-15 devstack@n-api.service[120425]: WARNING oslo_db.sqlalchemy.utils [None req-79049e66-abbb-4680-b001-29198b641668 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 24 10:29:46.659705 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-79049e66-abbb-4680-b001-29198b641668 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 1138 microversion: 2.2 time: 0.019697 Oct 24 10:29:46.660744 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 717/1520] 10.222.0.50 () {60 vars in 1177 bytes} [Mon Oct 24 10:29:46 2022] GET /compute/v2.1/os-keypairs => generated 1138 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:46.671786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-64358595-573a-4a69-924c-6ba1b579ae05 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Calling method '.version_select at 0x7f04d078d1f0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:46.699219 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-64358595-573a-4a69-924c-6ba1b579ae05 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-499327639" status: 204 len: 0 microversion: 2.2 time: 0.031407 Oct 24 10:29:46.700624 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 804/1521] 10.222.0.50 () {60 vars in 1318 bytes} [Mon Oct 24 10:29:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-499327639 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:46.720235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-82699eaa-d570-4440-8d25-362f04d175e4 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Calling method '.version_select at 0x7f04d0a02ca0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:46.768728 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-82699eaa-d570-4440-8d25-362f04d175e4 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-94207721" status: 204 len: 0 microversion: 2.2 time: 0.060461 Oct 24 10:29:46.769367 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 718/1522] 10.222.0.50 () {60 vars in 1315 bytes} [Mon Oct 24 10:29:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-94207721 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 10:29:46.778903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2a9f3abd-c545-40ee-966a-aec59f9a879e tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Calling method '.version_select at 0x7f04d07fa040>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:46.794014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c06e05c2-2e4d-479e-80cb-8fee9d8b455f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:46.797268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c06e05c2-2e4d-479e-80cb-8fee9d8b455f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:46.811387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c06e05c2-2e4d-479e-80cb-8fee9d8b455f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:46.812240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c06e05c2-2e4d-479e-80cb-8fee9d8b455f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:46.813560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c06e05c2-2e4d-479e-80cb-8fee9d8b455f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:46.814480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c06e05c2-2e4d-479e-80cb-8fee9d8b455f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:46.815129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c06e05c2-2e4d-479e-80cb-8fee9d8b455f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:46.815741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c06e05c2-2e4d-479e-80cb-8fee9d8b455f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:46.826352 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2a9f3abd-c545-40ee-966a-aec59f9a879e tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-909163225" status: 204 len: 0 microversion: 2.2 time: 0.052396 Oct 24 10:29:46.837382 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 805/1523] 10.222.0.50 () {60 vars in 1318 bytes} [Mon Oct 24 10:29:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-909163225 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:46.851742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a9495ea5-fc3e-4c5e-8d32-485db8d7ca8b tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Action: 'create', calling method: .version_select at 0x7f04d07f8820>, body: {"keypair": {"name": "tempest-keypair-1988518311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYjjqxnLemBjra34rnWuZugTFZLb7pEPaWvtThOslKIe6KXVh3j/YgfRYDK+qIBnYFHwGF/b2oSNAnaeOFbdcRkKWn7EUX1Tar/tlDppgYl4gFRkdAt7HLYm0Ko2pC79Q=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:46.923059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-a9495ea5-fc3e-4c5e-8d32-485db8d7ca8b tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Getting quotas for project 5590a778aa374e188549c755f9fdad3a. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:46.944263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-a9495ea5-fc3e-4c5e-8d32-485db8d7ca8b tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Getting quotas for user e3c8251bdcfb43ccad51d0d95dee5111 and project 5590a778aa374e188549c755f9fdad3a. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:47.021249 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a9495ea5-fc3e-4c5e-8d32-485db8d7ca8b tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.182213 Oct 24 10:29:47.022122 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 806/1524] 10.222.0.50 () {62 vars in 1199 bytes} [Mon Oct 24 10:29:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 184 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 24 10:29:47.104357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-5d11d920-de02-430a-a91e-a154df73164b req-69a053b8-d2d3-4d43-93dd-cdf4218273b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651e9e7c-ba1a-4472-b74e-3f14eb862773", "name": "network-vif-unplugged", "status": "completed", "tag": "994f617f-bba6-456d-9bee-7c7fa6c5a409"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:47.114730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c06e05c2-2e4d-479e-80cb-8fee9d8b455f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:47.116359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5d11d920-de02-430a-a91e-a154df73164b req-69a053b8-d2d3-4d43-93dd-cdf4218273b7 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:47.118668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5d11d920-de02-430a-a91e-a154df73164b req-69a053b8-d2d3-4d43-93dd-cdf4218273b7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:47.119342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5d11d920-de02-430a-a91e-a154df73164b req-69a053b8-d2d3-4d43-93dd-cdf4218273b7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:47.142413 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-5d11d920-de02-430a-a91e-a154df73164b req-69a053b8-d2d3-4d43-93dd-cdf4218273b7 service nova] Creating event network-vif-unplugged:994f617f-bba6-456d-9bee-7c7fa6c5a409 for instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 on n-h2-858383-15 Oct 24 10:29:47.143702 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c06e05c2-2e4d-479e-80cb-8fee9d8b455f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.359854 Oct 24 10:29:47.145502 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 719/1525] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:46 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:47.165549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [req-5d11d920-de02-430a-a91e-a154df73164b req-69a053b8-d2d3-4d43-93dd-cdf4218273b7 service nova] Instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120426) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:29:47.166876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6640921d-b4cb-4990-b1be-7592372f3c5c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:47.169387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6640921d-b4cb-4990-b1be-7592372f3c5c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:47.188395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6640921d-b4cb-4990-b1be-7592372f3c5c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:47.189235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6640921d-b4cb-4990-b1be-7592372f3c5c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:47.189909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6640921d-b4cb-4990-b1be-7592372f3c5c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:47.190861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6640921d-b4cb-4990-b1be-7592372f3c5c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:47.192040 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-5d11d920-de02-430a-a91e-a154df73164b req-69a053b8-d2d3-4d43-93dd-cdf4218273b7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166805 Oct 24 10:29:47.192736 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 807/1526] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:47.197719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6640921d-b4cb-4990-b1be-7592372f3c5c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:47.199617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5d9be3d0-b5c9-440e-904f-259d6dcf274d tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Calling method '.version_select at 0x7f04d07f8700>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:47.200511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6640921d-b4cb-4990-b1be-7592372f3c5c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:47.209206 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5d9be3d0-b5c9-440e-904f-259d6dcf274d tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-1988518311" status: 200 len: 513 microversion: 2.2 time: 0.014587 Oct 24 10:29:47.210539 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 808/1527] 10.222.0.50 () {60 vars in 1258 bytes} [Mon Oct 24 10:29:47 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1988518311 => generated 513 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:47.222409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-40b1a04c-cc72-403b-ba89-ca5ffd662a0a tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Calling method '.version_select at 0x7f04d1220280>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:47.228044 n-d-858383-15 devstack@n-api.service[120426]: WARNING oslo_db.sqlalchemy.utils [None req-40b1a04c-cc72-403b-ba89-ca5ffd662a0a tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 24 10:29:47.240155 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-40b1a04c-cc72-403b-ba89-ca5ffd662a0a tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.021671 Oct 24 10:29:47.247348 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 809/1528] 10.222.0.50 () {60 vars in 1177 bytes} [Mon Oct 24 10:29:47 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:29:47.249037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8f473c2e-41a2-4038-b30d-d4ef5d0e6a3d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:47.249823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8f473c2e-41a2-4038-b30d-d4ef5d0e6a3d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:47.261492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f473c2e-41a2-4038-b30d-d4ef5d0e6a3d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:47.262034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f473c2e-41a2-4038-b30d-d4ef5d0e6a3d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:47.262567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f473c2e-41a2-4038-b30d-d4ef5d0e6a3d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:47.264084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f473c2e-41a2-4038-b30d-d4ef5d0e6a3d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:47.265239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f473c2e-41a2-4038-b30d-d4ef5d0e6a3d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:47.265747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f473c2e-41a2-4038-b30d-d4ef5d0e6a3d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:47.410097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-8f473c2e-41a2-4038-b30d-d4ef5d0e6a3d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:47.462372 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8f473c2e-41a2-4038-b30d-d4ef5d0e6a3d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.218740 Oct 24 10:29:47.464657 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 810/1529] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:47 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:47.477138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c934e90d-e392-48b3-8563-a04c53f48de6 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Calling method '.version_select at 0x7f04d07f6700>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:47.522830 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c934e90d-e392-48b3-8563-a04c53f48de6 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1988518311" status: 204 len: 0 microversion: 2.2 time: 0.052987 Oct 24 10:29:47.522830 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 811/1530] 10.222.0.50 () {60 vars in 1261 bytes} [Mon Oct 24 10:29:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1988518311 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:47.525006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ad33db3a-d4c0-4868-b442-888b97a12ed0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d07955e0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:47.609537 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ad33db3a-d4c0-4868-b442-888b97a12ed0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.089626 Oct 24 10:29:47.615395 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 812/1531] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:47 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:47.620889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f2861ef3-60c7-49ab-8b8b-1af7531d59b3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:47.622030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f2861ef3-60c7-49ab-8b8b-1af7531d59b3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:47.629889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2861ef3-60c7-49ab-8b8b-1af7531d59b3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:47.630381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2861ef3-60c7-49ab-8b8b-1af7531d59b3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:47.630862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2861ef3-60c7-49ab-8b8b-1af7531d59b3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:47.631526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2861ef3-60c7-49ab-8b8b-1af7531d59b3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:47.632131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2861ef3-60c7-49ab-8b8b-1af7531d59b3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:47.632886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2861ef3-60c7-49ab-8b8b-1af7531d59b3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:47.675063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6640921d-b4cb-4990-b1be-7592372f3c5c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:47.683701 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6640921d-b4cb-4990-b1be-7592372f3c5c tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1317 microversion: 2.1 time: 0.533842 Oct 24 10:29:47.699924 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 720/1532] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:47 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:47.706810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cb0c8b00-940c-49c2-9ab3-a4fe3195564a tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Action: 'create', calling method: .version_select at 0x7f04d0a02ee0>, body: {"keypair": {"name": "tempest-keypair-1026378096", "type": "x509"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:47.725279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-cb0c8b00-940c-49c2-9ab3-a4fe3195564a tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Getting quotas for project 5590a778aa374e188549c755f9fdad3a. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:47.731740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-cb0c8b00-940c-49c2-9ab3-a4fe3195564a tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Getting quotas for user e3c8251bdcfb43ccad51d0d95dee5111 and project 5590a778aa374e188549c755f9fdad3a. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:47.759206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.processutils [None req-cb0c8b00-940c-49c2-9ab3-a4fe3195564a tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp9asmnwsh/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp9asmnwsh/temp.key -subj /CN=e3c8251bdcfb43ccad51d0d95dee5111 -extensions v3_req_client {{(pid=120425) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 24 10:29:47.830571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f2861ef3-60c7-49ab-8b8b-1af7531d59b3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:47.852308 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f2861ef3-60c7-49ab-8b8b-1af7531d59b3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1277 microversion: 2.1 time: 0.234132 Oct 24 10:29:47.853313 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 813/1533] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:47 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:47.859402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-83506283-6aa0-4921-988b-8b58676df71d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:47.860308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-83506283-6aa0-4921-988b-8b58676df71d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:47.893519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83506283-6aa0-4921-988b-8b58676df71d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:47.894244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83506283-6aa0-4921-988b-8b58676df71d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:47.894774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83506283-6aa0-4921-988b-8b58676df71d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:47.896654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83506283-6aa0-4921-988b-8b58676df71d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:47.898995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83506283-6aa0-4921-988b-8b58676df71d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:47.900454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83506283-6aa0-4921-988b-8b58676df71d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:48.104670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.processutils [None req-cb0c8b00-940c-49c2-9ab3-a4fe3195564a tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp9asmnwsh/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp9asmnwsh/temp.key -subj /CN=e3c8251bdcfb43ccad51d0d95dee5111 -extensions v3_req_client" returned: 0 in 0.344s {{(pid=120425) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 24 10:29:48.106836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.processutils [None req-cb0c8b00-940c-49c2-9ab3-a4fe3195564a tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp9asmnwsh/temp.key -password pass: {{(pid=120425) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 24 10:29:48.119859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-83506283-6aa0-4921-988b-8b58676df71d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:48.133567 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-83506283-6aa0-4921-988b-8b58676df71d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1470 microversion: 2.1 time: 0.278548 Oct 24 10:29:48.134452 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 814/1534] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:47 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1470 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:48.141928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.processutils [None req-cb0c8b00-940c-49c2-9ab3-a4fe3195564a tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp9asmnwsh/temp.key -password pass:" returned: 0 in 0.034s {{(pid=120425) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 24 10:29:48.179694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-816a1c3e-0ab5-4377-8967-f124f80dcf0b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:48.180881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-816a1c3e-0ab5-4377-8967-f124f80dcf0b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:48.193806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-816a1c3e-0ab5-4377-8967-f124f80dcf0b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:48.194504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-816a1c3e-0ab5-4377-8967-f124f80dcf0b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:48.196783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-816a1c3e-0ab5-4377-8967-f124f80dcf0b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:48.200529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-816a1c3e-0ab5-4377-8967-f124f80dcf0b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:48.201235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-816a1c3e-0ab5-4377-8967-f124f80dcf0b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:48.202887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-816a1c3e-0ab5-4377-8967-f124f80dcf0b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:48.204096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-cb0c8b00-940c-49c2-9ab3-a4fe3195564a tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Getting quotas for project 5590a778aa374e188549c755f9fdad3a. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:29:48.214242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-cb0c8b00-940c-49c2-9ab3-a4fe3195564a tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Getting quotas for user e3c8251bdcfb43ccad51d0d95dee5111 and project 5590a778aa374e188549c755f9fdad3a. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:29:48.245558 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cb0c8b00-940c-49c2-9ab3-a4fe3195564a tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.551198 Oct 24 10:29:48.253849 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 721/1535] 10.222.0.50 () {62 vars in 1198 bytes} [Mon Oct 24 10:29:47 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 561 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:48.261719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eb1a10f6-f5c6-4c46-95fd-a6084743e418 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Calling method '.version_select at 0x7f04d0b35c10>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:48.274768 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eb1a10f6-f5c6-4c46-95fd-a6084743e418 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-1026378096" status: 200 len: 1534 microversion: 2.2 time: 0.019319 Oct 24 10:29:48.282138 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 722/1536] 10.222.0.50 () {60 vars in 1258 bytes} [Mon Oct 24 10:29:48 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1026378096 => generated 1534 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:48.288600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d31fc105-4238-40db-8064-c8b080730f07 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Calling method '.version_select at 0x7f04d0a02dc0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:48.292398 n-d-858383-15 devstack@n-api.service[120425]: WARNING oslo_db.sqlalchemy.utils [None req-d31fc105-4238-40db-8064-c8b080730f07 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 24 10:29:48.295560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:48.299527 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d31fc105-4238-40db-8064-c8b080730f07 tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.016153 Oct 24 10:29:48.307595 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 723/1537] 10.222.0.50 () {60 vars in 1177 bytes} [Mon Oct 24 10:29:48 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:48.315071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7dbde8e8-e515-4f12-abfc-66892ac41c2c tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] Calling method '.version_select at 0x7f04d0b0bca0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:48.346077 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7dbde8e8-e515-4f12-abfc-66892ac41c2c tempest-KeyPairsV22TestJSON-1550356336 tempest-KeyPairsV22TestJSON-1550356336-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1026378096" status: 204 len: 0 microversion: 2.2 time: 0.036862 Oct 24 10:29:48.351585 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 724/1538] 10.222.0.50 () {60 vars in 1261 bytes} [Mon Oct 24 10:29:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1026378096 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:48.457475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-816a1c3e-0ab5-4377-8967-f124f80dcf0b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:48.471589 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-816a1c3e-0ab5-4377-8967-f124f80dcf0b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1717 microversion: 2.1 time: 0.297342 Oct 24 10:29:48.474744 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 815/1539] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:48 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1717 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:48.494819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-76a83031-3b7d-4191-91c3-2080d36b8058 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:48.496268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-76a83031-3b7d-4191-91c3-2080d36b8058 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:48.510194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-76a83031-3b7d-4191-91c3-2080d36b8058 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:48.512214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-76a83031-3b7d-4191-91c3-2080d36b8058 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:48.513902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-76a83031-3b7d-4191-91c3-2080d36b8058 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:48.514978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-76a83031-3b7d-4191-91c3-2080d36b8058 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:48.517347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-76a83031-3b7d-4191-91c3-2080d36b8058 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:48.518304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-76a83031-3b7d-4191-91c3-2080d36b8058 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:48.627638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e0674651-c607-41cd-a699-3701c838fba2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d1450550>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:48.706084 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e0674651-c607-41cd-a699-3701c838fba2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.082067 Oct 24 10:29:48.708867 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 816/1540] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:48 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:48.726336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-94d4d1d0-06a0-4d4d-a6d4-dd581a4a7593 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:48.727231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-94d4d1d0-06a0-4d4d-a6d4-dd581a4a7593 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:48.758258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94d4d1d0-06a0-4d4d-a6d4-dd581a4a7593 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:48.758793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94d4d1d0-06a0-4d4d-a6d4-dd581a4a7593 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:48.759246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94d4d1d0-06a0-4d4d-a6d4-dd581a4a7593 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:48.762481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94d4d1d0-06a0-4d4d-a6d4-dd581a4a7593 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:48.762962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94d4d1d0-06a0-4d4d-a6d4-dd581a4a7593 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:48.766504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94d4d1d0-06a0-4d4d-a6d4-dd581a4a7593 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:48.937367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-76a83031-3b7d-4191-91c3-2080d36b8058 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:49.002050 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-76a83031-3b7d-4191-91c3-2080d36b8058 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.512972 Oct 24 10:29:49.006204 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 725/1541] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:48 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:49.019469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-edd6562b-9d8f-4f54-bff4-3d4ff8677010 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:49.023513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-edd6562b-9d8f-4f54-bff4-3d4ff8677010 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:49.043882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edd6562b-9d8f-4f54-bff4-3d4ff8677010 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:49.046639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edd6562b-9d8f-4f54-bff4-3d4ff8677010 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:49.047151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edd6562b-9d8f-4f54-bff4-3d4ff8677010 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:49.049229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edd6562b-9d8f-4f54-bff4-3d4ff8677010 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:49.051568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edd6562b-9d8f-4f54-bff4-3d4ff8677010 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:49.052588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edd6562b-9d8f-4f54-bff4-3d4ff8677010 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:49.128356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94d4d1d0-06a0-4d4d-a6d4-dd581a4a7593 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:49.140651 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-94d4d1d0-06a0-4d4d-a6d4-dd581a4a7593 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1317 microversion: 2.1 time: 0.419368 Oct 24 10:29:49.141953 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 817/1542] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:48 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:49.175470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f129c44e-2516-4f81-af12-8a274d44137b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:49.177165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f129c44e-2516-4f81-af12-8a274d44137b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:49.206306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f129c44e-2516-4f81-af12-8a274d44137b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:49.209442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f129c44e-2516-4f81-af12-8a274d44137b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:49.209933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f129c44e-2516-4f81-af12-8a274d44137b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:49.211294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f129c44e-2516-4f81-af12-8a274d44137b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:49.211757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f129c44e-2516-4f81-af12-8a274d44137b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:49.219871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f129c44e-2516-4f81-af12-8a274d44137b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:49.229692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-edd6562b-9d8f-4f54-bff4-3d4ff8677010 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:49.240612 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-edd6562b-9d8f-4f54-bff4-3d4ff8677010 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1283 microversion: 2.1 time: 0.232951 Oct 24 10:29:49.241768 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 726/1543] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:49 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1283 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:49.264799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-4ab9f0fe-cd20-4b94-8072-e8b2e9fbb282 req-d841b45d-26c2-441c-ab07-f06809fe9929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "651e9e7c-ba1a-4472-b74e-3f14eb862773", "tag": "994f617f-bba6-456d-9bee-7c7fa6c5a409"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:49.289249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4ab9f0fe-cd20-4b94-8072-e8b2e9fbb282 req-d841b45d-26c2-441c-ab07-f06809fe9929 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:49.298028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4ab9f0fe-cd20-4b94-8072-e8b2e9fbb282 req-d841b45d-26c2-441c-ab07-f06809fe9929 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:49.298028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4ab9f0fe-cd20-4b94-8072-e8b2e9fbb282 req-d841b45d-26c2-441c-ab07-f06809fe9929 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:49.334779 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-4ab9f0fe-cd20-4b94-8072-e8b2e9fbb282 req-d841b45d-26c2-441c-ab07-f06809fe9929 service nova] Creating event network-changed:994f617f-bba6-456d-9bee-7c7fa6c5a409 for instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 on n-h2-858383-15 Oct 24 10:29:49.347866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-4ab9f0fe-cd20-4b94-8072-e8b2e9fbb282 req-d841b45d-26c2-441c-ab07-f06809fe9929 service nova] Instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:29:49.374431 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-4ab9f0fe-cd20-4b94-8072-e8b2e9fbb282 req-d841b45d-26c2-441c-ab07-f06809fe9929 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131218 Oct 24 10:29:49.378669 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 727/1544] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:49.397619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e9254596-12ab-4b88-b9f7-4756d1a1f2b7 req-a7bd1d0f-f8cb-46ce-8d97-25a7db6dc4ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785efa4b-0de5-42e3-9310-ffd0f6a23a10", "name": "network-vif-plugged", "status": "completed", "tag": "c67b6a2d-14b0-4c1f-8c0e-3a2e6db0f440"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:49.428335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e9254596-12ab-4b88-b9f7-4756d1a1f2b7 req-a7bd1d0f-f8cb-46ce-8d97-25a7db6dc4ee service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:49.429762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e9254596-12ab-4b88-b9f7-4756d1a1f2b7 req-a7bd1d0f-f8cb-46ce-8d97-25a7db6dc4ee service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:49.433658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e9254596-12ab-4b88-b9f7-4756d1a1f2b7 req-a7bd1d0f-f8cb-46ce-8d97-25a7db6dc4ee service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:49.455809 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e9254596-12ab-4b88-b9f7-4756d1a1f2b7 req-a7bd1d0f-f8cb-46ce-8d97-25a7db6dc4ee service nova] Creating event network-vif-plugged:c67b6a2d-14b0-4c1f-8c0e-3a2e6db0f440 for instance 785efa4b-0de5-42e3-9310-ffd0f6a23a10 on n-h1-858383-15 Oct 24 10:29:49.470547 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e9254596-12ab-4b88-b9f7-4756d1a1f2b7 req-a7bd1d0f-f8cb-46ce-8d97-25a7db6dc4ee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090224 Oct 24 10:29:49.471796 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 728/1545] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:49.496622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-87c52c27-e297-4504-a925-1b8816d079db tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:49.497568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-87c52c27-e297-4504-a925-1b8816d079db tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:49.511867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87c52c27-e297-4504-a925-1b8816d079db tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:49.513510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87c52c27-e297-4504-a925-1b8816d079db tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:49.514091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87c52c27-e297-4504-a925-1b8816d079db tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:49.517678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87c52c27-e297-4504-a925-1b8816d079db tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:49.518603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87c52c27-e297-4504-a925-1b8816d079db tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:49.518889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87c52c27-e297-4504-a925-1b8816d079db tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:49.606757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f129c44e-2516-4f81-af12-8a274d44137b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:49.615759 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f129c44e-2516-4f81-af12-8a274d44137b tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1470 microversion: 2.1 time: 0.451992 Oct 24 10:29:49.633486 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 818/1546] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:49 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1470 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:49.724291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c22b5329-29ec-458e-9e31-a2b22027c85b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0795ca0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:49.805507 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c22b5329-29ec-458e-9e31-a2b22027c85b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.084816 Oct 24 10:29:49.806746 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 819/1547] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:49 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:49.859104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-87c52c27-e297-4504-a925-1b8816d079db tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:49.872120 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-87c52c27-e297-4504-a925-1b8816d079db tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1707 microversion: 2.1 time: 0.380108 Oct 24 10:29:49.875460 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 729/1548] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:49 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1707 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:49.899362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b850442e-2dcb-4c4d-bd8a-e0aead9f8cf9 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '.version_select at 0x7f04d1450550>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:49.904018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b850442e-2dcb-4c4d-bd8a-e0aead9f8cf9 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:49.904438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b850442e-2dcb-4c4d-bd8a-e0aead9f8cf9 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:49.909933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b850442e-2dcb-4c4d-bd8a-e0aead9f8cf9 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:49.938264 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b850442e-2dcb-4c4d-bd8a-e0aead9f8cf9 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 3540 microversion: 2.1 time: 0.040591 Oct 24 10:29:49.939250 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 820/1549] 10.222.0.50 () {58 vars in 1143 bytes} [Mon Oct 24 10:29:49 2022] GET /compute/v2.1/os-migrations => generated 3540 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:49.957664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4336a9de-debf-4de0-9a9a-7fa7ae4f8ce6 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:49.960051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4336a9de-debf-4de0-9a9a-7fa7ae4f8ce6 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:49.970145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4336a9de-debf-4de0-9a9a-7fa7ae4f8ce6 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:49.971520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4336a9de-debf-4de0-9a9a-7fa7ae4f8ce6 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:49.972135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4336a9de-debf-4de0-9a9a-7fa7ae4f8ce6 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:49.973482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4336a9de-debf-4de0-9a9a-7fa7ae4f8ce6 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:49.974083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4336a9de-debf-4de0-9a9a-7fa7ae4f8ce6 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:49.975354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4336a9de-debf-4de0-9a9a-7fa7ae4f8ce6 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:50.038339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-860765f1-b9a1-4a4d-8b62-1714441c6080 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:50.040052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-860765f1-b9a1-4a4d-8b62-1714441c6080 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:50.057547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-860765f1-b9a1-4a4d-8b62-1714441c6080 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:50.059410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-860765f1-b9a1-4a4d-8b62-1714441c6080 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:50.060002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-860765f1-b9a1-4a4d-8b62-1714441c6080 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:50.062213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-860765f1-b9a1-4a4d-8b62-1714441c6080 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:50.063565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-860765f1-b9a1-4a4d-8b62-1714441c6080 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:50.065144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-860765f1-b9a1-4a4d-8b62-1714441c6080 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:50.193487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-860765f1-b9a1-4a4d-8b62-1714441c6080 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:50.213707 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-860765f1-b9a1-4a4d-8b62-1714441c6080 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.181094 Oct 24 10:29:50.214929 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 821/1550] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:50 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:50.219814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1ccd2503-7698-416f-a49b-c4bf79b56229 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:50.220636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1ccd2503-7698-416f-a49b-c4bf79b56229 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:50.239924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ccd2503-7698-416f-a49b-c4bf79b56229 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:50.240686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ccd2503-7698-416f-a49b-c4bf79b56229 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:50.246989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ccd2503-7698-416f-a49b-c4bf79b56229 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:50.248689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ccd2503-7698-416f-a49b-c4bf79b56229 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:50.249430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ccd2503-7698-416f-a49b-c4bf79b56229 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:50.250039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ccd2503-7698-416f-a49b-c4bf79b56229 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:50.407465 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4336a9de-debf-4de0-9a9a-7fa7ae4f8ce6 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1860 microversion: 2.1 time: 0.454217 Oct 24 10:29:50.418255 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 730/1551] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:49 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1860 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:50.430256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-40116bdf-39cc-4135-91e6-5ad38d712d60 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:50.431022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-40116bdf-39cc-4135-91e6-5ad38d712d60 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:50.444562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40116bdf-39cc-4135-91e6-5ad38d712d60 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:50.445631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40116bdf-39cc-4135-91e6-5ad38d712d60 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:50.446523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40116bdf-39cc-4135-91e6-5ad38d712d60 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:50.447419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40116bdf-39cc-4135-91e6-5ad38d712d60 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:50.448153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40116bdf-39cc-4135-91e6-5ad38d712d60 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:50.448762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40116bdf-39cc-4135-91e6-5ad38d712d60 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:50.486062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1ccd2503-7698-416f-a49b-c4bf79b56229 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:50.495393 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1ccd2503-7698-416f-a49b-c4bf79b56229 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1317 microversion: 2.1 time: 0.279133 Oct 24 10:29:50.496171 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 822/1552] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:50 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:50.509220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cd678499-358a-4be5-807f-c12fca90c289 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:50.509867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cd678499-358a-4be5-807f-c12fca90c289 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:50.520279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd678499-358a-4be5-807f-c12fca90c289 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:50.521010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd678499-358a-4be5-807f-c12fca90c289 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:50.521614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd678499-358a-4be5-807f-c12fca90c289 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:50.522589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd678499-358a-4be5-807f-c12fca90c289 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:50.523712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd678499-358a-4be5-807f-c12fca90c289 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:50.524769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd678499-358a-4be5-807f-c12fca90c289 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:50.531336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:50.542750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-40116bdf-39cc-4135-91e6-5ad38d712d60 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:50.550542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:50.553000 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-40116bdf-39cc-4135-91e6-5ad38d712d60 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1283 microversion: 2.1 time: 0.132506 Oct 24 10:29:50.554446 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 731/1553] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:50 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1283 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:50.646155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-46217982-2fc9-4962-a3ac-c85c0f24d269 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:50.647053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-46217982-2fc9-4962-a3ac-c85c0f24d269 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:50.666272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46217982-2fc9-4962-a3ac-c85c0f24d269 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:50.667489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46217982-2fc9-4962-a3ac-c85c0f24d269 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:50.669379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46217982-2fc9-4962-a3ac-c85c0f24d269 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:50.670774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46217982-2fc9-4962-a3ac-c85c0f24d269 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:50.670774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46217982-2fc9-4962-a3ac-c85c0f24d269 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:50.674101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46217982-2fc9-4962-a3ac-c85c0f24d269 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:50.852724 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cd678499-358a-4be5-807f-c12fca90c289 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1860 microversion: 2.1 time: 0.353034 Oct 24 10:29:50.853851 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 823/1554] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:50 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1860 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:50.860775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8bf88d75-79a5-473a-9ed7-a6c80824c8af tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d085f8b0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:50.953336 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8bf88d75-79a5-473a-9ed7-a6c80824c8af tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.097648 Oct 24 10:29:50.966227 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 824/1555] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:50 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:51.006066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-50e0db3a-92a2-45f7-bb47-c218c50d51fc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:51.006575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-50e0db3a-92a2-45f7-bb47-c218c50d51fc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:51.017124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50e0db3a-92a2-45f7-bb47-c218c50d51fc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:51.017733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50e0db3a-92a2-45f7-bb47-c218c50d51fc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:51.024675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50e0db3a-92a2-45f7-bb47-c218c50d51fc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:51.025855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50e0db3a-92a2-45f7-bb47-c218c50d51fc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:51.026499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50e0db3a-92a2-45f7-bb47-c218c50d51fc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:51.027134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50e0db3a-92a2-45f7-bb47-c218c50d51fc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:51.061444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-46217982-2fc9-4962-a3ac-c85c0f24d269 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:51.072112 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-46217982-2fc9-4962-a3ac-c85c0f24d269 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1470 microversion: 2.1 time: 0.429655 Oct 24 10:29:51.074708 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 732/1556] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:50 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1470 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:51.250396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d1ad4e69-ed26-4658-b18c-ed32379ef18e tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:51.253230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d1ad4e69-ed26-4658-b18c-ed32379ef18e tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:51.262650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1ad4e69-ed26-4658-b18c-ed32379ef18e tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:51.264379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1ad4e69-ed26-4658-b18c-ed32379ef18e tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:51.265024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1ad4e69-ed26-4658-b18c-ed32379ef18e tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:51.266007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1ad4e69-ed26-4658-b18c-ed32379ef18e tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:51.267197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1ad4e69-ed26-4658-b18c-ed32379ef18e tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:51.267893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1ad4e69-ed26-4658-b18c-ed32379ef18e tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:51.285506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-50e0db3a-92a2-45f7-bb47-c218c50d51fc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lazy-loading 'services' on Instance uuid b9eff099-cc37-4432-8741-4e7d179b9ff0 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:51.410432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-d1ad4e69-ed26-4658-b18c-ed32379ef18e tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:51.433518 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d1ad4e69-ed26-4658-b18c-ed32379ef18e tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.187711 Oct 24 10:29:51.434802 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 733/1557] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:51 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:29:51.494010 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-50e0db3a-92a2-45f7-bb47-c218c50d51fc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments/5e4f013f-0f0b-4dfa-8bfd-7fbd73983677" status: 202 len: 0 microversion: 2.1 time: 0.495873 Oct 24 10:29:51.498795 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 825/1558] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 10:29:50 2022] DELETE /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments/5e4f013f-0f0b-4dfa-8bfd-7fbd73983677 => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:29:51.505620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-481a4c34-e234-438d-8ec5-5b53c56c3ead tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:51.508537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-481a4c34-e234-438d-8ec5-5b53c56c3ead tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:51.518462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-481a4c34-e234-438d-8ec5-5b53c56c3ead tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:51.518964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-481a4c34-e234-438d-8ec5-5b53c56c3ead tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:51.520023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-481a4c34-e234-438d-8ec5-5b53c56c3ead tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:51.520755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-481a4c34-e234-438d-8ec5-5b53c56c3ead tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:51.521774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-481a4c34-e234-438d-8ec5-5b53c56c3ead tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:51.522221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-481a4c34-e234-438d-8ec5-5b53c56c3ead tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:51.524751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5f5da752-7e31-4353-818f-7b4f98fa8d87 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:51.529588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5f5da752-7e31-4353-818f-7b4f98fa8d87 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:51.545332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f5da752-7e31-4353-818f-7b4f98fa8d87 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:51.545814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f5da752-7e31-4353-818f-7b4f98fa8d87 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:51.546257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f5da752-7e31-4353-818f-7b4f98fa8d87 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:51.546950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f5da752-7e31-4353-818f-7b4f98fa8d87 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:51.548731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f5da752-7e31-4353-818f-7b4f98fa8d87 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:51.549792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f5da752-7e31-4353-818f-7b4f98fa8d87 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:51.583827 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-481a4c34-e234-438d-8ec5-5b53c56c3ead tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083357 Oct 24 10:29:51.589552 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 734/1559] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:29:51 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:51.594570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f7302d2f-1c6d-44c3-afb0-1efa52d7be15 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:51.595129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f7302d2f-1c6d-44c3-afb0-1efa52d7be15 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:51.615232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7302d2f-1c6d-44c3-afb0-1efa52d7be15 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:51.620699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7302d2f-1c6d-44c3-afb0-1efa52d7be15 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:51.621770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7302d2f-1c6d-44c3-afb0-1efa52d7be15 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:51.622028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7302d2f-1c6d-44c3-afb0-1efa52d7be15 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:51.622390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7302d2f-1c6d-44c3-afb0-1efa52d7be15 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:51.622841 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7302d2f-1c6d-44c3-afb0-1efa52d7be15 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:51.833069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5f5da752-7e31-4353-818f-7b4f98fa8d87 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:51.858817 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5f5da752-7e31-4353-818f-7b4f98fa8d87 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1317 microversion: 2.1 time: 0.337859 Oct 24 10:29:51.864264 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 826/1560] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:51 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:51.890282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f7302d2f-1c6d-44c3-afb0-1efa52d7be15 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:51.915261 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f7302d2f-1c6d-44c3-afb0-1efa52d7be15 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1350 microversion: 2.1 time: 0.316390 Oct 24 10:29:51.915959 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 735/1561] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:51 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1350 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:51.974577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-30ee037d-7b68-4c24-b2f6-e97bb87a3c73 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d06e5ca0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:52.047393 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-30ee037d-7b68-4c24-b2f6-e97bb87a3c73 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.077247 Oct 24 10:29:52.053490 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 827/1562] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:51 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:52.100562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-989f8153-a31d-4b13-aa7b-f492ce035d95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:52.103285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-989f8153-a31d-4b13-aa7b-f492ce035d95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:52.136965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-989f8153-a31d-4b13-aa7b-f492ce035d95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:52.137463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-989f8153-a31d-4b13-aa7b-f492ce035d95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:52.137928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-989f8153-a31d-4b13-aa7b-f492ce035d95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:52.138636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-989f8153-a31d-4b13-aa7b-f492ce035d95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:52.139943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-989f8153-a31d-4b13-aa7b-f492ce035d95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:52.140382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-989f8153-a31d-4b13-aa7b-f492ce035d95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:52.344275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-989f8153-a31d-4b13-aa7b-f492ce035d95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:52.354599 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-989f8153-a31d-4b13-aa7b-f492ce035d95 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1470 microversion: 2.1 time: 0.260178 Oct 24 10:29:52.355961 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 736/1563] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:52 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1470 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:52.464570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3ccbc28b-3a75-4cc2-a001-50ca2c105ad5 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:52.466294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3ccbc28b-3a75-4cc2-a001-50ca2c105ad5 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:52.477594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ccbc28b-3a75-4cc2-a001-50ca2c105ad5 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:52.478546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ccbc28b-3a75-4cc2-a001-50ca2c105ad5 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:52.479787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ccbc28b-3a75-4cc2-a001-50ca2c105ad5 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:52.484036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ccbc28b-3a75-4cc2-a001-50ca2c105ad5 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:52.484761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ccbc28b-3a75-4cc2-a001-50ca2c105ad5 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:52.485274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ccbc28b-3a75-4cc2-a001-50ca2c105ad5 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:52.597158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-655cd28c-6861-4ba5-8553-8cd73b6d2c48 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:52.599437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-655cd28c-6861-4ba5-8553-8cd73b6d2c48 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:52.608362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-3ccbc28b-3a75-4cc2-a001-50ca2c105ad5 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:52.616103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-655cd28c-6861-4ba5-8553-8cd73b6d2c48 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:52.621236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-655cd28c-6861-4ba5-8553-8cd73b6d2c48 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:52.621786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-655cd28c-6861-4ba5-8553-8cd73b6d2c48 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:52.622536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-655cd28c-6861-4ba5-8553-8cd73b6d2c48 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:52.623006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-655cd28c-6861-4ba5-8553-8cd73b6d2c48 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:52.623435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-655cd28c-6861-4ba5-8553-8cd73b6d2c48 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:52.657359 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3ccbc28b-3a75-4cc2-a001-50ca2c105ad5 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.194848 Oct 24 10:29:52.658845 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 828/1564] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:52 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:52.685935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-2a06e40c-8fcd-40e4-bc7d-70c48b2c6302 req-7d4d8059-1111-4c89-b998-b19dac7ce4ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef7f7bd1-dcd0-4160-8198-be769a65429b", "tag": "c414991e-9fff-46ec-b95d-4a6da09466df"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:52.696447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2a06e40c-8fcd-40e4-bc7d-70c48b2c6302 req-7d4d8059-1111-4c89-b998-b19dac7ce4ff service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:52.696998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2a06e40c-8fcd-40e4-bc7d-70c48b2c6302 req-7d4d8059-1111-4c89-b998-b19dac7ce4ff service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:52.697441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2a06e40c-8fcd-40e4-bc7d-70c48b2c6302 req-7d4d8059-1111-4c89-b998-b19dac7ce4ff service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:52.707710 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-655cd28c-6861-4ba5-8553-8cd73b6d2c48 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114325 Oct 24 10:29:52.708675 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 737/1565] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:29:52 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:52.716256 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-2a06e40c-8fcd-40e4-bc7d-70c48b2c6302 req-7d4d8059-1111-4c89-b998-b19dac7ce4ff service nova] Creating event network-changed:c414991e-9fff-46ec-b95d-4a6da09466df for instance ef7f7bd1-dcd0-4160-8198-be769a65429b on n-h1-858383-15 Oct 24 10:29:52.721466 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-2a06e40c-8fcd-40e4-bc7d-70c48b2c6302 req-7d4d8059-1111-4c89-b998-b19dac7ce4ff service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044220 Oct 24 10:29:52.722629 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 829/1566] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:52.888744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9765cc9f-b78e-4003-af11-5e130f7479e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:52.889402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9765cc9f-b78e-4003-af11-5e130f7479e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:52.898608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9765cc9f-b78e-4003-af11-5e130f7479e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:52.899115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9765cc9f-b78e-4003-af11-5e130f7479e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:52.899564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9765cc9f-b78e-4003-af11-5e130f7479e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:52.900314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9765cc9f-b78e-4003-af11-5e130f7479e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:52.900845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9765cc9f-b78e-4003-af11-5e130f7479e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:52.909808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9765cc9f-b78e-4003-af11-5e130f7479e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:52.941528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b87a2ebf-3506-4c6d-87f9-029d2e187038 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:52.942248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b87a2ebf-3506-4c6d-87f9-029d2e187038 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:52.961482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b87a2ebf-3506-4c6d-87f9-029d2e187038 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:52.962031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b87a2ebf-3506-4c6d-87f9-029d2e187038 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:52.962479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b87a2ebf-3506-4c6d-87f9-029d2e187038 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:52.963191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b87a2ebf-3506-4c6d-87f9-029d2e187038 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:52.963904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b87a2ebf-3506-4c6d-87f9-029d2e187038 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:52.964497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b87a2ebf-3506-4c6d-87f9-029d2e187038 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:53.293830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b87a2ebf-3506-4c6d-87f9-029d2e187038 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:53.310987 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b87a2ebf-3506-4c6d-87f9-029d2e187038 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1350 microversion: 2.1 time: 0.368015 Oct 24 10:29:53.327350 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 830/1567] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:52 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1350 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:53.336158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-78d06215-5afb-4f1a-8d7b-baa2295f7bf6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d06f50d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:53.459595 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-78d06215-5afb-4f1a-8d7b-baa2295f7bf6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.140134 Oct 24 10:29:53.460187 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 831/1568] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:53 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:53.474003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-13c7ddd8-b20a-4161-bcfc-7326c47b203c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:53.485794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-13c7ddd8-b20a-4161-bcfc-7326c47b203c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:53.506657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13c7ddd8-b20a-4161-bcfc-7326c47b203c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:53.516553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13c7ddd8-b20a-4161-bcfc-7326c47b203c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:53.521753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13c7ddd8-b20a-4161-bcfc-7326c47b203c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:53.525227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13c7ddd8-b20a-4161-bcfc-7326c47b203c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:53.526042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13c7ddd8-b20a-4161-bcfc-7326c47b203c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:53.526741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13c7ddd8-b20a-4161-bcfc-7326c47b203c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:53.553679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9765cc9f-b78e-4003-af11-5e130f7479e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:53.626574 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9765cc9f-b78e-4003-af11-5e130f7479e8 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1467 microversion: 2.1 time: 0.742368 Oct 24 10:29:53.642248 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 738/1569] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:52 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1467 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:53.668395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-787726cc-e403-417d-b3dd-064385aa511f tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:53.670399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-787726cc-e403-417d-b3dd-064385aa511f tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:53.695387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-787726cc-e403-417d-b3dd-064385aa511f tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:53.699534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-787726cc-e403-417d-b3dd-064385aa511f tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:53.700580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-787726cc-e403-417d-b3dd-064385aa511f tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:53.704526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-787726cc-e403-417d-b3dd-064385aa511f tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:53.705247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-787726cc-e403-417d-b3dd-064385aa511f tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:53.708398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-787726cc-e403-417d-b3dd-064385aa511f tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:53.920006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-13c7ddd8-b20a-4161-bcfc-7326c47b203c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:53.929159 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-13c7ddd8-b20a-4161-bcfc-7326c47b203c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1470 microversion: 2.1 time: 0.463777 Oct 24 10:29:53.934867 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 832/1570] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:53 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1470 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:53.954945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-98ea08e6-0fec-48dd-8d23-4bf308859450 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:53.956008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-98ea08e6-0fec-48dd-8d23-4bf308859450 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:53.967163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98ea08e6-0fec-48dd-8d23-4bf308859450 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:53.973061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98ea08e6-0fec-48dd-8d23-4bf308859450 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:53.974727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98ea08e6-0fec-48dd-8d23-4bf308859450 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:53.977812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98ea08e6-0fec-48dd-8d23-4bf308859450 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:53.978324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98ea08e6-0fec-48dd-8d23-4bf308859450 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:53.980120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98ea08e6-0fec-48dd-8d23-4bf308859450 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:54.058196 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-787726cc-e403-417d-b3dd-064385aa511f tempest-ServersOnMultiNodesTest-1860339727 tempest-ServersOnMultiNodesTest-1860339727-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1620 microversion: 2.1 time: 0.406531 Oct 24 10:29:54.058830 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 739/1571] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:53 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1620 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:54.080945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e429ce7-26df-41fe-96e7-13c739e161ef tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:54.091567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e429ce7-26df-41fe-96e7-13c739e161ef tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:54.109568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e429ce7-26df-41fe-96e7-13c739e161ef tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:54.110089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e429ce7-26df-41fe-96e7-13c739e161ef tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:54.110540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e429ce7-26df-41fe-96e7-13c739e161ef tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:54.111464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e429ce7-26df-41fe-96e7-13c739e161ef tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:54.112095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e429ce7-26df-41fe-96e7-13c739e161ef tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:54.114349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e429ce7-26df-41fe-96e7-13c739e161ef tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:54.150654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-98ea08e6-0fec-48dd-8d23-4bf308859450 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:54.173360 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-98ea08e6-0fec-48dd-8d23-4bf308859450 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.236892 Oct 24 10:29:54.186561 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 833/1572] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:53 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:54.202015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5e369983-c010-47e9-87af-edb51d251f77 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:54.202489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5e369983-c010-47e9-87af-edb51d251f77 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:54.206296 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1e429ce7-26df-41fe-96e7-13c739e161ef tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146437 Oct 24 10:29:54.208366 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 740/1573] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:29:54 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:54.216237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e369983-c010-47e9-87af-edb51d251f77 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:54.217199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e369983-c010-47e9-87af-edb51d251f77 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:54.217886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e369983-c010-47e9-87af-edb51d251f77 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:54.219011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e369983-c010-47e9-87af-edb51d251f77 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:54.219750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e369983-c010-47e9-87af-edb51d251f77 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:54.220342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e369983-c010-47e9-87af-edb51d251f77 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:54.265391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5e369983-c010-47e9-87af-edb51d251f77 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:29:54.337978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa2ba1d8-fd4c-4379-89bf-bea5cf67b0d1 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:54.338596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa2ba1d8-fd4c-4379-89bf-bea5cf67b0d1 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:54.342657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:54.359935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa2ba1d8-fd4c-4379-89bf-bea5cf67b0d1 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:54.360442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa2ba1d8-fd4c-4379-89bf-bea5cf67b0d1 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:54.360905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa2ba1d8-fd4c-4379-89bf-bea5cf67b0d1 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:54.362892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa2ba1d8-fd4c-4379-89bf-bea5cf67b0d1 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:54.377040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa2ba1d8-fd4c-4379-89bf-bea5cf67b0d1 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:54.378630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa2ba1d8-fd4c-4379-89bf-bea5cf67b0d1 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:54.463333 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5e369983-c010-47e9-87af-edb51d251f77 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "DELETE /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 204 len: 0 microversion: 2.1 time: 0.274980 Oct 24 10:29:54.470314 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 834/1574] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:29:54 2022] DELETE /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:54.490456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f08907aa-31a0-4a44-b8e3-9746f39cd91e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d06f5ca0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:54.609441 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f08907aa-31a0-4a44-b8e3-9746f39cd91e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.135371 Oct 24 10:29:54.621473 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 835/1575] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:54 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:54.630763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-43071571-086d-4235-8740-150dbe5d7078 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:54.636926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-43071571-086d-4235-8740-150dbe5d7078 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:54.654586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43071571-086d-4235-8740-150dbe5d7078 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:54.655246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43071571-086d-4235-8740-150dbe5d7078 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:54.657234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43071571-086d-4235-8740-150dbe5d7078 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:54.658081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43071571-086d-4235-8740-150dbe5d7078 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:54.661493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43071571-086d-4235-8740-150dbe5d7078 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:54.662143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43071571-086d-4235-8740-150dbe5d7078 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:54.728976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa2ba1d8-fd4c-4379-89bf-bea5cf67b0d1 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:54.737396 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa2ba1d8-fd4c-4379-89bf-bea5cf67b0d1 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1350 microversion: 2.1 time: 0.404897 Oct 24 10:29:54.749590 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 741/1576] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:54 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1350 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:54.937198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-43071571-086d-4235-8740-150dbe5d7078 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:54.952183 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-43071571-086d-4235-8740-150dbe5d7078 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1473 microversion: 2.1 time: 0.329163 Oct 24 10:29:54.955238 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 836/1577] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:54 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1473 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:54.964016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a0b8fb40-1377-4cd0-b21d-7814dee04266 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:54.965834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a0b8fb40-1377-4cd0-b21d-7814dee04266 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:54.977681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0b8fb40-1377-4cd0-b21d-7814dee04266 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:54.979032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0b8fb40-1377-4cd0-b21d-7814dee04266 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:54.980787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0b8fb40-1377-4cd0-b21d-7814dee04266 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:54.981956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0b8fb40-1377-4cd0-b21d-7814dee04266 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:54.983511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0b8fb40-1377-4cd0-b21d-7814dee04266 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:54.984338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0b8fb40-1377-4cd0-b21d-7814dee04266 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:55.215072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ffff0ba8-cfd0-45c3-bb27-a4e4d20cc635 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:55.215736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ffff0ba8-cfd0-45c3-bb27-a4e4d20cc635 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:55.242083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffff0ba8-cfd0-45c3-bb27-a4e4d20cc635 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:55.247523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffff0ba8-cfd0-45c3-bb27-a4e4d20cc635 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:55.249178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffff0ba8-cfd0-45c3-bb27-a4e4d20cc635 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:55.254347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffff0ba8-cfd0-45c3-bb27-a4e4d20cc635 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:55.254874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffff0ba8-cfd0-45c3-bb27-a4e4d20cc635 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:55.260569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffff0ba8-cfd0-45c3-bb27-a4e4d20cc635 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:55.372053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a0b8fb40-1377-4cd0-b21d-7814dee04266 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:55.386414 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a0b8fb40-1377-4cd0-b21d-7814dee04266 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1463 microversion: 2.1 time: 0.428884 Oct 24 10:29:55.399507 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 742/1578] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:54 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1463 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:55.404990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ed1afab1-a828-45aa-aa55-f0ebad2346ac tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:55.412189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ed1afab1-a828-45aa-aa55-f0ebad2346ac tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:55.424122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed1afab1-a828-45aa-aa55-f0ebad2346ac tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:55.427266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed1afab1-a828-45aa-aa55-f0ebad2346ac tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:55.427922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed1afab1-a828-45aa-aa55-f0ebad2346ac tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:55.431353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed1afab1-a828-45aa-aa55-f0ebad2346ac tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:55.432031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed1afab1-a828-45aa-aa55-f0ebad2346ac tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:55.432645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed1afab1-a828-45aa-aa55-f0ebad2346ac tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:55.487896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-ffff0ba8-cfd0-45c3-bb27-a4e4d20cc635 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:55.533647 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ed1afab1-a828-45aa-aa55-f0ebad2346ac tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132534 Oct 24 10:29:55.542624 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ffff0ba8-cfd0-45c3-bb27-a4e4d20cc635 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.334787 Oct 24 10:29:55.562004 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 743/1579] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:29:55 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:55.567112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-36856405-15bf-4597-82e1-9b4ec1ccf564 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:55.571673 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 837/1580] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:55 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:29:55.572626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-36856405-15bf-4597-82e1-9b4ec1ccf564 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:55.588730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36856405-15bf-4597-82e1-9b4ec1ccf564 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:55.589531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36856405-15bf-4597-82e1-9b4ec1ccf564 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:55.590171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36856405-15bf-4597-82e1-9b4ec1ccf564 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:55.591065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36856405-15bf-4597-82e1-9b4ec1ccf564 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:55.591690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36856405-15bf-4597-82e1-9b4ec1ccf564 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:55.592284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36856405-15bf-4597-82e1-9b4ec1ccf564 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:55.626633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-83e6ee71-bf64-4ffa-a98d-729b4483c7d5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d068a700>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:55.700738 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-83e6ee71-bf64-4ffa-a98d-729b4483c7d5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.077989 Oct 24 10:29:55.701643 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 838/1581] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:55 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:29:55.762650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0bd30ecd-1d7e-4858-8d59-b9d9366a8148 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:55.763574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0bd30ecd-1d7e-4858-8d59-b9d9366a8148 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:55.781369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bd30ecd-1d7e-4858-8d59-b9d9366a8148 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:55.782076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bd30ecd-1d7e-4858-8d59-b9d9366a8148 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:55.785164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bd30ecd-1d7e-4858-8d59-b9d9366a8148 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:55.786630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bd30ecd-1d7e-4858-8d59-b9d9366a8148 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:55.793615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bd30ecd-1d7e-4858-8d59-b9d9366a8148 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:55.794214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bd30ecd-1d7e-4858-8d59-b9d9366a8148 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:56.047794 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-36856405-15bf-4597-82e1-9b4ec1ccf564 tempest-MigrationsAdminTest-1821588795 tempest-MigrationsAdminTest-1821588795-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1616 microversion: 2.1 time: 0.484231 Oct 24 10:29:56.049377 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 744/1582] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:55 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1616 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:56.062318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fe4797e0-40eb-4f2a-87b6-a61aea087d03 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:56.063221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fe4797e0-40eb-4f2a-87b6-a61aea087d03 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:56.079135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe4797e0-40eb-4f2a-87b6-a61aea087d03 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:56.079931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe4797e0-40eb-4f2a-87b6-a61aea087d03 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:56.080590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe4797e0-40eb-4f2a-87b6-a61aea087d03 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:56.081572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe4797e0-40eb-4f2a-87b6-a61aea087d03 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:56.082353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe4797e0-40eb-4f2a-87b6-a61aea087d03 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:56.082968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe4797e0-40eb-4f2a-87b6-a61aea087d03 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:56.167644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0bd30ecd-1d7e-4858-8d59-b9d9366a8148 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:56.177084 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0bd30ecd-1d7e-4858-8d59-b9d9366a8148 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1350 microversion: 2.1 time: 0.418440 Oct 24 10:29:56.199784 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 839/1583] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:55 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1350 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:56.215604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4a5f508b-183c-4029-b062-09e10bcd56e6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:56.216312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4a5f508b-183c-4029-b062-09e10bcd56e6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:56.223015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a5f508b-183c-4029-b062-09e10bcd56e6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:56.223733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a5f508b-183c-4029-b062-09e10bcd56e6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:56.225481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a5f508b-183c-4029-b062-09e10bcd56e6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:56.226560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a5f508b-183c-4029-b062-09e10bcd56e6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:56.227194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a5f508b-183c-4029-b062-09e10bcd56e6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:56.229043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a5f508b-183c-4029-b062-09e10bcd56e6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:56.280679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4a5f508b-183c-4029-b062-09e10bcd56e6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:29:56.406693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fe4797e0-40eb-4f2a-87b6-a61aea087d03 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:56.415865 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fe4797e0-40eb-4f2a-87b6-a61aea087d03 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1473 microversion: 2.1 time: 0.365118 Oct 24 10:29:56.423187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:56.425886 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 745/1584] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:56 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1473 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:56.494624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:56.540773 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4a5f508b-183c-4029-b062-09e10bcd56e6 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "DELETE /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 204 len: 0 microversion: 2.1 time: 0.339267 Oct 24 10:29:56.541764 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 840/1585] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:29:56 2022] DELETE /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:29:56.546513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c6872c98-aec7-4e61-a4db-b6bc07f161a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:56.549957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c6872c98-aec7-4e61-a4db-b6bc07f161a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:56.560777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b097910b-d993-4bb8-bc33-ae054ef53e61 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:56.570455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b097910b-d993-4bb8-bc33-ae054ef53e61 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:56.573775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6872c98-aec7-4e61-a4db-b6bc07f161a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:56.574955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6872c98-aec7-4e61-a4db-b6bc07f161a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:56.575667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6872c98-aec7-4e61-a4db-b6bc07f161a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:56.582055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6872c98-aec7-4e61-a4db-b6bc07f161a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:56.582881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6872c98-aec7-4e61-a4db-b6bc07f161a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:56.583583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6872c98-aec7-4e61-a4db-b6bc07f161a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:56.603776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b097910b-d993-4bb8-bc33-ae054ef53e61 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:56.604135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b097910b-d993-4bb8-bc33-ae054ef53e61 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:56.604544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b097910b-d993-4bb8-bc33-ae054ef53e61 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:56.605574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b097910b-d993-4bb8-bc33-ae054ef53e61 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:56.605752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b097910b-d993-4bb8-bc33-ae054ef53e61 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:56.606144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b097910b-d993-4bb8-bc33-ae054ef53e61 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:56.689105 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c6872c98-aec7-4e61-a4db-b6bc07f161a2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146476 Oct 24 10:29:56.690371 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 746/1586] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:29:56 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:56.695915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-de558558-848a-4011-a818-f3969965f88f tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:56.706769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-de558558-848a-4011-a818-f3969965f88f tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:56.727122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de558558-848a-4011-a818-f3969965f88f tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:56.728151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de558558-848a-4011-a818-f3969965f88f tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:56.728878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de558558-848a-4011-a818-f3969965f88f tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:56.729864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de558558-848a-4011-a818-f3969965f88f tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:56.730542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de558558-848a-4011-a818-f3969965f88f tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:56.731203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de558558-848a-4011-a818-f3969965f88f tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:56.951842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-de558558-848a-4011-a818-f3969965f88f tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:56.982195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=37 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:56.992646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:57.026919 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-de558558-848a-4011-a818-f3969965f88f tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.335159 Oct 24 10:29:57.045571 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 747/1587] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:56 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:57.063832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-084f15ce-04a4-4e6b-b52f-60dc825f930c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0b33ee0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:57.189019 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-084f15ce-04a4-4e6b-b52f-60dc825f930c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.141919 Oct 24 10:29:57.196740 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 748/1588] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:57 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:57.207795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d08915a9-2894-470a-b69a-2e1c6087c61a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:57.208703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d08915a9-2894-470a-b69a-2e1c6087c61a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:57.218981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d08915a9-2894-470a-b69a-2e1c6087c61a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:57.219749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d08915a9-2894-470a-b69a-2e1c6087c61a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:57.220373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d08915a9-2894-470a-b69a-2e1c6087c61a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:57.222930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d08915a9-2894-470a-b69a-2e1c6087c61a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:57.225087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d08915a9-2894-470a-b69a-2e1c6087c61a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:57.225748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d08915a9-2894-470a-b69a-2e1c6087c61a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:57.706264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b097910b-d993-4bb8-bc33-ae054ef53e61 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:57.721280 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b097910b-d993-4bb8-bc33-ae054ef53e61 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1469 microversion: 2.1 time: 1.169520 Oct 24 10:29:57.722544 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 841/1589] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:56 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1469 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:57.749502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5bd87974-75c9-4dbd-b14e-db2b68e5128e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:57.759675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5bd87974-75c9-4dbd-b14e-db2b68e5128e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:57.778105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bd87974-75c9-4dbd-b14e-db2b68e5128e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:57.781497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bd87974-75c9-4dbd-b14e-db2b68e5128e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:57.781995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bd87974-75c9-4dbd-b14e-db2b68e5128e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:57.782785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bd87974-75c9-4dbd-b14e-db2b68e5128e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:57.785407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bd87974-75c9-4dbd-b14e-db2b68e5128e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:57.786270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bd87974-75c9-4dbd-b14e-db2b68e5128e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:58.192699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d08915a9-2894-470a-b69a-2e1c6087c61a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:58.203944 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d08915a9-2894-470a-b69a-2e1c6087c61a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1350 microversion: 2.1 time: 1.000826 Oct 24 10:29:58.208805 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 749/1590] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:57 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1350 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:58.223353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-adcbc361-428e-4161-95e3-830310b1f43a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:58.226731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-adcbc361-428e-4161-95e3-830310b1f43a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:58.239556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=26 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:29:58.245148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adcbc361-428e-4161-95e3-830310b1f43a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:58.245657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adcbc361-428e-4161-95e3-830310b1f43a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:58.256717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adcbc361-428e-4161-95e3-830310b1f43a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:58.258031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adcbc361-428e-4161-95e3-830310b1f43a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:58.258749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adcbc361-428e-4161-95e3-830310b1f43a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:58.259421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adcbc361-428e-4161-95e3-830310b1f43a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:58.324530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5bd87974-75c9-4dbd-b14e-db2b68e5128e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:58.340073 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5bd87974-75c9-4dbd-b14e-db2b68e5128e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1473 microversion: 2.1 time: 0.615963 Oct 24 10:29:58.344372 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-adcbc361-428e-4161-95e3-830310b1f43a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124732 Oct 24 10:29:58.352069 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 750/1591] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:29:58 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:58.361067 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-2e2f0c41-66bf-4780-aa60-56d8a8cc8460 req-41a7e2ef-dae1-49f9-9bd8-119627014cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651e9e7c-ba1a-4472-b74e-3f14eb862773", "name": "network-vif-plugged", "status": "completed", "tag": "994f617f-bba6-456d-9bee-7c7fa6c5a409"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:58.361298 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 842/1592] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:57 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1473 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:58.369835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b3b6429c-fd80-4963-bd6b-c3abdb8d1a79 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:58.370474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b3b6429c-fd80-4963-bd6b-c3abdb8d1a79 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:58.383738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3b6429c-fd80-4963-bd6b-c3abdb8d1a79 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:58.385779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3b6429c-fd80-4963-bd6b-c3abdb8d1a79 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:58.385779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3b6429c-fd80-4963-bd6b-c3abdb8d1a79 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:58.386220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3b6429c-fd80-4963-bd6b-c3abdb8d1a79 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:58.386807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3b6429c-fd80-4963-bd6b-c3abdb8d1a79 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:58.387241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3b6429c-fd80-4963-bd6b-c3abdb8d1a79 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:58.394302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2e2f0c41-66bf-4780-aa60-56d8a8cc8460 req-41a7e2ef-dae1-49f9-9bd8-119627014cdf service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:58.395475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2e2f0c41-66bf-4780-aa60-56d8a8cc8460 req-41a7e2ef-dae1-49f9-9bd8-119627014cdf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:58.397348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2e2f0c41-66bf-4780-aa60-56d8a8cc8460 req-41a7e2ef-dae1-49f9-9bd8-119627014cdf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:58.440300 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-2e2f0c41-66bf-4780-aa60-56d8a8cc8460 req-41a7e2ef-dae1-49f9-9bd8-119627014cdf service nova] Creating event network-vif-plugged:994f617f-bba6-456d-9bee-7c7fa6c5a409 for instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 on n-h2-858383-15 Oct 24 10:29:58.456299 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-2e2f0c41-66bf-4780-aa60-56d8a8cc8460 req-41a7e2ef-dae1-49f9-9bd8-119627014cdf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107283 Oct 24 10:29:58.463168 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 751/1593] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:58.481211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-06fdabe2-8af7-42b6-8a2b-fd07362d3b16 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0cc6550>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:58.590596 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-06fdabe2-8af7-42b6-8a2b-fd07362d3b16 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.125803 Oct 24 10:29:58.593276 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 752/1594] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:58 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:58.628316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-eb6b3a0a-2866-4592-b79a-2fe33618f370 req-ee02c1f9-0423-4829-97f1-d12abc3e3dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785efa4b-0de5-42e3-9310-ffd0f6a23a10", "name": "network-vif-deleted", "tag": "c67b6a2d-14b0-4c1f-8c0e-3a2e6db0f440"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:29:58.645923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-b3b6429c-fd80-4963-bd6b-c3abdb8d1a79 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:29:58.656108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eb6b3a0a-2866-4592-b79a-2fe33618f370 req-ee02c1f9-0423-4829-97f1-d12abc3e3dcf service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:58.656583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eb6b3a0a-2866-4592-b79a-2fe33618f370 req-ee02c1f9-0423-4829-97f1-d12abc3e3dcf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:58.659565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eb6b3a0a-2866-4592-b79a-2fe33618f370 req-ee02c1f9-0423-4829-97f1-d12abc3e3dcf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:58.703873 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-eb6b3a0a-2866-4592-b79a-2fe33618f370 req-ee02c1f9-0423-4829-97f1-d12abc3e3dcf service nova] Creating event network-vif-deleted:c67b6a2d-14b0-4c1f-8c0e-3a2e6db0f440 for instance 785efa4b-0de5-42e3-9310-ffd0f6a23a10 on n-h1-858383-15 Oct 24 10:29:58.706857 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b3b6429c-fd80-4963-bd6b-c3abdb8d1a79 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.344362 Oct 24 10:29:58.707660 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 843/1595] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:58 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:29:58.717658 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-eb6b3a0a-2866-4592-b79a-2fe33618f370 req-ee02c1f9-0423-4829-97f1-d12abc3e3dcf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094106 Oct 24 10:29:58.724285 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 753/1596] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:29:58.745962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-31173c29-cbf9-477a-8927-893d187f5265 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:58.746569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-31173c29-cbf9-477a-8927-893d187f5265 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:58.767511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31173c29-cbf9-477a-8927-893d187f5265 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:58.768001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31173c29-cbf9-477a-8927-893d187f5265 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:58.768443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31173c29-cbf9-477a-8927-893d187f5265 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:58.769294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31173c29-cbf9-477a-8927-893d187f5265 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:58.769745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31173c29-cbf9-477a-8927-893d187f5265 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:58.770167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31173c29-cbf9-477a-8927-893d187f5265 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:59.105986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-31173c29-cbf9-477a-8927-893d187f5265 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:59.131017 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-31173c29-cbf9-477a-8927-893d187f5265 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1469 microversion: 2.1 time: 0.389280 Oct 24 10:29:59.135407 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 844/1597] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:58 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1469 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:59.248111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d32ba5f9-1e06-4f89-8bc1-7c8a8dab7d77 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:59.267950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d32ba5f9-1e06-4f89-8bc1-7c8a8dab7d77 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:59.296439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d32ba5f9-1e06-4f89-8bc1-7c8a8dab7d77 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:59.306560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d32ba5f9-1e06-4f89-8bc1-7c8a8dab7d77 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:59.310845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d32ba5f9-1e06-4f89-8bc1-7c8a8dab7d77 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:59.317044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d32ba5f9-1e06-4f89-8bc1-7c8a8dab7d77 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:59.351946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d32ba5f9-1e06-4f89-8bc1-7c8a8dab7d77 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:59.352584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d32ba5f9-1e06-4f89-8bc1-7c8a8dab7d77 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:59.360351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2ad5198a-c3d2-42a8-bce7-a14b20788454 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:59.362885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2ad5198a-c3d2-42a8-bce7-a14b20788454 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:59.385438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ad5198a-c3d2-42a8-bce7-a14b20788454 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:59.389461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ad5198a-c3d2-42a8-bce7-a14b20788454 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:59.392176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ad5198a-c3d2-42a8-bce7-a14b20788454 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:59.393096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ad5198a-c3d2-42a8-bce7-a14b20788454 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:59.394536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ad5198a-c3d2-42a8-bce7-a14b20788454 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:59.396332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ad5198a-c3d2-42a8-bce7-a14b20788454 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:59.519021 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2ad5198a-c3d2-42a8-bce7-a14b20788454 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163126 Oct 24 10:29:59.523867 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 845/1598] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:29:59 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:29:59.531927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4e98da9b-7fa4-42c8-851a-ebe2263dabe9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:59.535370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4e98da9b-7fa4-42c8-851a-ebe2263dabe9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:29:59.545629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e98da9b-7fa4-42c8-851a-ebe2263dabe9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:59.546276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e98da9b-7fa4-42c8-851a-ebe2263dabe9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:59.546919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e98da9b-7fa4-42c8-851a-ebe2263dabe9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:59.547727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e98da9b-7fa4-42c8-851a-ebe2263dabe9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:29:59.548290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e98da9b-7fa4-42c8-851a-ebe2263dabe9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:29:59.548935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e98da9b-7fa4-42c8-851a-ebe2263dabe9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:29:59.751127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4e98da9b-7fa4-42c8-851a-ebe2263dabe9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:29:59.770644 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4e98da9b-7fa4-42c8-851a-ebe2263dabe9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1431 microversion: 2.1 time: 0.245391 Oct 24 10:29:59.771390 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 846/1599] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:59 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1431 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:59.795855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9d69f360-0fc2-4e05-98cc-e01165078aa8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d06f0430>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:59.952174 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9d69f360-0fc2-4e05-98cc-e01165078aa8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.179578 Oct 24 10:29:59.953284 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 847/1600] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:29:59 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:29:59.985311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-73597ed1-9be8-47aa-906b-4d488fb99c1a tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:29:59.987016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-73597ed1-9be8-47aa-906b-4d488fb99c1a tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:00.019574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73597ed1-9be8-47aa-906b-4d488fb99c1a tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:00.022471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73597ed1-9be8-47aa-906b-4d488fb99c1a tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:00.025068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73597ed1-9be8-47aa-906b-4d488fb99c1a tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:00.027229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73597ed1-9be8-47aa-906b-4d488fb99c1a tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:00.030087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73597ed1-9be8-47aa-906b-4d488fb99c1a tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:00.033501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73597ed1-9be8-47aa-906b-4d488fb99c1a tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:00.088493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d32ba5f9-1e06-4f89-8bc1-7c8a8dab7d77 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:00.097748 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d32ba5f9-1e06-4f89-8bc1-7c8a8dab7d77 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1350 microversion: 2.1 time: 0.869279 Oct 24 10:30:00.102488 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 754/1601] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:29:59 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1350 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:00.163578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-18c9e930-5e2b-4933-83d2-6efe755f513c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:00.164931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-18c9e930-5e2b-4933-83d2-6efe755f513c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:00.177539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18c9e930-5e2b-4933-83d2-6efe755f513c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:00.178044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18c9e930-5e2b-4933-83d2-6efe755f513c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:00.178490 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18c9e930-5e2b-4933-83d2-6efe755f513c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:00.179294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18c9e930-5e2b-4933-83d2-6efe755f513c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:00.179761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18c9e930-5e2b-4933-83d2-6efe755f513c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:00.180187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18c9e930-5e2b-4933-83d2-6efe755f513c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:00.398762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-73597ed1-9be8-47aa-906b-4d488fb99c1a tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:00.475606 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-73597ed1-9be8-47aa-906b-4d488fb99c1a tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.515940 Oct 24 10:30:00.482797 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 848/1602] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:29:59 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:30:00.536189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-02e97f5a-c755-4f11-9e78-431ba41a3111 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:00.538291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-02e97f5a-c755-4f11-9e78-431ba41a3111 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:00.553853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02e97f5a-c755-4f11-9e78-431ba41a3111 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:00.557646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02e97f5a-c755-4f11-9e78-431ba41a3111 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:00.560443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02e97f5a-c755-4f11-9e78-431ba41a3111 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:00.563693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02e97f5a-c755-4f11-9e78-431ba41a3111 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:00.567986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02e97f5a-c755-4f11-9e78-431ba41a3111 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:00.568912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02e97f5a-c755-4f11-9e78-431ba41a3111 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:00.695897 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-02e97f5a-c755-4f11-9e78-431ba41a3111 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161507 Oct 24 10:30:00.697246 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 849/1603] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:30:00 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:00.801014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-02aa5d67-0865-442b-9caa-a32bcf5179b7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:00.802335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-02aa5d67-0865-442b-9caa-a32bcf5179b7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:00.815824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02aa5d67-0865-442b-9caa-a32bcf5179b7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:00.816532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02aa5d67-0865-442b-9caa-a32bcf5179b7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:00.817187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02aa5d67-0865-442b-9caa-a32bcf5179b7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:00.818078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02aa5d67-0865-442b-9caa-a32bcf5179b7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:00.819409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02aa5d67-0865-442b-9caa-a32bcf5179b7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:00.823407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02aa5d67-0865-442b-9caa-a32bcf5179b7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:00.833879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-18c9e930-5e2b-4933-83d2-6efe755f513c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:00.847270 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-18c9e930-5e2b-4933-83d2-6efe755f513c tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1469 microversion: 2.1 time: 0.688235 Oct 24 10:30:00.855185 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 755/1604] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:00 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1469 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:00.953063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-02aa5d67-0865-442b-9caa-a32bcf5179b7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:00.969548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d1546105-fe4e-4b4b-9833-272c3eb2212c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d15f3160>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:00.986645 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-02aa5d67-0865-442b-9caa-a32bcf5179b7 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1431 microversion: 2.1 time: 0.180542 Oct 24 10:30:00.987926 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 850/1605] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:00 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1431 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:01.010658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-fac3cb94-1ae6-40ba-ac3c-1f8d7674de2b req-82ab1da7-3e26-466f-a5b1-75e1f3a85bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651e9e7c-ba1a-4472-b74e-3f14eb862773", "name": "network-vif-deleted", "tag": "994f617f-bba6-456d-9bee-7c7fa6c5a409"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:01.030627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-fac3cb94-1ae6-40ba-ac3c-1f8d7674de2b req-82ab1da7-3e26-466f-a5b1-75e1f3a85bfd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:01.031387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-fac3cb94-1ae6-40ba-ac3c-1f8d7674de2b req-82ab1da7-3e26-466f-a5b1-75e1f3a85bfd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:01.032040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-fac3cb94-1ae6-40ba-ac3c-1f8d7674de2b req-82ab1da7-3e26-466f-a5b1-75e1f3a85bfd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:01.046153 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-fac3cb94-1ae6-40ba-ac3c-1f8d7674de2b req-82ab1da7-3e26-466f-a5b1-75e1f3a85bfd service nova] Creating event network-vif-deleted:994f617f-bba6-456d-9bee-7c7fa6c5a409 for instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 on n-h2-858383-15 Oct 24 10:30:01.055318 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-fac3cb94-1ae6-40ba-ac3c-1f8d7674de2b req-82ab1da7-3e26-466f-a5b1-75e1f3a85bfd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049488 Oct 24 10:30:01.063077 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 851/1606] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:30:01.084451 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d1546105-fe4e-4b4b-9833-272c3eb2212c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.118585 Oct 24 10:30:01.086537 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 756/1607] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:00 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:01.137804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-50ba37c8-be15-4b69-a708-ff999ee9654a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:01.142577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-50ba37c8-be15-4b69-a708-ff999ee9654a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:01.172207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50ba37c8-be15-4b69-a708-ff999ee9654a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:01.175609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50ba37c8-be15-4b69-a708-ff999ee9654a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:01.176355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50ba37c8-be15-4b69-a708-ff999ee9654a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:01.177703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50ba37c8-be15-4b69-a708-ff999ee9654a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:01.178614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50ba37c8-be15-4b69-a708-ff999ee9654a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:01.180339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50ba37c8-be15-4b69-a708-ff999ee9654a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:01.508783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f317d06d-03d0-410a-bef1-fcc6a6678711 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:01.509978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f317d06d-03d0-410a-bef1-fcc6a6678711 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:01.516981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f317d06d-03d0-410a-bef1-fcc6a6678711 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:01.517804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f317d06d-03d0-410a-bef1-fcc6a6678711 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:01.518589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f317d06d-03d0-410a-bef1-fcc6a6678711 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:01.519567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f317d06d-03d0-410a-bef1-fcc6a6678711 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:01.520202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f317d06d-03d0-410a-bef1-fcc6a6678711 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:01.520947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f317d06d-03d0-410a-bef1-fcc6a6678711 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:01.571318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-50ba37c8-be15-4b69-a708-ff999ee9654a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:01.586895 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-50ba37c8-be15-4b69-a708-ff999ee9654a tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1350 microversion: 2.1 time: 0.456262 Oct 24 10:30:01.594573 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 852/1608] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:01 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1350 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:01.708854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9d97091a-90b1-476a-95c7-9ebd99c07306 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:01.711073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9d97091a-90b1-476a-95c7-9ebd99c07306 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:01.721607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d97091a-90b1-476a-95c7-9ebd99c07306 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:01.731956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d97091a-90b1-476a-95c7-9ebd99c07306 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:01.732718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d97091a-90b1-476a-95c7-9ebd99c07306 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:01.734054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d97091a-90b1-476a-95c7-9ebd99c07306 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:01.737495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d97091a-90b1-476a-95c7-9ebd99c07306 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:01.739507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d97091a-90b1-476a-95c7-9ebd99c07306 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:01.826498 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9d97091a-90b1-476a-95c7-9ebd99c07306 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121469 Oct 24 10:30:01.833515 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 853/1609] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:30:01 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:30:01.872003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-16a7796b-4156-4bb6-ba54-64bd9111058f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:01.872973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-16a7796b-4156-4bb6-ba54-64bd9111058f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:01.880689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16a7796b-4156-4bb6-ba54-64bd9111058f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:01.881547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16a7796b-4156-4bb6-ba54-64bd9111058f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:01.883081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16a7796b-4156-4bb6-ba54-64bd9111058f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:01.884392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16a7796b-4156-4bb6-ba54-64bd9111058f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:01.886264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16a7796b-4156-4bb6-ba54-64bd9111058f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:01.887092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16a7796b-4156-4bb6-ba54-64bd9111058f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:01.891885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-f317d06d-03d0-410a-bef1-fcc6a6678711 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:01.953807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16a7796b-4156-4bb6-ba54-64bd9111058f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:01.959941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16a7796b-4156-4bb6-ba54-64bd9111058f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:01.960802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16a7796b-4156-4bb6-ba54-64bd9111058f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:01.961527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-16a7796b-4156-4bb6-ba54-64bd9111058f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lazy-loading 'fault' on Instance uuid 651e9e7c-ba1a-4472-b74e-3f14eb862773 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:01.985591 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f317d06d-03d0-410a-bef1-fcc6a6678711 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.481817 Oct 24 10:30:01.988943 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 757/1610] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:30:01 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:30:02.016200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c90fdd63-38d9-40a3-a363-eafab8579b02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:02.017273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c90fdd63-38d9-40a3-a363-eafab8579b02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:02.026356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c90fdd63-38d9-40a3-a363-eafab8579b02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:02.028748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c90fdd63-38d9-40a3-a363-eafab8579b02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:02.030126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c90fdd63-38d9-40a3-a363-eafab8579b02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:02.031148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c90fdd63-38d9-40a3-a363-eafab8579b02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:02.041646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c90fdd63-38d9-40a3-a363-eafab8579b02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:02.042718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c90fdd63-38d9-40a3-a363-eafab8579b02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:02.136423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c90fdd63-38d9-40a3-a363-eafab8579b02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:02.138736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c90fdd63-38d9-40a3-a363-eafab8579b02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:02.139666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c90fdd63-38d9-40a3-a363-eafab8579b02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:02.141695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-c90fdd63-38d9-40a3-a363-eafab8579b02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lazy-loading 'fault' on Instance uuid 785efa4b-0de5-42e3-9310-ffd0f6a23a10 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:02.147271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-16a7796b-4156-4bb6-ba54-64bd9111058f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:02.160148 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-16a7796b-4156-4bb6-ba54-64bd9111058f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 200 len: 1303 microversion: 2.1 time: 0.292966 Oct 24 10:30:02.163321 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 854/1611] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:01 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 1303 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:02.172068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-98866e09-dea5-4f14-9d7f-0db263c7bea6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d06a2f70>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:02.249470 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-98866e09-dea5-4f14-9d7f-0db263c7bea6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.083660 Oct 24 10:30:02.256481 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 855/1612] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:02 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:02.284555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c90fdd63-38d9-40a3-a363-eafab8579b02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:02.298800 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c90fdd63-38d9-40a3-a363-eafab8579b02 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 200 len: 1307 microversion: 2.1 time: 0.286428 Oct 24 10:30:02.302293 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 758/1613] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:02 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 1307 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:02.626316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c165f954-d715-4562-a4eb-fdaf17fbabf3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:02.628037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c165f954-d715-4562-a4eb-fdaf17fbabf3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:02.651367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c165f954-d715-4562-a4eb-fdaf17fbabf3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:02.655724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c165f954-d715-4562-a4eb-fdaf17fbabf3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:02.660339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c165f954-d715-4562-a4eb-fdaf17fbabf3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:02.667335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c165f954-d715-4562-a4eb-fdaf17fbabf3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:02.672138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c165f954-d715-4562-a4eb-fdaf17fbabf3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:02.675670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c165f954-d715-4562-a4eb-fdaf17fbabf3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:02.843517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b347afce-cf99-457b-a814-bb6ac573c21d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:02.846217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b347afce-cf99-457b-a814-bb6ac573c21d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:02.861432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b347afce-cf99-457b-a814-bb6ac573c21d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:02.861930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b347afce-cf99-457b-a814-bb6ac573c21d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:02.862379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b347afce-cf99-457b-a814-bb6ac573c21d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:02.863097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b347afce-cf99-457b-a814-bb6ac573c21d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:02.863556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b347afce-cf99-457b-a814-bb6ac573c21d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:02.863988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b347afce-cf99-457b-a814-bb6ac573c21d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:02.967411 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b347afce-cf99-457b-a814-bb6ac573c21d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123557 Oct 24 10:30:02.982297 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 759/1614] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:30:02 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:03.021711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d64b124e-7498-41a9-8a03-d0a31776d6ae tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:03.022345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d64b124e-7498-41a9-8a03-d0a31776d6ae tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:03.048019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d64b124e-7498-41a9-8a03-d0a31776d6ae tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:03.048519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d64b124e-7498-41a9-8a03-d0a31776d6ae tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:03.058226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d64b124e-7498-41a9-8a03-d0a31776d6ae tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:03.059149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d64b124e-7498-41a9-8a03-d0a31776d6ae tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:03.061763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d64b124e-7498-41a9-8a03-d0a31776d6ae tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:03.062244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d64b124e-7498-41a9-8a03-d0a31776d6ae tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:03.298103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-d64b124e-7498-41a9-8a03-d0a31776d6ae tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:03.349329 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d64b124e-7498-41a9-8a03-d0a31776d6ae tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.329527 Oct 24 10:30:03.351433 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 760/1615] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:30:03 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:30:03.363941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9ca5fe19-e0ed-4554-b209-030f10631e91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:03.365530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9ca5fe19-e0ed-4554-b209-030f10631e91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 651e9e7c-ba1a-4472-b74e-3f14eb862773] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:03.375140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ca5fe19-e0ed-4554-b209-030f10631e91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:03.377472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ca5fe19-e0ed-4554-b209-030f10631e91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:03.379154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ca5fe19-e0ed-4554-b209-030f10631e91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:03.380148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ca5fe19-e0ed-4554-b209-030f10631e91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:03.380988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ca5fe19-e0ed-4554-b209-030f10631e91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:03.381640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ca5fe19-e0ed-4554-b209-030f10631e91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:03.425348 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-9ca5fe19-e0ed-4554-b209-030f10631e91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] HTTP exception thrown: Instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 could not be found. Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9ca5fe19-e0ed-4554-b209-030f10631e91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Request method failure captured: Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 HTTP/1.1 Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfTgiVQkFreHjUnM8-9M4WXdVFFo3TwbYUuG90tWMf2U84Ct43t2RwFf9lp6Koocs_zPZzrCgx5V-uG_TrbOvXwkjInhf2fsg4sP_gV4bmp_eUqwH3j4gAJjxf3-J-L2cM0sKsq5wfN7DvL6M_aE1fA6jhg_Su-jUer19zeP7djDKU Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: ac5f703504204b91a5c7e895964ec985 Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-MigrationsAdminTest-1912783839 Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:30:03.427091 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:30:03.428786 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ac5f703504204b91a5c7e895964ec985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ac5f703504204b91a5c7e895964ec985"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ac5f703504204b91a5c7e895964ec985"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ac5f703504204b91a5c7e895964ec985", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:30:03.428786 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-MigrationsAdminTest-1912783839 Oct 24 10:30:03.428786 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: ac5f703504204b91a5c7e895964ec985 Oct 24 10:30:03.428786 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-MigrationsAdminTest-1912783839 Oct 24 10:30:03.428786 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-MigrationsAdminTest-1912783839-project Oct 24 10:30:03.428786 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:30:03.428786 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:30:03.428786 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: b684c865fc9e4abb8e0e55616087b92e Oct 24 10:30:03.428786 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-MigrationsAdminTest-1912783839-project Oct 24 10:30:03.428786 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:30:03.428786 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 could not be found. Oct 24 10:30:03.428786 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '651e9e7c-ba1a-4472-b74e-3f14eb862773'} Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 could not be found. Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:30:03.430426 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:30:03.432012 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:30:03.432012 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:30:03.432012 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:30:03.432012 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:30:03.432012 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:30:03.432012 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:30:03.432012 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:30:03.432012 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 could not be found. Oct 24 10:30:03.432012 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:03.432012 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:03.432012 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:03.432012 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:03.432012 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:03.432012 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:03.432012 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:30:03.432012 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:30:03.432012 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 could not be found. Oct 24 10:30:03.432012 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:03.433491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9ca5fe19-e0ed-4554-b209-030f10631e91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Returning 404 to user: Instance 651e9e7c-ba1a-4472-b74e-3f14eb862773 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:30:03.452719 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9ca5fe19-e0ed-4554-b209-030f10631e91 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773" status: 404 len: 111 microversion: 2.1 time: 0.096251 Oct 24 10:30:03.456938 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 761/1616] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:03 2022] GET /compute/v2.1/servers/651e9e7c-ba1a-4472-b74e-3f14eb862773 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:30:03.485249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-508d60b9-5026-42c6-bf37-b837f2f19b90 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0bb3430>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:03.636130 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-508d60b9-5026-42c6-bf37-b837f2f19b90 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1413 microversion: 2.1 time: 0.177117 Oct 24 10:30:03.637554 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 762/1617] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:03 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1413 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:03.652581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d2d64724-a0d8-467d-a41c-3dac3d9b7e00 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:03.653820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d2d64724-a0d8-467d-a41c-3dac3d9b7e00 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 785efa4b-0de5-42e3-9310-ffd0f6a23a10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:03.672585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2d64724-a0d8-467d-a41c-3dac3d9b7e00 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:03.675793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2d64724-a0d8-467d-a41c-3dac3d9b7e00 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:03.676641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2d64724-a0d8-467d-a41c-3dac3d9b7e00 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:03.681478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2d64724-a0d8-467d-a41c-3dac3d9b7e00 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:03.684622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2d64724-a0d8-467d-a41c-3dac3d9b7e00 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:03.685831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2d64724-a0d8-467d-a41c-3dac3d9b7e00 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:03.711463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c165f954-d715-4562-a4eb-fdaf17fbabf3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:03.721718 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-d2d64724-a0d8-467d-a41c-3dac3d9b7e00 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] HTTP exception thrown: Instance 785efa4b-0de5-42e3-9310-ffd0f6a23a10 could not be found. Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d2d64724-a0d8-467d-a41c-3dac3d9b7e00 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Request method failure captured: Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 HTTP/1.1 Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmhXqNSBsh7K7Uj2jXvR0yTVG9LTHhhGPCF6c-R_uu5XAWXN3q_pOqU3EQ6kswdvFK06P0vNock9UqKjP52kirztfJqRQ9SK9bbaCmdkDeP1GYXpg5nJ_Ea2cS2kg-fXYgatWKicP0gLPLbADF61RGIaCfWEQwHUVVkXN2VQjipCuYA Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: b565572c0c8c4871af02471a328bd1af Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:30:03.727587 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:30:03.729209 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b565572c0c8c4871af02471a328bd1af", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:30:03.729209 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:03.729209 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: b565572c0c8c4871af02471a328bd1af Oct 24 10:30:03.729209 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:03.729209 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersOnMultiNodesTest-2087726178-project Oct 24 10:30:03.729209 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:30:03.729209 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:30:03.729209 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 9aa572f1e5014e10bed0abe34dfad43f Oct 24 10:30:03.729209 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersOnMultiNodesTest-2087726178-project Oct 24 10:30:03.729209 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:30:03.729209 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 785efa4b-0de5-42e3-9310-ffd0f6a23a10 could not be found. Oct 24 10:30:03.729209 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '785efa4b-0de5-42e3-9310-ffd0f6a23a10'} Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 785efa4b-0de5-42e3-9310-ffd0f6a23a10 could not be found. Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:30:03.730186 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:30:03.731692 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:30:03.731692 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:30:03.731692 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:30:03.731692 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:30:03.731692 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:30:03.731692 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:30:03.731692 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:30:03.731692 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 785efa4b-0de5-42e3-9310-ffd0f6a23a10 could not be found. Oct 24 10:30:03.731692 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:03.731692 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:03.731692 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:03.731692 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:03.731692 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:03.731692 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:03.731692 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:30:03.731692 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:30:03.731692 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 785efa4b-0de5-42e3-9310-ffd0f6a23a10 could not be found. Oct 24 10:30:03.731692 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:03.740595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d2d64724-a0d8-467d-a41c-3dac3d9b7e00 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Returning 404 to user: Instance 785efa4b-0de5-42e3-9310-ffd0f6a23a10 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:30:03.741817 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d2d64724-a0d8-467d-a41c-3dac3d9b7e00 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10" status: 404 len: 111 microversion: 2.1 time: 0.102998 Oct 24 10:30:03.746403 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 763/1618] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:03 2022] GET /compute/v2.1/servers/785efa4b-0de5-42e3-9310-ffd0f6a23a10 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:30:03.758234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-166f6d97-9848-47e8-be9c-a0899407b9a8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:03.759033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-166f6d97-9848-47e8-be9c-a0899407b9a8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:03.760219 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c165f954-d715-4562-a4eb-fdaf17fbabf3 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1350 microversion: 2.1 time: 1.138983 Oct 24 10:30:03.772194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-166f6d97-9848-47e8-be9c-a0899407b9a8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:03.773189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-166f6d97-9848-47e8-be9c-a0899407b9a8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:03.774544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-166f6d97-9848-47e8-be9c-a0899407b9a8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:03.775778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-166f6d97-9848-47e8-be9c-a0899407b9a8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:03.776498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-166f6d97-9848-47e8-be9c-a0899407b9a8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:03.777428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-166f6d97-9848-47e8-be9c-a0899407b9a8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:03.778689 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 856/1619] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:02 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1350 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:03.787573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-646a10ef-aa1a-43fa-b365-b72e0abe7b17 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:03.789859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-646a10ef-aa1a-43fa-b365-b72e0abe7b17 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:03.801437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-646a10ef-aa1a-43fa-b365-b72e0abe7b17 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:03.802244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-646a10ef-aa1a-43fa-b365-b72e0abe7b17 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:03.803081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-646a10ef-aa1a-43fa-b365-b72e0abe7b17 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:03.804985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-646a10ef-aa1a-43fa-b365-b72e0abe7b17 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:03.805701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-646a10ef-aa1a-43fa-b365-b72e0abe7b17 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:03.807342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-646a10ef-aa1a-43fa-b365-b72e0abe7b17 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:03.875856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-166f6d97-9848-47e8-be9c-a0899407b9a8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:30:03.877073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-646a10ef-aa1a-43fa-b365-b72e0abe7b17 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:30:03.995113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:04.124445 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-646a10ef-aa1a-43fa-b365-b72e0abe7b17 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 204 len: 0 microversion: 2.1 time: 0.343946 Oct 24 10:30:04.126412 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 857/1620] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:30:03 2022] DELETE /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:30:04.134477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a27f2ac2-a627-4f38-938e-2f5d61f3f336 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:04.137894 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-166f6d97-9848-47e8-be9c-a0899407b9a8 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "DELETE /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 204 len: 0 microversion: 2.1 time: 0.389561 Oct 24 10:30:04.141608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a27f2ac2-a627-4f38-938e-2f5d61f3f336 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:04.142030 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 764/1621] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:30:03 2022] DELETE /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:30:04.152750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b9a50faf-507f-4667-9d23-2e0ac4bae6d3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:04.153037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a27f2ac2-a627-4f38-938e-2f5d61f3f336 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:04.153799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a27f2ac2-a627-4f38-938e-2f5d61f3f336 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:04.154413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a27f2ac2-a627-4f38-938e-2f5d61f3f336 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:04.155603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a27f2ac2-a627-4f38-938e-2f5d61f3f336 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:04.156553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a27f2ac2-a627-4f38-938e-2f5d61f3f336 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:04.157435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a27f2ac2-a627-4f38-938e-2f5d61f3f336 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:04.167609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b9a50faf-507f-4667-9d23-2e0ac4bae6d3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:04.184633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9a50faf-507f-4667-9d23-2e0ac4bae6d3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:04.187378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9a50faf-507f-4667-9d23-2e0ac4bae6d3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:04.194045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9a50faf-507f-4667-9d23-2e0ac4bae6d3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:04.195753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9a50faf-507f-4667-9d23-2e0ac4bae6d3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:04.196558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9a50faf-507f-4667-9d23-2e0ac4bae6d3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:04.197127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9a50faf-507f-4667-9d23-2e0ac4bae6d3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:04.233481 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a27f2ac2-a627-4f38-938e-2f5d61f3f336 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.105363 Oct 24 10:30:04.239564 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 858/1622] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:30:04 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:30:04.246237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a70d75ae-5e8e-4c34-a2a8-6b2094033963 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:04.247055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a70d75ae-5e8e-4c34-a2a8-6b2094033963 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:04.254518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a70d75ae-5e8e-4c34-a2a8-6b2094033963 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:04.255201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a70d75ae-5e8e-4c34-a2a8-6b2094033963 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:04.255815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a70d75ae-5e8e-4c34-a2a8-6b2094033963 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:04.256687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a70d75ae-5e8e-4c34-a2a8-6b2094033963 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:04.257923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a70d75ae-5e8e-4c34-a2a8-6b2094033963 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:04.258718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a70d75ae-5e8e-4c34-a2a8-6b2094033963 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:04.785086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a70d75ae-5e8e-4c34-a2a8-6b2094033963 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:04.799438 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a70d75ae-5e8e-4c34-a2a8-6b2094033963 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1535 microversion: 2.1 time: 0.556306 Oct 24 10:30:04.800879 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 859/1623] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:04 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1535 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:04.816514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b3c64897-be2e-4edd-bc26-54de127b695c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:04.817893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b3c64897-be2e-4edd-bc26-54de127b695c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:04.832695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3c64897-be2e-4edd-bc26-54de127b695c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:04.835103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3c64897-be2e-4edd-bc26-54de127b695c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:04.838209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3c64897-be2e-4edd-bc26-54de127b695c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:04.839117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3c64897-be2e-4edd-bc26-54de127b695c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:04.841291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3c64897-be2e-4edd-bc26-54de127b695c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:04.842134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3c64897-be2e-4edd-bc26-54de127b695c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:04.926844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9a50faf-507f-4667-9d23-2e0ac4bae6d3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:04.938893 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b9a50faf-507f-4667-9d23-2e0ac4bae6d3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 200 len: 1472 microversion: 2.1 time: 0.793820 Oct 24 10:30:04.939623 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 765/1624] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:04 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 1472 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:04.952111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef0b61ec-6617-44c3-a84e-127205abff4c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0bbaee0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:05.022722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-b3c64897-be2e-4edd-bc26-54de127b695c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:05.067283 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef0b61ec-6617-44c3-a84e-127205abff4c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1422 microversion: 2.1 time: 0.124834 Oct 24 10:30:05.067893 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 766/1625] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:04 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1422 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:05.072712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-24f4300d-82a1-4f47-9a0e-1313fc08bf2d tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:05.073381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-24f4300d-82a1-4f47-9a0e-1313fc08bf2d tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:05.078236 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b3c64897-be2e-4edd-bc26-54de127b695c tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.274720 Oct 24 10:30:05.081133 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 860/1626] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:30:04 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:30:05.089487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8c6830db-17d3-43ed-8f72-910635bd9d38 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d069c430>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:05.118890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24f4300d-82a1-4f47-9a0e-1313fc08bf2d tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:05.119655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24f4300d-82a1-4f47-9a0e-1313fc08bf2d tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:05.120268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24f4300d-82a1-4f47-9a0e-1313fc08bf2d tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:05.121205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24f4300d-82a1-4f47-9a0e-1313fc08bf2d tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:05.121829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24f4300d-82a1-4f47-9a0e-1313fc08bf2d tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:05.122423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24f4300d-82a1-4f47-9a0e-1313fc08bf2d tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:05.175885 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8c6830db-17d3-43ed-8f72-910635bd9d38 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 200 len: 1422 microversion: 2.1 time: 0.092965 Oct 24 10:30:05.175885 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 861/1627] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:05 2022] GET /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:05.190822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1ca82882-df5c-4096-a3bf-c650fdc1d9a5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d06f08b0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:06.092865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-24f4300d-82a1-4f47-9a0e-1313fc08bf2d tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:06.105866 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-24f4300d-82a1-4f47-9a0e-1313fc08bf2d tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1350 microversion: 2.1 time: 1.036879 Oct 24 10:30:06.116875 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 767/1628] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:05 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1350 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:06.116875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-382fd63a-b772-43ff-b3a7-e3ef934f76a5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:06.116875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-382fd63a-b772-43ff-b3a7-e3ef934f76a5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:06.119922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:06.121841 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-382fd63a-b772-43ff-b3a7-e3ef934f76a5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:06.122527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-382fd63a-b772-43ff-b3a7-e3ef934f76a5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:06.123174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-382fd63a-b772-43ff-b3a7-e3ef934f76a5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:06.124115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-382fd63a-b772-43ff-b3a7-e3ef934f76a5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:06.124749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-382fd63a-b772-43ff-b3a7-e3ef934f76a5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:06.125837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-382fd63a-b772-43ff-b3a7-e3ef934f76a5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:06.236384 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1ca82882-df5c-4096-a3bf-c650fdc1d9a5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 204 len: 0 microversion: 2.1 time: 1.049378 Oct 24 10:30:06.237889 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 862/1629] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:05 2022] DELETE /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 0 bytes in 1051 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 10:30:06.259341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8509f107-2d6b-4e73-a449-7324a61d9232 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:06.262156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8509f107-2d6b-4e73-a449-7324a61d9232 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:06.273187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8509f107-2d6b-4e73-a449-7324a61d9232 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:06.273791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8509f107-2d6b-4e73-a449-7324a61d9232 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:06.277376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8509f107-2d6b-4e73-a449-7324a61d9232 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:06.278526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8509f107-2d6b-4e73-a449-7324a61d9232 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:06.279099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8509f107-2d6b-4e73-a449-7324a61d9232 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:06.279746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8509f107-2d6b-4e73-a449-7324a61d9232 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:06.479713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-382fd63a-b772-43ff-b3a7-e3ef934f76a5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:06.487999 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-382fd63a-b772-43ff-b3a7-e3ef934f76a5 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1535 microversion: 2.1 time: 0.379619 Oct 24 10:30:06.488592 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 768/1630] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:06 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1535 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:06.499277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cc845381-ee1f-4538-add9-ca5513c40e62 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:06.505146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cc845381-ee1f-4538-add9-ca5513c40e62 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:06.515226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc845381-ee1f-4538-add9-ca5513c40e62 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:06.522824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc845381-ee1f-4538-add9-ca5513c40e62 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:06.524414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc845381-ee1f-4538-add9-ca5513c40e62 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:06.525398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc845381-ee1f-4538-add9-ca5513c40e62 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:06.525881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc845381-ee1f-4538-add9-ca5513c40e62 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:06.526464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc845381-ee1f-4538-add9-ca5513c40e62 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:06.550669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:06.617256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8509f107-2d6b-4e73-a449-7324a61d9232 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:06.625573 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8509f107-2d6b-4e73-a449-7324a61d9232 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 200 len: 1472 microversion: 2.1 time: 0.378699 Oct 24 10:30:06.627155 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 863/1631] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:06 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 1472 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:06.629996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-cc845381-ee1f-4538-add9-ca5513c40e62 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:06.632183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-85554568-63cf-4bab-9e65-9b8f5df62aae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:06.633325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-85554568-63cf-4bab-9e65-9b8f5df62aae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:06.639914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85554568-63cf-4bab-9e65-9b8f5df62aae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:06.640690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85554568-63cf-4bab-9e65-9b8f5df62aae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:06.642038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85554568-63cf-4bab-9e65-9b8f5df62aae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:06.642985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85554568-63cf-4bab-9e65-9b8f5df62aae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:06.643807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85554568-63cf-4bab-9e65-9b8f5df62aae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:06.644465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85554568-63cf-4bab-9e65-9b8f5df62aae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:06.680328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-85554568-63cf-4bab-9e65-9b8f5df62aae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:30:06.692445 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cc845381-ee1f-4538-add9-ca5513c40e62 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.199759 Oct 24 10:30:06.701433 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 769/1632] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:30:06 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:30:06.802040 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-85554568-63cf-4bab-9e65-9b8f5df62aae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 204 len: 0 microversion: 2.1 time: 0.173285 Oct 24 10:30:06.803578 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 864/1633] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:30:06 2022] DELETE /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:30:06.931821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e0f435a7-34a5-40cc-9d50-c3aefc352b08 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Calling method '.version_select at 0x7f04d0bd4670>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:06.967358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-65755d62-5a6a-4c9f-a804-2c9915b4813d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1170749773", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "c0c03a0b-80ac-4629-802c-40f648b11429"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:06.971364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG neutronclient.v2_0.client [None req-e0f435a7-34a5-40cc-9d50-c3aefc352b08 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9a1f0a26-6be9-4bdf-9808-248a333ce646 does not exist", "detail": ""}} {{(pid=120425) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:30:06.972500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.security_group_api [None req-e0f435a7-34a5-40cc-9d50-c3aefc352b08 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Neutron security group 9a1f0a26-6be9-4bdf-9808-248a333ce646 not found {{(pid=120425) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 10:30:06.973732 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-e0f435a7-34a5-40cc-9d50-c3aefc352b08 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] HTTP exception thrown: Security group 9a1f0a26-6be9-4bdf-9808-248a333ce646 does not exist Oct 24 10:30:06.973732 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-d89c8504-5aa4-4cd0-b4e5-a4071b82df8e'] Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e0f435a7-34a5-40cc-9d50-c3aefc352b08 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Request method failure captured: Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/os-security-groups/9a1f0a26-6be9-4bdf-9808-248a333ce646 HTTP/1.1 Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmkuF9wLoswwrFgZ-5tO3HNYpoYKAbV4_C-xiiuCi4AOLxpsvH_OmMu9w0McJcC2bzJAkA81OePYqL_S41Mab0BuQ-6r-xaGWGr8Sbwq7m4b_wgKqgjCBngAuMqQh2VqSgv4gKk9dirNMGBe7Kmwg1JgCvDlYq9ZEFckSTi4MZ-eQAk Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: fc798f6b6014468e871ffb21fbd6d4ab Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1183589040 Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:30:06.992714 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:30:06.994258 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fc798f6b6014468e871ffb21fbd6d4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fc798f6b6014468e871ffb21fbd6d4ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fc798f6b6014468e871ffb21fbd6d4ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fc798f6b6014468e871ffb21fbd6d4ab", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:30:06.994258 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1183589040 Oct 24 10:30:06.994258 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: fc798f6b6014468e871ffb21fbd6d4ab Oct 24 10:30:06.994258 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1183589040 Oct 24 10:30:06.994258 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupsNegativeTestJSON-1183589040-project Oct 24 10:30:06.994258 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:30:06.994258 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:30:06.994258 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 9274ed9a436746c480bab6a9df3965fa Oct 24 10:30:06.994258 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1183589040-project Oct 24 10:30:06.994258 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:30:06.994258 n-d-858383-15 devstack@n-api.service[120425]: exception: Security group 9a1f0a26-6be9-4bdf-9808-248a333ce646 does not exist Oct 24 10:30:06.994258 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-d89c8504-5aa4-4cd0-b4e5-a4071b82df8e'] Oct 24 10:30:06.994258 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '9a1f0a26-6be9-4bdf-9808-248a333ce646'} Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:06.995137 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:30:06.996458 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:30:06.996458 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:06.996458 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:06.996458 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:30:06.996458 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:30:06.996458 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:30:06.996458 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:30:06.996458 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9a1f0a26-6be9-4bdf-9808-248a333ce646 does not exist Oct 24 10:30:06.996458 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d89c8504-5aa4-4cd0-b4e5-a4071b82df8e'] Oct 24 10:30:06.996458 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:06.996458 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:06.996458 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:06.996458 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:06.996458 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 24 10:30:06.996458 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 10:30:06.996458 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 10:30:06.996458 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 10:30:06.996458 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9a1f0a26-6be9-4bdf-9808-248a333ce646 does not exist Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d89c8504-5aa4-4cd0-b4e5-a4071b82df8e'] Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9a1f0a26-6be9-4bdf-9808-248a333ce646 does not exist Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d89c8504-5aa4-4cd0-b4e5-a4071b82df8e'] Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:06.997896 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:06.999610 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:06.999610 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:06.999610 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:30:06.999610 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:30:06.999610 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9a1f0a26-6be9-4bdf-9808-248a333ce646 does not exist Oct 24 10:30:06.999610 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d89c8504-5aa4-4cd0-b4e5-a4071b82df8e'] Oct 24 10:30:06.999610 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:06.999610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e0f435a7-34a5-40cc-9d50-c3aefc352b08 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Returning 404 to user: Security group 9a1f0a26-6be9-4bdf-9808-248a333ce646 does not exist Oct 24 10:30:06.999610 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-d89c8504-5aa4-4cd0-b4e5-a4071b82df8e'] {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:30:06.999610 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e0f435a7-34a5-40cc-9d50-c3aefc352b08 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/9a1f0a26-6be9-4bdf-9808-248a333ce646" status: 404 len: 194 microversion: 2.1 time: 0.296861 Oct 24 10:30:07.000416 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 770/1634] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:30:06 2022] DELETE /compute/v2.1/os-security-groups/9a1f0a26-6be9-4bdf-9808-248a333ce646 => generated 194 bytes in 298 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:30:07.014476 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b97bdc66-241f-4d56-a4ed-0acb92a0c534 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.007046 Oct 24 10:30:07.015302 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 771/1635] 10.222.0.50 () {58 vars in 1164 bytes} [Mon Oct 24 10:30:07 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 24 10:30:07.024576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-14a0e7dd-095d-4ead-9a35-d5562c836340 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Calling method '.version_select at 0x7f04d110c700>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:07.050455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-65755d62-5a6a-4c9f-a804-2c9915b4813d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] validate_networks() for [('c0c03a0b-80ac-4629-802c-40f648b11429', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:30:07.494342 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-14a0e7dd-095d-4ead-9a35-d5562c836340 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.473998 Oct 24 10:30:07.503937 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 772/1636] 10.222.0.50 () {58 vars in 1158 bytes} [Mon Oct 24 10:30:07 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:07.509373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00cc438e-9348-4d3e-b4b2-e67a5e69ad18 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:07.509996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00cc438e-9348-4d3e-b4b2-e67a5e69ad18 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:07.526454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00cc438e-9348-4d3e-b4b2-e67a5e69ad18 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:07.527392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00cc438e-9348-4d3e-b4b2-e67a5e69ad18 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:07.528026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00cc438e-9348-4d3e-b4b2-e67a5e69ad18 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:07.528749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00cc438e-9348-4d3e-b4b2-e67a5e69ad18 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:07.529233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00cc438e-9348-4d3e-b4b2-e67a5e69ad18 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:07.529658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00cc438e-9348-4d3e-b4b2-e67a5e69ad18 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:08.160552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-00cc438e-9348-4d3e-b4b2-e67a5e69ad18 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:08.176688 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-00cc438e-9348-4d3e-b4b2-e67a5e69ad18 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1350 microversion: 2.1 time: 0.678619 Oct 24 10:30:08.180265 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 773/1637] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:07 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1350 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:08.190984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-217e3920-6e0d-47c7-aa7d-ef80e3e282b1 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Calling method '.version_select at 0x7f04d0ca1700>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:08.291288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-65755d62-5a6a-4c9f-a804-2c9915b4813d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:30:08.292322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-65755d62-5a6a-4c9f-a804-2c9915b4813d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:30:08.293745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-65755d62-5a6a-4c9f-a804-2c9915b4813d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:30:08.294341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-65755d62-5a6a-4c9f-a804-2c9915b4813d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:30:08.294997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-65755d62-5a6a-4c9f-a804-2c9915b4813d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:30:08.322712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-65755d62-5a6a-4c9f-a804-2c9915b4813d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:08.323229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-65755d62-5a6a-4c9f-a804-2c9915b4813d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:08.323717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-65755d62-5a6a-4c9f-a804-2c9915b4813d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:08.329706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-65755d62-5a6a-4c9f-a804-2c9915b4813d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:08.330159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-65755d62-5a6a-4c9f-a804-2c9915b4813d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:08.330948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-65755d62-5a6a-4c9f-a804-2c9915b4813d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:08.389147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-65755d62-5a6a-4c9f-a804-2c9915b4813d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Getting quotas for project 8a3ff02c01a64c9a940de444ca1197c4. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:30:08.397411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-65755d62-5a6a-4c9f-a804-2c9915b4813d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Getting quotas for user 43fd0499bc224bd8b190701a811ee204 and project 8a3ff02c01a64c9a940de444ca1197c4. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:30:08.434647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-65755d62-5a6a-4c9f-a804-2c9915b4813d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:30:08.437873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-65755d62-5a6a-4c9f-a804-2c9915b4813d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:30:08.586858 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-65755d62-5a6a-4c9f-a804-2c9915b4813d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.627672 Oct 24 10:30:08.588962 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 865/1638] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:30:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 10:30:08.595831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1d7cce56-1cf6-4ee7-b536-c7cbe52109e0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:08.596940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1d7cce56-1cf6-4ee7-b536-c7cbe52109e0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:08.605983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d7cce56-1cf6-4ee7-b536-c7cbe52109e0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:08.606662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d7cce56-1cf6-4ee7-b536-c7cbe52109e0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:08.607284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d7cce56-1cf6-4ee7-b536-c7cbe52109e0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:08.608437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d7cce56-1cf6-4ee7-b536-c7cbe52109e0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:08.611716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d7cce56-1cf6-4ee7-b536-c7cbe52109e0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:08.612411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d7cce56-1cf6-4ee7-b536-c7cbe52109e0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:08.669060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG neutronclient.v2_0.client [None req-217e3920-6e0d-47c7-aa7d-ef80e3e282b1 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120425) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:30:08.670431 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-217e3920-6e0d-47c7-aa7d-ef80e3e282b1 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 24 10:30:08.670431 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-6da92a76-ebd7-41ed-9207-578fb0f6d114'] Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-217e3920-6e0d-47c7-aa7d-ef80e3e282b1 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Request method failure captured: Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/os-security-groups/beb316a6-5c4b-4db5-ae29-5e8c1c58ec51 HTTP/1.1 Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmkuF9wLoswwrFgZ-5tO3HNYpoYKAbV4_C-xiiuCi4AOLxpsvH_OmMu9w0McJcC2bzJAkA81OePYqL_S41Mab0BuQ-6r-xaGWGr8Sbwq7m4b_wgKqgjCBngAuMqQh2VqSgv4gKk9dirNMGBe7Kmwg1JgCvDlYq9ZEFckSTi4MZ-eQAk Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: fc798f6b6014468e871ffb21fbd6d4ab Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1183589040 Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:30:08.677068 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:30:08.678477 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fc798f6b6014468e871ffb21fbd6d4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fc798f6b6014468e871ffb21fbd6d4ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fc798f6b6014468e871ffb21fbd6d4ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fc798f6b6014468e871ffb21fbd6d4ab", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:30:08.678477 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1183589040 Oct 24 10:30:08.678477 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: fc798f6b6014468e871ffb21fbd6d4ab Oct 24 10:30:08.678477 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1183589040 Oct 24 10:30:08.678477 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupsNegativeTestJSON-1183589040-project Oct 24 10:30:08.678477 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:30:08.678477 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:30:08.678477 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 9274ed9a436746c480bab6a9df3965fa Oct 24 10:30:08.678477 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1183589040-project Oct 24 10:30:08.678477 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:30:08.678477 n-d-858383-15 devstack@n-api.service[120425]: exception: Insufficient rights for removing default security group. Oct 24 10:30:08.678477 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-6da92a76-ebd7-41ed-9207-578fb0f6d114'] Oct 24 10:30:08.678477 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'beb316a6-5c4b-4db5-ae29-5e8c1c58ec51'} Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:08.679886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6da92a76-ebd7-41ed-9207-578fb0f6d114'] Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 24 10:30:08.681270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6da92a76-ebd7-41ed-9207-578fb0f6d114'] Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6da92a76-ebd7-41ed-9207-578fb0f6d114'] Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:08.683575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:08.685958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:08.685958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:30:08.685958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:30:08.685958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 24 10:30:08.685958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6da92a76-ebd7-41ed-9207-578fb0f6d114'] Oct 24 10:30:08.685958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:08.688627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-217e3920-6e0d-47c7-aa7d-ef80e3e282b1 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 24 10:30:08.688627 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-6da92a76-ebd7-41ed-9207-578fb0f6d114'] {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:30:08.690189 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-217e3920-6e0d-47c7-aa7d-ef80e3e282b1 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/beb316a6-5c4b-4db5-ae29-5e8c1c58ec51" status: 400 len: 182 microversion: 2.1 time: 0.508168 Oct 24 10:30:08.690927 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 774/1639] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:30:08 2022] DELETE /compute/v2.1/os-security-groups/beb316a6-5c4b-4db5-ae29-5e8c1c58ec51 => generated 182 bytes in 510 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:30:08.727566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-1de2dd2c-2d71-4453-b3b2-9368046415b7 req-2c7de80a-7714-4cbd-b33a-3b9fce2e26f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef7f7bd1-dcd0-4160-8198-be769a65429b", "name": "network-vif-plugged", "status": "completed", "tag": "c414991e-9fff-46ec-b95d-4a6da09466df"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:08.735213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d7cce56-1cf6-4ee7-b536-c7cbe52109e0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:08.737070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d7cce56-1cf6-4ee7-b536-c7cbe52109e0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:08.739227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d7cce56-1cf6-4ee7-b536-c7cbe52109e0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:08.739704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-1d7cce56-1cf6-4ee7-b536-c7cbe52109e0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lazy-loading 'fault' on Instance uuid 98c18a9a-ad67-4d8e-abd2-349766d8a002 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:08.762210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1de2dd2c-2d71-4453-b3b2-9368046415b7 req-2c7de80a-7714-4cbd-b33a-3b9fce2e26f6 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:08.762755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1de2dd2c-2d71-4453-b3b2-9368046415b7 req-2c7de80a-7714-4cbd-b33a-3b9fce2e26f6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:08.763338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1de2dd2c-2d71-4453-b3b2-9368046415b7 req-2c7de80a-7714-4cbd-b33a-3b9fce2e26f6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:08.783694 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-1de2dd2c-2d71-4453-b3b2-9368046415b7 req-2c7de80a-7714-4cbd-b33a-3b9fce2e26f6 service nova] Creating event network-vif-plugged:c414991e-9fff-46ec-b95d-4a6da09466df for instance ef7f7bd1-dcd0-4160-8198-be769a65429b on n-h1-858383-15 Oct 24 10:30:08.802802 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-1de2dd2c-2d71-4453-b3b2-9368046415b7 req-2c7de80a-7714-4cbd-b33a-3b9fce2e26f6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102296 Oct 24 10:30:08.814658 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 775/1640] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:08.825998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-93f52cab-fc8c-477d-a16a-09bc2fd52dad tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:08.827972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-93f52cab-fc8c-477d-a16a-09bc2fd52dad tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:08.836632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93f52cab-fc8c-477d-a16a-09bc2fd52dad tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:08.837728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93f52cab-fc8c-477d-a16a-09bc2fd52dad tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:08.838455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93f52cab-fc8c-477d-a16a-09bc2fd52dad tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:08.839711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93f52cab-fc8c-477d-a16a-09bc2fd52dad tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:08.840593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93f52cab-fc8c-477d-a16a-09bc2fd52dad tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:08.841444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93f52cab-fc8c-477d-a16a-09bc2fd52dad tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:08.842521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1d7cce56-1cf6-4ee7-b536-c7cbe52109e0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:08.855804 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1d7cce56-1cf6-4ee7-b536-c7cbe52109e0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 200 len: 1369 microversion: 2.1 time: 0.263891 Oct 24 10:30:08.856144 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 866/1641] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:08 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 1369 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:08.868302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-603172fc-70da-469c-aa63-cdee0af39fa1 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:08.877020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-603172fc-70da-469c-aa63-cdee0af39fa1 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:08.888261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-603172fc-70da-469c-aa63-cdee0af39fa1 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:08.888763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-603172fc-70da-469c-aa63-cdee0af39fa1 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:08.889336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-603172fc-70da-469c-aa63-cdee0af39fa1 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:08.890774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-603172fc-70da-469c-aa63-cdee0af39fa1 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:08.891455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-603172fc-70da-469c-aa63-cdee0af39fa1 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:08.892343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93f52cab-fc8c-477d-a16a-09bc2fd52dad tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:08.892918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-603172fc-70da-469c-aa63-cdee0af39fa1 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:08.893322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93f52cab-fc8c-477d-a16a-09bc2fd52dad tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:08.894762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93f52cab-fc8c-477d-a16a-09bc2fd52dad tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:08.895579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-93f52cab-fc8c-477d-a16a-09bc2fd52dad tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lazy-loading 'fault' on Instance uuid 4cf77d3a-0153-41cb-aba3-723a2aea3096 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:08.959021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-93f52cab-fc8c-477d-a16a-09bc2fd52dad tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:08.971342 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-93f52cab-fc8c-477d-a16a-09bc2fd52dad tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 200 len: 1307 microversion: 2.1 time: 0.154693 Oct 24 10:30:08.985923 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 776/1642] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:08 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 1307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:08.994063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-1147dd66-7f54-4ab1-86bf-501d17ab9897 req-8dcf235e-b5b9-40dd-8fd0-8d461406c377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c18a9a-ad67-4d8e-abd2-349766d8a002", "name": "network-vif-deleted", "tag": "0782d6f6-5f17-49c4-9ee3-4c8b802a9588"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:09.015730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1147dd66-7f54-4ab1-86bf-501d17ab9897 req-8dcf235e-b5b9-40dd-8fd0-8d461406c377 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:09.016462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1147dd66-7f54-4ab1-86bf-501d17ab9897 req-8dcf235e-b5b9-40dd-8fd0-8d461406c377 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:09.017633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1147dd66-7f54-4ab1-86bf-501d17ab9897 req-8dcf235e-b5b9-40dd-8fd0-8d461406c377 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:09.043314 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-1147dd66-7f54-4ab1-86bf-501d17ab9897 req-8dcf235e-b5b9-40dd-8fd0-8d461406c377 service nova] Creating event network-vif-deleted:0782d6f6-5f17-49c4-9ee3-4c8b802a9588 for instance 98c18a9a-ad67-4d8e-abd2-349766d8a002 on n-h2-858383-15 Oct 24 10:30:09.050297 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-1147dd66-7f54-4ab1-86bf-501d17ab9897 req-8dcf235e-b5b9-40dd-8fd0-8d461406c377 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077195 Oct 24 10:30:09.052098 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 777/1643] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:09.063759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4bbbb901-46bb-4696-8430-e58f5d26619f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:09.064981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4bbbb901-46bb-4696-8430-e58f5d26619f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:09.098201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-603172fc-70da-469c-aa63-cdee0af39fa1 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:09.145596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4bbbb901-46bb-4696-8430-e58f5d26619f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:09.155132 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-603172fc-70da-469c-aa63-cdee0af39fa1 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1931 microversion: 2.75 time: 0.292725 Oct 24 10:30:09.156995 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4bbbb901-46bb-4696-8430-e58f5d26619f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 200 len: 1208 microversion: 2.1 time: 0.103112 Oct 24 10:30:09.174939 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 778/1644] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:09 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 1208 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:09.182960 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 867/1645] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:30:08 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1931 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:30:09.187314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-4c7dbfa9-2c97-4aa3-bbe6-39dd6b83341b req-8e74d2ba-7465-4451-b717-f62504e7eb03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf77d3a-0153-41cb-aba3-723a2aea3096", "name": "network-vif-deleted", "tag": "c8ddb73d-e5b4-40cb-8aa9-348564b976e0"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:09.188069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-711a63d2-da66-4b3b-b1a7-dd9d27a3d139 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Calling method '.version_select at 0x7f04d06e5c10>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:09.200389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4c7dbfa9-2c97-4aa3-bbe6-39dd6b83341b req-8e74d2ba-7465-4451-b717-f62504e7eb03 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:09.201050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4c7dbfa9-2c97-4aa3-bbe6-39dd6b83341b req-8e74d2ba-7465-4451-b717-f62504e7eb03 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:09.201749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4c7dbfa9-2c97-4aa3-bbe6-39dd6b83341b req-8e74d2ba-7465-4451-b717-f62504e7eb03 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:09.216569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG neutronclient.v2_0.client [None req-711a63d2-da66-4b3b-b1a7-dd9d27a3d139 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f6f2e479-ee30-4aff-9586-749c85b64795 does not exist", "detail": ""}} {{(pid=120426) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:30:09.217805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.security_group_api [None req-711a63d2-da66-4b3b-b1a7-dd9d27a3d139 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Neutron security group f6f2e479-ee30-4aff-9586-749c85b64795 not found {{(pid=120426) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 10:30:09.218532 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-711a63d2-da66-4b3b-b1a7-dd9d27a3d139 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] HTTP exception thrown: Security group f6f2e479-ee30-4aff-9586-749c85b64795 does not exist Oct 24 10:30:09.218532 n-d-858383-15 devstack@n-api.service[120426]: Neutron server returns request_ids: ['req-6f24721d-2268-4de1-9abc-8d49a9cca299'] Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-711a63d2-da66-4b3b-b1a7-dd9d27a3d139 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Request method failure captured: Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-security-groups/f6f2e479-ee30-4aff-9586-749c85b64795 HTTP/1.1 Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmkuF9wLoswwrFgZ-5tO3HNYpoYKAbV4_C-xiiuCi4AOLxpsvH_OmMu9w0McJcC2bzJAkA81OePYqL_S41Mab0BuQ-6r-xaGWGr8Sbwq7m4b_wgKqgjCBngAuMqQh2VqSgv4gKk9dirNMGBe7Kmwg1JgCvDlYq9ZEFckSTi4MZ-eQAk Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: fc798f6b6014468e871ffb21fbd6d4ab Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1183589040 Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:30:09.222309 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:30:09.224047 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fc798f6b6014468e871ffb21fbd6d4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fc798f6b6014468e871ffb21fbd6d4ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fc798f6b6014468e871ffb21fbd6d4ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fc798f6b6014468e871ffb21fbd6d4ab", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:30:09.224047 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1183589040 Oct 24 10:30:09.224047 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: fc798f6b6014468e871ffb21fbd6d4ab Oct 24 10:30:09.224047 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1183589040 Oct 24 10:30:09.224047 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-SecurityGroupsNegativeTestJSON-1183589040-project Oct 24 10:30:09.224047 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:30:09.224047 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:30:09.224047 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 9274ed9a436746c480bab6a9df3965fa Oct 24 10:30:09.224047 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1183589040-project Oct 24 10:30:09.224047 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:30:09.224047 n-d-858383-15 devstack@n-api.service[120426]: exception: Security group f6f2e479-ee30-4aff-9586-749c85b64795 does not exist Oct 24 10:30:09.224047 n-d-858383-15 devstack@n-api.service[120426]: Neutron server returns request_ids: ['req-6f24721d-2268-4de1-9abc-8d49a9cca299'] Oct 24 10:30:09.224047 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'f6f2e479-ee30-4aff-9586-749c85b64795'} Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:09.225105 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:30:09.227096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:30:09.227096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:09.227096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:09.227096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:30:09.227096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:30:09.227096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:30:09.227096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:30:09.227096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f6f2e479-ee30-4aff-9586-749c85b64795 does not exist Oct 24 10:30:09.227096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f24721d-2268-4de1-9abc-8d49a9cca299'] Oct 24 10:30:09.227096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:09.227096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:09.227096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:09.227096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:09.227096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 24 10:30:09.227096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 10:30:09.227096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 10:30:09.227096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 10:30:09.227096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f6f2e479-ee30-4aff-9586-749c85b64795 does not exist Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f24721d-2268-4de1-9abc-8d49a9cca299'] Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f6f2e479-ee30-4aff-9586-749c85b64795 does not exist Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f24721d-2268-4de1-9abc-8d49a9cca299'] Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:09.231321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:09.232726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:09.232726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:09.232726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:30:09.232726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:30:09.232726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f6f2e479-ee30-4aff-9586-749c85b64795 does not exist Oct 24 10:30:09.232726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f24721d-2268-4de1-9abc-8d49a9cca299'] Oct 24 10:30:09.232726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:09.241716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-711a63d2-da66-4b3b-b1a7-dd9d27a3d139 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Returning 404 to user: Security group f6f2e479-ee30-4aff-9586-749c85b64795 does not exist Oct 24 10:30:09.241716 n-d-858383-15 devstack@n-api.service[120426]: Neutron server returns request_ids: ['req-6f24721d-2268-4de1-9abc-8d49a9cca299'] {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:30:09.245432 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-711a63d2-da66-4b3b-b1a7-dd9d27a3d139 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/f6f2e479-ee30-4aff-9586-749c85b64795" status: 404 len: 194 microversion: 2.1 time: 0.061241 Oct 24 10:30:09.247057 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-4c7dbfa9-2c97-4aa3-bbe6-39dd6b83341b req-8e74d2ba-7465-4451-b717-f62504e7eb03 service nova] Creating event network-vif-deleted:c8ddb73d-e5b4-40cb-8aa9-348564b976e0 for instance 4cf77d3a-0153-41cb-aba3-723a2aea3096 on n-h2-858383-15 Oct 24 10:30:09.256960 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 868/1646] 10.222.0.50 () {58 vars in 1269 bytes} [Mon Oct 24 10:30:09 2022] GET /compute/v2.1/os-security-groups/f6f2e479-ee30-4aff-9586-749c85b64795 => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:30:09.272520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-296a054e-0752-4f50-938b-13fe9de86ac9 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:09.272765 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-4c7dbfa9-2c97-4aa3-bbe6-39dd6b83341b req-8e74d2ba-7465-4451-b717-f62504e7eb03 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094187 Oct 24 10:30:09.272765 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 779/1647] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:09.277241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-296a054e-0752-4f50-938b-13fe9de86ac9 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:09.295746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-85532918-b1e2-4576-aaf4-08e4b5e15104 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Action: 'update', calling method: .version_select at 0x7f04d0b0b040>, body: {"security_group": {"name": "tempest-sg-1582578265", "description": "tempest-description-1227741820"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:09.327399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-296a054e-0752-4f50-938b-13fe9de86ac9 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:09.329331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-296a054e-0752-4f50-938b-13fe9de86ac9 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:09.330458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-296a054e-0752-4f50-938b-13fe9de86ac9 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:09.333009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-296a054e-0752-4f50-938b-13fe9de86ac9 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:09.333898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-296a054e-0752-4f50-938b-13fe9de86ac9 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:09.335268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-296a054e-0752-4f50-938b-13fe9de86ac9 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:09.364714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG neutronclient.v2_0.client [None req-85532918-b1e2-4576-aaf4-08e4b5e15104 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e2daf955-fad3-46cf-910b-59a358c2613c does not exist", "detail": ""}} {{(pid=120425) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:30:09.365457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.security_group_api [None req-85532918-b1e2-4576-aaf4-08e4b5e15104 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Neutron security group e2daf955-fad3-46cf-910b-59a358c2613c not found {{(pid=120425) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 10:30:09.366094 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-85532918-b1e2-4576-aaf4-08e4b5e15104 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] HTTP exception thrown: Security group e2daf955-fad3-46cf-910b-59a358c2613c does not exist Oct 24 10:30:09.366094 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-df517a39-c59e-4bf0-84cc-734830be35be'] Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-85532918-b1e2-4576-aaf4-08e4b5e15104 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Request method failure captured: Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: request: PUT /compute/v2.1/os-security-groups/e2daf955-fad3-46cf-910b-59a358c2613c HTTP/1.1 Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 102 Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmkuF9wLoswwrFgZ-5tO3HNYpoYKAbV4_C-xiiuCi4AOLxpsvH_OmMu9w0McJcC2bzJAkA81OePYqL_S41Mab0BuQ-6r-xaGWGr8Sbwq7m4b_wgKqgjCBngAuMqQh2VqSgv4gKk9dirNMGBe7Kmwg1JgCvDlYq9ZEFckSTi4MZ-eQAk Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: fc798f6b6014468e871ffb21fbd6d4ab Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1183589040 Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:30:09.376036 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:30:09.378567 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fc798f6b6014468e871ffb21fbd6d4ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fc798f6b6014468e871ffb21fbd6d4ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fc798f6b6014468e871ffb21fbd6d4ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fc798f6b6014468e871ffb21fbd6d4ab", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:30:09.378567 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1183589040 Oct 24 10:30:09.378567 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: fc798f6b6014468e871ffb21fbd6d4ab Oct 24 10:30:09.378567 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1183589040 Oct 24 10:30:09.378567 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupsNegativeTestJSON-1183589040-project Oct 24 10:30:09.378567 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:30:09.378567 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:30:09.378567 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 9274ed9a436746c480bab6a9df3965fa Oct 24 10:30:09.378567 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1183589040-project Oct 24 10:30:09.378567 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:30:09.378567 n-d-858383-15 devstack@n-api.service[120425]: {"security_group": {"name": "tempest-sg-1582578265", "description": "tempest-description-1227741820"}} Oct 24 10:30:09.378567 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:30:09.378567 n-d-858383-15 devstack@n-api.service[120425]: exception: Security group e2daf955-fad3-46cf-910b-59a358c2613c does not exist Oct 24 10:30:09.379929 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-df517a39-c59e-4bf0-84cc-734830be35be'] Oct 24 10:30:09.379929 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'e2daf955-fad3-46cf-910b-59a358c2613c', 'body': {'security_group': {'name': 'tempest-sg-1582578265', 'description': 'tempest-description-1227741820'}}} Oct 24 10:30:09.379929 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:30:09.379929 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:09.379929 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 10:30:09.379929 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 10:30:09.379929 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:09.379929 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:09.379929 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 10:30:09.379929 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 10:30:09.379929 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:09.379929 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:09.379929 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:30:09.379929 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:30:09.379929 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:09.379929 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:09.379929 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:30:09.379929 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e2daf955-fad3-46cf-910b-59a358c2613c does not exist Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df517a39-c59e-4bf0-84cc-734830be35be'] Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 10:30:09.381603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e2daf955-fad3-46cf-910b-59a358c2613c does not exist Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df517a39-c59e-4bf0-84cc-734830be35be'] Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e2daf955-fad3-46cf-910b-59a358c2613c does not exist Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df517a39-c59e-4bf0-84cc-734830be35be'] Oct 24 10:30:09.383618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:09.385600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:09.385600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:09.385600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:09.385600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:09.385600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:09.385600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:30:09.385600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:30:09.385600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e2daf955-fad3-46cf-910b-59a358c2613c does not exist Oct 24 10:30:09.385600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df517a39-c59e-4bf0-84cc-734830be35be'] Oct 24 10:30:09.385600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:09.385600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-85532918-b1e2-4576-aaf4-08e4b5e15104 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] Returning 404 to user: Security group e2daf955-fad3-46cf-910b-59a358c2613c does not exist Oct 24 10:30:09.385600 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-df517a39-c59e-4bf0-84cc-734830be35be'] {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:30:09.385600 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-85532918-b1e2-4576-aaf4-08e4b5e15104 tempest-SecurityGroupsNegativeTestJSON-1183589040 tempest-SecurityGroupsNegativeTestJSON-1183589040-project] 10.222.0.50 "PUT /compute/v2.1/os-security-groups/e2daf955-fad3-46cf-910b-59a358c2613c" status: 404 len: 194 microversion: 2.1 time: 0.099036 Oct 24 10:30:09.386977 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 780/1648] 10.222.0.50 () {60 vars in 1290 bytes} [Mon Oct 24 10:30:09 2022] PUT /compute/v2.1/os-security-groups/e2daf955-fad3-46cf-910b-59a358c2613c => generated 194 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:30:09.937893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-06a7d7fc-3b6c-4473-9f6f-32fe0632d5aa tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:09.944077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-06a7d7fc-3b6c-4473-9f6f-32fe0632d5aa tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 98c18a9a-ad67-4d8e-abd2-349766d8a002] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:09.970147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06a7d7fc-3b6c-4473-9f6f-32fe0632d5aa tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:09.971165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06a7d7fc-3b6c-4473-9f6f-32fe0632d5aa tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:09.973416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06a7d7fc-3b6c-4473-9f6f-32fe0632d5aa tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:09.977675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06a7d7fc-3b6c-4473-9f6f-32fe0632d5aa tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:09.979802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06a7d7fc-3b6c-4473-9f6f-32fe0632d5aa tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:09.982942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06a7d7fc-3b6c-4473-9f6f-32fe0632d5aa tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:10.018003 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-06a7d7fc-3b6c-4473-9f6f-32fe0632d5aa tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] HTTP exception thrown: Instance 98c18a9a-ad67-4d8e-abd2-349766d8a002 could not be found. Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-06a7d7fc-3b6c-4473-9f6f-32fe0632d5aa tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Request method failure captured: Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 HTTP/1.1 Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmfTgiVQkFreHjUnM8-9M4WXdVFFo3TwbYUuG90tWMf2U84Ct43t2RwFf9lp6Koocs_zPZzrCgx5V-uG_TrbOvXwkjInhf2fsg4sP_gV4bmp_eUqwH3j4gAJjxf3-J-L2cM0sKsq5wfN7DvL6M_aE1fA6jhg_Su-jUer19zeP7djDKU Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: ac5f703504204b91a5c7e895964ec985 Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-MigrationsAdminTest-1912783839 Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:30:10.019617 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:30:10.021378 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ac5f703504204b91a5c7e895964ec985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ac5f703504204b91a5c7e895964ec985"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ac5f703504204b91a5c7e895964ec985"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ac5f703504204b91a5c7e895964ec985", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:30:10.021378 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-MigrationsAdminTest-1912783839 Oct 24 10:30:10.021378 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: ac5f703504204b91a5c7e895964ec985 Oct 24 10:30:10.021378 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-MigrationsAdminTest-1912783839 Oct 24 10:30:10.021378 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-MigrationsAdminTest-1912783839-project Oct 24 10:30:10.021378 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:30:10.021378 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:30:10.021378 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: b684c865fc9e4abb8e0e55616087b92e Oct 24 10:30:10.021378 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-MigrationsAdminTest-1912783839-project Oct 24 10:30:10.021378 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:30:10.021378 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 98c18a9a-ad67-4d8e-abd2-349766d8a002 could not be found. Oct 24 10:30:10.021378 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '98c18a9a-ad67-4d8e-abd2-349766d8a002'} Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98c18a9a-ad67-4d8e-abd2-349766d8a002 could not be found. Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:30:10.022312 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:30:10.024814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:30:10.024814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:30:10.024814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:30:10.024814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:30:10.024814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:30:10.024814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:30:10.024814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:30:10.024814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98c18a9a-ad67-4d8e-abd2-349766d8a002 could not be found. Oct 24 10:30:10.024814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:10.024814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:10.024814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:10.024814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:10.024814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:10.024814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:10.024814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:30:10.024814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:30:10.024814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98c18a9a-ad67-4d8e-abd2-349766d8a002 could not be found. Oct 24 10:30:10.024814 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:10.026502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-06a7d7fc-3b6c-4473-9f6f-32fe0632d5aa tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Returning 404 to user: Instance 98c18a9a-ad67-4d8e-abd2-349766d8a002 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:30:10.026502 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-06a7d7fc-3b6c-4473-9f6f-32fe0632d5aa tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002" status: 404 len: 111 microversion: 2.1 time: 0.113903 Oct 24 10:30:10.027298 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 781/1649] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:09 2022] GET /compute/v2.1/servers/98c18a9a-ad67-4d8e-abd2-349766d8a002 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:30:10.041995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3d9a6a37-4339-404f-8366-b2b5df140e3e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:10.044817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3d9a6a37-4339-404f-8366-b2b5df140e3e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:10.058186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d9a6a37-4339-404f-8366-b2b5df140e3e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:10.067949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d9a6a37-4339-404f-8366-b2b5df140e3e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:10.070392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d9a6a37-4339-404f-8366-b2b5df140e3e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:10.073034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d9a6a37-4339-404f-8366-b2b5df140e3e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:10.073527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d9a6a37-4339-404f-8366-b2b5df140e3e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:10.073967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d9a6a37-4339-404f-8366-b2b5df140e3e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:10.138829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d9a6a37-4339-404f-8366-b2b5df140e3e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:10.139518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d9a6a37-4339-404f-8366-b2b5df140e3e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:10.140113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d9a6a37-4339-404f-8366-b2b5df140e3e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:10.140742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-3d9a6a37-4339-404f-8366-b2b5df140e3e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lazy-loading 'fault' on Instance uuid 4cf77d3a-0153-41cb-aba3-723a2aea3096 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:10.141444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-296a054e-0752-4f50-938b-13fe9de86ac9 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:10.155130 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-296a054e-0752-4f50-938b-13fe9de86ac9 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1350 microversion: 2.1 time: 0.896015 Oct 24 10:30:10.168519 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 869/1650] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:09 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1350 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:10.192701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-67d66ea0-92b5-4d87-9810-e8e3367361d0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '.version_select at 0x7f04d06189d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:10.260179 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-67d66ea0-92b5-4d87-9810-e8e3367361d0 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049449881" status: 202 len: 0 microversion: 2.1 time: 0.087552 Oct 24 10:30:10.261605 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 870/1651] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Oct 24 10:30:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049449881 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:30:10.304897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-40413fbc-f305-4c73-beb1-953fa59d457b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:10.305955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-40413fbc-f305-4c73-beb1-953fa59d457b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:10.331027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40413fbc-f305-4c73-beb1-953fa59d457b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:10.331735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40413fbc-f305-4c73-beb1-953fa59d457b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:10.332089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40413fbc-f305-4c73-beb1-953fa59d457b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:10.340579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40413fbc-f305-4c73-beb1-953fa59d457b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:10.341456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40413fbc-f305-4c73-beb1-953fa59d457b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:10.342070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40413fbc-f305-4c73-beb1-953fa59d457b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:10.485894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3d9a6a37-4339-404f-8366-b2b5df140e3e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:10.496516 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3d9a6a37-4339-404f-8366-b2b5df140e3e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 200 len: 1307 microversion: 2.1 time: 0.464743 Oct 24 10:30:10.505769 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 782/1652] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:10 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 1307 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:10.524046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68b596b6-9ea7-48a9-8467-5dc79ad8ab0b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:10.525163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-68b596b6-9ea7-48a9-8467-5dc79ad8ab0b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:10.552433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68b596b6-9ea7-48a9-8467-5dc79ad8ab0b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:10.558828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68b596b6-9ea7-48a9-8467-5dc79ad8ab0b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:10.563114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68b596b6-9ea7-48a9-8467-5dc79ad8ab0b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:10.567861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68b596b6-9ea7-48a9-8467-5dc79ad8ab0b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:10.568781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68b596b6-9ea7-48a9-8467-5dc79ad8ab0b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:10.569544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68b596b6-9ea7-48a9-8467-5dc79ad8ab0b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:10.692354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-40413fbc-f305-4c73-beb1-953fa59d457b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:10.706653 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-40413fbc-f305-4c73-beb1-953fa59d457b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 200 len: 1204 microversion: 2.1 time: 0.443624 Oct 24 10:30:10.721592 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 871/1653] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:10 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 1204 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:10.920538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-0ab2d03d-d980-46f7-a7f4-c57da7914a46 req-1145f7ff-ce18-4edd-9238-d8b7f2341ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a43af20e-f775-4549-9ee3-1560a5b43b7d", "name": "network-vif-unplugged", "status": "completed", "tag": "540ebdb6-65eb-4451-aafd-a3f1d1fd0a82"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:10.946853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-0ab2d03d-d980-46f7-a7f4-c57da7914a46 req-1145f7ff-ce18-4edd-9238-d8b7f2341ec4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:10.947877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-68b596b6-9ea7-48a9-8467-5dc79ad8ab0b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:10.952337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-0ab2d03d-d980-46f7-a7f4-c57da7914a46 req-1145f7ff-ce18-4edd-9238-d8b7f2341ec4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:10.952988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-0ab2d03d-d980-46f7-a7f4-c57da7914a46 req-1145f7ff-ce18-4edd-9238-d8b7f2341ec4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:10.985498 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-0ab2d03d-d980-46f7-a7f4-c57da7914a46 req-1145f7ff-ce18-4edd-9238-d8b7f2341ec4 service nova] Creating event network-vif-unplugged:540ebdb6-65eb-4451-aafd-a3f1d1fd0a82 for instance a43af20e-f775-4549-9ee3-1560a5b43b7d on n-h1-858383-15 Oct 24 10:30:10.998896 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-68b596b6-9ea7-48a9-8467-5dc79ad8ab0b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1949 microversion: 2.75 time: 0.491595 Oct 24 10:30:11.000925 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 783/1654] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:30:10 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1949 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:30:11.016410 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-0ab2d03d-d980-46f7-a7f4-c57da7914a46 req-1145f7ff-ce18-4edd-9238-d8b7f2341ec4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101156 Oct 24 10:30:11.018013 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 872/1655] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:30:11.179027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4592e5c1-e241-48c1-99e1-90e30e035675 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:11.180668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4592e5c1-e241-48c1-99e1-90e30e035675 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:11.191963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4592e5c1-e241-48c1-99e1-90e30e035675 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:11.192467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4592e5c1-e241-48c1-99e1-90e30e035675 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:11.192938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4592e5c1-e241-48c1-99e1-90e30e035675 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:11.193650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4592e5c1-e241-48c1-99e1-90e30e035675 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:11.194102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4592e5c1-e241-48c1-99e1-90e30e035675 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:11.194538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4592e5c1-e241-48c1-99e1-90e30e035675 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:11.529601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-87c60c49-6a15-407c-94d8-07488bad4239 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:11.532434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-87c60c49-6a15-407c-94d8-07488bad4239 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 4cf77d3a-0153-41cb-aba3-723a2aea3096] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:11.551718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:11.559018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87c60c49-6a15-407c-94d8-07488bad4239 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:11.559936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87c60c49-6a15-407c-94d8-07488bad4239 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:11.560638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87c60c49-6a15-407c-94d8-07488bad4239 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:11.561779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87c60c49-6a15-407c-94d8-07488bad4239 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:11.562617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87c60c49-6a15-407c-94d8-07488bad4239 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:11.563246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87c60c49-6a15-407c-94d8-07488bad4239 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:11.589060 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-87c60c49-6a15-407c-94d8-07488bad4239 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] HTTP exception thrown: Instance 4cf77d3a-0153-41cb-aba3-723a2aea3096 could not be found. Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-87c60c49-6a15-407c-94d8-07488bad4239 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Request method failure captured: Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 HTTP/1.1 Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmhXqNSBsh7K7Uj2jXvR0yTVG9LTHhhGPCF6c-R_uu5XAWXN3q_pOqU3EQ6kswdvFK06P0vNock9UqKjP52kirztfJqRQ9SK9bbaCmdkDeP1GYXpg5nJ_Ea2cS2kg-fXYgatWKicP0gLPLbADF61RGIaCfWEQwHUVVkXN2VQjipCuYA Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: b565572c0c8c4871af02471a328bd1af Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:30:11.596384 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:30:11.598197 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b565572c0c8c4871af02471a328bd1af", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:30:11.598197 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:11.598197 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: b565572c0c8c4871af02471a328bd1af Oct 24 10:30:11.598197 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:11.598197 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersOnMultiNodesTest-2087726178-project Oct 24 10:30:11.598197 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:30:11.598197 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:30:11.598197 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 9aa572f1e5014e10bed0abe34dfad43f Oct 24 10:30:11.598197 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersOnMultiNodesTest-2087726178-project Oct 24 10:30:11.598197 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:30:11.598197 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 4cf77d3a-0153-41cb-aba3-723a2aea3096 could not be found. Oct 24 10:30:11.598197 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '4cf77d3a-0153-41cb-aba3-723a2aea3096'} Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cf77d3a-0153-41cb-aba3-723a2aea3096 could not be found. Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:30:11.599050 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:30:11.600399 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:30:11.600399 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:30:11.600399 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:30:11.600399 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:30:11.600399 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:30:11.600399 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:30:11.600399 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:30:11.600399 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cf77d3a-0153-41cb-aba3-723a2aea3096 could not be found. Oct 24 10:30:11.600399 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:11.600399 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:11.600399 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:11.600399 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:11.600399 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:11.600399 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:11.600399 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:30:11.600399 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:30:11.600399 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cf77d3a-0153-41cb-aba3-723a2aea3096 could not be found. Oct 24 10:30:11.600399 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:11.605343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-87c60c49-6a15-407c-94d8-07488bad4239 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Returning 404 to user: Instance 4cf77d3a-0153-41cb-aba3-723a2aea3096 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:30:11.605343 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-87c60c49-6a15-407c-94d8-07488bad4239 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096" status: 404 len: 111 microversion: 2.1 time: 0.075154 Oct 24 10:30:11.605343 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 873/1656] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:11 2022] GET /compute/v2.1/servers/4cf77d3a-0153-41cb-aba3-723a2aea3096 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:30:11.612634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2b1b0d80-f393-4d2c-a63c-8b5f9f422539 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:11.614017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2b1b0d80-f393-4d2c-a63c-8b5f9f422539 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:11.641865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1b0d80-f393-4d2c-a63c-8b5f9f422539 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:11.642367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1b0d80-f393-4d2c-a63c-8b5f9f422539 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:11.642807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1b0d80-f393-4d2c-a63c-8b5f9f422539 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:11.646887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1b0d80-f393-4d2c-a63c-8b5f9f422539 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:11.649044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1b0d80-f393-4d2c-a63c-8b5f9f422539 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:11.649680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1b0d80-f393-4d2c-a63c-8b5f9f422539 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:11.716620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2b1b0d80-f393-4d2c-a63c-8b5f9f422539 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:30:11.756096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4592e5c1-e241-48c1-99e1-90e30e035675 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:11.765312 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4592e5c1-e241-48c1-99e1-90e30e035675 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1350 microversion: 2.1 time: 0.590208 Oct 24 10:30:11.790564 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 784/1657] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:11 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1350 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:11.798212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5b080b88-ce58-445e-8d1a-dc58fc824dcc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:11.809701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5b080b88-ce58-445e-8d1a-dc58fc824dcc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:11.816433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b080b88-ce58-445e-8d1a-dc58fc824dcc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:11.821957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b080b88-ce58-445e-8d1a-dc58fc824dcc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:11.822475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b080b88-ce58-445e-8d1a-dc58fc824dcc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:11.823239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b080b88-ce58-445e-8d1a-dc58fc824dcc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:11.841809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b080b88-ce58-445e-8d1a-dc58fc824dcc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:11.843286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b080b88-ce58-445e-8d1a-dc58fc824dcc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:11.894787 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2b1b0d80-f393-4d2c-a63c-8b5f9f422539 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "DELETE /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 204 len: 0 microversion: 2.1 time: 0.288114 Oct 24 10:30:11.897598 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 874/1658] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:30:11 2022] DELETE /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:30:11.911005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f44a1da8-2730-4ff6-a3b2-15837fcde552 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:11.912765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f44a1da8-2730-4ff6-a3b2-15837fcde552 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:11.918263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5b080b88-ce58-445e-8d1a-dc58fc824dcc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:30:11.933872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f44a1da8-2730-4ff6-a3b2-15837fcde552 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:11.934432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f44a1da8-2730-4ff6-a3b2-15837fcde552 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:11.936360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f44a1da8-2730-4ff6-a3b2-15837fcde552 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:11.937333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f44a1da8-2730-4ff6-a3b2-15837fcde552 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:11.938581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f44a1da8-2730-4ff6-a3b2-15837fcde552 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:11.940657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f44a1da8-2730-4ff6-a3b2-15837fcde552 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:12.006389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:12.118628 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5b080b88-ce58-445e-8d1a-dc58fc824dcc tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 204 len: 0 microversion: 2.1 time: 0.325574 Oct 24 10:30:12.119565 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 785/1659] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:30:11 2022] DELETE /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:30:12.126582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-41683b41-9f04-4233-8391-09ff92a08938 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:12.127294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-41683b41-9f04-4233-8391-09ff92a08938 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:12.140540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41683b41-9f04-4233-8391-09ff92a08938 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:12.143385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41683b41-9f04-4233-8391-09ff92a08938 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:12.145830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41683b41-9f04-4233-8391-09ff92a08938 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:12.147339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41683b41-9f04-4233-8391-09ff92a08938 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:12.150172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41683b41-9f04-4233-8391-09ff92a08938 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:12.150634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41683b41-9f04-4233-8391-09ff92a08938 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:12.172792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f44a1da8-2730-4ff6-a3b2-15837fcde552 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:12.183298 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f44a1da8-2730-4ff6-a3b2-15837fcde552 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 200 len: 1268 microversion: 2.1 time: 0.282958 Oct 24 10:30:12.199342 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 875/1660] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:11 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 1268 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:12.199342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2c87d8e4-4cf6-4b8b-ad0b-869e53bb2a8d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:12.199342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2c87d8e4-4cf6-4b8b-ad0b-869e53bb2a8d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:12.209071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c87d8e4-4cf6-4b8b-ad0b-869e53bb2a8d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:12.209644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c87d8e4-4cf6-4b8b-ad0b-869e53bb2a8d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:12.210291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c87d8e4-4cf6-4b8b-ad0b-869e53bb2a8d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:12.212471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c87d8e4-4cf6-4b8b-ad0b-869e53bb2a8d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:12.214061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c87d8e4-4cf6-4b8b-ad0b-869e53bb2a8d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:12.214985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c87d8e4-4cf6-4b8b-ad0b-869e53bb2a8d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:12.427589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-2c87d8e4-4cf6-4b8b-ad0b-869e53bb2a8d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:12.463637 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2c87d8e4-4cf6-4b8b-ad0b-869e53bb2a8d tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1937 microversion: 2.75 time: 0.268794 Oct 24 10:30:12.469315 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 876/1661] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:30:12 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1937 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:30:12.476911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9a666c22-a5dd-46e9-8c3b-614553eba66a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:12.477575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9a666c22-a5dd-46e9-8c3b-614553eba66a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:12.490470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a666c22-a5dd-46e9-8c3b-614553eba66a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:12.491709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a666c22-a5dd-46e9-8c3b-614553eba66a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:12.493488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a666c22-a5dd-46e9-8c3b-614553eba66a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:12.494206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a666c22-a5dd-46e9-8c3b-614553eba66a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:12.494708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a666c22-a5dd-46e9-8c3b-614553eba66a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:12.495084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a666c22-a5dd-46e9-8c3b-614553eba66a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:12.616412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-41683b41-9f04-4233-8391-09ff92a08938 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:12.632358 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-41683b41-9f04-4233-8391-09ff92a08938 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1473 microversion: 2.1 time: 0.510891 Oct 24 10:30:12.640888 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 786/1662] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:12 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1473 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:12.640888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-97efe11a-867d-4940-a980-aa98be3f2c05 req-fb43756e-6f29-4464-aa6a-f5aaa1fbc7fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a43af20e-f775-4549-9ee3-1560a5b43b7d", "name": "network-vif-deleted", "tag": "540ebdb6-65eb-4451-aafd-a3f1d1fd0a82"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:12.657262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-97efe11a-867d-4940-a980-aa98be3f2c05 req-fb43756e-6f29-4464-aa6a-f5aaa1fbc7fd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:12.657836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-97efe11a-867d-4940-a980-aa98be3f2c05 req-fb43756e-6f29-4464-aa6a-f5aaa1fbc7fd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:12.658813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-97efe11a-867d-4940-a980-aa98be3f2c05 req-fb43756e-6f29-4464-aa6a-f5aaa1fbc7fd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:12.671363 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-97efe11a-867d-4940-a980-aa98be3f2c05 req-fb43756e-6f29-4464-aa6a-f5aaa1fbc7fd service nova] Creating event network-vif-deleted:540ebdb6-65eb-4451-aafd-a3f1d1fd0a82 for instance a43af20e-f775-4549-9ee3-1560a5b43b7d on n-h1-858383-15 Oct 24 10:30:12.676866 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-97efe11a-867d-4940-a980-aa98be3f2c05 req-fb43756e-6f29-4464-aa6a-f5aaa1fbc7fd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039853 Oct 24 10:30:12.677603 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 787/1663] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:12.762999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9a666c22-a5dd-46e9-8c3b-614553eba66a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:12.771620 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9a666c22-a5dd-46e9-8c3b-614553eba66a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1467 microversion: 2.1 time: 0.301214 Oct 24 10:30:12.772588 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 877/1664] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:12 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1467 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:12.799351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-61cf38ad-7d88-4227-9697-4bdff1e0e372 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:12.800066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-61cf38ad-7d88-4227-9697-4bdff1e0e372 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:12.807118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61cf38ad-7d88-4227-9697-4bdff1e0e372 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:12.807816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61cf38ad-7d88-4227-9697-4bdff1e0e372 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:12.808872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61cf38ad-7d88-4227-9697-4bdff1e0e372 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:12.809220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61cf38ad-7d88-4227-9697-4bdff1e0e372 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:12.809685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61cf38ad-7d88-4227-9697-4bdff1e0e372 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:12.810119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61cf38ad-7d88-4227-9697-4bdff1e0e372 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:13.028423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-61cf38ad-7d88-4227-9697-4bdff1e0e372 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:13.036617 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-61cf38ad-7d88-4227-9697-4bdff1e0e372 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1539 microversion: 2.1 time: 0.244375 Oct 24 10:30:13.056878 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 788/1665] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:12 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1539 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:13.065609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7d64fdeb-742c-4efd-9deb-a1afa210e432 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:13.066388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7d64fdeb-742c-4efd-9deb-a1afa210e432 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:13.073720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d64fdeb-742c-4efd-9deb-a1afa210e432 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:13.074160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d64fdeb-742c-4efd-9deb-a1afa210e432 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:13.074600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d64fdeb-742c-4efd-9deb-a1afa210e432 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:13.075311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d64fdeb-742c-4efd-9deb-a1afa210e432 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:13.075776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d64fdeb-742c-4efd-9deb-a1afa210e432 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:13.076197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d64fdeb-742c-4efd-9deb-a1afa210e432 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:13.209867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f09a2299-2886-44e6-b332-d9e8dd25364b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:13.212524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f09a2299-2886-44e6-b332-d9e8dd25364b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:13.220180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f09a2299-2886-44e6-b332-d9e8dd25364b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:13.220964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f09a2299-2886-44e6-b332-d9e8dd25364b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:13.222532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f09a2299-2886-44e6-b332-d9e8dd25364b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:13.224336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f09a2299-2886-44e6-b332-d9e8dd25364b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:13.225021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f09a2299-2886-44e6-b332-d9e8dd25364b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:13.226154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f09a2299-2886-44e6-b332-d9e8dd25364b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:13.237100 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7d64fdeb-742c-4efd-9deb-a1afa210e432 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175191 Oct 24 10:30:13.237696 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 878/1666] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 10:30:13 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:13.495810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fd24dc7c-7a6d-4413-a1e8-963451a7147b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:13.496773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fd24dc7c-7a6d-4413-a1e8-963451a7147b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:13.508902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd24dc7c-7a6d-4413-a1e8-963451a7147b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:13.509416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd24dc7c-7a6d-4413-a1e8-963451a7147b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:13.510126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd24dc7c-7a6d-4413-a1e8-963451a7147b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:13.511118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd24dc7c-7a6d-4413-a1e8-963451a7147b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:13.511577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd24dc7c-7a6d-4413-a1e8-963451a7147b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:13.512250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd24dc7c-7a6d-4413-a1e8-963451a7147b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:13.732664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f09a2299-2886-44e6-b332-d9e8dd25364b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:13.745137 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f09a2299-2886-44e6-b332-d9e8dd25364b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 200 len: 1278 microversion: 2.1 time: 0.540022 Oct 24 10:30:13.760925 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 789/1667] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:13 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 1278 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:13.761302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-fd24dc7c-7a6d-4413-a1e8-963451a7147b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:13.761407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d2339405-b07f-4b2d-9ad8-8ba6ea6b1e8d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:13.761407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d2339405-b07f-4b2d-9ad8-8ba6ea6b1e8d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:13.765072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2339405-b07f-4b2d-9ad8-8ba6ea6b1e8d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:13.765571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2339405-b07f-4b2d-9ad8-8ba6ea6b1e8d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:13.766011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2339405-b07f-4b2d-9ad8-8ba6ea6b1e8d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:13.766730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2339405-b07f-4b2d-9ad8-8ba6ea6b1e8d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:13.767712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2339405-b07f-4b2d-9ad8-8ba6ea6b1e8d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:13.768158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2339405-b07f-4b2d-9ad8-8ba6ea6b1e8d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:13.782280 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fd24dc7c-7a6d-4413-a1e8-963451a7147b tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1937 microversion: 2.75 time: 0.290246 Oct 24 10:30:13.783603 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 879/1668] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:30:13 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1937 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:30:13.806624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-00d3110d-570f-4ce3-bb33-38b5ac7e8d6f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:13.809821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-00d3110d-570f-4ce3-bb33-38b5ac7e8d6f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:13.823635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00d3110d-570f-4ce3-bb33-38b5ac7e8d6f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:13.824137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00d3110d-570f-4ce3-bb33-38b5ac7e8d6f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:13.825176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00d3110d-570f-4ce3-bb33-38b5ac7e8d6f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:13.825922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00d3110d-570f-4ce3-bb33-38b5ac7e8d6f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:13.826382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00d3110d-570f-4ce3-bb33-38b5ac7e8d6f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:13.827340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00d3110d-570f-4ce3-bb33-38b5ac7e8d6f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:14.388316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d2339405-b07f-4b2d-9ad8-8ba6ea6b1e8d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:14.404738 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d2339405-b07f-4b2d-9ad8-8ba6ea6b1e8d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1473 microversion: 2.1 time: 0.656985 Oct 24 10:30:14.424290 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 790/1669] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:13 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1473 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:14.538229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-00d3110d-570f-4ce3-bb33-38b5ac7e8d6f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:14.548187 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-00d3110d-570f-4ce3-bb33-38b5ac7e8d6f tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1467 microversion: 2.1 time: 0.751752 Oct 24 10:30:14.560614 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 880/1670] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:13 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1467 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:14.772064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-974f8a11-b27a-41a2-98ae-7af22672f8a9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:14.772976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-974f8a11-b27a-41a2-98ae-7af22672f8a9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:14.791466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-974f8a11-b27a-41a2-98ae-7af22672f8a9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:14.796823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-974f8a11-b27a-41a2-98ae-7af22672f8a9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:14.797398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-974f8a11-b27a-41a2-98ae-7af22672f8a9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:14.798226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-974f8a11-b27a-41a2-98ae-7af22672f8a9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:14.799221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-974f8a11-b27a-41a2-98ae-7af22672f8a9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:14.799221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-974f8a11-b27a-41a2-98ae-7af22672f8a9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:14.817867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ad3bba36-8bb5-40c4-b065-1eec601f71cb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:14.818572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ad3bba36-8bb5-40c4-b065-1eec601f71cb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:14.833211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad3bba36-8bb5-40c4-b065-1eec601f71cb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:14.833985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad3bba36-8bb5-40c4-b065-1eec601f71cb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:14.837962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad3bba36-8bb5-40c4-b065-1eec601f71cb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:14.838892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad3bba36-8bb5-40c4-b065-1eec601f71cb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:14.839508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad3bba36-8bb5-40c4-b065-1eec601f71cb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:14.840093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad3bba36-8bb5-40c4-b065-1eec601f71cb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:15.056174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-974f8a11-b27a-41a2-98ae-7af22672f8a9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:15.065535 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-974f8a11-b27a-41a2-98ae-7af22672f8a9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 200 len: 1266 microversion: 2.1 time: 0.298375 Oct 24 10:30:15.081430 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 791/1671] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:14 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:15.114684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-ad3bba36-8bb5-40c4-b065-1eec601f71cb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:15.163149 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ad3bba36-8bb5-40c4-b065-1eec601f71cb tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1937 microversion: 2.75 time: 0.348211 Oct 24 10:30:15.165640 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 881/1672] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:30:14 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1937 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:30:15.435818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c60ae7fb-58c1-4aba-b234-fd04e2b862a5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:15.436442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c60ae7fb-58c1-4aba-b234-fd04e2b862a5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:15.461918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c60ae7fb-58c1-4aba-b234-fd04e2b862a5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:15.462718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c60ae7fb-58c1-4aba-b234-fd04e2b862a5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:15.464598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c60ae7fb-58c1-4aba-b234-fd04e2b862a5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:15.471526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c60ae7fb-58c1-4aba-b234-fd04e2b862a5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:15.473206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c60ae7fb-58c1-4aba-b234-fd04e2b862a5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:15.474207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c60ae7fb-58c1-4aba-b234-fd04e2b862a5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:15.529570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:15.591855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-611a5b72-f55a-488d-a0be-c77de0bcd154 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:15.592628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-611a5b72-f55a-488d-a0be-c77de0bcd154 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:15.624767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-611a5b72-f55a-488d-a0be-c77de0bcd154 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:15.626334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-611a5b72-f55a-488d-a0be-c77de0bcd154 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:15.628109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-611a5b72-f55a-488d-a0be-c77de0bcd154 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:15.629485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-611a5b72-f55a-488d-a0be-c77de0bcd154 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:15.630280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-611a5b72-f55a-488d-a0be-c77de0bcd154 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:15.632311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-611a5b72-f55a-488d-a0be-c77de0bcd154 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:16.657997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c60ae7fb-58c1-4aba-b234-fd04e2b862a5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:16.669924 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c60ae7fb-58c1-4aba-b234-fd04e2b862a5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 200 len: 1473 microversion: 2.1 time: 1.241812 Oct 24 10:30:16.685769 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 792/1673] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:15 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 1473 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:16.706631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-71d36a72-428b-43fa-a93a-8576473fbaf2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:16.717119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-71d36a72-428b-43fa-a93a-8576473fbaf2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:16.739055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71d36a72-428b-43fa-a93a-8576473fbaf2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:16.739782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71d36a72-428b-43fa-a93a-8576473fbaf2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:16.740381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71d36a72-428b-43fa-a93a-8576473fbaf2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:16.743104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71d36a72-428b-43fa-a93a-8576473fbaf2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:16.743744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71d36a72-428b-43fa-a93a-8576473fbaf2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:16.745807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71d36a72-428b-43fa-a93a-8576473fbaf2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:17.200820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-611a5b72-f55a-488d-a0be-c77de0bcd154 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:17.213826 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-611a5b72-f55a-488d-a0be-c77de0bcd154 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1467 microversion: 2.1 time: 1.633010 Oct 24 10:30:17.218866 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 882/1674] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:15 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1467 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:17.229832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-82bc8207-d4c0-455c-8954-c9f4c26ca891 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:17.230522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-82bc8207-d4c0-455c-8954-c9f4c26ca891 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:17.250285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82bc8207-d4c0-455c-8954-c9f4c26ca891 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:17.251135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82bc8207-d4c0-455c-8954-c9f4c26ca891 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:17.253966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82bc8207-d4c0-455c-8954-c9f4c26ca891 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:17.255101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82bc8207-d4c0-455c-8954-c9f4c26ca891 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:17.256753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82bc8207-d4c0-455c-8954-c9f4c26ca891 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:17.259282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82bc8207-d4c0-455c-8954-c9f4c26ca891 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:17.511448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-71d36a72-428b-43fa-a93a-8576473fbaf2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:17.515425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-82bc8207-d4c0-455c-8954-c9f4c26ca891 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:17.520295 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-71d36a72-428b-43fa-a93a-8576473fbaf2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 200 len: 1308 microversion: 2.1 time: 0.833481 Oct 24 10:30:17.520908 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 793/1675] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:16 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 1308 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:17.531357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-85331661-9cf1-4085-8443-92ae447cf772 req-1c49bdb2-a637-4b99-91fc-bae966303b5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef7f7bd1-dcd0-4160-8198-be769a65429b", "tag": "c414991e-9fff-46ec-b95d-4a6da09466df"}, {"server_uuid": "76cff000-3122-4b18-89a9-c679033be122", "name": "network-vif-deleted", "tag": "b8b62cc8-0a2d-4606-bc4b-f89a074e7a49"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:17.557636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-85331661-9cf1-4085-8443-92ae447cf772 req-1c49bdb2-a637-4b99-91fc-bae966303b5c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:17.558092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-85331661-9cf1-4085-8443-92ae447cf772 req-1c49bdb2-a637-4b99-91fc-bae966303b5c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:17.558519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-85331661-9cf1-4085-8443-92ae447cf772 req-1c49bdb2-a637-4b99-91fc-bae966303b5c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:17.560157 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-82bc8207-d4c0-455c-8954-c9f4c26ca891 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1937 microversion: 2.75 time: 0.340126 Oct 24 10:30:17.563627 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 883/1676] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:30:17 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1937 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:30:17.593103 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-85331661-9cf1-4085-8443-92ae447cf772 req-1c49bdb2-a637-4b99-91fc-bae966303b5c service nova] Creating event network-changed:c414991e-9fff-46ec-b95d-4a6da09466df for instance ef7f7bd1-dcd0-4160-8198-be769a65429b on n-h1-858383-15 Oct 24 10:30:17.595219 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-85331661-9cf1-4085-8443-92ae447cf772 req-1c49bdb2-a637-4b99-91fc-bae966303b5c service nova] Creating event network-vif-deleted:b8b62cc8-0a2d-4606-bc4b-f89a074e7a49 for instance 76cff000-3122-4b18-89a9-c679033be122 on n-h2-858383-15 Oct 24 10:30:17.611178 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-85331661-9cf1-4085-8443-92ae447cf772 req-1c49bdb2-a637-4b99-91fc-bae966303b5c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.089046 Oct 24 10:30:17.612536 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 794/1677] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:17.707973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5e04c74a-a658-471d-b702-cfbabdf39ce9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:17.709558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5e04c74a-a658-471d-b702-cfbabdf39ce9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 76cff000-3122-4b18-89a9-c679033be122] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:17.736959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e04c74a-a658-471d-b702-cfbabdf39ce9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:17.739149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e04c74a-a658-471d-b702-cfbabdf39ce9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:17.739819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e04c74a-a658-471d-b702-cfbabdf39ce9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:17.745597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e04c74a-a658-471d-b702-cfbabdf39ce9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:17.746376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e04c74a-a658-471d-b702-cfbabdf39ce9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:17.747015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e04c74a-a658-471d-b702-cfbabdf39ce9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:17.771319 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-5e04c74a-a658-471d-b702-cfbabdf39ce9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] HTTP exception thrown: Instance 76cff000-3122-4b18-89a9-c679033be122 could not be found. Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5e04c74a-a658-471d-b702-cfbabdf39ce9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Request method failure captured: Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 HTTP/1.1 Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmhXqNSBsh7K7Uj2jXvR0yTVG9LTHhhGPCF6c-R_uu5XAWXN3q_pOqU3EQ6kswdvFK06P0vNock9UqKjP52kirztfJqRQ9SK9bbaCmdkDeP1GYXpg5nJ_Ea2cS2kg-fXYgatWKicP0gLPLbADF61RGIaCfWEQwHUVVkXN2VQjipCuYA Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: b565572c0c8c4871af02471a328bd1af Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:30:17.778340 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:30:17.782053 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b565572c0c8c4871af02471a328bd1af", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:30:17.782053 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:17.782053 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: b565572c0c8c4871af02471a328bd1af Oct 24 10:30:17.782053 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:17.782053 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersOnMultiNodesTest-2087726178-project Oct 24 10:30:17.782053 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:30:17.782053 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:30:17.782053 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 9aa572f1e5014e10bed0abe34dfad43f Oct 24 10:30:17.782053 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersOnMultiNodesTest-2087726178-project Oct 24 10:30:17.782053 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:30:17.782053 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 76cff000-3122-4b18-89a9-c679033be122 could not be found. Oct 24 10:30:17.782053 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '76cff000-3122-4b18-89a9-c679033be122'} Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76cff000-3122-4b18-89a9-c679033be122 could not be found. Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:30:17.783176 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:30:17.784760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:30:17.784760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:30:17.784760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:30:17.784760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:30:17.784760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:30:17.784760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:30:17.784760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:30:17.784760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76cff000-3122-4b18-89a9-c679033be122 could not be found. Oct 24 10:30:17.784760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:17.784760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:17.784760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:17.784760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:17.784760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:17.784760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:17.784760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:30:17.784760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:30:17.784760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76cff000-3122-4b18-89a9-c679033be122 could not be found. Oct 24 10:30:17.784760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:17.787234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5e04c74a-a658-471d-b702-cfbabdf39ce9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Returning 404 to user: Instance 76cff000-3122-4b18-89a9-c679033be122 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:30:17.788016 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5e04c74a-a658-471d-b702-cfbabdf39ce9 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122" status: 404 len: 111 microversion: 2.1 time: 0.095239 Oct 24 10:30:17.788201 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 884/1678] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:17 2022] GET /compute/v2.1/servers/76cff000-3122-4b18-89a9-c679033be122 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:30:17.799918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-86dbcc7a-8e92-4946-9711-5318de42b4cf tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:17.801348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-86dbcc7a-8e92-4946-9711-5318de42b4cf tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: d4958f64-a776-423b-8544-b0918c30d25e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:17.811566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86dbcc7a-8e92-4946-9711-5318de42b4cf tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:17.813003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86dbcc7a-8e92-4946-9711-5318de42b4cf tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:17.814666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86dbcc7a-8e92-4946-9711-5318de42b4cf tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:17.815654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86dbcc7a-8e92-4946-9711-5318de42b4cf tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:17.816330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86dbcc7a-8e92-4946-9711-5318de42b4cf tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:17.817024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86dbcc7a-8e92-4946-9711-5318de42b4cf tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:17.856665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-86dbcc7a-8e92-4946-9711-5318de42b4cf tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: d4958f64-a776-423b-8544-b0918c30d25e] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:30:18.037291 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-86dbcc7a-8e92-4946-9711-5318de42b4cf tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e" status: 204 len: 0 microversion: 2.1 time: 0.242161 Oct 24 10:30:18.038304 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 795/1679] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:30:17 2022] DELETE /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:30:18.050247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a152a5c4-2e05-431d-979a-55ac96c2ab3d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:18.051890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a152a5c4-2e05-431d-979a-55ac96c2ab3d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:18.079782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a152a5c4-2e05-431d-979a-55ac96c2ab3d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:18.080502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a152a5c4-2e05-431d-979a-55ac96c2ab3d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:18.081196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a152a5c4-2e05-431d-979a-55ac96c2ab3d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:18.082668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a152a5c4-2e05-431d-979a-55ac96c2ab3d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:18.083334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a152a5c4-2e05-431d-979a-55ac96c2ab3d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:18.083958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a152a5c4-2e05-431d-979a-55ac96c2ab3d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:18.142436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a152a5c4-2e05-431d-979a-55ac96c2ab3d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:30:18.264319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-45c71dee-82cf-4814-b079-9cd5c4f36229 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:18.266468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-45c71dee-82cf-4814-b079-9cd5c4f36229 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:18.275892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45c71dee-82cf-4814-b079-9cd5c4f36229 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:18.277094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45c71dee-82cf-4814-b079-9cd5c4f36229 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:18.278190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45c71dee-82cf-4814-b079-9cd5c4f36229 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:18.279840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45c71dee-82cf-4814-b079-9cd5c4f36229 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:18.281382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45c71dee-82cf-4814-b079-9cd5c4f36229 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:18.284120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45c71dee-82cf-4814-b079-9cd5c4f36229 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:18.336893 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a152a5c4-2e05-431d-979a-55ac96c2ab3d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "DELETE /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010" status: 204 len: 0 microversion: 2.1 time: 0.292199 Oct 24 10:30:18.343520 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 885/1680] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:30:18 2022] DELETE /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:30:18.358938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-57dec6cf-43e5-4a0c-b794-48004cde70e3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:18.361191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-57dec6cf-43e5-4a0c-b794-48004cde70e3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: d4958f64-a776-423b-8544-b0918c30d25e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:18.367485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:18.376790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-57dec6cf-43e5-4a0c-b794-48004cde70e3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:18.377811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-57dec6cf-43e5-4a0c-b794-48004cde70e3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:18.378663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-57dec6cf-43e5-4a0c-b794-48004cde70e3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:18.380760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-57dec6cf-43e5-4a0c-b794-48004cde70e3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:18.381778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-57dec6cf-43e5-4a0c-b794-48004cde70e3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:18.383993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-57dec6cf-43e5-4a0c-b794-48004cde70e3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:18.422647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:18.841492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-45c71dee-82cf-4814-b079-9cd5c4f36229 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:18.850482 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-45c71dee-82cf-4814-b079-9cd5c4f36229 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1425 microversion: 2.1 time: 0.594083 Oct 24 10:30:18.869902 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 796/1681] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:18 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1425 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:18.877262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-768db8df-7af9-4853-be20-0dc23f436c23 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:18.878679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-768db8df-7af9-4853-be20-0dc23f436c23 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:18.886955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-768db8df-7af9-4853-be20-0dc23f436c23 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:18.887841 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-768db8df-7af9-4853-be20-0dc23f436c23 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:18.889075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-768db8df-7af9-4853-be20-0dc23f436c23 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:18.890532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-768db8df-7af9-4853-be20-0dc23f436c23 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:18.891164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-768db8df-7af9-4853-be20-0dc23f436c23 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:18.892155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-768db8df-7af9-4853-be20-0dc23f436c23 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:19.150812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:19.172200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-57dec6cf-43e5-4a0c-b794-48004cde70e3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:19.209166 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-57dec6cf-43e5-4a0c-b794-48004cde70e3 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e" status: 200 len: 1474 microversion: 2.1 time: 0.858159 Oct 24 10:30:19.236193 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 886/1682] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:18 2022] GET /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e => generated 1474 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:19.241791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c9eb943a-0985-4a7f-b2ac-f2c03c254f71 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:19.242499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c9eb943a-0985-4a7f-b2ac-f2c03c254f71 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:19.262245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9eb943a-0985-4a7f-b2ac-f2c03c254f71 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:19.262245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9eb943a-0985-4a7f-b2ac-f2c03c254f71 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:19.262245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9eb943a-0985-4a7f-b2ac-f2c03c254f71 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:19.262245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9eb943a-0985-4a7f-b2ac-f2c03c254f71 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:19.262681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9eb943a-0985-4a7f-b2ac-f2c03c254f71 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:19.262681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9eb943a-0985-4a7f-b2ac-f2c03c254f71 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:19.340235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-768db8df-7af9-4853-be20-0dc23f436c23 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:19.349199 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-768db8df-7af9-4853-be20-0dc23f436c23 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 200 len: 1308 microversion: 2.1 time: 0.476734 Oct 24 10:30:19.350084 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 797/1683] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:18 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 1308 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:19.355141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a245f410-5962-41a0-bc2c-ef443277a76d req-323a14e6-b803-42d2-baa6-b5cdfb0f8a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4f83cc-06a0-4a8e-b480-1878d348e1d1", "name": "network-vif-deleted", "tag": "fbe95751-507c-435d-b75f-b10bd1579493"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:19.366575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a245f410-5962-41a0-bc2c-ef443277a76d req-323a14e6-b803-42d2-baa6-b5cdfb0f8a31 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:19.367711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a245f410-5962-41a0-bc2c-ef443277a76d req-323a14e6-b803-42d2-baa6-b5cdfb0f8a31 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:19.368146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a245f410-5962-41a0-bc2c-ef443277a76d req-323a14e6-b803-42d2-baa6-b5cdfb0f8a31 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:19.384041 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a245f410-5962-41a0-bc2c-ef443277a76d req-323a14e6-b803-42d2-baa6-b5cdfb0f8a31 service nova] Creating event network-vif-deleted:fbe95751-507c-435d-b75f-b10bd1579493 for instance 9d4f83cc-06a0-4a8e-b480-1878d348e1d1 on n-h1-858383-15 Oct 24 10:30:19.389958 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a245f410-5962-41a0-bc2c-ef443277a76d req-323a14e6-b803-42d2-baa6-b5cdfb0f8a31 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038609 Oct 24 10:30:19.391158 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 798/1684] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:19.422742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-c9eb943a-0985-4a7f-b2ac-f2c03c254f71 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] Lazy-loading 'services' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:19.442861 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c9eb943a-0985-4a7f-b2ac-f2c03c254f71 tempest-ServersAdmin275Test-2051197882 tempest-ServersAdmin275Test-2051197882-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1922 microversion: 2.75 time: 0.204566 Oct 24 10:30:19.446068 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 887/1685] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:30:19 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1922 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:30:19.484185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-596d03e9-df21-448d-aad5-96d5e05c10ac tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:19.484770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-596d03e9-df21-448d-aad5-96d5e05c10ac tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:19.496255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-596d03e9-df21-448d-aad5-96d5e05c10ac tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:19.496752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-596d03e9-df21-448d-aad5-96d5e05c10ac tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:19.497423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-596d03e9-df21-448d-aad5-96d5e05c10ac tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:19.498323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-596d03e9-df21-448d-aad5-96d5e05c10ac tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:19.498943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-596d03e9-df21-448d-aad5-96d5e05c10ac tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:19.499531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-596d03e9-df21-448d-aad5-96d5e05c10ac tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:19.537766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-596d03e9-df21-448d-aad5-96d5e05c10ac tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:30:19.668103 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-596d03e9-df21-448d-aad5-96d5e05c10ac tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 204 len: 0 microversion: 2.75 time: 0.187745 Oct 24 10:30:19.688101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fda0ad4a-86e6-4bab-b404-67379665bbe5 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:19.688974 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 799/1686] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:30:19 2022] DELETE /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:30:19.690005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fda0ad4a-86e6-4bab-b404-67379665bbe5 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:19.700438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fda0ad4a-86e6-4bab-b404-67379665bbe5 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:19.701808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fda0ad4a-86e6-4bab-b404-67379665bbe5 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:19.703212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fda0ad4a-86e6-4bab-b404-67379665bbe5 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:19.705422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fda0ad4a-86e6-4bab-b404-67379665bbe5 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:19.706905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fda0ad4a-86e6-4bab-b404-67379665bbe5 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:19.708031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fda0ad4a-86e6-4bab-b404-67379665bbe5 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:19.795356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fda0ad4a-86e6-4bab-b404-67379665bbe5 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:19.810372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fda0ad4a-86e6-4bab-b404-67379665bbe5 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:19.811864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fda0ad4a-86e6-4bab-b404-67379665bbe5 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:19.818261 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fda0ad4a-86e6-4bab-b404-67379665bbe5 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1444 microversion: 2.75 time: 0.141590 Oct 24 10:30:19.819171 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 888/1687] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:30:19 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:30:19.879113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4afb9e1b-3c3c-499d-80a3-d0c2375ff0be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:19.880003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4afb9e1b-3c3c-499d-80a3-d0c2375ff0be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:19.892904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4afb9e1b-3c3c-499d-80a3-d0c2375ff0be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:19.905965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4afb9e1b-3c3c-499d-80a3-d0c2375ff0be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:19.921380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4afb9e1b-3c3c-499d-80a3-d0c2375ff0be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:19.921997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4afb9e1b-3c3c-499d-80a3-d0c2375ff0be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:19.922488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4afb9e1b-3c3c-499d-80a3-d0c2375ff0be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:19.922926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4afb9e1b-3c3c-499d-80a3-d0c2375ff0be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:19.981183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4afb9e1b-3c3c-499d-80a3-d0c2375ff0be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:19.981948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4afb9e1b-3c3c-499d-80a3-d0c2375ff0be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:19.982561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4afb9e1b-3c3c-499d-80a3-d0c2375ff0be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:19.983401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-4afb9e1b-3c3c-499d-80a3-d0c2375ff0be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lazy-loading 'fault' on Instance uuid 9d4f83cc-06a0-4a8e-b480-1878d348e1d1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:20.052967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4afb9e1b-3c3c-499d-80a3-d0c2375ff0be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:20.065920 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4afb9e1b-3c3c-499d-80a3-d0c2375ff0be tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1302 microversion: 2.1 time: 0.190294 Oct 24 10:30:20.067708 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 800/1688] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:19 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1302 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:20.240528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bf6c4b3e-6053-4578-bf27-21c799529916 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:20.241266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bf6c4b3e-6053-4578-bf27-21c799529916 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: d4958f64-a776-423b-8544-b0918c30d25e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:20.255228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf6c4b3e-6053-4578-bf27-21c799529916 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:20.260223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf6c4b3e-6053-4578-bf27-21c799529916 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:20.260861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf6c4b3e-6053-4578-bf27-21c799529916 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:20.262735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf6c4b3e-6053-4578-bf27-21c799529916 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:20.264453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf6c4b3e-6053-4578-bf27-21c799529916 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:20.267757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf6c4b3e-6053-4578-bf27-21c799529916 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:20.372532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ec10ec0d-e4f5-4a5d-9b42-fd88c057f26d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:20.373655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ec10ec0d-e4f5-4a5d-9b42-fd88c057f26d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:20.391208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec10ec0d-e4f5-4a5d-9b42-fd88c057f26d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:20.391897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec10ec0d-e4f5-4a5d-9b42-fd88c057f26d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:20.393058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec10ec0d-e4f5-4a5d-9b42-fd88c057f26d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:20.393942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec10ec0d-e4f5-4a5d-9b42-fd88c057f26d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:20.394555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec10ec0d-e4f5-4a5d-9b42-fd88c057f26d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:20.395177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec10ec0d-e4f5-4a5d-9b42-fd88c057f26d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:20.874889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bf6c4b3e-6053-4578-bf27-21c799529916 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:20.879039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:20.886940 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bf6c4b3e-6053-4578-bf27-21c799529916 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e" status: 200 len: 1474 microversion: 2.1 time: 0.652479 Oct 24 10:30:20.888553 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 889/1689] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:20 2022] GET /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e => generated 1474 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:20.901306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b09a49d6-bf3e-4d3b-9ba2-7e24037a348d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:20.905166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b09a49d6-bf3e-4d3b-9ba2-7e24037a348d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:20.906345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ec10ec0d-e4f5-4a5d-9b42-fd88c057f26d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:20.915864 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ec10ec0d-e4f5-4a5d-9b42-fd88c057f26d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 200 len: 1308 microversion: 2.1 time: 0.547251 Oct 24 10:30:20.917126 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 801/1690] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:20 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 1308 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:20.921546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b09a49d6-bf3e-4d3b-9ba2-7e24037a348d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:20.922935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b09a49d6-bf3e-4d3b-9ba2-7e24037a348d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:20.924128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b09a49d6-bf3e-4d3b-9ba2-7e24037a348d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:20.925850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b09a49d6-bf3e-4d3b-9ba2-7e24037a348d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:20.928142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b09a49d6-bf3e-4d3b-9ba2-7e24037a348d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:20.930201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b09a49d6-bf3e-4d3b-9ba2-7e24037a348d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:21.028260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b09a49d6-bf3e-4d3b-9ba2-7e24037a348d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:21.044185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b09a49d6-bf3e-4d3b-9ba2-7e24037a348d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:21.057959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b09a49d6-bf3e-4d3b-9ba2-7e24037a348d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:21.066237 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b09a49d6-bf3e-4d3b-9ba2-7e24037a348d tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1444 microversion: 2.75 time: 0.175672 Oct 24 10:30:21.072940 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 890/1691] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:30:20 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1444 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:30:21.091392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b67fd83f-9348-4c8b-ab9d-ee5e532ccdfb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:21.092072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b67fd83f-9348-4c8b-ab9d-ee5e532ccdfb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:21.103850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b67fd83f-9348-4c8b-ab9d-ee5e532ccdfb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:21.104420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b67fd83f-9348-4c8b-ab9d-ee5e532ccdfb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:21.104910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b67fd83f-9348-4c8b-ab9d-ee5e532ccdfb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:21.105660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b67fd83f-9348-4c8b-ab9d-ee5e532ccdfb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:21.106235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b67fd83f-9348-4c8b-ab9d-ee5e532ccdfb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:21.106675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b67fd83f-9348-4c8b-ab9d-ee5e532ccdfb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:21.151480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b67fd83f-9348-4c8b-ab9d-ee5e532ccdfb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:21.152347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b67fd83f-9348-4c8b-ab9d-ee5e532ccdfb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:21.152898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b67fd83f-9348-4c8b-ab9d-ee5e532ccdfb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:21.153432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-b67fd83f-9348-4c8b-ab9d-ee5e532ccdfb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lazy-loading 'fault' on Instance uuid 9d4f83cc-06a0-4a8e-b480-1878d348e1d1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:21.265047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b67fd83f-9348-4c8b-ab9d-ee5e532ccdfb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:21.279454 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b67fd83f-9348-4c8b-ab9d-ee5e532ccdfb tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 200 len: 1302 microversion: 2.1 time: 0.191793 Oct 24 10:30:21.280206 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 802/1692] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:21 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 1302 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:21.417282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-78ce7f4e-128b-45e7-a1d4-d513f54de8c0 req-cc1e1c26-dffb-4add-984f-8b0a887998e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84a8b2f8-edd4-45a3-be5f-878bfc0f5811", "tag": "776dc61c-efaa-4518-9e14-466879a8f1c1"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:21.439098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-78ce7f4e-128b-45e7-a1d4-d513f54de8c0 req-cc1e1c26-dffb-4add-984f-8b0a887998e5 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:21.439996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-78ce7f4e-128b-45e7-a1d4-d513f54de8c0 req-cc1e1c26-dffb-4add-984f-8b0a887998e5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:21.440455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-78ce7f4e-128b-45e7-a1d4-d513f54de8c0 req-cc1e1c26-dffb-4add-984f-8b0a887998e5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:21.459348 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-78ce7f4e-128b-45e7-a1d4-d513f54de8c0 req-cc1e1c26-dffb-4add-984f-8b0a887998e5 service nova] Creating event network-changed:776dc61c-efaa-4518-9e14-466879a8f1c1 for instance 84a8b2f8-edd4-45a3-be5f-878bfc0f5811 on n-h2-858383-15 Oct 24 10:30:21.466034 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-78ce7f4e-128b-45e7-a1d4-d513f54de8c0 req-cc1e1c26-dffb-4add-984f-8b0a887998e5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053859 Oct 24 10:30:21.467082 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 891/1693] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:30:21.526221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-4192fde0-d40c-44cf-8ddf-ed1480db3754 req-59d9e9c2-6922-4f89-9744-390fa1553591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4958f64-a776-423b-8544-b0918c30d25e", "name": "network-vif-deleted", "tag": "7cb75069-1936-455b-9d3e-e39ef3915249"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:21.539727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4192fde0-d40c-44cf-8ddf-ed1480db3754 req-59d9e9c2-6922-4f89-9744-390fa1553591 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:21.540670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4192fde0-d40c-44cf-8ddf-ed1480db3754 req-59d9e9c2-6922-4f89-9744-390fa1553591 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:21.542051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4192fde0-d40c-44cf-8ddf-ed1480db3754 req-59d9e9c2-6922-4f89-9744-390fa1553591 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:21.557707 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-4192fde0-d40c-44cf-8ddf-ed1480db3754 req-59d9e9c2-6922-4f89-9744-390fa1553591 service nova] Creating event network-vif-deleted:7cb75069-1936-455b-9d3e-e39ef3915249 for instance d4958f64-a776-423b-8544-b0918c30d25e on n-h2-858383-15 Oct 24 10:30:21.564667 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-4192fde0-d40c-44cf-8ddf-ed1480db3754 req-59d9e9c2-6922-4f89-9744-390fa1553591 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043085 Oct 24 10:30:21.566360 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 803/1694] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:21.911878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ff7431f1-5129-4292-bf5c-2c13900f147d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:21.913435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ff7431f1-5129-4292-bf5c-2c13900f147d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: d4958f64-a776-423b-8544-b0918c30d25e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:21.928731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff7431f1-5129-4292-bf5c-2c13900f147d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:21.930921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff7431f1-5129-4292-bf5c-2c13900f147d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:21.933469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff7431f1-5129-4292-bf5c-2c13900f147d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:21.941042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7573fa22-c750-43aa-bb01-c66d414d9aa2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:21.942401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7573fa22-c750-43aa-bb01-c66d414d9aa2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:21.952704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff7431f1-5129-4292-bf5c-2c13900f147d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:21.953822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff7431f1-5129-4292-bf5c-2c13900f147d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:21.954458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff7431f1-5129-4292-bf5c-2c13900f147d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:21.965758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7573fa22-c750-43aa-bb01-c66d414d9aa2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:21.969191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7573fa22-c750-43aa-bb01-c66d414d9aa2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:21.971964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7573fa22-c750-43aa-bb01-c66d414d9aa2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:21.977634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7573fa22-c750-43aa-bb01-c66d414d9aa2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:21.980231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7573fa22-c750-43aa-bb01-c66d414d9aa2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:21.984758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7573fa22-c750-43aa-bb01-c66d414d9aa2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:22.126072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ff7431f1-5129-4292-bf5c-2c13900f147d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:22.141473 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ff7431f1-5129-4292-bf5c-2c13900f147d tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e" status: 200 len: 1432 microversion: 2.1 time: 0.234179 Oct 24 10:30:22.142612 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 892/1695] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:21 2022] GET /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e => generated 1432 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:22.147681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-90d11259-94d5-473d-b865-f80714032714 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:22.149147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-90d11259-94d5-473d-b865-f80714032714 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:22.156382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90d11259-94d5-473d-b865-f80714032714 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:22.156975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90d11259-94d5-473d-b865-f80714032714 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:22.157835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90d11259-94d5-473d-b865-f80714032714 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:22.158815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90d11259-94d5-473d-b865-f80714032714 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:22.160739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90d11259-94d5-473d-b865-f80714032714 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:22.162024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90d11259-94d5-473d-b865-f80714032714 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:22.335168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-90d11259-94d5-473d-b865-f80714032714 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:22.356670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-90d11259-94d5-473d-b865-f80714032714 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:22.358166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-90d11259-94d5-473d-b865-f80714032714 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:22.373042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7573fa22-c750-43aa-bb01-c66d414d9aa2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:22.373653 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-90d11259-94d5-473d-b865-f80714032714 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1444 microversion: 2.75 time: 0.229631 Oct 24 10:30:22.386384 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7573fa22-c750-43aa-bb01-c66d414d9aa2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 200 len: 1308 microversion: 2.1 time: 0.450480 Oct 24 10:30:22.396577 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 893/1696] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:30:22 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1444 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:30:22.404476 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 804/1697] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:21 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 1308 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:22.408345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-88eeb0da-f878-4a8f-85df-591b2efe5131 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:22.409005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-88eeb0da-f878-4a8f-85df-591b2efe5131 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 9d4f83cc-06a0-4a8e-b480-1878d348e1d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:22.420745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88eeb0da-f878-4a8f-85df-591b2efe5131 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:22.421494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88eeb0da-f878-4a8f-85df-591b2efe5131 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:22.422102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88eeb0da-f878-4a8f-85df-591b2efe5131 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:22.423100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88eeb0da-f878-4a8f-85df-591b2efe5131 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:22.423741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88eeb0da-f878-4a8f-85df-591b2efe5131 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:22.424636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88eeb0da-f878-4a8f-85df-591b2efe5131 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:22.442096 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-88eeb0da-f878-4a8f-85df-591b2efe5131 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] HTTP exception thrown: Instance 9d4f83cc-06a0-4a8e-b480-1878d348e1d1 could not be found. Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-88eeb0da-f878-4a8f-85df-591b2efe5131 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Request method failure captured: Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 HTTP/1.1 Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfTgiVQkFreHjUnM8-9M4WXdVFFo3TwbYUuG90tWMf2U84Ct43t2RwFf9lp6Koocs_zPZzrCgx5V-uG_TrbOvXwkjInhf2fsg4sP_gV4bmp_eUqwH3j4gAJjxf3-J-L2cM0sKsq5wfN7DvL6M_aE1fA6jhg_Su-jUer19zeP7djDKU Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: ac5f703504204b91a5c7e895964ec985 Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-MigrationsAdminTest-1912783839 Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:30:22.444177 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:30:22.446552 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ac5f703504204b91a5c7e895964ec985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ac5f703504204b91a5c7e895964ec985"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ac5f703504204b91a5c7e895964ec985"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ac5f703504204b91a5c7e895964ec985", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:30:22.446552 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-MigrationsAdminTest-1912783839 Oct 24 10:30:22.446552 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: ac5f703504204b91a5c7e895964ec985 Oct 24 10:30:22.446552 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-MigrationsAdminTest-1912783839 Oct 24 10:30:22.446552 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-MigrationsAdminTest-1912783839-project Oct 24 10:30:22.446552 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:30:22.446552 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:30:22.446552 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: b684c865fc9e4abb8e0e55616087b92e Oct 24 10:30:22.446552 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-MigrationsAdminTest-1912783839-project Oct 24 10:30:22.446552 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:30:22.446552 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 9d4f83cc-06a0-4a8e-b480-1878d348e1d1 could not be found. Oct 24 10:30:22.446552 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '9d4f83cc-06a0-4a8e-b480-1878d348e1d1'} Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d4f83cc-06a0-4a8e-b480-1878d348e1d1 could not be found. Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:30:22.447540 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:30:22.449104 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:30:22.449104 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:30:22.449104 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:30:22.449104 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:30:22.449104 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:30:22.449104 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:30:22.449104 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:30:22.449104 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d4f83cc-06a0-4a8e-b480-1878d348e1d1 could not be found. Oct 24 10:30:22.449104 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:22.449104 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:22.449104 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:22.449104 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:22.449104 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:22.449104 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:22.449104 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:30:22.449104 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:30:22.449104 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d4f83cc-06a0-4a8e-b480-1878d348e1d1 could not be found. Oct 24 10:30:22.449104 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:22.450519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-88eeb0da-f878-4a8f-85df-591b2efe5131 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Returning 404 to user: Instance 9d4f83cc-06a0-4a8e-b480-1878d348e1d1 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:30:22.451727 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-88eeb0da-f878-4a8f-85df-591b2efe5131 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1" status: 404 len: 111 microversion: 2.1 time: 0.052656 Oct 24 10:30:22.457058 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 894/1698] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:22 2022] GET /compute/v2.1/servers/9d4f83cc-06a0-4a8e-b480-1878d348e1d1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:30:22.461335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e10e5035-34f3-4582-a5ab-b5099b4ea93d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:22.461903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e10e5035-34f3-4582-a5ab-b5099b4ea93d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:22.470468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e10e5035-34f3-4582-a5ab-b5099b4ea93d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:22.471720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e10e5035-34f3-4582-a5ab-b5099b4ea93d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:22.472329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e10e5035-34f3-4582-a5ab-b5099b4ea93d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:22.481229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e10e5035-34f3-4582-a5ab-b5099b4ea93d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:22.482064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e10e5035-34f3-4582-a5ab-b5099b4ea93d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:22.482753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e10e5035-34f3-4582-a5ab-b5099b4ea93d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:22.580911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e10e5035-34f3-4582-a5ab-b5099b4ea93d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:30:22.780456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:22.933594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:22.953610 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e10e5035-34f3-4582-a5ab-b5099b4ea93d tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 204 len: 0 microversion: 2.1 time: 0.488026 Oct 24 10:30:22.954382 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 805/1699] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:30:22 2022] DELETE /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:30:22.965204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ab27fb1f-38e8-402a-9996-69fe47f12598 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:22.966013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ab27fb1f-38e8-402a-9996-69fe47f12598 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:22.983515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab27fb1f-38e8-402a-9996-69fe47f12598 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:22.986030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab27fb1f-38e8-402a-9996-69fe47f12598 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:23.001886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab27fb1f-38e8-402a-9996-69fe47f12598 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:23.005796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab27fb1f-38e8-402a-9996-69fe47f12598 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:23.009494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab27fb1f-38e8-402a-9996-69fe47f12598 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:23.011582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab27fb1f-38e8-402a-9996-69fe47f12598 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:23.168618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-28122ade-cfb8-481f-bd83-fbe96c7c1d09 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:23.170615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-28122ade-cfb8-481f-bd83-fbe96c7c1d09 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: d4958f64-a776-423b-8544-b0918c30d25e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:23.185218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28122ade-cfb8-481f-bd83-fbe96c7c1d09 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:23.187771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28122ade-cfb8-481f-bd83-fbe96c7c1d09 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:23.188237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28122ade-cfb8-481f-bd83-fbe96c7c1d09 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:23.189032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28122ade-cfb8-481f-bd83-fbe96c7c1d09 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:23.189488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28122ade-cfb8-481f-bd83-fbe96c7c1d09 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:23.189911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28122ade-cfb8-481f-bd83-fbe96c7c1d09 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:23.264198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ab27fb1f-38e8-402a-9996-69fe47f12598 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:23.274536 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ab27fb1f-38e8-402a-9996-69fe47f12598 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1468 microversion: 2.1 time: 0.315197 Oct 24 10:30:23.275332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28122ade-cfb8-481f-bd83-fbe96c7c1d09 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:23.276068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28122ade-cfb8-481f-bd83-fbe96c7c1d09 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:23.276401 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 895/1700] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:22 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1468 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:23.277460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28122ade-cfb8-481f-bd83-fbe96c7c1d09 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:23.278656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-28122ade-cfb8-481f-bd83-fbe96c7c1d09 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lazy-loading 'fault' on Instance uuid d4958f64-a776-423b-8544-b0918c30d25e {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:23.350237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-28122ade-cfb8-481f-bd83-fbe96c7c1d09 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:23.358899 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-28122ade-cfb8-481f-bd83-fbe96c7c1d09 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e" status: 200 len: 1308 microversion: 2.1 time: 0.195666 Oct 24 10:30:23.376867 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 806/1701] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:23 2022] GET /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e => generated 1308 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:23.409491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4fa16675-35d5-450b-99cd-2c9c5ed62b5b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:23.413222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4fa16675-35d5-450b-99cd-2c9c5ed62b5b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:23.413503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d68390a9-3bf3-4419-b71d-e93b24671388 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:23.414942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d68390a9-3bf3-4419-b71d-e93b24671388 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:23.423085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4fa16675-35d5-450b-99cd-2c9c5ed62b5b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:23.423285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d68390a9-3bf3-4419-b71d-e93b24671388 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:23.423986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d68390a9-3bf3-4419-b71d-e93b24671388 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:23.424639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4fa16675-35d5-450b-99cd-2c9c5ed62b5b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:23.425081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d68390a9-3bf3-4419-b71d-e93b24671388 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:23.425226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4fa16675-35d5-450b-99cd-2c9c5ed62b5b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:23.426127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d68390a9-3bf3-4419-b71d-e93b24671388 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:23.426304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4fa16675-35d5-450b-99cd-2c9c5ed62b5b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:23.426778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4fa16675-35d5-450b-99cd-2c9c5ed62b5b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:23.427180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d68390a9-3bf3-4419-b71d-e93b24671388 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:23.427318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4fa16675-35d5-450b-99cd-2c9c5ed62b5b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:23.427898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d68390a9-3bf3-4419-b71d-e93b24671388 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:23.525573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4fa16675-35d5-450b-99cd-2c9c5ed62b5b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:23.527434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4fa16675-35d5-450b-99cd-2c9c5ed62b5b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:23.528662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4fa16675-35d5-450b-99cd-2c9c5ed62b5b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:23.530098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-4fa16675-35d5-450b-99cd-2c9c5ed62b5b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lazy-loading 'fault' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:23.616144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4fa16675-35d5-450b-99cd-2c9c5ed62b5b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:23.626616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4fa16675-35d5-450b-99cd-2c9c5ed62b5b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:23.630693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4fa16675-35d5-450b-99cd-2c9c5ed62b5b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:23.638757 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4fa16675-35d5-450b-99cd-2c9c5ed62b5b tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1449 microversion: 2.75 time: 0.236331 Oct 24 10:30:23.649901 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 896/1702] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:30:23 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1449 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:30:23.672757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-274bf718-722d-4635-a765-b319566c0906 req-d69be38a-e154-45ad-9f87-27e619d9a34d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "294c2f53-e675-40b8-a91f-634939781010", "name": "network-vif-deleted", "tag": "0bf4ef00-3ca4-480f-a144-3400a6a043f5"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:23.693990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-274bf718-722d-4635-a765-b319566c0906 req-d69be38a-e154-45ad-9f87-27e619d9a34d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:23.694869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-274bf718-722d-4635-a765-b319566c0906 req-d69be38a-e154-45ad-9f87-27e619d9a34d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:23.696171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-274bf718-722d-4635-a765-b319566c0906 req-d69be38a-e154-45ad-9f87-27e619d9a34d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:23.699609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d68390a9-3bf3-4419-b71d-e93b24671388 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:23.711422 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-274bf718-722d-4635-a765-b319566c0906 req-d69be38a-e154-45ad-9f87-27e619d9a34d service nova] Creating event network-vif-deleted:0bf4ef00-3ca4-480f-a144-3400a6a043f5 for instance 294c2f53-e675-40b8-a91f-634939781010 on n-h1-858383-15 Oct 24 10:30:23.714171 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d68390a9-3bf3-4419-b71d-e93b24671388 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 200 len: 1308 microversion: 2.1 time: 0.305910 Oct 24 10:30:23.715432 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 807/1703] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:23 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 1308 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:23.720875 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-274bf718-722d-4635-a765-b319566c0906 req-d69be38a-e154-45ad-9f87-27e619d9a34d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069599 Oct 24 10:30:23.721745 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 897/1704] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:24.303413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7693a525-e451-4be7-8b84-d9d0eb0c3063 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:24.305849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7693a525-e451-4be7-8b84-d9d0eb0c3063 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:24.317053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7693a525-e451-4be7-8b84-d9d0eb0c3063 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:24.318686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7693a525-e451-4be7-8b84-d9d0eb0c3063 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:24.319414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7693a525-e451-4be7-8b84-d9d0eb0c3063 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:24.320816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7693a525-e451-4be7-8b84-d9d0eb0c3063 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:24.321997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7693a525-e451-4be7-8b84-d9d0eb0c3063 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:24.322886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7693a525-e451-4be7-8b84-d9d0eb0c3063 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:24.395229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cbfbf522-2e81-486c-b3d8-516c7b9d9468 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:24.396673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cbfbf522-2e81-486c-b3d8-516c7b9d9468 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: d4958f64-a776-423b-8544-b0918c30d25e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:24.408351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbfbf522-2e81-486c-b3d8-516c7b9d9468 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:24.409949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbfbf522-2e81-486c-b3d8-516c7b9d9468 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:24.410899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbfbf522-2e81-486c-b3d8-516c7b9d9468 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:24.411981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbfbf522-2e81-486c-b3d8-516c7b9d9468 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:24.413060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbfbf522-2e81-486c-b3d8-516c7b9d9468 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:24.414628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbfbf522-2e81-486c-b3d8-516c7b9d9468 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:24.448145 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-cbfbf522-2e81-486c-b3d8-516c7b9d9468 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] HTTP exception thrown: Instance d4958f64-a776-423b-8544-b0918c30d25e could not be found. Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cbfbf522-2e81-486c-b3d8-516c7b9d9468 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Request method failure captured: Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e HTTP/1.1 Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmhXqNSBsh7K7Uj2jXvR0yTVG9LTHhhGPCF6c-R_uu5XAWXN3q_pOqU3EQ6kswdvFK06P0vNock9UqKjP52kirztfJqRQ9SK9bbaCmdkDeP1GYXpg5nJ_Ea2cS2kg-fXYgatWKicP0gLPLbADF61RGIaCfWEQwHUVVkXN2VQjipCuYA Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: b565572c0c8c4871af02471a328bd1af Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:30:24.451781 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:30:24.454738 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b565572c0c8c4871af02471a328bd1af", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:30:24.454738 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:24.454738 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: b565572c0c8c4871af02471a328bd1af Oct 24 10:30:24.454738 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:24.454738 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersOnMultiNodesTest-2087726178-project Oct 24 10:30:24.454738 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:30:24.454738 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:30:24.454738 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 9aa572f1e5014e10bed0abe34dfad43f Oct 24 10:30:24.454738 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersOnMultiNodesTest-2087726178-project Oct 24 10:30:24.454738 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:30:24.454738 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance d4958f64-a776-423b-8544-b0918c30d25e could not be found. Oct 24 10:30:24.454738 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'd4958f64-a776-423b-8544-b0918c30d25e'} Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4958f64-a776-423b-8544-b0918c30d25e could not be found. Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:30:24.456264 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:30:24.458866 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:30:24.458866 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:30:24.458866 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:30:24.458866 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:30:24.458866 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:30:24.458866 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:30:24.458866 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:30:24.458866 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4958f64-a776-423b-8544-b0918c30d25e could not be found. Oct 24 10:30:24.458866 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:24.458866 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:24.458866 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:24.458866 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:24.458866 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:24.458866 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:24.458866 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:30:24.458866 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:30:24.458866 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4958f64-a776-423b-8544-b0918c30d25e could not be found. Oct 24 10:30:24.458866 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:24.472581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cbfbf522-2e81-486c-b3d8-516c7b9d9468 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Returning 404 to user: Instance d4958f64-a776-423b-8544-b0918c30d25e could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:30:24.472581 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cbfbf522-2e81-486c-b3d8-516c7b9d9468 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e" status: 404 len: 111 microversion: 2.1 time: 0.077372 Oct 24 10:30:24.473467 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 898/1705] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:24 2022] GET /compute/v2.1/servers/d4958f64-a776-423b-8544-b0918c30d25e => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:30:24.480816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e8f0bdbb-b71b-4820-9f0e-099013785c68 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:24.482373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e8f0bdbb-b71b-4820-9f0e-099013785c68 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:24.503889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8f0bdbb-b71b-4820-9f0e-099013785c68 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:24.504386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8f0bdbb-b71b-4820-9f0e-099013785c68 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:24.504823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8f0bdbb-b71b-4820-9f0e-099013785c68 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:24.506713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8f0bdbb-b71b-4820-9f0e-099013785c68 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:24.507353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8f0bdbb-b71b-4820-9f0e-099013785c68 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:24.514040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8f0bdbb-b71b-4820-9f0e-099013785c68 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:24.558432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7693a525-e451-4be7-8b84-d9d0eb0c3063 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:24.562798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8f0bdbb-b71b-4820-9f0e-099013785c68 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:24.563351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8f0bdbb-b71b-4820-9f0e-099013785c68 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:24.563794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8f0bdbb-b71b-4820-9f0e-099013785c68 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:24.564394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-e8f0bdbb-b71b-4820-9f0e-099013785c68 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lazy-loading 'fault' on Instance uuid 294c2f53-e675-40b8-a91f-634939781010 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:24.568110 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7693a525-e451-4be7-8b84-d9d0eb0c3063 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1468 microversion: 2.1 time: 0.271792 Oct 24 10:30:24.569317 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 808/1706] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:24 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1468 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:24.622300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e8f0bdbb-b71b-4820-9f0e-099013785c68 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:24.631619 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e8f0bdbb-b71b-4820-9f0e-099013785c68 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010" status: 200 len: 1308 microversion: 2.1 time: 0.156614 Oct 24 10:30:24.632277 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 899/1707] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:24 2022] GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 => generated 1308 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:24.668991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eac8c93e-bf31-48bd-b226-b2b787374ab9 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:24.669611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eac8c93e-bf31-48bd-b226-b2b787374ab9 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:24.675854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac8c93e-bf31-48bd-b226-b2b787374ab9 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:24.676351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac8c93e-bf31-48bd-b226-b2b787374ab9 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:24.677024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac8c93e-bf31-48bd-b226-b2b787374ab9 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:24.677929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac8c93e-bf31-48bd-b226-b2b787374ab9 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:24.678393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac8c93e-bf31-48bd-b226-b2b787374ab9 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:24.678827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac8c93e-bf31-48bd-b226-b2b787374ab9 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:24.719163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac8c93e-bf31-48bd-b226-b2b787374ab9 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:24.719645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac8c93e-bf31-48bd-b226-b2b787374ab9 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:24.720347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac8c93e-bf31-48bd-b226-b2b787374ab9 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:24.720800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-eac8c93e-bf31-48bd-b226-b2b787374ab9 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lazy-loading 'fault' on Instance uuid c99c990f-944a-4227-9d75-5d09a861855e {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:24.738142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7f844737-4772-4d9a-9726-caf5b2233fe3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:24.738757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7f844737-4772-4d9a-9726-caf5b2233fe3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:24.745470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f844737-4772-4d9a-9726-caf5b2233fe3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:24.745951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f844737-4772-4d9a-9726-caf5b2233fe3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:24.746391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f844737-4772-4d9a-9726-caf5b2233fe3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:24.747082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f844737-4772-4d9a-9726-caf5b2233fe3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:24.747529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f844737-4772-4d9a-9726-caf5b2233fe3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:24.747949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f844737-4772-4d9a-9726-caf5b2233fe3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:24.774926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eac8c93e-bf31-48bd-b226-b2b787374ab9 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:24.787062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eac8c93e-bf31-48bd-b226-b2b787374ab9 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:24.788536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eac8c93e-bf31-48bd-b226-b2b787374ab9 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08328a8deb7a4107b30f61c10e92477b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58eb5f0cf9bc41c48c0815d5c7905989', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:24.795536 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eac8c93e-bf31-48bd-b226-b2b787374ab9 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 200 len: 1449 microversion: 2.75 time: 0.130787 Oct 24 10:30:24.816089 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 809/1708] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:30:24 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 1449 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:30:25.000364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7f844737-4772-4d9a-9726-caf5b2233fe3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:25.024129 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7f844737-4772-4d9a-9726-caf5b2233fe3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 200 len: 1308 microversion: 2.1 time: 0.288169 Oct 24 10:30:25.043858 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 900/1709] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:24 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 1308 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:25.593578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-95e493a0-346e-4ad2-81ac-084750da345a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:25.595523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-95e493a0-346e-4ad2-81ac-084750da345a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:25.606559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95e493a0-346e-4ad2-81ac-084750da345a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:25.607432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95e493a0-346e-4ad2-81ac-084750da345a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:25.608345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95e493a0-346e-4ad2-81ac-084750da345a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:25.609443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95e493a0-346e-4ad2-81ac-084750da345a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:25.610602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95e493a0-346e-4ad2-81ac-084750da345a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:25.611265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95e493a0-346e-4ad2-81ac-084750da345a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:25.656823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-121d8300-f23a-4d09-90a8-62b119cca44b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:25.657879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-121d8300-f23a-4d09-90a8-62b119cca44b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 294c2f53-e675-40b8-a91f-634939781010] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:25.673282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-121d8300-f23a-4d09-90a8-62b119cca44b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:25.674319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-121d8300-f23a-4d09-90a8-62b119cca44b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:25.678682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-121d8300-f23a-4d09-90a8-62b119cca44b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:25.680953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-121d8300-f23a-4d09-90a8-62b119cca44b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:25.682277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-121d8300-f23a-4d09-90a8-62b119cca44b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:25.683014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-121d8300-f23a-4d09-90a8-62b119cca44b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:25.704815 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-121d8300-f23a-4d09-90a8-62b119cca44b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] HTTP exception thrown: Instance 294c2f53-e675-40b8-a91f-634939781010 could not be found. Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-121d8300-f23a-4d09-90a8-62b119cca44b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Request method failure captured: Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 HTTP/1.1 Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmhXqNSBsh7K7Uj2jXvR0yTVG9LTHhhGPCF6c-R_uu5XAWXN3q_pOqU3EQ6kswdvFK06P0vNock9UqKjP52kirztfJqRQ9SK9bbaCmdkDeP1GYXpg5nJ_Ea2cS2kg-fXYgatWKicP0gLPLbADF61RGIaCfWEQwHUVVkXN2VQjipCuYA Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: b565572c0c8c4871af02471a328bd1af Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:30:25.708707 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:30:25.712013 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b565572c0c8c4871af02471a328bd1af", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:30:25.712013 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:25.712013 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: b565572c0c8c4871af02471a328bd1af Oct 24 10:30:25.712013 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:25.712013 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersOnMultiNodesTest-2087726178-project Oct 24 10:30:25.712013 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:30:25.712013 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:30:25.712013 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 9aa572f1e5014e10bed0abe34dfad43f Oct 24 10:30:25.712013 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersOnMultiNodesTest-2087726178-project Oct 24 10:30:25.712013 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:30:25.712013 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 294c2f53-e675-40b8-a91f-634939781010 could not be found. Oct 24 10:30:25.712013 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '294c2f53-e675-40b8-a91f-634939781010'} Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 294c2f53-e675-40b8-a91f-634939781010 could not be found. Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:30:25.713159 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:30:25.714991 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:30:25.714991 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:30:25.714991 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:30:25.714991 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:30:25.714991 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:30:25.714991 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:30:25.714991 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:30:25.714991 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 294c2f53-e675-40b8-a91f-634939781010 could not be found. Oct 24 10:30:25.714991 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:25.714991 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:25.714991 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:25.714991 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:25.714991 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:25.714991 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:25.714991 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:30:25.714991 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:30:25.714991 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 294c2f53-e675-40b8-a91f-634939781010 could not be found. Oct 24 10:30:25.714991 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:25.720659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-121d8300-f23a-4d09-90a8-62b119cca44b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Returning 404 to user: Instance 294c2f53-e675-40b8-a91f-634939781010 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:30:25.722102 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-121d8300-f23a-4d09-90a8-62b119cca44b tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010" status: 404 len: 111 microversion: 2.1 time: 0.070846 Oct 24 10:30:25.729209 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 901/1710] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:25 2022] GET /compute/v2.1/servers/294c2f53-e675-40b8-a91f-634939781010 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:30:25.735237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-df958eed-8c73-49e6-aea3-9bf4d157b6ec tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:25.776909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-95e493a0-346e-4ad2-81ac-084750da345a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:25.785948 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-95e493a0-346e-4ad2-81ac-084750da345a tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1426 microversion: 2.1 time: 0.197966 Oct 24 10:30:25.789262 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 810/1711] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:25 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1426 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:25.814176 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-df958eed-8c73-49e6-aea3-9bf4d157b6ec tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/0d6a7907-764b-402a-8228-682fb6b4a6a5" status: 204 len: 0 microversion: 2.1 time: 0.083349 Oct 24 10:30:25.815182 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 902/1712] 10.222.0.50 () {58 vars in 1266 bytes} [Mon Oct 24 10:30:25 2022] DELETE /compute/v2.1/os-server-groups/0d6a7907-764b-402a-8228-682fb6b4a6a5 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:30:25.825763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7f97c10f-202a-4a80-9d68-3eb711b16d89 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:25.826384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7f97c10f-202a-4a80-9d68-3eb711b16d89 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] [instance: c99c990f-944a-4227-9d75-5d09a861855e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:25.838685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f97c10f-202a-4a80-9d68-3eb711b16d89 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:25.839821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f97c10f-202a-4a80-9d68-3eb711b16d89 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:25.840648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f97c10f-202a-4a80-9d68-3eb711b16d89 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:25.841063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fbdeac34-a84b-48ef-be1d-f39c470d33d6 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:25.842804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fbdeac34-a84b-48ef-be1d-f39c470d33d6 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: a867d805-6462-410b-9486-bffcf7a9425c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:25.842962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f97c10f-202a-4a80-9d68-3eb711b16d89 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:25.843423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f97c10f-202a-4a80-9d68-3eb711b16d89 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:25.844525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f97c10f-202a-4a80-9d68-3eb711b16d89 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:25.848720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:25.854449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbdeac34-a84b-48ef-be1d-f39c470d33d6 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:25.855887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbdeac34-a84b-48ef-be1d-f39c470d33d6 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:25.859273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbdeac34-a84b-48ef-be1d-f39c470d33d6 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:25.860152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbdeac34-a84b-48ef-be1d-f39c470d33d6 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:25.860759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbdeac34-a84b-48ef-be1d-f39c470d33d6 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:25.861170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbdeac34-a84b-48ef-be1d-f39c470d33d6 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:25.892428 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-7f97c10f-202a-4a80-9d68-3eb711b16d89 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] HTTP exception thrown: Instance c99c990f-944a-4227-9d75-5d09a861855e could not be found. Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7f97c10f-202a-4a80-9d68-3eb711b16d89 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Request method failure captured: Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e HTTP/1.1 Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmjR8EU_8DscQ3Hw9DqiYFwpu0s-0VpLzRpF7UP9PfYKpjjRe0QqqjuFTW34EQFrxvYiZ9Gn1MmAsYzuLArz8JoNI3mU6XYZUNln6KkUs4D593kBcigpSmZLxZ51UYebOIXjIdOgb4p6L9J9ztMxxISHADCayXPAzTajJQ156HuWm5U Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.75 Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 58eb5f0cf9bc41c48c0815d5c7905989 Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersAdmin275Test-1045686446 Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:30:25.903269 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:30:25.905308 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58eb5f0cf9bc41c48c0815d5c7905989"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58eb5f0cf9bc41c48c0815d5c7905989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/58eb5f0cf9bc41c48c0815d5c7905989"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_58eb5f0cf9bc41c48c0815d5c7905989", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:30:25.905308 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersAdmin275Test-1045686446 Oct 24 10:30:25.905308 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 58eb5f0cf9bc41c48c0815d5c7905989 Oct 24 10:30:25.905308 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersAdmin275Test-1045686446 Oct 24 10:30:25.905308 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersAdmin275Test-1045686446-project Oct 24 10:30:25.905308 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:30:25.905308 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:30:25.905308 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 08328a8deb7a4107b30f61c10e92477b Oct 24 10:30:25.905308 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersAdmin275Test-1045686446-project Oct 24 10:30:25.905308 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:30:25.905308 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance c99c990f-944a-4227-9d75-5d09a861855e could not be found. Oct 24 10:30:25.905308 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'c99c990f-944a-4227-9d75-5d09a861855e'} Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99c990f-944a-4227-9d75-5d09a861855e could not be found. Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:30:25.907656 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:30:25.909383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:30:25.909383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:30:25.909383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:30:25.909383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:30:25.909383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:30:25.909383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:30:25.909383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:30:25.909383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99c990f-944a-4227-9d75-5d09a861855e could not be found. Oct 24 10:30:25.909383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:25.909383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:25.909383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:25.909383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:25.909383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:25.909383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:25.909383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:30:25.909383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:30:25.909383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99c990f-944a-4227-9d75-5d09a861855e could not be found. Oct 24 10:30:25.909383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:25.912416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7f97c10f-202a-4a80-9d68-3eb711b16d89 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] Returning 404 to user: Instance c99c990f-944a-4227-9d75-5d09a861855e could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:30:25.917495 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7f97c10f-202a-4a80-9d68-3eb711b16d89 tempest-ServersAdmin275Test-1045686446 tempest-ServersAdmin275Test-1045686446-project] 10.222.0.50 "GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e" status: 404 len: 111 microversion: 2.75 time: 0.097667 Oct 24 10:30:25.918665 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 811/1713] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:30:25 2022] GET /compute/v2.1/servers/c99c990f-944a-4227-9d75-5d09a861855e => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:30:25.926018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fbdeac34-a84b-48ef-be1d-f39c470d33d6 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: a867d805-6462-410b-9486-bffcf7a9425c] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:30:26.141663 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fbdeac34-a84b-48ef-be1d-f39c470d33d6 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a867d805-6462-410b-9486-bffcf7a9425c" status: 204 len: 0 microversion: 2.1 time: 0.313318 Oct 24 10:30:26.142840 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 903/1714] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:30:25 2022] DELETE /compute/v2.1/servers/a867d805-6462-410b-9486-bffcf7a9425c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:30:26.149606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0b9c9954-c679-4616-8526-fc55c4de3a65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:26.153340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0b9c9954-c679-4616-8526-fc55c4de3a65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:26.170744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b9c9954-c679-4616-8526-fc55c4de3a65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:26.172253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b9c9954-c679-4616-8526-fc55c4de3a65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:26.174305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b9c9954-c679-4616-8526-fc55c4de3a65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:26.175564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b9c9954-c679-4616-8526-fc55c4de3a65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:26.175689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b9c9954-c679-4616-8526-fc55c4de3a65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:26.177568 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b9c9954-c679-4616-8526-fc55c4de3a65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:26.508727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-7d9e0e15-7a3f-40a0-a7a3-fe910b0985e3 req-4bb460ad-6a14-4b81-b09b-5d30a2a1e7ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b52c962-e95e-465b-a898-0cb4fffe0ba0", "name": "network-vif-deleted", "tag": "eb4f598e-dc19-47d1-99f7-93994ac25681"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:26.525456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7d9e0e15-7a3f-40a0-a7a3-fe910b0985e3 req-4bb460ad-6a14-4b81-b09b-5d30a2a1e7ec service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:26.526247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7d9e0e15-7a3f-40a0-a7a3-fe910b0985e3 req-4bb460ad-6a14-4b81-b09b-5d30a2a1e7ec service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:26.526891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7d9e0e15-7a3f-40a0-a7a3-fe910b0985e3 req-4bb460ad-6a14-4b81-b09b-5d30a2a1e7ec service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:26.548646 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-7d9e0e15-7a3f-40a0-a7a3-fe910b0985e3 req-4bb460ad-6a14-4b81-b09b-5d30a2a1e7ec service nova] Creating event network-vif-deleted:eb4f598e-dc19-47d1-99f7-93994ac25681 for instance 1b52c962-e95e-465b-a898-0cb4fffe0ba0 on n-h1-858383-15 Oct 24 10:30:26.555228 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-7d9e0e15-7a3f-40a0-a7a3-fe910b0985e3 req-4bb460ad-6a14-4b81-b09b-5d30a2a1e7ec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.577252 Oct 24 10:30:26.556675 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 812/1715] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:30:26.563485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31db2d32-d721-46ef-8a14-b803557767d5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:26.564409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31db2d32-d721-46ef-8a14-b803557767d5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 0d5c6e34-f247-4f26-b237-26fc89ffc2bb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:26.572086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31db2d32-d721-46ef-8a14-b803557767d5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:26.572884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31db2d32-d721-46ef-8a14-b803557767d5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:26.573322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31db2d32-d721-46ef-8a14-b803557767d5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:26.574344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31db2d32-d721-46ef-8a14-b803557767d5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:26.574969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31db2d32-d721-46ef-8a14-b803557767d5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:26.575568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31db2d32-d721-46ef-8a14-b803557767d5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:26.612637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31db2d32-d721-46ef-8a14-b803557767d5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 0d5c6e34-f247-4f26-b237-26fc89ffc2bb] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:30:26.618650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0b9c9954-c679-4616-8526-fc55c4de3a65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:26.629283 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0b9c9954-c679-4616-8526-fc55c4de3a65 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 200 len: 1308 microversion: 2.1 time: 0.484576 Oct 24 10:30:26.632416 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 904/1716] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:26 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 1308 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:26.732876 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31db2d32-d721-46ef-8a14-b803557767d5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb" status: 204 len: 0 microversion: 2.1 time: 0.174451 Oct 24 10:30:26.735226 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 813/1717] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:30:26 2022] DELETE /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:30:26.745960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-547b58e7-43d3-4b77-be3b-0e54ea9aedc0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:26.747760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-547b58e7-43d3-4b77-be3b-0e54ea9aedc0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: a867d805-6462-410b-9486-bffcf7a9425c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:26.767816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-547b58e7-43d3-4b77-be3b-0e54ea9aedc0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:26.769984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-547b58e7-43d3-4b77-be3b-0e54ea9aedc0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:26.771147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-547b58e7-43d3-4b77-be3b-0e54ea9aedc0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:26.773411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-547b58e7-43d3-4b77-be3b-0e54ea9aedc0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:26.776806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-547b58e7-43d3-4b77-be3b-0e54ea9aedc0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:26.778628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-547b58e7-43d3-4b77-be3b-0e54ea9aedc0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:26.816139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e8d1c732-b44f-45d8-bcfc-dc4ddae2d713 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:26.818517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e8d1c732-b44f-45d8-bcfc-dc4ddae2d713 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:26.839624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8d1c732-b44f-45d8-bcfc-dc4ddae2d713 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:26.849266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8d1c732-b44f-45d8-bcfc-dc4ddae2d713 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:26.849753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8d1c732-b44f-45d8-bcfc-dc4ddae2d713 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:26.856699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8d1c732-b44f-45d8-bcfc-dc4ddae2d713 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:26.857430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8d1c732-b44f-45d8-bcfc-dc4ddae2d713 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:26.858647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8d1c732-b44f-45d8-bcfc-dc4ddae2d713 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:26.946784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8d1c732-b44f-45d8-bcfc-dc4ddae2d713 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:26.949415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8d1c732-b44f-45d8-bcfc-dc4ddae2d713 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:26.949879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8d1c732-b44f-45d8-bcfc-dc4ddae2d713 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:26.951988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-e8d1c732-b44f-45d8-bcfc-dc4ddae2d713 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lazy-loading 'fault' on Instance uuid 1b52c962-e95e-465b-a898-0cb4fffe0ba0 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:27.075345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e8d1c732-b44f-45d8-bcfc-dc4ddae2d713 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b684c865fc9e4abb8e0e55616087b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f703504204b91a5c7e895964ec985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:27.098974 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e8d1c732-b44f-45d8-bcfc-dc4ddae2d713 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 200 len: 1302 microversion: 2.1 time: 0.275757 Oct 24 10:30:27.099665 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 814/1718] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:26 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 1302 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:27.178288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-547b58e7-43d3-4b77-be3b-0e54ea9aedc0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:27.190183 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-547b58e7-43d3-4b77-be3b-0e54ea9aedc0 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/a867d805-6462-410b-9486-bffcf7a9425c" status: 200 len: 1475 microversion: 2.1 time: 0.450349 Oct 24 10:30:27.193701 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 905/1719] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:26 2022] GET /compute/v2.1/servers/a867d805-6462-410b-9486-bffcf7a9425c => generated 1475 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:27.655692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a106fc9e-55aa-422d-88a5-c79e2808e19a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:27.656309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a106fc9e-55aa-422d-88a5-c79e2808e19a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:27.670590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a106fc9e-55aa-422d-88a5-c79e2808e19a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:27.672266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a106fc9e-55aa-422d-88a5-c79e2808e19a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:27.672930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a106fc9e-55aa-422d-88a5-c79e2808e19a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:27.674331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a106fc9e-55aa-422d-88a5-c79e2808e19a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:27.675202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a106fc9e-55aa-422d-88a5-c79e2808e19a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:27.675805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a106fc9e-55aa-422d-88a5-c79e2808e19a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:27.993444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a106fc9e-55aa-422d-88a5-c79e2808e19a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:28.002124 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a106fc9e-55aa-422d-88a5-c79e2808e19a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 200 len: 1308 microversion: 2.1 time: 0.350340 Oct 24 10:30:28.021294 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 815/1720] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:27 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 1308 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:28.138776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c1f68a55-29a2-42aa-a35b-4c75b5672ef2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:28.140573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c1f68a55-29a2-42aa-a35b-4c75b5672ef2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] [instance: 1b52c962-e95e-465b-a898-0cb4fffe0ba0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:28.152790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1f68a55-29a2-42aa-a35b-4c75b5672ef2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:28.153609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1f68a55-29a2-42aa-a35b-4c75b5672ef2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:28.154288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1f68a55-29a2-42aa-a35b-4c75b5672ef2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:28.155256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1f68a55-29a2-42aa-a35b-4c75b5672ef2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:28.155954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1f68a55-29a2-42aa-a35b-4c75b5672ef2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:28.156629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1f68a55-29a2-42aa-a35b-4c75b5672ef2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:28.180928 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-c1f68a55-29a2-42aa-a35b-4c75b5672ef2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] HTTP exception thrown: Instance 1b52c962-e95e-465b-a898-0cb4fffe0ba0 could not be found. Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c1f68a55-29a2-42aa-a35b-4c75b5672ef2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Request method failure captured: Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 HTTP/1.1 Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmfTgiVQkFreHjUnM8-9M4WXdVFFo3TwbYUuG90tWMf2U84Ct43t2RwFf9lp6Koocs_zPZzrCgx5V-uG_TrbOvXwkjInhf2fsg4sP_gV4bmp_eUqwH3j4gAJjxf3-J-L2cM0sKsq5wfN7DvL6M_aE1fA6jhg_Su-jUer19zeP7djDKU Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: ac5f703504204b91a5c7e895964ec985 Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-MigrationsAdminTest-1912783839 Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:30:28.184925 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:30:28.186540 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ac5f703504204b91a5c7e895964ec985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ac5f703504204b91a5c7e895964ec985"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ac5f703504204b91a5c7e895964ec985"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ac5f703504204b91a5c7e895964ec985", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:30:28.186540 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-MigrationsAdminTest-1912783839 Oct 24 10:30:28.186540 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: ac5f703504204b91a5c7e895964ec985 Oct 24 10:30:28.186540 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-MigrationsAdminTest-1912783839 Oct 24 10:30:28.186540 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-MigrationsAdminTest-1912783839-project Oct 24 10:30:28.186540 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:30:28.186540 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:30:28.186540 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: b684c865fc9e4abb8e0e55616087b92e Oct 24 10:30:28.186540 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-MigrationsAdminTest-1912783839-project Oct 24 10:30:28.186540 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:30:28.186540 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 1b52c962-e95e-465b-a898-0cb4fffe0ba0 could not be found. Oct 24 10:30:28.186540 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '1b52c962-e95e-465b-a898-0cb4fffe0ba0'} Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b52c962-e95e-465b-a898-0cb4fffe0ba0 could not be found. Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:30:28.187363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:30:28.188672 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:30:28.188672 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:30:28.188672 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:30:28.188672 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:30:28.188672 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:30:28.188672 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:30:28.188672 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:30:28.188672 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b52c962-e95e-465b-a898-0cb4fffe0ba0 could not be found. Oct 24 10:30:28.188672 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:28.188672 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:28.188672 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:28.188672 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:28.188672 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:28.188672 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:28.188672 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:30:28.188672 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:30:28.188672 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b52c962-e95e-465b-a898-0cb4fffe0ba0 could not be found. Oct 24 10:30:28.188672 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:28.191081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c1f68a55-29a2-42aa-a35b-4c75b5672ef2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] Returning 404 to user: Instance 1b52c962-e95e-465b-a898-0cb4fffe0ba0 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:30:28.192035 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c1f68a55-29a2-42aa-a35b-4c75b5672ef2 tempest-MigrationsAdminTest-1912783839 tempest-MigrationsAdminTest-1912783839-project] 10.222.0.50 "GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0" status: 404 len: 111 microversion: 2.1 time: 0.071616 Oct 24 10:30:28.192998 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 906/1721] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:28 2022] GET /compute/v2.1/servers/1b52c962-e95e-465b-a898-0cb4fffe0ba0 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:30:28.217536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5f02d61-aae7-42e8-89f5-d4180fd4989e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:28.218475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d5f02d61-aae7-42e8-89f5-d4180fd4989e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: a867d805-6462-410b-9486-bffcf7a9425c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:28.232525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5f02d61-aae7-42e8-89f5-d4180fd4989e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:28.233353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5f02d61-aae7-42e8-89f5-d4180fd4989e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:28.233984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5f02d61-aae7-42e8-89f5-d4180fd4989e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:28.240518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5f02d61-aae7-42e8-89f5-d4180fd4989e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:28.241315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5f02d61-aae7-42e8-89f5-d4180fd4989e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:28.241926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5f02d61-aae7-42e8-89f5-d4180fd4989e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:29.031232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-20713976-7697-4cd2-a86c-50c87b13c523 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:29.032016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-20713976-7697-4cd2-a86c-50c87b13c523 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:29.043204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20713976-7697-4cd2-a86c-50c87b13c523 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:29.044484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20713976-7697-4cd2-a86c-50c87b13c523 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:29.045438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20713976-7697-4cd2-a86c-50c87b13c523 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:29.046194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20713976-7697-4cd2-a86c-50c87b13c523 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:29.046657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20713976-7697-4cd2-a86c-50c87b13c523 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:29.051071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20713976-7697-4cd2-a86c-50c87b13c523 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:29.204900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d5f02d61-aae7-42e8-89f5-d4180fd4989e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:29.219770 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d5f02d61-aae7-42e8-89f5-d4180fd4989e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/a867d805-6462-410b-9486-bffcf7a9425c" status: 200 len: 1475 microversion: 2.1 time: 1.006110 Oct 24 10:30:29.221051 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 816/1722] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:28 2022] GET /compute/v2.1/servers/a867d805-6462-410b-9486-bffcf7a9425c => generated 1475 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:29.713123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-20713976-7697-4cd2-a86c-50c87b13c523 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:29.722808 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-20713976-7697-4cd2-a86c-50c87b13c523 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 200 len: 1308 microversion: 2.1 time: 0.695786 Oct 24 10:30:29.728882 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 907/1723] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:29 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 1308 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:29.783369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-7d5986d3-a1c6-4e83-ac91-55251533195f req-695d87ac-09c8-47dc-b75a-f520f4c7a952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84a8b2f8-edd4-45a3-be5f-878bfc0f5811", "name": "network-vif-plugged", "status": "completed", "tag": "776dc61c-efaa-4518-9e14-466879a8f1c1"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:29.820888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7d5986d3-a1c6-4e83-ac91-55251533195f req-695d87ac-09c8-47dc-b75a-f520f4c7a952 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:29.827870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7d5986d3-a1c6-4e83-ac91-55251533195f req-695d87ac-09c8-47dc-b75a-f520f4c7a952 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:29.828393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7d5986d3-a1c6-4e83-ac91-55251533195f req-695d87ac-09c8-47dc-b75a-f520f4c7a952 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:29.869665 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-7d5986d3-a1c6-4e83-ac91-55251533195f req-695d87ac-09c8-47dc-b75a-f520f4c7a952 service nova] Creating event network-vif-plugged:776dc61c-efaa-4518-9e14-466879a8f1c1 for instance 84a8b2f8-edd4-45a3-be5f-878bfc0f5811 on n-h2-858383-15 Oct 24 10:30:29.882158 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-7d5986d3-a1c6-4e83-ac91-55251533195f req-695d87ac-09c8-47dc-b75a-f520f4c7a952 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102337 Oct 24 10:30:29.883180 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 817/1724] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:30.092232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-4d2cac68-abab-48aa-a21e-7212684d26ed req-5c0d8374-bfae-4296-9479-23b86a699ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a867d805-6462-410b-9486-bffcf7a9425c", "name": "network-vif-deleted", "tag": "e435d6a8-8b24-4eb0-9ebb-53775303b942"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:30.115171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4d2cac68-abab-48aa-a21e-7212684d26ed req-5c0d8374-bfae-4296-9479-23b86a699ed1 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:30.115171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4d2cac68-abab-48aa-a21e-7212684d26ed req-5c0d8374-bfae-4296-9479-23b86a699ed1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:30.128175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4d2cac68-abab-48aa-a21e-7212684d26ed req-5c0d8374-bfae-4296-9479-23b86a699ed1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:30.158171 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-4d2cac68-abab-48aa-a21e-7212684d26ed req-5c0d8374-bfae-4296-9479-23b86a699ed1 service nova] Creating event network-vif-deleted:e435d6a8-8b24-4eb0-9ebb-53775303b942 for instance a867d805-6462-410b-9486-bffcf7a9425c on n-h2-858383-15 Oct 24 10:30:30.182436 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-4d2cac68-abab-48aa-a21e-7212684d26ed req-5c0d8374-bfae-4296-9479-23b86a699ed1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095223 Oct 24 10:30:30.189245 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 908/1725] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:30.246892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7c286573-3085-4114-aea6-e113e64ab667 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:30.248262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7c286573-3085-4114-aea6-e113e64ab667 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: a867d805-6462-410b-9486-bffcf7a9425c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:30.261771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c286573-3085-4114-aea6-e113e64ab667 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:30.262278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c286573-3085-4114-aea6-e113e64ab667 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:30.262729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c286573-3085-4114-aea6-e113e64ab667 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:30.263455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c286573-3085-4114-aea6-e113e64ab667 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:30.263917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c286573-3085-4114-aea6-e113e64ab667 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:30.269735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c286573-3085-4114-aea6-e113e64ab667 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:30.588859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7c286573-3085-4114-aea6-e113e64ab667 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:30.611180 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7c286573-3085-4114-aea6-e113e64ab667 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/a867d805-6462-410b-9486-bffcf7a9425c" status: 200 len: 1304 microversion: 2.1 time: 0.369430 Oct 24 10:30:30.615499 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 818/1726] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:30 2022] GET /compute/v2.1/servers/a867d805-6462-410b-9486-bffcf7a9425c => generated 1304 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:30.750260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d9b7b15f-a948-4472-8d23-fb371244c376 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:30.751644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d9b7b15f-a948-4472-8d23-fb371244c376 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:30.781006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9b7b15f-a948-4472-8d23-fb371244c376 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:30.793828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9b7b15f-a948-4472-8d23-fb371244c376 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:30.794297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9b7b15f-a948-4472-8d23-fb371244c376 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:30.795290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9b7b15f-a948-4472-8d23-fb371244c376 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:30.795522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9b7b15f-a948-4472-8d23-fb371244c376 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:30.795952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9b7b15f-a948-4472-8d23-fb371244c376 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:31.131342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-59cb6777-fc1b-44c3-aeae-fe282abcf1ed req-4d633911-6a5d-4a8d-a6f3-782988363aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5c6e34-f247-4f26-b237-26fc89ffc2bb", "name": "network-vif-deleted", "tag": "46205a92-e3a8-4bbd-95c2-a49c14bc701b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:31.179693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-59cb6777-fc1b-44c3-aeae-fe282abcf1ed req-4d633911-6a5d-4a8d-a6f3-782988363aa8 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:31.184899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-59cb6777-fc1b-44c3-aeae-fe282abcf1ed req-4d633911-6a5d-4a8d-a6f3-782988363aa8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:31.186815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-59cb6777-fc1b-44c3-aeae-fe282abcf1ed req-4d633911-6a5d-4a8d-a6f3-782988363aa8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:31.267935 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-59cb6777-fc1b-44c3-aeae-fe282abcf1ed req-4d633911-6a5d-4a8d-a6f3-782988363aa8 service nova] Creating event network-vif-deleted:46205a92-e3a8-4bbd-95c2-a49c14bc701b for instance 0d5c6e34-f247-4f26-b237-26fc89ffc2bb on n-h2-858383-15 Oct 24 10:30:31.295549 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-59cb6777-fc1b-44c3-aeae-fe282abcf1ed req-4d633911-6a5d-4a8d-a6f3-782988363aa8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169683 Oct 24 10:30:31.302720 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 819/1727] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:31.487798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d9b7b15f-a948-4472-8d23-fb371244c376 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:31.503732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:31.525043 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d9b7b15f-a948-4472-8d23-fb371244c376 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 200 len: 1308 microversion: 2.1 time: 0.779329 Oct 24 10:30:31.530679 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 909/1728] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:30 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 1308 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:31.652442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1b6cadc4-32ac-4e61-b890-ffc670ac039f tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:31.654547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1b6cadc4-32ac-4e61-b890-ffc670ac039f tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: a867d805-6462-410b-9486-bffcf7a9425c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:31.669316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b6cadc4-32ac-4e61-b890-ffc670ac039f tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:31.672488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b6cadc4-32ac-4e61-b890-ffc670ac039f tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:31.675478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b6cadc4-32ac-4e61-b890-ffc670ac039f tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:31.676898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b6cadc4-32ac-4e61-b890-ffc670ac039f tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:31.678660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b6cadc4-32ac-4e61-b890-ffc670ac039f tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:31.679264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b6cadc4-32ac-4e61-b890-ffc670ac039f tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:31.736703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b6cadc4-32ac-4e61-b890-ffc670ac039f tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:31.738819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b6cadc4-32ac-4e61-b890-ffc670ac039f tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:31.739459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b6cadc4-32ac-4e61-b890-ffc670ac039f tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:31.740091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-1b6cadc4-32ac-4e61-b890-ffc670ac039f tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lazy-loading 'fault' on Instance uuid a867d805-6462-410b-9486-bffcf7a9425c {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:31.815610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1b6cadc4-32ac-4e61-b890-ffc670ac039f tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:31.830759 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1b6cadc4-32ac-4e61-b890-ffc670ac039f tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/a867d805-6462-410b-9486-bffcf7a9425c" status: 200 len: 1309 microversion: 2.1 time: 0.193568 Oct 24 10:30:31.833434 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 820/1729] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:31 2022] GET /compute/v2.1/servers/a867d805-6462-410b-9486-bffcf7a9425c => generated 1309 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:32.568288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7c44d699-5a4c-448f-b332-f0c899f0a644 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:32.570239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7c44d699-5a4c-448f-b332-f0c899f0a644 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:32.592213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c44d699-5a4c-448f-b332-f0c899f0a644 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:32.593701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c44d699-5a4c-448f-b332-f0c899f0a644 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:32.595647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c44d699-5a4c-448f-b332-f0c899f0a644 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:32.598616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c44d699-5a4c-448f-b332-f0c899f0a644 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:32.599973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c44d699-5a4c-448f-b332-f0c899f0a644 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:32.618990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c44d699-5a4c-448f-b332-f0c899f0a644 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:32.840090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d05bf9fd-a2ae-4452-9ab0-9693a9e81645 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-810780612", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:32.958163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-d05bf9fd-a2ae-4452-9ab0-9693a9e81645 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:30:33.260081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7c44d699-5a4c-448f-b332-f0c899f0a644 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:33.264608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:33.277654 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7c44d699-5a4c-448f-b332-f0c899f0a644 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 200 len: 1487 microversion: 2.1 time: 0.720132 Oct 24 10:30:33.279842 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 821/1730] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:32 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 1487 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:33.288243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2fd6dda4-62a9-4dc0-81f6-1a94a3f41e14 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:33.294551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2fd6dda4-62a9-4dc0-81f6-1a94a3f41e14 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: a867d805-6462-410b-9486-bffcf7a9425c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:33.308170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fd6dda4-62a9-4dc0-81f6-1a94a3f41e14 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:33.316122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fd6dda4-62a9-4dc0-81f6-1a94a3f41e14 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:33.321733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fd6dda4-62a9-4dc0-81f6-1a94a3f41e14 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:33.322717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fd6dda4-62a9-4dc0-81f6-1a94a3f41e14 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:33.323362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fd6dda4-62a9-4dc0-81f6-1a94a3f41e14 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:33.323964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fd6dda4-62a9-4dc0-81f6-1a94a3f41e14 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:33.382468 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-2fd6dda4-62a9-4dc0-81f6-1a94a3f41e14 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] HTTP exception thrown: Instance a867d805-6462-410b-9486-bffcf7a9425c could not be found. Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2fd6dda4-62a9-4dc0-81f6-1a94a3f41e14 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Request method failure captured: Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/a867d805-6462-410b-9486-bffcf7a9425c HTTP/1.1 Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmhXqNSBsh7K7Uj2jXvR0yTVG9LTHhhGPCF6c-R_uu5XAWXN3q_pOqU3EQ6kswdvFK06P0vNock9UqKjP52kirztfJqRQ9SK9bbaCmdkDeP1GYXpg5nJ_Ea2cS2kg-fXYgatWKicP0gLPLbADF61RGIaCfWEQwHUVVkXN2VQjipCuYA Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: b565572c0c8c4871af02471a328bd1af Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:30:33.385045 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:30:33.386730 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b565572c0c8c4871af02471a328bd1af", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:30:33.386730 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:33.386730 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: b565572c0c8c4871af02471a328bd1af Oct 24 10:30:33.386730 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:33.386730 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersOnMultiNodesTest-2087726178-project Oct 24 10:30:33.386730 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:30:33.386730 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:30:33.386730 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 9aa572f1e5014e10bed0abe34dfad43f Oct 24 10:30:33.386730 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersOnMultiNodesTest-2087726178-project Oct 24 10:30:33.386730 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:30:33.386730 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance a867d805-6462-410b-9486-bffcf7a9425c could not be found. Oct 24 10:30:33.386730 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'a867d805-6462-410b-9486-bffcf7a9425c'} Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a867d805-6462-410b-9486-bffcf7a9425c could not be found. Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:30:33.387877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:30:33.389661 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:30:33.389661 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:30:33.389661 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:30:33.389661 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:30:33.389661 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:30:33.389661 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:30:33.389661 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:30:33.389661 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a867d805-6462-410b-9486-bffcf7a9425c could not be found. Oct 24 10:30:33.389661 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:33.389661 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:33.389661 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:33.389661 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:33.389661 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:33.389661 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:33.389661 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:30:33.389661 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:30:33.389661 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a867d805-6462-410b-9486-bffcf7a9425c could not be found. Oct 24 10:30:33.389661 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:30:33.391169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2fd6dda4-62a9-4dc0-81f6-1a94a3f41e14 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Returning 404 to user: Instance a867d805-6462-410b-9486-bffcf7a9425c could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:30:33.391169 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2fd6dda4-62a9-4dc0-81f6-1a94a3f41e14 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/a867d805-6462-410b-9486-bffcf7a9425c" status: 404 len: 111 microversion: 2.1 time: 0.105447 Oct 24 10:30:33.391169 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 822/1731] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:33 2022] GET /compute/v2.1/servers/a867d805-6462-410b-9486-bffcf7a9425c => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:30:33.406917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d05bf9fd-a2ae-4452-9ab0-9693a9e81645 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:30:33.407556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d05bf9fd-a2ae-4452-9ab0-9693a9e81645 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:30:33.408201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d05bf9fd-a2ae-4452-9ab0-9693a9e81645 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:30:33.408771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d05bf9fd-a2ae-4452-9ab0-9693a9e81645 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:30:33.409407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f03c710a-9f01-4136-8686-ebbe325f4127 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:33.409666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d05bf9fd-a2ae-4452-9ab0-9693a9e81645 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:30:33.410576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f03c710a-9f01-4136-8686-ebbe325f4127 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:33.429394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f03c710a-9f01-4136-8686-ebbe325f4127 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:33.430322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f03c710a-9f01-4136-8686-ebbe325f4127 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:33.432315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d05bf9fd-a2ae-4452-9ab0-9693a9e81645 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:33.432971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d05bf9fd-a2ae-4452-9ab0-9693a9e81645 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:33.433173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f03c710a-9f01-4136-8686-ebbe325f4127 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:33.434244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f03c710a-9f01-4136-8686-ebbe325f4127 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:33.434589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f03c710a-9f01-4136-8686-ebbe325f4127 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:33.435105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f03c710a-9f01-4136-8686-ebbe325f4127 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:33.437555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d05bf9fd-a2ae-4452-9ab0-9693a9e81645 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:33.438405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d05bf9fd-a2ae-4452-9ab0-9693a9e81645 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:33.438890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d05bf9fd-a2ae-4452-9ab0-9693a9e81645 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:33.439309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d05bf9fd-a2ae-4452-9ab0-9693a9e81645 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:33.497783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-f03c710a-9f01-4136-8686-ebbe325f4127 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lazy-loading 'flavor' on Instance uuid 84a8b2f8-edd4-45a3-be5f-878bfc0f5811 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:30:33.513911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d05bf9fd-a2ae-4452-9ab0-9693a9e81645 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Getting quotas for project 496cc02be0824f85a94d06669e9662e5. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:30:33.529209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d05bf9fd-a2ae-4452-9ab0-9693a9e81645 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Getting quotas for user cd513ecfb3554dffaa701fdcf8ab4d5c and project 496cc02be0824f85a94d06669e9662e5. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:30:33.579120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d05bf9fd-a2ae-4452-9ab0-9693a9e81645 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:30:33.591585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d05bf9fd-a2ae-4452-9ab0-9693a9e81645 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:30:33.689667 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d05bf9fd-a2ae-4452-9ab0-9693a9e81645 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.498918 Oct 24 10:30:33.697862 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 910/1732] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:30:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 10:30:33.708361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7d5b3872-2b59-4011-a8dc-b81bfc30c774 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:33.710366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7d5b3872-2b59-4011-a8dc-b81bfc30c774 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 0d5c6e34-f247-4f26-b237-26fc89ffc2bb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:33.729467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d5b3872-2b59-4011-a8dc-b81bfc30c774 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:33.745781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d5b3872-2b59-4011-a8dc-b81bfc30c774 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:33.748872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d5b3872-2b59-4011-a8dc-b81bfc30c774 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:33.749856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d5b3872-2b59-4011-a8dc-b81bfc30c774 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:33.766893 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f03c710a-9f01-4136-8686-ebbe325f4127 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "POST /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811/action" status: 202 len: 0 microversion: 2.1 time: 0.378246 Oct 24 10:30:33.769222 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 823/1733] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:30:33 2022] POST /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:30:33.780265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d5b3872-2b59-4011-a8dc-b81bfc30c774 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:33.780745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d5b3872-2b59-4011-a8dc-b81bfc30c774 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:33.792963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e9879ad0-f3ae-41f9-a8b2-a2e70d681cec tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:33.794265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e9879ad0-f3ae-41f9-a8b2-a2e70d681cec tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:33.845963 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-7d5b3872-2b59-4011-a8dc-b81bfc30c774 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] HTTP exception thrown: Instance 0d5c6e34-f247-4f26-b237-26fc89ffc2bb could not be found. Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7d5b3872-2b59-4011-a8dc-b81bfc30c774 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Request method failure captured: Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb HTTP/1.1 Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmhXqNSBsh7K7Uj2jXvR0yTVG9LTHhhGPCF6c-R_uu5XAWXN3q_pOqU3EQ6kswdvFK06P0vNock9UqKjP52kirztfJqRQ9SK9bbaCmdkDeP1GYXpg5nJ_Ea2cS2kg-fXYgatWKicP0gLPLbADF61RGIaCfWEQwHUVVkXN2VQjipCuYA Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: b565572c0c8c4871af02471a328bd1af Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:30:33.850605 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:30:33.852323 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b565572c0c8c4871af02471a328bd1af", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:30:33.852323 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:33.852323 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: b565572c0c8c4871af02471a328bd1af Oct 24 10:30:33.852323 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:33.852323 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersOnMultiNodesTest-2087726178-project Oct 24 10:30:33.852323 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:30:33.852323 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:30:33.852323 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 9aa572f1e5014e10bed0abe34dfad43f Oct 24 10:30:33.852323 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersOnMultiNodesTest-2087726178-project Oct 24 10:30:33.852323 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:30:33.852323 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 0d5c6e34-f247-4f26-b237-26fc89ffc2bb could not be found. Oct 24 10:30:33.852323 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '0d5c6e34-f247-4f26-b237-26fc89ffc2bb'} Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d5c6e34-f247-4f26-b237-26fc89ffc2bb could not be found. Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:30:33.853179 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:30:33.854585 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:30:33.854585 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:30:33.854585 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:30:33.854585 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:30:33.854585 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:30:33.854585 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:30:33.854585 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:30:33.854585 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d5c6e34-f247-4f26-b237-26fc89ffc2bb could not be found. Oct 24 10:30:33.854585 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:33.854585 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:33.854585 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:33.854585 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:33.854585 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:33.854585 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:33.854585 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:30:33.854585 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:30:33.854585 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d5c6e34-f247-4f26-b237-26fc89ffc2bb could not be found. Oct 24 10:30:33.854585 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:33.863364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7d5b3872-2b59-4011-a8dc-b81bfc30c774 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Returning 404 to user: Instance 0d5c6e34-f247-4f26-b237-26fc89ffc2bb could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:30:33.864483 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7d5b3872-2b59-4011-a8dc-b81bfc30c774 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb" status: 404 len: 111 microversion: 2.1 time: 0.165317 Oct 24 10:30:33.869794 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 911/1734] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:33 2022] GET /compute/v2.1/servers/0d5c6e34-f247-4f26-b237-26fc89ffc2bb => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:30:33.883394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e7c6d9ee-e3e2-4700-a065-5263dd31cacc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:33.886478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9879ad0-f3ae-41f9-a8b2-a2e70d681cec tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd513ecfb3554dffaa701fdcf8ab4d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496cc02be0824f85a94d06669e9662e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:33.890571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e7c6d9ee-e3e2-4700-a065-5263dd31cacc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:33.900941 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e9879ad0-f3ae-41f9-a8b2-a2e70d681cec tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61" status: 200 len: 1213 microversion: 2.1 time: 0.128756 Oct 24 10:30:33.903023 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 824/1735] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:33 2022] GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61 => generated 1213 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:33.911478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3a57ebc7-a5d4-4bac-8385-df251fdd3608 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:33.937817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7c6d9ee-e3e2-4700-a065-5263dd31cacc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:33.943598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7c6d9ee-e3e2-4700-a065-5263dd31cacc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:33.944053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7c6d9ee-e3e2-4700-a065-5263dd31cacc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:33.944807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7c6d9ee-e3e2-4700-a065-5263dd31cacc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:33.950450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7c6d9ee-e3e2-4700-a065-5263dd31cacc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:33.951278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7c6d9ee-e3e2-4700-a065-5263dd31cacc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:34.122708 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3a57ebc7-a5d4-4bac-8385-df251fdd3608 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/06e41963-2e3b-471c-80dc-b907a8cef0a2" status: 204 len: 0 microversion: 2.1 time: 0.217042 Oct 24 10:30:34.128010 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 825/1736] 10.222.0.50 () {58 vars in 1266 bytes} [Mon Oct 24 10:30:33 2022] DELETE /compute/v2.1/os-server-groups/06e41963-2e3b-471c-80dc-b907a8cef0a2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:30:34.145387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31615727-9b22-4d8e-b932-f66fd60a40a4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:34.152193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31615727-9b22-4d8e-b932-f66fd60a40a4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:34.167520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31615727-9b22-4d8e-b932-f66fd60a40a4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:34.168018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31615727-9b22-4d8e-b932-f66fd60a40a4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:34.169012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31615727-9b22-4d8e-b932-f66fd60a40a4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:34.169684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31615727-9b22-4d8e-b932-f66fd60a40a4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:34.170469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31615727-9b22-4d8e-b932-f66fd60a40a4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:34.170936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31615727-9b22-4d8e-b932-f66fd60a40a4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:34.238649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31615727-9b22-4d8e-b932-f66fd60a40a4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:30:34.420201 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31615727-9b22-4d8e-b932-f66fd60a40a4 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404" status: 204 len: 0 microversion: 2.1 time: 0.283549 Oct 24 10:30:34.424125 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 826/1737] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:30:34 2022] DELETE /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:30:34.438195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f72e982a-bffb-42ce-be4f-25171d3dc8b5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:34.440381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f72e982a-bffb-42ce-be4f-25171d3dc8b5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:34.450804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f72e982a-bffb-42ce-be4f-25171d3dc8b5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:34.451675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f72e982a-bffb-42ce-be4f-25171d3dc8b5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:34.452500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f72e982a-bffb-42ce-be4f-25171d3dc8b5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:34.453542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f72e982a-bffb-42ce-be4f-25171d3dc8b5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:34.454294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f72e982a-bffb-42ce-be4f-25171d3dc8b5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:34.454975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f72e982a-bffb-42ce-be4f-25171d3dc8b5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:34.637634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e7c6d9ee-e3e2-4700-a065-5263dd31cacc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:34.655259 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e7c6d9ee-e3e2-4700-a065-5263dd31cacc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 200 len: 1495 microversion: 2.1 time: 0.783161 Oct 24 10:30:34.673871 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 912/1738] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:33 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 1495 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:34.949110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-68eb1ceb-0281-4b2f-b6e8-6c2694a4273a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:34.949717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-68eb1ceb-0281-4b2f-b6e8-6c2694a4273a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:34.964321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68eb1ceb-0281-4b2f-b6e8-6c2694a4273a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:34.965737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68eb1ceb-0281-4b2f-b6e8-6c2694a4273a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:34.966127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68eb1ceb-0281-4b2f-b6e8-6c2694a4273a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:34.972181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68eb1ceb-0281-4b2f-b6e8-6c2694a4273a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:34.972724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68eb1ceb-0281-4b2f-b6e8-6c2694a4273a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:34.973210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68eb1ceb-0281-4b2f-b6e8-6c2694a4273a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:35.079756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f72e982a-bffb-42ce-be4f-25171d3dc8b5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:35.109613 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f72e982a-bffb-42ce-be4f-25171d3dc8b5 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404" status: 200 len: 1471 microversion: 2.1 time: 0.676519 Oct 24 10:30:35.114481 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 827/1739] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:34 2022] GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 => generated 1471 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:35.176644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-68eb1ceb-0281-4b2f-b6e8-6c2694a4273a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd513ecfb3554dffaa701fdcf8ab4d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496cc02be0824f85a94d06669e9662e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:35.191835 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-68eb1ceb-0281-4b2f-b6e8-6c2694a4273a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61" status: 200 len: 1217 microversion: 2.1 time: 0.251298 Oct 24 10:30:35.204911 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 913/1740] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:34 2022] GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61 => generated 1217 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:35.686688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a712ca03-3f37-44a2-951d-0c809d8d47e9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:35.687935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a712ca03-3f37-44a2-951d-0c809d8d47e9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:35.699782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a712ca03-3f37-44a2-951d-0c809d8d47e9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:35.701282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a712ca03-3f37-44a2-951d-0c809d8d47e9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:35.701957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a712ca03-3f37-44a2-951d-0c809d8d47e9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:35.702721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a712ca03-3f37-44a2-951d-0c809d8d47e9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:35.705119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a712ca03-3f37-44a2-951d-0c809d8d47e9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:35.706483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a712ca03-3f37-44a2-951d-0c809d8d47e9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:36.037393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a712ca03-3f37-44a2-951d-0c809d8d47e9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:36.052965 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a712ca03-3f37-44a2-951d-0c809d8d47e9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 200 len: 1478 microversion: 2.1 time: 0.370616 Oct 24 10:30:36.054531 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 828/1741] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:35 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 1478 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:36.083968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-93174804-6a06-4486-81ed-e4b9dbd5994b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1974351688"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:36.092421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-93174804-6a06-4486-81ed-e4b9dbd5994b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:36.130011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93174804-6a06-4486-81ed-e4b9dbd5994b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:36.130465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93174804-6a06-4486-81ed-e4b9dbd5994b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:36.131170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93174804-6a06-4486-81ed-e4b9dbd5994b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:36.131628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93174804-6a06-4486-81ed-e4b9dbd5994b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:36.132090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93174804-6a06-4486-81ed-e4b9dbd5994b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:36.132522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93174804-6a06-4486-81ed-e4b9dbd5994b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:36.141222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e4a914a-1921-4fef-b195-856897a3120e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:36.142866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5e4a914a-1921-4fef-b195-856897a3120e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:36.162511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e4a914a-1921-4fef-b195-856897a3120e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:36.163678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e4a914a-1921-4fef-b195-856897a3120e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:36.164426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e4a914a-1921-4fef-b195-856897a3120e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:36.167049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e4a914a-1921-4fef-b195-856897a3120e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:36.168043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e4a914a-1921-4fef-b195-856897a3120e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:36.169126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e4a914a-1921-4fef-b195-856897a3120e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:36.723555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5e4a914a-1921-4fef-b195-856897a3120e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa572f1e5014e10bed0abe34dfad43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b565572c0c8c4871af02471a328bd1af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:36.748088 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5e4a914a-1921-4fef-b195-856897a3120e tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404" status: 200 len: 1471 microversion: 2.1 time: 0.608362 Oct 24 10:30:36.749522 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 829/1742] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:36 2022] GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 => generated 1471 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:36.769029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c66fa079-5abd-4ade-bbfe-c1af787f9552 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:36.770255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c66fa079-5abd-4ade-bbfe-c1af787f9552 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:36.796207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c66fa079-5abd-4ade-bbfe-c1af787f9552 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:36.796708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c66fa079-5abd-4ade-bbfe-c1af787f9552 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:36.797194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c66fa079-5abd-4ade-bbfe-c1af787f9552 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:36.806502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c66fa079-5abd-4ade-bbfe-c1af787f9552 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:36.812044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c66fa079-5abd-4ade-bbfe-c1af787f9552 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:36.813113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c66fa079-5abd-4ade-bbfe-c1af787f9552 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:36.929459 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-93174804-6a06-4486-81ed-e4b9dbd5994b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "POST /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811/action" status: 202 len: 0 microversion: 2.1 time: 0.850016 Oct 24 10:30:36.939630 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 914/1743] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:30:36 2022] POST /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811/action => generated 0 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 10:30:37.160631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c66fa079-5abd-4ade-bbfe-c1af787f9552 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd513ecfb3554dffaa701fdcf8ab4d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496cc02be0824f85a94d06669e9662e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:37.198871 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c66fa079-5abd-4ade-bbfe-c1af787f9552 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61" status: 200 len: 1271 microversion: 2.1 time: 0.441029 Oct 24 10:30:37.200567 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 830/1744] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:36 2022] GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61 => generated 1271 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:37.220163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cdb745dc-0200-4296-b796-c2fa88a2c966 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0de3dc0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:37.354592 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cdb745dc-0200-4296-b796-c2fa88a2c966 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.149271 Oct 24 10:30:37.365727 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 831/1745] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:37 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:37.373458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bcf1324b-6ece-420c-9720-be24a2c46e24 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-885456069", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "1708b044-d242-49f9-91ed-5f0276ac03a0"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:37.398514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5b826ee3-294c-4d37-b5f1-84fa18dd5e93 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2095883191", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "65c79d3e-bb06-4408-bcb0-99f943a08544"}], "block_device_mapping_v2": [{"uuid": "3930ef59-f070-4333-ac17-f75e997e7a79", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:37.509327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-bcf1324b-6ece-420c-9720-be24a2c46e24 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] validate_networks() for [('1708b044-d242-49f9-91ed-5f0276ac03a0', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:30:37.539312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-5b826ee3-294c-4d37-b5f1-84fa18dd5e93 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] validate_networks() for [('65c79d3e-bb06-4408-bcb0-99f943a08544', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:30:39.503505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-bcf1324b-6ece-420c-9720-be24a2c46e24 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:30:39.504033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-bcf1324b-6ece-420c-9720-be24a2c46e24 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:30:39.505535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-bcf1324b-6ece-420c-9720-be24a2c46e24 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:30:39.509508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-bcf1324b-6ece-420c-9720-be24a2c46e24 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:30:39.510231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-bcf1324b-6ece-420c-9720-be24a2c46e24 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:30:39.521205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bcf1324b-6ece-420c-9720-be24a2c46e24 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:39.521687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bcf1324b-6ece-420c-9720-be24a2c46e24 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:39.522432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bcf1324b-6ece-420c-9720-be24a2c46e24 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:39.526319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bcf1324b-6ece-420c-9720-be24a2c46e24 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:39.526801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bcf1324b-6ece-420c-9720-be24a2c46e24 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:39.527238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bcf1324b-6ece-420c-9720-be24a2c46e24 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:39.561533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5b826ee3-294c-4d37-b5f1-84fa18dd5e93 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:30:39.562879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5b826ee3-294c-4d37-b5f1-84fa18dd5e93 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:30:39.563586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5b826ee3-294c-4d37-b5f1-84fa18dd5e93 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:30:39.564376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5b826ee3-294c-4d37-b5f1-84fa18dd5e93 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:30:39.565124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5b826ee3-294c-4d37-b5f1-84fa18dd5e93 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:30:39.590356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b826ee3-294c-4d37-b5f1-84fa18dd5e93 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:39.592561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b826ee3-294c-4d37-b5f1-84fa18dd5e93 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:39.593946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b826ee3-294c-4d37-b5f1-84fa18dd5e93 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:39.595097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b826ee3-294c-4d37-b5f1-84fa18dd5e93 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:39.600997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b826ee3-294c-4d37-b5f1-84fa18dd5e93 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:39.607178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b826ee3-294c-4d37-b5f1-84fa18dd5e93 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:39.620675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-bcf1324b-6ece-420c-9720-be24a2c46e24 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Getting quotas for project a6bc572680a24c869bea20693817fb1c. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:30:39.647011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-bcf1324b-6ece-420c-9720-be24a2c46e24 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Getting quotas for user d94dc98cc420427a8fe6f756b82aafa1 and project a6bc572680a24c869bea20693817fb1c. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:30:39.718027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bcf1324b-6ece-420c-9720-be24a2c46e24 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:30:39.720553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bcf1324b-6ece-420c-9720-be24a2c46e24 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:30:39.723491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-5b826ee3-294c-4d37-b5f1-84fa18dd5e93 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Getting quotas for project 115025f23db94a71b74b6adbc536792f. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:30:39.741956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-5b826ee3-294c-4d37-b5f1-84fa18dd5e93 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Getting quotas for user 176a68ea281e4f65bbeac67cc304468d and project 115025f23db94a71b74b6adbc536792f. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:30:39.835904 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bcf1324b-6ece-420c-9720-be24a2c46e24 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.893881 Oct 24 10:30:39.848932 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 915/1746] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:30:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:30:39.859597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3002cf0a-abca-458f-b030-ec3711f54949 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:39.863184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3002cf0a-abca-458f-b030-ec3711f54949 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] [instance: 2a8bcf29-893c-4ca8-82cb-636c2bb6f404] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:39.880010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3002cf0a-abca-458f-b030-ec3711f54949 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:39.881398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3002cf0a-abca-458f-b030-ec3711f54949 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:39.883934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3002cf0a-abca-458f-b030-ec3711f54949 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:39.888425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3002cf0a-abca-458f-b030-ec3711f54949 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:39.889836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3002cf0a-abca-458f-b030-ec3711f54949 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:39.891735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3002cf0a-abca-458f-b030-ec3711f54949 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:39.931814 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-3002cf0a-abca-458f-b030-ec3711f54949 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] HTTP exception thrown: Instance 2a8bcf29-893c-4ca8-82cb-636c2bb6f404 could not be found. Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3002cf0a-abca-458f-b030-ec3711f54949 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Request method failure captured: Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 HTTP/1.1 Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmhXqNSBsh7K7Uj2jXvR0yTVG9LTHhhGPCF6c-R_uu5XAWXN3q_pOqU3EQ6kswdvFK06P0vNock9UqKjP52kirztfJqRQ9SK9bbaCmdkDeP1GYXpg5nJ_Ea2cS2kg-fXYgatWKicP0gLPLbADF61RGIaCfWEQwHUVVkXN2VQjipCuYA Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: b565572c0c8c4871af02471a328bd1af Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:30:39.933877 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:30:39.935609 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b565572c0c8c4871af02471a328bd1af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b565572c0c8c4871af02471a328bd1af", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:30:39.935609 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:39.935609 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: b565572c0c8c4871af02471a328bd1af Oct 24 10:30:39.935609 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2087726178 Oct 24 10:30:39.935609 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersOnMultiNodesTest-2087726178-project Oct 24 10:30:39.935609 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:30:39.935609 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:30:39.935609 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 9aa572f1e5014e10bed0abe34dfad43f Oct 24 10:30:39.935609 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersOnMultiNodesTest-2087726178-project Oct 24 10:30:39.935609 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:30:39.935609 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 2a8bcf29-893c-4ca8-82cb-636c2bb6f404 could not be found. Oct 24 10:30:39.935609 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '2a8bcf29-893c-4ca8-82cb-636c2bb6f404'} Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a8bcf29-893c-4ca8-82cb-636c2bb6f404 could not be found. Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:30:39.936579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:30:39.938221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:30:39.938221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:30:39.938221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:30:39.938221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:30:39.938221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:30:39.938221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:30:39.938221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:30:39.938221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a8bcf29-893c-4ca8-82cb-636c2bb6f404 could not be found. Oct 24 10:30:39.938221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:39.938221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:30:39.938221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:39.938221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:30:39.938221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:30:39.938221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:30:39.938221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:30:39.938221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:30:39.938221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a8bcf29-893c-4ca8-82cb-636c2bb6f404 could not be found. Oct 24 10:30:39.938221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:30:39.946827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3002cf0a-abca-458f-b030-ec3711f54949 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] Returning 404 to user: Instance 2a8bcf29-893c-4ca8-82cb-636c2bb6f404 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:30:39.947976 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3002cf0a-abca-458f-b030-ec3711f54949 tempest-ServersOnMultiNodesTest-2087726178 tempest-ServersOnMultiNodesTest-2087726178-project] 10.222.0.50 "GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404" status: 404 len: 111 microversion: 2.1 time: 0.097748 Oct 24 10:30:39.948737 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 916/1747] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:39 2022] GET /compute/v2.1/servers/2a8bcf29-893c-4ca8-82cb-636c2bb6f404 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:30:39.967227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0bfa46bd-9226-4fe4-99ec-3aab537f75fe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:39.979478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0bfa46bd-9226-4fe4-99ec-3aab537f75fe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:39.994613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bfa46bd-9226-4fe4-99ec-3aab537f75fe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:40.004663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5b826ee3-294c-4d37-b5f1-84fa18dd5e93 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:30:40.005608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bfa46bd-9226-4fe4-99ec-3aab537f75fe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:40.007485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bfa46bd-9226-4fe4-99ec-3aab537f75fe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:40.010249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bfa46bd-9226-4fe4-99ec-3aab537f75fe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:40.011516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bfa46bd-9226-4fe4-99ec-3aab537f75fe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:40.014836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bfa46bd-9226-4fe4-99ec-3aab537f75fe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:40.019182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5b826ee3-294c-4d37-b5f1-84fa18dd5e93 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3930ef59-f070-4333-ac17-f75e997e7a79',volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:30:40.564127 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5b826ee3-294c-4d37-b5f1-84fa18dd5e93 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.164088 Oct 24 10:30:40.583602 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 832/1748] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:30:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:30:40.627520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a4dda23c-8fa9-4724-ac63-0a02f7bd08b9 req-59ecd84c-a0a3-4713-bc58-a739147cc0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8bcf29-893c-4ca8-82cb-636c2bb6f404", "name": "network-vif-deleted", "tag": "60b5819c-0c14-41c1-9eb8-bedff7e720a0"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:40.711564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:40.715801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a4dda23c-8fa9-4724-ac63-0a02f7bd08b9 req-59ecd84c-a0a3-4713-bc58-a739147cc0e6 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:40.727104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a4dda23c-8fa9-4724-ac63-0a02f7bd08b9 req-59ecd84c-a0a3-4713-bc58-a739147cc0e6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:40.737562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a4dda23c-8fa9-4724-ac63-0a02f7bd08b9 req-59ecd84c-a0a3-4713-bc58-a739147cc0e6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:40.816194 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a4dda23c-8fa9-4724-ac63-0a02f7bd08b9 req-59ecd84c-a0a3-4713-bc58-a739147cc0e6 service nova] Creating event network-vif-deleted:60b5819c-0c14-41c1-9eb8-bedff7e720a0 for instance 2a8bcf29-893c-4ca8-82cb-636c2bb6f404 on n-h1-858383-15 Oct 24 10:30:40.851965 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a4dda23c-8fa9-4724-ac63-0a02f7bd08b9 req-59ecd84c-a0a3-4713-bc58-a739147cc0e6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256472 Oct 24 10:30:40.860253 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 833/1749] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:40.881682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c3e08e2f-920c-4bd9-b732-ddc4e54058c5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d108adc0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:41.021317 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c3e08e2f-920c-4bd9-b732-ddc4e54058c5 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.150995 Oct 24 10:30:41.022254 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 834/1750] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:40 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:41.027153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-67d56211-e393-4bfa-9344-999f12e05564 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:41.027885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-67d56211-e393-4bfa-9344-999f12e05564 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:41.451575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-67d56211-e393-4bfa-9344-999f12e05564 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:41.470382 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-67d56211-e393-4bfa-9344-999f12e05564 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1216 microversion: 2.1 time: 0.446961 Oct 24 10:30:41.470952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0bfa46bd-9226-4fe4-99ec-3aab537f75fe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd513ecfb3554dffaa701fdcf8ab4d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496cc02be0824f85a94d06669e9662e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:41.477330 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 835/1751] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:41 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1216 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:41.482984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-df759b0f-5b34-4179-a0e4-139d4e9af177 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:41.483770 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0bfa46bd-9226-4fe4-99ec-3aab537f75fe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61" status: 200 len: 1313 microversion: 2.1 time: 1.533816 Oct 24 10:30:41.501286 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 917/1752] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:39 2022] GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61 => generated 1313 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:41.501394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-df759b0f-5b34-4179-a0e4-139d4e9af177 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:41.781798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-df759b0f-5b34-4179-a0e4-139d4e9af177 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:41.806583 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-df759b0f-5b34-4179-a0e4-139d4e9af177 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1053 microversion: 2.1 time: 0.325646 Oct 24 10:30:41.813211 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 836/1753] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:41 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1053 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:42.042258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2a252bfd-3f83-4e36-bc33-b57a1eb4ad08 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d05d53a0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:42.219798 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2a252bfd-3f83-4e36-bc33-b57a1eb4ad08 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.185970 Oct 24 10:30:42.231492 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 918/1754] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:42 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:42.516427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2e5e0301-8d33-4f4b-bada-0b7d6b2a3aa9 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:42.518074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2e5e0301-8d33-4f4b-bada-0b7d6b2a3aa9 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:42.520094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f7986d52-c6d6-4dd1-aa69-f263c88ff2a6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:42.521201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f7986d52-c6d6-4dd1-aa69-f263c88ff2a6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:42.574153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e5e0301-8d33-4f4b-bada-0b7d6b2a3aa9 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:42.584949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7986d52-c6d6-4dd1-aa69-f263c88ff2a6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:42.589256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7986d52-c6d6-4dd1-aa69-f263c88ff2a6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:42.595492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e5e0301-8d33-4f4b-bada-0b7d6b2a3aa9 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:42.597709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e5e0301-8d33-4f4b-bada-0b7d6b2a3aa9 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:42.598177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7986d52-c6d6-4dd1-aa69-f263c88ff2a6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:42.599177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7986d52-c6d6-4dd1-aa69-f263c88ff2a6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:42.600778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e5e0301-8d33-4f4b-bada-0b7d6b2a3aa9 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:42.609678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7986d52-c6d6-4dd1-aa69-f263c88ff2a6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:42.610143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7986d52-c6d6-4dd1-aa69-f263c88ff2a6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:42.615502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e5e0301-8d33-4f4b-bada-0b7d6b2a3aa9 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:42.618108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e5e0301-8d33-4f4b-bada-0b7d6b2a3aa9 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:43.901171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f7986d52-c6d6-4dd1-aa69-f263c88ff2a6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:43.925032 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f7986d52-c6d6-4dd1-aa69-f263c88ff2a6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1268 microversion: 2.1 time: 1.421439 Oct 24 10:30:43.925712 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 837/1755] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:42 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1268 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:43.939821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-14d63e43-8e83-4997-9086-fb8edf7c1456 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:43.940539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-14d63e43-8e83-4997-9086-fb8edf7c1456 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:43.955429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-14d63e43-8e83-4997-9086-fb8edf7c1456 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:43.956877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-14d63e43-8e83-4997-9086-fb8edf7c1456 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:43.957920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-14d63e43-8e83-4997-9086-fb8edf7c1456 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:43.959465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-14d63e43-8e83-4997-9086-fb8edf7c1456 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:43.962323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-14d63e43-8e83-4997-9086-fb8edf7c1456 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:43.963057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-14d63e43-8e83-4997-9086-fb8edf7c1456 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:44.157795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-14d63e43-8e83-4997-9086-fb8edf7c1456 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:44.177140 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-14d63e43-8e83-4997-9086-fb8edf7c1456 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1151 microversion: 2.1 time: 0.249939 Oct 24 10:30:44.178987 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 838/1756] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:43 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1151 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:44.192438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f6e3a0df-668b-4494-9aa3-7dd0edbdf475 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0da03a0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:44.332819 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f6e3a0df-668b-4494-9aa3-7dd0edbdf475 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.151204 Oct 24 10:30:44.333827 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 839/1757] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:44 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:44.337799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2e5e0301-8d33-4f4b-bada-0b7d6b2a3aa9 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd513ecfb3554dffaa701fdcf8ab4d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496cc02be0824f85a94d06669e9662e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:44.359591 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2e5e0301-8d33-4f4b-bada-0b7d6b2a3aa9 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61" status: 200 len: 1313 microversion: 2.1 time: 1.841580 Oct 24 10:30:44.364280 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 919/1758] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:42 2022] GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61 => generated 1313 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:44.710870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ad69fd2b-5ae0-49b4-a3d3-735c3507ba32 req-680ca32b-8e33-4e02-a189-53603981b908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df9b0c0-5006-42ec-97af-b35aa01c2e61", "tag": "ad50564d-1c49-4d35-8459-a0f2bf0501fd"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:44.741349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ad69fd2b-5ae0-49b4-a3d3-735c3507ba32 req-680ca32b-8e33-4e02-a189-53603981b908 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:44.743926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ad69fd2b-5ae0-49b4-a3d3-735c3507ba32 req-680ca32b-8e33-4e02-a189-53603981b908 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:44.744602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ad69fd2b-5ae0-49b4-a3d3-735c3507ba32 req-680ca32b-8e33-4e02-a189-53603981b908 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:44.776308 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ad69fd2b-5ae0-49b4-a3d3-735c3507ba32 req-680ca32b-8e33-4e02-a189-53603981b908 service nova] Creating event network-changed:ad50564d-1c49-4d35-8459-a0f2bf0501fd for instance 1df9b0c0-5006-42ec-97af-b35aa01c2e61 on n-h2-858383-15 Oct 24 10:30:44.810479 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ad69fd2b-5ae0-49b4-a3d3-735c3507ba32 req-680ca32b-8e33-4e02-a189-53603981b908 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103654 Oct 24 10:30:44.812531 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 840/1759] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:44.950742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2598f5c6-ad0f-4fb2-bb75-89247ef3643e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:44.954013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2598f5c6-ad0f-4fb2-bb75-89247ef3643e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:44.976212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2598f5c6-ad0f-4fb2-bb75-89247ef3643e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:45.000526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2598f5c6-ad0f-4fb2-bb75-89247ef3643e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:45.002804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2598f5c6-ad0f-4fb2-bb75-89247ef3643e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:45.007706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2598f5c6-ad0f-4fb2-bb75-89247ef3643e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:45.010587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2598f5c6-ad0f-4fb2-bb75-89247ef3643e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:45.011126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2598f5c6-ad0f-4fb2-bb75-89247ef3643e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:45.208340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6460f4d4-4ca7-4641-a3bb-c7909b185faf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:45.209097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6460f4d4-4ca7-4641-a3bb-c7909b185faf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:45.256449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6460f4d4-4ca7-4641-a3bb-c7909b185faf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:45.257138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6460f4d4-4ca7-4641-a3bb-c7909b185faf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:45.263750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6460f4d4-4ca7-4641-a3bb-c7909b185faf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:45.264970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6460f4d4-4ca7-4641-a3bb-c7909b185faf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:45.269548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6460f4d4-4ca7-4641-a3bb-c7909b185faf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:45.270599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6460f4d4-4ca7-4641-a3bb-c7909b185faf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:45.586648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2598f5c6-ad0f-4fb2-bb75-89247ef3643e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:45.594713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6460f4d4-4ca7-4641-a3bb-c7909b185faf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:45.610274 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2598f5c6-ad0f-4fb2-bb75-89247ef3643e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1274 microversion: 2.1 time: 0.664999 Oct 24 10:30:45.617123 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6460f4d4-4ca7-4641-a3bb-c7909b185faf tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1169 microversion: 2.1 time: 0.416713 Oct 24 10:30:45.633317 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 841/1760] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:45 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1169 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:45.637755 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 920/1761] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:44 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1274 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:45.645784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3c84d089-201b-47a5-9e15-c1358f3ea7a3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0f09af0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:45.653914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6f2adb84-05d7-4f22-bc64-b1f88f4e0f92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:45.660252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6f2adb84-05d7-4f22-bc64-b1f88f4e0f92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:45.674837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f2adb84-05d7-4f22-bc64-b1f88f4e0f92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:45.676072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f2adb84-05d7-4f22-bc64-b1f88f4e0f92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:45.679072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f2adb84-05d7-4f22-bc64-b1f88f4e0f92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:45.680265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f2adb84-05d7-4f22-bc64-b1f88f4e0f92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:45.684991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f2adb84-05d7-4f22-bc64-b1f88f4e0f92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:45.686901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f2adb84-05d7-4f22-bc64-b1f88f4e0f92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:45.744850 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3c84d089-201b-47a5-9e15-c1358f3ea7a3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.121479 Oct 24 10:30:45.745627 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 842/1762] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:45 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:46.190712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6f2adb84-05d7-4f22-bc64-b1f88f4e0f92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd513ecfb3554dffaa701fdcf8ab4d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496cc02be0824f85a94d06669e9662e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:46.224821 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6f2adb84-05d7-4f22-bc64-b1f88f4e0f92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61" status: 200 len: 1313 microversion: 2.1 time: 0.585404 Oct 24 10:30:46.228743 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 921/1763] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:45 2022] GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61 => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:46.653052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad9911c2-ea97-4807-8dfb-220a4ebd7319 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:46.654025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad9911c2-ea97-4807-8dfb-220a4ebd7319 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:46.655007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f40b5782-2635-48f5-9462-8ea4b466d599 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:46.659077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f40b5782-2635-48f5-9462-8ea4b466d599 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:46.673597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f40b5782-2635-48f5-9462-8ea4b466d599 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:46.674608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f40b5782-2635-48f5-9462-8ea4b466d599 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:46.677215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f40b5782-2635-48f5-9462-8ea4b466d599 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:46.678535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad9911c2-ea97-4807-8dfb-220a4ebd7319 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:46.680903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f40b5782-2635-48f5-9462-8ea4b466d599 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:46.681063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad9911c2-ea97-4807-8dfb-220a4ebd7319 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:46.681692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f40b5782-2635-48f5-9462-8ea4b466d599 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:46.682155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f40b5782-2635-48f5-9462-8ea4b466d599 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:46.682402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad9911c2-ea97-4807-8dfb-220a4ebd7319 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:46.683520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad9911c2-ea97-4807-8dfb-220a4ebd7319 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:46.686255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad9911c2-ea97-4807-8dfb-220a4ebd7319 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:46.686834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad9911c2-ea97-4807-8dfb-220a4ebd7319 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:46.798784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f40b5782-2635-48f5-9462-8ea4b466d599 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:46.812589 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f40b5782-2635-48f5-9462-8ea4b466d599 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1274 microversion: 2.1 time: 0.161072 Oct 24 10:30:46.815751 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 922/1764] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:46 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1274 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:46.826459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-47fa9a7f-883e-449a-b4f8-49c693153c11 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d059de50>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:46.873280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ad9911c2-ea97-4807-8dfb-220a4ebd7319 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:46.884868 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad9911c2-ea97-4807-8dfb-220a4ebd7319 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1169 microversion: 2.1 time: 0.237863 Oct 24 10:30:46.889215 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 843/1765] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:46 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1169 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:46.915033 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-47fa9a7f-883e-449a-b4f8-49c693153c11 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.096986 Oct 24 10:30:46.915964 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 923/1766] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:46 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:47.255653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d3f1c64f-96ef-4ff2-b1ba-7feb7e7b5305 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:47.256159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d3f1c64f-96ef-4ff2-b1ba-7feb7e7b5305 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:47.269968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3f1c64f-96ef-4ff2-b1ba-7feb7e7b5305 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:47.270551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3f1c64f-96ef-4ff2-b1ba-7feb7e7b5305 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:47.271266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3f1c64f-96ef-4ff2-b1ba-7feb7e7b5305 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:47.272429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3f1c64f-96ef-4ff2-b1ba-7feb7e7b5305 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:47.272969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3f1c64f-96ef-4ff2-b1ba-7feb7e7b5305 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:47.273451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3f1c64f-96ef-4ff2-b1ba-7feb7e7b5305 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:47.780482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d3f1c64f-96ef-4ff2-b1ba-7feb7e7b5305 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd513ecfb3554dffaa701fdcf8ab4d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496cc02be0824f85a94d06669e9662e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:47.799222 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d3f1c64f-96ef-4ff2-b1ba-7feb7e7b5305 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61" status: 200 len: 1313 microversion: 2.1 time: 0.547672 Oct 24 10:30:47.799839 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 844/1767] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:47 2022] GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61 => generated 1313 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:47.844659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dfe8aa22-2fd8-44c7-bf90-5c958dbcfb79 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:47.851422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dfe8aa22-2fd8-44c7-bf90-5c958dbcfb79 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:47.877658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dfe8aa22-2fd8-44c7-bf90-5c958dbcfb79 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:47.878287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dfe8aa22-2fd8-44c7-bf90-5c958dbcfb79 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:47.878740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dfe8aa22-2fd8-44c7-bf90-5c958dbcfb79 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:47.882217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dfe8aa22-2fd8-44c7-bf90-5c958dbcfb79 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:47.885595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dfe8aa22-2fd8-44c7-bf90-5c958dbcfb79 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:47.886136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dfe8aa22-2fd8-44c7-bf90-5c958dbcfb79 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:47.912314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-84512b76-d9f4-494b-afc8-a1d5f9d8a266 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:47.912982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-84512b76-d9f4-494b-afc8-a1d5f9d8a266 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:47.930328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84512b76-d9f4-494b-afc8-a1d5f9d8a266 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:47.931066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84512b76-d9f4-494b-afc8-a1d5f9d8a266 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:47.952185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84512b76-d9f4-494b-afc8-a1d5f9d8a266 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:47.953133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84512b76-d9f4-494b-afc8-a1d5f9d8a266 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:47.953812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84512b76-d9f4-494b-afc8-a1d5f9d8a266 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:47.954458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84512b76-d9f4-494b-afc8-a1d5f9d8a266 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:49.073362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dfe8aa22-2fd8-44c7-bf90-5c958dbcfb79 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:49.097265 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dfe8aa22-2fd8-44c7-bf90-5c958dbcfb79 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1316 microversion: 2.1 time: 1.259524 Oct 24 10:30:49.099170 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 924/1768] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:47 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1316 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:49.136216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bbd9468a-0ea0-4d45-9ebd-713673283513 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d05d50d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:49.205485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-84512b76-d9f4-494b-afc8-a1d5f9d8a266 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:49.213611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:49.221147 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-84512b76-d9f4-494b-afc8-a1d5f9d8a266 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1211 microversion: 2.1 time: 1.313101 Oct 24 10:30:49.223170 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 845/1769] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:47 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1211 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:49.244309 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bbd9468a-0ea0-4d45-9ebd-713673283513 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.124357 Oct 24 10:30:49.246333 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 925/1770] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:49 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:49.264544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-770a4aad-0856-4c8a-a889-6fca2e89f3d5 req-a020fde6-9480-40d6-91b2-5813689c9d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84a8b2f8-edd4-45a3-be5f-878bfc0f5811", "name": "network-vif-plugged", "status": "completed", "tag": "776dc61c-efaa-4518-9e14-466879a8f1c1"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:49.265798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-475056b9-4d3b-4ec9-a287-edd7bb140025 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:49.266438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-475056b9-4d3b-4ec9-a287-edd7bb140025 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:49.278030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-475056b9-4d3b-4ec9-a287-edd7bb140025 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:49.280122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-475056b9-4d3b-4ec9-a287-edd7bb140025 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:49.282636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-475056b9-4d3b-4ec9-a287-edd7bb140025 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:49.284130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-475056b9-4d3b-4ec9-a287-edd7bb140025 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:49.286330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-770a4aad-0856-4c8a-a889-6fca2e89f3d5 req-a020fde6-9480-40d6-91b2-5813689c9d02 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:49.286485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-475056b9-4d3b-4ec9-a287-edd7bb140025 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:49.286806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-770a4aad-0856-4c8a-a889-6fca2e89f3d5 req-a020fde6-9480-40d6-91b2-5813689c9d02 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:49.287912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-475056b9-4d3b-4ec9-a287-edd7bb140025 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:49.292304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-770a4aad-0856-4c8a-a889-6fca2e89f3d5 req-a020fde6-9480-40d6-91b2-5813689c9d02 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:49.320110 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-770a4aad-0856-4c8a-a889-6fca2e89f3d5 req-a020fde6-9480-40d6-91b2-5813689c9d02 service nova] Creating event network-vif-plugged:776dc61c-efaa-4518-9e14-466879a8f1c1 for instance 84a8b2f8-edd4-45a3-be5f-878bfc0f5811 on n-h2-858383-15 Oct 24 10:30:49.332695 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-770a4aad-0856-4c8a-a889-6fca2e89f3d5 req-a020fde6-9480-40d6-91b2-5813689c9d02 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089859 Oct 24 10:30:49.338575 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 846/1771] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:49.539038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:49.618591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-475056b9-4d3b-4ec9-a287-edd7bb140025 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd513ecfb3554dffaa701fdcf8ab4d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496cc02be0824f85a94d06669e9662e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:49.634653 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-475056b9-4d3b-4ec9-a287-edd7bb140025 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61" status: 200 len: 1313 microversion: 2.1 time: 0.387152 Oct 24 10:30:49.639340 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 926/1772] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:49 2022] GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:49.661405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:50.049153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b65f8225-62d2-4ef8-b9fa-12ce11a5df74 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:50.053225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b65f8225-62d2-4ef8-b9fa-12ce11a5df74 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:50.054674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b65f8225-62d2-4ef8-b9fa-12ce11a5df74 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:50.056274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b65f8225-62d2-4ef8-b9fa-12ce11a5df74 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:50.057635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b65f8225-62d2-4ef8-b9fa-12ce11a5df74 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:50.058300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b65f8225-62d2-4ef8-b9fa-12ce11a5df74 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:50.058915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b65f8225-62d2-4ef8-b9fa-12ce11a5df74 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:50.103703 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b65f8225-62d2-4ef8-b9fa-12ce11a5df74 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.468474 Oct 24 10:30:50.117013 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 847/1773] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:30:49 2022] GET /compute/v2.1/os-services => generated 949 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:50.122915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=12 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:50.128392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d5fbc67d-8bcc-417c-9e83-19c3f2f701bc tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:50.132521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5fbc67d-8bcc-417c-9e83-19c3f2f701bc tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:50.142880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5fbc67d-8bcc-417c-9e83-19c3f2f701bc tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:50.143656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5fbc67d-8bcc-417c-9e83-19c3f2f701bc tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:50.147016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5fbc67d-8bcc-417c-9e83-19c3f2f701bc tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:50.148788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5fbc67d-8bcc-417c-9e83-19c3f2f701bc tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:50.149736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5fbc67d-8bcc-417c-9e83-19c3f2f701bc tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:50.151648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b5051056-3e4b-46b6-a1ef-ce7c69f18df1 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:50.153169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b5051056-3e4b-46b6-a1ef-ce7c69f18df1 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:50.167550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5051056-3e4b-46b6-a1ef-ce7c69f18df1 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:50.168049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5051056-3e4b-46b6-a1ef-ce7c69f18df1 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:50.168486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5051056-3e4b-46b6-a1ef-ce7c69f18df1 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:50.174948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5051056-3e4b-46b6-a1ef-ce7c69f18df1 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:50.175459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5051056-3e4b-46b6-a1ef-ce7c69f18df1 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:50.176209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5051056-3e4b-46b6-a1ef-ce7c69f18df1 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:50.220568 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d5fbc67d-8bcc-417c-9e83-19c3f2f701bc tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=n-d-858383-15" status: 200 len: 581 microversion: 2.1 time: 0.098261 Oct 24 10:30:50.232812 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 927/1774] 10.222.0.50 () {58 vars in 1174 bytes} [Mon Oct 24 10:30:50 2022] GET /compute/v2.1/os-services?host=n-d-858383-15 => generated 581 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:50.237769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-24ebcd4a-c0dd-40dd-ad20-ab2a446c5ee1 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:50.256597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24ebcd4a-c0dd-40dd-ad20-ab2a446c5ee1 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:50.257356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24ebcd4a-c0dd-40dd-ad20-ab2a446c5ee1 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:50.258054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24ebcd4a-c0dd-40dd-ad20-ab2a446c5ee1 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:50.259545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24ebcd4a-c0dd-40dd-ad20-ab2a446c5ee1 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:50.260200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24ebcd4a-c0dd-40dd-ad20-ab2a446c5ee1 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:50.262307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24ebcd4a-c0dd-40dd-ad20-ab2a446c5ee1 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:50.314526 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-24ebcd4a-c0dd-40dd-ad20-ab2a446c5ee1 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.080262 Oct 24 10:30:50.321196 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 928/1775] 10.222.0.50 () {58 vars in 1176 bytes} [Mon Oct 24 10:30:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:50.335837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6163033f-ef01-4f9d-886d-3638ef75da13 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:50.339753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6163033f-ef01-4f9d-886d-3638ef75da13 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:50.361160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6163033f-ef01-4f9d-886d-3638ef75da13 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:50.361400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6163033f-ef01-4f9d-886d-3638ef75da13 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:50.363097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6163033f-ef01-4f9d-886d-3638ef75da13 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:50.364987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6163033f-ef01-4f9d-886d-3638ef75da13 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:50.366758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6163033f-ef01-4f9d-886d-3638ef75da13 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:50.369806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6163033f-ef01-4f9d-886d-3638ef75da13 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:50.568496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b5051056-3e4b-46b6-a1ef-ce7c69f18df1 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:50.579964 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b5051056-3e4b-46b6-a1ef-ce7c69f18df1 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1316 microversion: 2.1 time: 0.445926 Oct 24 10:30:50.584602 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 848/1776] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:50 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:50.592617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-20aa3334-cd36-4d50-af7c-d6f998ff9c02 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d133c160>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:50.712251 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-20aa3334-cd36-4d50-af7c-d6f998ff9c02 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.123688 Oct 24 10:30:50.717792 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 849/1777] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:50 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:50.731732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cd9528c0-d08f-4426-836d-b6e5fc5e4796 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:50.740607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd9528c0-d08f-4426-836d-b6e5fc5e4796 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:50.741566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd9528c0-d08f-4426-836d-b6e5fc5e4796 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:50.746091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd9528c0-d08f-4426-836d-b6e5fc5e4796 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:50.747246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd9528c0-d08f-4426-836d-b6e5fc5e4796 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:50.747999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd9528c0-d08f-4426-836d-b6e5fc5e4796 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:50.749943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd9528c0-d08f-4426-836d-b6e5fc5e4796 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:50.754961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6163033f-ef01-4f9d-886d-3638ef75da13 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:50.771708 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6163033f-ef01-4f9d-886d-3638ef75da13 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1211 microversion: 2.1 time: 0.448278 Oct 24 10:30:50.785517 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 929/1778] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:50 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1211 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:50.799448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3025cdb3-872d-47a6-afb9-ea40cdda351d tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:50.800105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3025cdb3-872d-47a6-afb9-ea40cdda351d tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:50.808573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3025cdb3-872d-47a6-afb9-ea40cdda351d tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:50.809385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3025cdb3-872d-47a6-afb9-ea40cdda351d tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:50.810030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3025cdb3-872d-47a6-afb9-ea40cdda351d tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:50.810935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3025cdb3-872d-47a6-afb9-ea40cdda351d tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:50.811581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3025cdb3-872d-47a6-afb9-ea40cdda351d tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:50.812357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3025cdb3-872d-47a6-afb9-ea40cdda351d tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:50.858086 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cd9528c0-d08f-4426-836d-b6e5fc5e4796 tempest-ServicesAdminTestJSON-980848444 tempest-ServicesAdminTestJSON-980848444-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.136778 Oct 24 10:30:50.864423 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 850/1779] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:30:50 2022] GET /compute/v2.1/os-services => generated 949 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:51.050997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3025cdb3-872d-47a6-afb9-ea40cdda351d tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd513ecfb3554dffaa701fdcf8ab4d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496cc02be0824f85a94d06669e9662e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:51.062994 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3025cdb3-872d-47a6-afb9-ea40cdda351d tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61" status: 200 len: 1313 microversion: 2.1 time: 0.275808 Oct 24 10:30:51.078232 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 930/1780] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:50 2022] GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:51.609194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6a5f060e-47f0-4029-9888-a215577da1f6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:51.611122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6a5f060e-47f0-4029-9888-a215577da1f6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:51.626857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a5f060e-47f0-4029-9888-a215577da1f6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:51.627408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a5f060e-47f0-4029-9888-a215577da1f6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:51.629226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a5f060e-47f0-4029-9888-a215577da1f6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:51.633854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a5f060e-47f0-4029-9888-a215577da1f6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:51.639787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a5f060e-47f0-4029-9888-a215577da1f6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:51.642499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a5f060e-47f0-4029-9888-a215577da1f6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:51.732059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-75532487-11e3-4ce2-9c48-404fd9362466 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d05dfa60>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:51.800874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:51.862347 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-75532487-11e3-4ce2-9c48-404fd9362466 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.134075 Oct 24 10:30:51.862945 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 931/1781] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:51 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:51.877685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f27c0e46-602e-48e8-9dd8-539849d66112 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:51.878342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f27c0e46-602e-48e8-9dd8-539849d66112 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:51.895030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27c0e46-602e-48e8-9dd8-539849d66112 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:51.895458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27c0e46-602e-48e8-9dd8-539849d66112 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:51.896016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27c0e46-602e-48e8-9dd8-539849d66112 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:51.896827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27c0e46-602e-48e8-9dd8-539849d66112 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:51.897440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27c0e46-602e-48e8-9dd8-539849d66112 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:51.897885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27c0e46-602e-48e8-9dd8-539849d66112 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:51.996379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6a5f060e-47f0-4029-9888-a215577da1f6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:52.009798 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6a5f060e-47f0-4029-9888-a215577da1f6 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1316 microversion: 2.1 time: 0.401756 Oct 24 10:30:52.011554 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 851/1782] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:51 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:52.092518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8be8083e-29de-409b-a51b-476fce187193 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:52.093346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8be8083e-29de-409b-a51b-476fce187193 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:52.108653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8be8083e-29de-409b-a51b-476fce187193 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:52.113573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8be8083e-29de-409b-a51b-476fce187193 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:52.115789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8be8083e-29de-409b-a51b-476fce187193 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:52.120545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8be8083e-29de-409b-a51b-476fce187193 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:52.121385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8be8083e-29de-409b-a51b-476fce187193 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:52.122087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8be8083e-29de-409b-a51b-476fce187193 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:52.212927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f27c0e46-602e-48e8-9dd8-539849d66112 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:52.221547 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f27c0e46-602e-48e8-9dd8-539849d66112 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1211 microversion: 2.1 time: 0.357355 Oct 24 10:30:52.243461 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 932/1783] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:51 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1211 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:52.247740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-69d938e2-f509-4649-8c2b-09e6e2a6b158 req-5cf2ac64-2527-46cd-8c2d-07a6e39ddca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df9b0c0-5006-42ec-97af-b35aa01c2e61", "name": "network-vif-plugged", "status": "completed", "tag": "ad50564d-1c49-4d35-8459-a0f2bf0501fd"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:52.277895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-69d938e2-f509-4649-8c2b-09e6e2a6b158 req-5cf2ac64-2527-46cd-8c2d-07a6e39ddca1 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:52.278486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-69d938e2-f509-4649-8c2b-09e6e2a6b158 req-5cf2ac64-2527-46cd-8c2d-07a6e39ddca1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:52.279134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-69d938e2-f509-4649-8c2b-09e6e2a6b158 req-5cf2ac64-2527-46cd-8c2d-07a6e39ddca1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:52.283562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:52.311065 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-69d938e2-f509-4649-8c2b-09e6e2a6b158 req-5cf2ac64-2527-46cd-8c2d-07a6e39ddca1 service nova] Creating event network-vif-plugged:ad50564d-1c49-4d35-8459-a0f2bf0501fd for instance 1df9b0c0-5006-42ec-97af-b35aa01c2e61 on n-h2-858383-15 Oct 24 10:30:52.316805 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-69d938e2-f509-4649-8c2b-09e6e2a6b158 req-5cf2ac64-2527-46cd-8c2d-07a6e39ddca1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073677 Oct 24 10:30:52.317922 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 933/1784] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:52.344722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-bbd5042d-2141-4106-8cfa-492be0e2f7cb req-f8b2065e-ca7f-4338-879f-4bf3f8b97aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac22625-5979-4a7b-8bbd-e0d114e62f76", "tag": "0c6f5aab-b3a5-4a34-b31f-b771c9279d19"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:52.365309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-bbd5042d-2141-4106-8cfa-492be0e2f7cb req-f8b2065e-ca7f-4338-879f-4bf3f8b97aa6 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:52.366895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-bbd5042d-2141-4106-8cfa-492be0e2f7cb req-f8b2065e-ca7f-4338-879f-4bf3f8b97aa6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:52.368701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-bbd5042d-2141-4106-8cfa-492be0e2f7cb req-f8b2065e-ca7f-4338-879f-4bf3f8b97aa6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:52.400275 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-bbd5042d-2141-4106-8cfa-492be0e2f7cb req-f8b2065e-ca7f-4338-879f-4bf3f8b97aa6 service nova] Creating event network-changed:0c6f5aab-b3a5-4a34-b31f-b771c9279d19 for instance 8ac22625-5979-4a7b-8bbd-e0d114e62f76 on n-h1-858383-15 Oct 24 10:30:52.407741 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-bbd5042d-2141-4106-8cfa-492be0e2f7cb req-f8b2065e-ca7f-4338-879f-4bf3f8b97aa6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075317 Oct 24 10:30:52.417413 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 934/1785] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:52.493897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8be8083e-29de-409b-a51b-476fce187193 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd513ecfb3554dffaa701fdcf8ab4d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496cc02be0824f85a94d06669e9662e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:52.511226 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8be8083e-29de-409b-a51b-476fce187193 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61" status: 200 len: 1313 microversion: 2.1 time: 0.425943 Oct 24 10:30:52.513199 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 852/1786] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:52 2022] GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61 => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:52.884582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a9e58f3a-6ff6-426c-8b47-2949e1de7fcb tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d05a19d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:52.959006 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a9e58f3a-6ff6-426c-8b47-2949e1de7fcb tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.080548 Oct 24 10:30:52.959960 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 935/1787] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:52 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:53.034646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-951eb79b-6f50-42a3-9cd2-d9bc9abd363c tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:53.036012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-951eb79b-6f50-42a3-9cd2-d9bc9abd363c tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:53.043349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-951eb79b-6f50-42a3-9cd2-d9bc9abd363c tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:53.057639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-951eb79b-6f50-42a3-9cd2-d9bc9abd363c tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:53.059096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-951eb79b-6f50-42a3-9cd2-d9bc9abd363c tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:53.060138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-951eb79b-6f50-42a3-9cd2-d9bc9abd363c tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:53.060881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-951eb79b-6f50-42a3-9cd2-d9bc9abd363c tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:53.061579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-951eb79b-6f50-42a3-9cd2-d9bc9abd363c tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:53.249422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-93d24a1d-d1f7-427e-8514-3d335986a8f8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:53.254090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-93d24a1d-d1f7-427e-8514-3d335986a8f8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:53.274946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93d24a1d-d1f7-427e-8514-3d335986a8f8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:53.275847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93d24a1d-d1f7-427e-8514-3d335986a8f8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:53.276468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93d24a1d-d1f7-427e-8514-3d335986a8f8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:53.277396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93d24a1d-d1f7-427e-8514-3d335986a8f8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:53.278159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93d24a1d-d1f7-427e-8514-3d335986a8f8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:53.278784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93d24a1d-d1f7-427e-8514-3d335986a8f8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:53.308331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-951eb79b-6f50-42a3-9cd2-d9bc9abd363c tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:53.328587 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-951eb79b-6f50-42a3-9cd2-d9bc9abd363c tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1316 microversion: 2.1 time: 0.297693 Oct 24 10:30:53.329991 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 853/1788] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:53 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:53.534979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3b1d64ae-87fd-4bfe-91c0-c505f1d5e7b4 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:53.535938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3b1d64ae-87fd-4bfe-91c0-c505f1d5e7b4 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:53.544326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-93d24a1d-d1f7-427e-8514-3d335986a8f8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:53.551069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b1d64ae-87fd-4bfe-91c0-c505f1d5e7b4 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:53.553150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b1d64ae-87fd-4bfe-91c0-c505f1d5e7b4 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:53.555813 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-93d24a1d-d1f7-427e-8514-3d335986a8f8 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1211 microversion: 2.1 time: 0.310049 Oct 24 10:30:53.556680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b1d64ae-87fd-4bfe-91c0-c505f1d5e7b4 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:53.557735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b1d64ae-87fd-4bfe-91c0-c505f1d5e7b4 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:53.558313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b1d64ae-87fd-4bfe-91c0-c505f1d5e7b4 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:53.558997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b1d64ae-87fd-4bfe-91c0-c505f1d5e7b4 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:53.561912 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 936/1789] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:53 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1211 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:53.841681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3b1d64ae-87fd-4bfe-91c0-c505f1d5e7b4 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd513ecfb3554dffaa701fdcf8ab4d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496cc02be0824f85a94d06669e9662e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:53.858555 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3b1d64ae-87fd-4bfe-91c0-c505f1d5e7b4 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61" status: 200 len: 1313 microversion: 2.1 time: 0.327550 Oct 24 10:30:53.885029 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 854/1790] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:53 2022] GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:53.984779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-512e3aa2-0bd2-4cde-8149-cb2be9a1b4bc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d05df160>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:54.105908 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-512e3aa2-0bd2-4cde-8149-cb2be9a1b4bc tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.130740 Oct 24 10:30:54.111328 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 937/1791] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:53 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:54.352872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-05a031e4-6589-4cb3-aa8c-9775e4a19be4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:54.353908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-05a031e4-6589-4cb3-aa8c-9775e4a19be4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:54.369456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05a031e4-6589-4cb3-aa8c-9775e4a19be4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:54.373628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05a031e4-6589-4cb3-aa8c-9775e4a19be4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:54.377203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05a031e4-6589-4cb3-aa8c-9775e4a19be4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:54.380363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05a031e4-6589-4cb3-aa8c-9775e4a19be4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:54.383897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05a031e4-6589-4cb3-aa8c-9775e4a19be4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:54.386522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05a031e4-6589-4cb3-aa8c-9775e4a19be4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:54.493491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-caa1c90a-b431-4324-9dfa-ef36886e45b4 req-cb3fa2ad-4607-4f91-84fb-ea8ba9cb372c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38f4bf2a-de86-44f9-9481-b6591f1e0191", "tag": "67372bf5-c3c5-4daa-ac37-508ea3a9c66a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:54.533615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-caa1c90a-b431-4324-9dfa-ef36886e45b4 req-cb3fa2ad-4607-4f91-84fb-ea8ba9cb372c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:54.534800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-caa1c90a-b431-4324-9dfa-ef36886e45b4 req-cb3fa2ad-4607-4f91-84fb-ea8ba9cb372c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:54.535263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-caa1c90a-b431-4324-9dfa-ef36886e45b4 req-cb3fa2ad-4607-4f91-84fb-ea8ba9cb372c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:54.560851 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-caa1c90a-b431-4324-9dfa-ef36886e45b4 req-cb3fa2ad-4607-4f91-84fb-ea8ba9cb372c service nova] Creating event network-changed:67372bf5-c3c5-4daa-ac37-508ea3a9c66a for instance 38f4bf2a-de86-44f9-9481-b6591f1e0191 on n-h1-858383-15 Oct 24 10:30:54.576768 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-caa1c90a-b431-4324-9dfa-ef36886e45b4 req-cb3fa2ad-4607-4f91-84fb-ea8ba9cb372c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096930 Oct 24 10:30:54.581226 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 938/1792] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:54.599631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9cfd9c52-33d7-4534-861a-147696636173 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:54.604673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9cfd9c52-33d7-4534-861a-147696636173 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:54.627671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cfd9c52-33d7-4534-861a-147696636173 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:54.628418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cfd9c52-33d7-4534-861a-147696636173 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:54.632763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cfd9c52-33d7-4534-861a-147696636173 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:54.634676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cfd9c52-33d7-4534-861a-147696636173 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:54.637840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cfd9c52-33d7-4534-861a-147696636173 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:54.638515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cfd9c52-33d7-4534-861a-147696636173 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:54.750571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-05a031e4-6589-4cb3-aa8c-9775e4a19be4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:54.768387 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-05a031e4-6589-4cb3-aa8c-9775e4a19be4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1316 microversion: 2.1 time: 0.418856 Oct 24 10:30:54.771497 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 855/1793] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:54 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:54.887026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fae6611c-ecec-4217-a78d-d70435ff2a3a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:54.888159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fae6611c-ecec-4217-a78d-d70435ff2a3a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:54.905034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fae6611c-ecec-4217-a78d-d70435ff2a3a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:54.905967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fae6611c-ecec-4217-a78d-d70435ff2a3a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:54.906683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fae6611c-ecec-4217-a78d-d70435ff2a3a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:54.907699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fae6611c-ecec-4217-a78d-d70435ff2a3a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:54.908411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fae6611c-ecec-4217-a78d-d70435ff2a3a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:54.909052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fae6611c-ecec-4217-a78d-d70435ff2a3a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:55.003875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9cfd9c52-33d7-4534-861a-147696636173 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:55.019072 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9cfd9c52-33d7-4534-861a-147696636173 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1211 microversion: 2.1 time: 0.431755 Oct 24 10:30:55.039050 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 939/1794] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:54 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1211 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:55.128586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3707feaa-d3eb-4eef-b343-e311df6a568a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d05df820>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:55.221120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fae6611c-ecec-4217-a78d-d70435ff2a3a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd513ecfb3554dffaa701fdcf8ab4d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496cc02be0824f85a94d06669e9662e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:55.229832 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fae6611c-ecec-4217-a78d-d70435ff2a3a tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61" status: 200 len: 1462 microversion: 2.1 time: 0.350709 Oct 24 10:30:55.230424 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 856/1795] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:54 2022] GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61 => generated 1462 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:55.254231 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3707feaa-d3eb-4eef-b343-e311df6a568a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.130103 Oct 24 10:30:55.255356 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 940/1796] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:55 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:55.588211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7a2c3b02-9b93-42b8-ae76-25ccb70872ac tempest-TenantUsagesTestJSON-477683306 tempest-TenantUsagesTestJSON-477683306-project-admin] Calling method '.version_select at 0x7f04d0d33d30>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:55.625077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a2c3b02-9b93-42b8-ae76-25ccb70872ac tempest-TenantUsagesTestJSON-477683306 tempest-TenantUsagesTestJSON-477683306-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:55.628196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a2c3b02-9b93-42b8-ae76-25ccb70872ac tempest-TenantUsagesTestJSON-477683306 tempest-TenantUsagesTestJSON-477683306-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:55.629629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a2c3b02-9b93-42b8-ae76-25ccb70872ac tempest-TenantUsagesTestJSON-477683306 tempest-TenantUsagesTestJSON-477683306-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:55.697381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a2c3b02-9b93-42b8-ae76-25ccb70872ac tempest-TenantUsagesTestJSON-477683306 tempest-TenantUsagesTestJSON-477683306-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:55.698265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a2c3b02-9b93-42b8-ae76-25ccb70872ac tempest-TenantUsagesTestJSON-477683306 tempest-TenantUsagesTestJSON-477683306-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:55.701737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a2c3b02-9b93-42b8-ae76-25ccb70872ac tempest-TenantUsagesTestJSON-477683306 tempest-TenantUsagesTestJSON-477683306-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:55.749458 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7a2c3b02-9b93-42b8-ae76-25ccb70872ac tempest-TenantUsagesTestJSON-477683306 tempest-TenantUsagesTestJSON-477683306-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/496cc02be0824f85a94d06669e9662e5?start=2022-10-23T10%3A30%3A55.249637&end=2022-10-25T10%3A30%3A55.249637" status: 200 len: 694 microversion: 2.1 time: 0.494593 Oct 24 10:30:55.751301 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 857/1797] 10.222.0.50 () {58 vars in 1412 bytes} [Mon Oct 24 10:30:55 2022] GET /compute/v2.1/os-simple-tenant-usage/496cc02be0824f85a94d06669e9662e5?start=2022-10-23T10%3A30%3A55.249637&end=2022-10-25T10%3A30%3A55.249637 => generated 694 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:55.767574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e5bb454c-61dd-4181-9b2e-b19cd154054e tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Calling method '.version_select at 0x7f04d057bb80>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:55.779474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:30:55.785679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5bb454c-61dd-4181-9b2e-b19cd154054e tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:55.786578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5bb454c-61dd-4181-9b2e-b19cd154054e tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:55.787313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5bb454c-61dd-4181-9b2e-b19cd154054e tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:55.794401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dee001e0-279b-4bbe-83e1-b1d3d30a5fc4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:55.795525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dee001e0-279b-4bbe-83e1-b1d3d30a5fc4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:55.807860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5bb454c-61dd-4181-9b2e-b19cd154054e tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:55.808699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5bb454c-61dd-4181-9b2e-b19cd154054e tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:55.809415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5bb454c-61dd-4181-9b2e-b19cd154054e tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:55.817587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dee001e0-279b-4bbe-83e1-b1d3d30a5fc4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:55.818213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dee001e0-279b-4bbe-83e1-b1d3d30a5fc4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:55.818941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dee001e0-279b-4bbe-83e1-b1d3d30a5fc4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:55.826235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dee001e0-279b-4bbe-83e1-b1d3d30a5fc4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:55.826880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dee001e0-279b-4bbe-83e1-b1d3d30a5fc4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:55.827616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dee001e0-279b-4bbe-83e1-b1d3d30a5fc4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:55.834679 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e5bb454c-61dd-4181-9b2e-b19cd154054e tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/496cc02be0824f85a94d06669e9662e5?start=2022-10-23T10%3A30%3A55.249637&end=2022-10-25T10%3A30%3A55.249637" status: 200 len: 694 microversion: 2.1 time: 0.070970 Oct 24 10:30:55.835843 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 941/1798] 10.222.0.50 () {58 vars in 1412 bytes} [Mon Oct 24 10:30:55 2022] GET /compute/v2.1/os-simple-tenant-usage/496cc02be0824f85a94d06669e9662e5?start=2022-10-23T10%3A30%3A55.249637&end=2022-10-25T10%3A30%3A55.249637 => generated 694 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:55.857386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a1c63bef-9f13-4ca1-a2f8-ef98f440e6e1 tempest-TenantUsagesTestJSON-477683306 tempest-TenantUsagesTestJSON-477683306-project-admin] Calling method '.version_select at 0x7f04d059dd30>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:55.882413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1c63bef-9f13-4ca1-a2f8-ef98f440e6e1 tempest-TenantUsagesTestJSON-477683306 tempest-TenantUsagesTestJSON-477683306-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:55.884173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1c63bef-9f13-4ca1-a2f8-ef98f440e6e1 tempest-TenantUsagesTestJSON-477683306 tempest-TenantUsagesTestJSON-477683306-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:55.886240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1c63bef-9f13-4ca1-a2f8-ef98f440e6e1 tempest-TenantUsagesTestJSON-477683306 tempest-TenantUsagesTestJSON-477683306-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:55.925796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1c63bef-9f13-4ca1-a2f8-ef98f440e6e1 tempest-TenantUsagesTestJSON-477683306 tempest-TenantUsagesTestJSON-477683306-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:55.929698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1c63bef-9f13-4ca1-a2f8-ef98f440e6e1 tempest-TenantUsagesTestJSON-477683306 tempest-TenantUsagesTestJSON-477683306-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:55.931012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1c63bef-9f13-4ca1-a2f8-ef98f440e6e1 tempest-TenantUsagesTestJSON-477683306 tempest-TenantUsagesTestJSON-477683306-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:56.109553 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a1c63bef-9f13-4ca1-a2f8-ef98f440e6e1 tempest-TenantUsagesTestJSON-477683306 tempest-TenantUsagesTestJSON-477683306-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-23T10%3A30%3A55.249637&end=2022-10-25T10%3A30%3A55.249637&detailed=1" status: 200 len: 18518 microversion: 2.1 time: 0.261365 Oct 24 10:30:56.111164 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 942/1799] 10.222.0.50 () {58 vars in 1335 bytes} [Mon Oct 24 10:30:55 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-23T10%3A30%3A55.249637&end=2022-10-25T10%3A30%3A55.249637&detailed=1 => generated 18518 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:30:56.130656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cf068a16-9193-49e2-9744-5e5471a4f26a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:56.131304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cf068a16-9193-49e2-9744-5e5471a4f26a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:56.146745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf068a16-9193-49e2-9744-5e5471a4f26a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:56.147377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf068a16-9193-49e2-9744-5e5471a4f26a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:56.147814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf068a16-9193-49e2-9744-5e5471a4f26a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:56.148637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf068a16-9193-49e2-9744-5e5471a4f26a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:56.149721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf068a16-9193-49e2-9744-5e5471a4f26a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:56.150140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf068a16-9193-49e2-9744-5e5471a4f26a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:56.171243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dee001e0-279b-4bbe-83e1-b1d3d30a5fc4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:56.187726 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dee001e0-279b-4bbe-83e1-b1d3d30a5fc4 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1316 microversion: 2.1 time: 0.397434 Oct 24 10:30:56.191749 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 858/1800] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:55 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1316 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:56.210406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3d97ba5c-6298-4423-ab67-adaf7f7a4d6c tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:56.213860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3d97ba5c-6298-4423-ab67-adaf7f7a4d6c tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:56.231657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d97ba5c-6298-4423-ab67-adaf7f7a4d6c tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:56.233491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d97ba5c-6298-4423-ab67-adaf7f7a4d6c tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:56.235176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d97ba5c-6298-4423-ab67-adaf7f7a4d6c tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:56.237899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d97ba5c-6298-4423-ab67-adaf7f7a4d6c tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:56.238462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d97ba5c-6298-4423-ab67-adaf7f7a4d6c tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:56.240915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d97ba5c-6298-4423-ab67-adaf7f7a4d6c tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:56.394018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3d97ba5c-6298-4423-ab67-adaf7f7a4d6c tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:30:56.576662 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3d97ba5c-6298-4423-ab67-adaf7f7a4d6c tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61" status: 204 len: 0 microversion: 2.1 time: 0.381714 Oct 24 10:30:56.577296 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 859/1801] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:30:56 2022] DELETE /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:30:56.583941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d4b56f17-0b82-405c-87e4-b52cd1f1f254 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0d76ee0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:56.673032 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d4b56f17-0b82-405c-87e4-b52cd1f1f254 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.094209 Oct 24 10:30:56.690511 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 860/1802] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:56 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:56.697698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d89b0689-7185-460b-9c4f-9e7199307855 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:56.703489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d89b0689-7185-460b-9c4f-9e7199307855 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:56.712432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cf068a16-9193-49e2-9744-5e5471a4f26a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:56.722363 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cf068a16-9193-49e2-9744-5e5471a4f26a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1211 microversion: 2.1 time: 0.610138 Oct 24 10:30:56.729088 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 943/1803] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:56 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1211 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:56.737130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d89b0689-7185-460b-9c4f-9e7199307855 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:56.737705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d89b0689-7185-460b-9c4f-9e7199307855 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:56.738129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d89b0689-7185-460b-9c4f-9e7199307855 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:56.738859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d89b0689-7185-460b-9c4f-9e7199307855 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:56.739302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d89b0689-7185-460b-9c4f-9e7199307855 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:56.739723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d89b0689-7185-460b-9c4f-9e7199307855 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:56.991663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d89b0689-7185-460b-9c4f-9e7199307855 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd513ecfb3554dffaa701fdcf8ab4d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496cc02be0824f85a94d06669e9662e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:57.005558 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d89b0689-7185-460b-9c4f-9e7199307855 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61" status: 200 len: 1468 microversion: 2.1 time: 0.313143 Oct 24 10:30:57.006150 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 861/1804] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:56 2022] GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61 => generated 1468 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:57.217935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-707d54de-fda6-46d2-ae2c-c1878b548d3b tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:57.218936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-707d54de-fda6-46d2-ae2c-c1878b548d3b tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:57.232599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-707d54de-fda6-46d2-ae2c-c1878b548d3b tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:57.233115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-707d54de-fda6-46d2-ae2c-c1878b548d3b tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:57.233554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-707d54de-fda6-46d2-ae2c-c1878b548d3b tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:57.234393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-707d54de-fda6-46d2-ae2c-c1878b548d3b tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:57.234892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-707d54de-fda6-46d2-ae2c-c1878b548d3b tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:57.235322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-707d54de-fda6-46d2-ae2c-c1878b548d3b tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:57.537382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-707d54de-fda6-46d2-ae2c-c1878b548d3b tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:57.550337 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-707d54de-fda6-46d2-ae2c-c1878b548d3b tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1316 microversion: 2.1 time: 0.338746 Oct 24 10:30:57.566900 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 944/1805] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:57 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:57.692570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-296db1d0-de25-409b-b1ed-a52fc7a92140 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0de38b0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:57.765137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6d644103-fe3c-4fc0-a927-7f23b5e6bfdb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:57.767314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6d644103-fe3c-4fc0-a927-7f23b5e6bfdb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:57.782029 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-296db1d0-de25-409b-b1ed-a52fc7a92140 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.093955 Oct 24 10:30:57.796004 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 862/1806] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:57 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:57.803738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d644103-fe3c-4fc0-a927-7f23b5e6bfdb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:57.805543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d644103-fe3c-4fc0-a927-7f23b5e6bfdb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:57.806521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d644103-fe3c-4fc0-a927-7f23b5e6bfdb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:57.809684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d644103-fe3c-4fc0-a927-7f23b5e6bfdb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:57.810390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d644103-fe3c-4fc0-a927-7f23b5e6bfdb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:57.811017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d644103-fe3c-4fc0-a927-7f23b5e6bfdb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:58.022237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6d644103-fe3c-4fc0-a927-7f23b5e6bfdb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:58.029934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-588a5343-148e-49f5-b163-39f4174922cf tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:58.030834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-588a5343-148e-49f5-b163-39f4174922cf tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:58.031704 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6d644103-fe3c-4fc0-a927-7f23b5e6bfdb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1199 microversion: 2.1 time: 0.280979 Oct 24 10:30:58.032302 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 945/1807] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:57 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1199 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:58.043143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-588a5343-148e-49f5-b163-39f4174922cf tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:58.043886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-588a5343-148e-49f5-b163-39f4174922cf tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:58.044540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-588a5343-148e-49f5-b163-39f4174922cf tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:58.045605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-588a5343-148e-49f5-b163-39f4174922cf tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:58.053460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-588a5343-148e-49f5-b163-39f4174922cf tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:58.054174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-588a5343-148e-49f5-b163-39f4174922cf tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:58.394584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-588a5343-148e-49f5-b163-39f4174922cf tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd513ecfb3554dffaa701fdcf8ab4d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496cc02be0824f85a94d06669e9662e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:58.404307 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-588a5343-148e-49f5-b163-39f4174922cf tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61" status: 200 len: 1468 microversion: 2.1 time: 0.378684 Oct 24 10:30:58.408981 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 863/1808] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:58 2022] GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61 => generated 1468 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:58.576526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-978f4ad6-9cb3-4519-8144-c09352180bab tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:58.577937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-978f4ad6-9cb3-4519-8144-c09352180bab tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:58.598295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-978f4ad6-9cb3-4519-8144-c09352180bab tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:58.601312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-978f4ad6-9cb3-4519-8144-c09352180bab tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:58.603166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-978f4ad6-9cb3-4519-8144-c09352180bab tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:58.605878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-978f4ad6-9cb3-4519-8144-c09352180bab tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:58.609141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-978f4ad6-9cb3-4519-8144-c09352180bab tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:58.610043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-978f4ad6-9cb3-4519-8144-c09352180bab tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:58.803403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f95db1bf-3da7-4b3d-9cf3-f5fa267fc0e6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d108a670>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:58.913454 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f95db1bf-3da7-4b3d-9cf3-f5fa267fc0e6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.114699 Oct 24 10:30:58.920359 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 864/1809] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:58 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:58.956449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-978f4ad6-9cb3-4519-8144-c09352180bab tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:58.978644 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-978f4ad6-9cb3-4519-8144-c09352180bab tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1316 microversion: 2.1 time: 0.400903 Oct 24 10:30:58.980075 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 946/1810] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:58 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:59.057635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-386a2b89-319a-4d9c-8639-aa4821e05eb1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:59.058283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-386a2b89-319a-4d9c-8639-aa4821e05eb1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:59.079342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-386a2b89-319a-4d9c-8639-aa4821e05eb1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:59.080810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-386a2b89-319a-4d9c-8639-aa4821e05eb1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:59.081531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-386a2b89-319a-4d9c-8639-aa4821e05eb1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:59.082458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-386a2b89-319a-4d9c-8639-aa4821e05eb1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:59.083288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-386a2b89-319a-4d9c-8639-aa4821e05eb1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:59.085462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-386a2b89-319a-4d9c-8639-aa4821e05eb1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:59.433401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6d5b36c8-6769-42af-ad13-09e51a335b92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:30:59.434133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6d5b36c8-6769-42af-ad13-09e51a335b92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:30:59.450268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d5b36c8-6769-42af-ad13-09e51a335b92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:59.456232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d5b36c8-6769-42af-ad13-09e51a335b92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:59.465994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d5b36c8-6769-42af-ad13-09e51a335b92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:59.469578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d5b36c8-6769-42af-ad13-09e51a335b92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:59.470091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d5b36c8-6769-42af-ad13-09e51a335b92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:59.470616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d5b36c8-6769-42af-ad13-09e51a335b92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:59.752133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-386a2b89-319a-4d9c-8639-aa4821e05eb1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:59.755694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6d5b36c8-6769-42af-ad13-09e51a335b92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd513ecfb3554dffaa701fdcf8ab4d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496cc02be0824f85a94d06669e9662e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:30:59.762331 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-386a2b89-319a-4d9c-8639-aa4821e05eb1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1199 microversion: 2.1 time: 0.710196 Oct 24 10:30:59.769314 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6d5b36c8-6769-42af-ad13-09e51a335b92 tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61" status: 200 len: 1426 microversion: 2.1 time: 0.340113 Oct 24 10:30:59.772322 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 947/1811] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:59 2022] GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61 => generated 1426 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:30:59.784402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-b3572516-aca1-44c4-8ab5-8b83e9feb847 req-8c0e1132-7c96-40f6-9860-4358dd2434e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df9b0c0-5006-42ec-97af-b35aa01c2e61", "name": "network-vif-deleted", "tag": "ad50564d-1c49-4d35-8459-a0f2bf0501fd"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:30:59.787658 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 865/1812] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:59 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1199 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:30:59.814494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b3572516-aca1-44c4-8ab5-8b83e9feb847 req-8c0e1132-7c96-40f6-9860-4358dd2434e1 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:30:59.814976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b3572516-aca1-44c4-8ab5-8b83e9feb847 req-8c0e1132-7c96-40f6-9860-4358dd2434e1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:30:59.815409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b3572516-aca1-44c4-8ab5-8b83e9feb847 req-8c0e1132-7c96-40f6-9860-4358dd2434e1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:30:59.869742 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-b3572516-aca1-44c4-8ab5-8b83e9feb847 req-8c0e1132-7c96-40f6-9860-4358dd2434e1 service nova] Creating event network-vif-deleted:ad50564d-1c49-4d35-8459-a0f2bf0501fd for instance 1df9b0c0-5006-42ec-97af-b35aa01c2e61 on n-h2-858383-15 Oct 24 10:30:59.885442 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-b3572516-aca1-44c4-8ab5-8b83e9feb847 req-8c0e1132-7c96-40f6-9860-4358dd2434e1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109637 Oct 24 10:30:59.887659 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 948/1813] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:30:59.935836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-29bfe478-650a-43f2-afce-9cdd71d82c22 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d133ca60>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:00.005703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d9efb52d-869d-40ce-a9ee-dd240d781158 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:00.006558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d9efb52d-869d-40ce-a9ee-dd240d781158 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:00.018722 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-29bfe478-650a-43f2-afce-9cdd71d82c22 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.086002 Oct 24 10:31:00.020126 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 866/1814] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:30:59 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:00.035087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9efb52d-869d-40ce-a9ee-dd240d781158 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:00.035987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9efb52d-869d-40ce-a9ee-dd240d781158 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:00.039530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9efb52d-869d-40ce-a9ee-dd240d781158 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:00.044772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9efb52d-869d-40ce-a9ee-dd240d781158 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:00.047069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9efb52d-869d-40ce-a9ee-dd240d781158 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:00.047733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9efb52d-869d-40ce-a9ee-dd240d781158 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:00.314625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d9efb52d-869d-40ce-a9ee-dd240d781158 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:00.344142 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d9efb52d-869d-40ce-a9ee-dd240d781158 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1316 microversion: 2.1 time: 0.342666 Oct 24 10:31:00.345878 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 949/1815] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:30:59 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:31:00.786095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a608a17d-92e6-41b2-854c-689acd566b3d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:00.787311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a608a17d-92e6-41b2-854c-689acd566b3d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:00.793527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f8b03dbc-7577-4bf3-a01d-99f405db5abe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:00.794787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f8b03dbc-7577-4bf3-a01d-99f405db5abe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] [instance: 1df9b0c0-5006-42ec-97af-b35aa01c2e61] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:00.801746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a608a17d-92e6-41b2-854c-689acd566b3d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:00.804713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8b03dbc-7577-4bf3-a01d-99f405db5abe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:00.805827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a608a17d-92e6-41b2-854c-689acd566b3d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:00.806318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a608a17d-92e6-41b2-854c-689acd566b3d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:00.807106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a608a17d-92e6-41b2-854c-689acd566b3d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:00.807878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8b03dbc-7577-4bf3-a01d-99f405db5abe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:00.809094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a608a17d-92e6-41b2-854c-689acd566b3d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:00.809544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a608a17d-92e6-41b2-854c-689acd566b3d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:00.809929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8b03dbc-7577-4bf3-a01d-99f405db5abe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:00.810854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8b03dbc-7577-4bf3-a01d-99f405db5abe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:00.814674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8b03dbc-7577-4bf3-a01d-99f405db5abe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:00.816095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8b03dbc-7577-4bf3-a01d-99f405db5abe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:00.858031 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-f8b03dbc-7577-4bf3-a01d-99f405db5abe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] HTTP exception thrown: Instance 1df9b0c0-5006-42ec-97af-b35aa01c2e61 could not be found. Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f8b03dbc-7577-4bf3-a01d-99f405db5abe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Request method failure captured: Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61 HTTP/1.1 Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmlF43WjBt3bxZOa14si7Rzf6gc3iA6a-SjBzuW1GkDexnx4iT0Jjliup8QLLEvkGC-xdRs1-7r1VcOblQ1pfzmFhmr00UShE1lMnUEj94GFDAkXwc_wLY620gkcOQ9L8YA0vq6KuQ4-zNiPj0vF-wvCWguj2jElkGYPptgYg2qfFQs Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 496cc02be0824f85a94d06669e9662e5 Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TenantUsagesTestJSON-1747018975 Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:31:00.860034 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:31:00.861694 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/496cc02be0824f85a94d06669e9662e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/496cc02be0824f85a94d06669e9662e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/496cc02be0824f85a94d06669e9662e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_496cc02be0824f85a94d06669e9662e5", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:31:00.861694 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TenantUsagesTestJSON-1747018975 Oct 24 10:31:00.861694 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 496cc02be0824f85a94d06669e9662e5 Oct 24 10:31:00.861694 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1747018975 Oct 24 10:31:00.861694 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TenantUsagesTestJSON-1747018975-project Oct 24 10:31:00.861694 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:31:00.861694 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:31:00.861694 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: cd513ecfb3554dffaa701fdcf8ab4d5c Oct 24 10:31:00.861694 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TenantUsagesTestJSON-1747018975-project Oct 24 10:31:00.861694 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:31:00.861694 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 1df9b0c0-5006-42ec-97af-b35aa01c2e61 could not be found. Oct 24 10:31:00.861694 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '1df9b0c0-5006-42ec-97af-b35aa01c2e61'} Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1df9b0c0-5006-42ec-97af-b35aa01c2e61 could not be found. Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:31:00.862576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:31:00.864010 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:31:00.864010 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:31:00.864010 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:31:00.864010 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:31:00.864010 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:31:00.864010 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:31:00.864010 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:31:00.864010 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1df9b0c0-5006-42ec-97af-b35aa01c2e61 could not be found. Oct 24 10:31:00.864010 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:00.864010 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:00.864010 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:00.864010 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:00.864010 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:31:00.864010 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:31:00.864010 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:31:00.864010 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:31:00.864010 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1df9b0c0-5006-42ec-97af-b35aa01c2e61 could not be found. Oct 24 10:31:00.864010 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:00.867283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f8b03dbc-7577-4bf3-a01d-99f405db5abe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] Returning 404 to user: Instance 1df9b0c0-5006-42ec-97af-b35aa01c2e61 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:31:00.869050 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f8b03dbc-7577-4bf3-a01d-99f405db5abe tempest-TenantUsagesTestJSON-1747018975 tempest-TenantUsagesTestJSON-1747018975-project] 10.222.0.50 "GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61" status: 404 len: 111 microversion: 2.1 time: 0.080015 Oct 24 10:31:00.870201 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 950/1816] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:00 2022] GET /compute/v2.1/servers/1df9b0c0-5006-42ec-97af-b35aa01c2e61 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:31:01.039171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2c623591-40e1-4986-a5fa-17940e90b7e0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d059df70>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:01.132312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a608a17d-92e6-41b2-854c-689acd566b3d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:01.154469 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a608a17d-92e6-41b2-854c-689acd566b3d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1199 microversion: 2.1 time: 0.369888 Oct 24 10:31:01.158726 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 867/1817] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:00 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1199 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:01.172172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-2c46f1e7-dec0-4ca7-9b73-623f6541e72a req-0d2fc9cb-0740-495b-902e-0419369cdd20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac22625-5979-4a7b-8bbd-e0d114e62f76", "name": "network-vif-plugged", "status": "completed", "tag": "0c6f5aab-b3a5-4a34-b31f-b771c9279d19"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:01.184641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2c46f1e7-dec0-4ca7-9b73-623f6541e72a req-0d2fc9cb-0740-495b-902e-0419369cdd20 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:01.185944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2c46f1e7-dec0-4ca7-9b73-623f6541e72a req-0d2fc9cb-0740-495b-902e-0419369cdd20 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:01.186618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2c46f1e7-dec0-4ca7-9b73-623f6541e72a req-0d2fc9cb-0740-495b-902e-0419369cdd20 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:01.187477 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2c623591-40e1-4986-a5fa-17940e90b7e0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.155375 Oct 24 10:31:01.199533 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 951/1818] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:31:01 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:01.209731 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-2c46f1e7-dec0-4ca7-9b73-623f6541e72a req-0d2fc9cb-0740-495b-902e-0419369cdd20 service nova] Creating event network-vif-plugged:0c6f5aab-b3a5-4a34-b31f-b771c9279d19 for instance 8ac22625-5979-4a7b-8bbd-e0d114e62f76 on n-h1-858383-15 Oct 24 10:31:01.216185 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-2c46f1e7-dec0-4ca7-9b73-623f6541e72a req-0d2fc9cb-0740-495b-902e-0419369cdd20 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055736 Oct 24 10:31:01.217250 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 868/1819] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:31:01.367533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d3019967-ece0-495b-bc10-1ef0dd812ff5 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:01.368079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d3019967-ece0-495b-bc10-1ef0dd812ff5 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:01.390164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3019967-ece0-495b-bc10-1ef0dd812ff5 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:01.392503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3019967-ece0-495b-bc10-1ef0dd812ff5 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:01.396541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3019967-ece0-495b-bc10-1ef0dd812ff5 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:01.400277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3019967-ece0-495b-bc10-1ef0dd812ff5 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:01.403769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3019967-ece0-495b-bc10-1ef0dd812ff5 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:01.404649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3019967-ece0-495b-bc10-1ef0dd812ff5 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:01.752978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d3019967-ece0-495b-bc10-1ef0dd812ff5 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:01.774883 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d3019967-ece0-495b-bc10-1ef0dd812ff5 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1316 microversion: 2.1 time: 0.408665 Oct 24 10:31:01.791131 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 952/1820] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:01 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1316 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:02.043271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ae8481da-5a24-44fb-b1ea-95bc72601666 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:02.044210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ae8481da-5a24-44fb-b1ea-95bc72601666 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:02.061771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae8481da-5a24-44fb-b1ea-95bc72601666 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:02.073235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae8481da-5a24-44fb-b1ea-95bc72601666 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:02.074070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae8481da-5a24-44fb-b1ea-95bc72601666 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:02.076177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae8481da-5a24-44fb-b1ea-95bc72601666 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:02.077983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae8481da-5a24-44fb-b1ea-95bc72601666 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:02.080285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae8481da-5a24-44fb-b1ea-95bc72601666 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:02.132269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:02.184032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-85e025b4-678d-4832-ad83-bc6365d85e17 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:02.185773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-85e025b4-678d-4832-ad83-bc6365d85e17 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:02.209851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85e025b4-678d-4832-ad83-bc6365d85e17 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:02.212570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85e025b4-678d-4832-ad83-bc6365d85e17 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:02.217169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85e025b4-678d-4832-ad83-bc6365d85e17 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:02.228039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85e025b4-678d-4832-ad83-bc6365d85e17 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:02.235671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85e025b4-678d-4832-ad83-bc6365d85e17 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:02.237147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85e025b4-678d-4832-ad83-bc6365d85e17 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:02.477926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-ae8481da-5a24-44fb-b1ea-95bc72601666 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'services' on Instance uuid 07e4585f-945b-462a-aac7-5a7af22f160d {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:31:02.560699 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ae8481da-5a24-44fb-b1ea-95bc72601666 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 2344 microversion: 2.25 time: 0.504114 Oct 24 10:31:02.561692 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 869/1821] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:31:02 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 2344 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:31:02.568828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7593feaa-c276-4a7b-8a5b-11a3a0ccb5df tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0a64e50>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:02.627305 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7593feaa-c276-4a7b-8a5b-11a3a0ccb5df tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.064338 Oct 24 10:31:02.630628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-85e025b4-678d-4832-ad83-bc6365d85e17 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:02.645738 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 870/1822] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:31:02 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:02.651982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8cb8062d-ce4f-4d69-aa74-0b31029c57b9 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:02.652625 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-85e025b4-678d-4832-ad83-bc6365d85e17 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1199 microversion: 2.1 time: 0.474011 Oct 24 10:31:02.653733 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 953/1823] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:02 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1199 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:02.656087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb8062d-ce4f-4d69-aa74-0b31029c57b9 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:02.661535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb8062d-ce4f-4d69-aa74-0b31029c57b9 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:02.662225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb8062d-ce4f-4d69-aa74-0b31029c57b9 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:02.663213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb8062d-ce4f-4d69-aa74-0b31029c57b9 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:02.663850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb8062d-ce4f-4d69-aa74-0b31029c57b9 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:02.667761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb8062d-ce4f-4d69-aa74-0b31029c57b9 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:02.753372 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8cb8062d-ce4f-4d69-aa74-0b31029c57b9 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.106024 Oct 24 10:31:02.754343 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 871/1824] 10.222.0.50 () {60 vars in 1217 bytes} [Mon Oct 24 10:31:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:31:02.809952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fd74ec19-5c37-48e5-8625-f184c4b09956 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:02.812313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fd74ec19-5c37-48e5-8625-f184c4b09956 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:02.831618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd74ec19-5c37-48e5-8625-f184c4b09956 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:02.832127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd74ec19-5c37-48e5-8625-f184c4b09956 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:02.832573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd74ec19-5c37-48e5-8625-f184c4b09956 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:02.844121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd74ec19-5c37-48e5-8625-f184c4b09956 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:02.845355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd74ec19-5c37-48e5-8625-f184c4b09956 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:02.846203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd74ec19-5c37-48e5-8625-f184c4b09956 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:03.250398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fd74ec19-5c37-48e5-8625-f184c4b09956 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:03.272305 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fd74ec19-5c37-48e5-8625-f184c4b09956 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1316 microversion: 2.1 time: 0.472515 Oct 24 10:31:03.291705 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 954/1825] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:02 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:03.644189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c363e360-6ecc-4063-918a-3e58818c0741 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0a64040>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:03.684512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fa182eae-0a1f-4e66-8e6b-b60654842ed2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:03.686236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fa182eae-0a1f-4e66-8e6b-b60654842ed2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:03.702806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa182eae-0a1f-4e66-8e6b-b60654842ed2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:03.703745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa182eae-0a1f-4e66-8e6b-b60654842ed2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:03.720296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa182eae-0a1f-4e66-8e6b-b60654842ed2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:03.723458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa182eae-0a1f-4e66-8e6b-b60654842ed2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:03.723950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa182eae-0a1f-4e66-8e6b-b60654842ed2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:03.731063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa182eae-0a1f-4e66-8e6b-b60654842ed2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:03.779955 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c363e360-6ecc-4063-918a-3e58818c0741 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.140241 Oct 24 10:31:03.788752 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 872/1826] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:31:03 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:04.231179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fa182eae-0a1f-4e66-8e6b-b60654842ed2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:04.253112 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fa182eae-0a1f-4e66-8e6b-b60654842ed2 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1199 microversion: 2.1 time: 0.572754 Oct 24 10:31:04.255148 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 955/1827] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:03 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1199 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:04.297662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f62a4f86-46cd-4cd5-9319-76be1f257b6d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:04.298653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f62a4f86-46cd-4cd5-9319-76be1f257b6d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:04.329672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f62a4f86-46cd-4cd5-9319-76be1f257b6d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:04.330434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f62a4f86-46cd-4cd5-9319-76be1f257b6d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:04.331086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f62a4f86-46cd-4cd5-9319-76be1f257b6d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:04.332022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f62a4f86-46cd-4cd5-9319-76be1f257b6d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:04.332707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f62a4f86-46cd-4cd5-9319-76be1f257b6d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:04.333370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f62a4f86-46cd-4cd5-9319-76be1f257b6d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:04.795550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b823564f-b03f-405a-bebf-fed28ed91e1f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d059df70>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:04.875011 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b823564f-b03f-405a-bebf-fed28ed91e1f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.083197 Oct 24 10:31:04.875700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f62a4f86-46cd-4cd5-9319-76be1f257b6d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:04.892942 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 956/1828] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:31:04 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:31:04.897548 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f62a4f86-46cd-4cd5-9319-76be1f257b6d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1506 microversion: 2.1 time: 0.596695 Oct 24 10:31:04.904332 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 873/1829] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:04 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1506 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:04.936799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e3ccc946-851f-4185-b49b-a00382972155 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:04.937831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e3ccc946-851f-4185-b49b-a00382972155 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:04.954232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3ccc946-851f-4185-b49b-a00382972155 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:04.955667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3ccc946-851f-4185-b49b-a00382972155 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:04.957867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3ccc946-851f-4185-b49b-a00382972155 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:04.959655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3ccc946-851f-4185-b49b-a00382972155 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:04.964680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3ccc946-851f-4185-b49b-a00382972155 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:04.966477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3ccc946-851f-4185-b49b-a00382972155 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:05.076619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e3ccc946-851f-4185-b49b-a00382972155 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:05.083313 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e3ccc946-851f-4185-b49b-a00382972155 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76/os-instance-actions/req-bcf1324b-6ece-420c-9720-be24a2c46e24" status: 200 len: 313 microversion: 2.1 time: 0.148760 Oct 24 10:31:05.095376 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 957/1830] 10.222.0.50 () {58 vars in 1419 bytes} [Mon Oct 24 10:31:04 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76/os-instance-actions/req-bcf1324b-6ece-420c-9720-be24a2c46e24 => generated 313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:31:05.100684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ae222121-9c7d-4ef6-90fc-ccc52d7d142d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:05.104584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ae222121-9c7d-4ef6-90fc-ccc52d7d142d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:05.138616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae222121-9c7d-4ef6-90fc-ccc52d7d142d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:05.139184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae222121-9c7d-4ef6-90fc-ccc52d7d142d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:05.139645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae222121-9c7d-4ef6-90fc-ccc52d7d142d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:05.144153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae222121-9c7d-4ef6-90fc-ccc52d7d142d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:05.144652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae222121-9c7d-4ef6-90fc-ccc52d7d142d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:05.145156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae222121-9c7d-4ef6-90fc-ccc52d7d142d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:05.284445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4233d257-ccbc-4965-aa2a-661a26cae364 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:05.285695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4233d257-ccbc-4965-aa2a-661a26cae364 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:05.304145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4233d257-ccbc-4965-aa2a-661a26cae364 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:05.305960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4233d257-ccbc-4965-aa2a-661a26cae364 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:05.306697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4233d257-ccbc-4965-aa2a-661a26cae364 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:05.312681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4233d257-ccbc-4965-aa2a-661a26cae364 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:05.313260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4233d257-ccbc-4965-aa2a-661a26cae364 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:05.313743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4233d257-ccbc-4965-aa2a-661a26cae364 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:05.462876 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ae222121-9c7d-4ef6-90fc-ccc52d7d142d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "POST /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76/action" status: 202 len: 0 microversion: 2.1 time: 0.363630 Oct 24 10:31:05.466420 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 874/1831] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:31:05 2022] POST /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:31:05.485931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7a5522bd-b46e-426a-9eea-7af8cc5d1770 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:05.489621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7a5522bd-b46e-426a-9eea-7af8cc5d1770 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:05.524891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a5522bd-b46e-426a-9eea-7af8cc5d1770 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:05.525719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a5522bd-b46e-426a-9eea-7af8cc5d1770 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:05.526165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a5522bd-b46e-426a-9eea-7af8cc5d1770 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:05.526912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a5522bd-b46e-426a-9eea-7af8cc5d1770 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:05.527365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a5522bd-b46e-426a-9eea-7af8cc5d1770 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:05.527785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a5522bd-b46e-426a-9eea-7af8cc5d1770 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:05.914081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=8 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:06.112188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4233d257-ccbc-4965-aa2a-661a26cae364 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:06.128015 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4233d257-ccbc-4965-aa2a-661a26cae364 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1199 microversion: 2.1 time: 0.848532 Oct 24 10:31:06.130908 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 958/1832] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:05 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1199 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:31:06.147847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-182711ca-ab79-443f-bb24-a9b46e301b5e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0556310>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:06.232004 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-182711ca-ab79-443f-bb24-a9b46e301b5e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.099799 Oct 24 10:31:06.233883 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 959/1833] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:31:06 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:06.253199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5256fccf-96cd-4ec4-8047-c40b6fcdbb82 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6f9668b-2a34-43a1-bdb0-76ed16e3cd05", "device": "/dev/xvdb"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:06.265689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5256fccf-96cd-4ec4-8047-c40b6fcdbb82 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:06.272008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7a5522bd-b46e-426a-9eea-7af8cc5d1770 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:06.286590 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7a5522bd-b46e-426a-9eea-7af8cc5d1770 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1508 microversion: 2.1 time: 0.818059 Oct 24 10:31:06.291986 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 875/1834] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:05 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1508 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:06.303142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5256fccf-96cd-4ec4-8047-c40b6fcdbb82 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:06.303724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5256fccf-96cd-4ec4-8047-c40b6fcdbb82 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:06.304753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5256fccf-96cd-4ec4-8047-c40b6fcdbb82 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:06.313054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5256fccf-96cd-4ec4-8047-c40b6fcdbb82 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:06.313789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5256fccf-96cd-4ec4-8047-c40b6fcdbb82 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:06.317098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5256fccf-96cd-4ec4-8047-c40b6fcdbb82 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:06.400694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:07.154127 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5256fccf-96cd-4ec4-8047-c40b6fcdbb82 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "POST /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.912798 Oct 24 10:31:07.158835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1bd7ed5a-936f-4616-b7c9-24f547dc6cad tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:07.159518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1bd7ed5a-936f-4616-b7c9-24f547dc6cad tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:07.168720 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 960/1835] 10.222.0.50 () {62 vars in 1364 bytes} [Mon Oct 24 10:31:06 2022] POST /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments => generated 194 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:31:07.170843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bd7ed5a-936f-4616-b7c9-24f547dc6cad tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:07.172725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bd7ed5a-936f-4616-b7c9-24f547dc6cad tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:07.174664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bd7ed5a-936f-4616-b7c9-24f547dc6cad tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:07.175535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bd7ed5a-936f-4616-b7c9-24f547dc6cad tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:07.177495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bd7ed5a-936f-4616-b7c9-24f547dc6cad tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:07.179341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bd7ed5a-936f-4616-b7c9-24f547dc6cad tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:07.257800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0f0d25ed-a1e7-46ac-b748-26f44cfb95c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d06f0af0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:07.382856 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0f0d25ed-a1e7-46ac-b748-26f44cfb95c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.129017 Oct 24 10:31:07.395439 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 961/1836] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:31:07 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:07.422948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fe305d7c-140f-46b1-829a-366820101de3 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:07.425862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fe305d7c-140f-46b1-829a-366820101de3 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:07.452474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe305d7c-140f-46b1-829a-366820101de3 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:07.456162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe305d7c-140f-46b1-829a-366820101de3 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:07.457160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe305d7c-140f-46b1-829a-366820101de3 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:07.465232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe305d7c-140f-46b1-829a-366820101de3 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:07.467308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe305d7c-140f-46b1-829a-366820101de3 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:07.469408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe305d7c-140f-46b1-829a-366820101de3 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:07.477943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1bd7ed5a-936f-4616-b7c9-24f547dc6cad tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:07.497553 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1bd7ed5a-936f-4616-b7c9-24f547dc6cad tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1199 microversion: 2.1 time: 0.341615 Oct 24 10:31:07.498369 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 876/1837] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:07 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1199 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:31:07.826321 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-379c5625-89d8-4389-890e-1784634e27e9 tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] 10.222.0.50 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.222922 Oct 24 10:31:07.827358 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 877/1838] 10.222.0.50 () {58 vars in 1128 bytes} [Mon Oct 24 10:31:07 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 24 10:31:07.839416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0f4005ca-6bd3-4a05-abe6-b28be77af4ba tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] Calling method '.version_select at 0x7f04d0bb3160>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:07.938267 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-0f4005ca-6bd3-4a05-abe6-b28be77af4ba tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] HTTP exception thrown: Image not found. Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0f4005ca-6bd3-4a05-abe6-b28be77af4ba tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] Request method failure captured: Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmlr_JNP_zF_7bbqquV_C_9-sPPPPUpyqCDImtcAvgA56NmlOjiRVmChr-2n-APZxRQSv8SlKQB7GzQp9ptI_BUxnfA6A_qJwgVa_gSprNkb6Y9cOrL7vN1cYBqiRIU8WSMltZfcvFDsahUwxkBe15FLmBtYCYtkHETJqz5AJKl4EvA Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 83b5426babc44354a8c18a4e2abf3937 Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-293737225 Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:31:07.946995 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:31:07.948553 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/83b5426babc44354a8c18a4e2abf3937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/83b5426babc44354a8c18a4e2abf3937"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/83b5426babc44354a8c18a4e2abf3937"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_83b5426babc44354a8c18a4e2abf3937", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:31:07.948553 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-293737225 Oct 24 10:31:07.948553 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 83b5426babc44354a8c18a4e2abf3937 Oct 24 10:31:07.948553 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-293737225 Oct 24 10:31:07.948553 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesDeleteNegativeTestJSON-293737225-project Oct 24 10:31:07.948553 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:31:07.948553 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:31:07.948553 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: aea88fad1b6441f4809db9b4422f17fa Oct 24 10:31:07.948553 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-293737225-project Oct 24 10:31:07.948553 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:31:07.948553 n-d-858383-15 devstack@n-api.service[120425]: exception: Image not found. Oct 24 10:31:07.948553 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '-1'} Oct 24 10:31:07.948553 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:31:07.948553 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:07.950850 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:31:07.952120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 10:31:07.955062 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 10:31:07.955062 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:31:07.955062 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:07.955062 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:07.955062 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:07.955062 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:07.955062 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:31:07.955062 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:31:07.955062 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:31:07.955062 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:31:07.955062 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:31:07.955062 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:07.955062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0f4005ca-6bd3-4a05-abe6-b28be77af4ba tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] Returning 404 to user: Image not found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:31:07.955062 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0f4005ca-6bd3-4a05-abe6-b28be77af4ba tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] 10.222.0.50 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.116359 Oct 24 10:31:07.955062 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 878/1839] 10.222.0.50 () {58 vars in 1134 bytes} [Mon Oct 24 10:31:07 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 24 10:31:07.958230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d9693542-4a34-44a5-87f3-d1d46c5bbd38 tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] Calling method '.version_select at 0x7f04d10ac9d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:07.990265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fe305d7c-140f-46b1-829a-366820101de3 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:07.994154 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-d9693542-4a34-44a5-87f3-d1d46c5bbd38 tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] HTTP exception thrown: Image not found. Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d9693542-4a34-44a5-87f3-d1d46c5bbd38 tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] Request method failure captured: Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/images/b33cd219-111f-4af1-8c30-9228658d88bj HTTP/1.1 Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmlr_JNP_zF_7bbqquV_C_9-sPPPPUpyqCDImtcAvgA56NmlOjiRVmChr-2n-APZxRQSv8SlKQB7GzQp9ptI_BUxnfA6A_qJwgVa_gSprNkb6Y9cOrL7vN1cYBqiRIU8WSMltZfcvFDsahUwxkBe15FLmBtYCYtkHETJqz5AJKl4EvA Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 83b5426babc44354a8c18a4e2abf3937 Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-293737225 Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:31:07.996973 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:31:07.998750 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/83b5426babc44354a8c18a4e2abf3937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/83b5426babc44354a8c18a4e2abf3937"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/83b5426babc44354a8c18a4e2abf3937"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_83b5426babc44354a8c18a4e2abf3937", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:31:07.998750 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-293737225 Oct 24 10:31:07.998750 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 83b5426babc44354a8c18a4e2abf3937 Oct 24 10:31:07.998750 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-293737225 Oct 24 10:31:07.998750 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesDeleteNegativeTestJSON-293737225-project Oct 24 10:31:07.998750 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:31:07.998750 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:31:07.998750 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: aea88fad1b6441f4809db9b4422f17fa Oct 24 10:31:07.998750 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-293737225-project Oct 24 10:31:07.998750 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:31:07.998750 n-d-858383-15 devstack@n-api.service[120425]: exception: Image not found. Oct 24 10:31:07.998750 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'b33cd219-111f-4af1-8c30-9228658d88bj'} Oct 24 10:31:07.998750 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b33cd219-111f-4af1-8c30-9228658d88bj to delete Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:07.999813 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b33cd219-111f-4af1-8c30-9228658d88bj could not be found. Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:31:08.001374 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:31:08.003331 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 10:31:08.003331 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 10:31:08.003331 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:31:08.003331 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.003331 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:08.003331 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.003331 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:08.003331 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:31:08.003331 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:31:08.003331 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:31:08.003331 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:31:08.003331 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:31:08.003331 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.005751 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fe305d7c-140f-46b1-829a-366820101de3 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1508 microversion: 2.1 time: 0.608300 Oct 24 10:31:08.006019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d9693542-4a34-44a5-87f3-d1d46c5bbd38 tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] Returning 404 to user: Image not found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:31:08.006472 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 962/1840] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:07 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1508 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:08.007424 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d9693542-4a34-44a5-87f3-d1d46c5bbd38 tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] 10.222.0.50 "DELETE /compute/v2.1/images/b33cd219-111f-4af1-8c30-9228658d88bj" status: 404 len: 62 microversion: 2.1 time: 0.052758 Oct 24 10:31:08.008246 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 879/1841] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:07 2022] DELETE /compute/v2.1/images/b33cd219-111f-4af1-8c30-9228658d88bj => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:31:08.038946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c648696e-9bba-45fc-8201-9be87f0b5718 tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] Calling method '.version_select at 0x7f04d07fae50>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:08.072992 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-c648696e-9bba-45fc-8201-9be87f0b5718 tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] HTTP exception thrown: Image not found. Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c648696e-9bba-45fc-8201-9be87f0b5718 tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] Request method failure captured: Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/images/67a289e1-b32d-48db-889d-b7bb5c1603231 HTTP/1.1 Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmlr_JNP_zF_7bbqquV_C_9-sPPPPUpyqCDImtcAvgA56NmlOjiRVmChr-2n-APZxRQSv8SlKQB7GzQp9ptI_BUxnfA6A_qJwgVa_gSprNkb6Y9cOrL7vN1cYBqiRIU8WSMltZfcvFDsahUwxkBe15FLmBtYCYtkHETJqz5AJKl4EvA Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 83b5426babc44354a8c18a4e2abf3937 Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-293737225 Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:31:08.090750 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:31:08.092607 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/83b5426babc44354a8c18a4e2abf3937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/83b5426babc44354a8c18a4e2abf3937"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/83b5426babc44354a8c18a4e2abf3937"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_83b5426babc44354a8c18a4e2abf3937", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:31:08.092607 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-293737225 Oct 24 10:31:08.092607 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 83b5426babc44354a8c18a4e2abf3937 Oct 24 10:31:08.092607 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-293737225 Oct 24 10:31:08.092607 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesDeleteNegativeTestJSON-293737225-project Oct 24 10:31:08.092607 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:31:08.092607 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:31:08.092607 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: aea88fad1b6441f4809db9b4422f17fa Oct 24 10:31:08.092607 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-293737225-project Oct 24 10:31:08.092607 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:31:08.092607 n-d-858383-15 devstack@n-api.service[120426]: exception: Image not found. Oct 24 10:31:08.092607 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '67a289e1-b32d-48db-889d-b7bb5c1603231'} Oct 24 10:31:08.092607 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 67a289e1-b32d-48db-889d-b7bb5c1603231 to delete Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:08.093720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 67a289e1-b32d-48db-889d-b7bb5c1603231 could not be found. Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:31:08.095254 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:31:08.096980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 10:31:08.096980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 10:31:08.096980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:31:08.096980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.096980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:08.096980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.096980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:08.096980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:31:08.096980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:31:08.096980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:31:08.096980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:31:08.096980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:31:08.096980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.099112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c648696e-9bba-45fc-8201-9be87f0b5718 tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] Returning 404 to user: Image not found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:31:08.100152 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c648696e-9bba-45fc-8201-9be87f0b5718 tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] 10.222.0.50 "DELETE /compute/v2.1/images/67a289e1-b32d-48db-889d-b7bb5c1603231" status: 404 len: 62 microversion: 2.1 time: 0.069955 Oct 24 10:31:08.101264 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 963/1842] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:31:08 2022] DELETE /compute/v2.1/images/67a289e1-b32d-48db-889d-b7bb5c1603231 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:31:08.110635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9269e9b6-5250-49eb-8397-2a28905bf827 tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] Calling method '.version_select at 0x7f04d0bb3160>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:08.157219 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-9269e9b6-5250-49eb-8397-2a28905bf827 tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] HTTP exception thrown: Image not found. Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9269e9b6-5250-49eb-8397-2a28905bf827 tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] Request method failure captured: Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/images/tempest-invalid-475466773 HTTP/1.1 Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmlr_JNP_zF_7bbqquV_C_9-sPPPPUpyqCDImtcAvgA56NmlOjiRVmChr-2n-APZxRQSv8SlKQB7GzQp9ptI_BUxnfA6A_qJwgVa_gSprNkb6Y9cOrL7vN1cYBqiRIU8WSMltZfcvFDsahUwxkBe15FLmBtYCYtkHETJqz5AJKl4EvA Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 83b5426babc44354a8c18a4e2abf3937 Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-293737225 Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:31:08.159367 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:31:08.160889 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/83b5426babc44354a8c18a4e2abf3937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/83b5426babc44354a8c18a4e2abf3937"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/83b5426babc44354a8c18a4e2abf3937"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_83b5426babc44354a8c18a4e2abf3937", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:31:08.160889 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-293737225 Oct 24 10:31:08.160889 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 83b5426babc44354a8c18a4e2abf3937 Oct 24 10:31:08.160889 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-293737225 Oct 24 10:31:08.160889 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesDeleteNegativeTestJSON-293737225-project Oct 24 10:31:08.160889 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:31:08.160889 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:31:08.160889 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: aea88fad1b6441f4809db9b4422f17fa Oct 24 10:31:08.160889 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-293737225-project Oct 24 10:31:08.160889 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:31:08.160889 n-d-858383-15 devstack@n-api.service[120425]: exception: Image not found. Oct 24 10:31:08.160889 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'tempest-invalid-475466773'} Oct 24 10:31:08.160889 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-475466773 to delete Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:08.161791 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-475466773 could not be found. Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:31:08.163104 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:31:08.165047 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 10:31:08.165047 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 10:31:08.165047 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:31:08.165047 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.165047 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:08.165047 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.165047 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:08.165047 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:31:08.165047 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:31:08.165047 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:31:08.165047 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:31:08.165047 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:31:08.165047 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.168667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9269e9b6-5250-49eb-8397-2a28905bf827 tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] Returning 404 to user: Image not found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:31:08.169742 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9269e9b6-5250-49eb-8397-2a28905bf827 tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] 10.222.0.50 "DELETE /compute/v2.1/images/tempest-invalid-475466773" status: 404 len: 62 microversion: 2.1 time: 0.063066 Oct 24 10:31:08.170585 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 880/1843] 10.222.0.50 () {58 vars in 1203 bytes} [Mon Oct 24 10:31:08 2022] DELETE /compute/v2.1/images/tempest-invalid-475466773 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:31:08.179916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3482c667-d886-4e03-9596-b4cf82d21d4a tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] Calling method '.version_select at 0x7f04d051d670>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:08.214582 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-3482c667-d886-4e03-9596-b4cf82d21d4a tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] HTTP exception thrown: Image not found. Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3482c667-d886-4e03-9596-b4cf82d21d4a tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] Request method failure captured: Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/images/43db001b-3ce3-44ef-a7bb-ed1480051f78 HTTP/1.1 Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmlr_JNP_zF_7bbqquV_C_9-sPPPPUpyqCDImtcAvgA56NmlOjiRVmChr-2n-APZxRQSv8SlKQB7GzQp9ptI_BUxnfA6A_qJwgVa_gSprNkb6Y9cOrL7vN1cYBqiRIU8WSMltZfcvFDsahUwxkBe15FLmBtYCYtkHETJqz5AJKl4EvA Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 83b5426babc44354a8c18a4e2abf3937 Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-293737225 Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:31:08.216579 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:31:08.218359 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/83b5426babc44354a8c18a4e2abf3937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/83b5426babc44354a8c18a4e2abf3937"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/83b5426babc44354a8c18a4e2abf3937"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_83b5426babc44354a8c18a4e2abf3937", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:31:08.218359 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-293737225 Oct 24 10:31:08.218359 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 83b5426babc44354a8c18a4e2abf3937 Oct 24 10:31:08.218359 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-293737225 Oct 24 10:31:08.218359 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesDeleteNegativeTestJSON-293737225-project Oct 24 10:31:08.218359 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:31:08.218359 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:31:08.218359 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: aea88fad1b6441f4809db9b4422f17fa Oct 24 10:31:08.218359 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-293737225-project Oct 24 10:31:08.218359 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:31:08.218359 n-d-858383-15 devstack@n-api.service[120426]: exception: Image not found. Oct 24 10:31:08.218359 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '43db001b-3ce3-44ef-a7bb-ed1480051f78'} Oct 24 10:31:08.218359 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 43db001b-3ce3-44ef-a7bb-ed1480051f78 to delete Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:08.219445 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 43db001b-3ce3-44ef-a7bb-ed1480051f78 could not be found. Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:31:08.221007 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:31:08.222890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 10:31:08.222890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 10:31:08.222890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:31:08.222890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.222890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:08.222890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.222890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:08.222890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:31:08.222890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:31:08.222890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:31:08.222890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:31:08.222890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:31:08.222890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:08.225761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3482c667-d886-4e03-9596-b4cf82d21d4a tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] Returning 404 to user: Image not found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:31:08.227488 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3482c667-d886-4e03-9596-b4cf82d21d4a tempest-ImagesDeleteNegativeTestJSON-293737225 tempest-ImagesDeleteNegativeTestJSON-293737225-project] 10.222.0.50 "DELETE /compute/v2.1/images/43db001b-3ce3-44ef-a7bb-ed1480051f78" status: 404 len: 62 microversion: 2.1 time: 0.051279 Oct 24 10:31:08.228870 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 964/1844] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:08 2022] DELETE /compute/v2.1/images/43db001b-3ce3-44ef-a7bb-ed1480051f78 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:31:08.401238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-90f9596e-b198-4d06-b611-751e25810345 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0aa3c10>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:08.509938 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-90f9596e-b198-4d06-b611-751e25810345 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1440 microversion: 2.1 time: 0.114553 Oct 24 10:31:08.512420 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 881/1845] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:31:08 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1440 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:08.529646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-14c26605-73db-434e-a491-d046cd7d3774 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:08.532791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-14c26605-73db-434e-a491-d046cd7d3774 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:08.543448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14c26605-73db-434e-a491-d046cd7d3774 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:08.557913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14c26605-73db-434e-a491-d046cd7d3774 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:08.558839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14c26605-73db-434e-a491-d046cd7d3774 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:08.563556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14c26605-73db-434e-a491-d046cd7d3774 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:08.564236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14c26605-73db-434e-a491-d046cd7d3774 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:08.566315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14c26605-73db-434e-a491-d046cd7d3774 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:09.036699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-820b6d00-f617-482c-9543-24ce3aeb8e59 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:09.037549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-820b6d00-f617-482c-9543-24ce3aeb8e59 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:09.051723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-820b6d00-f617-482c-9543-24ce3aeb8e59 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:09.052596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-820b6d00-f617-482c-9543-24ce3aeb8e59 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:09.053261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-820b6d00-f617-482c-9543-24ce3aeb8e59 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:09.056962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-820b6d00-f617-482c-9543-24ce3aeb8e59 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:09.057835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-820b6d00-f617-482c-9543-24ce3aeb8e59 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:09.059195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-820b6d00-f617-482c-9543-24ce3aeb8e59 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:09.742831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-14c26605-73db-434e-a491-d046cd7d3774 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:09.759174 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-14c26605-73db-434e-a491-d046cd7d3774 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1199 microversion: 2.1 time: 1.236552 Oct 24 10:31:09.777420 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 965/1846] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:08 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1199 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:09.783546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-55914129-d9ad-4929-bf3e-011895ed623d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d06f55e0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:09.853518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-820b6d00-f617-482c-9543-24ce3aeb8e59 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:09.863351 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-55914129-d9ad-4929-bf3e-011895ed623d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1449 microversion: 2.1 time: 0.083502 Oct 24 10:31:09.864182 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 966/1847] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:31:09 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:09.865738 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-820b6d00-f617-482c-9543-24ce3aeb8e59 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1513 microversion: 2.1 time: 0.832817 Oct 24 10:31:09.872380 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 882/1848] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:09 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1513 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:09.900208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ead2bd73-9b47-4a09-a4b4-2c1c261e8413 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d04f5670>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:09.992307 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ead2bd73-9b47-4a09-a4b4-2c1c261e8413 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 200 len: 1449 microversion: 2.1 time: 0.098233 Oct 24 10:31:09.995892 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 967/1849] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:31:09 2022] GET /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 1449 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:10.017239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fad22fad-fcf6-48b0-9a77-964362da1bd3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0c9cca0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:10.791936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7b15d2fe-524e-4ff9-8134-dd9dee8d468e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:10.793132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7b15d2fe-524e-4ff9-8134-dd9dee8d468e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:10.811574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b15d2fe-524e-4ff9-8134-dd9dee8d468e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:10.811958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b15d2fe-524e-4ff9-8134-dd9dee8d468e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:10.814224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b15d2fe-524e-4ff9-8134-dd9dee8d468e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:10.816746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b15d2fe-524e-4ff9-8134-dd9dee8d468e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:10.818822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b15d2fe-524e-4ff9-8134-dd9dee8d468e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:10.822941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b15d2fe-524e-4ff9-8134-dd9dee8d468e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:11.426282 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fad22fad-fcf6-48b0-9a77-964362da1bd3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 204 len: 0 microversion: 2.1 time: 1.415586 Oct 24 10:31:11.430046 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 883/1850] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:10 2022] DELETE /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 0 bytes in 1417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:31:11.437702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e841e3e-9f51-46cd-997c-81228b7c8a3a tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:11.438733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e841e3e-9f51-46cd-997c-81228b7c8a3a tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:11.452377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7b15d2fe-524e-4ff9-8134-dd9dee8d468e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:11.471613 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7b15d2fe-524e-4ff9-8134-dd9dee8d468e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1199 microversion: 2.1 time: 0.685289 Oct 24 10:31:11.473585 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 968/1851] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:10 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1199 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:11.476779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:11.487905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e841e3e-9f51-46cd-997c-81228b7c8a3a tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:11.488414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e841e3e-9f51-46cd-997c-81228b7c8a3a tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:11.490745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8797e4e0-d93d-4be6-94cb-3d5983af9f4e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:11.491274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8797e4e0-d93d-4be6-94cb-3d5983af9f4e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:11.492379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e841e3e-9f51-46cd-997c-81228b7c8a3a tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:11.493273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e841e3e-9f51-46cd-997c-81228b7c8a3a tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:11.493919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e841e3e-9f51-46cd-997c-81228b7c8a3a tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:11.497479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e841e3e-9f51-46cd-997c-81228b7c8a3a tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:11.513994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8797e4e0-d93d-4be6-94cb-3d5983af9f4e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:11.514511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8797e4e0-d93d-4be6-94cb-3d5983af9f4e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:11.518422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8797e4e0-d93d-4be6-94cb-3d5983af9f4e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:11.519655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8797e4e0-d93d-4be6-94cb-3d5983af9f4e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:11.522496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8797e4e0-d93d-4be6-94cb-3d5983af9f4e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:11.525471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8797e4e0-d93d-4be6-94cb-3d5983af9f4e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:11.646338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8797e4e0-d93d-4be6-94cb-3d5983af9f4e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:31:11.881136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1e841e3e-9f51-46cd-997c-81228b7c8a3a tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:11.895060 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1e841e3e-9f51-46cd-997c-81228b7c8a3a tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1506 microversion: 2.1 time: 0.459646 Oct 24 10:31:11.898507 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 884/1852] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:11 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1506 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:11.899478 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8797e4e0-d93d-4be6-94cb-3d5983af9f4e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 204 len: 0 microversion: 2.1 time: 0.423542 Oct 24 10:31:11.900472 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 969/1853] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:31:11 2022] DELETE /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:31:11.930974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-99c34f42-3579-4928-8a40-33229444a6e0 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '.version_select at 0x7f04d0f094c0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:11.933529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-99c34f42-3579-4928-8a40-33229444a6e0 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:11.950565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99c34f42-3579-4928-8a40-33229444a6e0 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:11.953482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99c34f42-3579-4928-8a40-33229444a6e0 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:11.956514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99c34f42-3579-4928-8a40-33229444a6e0 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:11.957587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99c34f42-3579-4928-8a40-33229444a6e0 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:11.958293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99c34f42-3579-4928-8a40-33229444a6e0 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:11.958976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99c34f42-3579-4928-8a40-33229444a6e0 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:12.039442 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-99c34f42-3579-4928-8a40-33229444a6e0 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.109532 Oct 24 10:31:12.040232 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 885/1854] 10.222.0.50 () {58 vars in 1296 bytes} [Mon Oct 24 10:31:11 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76/os-instance-actions => generated 611 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:31:12.059278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1c177286-9d67-4eb2-a669-44a8fc9b1288 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:12.060182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1c177286-9d67-4eb2-a669-44a8fc9b1288 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:12.080944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c177286-9d67-4eb2-a669-44a8fc9b1288 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:12.082372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c177286-9d67-4eb2-a669-44a8fc9b1288 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:12.085346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c177286-9d67-4eb2-a669-44a8fc9b1288 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:12.088134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c177286-9d67-4eb2-a669-44a8fc9b1288 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:12.089387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c177286-9d67-4eb2-a669-44a8fc9b1288 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:12.092370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c177286-9d67-4eb2-a669-44a8fc9b1288 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:12.177358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09a0458c-69b5-4d81-b1a4-911f27605030 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1663498499", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "c0c03a0b-80ac-4629-802c-40f648b11429"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:12.179895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1c177286-9d67-4eb2-a669-44a8fc9b1288 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:31:12.328088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-09a0458c-69b5-4d81-b1a4-911f27605030 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] validate_networks() for [('c0c03a0b-80ac-4629-802c-40f648b11429', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:31:12.334453 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1c177286-9d67-4eb2-a669-44a8fc9b1288 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 204 len: 0 microversion: 2.1 time: 0.281253 Oct 24 10:31:12.345071 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 970/1855] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:31:12 2022] DELETE /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:31:12.354161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dc47ed5d-129a-49cd-b20c-a415fa7c7c2f tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:12.357471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dc47ed5d-129a-49cd-b20c-a415fa7c7c2f tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:12.364644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc47ed5d-129a-49cd-b20c-a415fa7c7c2f tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:12.365551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc47ed5d-129a-49cd-b20c-a415fa7c7c2f tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:12.366282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc47ed5d-129a-49cd-b20c-a415fa7c7c2f tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:12.367262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc47ed5d-129a-49cd-b20c-a415fa7c7c2f tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:12.368507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc47ed5d-129a-49cd-b20c-a415fa7c7c2f tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:12.369247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc47ed5d-129a-49cd-b20c-a415fa7c7c2f tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:12.699239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:13.390012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dc47ed5d-129a-49cd-b20c-a415fa7c7c2f tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:13.404567 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dc47ed5d-129a-49cd-b20c-a415fa7c7c2f tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1512 microversion: 2.1 time: 1.057673 Oct 24 10:31:13.422342 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 971/1856] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:12 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1512 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:13.431705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d3b4837a-6087-4b58-9d0a-ff33991ac5df tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:13.432500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d3b4837a-6087-4b58-9d0a-ff33991ac5df tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:13.447098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3b4837a-6087-4b58-9d0a-ff33991ac5df tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:13.449820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3b4837a-6087-4b58-9d0a-ff33991ac5df tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:13.456554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3b4837a-6087-4b58-9d0a-ff33991ac5df tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:13.457832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3b4837a-6087-4b58-9d0a-ff33991ac5df tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:13.458536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3b4837a-6087-4b58-9d0a-ff33991ac5df tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:13.459475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3b4837a-6087-4b58-9d0a-ff33991ac5df tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:14.134048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-09a0458c-69b5-4d81-b1a4-911f27605030 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:31:14.135287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-09a0458c-69b5-4d81-b1a4-911f27605030 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:31:14.135597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-09a0458c-69b5-4d81-b1a4-911f27605030 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:31:14.136175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-09a0458c-69b5-4d81-b1a4-911f27605030 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:31:14.136758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-09a0458c-69b5-4d81-b1a4-911f27605030 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:31:14.155270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d3b4837a-6087-4b58-9d0a-ff33991ac5df tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:14.163637 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d3b4837a-6087-4b58-9d0a-ff33991ac5df tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1199 microversion: 2.1 time: 0.739845 Oct 24 10:31:14.165680 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 972/1857] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:13 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1199 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:14.170849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-15d9c631-534b-43d3-8868-660cc28253e0 req-acc1ec04-2af1-48c2-b210-520ed19bc9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84a8b2f8-edd4-45a3-be5f-878bfc0f5811", "name": "network-vif-unplugged", "status": "completed", "tag": "776dc61c-efaa-4518-9e14-466879a8f1c1"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:14.176030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09a0458c-69b5-4d81-b1a4-911f27605030 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:14.176729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09a0458c-69b5-4d81-b1a4-911f27605030 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:14.177390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09a0458c-69b5-4d81-b1a4-911f27605030 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:14.181413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09a0458c-69b5-4d81-b1a4-911f27605030 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:14.183109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09a0458c-69b5-4d81-b1a4-911f27605030 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:14.186111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09a0458c-69b5-4d81-b1a4-911f27605030 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:14.229601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-15d9c631-534b-43d3-8868-660cc28253e0 req-acc1ec04-2af1-48c2-b210-520ed19bc9d5 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:14.230101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-15d9c631-534b-43d3-8868-660cc28253e0 req-acc1ec04-2af1-48c2-b210-520ed19bc9d5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:14.233062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-15d9c631-534b-43d3-8868-660cc28253e0 req-acc1ec04-2af1-48c2-b210-520ed19bc9d5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:14.246307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-09a0458c-69b5-4d81-b1a4-911f27605030 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Getting quotas for project 8a3ff02c01a64c9a940de444ca1197c4. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:31:14.293699 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-15d9c631-534b-43d3-8868-660cc28253e0 req-acc1ec04-2af1-48c2-b210-520ed19bc9d5 service nova] Creating event network-vif-unplugged:776dc61c-efaa-4518-9e14-466879a8f1c1 for instance 84a8b2f8-edd4-45a3-be5f-878bfc0f5811 on n-h2-858383-15 Oct 24 10:31:14.304563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-09a0458c-69b5-4d81-b1a4-911f27605030 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Getting quotas for user 43fd0499bc224bd8b190701a811ee204 and project 8a3ff02c01a64c9a940de444ca1197c4. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:31:14.313648 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-15d9c631-534b-43d3-8868-660cc28253e0 req-acc1ec04-2af1-48c2-b210-520ed19bc9d5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138220 Oct 24 10:31:14.314351 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 973/1858] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:31:14.349705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09a0458c-69b5-4d81-b1a4-911f27605030 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:31:14.368407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09a0458c-69b5-4d81-b1a4-911f27605030 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: e09308b8-ad10-4557-bb53-7bdf515bbf36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:31:14.436255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ad8fa205-2fc0-4e56-9ec1-55b82fa02271 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:14.438114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ad8fa205-2fc0-4e56-9ec1-55b82fa02271 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:14.461022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad8fa205-2fc0-4e56-9ec1-55b82fa02271 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:14.464519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad8fa205-2fc0-4e56-9ec1-55b82fa02271 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:14.465667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad8fa205-2fc0-4e56-9ec1-55b82fa02271 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:14.470015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad8fa205-2fc0-4e56-9ec1-55b82fa02271 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:14.470705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad8fa205-2fc0-4e56-9ec1-55b82fa02271 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:14.472018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad8fa205-2fc0-4e56-9ec1-55b82fa02271 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:14.495209 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-09a0458c-69b5-4d81-b1a4-911f27605030 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.321865 Oct 24 10:31:14.500948 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 886/1859] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:31:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 10:31:14.512158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d51395a6-2074-4c30-ad9a-d679a8de210f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:14.513152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d51395a6-2074-4c30-ad9a-d679a8de210f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: e09308b8-ad10-4557-bb53-7bdf515bbf36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:14.852701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d51395a6-2074-4c30-ad9a-d679a8de210f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:14.860622 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d51395a6-2074-4c30-ad9a-d679a8de210f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36" status: 200 len: 1208 microversion: 2.1 time: 0.352501 Oct 24 10:31:14.867479 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 887/1860] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:14 2022] GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36 => generated 1208 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:31:15.189079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d58b43f4-9097-4e00-93c3-cd8d44911c55 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:15.189905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d58b43f4-9097-4e00-93c3-cd8d44911c55 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:15.201096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d58b43f4-9097-4e00-93c3-cd8d44911c55 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:15.225184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d58b43f4-9097-4e00-93c3-cd8d44911c55 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:15.230091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d58b43f4-9097-4e00-93c3-cd8d44911c55 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:15.233835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d58b43f4-9097-4e00-93c3-cd8d44911c55 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:15.238762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d58b43f4-9097-4e00-93c3-cd8d44911c55 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:15.239460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d58b43f4-9097-4e00-93c3-cd8d44911c55 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:15.282074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ad8fa205-2fc0-4e56-9ec1-55b82fa02271 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:15.299674 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ad8fa205-2fc0-4e56-9ec1-55b82fa02271 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1512 microversion: 2.1 time: 0.866592 Oct 24 10:31:15.303275 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 974/1861] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:14 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1512 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:15.965771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fca2745f-a813-401e-b1dc-d0fc2e1ab877 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:15.966551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fca2745f-a813-401e-b1dc-d0fc2e1ab877 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: e09308b8-ad10-4557-bb53-7bdf515bbf36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:15.998926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d58b43f4-9097-4e00-93c3-cd8d44911c55 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:16.011419 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d58b43f4-9097-4e00-93c3-cd8d44911c55 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1199 microversion: 2.1 time: 0.829172 Oct 24 10:31:16.014178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fca2745f-a813-401e-b1dc-d0fc2e1ab877 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:16.014864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fca2745f-a813-401e-b1dc-d0fc2e1ab877 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:16.015478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fca2745f-a813-401e-b1dc-d0fc2e1ab877 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:16.016529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fca2745f-a813-401e-b1dc-d0fc2e1ab877 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:16.017234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fca2745f-a813-401e-b1dc-d0fc2e1ab877 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:16.017875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fca2745f-a813-401e-b1dc-d0fc2e1ab877 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:16.034781 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 888/1862] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:15 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1199 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:16.176774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fca2745f-a813-401e-b1dc-d0fc2e1ab877 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:16.192268 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fca2745f-a813-401e-b1dc-d0fc2e1ab877 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36" status: 200 len: 1212 microversion: 2.1 time: 0.285800 Oct 24 10:31:16.216705 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 975/1863] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:15 2022] GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36 => generated 1212 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:16.335805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-54f9c9ed-7f4d-444a-be8d-82fdb75c9866 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:16.342071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-54f9c9ed-7f4d-444a-be8d-82fdb75c9866 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:16.365919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54f9c9ed-7f4d-444a-be8d-82fdb75c9866 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:16.370197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54f9c9ed-7f4d-444a-be8d-82fdb75c9866 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:16.371584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54f9c9ed-7f4d-444a-be8d-82fdb75c9866 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:16.372462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54f9c9ed-7f4d-444a-be8d-82fdb75c9866 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:16.376647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54f9c9ed-7f4d-444a-be8d-82fdb75c9866 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:16.381549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54f9c9ed-7f4d-444a-be8d-82fdb75c9866 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:16.424321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-43bb50d6-d267-46a3-ae7b-1c0f870186d9 req-e1ba570b-5250-4c99-a3a6-5e233e518700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84a8b2f8-edd4-45a3-be5f-878bfc0f5811", "name": "network-vif-deleted", "tag": "776dc61c-efaa-4518-9e14-466879a8f1c1"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:16.444677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-43bb50d6-d267-46a3-ae7b-1c0f870186d9 req-e1ba570b-5250-4c99-a3a6-5e233e518700 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:16.445517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-43bb50d6-d267-46a3-ae7b-1c0f870186d9 req-e1ba570b-5250-4c99-a3a6-5e233e518700 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:16.446846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-43bb50d6-d267-46a3-ae7b-1c0f870186d9 req-e1ba570b-5250-4c99-a3a6-5e233e518700 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:16.485010 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-43bb50d6-d267-46a3-ae7b-1c0f870186d9 req-e1ba570b-5250-4c99-a3a6-5e233e518700 service nova] Creating event network-vif-deleted:776dc61c-efaa-4518-9e14-466879a8f1c1 for instance 84a8b2f8-edd4-45a3-be5f-878bfc0f5811 on n-h2-858383-15 Oct 24 10:31:16.491870 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-43bb50d6-d267-46a3-ae7b-1c0f870186d9 req-e1ba570b-5250-4c99-a3a6-5e233e518700 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073237 Oct 24 10:31:16.510570 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 976/1864] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:31:16.810637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-54f9c9ed-7f4d-444a-be8d-82fdb75c9866 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:16.823539 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-54f9c9ed-7f4d-444a-be8d-82fdb75c9866 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1512 microversion: 2.1 time: 0.491914 Oct 24 10:31:16.858422 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 889/1865] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:16 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1512 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:16.979999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-d03fc4c5-7416-488a-9d8d-653c68c70877 req-5cbf513a-2117-4a9d-8aad-0db5b28df583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f4bf2a-de86-44f9-9481-b6591f1e0191", "name": "network-vif-plugged", "status": "completed", "tag": "67372bf5-c3c5-4daa-ac37-508ea3a9c66a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:17.030871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d03fc4c5-7416-488a-9d8d-653c68c70877 req-5cbf513a-2117-4a9d-8aad-0db5b28df583 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:17.031802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d03fc4c5-7416-488a-9d8d-653c68c70877 req-5cbf513a-2117-4a9d-8aad-0db5b28df583 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:17.033129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d03fc4c5-7416-488a-9d8d-653c68c70877 req-5cbf513a-2117-4a9d-8aad-0db5b28df583 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:17.061670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1094d5cd-1f99-4eeb-9bf0-da58a635727c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:17.066779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1094d5cd-1f99-4eeb-9bf0-da58a635727c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:17.111962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1094d5cd-1f99-4eeb-9bf0-da58a635727c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:17.112483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1094d5cd-1f99-4eeb-9bf0-da58a635727c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:17.112945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1094d5cd-1f99-4eeb-9bf0-da58a635727c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:17.127869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1094d5cd-1f99-4eeb-9bf0-da58a635727c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:17.128630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1094d5cd-1f99-4eeb-9bf0-da58a635727c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:17.131625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1094d5cd-1f99-4eeb-9bf0-da58a635727c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:17.137581 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-d03fc4c5-7416-488a-9d8d-653c68c70877 req-5cbf513a-2117-4a9d-8aad-0db5b28df583 service nova] Creating event network-vif-plugged:67372bf5-c3c5-4daa-ac37-508ea3a9c66a for instance 38f4bf2a-de86-44f9-9481-b6591f1e0191 on n-h1-858383-15 Oct 24 10:31:17.145501 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-d03fc4c5-7416-488a-9d8d-653c68c70877 req-5cbf513a-2117-4a9d-8aad-0db5b28df583 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169321 Oct 24 10:31:17.146915 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 977/1866] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:31:17.226384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dd0c1f8b-544f-4154-8738-7f2d9070ab30 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:17.228178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dd0c1f8b-544f-4154-8738-7f2d9070ab30 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: e09308b8-ad10-4557-bb53-7bdf515bbf36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:17.291816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd0c1f8b-544f-4154-8738-7f2d9070ab30 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:17.298220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd0c1f8b-544f-4154-8738-7f2d9070ab30 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:17.303902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd0c1f8b-544f-4154-8738-7f2d9070ab30 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:17.306664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd0c1f8b-544f-4154-8738-7f2d9070ab30 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:17.307173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd0c1f8b-544f-4154-8738-7f2d9070ab30 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:17.316464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd0c1f8b-544f-4154-8738-7f2d9070ab30 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:18.086030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dd0c1f8b-544f-4154-8738-7f2d9070ab30 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:18.138843 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dd0c1f8b-544f-4154-8738-7f2d9070ab30 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36" status: 200 len: 1268 microversion: 2.1 time: 0.894319 Oct 24 10:31:18.141829 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 978/1867] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:17 2022] GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36 => generated 1268 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:18.161213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-64574333-5254-41c2-bc99-fa6c24cef685 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:18.162405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-64574333-5254-41c2-bc99-fa6c24cef685 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:18.184685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64574333-5254-41c2-bc99-fa6c24cef685 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:18.189880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64574333-5254-41c2-bc99-fa6c24cef685 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:18.193304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64574333-5254-41c2-bc99-fa6c24cef685 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:18.194189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64574333-5254-41c2-bc99-fa6c24cef685 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:18.197905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64574333-5254-41c2-bc99-fa6c24cef685 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:18.199103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64574333-5254-41c2-bc99-fa6c24cef685 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:18.270168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:18.464420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-64574333-5254-41c2-bc99-fa6c24cef685 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:18.481497 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-64574333-5254-41c2-bc99-fa6c24cef685 tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1470 microversion: 2.1 time: 0.336313 Oct 24 10:31:18.485259 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 979/1868] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:18 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1470 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:18.551768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1094d5cd-1f99-4eeb-9bf0-da58a635727c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:18.573364 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1094d5cd-1f99-4eeb-9bf0-da58a635727c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1199 microversion: 2.1 time: 1.512282 Oct 24 10:31:18.594581 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 890/1869] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:17 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1199 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:18.776134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-02cc4a74-958e-4910-8201-73750f06dbe0 req-1ed8a8e8-fe70-44d1-bc98-e1d2bf34f180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac22625-5979-4a7b-8bbd-e0d114e62f76", "name": "network-vif-deleted", "tag": "0c6f5aab-b3a5-4a34-b31f-b771c9279d19"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:18.811025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-02cc4a74-958e-4910-8201-73750f06dbe0 req-1ed8a8e8-fe70-44d1-bc98-e1d2bf34f180 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:18.814643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-02cc4a74-958e-4910-8201-73750f06dbe0 req-1ed8a8e8-fe70-44d1-bc98-e1d2bf34f180 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:18.816456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-02cc4a74-958e-4910-8201-73750f06dbe0 req-1ed8a8e8-fe70-44d1-bc98-e1d2bf34f180 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:18.875887 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-02cc4a74-958e-4910-8201-73750f06dbe0 req-1ed8a8e8-fe70-44d1-bc98-e1d2bf34f180 service nova] Creating event network-vif-deleted:0c6f5aab-b3a5-4a34-b31f-b771c9279d19 for instance 8ac22625-5979-4a7b-8bbd-e0d114e62f76 on n-h1-858383-15 Oct 24 10:31:18.912188 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-02cc4a74-958e-4910-8201-73750f06dbe0 req-1ed8a8e8-fe70-44d1-bc98-e1d2bf34f180 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138855 Oct 24 10:31:18.918881 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 980/1870] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:31:19.167991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5d60ecc4-4c7f-495c-8f88-fe9e3087bbc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:19.168684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5d60ecc4-4c7f-495c-8f88-fe9e3087bbc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: e09308b8-ad10-4557-bb53-7bdf515bbf36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:19.187618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d60ecc4-4c7f-495c-8f88-fe9e3087bbc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:19.192335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d60ecc4-4c7f-495c-8f88-fe9e3087bbc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:19.195419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d60ecc4-4c7f-495c-8f88-fe9e3087bbc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:19.200391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d60ecc4-4c7f-495c-8f88-fe9e3087bbc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:19.201369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d60ecc4-4c7f-495c-8f88-fe9e3087bbc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:19.201823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d60ecc4-4c7f-495c-8f88-fe9e3087bbc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:19.460037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5d60ecc4-4c7f-495c-8f88-fe9e3087bbc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:19.470158 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5d60ecc4-4c7f-495c-8f88-fe9e3087bbc8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36" status: 200 len: 1266 microversion: 2.1 time: 0.308655 Oct 24 10:31:19.484223 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 891/1871] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:19 2022] GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36 => generated 1266 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:19.509161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3d264d12-8eac-4710-aa63-36d23b19f92e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:19.511005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3d264d12-8eac-4710-aa63-36d23b19f92e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:19.523205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d264d12-8eac-4710-aa63-36d23b19f92e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:19.525411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d264d12-8eac-4710-aa63-36d23b19f92e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:19.527968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d264d12-8eac-4710-aa63-36d23b19f92e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:19.528929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d264d12-8eac-4710-aa63-36d23b19f92e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:19.531089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d264d12-8eac-4710-aa63-36d23b19f92e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:19.531741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d264d12-8eac-4710-aa63-36d23b19f92e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:19.601542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6ff52690-8aa8-4b12-918a-70a958c43d30 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:19.602862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6ff52690-8aa8-4b12-918a-70a958c43d30 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:19.630050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ff52690-8aa8-4b12-918a-70a958c43d30 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:19.630554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ff52690-8aa8-4b12-918a-70a958c43d30 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:19.631272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ff52690-8aa8-4b12-918a-70a958c43d30 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:19.635915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ff52690-8aa8-4b12-918a-70a958c43d30 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:19.636419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ff52690-8aa8-4b12-918a-70a958c43d30 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:19.636899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ff52690-8aa8-4b12-918a-70a958c43d30 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:19.664919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d264d12-8eac-4710-aa63-36d23b19f92e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:19.665424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d264d12-8eac-4710-aa63-36d23b19f92e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:19.665871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d264d12-8eac-4710-aa63-36d23b19f92e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:19.666330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-3d264d12-8eac-4710-aa63-36d23b19f92e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lazy-loading 'fault' on Instance uuid 8ac22625-5979-4a7b-8bbd-e0d114e62f76 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:31:20.119154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3d264d12-8eac-4710-aa63-36d23b19f92e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94dc98cc420427a8fe6f756b82aafa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bc572680a24c869bea20693817fb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:20.143319 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3d264d12-8eac-4710-aa63-36d23b19f92e tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 200 len: 1306 microversion: 2.1 time: 0.639329 Oct 24 10:31:20.144175 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 981/1872] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:19 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 1306 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:20.384335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ff52690-8aa8-4b12-918a-70a958c43d30 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:20.396047 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6ff52690-8aa8-4b12-918a-70a958c43d30 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1199 microversion: 2.1 time: 0.798439 Oct 24 10:31:20.399763 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 892/1873] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:19 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1199 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:20.506769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cae8bda9-caa9-460b-9b01-04d75680bfe2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:20.508004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cae8bda9-caa9-460b-9b01-04d75680bfe2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: e09308b8-ad10-4557-bb53-7bdf515bbf36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:20.521071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae8bda9-caa9-460b-9b01-04d75680bfe2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:20.522173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae8bda9-caa9-460b-9b01-04d75680bfe2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:20.522808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae8bda9-caa9-460b-9b01-04d75680bfe2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:20.523712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae8bda9-caa9-460b-9b01-04d75680bfe2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:20.525051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae8bda9-caa9-460b-9b01-04d75680bfe2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:20.528918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae8bda9-caa9-460b-9b01-04d75680bfe2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:21.175217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8a73e1f1-4b7f-4562-8aba-41cc95ae089d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:21.176644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8a73e1f1-4b7f-4562-8aba-41cc95ae089d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] [instance: 8ac22625-5979-4a7b-8bbd-e0d114e62f76] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:21.191316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a73e1f1-4b7f-4562-8aba-41cc95ae089d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:21.193610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a73e1f1-4b7f-4562-8aba-41cc95ae089d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:21.194288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a73e1f1-4b7f-4562-8aba-41cc95ae089d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:21.200822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a73e1f1-4b7f-4562-8aba-41cc95ae089d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:21.201671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a73e1f1-4b7f-4562-8aba-41cc95ae089d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:21.202352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a73e1f1-4b7f-4562-8aba-41cc95ae089d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:21.230940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cae8bda9-caa9-460b-9b01-04d75680bfe2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:21.237664 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-8a73e1f1-4b7f-4562-8aba-41cc95ae089d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] HTTP exception thrown: Instance 8ac22625-5979-4a7b-8bbd-e0d114e62f76 could not be found. Oct 24 10:31:21.247471 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cae8bda9-caa9-460b-9b01-04d75680bfe2 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36" status: 200 len: 1308 microversion: 2.1 time: 0.741655 Oct 24 10:31:21.251425 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 982/1874] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:20 2022] GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36 => generated 1308 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8a73e1f1-4b7f-4562-8aba-41cc95ae089d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Request method failure captured: Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 HTTP/1.1 Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmlMSYwh7PBiMY299IfgsMlUJQr2dAtRmOigaO6vX8tyBq2Br0RRnS725fvBh8vH1xNyrGRUlK_cwmDIoSn9ZGPNjoUwAcmxzkD18UaoBxtvQ-6pShwkHzVnhgmI2cH7MlP1BIk__mIrSJReRZb4og1WwPBl1Az7x0eGaDJAsb3atNY Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: a6bc572680a24c869bea20693817fb1c Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-InstanceActionsTestJSON-878119073 Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:31:21.253933 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:31:21.255607 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6bc572680a24c869bea20693817fb1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6bc572680a24c869bea20693817fb1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a6bc572680a24c869bea20693817fb1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a6bc572680a24c869bea20693817fb1c", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:31:21.255607 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-InstanceActionsTestJSON-878119073 Oct 24 10:31:21.255607 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: a6bc572680a24c869bea20693817fb1c Oct 24 10:31:21.255607 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-InstanceActionsTestJSON-878119073 Oct 24 10:31:21.255607 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-InstanceActionsTestJSON-878119073-project Oct 24 10:31:21.255607 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:31:21.255607 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:31:21.255607 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: d94dc98cc420427a8fe6f756b82aafa1 Oct 24 10:31:21.255607 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-InstanceActionsTestJSON-878119073-project Oct 24 10:31:21.255607 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:31:21.255607 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 8ac22625-5979-4a7b-8bbd-e0d114e62f76 could not be found. Oct 24 10:31:21.255607 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '8ac22625-5979-4a7b-8bbd-e0d114e62f76'} Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac22625-5979-4a7b-8bbd-e0d114e62f76 could not be found. Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:31:21.256759 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:31:21.259384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:31:21.259384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:31:21.259384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:31:21.259384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:31:21.259384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:31:21.259384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:31:21.259384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:31:21.259384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac22625-5979-4a7b-8bbd-e0d114e62f76 could not be found. Oct 24 10:31:21.259384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:21.259384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:21.259384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:21.259384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:21.259384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:31:21.259384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:31:21.259384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:31:21.259384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:31:21.259384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac22625-5979-4a7b-8bbd-e0d114e62f76 could not be found. Oct 24 10:31:21.259384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:31:21.261974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8a73e1f1-4b7f-4562-8aba-41cc95ae089d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] Returning 404 to user: Instance 8ac22625-5979-4a7b-8bbd-e0d114e62f76 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:31:21.263078 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8a73e1f1-4b7f-4562-8aba-41cc95ae089d tempest-InstanceActionsTestJSON-878119073 tempest-InstanceActionsTestJSON-878119073-project] 10.222.0.50 "GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76" status: 404 len: 111 microversion: 2.1 time: 0.091689 Oct 24 10:31:21.268530 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 893/1875] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:21 2022] GET /compute/v2.1/servers/8ac22625-5979-4a7b-8bbd-e0d114e62f76 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:31:21.429435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b890bcc4-3d12-424c-b1c2-8671222b1c43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:21.430295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b890bcc4-3d12-424c-b1c2-8671222b1c43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:21.437934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b890bcc4-3d12-424c-b1c2-8671222b1c43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:21.450726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b890bcc4-3d12-424c-b1c2-8671222b1c43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:21.451878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b890bcc4-3d12-424c-b1c2-8671222b1c43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:21.453825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b890bcc4-3d12-424c-b1c2-8671222b1c43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:21.454760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b890bcc4-3d12-424c-b1c2-8671222b1c43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:21.456348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b890bcc4-3d12-424c-b1c2-8671222b1c43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:22.282664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9d47e5ea-09e8-4df6-a763-36b53c3d5326 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:22.283338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9d47e5ea-09e8-4df6-a763-36b53c3d5326 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: e09308b8-ad10-4557-bb53-7bdf515bbf36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:22.292371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d47e5ea-09e8-4df6-a763-36b53c3d5326 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:22.294286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d47e5ea-09e8-4df6-a763-36b53c3d5326 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:22.294914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d47e5ea-09e8-4df6-a763-36b53c3d5326 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:22.298630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d47e5ea-09e8-4df6-a763-36b53c3d5326 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:22.299326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d47e5ea-09e8-4df6-a763-36b53c3d5326 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:22.299963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d47e5ea-09e8-4df6-a763-36b53c3d5326 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:23.071136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b890bcc4-3d12-424c-b1c2-8671222b1c43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:23.108893 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b890bcc4-3d12-424c-b1c2-8671222b1c43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1383 microversion: 2.1 time: 1.674823 Oct 24 10:31:23.110609 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 983/1876] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:21 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1383 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:23.241958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9d47e5ea-09e8-4df6-a763-36b53c3d5326 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:23.251222 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9d47e5ea-09e8-4df6-a763-36b53c3d5326 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36" status: 200 len: 1308 microversion: 2.1 time: 0.973866 Oct 24 10:31:23.293584 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 894/1877] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:22 2022] GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36 => generated 1308 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:23.790820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-92636b6a-eee0-47a6-a3ac-c5b43ff685ea tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:23.791979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-92636b6a-eee0-47a6-a3ac-c5b43ff685ea tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:23.809619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92636b6a-eee0-47a6-a3ac-c5b43ff685ea tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:23.814141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92636b6a-eee0-47a6-a3ac-c5b43ff685ea tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:23.817807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92636b6a-eee0-47a6-a3ac-c5b43ff685ea tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:23.818620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92636b6a-eee0-47a6-a3ac-c5b43ff685ea tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:23.819107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92636b6a-eee0-47a6-a3ac-c5b43ff685ea tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:23.821387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92636b6a-eee0-47a6-a3ac-c5b43ff685ea tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:24.043679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e79d1534-f3af-4cb1-9637-bc191de8e059 req-c710e0ff-a11a-40cc-a24a-7400fbf14979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e09308b8-ad10-4557-bb53-7bdf515bbf36", "tag": "9267e901-eb9a-451c-a91f-fcadbd8fa2a9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:24.063127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e79d1534-f3af-4cb1-9637-bc191de8e059 req-c710e0ff-a11a-40cc-a24a-7400fbf14979 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:24.064603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e79d1534-f3af-4cb1-9637-bc191de8e059 req-c710e0ff-a11a-40cc-a24a-7400fbf14979 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:24.065347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e79d1534-f3af-4cb1-9637-bc191de8e059 req-c710e0ff-a11a-40cc-a24a-7400fbf14979 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:24.112173 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e79d1534-f3af-4cb1-9637-bc191de8e059 req-c710e0ff-a11a-40cc-a24a-7400fbf14979 service nova] Creating event network-changed:9267e901-eb9a-451c-a91f-fcadbd8fa2a9 for instance e09308b8-ad10-4557-bb53-7bdf515bbf36 on n-h2-858383-15 Oct 24 10:31:24.119489 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e79d1534-f3af-4cb1-9637-bc191de8e059 req-c710e0ff-a11a-40cc-a24a-7400fbf14979 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079912 Oct 24 10:31:24.125548 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 895/1878] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:31:24.299958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-59c97542-3c34-44c0-9fd1-47d84765df97 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:24.301584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-59c97542-3c34-44c0-9fd1-47d84765df97 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: e09308b8-ad10-4557-bb53-7bdf515bbf36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:24.304952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:24.312037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59c97542-3c34-44c0-9fd1-47d84765df97 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:24.317496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59c97542-3c34-44c0-9fd1-47d84765df97 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:24.318216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59c97542-3c34-44c0-9fd1-47d84765df97 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:24.322168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59c97542-3c34-44c0-9fd1-47d84765df97 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:24.326137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59c97542-3c34-44c0-9fd1-47d84765df97 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:24.326986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59c97542-3c34-44c0-9fd1-47d84765df97 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:24.400778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:24.792746 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-92636b6a-eee0-47a6-a3ac-c5b43ff685ea tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1536 microversion: 2.1 time: 1.631412 Oct 24 10:31:24.794611 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 984/1879] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:23 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1536 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:24.827924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6239ec1d-e615-4730-8876-aab3c1fd1ad0 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:24.828649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6239ec1d-e615-4730-8876-aab3c1fd1ad0 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:24.842972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6239ec1d-e615-4730-8876-aab3c1fd1ad0 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:24.843475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6239ec1d-e615-4730-8876-aab3c1fd1ad0 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:24.849848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6239ec1d-e615-4730-8876-aab3c1fd1ad0 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:24.851434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6239ec1d-e615-4730-8876-aab3c1fd1ad0 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:24.852157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6239ec1d-e615-4730-8876-aab3c1fd1ad0 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:24.852773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6239ec1d-e615-4730-8876-aab3c1fd1ad0 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:24.860383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:25.074141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-59c97542-3c34-44c0-9fd1-47d84765df97 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:25.082599 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-59c97542-3c34-44c0-9fd1-47d84765df97 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36" status: 200 len: 1308 microversion: 2.1 time: 0.787548 Oct 24 10:31:25.085670 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 896/1880] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:24 2022] GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36 => generated 1308 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:25.242581 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6239ec1d-e615-4730-8876-aab3c1fd1ad0 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1536 microversion: 2.1 time: 0.419405 Oct 24 10:31:25.246321 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 985/1881] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:24 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1536 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:25.277305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-04173277-d5b0-43cb-a9fe-70bab30fa598 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:25.282691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04173277-d5b0-43cb-a9fe-70bab30fa598 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:25.290268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04173277-d5b0-43cb-a9fe-70bab30fa598 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:25.292155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04173277-d5b0-43cb-a9fe-70bab30fa598 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:25.293278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04173277-d5b0-43cb-a9fe-70bab30fa598 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:25.294031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04173277-d5b0-43cb-a9fe-70bab30fa598 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:25.294763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04173277-d5b0-43cb-a9fe-70bab30fa598 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:25.357353 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-04173277-d5b0-43cb-a9fe-70bab30fa598 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.083777 Oct 24 10:31:25.365342 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 897/1882] 10.222.0.50 () {58 vars in 1176 bytes} [Mon Oct 24 10:31:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:31:25.382310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4d3be0d7-28f9-4ddf-8096-ff65a82a1c32 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-15", "block_migration": false, "disk_over_commit": false}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:25.385504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4d3be0d7-28f9-4ddf-8096-ff65a82a1c32 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:25.399796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d3be0d7-28f9-4ddf-8096-ff65a82a1c32 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:25.401231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d3be0d7-28f9-4ddf-8096-ff65a82a1c32 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:25.401882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d3be0d7-28f9-4ddf-8096-ff65a82a1c32 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:25.404270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d3be0d7-28f9-4ddf-8096-ff65a82a1c32 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:25.405591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d3be0d7-28f9-4ddf-8096-ff65a82a1c32 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:25.407786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d3be0d7-28f9-4ddf-8096-ff65a82a1c32 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:25.465838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-4d3be0d7-28f9-4ddf-8096-ff65a82a1c32 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lazy-loading 'flavor' on Instance uuid 38f4bf2a-de86-44f9-9481-b6591f1e0191 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:31:25.497020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4d3be0d7-28f9-4ddf-8096-ff65a82a1c32 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Going to try to live migrate instance to n-h2-858383-15 {{(pid=120426) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 24 10:31:26.146260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fe5751f6-87ef-4a21-ac6f-9ccd62e99869 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:26.147149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fe5751f6-87ef-4a21-ac6f-9ccd62e99869 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: e09308b8-ad10-4557-bb53-7bdf515bbf36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:26.175592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe5751f6-87ef-4a21-ac6f-9ccd62e99869 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:26.177932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe5751f6-87ef-4a21-ac6f-9ccd62e99869 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:26.179115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe5751f6-87ef-4a21-ac6f-9ccd62e99869 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:26.184508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe5751f6-87ef-4a21-ac6f-9ccd62e99869 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:26.185863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe5751f6-87ef-4a21-ac6f-9ccd62e99869 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:26.187459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe5751f6-87ef-4a21-ac6f-9ccd62e99869 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:27.474121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fe5751f6-87ef-4a21-ac6f-9ccd62e99869 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:27.487893 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fe5751f6-87ef-4a21-ac6f-9ccd62e99869 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36" status: 200 len: 1308 microversion: 2.1 time: 1.344332 Oct 24 10:31:27.489820 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 898/1883] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:26 2022] GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36 => generated 1308 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:27.501923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d9289feb-b8d5-4c8e-9b08-0bcaa34fe183 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:27.504971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d9289feb-b8d5-4c8e-9b08-0bcaa34fe183 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:27.534758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9289feb-b8d5-4c8e-9b08-0bcaa34fe183 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:27.538728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9289feb-b8d5-4c8e-9b08-0bcaa34fe183 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:27.541386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9289feb-b8d5-4c8e-9b08-0bcaa34fe183 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:27.543371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9289feb-b8d5-4c8e-9b08-0bcaa34fe183 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:27.545334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9289feb-b8d5-4c8e-9b08-0bcaa34fe183 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:27.549074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9289feb-b8d5-4c8e-9b08-0bcaa34fe183 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:28.718684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-d9289feb-b8d5-4c8e-9b08-0bcaa34fe183 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'services' on Instance uuid 07e4585f-945b-462a-aac7-5a7af22f160d {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:31:28.756647 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d9289feb-b8d5-4c8e-9b08-0bcaa34fe183 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 2422 microversion: 2.25 time: 1.265128 Oct 24 10:31:28.774987 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 899/1884] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:31:27 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 2422 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:31:28.780213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3a5e9501-5cb5-41d9-a04d-e48cd2e43561 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:28.792995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3a5e9501-5cb5-41d9-a04d-e48cd2e43561 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: e09308b8-ad10-4557-bb53-7bdf515bbf36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:28.807701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a5e9501-5cb5-41d9-a04d-e48cd2e43561 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:28.808710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a5e9501-5cb5-41d9-a04d-e48cd2e43561 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:28.809735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a5e9501-5cb5-41d9-a04d-e48cd2e43561 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:28.816747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a5e9501-5cb5-41d9-a04d-e48cd2e43561 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:28.817612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a5e9501-5cb5-41d9-a04d-e48cd2e43561 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:28.818312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a5e9501-5cb5-41d9-a04d-e48cd2e43561 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:30.187738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3a5e9501-5cb5-41d9-a04d-e48cd2e43561 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:30.206829 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3a5e9501-5cb5-41d9-a04d-e48cd2e43561 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36" status: 200 len: 1308 microversion: 2.1 time: 1.424998 Oct 24 10:31:30.211052 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 900/1885] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:28 2022] GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36 => generated 1308 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:30.248744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-719fa9f9-9338-45fe-b5aa-94903025a852 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-15", "block_migration": "auto"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:30.255657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-719fa9f9-9338-45fe-b5aa-94903025a852 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:30.284989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-719fa9f9-9338-45fe-b5aa-94903025a852 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:30.288996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-719fa9f9-9338-45fe-b5aa-94903025a852 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:30.292502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-719fa9f9-9338-45fe-b5aa-94903025a852 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:30.296077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-719fa9f9-9338-45fe-b5aa-94903025a852 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:30.299135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-719fa9f9-9338-45fe-b5aa-94903025a852 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:30.303621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-719fa9f9-9338-45fe-b5aa-94903025a852 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:30.418569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-719fa9f9-9338-45fe-b5aa-94903025a852 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'flavor' on Instance uuid 07e4585f-945b-462a-aac7-5a7af22f160d {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:31:30.472757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-719fa9f9-9338-45fe-b5aa-94903025a852 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Going to try to live migrate instance to n-h2-858383-15 {{(pid=120425) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 24 10:31:31.219583 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4d3be0d7-28f9-4ddf-8096-ff65a82a1c32 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191/action" status: 202 len: 0 microversion: 2.1 time: 5.844658 Oct 24 10:31:31.220468 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 986/1886] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:31:25 2022] POST /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191/action => generated 0 bytes in 5846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:31:31.229609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5d5d99e1-e34e-420f-957c-57b55d7ac407 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:31.231468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5d5d99e1-e34e-420f-957c-57b55d7ac407 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:31.247792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:31.267753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d5d99e1-e34e-420f-957c-57b55d7ac407 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:31.278308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d5d99e1-e34e-420f-957c-57b55d7ac407 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:31.279507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d5d99e1-e34e-420f-957c-57b55d7ac407 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:31.307634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d5d99e1-e34e-420f-957c-57b55d7ac407 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:31.312412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d5d99e1-e34e-420f-957c-57b55d7ac407 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:31.315584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d5d99e1-e34e-420f-957c-57b55d7ac407 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:32.467668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5d5d99e1-e34e-420f-957c-57b55d7ac407 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:32.478207 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5d5d99e1-e34e-420f-957c-57b55d7ac407 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1393 microversion: 2.1 time: 1.252074 Oct 24 10:31:32.496974 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 987/1887] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:31 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1393 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:31:32.503304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eda9dbe6-fdb5-4af5-b9cb-39b65300c7a0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:32.517655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-eda9dbe6-fdb5-4af5-b9cb-39b65300c7a0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: e09308b8-ad10-4557-bb53-7bdf515bbf36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:32.543836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eda9dbe6-fdb5-4af5-b9cb-39b65300c7a0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:32.544762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eda9dbe6-fdb5-4af5-b9cb-39b65300c7a0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:32.545486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eda9dbe6-fdb5-4af5-b9cb-39b65300c7a0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:32.546454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eda9dbe6-fdb5-4af5-b9cb-39b65300c7a0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:32.549237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eda9dbe6-fdb5-4af5-b9cb-39b65300c7a0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:32.549980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eda9dbe6-fdb5-4af5-b9cb-39b65300c7a0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:33.128248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-eda9dbe6-fdb5-4af5-b9cb-39b65300c7a0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:33.161981 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-eda9dbe6-fdb5-4af5-b9cb-39b65300c7a0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36" status: 200 len: 1308 microversion: 2.1 time: 0.653806 Oct 24 10:31:33.164966 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 988/1888] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:32 2022] GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36 => generated 1308 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:33.181480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-01390df9-e19e-48ce-b28e-b9df23ebc887 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:33.182649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-01390df9-e19e-48ce-b28e-b9df23ebc887 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:33.199611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01390df9-e19e-48ce-b28e-b9df23ebc887 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:33.201481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01390df9-e19e-48ce-b28e-b9df23ebc887 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:33.202820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01390df9-e19e-48ce-b28e-b9df23ebc887 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:33.205771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01390df9-e19e-48ce-b28e-b9df23ebc887 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:33.206550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01390df9-e19e-48ce-b28e-b9df23ebc887 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:33.208079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01390df9-e19e-48ce-b28e-b9df23ebc887 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:33.280928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-01390df9-e19e-48ce-b28e-b9df23ebc887 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:31:33.433446 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-01390df9-e19e-48ce-b28e-b9df23ebc887 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 204 len: 0 microversion: 2.1 time: 0.261971 Oct 24 10:31:33.434553 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 989/1889] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:31:33 2022] DELETE /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:31:33.476536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7f2e7247-16b0-495b-9b25-52c04ee92b49 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:33.478870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7f2e7247-16b0-495b-9b25-52c04ee92b49 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:33.490405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f2e7247-16b0-495b-9b25-52c04ee92b49 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:33.491352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f2e7247-16b0-495b-9b25-52c04ee92b49 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:33.492069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f2e7247-16b0-495b-9b25-52c04ee92b49 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:33.493801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f2e7247-16b0-495b-9b25-52c04ee92b49 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:33.494612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f2e7247-16b0-495b-9b25-52c04ee92b49 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:33.495306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f2e7247-16b0-495b-9b25-52c04ee92b49 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:34.236912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7f2e7247-16b0-495b-9b25-52c04ee92b49 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:34.265481 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7f2e7247-16b0-495b-9b25-52c04ee92b49 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1664 microversion: 2.1 time: 0.823686 Oct 24 10:31:34.273047 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 990/1890] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:33 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1664 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:34.304774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-148cc4c6-44d8-4025-a5f8-d2dfb974af43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:34.306004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-148cc4c6-44d8-4025-a5f8-d2dfb974af43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:34.326432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-148cc4c6-44d8-4025-a5f8-d2dfb974af43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:34.327051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-148cc4c6-44d8-4025-a5f8-d2dfb974af43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:34.327401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-148cc4c6-44d8-4025-a5f8-d2dfb974af43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:34.328155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-148cc4c6-44d8-4025-a5f8-d2dfb974af43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:34.328621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-148cc4c6-44d8-4025-a5f8-d2dfb974af43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:34.329081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-148cc4c6-44d8-4025-a5f8-d2dfb974af43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:35.161383 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-719fa9f9-9338-45fe-b5aa-94903025a852 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/action" status: 202 len: 0 microversion: 2.25 time: 4.948366 Oct 24 10:31:35.162982 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 901/1891] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Oct 24 10:31:30 2022] POST /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/action => generated 0 bytes in 4951 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:31:35.168474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-23411602-e9db-4094-9cc2-9ea35c011273 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:35.169394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-23411602-e9db-4094-9cc2-9ea35c011273 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: e09308b8-ad10-4557-bb53-7bdf515bbf36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:35.204889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23411602-e9db-4094-9cc2-9ea35c011273 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:35.206023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23411602-e9db-4094-9cc2-9ea35c011273 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:35.207048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23411602-e9db-4094-9cc2-9ea35c011273 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:35.210447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23411602-e9db-4094-9cc2-9ea35c011273 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:35.213565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23411602-e9db-4094-9cc2-9ea35c011273 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:35.215120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23411602-e9db-4094-9cc2-9ea35c011273 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:35.226468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-148cc4c6-44d8-4025-a5f8-d2dfb974af43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:35.251440 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-148cc4c6-44d8-4025-a5f8-d2dfb974af43 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1393 microversion: 2.1 time: 0.970797 Oct 24 10:31:35.260607 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 991/1892] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:34 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1393 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:35.318461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:35.812307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-23411602-e9db-4094-9cc2-9ea35c011273 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:35.817618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0f96ec22-24c9-4b4a-8907-9247b97413c9 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1174170376", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "ad9ab30d-ae02-452d-ac46-f6bad4ab50a2"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:35.822000 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-23411602-e9db-4094-9cc2-9ea35c011273 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36" status: 200 len: 1308 microversion: 2.1 time: 0.657713 Oct 24 10:31:35.826885 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 902/1893] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:35 2022] GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36 => generated 1308 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:35.846176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-50c5131c-7517-44b7-93df-9fb2b4318bef req-28db8ac5-6b1e-4d79-94fd-155ef16d3272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09308b8-ad10-4557-bb53-7bdf515bbf36", "name": "network-vif-plugged", "status": "completed", "tag": "9267e901-eb9a-451c-a91f-fcadbd8fa2a9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:35.891033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-50c5131c-7517-44b7-93df-9fb2b4318bef req-28db8ac5-6b1e-4d79-94fd-155ef16d3272 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:35.893341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-50c5131c-7517-44b7-93df-9fb2b4318bef req-28db8ac5-6b1e-4d79-94fd-155ef16d3272 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:35.895435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-50c5131c-7517-44b7-93df-9fb2b4318bef req-28db8ac5-6b1e-4d79-94fd-155ef16d3272 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:35.922870 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-50c5131c-7517-44b7-93df-9fb2b4318bef req-28db8ac5-6b1e-4d79-94fd-155ef16d3272 service nova] Creating event network-vif-plugged:9267e901-eb9a-451c-a91f-fcadbd8fa2a9 for instance e09308b8-ad10-4557-bb53-7bdf515bbf36 on n-h2-858383-15 Oct 24 10:31:35.928402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-0f96ec22-24c9-4b4a-8907-9247b97413c9 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] validate_networks() for [('ad9ab30d-ae02-452d-ac46-f6bad4ab50a2', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:31:35.937858 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-50c5131c-7517-44b7-93df-9fb2b4318bef req-28db8ac5-6b1e-4d79-94fd-155ef16d3272 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107735 Oct 24 10:31:35.946763 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 903/1894] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:31:35.960560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5c64b72d-f27c-4a6e-89dd-7b828f0c49f4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:35.966359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c64b72d-f27c-4a6e-89dd-7b828f0c49f4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:35.991908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c64b72d-f27c-4a6e-89dd-7b828f0c49f4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:35.998693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c64b72d-f27c-4a6e-89dd-7b828f0c49f4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:36.000164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c64b72d-f27c-4a6e-89dd-7b828f0c49f4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:36.002230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c64b72d-f27c-4a6e-89dd-7b828f0c49f4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:36.005438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c64b72d-f27c-4a6e-89dd-7b828f0c49f4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:36.008156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c64b72d-f27c-4a6e-89dd-7b828f0c49f4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:36.808812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5c64b72d-f27c-4a6e-89dd-7b828f0c49f4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:36.819441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5c64b72d-f27c-4a6e-89dd-7b828f0c49f4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:36.827291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5c64b72d-f27c-4a6e-89dd-7b828f0c49f4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:36.828531 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5c64b72d-f27c-4a6e-89dd-7b828f0c49f4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.879748 Oct 24 10:31:36.841978 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 904/1895] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:31:35 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:31:36.879101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-71b1b634-a50a-4c8b-a65c-b44b3de5d4a4 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:36.879644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-71b1b634-a50a-4c8b-a65c-b44b3de5d4a4 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:36.908542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71b1b634-a50a-4c8b-a65c-b44b3de5d4a4 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:36.909085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71b1b634-a50a-4c8b-a65c-b44b3de5d4a4 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:36.909539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71b1b634-a50a-4c8b-a65c-b44b3de5d4a4 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:36.910268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71b1b634-a50a-4c8b-a65c-b44b3de5d4a4 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:36.910737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71b1b634-a50a-4c8b-a65c-b44b3de5d4a4 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:36.917084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71b1b634-a50a-4c8b-a65c-b44b3de5d4a4 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:37.919116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-71b1b634-a50a-4c8b-a65c-b44b3de5d4a4 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f2788374fc24904a24a485432028c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f78b0d6e2588499b8daf4607043f892d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:37.932682 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-71b1b634-a50a-4c8b-a65c-b44b3de5d4a4 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 200 len: 1597 microversion: 2.1 time: 1.077343 Oct 24 10:31:37.936607 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 905/1896] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:36 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 1597 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:37.950053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6c43b3a2-d4c7-4827-ae07-baadd2ef6d66 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:37.952390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6c43b3a2-d4c7-4827-ae07-baadd2ef6d66 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:37.964440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c43b3a2-d4c7-4827-ae07-baadd2ef6d66 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:37.971923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c43b3a2-d4c7-4827-ae07-baadd2ef6d66 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:37.972952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c43b3a2-d4c7-4827-ae07-baadd2ef6d66 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:37.975803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c43b3a2-d4c7-4827-ae07-baadd2ef6d66 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:37.976571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c43b3a2-d4c7-4827-ae07-baadd2ef6d66 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:37.979701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c43b3a2-d4c7-4827-ae07-baadd2ef6d66 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:38.337951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6c43b3a2-d4c7-4827-ae07-baadd2ef6d66 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:38.351794 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6c43b3a2-d4c7-4827-ae07-baadd2ef6d66 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1393 microversion: 2.1 time: 0.413709 Oct 24 10:31:38.354383 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 906/1897] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:37 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1393 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:38.531032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0f96ec22-24c9-4b4a-8907-9247b97413c9 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:31:38.532270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0f96ec22-24c9-4b4a-8907-9247b97413c9 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:31:38.532945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0f96ec22-24c9-4b4a-8907-9247b97413c9 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:31:38.533876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0f96ec22-24c9-4b4a-8907-9247b97413c9 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:31:38.534451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0f96ec22-24c9-4b4a-8907-9247b97413c9 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:31:38.568351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f96ec22-24c9-4b4a-8907-9247b97413c9 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:38.575950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f96ec22-24c9-4b4a-8907-9247b97413c9 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:38.576752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f96ec22-24c9-4b4a-8907-9247b97413c9 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:38.580799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f96ec22-24c9-4b4a-8907-9247b97413c9 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:38.581775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f96ec22-24c9-4b4a-8907-9247b97413c9 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:38.583142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f96ec22-24c9-4b4a-8907-9247b97413c9 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:38.700916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1284e012-f6d3-405c-9ca6-a47bf800b8d6 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Action: 'create', calling method: .version_select at 0x7f04d0b35f70>, body: {"keypair": {"name": "tempest-keypair-454012539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCU3hjzCyS34g387tslo05FI2deyuTl7vVRwzZobnAxIMzVnuljvsBkrHUqFjyL9O+Jnhlbu2iYEgrqoEF14N7PGsD0H5J1w51maeYiXiXnhDpzarKuQ946YPS2pJhBfHA=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:38.765981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-1284e012-f6d3-405c-9ca6-a47bf800b8d6 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Getting quotas for project db7036c053ec42a98e784dbdc396c532. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:31:38.802860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-1284e012-f6d3-405c-9ca6-a47bf800b8d6 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Getting quotas for user 001a2dd2081241c397719005e1d52eec and project db7036c053ec42a98e784dbdc396c532. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:31:38.909069 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1284e012-f6d3-405c-9ca6-a47bf800b8d6 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.554010 Oct 24 10:31:38.933585 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 907/1898] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:31:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:31:38.959558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0794f67d-616f-498b-a3af-8757f56309d6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:38.963380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0794f67d-616f-498b-a3af-8757f56309d6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: e09308b8-ad10-4557-bb53-7bdf515bbf36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:39.009758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0794f67d-616f-498b-a3af-8757f56309d6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:39.012239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0794f67d-616f-498b-a3af-8757f56309d6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:39.014481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0794f67d-616f-498b-a3af-8757f56309d6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:39.018569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0794f67d-616f-498b-a3af-8757f56309d6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:39.022684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0794f67d-616f-498b-a3af-8757f56309d6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:39.031991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0794f67d-616f-498b-a3af-8757f56309d6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:39.557713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-0f96ec22-24c9-4b4a-8907-9247b97413c9 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Getting quotas for project d3f5d94906264801ab259b0ead015b1a. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:31:39.575448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-0f96ec22-24c9-4b4a-8907-9247b97413c9 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Getting quotas for user 28a812a01cad4d2c9fd471279399dd42 and project d3f5d94906264801ab259b0ead015b1a. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:31:39.606704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0f96ec22-24c9-4b4a-8907-9247b97413c9 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:31:39.620724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0f96ec22-24c9-4b4a-8907-9247b97413c9 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] [instance: 1c6b6d52-2b71-42de-8866-e53346845e72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:31:39.639725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0794f67d-616f-498b-a3af-8757f56309d6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:39.655700 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0794f67d-616f-498b-a3af-8757f56309d6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36" status: 200 len: 1488 microversion: 2.1 time: 0.718274 Oct 24 10:31:39.661448 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 908/1899] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:38 2022] GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36 => generated 1488 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:39.674332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c0f08ce3-66e6-4eef-b879-241634f11c1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:39.683456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c0f08ce3-66e6-4eef-b879-241634f11c1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:39.707031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0f08ce3-66e6-4eef-b879-241634f11c1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:39.717594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0f08ce3-66e6-4eef-b879-241634f11c1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:39.720877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0f08ce3-66e6-4eef-b879-241634f11c1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:39.721832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0f08ce3-66e6-4eef-b879-241634f11c1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:39.728405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0f08ce3-66e6-4eef-b879-241634f11c1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:39.729528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0f08ce3-66e6-4eef-b879-241634f11c1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:39.871300 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0f96ec22-24c9-4b4a-8907-9247b97413c9 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.605692 Oct 24 10:31:39.882364 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 992/1900] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:31:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 4620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:31:39.898304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-86bfdf62-d2bb-4dae-9232-6985d6c61a18 req-77fc7962-a1ac-4f69-9d53-ece48a7b0e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef7f7bd1-dcd0-4160-8198-be769a65429b", "name": "network-vif-deleted", "tag": "c414991e-9fff-46ec-b95d-4a6da09466df"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:39.929833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-86bfdf62-d2bb-4dae-9232-6985d6c61a18 req-77fc7962-a1ac-4f69-9d53-ece48a7b0e34 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:39.930993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-86bfdf62-d2bb-4dae-9232-6985d6c61a18 req-77fc7962-a1ac-4f69-9d53-ece48a7b0e34 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:39.931435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-86bfdf62-d2bb-4dae-9232-6985d6c61a18 req-77fc7962-a1ac-4f69-9d53-ece48a7b0e34 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:39.952661 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-86bfdf62-d2bb-4dae-9232-6985d6c61a18 req-77fc7962-a1ac-4f69-9d53-ece48a7b0e34 service nova] Creating event network-vif-deleted:c414991e-9fff-46ec-b95d-4a6da09466df for instance ef7f7bd1-dcd0-4160-8198-be769a65429b on n-h1-858383-15 Oct 24 10:31:39.959009 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-86bfdf62-d2bb-4dae-9232-6985d6c61a18 req-77fc7962-a1ac-4f69-9d53-ece48a7b0e34 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072919 Oct 24 10:31:39.960909 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 993/1901] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:31:39.968135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-219c03e6-2267-486c-905a-080e7b1aab67 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:39.969138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-219c03e6-2267-486c-905a-080e7b1aab67 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] [instance: ef7f7bd1-dcd0-4160-8198-be769a65429b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:39.981012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-219c03e6-2267-486c-905a-080e7b1aab67 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:39.982107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-219c03e6-2267-486c-905a-080e7b1aab67 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:39.983139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-219c03e6-2267-486c-905a-080e7b1aab67 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:39.984977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-219c03e6-2267-486c-905a-080e7b1aab67 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:39.986131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-219c03e6-2267-486c-905a-080e7b1aab67 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:39.986731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-219c03e6-2267-486c-905a-080e7b1aab67 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:39.993682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:40.014923 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-219c03e6-2267-486c-905a-080e7b1aab67 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] HTTP exception thrown: Instance ef7f7bd1-dcd0-4160-8198-be769a65429b could not be found. Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-219c03e6-2267-486c-905a-080e7b1aab67 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Request method failure captured: Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b HTTP/1.1 Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmkR4TDsR8oT7dHSc2o9tE4FZIr0ZBygrEOOexLo_mbjwZff0f1I06iS_5ZQSbgFNubbSsftk-U4t75XPIM_BONxAsYKuLGZQzHX8AOQ53N3srWpxsaKLJDF6MzV3cw3zNrUy2Do9gQ7jpumfGMkWoL88BZKsUZwT4wNk6AfXxKPLqo Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: f78b0d6e2588499b8daf4607043f892d Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersTestFqdnHostnames-1748111621 Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:31:40.017217 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:31:40.019343 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f78b0d6e2588499b8daf4607043f892d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f78b0d6e2588499b8daf4607043f892d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f78b0d6e2588499b8daf4607043f892d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f78b0d6e2588499b8daf4607043f892d", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:31:40.019343 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersTestFqdnHostnames-1748111621 Oct 24 10:31:40.019343 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: f78b0d6e2588499b8daf4607043f892d Oct 24 10:31:40.019343 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1748111621 Oct 24 10:31:40.019343 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersTestFqdnHostnames-1748111621-project Oct 24 10:31:40.019343 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:31:40.019343 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:31:40.019343 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 6f2788374fc24904a24a485432028c17 Oct 24 10:31:40.019343 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersTestFqdnHostnames-1748111621-project Oct 24 10:31:40.019343 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:31:40.019343 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance ef7f7bd1-dcd0-4160-8198-be769a65429b could not be found. Oct 24 10:31:40.019343 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'ef7f7bd1-dcd0-4160-8198-be769a65429b'} Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef7f7bd1-dcd0-4160-8198-be769a65429b could not be found. Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:31:40.020641 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:31:40.022939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:31:40.022939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:31:40.022939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:31:40.022939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:31:40.022939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:31:40.022939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:31:40.022939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:31:40.022939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef7f7bd1-dcd0-4160-8198-be769a65429b could not be found. Oct 24 10:31:40.022939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:40.022939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:31:40.022939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:40.022939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:31:40.022939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:31:40.022939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:31:40.022939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:31:40.022939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:31:40.022939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef7f7bd1-dcd0-4160-8198-be769a65429b could not be found. Oct 24 10:31:40.022939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:31:40.030690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-219c03e6-2267-486c-905a-080e7b1aab67 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Returning 404 to user: Instance ef7f7bd1-dcd0-4160-8198-be769a65429b could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:31:40.032621 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-219c03e6-2267-486c-905a-080e7b1aab67 tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b" status: 404 len: 111 microversion: 2.1 time: 0.069798 Oct 24 10:31:40.033400 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 994/1902] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:39 2022] GET /compute/v2.1/servers/ef7f7bd1-dcd0-4160-8198-be769a65429b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:31:40.038658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-574d2f6f-f7b9-4e52-a32f-1ed0657b4f69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:40.039514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-574d2f6f-f7b9-4e52-a32f-1ed0657b4f69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:40.048715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-574d2f6f-f7b9-4e52-a32f-1ed0657b4f69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:40.049517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-574d2f6f-f7b9-4e52-a32f-1ed0657b4f69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:40.050240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-574d2f6f-f7b9-4e52-a32f-1ed0657b4f69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:40.051169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-574d2f6f-f7b9-4e52-a32f-1ed0657b4f69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:40.051784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-574d2f6f-f7b9-4e52-a32f-1ed0657b4f69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:40.052478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-574d2f6f-f7b9-4e52-a32f-1ed0657b4f69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:40.726235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0f08ce3-66e6-4eef-b879-241634f11c1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:40.759723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0f08ce3-66e6-4eef-b879-241634f11c1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:40.763494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0f08ce3-66e6-4eef-b879-241634f11c1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:40.780706 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c0f08ce3-66e6-4eef-b879-241634f11c1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 1.117184 Oct 24 10:31:40.785664 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 909/1903] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:31:39 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:31:40.823418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-574d2f6f-f7b9-4e52-a32f-1ed0657b4f69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:40.837984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ea5b8f77-72f4-40e5-9eec-29921dcb5e93 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-453749328"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:40.843905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ea5b8f77-72f4-40e5-9eec-29921dcb5e93 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: e09308b8-ad10-4557-bb53-7bdf515bbf36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:40.853452 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-574d2f6f-f7b9-4e52-a32f-1ed0657b4f69 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1393 microversion: 2.1 time: 0.818091 Oct 24 10:31:40.862272 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 995/1904] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:40 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1393 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:40.862948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea5b8f77-72f4-40e5-9eec-29921dcb5e93 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:40.864105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea5b8f77-72f4-40e5-9eec-29921dcb5e93 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:40.865319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea5b8f77-72f4-40e5-9eec-29921dcb5e93 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:40.867807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea5b8f77-72f4-40e5-9eec-29921dcb5e93 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:40.871252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea5b8f77-72f4-40e5-9eec-29921dcb5e93 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:40.871992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea5b8f77-72f4-40e5-9eec-29921dcb5e93 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:40.890869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c88c14ca-d465-4a7c-a01e-f894cf36488a tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:40.898927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c88c14ca-d465-4a7c-a01e-f894cf36488a tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] [instance: 1c6b6d52-2b71-42de-8866-e53346845e72] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:41.101462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c88c14ca-d465-4a7c-a01e-f894cf36488a tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a812a01cad4d2c9fd471279399dd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f5d94906264801ab259b0ead015b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:41.110835 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c88c14ca-d465-4a7c-a01e-f894cf36488a tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] 10.222.0.50 "GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72" status: 200 len: 1216 microversion: 2.1 time: 0.244734 Oct 24 10:31:41.115939 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 996/1905] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:40 2022] GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72 => generated 1216 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:41.126919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-70d6fc52-2ca3-4e79-b3a1-ac949dedadec tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] Calling method '.version_select at 0x7f04d06afd30>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:41.197909 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-70d6fc52-2ca3-4e79-b3a1-ac949dedadec tempest-ServersTestFqdnHostnames-1748111621 tempest-ServersTestFqdnHostnames-1748111621-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-291368310" status: 202 len: 0 microversion: 2.1 time: 0.080547 Oct 24 10:31:41.199107 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 997/1906] 10.222.0.50 () {58 vars in 1218 bytes} [Mon Oct 24 10:31:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-291368310 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:31:41.553087 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ea5b8f77-72f4-40e5-9eec-29921dcb5e93 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "POST /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36/action" status: 202 len: 0 microversion: 2.1 time: 0.736380 Oct 24 10:31:41.554127 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 910/1907] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:31:40 2022] POST /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36/action => generated 0 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 10:31:41.565293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8d8de722-0c80-4957-bd75-dd117a6ed917 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d05afca0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:41.668944 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8d8de722-0c80-4957-bd75-dd117a6ed917 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a" status: 200 len: 1413 microversion: 2.1 time: 0.107299 Oct 24 10:31:41.669657 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 998/1908] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:31:41 2022] GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:31:41.815857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b9900368-68f1-4c66-8bd7-c2ef0c328b8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:41.816562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b9900368-68f1-4c66-8bd7-c2ef0c328b8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:41.829967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:41.837600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9900368-68f1-4c66-8bd7-c2ef0c328b8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:41.838350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9900368-68f1-4c66-8bd7-c2ef0c328b8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:41.840197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9900368-68f1-4c66-8bd7-c2ef0c328b8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:41.846338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9900368-68f1-4c66-8bd7-c2ef0c328b8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:41.846969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9900368-68f1-4c66-8bd7-c2ef0c328b8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:41.848893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9900368-68f1-4c66-8bd7-c2ef0c328b8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:41.880472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2e6cdc32-fb12-4707-ad40-d70bd4ab4e51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:41.881232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2e6cdc32-fb12-4707-ad40-d70bd4ab4e51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:41.903357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e6cdc32-fb12-4707-ad40-d70bd4ab4e51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:41.910749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e6cdc32-fb12-4707-ad40-d70bd4ab4e51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:41.913789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e6cdc32-fb12-4707-ad40-d70bd4ab4e51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:41.918170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e6cdc32-fb12-4707-ad40-d70bd4ab4e51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:41.919663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e6cdc32-fb12-4707-ad40-d70bd4ab4e51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:41.932994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e6cdc32-fb12-4707-ad40-d70bd4ab4e51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:41.999190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:43.418819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9900368-68f1-4c66-8bd7-c2ef0c328b8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:43.438205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9900368-68f1-4c66-8bd7-c2ef0c328b8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:43.440109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9900368-68f1-4c66-8bd7-c2ef0c328b8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:43.442306 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b9900368-68f1-4c66-8bd7-c2ef0c328b8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 1.631704 Oct 24 10:31:43.444961 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 911/1909] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:31:41 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:31:43.454599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cca410fb-4235-4ebe-acfb-4547ca4aab72 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:43.461463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cca410fb-4235-4ebe-acfb-4547ca4aab72 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] [instance: 1c6b6d52-2b71-42de-8866-e53346845e72] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:43.475493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cca410fb-4235-4ebe-acfb-4547ca4aab72 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:43.476005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cca410fb-4235-4ebe-acfb-4547ca4aab72 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:43.476427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cca410fb-4235-4ebe-acfb-4547ca4aab72 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:43.480711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cca410fb-4235-4ebe-acfb-4547ca4aab72 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:43.483017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cca410fb-4235-4ebe-acfb-4547ca4aab72 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:43.483656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cca410fb-4235-4ebe-acfb-4547ca4aab72 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:43.497407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2e6cdc32-fb12-4707-ad40-d70bd4ab4e51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:43.508419 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2e6cdc32-fb12-4707-ad40-d70bd4ab4e51 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1393 microversion: 2.1 time: 1.632245 Oct 24 10:31:43.517651 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 999/1910] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:41 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1393 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:43.541043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ec1596a7-a95f-4c52-8689-c4c0ff78001e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0556430>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:43.614629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cca410fb-4235-4ebe-acfb-4547ca4aab72 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a812a01cad4d2c9fd471279399dd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f5d94906264801ab259b0ead015b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:43.629263 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cca410fb-4235-4ebe-acfb-4547ca4aab72 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] 10.222.0.50 "GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72" status: 200 len: 1274 microversion: 2.1 time: 0.181404 Oct 24 10:31:43.631334 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 912/1911] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:43 2022] GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72 => generated 1274 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:43.673925 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ec1596a7-a95f-4c52-8689-c4c0ff78001e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a" status: 200 len: 1413 microversion: 2.1 time: 0.154852 Oct 24 10:31:43.683605 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1000/1912] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:31:43 2022] GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a => generated 1413 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:44.471789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3910b405-5eb2-43d8-bad7-992bddcc6800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:44.473199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3910b405-5eb2-43d8-bad7-992bddcc6800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:44.499857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3910b405-5eb2-43d8-bad7-992bddcc6800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:44.501451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3910b405-5eb2-43d8-bad7-992bddcc6800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:44.504381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3910b405-5eb2-43d8-bad7-992bddcc6800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:44.505599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3910b405-5eb2-43d8-bad7-992bddcc6800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:44.508235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3910b405-5eb2-43d8-bad7-992bddcc6800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:44.513947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3910b405-5eb2-43d8-bad7-992bddcc6800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:44.545490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fda5e28e-8fd5-432e-a4f6-c400f014a6af tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:44.547646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fda5e28e-8fd5-432e-a4f6-c400f014a6af tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:44.564234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fda5e28e-8fd5-432e-a4f6-c400f014a6af tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:44.565198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fda5e28e-8fd5-432e-a4f6-c400f014a6af tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:44.566618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fda5e28e-8fd5-432e-a4f6-c400f014a6af tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:44.567617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fda5e28e-8fd5-432e-a4f6-c400f014a6af tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:44.569264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fda5e28e-8fd5-432e-a4f6-c400f014a6af tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:44.574180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fda5e28e-8fd5-432e-a4f6-c400f014a6af tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:45.131639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3910b405-5eb2-43d8-bad7-992bddcc6800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:45.162520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3910b405-5eb2-43d8-bad7-992bddcc6800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:45.179053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3910b405-5eb2-43d8-bad7-992bddcc6800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:45.186096 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3910b405-5eb2-43d8-bad7-992bddcc6800 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.717431 Oct 24 10:31:45.198034 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 913/1913] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:31:44 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:31:45.230553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00a9cb60-4d1f-42aa-84e8-aae61c3c1e51 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:45.231636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00a9cb60-4d1f-42aa-84e8-aae61c3c1e51 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] [instance: 1c6b6d52-2b71-42de-8866-e53346845e72] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:45.238834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00a9cb60-4d1f-42aa-84e8-aae61c3c1e51 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:45.239852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00a9cb60-4d1f-42aa-84e8-aae61c3c1e51 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:45.240791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00a9cb60-4d1f-42aa-84e8-aae61c3c1e51 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:45.242118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00a9cb60-4d1f-42aa-84e8-aae61c3c1e51 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:45.243186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00a9cb60-4d1f-42aa-84e8-aae61c3c1e51 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:45.244043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00a9cb60-4d1f-42aa-84e8-aae61c3c1e51 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:45.576774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-00a9cb60-4d1f-42aa-84e8-aae61c3c1e51 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a812a01cad4d2c9fd471279399dd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f5d94906264801ab259b0ead015b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:45.587516 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-00a9cb60-4d1f-42aa-84e8-aae61c3c1e51 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] 10.222.0.50 "GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72" status: 200 len: 1274 microversion: 2.1 time: 0.371309 Oct 24 10:31:45.593345 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 914/1914] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:45 2022] GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72 => generated 1274 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:45.619989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d31417df-9060-4b88-88f4-afe80c2b18ee tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d5005af0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:45.763227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fda5e28e-8fd5-432e-a4f6-c400f014a6af tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:45.784121 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fda5e28e-8fd5-432e-a4f6-c400f014a6af tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1393 microversion: 2.1 time: 1.243073 Oct 24 10:31:45.790670 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1001/1915] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:44 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1393 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:31:45.933543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a357308e-ce5a-4d3f-b9b5-a12608ebc24b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-220137198", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "edd81caa-e7a0-4a5c-8a00-b4009b337655"}], "security_groups": [{"name": "tempest-securitygroup--165623224"}], "key_name": "tempest-keypair-454012539", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:48.843535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:49.492742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:51.110774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=8 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:55.238949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=7 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:55.582315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=20 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:55.792762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=18 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:56.014683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:31:57.560913 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d31417df-9060-4b88-88f4-afe80c2b18ee tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a" status: 200 len: 1413 microversion: 2.1 time: 11.961342 Oct 24 10:31:57.562159 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 915/1916] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:31:45 2022] GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a => generated 1413 bytes in 11968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:57.567737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a0db85c6-daba-479a-b2e5-e3e9c89adf56 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:57.568886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a0db85c6-daba-479a-b2e5-e3e9c89adf56 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:57.577225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0db85c6-daba-479a-b2e5-e3e9c89adf56 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:57.577975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0db85c6-daba-479a-b2e5-e3e9c89adf56 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:57.578760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0db85c6-daba-479a-b2e5-e3e9c89adf56 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:57.581266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0db85c6-daba-479a-b2e5-e3e9c89adf56 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:57.583551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0db85c6-daba-479a-b2e5-e3e9c89adf56 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:57.588309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0db85c6-daba-479a-b2e5-e3e9c89adf56 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:57.969789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-a357308e-ce5a-4d3f-b9b5-a12608ebc24b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] validate_networks() for [('edd81caa-e7a0-4a5c-8a00-b4009b337655', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:31:58.445966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a0db85c6-daba-479a-b2e5-e3e9c89adf56 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:58.482623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a0db85c6-daba-479a-b2e5-e3e9c89adf56 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:58.487420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a0db85c6-daba-479a-b2e5-e3e9c89adf56 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:58.492131 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a0db85c6-daba-479a-b2e5-e3e9c89adf56 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.928063 Oct 24 10:31:58.494109 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 916/1917] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:31:57 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:31:58.504426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3326e132-0ab3-489a-afa3-800661e4673f tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:58.510122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3326e132-0ab3-489a-afa3-800661e4673f tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] [instance: 1c6b6d52-2b71-42de-8866-e53346845e72] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:58.527972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3326e132-0ab3-489a-afa3-800661e4673f tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:58.528510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3326e132-0ab3-489a-afa3-800661e4673f tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:58.529007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3326e132-0ab3-489a-afa3-800661e4673f tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:58.533352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3326e132-0ab3-489a-afa3-800661e4673f tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:58.533892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3326e132-0ab3-489a-afa3-800661e4673f tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:58.534351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3326e132-0ab3-489a-afa3-800661e4673f tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:58.935404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3326e132-0ab3-489a-afa3-800661e4673f tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a812a01cad4d2c9fd471279399dd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f5d94906264801ab259b0ead015b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:58.961580 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3326e132-0ab3-489a-afa3-800661e4673f tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] 10.222.0.50 "GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72" status: 200 len: 1316 microversion: 2.1 time: 0.461555 Oct 24 10:31:58.964405 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 917/1918] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:58 2022] GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72 => generated 1316 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:58.970435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d48874b1-193d-4ef9-91f6-02aad8175f10 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:31:58.971782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d48874b1-193d-4ef9-91f6-02aad8175f10 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:31:58.984662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d48874b1-193d-4ef9-91f6-02aad8175f10 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:58.985506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d48874b1-193d-4ef9-91f6-02aad8175f10 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:58.986165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d48874b1-193d-4ef9-91f6-02aad8175f10 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:58.986876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a357308e-ce5a-4d3f-b9b5-a12608ebc24b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:31:58.987496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a357308e-ce5a-4d3f-b9b5-a12608ebc24b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:31:58.987854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a357308e-ce5a-4d3f-b9b5-a12608ebc24b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:31:58.988101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d48874b1-193d-4ef9-91f6-02aad8175f10 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:58.988245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a357308e-ce5a-4d3f-b9b5-a12608ebc24b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:31:58.988669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a357308e-ce5a-4d3f-b9b5-a12608ebc24b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:31:58.989117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d48874b1-193d-4ef9-91f6-02aad8175f10 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:58.989746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d48874b1-193d-4ef9-91f6-02aad8175f10 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:59.015808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a357308e-ce5a-4d3f-b9b5-a12608ebc24b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:59.016319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a357308e-ce5a-4d3f-b9b5-a12608ebc24b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:59.021488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a357308e-ce5a-4d3f-b9b5-a12608ebc24b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:59.022318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a357308e-ce5a-4d3f-b9b5-a12608ebc24b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:59.022797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a357308e-ce5a-4d3f-b9b5-a12608ebc24b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:59.023242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a357308e-ce5a-4d3f-b9b5-a12608ebc24b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:59.062821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-a357308e-ce5a-4d3f-b9b5-a12608ebc24b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Getting quotas for project db7036c053ec42a98e784dbdc396c532. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:31:59.082314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-a357308e-ce5a-4d3f-b9b5-a12608ebc24b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Getting quotas for user 001a2dd2081241c397719005e1d52eec and project db7036c053ec42a98e784dbdc396c532. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:31:59.131676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a357308e-ce5a-4d3f-b9b5-a12608ebc24b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:31:59.138320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a357308e-ce5a-4d3f-b9b5-a12608ebc24b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:31:59.271045 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a357308e-ce5a-4d3f-b9b5-a12608ebc24b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 13.342598 Oct 24 10:31:59.275256 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1002/1919] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:31:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 13347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:31:59.290350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-952ce443-3869-4fde-9f6f-ed1c07c5ea4d req-16f12b5c-67a8-4a22-808f-f5a0158c3474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09308b8-ad10-4557-bb53-7bdf515bbf36", "name": "network-vif-plugged", "status": "completed", "tag": "9267e901-eb9a-451c-a91f-fcadbd8fa2a9"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:59.309462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-952ce443-3869-4fde-9f6f-ed1c07c5ea4d req-16f12b5c-67a8-4a22-808f-f5a0158c3474 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:59.310477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-952ce443-3869-4fde-9f6f-ed1c07c5ea4d req-16f12b5c-67a8-4a22-808f-f5a0158c3474 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:59.311539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-952ce443-3869-4fde-9f6f-ed1c07c5ea4d req-16f12b5c-67a8-4a22-808f-f5a0158c3474 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:59.335676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d48874b1-193d-4ef9-91f6-02aad8175f10 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:31:59.358892 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d48874b1-193d-4ef9-91f6-02aad8175f10 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1393 microversion: 2.1 time: 0.393041 Oct 24 10:31:59.360222 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 918/1920] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:31:58 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1393 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:31:59.372524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-af5c8ec0-e60c-4d76-b30f-78cbfd00b184 req-63a3a269-4e0b-46d9-a84e-00d89811f116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c6b6d52-2b71-42de-8866-e53346845e72", "tag": "75ac6ad5-6c3b-44b5-b980-dc05207dc3d5"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:59.377469 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-952ce443-3869-4fde-9f6f-ed1c07c5ea4d req-16f12b5c-67a8-4a22-808f-f5a0158c3474 service nova] Creating event network-vif-plugged:9267e901-eb9a-451c-a91f-fcadbd8fa2a9 for instance e09308b8-ad10-4557-bb53-7bdf515bbf36 on n-h2-858383-15 Oct 24 10:31:59.387037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-af5c8ec0-e60c-4d76-b30f-78cbfd00b184 req-63a3a269-4e0b-46d9-a84e-00d89811f116 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:31:59.387531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-af5c8ec0-e60c-4d76-b30f-78cbfd00b184 req-63a3a269-4e0b-46d9-a84e-00d89811f116 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:31:59.387965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-af5c8ec0-e60c-4d76-b30f-78cbfd00b184 req-63a3a269-4e0b-46d9-a84e-00d89811f116 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:31:59.389018 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-952ce443-3869-4fde-9f6f-ed1c07c5ea4d req-16f12b5c-67a8-4a22-808f-f5a0158c3474 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110744 Oct 24 10:31:59.391038 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1003/1921] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:31:59.400704 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-af5c8ec0-e60c-4d76-b30f-78cbfd00b184 req-63a3a269-4e0b-46d9-a84e-00d89811f116 service nova] Creating event network-changed:75ac6ad5-6c3b-44b5-b980-dc05207dc3d5 for instance 1c6b6d52-2b71-42de-8866-e53346845e72 on n-h2-858383-15 Oct 24 10:31:59.408590 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-af5c8ec0-e60c-4d76-b30f-78cbfd00b184 req-63a3a269-4e0b-46d9-a84e-00d89811f116 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046121 Oct 24 10:31:59.410054 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 919/1922] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:31:59.819109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-73c20573-5a4c-438e-a16a-579e8c9217c3 tempest-ServerGroup264TestJSON-229046103 tempest-ServerGroup264TestJSON-229046103-project] Action: 'create', calling method: .version_select at 0x7f04d059d940>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:31:59.855861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-73c20573-5a4c-438e-a16a-579e8c9217c3 tempest-ServerGroup264TestJSON-229046103 tempest-ServerGroup264TestJSON-229046103-project] Getting quotas for project df2d39554e2e4591b1ec035ab47bbf58. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:31:59.863653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-73c20573-5a4c-438e-a16a-579e8c9217c3 tempest-ServerGroup264TestJSON-229046103 tempest-ServerGroup264TestJSON-229046103-project] Getting quotas for user 62e8561bb12e48388d5326c6ce3fd065 and project df2d39554e2e4591b1ec035ab47bbf58. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:31:59.923699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-73c20573-5a4c-438e-a16a-579e8c9217c3 tempest-ServerGroup264TestJSON-229046103 tempest-ServerGroup264TestJSON-229046103-project] Getting quotas for project df2d39554e2e4591b1ec035ab47bbf58. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:31:59.952607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-73c20573-5a4c-438e-a16a-579e8c9217c3 tempest-ServerGroup264TestJSON-229046103 tempest-ServerGroup264TestJSON-229046103-project] Getting quotas for user 62e8561bb12e48388d5326c6ce3fd065 and project df2d39554e2e4591b1ec035ab47bbf58. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:31:59.996823 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-73c20573-5a4c-438e-a16a-579e8c9217c3 tempest-ServerGroup264TestJSON-229046103 tempest-ServerGroup264TestJSON-229046103-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.594594 Oct 24 10:32:00.012001 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1004/1923] 10.222.0.50 () {62 vars in 1214 bytes} [Mon Oct 24 10:31:59 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:32:00.019265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9a76bb9d-4e28-49cb-8afe-0921927e38e0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d059d1f0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:00.040511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ae879dba-ce9e-4e07-8eab-929e97afad59 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Action: 'create', calling method: .version_select at 0x7f04d0a3a280>, body: {"keypair": {"name": "tempest-keypair-2116530247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsbGS404mEDeoWn6roTLGh9so+duW21/xqngIb+bRrUN+Ml+I9xlu3/h4vrmE42PLqdsUwbQbAdeBSIXKHSicLJpCd98KsICiu8ffi0SYFP6+tvoSTTS+/zF2KcYvPl0Q=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:00.143704 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9a76bb9d-4e28-49cb-8afe-0921927e38e0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a" status: 200 len: 1413 microversion: 2.1 time: 0.129990 Oct 24 10:32:00.151296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ae879dba-ce9e-4e07-8eab-929e97afad59 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Getting quotas for project 37320b68ea0d4d8ab38ba0cd4a3f3f55. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:32:00.152928 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1005/1924] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:32:00 2022] GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a => generated 1413 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:00.159425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ec2926a7-3f3d-48bc-980e-e25989a19cc9 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:00.165896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ae879dba-ce9e-4e07-8eab-929e97afad59 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Getting quotas for user 761ab93565de4e07a19489ce7f479735 and project 37320b68ea0d4d8ab38ba0cd4a3f3f55. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:32:00.166792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ec2926a7-3f3d-48bc-980e-e25989a19cc9 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:00.217160 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ae879dba-ce9e-4e07-8eab-929e97afad59 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.804565 Oct 24 10:32:00.219923 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 920/1925] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:31:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:00.252424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eee0477f-e234-4d9e-b2bb-31865c00209c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:00.253219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eee0477f-e234-4d9e-b2bb-31865c00209c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:00.286960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eee0477f-e234-4d9e-b2bb-31865c00209c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:00.288141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eee0477f-e234-4d9e-b2bb-31865c00209c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:00.289437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eee0477f-e234-4d9e-b2bb-31865c00209c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:00.293726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eee0477f-e234-4d9e-b2bb-31865c00209c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:00.295729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eee0477f-e234-4d9e-b2bb-31865c00209c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:00.298358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eee0477f-e234-4d9e-b2bb-31865c00209c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:00.498830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ec2926a7-3f3d-48bc-980e-e25989a19cc9 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:00.506724 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ec2926a7-3f3d-48bc-980e-e25989a19cc9 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf" status: 200 len: 1240 microversion: 2.1 time: 0.352533 Oct 24 10:32:00.508051 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1006/1926] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:00 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf => generated 1240 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:00.527040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-28fae933-618b-439d-868c-b347e606e2e0 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:00.553810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-28fae933-618b-439d-868c-b347e606e2e0 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] [instance: 1c6b6d52-2b71-42de-8866-e53346845e72] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:00.587777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28fae933-618b-439d-868c-b347e606e2e0 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:00.589909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28fae933-618b-439d-868c-b347e606e2e0 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:00.590618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28fae933-618b-439d-868c-b347e606e2e0 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:00.598194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28fae933-618b-439d-868c-b347e606e2e0 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:00.599377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28fae933-618b-439d-868c-b347e606e2e0 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:00.600917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28fae933-618b-439d-868c-b347e606e2e0 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:01.186160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eee0477f-e234-4d9e-b2bb-31865c00209c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:01.204167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eee0477f-e234-4d9e-b2bb-31865c00209c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:01.206090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eee0477f-e234-4d9e-b2bb-31865c00209c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:01.209485 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eee0477f-e234-4d9e-b2bb-31865c00209c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.987317 Oct 24 10:32:01.222337 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 921/1927] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:00 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:01.249674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ce68e8b9-2b04-4fd2-a489-c91ff83907c9 tempest-ServerGroup264TestJSON-229046103 tempest-ServerGroup264TestJSON-229046103-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:01.285685 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ce68e8b9-2b04-4fd2-a489-c91ff83907c9 tempest-ServerGroup264TestJSON-229046103 tempest-ServerGroup264TestJSON-229046103-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.048285 Oct 24 10:32:01.293631 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 922/1928] 10.222.0.50 () {60 vars in 1193 bytes} [Mon Oct 24 10:32:01 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:32:01.299778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-28fae933-618b-439d-868c-b347e606e2e0 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a812a01cad4d2c9fd471279399dd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f5d94906264801ab259b0ead015b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:01.312041 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-28fae933-618b-439d-868c-b347e606e2e0 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] 10.222.0.50 "GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72" status: 200 len: 1316 microversion: 2.1 time: 0.789476 Oct 24 10:32:01.319442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-910c7b14-9569-41ff-8c21-14bd38d88616 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:01.320390 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1007/1929] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:00 2022] GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72 => generated 1316 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:01.323382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-910c7b14-9569-41ff-8c21-14bd38d88616 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:01.339844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9de4de6d-b2d9-47fd-9e1f-9e68991d6c14 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d06afe50>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:01.343740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-910c7b14-9569-41ff-8c21-14bd38d88616 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:01.349347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-910c7b14-9569-41ff-8c21-14bd38d88616 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:01.351306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-910c7b14-9569-41ff-8c21-14bd38d88616 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:01.356103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-910c7b14-9569-41ff-8c21-14bd38d88616 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:01.356928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-910c7b14-9569-41ff-8c21-14bd38d88616 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:01.358735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-910c7b14-9569-41ff-8c21-14bd38d88616 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:01.464181 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9de4de6d-b2d9-47fd-9e1f-9e68991d6c14 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a" status: 200 len: 1413 microversion: 2.1 time: 0.141625 Oct 24 10:32:01.464865 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1008/1930] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:32:01 2022] GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a => generated 1413 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:01.490570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d7894345-450f-4df0-9a7c-f9ecd1a517a2 tempest-ServerGroup264TestJSON-229046103 tempest-ServerGroup264TestJSON-229046103-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:01.510619 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d7894345-450f-4df0-9a7c-f9ecd1a517a2 tempest-ServerGroup264TestJSON-229046103 tempest-ServerGroup264TestJSON-229046103-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/3811c66a-3777-4f78-9848-77f070718337" status: 200 len: 235 microversion: 2.64 time: 0.033684 Oct 24 10:32:01.518190 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1009/1931] 10.222.0.50 () {60 vars in 1304 bytes} [Mon Oct 24 10:32:01 2022] GET /compute/v2.1/os-server-groups/3811c66a-3777-4f78-9848-77f070718337 => generated 235 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:32:01.533071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-0d8771b5-6799-40b0-b938-ec86e480f05e req-e8e70297-d77a-4efb-aefd-2ff6d01e6d08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c6b6d52-2b71-42de-8866-e53346845e72", "name": "network-vif-plugged", "status": "completed", "tag": "75ac6ad5-6c3b-44b5-b980-dc05207dc3d5"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:01.559265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-0d8771b5-6799-40b0-b938-ec86e480f05e req-e8e70297-d77a-4efb-aefd-2ff6d01e6d08 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:01.562449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-0d8771b5-6799-40b0-b938-ec86e480f05e req-e8e70297-d77a-4efb-aefd-2ff6d01e6d08 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:01.564826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-0d8771b5-6799-40b0-b938-ec86e480f05e req-e8e70297-d77a-4efb-aefd-2ff6d01e6d08 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:01.597377 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-0d8771b5-6799-40b0-b938-ec86e480f05e req-e8e70297-d77a-4efb-aefd-2ff6d01e6d08 service nova] Creating event network-vif-plugged:75ac6ad5-6c3b-44b5-b980-dc05207dc3d5 for instance 1c6b6d52-2b71-42de-8866-e53346845e72 on n-h2-858383-15 Oct 24 10:32:01.609424 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-0d8771b5-6799-40b0-b938-ec86e480f05e req-e8e70297-d77a-4efb-aefd-2ff6d01e6d08 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088740 Oct 24 10:32:01.610279 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1010/1932] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:01.619210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-9feb635e-72e1-4282-a282-d3a26856d9fd req-fcfb42e0-e9d7-4d05-b854-1628c428dd7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f4bf2a-de86-44f9-9481-b6591f1e0191", "name": "network-vif-unplugged", "status": "completed", "tag": "67372bf5-c3c5-4daa-ac37-508ea3a9c66a"}, {"name": "network-changed", "server_uuid": "38f4bf2a-de86-44f9-9481-b6591f1e0191", "tag": "67372bf5-c3c5-4daa-ac37-508ea3a9c66a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:01.647025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9feb635e-72e1-4282-a282-d3a26856d9fd req-fcfb42e0-e9d7-4d05-b854-1628c428dd7d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:01.651173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9feb635e-72e1-4282-a282-d3a26856d9fd req-fcfb42e0-e9d7-4d05-b854-1628c428dd7d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:01.651650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9feb635e-72e1-4282-a282-d3a26856d9fd req-fcfb42e0-e9d7-4d05-b854-1628c428dd7d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:01.676055 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-9feb635e-72e1-4282-a282-d3a26856d9fd req-fcfb42e0-e9d7-4d05-b854-1628c428dd7d service nova] Creating event network-vif-unplugged:67372bf5-c3c5-4daa-ac37-508ea3a9c66a for instance 38f4bf2a-de86-44f9-9481-b6591f1e0191 on n-h1-858383-15 Oct 24 10:32:01.676585 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-9feb635e-72e1-4282-a282-d3a26856d9fd req-fcfb42e0-e9d7-4d05-b854-1628c428dd7d service nova] Creating event network-changed:67372bf5-c3c5-4daa-ac37-508ea3a9c66a for instance 38f4bf2a-de86-44f9-9481-b6591f1e0191 on n-h1-858383-15 Oct 24 10:32:01.694271 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-9feb635e-72e1-4282-a282-d3a26856d9fd req-fcfb42e0-e9d7-4d05-b854-1628c428dd7d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.082268 Oct 24 10:32:01.695208 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1011/1933] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:01.709737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-85efd5ac-3892-4193-8027-961741e839fb tempest-ServerGroup264TestJSON-229046103 tempest-ServerGroup264TestJSON-229046103-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:01.768891 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-85efd5ac-3892-4193-8027-961741e839fb tempest-ServerGroup264TestJSON-229046103 tempest-ServerGroup264TestJSON-229046103-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/3811c66a-3777-4f78-9848-77f070718337" status: 204 len: 0 microversion: 2.64 time: 0.072223 Oct 24 10:32:01.773566 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1012/1934] 10.222.0.50 () {60 vars in 1307 bytes} [Mon Oct 24 10:32:01 2022] DELETE /compute/v2.1/os-server-groups/3811c66a-3777-4f78-9848-77f070718337 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:32:01.783970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d0e29448-fbd1-4b63-861b-d644ed8ef9b4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:01.785075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d0e29448-fbd1-4b63-861b-d644ed8ef9b4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:01.799156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0e29448-fbd1-4b63-861b-d644ed8ef9b4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:01.799966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0e29448-fbd1-4b63-861b-d644ed8ef9b4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:01.800614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0e29448-fbd1-4b63-861b-d644ed8ef9b4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:01.801551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0e29448-fbd1-4b63-861b-d644ed8ef9b4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:01.804652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0e29448-fbd1-4b63-861b-d644ed8ef9b4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:01.805320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0e29448-fbd1-4b63-861b-d644ed8ef9b4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:01.927020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-910c7b14-9569-41ff-8c21-14bd38d88616 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:01.939111 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-910c7b14-9569-41ff-8c21-14bd38d88616 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1393 microversion: 2.1 time: 0.643987 Oct 24 10:32:01.942192 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 923/1935] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:01 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1393 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:01.954170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-040e05fe-100b-416b-80ba-b6264b41ee17 tempest-ServerGroup264TestJSON-229046103 tempest-ServerGroup264TestJSON-229046103-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:01.965277 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-040e05fe-100b-416b-80ba-b6264b41ee17 tempest-ServerGroup264TestJSON-229046103 tempest-ServerGroup264TestJSON-229046103-project] HTTP exception thrown: Instance group 3811c66a-3777-4f78-9848-77f070718337 could not be found. Oct 24 10:32:01.977830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d0e29448-fbd1-4b63-861b-d644ed8ef9b4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-040e05fe-100b-416b-80ba-b6264b41ee17 tempest-ServerGroup264TestJSON-229046103 tempest-ServerGroup264TestJSON-229046103-project] Request method failure captured: Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/os-server-groups/3811c66a-3777-4f78-9848-77f070718337 HTTP/1.1 Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmmaO8wnC4qHpQ9Q0Uzg3zczN9j-LFYvmmreRJqP2ltXu6jfVCJ_hHblzT0n5rqle3ZGwDeKSRjMN0UZx9ZR-O6FXIz8nJazrSd0-uWvH5GL32fx1oV-MuSNC9zwxI9tlP4Ih9zZL2wRvtv5w_RPX-2qXy5GxdFtGKPnEJug2pzbeXs Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.64 Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: df2d39554e2e4591b1ec035ab47bbf58 Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerGroup264TestJSON-229046103 Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:32:01.980872 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:32:01.982720 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/df2d39554e2e4591b1ec035ab47bbf58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/df2d39554e2e4591b1ec035ab47bbf58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/df2d39554e2e4591b1ec035ab47bbf58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_df2d39554e2e4591b1ec035ab47bbf58", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:32:01.982720 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerGroup264TestJSON-229046103 Oct 24 10:32:01.982720 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: df2d39554e2e4591b1ec035ab47bbf58 Oct 24 10:32:01.982720 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerGroup264TestJSON-229046103 Oct 24 10:32:01.982720 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerGroup264TestJSON-229046103-project Oct 24 10:32:01.982720 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:32:01.982720 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:32:01.982720 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 62e8561bb12e48388d5326c6ce3fd065 Oct 24 10:32:01.982720 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerGroup264TestJSON-229046103-project Oct 24 10:32:01.982720 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:32:01.982720 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance group 3811c66a-3777-4f78-9848-77f070718337 could not be found. Oct 24 10:32:01.982720 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '3811c66a-3777-4f78-9848-77f070718337'} Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3811c66a-3777-4f78-9848-77f070718337 could not be found. Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:01.983582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:01.985154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:32:01.985154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:32:01.985154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:32:01.985154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:32:01.985154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 24 10:32:01.985154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:32:01.985154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3811c66a-3777-4f78-9848-77f070718337 could not be found. Oct 24 10:32:01.985154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:01.985154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:01.985154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:01.985154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:01.985154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:01.985154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:01.985154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:32:01.985154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:32:01.985154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3811c66a-3777-4f78-9848-77f070718337 could not be found. Oct 24 10:32:01.985154 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:01.988314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-040e05fe-100b-416b-80ba-b6264b41ee17 tempest-ServerGroup264TestJSON-229046103 tempest-ServerGroup264TestJSON-229046103-project] Returning 404 to user: Instance group 3811c66a-3777-4f78-9848-77f070718337 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:32:01.990418 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-040e05fe-100b-416b-80ba-b6264b41ee17 tempest-ServerGroup264TestJSON-229046103 tempest-ServerGroup264TestJSON-229046103-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/3811c66a-3777-4f78-9848-77f070718337" status: 404 len: 117 microversion: 2.64 time: 0.047094 Oct 24 10:32:01.996810 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 924/1936] 10.222.0.50 () {60 vars in 1307 bytes} [Mon Oct 24 10:32:01 2022] DELETE /compute/v2.1/os-server-groups/3811c66a-3777-4f78-9848-77f070718337 => generated 117 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:32:02.000375 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d0e29448-fbd1-4b63-861b-d644ed8ef9b4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf" status: 200 len: 1292 microversion: 2.1 time: 0.225338 Oct 24 10:32:02.001537 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1013/1937] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:01 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf => generated 1292 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:02.245695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-75ce96ed-f89f-4fe8-92c4-2bf73067a2ef tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:02.246909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-75ce96ed-f89f-4fe8-92c4-2bf73067a2ef tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:02.262629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75ce96ed-f89f-4fe8-92c4-2bf73067a2ef tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:02.280004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75ce96ed-f89f-4fe8-92c4-2bf73067a2ef tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:02.280747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75ce96ed-f89f-4fe8-92c4-2bf73067a2ef tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:02.281915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75ce96ed-f89f-4fe8-92c4-2bf73067a2ef tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:02.282650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75ce96ed-f89f-4fe8-92c4-2bf73067a2ef tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:02.283203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75ce96ed-f89f-4fe8-92c4-2bf73067a2ef tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:02.350959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b9942772-cd50-43f6-91a4-cbb190786361 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:02.351626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b9942772-cd50-43f6-91a4-cbb190786361 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] [instance: 1c6b6d52-2b71-42de-8866-e53346845e72] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:02.362128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b9942772-cd50-43f6-91a4-cbb190786361 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:02.370656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b9942772-cd50-43f6-91a4-cbb190786361 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:02.372310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b9942772-cd50-43f6-91a4-cbb190786361 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:02.373201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b9942772-cd50-43f6-91a4-cbb190786361 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:02.379113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b9942772-cd50-43f6-91a4-cbb190786361 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:02.380049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b9942772-cd50-43f6-91a4-cbb190786361 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:03.140932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-75ce96ed-f89f-4fe8-92c4-2bf73067a2ef tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:03.147036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b9942772-cd50-43f6-91a4-cbb190786361 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a812a01cad4d2c9fd471279399dd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f5d94906264801ab259b0ead015b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:03.179246 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b9942772-cd50-43f6-91a4-cbb190786361 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] 10.222.0.50 "GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72" status: 200 len: 1316 microversion: 2.1 time: 0.832856 Oct 24 10:32:03.179743 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1014/1938] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:02 2022] GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72 => generated 1316 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:32:03.183186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-75ce96ed-f89f-4fe8-92c4-2bf73067a2ef tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:03.185718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-75ce96ed-f89f-4fe8-92c4-2bf73067a2ef tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:03.187474 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-75ce96ed-f89f-4fe8-92c4-2bf73067a2ef tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.947702 Oct 24 10:32:03.198272 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 925/1939] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:02 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:03.220124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-59981e4d-4b31-4985-8fcc-6dcfb3a98f76 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:03.221290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-59981e4d-4b31-4985-8fcc-6dcfb3a98f76 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:03.232066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59981e4d-4b31-4985-8fcc-6dcfb3a98f76 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:03.233478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cb866c6d-782d-468d-8918-76719eda90b3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0618b80>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:03.235003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59981e4d-4b31-4985-8fcc-6dcfb3a98f76 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:03.237367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59981e4d-4b31-4985-8fcc-6dcfb3a98f76 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:03.238600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59981e4d-4b31-4985-8fcc-6dcfb3a98f76 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:03.242653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59981e4d-4b31-4985-8fcc-6dcfb3a98f76 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:03.243916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59981e4d-4b31-4985-8fcc-6dcfb3a98f76 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:03.338143 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cb866c6d-782d-468d-8918-76719eda90b3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a" status: 200 len: 1413 microversion: 2.1 time: 0.126326 Oct 24 10:32:03.348691 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1015/1940] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:32:03 2022] GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a => generated 1413 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:03.355903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-309f4da8-4c91-4c95-acb6-7bd4610264e7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:03.356794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-309f4da8-4c91-4c95-acb6-7bd4610264e7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:03.364478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-309f4da8-4c91-4c95-acb6-7bd4610264e7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:03.365082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-309f4da8-4c91-4c95-acb6-7bd4610264e7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:03.365597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-309f4da8-4c91-4c95-acb6-7bd4610264e7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:03.366402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-309f4da8-4c91-4c95-acb6-7bd4610264e7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:03.367033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-309f4da8-4c91-4c95-acb6-7bd4610264e7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:03.367631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-309f4da8-4c91-4c95-acb6-7bd4610264e7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:03.573479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-309f4da8-4c91-4c95-acb6-7bd4610264e7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:03.582132 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-309f4da8-4c91-4c95-acb6-7bd4610264e7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf" status: 200 len: 1298 microversion: 2.1 time: 0.231531 Oct 24 10:32:03.587827 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1016/1941] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:03 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf => generated 1298 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:03.822837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-59981e4d-4b31-4985-8fcc-6dcfb3a98f76 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:03.831687 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-59981e4d-4b31-4985-8fcc-6dcfb3a98f76 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1393 microversion: 2.1 time: 0.622425 Oct 24 10:32:03.840894 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 926/1942] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:03 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1393 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:04.205705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3de43bef-f659-4106-8932-8c6d770336fe tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:04.206593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3de43bef-f659-4106-8932-8c6d770336fe tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] [instance: 1c6b6d52-2b71-42de-8866-e53346845e72] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:04.215769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3de43bef-f659-4106-8932-8c6d770336fe tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:04.216527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3de43bef-f659-4106-8932-8c6d770336fe tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:04.217180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3de43bef-f659-4106-8932-8c6d770336fe tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:04.218346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3de43bef-f659-4106-8932-8c6d770336fe tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:04.221207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3de43bef-f659-4106-8932-8c6d770336fe tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:04.221707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ffcff7cb-5578-4ffe-bfdf-d4d238f44656 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:04.222467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ffcff7cb-5578-4ffe-bfdf-d4d238f44656 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:04.223416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3de43bef-f659-4106-8932-8c6d770336fe tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:04.233764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffcff7cb-5578-4ffe-bfdf-d4d238f44656 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:04.236650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffcff7cb-5578-4ffe-bfdf-d4d238f44656 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:04.237171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffcff7cb-5578-4ffe-bfdf-d4d238f44656 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:04.240241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffcff7cb-5578-4ffe-bfdf-d4d238f44656 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:04.240786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffcff7cb-5578-4ffe-bfdf-d4d238f44656 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:04.241262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffcff7cb-5578-4ffe-bfdf-d4d238f44656 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:05.827830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ffcff7cb-5578-4ffe-bfdf-d4d238f44656 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:05.860330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ffcff7cb-5578-4ffe-bfdf-d4d238f44656 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:05.870900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ffcff7cb-5578-4ffe-bfdf-d4d238f44656 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:05.872312 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ffcff7cb-5578-4ffe-bfdf-d4d238f44656 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 1.655286 Oct 24 10:32:05.877343 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 927/1943] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:04 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:05.900487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-66b804b0-4d7d-4ad8-b732-3041473589e8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d5012ca0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:06.073852 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-66b804b0-4d7d-4ad8-b732-3041473589e8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a" status: 200 len: 1413 microversion: 2.1 time: 0.194831 Oct 24 10:32:06.074786 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 928/1944] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:32:05 2022] GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a => generated 1413 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:06.082545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-90acebc1-5c14-4342-a11b-81b51e3f74fc tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:06.083549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-90acebc1-5c14-4342-a11b-81b51e3f74fc tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:06.108717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90acebc1-5c14-4342-a11b-81b51e3f74fc tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:06.109780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90acebc1-5c14-4342-a11b-81b51e3f74fc tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:06.112491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90acebc1-5c14-4342-a11b-81b51e3f74fc tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:06.114167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90acebc1-5c14-4342-a11b-81b51e3f74fc tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:06.119987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90acebc1-5c14-4342-a11b-81b51e3f74fc tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:06.121098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90acebc1-5c14-4342-a11b-81b51e3f74fc tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:06.139563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3de43bef-f659-4106-8932-8c6d770336fe tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a812a01cad4d2c9fd471279399dd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f5d94906264801ab259b0ead015b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:06.148936 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3de43bef-f659-4106-8932-8c6d770336fe tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] 10.222.0.50 "GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72" status: 200 len: 1505 microversion: 2.1 time: 1.947037 Oct 24 10:32:06.150071 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1017/1945] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:04 2022] GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72 => generated 1505 bytes in 1949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:06.177743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-72eb5429-4b04-43d4-b743-5ea97146183d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:06.180541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-72eb5429-4b04-43d4-b743-5ea97146183d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:06.197243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72eb5429-4b04-43d4-b743-5ea97146183d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:06.197807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72eb5429-4b04-43d4-b743-5ea97146183d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:06.198256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72eb5429-4b04-43d4-b743-5ea97146183d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:06.198986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72eb5429-4b04-43d4-b743-5ea97146183d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:06.199450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72eb5429-4b04-43d4-b743-5ea97146183d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:06.199880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72eb5429-4b04-43d4-b743-5ea97146183d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:07.038406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-72eb5429-4b04-43d4-b743-5ea97146183d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:07.061933 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-72eb5429-4b04-43d4-b743-5ea97146183d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1393 microversion: 2.1 time: 0.888249 Oct 24 10:32:07.084476 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1018/1946] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:06 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1393 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:07.098648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3038bd38-49d7-4ba6-908b-0db08c22bcec tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:07.106856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3038bd38-49d7-4ba6-908b-0db08c22bcec tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] [instance: 1c6b6d52-2b71-42de-8866-e53346845e72] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:07.119406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3038bd38-49d7-4ba6-908b-0db08c22bcec tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:07.125807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3038bd38-49d7-4ba6-908b-0db08c22bcec tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:07.127440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3038bd38-49d7-4ba6-908b-0db08c22bcec tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:07.132347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3038bd38-49d7-4ba6-908b-0db08c22bcec tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:07.134484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3038bd38-49d7-4ba6-908b-0db08c22bcec tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:07.139983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3038bd38-49d7-4ba6-908b-0db08c22bcec tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:07.204687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3038bd38-49d7-4ba6-908b-0db08c22bcec tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] [instance: 1c6b6d52-2b71-42de-8866-e53346845e72] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:32:07.346953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-90acebc1-5c14-4342-a11b-81b51e3f74fc tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:07.376742 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-90acebc1-5c14-4342-a11b-81b51e3f74fc tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf" status: 200 len: 1365 microversion: 2.1 time: 1.299587 Oct 24 10:32:07.380057 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 929/1947] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:06 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf => generated 1365 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:07.410414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7b1d4954-0804-4eb8-ad19-88f32828a348 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:07.412366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7b1d4954-0804-4eb8-ad19-88f32828a348 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:07.427290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b1d4954-0804-4eb8-ad19-88f32828a348 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:07.431518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b1d4954-0804-4eb8-ad19-88f32828a348 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:07.433101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b1d4954-0804-4eb8-ad19-88f32828a348 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:07.434383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b1d4954-0804-4eb8-ad19-88f32828a348 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:07.436619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b1d4954-0804-4eb8-ad19-88f32828a348 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:07.439035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b1d4954-0804-4eb8-ad19-88f32828a348 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:07.486057 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3038bd38-49d7-4ba6-908b-0db08c22bcec tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72" status: 204 len: 0 microversion: 2.1 time: 0.399428 Oct 24 10:32:07.491037 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1019/1948] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:32:07 2022] DELETE /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:32:07.522859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6c2e5756-2e12-4927-a9d0-3823cac8eb63 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d05df5e0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:07.665091 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6c2e5756-2e12-4927-a9d0-3823cac8eb63 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a" status: 200 len: 1413 microversion: 2.1 time: 0.161945 Oct 24 10:32:07.667004 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1020/1949] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:32:07 2022] GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a => generated 1413 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:07.680021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4f93d1ee-c855-4725-b3d5-6dc424e4640c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:07.681783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4f93d1ee-c855-4725-b3d5-6dc424e4640c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] [instance: 1c6b6d52-2b71-42de-8866-e53346845e72] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:07.712300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f93d1ee-c855-4725-b3d5-6dc424e4640c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:07.712817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f93d1ee-c855-4725-b3d5-6dc424e4640c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:07.713288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f93d1ee-c855-4725-b3d5-6dc424e4640c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:07.714047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f93d1ee-c855-4725-b3d5-6dc424e4640c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:07.714499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f93d1ee-c855-4725-b3d5-6dc424e4640c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:07.714938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f93d1ee-c855-4725-b3d5-6dc424e4640c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:08.299587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7b1d4954-0804-4eb8-ad19-88f32828a348 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:08.316476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7b1d4954-0804-4eb8-ad19-88f32828a348 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:08.318922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7b1d4954-0804-4eb8-ad19-88f32828a348 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:08.322089 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7b1d4954-0804-4eb8-ad19-88f32828a348 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.921894 Oct 24 10:32:08.323214 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 930/1950] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:07 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:08.329200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2e02d7a6-c400-4dee-93d6-cbedad0deb8f tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1339560340", "imageRef": "070fa543-4eec-4137-893e-141a7e834da3", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c6e01f12-4b2a-4baf-8a16-b91dea515d1c"}], "security_groups": [{"name": "tempest-securitygroup--1184991542"}], "key_name": "tempest-keypair-2116530247", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:08.515947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4f93d1ee-c855-4725-b3d5-6dc424e4640c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a812a01cad4d2c9fd471279399dd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f5d94906264801ab259b0ead015b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:08.541013 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4f93d1ee-c855-4725-b3d5-6dc424e4640c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] 10.222.0.50 "GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72" status: 200 len: 1511 microversion: 2.1 time: 0.869509 Oct 24 10:32:08.547537 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1021/1951] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:07 2022] GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72 => generated 1511 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:08.580740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d1bc7a84-a4e6-4d2f-98bd-431a93f36fa7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:08.582880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d1bc7a84-a4e6-4d2f-98bd-431a93f36fa7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:08.607935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1bc7a84-a4e6-4d2f-98bd-431a93f36fa7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:08.610520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1bc7a84-a4e6-4d2f-98bd-431a93f36fa7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:08.611111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1bc7a84-a4e6-4d2f-98bd-431a93f36fa7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:08.615907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1bc7a84-a4e6-4d2f-98bd-431a93f36fa7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:08.616581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1bc7a84-a4e6-4d2f-98bd-431a93f36fa7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:08.619802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1bc7a84-a4e6-4d2f-98bd-431a93f36fa7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:08.878511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-2e02d7a6-c400-4dee-93d6-cbedad0deb8f tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] validate_networks() for [('c6e01f12-4b2a-4baf-8a16-b91dea515d1c', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:32:09.038590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:09.324106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d1bc7a84-a4e6-4d2f-98bd-431a93f36fa7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:09.339597 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d1bc7a84-a4e6-4d2f-98bd-431a93f36fa7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1393 microversion: 2.1 time: 0.788938 Oct 24 10:32:09.342370 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1022/1952] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:08 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1393 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:09.349780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c56a48c1-0928-4e60-a24c-7f14a77d0791 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:09.350722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c56a48c1-0928-4e60-a24c-7f14a77d0791 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:09.369143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c56a48c1-0928-4e60-a24c-7f14a77d0791 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:09.370822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c56a48c1-0928-4e60-a24c-7f14a77d0791 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:09.373530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c56a48c1-0928-4e60-a24c-7f14a77d0791 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:09.374525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c56a48c1-0928-4e60-a24c-7f14a77d0791 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:09.378042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c56a48c1-0928-4e60-a24c-7f14a77d0791 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:09.381404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c56a48c1-0928-4e60-a24c-7f14a77d0791 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:10.175066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:10.506000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=16 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:10.663441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c56a48c1-0928-4e60-a24c-7f14a77d0791 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:10.677329 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c56a48c1-0928-4e60-a24c-7f14a77d0791 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf" status: 200 len: 1365 microversion: 2.1 time: 1.331487 Oct 24 10:32:10.678827 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1023/1953] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:09 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf => generated 1365 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:10.686093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5a8f8cf2-24a6-4ea6-8898-116181e27529 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d04b3160>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:10.807226 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5a8f8cf2-24a6-4ea6-8898-116181e27529 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a" status: 200 len: 1422 microversion: 2.1 time: 0.122040 Oct 24 10:32:10.815728 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1024/1954] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:32:10 2022] GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a => generated 1422 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:10.827638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6963c47c-47bf-48c1-8a6f-420d719d568a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:10.829071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6963c47c-47bf-48c1-8a6f-420d719d568a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:10.842931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6963c47c-47bf-48c1-8a6f-420d719d568a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:10.843698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6963c47c-47bf-48c1-8a6f-420d719d568a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:10.844779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6963c47c-47bf-48c1-8a6f-420d719d568a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:10.845805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6963c47c-47bf-48c1-8a6f-420d719d568a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:10.846442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6963c47c-47bf-48c1-8a6f-420d719d568a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:10.847055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6963c47c-47bf-48c1-8a6f-420d719d568a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:11.507704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2e02d7a6-c400-4dee-93d6-cbedad0deb8f tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:32:11.508736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2e02d7a6-c400-4dee-93d6-cbedad0deb8f tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:32:11.509476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2e02d7a6-c400-4dee-93d6-cbedad0deb8f tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:32:11.509988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2e02d7a6-c400-4dee-93d6-cbedad0deb8f tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:32:11.510598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2e02d7a6-c400-4dee-93d6-cbedad0deb8f tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:32:11.531162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e02d7a6-c400-4dee-93d6-cbedad0deb8f tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:11.533321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e02d7a6-c400-4dee-93d6-cbedad0deb8f tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:11.533994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e02d7a6-c400-4dee-93d6-cbedad0deb8f tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:11.534955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e02d7a6-c400-4dee-93d6-cbedad0deb8f tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:11.535636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e02d7a6-c400-4dee-93d6-cbedad0deb8f tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:11.536229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e02d7a6-c400-4dee-93d6-cbedad0deb8f tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:11.578445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-2e02d7a6-c400-4dee-93d6-cbedad0deb8f tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Getting quotas for project 37320b68ea0d4d8ab38ba0cd4a3f3f55. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:32:11.588102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-2e02d7a6-c400-4dee-93d6-cbedad0deb8f tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Getting quotas for user 761ab93565de4e07a19489ce7f479735 and project 37320b68ea0d4d8ab38ba0cd4a3f3f55. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:32:11.607391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2e02d7a6-c400-4dee-93d6-cbedad0deb8f tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:32:11.614030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2e02d7a6-c400-4dee-93d6-cbedad0deb8f tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='070fa543-4eec-4137-893e-141a7e834da3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:32:11.669370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6963c47c-47bf-48c1-8a6f-420d719d568a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:11.689552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6963c47c-47bf-48c1-8a6f-420d719d568a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:11.690719 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2e02d7a6-c400-4dee-93d6-cbedad0deb8f tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.366273 Oct 24 10:32:11.692372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6963c47c-47bf-48c1-8a6f-420d719d568a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:11.692590 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 931/1955] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:32:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 3368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:32:11.694073 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6963c47c-47bf-48c1-8a6f-420d719d568a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.876730 Oct 24 10:32:11.700154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-74fccfe8-28af-49a9-9542-3f5766d9aeb5 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:11.701186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-74fccfe8-28af-49a9-9542-3f5766d9aeb5 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] [instance: 1c6b6d52-2b71-42de-8866-e53346845e72] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:11.710281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74fccfe8-28af-49a9-9542-3f5766d9aeb5 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:11.711075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74fccfe8-28af-49a9-9542-3f5766d9aeb5 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:11.711691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74fccfe8-28af-49a9-9542-3f5766d9aeb5 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:11.712001 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1025/1956] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:10 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:11.712945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74fccfe8-28af-49a9-9542-3f5766d9aeb5 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:11.713717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74fccfe8-28af-49a9-9542-3f5766d9aeb5 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:11.714474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74fccfe8-28af-49a9-9542-3f5766d9aeb5 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:11.736136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1aedeb38-de1e-42e3-bc0c-e611b2a3b365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:11.736729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1aedeb38-de1e-42e3-bc0c-e611b2a3b365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:11.763578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1aedeb38-de1e-42e3-bc0c-e611b2a3b365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:11.764054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1aedeb38-de1e-42e3-bc0c-e611b2a3b365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:11.764728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1aedeb38-de1e-42e3-bc0c-e611b2a3b365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:11.772179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1aedeb38-de1e-42e3-bc0c-e611b2a3b365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:11.772730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1aedeb38-de1e-42e3-bc0c-e611b2a3b365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:11.774232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1aedeb38-de1e-42e3-bc0c-e611b2a3b365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:11.821645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74fccfe8-28af-49a9-9542-3f5766d9aeb5 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:11.822227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74fccfe8-28af-49a9-9542-3f5766d9aeb5 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:11.822678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74fccfe8-28af-49a9-9542-3f5766d9aeb5 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:11.823314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-74fccfe8-28af-49a9-9542-3f5766d9aeb5 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lazy-loading 'fault' on Instance uuid 1c6b6d52-2b71-42de-8866-e53346845e72 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:32:12.037428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-74fccfe8-28af-49a9-9542-3f5766d9aeb5 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a812a01cad4d2c9fd471279399dd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f5d94906264801ab259b0ead015b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:12.053014 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-74fccfe8-28af-49a9-9542-3f5766d9aeb5 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] 10.222.0.50 "GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72" status: 200 len: 1306 microversion: 2.1 time: 0.358192 Oct 24 10:32:12.065298 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 932/1957] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:11 2022] GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72 => generated 1306 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:12.077419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-888600ef-ddae-418e-bac4-06cf9c021550 req-a929071f-c322-4937-8877-dbef0cca3a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c6b6d52-2b71-42de-8866-e53346845e72", "name": "network-vif-deleted", "tag": "75ac6ad5-6c3b-44b5-b980-dc05207dc3d5"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:12.089282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-888600ef-ddae-418e-bac4-06cf9c021550 req-a929071f-c322-4937-8877-dbef0cca3a5d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:12.090036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-888600ef-ddae-418e-bac4-06cf9c021550 req-a929071f-c322-4937-8877-dbef0cca3a5d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:12.090649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-888600ef-ddae-418e-bac4-06cf9c021550 req-a929071f-c322-4937-8877-dbef0cca3a5d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:12.104950 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-888600ef-ddae-418e-bac4-06cf9c021550 req-a929071f-c322-4937-8877-dbef0cca3a5d service nova] Creating event network-vif-deleted:75ac6ad5-6c3b-44b5-b980-dc05207dc3d5 for instance 1c6b6d52-2b71-42de-8866-e53346845e72 on n-h2-858383-15 Oct 24 10:32:12.112075 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-888600ef-ddae-418e-bac4-06cf9c021550 req-a929071f-c322-4937-8877-dbef0cca3a5d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042582 Oct 24 10:32:12.113408 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 933/1958] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:12.370221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1aedeb38-de1e-42e3-bc0c-e611b2a3b365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:12.380121 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1aedeb38-de1e-42e3-bc0c-e611b2a3b365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1393 microversion: 2.1 time: 0.666776 Oct 24 10:32:12.384126 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1026/1959] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:11 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1393 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:12.395951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-5e2dcb6b-0044-4e05-a57f-64a100573538 req-8fdda62d-6e87-47b2-92bb-56764d98dd15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8832f22-83eb-47c3-8597-614ff8f28ecf", "tag": "03d79102-62cf-4d9f-a210-b0d94c109df9"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:12.417509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5e2dcb6b-0044-4e05-a57f-64a100573538 req-8fdda62d-6e87-47b2-92bb-56764d98dd15 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:12.418108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5e2dcb6b-0044-4e05-a57f-64a100573538 req-8fdda62d-6e87-47b2-92bb-56764d98dd15 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:12.419420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5e2dcb6b-0044-4e05-a57f-64a100573538 req-8fdda62d-6e87-47b2-92bb-56764d98dd15 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:12.463269 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-5e2dcb6b-0044-4e05-a57f-64a100573538 req-8fdda62d-6e87-47b2-92bb-56764d98dd15 service nova] Creating event network-changed:03d79102-62cf-4d9f-a210-b0d94c109df9 for instance a8832f22-83eb-47c3-8597-614ff8f28ecf on n-h1-858383-15 Oct 24 10:32:12.481958 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-5e2dcb6b-0044-4e05-a57f-64a100573538 req-8fdda62d-6e87-47b2-92bb-56764d98dd15 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093708 Oct 24 10:32:12.485427 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1027/1960] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:12.495628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-30b2a5eb-2bdb-4217-b5dc-42d63d10051a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:12.500657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-30b2a5eb-2bdb-4217-b5dc-42d63d10051a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:12.517210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30b2a5eb-2bdb-4217-b5dc-42d63d10051a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:12.518666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30b2a5eb-2bdb-4217-b5dc-42d63d10051a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:12.521633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30b2a5eb-2bdb-4217-b5dc-42d63d10051a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:12.523006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30b2a5eb-2bdb-4217-b5dc-42d63d10051a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:12.525652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30b2a5eb-2bdb-4217-b5dc-42d63d10051a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:12.526574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30b2a5eb-2bdb-4217-b5dc-42d63d10051a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:12.570528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-63f28ae0-c8bf-4285-a1a0-4d3123441683 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d501dd30>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:12.664224 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-63f28ae0-c8bf-4285-a1a0-4d3123441683 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a" status: 200 len: 1422 microversion: 2.1 time: 0.549387 Oct 24 10:32:12.675262 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 934/1961] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:32:12 2022] GET /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a => generated 1422 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:12.686402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e22cfa8-754f-43cc-95b5-37aefdc4e1de tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:12.688809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5e22cfa8-754f-43cc-95b5-37aefdc4e1de tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:12.715655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e22cfa8-754f-43cc-95b5-37aefdc4e1de tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:12.716530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e22cfa8-754f-43cc-95b5-37aefdc4e1de tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:12.716977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e22cfa8-754f-43cc-95b5-37aefdc4e1de tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:12.717722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e22cfa8-754f-43cc-95b5-37aefdc4e1de tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:12.718414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e22cfa8-754f-43cc-95b5-37aefdc4e1de tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:12.719025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e22cfa8-754f-43cc-95b5-37aefdc4e1de tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:12.934866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5e22cfa8-754f-43cc-95b5-37aefdc4e1de tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:12.953290 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5e22cfa8-754f-43cc-95b5-37aefdc4e1de tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1250 microversion: 2.1 time: 0.266679 Oct 24 10:32:12.953988 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 935/1962] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:12 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1250 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:12.958977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8cb63f77-7d48-4240-b17a-d4b9d00be76c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:12.970146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8cb63f77-7d48-4240-b17a-d4b9d00be76c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:12.992795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb63f77-7d48-4240-b17a-d4b9d00be76c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:12.993561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb63f77-7d48-4240-b17a-d4b9d00be76c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:12.994236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb63f77-7d48-4240-b17a-d4b9d00be76c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:12.995379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb63f77-7d48-4240-b17a-d4b9d00be76c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:12.996025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb63f77-7d48-4240-b17a-d4b9d00be76c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:12.996666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb63f77-7d48-4240-b17a-d4b9d00be76c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:13.244403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-30b2a5eb-2bdb-4217-b5dc-42d63d10051a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:13.261457 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-30b2a5eb-2bdb-4217-b5dc-42d63d10051a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf" status: 200 len: 1365 microversion: 2.1 time: 0.770058 Oct 24 10:32:13.262917 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1028/1963] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:12 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf => generated 1365 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:13.284482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4a2a50c2-09cf-427e-9183-3ac46af2135b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-434437909", "imageRef": "c57db0fe-20a9-44aa-909b-1fe7d0d0642a", "flavorRef": "452", "networks": [{"uuid": "c0c03a0b-80ac-4629-802c-40f648b11429"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:13.410998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-4a2a50c2-09cf-427e-9183-3ac46af2135b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] validate_networks() for [('c0c03a0b-80ac-4629-802c-40f648b11429', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:32:13.488800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8cb63f77-7d48-4240-b17a-d4b9d00be76c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:13.498740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8cb63f77-7d48-4240-b17a-d4b9d00be76c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:13.500302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8cb63f77-7d48-4240-b17a-d4b9d00be76c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:13.501525 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8cb63f77-7d48-4240-b17a-d4b9d00be76c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.546489 Oct 24 10:32:13.520087 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 936/1964] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:12 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:13.530561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4e508827-d903-42c9-979c-dc629ce84c02 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:13.531759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4e508827-d903-42c9-979c-dc629ce84c02 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] [instance: 1c6b6d52-2b71-42de-8866-e53346845e72] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:13.558691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e508827-d903-42c9-979c-dc629ce84c02 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:13.559539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e508827-d903-42c9-979c-dc629ce84c02 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:13.560861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e508827-d903-42c9-979c-dc629ce84c02 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:13.568574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e508827-d903-42c9-979c-dc629ce84c02 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:13.569407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e508827-d903-42c9-979c-dc629ce84c02 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:13.570058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e508827-d903-42c9-979c-dc629ce84c02 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:13.602116 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-4e508827-d903-42c9-979c-dc629ce84c02 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] HTTP exception thrown: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4e508827-d903-42c9-979c-dc629ce84c02 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Request method failure captured: Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72 HTTP/1.1 Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmmGbHpv9OfKPHvwfDnjGazMCGlY8bAlhIPgySkqwubvIJzGrtmNvLnadrqYaJVPzc6DIlQu5fLRg4yKDyukhtFl4UVK_N3fONMbIZPceE5HNPSbOmaCxwjWosubqM9V1A7eA-RET-saa5f0upWZ-YkOn8vYtU5m5zyGGxZXMcMXJwI Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: d3f5d94906264801ab259b0ead015b1a Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:32:13.605277 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:32:13.607392 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d3f5d94906264801ab259b0ead015b1a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:32:13.607392 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:13.607392 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: d3f5d94906264801ab259b0ead015b1a Oct 24 10:32:13.607392 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:13.607392 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesNegativeTestJSON-481426532-project Oct 24 10:32:13.607392 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:32:13.607392 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:32:13.607392 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 28a812a01cad4d2c9fd471279399dd42 Oct 24 10:32:13.607392 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesNegativeTestJSON-481426532-project Oct 24 10:32:13.607392 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:32:13.607392 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:13.607392 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '1c6b6d52-2b71-42de-8866-e53346845e72'} Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:32:13.608450 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:32:13.610208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:32:13.610208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:32:13.610208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:32:13.610208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:32:13.610208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:32:13.610208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:32:13.610208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:32:13.610208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:13.610208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:13.610208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:13.610208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:13.610208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:13.610208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:13.610208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:13.610208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:32:13.610208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:32:13.610208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:13.610208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:13.613074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4e508827-d903-42c9-979c-dc629ce84c02 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Returning 404 to user: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:32:13.614395 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4e508827-d903-42c9-979c-dc629ce84c02 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] 10.222.0.50 "GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72" status: 404 len: 111 microversion: 2.1 time: 0.092978 Oct 24 10:32:13.615536 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 937/1965] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:13 2022] GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:32:13.621621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-55ed7efe-8bef-45b0-87a1-3c2e4e50915b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:13.622802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-55ed7efe-8bef-45b0-87a1-3c2e4e50915b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:13.636621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-55ed7efe-8bef-45b0-87a1-3c2e4e50915b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:13.637155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-55ed7efe-8bef-45b0-87a1-3c2e4e50915b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:13.637581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-55ed7efe-8bef-45b0-87a1-3c2e4e50915b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:13.638306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-55ed7efe-8bef-45b0-87a1-3c2e4e50915b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:13.638765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-55ed7efe-8bef-45b0-87a1-3c2e4e50915b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:13.639194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-55ed7efe-8bef-45b0-87a1-3c2e4e50915b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:14.060388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-55ed7efe-8bef-45b0-87a1-3c2e4e50915b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:14.071308 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-55ed7efe-8bef-45b0-87a1-3c2e4e50915b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1393 microversion: 2.1 time: 0.454364 Oct 24 10:32:14.076523 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 938/1966] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:13 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1393 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:14.084812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b9b899c-64c2-4417-8ee3-904072a7e5d4 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1842200764", "metadata": {"image_type": "test"}}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:14.088007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6b9b899c-64c2-4417-8ee3-904072a7e5d4 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] [instance: 1c6b6d52-2b71-42de-8866-e53346845e72] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:14.105091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b9b899c-64c2-4417-8ee3-904072a7e5d4 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:14.105588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b9b899c-64c2-4417-8ee3-904072a7e5d4 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:14.106025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b9b899c-64c2-4417-8ee3-904072a7e5d4 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:14.106738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b9b899c-64c2-4417-8ee3-904072a7e5d4 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:14.111006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b9b899c-64c2-4417-8ee3-904072a7e5d4 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:14.111519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b9b899c-64c2-4417-8ee3-904072a7e5d4 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:14.170555 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-6b9b899c-64c2-4417-8ee3-904072a7e5d4 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] HTTP exception thrown: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b9b899c-64c2-4417-8ee3-904072a7e5d4 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Request method failure captured: Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72/action HTTP/1.1 Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 112 Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmmGbHpv9OfKPHvwfDnjGazMCGlY8bAlhIPgySkqwubvIJzGrtmNvLnadrqYaJVPzc6DIlQu5fLRg4yKDyukhtFl4UVK_N3fONMbIZPceE5HNPSbOmaCxwjWosubqM9V1A7eA-RET-saa5f0upWZ-YkOn8vYtU5m5zyGGxZXMcMXJwI Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: d3f5d94906264801ab259b0ead015b1a Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:32:14.182450 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:32:14.184322 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d3f5d94906264801ab259b0ead015b1a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:32:14.184322 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:14.184322 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: d3f5d94906264801ab259b0ead015b1a Oct 24 10:32:14.184322 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:14.184322 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesNegativeTestJSON-481426532-project Oct 24 10:32:14.184322 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:32:14.184322 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:32:14.184322 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 28a812a01cad4d2c9fd471279399dd42 Oct 24 10:32:14.184322 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesNegativeTestJSON-481426532-project Oct 24 10:32:14.184322 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:32:14.184322 n-d-858383-15 devstack@n-api.service[120425]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1842200764", "metadata": {"image_type": "test"}}} Oct 24 10:32:14.184322 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '1c6b6d52-2b71-42de-8866-e53346845e72', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1842200764', 'metadata': {'image_type': 'test'}}}} Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:14.190462 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:14.191961 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:14.193581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:14.193581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:32:14.193581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:32:14.193581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:14.193581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:14.193581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b9b899c-64c2-4417-8ee3-904072a7e5d4 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Returning 404 to user: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:32:14.193581 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6b9b899c-64c2-4417-8ee3-904072a7e5d4 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] 10.222.0.50 "POST /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72/action" status: 404 len: 111 microversion: 2.1 time: 0.106596 Oct 24 10:32:14.194210 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 939/1967] 10.222.0.50 () {60 vars in 1279 bytes} [Mon Oct 24 10:32:14 2022] POST /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72/action => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:32:14.209698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-70a44b7a-a63f-4ce2-a87c-26887841730a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:14.210330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-70a44b7a-a63f-4ce2-a87c-26887841730a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:14.234826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70a44b7a-a63f-4ce2-a87c-26887841730a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:14.235357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70a44b7a-a63f-4ce2-a87c-26887841730a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:14.235804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70a44b7a-a63f-4ce2-a87c-26887841730a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:14.236672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70a44b7a-a63f-4ce2-a87c-26887841730a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:14.237230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70a44b7a-a63f-4ce2-a87c-26887841730a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:14.237621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70a44b7a-a63f-4ce2-a87c-26887841730a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:14.322445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:14.447173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-70a44b7a-a63f-4ce2-a87c-26887841730a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:14.457294 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-70a44b7a-a63f-4ce2-a87c-26887841730a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1316 microversion: 2.1 time: 0.261756 Oct 24 10:32:14.463241 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 940/1968] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:14 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:14.481155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-22b06108-61be-4f8e-9278-c3ab77df310a tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-412101610", "metadata": {"image_type": "test"}}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:14.483967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-22b06108-61be-4f8e-9278-c3ab77df310a tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Failed to fetch instance by id tempest-invalid-1759761025 {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 24 10:32:14.484778 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-22b06108-61be-4f8e-9278-c3ab77df310a tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] HTTP exception thrown: Instance tempest-invalid-1759761025 could not be found. Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-22b06108-61be-4f8e-9278-c3ab77df310a tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Request method failure captured: Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/tempest-invalid-1759761025/action HTTP/1.1 Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 111 Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmmGbHpv9OfKPHvwfDnjGazMCGlY8bAlhIPgySkqwubvIJzGrtmNvLnadrqYaJVPzc6DIlQu5fLRg4yKDyukhtFl4UVK_N3fONMbIZPceE5HNPSbOmaCxwjWosubqM9V1A7eA-RET-saa5f0upWZ-YkOn8vYtU5m5zyGGxZXMcMXJwI Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: d3f5d94906264801ab259b0ead015b1a Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:32:14.490249 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:32:14.492559 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d3f5d94906264801ab259b0ead015b1a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:32:14.492559 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:14.492559 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: d3f5d94906264801ab259b0ead015b1a Oct 24 10:32:14.492559 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:14.492559 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesNegativeTestJSON-481426532-project Oct 24 10:32:14.492559 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:32:14.492559 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:32:14.492559 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 28a812a01cad4d2c9fd471279399dd42 Oct 24 10:32:14.492559 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesNegativeTestJSON-481426532-project Oct 24 10:32:14.492559 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:32:14.492559 n-d-858383-15 devstack@n-api.service[120425]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-412101610", "metadata": {"image_type": "test"}}} Oct 24 10:32:14.492559 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:32:14.492559 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance tempest-invalid-1759761025 could not be found. Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'tempest-invalid-1759761025', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-412101610', 'metadata': {'image_type': 'test'}}}} Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1759761025 could not be found. Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:32:14.494085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1759761025 could not be found. Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1759761025 could not be found. Oct 24 10:32:14.495771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:14.497804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-4a2a50c2-09cf-427e-9183-3ac46af2135b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:32:14.497804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-4a2a50c2-09cf-427e-9183-3ac46af2135b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:32:14.497804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-4a2a50c2-09cf-427e-9183-3ac46af2135b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:32:14.497804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-4a2a50c2-09cf-427e-9183-3ac46af2135b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:32:14.498617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-22b06108-61be-4f8e-9278-c3ab77df310a tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Returning 404 to user: Instance tempest-invalid-1759761025 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:32:14.498731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-4a2a50c2-09cf-427e-9183-3ac46af2135b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:32:14.498839 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-22b06108-61be-4f8e-9278-c3ab77df310a tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] 10.222.0.50 "POST /compute/v2.1/servers/tempest-invalid-1759761025/action" status: 404 len: 101 microversion: 2.1 time: 0.031731 Oct 24 10:32:14.499664 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 941/1969] 10.222.0.50 () {60 vars in 1249 bytes} [Mon Oct 24 10:32:14 2022] POST /compute/v2.1/servers/tempest-invalid-1759761025/action => generated 101 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:32:14.504008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:14.506607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d73804a0-e271-4521-b97a-e6cd69684fb0 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:14.507522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d73804a0-e271-4521-b97a-e6cd69684fb0 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:14.516732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d73804a0-e271-4521-b97a-e6cd69684fb0 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:14.517041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a2a50c2-09cf-427e-9183-3ac46af2135b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:14.517295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a2a50c2-09cf-427e-9183-3ac46af2135b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:14.517577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d73804a0-e271-4521-b97a-e6cd69684fb0 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:14.517973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a2a50c2-09cf-427e-9183-3ac46af2135b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:14.518221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d73804a0-e271-4521-b97a-e6cd69684fb0 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:14.521661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d73804a0-e271-4521-b97a-e6cd69684fb0 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:14.522808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d73804a0-e271-4521-b97a-e6cd69684fb0 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:14.523265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d73804a0-e271-4521-b97a-e6cd69684fb0 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:14.529811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a2a50c2-09cf-427e-9183-3ac46af2135b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:14.530716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a2a50c2-09cf-427e-9183-3ac46af2135b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:14.531363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a2a50c2-09cf-427e-9183-3ac46af2135b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:14.550306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:14.567240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-4a2a50c2-09cf-427e-9183-3ac46af2135b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Getting quotas for project 8a3ff02c01a64c9a940de444ca1197c4. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:32:14.576228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-4a2a50c2-09cf-427e-9183-3ac46af2135b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Getting quotas for user 43fd0499bc224bd8b190701a811ee204 and project 8a3ff02c01a64c9a940de444ca1197c4. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:32:14.595424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4a2a50c2-09cf-427e-9183-3ac46af2135b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:32:14.598036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4a2a50c2-09cf-427e-9183-3ac46af2135b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c57db0fe-20a9-44aa-909b-1fe7d0d0642a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:32:14.770065 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4a2a50c2-09cf-427e-9183-3ac46af2135b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.505721 Oct 24 10:32:14.770718 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1029/1970] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:32:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:32:14.863575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d73804a0-e271-4521-b97a-e6cd69684fb0 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:14.877876 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d73804a0-e271-4521-b97a-e6cd69684fb0 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf" status: 200 len: 1365 microversion: 2.1 time: 0.377109 Oct 24 10:32:14.879697 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 942/1971] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:14 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf => generated 1365 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:14.895947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f61a8f62-9526-4a94-9bc7-3b6878531228 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1542001863"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:14.902836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f61a8f62-9526-4a94-9bc7-3b6878531228 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 24 10:32:14.903488 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-f61a8f62-9526-4a94-9bc7-3b6878531228 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f61a8f62-9526-4a94-9bc7-3b6878531228 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Request method failure captured: Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 57 Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmmGbHpv9OfKPHvwfDnjGazMCGlY8bAlhIPgySkqwubvIJzGrtmNvLnadrqYaJVPzc6DIlQu5fLRg4yKDyukhtFl4UVK_N3fONMbIZPceE5HNPSbOmaCxwjWosubqM9V1A7eA-RET-saa5f0upWZ-YkOn8vYtU5m5zyGGxZXMcMXJwI Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: d3f5d94906264801ab259b0ead015b1a Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:32:14.905434 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:32:14.907275 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d3f5d94906264801ab259b0ead015b1a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:32:14.907275 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:14.907275 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: d3f5d94906264801ab259b0ead015b1a Oct 24 10:32:14.907275 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:14.907275 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesNegativeTestJSON-481426532-project Oct 24 10:32:14.907275 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:32:14.907275 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:32:14.907275 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 28a812a01cad4d2c9fd471279399dd42 Oct 24 10:32:14.907275 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesNegativeTestJSON-481426532-project Oct 24 10:32:14.907275 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:32:14.907275 n-d-858383-15 devstack@n-api.service[120425]: {"createImage": {"name": "tempest-test-snap-1542001863"}} Oct 24 10:32:14.907275 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:32:14.907275 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1542001863'}}} Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:32:14.908580 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 10:32:14.910383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:14.912050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f61a8f62-9526-4a94-9bc7-3b6878531228 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:32:14.912050 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f61a8f62-9526-4a94-9bc7-3b6878531228 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] 10.222.0.50 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.026460 Oct 24 10:32:14.917144 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 943/1972] 10.222.0.50 () {60 vars in 1275 bytes} [Mon Oct 24 10:32:14 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:32:14.937955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fca59b9f-34d0-4956-9abb-566603401fb7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:14.939034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fca59b9f-34d0-4956-9abb-566603401fb7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:14.964649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fca59b9f-34d0-4956-9abb-566603401fb7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:14.965422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fca59b9f-34d0-4956-9abb-566603401fb7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:14.969134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fca59b9f-34d0-4956-9abb-566603401fb7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:14.970015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fca59b9f-34d0-4956-9abb-566603401fb7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:14.970753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fca59b9f-34d0-4956-9abb-566603401fb7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:14.971475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fca59b9f-34d0-4956-9abb-566603401fb7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:14.975006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e68597f-47c6-45a3-8d99-87f2ac774050 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'create', calling method: .version_select at 0x7f04d05af820>, body: {"keypair": {"name": "tempest-keypair-1372951817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq7tq+fsf8ZSEmD5QynNEcOpVNPzC5/XJEsAB7xbyOzFrhiU/IgkU81zJ5M/vhN/RjMo+k4GI7QXQa1+ykicsUzWnCcJ8jOMkORpUtOF9AmA8glvjTpcu5IAnq6ZYykww=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:15.015245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-1e68597f-47c6-45a3-8d99-87f2ac774050 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Getting quotas for project 4878c0e43a9d4db8ba5c6590b43624f0. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:32:15.036488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-1e68597f-47c6-45a3-8d99-87f2ac774050 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Getting quotas for user 45500f699a6f463b8755f0417b24151c and project 4878c0e43a9d4db8ba5c6590b43624f0. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:32:15.180270 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1e68597f-47c6-45a3-8d99-87f2ac774050 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.381969 Oct 24 10:32:15.185682 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1030/1973] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:32:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:15.198308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1c9d5b2e-43cb-431a-981b-1f8808a3ea0b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:15.198944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1c9d5b2e-43cb-431a-981b-1f8808a3ea0b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:16.619108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1c9d5b2e-43cb-431a-981b-1f8808a3ea0b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:16.631162 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1c9d5b2e-43cb-431a-981b-1f8808a3ea0b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1207 microversion: 2.1 time: 1.443657 Oct 24 10:32:16.636391 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1031/1974] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:15 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1207 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:16.659423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-29e3b288-b09b-4c85-ad99-a6733e813e87 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1630162732"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:16.665513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-29e3b288-b09b-4c85-ad99-a6733e813e87 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 24 10:32:16.666254 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-29e3b288-b09b-4c85-ad99-a6733e813e87 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-29e3b288-b09b-4c85-ad99-a6733e813e87 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Request method failure captured: Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 57 Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmmGbHpv9OfKPHvwfDnjGazMCGlY8bAlhIPgySkqwubvIJzGrtmNvLnadrqYaJVPzc6DIlQu5fLRg4yKDyukhtFl4UVK_N3fONMbIZPceE5HNPSbOmaCxwjWosubqM9V1A7eA-RET-saa5f0upWZ-YkOn8vYtU5m5zyGGxZXMcMXJwI Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: d3f5d94906264801ab259b0ead015b1a Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:32:16.668137 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:32:16.669984 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d3f5d94906264801ab259b0ead015b1a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:32:16.669984 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:16.669984 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: d3f5d94906264801ab259b0ead015b1a Oct 24 10:32:16.669984 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:16.669984 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesNegativeTestJSON-481426532-project Oct 24 10:32:16.669984 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:32:16.669984 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:32:16.669984 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 28a812a01cad4d2c9fd471279399dd42 Oct 24 10:32:16.669984 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesNegativeTestJSON-481426532-project Oct 24 10:32:16.669984 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:32:16.669984 n-d-858383-15 devstack@n-api.service[120426]: {"createImage": {"name": "tempest-test-snap-1630162732"}} Oct 24 10:32:16.669984 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:32:16.669984 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1630162732'}}} Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:32:16.671167 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 24 10:32:16.672800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:16.679675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-29e3b288-b09b-4c85-ad99-a6733e813e87 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:32:16.681780 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-29e3b288-b09b-4c85-ad99-a6733e813e87 tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] 10.222.0.50 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.043331 Oct 24 10:32:16.686337 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1032/1975] 10.222.0.50 () {60 vars in 1281 bytes} [Mon Oct 24 10:32:16 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:32:16.700297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b6c56dfa-d246-4aea-a47d-2effde719af6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:16.702965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b6c56dfa-d246-4aea-a47d-2effde719af6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:16.725418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6c56dfa-d246-4aea-a47d-2effde719af6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:16.727340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6c56dfa-d246-4aea-a47d-2effde719af6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:16.727963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6c56dfa-d246-4aea-a47d-2effde719af6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:16.728762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6c56dfa-d246-4aea-a47d-2effde719af6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:16.729265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6c56dfa-d246-4aea-a47d-2effde719af6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:16.729727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6c56dfa-d246-4aea-a47d-2effde719af6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:17.312065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b6c56dfa-d246-4aea-a47d-2effde719af6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:17.326732 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b6c56dfa-d246-4aea-a47d-2effde719af6 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1383 microversion: 2.1 time: 0.637381 Oct 24 10:32:17.327913 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1033/1976] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:16 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1383 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:17.343688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fca59b9f-34d0-4956-9abb-566603401fb7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:17.346489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e87910f2-ee7b-4da2-805e-b7f0e50d4ab6 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:17.349089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e87910f2-ee7b-4da2-805e-b7f0e50d4ab6 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:17.370819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e87910f2-ee7b-4da2-805e-b7f0e50d4ab6 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:17.374646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e87910f2-ee7b-4da2-805e-b7f0e50d4ab6 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:17.375780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fca59b9f-34d0-4956-9abb-566603401fb7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:17.377449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e87910f2-ee7b-4da2-805e-b7f0e50d4ab6 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:17.380115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e87910f2-ee7b-4da2-805e-b7f0e50d4ab6 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:17.382428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e87910f2-ee7b-4da2-805e-b7f0e50d4ab6 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:17.383140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e87910f2-ee7b-4da2-805e-b7f0e50d4ab6 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:17.389881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fca59b9f-34d0-4956-9abb-566603401fb7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:17.399712 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fca59b9f-34d0-4956-9abb-566603401fb7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 2.480131 Oct 24 10:32:17.402540 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 944/1977] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:14 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 2485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:17.420695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-de1bef9c-94b1-4f3a-9ae3-a17ef18092a9 req-077a919f-72f7-4179-8207-fcf0c4614cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09308b8-ad10-4557-bb53-7bdf515bbf36", "name": "network-vif-unplugged", "status": "completed", "tag": "9267e901-eb9a-451c-a91f-fcadbd8fa2a9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:17.442578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-de1bef9c-94b1-4f3a-9ae3-a17ef18092a9 req-077a919f-72f7-4179-8207-fcf0c4614cfc service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:17.443682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-de1bef9c-94b1-4f3a-9ae3-a17ef18092a9 req-077a919f-72f7-4179-8207-fcf0c4614cfc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:17.444322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-de1bef9c-94b1-4f3a-9ae3-a17ef18092a9 req-077a919f-72f7-4179-8207-fcf0c4614cfc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:17.476692 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-de1bef9c-94b1-4f3a-9ae3-a17ef18092a9 req-077a919f-72f7-4179-8207-fcf0c4614cfc service nova] Creating event network-vif-unplugged:9267e901-eb9a-451c-a91f-fcadbd8fa2a9 for instance e09308b8-ad10-4557-bb53-7bdf515bbf36 on n-h2-858383-15 Oct 24 10:32:17.487511 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-de1bef9c-94b1-4f3a-9ae3-a17ef18092a9 req-077a919f-72f7-4179-8207-fcf0c4614cfc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080219 Oct 24 10:32:17.489145 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 945/1978] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:17.496346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-81a0e3dc-b754-4817-b5d4-39d00ad3d6af tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:17.497569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-81a0e3dc-b754-4817-b5d4-39d00ad3d6af tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:17.512117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81a0e3dc-b754-4817-b5d4-39d00ad3d6af tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:17.513437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81a0e3dc-b754-4817-b5d4-39d00ad3d6af tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:17.514308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81a0e3dc-b754-4817-b5d4-39d00ad3d6af tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:17.515399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81a0e3dc-b754-4817-b5d4-39d00ad3d6af tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:17.516109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81a0e3dc-b754-4817-b5d4-39d00ad3d6af tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:17.516954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81a0e3dc-b754-4817-b5d4-39d00ad3d6af tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:18.154306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e87910f2-ee7b-4da2-805e-b7f0e50d4ab6 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:18.181474 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e87910f2-ee7b-4da2-805e-b7f0e50d4ab6 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1372 microversion: 2.1 time: 0.835244 Oct 24 10:32:18.184778 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1034/1979] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:17 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1372 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:18.193158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c6dc2d79-f9fa-420e-9cb5-c6ed80c9907c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:18.202801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c6dc2d79-f9fa-420e-9cb5-c6ed80c9907c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] [instance: 1c6b6d52-2b71-42de-8866-e53346845e72] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:18.215717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6dc2d79-f9fa-420e-9cb5-c6ed80c9907c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:18.216469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6dc2d79-f9fa-420e-9cb5-c6ed80c9907c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:18.217130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6dc2d79-f9fa-420e-9cb5-c6ed80c9907c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:18.218095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6dc2d79-f9fa-420e-9cb5-c6ed80c9907c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:18.225588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6dc2d79-f9fa-420e-9cb5-c6ed80c9907c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:18.226520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6dc2d79-f9fa-420e-9cb5-c6ed80c9907c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:18.261866 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-c6dc2d79-f9fa-420e-9cb5-c6ed80c9907c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] HTTP exception thrown: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c6dc2d79-f9fa-420e-9cb5-c6ed80c9907c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Request method failure captured: Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72 HTTP/1.1 Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmmGbHpv9OfKPHvwfDnjGazMCGlY8bAlhIPgySkqwubvIJzGrtmNvLnadrqYaJVPzc6DIlQu5fLRg4yKDyukhtFl4UVK_N3fONMbIZPceE5HNPSbOmaCxwjWosubqM9V1A7eA-RET-saa5f0upWZ-YkOn8vYtU5m5zyGGxZXMcMXJwI Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: d3f5d94906264801ab259b0ead015b1a Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:32:18.268397 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:32:18.270212 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d3f5d94906264801ab259b0ead015b1a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:32:18.270212 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:18.270212 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: d3f5d94906264801ab259b0ead015b1a Oct 24 10:32:18.270212 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:18.270212 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesNegativeTestJSON-481426532-project Oct 24 10:32:18.270212 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:32:18.270212 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:32:18.270212 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 28a812a01cad4d2c9fd471279399dd42 Oct 24 10:32:18.270212 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesNegativeTestJSON-481426532-project Oct 24 10:32:18.270212 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:32:18.270212 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:18.270212 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '1c6b6d52-2b71-42de-8866-e53346845e72'} Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:32:18.271240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:18.273004 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:18.276165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c6dc2d79-f9fa-420e-9cb5-c6ed80c9907c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Returning 404 to user: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:32:18.277453 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c6dc2d79-f9fa-420e-9cb5-c6ed80c9907c tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72" status: 404 len: 111 microversion: 2.1 time: 0.090216 Oct 24 10:32:18.278541 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1035/1980] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:32:18 2022] DELETE /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:32:18.284278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-089ff0a0-e64b-4f8a-ae19-d35fb1ecc9b5 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '.version_select at 0x7f04d04b3550>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:18.289968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-089ff0a0-e64b-4f8a-ae19-d35fb1ecc9b5 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:18.292557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-089ff0a0-e64b-4f8a-ae19-d35fb1ecc9b5 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:18.295304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-089ff0a0-e64b-4f8a-ae19-d35fb1ecc9b5 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:18.326728 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-089ff0a0-e64b-4f8a-ae19-d35fb1ecc9b5 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 2734 microversion: 2.1 time: 0.046838 Oct 24 10:32:18.327645 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1036/1981] 10.222.0.50 () {58 vars in 1143 bytes} [Mon Oct 24 10:32:18 2022] GET /compute/v2.1/os-migrations => generated 2734 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:18.338519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e3501dfb-cc39-46a7-9f6b-5259344ab019 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:18.343934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e3501dfb-cc39-46a7-9f6b-5259344ab019 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:18.361966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3501dfb-cc39-46a7-9f6b-5259344ab019 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:18.362878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3501dfb-cc39-46a7-9f6b-5259344ab019 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:18.363591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3501dfb-cc39-46a7-9f6b-5259344ab019 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:18.364561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3501dfb-cc39-46a7-9f6b-5259344ab019 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:18.365302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3501dfb-cc39-46a7-9f6b-5259344ab019 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:18.365977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3501dfb-cc39-46a7-9f6b-5259344ab019 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:18.395221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-81a0e3dc-b754-4817-b5d4-39d00ad3d6af tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:18.407799 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-81a0e3dc-b754-4817-b5d4-39d00ad3d6af tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf" status: 200 len: 1365 microversion: 2.1 time: 0.917104 Oct 24 10:32:18.423370 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 946/1982] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:17 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf => generated 1365 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:18.439029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-223ff581-2db1-43ef-9501-d662736165dc tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:18.441788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-223ff581-2db1-43ef-9501-d662736165dc tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] [instance: 1c6b6d52-2b71-42de-8866-e53346845e72] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:18.459221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-223ff581-2db1-43ef-9501-d662736165dc tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:18.460254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-223ff581-2db1-43ef-9501-d662736165dc tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:18.461296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-223ff581-2db1-43ef-9501-d662736165dc tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:18.465295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-223ff581-2db1-43ef-9501-d662736165dc tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:18.466934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-223ff581-2db1-43ef-9501-d662736165dc tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:18.468327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-223ff581-2db1-43ef-9501-d662736165dc tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:18.503743 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-223ff581-2db1-43ef-9501-d662736165dc tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] HTTP exception thrown: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-223ff581-2db1-43ef-9501-d662736165dc tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Request method failure captured: Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72 HTTP/1.1 Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmmGbHpv9OfKPHvwfDnjGazMCGlY8bAlhIPgySkqwubvIJzGrtmNvLnadrqYaJVPzc6DIlQu5fLRg4yKDyukhtFl4UVK_N3fONMbIZPceE5HNPSbOmaCxwjWosubqM9V1A7eA-RET-saa5f0upWZ-YkOn8vYtU5m5zyGGxZXMcMXJwI Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: d3f5d94906264801ab259b0ead015b1a Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:32:18.511010 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:32:18.512918 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d3f5d94906264801ab259b0ead015b1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d3f5d94906264801ab259b0ead015b1a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:32:18.512918 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:18.512918 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: d3f5d94906264801ab259b0ead015b1a Oct 24 10:32:18.512918 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-481426532 Oct 24 10:32:18.512918 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesNegativeTestJSON-481426532-project Oct 24 10:32:18.512918 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:32:18.512918 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:32:18.512918 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 28a812a01cad4d2c9fd471279399dd42 Oct 24 10:32:18.512918 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesNegativeTestJSON-481426532-project Oct 24 10:32:18.512918 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:32:18.512918 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:18.512918 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '1c6b6d52-2b71-42de-8866-e53346845e72'} Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:32:18.513868 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:32:18.515892 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:32:18.515892 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:32:18.515892 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:32:18.515892 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:32:18.515892 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:32:18.515892 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:32:18.515892 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:32:18.515892 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:18.515892 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:18.515892 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:18.515892 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:18.515892 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:18.515892 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:18.515892 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:18.515892 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:32:18.515892 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:32:18.515892 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. Oct 24 10:32:18.515892 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:18.517705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-223ff581-2db1-43ef-9501-d662736165dc tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] Returning 404 to user: Instance 1c6b6d52-2b71-42de-8866-e53346845e72 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:32:18.520896 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-223ff581-2db1-43ef-9501-d662736165dc tempest-ImagesNegativeTestJSON-481426532 tempest-ImagesNegativeTestJSON-481426532-project] 10.222.0.50 "GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72" status: 404 len: 111 microversion: 2.1 time: 0.090091 Oct 24 10:32:18.522903 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 947/1983] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:18 2022] GET /compute/v2.1/servers/1c6b6d52-2b71-42de-8866-e53346845e72 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:32:18.536352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31f949fe-1bbb-4505-81e2-02cdb68dab97 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:18.537144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31f949fe-1bbb-4505-81e2-02cdb68dab97 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:18.556577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31f949fe-1bbb-4505-81e2-02cdb68dab97 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:18.557222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31f949fe-1bbb-4505-81e2-02cdb68dab97 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:18.558088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31f949fe-1bbb-4505-81e2-02cdb68dab97 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:18.560357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31f949fe-1bbb-4505-81e2-02cdb68dab97 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:18.562975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31f949fe-1bbb-4505-81e2-02cdb68dab97 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:18.564311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31f949fe-1bbb-4505-81e2-02cdb68dab97 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:18.836191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e3501dfb-cc39-46a7-9f6b-5259344ab019 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:18.850745 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e3501dfb-cc39-46a7-9f6b-5259344ab019 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1267 microversion: 2.1 time: 0.516952 Oct 24 10:32:18.851405 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1037/1984] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:18 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1267 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:18.858270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-902762ce-d6a7-48b4-8e80-fcbf02fe0b97 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:18.863119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-902762ce-d6a7-48b4-8e80-fcbf02fe0b97 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:18.874361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-902762ce-d6a7-48b4-8e80-fcbf02fe0b97 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:18.875175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-902762ce-d6a7-48b4-8e80-fcbf02fe0b97 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:18.879286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-902762ce-d6a7-48b4-8e80-fcbf02fe0b97 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:18.880335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-902762ce-d6a7-48b4-8e80-fcbf02fe0b97 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:18.881269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-902762ce-d6a7-48b4-8e80-fcbf02fe0b97 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:18.881915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-902762ce-d6a7-48b4-8e80-fcbf02fe0b97 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:20.413763 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31f949fe-1bbb-4505-81e2-02cdb68dab97 tempest-LiveMigrationTest-1452246496 tempest-LiveMigrationTest-1452246496-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1536 microversion: 2.1 time: 1.882225 Oct 24 10:32:20.419044 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 948/1985] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:18 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1536 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:20.448051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e44254e5-0643-481c-af3d-45affffc82cc tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:20.450179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e44254e5-0643-481c-af3d-45affffc82cc tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:20.490279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e44254e5-0643-481c-af3d-45affffc82cc tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:20.491832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e44254e5-0643-481c-af3d-45affffc82cc tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:20.500169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e44254e5-0643-481c-af3d-45affffc82cc tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:20.505133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e44254e5-0643-481c-af3d-45affffc82cc tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:20.507088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e44254e5-0643-481c-af3d-45affffc82cc tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:20.512976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e44254e5-0643-481c-af3d-45affffc82cc tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:20.772576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-902762ce-d6a7-48b4-8e80-fcbf02fe0b97 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:20.819290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-902762ce-d6a7-48b4-8e80-fcbf02fe0b97 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:20.824667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-902762ce-d6a7-48b4-8e80-fcbf02fe0b97 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:20.833315 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-902762ce-d6a7-48b4-8e80-fcbf02fe0b97 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 1.977864 Oct 24 10:32:20.840256 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1038/1986] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:18 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:20.875017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b3a76087-96e9-4d12-805a-20d57a66334a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:20.875617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b3a76087-96e9-4d12-805a-20d57a66334a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:20.899706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3a76087-96e9-4d12-805a-20d57a66334a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:20.902204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3a76087-96e9-4d12-805a-20d57a66334a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:20.904922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3a76087-96e9-4d12-805a-20d57a66334a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:20.913007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3a76087-96e9-4d12-805a-20d57a66334a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:20.916961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3a76087-96e9-4d12-805a-20d57a66334a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:20.920042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3a76087-96e9-4d12-805a-20d57a66334a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:21.413618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e44254e5-0643-481c-af3d-45affffc82cc tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:21.427263 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e44254e5-0643-481c-af3d-45affffc82cc tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1372 microversion: 2.1 time: 1.006729 Oct 24 10:32:21.448407 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 949/1987] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:20 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1372 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:21.453368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f891e0a5-463c-452b-be62-0faec5a9dca0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:21.453996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f891e0a5-463c-452b-be62-0faec5a9dca0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:21.473922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f891e0a5-463c-452b-be62-0faec5a9dca0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:21.474557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f891e0a5-463c-452b-be62-0faec5a9dca0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:21.475070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f891e0a5-463c-452b-be62-0faec5a9dca0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:21.475789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f891e0a5-463c-452b-be62-0faec5a9dca0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:21.476255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f891e0a5-463c-452b-be62-0faec5a9dca0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:21.476687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f891e0a5-463c-452b-be62-0faec5a9dca0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:21.563856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:21.598589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:21.776895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b3a76087-96e9-4d12-805a-20d57a66334a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:21.799683 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b3a76087-96e9-4d12-805a-20d57a66334a tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf" status: 200 len: 1365 microversion: 2.1 time: 0.958231 Oct 24 10:32:21.817547 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1039/1988] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:20 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf => generated 1365 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:21.836035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-da7a13f0-a7cb-4858-8911-4ce3499d228e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:21.836956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-da7a13f0-a7cb-4858-8911-4ce3499d228e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:21.850260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da7a13f0-a7cb-4858-8911-4ce3499d228e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:21.851148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da7a13f0-a7cb-4858-8911-4ce3499d228e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:21.851855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da7a13f0-a7cb-4858-8911-4ce3499d228e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:21.853092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da7a13f0-a7cb-4858-8911-4ce3499d228e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:21.853809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da7a13f0-a7cb-4858-8911-4ce3499d228e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:21.854477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da7a13f0-a7cb-4858-8911-4ce3499d228e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:21.916438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-da7a13f0-a7cb-4858-8911-4ce3499d228e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:32:22.158288 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-da7a13f0-a7cb-4858-8911-4ce3499d228e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "DELETE /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 204 len: 0 microversion: 2.1 time: 0.338938 Oct 24 10:32:22.158930 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1040/1989] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:32:21 2022] DELETE /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:32:22.188208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7dbd7b7e-e6bb-4467-92f3-0d64db9bdd34 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:22.188976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7dbd7b7e-e6bb-4467-92f3-0d64db9bdd34 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:22.203185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7dbd7b7e-e6bb-4467-92f3-0d64db9bdd34 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:22.203773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7dbd7b7e-e6bb-4467-92f3-0d64db9bdd34 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:22.204325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7dbd7b7e-e6bb-4467-92f3-0d64db9bdd34 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:22.217178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7dbd7b7e-e6bb-4467-92f3-0d64db9bdd34 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:22.217852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7dbd7b7e-e6bb-4467-92f3-0d64db9bdd34 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:22.219436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7dbd7b7e-e6bb-4467-92f3-0d64db9bdd34 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:22.819318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f891e0a5-463c-452b-be62-0faec5a9dca0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:22.848935 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f891e0a5-463c-452b-be62-0faec5a9dca0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1307 microversion: 2.1 time: 1.396669 Oct 24 10:32:22.852546 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 950/1990] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:21 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1307 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:22.877098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8d5ff8a0-1eb2-4562-b612-1aaf731659bc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:22.878343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8d5ff8a0-1eb2-4562-b612-1aaf731659bc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:22.902917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d5ff8a0-1eb2-4562-b612-1aaf731659bc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:22.904486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d5ff8a0-1eb2-4562-b612-1aaf731659bc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:22.906808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d5ff8a0-1eb2-4562-b612-1aaf731659bc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:22.909998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d5ff8a0-1eb2-4562-b612-1aaf731659bc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:22.911690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d5ff8a0-1eb2-4562-b612-1aaf731659bc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:22.913241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d5ff8a0-1eb2-4562-b612-1aaf731659bc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:24.402831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7dbd7b7e-e6bb-4467-92f3-0d64db9bdd34 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:24.423349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7dbd7b7e-e6bb-4467-92f3-0d64db9bdd34 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:24.426832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7dbd7b7e-e6bb-4467-92f3-0d64db9bdd34 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:24.440520 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7dbd7b7e-e6bb-4467-92f3-0d64db9bdd34 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 2.268934 Oct 24 10:32:24.457727 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1041/1991] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:22 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 2298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:24.475840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b963c062-f103-464a-8e0e-e1684668a099 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-641636748", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c723f9d-e03c-43f2-9281-1f2dfc935187"}], "security_groups": [{"name": "tempest-securitygroup--1423884380"}], "key_name": "tempest-keypair-1372951817", "user_data": "}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:24.534706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8d5ff8a0-1eb2-4562-b612-1aaf731659bc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:24.545036 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8d5ff8a0-1eb2-4562-b612-1aaf731659bc tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1389 microversion: 2.1 time: 1.684463 Oct 24 10:32:24.551249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:24.558115 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 951/1992] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:22 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1389 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:24.567827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e483979f-41d0-4df4-bee4-9db4d29a8971 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:24.575397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e483979f-41d0-4df4-bee4-9db4d29a8971 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:24.583373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e483979f-41d0-4df4-bee4-9db4d29a8971 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:24.583867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e483979f-41d0-4df4-bee4-9db4d29a8971 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:24.584302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e483979f-41d0-4df4-bee4-9db4d29a8971 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:24.589211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e483979f-41d0-4df4-bee4-9db4d29a8971 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:24.589729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e483979f-41d0-4df4-bee4-9db4d29a8971 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:24.590171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e483979f-41d0-4df4-bee4-9db4d29a8971 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:25.159929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e483979f-41d0-4df4-bee4-9db4d29a8971 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:25.176111 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e483979f-41d0-4df4-bee4-9db4d29a8971 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1372 microversion: 2.1 time: 0.613677 Oct 24 10:32:25.189924 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 952/1993] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:24 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1372 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:25.201700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-74191c56-4ab7-4ef5-96ae-d6107c248d24 req-06a48b5e-ee7c-477f-804a-b0aefb04d5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8832f22-83eb-47c3-8597-614ff8f28ecf", "name": "network-vif-plugged", "status": "completed", "tag": "03d79102-62cf-4d9f-a210-b0d94c109df9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:25.213566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-74191c56-4ab7-4ef5-96ae-d6107c248d24 req-06a48b5e-ee7c-477f-804a-b0aefb04d5b1 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:25.214239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-74191c56-4ab7-4ef5-96ae-d6107c248d24 req-06a48b5e-ee7c-477f-804a-b0aefb04d5b1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:25.214835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-74191c56-4ab7-4ef5-96ae-d6107c248d24 req-06a48b5e-ee7c-477f-804a-b0aefb04d5b1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:25.230606 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-74191c56-4ab7-4ef5-96ae-d6107c248d24 req-06a48b5e-ee7c-477f-804a-b0aefb04d5b1 service nova] Creating event network-vif-plugged:03d79102-62cf-4d9f-a210-b0d94c109df9 for instance a8832f22-83eb-47c3-8597-614ff8f28ecf on n-h1-858383-15 Oct 24 10:32:25.244765 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-74191c56-4ab7-4ef5-96ae-d6107c248d24 req-06a48b5e-ee7c-477f-804a-b0aefb04d5b1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047341 Oct 24 10:32:25.245898 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 953/1994] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:25.255234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c4316039-8e03-446e-bd3e-2c63d8b83411 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:25.257654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c4316039-8e03-446e-bd3e-2c63d8b83411 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:25.266325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:25.268401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4316039-8e03-446e-bd3e-2c63d8b83411 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:25.269656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4316039-8e03-446e-bd3e-2c63d8b83411 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:25.270418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4316039-8e03-446e-bd3e-2c63d8b83411 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:25.271830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4316039-8e03-446e-bd3e-2c63d8b83411 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:25.273102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4316039-8e03-446e-bd3e-2c63d8b83411 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:25.273795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4316039-8e03-446e-bd3e-2c63d8b83411 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:25.706931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c4316039-8e03-446e-bd3e-2c63d8b83411 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:25.720336 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c4316039-8e03-446e-bd3e-2c63d8b83411 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf" status: 200 len: 1365 microversion: 2.1 time: 0.472918 Oct 24 10:32:25.723129 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 954/1995] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:25 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf => generated 1365 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:25.734336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-eaf0ad74-9c16-42bd-ae0e-0c9d615835d4 req-3812b7c6-855a-4334-aac4-7736c307da2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7cf3710-4f48-4dca-9dc7-076994a09380", "tag": "b1313db3-8fe7-456f-a606-94713c638edc"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:25.768023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eaf0ad74-9c16-42bd-ae0e-0c9d615835d4 req-3812b7c6-855a-4334-aac4-7736c307da2d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:25.768532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eaf0ad74-9c16-42bd-ae0e-0c9d615835d4 req-3812b7c6-855a-4334-aac4-7736c307da2d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:25.771308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eaf0ad74-9c16-42bd-ae0e-0c9d615835d4 req-3812b7c6-855a-4334-aac4-7736c307da2d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:25.803139 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-eaf0ad74-9c16-42bd-ae0e-0c9d615835d4 req-3812b7c6-855a-4334-aac4-7736c307da2d service nova] Creating event network-changed:b1313db3-8fe7-456f-a606-94713c638edc for instance f7cf3710-4f48-4dca-9dc7-076994a09380 on n-h2-858383-15 Oct 24 10:32:25.817297 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-eaf0ad74-9c16-42bd-ae0e-0c9d615835d4 req-3812b7c6-855a-4334-aac4-7736c307da2d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090218 Oct 24 10:32:25.820889 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 955/1996] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:25.838629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a36d91c1-97af-48f4-8036-085ab2b3a7c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:25.840853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a36d91c1-97af-48f4-8036-085ab2b3a7c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:25.874484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a36d91c1-97af-48f4-8036-085ab2b3a7c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:25.875015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a36d91c1-97af-48f4-8036-085ab2b3a7c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:25.875502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a36d91c1-97af-48f4-8036-085ab2b3a7c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:25.877003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a36d91c1-97af-48f4-8036-085ab2b3a7c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:25.878957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a36d91c1-97af-48f4-8036-085ab2b3a7c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:25.880846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a36d91c1-97af-48f4-8036-085ab2b3a7c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:26.156448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a36d91c1-97af-48f4-8036-085ab2b3a7c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:26.167399 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a36d91c1-97af-48f4-8036-085ab2b3a7c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1307 microversion: 2.1 time: 0.342135 Oct 24 10:32:26.169462 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 956/1997] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:25 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1307 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:26.215173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ab79e9aa-e411-416a-926c-ffe0a19eaa04 req-23021317-240d-46ac-a9d8-1f02f1ecfccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b074ba99-0598-4bba-990f-df73ab74a17a", "tag": "c7fce0f1-82b3-46c9-9179-04bbcc40683f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:26.255467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ab79e9aa-e411-416a-926c-ffe0a19eaa04 req-23021317-240d-46ac-a9d8-1f02f1ecfccd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:26.257044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ab79e9aa-e411-416a-926c-ffe0a19eaa04 req-23021317-240d-46ac-a9d8-1f02f1ecfccd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:26.262041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ab79e9aa-e411-416a-926c-ffe0a19eaa04 req-23021317-240d-46ac-a9d8-1f02f1ecfccd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:26.314174 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ab79e9aa-e411-416a-926c-ffe0a19eaa04 req-23021317-240d-46ac-a9d8-1f02f1ecfccd service nova] Creating event network-changed:c7fce0f1-82b3-46c9-9179-04bbcc40683f for instance b074ba99-0598-4bba-990f-df73ab74a17a on n-h1-858383-15 Oct 24 10:32:26.334667 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ab79e9aa-e411-416a-926c-ffe0a19eaa04 req-23021317-240d-46ac-a9d8-1f02f1ecfccd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163914 Oct 24 10:32:26.342104 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 957/1998] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:26.347939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9294597-83f4-4d44-971b-2e5d310667aa tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:26.359284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f9294597-83f4-4d44-971b-2e5d310667aa tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:26.376946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9294597-83f4-4d44-971b-2e5d310667aa tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:26.377936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9294597-83f4-4d44-971b-2e5d310667aa tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:26.378631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9294597-83f4-4d44-971b-2e5d310667aa tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:26.379648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9294597-83f4-4d44-971b-2e5d310667aa tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:26.380324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9294597-83f4-4d44-971b-2e5d310667aa tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:26.382946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9294597-83f4-4d44-971b-2e5d310667aa tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:26.625485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=12 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:27.129217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f9294597-83f4-4d44-971b-2e5d310667aa tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:27.161045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f9294597-83f4-4d44-971b-2e5d310667aa tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:27.162903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f9294597-83f4-4d44-971b-2e5d310667aa tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:27.168275 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f9294597-83f4-4d44-971b-2e5d310667aa tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.824550 Oct 24 10:32:27.173823 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 958/1999] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:26 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:27.180728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-05dec387-6a48-4492-a1fd-c0655232d365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:27.185675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-05dec387-6a48-4492-a1fd-c0655232d365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:27.201878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05dec387-6a48-4492-a1fd-c0655232d365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:27.202566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05dec387-6a48-4492-a1fd-c0655232d365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:27.205936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05dec387-6a48-4492-a1fd-c0655232d365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:27.208360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05dec387-6a48-4492-a1fd-c0655232d365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:27.209394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05dec387-6a48-4492-a1fd-c0655232d365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:27.212904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05dec387-6a48-4492-a1fd-c0655232d365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:27.427959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-05dec387-6a48-4492-a1fd-c0655232d365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:27.451785 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-05dec387-6a48-4492-a1fd-c0655232d365 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1184 microversion: 2.1 time: 0.276430 Oct 24 10:32:27.452742 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 959/2000] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:27 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1184 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:27.469326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be30593a-e1af-4c8d-bd1b-8781eaa7238c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:27.475358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-be30593a-e1af-4c8d-bd1b-8781eaa7238c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:27.496007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be30593a-e1af-4c8d-bd1b-8781eaa7238c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:27.497599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be30593a-e1af-4c8d-bd1b-8781eaa7238c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:27.498631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be30593a-e1af-4c8d-bd1b-8781eaa7238c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:27.500673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be30593a-e1af-4c8d-bd1b-8781eaa7238c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:27.501621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be30593a-e1af-4c8d-bd1b-8781eaa7238c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:27.513593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be30593a-e1af-4c8d-bd1b-8781eaa7238c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:28.240107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-be30593a-e1af-4c8d-bd1b-8781eaa7238c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:28.252145 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-be30593a-e1af-4c8d-bd1b-8781eaa7238c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1372 microversion: 2.1 time: 0.796452 Oct 24 10:32:28.258581 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 960/2001] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:27 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1372 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:28.280571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e0fe0fe4-883d-4ca9-8c9c-186c15778a40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:28.284349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e0fe0fe4-883d-4ca9-8c9c-186c15778a40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:28.298090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0fe0fe4-883d-4ca9-8c9c-186c15778a40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:28.300800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0fe0fe4-883d-4ca9-8c9c-186c15778a40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:28.302147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0fe0fe4-883d-4ca9-8c9c-186c15778a40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:28.304495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0fe0fe4-883d-4ca9-8c9c-186c15778a40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:28.305141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0fe0fe4-883d-4ca9-8c9c-186c15778a40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:28.306451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0fe0fe4-883d-4ca9-8c9c-186c15778a40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:29.812607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e0fe0fe4-883d-4ca9-8c9c-186c15778a40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:29.828188 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e0fe0fe4-883d-4ca9-8c9c-186c15778a40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf" status: 200 len: 1555 microversion: 2.1 time: 1.567046 Oct 24 10:32:29.852275 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 961/2002] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:28 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf => generated 1555 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:29.865773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a3ae6e36-b305-45a3-8b1a-eb438feb179c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:29.867754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a3ae6e36-b305-45a3-8b1a-eb438feb179c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:29.885362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3ae6e36-b305-45a3-8b1a-eb438feb179c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:29.885921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3ae6e36-b305-45a3-8b1a-eb438feb179c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:29.886373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3ae6e36-b305-45a3-8b1a-eb438feb179c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:29.889617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3ae6e36-b305-45a3-8b1a-eb438feb179c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:29.890661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3ae6e36-b305-45a3-8b1a-eb438feb179c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:29.893516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3ae6e36-b305-45a3-8b1a-eb438feb179c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:29.945856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:30.416606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a3ae6e36-b305-45a3-8b1a-eb438feb179c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:30.430368 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a3ae6e36-b305-45a3-8b1a-eb438feb179c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1307 microversion: 2.1 time: 0.572352 Oct 24 10:32:30.433270 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 962/2003] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:29 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1307 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:30.449056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-51ca4039-d402-440f-90ee-d7f9f7bbd641 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:30.451296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-51ca4039-d402-440f-90ee-d7f9f7bbd641 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:30.469593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51ca4039-d402-440f-90ee-d7f9f7bbd641 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:30.470514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51ca4039-d402-440f-90ee-d7f9f7bbd641 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:30.471696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51ca4039-d402-440f-90ee-d7f9f7bbd641 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:30.474140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51ca4039-d402-440f-90ee-d7f9f7bbd641 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:30.475948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51ca4039-d402-440f-90ee-d7f9f7bbd641 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:30.476556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51ca4039-d402-440f-90ee-d7f9f7bbd641 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:32.003818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-51ca4039-d402-440f-90ee-d7f9f7bbd641 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:32.029547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-51ca4039-d402-440f-90ee-d7f9f7bbd641 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:32.042077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-51ca4039-d402-440f-90ee-d7f9f7bbd641 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:32.063089 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-51ca4039-d402-440f-90ee-d7f9f7bbd641 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 1.627148 Oct 24 10:32:32.073095 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 963/2004] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:30 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:32.101138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c58fb27a-73cd-4452-b085-62aa9a65de5c req-2c98f712-c4bc-4e31-9bcf-ea1ca4f6268a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f4bf2a-de86-44f9-9481-b6591f1e0191", "name": "network-vif-deleted", "tag": "67372bf5-c3c5-4daa-ac37-508ea3a9c66a"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:32.138409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c58fb27a-73cd-4452-b085-62aa9a65de5c req-2c98f712-c4bc-4e31-9bcf-ea1ca4f6268a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:32.138929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c58fb27a-73cd-4452-b085-62aa9a65de5c req-2c98f712-c4bc-4e31-9bcf-ea1ca4f6268a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:32.140592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c58fb27a-73cd-4452-b085-62aa9a65de5c req-2c98f712-c4bc-4e31-9bcf-ea1ca4f6268a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:32.173467 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c58fb27a-73cd-4452-b085-62aa9a65de5c req-2c98f712-c4bc-4e31-9bcf-ea1ca4f6268a service nova] Creating event network-vif-deleted:67372bf5-c3c5-4daa-ac37-508ea3a9c66a for instance 38f4bf2a-de86-44f9-9481-b6591f1e0191 on n-h2-858383-15 Oct 24 10:32:32.183171 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c58fb27a-73cd-4452-b085-62aa9a65de5c req-2c98f712-c4bc-4e31-9bcf-ea1ca4f6268a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107642 Oct 24 10:32:32.183850 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 964/2005] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:32.193165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-96ec55d3-8e36-4b2e-bbf3-8e388833d269 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:32.193899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-96ec55d3-8e36-4b2e-bbf3-8e388833d269 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:32.212090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96ec55d3-8e36-4b2e-bbf3-8e388833d269 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:32.213007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96ec55d3-8e36-4b2e-bbf3-8e388833d269 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:32.215143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96ec55d3-8e36-4b2e-bbf3-8e388833d269 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:32.216174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96ec55d3-8e36-4b2e-bbf3-8e388833d269 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:32.216880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96ec55d3-8e36-4b2e-bbf3-8e388833d269 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:32.218429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96ec55d3-8e36-4b2e-bbf3-8e388833d269 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:32.392743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-96ec55d3-8e36-4b2e-bbf3-8e388833d269 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:32.403768 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-96ec55d3-8e36-4b2e-bbf3-8e388833d269 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1184 microversion: 2.1 time: 0.218722 Oct 24 10:32:32.407554 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 965/2006] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:32 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1184 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:32.413691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef03975a-da8d-45db-b529-cb1121b88a0e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:32.421554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ef03975a-da8d-45db-b529-cb1121b88a0e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:32.437283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef03975a-da8d-45db-b529-cb1121b88a0e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:32.441682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef03975a-da8d-45db-b529-cb1121b88a0e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:32.442455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef03975a-da8d-45db-b529-cb1121b88a0e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:32.448042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef03975a-da8d-45db-b529-cb1121b88a0e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:32.448821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef03975a-da8d-45db-b529-cb1121b88a0e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:32.449588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef03975a-da8d-45db-b529-cb1121b88a0e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:32.750888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ef03975a-da8d-45db-b529-cb1121b88a0e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:32.760729 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef03975a-da8d-45db-b529-cb1121b88a0e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1372 microversion: 2.1 time: 0.350715 Oct 24 10:32:32.766157 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 966/2007] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:32 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1372 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:32.777190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-82871f71-9b85-4637-a952-4dff62c38801 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:32.778135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-82871f71-9b85-4637-a952-4dff62c38801 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:32.793011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82871f71-9b85-4637-a952-4dff62c38801 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:32.797772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82871f71-9b85-4637-a952-4dff62c38801 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:32.804874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82871f71-9b85-4637-a952-4dff62c38801 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:32.807985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82871f71-9b85-4637-a952-4dff62c38801 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:32.809344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82871f71-9b85-4637-a952-4dff62c38801 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:32.810558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82871f71-9b85-4637-a952-4dff62c38801 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:32.959291 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-82871f71-9b85-4637-a952-4dff62c38801 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.191308 Oct 24 10:32:32.969368 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 967/2008] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 10:32:32 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-interface => generated 284 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:32.974703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-945e2b9a-1580-437d-a9c5-b787b1dd3a70 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:32.975694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-945e2b9a-1580-437d-a9c5-b787b1dd3a70 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:32.993371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-945e2b9a-1580-437d-a9c5-b787b1dd3a70 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:32.994735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-945e2b9a-1580-437d-a9c5-b787b1dd3a70 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:33.000463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-945e2b9a-1580-437d-a9c5-b787b1dd3a70 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:33.001853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-945e2b9a-1580-437d-a9c5-b787b1dd3a70 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:33.002627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-945e2b9a-1580-437d-a9c5-b787b1dd3a70 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:33.003346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-945e2b9a-1580-437d-a9c5-b787b1dd3a70 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:33.659642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-945e2b9a-1580-437d-a9c5-b787b1dd3a70 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:33.669561 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-945e2b9a-1580-437d-a9c5-b787b1dd3a70 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1307 microversion: 2.1 time: 0.698572 Oct 24 10:32:33.692167 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 968/2009] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:32 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1307 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:33.698392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7be24b79-7f9c-45fb-ae3b-74c00890bdbb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:33.699498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7be24b79-7f9c-45fb-ae3b-74c00890bdbb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:33.707244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7be24b79-7f9c-45fb-ae3b-74c00890bdbb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:33.708134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7be24b79-7f9c-45fb-ae3b-74c00890bdbb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:33.708866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7be24b79-7f9c-45fb-ae3b-74c00890bdbb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:33.709947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7be24b79-7f9c-45fb-ae3b-74c00890bdbb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:33.710701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7be24b79-7f9c-45fb-ae3b-74c00890bdbb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:33.711372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7be24b79-7f9c-45fb-ae3b-74c00890bdbb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:34.222612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7be24b79-7f9c-45fb-ae3b-74c00890bdbb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:34.241479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7be24b79-7f9c-45fb-ae3b-74c00890bdbb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:34.246273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7be24b79-7f9c-45fb-ae3b-74c00890bdbb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:34.250138 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7be24b79-7f9c-45fb-ae3b-74c00890bdbb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.556442 Oct 24 10:32:34.251448 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 969/2010] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:33 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:34.291476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d19dfa28-222c-4eea-ad75-24bdd76f47ee tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:34.294697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d19dfa28-222c-4eea-ad75-24bdd76f47ee tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:34.314441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d19dfa28-222c-4eea-ad75-24bdd76f47ee tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:34.315313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d19dfa28-222c-4eea-ad75-24bdd76f47ee tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:34.319485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d19dfa28-222c-4eea-ad75-24bdd76f47ee tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:34.321223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d19dfa28-222c-4eea-ad75-24bdd76f47ee tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:34.324565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d19dfa28-222c-4eea-ad75-24bdd76f47ee tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:34.328044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d19dfa28-222c-4eea-ad75-24bdd76f47ee tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:34.407595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:34.459945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d19dfa28-222c-4eea-ad75-24bdd76f47ee tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:34.474110 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d19dfa28-222c-4eea-ad75-24bdd76f47ee tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1184 microversion: 2.1 time: 0.203570 Oct 24 10:32:34.474890 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 970/2011] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:34 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1184 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:34.482959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7e090df8-91fd-4881-940a-5152596ed388 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:34.494883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7e090df8-91fd-4881-940a-5152596ed388 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:34.507210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e090df8-91fd-4881-940a-5152596ed388 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:34.508539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e090df8-91fd-4881-940a-5152596ed388 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:34.510201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e090df8-91fd-4881-940a-5152596ed388 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:34.511299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e090df8-91fd-4881-940a-5152596ed388 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:34.512103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e090df8-91fd-4881-940a-5152596ed388 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:34.514411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:34.516009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e090df8-91fd-4881-940a-5152596ed388 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:34.936495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7e090df8-91fd-4881-940a-5152596ed388 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:34.961113 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7e090df8-91fd-4881-940a-5152596ed388 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1372 microversion: 2.1 time: 0.482578 Oct 24 10:32:34.961922 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 971/2012] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:34 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1372 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:34.975177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e598377-0286-4d2b-81c7-28cb9d19e43e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:34.977574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0e598377-0286-4d2b-81c7-28cb9d19e43e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:34.999057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e598377-0286-4d2b-81c7-28cb9d19e43e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:34.999957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e598377-0286-4d2b-81c7-28cb9d19e43e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:35.003335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e598377-0286-4d2b-81c7-28cb9d19e43e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:35.004573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e598377-0286-4d2b-81c7-28cb9d19e43e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:35.009706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e598377-0286-4d2b-81c7-28cb9d19e43e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:35.010286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e598377-0286-4d2b-81c7-28cb9d19e43e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:35.314321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0e598377-0286-4d2b-81c7-28cb9d19e43e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:35.332646 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e598377-0286-4d2b-81c7-28cb9d19e43e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1307 microversion: 2.1 time: 0.366592 Oct 24 10:32:35.333528 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 972/2013] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:34 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1307 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:36.007309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-767dfd59-2fa4-44b3-b157-930d1ec474cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:36.008482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-767dfd59-2fa4-44b3-b157-930d1ec474cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:36.021344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-767dfd59-2fa4-44b3-b157-930d1ec474cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:36.023323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-767dfd59-2fa4-44b3-b157-930d1ec474cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:36.026305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-767dfd59-2fa4-44b3-b157-930d1ec474cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:36.028660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-767dfd59-2fa4-44b3-b157-930d1ec474cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:36.029693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-767dfd59-2fa4-44b3-b157-930d1ec474cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:36.032528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-767dfd59-2fa4-44b3-b157-930d1ec474cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:36.445786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-767dfd59-2fa4-44b3-b157-930d1ec474cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:36.486255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-767dfd59-2fa4-44b3-b157-930d1ec474cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:36.488507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-767dfd59-2fa4-44b3-b157-930d1ec474cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:36.490259 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-767dfd59-2fa4-44b3-b157-930d1ec474cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 1.153717 Oct 24 10:32:36.530368 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 973/2014] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:35 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:36.539429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10b12294-7e71-4507-a0eb-233cbc45c622 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:36.540243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-10b12294-7e71-4507-a0eb-233cbc45c622 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:36.550993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10b12294-7e71-4507-a0eb-233cbc45c622 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:36.551661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10b12294-7e71-4507-a0eb-233cbc45c622 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:36.552533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10b12294-7e71-4507-a0eb-233cbc45c622 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:36.554079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10b12294-7e71-4507-a0eb-233cbc45c622 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:36.554798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10b12294-7e71-4507-a0eb-233cbc45c622 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:36.555549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10b12294-7e71-4507-a0eb-233cbc45c622 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:36.747063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-10b12294-7e71-4507-a0eb-233cbc45c622 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:36.767342 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10b12294-7e71-4507-a0eb-233cbc45c622 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 200 len: 1184 microversion: 2.1 time: 0.234145 Oct 24 10:32:36.768871 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 974/2015] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:36 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 1184 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:36.788424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b179651c-d7e0-4a1c-b720-b861ee236172 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:36.790059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b179651c-d7e0-4a1c-b720-b861ee236172 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:36.807281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b179651c-d7e0-4a1c-b720-b861ee236172 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:36.810978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b179651c-d7e0-4a1c-b720-b861ee236172 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:36.811993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b179651c-d7e0-4a1c-b720-b861ee236172 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:36.814484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b179651c-d7e0-4a1c-b720-b861ee236172 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:36.815336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b179651c-d7e0-4a1c-b720-b861ee236172 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:36.816219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b179651c-d7e0-4a1c-b720-b861ee236172 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:37.230321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b179651c-d7e0-4a1c-b720-b861ee236172 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:37.266293 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b179651c-d7e0-4a1c-b720-b861ee236172 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1372 microversion: 2.1 time: 0.493276 Oct 24 10:32:37.271073 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 975/2016] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:36 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1372 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:37.284498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8706156c-7649-4f91-8823-5b0aa5e09220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:37.288639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8706156c-7649-4f91-8823-5b0aa5e09220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:37.326843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8706156c-7649-4f91-8823-5b0aa5e09220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:37.327704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8706156c-7649-4f91-8823-5b0aa5e09220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:37.329016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8706156c-7649-4f91-8823-5b0aa5e09220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:37.332290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8706156c-7649-4f91-8823-5b0aa5e09220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:37.333339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8706156c-7649-4f91-8823-5b0aa5e09220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:37.333982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8706156c-7649-4f91-8823-5b0aa5e09220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:37.616302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8706156c-7649-4f91-8823-5b0aa5e09220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:37.644518 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8706156c-7649-4f91-8823-5b0aa5e09220 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1307 microversion: 2.1 time: 0.371859 Oct 24 10:32:37.645007 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 976/2017] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:37 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1307 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:37.668853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d8d7989c-c479-4aa9-9a29-2beca34e9e54 req-c98946e5-f346-448d-9d56-4eed86b2074c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8832f22-83eb-47c3-8597-614ff8f28ecf", "tag": "03d79102-62cf-4d9f-a210-b0d94c109df9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:37.691176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d8d7989c-c479-4aa9-9a29-2beca34e9e54 req-c98946e5-f346-448d-9d56-4eed86b2074c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:37.694816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d8d7989c-c479-4aa9-9a29-2beca34e9e54 req-c98946e5-f346-448d-9d56-4eed86b2074c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:37.695594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d8d7989c-c479-4aa9-9a29-2beca34e9e54 req-c98946e5-f346-448d-9d56-4eed86b2074c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:37.730818 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d8d7989c-c479-4aa9-9a29-2beca34e9e54 req-c98946e5-f346-448d-9d56-4eed86b2074c service nova] Creating event network-changed:03d79102-62cf-4d9f-a210-b0d94c109df9 for instance a8832f22-83eb-47c3-8597-614ff8f28ecf on n-h1-858383-15 Oct 24 10:32:37.737518 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d8d7989c-c479-4aa9-9a29-2beca34e9e54 req-c98946e5-f346-448d-9d56-4eed86b2074c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078029 Oct 24 10:32:37.744267 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 977/2018] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:38.082274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c527c8fa-2ef7-434e-b2d5-f5d731099396 tempest-ListImageFiltersNegativeTestJSON-721651128 tempest-ListImageFiltersNegativeTestJSON-721651128-project] Calling method '.version_select at 0x7f04d503b820>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:39.307877 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-c527c8fa-2ef7-434e-b2d5-f5d731099396 tempest-ListImageFiltersNegativeTestJSON-721651128 tempest-ListImageFiltersNegativeTestJSON-721651128-project] HTTP exception thrown: Image not found. Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c527c8fa-2ef7-434e-b2d5-f5d731099396 tempest-ListImageFiltersNegativeTestJSON-721651128 tempest-ListImageFiltersNegativeTestJSON-721651128-project] Request method failure captured: Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/images/655e19f0-354a-4c56-8eac-80f80f036e8e HTTP/1.1 Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmnF9boSYxB-DjSwmu1x1oLjiFiJnaYm23gXvwxxh4f-EYxhwqnk88l5yIp-_fNQiiWM4Btja4llN82J38wv4GOtCBCwoG532zrWEMFd7mjuGV9WxkhoAZO0Aw-WHvZ5_ZnwN57xfWZ57rHT7CPe9Y4_CR0L0AkMLu1IYUTvxX2VPjA Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: ecfcd5beccda4b2497e13304b7b2d983 Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-721651128 Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:32:39.311798 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:32:39.313564 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ecfcd5beccda4b2497e13304b7b2d983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ecfcd5beccda4b2497e13304b7b2d983"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ecfcd5beccda4b2497e13304b7b2d983"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ecfcd5beccda4b2497e13304b7b2d983", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:32:39.313564 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-721651128 Oct 24 10:32:39.313564 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: ecfcd5beccda4b2497e13304b7b2d983 Oct 24 10:32:39.313564 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-721651128 Oct 24 10:32:39.313564 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ListImageFiltersNegativeTestJSON-721651128-project Oct 24 10:32:39.313564 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:32:39.313564 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:32:39.313564 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 589d1b90abe5492c8b5be7d8e9bb2ad1 Oct 24 10:32:39.313564 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-721651128-project Oct 24 10:32:39.313564 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:32:39.313564 n-d-858383-15 devstack@n-api.service[120425]: exception: Image not found. Oct 24 10:32:39.313564 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '655e19f0-354a-4c56-8eac-80f80f036e8e'} Oct 24 10:32:39.313564 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:32:39.314590 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:39.314590 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:32:39.314590 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:32:39.314590 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:32:39.314590 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:32:39.314590 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:32:39.314590 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:32:39.314590 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:32:39.314590 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:32:39.314590 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:32:39.314590 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:32:39.314590 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:32:39.314590 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:32:39.314590 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:32:39.314590 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:32:39.314590 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:32:39.314590 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:32:39.314590 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 655e19f0-354a-4c56-8eac-80f80f036e8e Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:32:39.315973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 655e19f0-354a-4c56-8eac-80f80f036e8e could not be found. Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:32:39.318368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:32:39.321435 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:32:39.321435 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:32:39.321435 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 24 10:32:39.321435 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 10:32:39.321435 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:32:39.321435 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:39.321435 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:39.321435 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:39.321435 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:39.321435 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:39.321435 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:39.321435 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:32:39.321435 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:32:39.321435 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:32:39.321435 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:32:39.326505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c527c8fa-2ef7-434e-b2d5-f5d731099396 tempest-ListImageFiltersNegativeTestJSON-721651128 tempest-ListImageFiltersNegativeTestJSON-721651128-project] Returning 404 to user: Image not found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:32:39.327904 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c527c8fa-2ef7-434e-b2d5-f5d731099396 tempest-ListImageFiltersNegativeTestJSON-721651128 tempest-ListImageFiltersNegativeTestJSON-721651128-project] 10.222.0.50 "GET /compute/v2.1/images/655e19f0-354a-4c56-8eac-80f80f036e8e" status: 404 len: 62 microversion: 2.1 time: 1.581552 Oct 24 10:32:39.334027 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 978/2019] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:32:37 2022] GET /compute/v2.1/images/655e19f0-354a-4c56-8eac-80f80f036e8e => generated 62 bytes in 1589 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:32:39.450627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-b963c062-f103-464a-8e0e-e1684668a099 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] validate_networks() for [('4c723f9d-e03c-43f2-9281-1f2dfc935187', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:32:39.477047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1ccac3c6-b202-40f7-be14-fe180714740d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2069888233", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "e51243f1-b3f3-4576-87c2-d84ddd5e63e0"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:39.593634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-1ccac3c6-b202-40f7-be14-fe180714740d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] validate_networks() for [('e51243f1-b3f3-4576-87c2-d84ddd5e63e0', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:32:41.033186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1ccac3c6-b202-40f7-be14-fe180714740d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:32:41.034731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1ccac3c6-b202-40f7-be14-fe180714740d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:32:41.035528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1ccac3c6-b202-40f7-be14-fe180714740d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:32:41.036296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1ccac3c6-b202-40f7-be14-fe180714740d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:32:41.036976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1ccac3c6-b202-40f7-be14-fe180714740d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:32:41.058169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ccac3c6-b202-40f7-be14-fe180714740d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:41.061350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ccac3c6-b202-40f7-be14-fe180714740d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:41.062786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ccac3c6-b202-40f7-be14-fe180714740d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:41.065264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ccac3c6-b202-40f7-be14-fe180714740d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:41.067287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ccac3c6-b202-40f7-be14-fe180714740d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:41.077899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ccac3c6-b202-40f7-be14-fe180714740d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:41.103539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b963c062-f103-464a-8e0e-e1684668a099 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:32:41.104305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b963c062-f103-464a-8e0e-e1684668a099 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:32:41.105029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b963c062-f103-464a-8e0e-e1684668a099 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:32:41.105733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b963c062-f103-464a-8e0e-e1684668a099 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:32:41.107024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b963c062-f103-464a-8e0e-e1684668a099 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:32:41.132205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b963c062-f103-464a-8e0e-e1684668a099 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:41.132693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b963c062-f103-464a-8e0e-e1684668a099 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:41.133512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b963c062-f103-464a-8e0e-e1684668a099 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:41.135296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b963c062-f103-464a-8e0e-e1684668a099 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:41.136498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b963c062-f103-464a-8e0e-e1684668a099 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:41.137246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b963c062-f103-464a-8e0e-e1684668a099 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:41.146426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-1ccac3c6-b202-40f7-be14-fe180714740d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Getting quotas for project 95e37b041665467ab7b778324710c1c0. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:32:41.153866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-1ccac3c6-b202-40f7-be14-fe180714740d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Getting quotas for user 7f7bd36a563d4b4189301434f7f9bdba and project 95e37b041665467ab7b778324710c1c0. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:32:41.171190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1ccac3c6-b202-40f7-be14-fe180714740d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:32:41.175157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1ccac3c6-b202-40f7-be14-fe180714740d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:32:41.180641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-b963c062-f103-464a-8e0e-e1684668a099 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Getting quotas for project 4878c0e43a9d4db8ba5c6590b43624f0. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:32:41.198561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-b963c062-f103-464a-8e0e-e1684668a099 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Getting quotas for user 45500f699a6f463b8755f0417b24151c and project 4878c0e43a9d4db8ba5c6590b43624f0. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:32:41.210265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b963c062-f103-464a-8e0e-e1684668a099 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:32:41.215158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b963c062-f103-464a-8e0e-e1684668a099 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:32:41.288195 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1ccac3c6-b202-40f7-be14-fe180714740d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.952131 Oct 24 10:32:41.290048 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 979/2020] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:32:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:32:41.302154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-997499b1-67ae-41c1-a74b-3842ec727acd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:41.319408 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b963c062-f103-464a-8e0e-e1684668a099 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 16.860061 Oct 24 10:32:41.323449 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1042/2021] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:32:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 16865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:32:41.336752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-91101664-0e3f-4a96-9092-4104cce0ee5e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:41.338525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-91101664-0e3f-4a96-9092-4104cce0ee5e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 38f4bf2a-de86-44f9-9481-b6591f1e0191] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:41.353818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-997499b1-67ae-41c1-a74b-3842ec727acd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:41.354887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91101664-0e3f-4a96-9092-4104cce0ee5e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:41.358747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91101664-0e3f-4a96-9092-4104cce0ee5e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:41.359761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91101664-0e3f-4a96-9092-4104cce0ee5e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:41.360774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91101664-0e3f-4a96-9092-4104cce0ee5e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:41.361543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91101664-0e3f-4a96-9092-4104cce0ee5e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:41.363057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91101664-0e3f-4a96-9092-4104cce0ee5e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:41.382968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-997499b1-67ae-41c1-a74b-3842ec727acd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:41.383348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-997499b1-67ae-41c1-a74b-3842ec727acd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:41.387182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-997499b1-67ae-41c1-a74b-3842ec727acd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:41.389696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-997499b1-67ae-41c1-a74b-3842ec727acd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:41.394543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-997499b1-67ae-41c1-a74b-3842ec727acd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:41.395347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-997499b1-67ae-41c1-a74b-3842ec727acd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:41.396964 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-91101664-0e3f-4a96-9092-4104cce0ee5e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] HTTP exception thrown: Instance 38f4bf2a-de86-44f9-9481-b6591f1e0191 could not be found. Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-91101664-0e3f-4a96-9092-4104cce0ee5e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Request method failure captured: Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 HTTP/1.1 Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmgAI56ixX3LxgS7Ly-9n4q3huK4pYbld15OoCOex2Vf6Wku9STLKIRlZZ1d5nk_VUwGgN4V57lhzJHNDCb73Tn0ifTsKK6YRDPQ5jbKjKGMnQfE-Xi3pf6JmeXvaJwkuti6S33B5nt95lgzwThhG-3q84dQ-AyCluRwSJeYme1sFLs Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 115025f23db94a71b74b6adbc536792f Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-LiveMigrationTest-1696265939 Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:32:41.403540 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:32:41.405400 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/115025f23db94a71b74b6adbc536792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/115025f23db94a71b74b6adbc536792f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/115025f23db94a71b74b6adbc536792f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_115025f23db94a71b74b6adbc536792f", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:32:41.405400 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-LiveMigrationTest-1696265939 Oct 24 10:32:41.405400 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 115025f23db94a71b74b6adbc536792f Oct 24 10:32:41.405400 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-LiveMigrationTest-1696265939 Oct 24 10:32:41.405400 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-LiveMigrationTest-1696265939-project Oct 24 10:32:41.405400 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:32:41.405400 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:32:41.405400 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 176a68ea281e4f65bbeac67cc304468d Oct 24 10:32:41.405400 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-LiveMigrationTest-1696265939-project Oct 24 10:32:41.405400 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:32:41.405400 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 38f4bf2a-de86-44f9-9481-b6591f1e0191 could not be found. Oct 24 10:32:41.405400 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '38f4bf2a-de86-44f9-9481-b6591f1e0191'} Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38f4bf2a-de86-44f9-9481-b6591f1e0191 could not be found. Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:32:41.407171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:32:41.411564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:32:41.411564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:32:41.411564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:32:41.411564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:32:41.411564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:32:41.411564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:32:41.411564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:32:41.411564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38f4bf2a-de86-44f9-9481-b6591f1e0191 could not be found. Oct 24 10:32:41.411564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:41.411564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:41.411564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:41.411564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:41.411564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:41.411564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:41.411564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:32:41.411564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:32:41.411564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38f4bf2a-de86-44f9-9481-b6591f1e0191 could not be found. Oct 24 10:32:41.411564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:41.417495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-91101664-0e3f-4a96-9092-4104cce0ee5e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Returning 404 to user: Instance 38f4bf2a-de86-44f9-9481-b6591f1e0191 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:32:41.419352 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-91101664-0e3f-4a96-9092-4104cce0ee5e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191" status: 404 len: 111 microversion: 2.1 time: 0.091496 Oct 24 10:32:41.423930 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1043/2022] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:41 2022] GET /compute/v2.1/servers/38f4bf2a-de86-44f9-9481-b6591f1e0191 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:32:41.453597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6f37b7e9-ce5d-4df1-ae5d-367bb6d2457c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:41.457525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6f37b7e9-ce5d-4df1-ae5d-367bb6d2457c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:41.485642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f37b7e9-ce5d-4df1-ae5d-367bb6d2457c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:41.495267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f37b7e9-ce5d-4df1-ae5d-367bb6d2457c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:41.496889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f37b7e9-ce5d-4df1-ae5d-367bb6d2457c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:41.498761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f37b7e9-ce5d-4df1-ae5d-367bb6d2457c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:41.503543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f37b7e9-ce5d-4df1-ae5d-367bb6d2457c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:41.505385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f37b7e9-ce5d-4df1-ae5d-367bb6d2457c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:42.155481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6f37b7e9-ce5d-4df1-ae5d-367bb6d2457c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:42.167912 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6f37b7e9-ce5d-4df1-ae5d-367bb6d2457c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1372 microversion: 2.1 time: 0.729859 Oct 24 10:32:42.168556 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1044/2023] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:41 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1372 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:42.191557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-997499b1-67ae-41c1-a74b-3842ec727acd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:42.195722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a59009e0-8c36-4ba8-af6f-e8543bf7b14a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:42.199812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a59009e0-8c36-4ba8-af6f-e8543bf7b14a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:42.207580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a59009e0-8c36-4ba8-af6f-e8543bf7b14a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:42.208352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a59009e0-8c36-4ba8-af6f-e8543bf7b14a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:42.209008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a59009e0-8c36-4ba8-af6f-e8543bf7b14a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:42.210200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-997499b1-67ae-41c1-a74b-3842ec727acd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:42.211077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a59009e0-8c36-4ba8-af6f-e8543bf7b14a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:42.211738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-997499b1-67ae-41c1-a74b-3842ec727acd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:42.213022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a59009e0-8c36-4ba8-af6f-e8543bf7b14a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:42.221417 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-997499b1-67ae-41c1-a74b-3842ec727acd tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.929819 Oct 24 10:32:42.222100 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 980/2024] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:41 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:42.224828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a59009e0-8c36-4ba8-af6f-e8543bf7b14a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:42.257867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-27151d84-0221-4913-9cd6-5c23c09b8c72 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:42.258531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-27151d84-0221-4913-9cd6-5c23c09b8c72 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:42.348385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-27151d84-0221-4913-9cd6-5c23c09b8c72 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7bd36a563d4b4189301434f7f9bdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e37b041665467ab7b778324710c1c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:42.358466 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-27151d84-0221-4913-9cd6-5c23c09b8c72 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 200 len: 1224 microversion: 2.1 time: 0.111998 Oct 24 10:32:42.360135 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 981/2025] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:42 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 1224 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:42.365901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5d7fe11e-3fd8-4bb1-9f2f-2993443b6c3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:42.367482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5d7fe11e-3fd8-4bb1-9f2f-2993443b6c3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:42.458090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5d7fe11e-3fd8-4bb1-9f2f-2993443b6c3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:42.471294 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5d7fe11e-3fd8-4bb1-9f2f-2993443b6c3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1238 microversion: 2.1 time: 0.109504 Oct 24 10:32:42.474194 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 982/2026] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:42 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1238 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:42.809859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a59009e0-8c36-4ba8-af6f-e8543bf7b14a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:42.820040 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a59009e0-8c36-4ba8-af6f-e8543bf7b14a tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1307 microversion: 2.1 time: 0.628777 Oct 24 10:32:42.829789 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1045/2027] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:42 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1307 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:43.191961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-934648d4-e7bc-41be-b001-ffde7e446c88 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:43.193505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-934648d4-e7bc-41be-b001-ffde7e446c88 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:43.206722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-934648d4-e7bc-41be-b001-ffde7e446c88 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:43.208144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-934648d4-e7bc-41be-b001-ffde7e446c88 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:43.209859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-934648d4-e7bc-41be-b001-ffde7e446c88 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:43.211770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-934648d4-e7bc-41be-b001-ffde7e446c88 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:43.213151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-934648d4-e7bc-41be-b001-ffde7e446c88 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:43.230255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-934648d4-e7bc-41be-b001-ffde7e446c88 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:43.260719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e0f6f0f5-f0bd-4bea-b0d1-38fe3430ca8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:43.265006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e0f6f0f5-f0bd-4bea-b0d1-38fe3430ca8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:43.311239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0f6f0f5-f0bd-4bea-b0d1-38fe3430ca8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:43.311779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0f6f0f5-f0bd-4bea-b0d1-38fe3430ca8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:43.312235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0f6f0f5-f0bd-4bea-b0d1-38fe3430ca8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:43.317400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0f6f0f5-f0bd-4bea-b0d1-38fe3430ca8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:43.322170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0f6f0f5-f0bd-4bea-b0d1-38fe3430ca8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:43.323320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0f6f0f5-f0bd-4bea-b0d1-38fe3430ca8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:43.727337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-934648d4-e7bc-41be-b001-ffde7e446c88 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:43.748325 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-934648d4-e7bc-41be-b001-ffde7e446c88 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1372 microversion: 2.1 time: 0.560841 Oct 24 10:32:43.752073 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 983/2028] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:43 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1372 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:43.760407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e44a0b8-3961-4c33-93e9-7d90f4078fe2 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:43.761468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5e44a0b8-3961-4c33-93e9-7d90f4078fe2 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:43.791075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e44a0b8-3961-4c33-93e9-7d90f4078fe2 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:43.792332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e44a0b8-3961-4c33-93e9-7d90f4078fe2 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:43.793814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e44a0b8-3961-4c33-93e9-7d90f4078fe2 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:43.795102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e44a0b8-3961-4c33-93e9-7d90f4078fe2 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:43.796019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e44a0b8-3961-4c33-93e9-7d90f4078fe2 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:43.798813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e44a0b8-3961-4c33-93e9-7d90f4078fe2 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:43.873216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:43.958885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e0f6f0f5-f0bd-4bea-b0d1-38fe3430ca8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:43.979395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e0f6f0f5-f0bd-4bea-b0d1-38fe3430ca8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:43.983626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e0f6f0f5-f0bd-4bea-b0d1-38fe3430ca8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:44.001554 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e0f6f0f5-f0bd-4bea-b0d1-38fe3430ca8f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.749026 Oct 24 10:32:44.002167 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1046/2029] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:43 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:44.033060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dbaf4822-72ec-4cb3-8be5-6503e150cc3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:44.041064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dbaf4822-72ec-4cb3-8be5-6503e150cc3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:44.074443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbaf4822-72ec-4cb3-8be5-6503e150cc3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:44.078497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbaf4822-72ec-4cb3-8be5-6503e150cc3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:44.083235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbaf4822-72ec-4cb3-8be5-6503e150cc3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:44.086498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbaf4822-72ec-4cb3-8be5-6503e150cc3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:44.088434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbaf4822-72ec-4cb3-8be5-6503e150cc3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:44.092450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbaf4822-72ec-4cb3-8be5-6503e150cc3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:44.102469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5e44a0b8-3961-4c33-93e9-7d90f4078fe2 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7bd36a563d4b4189301434f7f9bdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e37b041665467ab7b778324710c1c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:44.122338 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5e44a0b8-3961-4c33-93e9-7d90f4078fe2 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 200 len: 1220 microversion: 2.1 time: 0.367683 Oct 24 10:32:44.142228 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 984/2030] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:43 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 1220 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:44.163771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1702284d-02bb-446b-ab90-f44cb77dafc1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:44.167157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1702284d-02bb-446b-ab90-f44cb77dafc1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:44.199208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1702284d-02bb-446b-ab90-f44cb77dafc1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:44.204347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1702284d-02bb-446b-ab90-f44cb77dafc1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:44.205883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1702284d-02bb-446b-ab90-f44cb77dafc1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:44.210800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1702284d-02bb-446b-ab90-f44cb77dafc1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:44.212214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1702284d-02bb-446b-ab90-f44cb77dafc1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:44.214671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1702284d-02bb-446b-ab90-f44cb77dafc1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:44.398686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dbaf4822-72ec-4cb3-8be5-6503e150cc3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:44.409096 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dbaf4822-72ec-4cb3-8be5-6503e150cc3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1290 microversion: 2.1 time: 0.405778 Oct 24 10:32:44.415033 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1047/2031] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:44 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1290 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:44.554222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-6518415f-845a-4996-b82c-253a49a7c2a3 req-27870e9e-bcca-445d-afc8-2e508df24be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7cf3710-4f48-4dca-9dc7-076994a09380", "name": "network-vif-plugged", "status": "completed", "tag": "b1313db3-8fe7-456f-a606-94713c638edc"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:44.589154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6518415f-845a-4996-b82c-253a49a7c2a3 req-27870e9e-bcca-445d-afc8-2e508df24be1 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:44.589657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6518415f-845a-4996-b82c-253a49a7c2a3 req-27870e9e-bcca-445d-afc8-2e508df24be1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:44.590106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6518415f-845a-4996-b82c-253a49a7c2a3 req-27870e9e-bcca-445d-afc8-2e508df24be1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:44.654524 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-6518415f-845a-4996-b82c-253a49a7c2a3 req-27870e9e-bcca-445d-afc8-2e508df24be1 service nova] Creating event network-vif-plugged:b1313db3-8fe7-456f-a606-94713c638edc for instance f7cf3710-4f48-4dca-9dc7-076994a09380 on n-h2-858383-15 Oct 24 10:32:44.669450 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-6518415f-845a-4996-b82c-253a49a7c2a3 req-27870e9e-bcca-445d-afc8-2e508df24be1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128708 Oct 24 10:32:44.672556 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1048/2032] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:32:44.783257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cd13dad6-4d76-4d7b-8c7a-55d7c9dbefaa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:44.784530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cd13dad6-4d76-4d7b-8c7a-55d7c9dbefaa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:44.796158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd13dad6-4d76-4d7b-8c7a-55d7c9dbefaa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:44.796672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd13dad6-4d76-4d7b-8c7a-55d7c9dbefaa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:44.797412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd13dad6-4d76-4d7b-8c7a-55d7c9dbefaa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:44.798338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd13dad6-4d76-4d7b-8c7a-55d7c9dbefaa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:44.798977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd13dad6-4d76-4d7b-8c7a-55d7c9dbefaa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:44.799643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd13dad6-4d76-4d7b-8c7a-55d7c9dbefaa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:44.843502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1702284d-02bb-446b-ab90-f44cb77dafc1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:44.872002 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1702284d-02bb-446b-ab90-f44cb77dafc1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1307 microversion: 2.1 time: 0.728554 Oct 24 10:32:44.872616 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 985/2033] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:44 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1307 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:45.029739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e59fdc2b-264b-4896-a6f4-9c91dcf0d336 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:45.030438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e59fdc2b-264b-4896-a6f4-9c91dcf0d336 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:45.048180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e59fdc2b-264b-4896-a6f4-9c91dcf0d336 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:45.050249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e59fdc2b-264b-4896-a6f4-9c91dcf0d336 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:45.051634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e59fdc2b-264b-4896-a6f4-9c91dcf0d336 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:45.054471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e59fdc2b-264b-4896-a6f4-9c91dcf0d336 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:45.055674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e59fdc2b-264b-4896-a6f4-9c91dcf0d336 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:45.060459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e59fdc2b-264b-4896-a6f4-9c91dcf0d336 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:45.258856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cd13dad6-4d76-4d7b-8c7a-55d7c9dbefaa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:45.267593 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cd13dad6-4d76-4d7b-8c7a-55d7c9dbefaa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1372 microversion: 2.1 time: 0.490710 Oct 24 10:32:45.268195 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1049/2034] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:44 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1372 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:45.281256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-15c221ab-5996-4506-bd7e-d854ef72bb6a tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:45.282260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-15c221ab-5996-4506-bd7e-d854ef72bb6a tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:45.299783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15c221ab-5996-4506-bd7e-d854ef72bb6a tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:45.300284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15c221ab-5996-4506-bd7e-d854ef72bb6a tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:45.300950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15c221ab-5996-4506-bd7e-d854ef72bb6a tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:45.302554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15c221ab-5996-4506-bd7e-d854ef72bb6a tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:45.303207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15c221ab-5996-4506-bd7e-d854ef72bb6a tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:45.303835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15c221ab-5996-4506-bd7e-d854ef72bb6a tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:45.332963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e59fdc2b-264b-4896-a6f4-9c91dcf0d336 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:45.343319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e59fdc2b-264b-4896-a6f4-9c91dcf0d336 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:45.344781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e59fdc2b-264b-4896-a6f4-9c91dcf0d336 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:45.346611 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e59fdc2b-264b-4896-a6f4-9c91dcf0d336 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.322769 Oct 24 10:32:45.347782 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 986/2035] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:45 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:45.424364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-15c221ab-5996-4506-bd7e-d854ef72bb6a tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7bd36a563d4b4189301434f7f9bdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e37b041665467ab7b778324710c1c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:45.441805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fd45bdbb-84a7-4630-bbc7-d8b5ce5d975d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:45.442728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fd45bdbb-84a7-4630-bbc7-d8b5ce5d975d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:45.455433 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-15c221ab-5996-4506-bd7e-d854ef72bb6a tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 200 len: 1276 microversion: 2.1 time: 0.183515 Oct 24 10:32:45.456376 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1050/2036] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:45 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:45.457305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd45bdbb-84a7-4630-bbc7-d8b5ce5d975d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:45.458047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd45bdbb-84a7-4630-bbc7-d8b5ce5d975d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:45.458817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd45bdbb-84a7-4630-bbc7-d8b5ce5d975d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:45.459750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd45bdbb-84a7-4630-bbc7-d8b5ce5d975d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:45.460543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd45bdbb-84a7-4630-bbc7-d8b5ce5d975d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:45.461328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd45bdbb-84a7-4630-bbc7-d8b5ce5d975d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:45.553041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fd45bdbb-84a7-4630-bbc7-d8b5ce5d975d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:45.563250 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fd45bdbb-84a7-4630-bbc7-d8b5ce5d975d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1296 microversion: 2.1 time: 0.126840 Oct 24 10:32:45.564280 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 987/2037] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:45 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1296 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:45.897481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c90c92f9-dd7f-4768-9224-4f3847c2f40d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:45.898639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c90c92f9-dd7f-4768-9224-4f3847c2f40d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:45.915250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c90c92f9-dd7f-4768-9224-4f3847c2f40d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:45.916814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c90c92f9-dd7f-4768-9224-4f3847c2f40d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:45.917647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c90c92f9-dd7f-4768-9224-4f3847c2f40d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:45.918712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c90c92f9-dd7f-4768-9224-4f3847c2f40d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:45.919401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c90c92f9-dd7f-4768-9224-4f3847c2f40d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:45.920142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c90c92f9-dd7f-4768-9224-4f3847c2f40d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:46.294793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-398a13ec-2d7f-43f9-8bb3-a10e81c30c17 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:46.297561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-398a13ec-2d7f-43f9-8bb3-a10e81c30c17 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:46.315852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-398a13ec-2d7f-43f9-8bb3-a10e81c30c17 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:46.328543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-398a13ec-2d7f-43f9-8bb3-a10e81c30c17 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:46.329277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-398a13ec-2d7f-43f9-8bb3-a10e81c30c17 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:46.330219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-398a13ec-2d7f-43f9-8bb3-a10e81c30c17 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:46.331353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-398a13ec-2d7f-43f9-8bb3-a10e81c30c17 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:46.331810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-398a13ec-2d7f-43f9-8bb3-a10e81c30c17 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:46.745195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c90c92f9-dd7f-4768-9224-4f3847c2f40d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:46.761100 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c90c92f9-dd7f-4768-9224-4f3847c2f40d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1307 microversion: 2.1 time: 0.861089 Oct 24 10:32:46.763977 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1051/2038] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:45 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1307 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:46.784255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-40f459ee-8f84-47d0-ae54-4b7527265f04 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:46.785412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-40f459ee-8f84-47d0-ae54-4b7527265f04 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:46.795554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40f459ee-8f84-47d0-ae54-4b7527265f04 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:46.797472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40f459ee-8f84-47d0-ae54-4b7527265f04 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:46.799412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40f459ee-8f84-47d0-ae54-4b7527265f04 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:46.800389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40f459ee-8f84-47d0-ae54-4b7527265f04 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:46.802731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40f459ee-8f84-47d0-ae54-4b7527265f04 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:46.803552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40f459ee-8f84-47d0-ae54-4b7527265f04 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:47.389451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-398a13ec-2d7f-43f9-8bb3-a10e81c30c17 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:47.399997 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-398a13ec-2d7f-43f9-8bb3-a10e81c30c17 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1372 microversion: 2.1 time: 1.111090 Oct 24 10:32:47.400775 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 988/2039] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:46 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1372 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:32:47.406629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b319b16b-793e-44cd-b798-ffcec059c39f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:47.407332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b319b16b-793e-44cd-b798-ffcec059c39f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:47.415743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b319b16b-793e-44cd-b798-ffcec059c39f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:47.416243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b319b16b-793e-44cd-b798-ffcec059c39f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:47.416692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b319b16b-793e-44cd-b798-ffcec059c39f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:47.417454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b319b16b-793e-44cd-b798-ffcec059c39f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:47.417908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b319b16b-793e-44cd-b798-ffcec059c39f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:47.421435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b319b16b-793e-44cd-b798-ffcec059c39f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:47.609315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-40f459ee-8f84-47d0-ae54-4b7527265f04 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:47.635072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-40f459ee-8f84-47d0-ae54-4b7527265f04 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:47.636729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-40f459ee-8f84-47d0-ae54-4b7527265f04 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:47.638116 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-40f459ee-8f84-47d0-ae54-4b7527265f04 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.872898 Oct 24 10:32:47.642309 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1052/2040] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:46 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:47.653084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d01cf736-a482-4a2e-a42b-3951d76932fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:47.653890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d01cf736-a482-4a2e-a42b-3951d76932fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:47.668885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d01cf736-a482-4a2e-a42b-3951d76932fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:47.670948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d01cf736-a482-4a2e-a42b-3951d76932fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:47.673031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d01cf736-a482-4a2e-a42b-3951d76932fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:47.674885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d01cf736-a482-4a2e-a42b-3951d76932fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:47.676805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d01cf736-a482-4a2e-a42b-3951d76932fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:47.678774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d01cf736-a482-4a2e-a42b-3951d76932fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:47.907731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b319b16b-793e-44cd-b798-ffcec059c39f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7bd36a563d4b4189301434f7f9bdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e37b041665467ab7b778324710c1c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:47.927229 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b319b16b-793e-44cd-b798-ffcec059c39f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 200 len: 1282 microversion: 2.1 time: 0.524477 Oct 24 10:32:47.927884 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 989/2041] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:47 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 1282 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:47.932493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-7c9b673f-2fa6-4474-9503-5f350f47b52d req-2b2246c6-c960-4371-9610-5f7c57e1cc38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513ca608-24c9-45f9-8fb9-e231d92c7262", "tag": "b2def801-647c-479d-9e34-cb0b4d60448e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:47.955406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7c9b673f-2fa6-4474-9503-5f350f47b52d req-2b2246c6-c960-4371-9610-5f7c57e1cc38 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:47.955901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7c9b673f-2fa6-4474-9503-5f350f47b52d req-2b2246c6-c960-4371-9610-5f7c57e1cc38 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:47.956346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7c9b673f-2fa6-4474-9503-5f350f47b52d req-2b2246c6-c960-4371-9610-5f7c57e1cc38 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:47.976550 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-7c9b673f-2fa6-4474-9503-5f350f47b52d req-2b2246c6-c960-4371-9610-5f7c57e1cc38 service nova] Creating event network-changed:b2def801-647c-479d-9e34-cb0b4d60448e for instance 513ca608-24c9-45f9-8fb9-e231d92c7262 on n-h2-858383-15 Oct 24 10:32:47.989844 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-7c9b673f-2fa6-4474-9503-5f350f47b52d req-2b2246c6-c960-4371-9610-5f7c57e1cc38 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060716 Oct 24 10:32:47.990771 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 990/2042] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:47.996122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2a43093a-7160-4442-8109-3e1a38fb9745 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:48.010749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2a43093a-7160-4442-8109-3e1a38fb9745 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:48.017311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a43093a-7160-4442-8109-3e1a38fb9745 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:48.017829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a43093a-7160-4442-8109-3e1a38fb9745 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:48.018259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a43093a-7160-4442-8109-3e1a38fb9745 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:48.018982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a43093a-7160-4442-8109-3e1a38fb9745 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:48.019456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a43093a-7160-4442-8109-3e1a38fb9745 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:48.019886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a43093a-7160-4442-8109-3e1a38fb9745 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:48.781054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d01cf736-a482-4a2e-a42b-3951d76932fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:48.789315 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d01cf736-a482-4a2e-a42b-3951d76932fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1364 microversion: 2.1 time: 1.145746 Oct 24 10:32:48.807911 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1053/2043] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:47 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1364 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:48.814082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-53b64daf-2f93-4a62-aed1-119746b97a2d tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:48.814979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-53b64daf-2f93-4a62-aed1-119746b97a2d tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:48.822281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53b64daf-2f93-4a62-aed1-119746b97a2d tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:48.823076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53b64daf-2f93-4a62-aed1-119746b97a2d tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:48.824441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53b64daf-2f93-4a62-aed1-119746b97a2d tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:48.825784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53b64daf-2f93-4a62-aed1-119746b97a2d tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:48.826440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53b64daf-2f93-4a62-aed1-119746b97a2d tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:48.827046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53b64daf-2f93-4a62-aed1-119746b97a2d tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:48.875140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2a43093a-7160-4442-8109-3e1a38fb9745 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:48.889863 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2a43093a-7160-4442-8109-3e1a38fb9745 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1307 microversion: 2.1 time: 0.897686 Oct 24 10:32:48.890754 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 991/2044] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:47 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1307 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:48.899756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b92053b-04ca-4a07-8a18-adb70b3f3010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:48.901783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6b92053b-04ca-4a07-8a18-adb70b3f3010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:48.909037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b92053b-04ca-4a07-8a18-adb70b3f3010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:48.909806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b92053b-04ca-4a07-8a18-adb70b3f3010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:48.914117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b92053b-04ca-4a07-8a18-adb70b3f3010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:48.917565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b92053b-04ca-4a07-8a18-adb70b3f3010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:48.918773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b92053b-04ca-4a07-8a18-adb70b3f3010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:48.919534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b92053b-04ca-4a07-8a18-adb70b3f3010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:49.402221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-53b64daf-2f93-4a62-aed1-119746b97a2d tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:49.411084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6b92053b-04ca-4a07-8a18-adb70b3f3010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:49.420243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6b92053b-04ca-4a07-8a18-adb70b3f3010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:49.421734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6b92053b-04ca-4a07-8a18-adb70b3f3010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:49.422474 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-53b64daf-2f93-4a62-aed1-119746b97a2d tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1558 microversion: 2.1 time: 0.611107 Oct 24 10:32:49.422940 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6b92053b-04ca-4a07-8a18-adb70b3f3010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.531087 Oct 24 10:32:49.432742 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1054/2045] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:48 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1558 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:49.433188 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 992/2046] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:48 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:49.452557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8bf6d0d4-071b-4672-a449-0b125f8a0829 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:49.455795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8bf6d0d4-071b-4672-a449-0b125f8a0829 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:49.467160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bf6d0d4-071b-4672-a449-0b125f8a0829 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:49.468083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bf6d0d4-071b-4672-a449-0b125f8a0829 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:49.469291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bf6d0d4-071b-4672-a449-0b125f8a0829 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:49.470272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bf6d0d4-071b-4672-a449-0b125f8a0829 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:49.470972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bf6d0d4-071b-4672-a449-0b125f8a0829 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:49.471757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bf6d0d4-071b-4672-a449-0b125f8a0829 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:49.475191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6d154617-2c80-40aa-8136-5e2370af9bd8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:49.475870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6d154617-2c80-40aa-8136-5e2370af9bd8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:49.510149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d154617-2c80-40aa-8136-5e2370af9bd8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:49.517270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d154617-2c80-40aa-8136-5e2370af9bd8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:49.517739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d154617-2c80-40aa-8136-5e2370af9bd8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:49.518506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d154617-2c80-40aa-8136-5e2370af9bd8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:49.518974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d154617-2c80-40aa-8136-5e2370af9bd8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:49.519414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d154617-2c80-40aa-8136-5e2370af9bd8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:50.133154 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6d154617-2c80-40aa-8136-5e2370af9bd8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.674804 Oct 24 10:32:50.135125 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 993/2047] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 10:32:49 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380/os-interface => generated 284 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:50.159344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-74bb6b28-0770-4569-80bf-ddf882fb370d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:50.159969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-74bb6b28-0770-4569-80bf-ddf882fb370d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:50.177812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74bb6b28-0770-4569-80bf-ddf882fb370d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:50.180992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74bb6b28-0770-4569-80bf-ddf882fb370d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:50.183754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74bb6b28-0770-4569-80bf-ddf882fb370d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:50.185088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74bb6b28-0770-4569-80bf-ddf882fb370d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:50.187943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74bb6b28-0770-4569-80bf-ddf882fb370d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:50.188949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74bb6b28-0770-4569-80bf-ddf882fb370d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:50.275013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8bf6d0d4-071b-4672-a449-0b125f8a0829 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7bd36a563d4b4189301434f7f9bdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e37b041665467ab7b778324710c1c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:50.286254 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8bf6d0d4-071b-4672-a449-0b125f8a0829 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 200 len: 1324 microversion: 2.1 time: 0.849821 Oct 24 10:32:50.289348 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1055/2048] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:49 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 1324 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:50.305389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8cbf8465-1596-496c-9a96-54babafa73f7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:50.307516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8cbf8465-1596-496c-9a96-54babafa73f7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:50.319204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cbf8465-1596-496c-9a96-54babafa73f7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:50.331692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cbf8465-1596-496c-9a96-54babafa73f7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:50.332288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cbf8465-1596-496c-9a96-54babafa73f7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:50.333632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cbf8465-1596-496c-9a96-54babafa73f7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:50.336224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cbf8465-1596-496c-9a96-54babafa73f7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:50.337073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cbf8465-1596-496c-9a96-54babafa73f7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:50.632236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-74bb6b28-0770-4569-80bf-ddf882fb370d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:50.644123 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-74bb6b28-0770-4569-80bf-ddf882fb370d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1364 microversion: 2.1 time: 0.493966 Oct 24 10:32:50.645134 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 994/2049] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:50 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1364 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:50.666504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-54632166-f0c3-41c4-a5d5-d96e6c8c7c35 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:50.667555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-54632166-f0c3-41c4-a5d5-d96e6c8c7c35 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:50.679758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54632166-f0c3-41c4-a5d5-d96e6c8c7c35 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:50.680591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54632166-f0c3-41c4-a5d5-d96e6c8c7c35 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:50.684699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54632166-f0c3-41c4-a5d5-d96e6c8c7c35 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:50.686212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54632166-f0c3-41c4-a5d5-d96e6c8c7c35 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:50.689053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54632166-f0c3-41c4-a5d5-d96e6c8c7c35 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:50.689503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54632166-f0c3-41c4-a5d5-d96e6c8c7c35 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:50.824013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8cbf8465-1596-496c-9a96-54babafa73f7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:50.839819 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8cbf8465-1596-496c-9a96-54babafa73f7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1307 microversion: 2.1 time: 0.547380 Oct 24 10:32:50.840675 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1056/2050] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:50 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1307 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:50.847124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3a823521-1c38-4a99-a448-f415bf8144c5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:50.848222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3a823521-1c38-4a99-a448-f415bf8144c5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:50.856245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a823521-1c38-4a99-a448-f415bf8144c5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:50.857062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a823521-1c38-4a99-a448-f415bf8144c5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:50.857733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a823521-1c38-4a99-a448-f415bf8144c5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:50.858977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a823521-1c38-4a99-a448-f415bf8144c5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:50.860057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a823521-1c38-4a99-a448-f415bf8144c5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:50.860716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a823521-1c38-4a99-a448-f415bf8144c5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:50.898714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3a823521-1c38-4a99-a448-f415bf8144c5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:32:51.115222 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3a823521-1c38-4a99-a448-f415bf8144c5 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 204 len: 0 microversion: 2.1 time: 0.272342 Oct 24 10:32:51.117281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:51.135423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-54632166-f0c3-41c4-a5d5-d96e6c8c7c35 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:51.137592 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1057/2051] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:32:50 2022] DELETE /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:32:51.147266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a471a976-5f09-405e-a74b-5b82aa27a33a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:51.147974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a471a976-5f09-405e-a74b-5b82aa27a33a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:51.153914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-54632166-f0c3-41c4-a5d5-d96e6c8c7c35 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:51.156148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a471a976-5f09-405e-a74b-5b82aa27a33a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:51.157476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a471a976-5f09-405e-a74b-5b82aa27a33a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:51.158262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-54632166-f0c3-41c4-a5d5-d96e6c8c7c35 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:51.163756 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-54632166-f0c3-41c4-a5d5-d96e6c8c7c35 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.504692 Oct 24 10:32:51.168305 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 995/2052] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:50 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:51.170821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a471a976-5f09-405e-a74b-5b82aa27a33a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:51.173253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a471a976-5f09-405e-a74b-5b82aa27a33a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:51.173389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a471a976-5f09-405e-a74b-5b82aa27a33a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:51.173750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a471a976-5f09-405e-a74b-5b82aa27a33a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:51.174355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:51.217179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:51.315471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-90f4bee8-c9bf-4105-914c-0758ba802562 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:51.316522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-90f4bee8-c9bf-4105-914c-0758ba802562 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:51.322692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:51.325714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90f4bee8-c9bf-4105-914c-0758ba802562 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:51.326580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90f4bee8-c9bf-4105-914c-0758ba802562 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:51.328202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90f4bee8-c9bf-4105-914c-0758ba802562 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:51.329220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90f4bee8-c9bf-4105-914c-0758ba802562 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:51.329924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90f4bee8-c9bf-4105-914c-0758ba802562 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:51.330580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90f4bee8-c9bf-4105-914c-0758ba802562 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:51.569400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a471a976-5f09-405e-a74b-5b82aa27a33a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:51.578107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:51.590965 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a471a976-5f09-405e-a74b-5b82aa27a33a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1667 microversion: 2.1 time: 0.448361 Oct 24 10:32:51.592462 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1058/2053] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:51 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1667 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:51.672891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d9113b9-8ed8-4458-b592-3cb3c37a2532 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:51.673894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2d9113b9-8ed8-4458-b592-3cb3c37a2532 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:51.683648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d9113b9-8ed8-4458-b592-3cb3c37a2532 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:51.686809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d9113b9-8ed8-4458-b592-3cb3c37a2532 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:51.687503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d9113b9-8ed8-4458-b592-3cb3c37a2532 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:51.690646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d9113b9-8ed8-4458-b592-3cb3c37a2532 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:51.691368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d9113b9-8ed8-4458-b592-3cb3c37a2532 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:51.692096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d9113b9-8ed8-4458-b592-3cb3c37a2532 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:51.849886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-90f4bee8-c9bf-4105-914c-0758ba802562 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7bd36a563d4b4189301434f7f9bdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e37b041665467ab7b778324710c1c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:51.858646 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-90f4bee8-c9bf-4105-914c-0758ba802562 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 200 len: 1324 microversion: 2.1 time: 0.546882 Oct 24 10:32:51.873852 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 996/2054] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:51 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 1324 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:32:51.882417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cb98c6ca-59af-4f2b-8d12-5143fad5786e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:51.883618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cb98c6ca-59af-4f2b-8d12-5143fad5786e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:51.891904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb98c6ca-59af-4f2b-8d12-5143fad5786e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:51.892915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb98c6ca-59af-4f2b-8d12-5143fad5786e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:51.893647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb98c6ca-59af-4f2b-8d12-5143fad5786e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:51.894725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb98c6ca-59af-4f2b-8d12-5143fad5786e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:51.895438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb98c6ca-59af-4f2b-8d12-5143fad5786e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:51.896186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb98c6ca-59af-4f2b-8d12-5143fad5786e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:52.467005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=10 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:52.505701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2d9113b9-8ed8-4458-b592-3cb3c37a2532 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:52.515074 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2d9113b9-8ed8-4458-b592-3cb3c37a2532 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1364 microversion: 2.1 time: 0.846468 Oct 24 10:32:52.529939 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1059/2055] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:51 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1364 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:32:52.540126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-55f57370-0d62-4dce-8fac-1cfcad1d3848 req-d7a11ec2-ee7b-4851-9f5e-7cd09b5c2f13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e4585f-945b-462a-aac7-5a7af22f160d", "name": "network-vif-unplugged", "status": "completed", "tag": "37825a2f-34ee-4e53-ae99-2a22e0da2d1b"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:52.555354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-55f57370-0d62-4dce-8fac-1cfcad1d3848 req-d7a11ec2-ee7b-4851-9f5e-7cd09b5c2f13 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:52.558509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-55f57370-0d62-4dce-8fac-1cfcad1d3848 req-d7a11ec2-ee7b-4851-9f5e-7cd09b5c2f13 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:52.559287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-55f57370-0d62-4dce-8fac-1cfcad1d3848 req-d7a11ec2-ee7b-4851-9f5e-7cd09b5c2f13 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:52.580225 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-55f57370-0d62-4dce-8fac-1cfcad1d3848 req-d7a11ec2-ee7b-4851-9f5e-7cd09b5c2f13 service nova] Creating event network-vif-unplugged:37825a2f-34ee-4e53-ae99-2a22e0da2d1b for instance 07e4585f-945b-462a-aac7-5a7af22f160d on n-h1-858383-15 Oct 24 10:32:52.587280 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-55f57370-0d62-4dce-8fac-1cfcad1d3848 req-d7a11ec2-ee7b-4851-9f5e-7cd09b5c2f13 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055704 Oct 24 10:32:52.589064 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1060/2056] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:52.595680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-88f6222c-2631-45b2-85c5-32ac3d4c849a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:52.596662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-88f6222c-2631-45b2-85c5-32ac3d4c849a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:52.605301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88f6222c-2631-45b2-85c5-32ac3d4c849a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:52.606058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88f6222c-2631-45b2-85c5-32ac3d4c849a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:52.606774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88f6222c-2631-45b2-85c5-32ac3d4c849a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:52.607756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88f6222c-2631-45b2-85c5-32ac3d4c849a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:52.608797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88f6222c-2631-45b2-85c5-32ac3d4c849a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:52.609493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88f6222c-2631-45b2-85c5-32ac3d4c849a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:52.737360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cb98c6ca-59af-4f2b-8d12-5143fad5786e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:52.761652 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cb98c6ca-59af-4f2b-8d12-5143fad5786e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1307 microversion: 2.1 time: 0.886145 Oct 24 10:32:52.778799 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 997/2057] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:51 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1307 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:52.784351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e86c6e4-1043-4e24-b6a5-cf8f036f3e7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:52.785472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0e86c6e4-1043-4e24-b6a5-cf8f036f3e7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:52.792888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e86c6e4-1043-4e24-b6a5-cf8f036f3e7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:52.793636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e86c6e4-1043-4e24-b6a5-cf8f036f3e7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:52.794316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e86c6e4-1043-4e24-b6a5-cf8f036f3e7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:52.795494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e86c6e4-1043-4e24-b6a5-cf8f036f3e7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:52.796198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e86c6e4-1043-4e24-b6a5-cf8f036f3e7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:52.796922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e86c6e4-1043-4e24-b6a5-cf8f036f3e7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:53.371183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-88f6222c-2631-45b2-85c5-32ac3d4c849a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:53.386442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-88f6222c-2631-45b2-85c5-32ac3d4c849a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:53.390330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-88f6222c-2631-45b2-85c5-32ac3d4c849a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:53.393502 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-88f6222c-2631-45b2-85c5-32ac3d4c849a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.803017 Oct 24 10:32:53.409783 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1061/2058] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:52 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:53.420746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ce9ed14e-6860-4621-91b6-769c274efe48 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:53.421499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ce9ed14e-6860-4621-91b6-769c274efe48 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:53.429293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce9ed14e-6860-4621-91b6-769c274efe48 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:53.429906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce9ed14e-6860-4621-91b6-769c274efe48 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:53.430598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce9ed14e-6860-4621-91b6-769c274efe48 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:53.431630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce9ed14e-6860-4621-91b6-769c274efe48 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:53.432455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce9ed14e-6860-4621-91b6-769c274efe48 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:53.433154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce9ed14e-6860-4621-91b6-769c274efe48 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:53.637264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0e86c6e4-1043-4e24-b6a5-cf8f036f3e7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:53.645928 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e86c6e4-1043-4e24-b6a5-cf8f036f3e7e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1667 microversion: 2.1 time: 0.865609 Oct 24 10:32:53.647206 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 998/2059] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:52 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1667 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:53.652375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-8b6b931c-bce9-4f61-983d-daa9a78fe93c req-5a249bfa-5d9e-4651-8b32-26db10e756e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b074ba99-0598-4bba-990f-df73ab74a17a", "name": "network-vif-plugged", "status": "completed", "tag": "c7fce0f1-82b3-46c9-9179-04bbcc40683f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:53.662466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8b6b931c-bce9-4f61-983d-daa9a78fe93c req-5a249bfa-5d9e-4651-8b32-26db10e756e0 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:53.663279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8b6b931c-bce9-4f61-983d-daa9a78fe93c req-5a249bfa-5d9e-4651-8b32-26db10e756e0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:53.663976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8b6b931c-bce9-4f61-983d-daa9a78fe93c req-5a249bfa-5d9e-4651-8b32-26db10e756e0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:53.675825 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-8b6b931c-bce9-4f61-983d-daa9a78fe93c req-5a249bfa-5d9e-4651-8b32-26db10e756e0 service nova] Creating event network-vif-plugged:c7fce0f1-82b3-46c9-9179-04bbcc40683f for instance b074ba99-0598-4bba-990f-df73ab74a17a on n-h1-858383-15 Oct 24 10:32:53.682177 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-8b6b931c-bce9-4f61-983d-daa9a78fe93c req-5a249bfa-5d9e-4651-8b32-26db10e756e0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032703 Oct 24 10:32:53.683171 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 999/2060] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:53.689220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-654f2080-feeb-49e4-a4ba-584f2021f896 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:53.690301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-654f2080-feeb-49e4-a4ba-584f2021f896 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:53.698940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-654f2080-feeb-49e4-a4ba-584f2021f896 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:53.699806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-654f2080-feeb-49e4-a4ba-584f2021f896 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:53.700774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-654f2080-feeb-49e4-a4ba-584f2021f896 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:53.701782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-654f2080-feeb-49e4-a4ba-584f2021f896 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:53.702661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-654f2080-feeb-49e4-a4ba-584f2021f896 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:53.703320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-654f2080-feeb-49e4-a4ba-584f2021f896 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:54.105741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ce9ed14e-6860-4621-91b6-769c274efe48 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7bd36a563d4b4189301434f7f9bdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e37b041665467ab7b778324710c1c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:54.114468 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ce9ed14e-6860-4621-91b6-769c274efe48 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 200 len: 1324 microversion: 2.1 time: 0.703215 Oct 24 10:32:54.115733 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1062/2061] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:53 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 1324 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:54.122701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-d16979ba-a79c-451d-9287-f6263b1cf842 req-0aeac612-8723-420e-875e-66d168a72d9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6b873b2-ffe7-4ddd-8f31-6c99b3c93339", "tag": "5722d9e2-b941-414a-af1d-34999df87a8b"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:54.137165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d16979ba-a79c-451d-9287-f6263b1cf842 req-0aeac612-8723-420e-875e-66d168a72d9f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:54.138086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d16979ba-a79c-451d-9287-f6263b1cf842 req-0aeac612-8723-420e-875e-66d168a72d9f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:54.138772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d16979ba-a79c-451d-9287-f6263b1cf842 req-0aeac612-8723-420e-875e-66d168a72d9f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:54.151308 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-d16979ba-a79c-451d-9287-f6263b1cf842 req-0aeac612-8723-420e-875e-66d168a72d9f service nova] Creating event network-changed:5722d9e2-b941-414a-af1d-34999df87a8b for instance a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 on n-h2-858383-15 Oct 24 10:32:54.157002 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-d16979ba-a79c-451d-9287-f6263b1cf842 req-0aeac612-8723-420e-875e-66d168a72d9f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039793 Oct 24 10:32:54.158230 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1063/2062] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:54.163685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-de06d60d-0fc2-44d1-8322-3b7d6beedd26 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:54.164669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-de06d60d-0fc2-44d1-8322-3b7d6beedd26 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:54.173065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de06d60d-0fc2-44d1-8322-3b7d6beedd26 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:54.173834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de06d60d-0fc2-44d1-8322-3b7d6beedd26 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:54.174487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de06d60d-0fc2-44d1-8322-3b7d6beedd26 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:54.175420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de06d60d-0fc2-44d1-8322-3b7d6beedd26 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:54.176086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de06d60d-0fc2-44d1-8322-3b7d6beedd26 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:54.176717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de06d60d-0fc2-44d1-8322-3b7d6beedd26 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:54.261037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-654f2080-feeb-49e4-a4ba-584f2021f896 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:54.270407 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-654f2080-feeb-49e4-a4ba-584f2021f896 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1364 microversion: 2.1 time: 0.585710 Oct 24 10:32:54.274539 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1000/2063] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:53 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1364 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:54.423014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5ae12ffe-13eb-4efa-adfe-b2b0f910222f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:54.424154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5ae12ffe-13eb-4efa-adfe-b2b0f910222f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:54.432546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ae12ffe-13eb-4efa-adfe-b2b0f910222f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:54.433049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ae12ffe-13eb-4efa-adfe-b2b0f910222f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:54.433649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ae12ffe-13eb-4efa-adfe-b2b0f910222f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:54.434362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ae12ffe-13eb-4efa-adfe-b2b0f910222f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:54.434810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ae12ffe-13eb-4efa-adfe-b2b0f910222f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:54.437480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ae12ffe-13eb-4efa-adfe-b2b0f910222f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:54.664498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-de06d60d-0fc2-44d1-8322-3b7d6beedd26 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:54.677008 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-de06d60d-0fc2-44d1-8322-3b7d6beedd26 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1307 microversion: 2.1 time: 0.516725 Oct 24 10:32:54.677622 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1064/2064] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:54 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1307 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:54.687083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-468cbc0a-4a58-4a26-9a73-6a3b46f45de2 req-125cf34d-d781-493e-9748-3737f0777c78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e4585f-945b-462a-aac7-5a7af22f160d", "tag": "37825a2f-34ee-4e53-ae99-2a22e0da2d1b"}, {"name": "network-changed", "server_uuid": "f7cf3710-4f48-4dca-9dc7-076994a09380", "tag": "b1313db3-8fe7-456f-a606-94713c638edc"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:54.700070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-468cbc0a-4a58-4a26-9a73-6a3b46f45de2 req-125cf34d-d781-493e-9748-3737f0777c78 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:54.700964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-468cbc0a-4a58-4a26-9a73-6a3b46f45de2 req-125cf34d-d781-493e-9748-3737f0777c78 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:54.701501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-468cbc0a-4a58-4a26-9a73-6a3b46f45de2 req-125cf34d-d781-493e-9748-3737f0777c78 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:54.719846 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-468cbc0a-4a58-4a26-9a73-6a3b46f45de2 req-125cf34d-d781-493e-9748-3737f0777c78 service nova] Creating event network-changed:37825a2f-34ee-4e53-ae99-2a22e0da2d1b for instance 07e4585f-945b-462a-aac7-5a7af22f160d on n-h1-858383-15 Oct 24 10:32:54.720517 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-468cbc0a-4a58-4a26-9a73-6a3b46f45de2 req-125cf34d-d781-493e-9748-3737f0777c78 service nova] Creating event network-changed:b1313db3-8fe7-456f-a606-94713c638edc for instance f7cf3710-4f48-4dca-9dc7-076994a09380 on n-h2-858383-15 Oct 24 10:32:54.729348 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-468cbc0a-4a58-4a26-9a73-6a3b46f45de2 req-125cf34d-d781-493e-9748-3737f0777c78 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.050060 Oct 24 10:32:54.730783 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1065/2065] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:54.737366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c3669b6e-1d3c-457a-a2ee-b2d3664160cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:54.738182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c3669b6e-1d3c-457a-a2ee-b2d3664160cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:54.745754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3669b6e-1d3c-457a-a2ee-b2d3664160cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:54.746216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3669b6e-1d3c-457a-a2ee-b2d3664160cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:54.746720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3669b6e-1d3c-457a-a2ee-b2d3664160cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:54.747528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3669b6e-1d3c-457a-a2ee-b2d3664160cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:54.748735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3669b6e-1d3c-457a-a2ee-b2d3664160cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:54.748735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3669b6e-1d3c-457a-a2ee-b2d3664160cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:54.878340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c3669b6e-1d3c-457a-a2ee-b2d3664160cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:54.908148 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c3669b6e-1d3c-457a-a2ee-b2d3664160cb tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1599 microversion: 2.1 time: 0.175622 Oct 24 10:32:54.908765 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1066/2066] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:54 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:54.990059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5ae12ffe-13eb-4efa-adfe-b2b0f910222f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:55.008735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5ae12ffe-13eb-4efa-adfe-b2b0f910222f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:55.014917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5ae12ffe-13eb-4efa-adfe-b2b0f910222f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:55.030625 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5ae12ffe-13eb-4efa-adfe-b2b0f910222f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.612050 Oct 24 10:32:55.032785 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1001/2067] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:54 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:55.151045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7b9394a2-b278-491c-83ad-0ac0b87d9b63 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:55.153082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7b9394a2-b278-491c-83ad-0ac0b87d9b63 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:55.163800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b9394a2-b278-491c-83ad-0ac0b87d9b63 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:55.164949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b9394a2-b278-491c-83ad-0ac0b87d9b63 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:55.167076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b9394a2-b278-491c-83ad-0ac0b87d9b63 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:55.168287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b9394a2-b278-491c-83ad-0ac0b87d9b63 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:55.168762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b9394a2-b278-491c-83ad-0ac0b87d9b63 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:55.169220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b9394a2-b278-491c-83ad-0ac0b87d9b63 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:55.309312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a58ad94a-95f7-419a-9de9-cadc70adb466 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:55.310638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a58ad94a-95f7-419a-9de9-cadc70adb466 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:55.333220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a58ad94a-95f7-419a-9de9-cadc70adb466 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:55.340601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a58ad94a-95f7-419a-9de9-cadc70adb466 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:55.341252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a58ad94a-95f7-419a-9de9-cadc70adb466 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:55.343132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a58ad94a-95f7-419a-9de9-cadc70adb466 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:55.344602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a58ad94a-95f7-419a-9de9-cadc70adb466 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:55.348595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a58ad94a-95f7-419a-9de9-cadc70adb466 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:56.153638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7b9394a2-b278-491c-83ad-0ac0b87d9b63 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7bd36a563d4b4189301434f7f9bdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e37b041665467ab7b778324710c1c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:56.163803 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7b9394a2-b278-491c-83ad-0ac0b87d9b63 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 200 len: 1324 microversion: 2.1 time: 1.023592 Oct 24 10:32:56.164776 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1067/2068] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:55 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 1324 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:56.170047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7301c6cd-cd99-4a8d-a37e-c8138365c2d8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:56.170901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7301c6cd-cd99-4a8d-a37e-c8138365c2d8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:56.178251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7301c6cd-cd99-4a8d-a37e-c8138365c2d8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:56.178739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7301c6cd-cd99-4a8d-a37e-c8138365c2d8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:56.179177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7301c6cd-cd99-4a8d-a37e-c8138365c2d8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:56.179972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7301c6cd-cd99-4a8d-a37e-c8138365c2d8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:56.180434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7301c6cd-cd99-4a8d-a37e-c8138365c2d8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:56.181076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7301c6cd-cd99-4a8d-a37e-c8138365c2d8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:56.192462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a58ad94a-95f7-419a-9de9-cadc70adb466 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:56.220737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:56.225912 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a58ad94a-95f7-419a-9de9-cadc70adb466 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1364 microversion: 2.1 time: 0.929302 Oct 24 10:32:56.227374 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1002/2069] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:55 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1364 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:56.233367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-52699bbe-6ec7-4698-96d6-3a8357e0e1f8 req-87b7a8e8-ff88-44fc-803c-e83a3b08c42f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513ca608-24c9-45f9-8fb9-e231d92c7262", "name": "network-vif-plugged", "status": "completed", "tag": "b2def801-647c-479d-9e34-cb0b4d60448e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:56.248392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-52699bbe-6ec7-4698-96d6-3a8357e0e1f8 req-87b7a8e8-ff88-44fc-803c-e83a3b08c42f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:56.250888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-52699bbe-6ec7-4698-96d6-3a8357e0e1f8 req-87b7a8e8-ff88-44fc-803c-e83a3b08c42f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:56.251612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-52699bbe-6ec7-4698-96d6-3a8357e0e1f8 req-87b7a8e8-ff88-44fc-803c-e83a3b08c42f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:56.269742 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-52699bbe-6ec7-4698-96d6-3a8357e0e1f8 req-87b7a8e8-ff88-44fc-803c-e83a3b08c42f service nova] Creating event network-vif-plugged:b2def801-647c-479d-9e34-cb0b4d60448e for instance 513ca608-24c9-45f9-8fb9-e231d92c7262 on n-h2-858383-15 Oct 24 10:32:56.296940 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-52699bbe-6ec7-4698-96d6-3a8357e0e1f8 req-87b7a8e8-ff88-44fc-803c-e83a3b08c42f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067848 Oct 24 10:32:56.297550 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1003/2070] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:56.313520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-30d7ac0a-8eb9-4e7a-a4ce-40faa6dd8cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:56.314584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-30d7ac0a-8eb9-4e7a-a4ce-40faa6dd8cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:56.323297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30d7ac0a-8eb9-4e7a-a4ce-40faa6dd8cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:56.324011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30d7ac0a-8eb9-4e7a-a4ce-40faa6dd8cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:56.327116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30d7ac0a-8eb9-4e7a-a4ce-40faa6dd8cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:56.328102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30d7ac0a-8eb9-4e7a-a4ce-40faa6dd8cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:56.329831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30d7ac0a-8eb9-4e7a-a4ce-40faa6dd8cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:56.330444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30d7ac0a-8eb9-4e7a-a4ce-40faa6dd8cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:56.450116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-30d7ac0a-8eb9-4e7a-a4ce-40faa6dd8cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:56.469584 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-30d7ac0a-8eb9-4e7a-a4ce-40faa6dd8cf9 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1318 microversion: 2.1 time: 0.158998 Oct 24 10:32:56.470842 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1004/2071] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:56 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:56.477352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b6ea2b68-94c4-440b-ba15-c655eed2b47d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:56.477969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b6ea2b68-94c4-440b-ba15-c655eed2b47d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:56.507442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6ea2b68-94c4-440b-ba15-c655eed2b47d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:56.510857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6ea2b68-94c4-440b-ba15-c655eed2b47d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:56.511513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6ea2b68-94c4-440b-ba15-c655eed2b47d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:56.515126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6ea2b68-94c4-440b-ba15-c655eed2b47d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:56.515860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6ea2b68-94c4-440b-ba15-c655eed2b47d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:56.517781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b6ea2b68-94c4-440b-ba15-c655eed2b47d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:56.624233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7301c6cd-cd99-4a8d-a37e-c8138365c2d8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:56.647157 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7301c6cd-cd99-4a8d-a37e-c8138365c2d8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1487 microversion: 2.1 time: 0.481125 Oct 24 10:32:56.675905 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1068/2072] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:56 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1487 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:56.682381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-1ffff5b2-3fa1-4583-ada6-00e6384212be req-34d0180e-7d02-4f82-8d58-51686bbb536a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9eff099-cc37-4432-8741-4e7d179b9ff0", "name": "network-vif-deleted", "tag": "e5f5ae43-f478-4bd6-8b05-04ea1b1ab6c2"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:56.695912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1ffff5b2-3fa1-4583-ada6-00e6384212be req-34d0180e-7d02-4f82-8d58-51686bbb536a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:56.696730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1ffff5b2-3fa1-4583-ada6-00e6384212be req-34d0180e-7d02-4f82-8d58-51686bbb536a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:56.698026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1ffff5b2-3fa1-4583-ada6-00e6384212be req-34d0180e-7d02-4f82-8d58-51686bbb536a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:56.716082 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-1ffff5b2-3fa1-4583-ada6-00e6384212be req-34d0180e-7d02-4f82-8d58-51686bbb536a service nova] Creating event network-vif-deleted:e5f5ae43-f478-4bd6-8b05-04ea1b1ab6c2 for instance b9eff099-cc37-4432-8741-4e7d179b9ff0 on n-h1-858383-15 Oct 24 10:32:56.722292 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-1ffff5b2-3fa1-4583-ada6-00e6384212be req-34d0180e-7d02-4f82-8d58-51686bbb536a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044511 Oct 24 10:32:56.723424 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1069/2073] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:56.733446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6909971f-616b-4cc7-b190-cfe5af1d24ab tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:56.735091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6909971f-616b-4cc7-b190-cfe5af1d24ab tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:56.742418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6909971f-616b-4cc7-b190-cfe5af1d24ab tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:56.743162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6909971f-616b-4cc7-b190-cfe5af1d24ab tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:56.743821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6909971f-616b-4cc7-b190-cfe5af1d24ab tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:56.746549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6909971f-616b-4cc7-b190-cfe5af1d24ab tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:56.747758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6909971f-616b-4cc7-b190-cfe5af1d24ab tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:56.748388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6909971f-616b-4cc7-b190-cfe5af1d24ab tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:56.814819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6909971f-616b-4cc7-b190-cfe5af1d24ab tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:32:56.939816 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6909971f-616b-4cc7-b190-cfe5af1d24ab tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 204 len: 0 microversion: 2.1 time: 0.214026 Oct 24 10:32:56.940666 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1070/2074] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:32:56 2022] DELETE /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:32:56.941434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b6ea2b68-94c4-440b-ba15-c655eed2b47d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:56.950482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5439b546-e8f5-4db5-ae9d-ea8a75ac893e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:56.951883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5439b546-e8f5-4db5-ae9d-ea8a75ac893e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:56.953071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b6ea2b68-94c4-440b-ba15-c655eed2b47d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:56.954816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b6ea2b68-94c4-440b-ba15-c655eed2b47d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:56.956500 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b6ea2b68-94c4-440b-ba15-c655eed2b47d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.484508 Oct 24 10:32:56.957540 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1005/2075] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:56 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:56.961027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5439b546-e8f5-4db5-ae9d-ea8a75ac893e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:56.961516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5439b546-e8f5-4db5-ae9d-ea8a75ac893e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:56.962101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5439b546-e8f5-4db5-ae9d-ea8a75ac893e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:56.962899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5439b546-e8f5-4db5-ae9d-ea8a75ac893e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:56.963359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5439b546-e8f5-4db5-ae9d-ea8a75ac893e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:56.963779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5439b546-e8f5-4db5-ae9d-ea8a75ac893e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:57.187338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-abe8d617-497a-49bd-94b2-71423486f765 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:57.188121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-abe8d617-497a-49bd-94b2-71423486f765 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:57.194844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-abe8d617-497a-49bd-94b2-71423486f765 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:57.199436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-abe8d617-497a-49bd-94b2-71423486f765 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:57.202386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-abe8d617-497a-49bd-94b2-71423486f765 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:57.203337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-abe8d617-497a-49bd-94b2-71423486f765 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:57.203987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-abe8d617-497a-49bd-94b2-71423486f765 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:57.204631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-abe8d617-497a-49bd-94b2-71423486f765 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:57.223081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5439b546-e8f5-4db5-ae9d-ea8a75ac893e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:57.235223 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5439b546-e8f5-4db5-ae9d-ea8a75ac893e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1493 microversion: 2.1 time: 0.288347 Oct 24 10:32:57.256210 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1071/2076] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:56 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1493 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:32:57.263742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dcbb8009-9110-4a06-9f60-125f9bcec77b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:57.264384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dcbb8009-9110-4a06-9f60-125f9bcec77b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:57.284978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dcbb8009-9110-4a06-9f60-125f9bcec77b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:57.288950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dcbb8009-9110-4a06-9f60-125f9bcec77b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:57.289442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dcbb8009-9110-4a06-9f60-125f9bcec77b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:57.290591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dcbb8009-9110-4a06-9f60-125f9bcec77b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:57.291768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dcbb8009-9110-4a06-9f60-125f9bcec77b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:57.292211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dcbb8009-9110-4a06-9f60-125f9bcec77b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:57.619463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-abe8d617-497a-49bd-94b2-71423486f765 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7bd36a563d4b4189301434f7f9bdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e37b041665467ab7b778324710c1c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:57.624252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dcbb8009-9110-4a06-9f60-125f9bcec77b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:57.631161 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-abe8d617-497a-49bd-94b2-71423486f765 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 200 len: 1324 microversion: 2.1 time: 0.446665 Oct 24 10:32:57.632198 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1006/2077] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:57 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 1324 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:32:57.633770 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dcbb8009-9110-4a06-9f60-125f9bcec77b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1364 microversion: 2.1 time: 0.375523 Oct 24 10:32:57.635360 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1072/2078] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:57 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1364 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:57.638826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-41c6f9be-1ab6-4cbc-9c6e-58f15a8e8e25 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:57.639650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-41c6f9be-1ab6-4cbc-9c6e-58f15a8e8e25 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:57.646034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c6f9be-1ab6-4cbc-9c6e-58f15a8e8e25 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:57.646926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c6f9be-1ab6-4cbc-9c6e-58f15a8e8e25 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:57.647580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c6f9be-1ab6-4cbc-9c6e-58f15a8e8e25 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:57.648485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c6f9be-1ab6-4cbc-9c6e-58f15a8e8e25 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:57.649173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c6f9be-1ab6-4cbc-9c6e-58f15a8e8e25 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:57.649784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c6f9be-1ab6-4cbc-9c6e-58f15a8e8e25 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:57.688625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c6f9be-1ab6-4cbc-9c6e-58f15a8e8e25 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:57.689298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c6f9be-1ab6-4cbc-9c6e-58f15a8e8e25 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:57.689702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c6f9be-1ab6-4cbc-9c6e-58f15a8e8e25 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:57.690288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-41c6f9be-1ab6-4cbc-9c6e-58f15a8e8e25 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lazy-loading 'fault' on Instance uuid b9eff099-cc37-4432-8741-4e7d179b9ff0 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:32:57.755582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-41c6f9be-1ab6-4cbc-9c6e-58f15a8e8e25 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:57.765176 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-41c6f9be-1ab6-4cbc-9c6e-58f15a8e8e25 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 200 len: 1323 microversion: 2.1 time: 0.131414 Oct 24 10:32:57.765867 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1007/2079] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:57 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 1323 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:57.987653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c182c283-1ede-47fe-bd4f-703c59d5079d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:57.988304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c182c283-1ede-47fe-bd4f-703c59d5079d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:57.995134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c182c283-1ede-47fe-bd4f-703c59d5079d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:57.995848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c182c283-1ede-47fe-bd4f-703c59d5079d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:57.996470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c182c283-1ede-47fe-bd4f-703c59d5079d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:57.997459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c182c283-1ede-47fe-bd4f-703c59d5079d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:57.998114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c182c283-1ede-47fe-bd4f-703c59d5079d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:57.998820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c182c283-1ede-47fe-bd4f-703c59d5079d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:58.083253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54750b61-62dc-4bda-a158-c621312ea253 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Action: 'create', calling method: .version_select at 0x7f04d068a280>, body: {"keypair": {"name": "tempest-keypair-1507993324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHN4BqdLSL+AE+rC6n22SxrpiHapnLf+d1WAGK3KZk82E10ENHgw5yIJ+wRDjevIIIGa6lasrnhbgOldAxIoEs/vWu2fBBDhiJHJQWhAlwW7i4aIfnmhyg/6m6lK7bwZQ=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:32:58.108728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-54750b61-62dc-4bda-a158-c621312ea253 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Getting quotas for project 3ac4ab050ff04fcab31bd2716c109436. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:32:58.114627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-54750b61-62dc-4bda-a158-c621312ea253 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Getting quotas for user 8044061b791543b6971fd889ad161161 and project 3ac4ab050ff04fcab31bd2716c109436. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:32:58.151604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:58.162780 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-54750b61-62dc-4bda-a158-c621312ea253 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.234584 Oct 24 10:32:58.163603 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1073/2080] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:32:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:58.260487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-43b8d8d9-68cf-421f-843f-e3f035b52563 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:58.261555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-43b8d8d9-68cf-421f-843f-e3f035b52563 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:58.280362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43b8d8d9-68cf-421f-843f-e3f035b52563 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:58.280856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43b8d8d9-68cf-421f-843f-e3f035b52563 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:58.293288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43b8d8d9-68cf-421f-843f-e3f035b52563 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:58.298561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43b8d8d9-68cf-421f-843f-e3f035b52563 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:58.299087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43b8d8d9-68cf-421f-843f-e3f035b52563 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:58.299627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43b8d8d9-68cf-421f-843f-e3f035b52563 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:58.324893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c182c283-1ede-47fe-bd4f-703c59d5079d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:58.339891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c182c283-1ede-47fe-bd4f-703c59d5079d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:58.343124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c182c283-1ede-47fe-bd4f-703c59d5079d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:58.344356 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c182c283-1ede-47fe-bd4f-703c59d5079d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.360747 Oct 24 10:32:58.356589 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1008/2081] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:57 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:32:58.536104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-43b8d8d9-68cf-421f-843f-e3f035b52563 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:58.550221 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-43b8d8d9-68cf-421f-843f-e3f035b52563 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1493 microversion: 2.1 time: 0.294895 Oct 24 10:32:58.551439 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1074/2082] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:58 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1493 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:32:58.669191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8ba7be9e-6b19-4065-a5f8-5d0ee9a77cf4 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:58.669574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-904909d0-b957-4b7a-8851-e6991691ef12 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:58.671041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8ba7be9e-6b19-4065-a5f8-5d0ee9a77cf4 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:58.671708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-904909d0-b957-4b7a-8851-e6991691ef12 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:58.690709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-904909d0-b957-4b7a-8851-e6991691ef12 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:58.691583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ba7be9e-6b19-4065-a5f8-5d0ee9a77cf4 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:58.692368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-904909d0-b957-4b7a-8851-e6991691ef12 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:58.693429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-904909d0-b957-4b7a-8851-e6991691ef12 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:58.695314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ba7be9e-6b19-4065-a5f8-5d0ee9a77cf4 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:58.695314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ba7be9e-6b19-4065-a5f8-5d0ee9a77cf4 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:58.695314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ba7be9e-6b19-4065-a5f8-5d0ee9a77cf4 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:58.695894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-904909d0-b957-4b7a-8851-e6991691ef12 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:58.696500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-904909d0-b957-4b7a-8851-e6991691ef12 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:58.698202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ba7be9e-6b19-4065-a5f8-5d0ee9a77cf4 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:58.699279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ba7be9e-6b19-4065-a5f8-5d0ee9a77cf4 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:58.700228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-904909d0-b957-4b7a-8851-e6991691ef12 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:59.336823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-904909d0-b957-4b7a-8851-e6991691ef12 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:59.347910 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-904909d0-b957-4b7a-8851-e6991691ef12 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1552 microversion: 2.1 time: 0.687466 Oct 24 10:32:59.348498 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1075/2083] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:58 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1552 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:59.355857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8ba7be9e-6b19-4065-a5f8-5d0ee9a77cf4 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7bd36a563d4b4189301434f7f9bdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e37b041665467ab7b778324710c1c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:32:59.362680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3d2f971d-5857-41f7-bfad-655edfd0218c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:59.366323 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8ba7be9e-6b19-4065-a5f8-5d0ee9a77cf4 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 200 len: 1324 microversion: 2.1 time: 0.710703 Oct 24 10:32:59.367299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3d2f971d-5857-41f7-bfad-655edfd0218c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: b9eff099-cc37-4432-8741-4e7d179b9ff0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:59.382565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d2f971d-5857-41f7-bfad-655edfd0218c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:59.383365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d2f971d-5857-41f7-bfad-655edfd0218c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:59.383812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d2f971d-5857-41f7-bfad-655edfd0218c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:59.385392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d2f971d-5857-41f7-bfad-655edfd0218c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:59.385979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d2f971d-5857-41f7-bfad-655edfd0218c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:59.386448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d2f971d-5857-41f7-bfad-655edfd0218c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:59.397261 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1009/2084] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:58 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 1324 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:32:59.403105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-26b10d0a-4eb6-4e23-bcab-0d93777e9806 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:59.403721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-26b10d0a-4eb6-4e23-bcab-0d93777e9806 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:59.428795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b10d0a-4eb6-4e23-bcab-0d93777e9806 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:59.429352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b10d0a-4eb6-4e23-bcab-0d93777e9806 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:59.429799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b10d0a-4eb6-4e23-bcab-0d93777e9806 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:59.433807 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-3d2f971d-5857-41f7-bfad-655edfd0218c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] HTTP exception thrown: Instance b9eff099-cc37-4432-8741-4e7d179b9ff0 could not be found. Oct 24 10:32:59.435390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b10d0a-4eb6-4e23-bcab-0d93777e9806 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:59.435885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b10d0a-4eb6-4e23-bcab-0d93777e9806 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:59.436325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b10d0a-4eb6-4e23-bcab-0d93777e9806 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3d2f971d-5857-41f7-bfad-655edfd0218c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Request method failure captured: Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 HTTP/1.1 Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmgAI56ixX3LxgS7Ly-9n4q3huK4pYbld15OoCOex2Vf6Wku9STLKIRlZZ1d5nk_VUwGgN4V57lhzJHNDCb73Tn0ifTsKK6YRDPQ5jbKjKGMnQfE-Xi3pf6JmeXvaJwkuti6S33B5nt95lgzwThhG-3q84dQ-AyCluRwSJeYme1sFLs Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 115025f23db94a71b74b6adbc536792f Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-LiveMigrationTest-1696265939 Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:32:59.450883 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:32:59.452699 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/115025f23db94a71b74b6adbc536792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/115025f23db94a71b74b6adbc536792f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/115025f23db94a71b74b6adbc536792f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_115025f23db94a71b74b6adbc536792f", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:32:59.452699 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-LiveMigrationTest-1696265939 Oct 24 10:32:59.452699 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 115025f23db94a71b74b6adbc536792f Oct 24 10:32:59.452699 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-LiveMigrationTest-1696265939 Oct 24 10:32:59.452699 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-LiveMigrationTest-1696265939-project Oct 24 10:32:59.452699 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:32:59.452699 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:32:59.452699 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 176a68ea281e4f65bbeac67cc304468d Oct 24 10:32:59.452699 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-LiveMigrationTest-1696265939-project Oct 24 10:32:59.452699 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:32:59.452699 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance b9eff099-cc37-4432-8741-4e7d179b9ff0 could not be found. Oct 24 10:32:59.452699 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'b9eff099-cc37-4432-8741-4e7d179b9ff0'} Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9eff099-cc37-4432-8741-4e7d179b9ff0 could not be found. Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:32:59.453760 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:32:59.455487 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:32:59.455487 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:32:59.455487 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:32:59.455487 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:32:59.455487 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:32:59.455487 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:32:59.455487 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:32:59.455487 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9eff099-cc37-4432-8741-4e7d179b9ff0 could not be found. Oct 24 10:32:59.455487 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:59.455487 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:32:59.455487 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:59.455487 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:32:59.455487 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:32:59.455487 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:32:59.455487 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:32:59.455487 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:32:59.455487 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9eff099-cc37-4432-8741-4e7d179b9ff0 could not be found. Oct 24 10:32:59.455487 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:32:59.461726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3d2f971d-5857-41f7-bfad-655edfd0218c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Returning 404 to user: Instance b9eff099-cc37-4432-8741-4e7d179b9ff0 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:32:59.461726 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3d2f971d-5857-41f7-bfad-655edfd0218c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0" status: 404 len: 111 microversion: 2.1 time: 0.104880 Oct 24 10:32:59.462808 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1076/2085] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:59 2022] GET /compute/v2.1/servers/b9eff099-cc37-4432-8741-4e7d179b9ff0 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:32:59.474940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e1cfb88b-fa18-4a8a-ab95-a40a789fa3e6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:59.475451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e1cfb88b-fa18-4a8a-ab95-a40a789fa3e6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:59.496567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1cfb88b-fa18-4a8a-ab95-a40a789fa3e6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:59.497488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1cfb88b-fa18-4a8a-ab95-a40a789fa3e6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:59.498119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1cfb88b-fa18-4a8a-ab95-a40a789fa3e6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:59.498874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1cfb88b-fa18-4a8a-ab95-a40a789fa3e6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:59.508236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1cfb88b-fa18-4a8a-ab95-a40a789fa3e6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:59.508690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1cfb88b-fa18-4a8a-ab95-a40a789fa3e6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:59.665418 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e1cfb88b-fa18-4a8a-ab95-a40a789fa3e6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.201215 Oct 24 10:32:59.666566 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1077/2086] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 10:32:59 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:32:59.671344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f373b29b-d447-4957-bfe4-19f6370a5e4d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '.version_select at 0x7f04d07f6160>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:59.716204 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f373b29b-d447-4957-bfe4-19f6370a5e4d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-45616671" status: 202 len: 0 microversion: 2.1 time: 0.048470 Oct 24 10:32:59.716811 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1078/2087] 10.222.0.50 () {58 vars in 1215 bytes} [Mon Oct 24 10:32:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-45616671 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:32:59.735302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6ee6f638-7bf0-4fcf-8470-947a64441279 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:32:59.735937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6ee6f638-7bf0-4fcf-8470-947a64441279 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:32:59.744732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ee6f638-7bf0-4fcf-8470-947a64441279 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:59.745247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ee6f638-7bf0-4fcf-8470-947a64441279 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:59.745696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ee6f638-7bf0-4fcf-8470-947a64441279 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:59.746427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ee6f638-7bf0-4fcf-8470-947a64441279 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:32:59.746877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ee6f638-7bf0-4fcf-8470-947a64441279 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:32:59.747310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ee6f638-7bf0-4fcf-8470-947a64441279 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:32:59.774356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:00.038088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-26b10d0a-4eb6-4e23-bcab-0d93777e9806 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:00.057800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-26b10d0a-4eb6-4e23-bcab-0d93777e9806 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:00.062993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-26b10d0a-4eb6-4e23-bcab-0d93777e9806 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:00.064636 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-26b10d0a-4eb6-4e23-bcab-0d93777e9806 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.666030 Oct 24 10:33:00.081966 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1010/2088] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:32:59 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:33:00.150517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6ee6f638-7bf0-4fcf-8470-947a64441279 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:00.158762 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6ee6f638-7bf0-4fcf-8470-947a64441279 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1493 microversion: 2.1 time: 0.440895 Oct 24 10:33:00.173292 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1079/2089] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:32:59 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1493 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:00.398170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0b0ecfd4-99ba-4267-9ad3-8546b29a53d5 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:00.398798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0b0ecfd4-99ba-4267-9ad3-8546b29a53d5 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:00.421320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b0ecfd4-99ba-4267-9ad3-8546b29a53d5 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:00.423032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b0ecfd4-99ba-4267-9ad3-8546b29a53d5 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:00.427262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b0ecfd4-99ba-4267-9ad3-8546b29a53d5 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:00.433028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b0ecfd4-99ba-4267-9ad3-8546b29a53d5 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:00.433645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b0ecfd4-99ba-4267-9ad3-8546b29a53d5 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:00.434104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b0ecfd4-99ba-4267-9ad3-8546b29a53d5 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:00.495302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-543ba2da-091f-4eef-8b9f-47f9d53cffec req-46f7032b-129a-4f26-949b-72283b9a96d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b074ba99-0598-4bba-990f-df73ab74a17a", "name": "network-vif-deleted", "tag": "c7fce0f1-82b3-46c9-9179-04bbcc40683f"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:00.527211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-543ba2da-091f-4eef-8b9f-47f9d53cffec req-46f7032b-129a-4f26-949b-72283b9a96d2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:00.529733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-543ba2da-091f-4eef-8b9f-47f9d53cffec req-46f7032b-129a-4f26-949b-72283b9a96d2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:00.533038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-543ba2da-091f-4eef-8b9f-47f9d53cffec req-46f7032b-129a-4f26-949b-72283b9a96d2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:00.560984 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-543ba2da-091f-4eef-8b9f-47f9d53cffec req-46f7032b-129a-4f26-949b-72283b9a96d2 service nova] Creating event network-vif-deleted:c7fce0f1-82b3-46c9-9179-04bbcc40683f for instance b074ba99-0598-4bba-990f-df73ab74a17a on n-h1-858383-15 Oct 24 10:33:00.577527 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-543ba2da-091f-4eef-8b9f-47f9d53cffec req-46f7032b-129a-4f26-949b-72283b9a96d2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081398 Oct 24 10:33:00.580634 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1080/2090] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:33:00.615979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-78ac67c5-9711-41cb-962c-1fc9c607302a req-48b13986-419b-431e-9059-c604a35c6d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b873b2-ffe7-4ddd-8f31-6c99b3c93339", "name": "network-vif-plugged", "status": "completed", "tag": "5722d9e2-b941-414a-af1d-34999df87a8b"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:00.673952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-78ac67c5-9711-41cb-962c-1fc9c607302a req-48b13986-419b-431e-9059-c604a35c6d2e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:00.674439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-78ac67c5-9711-41cb-962c-1fc9c607302a req-48b13986-419b-431e-9059-c604a35c6d2e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:00.674878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-78ac67c5-9711-41cb-962c-1fc9c607302a req-48b13986-419b-431e-9059-c604a35c6d2e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:00.732091 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-78ac67c5-9711-41cb-962c-1fc9c607302a req-48b13986-419b-431e-9059-c604a35c6d2e service nova] Creating event network-vif-plugged:5722d9e2-b941-414a-af1d-34999df87a8b for instance a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 on n-h2-858383-15 Oct 24 10:33:00.747113 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-78ac67c5-9711-41cb-962c-1fc9c607302a req-48b13986-419b-431e-9059-c604a35c6d2e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162410 Oct 24 10:33:00.754330 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1081/2091] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:33:01.071549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0b0ecfd4-99ba-4267-9ad3-8546b29a53d5 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7bd36a563d4b4189301434f7f9bdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e37b041665467ab7b778324710c1c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:01.087704 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0b0ecfd4-99ba-4267-9ad3-8546b29a53d5 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 200 len: 1324 microversion: 2.1 time: 0.698802 Oct 24 10:33:01.091484 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1011/2092] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:00 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 1324 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:01.100650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-648ac653-7f01-402c-8bd3-c956153414b3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:01.101463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-648ac653-7f01-402c-8bd3-c956153414b3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:01.114350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-648ac653-7f01-402c-8bd3-c956153414b3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:01.121534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-648ac653-7f01-402c-8bd3-c956153414b3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:01.125960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-648ac653-7f01-402c-8bd3-c956153414b3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:01.128787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-648ac653-7f01-402c-8bd3-c956153414b3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:01.129776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-648ac653-7f01-402c-8bd3-c956153414b3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:01.131093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-648ac653-7f01-402c-8bd3-c956153414b3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:01.187815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0344bdd5-d373-4734-9209-498335679008 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:01.188658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0344bdd5-d373-4734-9209-498335679008 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:01.200713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0344bdd5-d373-4734-9209-498335679008 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:01.201501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0344bdd5-d373-4734-9209-498335679008 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:01.202050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0344bdd5-d373-4734-9209-498335679008 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:01.208310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0344bdd5-d373-4734-9209-498335679008 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:01.209226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0344bdd5-d373-4734-9209-498335679008 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:01.211181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0344bdd5-d373-4734-9209-498335679008 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:01.257806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0344bdd5-d373-4734-9209-498335679008 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:01.260249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0344bdd5-d373-4734-9209-498335679008 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:01.261195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0344bdd5-d373-4734-9209-498335679008 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:01.262259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-0344bdd5-d373-4734-9209-498335679008 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lazy-loading 'fault' on Instance uuid b074ba99-0598-4bba-990f-df73ab74a17a {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:33:01.942530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0344bdd5-d373-4734-9209-498335679008 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:01.952145 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0344bdd5-d373-4734-9209-498335679008 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 200 len: 1297 microversion: 2.1 time: 0.768575 Oct 24 10:33:01.953049 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1012/2093] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:01 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 1297 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:33:02.003390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-340052992", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "c82dc214-ef28-4d88-93f0-c1efe432f8da"}], "security_groups": [{"name": "tempest-securitygroup--1265175305"}], "key_name": "tempest-keypair-1507993324", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:02.015452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-648ac653-7f01-402c-8bd3-c956153414b3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:02.030362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-648ac653-7f01-402c-8bd3-c956153414b3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:02.037031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-648ac653-7f01-402c-8bd3-c956153414b3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:02.041392 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-648ac653-7f01-402c-8bd3-c956153414b3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.946354 Oct 24 10:33:02.059064 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1082/2094] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:33:01 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:33:02.115096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7d36ce1a-db43-453f-a333-66440da7b30f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:02.115720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7d36ce1a-db43-453f-a333-66440da7b30f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:02.140702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d36ce1a-db43-453f-a333-66440da7b30f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:02.143248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d36ce1a-db43-453f-a333-66440da7b30f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:02.145631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d36ce1a-db43-453f-a333-66440da7b30f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:02.148269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d36ce1a-db43-453f-a333-66440da7b30f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:02.149134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d36ce1a-db43-453f-a333-66440da7b30f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:02.149682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d36ce1a-db43-453f-a333-66440da7b30f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:02.258592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] validate_networks() for [('c82dc214-ef28-4d88-93f0-c1efe432f8da', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:33:02.500343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7d36ce1a-db43-453f-a333-66440da7b30f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7bd36a563d4b4189301434f7f9bdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e37b041665467ab7b778324710c1c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:02.509708 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7d36ce1a-db43-453f-a333-66440da7b30f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 200 len: 1324 microversion: 2.1 time: 0.398279 Oct 24 10:33:02.511174 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1083/2095] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:02 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 1324 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:33:02.516079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-dc775b56-1b00-46cc-ab1b-cf8b9b00f44f req-c8a071a1-ca16-4e2b-abc1-786a9f4c574d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513ca608-24c9-45f9-8fb9-e231d92c7262", "tag": "b2def801-647c-479d-9e34-cb0b4d60448e"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:02.528649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dc775b56-1b00-46cc-ab1b-cf8b9b00f44f req-c8a071a1-ca16-4e2b-abc1-786a9f4c574d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:02.529191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dc775b56-1b00-46cc-ab1b-cf8b9b00f44f req-c8a071a1-ca16-4e2b-abc1-786a9f4c574d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:02.529873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dc775b56-1b00-46cc-ab1b-cf8b9b00f44f req-c8a071a1-ca16-4e2b-abc1-786a9f4c574d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:02.544258 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-dc775b56-1b00-46cc-ab1b-cf8b9b00f44f req-c8a071a1-ca16-4e2b-abc1-786a9f4c574d service nova] Creating event network-changed:b2def801-647c-479d-9e34-cb0b4d60448e for instance 513ca608-24c9-45f9-8fb9-e231d92c7262 on n-h2-858383-15 Oct 24 10:33:02.549153 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-dc775b56-1b00-46cc-ab1b-cf8b9b00f44f req-c8a071a1-ca16-4e2b-abc1-786a9f4c574d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036645 Oct 24 10:33:02.549766 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1084/2096] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:33:02.561753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d562405b-d78c-4756-86a1-ffe5fae8494a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:02.562359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d562405b-d78c-4756-86a1-ffe5fae8494a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:02.569910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d562405b-d78c-4756-86a1-ffe5fae8494a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:02.570641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d562405b-d78c-4756-86a1-ffe5fae8494a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:02.571177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d562405b-d78c-4756-86a1-ffe5fae8494a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:02.572403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d562405b-d78c-4756-86a1-ffe5fae8494a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:02.573318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d562405b-d78c-4756-86a1-ffe5fae8494a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:02.573763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d562405b-d78c-4756-86a1-ffe5fae8494a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:02.602830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d562405b-d78c-4756-86a1-ffe5fae8494a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:33:02.701912 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d562405b-d78c-4756-86a1-ffe5fae8494a tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 204 len: 0 microversion: 2.1 time: 0.150514 Oct 24 10:33:02.705588 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1085/2097] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:33:02 2022] DELETE /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:33:02.715454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0bcf89f3-b5dc-4b57-9178-6a321675e3c7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:02.716179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0bcf89f3-b5dc-4b57-9178-6a321675e3c7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:02.722233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bcf89f3-b5dc-4b57-9178-6a321675e3c7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:02.722730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bcf89f3-b5dc-4b57-9178-6a321675e3c7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:02.723172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bcf89f3-b5dc-4b57-9178-6a321675e3c7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:02.723889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bcf89f3-b5dc-4b57-9178-6a321675e3c7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:02.724351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bcf89f3-b5dc-4b57-9178-6a321675e3c7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:02.724788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bcf89f3-b5dc-4b57-9178-6a321675e3c7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:03.062882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0bcf89f3-b5dc-4b57-9178-6a321675e3c7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:03.072470 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0bcf89f3-b5dc-4b57-9178-6a321675e3c7 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1486 microversion: 2.1 time: 0.363493 Oct 24 10:33:03.073893 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1086/2098] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:02 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1486 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:03.091057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d785b52c-3df8-44ac-866b-e055e855b730 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:03.091962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d785b52c-3df8-44ac-866b-e055e855b730 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:03.098936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d785b52c-3df8-44ac-866b-e055e855b730 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:03.099823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d785b52c-3df8-44ac-866b-e055e855b730 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:03.100258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d785b52c-3df8-44ac-866b-e055e855b730 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:03.101111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d785b52c-3df8-44ac-866b-e055e855b730 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:03.102033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d785b52c-3df8-44ac-866b-e055e855b730 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:03.102621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d785b52c-3df8-44ac-866b-e055e855b730 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:03.142257 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-d785b52c-3df8-44ac-866b-e055e855b730 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] HTTP exception thrown: Instance b074ba99-0598-4bba-990f-df73ab74a17a could not be found. Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d785b52c-3df8-44ac-866b-e055e855b730 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Request method failure captured: Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a HTTP/1.1 Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmiA0DX_liToZ0pV228zL8tkxDoNZ90C_zUfh-mcLGRAqyETpR76J5rYcXmiUHNSeTdzUlLyX_GlkjvJrDNIB_LcXFEXEXbL4YIW1Ztk17MFGvIShjUKAccUvpxeM8eeBjB9ehAARGytA1LCpkYper2iI7o_fPsRJLjlHtsIw0XxO2c Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:33:03.144362 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:33:03.145975 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a3ff02c01a64c9a940de444ca1197c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:03.145975 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:03.145975 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:03.145975 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:03.145975 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:03.145975 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:33:03.145975 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:33:03.145975 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 43fd0499bc224bd8b190701a811ee204 Oct 24 10:33:03.145975 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:03.145975 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:33:03.145975 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance b074ba99-0598-4bba-990f-df73ab74a17a could not be found. Oct 24 10:33:03.145975 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'b074ba99-0598-4bba-990f-df73ab74a17a'} Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b074ba99-0598-4bba-990f-df73ab74a17a could not be found. Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:03.146857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:03.148243 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:03.148243 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:33:03.148243 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:33:03.148243 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:33:03.148243 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:33:03.148243 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:33:03.148243 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:33:03.148243 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b074ba99-0598-4bba-990f-df73ab74a17a could not be found. Oct 24 10:33:03.148243 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:03.148243 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:03.148243 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:03.148243 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:03.148243 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:03.148243 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:03.148243 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:03.148243 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:03.148243 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b074ba99-0598-4bba-990f-df73ab74a17a could not be found. Oct 24 10:33:03.148243 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:03.151928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d785b52c-3df8-44ac-866b-e055e855b730 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Returning 404 to user: Instance b074ba99-0598-4bba-990f-df73ab74a17a could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:03.153090 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d785b52c-3df8-44ac-866b-e055e855b730 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 404 len: 111 microversion: 2.1 time: 0.078084 Oct 24 10:33:03.154249 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1087/2099] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:03 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:33:03.159466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-29278177-acbc-4709-a0be-b79248e4db55 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:03.160322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-29278177-acbc-4709-a0be-b79248e4db55 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:03.167800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29278177-acbc-4709-a0be-b79248e4db55 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:03.168721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29278177-acbc-4709-a0be-b79248e4db55 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:03.169468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29278177-acbc-4709-a0be-b79248e4db55 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:03.170434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29278177-acbc-4709-a0be-b79248e4db55 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:03.181742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29278177-acbc-4709-a0be-b79248e4db55 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:03.186096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29278177-acbc-4709-a0be-b79248e4db55 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:03.410927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Getting quotas for project 3ac4ab050ff04fcab31bd2716c109436. Resources: dict_keys(['metadata_items']) {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:33:03.425912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Getting quotas for user 8044061b791543b6971fd889ad161161 and project 3ac4ab050ff04fcab31bd2716c109436. Resources: dict_keys(['metadata_items']) {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:33:03.461581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:33:03.462004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:33:03.468005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:33:03.468807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:33:03.469265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:33:03.486164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:03.486657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:03.490166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:03.494043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:03.497028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:03.497738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:03.539992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Getting quotas for project 3ac4ab050ff04fcab31bd2716c109436. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:33:03.547487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Getting quotas for user 8044061b791543b6971fd889ad161161 and project 3ac4ab050ff04fcab31bd2716c109436. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:33:03.564082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:33:03.568036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:33:03.646845 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-78bac8ce-7066-40d5-820e-5a9bb2e47a06 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.647804 Oct 24 10:33:03.648345 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1013/2100] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:33:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 1650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:33:03.656466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6c81fcf6-e3e6-4712-8598-35cfc0dc8f21 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d4fc0280>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:03.668154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-29278177-acbc-4709-a0be-b79248e4db55 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:03.678232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-29278177-acbc-4709-a0be-b79248e4db55 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:03.684921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-29278177-acbc-4709-a0be-b79248e4db55 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:03.688310 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-29278177-acbc-4709-a0be-b79248e4db55 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.532186 Oct 24 10:33:03.697259 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1088/2101] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:33:03 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:33:03.705703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ada92d77-75e8-475c-a72c-81a5a7260754 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:03.706348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ada92d77-75e8-475c-a72c-81a5a7260754 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:03.730719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ada92d77-75e8-475c-a72c-81a5a7260754 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:03.731220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ada92d77-75e8-475c-a72c-81a5a7260754 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:03.731661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ada92d77-75e8-475c-a72c-81a5a7260754 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:03.732383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ada92d77-75e8-475c-a72c-81a5a7260754 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:03.741495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ada92d77-75e8-475c-a72c-81a5a7260754 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:03.743284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ada92d77-75e8-475c-a72c-81a5a7260754 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:04.281277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ada92d77-75e8-475c-a72c-81a5a7260754 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7bd36a563d4b4189301434f7f9bdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e37b041665467ab7b778324710c1c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:04.299616 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ada92d77-75e8-475c-a72c-81a5a7260754 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 200 len: 1520 microversion: 2.1 time: 0.601181 Oct 24 10:33:04.300727 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1089/2102] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:03 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 1520 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:04.305682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-643d1233-da02-48f5-af92-e0b1a4004389 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:04.306979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-643d1233-da02-48f5-af92-e0b1a4004389 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:04.428301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-643d1233-da02-48f5-af92-e0b1a4004389 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:04.440224 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-643d1233-da02-48f5-af92-e0b1a4004389 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f" status: 200 len: 1277 microversion: 2.1 time: 0.138371 Oct 24 10:33:04.441107 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1090/2103] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:04 2022] GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f => generated 1277 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:04.461104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2b454666-786b-4f72-8a95-4db5dd593f5f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:04.461811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2b454666-786b-4f72-8a95-4db5dd593f5f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:04.468749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b454666-786b-4f72-8a95-4db5dd593f5f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:04.481551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b454666-786b-4f72-8a95-4db5dd593f5f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:04.482136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b454666-786b-4f72-8a95-4db5dd593f5f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:04.483046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b454666-786b-4f72-8a95-4db5dd593f5f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:04.483527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b454666-786b-4f72-8a95-4db5dd593f5f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:04.484051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b454666-786b-4f72-8a95-4db5dd593f5f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:04.659736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2b454666-786b-4f72-8a95-4db5dd593f5f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:04.669157 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2b454666-786b-4f72-8a95-4db5dd593f5f tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1444 microversion: 2.1 time: 0.226756 Oct 24 10:33:04.669759 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1091/2104] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:04 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1444 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:04.677279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6f6ff7d3-08a8-4842-a543-e12f405534ac tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2044779508", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "e51243f1-b3f3-4576-87c2-d84ddd5e63e0"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6f6ff7d3-08a8-4842-a543-e12f405534ac tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Request method failure captured: Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 243 Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmnFVrDtM-a34AbKBJrEoETal5V43JgZ67OsfBwFR5juAamG1yZLwzxriz_72WhbUcyKRxeb1FLbUHIxY4UyVF9SjoAZX9zlNILbnXEh3aBWKGb6nzyLg91DNxdI360q5upvPYFWJD9hxS7D-3d1o73hOVCs0OktKoQFouC75IPQUHo Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 95e37b041665467ab7b778324710c1c0 Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:33:04.683178 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:33:04.684365 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/95e37b041665467ab7b778324710c1c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/95e37b041665467ab7b778324710c1c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/95e37b041665467ab7b778324710c1c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_95e37b041665467ab7b778324710c1c0", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:04.684365 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:04.684365 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 95e37b041665467ab7b778324710c1c0 Oct 24 10:33:04.684365 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:04.684365 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerMetadataNegativeTestJSON-1559396102-project Oct 24 10:33:04.684365 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:33:04.684365 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:33:04.684365 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 7f7bd36a563d4b4189301434f7f9bdba Oct 24 10:33:04.684365 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1559396102-project Oct 24 10:33:04.684365 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:33:04.684365 n-d-858383-15 devstack@n-api.service[120426]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2044779508", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "e51243f1-b3f3-4576-87c2-d84ddd5e63e0"}]}} Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2044779508', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'e51243f1-b3f3-4576-87c2-d84ddd5e63e0'}]}}} Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 10:33:04.685003 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:04.685996 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:04.687049 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:04.687049 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:04.687049 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:04.687049 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:04.687049 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:04.687049 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:33:04.687049 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:33:04.687049 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:04.687049 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:04.690611 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6c81fcf6-e3e6-4712-8598-35cfc0dc8f21 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a" status: 204 len: 0 microversion: 2.1 time: 1.040926 Oct 24 10:33:04.691691 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1014/2105] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:03 2022] DELETE /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a => generated 0 bytes in 1043 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:33:04.692737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6f6ff7d3-08a8-4842-a543-e12f405534ac tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:04.693859 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6f6ff7d3-08a8-4842-a543-e12f405534ac tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.023129 Oct 24 10:33:04.714320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5c43f279-b018-4d60-ac18-52c69436730c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:04.717011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c43f279-b018-4d60-ac18-52c69436730c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: e09308b8-ad10-4557-bb53-7bdf515bbf36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:04.723286 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1092/2106] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:33:04 2022] POST /compute/v2.1/servers => generated 175 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:33:04.736524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cd3cb476-bef5-4cf9-af7b-f5fe0dc9cbd0 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:04.737663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cd3cb476-bef5-4cf9-af7b-f5fe0dc9cbd0 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: cc23799a-3b11-44a6-9f85-8f8e292322c8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:04.739999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c43f279-b018-4d60-ac18-52c69436730c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:04.741776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c43f279-b018-4d60-ac18-52c69436730c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:04.742609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c43f279-b018-4d60-ac18-52c69436730c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:04.744901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c43f279-b018-4d60-ac18-52c69436730c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:04.747437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c43f279-b018-4d60-ac18-52c69436730c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:04.747845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c43f279-b018-4d60-ac18-52c69436730c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:04.755414 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-cd3cb476-bef5-4cf9-af7b-f5fe0dc9cbd0 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] HTTP exception thrown: Instance cc23799a-3b11-44a6-9f85-8f8e292322c8 could not be found. Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cd3cb476-bef5-4cf9-af7b-f5fe0dc9cbd0 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Request method failure captured: Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/cc23799a-3b11-44a6-9f85-8f8e292322c8/metadata HTTP/1.1 Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmnFVrDtM-a34AbKBJrEoETal5V43JgZ67OsfBwFR5juAamG1yZLwzxriz_72WhbUcyKRxeb1FLbUHIxY4UyVF9SjoAZX9zlNILbnXEh3aBWKGb6nzyLg91DNxdI360q5upvPYFWJD9hxS7D-3d1o73hOVCs0OktKoQFouC75IPQUHo Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 95e37b041665467ab7b778324710c1c0 Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:33:04.760671 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:33:04.761725 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/95e37b041665467ab7b778324710c1c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/95e37b041665467ab7b778324710c1c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/95e37b041665467ab7b778324710c1c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_95e37b041665467ab7b778324710c1c0", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:04.761725 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:04.761725 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 95e37b041665467ab7b778324710c1c0 Oct 24 10:33:04.761725 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:04.761725 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerMetadataNegativeTestJSON-1559396102-project Oct 24 10:33:04.761725 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:33:04.761725 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:33:04.761725 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 7f7bd36a563d4b4189301434f7f9bdba Oct 24 10:33:04.761725 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1559396102-project Oct 24 10:33:04.761725 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:33:04.761725 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance cc23799a-3b11-44a6-9f85-8f8e292322c8 could not be found. Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'server_id': 'cc23799a-3b11-44a6-9f85-8f8e292322c8'} Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc23799a-3b11-44a6-9f85-8f8e292322c8 could not be found. Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:04.762229 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:04.763156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 24 10:33:04.763156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 24 10:33:04.763156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:33:04.763156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:33:04.763156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc23799a-3b11-44a6-9f85-8f8e292322c8 could not be found. Oct 24 10:33:04.763156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:04.763156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:04.763156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:04.763156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:04.763156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:04.763156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:04.763156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:04.763156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:04.763156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc23799a-3b11-44a6-9f85-8f8e292322c8 could not be found. Oct 24 10:33:04.763156 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:04.768213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cd3cb476-bef5-4cf9-af7b-f5fe0dc9cbd0 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Returning 404 to user: Instance cc23799a-3b11-44a6-9f85-8f8e292322c8 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:04.769602 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cd3cb476-bef5-4cf9-af7b-f5fe0dc9cbd0 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/cc23799a-3b11-44a6-9f85-8f8e292322c8/metadata" status: 404 len: 111 microversion: 2.1 time: 0.044476 Oct 24 10:33:04.790177 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1093/2107] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:33:04 2022] GET /compute/v2.1/servers/cc23799a-3b11-44a6-9f85-8f8e292322c8/metadata => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:33:04.795373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-291aa5d4-5d4f-4143-b9be-d45e8d0a7ab4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:04.800010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-291aa5d4-5d4f-4143-b9be-d45e8d0a7ab4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:04.813600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-291aa5d4-5d4f-4143-b9be-d45e8d0a7ab4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:04.814096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-291aa5d4-5d4f-4143-b9be-d45e8d0a7ab4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:04.814528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-291aa5d4-5d4f-4143-b9be-d45e8d0a7ab4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:04.819854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-291aa5d4-5d4f-4143-b9be-d45e8d0a7ab4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:04.820731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-291aa5d4-5d4f-4143-b9be-d45e8d0a7ab4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:04.825136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-291aa5d4-5d4f-4143-b9be-d45e8d0a7ab4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:04.834954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c43f279-b018-4d60-ac18-52c69436730c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: e09308b8-ad10-4557-bb53-7bdf515bbf36] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:33:05.077371 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5c43f279-b018-4d60-ac18-52c69436730c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36" status: 204 len: 0 microversion: 2.1 time: 0.374539 Oct 24 10:33:05.080421 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1015/2108] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:33:04 2022] DELETE /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:33:05.099790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-4d43d6e6-1a64-4b52-9d1a-ce52c770dff2 req-8e8c9cb1-1366-453f-a297-ea29409e3c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ef26c4-a579-469e-b5db-bc2b0e17e99d", "name": "network-vif-deleted", "tag": "7b8b4301-4ceb-4f7a-a75e-0a52614ad84f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:05.129746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4d43d6e6-1a64-4b52-9d1a-ce52c770dff2 req-8e8c9cb1-1366-453f-a297-ea29409e3c54 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:05.131707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4d43d6e6-1a64-4b52-9d1a-ce52c770dff2 req-8e8c9cb1-1366-453f-a297-ea29409e3c54 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:05.132787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4d43d6e6-1a64-4b52-9d1a-ce52c770dff2 req-8e8c9cb1-1366-453f-a297-ea29409e3c54 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:05.163305 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-4d43d6e6-1a64-4b52-9d1a-ce52c770dff2 req-8e8c9cb1-1366-453f-a297-ea29409e3c54 service nova] Creating event network-vif-deleted:7b8b4301-4ceb-4f7a-a75e-0a52614ad84f for instance e0ef26c4-a579-469e-b5db-bc2b0e17e99d on n-h1-858383-15 Oct 24 10:33:05.174696 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-4d43d6e6-1a64-4b52-9d1a-ce52c770dff2 req-8e8c9cb1-1366-453f-a297-ea29409e3c54 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082508 Oct 24 10:33:05.175833 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1016/2109] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:33:05.183186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2e601dc3-d837-446f-aba0-62ab47ea4804 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-373174046", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e51243f1-b3f3-4576-87c2-d84ddd5e63e0"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:05.187852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-291aa5d4-5d4f-4143-b9be-d45e8d0a7ab4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2e601dc3-d837-446f-aba0-62ab47ea4804 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Request method failure captured: Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 498 Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmnFVrDtM-a34AbKBJrEoETal5V43JgZ67OsfBwFR5juAamG1yZLwzxriz_72WhbUcyKRxeb1FLbUHIxY4UyVF9SjoAZX9zlNILbnXEh3aBWKGb6nzyLg91DNxdI360q5upvPYFWJD9hxS7D-3d1o73hOVCs0OktKoQFouC75IPQUHo Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 95e37b041665467ab7b778324710c1c0 Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:33:05.188487 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:33:05.189505 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/95e37b041665467ab7b778324710c1c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/95e37b041665467ab7b778324710c1c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/95e37b041665467ab7b778324710c1c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_95e37b041665467ab7b778324710c1c0", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:05.189505 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:05.189505 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 95e37b041665467ab7b778324710c1c0 Oct 24 10:33:05.189505 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:05.189505 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerMetadataNegativeTestJSON-1559396102-project Oct 24 10:33:05.189505 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:33:05.189505 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:33:05.189505 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 7f7bd36a563d4b4189301434f7f9bdba Oct 24 10:33:05.189505 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1559396102-project Oct 24 10:33:05.189505 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:33:05.189992 n-d-858383-15 devstack@n-api.service[120425]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-373174046", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e51243f1-b3f3-4576-87c2-d84ddd5e63e0"}]}} Oct 24 10:33:05.189992 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:33:05.189992 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:05.189992 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-373174046', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e51243f1-b3f3-4576-87c2-d84ddd5e63e0'}]}}} Oct 24 10:33:05.189992 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:05.189992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:05.190295 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:33:05.190295 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:33:05.190295 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:33:05.190295 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:33:05.190295 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:05.190295 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.190295 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 24 10:33:05.190295 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 24 10:33:05.190295 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 24 10:33:05.190295 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 24 10:33:05.190295 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 24 10:33:05.190295 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.190295 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 10:33:05.190295 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 24 10:33:05.190295 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.190295 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:05.190295 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.191046 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:05.191046 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:05.191046 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:05.191046 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:05.191046 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:05.191046 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:05.191046 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:05.191046 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:33:05.191046 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:33:05.191046 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:33:05.191046 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:33:05.191046 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:33:05.191046 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:33:05.191046 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:33:05.191046 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:33:05.191694 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:05.191694 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.191694 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:05.191694 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.191694 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:05.191694 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:05.191694 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:05.191694 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:33:05.191694 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:33:05.192101 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:05.192101 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.192101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2e601dc3-d837-446f-aba0-62ab47ea4804 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:05.192280 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2e601dc3-d837-446f-aba0-62ab47ea4804 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.013997 Oct 24 10:33:05.192280 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1017/2110] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:33:05 2022] POST /compute/v2.1/servers => generated 687 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:33:05.203169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-291aa5d4-5d4f-4143-b9be-d45e8d0a7ab4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:05.204991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-291aa5d4-5d4f-4143-b9be-d45e8d0a7ab4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:05.207412 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-291aa5d4-5d4f-4143-b9be-d45e8d0a7ab4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.415951 Oct 24 10:33:05.208964 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1094/2111] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:33:04 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:33:05.242533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e3e5b1cc-3dad-48c1-9234-d220729c530d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-812996978", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "c0c03a0b-80ac-4629-802c-40f648b11429"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:05.264735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fcd376eb-bf52-425a-bd8c-5d0b7da4be33 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1097755449", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e51243f1-b3f3-4576-87c2-d84ddd5e63e0"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fcd376eb-bf52-425a-bd8c-5d0b7da4be33 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Request method failure captured: Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 500 Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmnFVrDtM-a34AbKBJrEoETal5V43JgZ67OsfBwFR5juAamG1yZLwzxriz_72WhbUcyKRxeb1FLbUHIxY4UyVF9SjoAZX9zlNILbnXEh3aBWKGb6nzyLg91DNxdI360q5upvPYFWJD9hxS7D-3d1o73hOVCs0OktKoQFouC75IPQUHo Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 95e37b041665467ab7b778324710c1c0 Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:33:05.269720 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:33:05.270913 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/95e37b041665467ab7b778324710c1c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/95e37b041665467ab7b778324710c1c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/95e37b041665467ab7b778324710c1c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_95e37b041665467ab7b778324710c1c0", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:05.270913 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:05.270913 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 95e37b041665467ab7b778324710c1c0 Oct 24 10:33:05.270913 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:05.270913 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerMetadataNegativeTestJSON-1559396102-project Oct 24 10:33:05.270913 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:33:05.270913 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:33:05.270913 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 7f7bd36a563d4b4189301434f7f9bdba Oct 24 10:33:05.270913 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1559396102-project Oct 24 10:33:05.270913 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:33:05.271481 n-d-858383-15 devstack@n-api.service[120426]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1097755449", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e51243f1-b3f3-4576-87c2-d84ddd5e63e0"}]}} Oct 24 10:33:05.271481 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:33:05.271481 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:05.271481 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1097755449', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e51243f1-b3f3-4576-87c2-d84ddd5e63e0'}]}}} Oct 24 10:33:05.271481 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:05.271481 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:05.271863 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:33:05.271863 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:33:05.271863 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:33:05.271863 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:33:05.271863 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:05.271863 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.271863 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 24 10:33:05.271863 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 24 10:33:05.271863 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 24 10:33:05.271863 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 24 10:33:05.271863 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 24 10:33:05.271863 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.271863 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 10:33:05.271863 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 24 10:33:05.271863 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.271863 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:05.271863 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.272799 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:05.272799 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:05.272799 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:05.272799 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:05.272799 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:05.272799 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:05.272799 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:05.272799 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:33:05.272799 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:33:05.272799 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:33:05.272799 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:33:05.272799 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:33:05.272799 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:33:05.272799 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:33:05.272799 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:33:05.273621 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:05.273621 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.273621 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:05.273621 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.273621 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:05.273621 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:05.273621 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:05.273621 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:33:05.273621 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:33:05.274094 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:05.274094 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.274094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fcd376eb-bf52-425a-bd8c-5d0b7da4be33 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:05.274304 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fcd376eb-bf52-425a-bd8c-5d0b7da4be33 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.011176 Oct 24 10:33:05.281872 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1095/2112] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:33:05 2022] POST /compute/v2.1/servers => generated 689 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 10:33:05.301380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-e3e5b1cc-3dad-48c1-9234-d220729c530d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] validate_networks() for [('c0c03a0b-80ac-4629-802c-40f648b11429', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:33:05.324182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-10bed655-7897-4ffa-ab4c-c8c08a1df9e7 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-188238808", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e51243f1-b3f3-4576-87c2-d84ddd5e63e0"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-10bed655-7897-4ffa-ab4c-c8c08a1df9e7 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Request method failure captured: Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 753 Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmnFVrDtM-a34AbKBJrEoETal5V43JgZ67OsfBwFR5juAamG1yZLwzxriz_72WhbUcyKRxeb1FLbUHIxY4UyVF9SjoAZX9zlNILbnXEh3aBWKGb6nzyLg91DNxdI360q5upvPYFWJD9hxS7D-3d1o73hOVCs0OktKoQFouC75IPQUHo Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 95e37b041665467ab7b778324710c1c0 Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:33:05.329091 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:33:05.330184 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/95e37b041665467ab7b778324710c1c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/95e37b041665467ab7b778324710c1c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/95e37b041665467ab7b778324710c1c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_95e37b041665467ab7b778324710c1c0", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:05.330184 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:05.330184 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 95e37b041665467ab7b778324710c1c0 Oct 24 10:33:05.330184 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:05.330184 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerMetadataNegativeTestJSON-1559396102-project Oct 24 10:33:05.330184 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:33:05.330184 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:33:05.330184 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 7f7bd36a563d4b4189301434f7f9bdba Oct 24 10:33:05.330184 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1559396102-project Oct 24 10:33:05.330184 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:33:05.330668 n-d-858383-15 devstack@n-api.service[120426]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-188238808", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e51243f1-b3f3-4576-87c2-d84ddd5e63e0"}]}} Oct 24 10:33:05.330668 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:33:05.330668 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:05.330882 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-188238808', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e51243f1-b3f3-4576-87c2-d84ddd5e63e0'}]}}} Oct 24 10:33:05.330882 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:05.330882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:05.330882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:33:05.330882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:33:05.330882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:33:05.330882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:33:05.330882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:05.331363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.331363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 24 10:33:05.331363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 24 10:33:05.331363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 24 10:33:05.331363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 24 10:33:05.331363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 24 10:33:05.331363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.331363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 10:33:05.331363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 24 10:33:05.331363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.331363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:05.331363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.331363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:05.331363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:05.331363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:05.331363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:05.331363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:05.332283 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:05.332283 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:05.332283 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:33:05.332283 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:33:05.332283 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:33:05.332283 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:33:05.332283 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:33:05.332283 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:33:05.332283 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:33:05.332283 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:33:05.332724 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:05.332724 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.332724 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:05.332724 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.332724 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:05.332724 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:05.332724 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:05.332724 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:33:05.332724 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:33:05.333295 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:05.333295 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.333455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-10bed655-7897-4ffa-ab4c-c8c08a1df9e7 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:05.334362 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-10bed655-7897-4ffa-ab4c-c8c08a1df9e7 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.016622 Oct 24 10:33:05.336872 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1096/2113] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:33:05 2022] POST /compute/v2.1/servers => generated 1197 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 24 10:33:05.386808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f499be53-4fec-43b7-b983-91b3c08b8497 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-516491341", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e51243f1-b3f3-4576-87c2-d84ddd5e63e0"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f499be53-4fec-43b7-b983-91b3c08b8497 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Request method failure captured: Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 1265 Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmnFVrDtM-a34AbKBJrEoETal5V43JgZ67OsfBwFR5juAamG1yZLwzxriz_72WhbUcyKRxeb1FLbUHIxY4UyVF9SjoAZX9zlNILbnXEh3aBWKGb6nzyLg91DNxdI360q5upvPYFWJD9hxS7D-3d1o73hOVCs0OktKoQFouC75IPQUHo Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 95e37b041665467ab7b778324710c1c0 Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:33:05.391077 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:33:05.392115 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/95e37b041665467ab7b778324710c1c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/95e37b041665467ab7b778324710c1c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/95e37b041665467ab7b778324710c1c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_95e37b041665467ab7b778324710c1c0", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:05.392115 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:05.392115 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 95e37b041665467ab7b778324710c1c0 Oct 24 10:33:05.392115 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:05.392115 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerMetadataNegativeTestJSON-1559396102-project Oct 24 10:33:05.392115 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:33:05.392115 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:33:05.392115 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 7f7bd36a563d4b4189301434f7f9bdba Oct 24 10:33:05.392115 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1559396102-project Oct 24 10:33:05.392115 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:33:05.392583 n-d-858383-15 devstack@n-api.service[120426]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-516491341", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e51243f1-b3f3-4576-87c2-d84ddd5e63e0"}]}} Oct 24 10:33:05.392583 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:33:05.392713 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:05.392713 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-516491341', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e51243f1-b3f3-4576-87c2-d84ddd5e63e0'}]}}} Oct 24 10:33:05.392713 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:05.392713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:05.392713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:33:05.392713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:33:05.392713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:33:05.392713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:33:05.392713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:05.392713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.392713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 24 10:33:05.392713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 24 10:33:05.392713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 24 10:33:05.392713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 24 10:33:05.392713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 24 10:33:05.392713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.392713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:33:05.394161 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:33:05.396093 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:33:05.396093 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.396093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f499be53-4fec-43b7-b983-91b3c08b8497 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:05.396093 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f499be53-4fec-43b7-b983-91b3c08b8497 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.010772 Oct 24 10:33:05.396093 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1097/2114] 10.222.0.50 () {60 vars in 1148 bytes} [Mon Oct 24 10:33:05 2022] POST /compute/v2.1/servers => generated 2221 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 24 10:33:05.410674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-be37f992-e077-412c-94ea-1321bdd0777f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:05.411272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-be37f992-e077-412c-94ea-1321bdd0777f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: 0b22e272-e44b-414e-9650-e3d8a3fa9035] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:05.417008 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-be37f992-e077-412c-94ea-1321bdd0777f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] HTTP exception thrown: Instance 0b22e272-e44b-414e-9650-e3d8a3fa9035 could not be found. Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-be37f992-e077-412c-94ea-1321bdd0777f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Request method failure captured: Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/0b22e272-e44b-414e-9650-e3d8a3fa9035/metadata/test2 HTTP/1.1 Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmnFVrDtM-a34AbKBJrEoETal5V43JgZ67OsfBwFR5juAamG1yZLwzxriz_72WhbUcyKRxeb1FLbUHIxY4UyVF9SjoAZX9zlNILbnXEh3aBWKGb6nzyLg91DNxdI360q5upvPYFWJD9hxS7D-3d1o73hOVCs0OktKoQFouC75IPQUHo Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 95e37b041665467ab7b778324710c1c0 Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/95e37b041665467ab7b778324710c1c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/95e37b041665467ab7b778324710c1c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/95e37b041665467ab7b778324710c1c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_95e37b041665467ab7b778324710c1c0", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 95e37b041665467ab7b778324710c1c0 Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerMetadataNegativeTestJSON-1559396102-project Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 7f7bd36a563d4b4189301434f7f9bdba Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1559396102-project Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 0b22e272-e44b-414e-9650-e3d8a3fa9035 could not be found. Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'server_id': '0b22e272-e44b-414e-9650-e3d8a3fa9035', 'id': 'test2'} Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b22e272-e44b-414e-9650-e3d8a3fa9035 could not be found. Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b22e272-e44b-414e-9650-e3d8a3fa9035 could not be found. Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:05.418485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:05.421832 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:05.421832 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:05.421832 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b22e272-e44b-414e-9650-e3d8a3fa9035 could not be found. Oct 24 10:33:05.421832 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:05.421832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-be37f992-e077-412c-94ea-1321bdd0777f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Returning 404 to user: Instance 0b22e272-e44b-414e-9650-e3d8a3fa9035 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:05.421832 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-be37f992-e077-412c-94ea-1321bdd0777f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/0b22e272-e44b-414e-9650-e3d8a3fa9035/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.013330 Oct 24 10:33:05.421832 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1098/2115] 10.222.0.50 () {58 vars in 1281 bytes} [Mon Oct 24 10:33:05 2022] GET /compute/v2.1/servers/0b22e272-e44b-414e-9650-e3d8a3fa9035/metadata/test2 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:33:05.436206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2bd09860-277f-4396-a2db-f62c8299f96d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:05.437475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2bd09860-277f-4396-a2db-f62c8299f96d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:05.443796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bd09860-277f-4396-a2db-f62c8299f96d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:05.444355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bd09860-277f-4396-a2db-f62c8299f96d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:05.444903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bd09860-277f-4396-a2db-f62c8299f96d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:05.445678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bd09860-277f-4396-a2db-f62c8299f96d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:05.446141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bd09860-277f-4396-a2db-f62c8299f96d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:05.447419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bd09860-277f-4396-a2db-f62c8299f96d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:05.474867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2bd09860-277f-4396-a2db-f62c8299f96d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:33:05.587155 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2bd09860-277f-4396-a2db-f62c8299f96d tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 204 len: 0 microversion: 2.1 time: 0.155676 Oct 24 10:33:05.588599 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1099/2116] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:33:05 2022] DELETE /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:33:05.595855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-648e907a-21ff-4482-88e2-77c47e84c05e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:05.596984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-648e907a-21ff-4482-88e2-77c47e84c05e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:05.605055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-648e907a-21ff-4482-88e2-77c47e84c05e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:05.605831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-648e907a-21ff-4482-88e2-77c47e84c05e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:05.606597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-648e907a-21ff-4482-88e2-77c47e84c05e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:05.608220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-648e907a-21ff-4482-88e2-77c47e84c05e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:05.609426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-648e907a-21ff-4482-88e2-77c47e84c05e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:05.609961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-648e907a-21ff-4482-88e2-77c47e84c05e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:05.794946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-648e907a-21ff-4482-88e2-77c47e84c05e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:05.805513 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-648e907a-21ff-4482-88e2-77c47e84c05e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f" status: 200 len: 1337 microversion: 2.1 time: 0.215289 Oct 24 10:33:05.807966 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1100/2117] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:05 2022] GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f => generated 1337 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:05.813649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6b0c6c23-c1c4-45ac-95e8-ab7ed2dd750f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:05.814444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6b0c6c23-c1c4-45ac-95e8-ab7ed2dd750f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:05.822936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b0c6c23-c1c4-45ac-95e8-ab7ed2dd750f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:05.823634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b0c6c23-c1c4-45ac-95e8-ab7ed2dd750f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:05.824520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b0c6c23-c1c4-45ac-95e8-ab7ed2dd750f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:05.825597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b0c6c23-c1c4-45ac-95e8-ab7ed2dd750f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:05.826574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b0c6c23-c1c4-45ac-95e8-ab7ed2dd750f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:05.827192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b0c6c23-c1c4-45ac-95e8-ab7ed2dd750f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:05.869387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e3e5b1cc-3dad-48c1-9234-d220729c530d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:33:05.869921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e3e5b1cc-3dad-48c1-9234-d220729c530d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:33:05.870664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e3e5b1cc-3dad-48c1-9234-d220729c530d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:33:05.871163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e3e5b1cc-3dad-48c1-9234-d220729c530d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:33:05.871657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e3e5b1cc-3dad-48c1-9234-d220729c530d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:33:05.881426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3e5b1cc-3dad-48c1-9234-d220729c530d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:05.882038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3e5b1cc-3dad-48c1-9234-d220729c530d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:05.882601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3e5b1cc-3dad-48c1-9234-d220729c530d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:05.883439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3e5b1cc-3dad-48c1-9234-d220729c530d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:05.884655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3e5b1cc-3dad-48c1-9234-d220729c530d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:05.885463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3e5b1cc-3dad-48c1-9234-d220729c530d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:05.904423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-e3e5b1cc-3dad-48c1-9234-d220729c530d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Getting quotas for project 8a3ff02c01a64c9a940de444ca1197c4. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:33:05.910276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-e3e5b1cc-3dad-48c1-9234-d220729c530d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Getting quotas for user 43fd0499bc224bd8b190701a811ee204 and project 8a3ff02c01a64c9a940de444ca1197c4. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:33:05.923393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e3e5b1cc-3dad-48c1-9234-d220729c530d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:33:05.926029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e3e5b1cc-3dad-48c1-9234-d220729c530d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:33:05.977342 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e3e5b1cc-3dad-48c1-9234-d220729c530d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739443 Oct 24 10:33:05.978727 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1018/2118] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:33:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:33:05.983612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4cb4a301-6262-4ed8-92ca-699ce1346e11 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:05.984571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4cb4a301-6262-4ed8-92ca-699ce1346e11 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:05.991138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cb4a301-6262-4ed8-92ca-699ce1346e11 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:05.991905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cb4a301-6262-4ed8-92ca-699ce1346e11 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:05.992590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cb4a301-6262-4ed8-92ca-699ce1346e11 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:05.993747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cb4a301-6262-4ed8-92ca-699ce1346e11 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:05.994419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cb4a301-6262-4ed8-92ca-699ce1346e11 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:05.995098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cb4a301-6262-4ed8-92ca-699ce1346e11 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:06.022003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6b0c6c23-c1c4-45ac-95e8-ab7ed2dd750f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7bd36a563d4b4189301434f7f9bdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e37b041665467ab7b778324710c1c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:06.031857 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6b0c6c23-c1c4-45ac-95e8-ab7ed2dd750f tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 200 len: 1526 microversion: 2.1 time: 0.222666 Oct 24 10:33:06.033194 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1101/2119] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:05 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 1526 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:06.038008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-79f1071e-9387-4a6c-8543-07dddfc3900d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:06.038840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-79f1071e-9387-4a6c-8543-07dddfc3900d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:06.050221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cb4a301-6262-4ed8-92ca-699ce1346e11 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:06.051031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cb4a301-6262-4ed8-92ca-699ce1346e11 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:06.051720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cb4a301-6262-4ed8-92ca-699ce1346e11 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:06.053415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-4cb4a301-6262-4ed8-92ca-699ce1346e11 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lazy-loading 'fault' on Instance uuid e0ef26c4-a579-469e-b5db-bc2b0e17e99d {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:33:06.145544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4cb4a301-6262-4ed8-92ca-699ce1346e11 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:06.152274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-79f1071e-9387-4a6c-8543-07dddfc3900d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:06.155823 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4cb4a301-6262-4ed8-92ca-699ce1346e11 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 200 len: 1301 microversion: 2.1 time: 0.175745 Oct 24 10:33:06.156386 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1019/2120] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:05 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 1301 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:06.160544 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-79f1071e-9387-4a6c-8543-07dddfc3900d tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1207 microversion: 2.1 time: 0.126014 Oct 24 10:33:06.161146 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1102/2121] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:06 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1207 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:06.241589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-27d42986-74c2-461e-8280-567357455df6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:06.242749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-27d42986-74c2-461e-8280-567357455df6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:06.250384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27d42986-74c2-461e-8280-567357455df6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:06.250975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27d42986-74c2-461e-8280-567357455df6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:06.251587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27d42986-74c2-461e-8280-567357455df6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:06.252383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27d42986-74c2-461e-8280-567357455df6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:06.253099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27d42986-74c2-461e-8280-567357455df6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:06.253523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27d42986-74c2-461e-8280-567357455df6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:06.429767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-27d42986-74c2-461e-8280-567357455df6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:06.447261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-27d42986-74c2-461e-8280-567357455df6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:06.451304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-27d42986-74c2-461e-8280-567357455df6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:06.453823 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-27d42986-74c2-461e-8280-567357455df6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.222550 Oct 24 10:33:06.457002 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1020/2122] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:33:06 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:33:06.832464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-64556b36-a3d4-498e-9a83-1d064a5a0f46 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:06.833109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-64556b36-a3d4-498e-9a83-1d064a5a0f46 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:06.841087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64556b36-a3d4-498e-9a83-1d064a5a0f46 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:06.841576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64556b36-a3d4-498e-9a83-1d064a5a0f46 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:06.842010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64556b36-a3d4-498e-9a83-1d064a5a0f46 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:06.842713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64556b36-a3d4-498e-9a83-1d064a5a0f46 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:06.843166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64556b36-a3d4-498e-9a83-1d064a5a0f46 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:06.843587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64556b36-a3d4-498e-9a83-1d064a5a0f46 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:06.862825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:06.988460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-64556b36-a3d4-498e-9a83-1d064a5a0f46 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:07.004505 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-64556b36-a3d4-498e-9a83-1d064a5a0f46 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f" status: 200 len: 1403 microversion: 2.1 time: 0.175904 Oct 24 10:33:07.008886 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1103/2123] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:06 2022] GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f => generated 1403 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:07.059413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-66c99713-2cf2-47ca-abbe-599227884188 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:07.060034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-66c99713-2cf2-47ca-abbe-599227884188 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:07.074978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66c99713-2cf2-47ca-abbe-599227884188 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:07.075413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66c99713-2cf2-47ca-abbe-599227884188 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:07.076041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66c99713-2cf2-47ca-abbe-599227884188 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:07.076984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66c99713-2cf2-47ca-abbe-599227884188 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:07.077448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66c99713-2cf2-47ca-abbe-599227884188 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:07.077883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66c99713-2cf2-47ca-abbe-599227884188 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:07.098034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:07.193137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f27667fd-0b36-4c4c-be7c-1cb9249aebed tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:07.194082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f27667fd-0b36-4c4c-be7c-1cb9249aebed tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:07.202291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27667fd-0b36-4c4c-be7c-1cb9249aebed tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:07.202922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27667fd-0b36-4c4c-be7c-1cb9249aebed tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:07.203435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27667fd-0b36-4c4c-be7c-1cb9249aebed tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:07.204293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27667fd-0b36-4c4c-be7c-1cb9249aebed tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:07.205056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27667fd-0b36-4c4c-be7c-1cb9249aebed tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:07.205700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27667fd-0b36-4c4c-be7c-1cb9249aebed tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:07.265182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-66c99713-2cf2-47ca-abbe-599227884188 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7bd36a563d4b4189301434f7f9bdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e37b041665467ab7b778324710c1c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:07.275446 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-66c99713-2cf2-47ca-abbe-599227884188 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 200 len: 1526 microversion: 2.1 time: 0.220349 Oct 24 10:33:07.276378 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1021/2124] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:07 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 1526 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:07.281155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-66621d85-f463-4cc6-8787-ea3bfaa7863c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:07.282199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-66621d85-f463-4cc6-8787-ea3bfaa7863c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: e0ef26c4-a579-469e-b5db-bc2b0e17e99d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:07.292332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f27667fd-0b36-4c4c-be7c-1cb9249aebed tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:07.297329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66621d85-f463-4cc6-8787-ea3bfaa7863c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:07.297947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66621d85-f463-4cc6-8787-ea3bfaa7863c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:07.298445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66621d85-f463-4cc6-8787-ea3bfaa7863c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:07.299152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66621d85-f463-4cc6-8787-ea3bfaa7863c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:07.300525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66621d85-f463-4cc6-8787-ea3bfaa7863c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:07.300991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66621d85-f463-4cc6-8787-ea3bfaa7863c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:07.301513 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f27667fd-0b36-4c4c-be7c-1cb9249aebed tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1259 microversion: 2.1 time: 0.113811 Oct 24 10:33:07.302402 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1104/2125] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:07 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1259 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:07.325087 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-66621d85-f463-4cc6-8787-ea3bfaa7863c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] HTTP exception thrown: Instance e0ef26c4-a579-469e-b5db-bc2b0e17e99d could not be found. Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-66621d85-f463-4cc6-8787-ea3bfaa7863c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Request method failure captured: Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d HTTP/1.1 Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmgAI56ixX3LxgS7Ly-9n4q3huK4pYbld15OoCOex2Vf6Wku9STLKIRlZZ1d5nk_VUwGgN4V57lhzJHNDCb73Tn0ifTsKK6YRDPQ5jbKjKGMnQfE-Xi3pf6JmeXvaJwkuti6S33B5nt95lgzwThhG-3q84dQ-AyCluRwSJeYme1sFLs Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 115025f23db94a71b74b6adbc536792f Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-LiveMigrationTest-1696265939 Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/115025f23db94a71b74b6adbc536792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/115025f23db94a71b74b6adbc536792f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/115025f23db94a71b74b6adbc536792f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_115025f23db94a71b74b6adbc536792f", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-LiveMigrationTest-1696265939 Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 115025f23db94a71b74b6adbc536792f Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-LiveMigrationTest-1696265939 Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-LiveMigrationTest-1696265939-project Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 176a68ea281e4f65bbeac67cc304468d Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-LiveMigrationTest-1696265939-project Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance e0ef26c4-a579-469e-b5db-bc2b0e17e99d could not be found. Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'e0ef26c4-a579-469e-b5db-bc2b0e17e99d'} Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ef26c4-a579-469e-b5db-bc2b0e17e99d could not be found. Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ef26c4-a579-469e-b5db-bc2b0e17e99d could not be found. Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:07.326849 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:07.330453 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:07.330453 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:07.330453 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:07.330453 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:07.330453 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:07.330453 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ef26c4-a579-469e-b5db-bc2b0e17e99d could not be found. Oct 24 10:33:07.330453 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:07.330453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-66621d85-f463-4cc6-8787-ea3bfaa7863c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Returning 404 to user: Instance e0ef26c4-a579-469e-b5db-bc2b0e17e99d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:07.330453 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-66621d85-f463-4cc6-8787-ea3bfaa7863c tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d" status: 404 len: 111 microversion: 2.1 time: 0.050764 Oct 24 10:33:07.331978 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1022/2126] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:07 2022] GET /compute/v2.1/servers/e0ef26c4-a579-469e-b5db-bc2b0e17e99d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:33:07.338088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7f512be9-414e-45ba-96cd-1352220ca447 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:07.338597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7f512be9-414e-45ba-96cd-1352220ca447 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:07.344539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f512be9-414e-45ba-96cd-1352220ca447 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:07.345064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f512be9-414e-45ba-96cd-1352220ca447 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:07.345513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f512be9-414e-45ba-96cd-1352220ca447 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:07.346215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f512be9-414e-45ba-96cd-1352220ca447 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:07.346674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f512be9-414e-45ba-96cd-1352220ca447 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:07.347105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f512be9-414e-45ba-96cd-1352220ca447 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:07.373174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7f512be9-414e-45ba-96cd-1352220ca447 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:33:07.450665 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7f512be9-414e-45ba-96cd-1352220ca447 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 204 len: 0 microversion: 2.1 time: 0.116953 Oct 24 10:33:07.451260 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1105/2127] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:33:07 2022] DELETE /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 10:33:07.459200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-99744476-aabb-4d89-91f1-f28ffb7b1c7d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:07.460039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-99744476-aabb-4d89-91f1-f28ffb7b1c7d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:07.463876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:07.467969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99744476-aabb-4d89-91f1-f28ffb7b1c7d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:07.468522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99744476-aabb-4d89-91f1-f28ffb7b1c7d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:07.469056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99744476-aabb-4d89-91f1-f28ffb7b1c7d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:07.469809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99744476-aabb-4d89-91f1-f28ffb7b1c7d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:07.470406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99744476-aabb-4d89-91f1-f28ffb7b1c7d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:07.470972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99744476-aabb-4d89-91f1-f28ffb7b1c7d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:07.483154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-84e21da4-a5c4-4794-8f34-2971c6295cc5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:07.483827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-84e21da4-a5c4-4794-8f34-2971c6295cc5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:07.489952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84e21da4-a5c4-4794-8f34-2971c6295cc5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:07.490442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84e21da4-a5c4-4794-8f34-2971c6295cc5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:07.490880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84e21da4-a5c4-4794-8f34-2971c6295cc5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:07.491588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84e21da4-a5c4-4794-8f34-2971c6295cc5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:07.492049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84e21da4-a5c4-4794-8f34-2971c6295cc5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:07.492478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84e21da4-a5c4-4794-8f34-2971c6295cc5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:07.691932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-99744476-aabb-4d89-91f1-f28ffb7b1c7d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:07.701125 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-99744476-aabb-4d89-91f1-f28ffb7b1c7d tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1499 microversion: 2.1 time: 0.245627 Oct 24 10:33:07.717179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-84e21da4-a5c4-4794-8f34-2971c6295cc5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:07.717703 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1023/2128] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:07 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1499 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:33:07.729481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-84e21da4-a5c4-4794-8f34-2971c6295cc5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:07.731741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-84e21da4-a5c4-4794-8f34-2971c6295cc5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:07.733572 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-84e21da4-a5c4-4794-8f34-2971c6295cc5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.254773 Oct 24 10:33:07.748860 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1106/2129] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:33:07 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:33:07.850733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d4228788-b2d8-425e-b9cc-4c098dd9b102 req-181420db-1540-4ffe-ac76-9a537ac112a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7254c068-e068-42f0-b0bd-1fb8ed98104f", "tag": "e9ece899-4bb1-4d03-a940-7ed49dc6da77"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:07.860316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d4228788-b2d8-425e-b9cc-4c098dd9b102 req-181420db-1540-4ffe-ac76-9a537ac112a7 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:07.860797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d4228788-b2d8-425e-b9cc-4c098dd9b102 req-181420db-1540-4ffe-ac76-9a537ac112a7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:07.861286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d4228788-b2d8-425e-b9cc-4c098dd9b102 req-181420db-1540-4ffe-ac76-9a537ac112a7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:07.872915 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d4228788-b2d8-425e-b9cc-4c098dd9b102 req-181420db-1540-4ffe-ac76-9a537ac112a7 service nova] Creating event network-changed:e9ece899-4bb1-4d03-a940-7ed49dc6da77 for instance 7254c068-e068-42f0-b0bd-1fb8ed98104f on n-h1-858383-15 Oct 24 10:33:07.877712 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d4228788-b2d8-425e-b9cc-4c098dd9b102 req-181420db-1540-4ffe-ac76-9a537ac112a7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030762 Oct 24 10:33:07.878302 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1024/2130] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:33:08.030805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6464d853-1582-4d31-bb49-463978779cdd tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:08.031524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6464d853-1582-4d31-bb49-463978779cdd tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:08.038544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6464d853-1582-4d31-bb49-463978779cdd tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:08.039032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6464d853-1582-4d31-bb49-463978779cdd tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:08.039468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6464d853-1582-4d31-bb49-463978779cdd tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:08.040731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6464d853-1582-4d31-bb49-463978779cdd tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:08.041219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6464d853-1582-4d31-bb49-463978779cdd tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:08.041645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6464d853-1582-4d31-bb49-463978779cdd tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:08.177918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6464d853-1582-4d31-bb49-463978779cdd tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:08.189901 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6464d853-1582-4d31-bb49-463978779cdd tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f" status: 200 len: 1403 microversion: 2.1 time: 0.163370 Oct 24 10:33:08.190696 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1107/2131] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:08 2022] GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f => generated 1403 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:08.300807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bfad7b72-4b80-4a48-8927-edf517b26336 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:08.301565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bfad7b72-4b80-4a48-8927-edf517b26336 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:08.308871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfad7b72-4b80-4a48-8927-edf517b26336 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:08.309419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfad7b72-4b80-4a48-8927-edf517b26336 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:08.309858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfad7b72-4b80-4a48-8927-edf517b26336 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:08.310556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfad7b72-4b80-4a48-8927-edf517b26336 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:08.311010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfad7b72-4b80-4a48-8927-edf517b26336 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:08.311429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bfad7b72-4b80-4a48-8927-edf517b26336 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:08.327790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-34c24d5d-7c58-4aaa-a185-ff5e226b4517 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:08.328514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-34c24d5d-7c58-4aaa-a185-ff5e226b4517 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:08.335966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34c24d5d-7c58-4aaa-a185-ff5e226b4517 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:08.337391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34c24d5d-7c58-4aaa-a185-ff5e226b4517 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:08.337861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34c24d5d-7c58-4aaa-a185-ff5e226b4517 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:08.339067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34c24d5d-7c58-4aaa-a185-ff5e226b4517 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:08.339489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34c24d5d-7c58-4aaa-a185-ff5e226b4517 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:08.340024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34c24d5d-7c58-4aaa-a185-ff5e226b4517 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:08.425239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-34c24d5d-7c58-4aaa-a185-ff5e226b4517 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:08.434123 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-34c24d5d-7c58-4aaa-a185-ff5e226b4517 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1265 microversion: 2.1 time: 0.110945 Oct 24 10:33:08.434895 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1108/2132] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:08 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:08.486327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bfad7b72-4b80-4a48-8927-edf517b26336 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7bd36a563d4b4189301434f7f9bdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e37b041665467ab7b778324710c1c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:08.494818 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bfad7b72-4b80-4a48-8927-edf517b26336 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 200 len: 1526 microversion: 2.1 time: 0.198799 Oct 24 10:33:08.496345 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1025/2133] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:08 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 1526 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:08.723386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5b42ad4a-08e4-409f-a60e-2a3e7d919517 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:08.724035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5b42ad4a-08e4-409f-a60e-2a3e7d919517 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:08.730146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b42ad4a-08e4-409f-a60e-2a3e7d919517 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:08.730623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b42ad4a-08e4-409f-a60e-2a3e7d919517 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:08.731056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b42ad4a-08e4-409f-a60e-2a3e7d919517 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:08.731759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b42ad4a-08e4-409f-a60e-2a3e7d919517 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:08.732206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b42ad4a-08e4-409f-a60e-2a3e7d919517 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:08.732634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b42ad4a-08e4-409f-a60e-2a3e7d919517 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:08.763180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c99dc2c-23fb-4e70-81c5-6e6f5a975583 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:08.764036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4c99dc2c-23fb-4e70-81c5-6e6f5a975583 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:08.770365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c99dc2c-23fb-4e70-81c5-6e6f5a975583 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:08.770876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c99dc2c-23fb-4e70-81c5-6e6f5a975583 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:08.771319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c99dc2c-23fb-4e70-81c5-6e6f5a975583 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:08.772053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c99dc2c-23fb-4e70-81c5-6e6f5a975583 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:08.772509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c99dc2c-23fb-4e70-81c5-6e6f5a975583 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:08.772965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c99dc2c-23fb-4e70-81c5-6e6f5a975583 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:08.941417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5b42ad4a-08e4-409f-a60e-2a3e7d919517 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:08.955169 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5b42ad4a-08e4-409f-a60e-2a3e7d919517 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1499 microversion: 2.1 time: 0.235556 Oct 24 10:33:08.968871 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1109/2134] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:08 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1499 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:08.997139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c99dc2c-23fb-4e70-81c5-6e6f5a975583 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:09.007298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c99dc2c-23fb-4e70-81c5-6e6f5a975583 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:09.009354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c99dc2c-23fb-4e70-81c5-6e6f5a975583 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:09.010795 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4c99dc2c-23fb-4e70-81c5-6e6f5a975583 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.252923 Oct 24 10:33:09.011350 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1026/2135] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:33:08 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:33:09.216178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ef9219bb-dbc4-4c70-9976-b6470c88bfb6 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:09.216802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ef9219bb-dbc4-4c70-9976-b6470c88bfb6 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:09.223973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef9219bb-dbc4-4c70-9976-b6470c88bfb6 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:09.224943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef9219bb-dbc4-4c70-9976-b6470c88bfb6 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:09.225392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef9219bb-dbc4-4c70-9976-b6470c88bfb6 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:09.226106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef9219bb-dbc4-4c70-9976-b6470c88bfb6 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:09.226558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef9219bb-dbc4-4c70-9976-b6470c88bfb6 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:09.226982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef9219bb-dbc4-4c70-9976-b6470c88bfb6 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:09.460429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2642d36d-0174-419b-804e-04c9e263d7c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:09.462530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2642d36d-0174-419b-804e-04c9e263d7c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:09.480320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2642d36d-0174-419b-804e-04c9e263d7c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:09.481422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2642d36d-0174-419b-804e-04c9e263d7c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:09.482759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2642d36d-0174-419b-804e-04c9e263d7c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:09.483977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2642d36d-0174-419b-804e-04c9e263d7c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:09.484533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2642d36d-0174-419b-804e-04c9e263d7c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:09.485085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2642d36d-0174-419b-804e-04c9e263d7c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:09.619270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ef9219bb-dbc4-4c70-9976-b6470c88bfb6 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:09.629967 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ef9219bb-dbc4-4c70-9976-b6470c88bfb6 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f" status: 200 len: 1403 microversion: 2.1 time: 0.419341 Oct 24 10:33:09.630964 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1110/2136] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:09 2022] GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f => generated 1403 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:09.652387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ad32df5e-984b-4cdc-b653-7b67b064bc88 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:09.653323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ad32df5e-984b-4cdc-b653-7b67b064bc88 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:09.659788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad32df5e-984b-4cdc-b653-7b67b064bc88 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:09.660873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad32df5e-984b-4cdc-b653-7b67b064bc88 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:09.660873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad32df5e-984b-4cdc-b653-7b67b064bc88 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:09.661545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad32df5e-984b-4cdc-b653-7b67b064bc88 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:09.661929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad32df5e-984b-4cdc-b653-7b67b064bc88 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:09.662363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad32df5e-984b-4cdc-b653-7b67b064bc88 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:10.210830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2642d36d-0174-419b-804e-04c9e263d7c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:10.221682 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2642d36d-0174-419b-804e-04c9e263d7c6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1307 microversion: 2.1 time: 0.767813 Oct 24 10:33:10.229772 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1027/2137] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:09 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1307 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:10.235182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c038cde8-7f3c-4b23-8a25-74c9ed2dd413 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:10.235939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c038cde8-7f3c-4b23-8a25-74c9ed2dd413 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:10.242851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c038cde8-7f3c-4b23-8a25-74c9ed2dd413 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:10.243861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c038cde8-7f3c-4b23-8a25-74c9ed2dd413 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:10.244310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c038cde8-7f3c-4b23-8a25-74c9ed2dd413 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:10.245552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c038cde8-7f3c-4b23-8a25-74c9ed2dd413 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:10.245552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c038cde8-7f3c-4b23-8a25-74c9ed2dd413 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:10.245922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c038cde8-7f3c-4b23-8a25-74c9ed2dd413 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:10.339446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ad32df5e-984b-4cdc-b653-7b67b064bc88 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7bd36a563d4b4189301434f7f9bdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e37b041665467ab7b778324710c1c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:10.348147 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ad32df5e-984b-4cdc-b653-7b67b064bc88 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 200 len: 1526 microversion: 2.1 time: 0.701084 Oct 24 10:33:10.360858 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1111/2138] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:09 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 1526 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:10.366318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-53d2f678-2357-4d17-9031-3a1c5e67ec29 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:10.366318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-53d2f678-2357-4d17-9031-3a1c5e67ec29 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:10.373983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53d2f678-2357-4d17-9031-3a1c5e67ec29 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:10.374577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53d2f678-2357-4d17-9031-3a1c5e67ec29 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:10.375203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53d2f678-2357-4d17-9031-3a1c5e67ec29 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:10.375930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53d2f678-2357-4d17-9031-3a1c5e67ec29 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:10.376381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53d2f678-2357-4d17-9031-3a1c5e67ec29 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:10.377767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53d2f678-2357-4d17-9031-3a1c5e67ec29 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:10.618659 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c038cde8-7f3c-4b23-8a25-74c9ed2dd413 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:10.628663 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c038cde8-7f3c-4b23-8a25-74c9ed2dd413 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1499 microversion: 2.1 time: 0.403620 Oct 24 10:33:10.653826 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1028/2139] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:10 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1499 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:10.661442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-844b80d9-7993-43a0-8824-a9a332fc8c4f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:10.662339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-844b80d9-7993-43a0-8824-a9a332fc8c4f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:10.672399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-844b80d9-7993-43a0-8824-a9a332fc8c4f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:10.673179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-844b80d9-7993-43a0-8824-a9a332fc8c4f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:10.673832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-844b80d9-7993-43a0-8824-a9a332fc8c4f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:10.674848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-844b80d9-7993-43a0-8824-a9a332fc8c4f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:10.675563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-844b80d9-7993-43a0-8824-a9a332fc8c4f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:10.676200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-844b80d9-7993-43a0-8824-a9a332fc8c4f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:10.796479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-53d2f678-2357-4d17-9031-3a1c5e67ec29 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:10.808516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-53d2f678-2357-4d17-9031-3a1c5e67ec29 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:10.810051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-53d2f678-2357-4d17-9031-3a1c5e67ec29 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:10.811416 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-53d2f678-2357-4d17-9031-3a1c5e67ec29 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1812 microversion: 2.25 time: 0.460702 Oct 24 10:33:10.812001 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1112/2140] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:33:10 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1812 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:33:10.900130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a16388fa-0982-4632-93f0-0e6785dcf2fd req-f191d961-4407-47d4-a756-8b5b89d7fb64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b873b2-ffe7-4ddd-8f31-6c99b3c93339", "name": "network-vif-deleted", "tag": "5722d9e2-b941-414a-af1d-34999df87a8b"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:10.929776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a16388fa-0982-4632-93f0-0e6785dcf2fd req-f191d961-4407-47d4-a756-8b5b89d7fb64 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:10.930290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a16388fa-0982-4632-93f0-0e6785dcf2fd req-f191d961-4407-47d4-a756-8b5b89d7fb64 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:10.931606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a16388fa-0982-4632-93f0-0e6785dcf2fd req-f191d961-4407-47d4-a756-8b5b89d7fb64 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:10.951373 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a16388fa-0982-4632-93f0-0e6785dcf2fd req-f191d961-4407-47d4-a756-8b5b89d7fb64 service nova] Creating event network-vif-deleted:5722d9e2-b941-414a-af1d-34999df87a8b for instance a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 on n-h2-858383-15 Oct 24 10:33:10.964163 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a16388fa-0982-4632-93f0-0e6785dcf2fd req-f191d961-4407-47d4-a756-8b5b89d7fb64 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072308 Oct 24 10:33:10.965101 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1113/2141] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:33:11.022000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-844b80d9-7993-43a0-8824-a9a332fc8c4f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:11.037531 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-844b80d9-7993-43a0-8824-a9a332fc8c4f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f" status: 200 len: 1403 microversion: 2.1 time: 0.379241 Oct 24 10:33:11.038169 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1029/2142] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:10 2022] GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f => generated 1403 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:11.078046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-dba20709-d5b9-4dc1-a67f-30fed25639ba req-f2cd2d65-3065-4d8b-ab3f-4aba6779b2fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09308b8-ad10-4557-bb53-7bdf515bbf36", "name": "network-vif-deleted", "tag": "9267e901-eb9a-451c-a91f-fcadbd8fa2a9"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:11.099588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dba20709-d5b9-4dc1-a67f-30fed25639ba req-f2cd2d65-3065-4d8b-ab3f-4aba6779b2fe service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:11.101014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dba20709-d5b9-4dc1-a67f-30fed25639ba req-f2cd2d65-3065-4d8b-ab3f-4aba6779b2fe service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:11.103061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dba20709-d5b9-4dc1-a67f-30fed25639ba req-f2cd2d65-3065-4d8b-ab3f-4aba6779b2fe service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:11.138740 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-dba20709-d5b9-4dc1-a67f-30fed25639ba req-f2cd2d65-3065-4d8b-ab3f-4aba6779b2fe service nova] Creating event network-vif-deleted:9267e901-eb9a-451c-a91f-fcadbd8fa2a9 for instance e09308b8-ad10-4557-bb53-7bdf515bbf36 on n-h2-858383-15 Oct 24 10:33:11.144673 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-dba20709-d5b9-4dc1-a67f-30fed25639ba req-f2cd2d65-3065-4d8b-ab3f-4aba6779b2fe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077980 Oct 24 10:33:11.145842 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1114/2143] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:33:11.245608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-130093db-a914-46f2-8298-e1d0216a2e42 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:11.246224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-130093db-a914-46f2-8298-e1d0216a2e42 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:11.252981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-130093db-a914-46f2-8298-e1d0216a2e42 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:11.253702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-130093db-a914-46f2-8298-e1d0216a2e42 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:11.254354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-130093db-a914-46f2-8298-e1d0216a2e42 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:11.255364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-130093db-a914-46f2-8298-e1d0216a2e42 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:11.256135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-130093db-a914-46f2-8298-e1d0216a2e42 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:11.256776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-130093db-a914-46f2-8298-e1d0216a2e42 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:11.388305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1248c40d-634f-4da3-9286-81e48e8421f1 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:11.390269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1248c40d-634f-4da3-9286-81e48e8421f1 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:11.402949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:11.405595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1248c40d-634f-4da3-9286-81e48e8421f1 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:11.406190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1248c40d-634f-4da3-9286-81e48e8421f1 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:11.406667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1248c40d-634f-4da3-9286-81e48e8421f1 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:11.407344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1248c40d-634f-4da3-9286-81e48e8421f1 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:11.408067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1248c40d-634f-4da3-9286-81e48e8421f1 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:11.408667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1248c40d-634f-4da3-9286-81e48e8421f1 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:11.466399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1248c40d-634f-4da3-9286-81e48e8421f1 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:11.466910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1248c40d-634f-4da3-9286-81e48e8421f1 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:11.467353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1248c40d-634f-4da3-9286-81e48e8421f1 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:11.468077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-1248c40d-634f-4da3-9286-81e48e8421f1 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lazy-loading 'fault' on Instance uuid a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:33:11.518566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1248c40d-634f-4da3-9286-81e48e8421f1 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f7bd36a563d4b4189301434f7f9bdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e37b041665467ab7b778324710c1c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:11.524064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-130093db-a914-46f2-8298-e1d0216a2e42 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:11.527042 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1248c40d-634f-4da3-9286-81e48e8421f1 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 200 len: 1314 microversion: 2.1 time: 0.153467 Oct 24 10:33:11.527638 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1115/2144] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:11 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:11.532706 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-130093db-a914-46f2-8298-e1d0216a2e42 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1307 microversion: 2.1 time: 0.291226 Oct 24 10:33:11.533307 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1030/2145] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:11 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1307 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:11.661182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-adf730af-9f0f-4a5e-862f-dbbc0859363e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:11.661810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-adf730af-9f0f-4a5e-862f-dbbc0859363e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:11.667891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adf730af-9f0f-4a5e-862f-dbbc0859363e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:11.668372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adf730af-9f0f-4a5e-862f-dbbc0859363e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:11.668808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adf730af-9f0f-4a5e-862f-dbbc0859363e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:11.669533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adf730af-9f0f-4a5e-862f-dbbc0859363e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:11.669988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adf730af-9f0f-4a5e-862f-dbbc0859363e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:11.670416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adf730af-9f0f-4a5e-862f-dbbc0859363e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:11.703979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adf730af-9f0f-4a5e-862f-dbbc0859363e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:11.704458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adf730af-9f0f-4a5e-862f-dbbc0859363e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:11.704926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adf730af-9f0f-4a5e-862f-dbbc0859363e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:11.705383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-adf730af-9f0f-4a5e-862f-dbbc0859363e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lazy-loading 'fault' on Instance uuid 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:33:11.749545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-adf730af-9f0f-4a5e-862f-dbbc0859363e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:11.757321 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-adf730af-9f0f-4a5e-862f-dbbc0859363e tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1300 microversion: 2.1 time: 0.100122 Oct 24 10:33:11.757884 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1116/2146] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:11 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:11.841106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8da1de61-98b8-47b3-bb6f-5bf419d6d4b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:11.841737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8da1de61-98b8-47b3-bb6f-5bf419d6d4b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:11.847898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8da1de61-98b8-47b3-bb6f-5bf419d6d4b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:11.848389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8da1de61-98b8-47b3-bb6f-5bf419d6d4b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:11.848861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8da1de61-98b8-47b3-bb6f-5bf419d6d4b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:11.849575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8da1de61-98b8-47b3-bb6f-5bf419d6d4b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:11.850038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8da1de61-98b8-47b3-bb6f-5bf419d6d4b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:11.850469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8da1de61-98b8-47b3-bb6f-5bf419d6d4b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:12.037378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8da1de61-98b8-47b3-bb6f-5bf419d6d4b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:12.048432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8da1de61-98b8-47b3-bb6f-5bf419d6d4b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:12.050027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8da1de61-98b8-47b3-bb6f-5bf419d6d4b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:12.051213 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8da1de61-98b8-47b3-bb6f-5bf419d6d4b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1802 microversion: 2.25 time: 0.214267 Oct 24 10:33:12.052023 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1031/2147] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:33:11 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1802 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:33:12.063521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-51af1c6d-3db2-42fe-b548-9baf04ad3663 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:12.064145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-51af1c6d-3db2-42fe-b548-9baf04ad3663 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:12.070537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51af1c6d-3db2-42fe-b548-9baf04ad3663 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:12.071061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51af1c6d-3db2-42fe-b548-9baf04ad3663 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:12.071507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51af1c6d-3db2-42fe-b548-9baf04ad3663 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:12.072549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51af1c6d-3db2-42fe-b548-9baf04ad3663 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:12.072656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51af1c6d-3db2-42fe-b548-9baf04ad3663 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:12.073124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51af1c6d-3db2-42fe-b548-9baf04ad3663 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:12.078709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-522284f8-0ec5-45ac-8049-8902fa341fc5 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '.version_select at 0x7f04d4f895e0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:12.082331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-522284f8-0ec5-45ac-8049-8902fa341fc5 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:12.082761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-522284f8-0ec5-45ac-8049-8902fa341fc5 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:12.083206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-522284f8-0ec5-45ac-8049-8902fa341fc5 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:12.093981 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-522284f8-0ec5-45ac-8049-8902fa341fc5 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1959 microversion: 2.25 time: 0.019140 Oct 24 10:33:12.094672 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1032/2148] 10.222.0.50 () {60 vars in 1184 bytes} [Mon Oct 24 10:33:12 2022] GET /compute/v2.1/os-migrations => generated 1959 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:33:12.112519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8358952d-bdc6-42b1-bb71-1c13040302fc tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:12.113842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8358952d-bdc6-42b1-bb71-1c13040302fc tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:12.122614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8358952d-bdc6-42b1-bb71-1c13040302fc tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:12.132584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8358952d-bdc6-42b1-bb71-1c13040302fc tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:12.133089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8358952d-bdc6-42b1-bb71-1c13040302fc tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:12.133889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8358952d-bdc6-42b1-bb71-1c13040302fc tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:12.135230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8358952d-bdc6-42b1-bb71-1c13040302fc tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:12.135911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8358952d-bdc6-42b1-bb71-1c13040302fc tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:12.340149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-8358952d-bdc6-42b1-bb71-1c13040302fc tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'services' on Instance uuid 07e4585f-945b-462a-aac7-5a7af22f160d {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:33:12.346090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-51af1c6d-3db2-42fe-b548-9baf04ad3663 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:12.353862 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-51af1c6d-3db2-42fe-b548-9baf04ad3663 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f" status: 200 len: 1403 microversion: 2.1 time: 0.295090 Oct 24 10:33:12.354273 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8358952d-bdc6-42b1-bb71-1c13040302fc tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 2422 microversion: 2.25 time: 0.247066 Oct 24 10:33:12.366063 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1117/2149] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:12 2022] GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f => generated 1403 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:12.366218 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1033/2150] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:33:12 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 2422 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:33:12.379353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1b7079c7-f9ff-4ed2-af31-4a17682b8c03 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:12.380014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1b7079c7-f9ff-4ed2-af31-4a17682b8c03 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:12.387642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b7079c7-f9ff-4ed2-af31-4a17682b8c03 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:12.388242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b7079c7-f9ff-4ed2-af31-4a17682b8c03 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:12.388763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b7079c7-f9ff-4ed2-af31-4a17682b8c03 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:12.389605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b7079c7-f9ff-4ed2-af31-4a17682b8c03 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:12.390177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b7079c7-f9ff-4ed2-af31-4a17682b8c03 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:12.390674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b7079c7-f9ff-4ed2-af31-4a17682b8c03 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:12.518846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-1b7079c7-f9ff-4ed2-af31-4a17682b8c03 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'services' on Instance uuid 07e4585f-945b-462a-aac7-5a7af22f160d {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:33:12.522188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:12.533402 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1b7079c7-f9ff-4ed2-af31-4a17682b8c03 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 2422 microversion: 2.25 time: 0.158226 Oct 24 10:33:12.533988 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1118/2151] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:33:12 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 2422 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:33:12.555197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-532bc9e7-9cc7-43fe-8162-9b4bc3cdf5b3 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:12.557242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-532bc9e7-9cc7-43fe-8162-9b4bc3cdf5b3 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] [instance: a6b873b2-ffe7-4ddd-8f31-6c99b3c93339] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:12.558157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-34f946b3-a689-4584-a96d-149d5af7de67 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:12.558962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-34f946b3-a689-4584-a96d-149d5af7de67 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:12.566158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34f946b3-a689-4584-a96d-149d5af7de67 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:12.566864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34f946b3-a689-4584-a96d-149d5af7de67 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:12.567887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34f946b3-a689-4584-a96d-149d5af7de67 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:12.568968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34f946b3-a689-4584-a96d-149d5af7de67 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:12.569887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34f946b3-a689-4584-a96d-149d5af7de67 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:12.570495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34f946b3-a689-4584-a96d-149d5af7de67 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:12.571649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-532bc9e7-9cc7-43fe-8162-9b4bc3cdf5b3 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:12.572409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-532bc9e7-9cc7-43fe-8162-9b4bc3cdf5b3 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:12.573148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-532bc9e7-9cc7-43fe-8162-9b4bc3cdf5b3 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:12.574083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-532bc9e7-9cc7-43fe-8162-9b4bc3cdf5b3 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:12.574892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-532bc9e7-9cc7-43fe-8162-9b4bc3cdf5b3 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:12.575537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-532bc9e7-9cc7-43fe-8162-9b4bc3cdf5b3 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:12.595040 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-532bc9e7-9cc7-43fe-8162-9b4bc3cdf5b3 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] HTTP exception thrown: Instance a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 could not be found. Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-532bc9e7-9cc7-43fe-8162-9b4bc3cdf5b3 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Request method failure captured: Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 HTTP/1.1 Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmnFVrDtM-a34AbKBJrEoETal5V43JgZ67OsfBwFR5juAamG1yZLwzxriz_72WhbUcyKRxeb1FLbUHIxY4UyVF9SjoAZX9zlNILbnXEh3aBWKGb6nzyLg91DNxdI360q5upvPYFWJD9hxS7D-3d1o73hOVCs0OktKoQFouC75IPQUHo Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 95e37b041665467ab7b778324710c1c0 Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/95e37b041665467ab7b778324710c1c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/95e37b041665467ab7b778324710c1c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/95e37b041665467ab7b778324710c1c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_95e37b041665467ab7b778324710c1c0", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 95e37b041665467ab7b778324710c1c0 Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1559396102 Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerMetadataNegativeTestJSON-1559396102-project Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 7f7bd36a563d4b4189301434f7f9bdba Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1559396102-project Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 could not be found. Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'a6b873b2-ffe7-4ddd-8f31-6c99b3c93339'} Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 could not be found. Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 could not be found. Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:12.597345 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:12.601693 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:12.601693 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:12.601693 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:12.601693 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:12.601693 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:12.601693 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:12.601693 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 could not be found. Oct 24 10:33:12.601693 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:12.603861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-532bc9e7-9cc7-43fe-8162-9b4bc3cdf5b3 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] Returning 404 to user: Instance a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:12.605143 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-532bc9e7-9cc7-43fe-8162-9b4bc3cdf5b3 tempest-ServerMetadataNegativeTestJSON-1559396102 tempest-ServerMetadataNegativeTestJSON-1559396102-project] 10.222.0.50 "GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339" status: 404 len: 111 microversion: 2.1 time: 0.057923 Oct 24 10:33:12.606397 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1034/2152] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:12 2022] GET /compute/v2.1/servers/a6b873b2-ffe7-4ddd-8f31-6c99b3c93339 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:33:12.646466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b476baf3-87fb-4fde-a8c2-71b344e1cfd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:12.647303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b476baf3-87fb-4fde-a8c2-71b344e1cfd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:12.661304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b476baf3-87fb-4fde-a8c2-71b344e1cfd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:12.662087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b476baf3-87fb-4fde-a8c2-71b344e1cfd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:12.662710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b476baf3-87fb-4fde-a8c2-71b344e1cfd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:12.663692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b476baf3-87fb-4fde-a8c2-71b344e1cfd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:12.664550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b476baf3-87fb-4fde-a8c2-71b344e1cfd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:12.666041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b476baf3-87fb-4fde-a8c2-71b344e1cfd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:12.830537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-34f946b3-a689-4584-a96d-149d5af7de67 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:12.840433 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-34f946b3-a689-4584-a96d-149d5af7de67 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1307 microversion: 2.1 time: 0.288290 Oct 24 10:33:12.841773 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1119/2153] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:12 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1307 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:33:12.846697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0fef259a-9a70-4ad2-ad1c-e410a7a3912b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:12.847546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0fef259a-9a70-4ad2-ad1c-e410a7a3912b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:12.854628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fef259a-9a70-4ad2-ad1c-e410a7a3912b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:12.855429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fef259a-9a70-4ad2-ad1c-e410a7a3912b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:12.856072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fef259a-9a70-4ad2-ad1c-e410a7a3912b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:12.857127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fef259a-9a70-4ad2-ad1c-e410a7a3912b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:12.857772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fef259a-9a70-4ad2-ad1c-e410a7a3912b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:12.858441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fef259a-9a70-4ad2-ad1c-e410a7a3912b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:12.935328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fef259a-9a70-4ad2-ad1c-e410a7a3912b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:12.936429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fef259a-9a70-4ad2-ad1c-e410a7a3912b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:12.936647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-b476baf3-87fb-4fde-a8c2-71b344e1cfd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lazy-loading 'services' on Instance uuid 07e4585f-945b-462a-aac7-5a7af22f160d {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:33:12.937277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fef259a-9a70-4ad2-ad1c-e410a7a3912b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:12.937944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-0fef259a-9a70-4ad2-ad1c-e410a7a3912b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lazy-loading 'fault' on Instance uuid 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:33:13.014332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0fef259a-9a70-4ad2-ad1c-e410a7a3912b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176a68ea281e4f65bbeac67cc304468d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115025f23db94a71b74b6adbc536792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:13.021466 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0fef259a-9a70-4ad2-ad1c-e410a7a3912b tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 200 len: 1300 microversion: 2.1 time: 0.178514 Oct 24 10:33:13.022168 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1120/2154] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:12 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 1300 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:13.030681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-eb150269-75dc-484c-ac9b-4cf27c87616a req-c1497831-1062-44b5-8c8f-ae70e89c32c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb", "name": "network-vif-deleted", "tag": "91ca1e13-d23d-4153-8e07-b972532258b3"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:13.043692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-eb150269-75dc-484c-ac9b-4cf27c87616a req-c1497831-1062-44b5-8c8f-ae70e89c32c5 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:13.044107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-eb150269-75dc-484c-ac9b-4cf27c87616a req-c1497831-1062-44b5-8c8f-ae70e89c32c5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:13.044512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-eb150269-75dc-484c-ac9b-4cf27c87616a req-c1497831-1062-44b5-8c8f-ae70e89c32c5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:13.057298 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-eb150269-75dc-484c-ac9b-4cf27c87616a req-c1497831-1062-44b5-8c8f-ae70e89c32c5 service nova] Creating event network-vif-deleted:91ca1e13-d23d-4153-8e07-b972532258b3 for instance 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb on n-h2-858383-15 Oct 24 10:33:13.062667 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-eb150269-75dc-484c-ac9b-4cf27c87616a req-c1497831-1062-44b5-8c8f-ae70e89c32c5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039063 Oct 24 10:33:13.063577 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1121/2155] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:33:13.071956 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b476baf3-87fb-4fde-a8c2-71b344e1cfd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "DELETE /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments/c6f9668b-2a34-43a1-bdb0-76ed16e3cd05" status: 202 len: 0 microversion: 2.25 time: 0.429904 Oct 24 10:33:13.072634 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1035/2156] 10.222.0.50 () {60 vars in 1457 bytes} [Mon Oct 24 10:33:12 2022] DELETE /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments/c6f9668b-2a34-43a1-bdb0-76ed16e3cd05 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 24 10:33:13.081749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-76eac62b-6e95-4791-88de-a4cbcea95d92 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:13.084117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-76eac62b-6e95-4791-88de-a4cbcea95d92 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:13.091195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76eac62b-6e95-4791-88de-a4cbcea95d92 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:13.091694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76eac62b-6e95-4791-88de-a4cbcea95d92 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:13.092139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76eac62b-6e95-4791-88de-a4cbcea95d92 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:13.092899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76eac62b-6e95-4791-88de-a4cbcea95d92 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:13.093343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76eac62b-6e95-4791-88de-a4cbcea95d92 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:13.093781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76eac62b-6e95-4791-88de-a4cbcea95d92 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:13.126705 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-76eac62b-6e95-4791-88de-a4cbcea95d92 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.049180 Oct 24 10:33:13.127526 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1122/2157] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:33:13 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:33:13.190859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-662856db-bc48-4664-9da6-4d7ae07b5e1b req-dfa47daa-ead0-41f4-af0d-623063d94209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e69d62-2639-481e-a3bb-afe5c3ae0f79", "tag": "6bff8cd6-2640-4c13-a7f3-be3af206c633"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:13.202552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-662856db-bc48-4664-9da6-4d7ae07b5e1b req-dfa47daa-ead0-41f4-af0d-623063d94209 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:13.203453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-662856db-bc48-4664-9da6-4d7ae07b5e1b req-dfa47daa-ead0-41f4-af0d-623063d94209 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:13.204125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-662856db-bc48-4664-9da6-4d7ae07b5e1b req-dfa47daa-ead0-41f4-af0d-623063d94209 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:13.217017 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-662856db-bc48-4664-9da6-4d7ae07b5e1b req-dfa47daa-ead0-41f4-af0d-623063d94209 service nova] Creating event network-changed:6bff8cd6-2640-4c13-a7f3-be3af206c633 for instance 84e69d62-2639-481e-a3bb-afe5c3ae0f79 on n-h1-858383-15 Oct 24 10:33:13.221890 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-662856db-bc48-4664-9da6-4d7ae07b5e1b req-dfa47daa-ead0-41f4-af0d-623063d94209 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035115 Oct 24 10:33:13.222419 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1036/2158] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:33:13.380099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d2e0704c-fb40-45c5-9d9c-2600cf61eb5c tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:13.380726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d2e0704c-fb40-45c5-9d9c-2600cf61eb5c tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:13.389039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2e0704c-fb40-45c5-9d9c-2600cf61eb5c tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:13.389533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2e0704c-fb40-45c5-9d9c-2600cf61eb5c tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:13.389533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2e0704c-fb40-45c5-9d9c-2600cf61eb5c tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:13.390447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2e0704c-fb40-45c5-9d9c-2600cf61eb5c tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:13.392578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2e0704c-fb40-45c5-9d9c-2600cf61eb5c tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:13.393194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2e0704c-fb40-45c5-9d9c-2600cf61eb5c tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:13.550567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d2e0704c-fb40-45c5-9d9c-2600cf61eb5c tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:13.559787 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d2e0704c-fb40-45c5-9d9c-2600cf61eb5c tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f" status: 200 len: 1403 microversion: 2.1 time: 0.185450 Oct 24 10:33:13.560444 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1123/2159] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:13 2022] GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f => generated 1403 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:13.870245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad212012-39d1-44fb-a0c5-1d34d069fd33 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:13.870939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad212012-39d1-44fb-a0c5-1d34d069fd33 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:13.877213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad212012-39d1-44fb-a0c5-1d34d069fd33 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:13.877698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad212012-39d1-44fb-a0c5-1d34d069fd33 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:13.878138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad212012-39d1-44fb-a0c5-1d34d069fd33 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:13.878840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad212012-39d1-44fb-a0c5-1d34d069fd33 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:13.879293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad212012-39d1-44fb-a0c5-1d34d069fd33 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:13.879721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad212012-39d1-44fb-a0c5-1d34d069fd33 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:14.046701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-166b3b14-c8a8-4847-ab7a-d8731e7a3cc1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:14.047736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-166b3b14-c8a8-4847-ab7a-d8731e7a3cc1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] [instance: 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:14.059433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-166b3b14-c8a8-4847-ab7a-d8731e7a3cc1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:14.060306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-166b3b14-c8a8-4847-ab7a-d8731e7a3cc1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:14.060993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-166b3b14-c8a8-4847-ab7a-d8731e7a3cc1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:14.061933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-166b3b14-c8a8-4847-ab7a-d8731e7a3cc1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:14.067800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-166b3b14-c8a8-4847-ab7a-d8731e7a3cc1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:14.068725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-166b3b14-c8a8-4847-ab7a-d8731e7a3cc1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:14.073955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ad212012-39d1-44fb-a0c5-1d34d069fd33 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:14.083810 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad212012-39d1-44fb-a0c5-1d34d069fd33 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1307 microversion: 2.1 time: 0.219386 Oct 24 10:33:14.084887 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1037/2160] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:13 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1307 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:14.102524 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-166b3b14-c8a8-4847-ab7a-d8731e7a3cc1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] HTTP exception thrown: Instance 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb could not be found. Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-166b3b14-c8a8-4847-ab7a-d8731e7a3cc1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Request method failure captured: Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb HTTP/1.1 Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmgAI56ixX3LxgS7Ly-9n4q3huK4pYbld15OoCOex2Vf6Wku9STLKIRlZZ1d5nk_VUwGgN4V57lhzJHNDCb73Tn0ifTsKK6YRDPQ5jbKjKGMnQfE-Xi3pf6JmeXvaJwkuti6S33B5nt95lgzwThhG-3q84dQ-AyCluRwSJeYme1sFLs Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 115025f23db94a71b74b6adbc536792f Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-LiveMigrationTest-1696265939 Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/115025f23db94a71b74b6adbc536792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/115025f23db94a71b74b6adbc536792f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/115025f23db94a71b74b6adbc536792f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_115025f23db94a71b74b6adbc536792f", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-LiveMigrationTest-1696265939 Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 115025f23db94a71b74b6adbc536792f Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-LiveMigrationTest-1696265939 Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-LiveMigrationTest-1696265939-project Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 176a68ea281e4f65bbeac67cc304468d Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-LiveMigrationTest-1696265939-project Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb could not be found. Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb'} Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb could not be found. Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb could not be found. Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:14.104226 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:14.107410 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:14.107410 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:14.107410 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:14.107410 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:14.107410 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:14.107410 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb could not be found. Oct 24 10:33:14.107410 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:14.107410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-166b3b14-c8a8-4847-ab7a-d8731e7a3cc1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] Returning 404 to user: Instance 0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:14.107410 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-166b3b14-c8a8-4847-ab7a-d8731e7a3cc1 tempest-LiveMigrationTest-1696265939 tempest-LiveMigrationTest-1696265939-project] 10.222.0.50 "GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb" status: 404 len: 111 microversion: 2.1 time: 0.062957 Oct 24 10:33:14.107410 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1124/2161] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:14 2022] GET /compute/v2.1/servers/0ba578aa-6ec9-4be0-9f4c-cbf21ed940fb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:33:14.142511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4883f34f-e28b-4925-8735-a2a6e912967b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:14.145276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4883f34f-e28b-4925-8735-a2a6e912967b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:14.155054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4883f34f-e28b-4925-8735-a2a6e912967b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:14.155580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4883f34f-e28b-4925-8735-a2a6e912967b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:14.156023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4883f34f-e28b-4925-8735-a2a6e912967b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:14.156742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4883f34f-e28b-4925-8735-a2a6e912967b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:14.157220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4883f34f-e28b-4925-8735-a2a6e912967b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:14.157819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4883f34f-e28b-4925-8735-a2a6e912967b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:14.207120 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4883f34f-e28b-4925-8735-a2a6e912967b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.069917 Oct 24 10:33:14.209574 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1038/2162] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:33:14 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:33:14.583719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0364494e-2159-43af-9fbc-f9ffb9ecf6e3 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:14.584349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0364494e-2159-43af-9fbc-f9ffb9ecf6e3 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:14.595158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0364494e-2159-43af-9fbc-f9ffb9ecf6e3 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:14.599479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0364494e-2159-43af-9fbc-f9ffb9ecf6e3 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:14.600096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0364494e-2159-43af-9fbc-f9ffb9ecf6e3 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:14.601041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0364494e-2159-43af-9fbc-f9ffb9ecf6e3 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:14.603251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0364494e-2159-43af-9fbc-f9ffb9ecf6e3 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:14.608347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0364494e-2159-43af-9fbc-f9ffb9ecf6e3 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:15.109141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-adffc524-92bc-42a4-8eb6-dba998bf94b8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:15.109794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-adffc524-92bc-42a4-8eb6-dba998bf94b8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:15.110233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0364494e-2159-43af-9fbc-f9ffb9ecf6e3 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:15.127861 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0364494e-2159-43af-9fbc-f9ffb9ecf6e3 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f" status: 200 len: 1403 microversion: 2.1 time: 0.545419 Oct 24 10:33:15.130497 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1125/2163] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:14 2022] GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f => generated 1403 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:15.139994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adffc524-92bc-42a4-8eb6-dba998bf94b8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:15.143693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adffc524-92bc-42a4-8eb6-dba998bf94b8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:15.147290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adffc524-92bc-42a4-8eb6-dba998bf94b8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:15.150234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adffc524-92bc-42a4-8eb6-dba998bf94b8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:15.160050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adffc524-92bc-42a4-8eb6-dba998bf94b8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:15.160600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adffc524-92bc-42a4-8eb6-dba998bf94b8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:15.222580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a0f7222f-62f6-4ec6-98c7-600a6fb352b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:15.224860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a0f7222f-62f6-4ec6-98c7-600a6fb352b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:15.245792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0f7222f-62f6-4ec6-98c7-600a6fb352b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:15.246298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0f7222f-62f6-4ec6-98c7-600a6fb352b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:15.252824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0f7222f-62f6-4ec6-98c7-600a6fb352b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:15.255220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0f7222f-62f6-4ec6-98c7-600a6fb352b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:15.256890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0f7222f-62f6-4ec6-98c7-600a6fb352b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:15.257297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0f7222f-62f6-4ec6-98c7-600a6fb352b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:15.327914 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a0f7222f-62f6-4ec6-98c7-600a6fb352b4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.109641 Oct 24 10:33:15.329878 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1126/2164] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:33:15 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 10:33:15.400227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-279ccc9a-4571-42f0-ade4-59a61faa291d req-5464d2d7-f3d8-41e3-8fab-8dbcb23a07ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7254c068-e068-42f0-b0bd-1fb8ed98104f", "name": "network-vif-plugged", "status": "completed", "tag": "e9ece899-4bb1-4d03-a940-7ed49dc6da77"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:15.424352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-279ccc9a-4571-42f0-ade4-59a61faa291d req-5464d2d7-f3d8-41e3-8fab-8dbcb23a07ae service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:15.426950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-279ccc9a-4571-42f0-ade4-59a61faa291d req-5464d2d7-f3d8-41e3-8fab-8dbcb23a07ae service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:15.429101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-279ccc9a-4571-42f0-ade4-59a61faa291d req-5464d2d7-f3d8-41e3-8fab-8dbcb23a07ae service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:15.442327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-adffc524-92bc-42a4-8eb6-dba998bf94b8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:15.451416 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-adffc524-92bc-42a4-8eb6-dba998bf94b8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1307 microversion: 2.1 time: 0.346931 Oct 24 10:33:15.452130 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-279ccc9a-4571-42f0-ade4-59a61faa291d req-5464d2d7-f3d8-41e3-8fab-8dbcb23a07ae service nova] Creating event network-vif-plugged:e9ece899-4bb1-4d03-a940-7ed49dc6da77 for instance 7254c068-e068-42f0-b0bd-1fb8ed98104f on n-h1-858383-15 Oct 24 10:33:15.453178 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1039/2165] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:15 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1307 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:15.479395 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-279ccc9a-4571-42f0-ade4-59a61faa291d req-5464d2d7-f3d8-41e3-8fab-8dbcb23a07ae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084589 Oct 24 10:33:15.480087 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1127/2166] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:33:16.156310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4624e8cd-0f4d-45ed-a9d2-7811cada0f7a tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:16.156959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4624e8cd-0f4d-45ed-a9d2-7811cada0f7a tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:16.160660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:16.161494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=16 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:16.178262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4624e8cd-0f4d-45ed-a9d2-7811cada0f7a tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:16.178984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4624e8cd-0f4d-45ed-a9d2-7811cada0f7a tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:16.179564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4624e8cd-0f4d-45ed-a9d2-7811cada0f7a tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:16.181026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4624e8cd-0f4d-45ed-a9d2-7811cada0f7a tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:16.188294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4624e8cd-0f4d-45ed-a9d2-7811cada0f7a tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:16.189013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4624e8cd-0f4d-45ed-a9d2-7811cada0f7a tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:16.223715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:16.340348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=8 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:16.345864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9049e652-20b2-4050-aa63-0dc46bce9462 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:16.353188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9049e652-20b2-4050-aa63-0dc46bce9462 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:16.387732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9049e652-20b2-4050-aa63-0dc46bce9462 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:16.395410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9049e652-20b2-4050-aa63-0dc46bce9462 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:16.396993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9049e652-20b2-4050-aa63-0dc46bce9462 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:16.406146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9049e652-20b2-4050-aa63-0dc46bce9462 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:16.407260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9049e652-20b2-4050-aa63-0dc46bce9462 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:16.407893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9049e652-20b2-4050-aa63-0dc46bce9462 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:16.495427 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9049e652-20b2-4050-aa63-0dc46bce9462 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.156907 Oct 24 10:33:16.500071 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1128/2167] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:33:16 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:33:16.512742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5de36cfb-9491-4c3a-a1f9-fe6e71947d7f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:16.519058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5de36cfb-9491-4c3a-a1f9-fe6e71947d7f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:16.535316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5de36cfb-9491-4c3a-a1f9-fe6e71947d7f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:16.536104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5de36cfb-9491-4c3a-a1f9-fe6e71947d7f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:16.536754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5de36cfb-9491-4c3a-a1f9-fe6e71947d7f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:16.537745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5de36cfb-9491-4c3a-a1f9-fe6e71947d7f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:16.542103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5de36cfb-9491-4c3a-a1f9-fe6e71947d7f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:16.550541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5de36cfb-9491-4c3a-a1f9-fe6e71947d7f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:16.595925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4624e8cd-0f4d-45ed-a9d2-7811cada0f7a tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:16.609572 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4624e8cd-0f4d-45ed-a9d2-7811cada0f7a tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f" status: 200 len: 1403 microversion: 2.1 time: 0.453048 Oct 24 10:33:16.610235 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1040/2168] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:16 2022] GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f => generated 1403 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:16.784125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5de36cfb-9491-4c3a-a1f9-fe6e71947d7f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:16.793349 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5de36cfb-9491-4c3a-a1f9-fe6e71947d7f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1307 microversion: 2.1 time: 0.288193 Oct 24 10:33:16.796156 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1129/2169] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:16 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1307 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:17.512713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e5e9344f-24ba-436a-9761-7536fd5b0d80 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:17.515262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e5e9344f-24ba-436a-9761-7536fd5b0d80 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:17.532023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5e9344f-24ba-436a-9761-7536fd5b0d80 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:17.532660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5e9344f-24ba-436a-9761-7536fd5b0d80 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:17.533130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5e9344f-24ba-436a-9761-7536fd5b0d80 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:17.534217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5e9344f-24ba-436a-9761-7536fd5b0d80 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:17.534831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5e9344f-24ba-436a-9761-7536fd5b0d80 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:17.535532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5e9344f-24ba-436a-9761-7536fd5b0d80 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:17.627301 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e5e9344f-24ba-436a-9761-7536fd5b0d80 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.119335 Oct 24 10:33:17.635047 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1041/2170] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:33:17 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:33:17.639877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4af4caa9-7cf1-4fe5-9b8f-9cbbb599c5ac tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:17.640502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4af4caa9-7cf1-4fe5-9b8f-9cbbb599c5ac tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:17.685451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4af4caa9-7cf1-4fe5-9b8f-9cbbb599c5ac tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:17.685952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4af4caa9-7cf1-4fe5-9b8f-9cbbb599c5ac tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:17.686440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4af4caa9-7cf1-4fe5-9b8f-9cbbb599c5ac tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:17.687260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4af4caa9-7cf1-4fe5-9b8f-9cbbb599c5ac tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:17.687721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4af4caa9-7cf1-4fe5-9b8f-9cbbb599c5ac tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:17.688200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4af4caa9-7cf1-4fe5-9b8f-9cbbb599c5ac tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:17.820732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b95329ae-9a67-4f36-8dde-6e3b32c9dfb7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:17.821936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b95329ae-9a67-4f36-8dde-6e3b32c9dfb7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:17.831934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b95329ae-9a67-4f36-8dde-6e3b32c9dfb7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:17.833250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b95329ae-9a67-4f36-8dde-6e3b32c9dfb7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:17.834272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b95329ae-9a67-4f36-8dde-6e3b32c9dfb7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:17.835622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b95329ae-9a67-4f36-8dde-6e3b32c9dfb7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:17.839660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b95329ae-9a67-4f36-8dde-6e3b32c9dfb7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:17.840275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b95329ae-9a67-4f36-8dde-6e3b32c9dfb7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:17.994075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4af4caa9-7cf1-4fe5-9b8f-9cbbb599c5ac tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:18.009241 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4af4caa9-7cf1-4fe5-9b8f-9cbbb599c5ac tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f" status: 200 len: 1590 microversion: 2.1 time: 0.369209 Oct 24 10:33:18.019972 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1130/2171] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:17 2022] GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f => generated 1590 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:18.038701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0703b0ff-a84a-4cea-bdf3-b644055693a1 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:18.039418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0703b0ff-a84a-4cea-bdf3-b644055693a1 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:18.051735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0703b0ff-a84a-4cea-bdf3-b644055693a1 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:18.055914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0703b0ff-a84a-4cea-bdf3-b644055693a1 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:18.056457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0703b0ff-a84a-4cea-bdf3-b644055693a1 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:18.057366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0703b0ff-a84a-4cea-bdf3-b644055693a1 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:18.057841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0703b0ff-a84a-4cea-bdf3-b644055693a1 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:18.063314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0703b0ff-a84a-4cea-bdf3-b644055693a1 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:18.322938 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0703b0ff-a84a-4cea-bdf3-b644055693a1 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.288278 Oct 24 10:33:18.323732 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1131/2172] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 10:33:18 2022] GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f/os-interface => generated 284 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:33:18.332075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b95329ae-9a67-4f36-8dde-6e3b32c9dfb7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:18.360030 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b95329ae-9a67-4f36-8dde-6e3b32c9dfb7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1307 microversion: 2.1 time: 0.543648 Oct 24 10:33:18.361278 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1042/2173] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:17 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1307 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:33:18.651942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6dde48af-f1c7-47eb-80fb-c6ac8c5e8d26 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:18.660172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6dde48af-f1c7-47eb-80fb-c6ac8c5e8d26 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:18.672479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6dde48af-f1c7-47eb-80fb-c6ac8c5e8d26 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:18.673902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6dde48af-f1c7-47eb-80fb-c6ac8c5e8d26 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:18.694664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6dde48af-f1c7-47eb-80fb-c6ac8c5e8d26 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:18.698882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6dde48af-f1c7-47eb-80fb-c6ac8c5e8d26 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:18.699887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6dde48af-f1c7-47eb-80fb-c6ac8c5e8d26 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:18.700541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6dde48af-f1c7-47eb-80fb-c6ac8c5e8d26 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:18.779446 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6dde48af-f1c7-47eb-80fb-c6ac8c5e8d26 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.141133 Oct 24 10:33:18.785039 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1132/2174] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:33:18 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:33:19.384657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2a0fe630-a611-4ca6-9adf-9c67f4b555ae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:19.393110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2a0fe630-a611-4ca6-9adf-9c67f4b555ae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:19.400453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a0fe630-a611-4ca6-9adf-9c67f4b555ae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:19.401187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a0fe630-a611-4ca6-9adf-9c67f4b555ae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:19.401760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a0fe630-a611-4ca6-9adf-9c67f4b555ae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:19.403104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a0fe630-a611-4ca6-9adf-9c67f4b555ae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:19.403697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a0fe630-a611-4ca6-9adf-9c67f4b555ae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:19.409151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a0fe630-a611-4ca6-9adf-9c67f4b555ae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:19.588542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-75605f2d-3b57-4dc9-aab2-270d81eb7309 req-9fffca65-fc5e-473b-a4ed-ad0bbab8e0dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e69d62-2639-481e-a3bb-afe5c3ae0f79", "name": "network-vif-plugged", "status": "completed", "tag": "6bff8cd6-2640-4c13-a7f3-be3af206c633"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:19.613270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-75605f2d-3b57-4dc9-aab2-270d81eb7309 req-9fffca65-fc5e-473b-a4ed-ad0bbab8e0dc service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:19.614289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-75605f2d-3b57-4dc9-aab2-270d81eb7309 req-9fffca65-fc5e-473b-a4ed-ad0bbab8e0dc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:19.614753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-75605f2d-3b57-4dc9-aab2-270d81eb7309 req-9fffca65-fc5e-473b-a4ed-ad0bbab8e0dc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:19.642897 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-75605f2d-3b57-4dc9-aab2-270d81eb7309 req-9fffca65-fc5e-473b-a4ed-ad0bbab8e0dc service nova] Creating event network-vif-plugged:6bff8cd6-2640-4c13-a7f3-be3af206c633 for instance 84e69d62-2639-481e-a3bb-afe5c3ae0f79 on n-h1-858383-15 Oct 24 10:33:19.651499 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-75605f2d-3b57-4dc9-aab2-270d81eb7309 req-9fffca65-fc5e-473b-a4ed-ad0bbab8e0dc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066632 Oct 24 10:33:19.653346 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1133/2175] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:33:19.766155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2a0fe630-a611-4ca6-9adf-9c67f4b555ae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:19.774138 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2a0fe630-a611-4ca6-9adf-9c67f4b555ae tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1307 microversion: 2.1 time: 0.394687 Oct 24 10:33:19.775302 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1043/2176] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:19 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1307 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:19.793781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9fc51191-3bae-421b-a8e3-9f5a99ee5db1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:19.796402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9fc51191-3bae-421b-a8e3-9f5a99ee5db1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:19.818653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9fc51191-3bae-421b-a8e3-9f5a99ee5db1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:19.821673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9fc51191-3bae-421b-a8e3-9f5a99ee5db1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:19.822168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9fc51191-3bae-421b-a8e3-9f5a99ee5db1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:19.822911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9fc51191-3bae-421b-a8e3-9f5a99ee5db1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:19.825154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9fc51191-3bae-421b-a8e3-9f5a99ee5db1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:19.825654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9fc51191-3bae-421b-a8e3-9f5a99ee5db1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:19.860109 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9fc51191-3bae-421b-a8e3-9f5a99ee5db1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.072115 Oct 24 10:33:19.861100 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1134/2177] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:33:19 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:33:20.589412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c138503-ccac-41cc-b383-c8a422e3b964 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:20.590481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1c138503-ccac-41cc-b383-c8a422e3b964 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:20.597013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-cd91cf7c-11df-47a5-8c68-94dcbb7b3b6d req-9e2dc429-b624-4864-a263-2354b810cde3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7254c068-e068-42f0-b0bd-1fb8ed98104f", "tag": "e9ece899-4bb1-4d03-a940-7ed49dc6da77"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:20.607073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c138503-ccac-41cc-b383-c8a422e3b964 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:20.608239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c138503-ccac-41cc-b383-c8a422e3b964 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:20.609335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c138503-ccac-41cc-b383-c8a422e3b964 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:20.610554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c138503-ccac-41cc-b383-c8a422e3b964 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:20.611385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c138503-ccac-41cc-b383-c8a422e3b964 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:20.611827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c138503-ccac-41cc-b383-c8a422e3b964 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:20.616964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cd91cf7c-11df-47a5-8c68-94dcbb7b3b6d req-9e2dc429-b624-4864-a263-2354b810cde3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:20.618114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cd91cf7c-11df-47a5-8c68-94dcbb7b3b6d req-9e2dc429-b624-4864-a263-2354b810cde3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:20.626265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cd91cf7c-11df-47a5-8c68-94dcbb7b3b6d req-9e2dc429-b624-4864-a263-2354b810cde3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:20.657308 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-cd91cf7c-11df-47a5-8c68-94dcbb7b3b6d req-9e2dc429-b624-4864-a263-2354b810cde3 service nova] Creating event network-changed:e9ece899-4bb1-4d03-a940-7ed49dc6da77 for instance 7254c068-e068-42f0-b0bd-1fb8ed98104f on n-h1-858383-15 Oct 24 10:33:20.666244 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-cd91cf7c-11df-47a5-8c68-94dcbb7b3b6d req-9e2dc429-b624-4864-a263-2354b810cde3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074719 Oct 24 10:33:20.667203 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1135/2178] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:33:20.793988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1c138503-ccac-41cc-b383-c8a422e3b964 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:20.798049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-05c69b2d-bc5c-4411-a7f4-8a7d1a9d4525 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:20.798915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-05c69b2d-bc5c-4411-a7f4-8a7d1a9d4525 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:20.804958 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1c138503-ccac-41cc-b383-c8a422e3b964 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f" status: 200 len: 1590 microversion: 2.1 time: 0.221369 Oct 24 10:33:20.811510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05c69b2d-bc5c-4411-a7f4-8a7d1a9d4525 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:20.812185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05c69b2d-bc5c-4411-a7f4-8a7d1a9d4525 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:20.812781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05c69b2d-bc5c-4411-a7f4-8a7d1a9d4525 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:20.813516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05c69b2d-bc5c-4411-a7f4-8a7d1a9d4525 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:20.814151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05c69b2d-bc5c-4411-a7f4-8a7d1a9d4525 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:20.814577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05c69b2d-bc5c-4411-a7f4-8a7d1a9d4525 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:20.819926 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1044/2179] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:20 2022] GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f => generated 1590 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:20.873682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1eeea4c6-8600-48da-8e70-2b2ce2e54ad4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:20.877044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1eeea4c6-8600-48da-8e70-2b2ce2e54ad4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:20.890983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1eeea4c6-8600-48da-8e70-2b2ce2e54ad4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:20.893472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1eeea4c6-8600-48da-8e70-2b2ce2e54ad4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:20.894159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1eeea4c6-8600-48da-8e70-2b2ce2e54ad4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:20.900124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1eeea4c6-8600-48da-8e70-2b2ce2e54ad4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:20.901293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1eeea4c6-8600-48da-8e70-2b2ce2e54ad4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:20.901940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1eeea4c6-8600-48da-8e70-2b2ce2e54ad4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:20.972077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-05c69b2d-bc5c-4411-a7f4-8a7d1a9d4525 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:20.975493 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1eeea4c6-8600-48da-8e70-2b2ce2e54ad4 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.107234 Oct 24 10:33:20.982655 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1045/2180] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:33:20 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:33:20.994952 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-05c69b2d-bc5c-4411-a7f4-8a7d1a9d4525 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1307 microversion: 2.1 time: 0.200815 Oct 24 10:33:21.009236 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1136/2181] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:20 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1307 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:33:22.024555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6acd63e2-78c4-431c-8874-cdcdecadb228 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:22.025736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6acd63e2-78c4-431c-8874-cdcdecadb228 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:22.039037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6acd63e2-78c4-431c-8874-cdcdecadb228 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:22.040373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6acd63e2-78c4-431c-8874-cdcdecadb228 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:22.041433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6acd63e2-78c4-431c-8874-cdcdecadb228 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:22.044357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6acd63e2-78c4-431c-8874-cdcdecadb228 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:22.044854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6acd63e2-78c4-431c-8874-cdcdecadb228 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:22.047160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6acd63e2-78c4-431c-8874-cdcdecadb228 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:22.218689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6acd63e2-78c4-431c-8874-cdcdecadb228 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:22.228259 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6acd63e2-78c4-431c-8874-cdcdecadb228 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1487 microversion: 2.1 time: 0.209462 Oct 24 10:33:22.228863 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1046/2182] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:22 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1487 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:22.264225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e3903b14-68a0-4abe-989d-07af82b1ba1b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1778650806"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:22.276751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e3903b14-68a0-4abe-989d-07af82b1ba1b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:22.290933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3903b14-68a0-4abe-989d-07af82b1ba1b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:22.291766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3903b14-68a0-4abe-989d-07af82b1ba1b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:22.292352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3903b14-68a0-4abe-989d-07af82b1ba1b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:22.293299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3903b14-68a0-4abe-989d-07af82b1ba1b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:22.294184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3903b14-68a0-4abe-989d-07af82b1ba1b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:22.294814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3903b14-68a0-4abe-989d-07af82b1ba1b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:22.590603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:22.647019 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e3903b14-68a0-4abe-989d-07af82b1ba1b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "POST /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79/action" status: 202 len: 0 microversion: 2.1 time: 0.395926 Oct 24 10:33:22.648294 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1137/2183] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:33:22 2022] POST /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 10:33:22.659228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-19320485-bbf6-4351-8105-861b78399208 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d50120d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:22.725645 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-19320485-bbf6-4351-8105-861b78399208 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/258f3355-46bc-4ddd-ad48-73b6cd10dc27" status: 200 len: 1414 microversion: 2.1 time: 0.069888 Oct 24 10:33:22.726302 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1047/2184] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:33:22 2022] GET /compute/v2.1/images/258f3355-46bc-4ddd-ad48-73b6cd10dc27 => generated 1414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:33:22.744729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-73dc1d29-c1fe-46e8-be74-cfeca30a6ff8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0f56670>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:22.802550 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-73dc1d29-c1fe-46e8-be74-cfeca30a6ff8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/258f3355-46bc-4ddd-ad48-73b6cd10dc27" status: 200 len: 1414 microversion: 2.1 time: 0.063871 Oct 24 10:33:22.809374 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1138/2185] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:33:22 2022] GET /compute/v2.1/images/258f3355-46bc-4ddd-ad48-73b6cd10dc27 => generated 1414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:22.818558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-90b9a94a-36b0-4831-91e2-748f39f055f8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d4f71040>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:22.986123 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-90b9a94a-36b0-4831-91e2-748f39f055f8 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/images/258f3355-46bc-4ddd-ad48-73b6cd10dc27" status: 204 len: 0 microversion: 2.1 time: 0.172236 Oct 24 10:33:22.987207 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1048/2186] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:22 2022] DELETE /compute/v2.1/images/258f3355-46bc-4ddd-ad48-73b6cd10dc27 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 10:33:22.996958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-52ee27fc-43bc-41a4-a9d0-d4ecefc919c7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0cc0280>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:23.038682 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-52ee27fc-43bc-41a4-a9d0-d4ecefc919c7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] HTTP exception thrown: Image not found. Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-52ee27fc-43bc-41a4-a9d0-d4ecefc919c7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Request method failure captured: Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/images/258f3355-46bc-4ddd-ad48-73b6cd10dc27 HTTP/1.1 Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmiA0DX_liToZ0pV228zL8tkxDoNZ90C_zUfh-mcLGRAqyETpR76J5rYcXmiUHNSeTdzUlLyX_GlkjvJrDNIB_LcXFEXEXbL4YIW1Ztk17MFGvIShjUKAccUvpxeM8eeBjB9ehAARGytA1LCpkYper2iI7o_fPsRJLjlHtsIw0XxO2c Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a3ff02c01a64c9a940de444ca1197c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 43fd0499bc224bd8b190701a811ee204 Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: exception: Image not found. Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '258f3355-46bc-4ddd-ad48-73b6cd10dc27'} Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 258f3355-46bc-4ddd-ad48-73b6cd10dc27 Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 10:33:23.041693 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 258f3355-46bc-4ddd-ad48-73b6cd10dc27 could not be found. Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:33:23.045437 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:23.052264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-52ee27fc-43bc-41a4-a9d0-d4ecefc919c7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Returning 404 to user: Image not found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:23.053597 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-52ee27fc-43bc-41a4-a9d0-d4ecefc919c7 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/images/258f3355-46bc-4ddd-ad48-73b6cd10dc27" status: 404 len: 62 microversion: 2.1 time: 0.062464 Oct 24 10:33:23.057885 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1139/2187] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:33:22 2022] GET /compute/v2.1/images/258f3355-46bc-4ddd-ad48-73b6cd10dc27 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:33:23.076408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-da981f4c-0c1c-4347-bab7-aeeef4711402 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:23.077661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-da981f4c-0c1c-4347-bab7-aeeef4711402 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:23.089771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da981f4c-0c1c-4347-bab7-aeeef4711402 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:23.090544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da981f4c-0c1c-4347-bab7-aeeef4711402 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:23.091187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da981f4c-0c1c-4347-bab7-aeeef4711402 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:23.093621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da981f4c-0c1c-4347-bab7-aeeef4711402 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:23.094267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da981f4c-0c1c-4347-bab7-aeeef4711402 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:23.094873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da981f4c-0c1c-4347-bab7-aeeef4711402 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:23.327089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-da981f4c-0c1c-4347-bab7-aeeef4711402 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:23.334805 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-da981f4c-0c1c-4347-bab7-aeeef4711402 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1499 microversion: 2.1 time: 0.262513 Oct 24 10:33:23.337410 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1049/2188] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:23 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1499 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:24.363039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8ccb2ac1-ba83-4d2c-8c11-19ef1b63a079 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:24.365226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8ccb2ac1-ba83-4d2c-8c11-19ef1b63a079 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:24.375398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ccb2ac1-ba83-4d2c-8c11-19ef1b63a079 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:24.376255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ccb2ac1-ba83-4d2c-8c11-19ef1b63a079 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:24.377071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ccb2ac1-ba83-4d2c-8c11-19ef1b63a079 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:24.378019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ccb2ac1-ba83-4d2c-8c11-19ef1b63a079 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:24.378678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ccb2ac1-ba83-4d2c-8c11-19ef1b63a079 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:24.379325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ccb2ac1-ba83-4d2c-8c11-19ef1b63a079 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:24.566969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8ccb2ac1-ba83-4d2c-8c11-19ef1b63a079 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:24.577872 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8ccb2ac1-ba83-4d2c-8c11-19ef1b63a079 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1499 microversion: 2.1 time: 0.220111 Oct 24 10:33:24.578466 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1140/2189] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:24 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1499 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:25.601753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-509d3aa0-ca35-4329-b9e5-948d4c2f0345 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:25.603718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-509d3aa0-ca35-4329-b9e5-948d4c2f0345 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:25.613666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-509d3aa0-ca35-4329-b9e5-948d4c2f0345 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:25.615002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-509d3aa0-ca35-4329-b9e5-948d4c2f0345 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:25.616318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-509d3aa0-ca35-4329-b9e5-948d4c2f0345 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:25.621574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-509d3aa0-ca35-4329-b9e5-948d4c2f0345 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:25.622118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-509d3aa0-ca35-4329-b9e5-948d4c2f0345 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:25.622716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-509d3aa0-ca35-4329-b9e5-948d4c2f0345 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:25.819795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-509d3aa0-ca35-4329-b9e5-948d4c2f0345 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:25.833986 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-509d3aa0-ca35-4329-b9e5-948d4c2f0345 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1505 microversion: 2.1 time: 0.236420 Oct 24 10:33:25.851591 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1050/2190] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:25 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:26.860539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bde0eca0-f0bd-4f4d-8c95-63f22ef612be tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:26.861311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bde0eca0-f0bd-4f4d-8c95-63f22ef612be tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:26.875056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bde0eca0-f0bd-4f4d-8c95-63f22ef612be tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:26.876732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bde0eca0-f0bd-4f4d-8c95-63f22ef612be tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:26.877987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bde0eca0-f0bd-4f4d-8c95-63f22ef612be tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:26.880754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bde0eca0-f0bd-4f4d-8c95-63f22ef612be tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:26.881727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bde0eca0-f0bd-4f4d-8c95-63f22ef612be tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:26.882444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bde0eca0-f0bd-4f4d-8c95-63f22ef612be tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:27.059223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bde0eca0-f0bd-4f4d-8c95-63f22ef612be tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:27.082175 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bde0eca0-f0bd-4f4d-8c95-63f22ef612be tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1505 microversion: 2.1 time: 0.225623 Oct 24 10:33:27.088085 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1141/2191] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:26 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:28.109317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-11987dd1-8106-47d6-9b9e-06f2db1acee4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:28.109856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-11987dd1-8106-47d6-9b9e-06f2db1acee4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:28.132103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11987dd1-8106-47d6-9b9e-06f2db1acee4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:28.133182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11987dd1-8106-47d6-9b9e-06f2db1acee4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:28.135798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11987dd1-8106-47d6-9b9e-06f2db1acee4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:28.137232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11987dd1-8106-47d6-9b9e-06f2db1acee4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:28.138232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11987dd1-8106-47d6-9b9e-06f2db1acee4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:28.138813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11987dd1-8106-47d6-9b9e-06f2db1acee4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:28.402744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-11987dd1-8106-47d6-9b9e-06f2db1acee4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:28.418728 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-11987dd1-8106-47d6-9b9e-06f2db1acee4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1505 microversion: 2.1 time: 0.313750 Oct 24 10:33:28.422350 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1051/2192] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:28 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:29.318997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-b3948028-5f6a-4e4c-86bd-32eccd7ccd28 req-eb583a71-1d9b-482f-8f4a-1b02a9cf59f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e69d62-2639-481e-a3bb-afe5c3ae0f79", "name": "network-vif-plugged", "status": "completed", "tag": "6bff8cd6-2640-4c13-a7f3-be3af206c633"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:29.334484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b3948028-5f6a-4e4c-86bd-32eccd7ccd28 req-eb583a71-1d9b-482f-8f4a-1b02a9cf59f5 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:29.335208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b3948028-5f6a-4e4c-86bd-32eccd7ccd28 req-eb583a71-1d9b-482f-8f4a-1b02a9cf59f5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:29.336044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b3948028-5f6a-4e4c-86bd-32eccd7ccd28 req-eb583a71-1d9b-482f-8f4a-1b02a9cf59f5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:29.350712 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-b3948028-5f6a-4e4c-86bd-32eccd7ccd28 req-eb583a71-1d9b-482f-8f4a-1b02a9cf59f5 service nova] Creating event network-vif-plugged:6bff8cd6-2640-4c13-a7f3-be3af206c633 for instance 84e69d62-2639-481e-a3bb-afe5c3ae0f79 on n-h1-858383-15 Oct 24 10:33:29.356895 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-b3948028-5f6a-4e4c-86bd-32eccd7ccd28 req-eb583a71-1d9b-482f-8f4a-1b02a9cf59f5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041716 Oct 24 10:33:29.358242 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1142/2193] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:33:29.443975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-941d86dc-0fe2-4f17-96fa-6c14c7131b2e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:29.445288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-941d86dc-0fe2-4f17-96fa-6c14c7131b2e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:29.458230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-941d86dc-0fe2-4f17-96fa-6c14c7131b2e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:29.458996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-941d86dc-0fe2-4f17-96fa-6c14c7131b2e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:29.459629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-941d86dc-0fe2-4f17-96fa-6c14c7131b2e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:29.461206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-941d86dc-0fe2-4f17-96fa-6c14c7131b2e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:29.461751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-941d86dc-0fe2-4f17-96fa-6c14c7131b2e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:29.462255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-941d86dc-0fe2-4f17-96fa-6c14c7131b2e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:29.639606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-941d86dc-0fe2-4f17-96fa-6c14c7131b2e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:29.654212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-478a214b-f177-4a61-bb19-9f9010022e06 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-224746664", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:29.667006 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-941d86dc-0fe2-4f17-96fa-6c14c7131b2e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1505 microversion: 2.1 time: 0.226923 Oct 24 10:33:29.668116 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1052/2194] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:29 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:29.732611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-478a214b-f177-4a61-bb19-9f9010022e06 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:33:29.843777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e2fedc65-99e1-4364-9b23-dae0f5b452b2 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b751d081-420e-4cf3-8405-269d3be47203"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:29.848432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e2fedc65-99e1-4364-9b23-dae0f5b452b2 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:29.856351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2fedc65-99e1-4364-9b23-dae0f5b452b2 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:29.857031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2fedc65-99e1-4364-9b23-dae0f5b452b2 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:29.857668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2fedc65-99e1-4364-9b23-dae0f5b452b2 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:29.858415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2fedc65-99e1-4364-9b23-dae0f5b452b2 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:29.858876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2fedc65-99e1-4364-9b23-dae0f5b452b2 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:29.859297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2fedc65-99e1-4364-9b23-dae0f5b452b2 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:30.008620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-478a214b-f177-4a61-bb19-9f9010022e06 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:33:30.009491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-478a214b-f177-4a61-bb19-9f9010022e06 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:33:30.010250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-478a214b-f177-4a61-bb19-9f9010022e06 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:33:30.010749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-478a214b-f177-4a61-bb19-9f9010022e06 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:33:30.011293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-478a214b-f177-4a61-bb19-9f9010022e06 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:33:30.021297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-478a214b-f177-4a61-bb19-9f9010022e06 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:30.021850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-478a214b-f177-4a61-bb19-9f9010022e06 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:30.022358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-478a214b-f177-4a61-bb19-9f9010022e06 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:30.023393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-478a214b-f177-4a61-bb19-9f9010022e06 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:30.024036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-478a214b-f177-4a61-bb19-9f9010022e06 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:30.024531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-478a214b-f177-4a61-bb19-9f9010022e06 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:30.043115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-478a214b-f177-4a61-bb19-9f9010022e06 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Getting quotas for project 75bae6df8f0a4f808e29edb3ddc33cb3. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:33:30.049231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-478a214b-f177-4a61-bb19-9f9010022e06 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Getting quotas for user 096bc5b57afb4eb6866c3952c65276dc and project 75bae6df8f0a4f808e29edb3ddc33cb3. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:33:30.062710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-478a214b-f177-4a61-bb19-9f9010022e06 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:33:30.065439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-478a214b-f177-4a61-bb19-9f9010022e06 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:33:30.126132 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-478a214b-f177-4a61-bb19-9f9010022e06 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671974 Oct 24 10:33:30.128995 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1143/2195] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:33:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:33:30.141981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6e4760d1-fba7-4269-9109-5860d4a848be tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:30.143036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6e4760d1-fba7-4269-9109-5860d4a848be tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:30.252074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e4760d1-fba7-4269-9109-5860d4a848be tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096bc5b57afb4eb6866c3952c65276dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75bae6df8f0a4f808e29edb3ddc33cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:30.259884 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6e4760d1-fba7-4269-9109-5860d4a848be tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] 10.222.0.50 "GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f" status: 200 len: 1222 microversion: 2.1 time: 0.125664 Oct 24 10:33:30.260462 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1144/2196] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:30 2022] GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f => generated 1222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:30.278689 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e2fedc65-99e1-4364-9b23-dae0f5b452b2 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "POST /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.438583 Oct 24 10:33:30.294549 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1053/2197] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 10:33:29 2022] POST /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380/os-volume_attachments => generated 194 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:33:30.700188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1cf738e1-d200-4d3a-9d5a-6c9950fa937c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:30.701486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1cf738e1-d200-4d3a-9d5a-6c9950fa937c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:30.724029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1cf738e1-d200-4d3a-9d5a-6c9950fa937c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:30.724533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1cf738e1-d200-4d3a-9d5a-6c9950fa937c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:30.725007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1cf738e1-d200-4d3a-9d5a-6c9950fa937c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:30.725727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1cf738e1-d200-4d3a-9d5a-6c9950fa937c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:30.726273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1cf738e1-d200-4d3a-9d5a-6c9950fa937c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:30.726943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1cf738e1-d200-4d3a-9d5a-6c9950fa937c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:30.902020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1cf738e1-d200-4d3a-9d5a-6c9950fa937c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:30.911049 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1cf738e1-d200-4d3a-9d5a-6c9950fa937c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1500 microversion: 2.1 time: 0.217127 Oct 24 10:33:30.916282 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1145/2198] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:30 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1500 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:31.289590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8532e04e-4d91-4fc7-8110-9891d9704425 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:31.290389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8532e04e-4d91-4fc7-8110-9891d9704425 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:31.302924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8532e04e-4d91-4fc7-8110-9891d9704425 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:31.305755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8532e04e-4d91-4fc7-8110-9891d9704425 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:31.308092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8532e04e-4d91-4fc7-8110-9891d9704425 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:31.310541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8532e04e-4d91-4fc7-8110-9891d9704425 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:31.311265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8532e04e-4d91-4fc7-8110-9891d9704425 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:31.311715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8532e04e-4d91-4fc7-8110-9891d9704425 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:31.453267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8532e04e-4d91-4fc7-8110-9891d9704425 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096bc5b57afb4eb6866c3952c65276dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75bae6df8f0a4f808e29edb3ddc33cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:31.464123 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8532e04e-4d91-4fc7-8110-9891d9704425 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] 10.222.0.50 "GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f" status: 200 len: 1274 microversion: 2.1 time: 0.181361 Oct 24 10:33:31.464724 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1054/2199] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:31 2022] GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:31.943123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ed24ca5e-28ee-47c9-98ce-21ce104c8058 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:31.943746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ed24ca5e-28ee-47c9-98ce-21ce104c8058 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:31.963513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed24ca5e-28ee-47c9-98ce-21ce104c8058 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:31.964378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed24ca5e-28ee-47c9-98ce-21ce104c8058 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:31.965967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed24ca5e-28ee-47c9-98ce-21ce104c8058 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:31.966866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed24ca5e-28ee-47c9-98ce-21ce104c8058 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:31.969360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed24ca5e-28ee-47c9-98ce-21ce104c8058 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:31.971371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed24ca5e-28ee-47c9-98ce-21ce104c8058 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:32.228652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ed24ca5e-28ee-47c9-98ce-21ce104c8058 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:32.238888 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ed24ca5e-28ee-47c9-98ce-21ce104c8058 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1487 microversion: 2.1 time: 0.300576 Oct 24 10:33:32.239488 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1146/2200] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:31 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1487 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:32.267517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10fc8e70-5b85-42c4-99f6-52adb5ee185c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:32.268889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-10fc8e70-5b85-42c4-99f6-52adb5ee185c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:32.278870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10fc8e70-5b85-42c4-99f6-52adb5ee185c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:32.279687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10fc8e70-5b85-42c4-99f6-52adb5ee185c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:32.280604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10fc8e70-5b85-42c4-99f6-52adb5ee185c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:32.283227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10fc8e70-5b85-42c4-99f6-52adb5ee185c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:32.283881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10fc8e70-5b85-42c4-99f6-52adb5ee185c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:32.284549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10fc8e70-5b85-42c4-99f6-52adb5ee185c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:32.319081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-10fc8e70-5b85-42c4-99f6-52adb5ee185c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:33:32.448714 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10fc8e70-5b85-42c4-99f6-52adb5ee185c tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 204 len: 0 microversion: 2.1 time: 0.188673 Oct 24 10:33:32.452418 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1055/2201] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:33:32 2022] DELETE /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:33:32.463482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b2af236b-b112-4fa8-8a9e-4c2c464b19e9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d0df7430>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:32.487979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4776b58c-265b-472c-9481-2200c6fd15e7 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:32.488605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4776b58c-265b-472c-9481-2200c6fd15e7 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:32.495884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4776b58c-265b-472c-9481-2200c6fd15e7 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:32.496582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4776b58c-265b-472c-9481-2200c6fd15e7 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:32.497193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4776b58c-265b-472c-9481-2200c6fd15e7 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:32.498077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4776b58c-265b-472c-9481-2200c6fd15e7 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:32.498664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4776b58c-265b-472c-9481-2200c6fd15e7 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:32.500667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4776b58c-265b-472c-9481-2200c6fd15e7 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:32.531264 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-b2af236b-b112-4fa8-8a9e-4c2c464b19e9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] HTTP exception thrown: Image not found. Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b2af236b-b112-4fa8-8a9e-4c2c464b19e9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Request method failure captured: Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/images/258f3355-46bc-4ddd-ad48-73b6cd10dc27 HTTP/1.1 Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmiA0DX_liToZ0pV228zL8tkxDoNZ90C_zUfh-mcLGRAqyETpR76J5rYcXmiUHNSeTdzUlLyX_GlkjvJrDNIB_LcXFEXEXbL4YIW1Ztk17MFGvIShjUKAccUvpxeM8eeBjB9ehAARGytA1LCpkYper2iI7o_fPsRJLjlHtsIw0XxO2c Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a3ff02c01a64c9a940de444ca1197c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 43fd0499bc224bd8b190701a811ee204 Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: exception: Image not found. Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '258f3355-46bc-4ddd-ad48-73b6cd10dc27'} Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 258f3355-46bc-4ddd-ad48-73b6cd10dc27 to delete Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 258f3355-46bc-4ddd-ad48-73b6cd10dc27 could not be found. Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:32.533372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:33:32.536568 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:32.539756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b2af236b-b112-4fa8-8a9e-4c2c464b19e9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Returning 404 to user: Image not found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:32.540824 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b2af236b-b112-4fa8-8a9e-4c2c464b19e9 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/images/258f3355-46bc-4ddd-ad48-73b6cd10dc27" status: 404 len: 62 microversion: 2.1 time: 0.081972 Oct 24 10:33:32.541938 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1147/2202] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:32 2022] DELETE /compute/v2.1/images/258f3355-46bc-4ddd-ad48-73b6cd10dc27 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:33:32.557881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-34f1b910-da30-41f9-a2c2-4abe109fcf82 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:32.558690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-34f1b910-da30-41f9-a2c2-4abe109fcf82 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:32.571573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:32.579985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34f1b910-da30-41f9-a2c2-4abe109fcf82 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:32.585614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34f1b910-da30-41f9-a2c2-4abe109fcf82 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:32.586302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34f1b910-da30-41f9-a2c2-4abe109fcf82 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:32.587286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34f1b910-da30-41f9-a2c2-4abe109fcf82 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:32.587846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34f1b910-da30-41f9-a2c2-4abe109fcf82 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:32.588130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34f1b910-da30-41f9-a2c2-4abe109fcf82 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:32.657244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-34f1b910-da30-41f9-a2c2-4abe109fcf82 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:33:32.766982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4776b58c-265b-472c-9481-2200c6fd15e7 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096bc5b57afb4eb6866c3952c65276dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75bae6df8f0a4f808e29edb3ddc33cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:32.775151 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4776b58c-265b-472c-9481-2200c6fd15e7 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] 10.222.0.50 "GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f" status: 200 len: 1280 microversion: 2.1 time: 0.291269 Oct 24 10:33:32.775745 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1056/2203] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:32 2022] GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f => generated 1280 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:33:32.812018 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.compute.api [None req-34f1b910-da30-41f9-a2c2-4abe109fcf82 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Instance is already in deleting state, ignoring this request Oct 24 10:33:32.818881 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-34f1b910-da30-41f9-a2c2-4abe109fcf82 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 204 len: 0 microversion: 2.1 time: 0.273138 Oct 24 10:33:32.822706 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1148/2204] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:33:32 2022] DELETE /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 10:33:32.834020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-37fa0958-8e7c-49c2-a1d3-cf4f3e991e89 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:32.835461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-37fa0958-8e7c-49c2-a1d3-cf4f3e991e89 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:32.863015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37fa0958-8e7c-49c2-a1d3-cf4f3e991e89 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:32.863787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37fa0958-8e7c-49c2-a1d3-cf4f3e991e89 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:32.864553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37fa0958-8e7c-49c2-a1d3-cf4f3e991e89 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:32.865651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37fa0958-8e7c-49c2-a1d3-cf4f3e991e89 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:32.866354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37fa0958-8e7c-49c2-a1d3-cf4f3e991e89 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:32.869442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37fa0958-8e7c-49c2-a1d3-cf4f3e991e89 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:33.113030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-37fa0958-8e7c-49c2-a1d3-cf4f3e991e89 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:33.138830 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-37fa0958-8e7c-49c2-a1d3-cf4f3e991e89 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1493 microversion: 2.1 time: 0.306173 Oct 24 10:33:33.139508 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1057/2205] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:32 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1493 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:33.803163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-239df754-cc27-4940-9af8-96d662ed7474 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:33.805224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-239df754-cc27-4940-9af8-96d662ed7474 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:33.815198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-239df754-cc27-4940-9af8-96d662ed7474 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:33.817508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-239df754-cc27-4940-9af8-96d662ed7474 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:33.819241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-239df754-cc27-4940-9af8-96d662ed7474 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:33.823221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-239df754-cc27-4940-9af8-96d662ed7474 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:33.824201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-239df754-cc27-4940-9af8-96d662ed7474 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:33.825790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-239df754-cc27-4940-9af8-96d662ed7474 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:34.091662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-239df754-cc27-4940-9af8-96d662ed7474 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096bc5b57afb4eb6866c3952c65276dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75bae6df8f0a4f808e29edb3ddc33cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:34.109160 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-239df754-cc27-4940-9af8-96d662ed7474 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] 10.222.0.50 "GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f" status: 200 len: 1322 microversion: 2.1 time: 0.310721 Oct 24 10:33:34.109776 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1149/2206] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:33 2022] GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:34.167755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8d35d402-a623-443a-9647-719f5a51d132 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:34.169446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8d35d402-a623-443a-9647-719f5a51d132 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:34.185590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d35d402-a623-443a-9647-719f5a51d132 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:34.188639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d35d402-a623-443a-9647-719f5a51d132 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:34.189303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d35d402-a623-443a-9647-719f5a51d132 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:34.192551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d35d402-a623-443a-9647-719f5a51d132 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:34.193243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d35d402-a623-443a-9647-719f5a51d132 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:34.195828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d35d402-a623-443a-9647-719f5a51d132 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:34.490882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8d35d402-a623-443a-9647-719f5a51d132 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:34.503617 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8d35d402-a623-443a-9647-719f5a51d132 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1493 microversion: 2.1 time: 0.341614 Oct 24 10:33:34.504402 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1058/2207] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:34 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1493 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:34.546133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-beb92fff-7987-4685-bcb4-57267cc39504 req-528d68ff-9b8b-496c-a0c0-86c3a211ddaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31fa9f50-887f-4cbd-b569-7b8bc66bbb4f", "tag": "5fce5553-24ad-4ae4-874a-baf819eb9300"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:34.560238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-beb92fff-7987-4685-bcb4-57267cc39504 req-528d68ff-9b8b-496c-a0c0-86c3a211ddaf service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:34.561216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-beb92fff-7987-4685-bcb4-57267cc39504 req-528d68ff-9b8b-496c-a0c0-86c3a211ddaf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:34.562673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-beb92fff-7987-4685-bcb4-57267cc39504 req-528d68ff-9b8b-496c-a0c0-86c3a211ddaf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:34.580615 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-beb92fff-7987-4685-bcb4-57267cc39504 req-528d68ff-9b8b-496c-a0c0-86c3a211ddaf service nova] Creating event network-changed:5fce5553-24ad-4ae4-874a-baf819eb9300 for instance 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f on n-h2-858383-15 Oct 24 10:33:34.588623 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-beb92fff-7987-4685-bcb4-57267cc39504 req-528d68ff-9b8b-496c-a0c0-86c3a211ddaf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053213 Oct 24 10:33:34.589584 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1150/2208] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:33:35.139211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1817b925-ff39-4526-9042-7ffee77c0fa1 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:35.139840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1817b925-ff39-4526-9042-7ffee77c0fa1 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:35.154782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1817b925-ff39-4526-9042-7ffee77c0fa1 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:35.155521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1817b925-ff39-4526-9042-7ffee77c0fa1 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:35.156144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1817b925-ff39-4526-9042-7ffee77c0fa1 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:35.157126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1817b925-ff39-4526-9042-7ffee77c0fa1 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:35.157733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1817b925-ff39-4526-9042-7ffee77c0fa1 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:35.158311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1817b925-ff39-4526-9042-7ffee77c0fa1 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:35.361233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a36381e0-fa6b-4ae2-ba8c-55f366c867db req-43d26308-7b03-4fd0-9224-2aacef3814b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e69d62-2639-481e-a3bb-afe5c3ae0f79", "name": "network-vif-unplugged", "status": "completed", "tag": "6bff8cd6-2640-4c13-a7f3-be3af206c633"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:35.391830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1817b925-ff39-4526-9042-7ffee77c0fa1 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096bc5b57afb4eb6866c3952c65276dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75bae6df8f0a4f808e29edb3ddc33cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:35.404809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a36381e0-fa6b-4ae2-ba8c-55f366c867db req-43d26308-7b03-4fd0-9224-2aacef3814b4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:35.405104 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1817b925-ff39-4526-9042-7ffee77c0fa1 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] 10.222.0.50 "GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f" status: 200 len: 1322 microversion: 2.1 time: 0.272459 Oct 24 10:33:35.406095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a36381e0-fa6b-4ae2-ba8c-55f366c867db req-43d26308-7b03-4fd0-9224-2aacef3814b4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:35.407506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a36381e0-fa6b-4ae2-ba8c-55f366c867db req-43d26308-7b03-4fd0-9224-2aacef3814b4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:35.407938 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1059/2209] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:35 2022] GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:35.423808 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a36381e0-fa6b-4ae2-ba8c-55f366c867db req-43d26308-7b03-4fd0-9224-2aacef3814b4 service nova] Creating event network-vif-unplugged:6bff8cd6-2640-4c13-a7f3-be3af206c633 for instance 84e69d62-2639-481e-a3bb-afe5c3ae0f79 on n-h1-858383-15 Oct 24 10:33:35.430892 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a36381e0-fa6b-4ae2-ba8c-55f366c867db req-43d26308-7b03-4fd0-9224-2aacef3814b4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073964 Oct 24 10:33:35.432108 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1151/2210] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:33:35.533816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e4febe09-0440-454a-82b7-2be1d4b2610b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:35.534628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e4febe09-0440-454a-82b7-2be1d4b2610b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:35.549641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4febe09-0440-454a-82b7-2be1d4b2610b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:35.550148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4febe09-0440-454a-82b7-2be1d4b2610b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:35.550599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4febe09-0440-454a-82b7-2be1d4b2610b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:35.553659 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4febe09-0440-454a-82b7-2be1d4b2610b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:35.558530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4febe09-0440-454a-82b7-2be1d4b2610b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:35.559024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4febe09-0440-454a-82b7-2be1d4b2610b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:35.838435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e4febe09-0440-454a-82b7-2be1d4b2610b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:35.848261 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e4febe09-0440-454a-82b7-2be1d4b2610b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1493 microversion: 2.1 time: 0.321895 Oct 24 10:33:35.848869 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1060/2211] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:35 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1493 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:36.434317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-10a575ea-7b14-4bdd-bd5d-db8a50f10032 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:36.435490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-10a575ea-7b14-4bdd-bd5d-db8a50f10032 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:36.451262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10a575ea-7b14-4bdd-bd5d-db8a50f10032 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:36.452047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10a575ea-7b14-4bdd-bd5d-db8a50f10032 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:36.452657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10a575ea-7b14-4bdd-bd5d-db8a50f10032 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:36.453721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10a575ea-7b14-4bdd-bd5d-db8a50f10032 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:36.454324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10a575ea-7b14-4bdd-bd5d-db8a50f10032 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:36.455424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10a575ea-7b14-4bdd-bd5d-db8a50f10032 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:36.607819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b8768705-d1b5-4761-9de1-e936f6e55457 req-5140ca97-d6de-4ce1-bdd1-503659b879da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e69d62-2639-481e-a3bb-afe5c3ae0f79", "name": "network-vif-deleted", "tag": "6bff8cd6-2640-4c13-a7f3-be3af206c633"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:36.641860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-10a575ea-7b14-4bdd-bd5d-db8a50f10032 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096bc5b57afb4eb6866c3952c65276dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75bae6df8f0a4f808e29edb3ddc33cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:36.651531 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-10a575ea-7b14-4bdd-bd5d-db8a50f10032 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] 10.222.0.50 "GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f" status: 200 len: 1322 microversion: 2.1 time: 0.223296 Oct 24 10:33:36.652530 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1152/2212] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:36 2022] GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:36.653981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b8768705-d1b5-4761-9de1-e936f6e55457 req-5140ca97-d6de-4ce1-bdd1-503659b879da service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:36.655002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b8768705-d1b5-4761-9de1-e936f6e55457 req-5140ca97-d6de-4ce1-bdd1-503659b879da service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:36.655200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b8768705-d1b5-4761-9de1-e936f6e55457 req-5140ca97-d6de-4ce1-bdd1-503659b879da service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:36.674273 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b8768705-d1b5-4761-9de1-e936f6e55457 req-5140ca97-d6de-4ce1-bdd1-503659b879da service nova] Creating event network-vif-deleted:6bff8cd6-2640-4c13-a7f3-be3af206c633 for instance 84e69d62-2639-481e-a3bb-afe5c3ae0f79 on n-h1-858383-15 Oct 24 10:33:36.680773 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b8768705-d1b5-4761-9de1-e936f6e55457 req-5140ca97-d6de-4ce1-bdd1-503659b879da service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076765 Oct 24 10:33:36.681668 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1061/2213] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:33:36.874137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2a0e383a-fb14-4ee6-a9fc-2ecb6f20ad3f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:36.875013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2a0e383a-fb14-4ee6-a9fc-2ecb6f20ad3f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:36.884017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a0e383a-fb14-4ee6-a9fc-2ecb6f20ad3f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:36.884502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a0e383a-fb14-4ee6-a9fc-2ecb6f20ad3f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:36.884965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a0e383a-fb14-4ee6-a9fc-2ecb6f20ad3f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:36.885735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a0e383a-fb14-4ee6-a9fc-2ecb6f20ad3f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:36.886297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a0e383a-fb14-4ee6-a9fc-2ecb6f20ad3f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:36.886616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a0e383a-fb14-4ee6-a9fc-2ecb6f20ad3f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:36.932044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a0e383a-fb14-4ee6-a9fc-2ecb6f20ad3f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:36.932967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a0e383a-fb14-4ee6-a9fc-2ecb6f20ad3f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:36.934490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a0e383a-fb14-4ee6-a9fc-2ecb6f20ad3f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:36.935638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-2a0e383a-fb14-4ee6-a9fc-2ecb6f20ad3f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lazy-loading 'fault' on Instance uuid 84e69d62-2639-481e-a3bb-afe5c3ae0f79 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:33:37.012140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2a0e383a-fb14-4ee6-a9fc-2ecb6f20ad3f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43fd0499bc224bd8b190701a811ee204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3ff02c01a64c9a940de444ca1197c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:37.024901 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2a0e383a-fb14-4ee6-a9fc-2ecb6f20ad3f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 200 len: 1297 microversion: 2.1 time: 0.152653 Oct 24 10:33:37.025559 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1153/2214] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:36 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 1297 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:37.679611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5a1dbda7-023e-49e3-b5d4-c3be582bdfdf tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:37.681009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5a1dbda7-023e-49e3-b5d4-c3be582bdfdf tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:37.687364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:37.689849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a1dbda7-023e-49e3-b5d4-c3be582bdfdf tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:37.690538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a1dbda7-023e-49e3-b5d4-c3be582bdfdf tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:37.691137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a1dbda7-023e-49e3-b5d4-c3be582bdfdf tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:37.692003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a1dbda7-023e-49e3-b5d4-c3be582bdfdf tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:37.692600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a1dbda7-023e-49e3-b5d4-c3be582bdfdf tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:37.693205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a1dbda7-023e-49e3-b5d4-c3be582bdfdf tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:37.860103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5a1dbda7-023e-49e3-b5d4-c3be582bdfdf tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096bc5b57afb4eb6866c3952c65276dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75bae6df8f0a4f808e29edb3ddc33cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:37.869018 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5a1dbda7-023e-49e3-b5d4-c3be582bdfdf tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] 10.222.0.50 "GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f" status: 200 len: 1322 microversion: 2.1 time: 0.194321 Oct 24 10:33:37.870090 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1062/2215] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:37 2022] GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:38.058862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bdfe1110-911f-4256-9c47-d79952c7f3c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:38.059981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bdfe1110-911f-4256-9c47-d79952c7f3c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84e69d62-2639-481e-a3bb-afe5c3ae0f79] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:38.094781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bdfe1110-911f-4256-9c47-d79952c7f3c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.095545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bdfe1110-911f-4256-9c47-d79952c7f3c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.096047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bdfe1110-911f-4256-9c47-d79952c7f3c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.097189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bdfe1110-911f-4256-9c47-d79952c7f3c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.097888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bdfe1110-911f-4256-9c47-d79952c7f3c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.098498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bdfe1110-911f-4256-9c47-d79952c7f3c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.114645 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-bdfe1110-911f-4256-9c47-d79952c7f3c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] HTTP exception thrown: Instance 84e69d62-2639-481e-a3bb-afe5c3ae0f79 could not be found. Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bdfe1110-911f-4256-9c47-d79952c7f3c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Request method failure captured: Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 HTTP/1.1 Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmiA0DX_liToZ0pV228zL8tkxDoNZ90C_zUfh-mcLGRAqyETpR76J5rYcXmiUHNSeTdzUlLyX_GlkjvJrDNIB_LcXFEXEXbL4YIW1Ztk17MFGvIShjUKAccUvpxeM8eeBjB9ehAARGytA1LCpkYper2iI7o_fPsRJLjlHtsIw0XxO2c Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a3ff02c01a64c9a940de444ca1197c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 43fd0499bc224bd8b190701a811ee204 Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 84e69d62-2639-481e-a3bb-afe5c3ae0f79 could not be found. Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '84e69d62-2639-481e-a3bb-afe5c3ae0f79'} Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e69d62-2639-481e-a3bb-afe5c3ae0f79 could not be found. Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e69d62-2639-481e-a3bb-afe5c3ae0f79 could not be found. Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.116368 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.120000 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.120000 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.120000 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:38.120000 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:38.120000 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e69d62-2639-481e-a3bb-afe5c3ae0f79 could not be found. Oct 24 10:33:38.120000 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.120000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bdfe1110-911f-4256-9c47-d79952c7f3c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Returning 404 to user: Instance 84e69d62-2639-481e-a3bb-afe5c3ae0f79 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:38.120000 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bdfe1110-911f-4256-9c47-d79952c7f3c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79" status: 404 len: 111 microversion: 2.1 time: 0.073584 Oct 24 10:33:38.120000 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1154/2216] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:38 2022] GET /compute/v2.1/servers/84e69d62-2639-481e-a3bb-afe5c3ae0f79 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:33:38.127423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8e6bacc0-7d05-4a63-9d35-90d9c5489d6b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:38.127922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8e6bacc0-7d05-4a63-9d35-90d9c5489d6b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:38.135549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e6bacc0-7d05-4a63-9d35-90d9c5489d6b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.136436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e6bacc0-7d05-4a63-9d35-90d9c5489d6b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.137088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e6bacc0-7d05-4a63-9d35-90d9c5489d6b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.137794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e6bacc0-7d05-4a63-9d35-90d9c5489d6b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.138245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e6bacc0-7d05-4a63-9d35-90d9c5489d6b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.138673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e6bacc0-7d05-4a63-9d35-90d9c5489d6b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.155660 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-8e6bacc0-7d05-4a63-9d35-90d9c5489d6b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] HTTP exception thrown: Instance b074ba99-0598-4bba-990f-df73ab74a17a could not be found. Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8e6bacc0-7d05-4a63-9d35-90d9c5489d6b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Request method failure captured: Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a HTTP/1.1 Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmiA0DX_liToZ0pV228zL8tkxDoNZ90C_zUfh-mcLGRAqyETpR76J5rYcXmiUHNSeTdzUlLyX_GlkjvJrDNIB_LcXFEXEXbL4YIW1Ztk17MFGvIShjUKAccUvpxeM8eeBjB9ehAARGytA1LCpkYper2iI7o_fPsRJLjlHtsIw0XxO2c Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a3ff02c01a64c9a940de444ca1197c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 43fd0499bc224bd8b190701a811ee204 Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance b074ba99-0598-4bba-990f-df73ab74a17a could not be found. Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'b074ba99-0598-4bba-990f-df73ab74a17a'} Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b074ba99-0598-4bba-990f-df73ab74a17a could not be found. Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:33:38.157379 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b074ba99-0598-4bba-990f-df73ab74a17a could not be found. Oct 24 10:33:38.161260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.161260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.161260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.161260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.161260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.161260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.161260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:38.161260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:38.161260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b074ba99-0598-4bba-990f-df73ab74a17a could not be found. Oct 24 10:33:38.161260 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.161260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8e6bacc0-7d05-4a63-9d35-90d9c5489d6b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Returning 404 to user: Instance b074ba99-0598-4bba-990f-df73ab74a17a could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:38.161260 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8e6bacc0-7d05-4a63-9d35-90d9c5489d6b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 404 len: 111 microversion: 2.1 time: 0.035742 Oct 24 10:33:38.161260 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1063/2217] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:33:38 2022] DELETE /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:33:38.167754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a83a18fb-d9cd-45d5-8f15-80799e176a80 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:38.168386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a83a18fb-d9cd-45d5-8f15-80799e176a80 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: b074ba99-0598-4bba-990f-df73ab74a17a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:38.174819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a83a18fb-d9cd-45d5-8f15-80799e176a80 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.175308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a83a18fb-d9cd-45d5-8f15-80799e176a80 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.176069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a83a18fb-d9cd-45d5-8f15-80799e176a80 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.176858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a83a18fb-d9cd-45d5-8f15-80799e176a80 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.177330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a83a18fb-d9cd-45d5-8f15-80799e176a80 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.177775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a83a18fb-d9cd-45d5-8f15-80799e176a80 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.192908 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-a83a18fb-d9cd-45d5-8f15-80799e176a80 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] HTTP exception thrown: Instance b074ba99-0598-4bba-990f-df73ab74a17a could not be found. Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a83a18fb-d9cd-45d5-8f15-80799e176a80 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Request method failure captured: Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a HTTP/1.1 Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmiA0DX_liToZ0pV228zL8tkxDoNZ90C_zUfh-mcLGRAqyETpR76J5rYcXmiUHNSeTdzUlLyX_GlkjvJrDNIB_LcXFEXEXbL4YIW1Ztk17MFGvIShjUKAccUvpxeM8eeBjB9ehAARGytA1LCpkYper2iI7o_fPsRJLjlHtsIw0XxO2c Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a3ff02c01a64c9a940de444ca1197c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 43fd0499bc224bd8b190701a811ee204 Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance b074ba99-0598-4bba-990f-df73ab74a17a could not be found. Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'b074ba99-0598-4bba-990f-df73ab74a17a'} Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b074ba99-0598-4bba-990f-df73ab74a17a could not be found. Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b074ba99-0598-4bba-990f-df73ab74a17a could not be found. Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.194980 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.201507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.201507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.201507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:38.201507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:38.201507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b074ba99-0598-4bba-990f-df73ab74a17a could not be found. Oct 24 10:33:38.201507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.201507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a83a18fb-d9cd-45d5-8f15-80799e176a80 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Returning 404 to user: Instance b074ba99-0598-4bba-990f-df73ab74a17a could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:38.201507 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a83a18fb-d9cd-45d5-8f15-80799e176a80 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a" status: 404 len: 111 microversion: 2.1 time: 0.032676 Oct 24 10:33:38.201507 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1155/2218] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:38 2022] GET /compute/v2.1/servers/b074ba99-0598-4bba-990f-df73ab74a17a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:33:38.206855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-83a7df74-dce4-4b99-88d9-3b10a1a1ab1f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d4e95700>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:38.243333 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-83a7df74-dce4-4b99-88d9-3b10a1a1ab1f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] HTTP exception thrown: Image not found. Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-83a7df74-dce4-4b99-88d9-3b10a1a1ab1f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Request method failure captured: Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a HTTP/1.1 Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmiA0DX_liToZ0pV228zL8tkxDoNZ90C_zUfh-mcLGRAqyETpR76J5rYcXmiUHNSeTdzUlLyX_GlkjvJrDNIB_LcXFEXEXbL4YIW1Ztk17MFGvIShjUKAccUvpxeM8eeBjB9ehAARGytA1LCpkYper2iI7o_fPsRJLjlHtsIw0XxO2c Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a3ff02c01a64c9a940de444ca1197c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 43fd0499bc224bd8b190701a811ee204 Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: exception: Image not found. Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'c57db0fe-20a9-44aa-909b-1fe7d0d0642a'} Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c57db0fe-20a9-44aa-909b-1fe7d0d0642a to delete Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c57db0fe-20a9-44aa-909b-1fe7d0d0642a could not be found. Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.245270 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-83a7df74-dce4-4b99-88d9-3b10a1a1ab1f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Returning 404 to user: Image not found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-83a7df74-dce4-4b99-88d9-3b10a1a1ab1f tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a" status: 404 len: 62 microversion: 2.1 time: 0.046654 Oct 24 10:33:38.249540 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1064/2219] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:38 2022] DELETE /compute/v2.1/images/c57db0fe-20a9-44aa-909b-1fe7d0d0642a => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:33:38.259040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-16f71149-9991-4978-9fac-cd5e0d392e2b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:38.259656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-16f71149-9991-4978-9fac-cd5e0d392e2b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: e09308b8-ad10-4557-bb53-7bdf515bbf36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:38.263508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:38.267909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16f71149-9991-4978-9fac-cd5e0d392e2b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.268561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16f71149-9991-4978-9fac-cd5e0d392e2b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.269091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16f71149-9991-4978-9fac-cd5e0d392e2b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.269898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16f71149-9991-4978-9fac-cd5e0d392e2b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.270461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16f71149-9991-4978-9fac-cd5e0d392e2b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.271131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16f71149-9991-4978-9fac-cd5e0d392e2b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.290468 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-16f71149-9991-4978-9fac-cd5e0d392e2b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] HTTP exception thrown: Instance e09308b8-ad10-4557-bb53-7bdf515bbf36 could not be found. Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-16f71149-9991-4978-9fac-cd5e0d392e2b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Request method failure captured: Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36 HTTP/1.1 Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmiA0DX_liToZ0pV228zL8tkxDoNZ90C_zUfh-mcLGRAqyETpR76J5rYcXmiUHNSeTdzUlLyX_GlkjvJrDNIB_LcXFEXEXbL4YIW1Ztk17MFGvIShjUKAccUvpxeM8eeBjB9ehAARGytA1LCpkYper2iI7o_fPsRJLjlHtsIw0XxO2c Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a3ff02c01a64c9a940de444ca1197c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 43fd0499bc224bd8b190701a811ee204 Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance e09308b8-ad10-4557-bb53-7bdf515bbf36 could not be found. Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'e09308b8-ad10-4557-bb53-7bdf515bbf36'} Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e09308b8-ad10-4557-bb53-7bdf515bbf36 could not be found. Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:33:38.292438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e09308b8-ad10-4557-bb53-7bdf515bbf36 could not be found. Oct 24 10:33:38.296321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.296321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.296321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.296321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.296321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.296321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.296321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:38.296321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:38.296321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e09308b8-ad10-4557-bb53-7bdf515bbf36 could not be found. Oct 24 10:33:38.296321 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.297841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-16f71149-9991-4978-9fac-cd5e0d392e2b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Returning 404 to user: Instance e09308b8-ad10-4557-bb53-7bdf515bbf36 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:38.299371 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-16f71149-9991-4978-9fac-cd5e0d392e2b tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36" status: 404 len: 111 microversion: 2.1 time: 0.046465 Oct 24 10:33:38.300227 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1156/2220] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:33:38 2022] DELETE /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:33:38.308802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b0cb9cae-e0cb-4d47-8755-1646cd42f01e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:38.309849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b0cb9cae-e0cb-4d47-8755-1646cd42f01e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: e09308b8-ad10-4557-bb53-7bdf515bbf36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:38.316779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0cb9cae-e0cb-4d47-8755-1646cd42f01e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.317302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0cb9cae-e0cb-4d47-8755-1646cd42f01e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.317777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0cb9cae-e0cb-4d47-8755-1646cd42f01e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.318430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0cb9cae-e0cb-4d47-8755-1646cd42f01e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.318954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0cb9cae-e0cb-4d47-8755-1646cd42f01e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.320139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0cb9cae-e0cb-4d47-8755-1646cd42f01e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.338212 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-b0cb9cae-e0cb-4d47-8755-1646cd42f01e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] HTTP exception thrown: Instance e09308b8-ad10-4557-bb53-7bdf515bbf36 could not be found. Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b0cb9cae-e0cb-4d47-8755-1646cd42f01e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Request method failure captured: Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36 HTTP/1.1 Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmiA0DX_liToZ0pV228zL8tkxDoNZ90C_zUfh-mcLGRAqyETpR76J5rYcXmiUHNSeTdzUlLyX_GlkjvJrDNIB_LcXFEXEXbL4YIW1Ztk17MFGvIShjUKAccUvpxeM8eeBjB9ehAARGytA1LCpkYper2iI7o_fPsRJLjlHtsIw0XxO2c Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a3ff02c01a64c9a940de444ca1197c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 43fd0499bc224bd8b190701a811ee204 Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance e09308b8-ad10-4557-bb53-7bdf515bbf36 could not be found. Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'e09308b8-ad10-4557-bb53-7bdf515bbf36'} Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e09308b8-ad10-4557-bb53-7bdf515bbf36 could not be found. Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e09308b8-ad10-4557-bb53-7bdf515bbf36 could not be found. Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.339838 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.344173 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.344173 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.344173 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:38.344173 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:38.344173 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e09308b8-ad10-4557-bb53-7bdf515bbf36 could not be found. Oct 24 10:33:38.344173 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.344173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b0cb9cae-e0cb-4d47-8755-1646cd42f01e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Returning 404 to user: Instance e09308b8-ad10-4557-bb53-7bdf515bbf36 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:38.344173 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b0cb9cae-e0cb-4d47-8755-1646cd42f01e tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36" status: 404 len: 111 microversion: 2.1 time: 0.036277 Oct 24 10:33:38.344173 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1065/2221] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:38 2022] GET /compute/v2.1/servers/e09308b8-ad10-4557-bb53-7bdf515bbf36 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:33:38.350049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1fed125c-1c34-43ab-9eed-a514c0a697f4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d06693a0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:38.380477 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-1fed125c-1c34-43ab-9eed-a514c0a697f4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] HTTP exception thrown: Image not found. Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1fed125c-1c34-43ab-9eed-a514c0a697f4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Request method failure captured: Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c HTTP/1.1 Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmiA0DX_liToZ0pV228zL8tkxDoNZ90C_zUfh-mcLGRAqyETpR76J5rYcXmiUHNSeTdzUlLyX_GlkjvJrDNIB_LcXFEXEXbL4YIW1Ztk17MFGvIShjUKAccUvpxeM8eeBjB9ehAARGytA1LCpkYper2iI7o_fPsRJLjlHtsIw0XxO2c Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a3ff02c01a64c9a940de444ca1197c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 43fd0499bc224bd8b190701a811ee204 Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: exception: Image not found. Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '1af4390b-42eb-4401-a132-08f9b75ca99c'} Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1af4390b-42eb-4401-a132-08f9b75ca99c to delete Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1af4390b-42eb-4401-a132-08f9b75ca99c could not be found. Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.383508 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1fed125c-1c34-43ab-9eed-a514c0a697f4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Returning 404 to user: Image not found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1fed125c-1c34-43ab-9eed-a514c0a697f4 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c" status: 404 len: 62 microversion: 2.1 time: 0.039816 Oct 24 10:33:38.387581 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1157/2222] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:38 2022] DELETE /compute/v2.1/images/1af4390b-42eb-4401-a132-08f9b75ca99c => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:33:38.396159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4ad71a75-d748-4f0b-8c0f-80722a61a8f0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:38.396814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4ad71a75-d748-4f0b-8c0f-80722a61a8f0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:38.403378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ad71a75-d748-4f0b-8c0f-80722a61a8f0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.404170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ad71a75-d748-4f0b-8c0f-80722a61a8f0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.404618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ad71a75-d748-4f0b-8c0f-80722a61a8f0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.405441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ad71a75-d748-4f0b-8c0f-80722a61a8f0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.406122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ad71a75-d748-4f0b-8c0f-80722a61a8f0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.406888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ad71a75-d748-4f0b-8c0f-80722a61a8f0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.428035 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-4ad71a75-d748-4f0b-8c0f-80722a61a8f0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] HTTP exception thrown: Instance 84a8b2f8-edd4-45a3-be5f-878bfc0f5811 could not be found. Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4ad71a75-d748-4f0b-8c0f-80722a61a8f0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Request method failure captured: Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 HTTP/1.1 Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmiA0DX_liToZ0pV228zL8tkxDoNZ90C_zUfh-mcLGRAqyETpR76J5rYcXmiUHNSeTdzUlLyX_GlkjvJrDNIB_LcXFEXEXbL4YIW1Ztk17MFGvIShjUKAccUvpxeM8eeBjB9ehAARGytA1LCpkYper2iI7o_fPsRJLjlHtsIw0XxO2c Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a3ff02c01a64c9a940de444ca1197c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 43fd0499bc224bd8b190701a811ee204 Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 84a8b2f8-edd4-45a3-be5f-878bfc0f5811 could not be found. Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '84a8b2f8-edd4-45a3-be5f-878bfc0f5811'} Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84a8b2f8-edd4-45a3-be5f-878bfc0f5811 could not be found. Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:33:38.432200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84a8b2f8-edd4-45a3-be5f-878bfc0f5811 could not be found. Oct 24 10:33:38.439855 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.439855 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.439855 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.439855 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.439855 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.439855 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.439855 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:38.439855 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:38.439855 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84a8b2f8-edd4-45a3-be5f-878bfc0f5811 could not be found. Oct 24 10:33:38.439855 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.440514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4ad71a75-d748-4f0b-8c0f-80722a61a8f0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Returning 404 to user: Instance 84a8b2f8-edd4-45a3-be5f-878bfc0f5811 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:38.441577 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4ad71a75-d748-4f0b-8c0f-80722a61a8f0 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 404 len: 111 microversion: 2.1 time: 0.049879 Oct 24 10:33:38.442296 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1066/2223] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:33:38 2022] DELETE /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:33:38.453246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e3d7af6-c0fb-4dd0-a28f-80f9da7864fe tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:38.454385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3e3d7af6-c0fb-4dd0-a28f-80f9da7864fe tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: 84a8b2f8-edd4-45a3-be5f-878bfc0f5811] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:38.468357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e3d7af6-c0fb-4dd0-a28f-80f9da7864fe tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.469365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e3d7af6-c0fb-4dd0-a28f-80f9da7864fe tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.470689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e3d7af6-c0fb-4dd0-a28f-80f9da7864fe tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.471692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e3d7af6-c0fb-4dd0-a28f-80f9da7864fe tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.472590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e3d7af6-c0fb-4dd0-a28f-80f9da7864fe tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.473376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e3d7af6-c0fb-4dd0-a28f-80f9da7864fe tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.498139 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-3e3d7af6-c0fb-4dd0-a28f-80f9da7864fe tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] HTTP exception thrown: Instance 84a8b2f8-edd4-45a3-be5f-878bfc0f5811 could not be found. Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e3d7af6-c0fb-4dd0-a28f-80f9da7864fe tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Request method failure captured: Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 HTTP/1.1 Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmiA0DX_liToZ0pV228zL8tkxDoNZ90C_zUfh-mcLGRAqyETpR76J5rYcXmiUHNSeTdzUlLyX_GlkjvJrDNIB_LcXFEXEXbL4YIW1Ztk17MFGvIShjUKAccUvpxeM8eeBjB9ehAARGytA1LCpkYper2iI7o_fPsRJLjlHtsIw0XxO2c Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a3ff02c01a64c9a940de444ca1197c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 43fd0499bc224bd8b190701a811ee204 Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 84a8b2f8-edd4-45a3-be5f-878bfc0f5811 could not be found. Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '84a8b2f8-edd4-45a3-be5f-878bfc0f5811'} Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84a8b2f8-edd4-45a3-be5f-878bfc0f5811 could not be found. Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84a8b2f8-edd4-45a3-be5f-878bfc0f5811 could not be found. Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.501583 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.505333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.505333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.505333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:38.505333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:38.505333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84a8b2f8-edd4-45a3-be5f-878bfc0f5811 could not be found. Oct 24 10:33:38.505333 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.507710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e3d7af6-c0fb-4dd0-a28f-80f9da7864fe tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Returning 404 to user: Instance 84a8b2f8-edd4-45a3-be5f-878bfc0f5811 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:38.512029 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3e3d7af6-c0fb-4dd0-a28f-80f9da7864fe tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811" status: 404 len: 111 microversion: 2.1 time: 0.063617 Oct 24 10:33:38.513476 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1158/2224] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:38 2022] GET /compute/v2.1/servers/84a8b2f8-edd4-45a3-be5f-878bfc0f5811 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:33:38.522033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a3c5de8-b972-4ff6-8240-9b0c3ec136c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d4e8d430>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:38.551451 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-0a3c5de8-b972-4ff6-8240-9b0c3ec136c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] HTTP exception thrown: Image not found. Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a3c5de8-b972-4ff6-8240-9b0c3ec136c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Request method failure captured: Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 HTTP/1.1 Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmiA0DX_liToZ0pV228zL8tkxDoNZ90C_zUfh-mcLGRAqyETpR76J5rYcXmiUHNSeTdzUlLyX_GlkjvJrDNIB_LcXFEXEXbL4YIW1Ztk17MFGvIShjUKAccUvpxeM8eeBjB9ehAARGytA1LCpkYper2iI7o_fPsRJLjlHtsIw0XxO2c Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a3ff02c01a64c9a940de444ca1197c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 43fd0499bc224bd8b190701a811ee204 Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: exception: Image not found. Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '01974b63-c35f-43cf-b54d-390257ed04a6'} Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 01974b63-c35f-43cf-b54d-390257ed04a6 to delete Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 01974b63-c35f-43cf-b54d-390257ed04a6 could not be found. Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.553465 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a3c5de8-b972-4ff6-8240-9b0c3ec136c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Returning 404 to user: Image not found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0a3c5de8-b972-4ff6-8240-9b0c3ec136c3 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6" status: 404 len: 62 microversion: 2.1 time: 0.037525 Oct 24 10:33:38.567953 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1067/2225] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:38 2022] DELETE /compute/v2.1/images/01974b63-c35f-43cf-b54d-390257ed04a6 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:33:38.571972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a6fe4bfe-371d-4758-877b-8bb0d6421ab6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:38.571972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a6fe4bfe-371d-4758-877b-8bb0d6421ab6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:38.574897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6fe4bfe-371d-4758-877b-8bb0d6421ab6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.575938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6fe4bfe-371d-4758-877b-8bb0d6421ab6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.576920 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6fe4bfe-371d-4758-877b-8bb0d6421ab6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.577829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6fe4bfe-371d-4758-877b-8bb0d6421ab6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.578430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6fe4bfe-371d-4758-877b-8bb0d6421ab6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.579055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6fe4bfe-371d-4758-877b-8bb0d6421ab6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.597197 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-a6fe4bfe-371d-4758-877b-8bb0d6421ab6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] HTTP exception thrown: Instance a43af20e-f775-4549-9ee3-1560a5b43b7d could not be found. Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a6fe4bfe-371d-4758-877b-8bb0d6421ab6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Request method failure captured: Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d HTTP/1.1 Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmiA0DX_liToZ0pV228zL8tkxDoNZ90C_zUfh-mcLGRAqyETpR76J5rYcXmiUHNSeTdzUlLyX_GlkjvJrDNIB_LcXFEXEXbL4YIW1Ztk17MFGvIShjUKAccUvpxeM8eeBjB9ehAARGytA1LCpkYper2iI7o_fPsRJLjlHtsIw0XxO2c Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a3ff02c01a64c9a940de444ca1197c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 43fd0499bc224bd8b190701a811ee204 Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance a43af20e-f775-4549-9ee3-1560a5b43b7d could not be found. Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'a43af20e-f775-4549-9ee3-1560a5b43b7d'} Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a43af20e-f775-4549-9ee3-1560a5b43b7d could not be found. Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:33:38.599171 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a43af20e-f775-4549-9ee3-1560a5b43b7d could not be found. Oct 24 10:33:38.603295 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.603295 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.603295 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.603295 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.603295 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.603295 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.603295 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:38.603295 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:38.603295 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a43af20e-f775-4549-9ee3-1560a5b43b7d could not be found. Oct 24 10:33:38.603295 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.603295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a6fe4bfe-371d-4758-877b-8bb0d6421ab6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Returning 404 to user: Instance a43af20e-f775-4549-9ee3-1560a5b43b7d could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:38.603295 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a6fe4bfe-371d-4758-877b-8bb0d6421ab6 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 404 len: 111 microversion: 2.1 time: 0.040928 Oct 24 10:33:38.603295 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1159/2226] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:33:38 2022] DELETE /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:33:38.613339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4d8124bc-e2bf-49a9-83c5-deb73e593fd1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:38.614090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4d8124bc-e2bf-49a9-83c5-deb73e593fd1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: a43af20e-f775-4549-9ee3-1560a5b43b7d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:38.625809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d8124bc-e2bf-49a9-83c5-deb73e593fd1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.626538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d8124bc-e2bf-49a9-83c5-deb73e593fd1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.628028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d8124bc-e2bf-49a9-83c5-deb73e593fd1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.628882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d8124bc-e2bf-49a9-83c5-deb73e593fd1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.630366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d8124bc-e2bf-49a9-83c5-deb73e593fd1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.631368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d8124bc-e2bf-49a9-83c5-deb73e593fd1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.659583 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-4d8124bc-e2bf-49a9-83c5-deb73e593fd1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] HTTP exception thrown: Instance a43af20e-f775-4549-9ee3-1560a5b43b7d could not be found. Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4d8124bc-e2bf-49a9-83c5-deb73e593fd1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Request method failure captured: Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d HTTP/1.1 Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmiA0DX_liToZ0pV228zL8tkxDoNZ90C_zUfh-mcLGRAqyETpR76J5rYcXmiUHNSeTdzUlLyX_GlkjvJrDNIB_LcXFEXEXbL4YIW1Ztk17MFGvIShjUKAccUvpxeM8eeBjB9ehAARGytA1LCpkYper2iI7o_fPsRJLjlHtsIw0XxO2c Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a3ff02c01a64c9a940de444ca1197c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 43fd0499bc224bd8b190701a811ee204 Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance a43af20e-f775-4549-9ee3-1560a5b43b7d could not be found. Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'a43af20e-f775-4549-9ee3-1560a5b43b7d'} Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a43af20e-f775-4549-9ee3-1560a5b43b7d could not be found. Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a43af20e-f775-4549-9ee3-1560a5b43b7d could not be found. Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.661657 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.667406 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.667406 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.667406 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:38.667406 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:38.667406 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a43af20e-f775-4549-9ee3-1560a5b43b7d could not be found. Oct 24 10:33:38.667406 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.670484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4eb3f444-e4de-4a05-bb56-b2ad62a34a90 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:38.670484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4eb3f444-e4de-4a05-bb56-b2ad62a34a90 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:38.671137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4d8124bc-e2bf-49a9-83c5-deb73e593fd1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Returning 404 to user: Instance a43af20e-f775-4549-9ee3-1560a5b43b7d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:38.671712 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4d8124bc-e2bf-49a9-83c5-deb73e593fd1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d" status: 404 len: 111 microversion: 2.1 time: 0.063389 Oct 24 10:33:38.673455 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1068/2227] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:38 2022] GET /compute/v2.1/servers/a43af20e-f775-4549-9ee3-1560a5b43b7d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:33:38.682152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4eb3f444-e4de-4a05-bb56-b2ad62a34a90 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.682898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4eb3f444-e4de-4a05-bb56-b2ad62a34a90 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.683973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9a714a03-b264-46b4-adc8-5ec19313c756 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '.version_select at 0x7f04d4e95f70>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:38.684959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4eb3f444-e4de-4a05-bb56-b2ad62a34a90 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.685944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4eb3f444-e4de-4a05-bb56-b2ad62a34a90 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.687006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4eb3f444-e4de-4a05-bb56-b2ad62a34a90 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.687699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4eb3f444-e4de-4a05-bb56-b2ad62a34a90 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.710939 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-9a714a03-b264-46b4-adc8-5ec19313c756 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] HTTP exception thrown: Image not found. Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9a714a03-b264-46b4-adc8-5ec19313c756 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Request method failure captured: Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 HTTP/1.1 Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmiA0DX_liToZ0pV228zL8tkxDoNZ90C_zUfh-mcLGRAqyETpR76J5rYcXmiUHNSeTdzUlLyX_GlkjvJrDNIB_LcXFEXEXbL4YIW1Ztk17MFGvIShjUKAccUvpxeM8eeBjB9ehAARGytA1LCpkYper2iI7o_fPsRJLjlHtsIw0XxO2c Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a3ff02c01a64c9a940de444ca1197c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 43fd0499bc224bd8b190701a811ee204 Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: exception: Image not found. Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '9c8e4b33-5daa-4ab5-8761-047d303ccd69'} Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9c8e4b33-5daa-4ab5-8761-047d303ccd69 to delete Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9c8e4b33-5daa-4ab5-8761-047d303ccd69 could not be found. Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.713467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.717574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9a714a03-b264-46b4-adc8-5ec19313c756 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Returning 404 to user: Image not found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:38.720206 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9a714a03-b264-46b4-adc8-5ec19313c756 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69" status: 404 len: 62 microversion: 2.1 time: 0.042716 Oct 24 10:33:38.723635 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1069/2228] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:38 2022] DELETE /compute/v2.1/images/9c8e4b33-5daa-4ab5-8761-047d303ccd69 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:33:38.732461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a2cf292e-4686-4c1d-963a-b948badf5b64 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:38.733062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a2cf292e-4686-4c1d-963a-b948badf5b64 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: c828266b-d510-4a99-9b08-476e19b057a7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:38.739362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2cf292e-4686-4c1d-963a-b948badf5b64 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.740034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2cf292e-4686-4c1d-963a-b948badf5b64 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.740476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2cf292e-4686-4c1d-963a-b948badf5b64 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.741943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2cf292e-4686-4c1d-963a-b948badf5b64 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.742605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2cf292e-4686-4c1d-963a-b948badf5b64 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.743040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2cf292e-4686-4c1d-963a-b948badf5b64 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.757744 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-a2cf292e-4686-4c1d-963a-b948badf5b64 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] HTTP exception thrown: Instance c828266b-d510-4a99-9b08-476e19b057a7 could not be found. Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a2cf292e-4686-4c1d-963a-b948badf5b64 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Request method failure captured: Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7 HTTP/1.1 Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmiA0DX_liToZ0pV228zL8tkxDoNZ90C_zUfh-mcLGRAqyETpR76J5rYcXmiUHNSeTdzUlLyX_GlkjvJrDNIB_LcXFEXEXbL4YIW1Ztk17MFGvIShjUKAccUvpxeM8eeBjB9ehAARGytA1LCpkYper2iI7o_fPsRJLjlHtsIw0XxO2c Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a3ff02c01a64c9a940de444ca1197c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 43fd0499bc224bd8b190701a811ee204 Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance c828266b-d510-4a99-9b08-476e19b057a7 could not be found. Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'c828266b-d510-4a99-9b08-476e19b057a7'} Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c828266b-d510-4a99-9b08-476e19b057a7 could not be found. Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:33:38.759618 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c828266b-d510-4a99-9b08-476e19b057a7 could not be found. Oct 24 10:33:38.763517 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.763517 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.763517 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.763517 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.763517 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.763517 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.763517 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:38.763517 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:38.763517 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c828266b-d510-4a99-9b08-476e19b057a7 could not be found. Oct 24 10:33:38.763517 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.763517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a2cf292e-4686-4c1d-963a-b948badf5b64 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Returning 404 to user: Instance c828266b-d510-4a99-9b08-476e19b057a7 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:38.763517 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a2cf292e-4686-4c1d-963a-b948badf5b64 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7" status: 404 len: 111 microversion: 2.1 time: 0.036528 Oct 24 10:33:38.764935 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1070/2229] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:33:38 2022] DELETE /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:33:38.769430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c758a675-a146-4063-a0e8-c5e2be1f83a1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:38.770037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c758a675-a146-4063-a0e8-c5e2be1f83a1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] [instance: c828266b-d510-4a99-9b08-476e19b057a7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:38.776240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c758a675-a146-4063-a0e8-c5e2be1f83a1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.776724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c758a675-a146-4063-a0e8-c5e2be1f83a1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.777190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c758a675-a146-4063-a0e8-c5e2be1f83a1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.777884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c758a675-a146-4063-a0e8-c5e2be1f83a1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.778498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c758a675-a146-4063-a0e8-c5e2be1f83a1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.779189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c758a675-a146-4063-a0e8-c5e2be1f83a1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.793796 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-c758a675-a146-4063-a0e8-c5e2be1f83a1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] HTTP exception thrown: Instance c828266b-d510-4a99-9b08-476e19b057a7 could not be found. Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c758a675-a146-4063-a0e8-c5e2be1f83a1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Request method failure captured: Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7 HTTP/1.1 Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmiA0DX_liToZ0pV228zL8tkxDoNZ90C_zUfh-mcLGRAqyETpR76J5rYcXmiUHNSeTdzUlLyX_GlkjvJrDNIB_LcXFEXEXbL4YIW1Ztk17MFGvIShjUKAccUvpxeM8eeBjB9ehAARGytA1LCpkYper2iI7o_fPsRJLjlHtsIw0XxO2c Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a3ff02c01a64c9a940de444ca1197c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a3ff02c01a64c9a940de444ca1197c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 8a3ff02c01a64c9a940de444ca1197c4 Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesTestJSON-1224223089 Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 43fd0499bc224bd8b190701a811ee204 Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesTestJSON-1224223089-project Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance c828266b-d510-4a99-9b08-476e19b057a7 could not be found. Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'c828266b-d510-4a99-9b08-476e19b057a7'} Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c828266b-d510-4a99-9b08-476e19b057a7 could not be found. Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c828266b-d510-4a99-9b08-476e19b057a7 could not be found. Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.795344 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:38.798784 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:38.798784 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:38.798784 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:38.798784 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:38.798784 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c828266b-d510-4a99-9b08-476e19b057a7 could not be found. Oct 24 10:33:38.798784 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:38.798784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c758a675-a146-4063-a0e8-c5e2be1f83a1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] Returning 404 to user: Instance c828266b-d510-4a99-9b08-476e19b057a7 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:38.798784 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c758a675-a146-4063-a0e8-c5e2be1f83a1 tempest-ImagesTestJSON-1224223089 tempest-ImagesTestJSON-1224223089-project] 10.222.0.50 "GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7" status: 404 len: 111 microversion: 2.1 time: 0.030976 Oct 24 10:33:38.798784 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1071/2230] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:38 2022] GET /compute/v2.1/servers/c828266b-d510-4a99-9b08-476e19b057a7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:33:38.893289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-779621b3-f5b3-478f-9ec2-085afffb5741 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:38.894298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-779621b3-f5b3-478f-9ec2-085afffb5741 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:38.901015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-779621b3-f5b3-478f-9ec2-085afffb5741 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.901667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4eb3f444-e4de-4a05-bb56-b2ad62a34a90 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:38.901818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-779621b3-f5b3-478f-9ec2-085afffb5741 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.902245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-779621b3-f5b3-478f-9ec2-085afffb5741 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.902945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-779621b3-f5b3-478f-9ec2-085afffb5741 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.903423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-779621b3-f5b3-478f-9ec2-085afffb5741 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.903814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-779621b3-f5b3-478f-9ec2-085afffb5741 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.915140 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4eb3f444-e4de-4a05-bb56-b2ad62a34a90 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.266153 Oct 24 10:33:38.916506 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1160/2231] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:38 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:38.952828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e3d90272-f765-4b08-be77-1ac3eaf11718 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:38.953741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e3d90272-f765-4b08-be77-1ac3eaf11718 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:38.976987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3d90272-f765-4b08-be77-1ac3eaf11718 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.979089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3d90272-f765-4b08-be77-1ac3eaf11718 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.979615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3d90272-f765-4b08-be77-1ac3eaf11718 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:38.980696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3d90272-f765-4b08-be77-1ac3eaf11718 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:38.983898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3d90272-f765-4b08-be77-1ac3eaf11718 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:38.985003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3d90272-f765-4b08-be77-1ac3eaf11718 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:39.151281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-779621b3-f5b3-478f-9ec2-085afffb5741 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096bc5b57afb4eb6866c3952c65276dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75bae6df8f0a4f808e29edb3ddc33cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:39.165152 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-779621b3-f5b3-478f-9ec2-085afffb5741 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] 10.222.0.50 "GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f" status: 200 len: 1322 microversion: 2.1 time: 0.275305 Oct 24 10:33:39.165767 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1072/2232] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:38 2022] GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:33:39.348640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e3d90272-f765-4b08-be77-1ac3eaf11718 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:39.362126 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e3d90272-f765-4b08-be77-1ac3eaf11718 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.423053 Oct 24 10:33:39.369195 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1161/2233] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:38 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:39.392026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c1cfb72d-9432-4472-813b-f9283aec8ba7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:39.392947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c1cfb72d-9432-4472-813b-f9283aec8ba7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:39.401561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1cfb72d-9432-4472-813b-f9283aec8ba7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:39.402391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1cfb72d-9432-4472-813b-f9283aec8ba7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:39.402937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1cfb72d-9432-4472-813b-f9283aec8ba7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:39.404412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1cfb72d-9432-4472-813b-f9283aec8ba7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:39.405285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1cfb72d-9432-4472-813b-f9283aec8ba7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:39.406315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1cfb72d-9432-4472-813b-f9283aec8ba7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:39.579106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c1cfb72d-9432-4472-813b-f9283aec8ba7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:39.592298 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c1cfb72d-9432-4472-813b-f9283aec8ba7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.208970 Oct 24 10:33:39.594833 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1073/2234] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:39 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:39.619672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b4fd5a10-755f-4102-b1d5-eaf9b11394c3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-213638116"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:39.622754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b4fd5a10-755f-4102-b1d5-eaf9b11394c3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:39.629759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4fd5a10-755f-4102-b1d5-eaf9b11394c3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:39.630374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4fd5a10-755f-4102-b1d5-eaf9b11394c3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:39.630931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4fd5a10-755f-4102-b1d5-eaf9b11394c3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:39.632420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4fd5a10-755f-4102-b1d5-eaf9b11394c3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:39.633017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4fd5a10-755f-4102-b1d5-eaf9b11394c3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:39.633583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4fd5a10-755f-4102-b1d5-eaf9b11394c3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:39.871948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:39.917407 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b4fd5a10-755f-4102-b1d5-eaf9b11394c3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 202 len: 0 microversion: 2.1 time: 0.302301 Oct 24 10:33:39.921364 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1162/2235] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:33:39 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 24 10:33:40.191116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fa157730-3efa-4fab-9092-8e70b6b2228f tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:40.192606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fa157730-3efa-4fab-9092-8e70b6b2228f tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:40.203186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa157730-3efa-4fab-9092-8e70b6b2228f tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:40.203835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa157730-3efa-4fab-9092-8e70b6b2228f tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:40.204455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa157730-3efa-4fab-9092-8e70b6b2228f tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:40.205199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa157730-3efa-4fab-9092-8e70b6b2228f tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:40.214637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa157730-3efa-4fab-9092-8e70b6b2228f tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:40.215113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa157730-3efa-4fab-9092-8e70b6b2228f tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:40.483916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fa157730-3efa-4fab-9092-8e70b6b2228f tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096bc5b57afb4eb6866c3952c65276dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75bae6df8f0a4f808e29edb3ddc33cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:40.493262 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fa157730-3efa-4fab-9092-8e70b6b2228f tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] 10.222.0.50 "GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f" status: 200 len: 1322 microversion: 2.1 time: 0.308104 Oct 24 10:33:40.493771 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1074/2236] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:40 2022] GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:33:40.632433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-e62dab0c-110a-4621-ba24-0d63032ffb15 req-c811cf4b-5ee8-4d31-819c-740bc4e6e053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31fa9f50-887f-4cbd-b569-7b8bc66bbb4f", "name": "network-vif-plugged", "status": "completed", "tag": "5fce5553-24ad-4ae4-874a-baf819eb9300"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:40.650221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:40.656500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=8 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:40.665512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e62dab0c-110a-4621-ba24-0d63032ffb15 req-c811cf4b-5ee8-4d31-819c-740bc4e6e053 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:40.666000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e62dab0c-110a-4621-ba24-0d63032ffb15 req-c811cf4b-5ee8-4d31-819c-740bc4e6e053 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:40.666471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e62dab0c-110a-4621-ba24-0d63032ffb15 req-c811cf4b-5ee8-4d31-819c-740bc4e6e053 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:40.690924 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-e62dab0c-110a-4621-ba24-0d63032ffb15 req-c811cf4b-5ee8-4d31-819c-740bc4e6e053 service nova] Creating event network-vif-plugged:5fce5553-24ad-4ae4-874a-baf819eb9300 for instance 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f on n-h2-858383-15 Oct 24 10:33:40.708321 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-e62dab0c-110a-4621-ba24-0d63032ffb15 req-c811cf4b-5ee8-4d31-819c-740bc4e6e053 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080391 Oct 24 10:33:40.709256 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1163/2237] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:33:41.520632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f1d6b5f9-40c1-43e9-b29d-26fd3e826403 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:41.521823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f1d6b5f9-40c1-43e9-b29d-26fd3e826403 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:41.542413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1d6b5f9-40c1-43e9-b29d-26fd3e826403 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:41.543398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1d6b5f9-40c1-43e9-b29d-26fd3e826403 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:41.560403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1d6b5f9-40c1-43e9-b29d-26fd3e826403 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:41.563688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1d6b5f9-40c1-43e9-b29d-26fd3e826403 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:41.565992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1d6b5f9-40c1-43e9-b29d-26fd3e826403 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:41.571438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f1d6b5f9-40c1-43e9-b29d-26fd3e826403 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:41.892549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f1d6b5f9-40c1-43e9-b29d-26fd3e826403 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096bc5b57afb4eb6866c3952c65276dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75bae6df8f0a4f808e29edb3ddc33cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:41.904254 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f1d6b5f9-40c1-43e9-b29d-26fd3e826403 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] 10.222.0.50 "GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f" status: 200 len: 1322 microversion: 2.1 time: 0.388682 Oct 24 10:33:41.906848 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1075/2238] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:41 2022] GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:42.935005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3dd5e2e-7aef-459a-b945-43de16f5237e tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:42.935733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f3dd5e2e-7aef-459a-b945-43de16f5237e tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:42.943744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3dd5e2e-7aef-459a-b945-43de16f5237e tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:42.944685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3dd5e2e-7aef-459a-b945-43de16f5237e tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:42.945165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3dd5e2e-7aef-459a-b945-43de16f5237e tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:42.945950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3dd5e2e-7aef-459a-b945-43de16f5237e tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:42.946412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3dd5e2e-7aef-459a-b945-43de16f5237e tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:42.946897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3dd5e2e-7aef-459a-b945-43de16f5237e tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:43.255790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3dd5e2e-7aef-459a-b945-43de16f5237e tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096bc5b57afb4eb6866c3952c65276dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75bae6df8f0a4f808e29edb3ddc33cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:43.265599 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f3dd5e2e-7aef-459a-b945-43de16f5237e tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] 10.222.0.50 "GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f" status: 200 len: 1472 microversion: 2.1 time: 0.335341 Oct 24 10:33:43.269929 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1164/2239] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:42 2022] GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f => generated 1472 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:43.298682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-190a3438-0bac-4916-9e94-14cfc243eaa4 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:43.299727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-190a3438-0bac-4916-9e94-14cfc243eaa4 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:43.312956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-190a3438-0bac-4916-9e94-14cfc243eaa4 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:43.315715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-190a3438-0bac-4916-9e94-14cfc243eaa4 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:43.317358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-190a3438-0bac-4916-9e94-14cfc243eaa4 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:43.318269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-190a3438-0bac-4916-9e94-14cfc243eaa4 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:43.326467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-190a3438-0bac-4916-9e94-14cfc243eaa4 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:43.327187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-190a3438-0bac-4916-9e94-14cfc243eaa4 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:43.363562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-190a3438-0bac-4916-9e94-14cfc243eaa4 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '096bc5b57afb4eb6866c3952c65276dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75bae6df8f0a4f808e29edb3ddc33cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-190a3438-0bac-4916-9e94-14cfc243eaa4 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Request method failure captured: Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f/diagnostics HTTP/1.1 Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmn4lcoLYC861TvX1DkwhcR9U0GVBHpskUthdKVRnwp9HjyF7mbQvYQyUtDatAGFiFD3DLoeAuWQlluMV1_RIrkC8AIwoGBn0oOhcTot1mOtkkEpzOMzj1SY56n58sbPxFrD0gH3qUk9lfi03_zmLHfJHCKqyOY3saFpAPYceoMOBFw Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 75bae6df8f0a4f808e29edb3ddc33cb3 Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1627036112 Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75bae6df8f0a4f808e29edb3ddc33cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75bae6df8f0a4f808e29edb3ddc33cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75bae6df8f0a4f808e29edb3ddc33cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75bae6df8f0a4f808e29edb3ddc33cb3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1627036112 Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 75bae6df8f0a4f808e29edb3ddc33cb3 Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1627036112 Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerDiagnosticsNegativeTest-1627036112-project Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 096bc5b57afb4eb6866c3952c65276dc Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1627036112-project Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'server_id': '31fa9f50-887f-4cbd-b569-7b8bc66bbb4f'} Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:43.374968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:43.380468 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:43.380468 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:43.380468 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:33:43.380468 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:33:43.380468 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 24 10:33:43.380468 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:43.380468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-190a3438-0bac-4916-9e94-14cfc243eaa4 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:43.380468 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-190a3438-0bac-4916-9e94-14cfc243eaa4 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] 10.222.0.50 "GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.082185 Oct 24 10:33:43.387436 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1076/2240] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:33:43 2022] GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f/diagnostics => generated 117 bytes in 93 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:33:43.387737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-af884eab-fd46-42ab-9861-3ef98e1f0a43 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:43.388371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-af884eab-fd46-42ab-9861-3ef98e1f0a43 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:43.409268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af884eab-fd46-42ab-9861-3ef98e1f0a43 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:43.409804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af884eab-fd46-42ab-9861-3ef98e1f0a43 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:43.412466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af884eab-fd46-42ab-9861-3ef98e1f0a43 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:43.416222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af884eab-fd46-42ab-9861-3ef98e1f0a43 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:43.418117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af884eab-fd46-42ab-9861-3ef98e1f0a43 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:43.418620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af884eab-fd46-42ab-9861-3ef98e1f0a43 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:43.485689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-af884eab-fd46-42ab-9861-3ef98e1f0a43 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:33:43.675021 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-af884eab-fd46-42ab-9861-3ef98e1f0a43 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] 10.222.0.50 "DELETE /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f" status: 204 len: 0 microversion: 2.1 time: 0.291969 Oct 24 10:33:43.677783 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1165/2241] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:33:43 2022] DELETE /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:33:43.688630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d65e5bf8-b82f-46d8-9c19-845521b6180c tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:43.689644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d65e5bf8-b82f-46d8-9c19-845521b6180c tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:43.699601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d65e5bf8-b82f-46d8-9c19-845521b6180c tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:43.700466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d65e5bf8-b82f-46d8-9c19-845521b6180c tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:43.701178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d65e5bf8-b82f-46d8-9c19-845521b6180c tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:43.702420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d65e5bf8-b82f-46d8-9c19-845521b6180c tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:43.704482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d65e5bf8-b82f-46d8-9c19-845521b6180c tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:43.705785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d65e5bf8-b82f-46d8-9c19-845521b6180c tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:43.864702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-53ae5eaf-2235-4321-a128-29b1ea51a3da tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:43.883523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-53ae5eaf-2235-4321-a128-29b1ea51a3da tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:43.892727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53ae5eaf-2235-4321-a128-29b1ea51a3da tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:43.894596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53ae5eaf-2235-4321-a128-29b1ea51a3da tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:43.895082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53ae5eaf-2235-4321-a128-29b1ea51a3da tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:43.899729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53ae5eaf-2235-4321-a128-29b1ea51a3da tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:43.900209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53ae5eaf-2235-4321-a128-29b1ea51a3da tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:43.900648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53ae5eaf-2235-4321-a128-29b1ea51a3da tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:43.973689 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-53ae5eaf-2235-4321-a128-29b1ea51a3da tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110639 Oct 24 10:33:43.974980 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1166/2242] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:33:43 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:33:43.986757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-09055a79-85a5-4cb3-b758-9c41f36b9eb7 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:43.987490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-09055a79-85a5-4cb3-b758-9c41f36b9eb7 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:44.001008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09055a79-85a5-4cb3-b758-9c41f36b9eb7 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:44.001774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09055a79-85a5-4cb3-b758-9c41f36b9eb7 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:44.002380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09055a79-85a5-4cb3-b758-9c41f36b9eb7 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:44.003262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09055a79-85a5-4cb3-b758-9c41f36b9eb7 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:44.006345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09055a79-85a5-4cb3-b758-9c41f36b9eb7 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:44.007076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09055a79-85a5-4cb3-b758-9c41f36b9eb7 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:44.049096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d65e5bf8-b82f-46d8-9c19-845521b6180c tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096bc5b57afb4eb6866c3952c65276dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75bae6df8f0a4f808e29edb3ddc33cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:44.058472 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d65e5bf8-b82f-46d8-9c19-845521b6180c tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] 10.222.0.50 "GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f" status: 200 len: 1478 microversion: 2.1 time: 0.375445 Oct 24 10:33:44.074342 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1077/2243] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:43 2022] GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f => generated 1478 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:44.195206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-09055a79-85a5-4cb3-b758-9c41f36b9eb7 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lazy-loading 'services' on Instance uuid f7cf3710-4f48-4dca-9dc7-076994a09380 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:33:44.352525 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-09055a79-85a5-4cb3-b758-9c41f36b9eb7 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380/os-volume_attachments/b751d081-420e-4cf3-8405-269d3be47203" status: 202 len: 0 microversion: 2.1 time: 0.369547 Oct 24 10:33:44.354773 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1167/2244] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 10:33:43 2022] DELETE /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380/os-volume_attachments/b751d081-420e-4cf3-8405-269d3be47203 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:33:45.082565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-21dfaf40-e18e-4fc3-9eea-38a8711813f5 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:45.083177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-21dfaf40-e18e-4fc3-9eea-38a8711813f5 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:45.112540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21dfaf40-e18e-4fc3-9eea-38a8711813f5 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:45.113450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21dfaf40-e18e-4fc3-9eea-38a8711813f5 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:45.114080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21dfaf40-e18e-4fc3-9eea-38a8711813f5 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:45.143618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21dfaf40-e18e-4fc3-9eea-38a8711813f5 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:45.144326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21dfaf40-e18e-4fc3-9eea-38a8711813f5 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:45.145174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21dfaf40-e18e-4fc3-9eea-38a8711813f5 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:45.379304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-21dfaf40-e18e-4fc3-9eea-38a8711813f5 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096bc5b57afb4eb6866c3952c65276dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75bae6df8f0a4f808e29edb3ddc33cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:45.393083 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-21dfaf40-e18e-4fc3-9eea-38a8711813f5 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] 10.222.0.50 "GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f" status: 200 len: 1478 microversion: 2.1 time: 0.314335 Oct 24 10:33:45.400914 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1078/2245] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:45 2022] GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f => generated 1478 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:46.419516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4bea6f4d-c3f0-4d41-8f30-3487db290ec3 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:46.420231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4bea6f4d-c3f0-4d41-8f30-3487db290ec3 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:46.443850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bea6f4d-c3f0-4d41-8f30-3487db290ec3 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:46.444365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bea6f4d-c3f0-4d41-8f30-3487db290ec3 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:46.444812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bea6f4d-c3f0-4d41-8f30-3487db290ec3 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:46.445591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bea6f4d-c3f0-4d41-8f30-3487db290ec3 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:46.446055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bea6f4d-c3f0-4d41-8f30-3487db290ec3 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:46.446479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bea6f4d-c3f0-4d41-8f30-3487db290ec3 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:46.492693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-06953773-da3d-49de-beaf-ecdcf2bce3b3 req-7ea4ed74-14b9-4e04-a840-f9423a77618b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31fa9f50-887f-4cbd-b569-7b8bc66bbb4f", "name": "network-vif-deleted", "tag": "5fce5553-24ad-4ae4-874a-baf819eb9300"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:46.527121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-06953773-da3d-49de-beaf-ecdcf2bce3b3 req-7ea4ed74-14b9-4e04-a840-f9423a77618b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:46.527607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-06953773-da3d-49de-beaf-ecdcf2bce3b3 req-7ea4ed74-14b9-4e04-a840-f9423a77618b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:46.528038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-06953773-da3d-49de-beaf-ecdcf2bce3b3 req-7ea4ed74-14b9-4e04-a840-f9423a77618b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:46.558580 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-06953773-da3d-49de-beaf-ecdcf2bce3b3 req-7ea4ed74-14b9-4e04-a840-f9423a77618b service nova] Creating event network-vif-deleted:5fce5553-24ad-4ae4-874a-baf819eb9300 for instance 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f on n-h2-858383-15 Oct 24 10:33:46.578600 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-06953773-da3d-49de-beaf-ecdcf2bce3b3 req-7ea4ed74-14b9-4e04-a840-f9423a77618b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090172 Oct 24 10:33:46.585193 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1079/2246] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:33:46.659226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4bea6f4d-c3f0-4d41-8f30-3487db290ec3 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096bc5b57afb4eb6866c3952c65276dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75bae6df8f0a4f808e29edb3ddc33cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:46.674701 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4bea6f4d-c3f0-4d41-8f30-3487db290ec3 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] 10.222.0.50 "GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f" status: 200 len: 1436 microversion: 2.1 time: 0.254507 Oct 24 10:33:46.676110 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1168/2247] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:46 2022] GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f => generated 1436 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:33:46.814287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-2b3d3a0f-49b5-45a1-a897-0973b3fd93d9 req-8d4228be-3053-47d9-9ea8-c9685a462531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513ca608-24c9-45f9-8fb9-e231d92c7262", "name": "network-vif-plugged", "status": "completed", "tag": "b2def801-647c-479d-9e34-cb0b4d60448e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:46.836539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2b3d3a0f-49b5-45a1-a897-0973b3fd93d9 req-8d4228be-3053-47d9-9ea8-c9685a462531 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:46.837482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2b3d3a0f-49b5-45a1-a897-0973b3fd93d9 req-8d4228be-3053-47d9-9ea8-c9685a462531 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:46.838095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2b3d3a0f-49b5-45a1-a897-0973b3fd93d9 req-8d4228be-3053-47d9-9ea8-c9685a462531 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:46.862059 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-2b3d3a0f-49b5-45a1-a897-0973b3fd93d9 req-8d4228be-3053-47d9-9ea8-c9685a462531 service nova] Creating event network-vif-plugged:b2def801-647c-479d-9e34-cb0b4d60448e for instance 513ca608-24c9-45f9-8fb9-e231d92c7262 on n-h2-858383-15 Oct 24 10:33:46.871434 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-2b3d3a0f-49b5-45a1-a897-0973b3fd93d9 req-8d4228be-3053-47d9-9ea8-c9685a462531 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061228 Oct 24 10:33:46.880416 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1080/2248] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:33:47.111387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c2d38d9e-728a-4bc6-b034-216e7ce5cfc3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2036683363", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "979ef371-392f-454f-8dbb-ad9320d9a120"}], "block_device_mapping_v2": [{"uuid": "cc85bf15-ce49-43eb-af5c-dd969ed2f4ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:47.201614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-c2d38d9e-728a-4bc6-b034-216e7ce5cfc3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] validate_networks() for [('979ef371-392f-454f-8dbb-ad9320d9a120', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:33:47.704202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c4c50ed8-55b8-48ec-b0cc-4c3b966bc996 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:47.705151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c4c50ed8-55b8-48ec-b0cc-4c3b966bc996 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] [instance: 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:47.716745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4c50ed8-55b8-48ec-b0cc-4c3b966bc996 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:47.718991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4c50ed8-55b8-48ec-b0cc-4c3b966bc996 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:47.719493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4c50ed8-55b8-48ec-b0cc-4c3b966bc996 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:47.743237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4c50ed8-55b8-48ec-b0cc-4c3b966bc996 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:47.743845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4c50ed8-55b8-48ec-b0cc-4c3b966bc996 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:47.744300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4c50ed8-55b8-48ec-b0cc-4c3b966bc996 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:47.772146 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-c4c50ed8-55b8-48ec-b0cc-4c3b966bc996 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] HTTP exception thrown: Instance 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f could not be found. Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c4c50ed8-55b8-48ec-b0cc-4c3b966bc996 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Request method failure captured: Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f HTTP/1.1 Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmn4lcoLYC861TvX1DkwhcR9U0GVBHpskUthdKVRnwp9HjyF7mbQvYQyUtDatAGFiFD3DLoeAuWQlluMV1_RIrkC8AIwoGBn0oOhcTot1mOtkkEpzOMzj1SY56n58sbPxFrD0gH3qUk9lfi03_zmLHfJHCKqyOY3saFpAPYceoMOBFw Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 75bae6df8f0a4f808e29edb3ddc33cb3 Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1627036112 Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75bae6df8f0a4f808e29edb3ddc33cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75bae6df8f0a4f808e29edb3ddc33cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75bae6df8f0a4f808e29edb3ddc33cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75bae6df8f0a4f808e29edb3ddc33cb3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1627036112 Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 75bae6df8f0a4f808e29edb3ddc33cb3 Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1627036112 Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerDiagnosticsNegativeTest-1627036112-project Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 096bc5b57afb4eb6866c3952c65276dc Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1627036112-project Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f could not be found. Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '31fa9f50-887f-4cbd-b569-7b8bc66bbb4f'} Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f could not be found. Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f could not be found. Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:47.774157 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:33:47.777741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:47.777741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:33:47.777741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:33:47.777741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:33:47.777741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:33:47.777741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:33:47.777741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f could not be found. Oct 24 10:33:47.777741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:33:47.779771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c4c50ed8-55b8-48ec-b0cc-4c3b966bc996 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] Returning 404 to user: Instance 31fa9f50-887f-4cbd-b569-7b8bc66bbb4f could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:33:47.780886 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c4c50ed8-55b8-48ec-b0cc-4c3b966bc996 tempest-ServerDiagnosticsNegativeTest-1627036112 tempest-ServerDiagnosticsNegativeTest-1627036112-project] 10.222.0.50 "GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f" status: 404 len: 111 microversion: 2.1 time: 0.082417 Oct 24 10:33:47.782527 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1081/2249] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:47 2022] GET /compute/v2.1/servers/31fa9f50-887f-4cbd-b569-7b8bc66bbb4f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:33:49.580008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-c2d38d9e-728a-4bc6-b034-216e7ce5cfc3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:33:49.581022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-c2d38d9e-728a-4bc6-b034-216e7ce5cfc3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:33:49.581940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-c2d38d9e-728a-4bc6-b034-216e7ce5cfc3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:33:49.582556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-c2d38d9e-728a-4bc6-b034-216e7ce5cfc3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:33:49.583122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-c2d38d9e-728a-4bc6-b034-216e7ce5cfc3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:33:49.610620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2d38d9e-728a-4bc6-b034-216e7ce5cfc3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:49.611210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2d38d9e-728a-4bc6-b034-216e7ce5cfc3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:49.615806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2d38d9e-728a-4bc6-b034-216e7ce5cfc3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:49.621943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2d38d9e-728a-4bc6-b034-216e7ce5cfc3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:49.622649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2d38d9e-728a-4bc6-b034-216e7ce5cfc3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:49.624213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2d38d9e-728a-4bc6-b034-216e7ce5cfc3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:49.716773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-c2d38d9e-728a-4bc6-b034-216e7ce5cfc3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Getting quotas for project 9f2d317e42584b41b11c1668de6657bd. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:33:49.739541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-c2d38d9e-728a-4bc6-b034-216e7ce5cfc3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Getting quotas for user 66ca4f9e7ffb447ebf740c52f6a098c2 and project 9f2d317e42584b41b11c1668de6657bd. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:33:49.885303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c2d38d9e-728a-4bc6-b034-216e7ce5cfc3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:33:49.888014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c2d38d9e-728a-4bc6-b034-216e7ce5cfc3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc85bf15-ce49-43eb-af5c-dd969ed2f4ff',volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:33:50.302748 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c2d38d9e-728a-4bc6-b034-216e7ce5cfc3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.193953 Oct 24 10:33:50.309059 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1169/2250] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Oct 24 10:33:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3202 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 10:33:50.327113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e616c76-09a9-42b8-aa3e-1b824ce0d018 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:50.328513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0e616c76-09a9-42b8-aa3e-1b824ce0d018 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:50.522657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0e616c76-09a9-42b8-aa3e-1b824ce0d018 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:50.550882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0e616c76-09a9-42b8-aa3e-1b824ce0d018 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:50.555432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0e616c76-09a9-42b8-aa3e-1b824ce0d018 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:50.561153 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e616c76-09a9-42b8-aa3e-1b824ce0d018 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1104 microversion: 2.25 time: 0.242718 Oct 24 10:33:50.563058 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1082/2251] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:33:50 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1104 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:33:51.601531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-75ea3307-5765-48c6-b2dd-07424dbe1826 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:51.602848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-75ea3307-5765-48c6-b2dd-07424dbe1826 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:51.826068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-75ea3307-5765-48c6-b2dd-07424dbe1826 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:51.846400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-75ea3307-5765-48c6-b2dd-07424dbe1826 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:51.848398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-75ea3307-5765-48c6-b2dd-07424dbe1826 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:51.850558 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-75ea3307-5765-48c6-b2dd-07424dbe1826 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1104 microversion: 2.25 time: 0.255795 Oct 24 10:33:51.871275 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1170/2252] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:33:51 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1104 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:33:52.879562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2c33d28e-a583-4231-8b94-345e586607ce tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:52.880179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2c33d28e-a583-4231-8b94-345e586607ce tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:52.897671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c33d28e-a583-4231-8b94-345e586607ce tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:52.903862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c33d28e-a583-4231-8b94-345e586607ce tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:52.907266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c33d28e-a583-4231-8b94-345e586607ce tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:52.908465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c33d28e-a583-4231-8b94-345e586607ce tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:52.914917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c33d28e-a583-4231-8b94-345e586607ce tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:52.915762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c33d28e-a583-4231-8b94-345e586607ce tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:53.192174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d734005d-8e56-46ae-8f37-c7a6618e68cb tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f83c57ca-b734-4c6d-8da5-120a4eaac68e"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:53.196911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d734005d-8e56-46ae-8f37-c7a6618e68cb tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:53.206021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c33d28e-a583-4231-8b94-345e586607ce tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:53.210397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:53.232704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c33d28e-a583-4231-8b94-345e586607ce tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:53.234182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c33d28e-a583-4231-8b94-345e586607ce tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:53.235335 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2c33d28e-a583-4231-8b94-345e586607ce tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1233 microversion: 2.25 time: 0.359732 Oct 24 10:33:53.235889 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1083/2253] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:33:52 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1233 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:33:53.266950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d734005d-8e56-46ae-8f37-c7a6618e68cb tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:53.267453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d734005d-8e56-46ae-8f37-c7a6618e68cb tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:53.267889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d734005d-8e56-46ae-8f37-c7a6618e68cb tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:53.268606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d734005d-8e56-46ae-8f37-c7a6618e68cb tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:53.288985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d734005d-8e56-46ae-8f37-c7a6618e68cb tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:53.289931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d734005d-8e56-46ae-8f37-c7a6618e68cb tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:54.265776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-357d4c65-12da-4e1a-b50c-aa62cb92c536 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:54.266941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-357d4c65-12da-4e1a-b50c-aa62cb92c536 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:54.281927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-357d4c65-12da-4e1a-b50c-aa62cb92c536 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:54.282704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-357d4c65-12da-4e1a-b50c-aa62cb92c536 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:54.283490 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-357d4c65-12da-4e1a-b50c-aa62cb92c536 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:54.286180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-357d4c65-12da-4e1a-b50c-aa62cb92c536 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:54.286896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-357d4c65-12da-4e1a-b50c-aa62cb92c536 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:54.289191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-357d4c65-12da-4e1a-b50c-aa62cb92c536 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:54.455380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-357d4c65-12da-4e1a-b50c-aa62cb92c536 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:54.476606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-357d4c65-12da-4e1a-b50c-aa62cb92c536 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:54.486993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-357d4c65-12da-4e1a-b50c-aa62cb92c536 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:54.494532 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-357d4c65-12da-4e1a-b50c-aa62cb92c536 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1251 microversion: 2.25 time: 0.231442 Oct 24 10:33:54.497751 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1084/2254] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:33:54 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1251 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:33:55.457878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c9012fb-b985-4841-8941-4d162baa6bb8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-915137531", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:55.621096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-1c9012fb-b985-4841-8941-4d162baa6bb8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] validate_networks() for None {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:33:56.520075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1c9012fb-b985-4841-8941-4d162baa6bb8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:33:56.520670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1c9012fb-b985-4841-8941-4d162baa6bb8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:33:56.521909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1c9012fb-b985-4841-8941-4d162baa6bb8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:33:56.522424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1c9012fb-b985-4841-8941-4d162baa6bb8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:33:56.522978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1c9012fb-b985-4841-8941-4d162baa6bb8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:33:56.541436 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d734005d-8e56-46ae-8f37-c7a6618e68cb tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "POST /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.353263 Oct 24 10:33:56.542113 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1171/2255] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 10:33:53 2022] POST /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments => generated 194 bytes in 3355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:33:56.559814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3f8086e8-dc47-4add-b6a5-b8fd7074afed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:56.561854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3f8086e8-dc47-4add-b6a5-b8fd7074afed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:56.571939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c9012fb-b985-4841-8941-4d162baa6bb8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:56.575633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f8086e8-dc47-4add-b6a5-b8fd7074afed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:56.576168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f8086e8-dc47-4add-b6a5-b8fd7074afed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:56.576745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f8086e8-dc47-4add-b6a5-b8fd7074afed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:56.578455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c9012fb-b985-4841-8941-4d162baa6bb8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:56.580624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c9012fb-b985-4841-8941-4d162baa6bb8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:56.583323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f8086e8-dc47-4add-b6a5-b8fd7074afed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:56.583852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f8086e8-dc47-4add-b6a5-b8fd7074afed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:56.584315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f8086e8-dc47-4add-b6a5-b8fd7074afed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:56.584620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c9012fb-b985-4841-8941-4d162baa6bb8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:56.586460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c9012fb-b985-4841-8941-4d162baa6bb8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:56.589520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c9012fb-b985-4841-8941-4d162baa6bb8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:56.674731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-1c9012fb-b985-4841-8941-4d162baa6bb8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Getting quotas for project ddcca0b4ac864e36a9732a13c93171d3. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:33:56.697358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-1c9012fb-b985-4841-8941-4d162baa6bb8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Getting quotas for user 5ab9827c96bb42fa8975d46618243d33 and project ddcca0b4ac864e36a9732a13c93171d3. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:33:56.743144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1c9012fb-b985-4841-8941-4d162baa6bb8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:33:56.760562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1c9012fb-b985-4841-8941-4d162baa6bb8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:33:56.940583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3f8086e8-dc47-4add-b6a5-b8fd7074afed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:56.985673 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1c9012fb-b985-4841-8941-4d162baa6bb8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.662112 Oct 24 10:33:56.985673 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1085/2256] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:33:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:33:56.986221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3f8086e8-dc47-4add-b6a5-b8fd7074afed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:56.986221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3f8086e8-dc47-4add-b6a5-b8fd7074afed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:56.986221 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3f8086e8-dc47-4add-b6a5-b8fd7074afed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1293 microversion: 2.25 time: 0.422555 Oct 24 10:33:57.005114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-72ff2ad7-6a43-4493-ae17-8e6048a2725e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:57.006828 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1172/2257] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:33:56 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1293 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:33:57.044784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-72ff2ad7-6a43-4493-ae17-8e6048a2725e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:57.077363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72ff2ad7-6a43-4493-ae17-8e6048a2725e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:57.077932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72ff2ad7-6a43-4493-ae17-8e6048a2725e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:57.078560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72ff2ad7-6a43-4493-ae17-8e6048a2725e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:57.081719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72ff2ad7-6a43-4493-ae17-8e6048a2725e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:57.084981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72ff2ad7-6a43-4493-ae17-8e6048a2725e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:57.085440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72ff2ad7-6a43-4493-ae17-8e6048a2725e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:57.235249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ca78ff77-6172-40d6-9212-dd4bf91a78ff tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-811852719", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:57.243443 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-72ff2ad7-6a43-4493-ae17-8e6048a2725e tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.274100 Oct 24 10:33:57.249715 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1086/2258] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:33:56 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380/os-volume_attachments => generated 25 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:33:57.410406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-ca78ff77-6172-40d6-9212-dd4bf91a78ff tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:33:58.021865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7d380148-2a28-4eab-b45c-9eb5183e7a9a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:58.024022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7d380148-2a28-4eab-b45c-9eb5183e7a9a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:58.040911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d380148-2a28-4eab-b45c-9eb5183e7a9a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:58.041478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d380148-2a28-4eab-b45c-9eb5183e7a9a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:58.041931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d380148-2a28-4eab-b45c-9eb5183e7a9a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:58.043397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d380148-2a28-4eab-b45c-9eb5183e7a9a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:58.043882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d380148-2a28-4eab-b45c-9eb5183e7a9a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:58.047169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d380148-2a28-4eab-b45c-9eb5183e7a9a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:59.104581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ca78ff77-6172-40d6-9212-dd4bf91a78ff tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:33:59.105858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ca78ff77-6172-40d6-9212-dd4bf91a78ff tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:33:59.106492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ca78ff77-6172-40d6-9212-dd4bf91a78ff tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:33:59.107374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ca78ff77-6172-40d6-9212-dd4bf91a78ff tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:33:59.107973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ca78ff77-6172-40d6-9212-dd4bf91a78ff tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:33:59.136499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca78ff77-6172-40d6-9212-dd4bf91a78ff tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:59.138242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca78ff77-6172-40d6-9212-dd4bf91a78ff tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:59.138856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca78ff77-6172-40d6-9212-dd4bf91a78ff tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:59.139881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca78ff77-6172-40d6-9212-dd4bf91a78ff tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:59.148010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca78ff77-6172-40d6-9212-dd4bf91a78ff tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:59.150705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca78ff77-6172-40d6-9212-dd4bf91a78ff tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:59.206435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-ca78ff77-6172-40d6-9212-dd4bf91a78ff tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Getting quotas for project ddcca0b4ac864e36a9732a13c93171d3. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:33:59.218642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-ca78ff77-6172-40d6-9212-dd4bf91a78ff tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Getting quotas for user 5ab9827c96bb42fa8975d46618243d33 and project ddcca0b4ac864e36a9732a13c93171d3. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:33:59.263324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ca78ff77-6172-40d6-9212-dd4bf91a78ff tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:33:59.265738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ca78ff77-6172-40d6-9212-dd4bf91a78ff tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:33:59.299242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7d380148-2a28-4eab-b45c-9eb5183e7a9a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:59.311453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7d380148-2a28-4eab-b45c-9eb5183e7a9a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:59.313262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7d380148-2a28-4eab-b45c-9eb5183e7a9a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:59.314123 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7d380148-2a28-4eab-b45c-9eb5183e7a9a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1293 microversion: 2.25 time: 1.297730 Oct 24 10:33:59.314703 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1087/2259] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:33:58 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1293 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:33:59.372549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-2a1f1005-e9a2-43b5-9a98-016aea86f9a7 req-09337fe4-dcd0-43ae-814c-211d04076aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d", "tag": "4787ea89-a905-45b9-ba75-416fa72d12e3"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:33:59.438819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2a1f1005-e9a2-43b5-9a98-016aea86f9a7 req-09337fe4-dcd0-43ae-814c-211d04076aac service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:33:59.449381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2a1f1005-e9a2-43b5-9a98-016aea86f9a7 req-09337fe4-dcd0-43ae-814c-211d04076aac service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:33:59.449845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2a1f1005-e9a2-43b5-9a98-016aea86f9a7 req-09337fe4-dcd0-43ae-814c-211d04076aac service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:33:59.499679 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-2a1f1005-e9a2-43b5-9a98-016aea86f9a7 req-09337fe4-dcd0-43ae-814c-211d04076aac service nova] Creating event network-changed:4787ea89-a905-45b9-ba75-416fa72d12e3 for instance c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d on n-h1-858383-15 Oct 24 10:33:59.534690 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-2a1f1005-e9a2-43b5-9a98-016aea86f9a7 req-09337fe4-dcd0-43ae-814c-211d04076aac service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179978 Oct 24 10:33:59.536483 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1088/2260] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:33:59.567598 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ca78ff77-6172-40d6-9212-dd4bf91a78ff tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.336728 Oct 24 10:33:59.585072 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1173/2261] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:33:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:33:59.588649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a8830260-f072-4c86-8de7-0ae25c4583ba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:33:59.592621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a8830260-f072-4c86-8de7-0ae25c4583ba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:33:59.778292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a8830260-f072-4c86-8de7-0ae25c4583ba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:33:59.794976 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a8830260-f072-4c86-8de7-0ae25c4583ba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1213 microversion: 2.1 time: 0.209507 Oct 24 10:33:59.796443 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1089/2262] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:33:59 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1213 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:00.346929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-067f6209-212a-4141-896e-bcbe131f6ebf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:00.347571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-067f6209-212a-4141-896e-bcbe131f6ebf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:00.368079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-067f6209-212a-4141-896e-bcbe131f6ebf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:00.371212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-067f6209-212a-4141-896e-bcbe131f6ebf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:00.373331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-067f6209-212a-4141-896e-bcbe131f6ebf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:00.376987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-067f6209-212a-4141-896e-bcbe131f6ebf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:00.378660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-067f6209-212a-4141-896e-bcbe131f6ebf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:00.379128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-067f6209-212a-4141-896e-bcbe131f6ebf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:00.821071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ce6a8e65-c93f-419f-b6a8-227806bd5cd1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:00.822537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ce6a8e65-c93f-419f-b6a8-227806bd5cd1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:01.049617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce6a8e65-c93f-419f-b6a8-227806bd5cd1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:01.095816 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ce6a8e65-c93f-419f-b6a8-227806bd5cd1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1213 microversion: 2.1 time: 0.244449 Oct 24 10:34:01.098801 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1090/2263] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:00 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1213 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:34:01.285929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-067f6209-212a-4141-896e-bcbe131f6ebf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:01.300291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-067f6209-212a-4141-896e-bcbe131f6ebf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:01.304530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-067f6209-212a-4141-896e-bcbe131f6ebf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:01.305996 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-067f6209-212a-4141-896e-bcbe131f6ebf tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1293 microversion: 2.25 time: 0.964677 Oct 24 10:34:01.329380 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1174/2264] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:00 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1293 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:02.124008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3f5f1ba7-7ed8-4718-941f-23f80f616118 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:02.124626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3f5f1ba7-7ed8-4718-941f-23f80f616118 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:02.136713 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 10:34:02.139501 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 10:34:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 (ip 10.222.0.50) !!! Oct 24 10:34:02.148923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f5f1ba7-7ed8-4718-941f-23f80f616118 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:02.149654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f5f1ba7-7ed8-4718-941f-23f80f616118 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:02.152644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f5f1ba7-7ed8-4718-941f-23f80f616118 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:02.153894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f5f1ba7-7ed8-4718-941f-23f80f616118 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:02.154527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f5f1ba7-7ed8-4718-941f-23f80f616118 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:02.157025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f5f1ba7-7ed8-4718-941f-23f80f616118 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:02.336273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e9376b37-baf2-4686-8ac8-8684e175de4a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:02.337644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e9376b37-baf2-4686-8ac8-8684e175de4a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:02.352041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9376b37-baf2-4686-8ac8-8684e175de4a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:02.369308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9376b37-baf2-4686-8ac8-8684e175de4a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:02.369988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9376b37-baf2-4686-8ac8-8684e175de4a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:02.370741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9376b37-baf2-4686-8ac8-8684e175de4a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:02.371249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9376b37-baf2-4686-8ac8-8684e175de4a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:02.372647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9376b37-baf2-4686-8ac8-8684e175de4a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:02.383705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3f5f1ba7-7ed8-4718-941f-23f80f616118 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:02.394434 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3f5f1ba7-7ed8-4718-941f-23f80f616118 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1265 microversion: 2.1 time: 0.274569 Oct 24 10:34:02.395396 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1091/2265] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:02 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:02.797033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e9376b37-baf2-4686-8ac8-8684e175de4a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:02.815070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e9376b37-baf2-4686-8ac8-8684e175de4a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:02.825421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e9376b37-baf2-4686-8ac8-8684e175de4a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:02.827838 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e9376b37-baf2-4686-8ac8-8684e175de4a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1293 microversion: 2.25 time: 0.496132 Oct 24 10:34:02.831865 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1175/2266] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:02 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1293 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:34:03.006293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-29e9bc75-da12-405b-98a8-94a1d430347b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Action: 'create', calling method: .version_select at 0x7f04d4eadb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2077462351", "description": "tempest-description-495365196"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:03.349626 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-29e9bc75-da12-405b-98a8-94a1d430347b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.935112 Oct 24 10:34:03.351051 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1092/2267] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:34:02 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:34:03.364629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a4918bab-5565-4ef5-978f-9e5c164cb96e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Action: 'create', calling method: .version_select at 0x7f04d0b620d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-470094115", "description": "tempest-description-1580325432"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:03.425031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c24bb692-622a-462e-b0ef-b11e4e4be3e9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:03.426903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c24bb692-622a-462e-b0ef-b11e4e4be3e9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:03.435497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c24bb692-622a-462e-b0ef-b11e4e4be3e9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:03.459198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c24bb692-622a-462e-b0ef-b11e4e4be3e9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:03.461882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c24bb692-622a-462e-b0ef-b11e4e4be3e9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:03.466497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c24bb692-622a-462e-b0ef-b11e4e4be3e9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:03.470064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c24bb692-622a-462e-b0ef-b11e4e4be3e9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:03.470958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c24bb692-622a-462e-b0ef-b11e4e4be3e9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:03.743465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c24bb692-622a-462e-b0ef-b11e4e4be3e9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:03.757474 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c24bb692-622a-462e-b0ef-b11e4e4be3e9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1271 microversion: 2.1 time: 0.335543 Oct 24 10:34:03.775496 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1093/2268] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:03 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1271 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:03.855948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1bd883bf-979f-4d97-a5c5-79c2de2c32c7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:03.856582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1bd883bf-979f-4d97-a5c5-79c2de2c32c7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:03.870637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bd883bf-979f-4d97-a5c5-79c2de2c32c7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:03.871158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bd883bf-979f-4d97-a5c5-79c2de2c32c7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:03.871607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bd883bf-979f-4d97-a5c5-79c2de2c32c7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:03.872374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bd883bf-979f-4d97-a5c5-79c2de2c32c7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:03.872872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bd883bf-979f-4d97-a5c5-79c2de2c32c7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:03.873305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bd883bf-979f-4d97-a5c5-79c2de2c32c7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:04.198180 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a4918bab-5565-4ef5-978f-9e5c164cb96e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.837582 Oct 24 10:34:04.198805 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1176/2269] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:34:03 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:04.289149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1bd883bf-979f-4d97-a5c5-79c2de2c32c7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:04.303233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1bd883bf-979f-4d97-a5c5-79c2de2c32c7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:04.310414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1bd883bf-979f-4d97-a5c5-79c2de2c32c7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:04.311883 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1bd883bf-979f-4d97-a5c5-79c2de2c32c7 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1293 microversion: 2.25 time: 0.459841 Oct 24 10:34:04.326908 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1094/2270] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:03 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1293 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:34:04.401497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7a924c8e-14f4-4fd1-9742-eb5c59c11f38 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-489402949", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "f8aaf736-bcc8-4efe-a0af-ff2b8190b625"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:04.518883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-7a924c8e-14f4-4fd1-9742-eb5c59c11f38 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] validate_networks() for [('f8aaf736-bcc8-4efe-a0af-ff2b8190b625', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:34:04.788821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-713eb084-a967-41ef-86d4-203e8a7505c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:04.789657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-713eb084-a967-41ef-86d4-203e8a7505c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:04.799259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-713eb084-a967-41ef-86d4-203e8a7505c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:04.804985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-713eb084-a967-41ef-86d4-203e8a7505c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:04.805572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-713eb084-a967-41ef-86d4-203e8a7505c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:04.806355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-713eb084-a967-41ef-86d4-203e8a7505c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:04.806840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-713eb084-a967-41ef-86d4-203e8a7505c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:04.807276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-713eb084-a967-41ef-86d4-203e8a7505c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:05.436583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-713eb084-a967-41ef-86d4-203e8a7505c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:05.445956 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-713eb084-a967-41ef-86d4-203e8a7505c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1313 microversion: 2.1 time: 0.661122 Oct 24 10:34:05.446564 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1095/2271] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:04 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1313 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:34:05.479069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-df2339d0-4dde-45e6-85d6-c6417c224cf5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:05.482021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-df2339d0-4dde-45e6-85d6-c6417c224cf5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:05.504641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df2339d0-4dde-45e6-85d6-c6417c224cf5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:05.508622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df2339d0-4dde-45e6-85d6-c6417c224cf5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:05.509993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df2339d0-4dde-45e6-85d6-c6417c224cf5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:05.511881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df2339d0-4dde-45e6-85d6-c6417c224cf5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:05.525700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df2339d0-4dde-45e6-85d6-c6417c224cf5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:05.527714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df2339d0-4dde-45e6-85d6-c6417c224cf5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:05.625416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7a924c8e-14f4-4fd1-9742-eb5c59c11f38 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:34:05.625969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7a924c8e-14f4-4fd1-9742-eb5c59c11f38 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:34:05.626565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7a924c8e-14f4-4fd1-9742-eb5c59c11f38 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:34:05.627095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7a924c8e-14f4-4fd1-9742-eb5c59c11f38 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:34:05.627625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7a924c8e-14f4-4fd1-9742-eb5c59c11f38 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:34:05.644373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a924c8e-14f4-4fd1-9742-eb5c59c11f38 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:05.645526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a924c8e-14f4-4fd1-9742-eb5c59c11f38 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:05.657150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a924c8e-14f4-4fd1-9742-eb5c59c11f38 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:05.658855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a924c8e-14f4-4fd1-9742-eb5c59c11f38 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:05.660489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a924c8e-14f4-4fd1-9742-eb5c59c11f38 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:05.663928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a924c8e-14f4-4fd1-9742-eb5c59c11f38 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:05.723398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-7a924c8e-14f4-4fd1-9742-eb5c59c11f38 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Getting quotas for project 60b1c666c4914debad43704393d651cf. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:34:05.731810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-7a924c8e-14f4-4fd1-9742-eb5c59c11f38 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Getting quotas for user 6aeb81e9b2fa4796813c607234174af6 and project 60b1c666c4914debad43704393d651cf. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:34:05.768092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7a924c8e-14f4-4fd1-9742-eb5c59c11f38 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:34:05.770888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7a924c8e-14f4-4fd1-9742-eb5c59c11f38 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:34:05.923866 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7a924c8e-14f4-4fd1-9742-eb5c59c11f38 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.526194 Oct 24 10:34:05.934085 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1177/2272] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:34:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:34:05.948039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-df2339d0-4dde-45e6-85d6-c6417c224cf5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:05.962303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d7c2b941-1aee-429c-a7f6-9899f87b7694 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:05.963356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d7c2b941-1aee-429c-a7f6-9899f87b7694 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:05.965245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-df2339d0-4dde-45e6-85d6-c6417c224cf5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:05.971385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-df2339d0-4dde-45e6-85d6-c6417c224cf5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:05.974908 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-df2339d0-4dde-45e6-85d6-c6417c224cf5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1293 microversion: 2.25 time: 0.525501 Oct 24 10:34:05.977657 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1096/2273] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:05 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1293 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:06.125391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d7c2b941-1aee-429c-a7f6-9899f87b7694 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:06.143898 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d7c2b941-1aee-429c-a7f6-9899f87b7694 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1215 microversion: 2.1 time: 0.203339 Oct 24 10:34:06.160779 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1178/2274] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:05 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1215 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:06.471931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-25830e43-eae2-4b53-a2dc-f809c3eb5f4f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:06.472550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-25830e43-eae2-4b53-a2dc-f809c3eb5f4f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:06.492475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25830e43-eae2-4b53-a2dc-f809c3eb5f4f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:06.493003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25830e43-eae2-4b53-a2dc-f809c3eb5f4f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:06.493442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25830e43-eae2-4b53-a2dc-f809c3eb5f4f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:06.494157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25830e43-eae2-4b53-a2dc-f809c3eb5f4f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:06.504715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25830e43-eae2-4b53-a2dc-f809c3eb5f4f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:06.506086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25830e43-eae2-4b53-a2dc-f809c3eb5f4f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:06.635556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:06.813279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-25830e43-eae2-4b53-a2dc-f809c3eb5f4f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:06.822899 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-25830e43-eae2-4b53-a2dc-f809c3eb5f4f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1313 microversion: 2.1 time: 0.354760 Oct 24 10:34:06.823500 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1097/2275] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:06 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:06.996105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-8ad76a84-e766-431d-87d4-6492279dd269 req-74fbd2a4-1466-4239-8e80-e45ee4f2f413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "485d2945-20d9-4620-a9e5-004680c44d43", "tag": "ceedad81-43a8-4ff1-9629-690de6218202"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:07.003135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c3843b6-1c97-4a47-bba8-713d21b02354 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:07.004501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4c3843b6-1c97-4a47-bba8-713d21b02354 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:07.020496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c3843b6-1c97-4a47-bba8-713d21b02354 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:07.025865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c3843b6-1c97-4a47-bba8-713d21b02354 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:07.026320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c3843b6-1c97-4a47-bba8-713d21b02354 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:07.027074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c3843b6-1c97-4a47-bba8-713d21b02354 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:07.027528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c3843b6-1c97-4a47-bba8-713d21b02354 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:07.027952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c3843b6-1c97-4a47-bba8-713d21b02354 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:07.045342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8ad76a84-e766-431d-87d4-6492279dd269 req-74fbd2a4-1466-4239-8e80-e45ee4f2f413 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:07.045826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8ad76a84-e766-431d-87d4-6492279dd269 req-74fbd2a4-1466-4239-8e80-e45ee4f2f413 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:07.056413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8ad76a84-e766-431d-87d4-6492279dd269 req-74fbd2a4-1466-4239-8e80-e45ee4f2f413 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:07.112989 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-8ad76a84-e766-431d-87d4-6492279dd269 req-74fbd2a4-1466-4239-8e80-e45ee4f2f413 service nova] Creating event network-changed:ceedad81-43a8-4ff1-9629-690de6218202 for instance 485d2945-20d9-4620-a9e5-004680c44d43 on n-h2-858383-15 Oct 24 10:34:07.138720 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-8ad76a84-e766-431d-87d4-6492279dd269 req-74fbd2a4-1466-4239-8e80-e45ee4f2f413 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137409 Oct 24 10:34:07.143919 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1179/2276] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:07.172229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5ad310de-7518-47b4-b086-0b9b3a701c98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:07.174592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5ad310de-7518-47b4-b086-0b9b3a701c98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:07.225495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ad310de-7518-47b4-b086-0b9b3a701c98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:07.230259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ad310de-7518-47b4-b086-0b9b3a701c98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:07.230847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ad310de-7518-47b4-b086-0b9b3a701c98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:07.235211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ad310de-7518-47b4-b086-0b9b3a701c98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:07.241465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ad310de-7518-47b4-b086-0b9b3a701c98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:07.242090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ad310de-7518-47b4-b086-0b9b3a701c98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:07.471422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5ad310de-7518-47b4-b086-0b9b3a701c98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:07.528962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c3843b6-1c97-4a47-bba8-713d21b02354 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:07.542204 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5ad310de-7518-47b4-b086-0b9b3a701c98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1211 microversion: 2.1 time: 0.371658 Oct 24 10:34:07.542204 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1180/2277] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:07 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1211 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:07.542346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c3843b6-1c97-4a47-bba8-713d21b02354 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:07.546873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c3843b6-1c97-4a47-bba8-713d21b02354 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:07.548034 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4c3843b6-1c97-4a47-bba8-713d21b02354 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1293 microversion: 2.25 time: 0.548886 Oct 24 10:34:07.563766 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1098/2278] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:06 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1293 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:34:07.849603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-73747e63-9c8b-4ba5-8f42-d04aaf6347cf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:07.850688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-73747e63-9c8b-4ba5-8f42-d04aaf6347cf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:07.864230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73747e63-9c8b-4ba5-8f42-d04aaf6347cf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:07.865567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73747e63-9c8b-4ba5-8f42-d04aaf6347cf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:07.866165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73747e63-9c8b-4ba5-8f42-d04aaf6347cf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:07.867497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73747e63-9c8b-4ba5-8f42-d04aaf6347cf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:07.868466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73747e63-9c8b-4ba5-8f42-d04aaf6347cf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:07.869101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73747e63-9c8b-4ba5-8f42-d04aaf6347cf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:07.912180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=92,nova_cell1:INSERT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:08.200211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-73747e63-9c8b-4ba5-8f42-d04aaf6347cf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:08.209376 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-73747e63-9c8b-4ba5-8f42-d04aaf6347cf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1313 microversion: 2.1 time: 0.363032 Oct 24 10:34:08.229266 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1181/2279] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:07 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:08.565666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-06161f34-fdf9-4c04-8cc4-5ae5519f197a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:08.566271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-06161f34-fdf9-4c04-8cc4-5ae5519f197a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:08.569496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:08.576883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d8a05b6c-deac-40dd-b8d0-a7b24fbf897e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:08.577731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d8a05b6c-deac-40dd-b8d0-a7b24fbf897e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:08.581077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:08.617382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8a05b6c-deac-40dd-b8d0-a7b24fbf897e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:08.619861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06161f34-fdf9-4c04-8cc4-5ae5519f197a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:08.625730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8a05b6c-deac-40dd-b8d0-a7b24fbf897e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:08.629618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06161f34-fdf9-4c04-8cc4-5ae5519f197a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:08.630611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8a05b6c-deac-40dd-b8d0-a7b24fbf897e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:08.634078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06161f34-fdf9-4c04-8cc4-5ae5519f197a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:08.635069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8a05b6c-deac-40dd-b8d0-a7b24fbf897e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:08.635971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06161f34-fdf9-4c04-8cc4-5ae5519f197a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:08.636618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8a05b6c-deac-40dd-b8d0-a7b24fbf897e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:08.637363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06161f34-fdf9-4c04-8cc4-5ae5519f197a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:08.637805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06161f34-fdf9-4c04-8cc4-5ae5519f197a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:08.640007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8a05b6c-deac-40dd-b8d0-a7b24fbf897e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:08.831316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-06161f34-fdf9-4c04-8cc4-5ae5519f197a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:08.846933 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-06161f34-fdf9-4c04-8cc4-5ae5519f197a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1273 microversion: 2.1 time: 0.284678 Oct 24 10:34:08.855638 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1099/2280] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:08 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1273 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:09.243549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e0314703-6649-41c5-a80c-666957923d94 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:09.244748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e0314703-6649-41c5-a80c-666957923d94 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:09.257217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0314703-6649-41c5-a80c-666957923d94 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:09.258380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0314703-6649-41c5-a80c-666957923d94 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:09.261978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0314703-6649-41c5-a80c-666957923d94 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:09.263838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0314703-6649-41c5-a80c-666957923d94 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:09.264548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0314703-6649-41c5-a80c-666957923d94 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:09.269471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0314703-6649-41c5-a80c-666957923d94 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:09.471423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d8a05b6c-deac-40dd-b8d0-a7b24fbf897e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:09.488715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d8a05b6c-deac-40dd-b8d0-a7b24fbf897e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:09.491177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d8a05b6c-deac-40dd-b8d0-a7b24fbf897e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:09.492619 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d8a05b6c-deac-40dd-b8d0-a7b24fbf897e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1293 microversion: 2.25 time: 0.919556 Oct 24 10:34:09.497130 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1182/2281] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:08 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1293 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:34:09.542018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e0314703-6649-41c5-a80c-666957923d94 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:09.552944 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e0314703-6649-41c5-a80c-666957923d94 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1313 microversion: 2.1 time: 0.313148 Oct 24 10:34:09.569536 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1100/2282] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:09 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:09.883986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e136526-817e-418a-9bd4-075286c70bf7 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:09.884923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1e136526-817e-418a-9bd4-075286c70bf7 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:09.896608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e136526-817e-418a-9bd4-075286c70bf7 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:09.900093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e136526-817e-418a-9bd4-075286c70bf7 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:09.900722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e136526-817e-418a-9bd4-075286c70bf7 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:09.901694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e136526-817e-418a-9bd4-075286c70bf7 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:09.903069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e136526-817e-418a-9bd4-075286c70bf7 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:09.908755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e136526-817e-418a-9bd4-075286c70bf7 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:10.094727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1e136526-817e-418a-9bd4-075286c70bf7 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:10.109618 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1e136526-817e-418a-9bd4-075286c70bf7 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1273 microversion: 2.1 time: 0.230684 Oct 24 10:34:10.110804 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1183/2283] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:09 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:10.529063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-483ff26a-0df0-466c-8b28-f1f17118e621 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:10.530026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-483ff26a-0df0-466c-8b28-f1f17118e621 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:10.538498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-483ff26a-0df0-466c-8b28-f1f17118e621 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:10.539306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-483ff26a-0df0-466c-8b28-f1f17118e621 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:10.540035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-483ff26a-0df0-466c-8b28-f1f17118e621 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:10.549061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-483ff26a-0df0-466c-8b28-f1f17118e621 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:10.550452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-483ff26a-0df0-466c-8b28-f1f17118e621 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:10.551210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-483ff26a-0df0-466c-8b28-f1f17118e621 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:10.585798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c6cd56ec-ac2d-4002-8422-1236e3846600 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:10.587203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c6cd56ec-ac2d-4002-8422-1236e3846600 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:10.600354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6cd56ec-ac2d-4002-8422-1236e3846600 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:10.603624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6cd56ec-ac2d-4002-8422-1236e3846600 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:10.603624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6cd56ec-ac2d-4002-8422-1236e3846600 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:10.603914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6cd56ec-ac2d-4002-8422-1236e3846600 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:10.607371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6cd56ec-ac2d-4002-8422-1236e3846600 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:10.607947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6cd56ec-ac2d-4002-8422-1236e3846600 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:11.060392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:11.447852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-483ff26a-0df0-466c-8b28-f1f17118e621 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:11.458103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-483ff26a-0df0-466c-8b28-f1f17118e621 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:11.459641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-483ff26a-0df0-466c-8b28-f1f17118e621 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:11.466303 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-483ff26a-0df0-466c-8b28-f1f17118e621 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1293 microversion: 2.25 time: 0.941777 Oct 24 10:34:11.471216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c6cd56ec-ac2d-4002-8422-1236e3846600 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:11.479460 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c6cd56ec-ac2d-4002-8422-1236e3846600 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1313 microversion: 2.1 time: 0.899125 Oct 24 10:34:11.480818 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1101/2284] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:10 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1293 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:11.487110 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1184/2285] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:10 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1313 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:11.500567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-72ccd9c7-c92a-4143-9dd5-9b809aa1d74d req-96cd5224-8834-478b-bd2f-13a1e2ea9739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60354b63-afb2-4624-8a37-aeda3bf88672", "tag": "72f5ab98-427f-4f57-a27f-b04761c1e779"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:11.502120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9eee832b-de80-4c9d-8dd4-78746ceb87f2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:11.505021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9eee832b-de80-4c9d-8dd4-78746ceb87f2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:11.525680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9eee832b-de80-4c9d-8dd4-78746ceb87f2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:11.525983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-72ccd9c7-c92a-4143-9dd5-9b809aa1d74d req-96cd5224-8834-478b-bd2f-13a1e2ea9739 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:11.528285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9eee832b-de80-4c9d-8dd4-78746ceb87f2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:11.528933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-72ccd9c7-c92a-4143-9dd5-9b809aa1d74d req-96cd5224-8834-478b-bd2f-13a1e2ea9739 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:11.529388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-72ccd9c7-c92a-4143-9dd5-9b809aa1d74d req-96cd5224-8834-478b-bd2f-13a1e2ea9739 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:11.530055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9eee832b-de80-4c9d-8dd4-78746ceb87f2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:11.533305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9eee832b-de80-4c9d-8dd4-78746ceb87f2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:11.534233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9eee832b-de80-4c9d-8dd4-78746ceb87f2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:11.537275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9eee832b-de80-4c9d-8dd4-78746ceb87f2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:11.553275 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-72ccd9c7-c92a-4143-9dd5-9b809aa1d74d req-96cd5224-8834-478b-bd2f-13a1e2ea9739 service nova] Creating event network-changed:72f5ab98-427f-4f57-a27f-b04761c1e779 for instance 60354b63-afb2-4624-8a37-aeda3bf88672 on n-h1-858383-15 Oct 24 10:34:11.562815 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-72ccd9c7-c92a-4143-9dd5-9b809aa1d74d req-96cd5224-8834-478b-bd2f-13a1e2ea9739 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078243 Oct 24 10:34:11.566942 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1102/2286] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:11.802608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9eee832b-de80-4c9d-8dd4-78746ceb87f2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:11.815041 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9eee832b-de80-4c9d-8dd4-78746ceb87f2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1315 microversion: 2.1 time: 0.324195 Oct 24 10:34:11.831536 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1185/2287] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:11 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:12.524237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33831c9f-f3d7-4242-a0b3-11688be47deb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:12.525980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8323fd85-1d04-45b1-98c2-051afe610814 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:12.526853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8323fd85-1d04-45b1-98c2-051afe610814 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:12.527723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-33831c9f-f3d7-4242-a0b3-11688be47deb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:12.547658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8323fd85-1d04-45b1-98c2-051afe610814 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:12.548815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8323fd85-1d04-45b1-98c2-051afe610814 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:12.550675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8323fd85-1d04-45b1-98c2-051afe610814 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:12.550915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33831c9f-f3d7-4242-a0b3-11688be47deb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:12.551648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33831c9f-f3d7-4242-a0b3-11688be47deb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:12.553233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8323fd85-1d04-45b1-98c2-051afe610814 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:12.553943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33831c9f-f3d7-4242-a0b3-11688be47deb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:12.555182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33831c9f-f3d7-4242-a0b3-11688be47deb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:12.555663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8323fd85-1d04-45b1-98c2-051afe610814 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:12.556324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8323fd85-1d04-45b1-98c2-051afe610814 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:12.558369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33831c9f-f3d7-4242-a0b3-11688be47deb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:12.560320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33831c9f-f3d7-4242-a0b3-11688be47deb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:13.035577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8323fd85-1d04-45b1-98c2-051afe610814 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:13.049217 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8323fd85-1d04-45b1-98c2-051afe610814 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1313 microversion: 2.1 time: 0.540422 Oct 24 10:34:13.051155 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1186/2288] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:12 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1313 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:13.057090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a8a1fbe9-4797-42e6-a992-f6c3a36eb63a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:13.058122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a8a1fbe9-4797-42e6-a992-f6c3a36eb63a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:13.066011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8a1fbe9-4797-42e6-a992-f6c3a36eb63a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:13.068770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8a1fbe9-4797-42e6-a992-f6c3a36eb63a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:13.079721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8a1fbe9-4797-42e6-a992-f6c3a36eb63a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:13.086294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8a1fbe9-4797-42e6-a992-f6c3a36eb63a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:13.087087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8a1fbe9-4797-42e6-a992-f6c3a36eb63a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:13.088918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8a1fbe9-4797-42e6-a992-f6c3a36eb63a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:13.154924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-33831c9f-f3d7-4242-a0b3-11688be47deb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:13.180406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-33831c9f-f3d7-4242-a0b3-11688be47deb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:13.182614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-33831c9f-f3d7-4242-a0b3-11688be47deb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:13.183997 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-33831c9f-f3d7-4242-a0b3-11688be47deb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1293 microversion: 2.25 time: 0.673469 Oct 24 10:34:13.185123 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1103/2289] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:12 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1293 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:13.492387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0bca6be0-ab1d-436f-ba7c-e3ba0c0480cf tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:13.494871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0bca6be0-ab1d-436f-ba7c-e3ba0c0480cf tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:13.509988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bca6be0-ab1d-436f-ba7c-e3ba0c0480cf tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:13.514161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bca6be0-ab1d-436f-ba7c-e3ba0c0480cf tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:13.516721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bca6be0-ab1d-436f-ba7c-e3ba0c0480cf tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:13.518288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bca6be0-ab1d-436f-ba7c-e3ba0c0480cf tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:13.526028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bca6be0-ab1d-436f-ba7c-e3ba0c0480cf tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:13.529929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bca6be0-ab1d-436f-ba7c-e3ba0c0480cf tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:13.636808 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0bca6be0-ab1d-436f-ba7c-e3ba0c0480cf tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.147401 Oct 24 10:34:13.639848 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1104/2290] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:34:13 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380/os-volume_attachments => generated 25 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:34:13.681140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a8a1fbe9-4797-42e6-a992-f6c3a36eb63a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:13.691772 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a8a1fbe9-4797-42e6-a992-f6c3a36eb63a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1315 microversion: 2.1 time: 0.638698 Oct 24 10:34:13.704863 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1187/2291] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:13 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:13.768262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-50948988-96ed-4e02-aae3-0b80275b81aa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:13.769449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-50948988-96ed-4e02-aae3-0b80275b81aa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:13.787789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50948988-96ed-4e02-aae3-0b80275b81aa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:13.789391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50948988-96ed-4e02-aae3-0b80275b81aa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:13.790660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50948988-96ed-4e02-aae3-0b80275b81aa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:13.794169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50948988-96ed-4e02-aae3-0b80275b81aa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:13.794940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50948988-96ed-4e02-aae3-0b80275b81aa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:13.798103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50948988-96ed-4e02-aae3-0b80275b81aa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:13.856666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:13.884626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-50948988-96ed-4e02-aae3-0b80275b81aa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:34:14.078223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9808a68f-33d0-4468-8590-f991f1f5e675 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:14.079854 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-50948988-96ed-4e02-aae3-0b80275b81aa tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 204 len: 0 microversion: 2.1 time: 0.316289 Oct 24 10:34:14.080424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9808a68f-33d0-4468-8590-f991f1f5e675 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:14.085029 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1105/2292] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:34:13 2022] DELETE /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:34:14.101873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aef6f87b-29ac-4f7d-b20c-c15a240c27fd tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:14.102603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aef6f87b-29ac-4f7d-b20c-c15a240c27fd tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:14.103818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9808a68f-33d0-4468-8590-f991f1f5e675 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:14.104544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9808a68f-33d0-4468-8590-f991f1f5e675 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:14.105042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9808a68f-33d0-4468-8590-f991f1f5e675 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:14.105809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9808a68f-33d0-4468-8590-f991f1f5e675 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:14.106280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9808a68f-33d0-4468-8590-f991f1f5e675 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:14.106715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9808a68f-33d0-4468-8590-f991f1f5e675 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:14.122218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aef6f87b-29ac-4f7d-b20c-c15a240c27fd tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:14.122218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aef6f87b-29ac-4f7d-b20c-c15a240c27fd tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:14.122218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aef6f87b-29ac-4f7d-b20c-c15a240c27fd tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:14.122218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aef6f87b-29ac-4f7d-b20c-c15a240c27fd tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:14.124569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aef6f87b-29ac-4f7d-b20c-c15a240c27fd tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:14.125136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aef6f87b-29ac-4f7d-b20c-c15a240c27fd tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:14.514691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9808a68f-33d0-4468-8590-f991f1f5e675 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:14.528127 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9808a68f-33d0-4468-8590-f991f1f5e675 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1313 microversion: 2.1 time: 0.453833 Oct 24 10:34:14.541836 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1188/2293] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:14 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1313 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:14.550075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aef6f87b-29ac-4f7d-b20c-c15a240c27fd tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:14.554516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a6cf62ca-a134-472e-ae04-5ef3876526bb req-7670334d-5cd6-4820-ace6-ed81c24aec2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e14a4e9-2c60-4604-a670-dd4ea589e5f4", "tag": "22ad6515-0ea9-46ea-b637-abe57e0376b9"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:14.559970 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aef6f87b-29ac-4f7d-b20c-c15a240c27fd tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1683 microversion: 2.1 time: 0.473444 Oct 24 10:34:14.564337 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1106/2294] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:14 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1683 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:14.566332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a6cf62ca-a134-472e-ae04-5ef3876526bb req-7670334d-5cd6-4820-ace6-ed81c24aec2f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:14.566996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a6cf62ca-a134-472e-ae04-5ef3876526bb req-7670334d-5cd6-4820-ace6-ed81c24aec2f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:14.568189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a6cf62ca-a134-472e-ae04-5ef3876526bb req-7670334d-5cd6-4820-ace6-ed81c24aec2f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:14.576908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-24b2ee78-2479-4ce0-9c2d-7f3775612f30 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:14.577549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-24b2ee78-2479-4ce0-9c2d-7f3775612f30 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:14.582637 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a6cf62ca-a134-472e-ae04-5ef3876526bb req-7670334d-5cd6-4820-ace6-ed81c24aec2f service nova] Creating event network-changed:22ad6515-0ea9-46ea-b637-abe57e0376b9 for instance 0e14a4e9-2c60-4604-a670-dd4ea589e5f4 on n-h2-858383-15 Oct 24 10:34:14.588987 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a6cf62ca-a134-472e-ae04-5ef3876526bb req-7670334d-5cd6-4820-ace6-ed81c24aec2f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045437 Oct 24 10:34:14.594609 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1189/2295] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:14.605009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24b2ee78-2479-4ce0-9c2d-7f3775612f30 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:14.605459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24b2ee78-2479-4ce0-9c2d-7f3775612f30 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:14.605913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24b2ee78-2479-4ce0-9c2d-7f3775612f30 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:14.610390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24b2ee78-2479-4ce0-9c2d-7f3775612f30 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:14.614786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24b2ee78-2479-4ce0-9c2d-7f3775612f30 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:14.615599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24b2ee78-2479-4ce0-9c2d-7f3775612f30 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:14.720030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-77da7759-d9e9-4123-aaa0-e625d1799aec tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:14.720756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-77da7759-d9e9-4123-aaa0-e625d1799aec tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:14.736694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77da7759-d9e9-4123-aaa0-e625d1799aec tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:14.737464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77da7759-d9e9-4123-aaa0-e625d1799aec tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:14.738092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77da7759-d9e9-4123-aaa0-e625d1799aec tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:14.741905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77da7759-d9e9-4123-aaa0-e625d1799aec tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:14.745499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77da7759-d9e9-4123-aaa0-e625d1799aec tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:14.745694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77da7759-d9e9-4123-aaa0-e625d1799aec tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:15.214601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-24b2ee78-2479-4ce0-9c2d-7f3775612f30 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:15.237227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-24b2ee78-2479-4ce0-9c2d-7f3775612f30 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:15.240028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-24b2ee78-2479-4ce0-9c2d-7f3775612f30 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:15.244366 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-24b2ee78-2479-4ce0-9c2d-7f3775612f30 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1293 microversion: 2.25 time: 0.678480 Oct 24 10:34:15.246529 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1107/2296] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:14 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1293 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:15.259186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-dd757b83-8e18-4887-93ca-5b6b2dc6ae5f req-718289fa-ae6c-4a76-b912-f1527f4143d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485d2945-20d9-4620-a9e5-004680c44d43", "name": "network-vif-plugged", "status": "completed", "tag": "ceedad81-43a8-4ff1-9629-690de6218202"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:15.269067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-77da7759-d9e9-4123-aaa0-e625d1799aec tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:15.286195 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-77da7759-d9e9-4123-aaa0-e625d1799aec tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1315 microversion: 2.1 time: 0.570178 Oct 24 10:34:15.299937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-dd757b83-8e18-4887-93ca-5b6b2dc6ae5f req-718289fa-ae6c-4a76-b912-f1527f4143d3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:15.300569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-dd757b83-8e18-4887-93ca-5b6b2dc6ae5f req-718289fa-ae6c-4a76-b912-f1527f4143d3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:15.300994 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1190/2297] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:14 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:15.301124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-dd757b83-8e18-4887-93ca-5b6b2dc6ae5f req-718289fa-ae6c-4a76-b912-f1527f4143d3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:15.347305 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-dd757b83-8e18-4887-93ca-5b6b2dc6ae5f req-718289fa-ae6c-4a76-b912-f1527f4143d3 service nova] Creating event network-vif-plugged:ceedad81-43a8-4ff1-9629-690de6218202 for instance 485d2945-20d9-4620-a9e5-004680c44d43 on n-h2-858383-15 Oct 24 10:34:15.368399 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-dd757b83-8e18-4887-93ca-5b6b2dc6ae5f req-718289fa-ae6c-4a76-b912-f1527f4143d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120393 Oct 24 10:34:15.369041 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1108/2298] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:15.558168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-31c1b68f-cd60-4601-a0d1-8b2555aece46 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:15.559918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-31c1b68f-cd60-4601-a0d1-8b2555aece46 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:15.575172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31c1b68f-cd60-4601-a0d1-8b2555aece46 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:15.575804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31c1b68f-cd60-4601-a0d1-8b2555aece46 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:15.576441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31c1b68f-cd60-4601-a0d1-8b2555aece46 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:15.577449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31c1b68f-cd60-4601-a0d1-8b2555aece46 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:15.578252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31c1b68f-cd60-4601-a0d1-8b2555aece46 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:15.579054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31c1b68f-cd60-4601-a0d1-8b2555aece46 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:15.589380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9a0d03fc-42e6-49de-881e-af9e31ea0fe5 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:15.590084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9a0d03fc-42e6-49de-881e-af9e31ea0fe5 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:15.606568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a0d03fc-42e6-49de-881e-af9e31ea0fe5 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:15.607062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a0d03fc-42e6-49de-881e-af9e31ea0fe5 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:15.607500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a0d03fc-42e6-49de-881e-af9e31ea0fe5 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:15.608198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a0d03fc-42e6-49de-881e-af9e31ea0fe5 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:15.608652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a0d03fc-42e6-49de-881e-af9e31ea0fe5 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:15.609103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a0d03fc-42e6-49de-881e-af9e31ea0fe5 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:15.696185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:16.044529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-31c1b68f-cd60-4601-a0d1-8b2555aece46 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:16.054186 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-31c1b68f-cd60-4601-a0d1-8b2555aece46 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1313 microversion: 2.1 time: 0.499737 Oct 24 10:34:16.057293 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1191/2299] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:15 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:16.188110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9a0d03fc-42e6-49de-881e-af9e31ea0fe5 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:16.197389 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9a0d03fc-42e6-49de-881e-af9e31ea0fe5 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1683 microversion: 2.1 time: 0.612177 Oct 24 10:34:16.205961 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1109/2300] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:15 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1683 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:34:16.282197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d4c611aa-6040-4d32-8322-e1b17d96532a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:16.282596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d4c611aa-6040-4d32-8322-e1b17d96532a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:16.285638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=22 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:16.298131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c611aa-6040-4d32-8322-e1b17d96532a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:16.298733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c611aa-6040-4d32-8322-e1b17d96532a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:16.300959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c611aa-6040-4d32-8322-e1b17d96532a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:16.301895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c611aa-6040-4d32-8322-e1b17d96532a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:16.306842 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c611aa-6040-4d32-8322-e1b17d96532a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:16.307711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c611aa-6040-4d32-8322-e1b17d96532a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:16.318318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7a0ce40c-26f9-4d6b-badb-3916d213400f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:16.319285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7a0ce40c-26f9-4d6b-badb-3916d213400f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:16.329344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a0ce40c-26f9-4d6b-badb-3916d213400f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:16.334528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a0ce40c-26f9-4d6b-badb-3916d213400f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:16.337487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a0ce40c-26f9-4d6b-badb-3916d213400f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:16.339491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a0ce40c-26f9-4d6b-badb-3916d213400f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:16.342130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a0ce40c-26f9-4d6b-badb-3916d213400f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:16.344964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a0ce40c-26f9-4d6b-badb-3916d213400f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:16.687333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d4c611aa-6040-4d32-8322-e1b17d96532a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:16.702233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7a0ce40c-26f9-4d6b-badb-3916d213400f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:16.708681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d4c611aa-6040-4d32-8322-e1b17d96532a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:16.713938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d4c611aa-6040-4d32-8322-e1b17d96532a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:16.717173 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7a0ce40c-26f9-4d6b-badb-3916d213400f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1315 microversion: 2.1 time: 0.403238 Oct 24 10:34:16.717902 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d4c611aa-6040-4d32-8322-e1b17d96532a tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1281 microversion: 2.25 time: 0.446387 Oct 24 10:34:16.722358 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1192/2301] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:16 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1281 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:16.723531 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1110/2302] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:16 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:17.080495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7f67442b-1e13-4bdd-bf51-6fa1ca954867 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:17.081388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7f67442b-1e13-4bdd-bf51-6fa1ca954867 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:17.088559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f67442b-1e13-4bdd-bf51-6fa1ca954867 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:17.089180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f67442b-1e13-4bdd-bf51-6fa1ca954867 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:17.089681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f67442b-1e13-4bdd-bf51-6fa1ca954867 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:17.090463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f67442b-1e13-4bdd-bf51-6fa1ca954867 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:17.090978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f67442b-1e13-4bdd-bf51-6fa1ca954867 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:17.091817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f67442b-1e13-4bdd-bf51-6fa1ca954867 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:17.233957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6d4cc587-aace-4845-b125-1262769c099a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:17.235443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6d4cc587-aace-4845-b125-1262769c099a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:17.242352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d4cc587-aace-4845-b125-1262769c099a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:17.243028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d4cc587-aace-4845-b125-1262769c099a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:17.243497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d4cc587-aace-4845-b125-1262769c099a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:17.244202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d4cc587-aace-4845-b125-1262769c099a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:17.244652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d4cc587-aace-4845-b125-1262769c099a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:17.245243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d4cc587-aace-4845-b125-1262769c099a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:17.344229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7f67442b-1e13-4bdd-bf51-6fa1ca954867 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:17.366519 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7f67442b-1e13-4bdd-bf51-6fa1ca954867 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1313 microversion: 2.1 time: 0.290573 Oct 24 10:34:17.388916 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1193/2303] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:17 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:17.513894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6d4cc587-aace-4845-b125-1262769c099a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:17.520790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a50bc425-ce53-4234-bdde-c82bf4356a57 req-50faa93a-0d6e-4292-ab99-46d1a661f1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60354b63-afb2-4624-8a37-aeda3bf88672", "name": "network-vif-plugged", "status": "completed", "tag": "72f5ab98-427f-4f57-a27f-b04761c1e779"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:17.524586 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6d4cc587-aace-4845-b125-1262769c099a tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1683 microversion: 2.1 time: 0.293811 Oct 24 10:34:17.525506 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1111/2304] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:17 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1683 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:34:17.545017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a50bc425-ce53-4234-bdde-c82bf4356a57 req-50faa93a-0d6e-4292-ab99-46d1a661f1c4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:17.545498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a50bc425-ce53-4234-bdde-c82bf4356a57 req-50faa93a-0d6e-4292-ab99-46d1a661f1c4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:17.546114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a50bc425-ce53-4234-bdde-c82bf4356a57 req-50faa93a-0d6e-4292-ab99-46d1a661f1c4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:17.562028 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a50bc425-ce53-4234-bdde-c82bf4356a57 req-50faa93a-0d6e-4292-ab99-46d1a661f1c4 service nova] Creating event network-vif-plugged:72f5ab98-427f-4f57-a27f-b04761c1e779 for instance 60354b63-afb2-4624-8a37-aeda3bf88672 on n-h1-858383-15 Oct 24 10:34:17.569193 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a50bc425-ce53-4234-bdde-c82bf4356a57 req-50faa93a-0d6e-4292-ab99-46d1a661f1c4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053130 Oct 24 10:34:17.569892 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1194/2305] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:34:17.755691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-808915d3-3c49-408b-b8e4-28906d38f29c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:17.758210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-808915d3-3c49-408b-b8e4-28906d38f29c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:17.759574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d5e3b540-024e-41f0-ad26-f1d0edd9e68f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:17.761862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d5e3b540-024e-41f0-ad26-f1d0edd9e68f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:17.776717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-808915d3-3c49-408b-b8e4-28906d38f29c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:17.778108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5e3b540-024e-41f0-ad26-f1d0edd9e68f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:17.778817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5e3b540-024e-41f0-ad26-f1d0edd9e68f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:17.779738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-808915d3-3c49-408b-b8e4-28906d38f29c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:17.780387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5e3b540-024e-41f0-ad26-f1d0edd9e68f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:17.781059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-808915d3-3c49-408b-b8e4-28906d38f29c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:17.782351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5e3b540-024e-41f0-ad26-f1d0edd9e68f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:17.789438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-808915d3-3c49-408b-b8e4-28906d38f29c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:17.790015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5e3b540-024e-41f0-ad26-f1d0edd9e68f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:17.790811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-808915d3-3c49-408b-b8e4-28906d38f29c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:17.792206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5e3b540-024e-41f0-ad26-f1d0edd9e68f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:17.793002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-808915d3-3c49-408b-b8e4-28906d38f29c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:18.209468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d5e3b540-024e-41f0-ad26-f1d0edd9e68f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:18.222392 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d5e3b540-024e-41f0-ad26-f1d0edd9e68f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1315 microversion: 2.1 time: 0.475158 Oct 24 10:34:18.225167 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1195/2306] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:17 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:18.231909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d8ef5b34-859c-4a2c-91dd-86c3ec291a3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:18.233037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d8ef5b34-859c-4a2c-91dd-86c3ec291a3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:18.240659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8ef5b34-859c-4a2c-91dd-86c3ec291a3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:18.241957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8ef5b34-859c-4a2c-91dd-86c3ec291a3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:18.242574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8ef5b34-859c-4a2c-91dd-86c3ec291a3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:18.243020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-808915d3-3c49-408b-b8e4-28906d38f29c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:18.243964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8ef5b34-859c-4a2c-91dd-86c3ec291a3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:18.244764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8ef5b34-859c-4a2c-91dd-86c3ec291a3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:18.245222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8ef5b34-859c-4a2c-91dd-86c3ec291a3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:18.251964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-808915d3-3c49-408b-b8e4-28906d38f29c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:18.262025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-808915d3-3c49-408b-b8e4-28906d38f29c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:18.267047 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-808915d3-3c49-408b-b8e4-28906d38f29c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1281 microversion: 2.25 time: 0.520932 Oct 24 10:34:18.281257 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1112/2307] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:17 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1281 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:18.392457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5bc5787f-2414-436b-ba20-1aae25ace5db tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:18.393448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5bc5787f-2414-436b-ba20-1aae25ace5db tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:18.401295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bc5787f-2414-436b-ba20-1aae25ace5db tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:18.401924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bc5787f-2414-436b-ba20-1aae25ace5db tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:18.402442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bc5787f-2414-436b-ba20-1aae25ace5db tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:18.403446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bc5787f-2414-436b-ba20-1aae25ace5db tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:18.403976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bc5787f-2414-436b-ba20-1aae25ace5db tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:18.404474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bc5787f-2414-436b-ba20-1aae25ace5db tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:18.896243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d8ef5b34-859c-4a2c-91dd-86c3ec291a3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:18.908913 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d8ef5b34-859c-4a2c-91dd-86c3ec291a3c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.681996 Oct 24 10:34:18.913683 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1196/2308] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:18 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:18.922144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9034c72b-6366-45cc-9ab5-c348f03658ad tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:18.924052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9034c72b-6366-45cc-9ab5-c348f03658ad tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:18.935872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9034c72b-6366-45cc-9ab5-c348f03658ad tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:18.936279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9034c72b-6366-45cc-9ab5-c348f03658ad tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:18.936722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9034c72b-6366-45cc-9ab5-c348f03658ad tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:18.937495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9034c72b-6366-45cc-9ab5-c348f03658ad tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:18.937950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9034c72b-6366-45cc-9ab5-c348f03658ad tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:18.938485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9034c72b-6366-45cc-9ab5-c348f03658ad tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:18.943007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5bc5787f-2414-436b-ba20-1aae25ace5db tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:18.955772 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5bc5787f-2414-436b-ba20-1aae25ace5db tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1313 microversion: 2.1 time: 0.567801 Oct 24 10:34:18.956373 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1113/2309] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:18 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:34:18.962763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-eafd4931-1f04-489f-94dd-ef54111e3ef4 req-593cc305-447c-418c-b230-b76995936f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7cf3710-4f48-4dca-9dc7-076994a09380", "name": "network-vif-deleted", "tag": "b1313db3-8fe7-456f-a606-94713c638edc"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:18.976029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eafd4931-1f04-489f-94dd-ef54111e3ef4 req-593cc305-447c-418c-b230-b76995936f90 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:18.977162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eafd4931-1f04-489f-94dd-ef54111e3ef4 req-593cc305-447c-418c-b230-b76995936f90 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:18.977866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eafd4931-1f04-489f-94dd-ef54111e3ef4 req-593cc305-447c-418c-b230-b76995936f90 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:18.997220 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-eafd4931-1f04-489f-94dd-ef54111e3ef4 req-593cc305-447c-418c-b230-b76995936f90 service nova] Creating event network-vif-deleted:b1313db3-8fe7-456f-a606-94713c638edc for instance f7cf3710-4f48-4dca-9dc7-076994a09380 on n-h2-858383-15 Oct 24 10:34:19.003720 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-eafd4931-1f04-489f-94dd-ef54111e3ef4 req-593cc305-447c-418c-b230-b76995936f90 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045452 Oct 24 10:34:19.004679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9034c72b-6366-45cc-9ab5-c348f03658ad tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:19.005518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9034c72b-6366-45cc-9ab5-c348f03658ad tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:19.005801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9034c72b-6366-45cc-9ab5-c348f03658ad tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:19.006076 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1114/2310] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:19.006375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-9034c72b-6366-45cc-9ab5-c348f03658ad tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lazy-loading 'fault' on Instance uuid f7cf3710-4f48-4dca-9dc7-076994a09380 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:34:19.013762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-deb2b447-be31-48f3-827e-ad38720812d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-699738170"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:19.016586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-deb2b447-be31-48f3-827e-ad38720812d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:19.025084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-deb2b447-be31-48f3-827e-ad38720812d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:19.025584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-deb2b447-be31-48f3-827e-ad38720812d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:19.026025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-deb2b447-be31-48f3-827e-ad38720812d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:19.026950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-deb2b447-be31-48f3-827e-ad38720812d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:19.027412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-deb2b447-be31-48f3-827e-ad38720812d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:19.027839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-deb2b447-be31-48f3-827e-ad38720812d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:19.081967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9034c72b-6366-45cc-9ab5-c348f03658ad tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:19.097237 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9034c72b-6366-45cc-9ab5-c348f03658ad tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1332 microversion: 2.1 time: 0.178847 Oct 24 10:34:19.108402 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1197/2311] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:18 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1332 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:19.254042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8b650d7d-dee5-4df4-a9a6-b84a16636937 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:19.255661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8b650d7d-dee5-4df4-a9a6-b84a16636937 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:19.264555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b650d7d-dee5-4df4-a9a6-b84a16636937 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:19.265375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b650d7d-dee5-4df4-a9a6-b84a16636937 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:19.266923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b650d7d-dee5-4df4-a9a6-b84a16636937 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:19.268472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b650d7d-dee5-4df4-a9a6-b84a16636937 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:19.269221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b650d7d-dee5-4df4-a9a6-b84a16636937 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:19.269892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b650d7d-dee5-4df4-a9a6-b84a16636937 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:19.318508 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-deb2b447-be31-48f3-827e-ad38720812d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 202 len: 0 microversion: 2.1 time: 0.308142 Oct 24 10:34:19.319977 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1115/2312] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:34:19 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 24 10:34:19.328071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3b67c613-72b2-4544-b50b-e90a0c0f6dd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:19.328791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3b67c613-72b2-4544-b50b-e90a0c0f6dd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:19.337104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b67c613-72b2-4544-b50b-e90a0c0f6dd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:19.337827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b67c613-72b2-4544-b50b-e90a0c0f6dd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:19.338469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b67c613-72b2-4544-b50b-e90a0c0f6dd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:19.339351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b67c613-72b2-4544-b50b-e90a0c0f6dd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:19.339956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b67c613-72b2-4544-b50b-e90a0c0f6dd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:19.340539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b67c613-72b2-4544-b50b-e90a0c0f6dd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:19.478455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8b650d7d-dee5-4df4-a9a6-b84a16636937 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:19.491251 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8b650d7d-dee5-4df4-a9a6-b84a16636937 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1315 microversion: 2.1 time: 0.241163 Oct 24 10:34:19.492253 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1198/2313] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:19 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:19.907794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3b67c613-72b2-4544-b50b-e90a0c0f6dd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:19.917917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3b67c613-72b2-4544-b50b-e90a0c0f6dd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:19.920255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3b67c613-72b2-4544-b50b-e90a0c0f6dd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:19.921783 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3b67c613-72b2-4544-b50b-e90a0c0f6dd2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1281 microversion: 2.25 time: 0.600649 Oct 24 10:34:19.922572 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1116/2314] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:19 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1281 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:19.984516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-16517fe9-a772-46f5-8cb9-510869233cba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:19.985306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-16517fe9-a772-46f5-8cb9-510869233cba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:19.992170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16517fe9-a772-46f5-8cb9-510869233cba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:19.992717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16517fe9-a772-46f5-8cb9-510869233cba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:19.993165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16517fe9-a772-46f5-8cb9-510869233cba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:19.993909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16517fe9-a772-46f5-8cb9-510869233cba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:19.994382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16517fe9-a772-46f5-8cb9-510869233cba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:19.994759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16517fe9-a772-46f5-8cb9-510869233cba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:20.000320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:20.126707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ac3ed77b-3af2-44bf-ae3f-329ab07b14d8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:20.127918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ac3ed77b-3af2-44bf-ae3f-329ab07b14d8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:20.141457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac3ed77b-3af2-44bf-ae3f-329ab07b14d8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:20.142967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac3ed77b-3af2-44bf-ae3f-329ab07b14d8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:20.143918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac3ed77b-3af2-44bf-ae3f-329ab07b14d8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:20.144659 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac3ed77b-3af2-44bf-ae3f-329ab07b14d8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:20.145743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac3ed77b-3af2-44bf-ae3f-329ab07b14d8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:20.146185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac3ed77b-3af2-44bf-ae3f-329ab07b14d8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:20.170458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-16517fe9-a772-46f5-8cb9-510869233cba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:20.181155 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-16517fe9-a772-46f5-8cb9-510869233cba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1463 microversion: 2.1 time: 0.200423 Oct 24 10:34:20.184509 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1199/2315] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:19 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1463 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:20.196867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac3ed77b-3af2-44bf-ae3f-329ab07b14d8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:20.197361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac3ed77b-3af2-44bf-ae3f-329ab07b14d8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:20.197806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac3ed77b-3af2-44bf-ae3f-329ab07b14d8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:20.198263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-ac3ed77b-3af2-44bf-ae3f-329ab07b14d8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lazy-loading 'fault' on Instance uuid f7cf3710-4f48-4dca-9dc7-076994a09380 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:34:20.204481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-74fde4ff-ed3d-4ff6-bf4c-8b998107abdf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:20.205133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-74fde4ff-ed3d-4ff6-bf4c-8b998107abdf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:20.212607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-74fde4ff-ed3d-4ff6-bf4c-8b998107abdf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:20.213131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-74fde4ff-ed3d-4ff6-bf4c-8b998107abdf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:20.213729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-74fde4ff-ed3d-4ff6-bf4c-8b998107abdf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:20.214588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-74fde4ff-ed3d-4ff6-bf4c-8b998107abdf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:20.215060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-74fde4ff-ed3d-4ff6-bf4c-8b998107abdf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:20.215498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-74fde4ff-ed3d-4ff6-bf4c-8b998107abdf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:20.273693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ac3ed77b-3af2-44bf-ae3f-329ab07b14d8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761ab93565de4e07a19489ce7f479735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37320b68ea0d4d8ab38ba0cd4a3f3f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:20.282340 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ac3ed77b-3af2-44bf-ae3f-329ab07b14d8 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 200 len: 1332 microversion: 2.1 time: 0.161628 Oct 24 10:34:20.282908 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1117/2316] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:20 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 1332 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:34:20.385123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-74fde4ff-ed3d-4ff6-bf4c-8b998107abdf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:20.400087 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-74fde4ff-ed3d-4ff6-bf4c-8b998107abdf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1463 microversion: 2.1 time: 0.199293 Oct 24 10:34:20.405274 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1200/2317] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:20 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1463 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:34:20.516015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-58f459fd-e7de-473f-b309-3c7ef534a849 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:20.522505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6f444fcd-58a3-4e39-b82a-eae70249838a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1666583633", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "485d2945-20d9-4620-a9e5-004680c44d43"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:20.523958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-58f459fd-e7de-473f-b309-3c7ef534a849 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:20.542380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58f459fd-e7de-473f-b309-3c7ef534a849 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:20.543341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58f459fd-e7de-473f-b309-3c7ef534a849 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:20.543977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58f459fd-e7de-473f-b309-3c7ef534a849 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:20.545016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58f459fd-e7de-473f-b309-3c7ef534a849 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:20.546969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58f459fd-e7de-473f-b309-3c7ef534a849 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:20.547613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58f459fd-e7de-473f-b309-3c7ef534a849 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:20.618226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-6f444fcd-58a3-4e39-b82a-eae70249838a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:34:20.852745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-58f459fd-e7de-473f-b309-3c7ef534a849 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:20.861507 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-58f459fd-e7de-473f-b309-3c7ef534a849 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1315 microversion: 2.1 time: 0.349789 Oct 24 10:34:20.863157 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1118/2318] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:20 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:20.947675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f76b5ea7-5f7f-4590-a86a-c628055a6bee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:20.948385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f76b5ea7-5f7f-4590-a86a-c628055a6bee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:20.955302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f76b5ea7-5f7f-4590-a86a-c628055a6bee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:20.955788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f76b5ea7-5f7f-4590-a86a-c628055a6bee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:20.956243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6f444fcd-58a3-4e39-b82a-eae70249838a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:34:20.956732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6f444fcd-58a3-4e39-b82a-eae70249838a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:34:20.956859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f76b5ea7-5f7f-4590-a86a-c628055a6bee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:20.957346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6f444fcd-58a3-4e39-b82a-eae70249838a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:34:20.957647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f76b5ea7-5f7f-4590-a86a-c628055a6bee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:20.957971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6f444fcd-58a3-4e39-b82a-eae70249838a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:34:20.958270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f76b5ea7-5f7f-4590-a86a-c628055a6bee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:20.958601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6f444fcd-58a3-4e39-b82a-eae70249838a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:34:20.958878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f76b5ea7-5f7f-4590-a86a-c628055a6bee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:20.968153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f444fcd-58a3-4e39-b82a-eae70249838a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:20.969045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f444fcd-58a3-4e39-b82a-eae70249838a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:20.969681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f444fcd-58a3-4e39-b82a-eae70249838a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:20.970728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f444fcd-58a3-4e39-b82a-eae70249838a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:20.971376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f444fcd-58a3-4e39-b82a-eae70249838a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:20.972012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f444fcd-58a3-4e39-b82a-eae70249838a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:20.996675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-6f444fcd-58a3-4e39-b82a-eae70249838a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Getting quotas for project ddcca0b4ac864e36a9732a13c93171d3. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:34:21.003446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-6f444fcd-58a3-4e39-b82a-eae70249838a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Getting quotas for user 5ab9827c96bb42fa8975d46618243d33 and project ddcca0b4ac864e36a9732a13c93171d3. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:34:21.022650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6f444fcd-58a3-4e39-b82a-eae70249838a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:34:21.026121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6f444fcd-58a3-4e39-b82a-eae70249838a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:34:21.093844 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6f444fcd-58a3-4e39-b82a-eae70249838a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575735 Oct 24 10:34:21.101541 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1201/2319] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:34:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 10:34:21.128120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-211db5a5-dfee-4764-bab4-554979174238 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:21.133766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-211db5a5-dfee-4764-bab4-554979174238 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:21.151857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f76b5ea7-5f7f-4590-a86a-c628055a6bee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:21.161233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f76b5ea7-5f7f-4590-a86a-c628055a6bee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:21.166916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f76b5ea7-5f7f-4590-a86a-c628055a6bee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:21.168968 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f76b5ea7-5f7f-4590-a86a-c628055a6bee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1281 microversion: 2.25 time: 0.224386 Oct 24 10:34:21.188151 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1119/2320] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:20 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1281 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:21.204721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-211db5a5-dfee-4764-bab4-554979174238 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:21.213886 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-211db5a5-dfee-4764-bab4-554979174238 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5" status: 200 len: 1214 microversion: 2.1 time: 0.109046 Oct 24 10:34:21.214790 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1202/2321] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:21 2022] GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5 => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:21.307099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eb00f9b4-7be0-4c06-bbec-21d05bb38785 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:21.313580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eb00f9b4-7be0-4c06-bbec-21d05bb38785 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:21.329865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb00f9b4-7be0-4c06-bbec-21d05bb38785 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:21.330510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb00f9b4-7be0-4c06-bbec-21d05bb38785 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:21.330967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb00f9b4-7be0-4c06-bbec-21d05bb38785 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:21.331697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb00f9b4-7be0-4c06-bbec-21d05bb38785 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:21.332262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb00f9b4-7be0-4c06-bbec-21d05bb38785 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:21.332916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb00f9b4-7be0-4c06-bbec-21d05bb38785 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:21.338140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:21.350604 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-eb00f9b4-7be0-4c06-bbec-21d05bb38785 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] HTTP exception thrown: Instance f7cf3710-4f48-4dca-9dc7-076994a09380 could not be found. Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eb00f9b4-7be0-4c06-bbec-21d05bb38785 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Request method failure captured: Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 HTTP/1.1 Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmleeR96sL8coeavtta6IWofolwEjRo9REaJ-ogVTGzbtwUHteDLAuHBWQq9Z5GdCHlRFt-o3nhJkxOpB8OjF3x0EfAlbqhwWVI4fVag77lc_GSMifoFfhimsGU4f6bHEWdiioWwZbvc5ej-nnwjzlkgcAKa3WDBf4DD8mogRuHZR1A Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 37320b68ea0d4d8ab38ba0cd4a3f3f55 Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-53460477 Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/37320b68ea0d4d8ab38ba0cd4a3f3f55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/37320b68ea0d4d8ab38ba0cd4a3f3f55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/37320b68ea0d4d8ab38ba0cd4a3f3f55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_37320b68ea0d4d8ab38ba0cd4a3f3f55", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-53460477 Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 37320b68ea0d4d8ab38ba0cd4a3f3f55 Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-53460477 Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AttachSCSIVolumeTestJSON-53460477-project Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 761ab93565de4e07a19489ce7f479735 Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-53460477-project Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance f7cf3710-4f48-4dca-9dc7-076994a09380 could not be found. Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'f7cf3710-4f48-4dca-9dc7-076994a09380'} Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7cf3710-4f48-4dca-9dc7-076994a09380 could not be found. Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7cf3710-4f48-4dca-9dc7-076994a09380 could not be found. Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:21.352501 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:21.358464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:21.358464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:21.358464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:21.358464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:34:21.358464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:34:21.358464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7cf3710-4f48-4dca-9dc7-076994a09380 could not be found. Oct 24 10:34:21.358464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:21.358464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eb00f9b4-7be0-4c06-bbec-21d05bb38785 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Returning 404 to user: Instance f7cf3710-4f48-4dca-9dc7-076994a09380 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:34:21.358464 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eb00f9b4-7be0-4c06-bbec-21d05bb38785 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 404 len: 111 microversion: 2.1 time: 0.052312 Oct 24 10:34:21.358464 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1120/2322] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:21 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:34:21.364562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8caf1ab0-6d32-4653-99db-e2a6bdf1d6ec tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '.version_select at 0x7f04d0f7ff70>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:21.384678 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8caf1ab0-6d32-4653-99db-e2a6bdf1d6ec tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2116530247" status: 202 len: 0 microversion: 2.1 time: 0.024586 Oct 24 10:34:21.385411 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1203/2323] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Oct 24 10:34:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2116530247 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:34:21.887484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0f3edcb9-d035-482d-bbc7-07423cca7f7b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:21.888366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0f3edcb9-d035-482d-bbc7-07423cca7f7b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:21.896548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f3edcb9-d035-482d-bbc7-07423cca7f7b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:21.897466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f3edcb9-d035-482d-bbc7-07423cca7f7b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:21.898226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f3edcb9-d035-482d-bbc7-07423cca7f7b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:21.899192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f3edcb9-d035-482d-bbc7-07423cca7f7b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:21.899869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f3edcb9-d035-482d-bbc7-07423cca7f7b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:21.900383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f3edcb9-d035-482d-bbc7-07423cca7f7b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:22.069490 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0f3edcb9-d035-482d-bbc7-07423cca7f7b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:22.078135 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0f3edcb9-d035-482d-bbc7-07423cca7f7b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1315 microversion: 2.1 time: 0.194793 Oct 24 10:34:22.079008 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1121/2324] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:21 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:22.199602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d38b206c-670f-449c-babd-6172bd6938b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:22.200532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d38b206c-670f-449c-babd-6172bd6938b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:22.210530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d38b206c-670f-449c-babd-6172bd6938b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:22.211208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d38b206c-670f-449c-babd-6172bd6938b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:22.213212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d38b206c-670f-449c-babd-6172bd6938b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:22.214477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d38b206c-670f-449c-babd-6172bd6938b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:22.215196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d38b206c-670f-449c-babd-6172bd6938b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:22.215988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d38b206c-670f-449c-babd-6172bd6938b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:22.239261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8655869f-8e8b-4b7a-afab-7d0a3823aca8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:22.240687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8655869f-8e8b-4b7a-afab-7d0a3823aca8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:22.252060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8655869f-8e8b-4b7a-afab-7d0a3823aca8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:22.253591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8655869f-8e8b-4b7a-afab-7d0a3823aca8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:22.256320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8655869f-8e8b-4b7a-afab-7d0a3823aca8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:22.258358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8655869f-8e8b-4b7a-afab-7d0a3823aca8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:22.259111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8655869f-8e8b-4b7a-afab-7d0a3823aca8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:22.259886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8655869f-8e8b-4b7a-afab-7d0a3823aca8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:22.368679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8655869f-8e8b-4b7a-afab-7d0a3823aca8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:22.388404 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8655869f-8e8b-4b7a-afab-7d0a3823aca8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5" status: 200 len: 1266 microversion: 2.1 time: 0.152864 Oct 24 10:34:22.405765 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1122/2325] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:22 2022] GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:22.483395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d38b206c-670f-449c-babd-6172bd6938b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:22.492954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d38b206c-670f-449c-babd-6172bd6938b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:22.494808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d38b206c-670f-449c-babd-6172bd6938b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:22.496136 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d38b206c-670f-449c-babd-6172bd6938b0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1281 microversion: 2.25 time: 0.303908 Oct 24 10:34:22.497426 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1204/2326] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:22 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1281 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:22.812486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-fba9d7c8-8608-474f-9432-2172413014cb req-102dc1aa-42cd-47a5-82d2-17ade285cfdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513ca608-24c9-45f9-8fb9-e231d92c7262", "name": "network-vif-unplugged", "status": "completed", "tag": "b2def801-647c-479d-9e34-cb0b4d60448e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:22.834881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fba9d7c8-8608-474f-9432-2172413014cb req-102dc1aa-42cd-47a5-82d2-17ade285cfdb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:22.835387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fba9d7c8-8608-474f-9432-2172413014cb req-102dc1aa-42cd-47a5-82d2-17ade285cfdb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:22.835860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fba9d7c8-8608-474f-9432-2172413014cb req-102dc1aa-42cd-47a5-82d2-17ade285cfdb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:22.859015 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-fba9d7c8-8608-474f-9432-2172413014cb req-102dc1aa-42cd-47a5-82d2-17ade285cfdb service nova] Creating event network-vif-unplugged:b2def801-647c-479d-9e34-cb0b4d60448e for instance 513ca608-24c9-45f9-8fb9-e231d92c7262 on n-h2-858383-15 Oct 24 10:34:22.870771 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-fba9d7c8-8608-474f-9432-2172413014cb req-102dc1aa-42cd-47a5-82d2-17ade285cfdb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063053 Oct 24 10:34:22.871579 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1123/2327] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:23.105134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-87fc44c0-8101-4e33-a419-a0961c0036cb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:23.106004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-87fc44c0-8101-4e33-a419-a0961c0036cb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:23.118854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87fc44c0-8101-4e33-a419-a0961c0036cb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:23.128749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87fc44c0-8101-4e33-a419-a0961c0036cb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:23.129759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87fc44c0-8101-4e33-a419-a0961c0036cb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:23.131784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87fc44c0-8101-4e33-a419-a0961c0036cb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:23.132723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87fc44c0-8101-4e33-a419-a0961c0036cb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:23.133361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87fc44c0-8101-4e33-a419-a0961c0036cb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:23.386710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-87fc44c0-8101-4e33-a419-a0961c0036cb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:23.415694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3984b0e2-4fd9-4284-a57c-8a706fc7089a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:23.418044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3984b0e2-4fd9-4284-a57c-8a706fc7089a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:23.435019 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-87fc44c0-8101-4e33-a419-a0961c0036cb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1315 microversion: 2.1 time: 0.334671 Oct 24 10:34:23.441952 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1205/2328] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:23 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:23.448718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3984b0e2-4fd9-4284-a57c-8a706fc7089a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:23.450338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3984b0e2-4fd9-4284-a57c-8a706fc7089a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:23.452324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3984b0e2-4fd9-4284-a57c-8a706fc7089a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:23.454372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3984b0e2-4fd9-4284-a57c-8a706fc7089a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:23.455461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3984b0e2-4fd9-4284-a57c-8a706fc7089a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:23.458843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3984b0e2-4fd9-4284-a57c-8a706fc7089a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:23.528691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7cf96747-5cba-40b2-a49f-b27933aa8675 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:23.529872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7cf96747-5cba-40b2-a49f-b27933aa8675 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:23.540958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cf96747-5cba-40b2-a49f-b27933aa8675 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:23.553610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cf96747-5cba-40b2-a49f-b27933aa8675 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:23.554435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cf96747-5cba-40b2-a49f-b27933aa8675 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:23.556334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cf96747-5cba-40b2-a49f-b27933aa8675 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:23.558631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cf96747-5cba-40b2-a49f-b27933aa8675 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:23.561550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cf96747-5cba-40b2-a49f-b27933aa8675 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:23.590142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3984b0e2-4fd9-4284-a57c-8a706fc7089a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:23.606310 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3984b0e2-4fd9-4284-a57c-8a706fc7089a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5" status: 200 len: 1272 microversion: 2.1 time: 0.195977 Oct 24 10:34:23.616886 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1124/2329] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:23 2022] GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5 => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:34:23.910250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7cf96747-5cba-40b2-a49f-b27933aa8675 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:23.936464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7cf96747-5cba-40b2-a49f-b27933aa8675 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:23.941259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7cf96747-5cba-40b2-a49f-b27933aa8675 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:23.948747 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7cf96747-5cba-40b2-a49f-b27933aa8675 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1281 microversion: 2.25 time: 0.428022 Oct 24 10:34:23.949412 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1206/2330] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:23 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1281 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:34:24.096494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cea9403b-004b-4106-99d5-612c695c1490 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5b00a027-fd08-4947-8648-83a98d65c84c"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:24.100253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cea9403b-004b-4106-99d5-612c695c1490 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:24.112420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cea9403b-004b-4106-99d5-612c695c1490 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:24.116917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cea9403b-004b-4106-99d5-612c695c1490 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:24.117739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cea9403b-004b-4106-99d5-612c695c1490 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:24.120280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cea9403b-004b-4106-99d5-612c695c1490 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:24.120754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cea9403b-004b-4106-99d5-612c695c1490 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:24.121349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cea9403b-004b-4106-99d5-612c695c1490 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:24.315487 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-cea9403b-004b-4106-99d5-612c695c1490 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] HTTP exception thrown: Volume 5b00a027-fd08-4947-8648-83a98d65c84c could not be found. Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cea9403b-004b-4106-99d5-612c695c1490 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] Request method failure captured: Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: request: PUT /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments/f83c57ca-b734-4c6d-8da5-120a4eaac68e HTTP/1.1 Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 74 Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmmIHpOAZ4NMsZ1sVf1-OdcvEKc2DWxYiNwGUiKVqqs1_fGNvH6iIqLHrMrpSEZ3Z6t2rFG1krgN8UWki85p-xzr-nK4aW9056NP6RQVTXMobSVFkO5FWIgdpl1qnFgObQmnM5z3QEC31k12Kebtu2A3sqJEz3jKiOzeErnqldu2aEQ Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 09d8c73d56ca4b03881b78ecf50ae23a Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesAdminNegativeTest-82074864 Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/09d8c73d56ca4b03881b78ecf50ae23a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/09d8c73d56ca4b03881b78ecf50ae23a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/09d8c73d56ca4b03881b78ecf50ae23a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_09d8c73d56ca4b03881b78ecf50ae23a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-VolumesAdminNegativeTest-82074864 Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 09d8c73d56ca4b03881b78ecf50ae23a Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-82074864 Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-VolumesAdminNegativeTest-82074864-project-admin Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5d5d10c152f5439894b4aca72763e0d5 Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-VolumesAdminNegativeTest-82074864-project-admin Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: {"volumeAttachment": {"volumeId": "5b00a027-fd08-4947-8648-83a98d65c84c"}} Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: exception: Volume 5b00a027-fd08-4947-8648-83a98d65c84c could not be found. Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'server_id': 'a8832f22-83eb-47c3-8597-614ff8f28ecf', 'id': 'f83c57ca-b734-4c6d-8da5-120a4eaac68e', 'body': {'volumeAttachment': {'volumeId': '5b00a027-fd08-4947-8648-83a98d65c84c'}}} Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b00a027-fd08-4947-8648-83a98d65c84c could not be found. (HTTP 404) (Request-ID: req-5e651f4c-39c4-4e70-905d-267b9f6e1fb4) Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 10:34:24.359243 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b00a027-fd08-4947-8648-83a98d65c84c could not be found. Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 5b00a027-fd08-4947-8648-83a98d65c84c could not be found. Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b00a027-fd08-4947-8648-83a98d65c84c could not be found. Oct 24 10:34:24.363425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:24.368196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cea9403b-004b-4106-99d5-612c695c1490 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] Returning 400 to user: Volume 5b00a027-fd08-4947-8648-83a98d65c84c could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:34:24.369390 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cea9403b-004b-4106-99d5-612c695c1490 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] 10.222.0.50 "PUT /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments/f83c57ca-b734-4c6d-8da5-120a4eaac68e" status: 400 len: 107 microversion: 2.1 time: 0.673930 Oct 24 10:34:24.370115 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1125/2331] 10.222.0.50 () {60 vars in 1433 bytes} [Mon Oct 24 10:34:23 2022] PUT /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments/f83c57ca-b734-4c6d-8da5-120a4eaac68e => generated 107 bytes in 675 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:34:24.469375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7adffa23-6796-4bad-bb6a-74322b18bb42 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:24.470173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7adffa23-6796-4bad-bb6a-74322b18bb42 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:24.476084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8ef08e8c-56bc-49ff-9d11-ae7fb7de946f tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:24.477173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8ef08e8c-56bc-49ff-9d11-ae7fb7de946f tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:24.484546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adffa23-6796-4bad-bb6a-74322b18bb42 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:24.485096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adffa23-6796-4bad-bb6a-74322b18bb42 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:24.487026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ef08e8c-56bc-49ff-9d11-ae7fb7de946f tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:24.487713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ef08e8c-56bc-49ff-9d11-ae7fb7de946f tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:24.487977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adffa23-6796-4bad-bb6a-74322b18bb42 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:24.488744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ef08e8c-56bc-49ff-9d11-ae7fb7de946f tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:24.489035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adffa23-6796-4bad-bb6a-74322b18bb42 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:24.489586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adffa23-6796-4bad-bb6a-74322b18bb42 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:24.490345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ef08e8c-56bc-49ff-9d11-ae7fb7de946f tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:24.491153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ef08e8c-56bc-49ff-9d11-ae7fb7de946f tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:24.491808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ef08e8c-56bc-49ff-9d11-ae7fb7de946f tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:24.494656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adffa23-6796-4bad-bb6a-74322b18bb42 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:24.653744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-8ef08e8c-56bc-49ff-9d11-ae7fb7de946f tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lazy-loading 'services' on Instance uuid a8832f22-83eb-47c3-8597-614ff8f28ecf {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:34:24.845694 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8ef08e8c-56bc-49ff-9d11-ae7fb7de946f tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments/f83c57ca-b734-4c6d-8da5-120a4eaac68e" status: 202 len: 0 microversion: 2.1 time: 0.374222 Oct 24 10:34:24.846703 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1126/2332] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 10:34:24 2022] DELETE /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments/f83c57ca-b734-4c6d-8da5-120a4eaac68e => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:34:24.880707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7adffa23-6796-4bad-bb6a-74322b18bb42 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:24.883190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-de78ad17-290d-4db3-bc90-bdcce719c99d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:24.890859 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7adffa23-6796-4bad-bb6a-74322b18bb42 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1315 microversion: 2.1 time: 0.430135 Oct 24 10:34:24.893330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-de78ad17-290d-4db3-bc90-bdcce719c99d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:24.904087 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1207/2333] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:24 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:24.912383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-41035508-0843-4018-9f33-41fcd7eaf1ef tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:24.915851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-41035508-0843-4018-9f33-41fcd7eaf1ef tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:24.919970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de78ad17-290d-4db3-bc90-bdcce719c99d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:24.924600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de78ad17-290d-4db3-bc90-bdcce719c99d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:24.926780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de78ad17-290d-4db3-bc90-bdcce719c99d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:24.929854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de78ad17-290d-4db3-bc90-bdcce719c99d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:24.930361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de78ad17-290d-4db3-bc90-bdcce719c99d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:24.930811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de78ad17-290d-4db3-bc90-bdcce719c99d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:24.946691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41035508-0843-4018-9f33-41fcd7eaf1ef tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:24.951046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41035508-0843-4018-9f33-41fcd7eaf1ef tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:24.952504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41035508-0843-4018-9f33-41fcd7eaf1ef tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:24.954650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41035508-0843-4018-9f33-41fcd7eaf1ef tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:24.955990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41035508-0843-4018-9f33-41fcd7eaf1ef tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:24.962368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41035508-0843-4018-9f33-41fcd7eaf1ef tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:25.050160 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-41035508-0843-4018-9f33-41fcd7eaf1ef tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142074 Oct 24 10:34:25.051072 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1208/2334] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:34:24 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:25.056594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c8cf15bd-775f-4e11-bc8c-cb6b9b7c787d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:25.057591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c8cf15bd-775f-4e11-bc8c-cb6b9b7c787d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:25.071113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8cf15bd-775f-4e11-bc8c-cb6b9b7c787d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:25.071973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8cf15bd-775f-4e11-bc8c-cb6b9b7c787d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:25.072648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8cf15bd-775f-4e11-bc8c-cb6b9b7c787d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:25.075166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8cf15bd-775f-4e11-bc8c-cb6b9b7c787d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:25.077082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8cf15bd-775f-4e11-bc8c-cb6b9b7c787d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:25.083727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8cf15bd-775f-4e11-bc8c-cb6b9b7c787d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:25.382871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-de78ad17-290d-4db3-bc90-bdcce719c99d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:25.397217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c8cf15bd-775f-4e11-bc8c-cb6b9b7c787d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:25.397503 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-de78ad17-290d-4db3-bc90-bdcce719c99d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5" status: 200 len: 1314 microversion: 2.1 time: 0.532981 Oct 24 10:34:25.398100 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1127/2335] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:24 2022] GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5 => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:25.416482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c8cf15bd-775f-4e11-bc8c-cb6b9b7c787d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:25.422670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c8cf15bd-775f-4e11-bc8c-cb6b9b7c787d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:25.425808 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c8cf15bd-775f-4e11-bc8c-cb6b9b7c787d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1281 microversion: 2.25 time: 0.372786 Oct 24 10:34:25.429879 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1209/2336] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:25 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1281 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:25.930883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-32fdbf85-7439-490a-9136-881e08794f3c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:25.932082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-32fdbf85-7439-490a-9136-881e08794f3c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:25.949578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32fdbf85-7439-490a-9136-881e08794f3c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:25.951923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32fdbf85-7439-490a-9136-881e08794f3c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:25.954276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32fdbf85-7439-490a-9136-881e08794f3c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:25.958957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32fdbf85-7439-490a-9136-881e08794f3c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:25.960068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32fdbf85-7439-490a-9136-881e08794f3c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:25.960693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32fdbf85-7439-490a-9136-881e08794f3c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:26.068898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b80345ed-c4a8-4202-a69a-93d6836f3d57 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:26.071634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b80345ed-c4a8-4202-a69a-93d6836f3d57 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:26.095099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b80345ed-c4a8-4202-a69a-93d6836f3d57 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:26.099557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b80345ed-c4a8-4202-a69a-93d6836f3d57 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:26.100738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b80345ed-c4a8-4202-a69a-93d6836f3d57 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:26.101824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b80345ed-c4a8-4202-a69a-93d6836f3d57 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:26.105580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b80345ed-c4a8-4202-a69a-93d6836f3d57 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:26.108261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b80345ed-c4a8-4202-a69a-93d6836f3d57 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:26.200546 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b80345ed-c4a8-4202-a69a-93d6836f3d57 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141132 Oct 24 10:34:26.208007 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1210/2337] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:34:26 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:26.232275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-8c864e5c-f4ab-4a96-9bba-3afbedfc5e19 req-8cfc877d-fc98-4fee-b231-5fcc44e613c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25185635-1966-4f64-8616-7698ea9e04c5", "tag": "3b489847-d634-4d76-a8f5-79292a60ebab"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:26.263779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8c864e5c-f4ab-4a96-9bba-3afbedfc5e19 req-8cfc877d-fc98-4fee-b231-5fcc44e613c0 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:26.265267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8c864e5c-f4ab-4a96-9bba-3afbedfc5e19 req-8cfc877d-fc98-4fee-b231-5fcc44e613c0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:26.266980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8c864e5c-f4ab-4a96-9bba-3afbedfc5e19 req-8cfc877d-fc98-4fee-b231-5fcc44e613c0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:26.297689 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-8c864e5c-f4ab-4a96-9bba-3afbedfc5e19 req-8cfc877d-fc98-4fee-b231-5fcc44e613c0 service nova] Creating event network-changed:3b489847-d634-4d76-a8f5-79292a60ebab for instance 25185635-1966-4f64-8616-7698ea9e04c5 on n-h2-858383-15 Oct 24 10:34:26.311432 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-8c864e5c-f4ab-4a96-9bba-3afbedfc5e19 req-8cfc877d-fc98-4fee-b231-5fcc44e613c0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086583 Oct 24 10:34:26.314042 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1211/2338] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:26.407974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-32fdbf85-7439-490a-9136-881e08794f3c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:26.424235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5f80486f-9f1a-4b62-87e8-c0f7dda0035e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:26.425483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5f80486f-9f1a-4b62-87e8-c0f7dda0035e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:26.437512 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-32fdbf85-7439-490a-9136-881e08794f3c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1315 microversion: 2.1 time: 0.510974 Oct 24 10:34:26.442343 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1128/2339] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:25 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:26.452769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f80486f-9f1a-4b62-87e8-c0f7dda0035e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:26.455513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f80486f-9f1a-4b62-87e8-c0f7dda0035e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:26.455990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f80486f-9f1a-4b62-87e8-c0f7dda0035e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:26.457976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f80486f-9f1a-4b62-87e8-c0f7dda0035e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:26.466577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-863d46e2-9eeb-498d-8f0d-8735122a1429 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:26.467554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f80486f-9f1a-4b62-87e8-c0f7dda0035e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:26.468118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f80486f-9f1a-4b62-87e8-c0f7dda0035e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:26.469626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-863d46e2-9eeb-498d-8f0d-8735122a1429 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:26.507777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-863d46e2-9eeb-498d-8f0d-8735122a1429 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:26.508495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-863d46e2-9eeb-498d-8f0d-8735122a1429 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:26.508986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-863d46e2-9eeb-498d-8f0d-8735122a1429 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:26.509949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-863d46e2-9eeb-498d-8f0d-8735122a1429 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:26.510423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-863d46e2-9eeb-498d-8f0d-8735122a1429 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:26.510860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-863d46e2-9eeb-498d-8f0d-8735122a1429 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:27.087269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5f80486f-9f1a-4b62-87e8-c0f7dda0035e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:27.100601 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5f80486f-9f1a-4b62-87e8-c0f7dda0035e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5" status: 200 len: 1314 microversion: 2.1 time: 0.681008 Oct 24 10:34:27.101244 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1212/2340] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:26 2022] GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5 => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:34:27.214434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7524cf8c-f94a-495f-be8f-343e83e778f9 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:27.216800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7524cf8c-f94a-495f-be8f-343e83e778f9 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:27.242530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7524cf8c-f94a-495f-be8f-343e83e778f9 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:27.244223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7524cf8c-f94a-495f-be8f-343e83e778f9 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:27.245245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7524cf8c-f94a-495f-be8f-343e83e778f9 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:27.248681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7524cf8c-f94a-495f-be8f-343e83e778f9 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:27.249400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7524cf8c-f94a-495f-be8f-343e83e778f9 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:27.255509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7524cf8c-f94a-495f-be8f-343e83e778f9 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:27.340867 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7524cf8c-f94a-495f-be8f-343e83e778f9 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130550 Oct 24 10:34:27.341479 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1213/2341] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:34:27 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:34:27.453245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-83435c44-a8d8-4a46-b356-21f558c86156 req-ea2489f8-691b-4610-9d0b-5e4183d558d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d", "name": "network-vif-plugged", "status": "completed", "tag": "4787ea89-a905-45b9-ba75-416fa72d12e3"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:27.482544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-83435c44-a8d8-4a46-b356-21f558c86156 req-ea2489f8-691b-4610-9d0b-5e4183d558d2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:27.484321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-83435c44-a8d8-4a46-b356-21f558c86156 req-ea2489f8-691b-4610-9d0b-5e4183d558d2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:27.487532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-83435c44-a8d8-4a46-b356-21f558c86156 req-ea2489f8-691b-4610-9d0b-5e4183d558d2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:27.529574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-863d46e2-9eeb-498d-8f0d-8735122a1429 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:27.539585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-863d46e2-9eeb-498d-8f0d-8735122a1429 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:27.547342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-863d46e2-9eeb-498d-8f0d-8735122a1429 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:27.548759 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-863d46e2-9eeb-498d-8f0d-8735122a1429 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1281 microversion: 2.25 time: 1.088760 Oct 24 10:34:27.552472 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1129/2342] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:26 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1281 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:27.555365 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-83435c44-a8d8-4a46-b356-21f558c86156 req-ea2489f8-691b-4610-9d0b-5e4183d558d2 service nova] Creating event network-vif-plugged:4787ea89-a905-45b9-ba75-416fa72d12e3 for instance c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d on n-h1-858383-15 Oct 24 10:34:27.564168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7d4637a8-95c0-4ad7-b65c-92d1ca1e8a4e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:27.567662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7d4637a8-95c0-4ad7-b65c-92d1ca1e8a4e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:27.580141 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-83435c44-a8d8-4a46-b356-21f558c86156 req-ea2489f8-691b-4610-9d0b-5e4183d558d2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128017 Oct 24 10:34:27.581375 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1214/2343] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:34:27.585048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d4637a8-95c0-4ad7-b65c-92d1ca1e8a4e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:27.585962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d4637a8-95c0-4ad7-b65c-92d1ca1e8a4e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:27.586570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d4637a8-95c0-4ad7-b65c-92d1ca1e8a4e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:27.593525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d4637a8-95c0-4ad7-b65c-92d1ca1e8a4e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:27.594272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d4637a8-95c0-4ad7-b65c-92d1ca1e8a4e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:27.594905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d4637a8-95c0-4ad7-b65c-92d1ca1e8a4e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:28.149303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a373132d-3552-4191-9eca-941e3067138a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:28.150710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a373132d-3552-4191-9eca-941e3067138a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:28.167015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a373132d-3552-4191-9eca-941e3067138a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:28.170489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a373132d-3552-4191-9eca-941e3067138a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:28.171158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a373132d-3552-4191-9eca-941e3067138a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:28.173483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a373132d-3552-4191-9eca-941e3067138a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:28.174154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a373132d-3552-4191-9eca-941e3067138a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:28.177614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a373132d-3552-4191-9eca-941e3067138a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:28.255210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7d4637a8-95c0-4ad7-b65c-92d1ca1e8a4e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:28.289531 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7d4637a8-95c0-4ad7-b65c-92d1ca1e8a4e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1315 microversion: 2.1 time: 0.735681 Oct 24 10:34:28.290024 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1130/2344] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:27 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1315 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:28.357282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-346e07f3-dffe-4486-bb8a-47625f533c6d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:28.362774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-346e07f3-dffe-4486-bb8a-47625f533c6d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:28.381401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-346e07f3-dffe-4486-bb8a-47625f533c6d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:28.381900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-346e07f3-dffe-4486-bb8a-47625f533c6d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:28.382598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-346e07f3-dffe-4486-bb8a-47625f533c6d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:28.385171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-346e07f3-dffe-4486-bb8a-47625f533c6d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:28.386519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-346e07f3-dffe-4486-bb8a-47625f533c6d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:28.389393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-346e07f3-dffe-4486-bb8a-47625f533c6d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:28.467109 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-346e07f3-dffe-4486-bb8a-47625f533c6d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111510 Oct 24 10:34:28.469259 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1131/2345] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:34:28 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:34:28.477518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a373132d-3552-4191-9eca-941e3067138a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:28.495815 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a373132d-3552-4191-9eca-941e3067138a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5" status: 200 len: 1314 microversion: 2.1 time: 0.360323 Oct 24 10:34:28.511095 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1215/2346] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:28 2022] GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:28.579030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1a79f618-4728-43df-81e0-00f16061161c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:28.580211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1a79f618-4728-43df-81e0-00f16061161c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:28.606540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a79f618-4728-43df-81e0-00f16061161c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:28.607323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a79f618-4728-43df-81e0-00f16061161c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:28.607934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a79f618-4728-43df-81e0-00f16061161c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:28.608828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a79f618-4728-43df-81e0-00f16061161c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:28.609590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a79f618-4728-43df-81e0-00f16061161c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:28.614493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a79f618-4728-43df-81e0-00f16061161c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:28.952094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1a79f618-4728-43df-81e0-00f16061161c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:28.961125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1a79f618-4728-43df-81e0-00f16061161c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:28.962568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1a79f618-4728-43df-81e0-00f16061161c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:28.963696 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1a79f618-4728-43df-81e0-00f16061161c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1281 microversion: 2.25 time: 0.388595 Oct 24 10:34:28.964254 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1132/2347] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:28 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1281 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:29.039630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-26a961e5-1cfc-468d-8082-731dbb649585 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:29.040898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-26a961e5-1cfc-468d-8082-731dbb649585 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:29.050558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26a961e5-1cfc-468d-8082-731dbb649585 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:29.054498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26a961e5-1cfc-468d-8082-731dbb649585 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:29.055309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26a961e5-1cfc-468d-8082-731dbb649585 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:29.056195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26a961e5-1cfc-468d-8082-731dbb649585 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:29.059362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26a961e5-1cfc-468d-8082-731dbb649585 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:29.060146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26a961e5-1cfc-468d-8082-731dbb649585 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:29.079991 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-26a961e5-1cfc-468d-8082-731dbb649585 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] HTTP exception thrown: Instance f7cf3710-4f48-4dca-9dc7-076994a09380 could not be found. Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-26a961e5-1cfc-468d-8082-731dbb649585 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Request method failure captured: Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 HTTP/1.1 Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmleeR96sL8coeavtta6IWofolwEjRo9REaJ-ogVTGzbtwUHteDLAuHBWQq9Z5GdCHlRFt-o3nhJkxOpB8OjF3x0EfAlbqhwWVI4fVag77lc_GSMifoFfhimsGU4f6bHEWdiioWwZbvc5ej-nnwjzlkgcAKa3WDBf4DD8mogRuHZR1A Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 37320b68ea0d4d8ab38ba0cd4a3f3f55 Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-53460477 Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/37320b68ea0d4d8ab38ba0cd4a3f3f55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/37320b68ea0d4d8ab38ba0cd4a3f3f55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/37320b68ea0d4d8ab38ba0cd4a3f3f55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_37320b68ea0d4d8ab38ba0cd4a3f3f55", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-53460477 Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 37320b68ea0d4d8ab38ba0cd4a3f3f55 Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-53460477 Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AttachSCSIVolumeTestJSON-53460477-project Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 761ab93565de4e07a19489ce7f479735 Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-53460477-project Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance f7cf3710-4f48-4dca-9dc7-076994a09380 could not be found. Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'f7cf3710-4f48-4dca-9dc7-076994a09380'} Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7cf3710-4f48-4dca-9dc7-076994a09380 could not be found. Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:34:29.081916 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:34:29.086725 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7cf3710-4f48-4dca-9dc7-076994a09380 could not be found. Oct 24 10:34:29.086725 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:34:29.086725 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:29.086725 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:34:29.086725 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:29.086725 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:29.086725 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:29.086725 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:34:29.086725 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:34:29.086725 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7cf3710-4f48-4dca-9dc7-076994a09380 could not be found. Oct 24 10:34:29.086725 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:34:29.105511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-26a961e5-1cfc-468d-8082-731dbb649585 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Returning 404 to user: Instance f7cf3710-4f48-4dca-9dc7-076994a09380 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:34:29.106857 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-26a961e5-1cfc-468d-8082-731dbb649585 tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 404 len: 111 microversion: 2.1 time: 0.077634 Oct 24 10:34:29.107900 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1216/2348] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:34:29 2022] DELETE /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:34:29.116431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1ec9e5a4-1037-4dac-a61b-d714d2f0306c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:29.117333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1ec9e5a4-1037-4dac-a61b-d714d2f0306c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] [instance: f7cf3710-4f48-4dca-9dc7-076994a09380] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:29.137011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ec9e5a4-1037-4dac-a61b-d714d2f0306c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:29.137544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ec9e5a4-1037-4dac-a61b-d714d2f0306c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:29.138690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ec9e5a4-1037-4dac-a61b-d714d2f0306c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:29.140001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ec9e5a4-1037-4dac-a61b-d714d2f0306c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:29.140650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ec9e5a4-1037-4dac-a61b-d714d2f0306c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:29.141320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ec9e5a4-1037-4dac-a61b-d714d2f0306c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:29.158014 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-1ec9e5a4-1037-4dac-a61b-d714d2f0306c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] HTTP exception thrown: Instance f7cf3710-4f48-4dca-9dc7-076994a09380 could not be found. Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1ec9e5a4-1037-4dac-a61b-d714d2f0306c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Request method failure captured: Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 HTTP/1.1 Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmleeR96sL8coeavtta6IWofolwEjRo9REaJ-ogVTGzbtwUHteDLAuHBWQq9Z5GdCHlRFt-o3nhJkxOpB8OjF3x0EfAlbqhwWVI4fVag77lc_GSMifoFfhimsGU4f6bHEWdiioWwZbvc5ej-nnwjzlkgcAKa3WDBf4DD8mogRuHZR1A Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 37320b68ea0d4d8ab38ba0cd4a3f3f55 Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-53460477 Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/37320b68ea0d4d8ab38ba0cd4a3f3f55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/37320b68ea0d4d8ab38ba0cd4a3f3f55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/37320b68ea0d4d8ab38ba0cd4a3f3f55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_37320b68ea0d4d8ab38ba0cd4a3f3f55", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-53460477 Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 37320b68ea0d4d8ab38ba0cd4a3f3f55 Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-53460477 Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AttachSCSIVolumeTestJSON-53460477-project Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 761ab93565de4e07a19489ce7f479735 Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-53460477-project Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance f7cf3710-4f48-4dca-9dc7-076994a09380 could not be found. Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'f7cf3710-4f48-4dca-9dc7-076994a09380'} Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7cf3710-4f48-4dca-9dc7-076994a09380 could not be found. Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7cf3710-4f48-4dca-9dc7-076994a09380 could not be found. Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:29.161002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:29.165721 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:29.165721 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:29.165721 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:29.165721 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:34:29.165721 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:34:29.165721 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7cf3710-4f48-4dca-9dc7-076994a09380 could not be found. Oct 24 10:34:29.165721 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:29.166846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1ec9e5a4-1037-4dac-a61b-d714d2f0306c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] Returning 404 to user: Instance f7cf3710-4f48-4dca-9dc7-076994a09380 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:34:29.168462 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1ec9e5a4-1037-4dac-a61b-d714d2f0306c tempest-AttachSCSIVolumeTestJSON-53460477 tempest-AttachSCSIVolumeTestJSON-53460477-project] 10.222.0.50 "GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380" status: 404 len: 111 microversion: 2.1 time: 0.056740 Oct 24 10:34:29.174178 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1133/2349] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:29 2022] GET /compute/v2.1/servers/f7cf3710-4f48-4dca-9dc7-076994a09380 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:34:29.321716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8443f4dd-ab51-444d-97b7-0d9aee577466 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:29.322336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8443f4dd-ab51-444d-97b7-0d9aee577466 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:29.342905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8443f4dd-ab51-444d-97b7-0d9aee577466 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:29.343630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8443f4dd-ab51-444d-97b7-0d9aee577466 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:29.344236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8443f4dd-ab51-444d-97b7-0d9aee577466 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:29.345134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8443f4dd-ab51-444d-97b7-0d9aee577466 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:29.345904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8443f4dd-ab51-444d-97b7-0d9aee577466 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:29.346527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8443f4dd-ab51-444d-97b7-0d9aee577466 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:29.479811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-14214afb-f762-4aad-9b13-417e529b9df1 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:29.482776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-14214afb-f762-4aad-9b13-417e529b9df1 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:29.491159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-14214afb-f762-4aad-9b13-417e529b9df1 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:29.491934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-14214afb-f762-4aad-9b13-417e529b9df1 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:29.492535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-14214afb-f762-4aad-9b13-417e529b9df1 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:29.493649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-14214afb-f762-4aad-9b13-417e529b9df1 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:29.494428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-14214afb-f762-4aad-9b13-417e529b9df1 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:29.495070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-14214afb-f762-4aad-9b13-417e529b9df1 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:29.597223 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-14214afb-f762-4aad-9b13-417e529b9df1 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121354 Oct 24 10:34:29.600143 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1134/2350] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:34:29 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:34:29.610381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-71a2ac62-7924-47ef-90a0-2ea2bbe59b68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:29.613923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-71a2ac62-7924-47ef-90a0-2ea2bbe59b68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:29.627826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71a2ac62-7924-47ef-90a0-2ea2bbe59b68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:29.633011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71a2ac62-7924-47ef-90a0-2ea2bbe59b68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:29.633861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71a2ac62-7924-47ef-90a0-2ea2bbe59b68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:29.634818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71a2ac62-7924-47ef-90a0-2ea2bbe59b68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:29.636577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71a2ac62-7924-47ef-90a0-2ea2bbe59b68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:29.637244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71a2ac62-7924-47ef-90a0-2ea2bbe59b68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:29.995265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8443f4dd-ab51-444d-97b7-0d9aee577466 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:30.008677 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8443f4dd-ab51-444d-97b7-0d9aee577466 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1315 microversion: 2.1 time: 0.687212 Oct 24 10:34:30.009532 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1217/2351] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:29 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1315 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:30.021498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-ccff39db-d69a-460c-b2fe-ff27edf57437 req-82d2538b-c484-48ae-aafa-06608035ae24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e14a4e9-2c60-4604-a670-dd4ea589e5f4", "name": "network-vif-plugged", "status": "completed", "tag": "22ad6515-0ea9-46ea-b637-abe57e0376b9"}, {"server_uuid": "513ca608-24c9-45f9-8fb9-e231d92c7262", "name": "network-vif-plugged", "status": "completed", "tag": "b2def801-647c-479d-9e34-cb0b4d60448e"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:30.039707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ccff39db-d69a-460c-b2fe-ff27edf57437 req-82d2538b-c484-48ae-aafa-06608035ae24 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:30.040445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ccff39db-d69a-460c-b2fe-ff27edf57437 req-82d2538b-c484-48ae-aafa-06608035ae24 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:30.042251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ccff39db-d69a-460c-b2fe-ff27edf57437 req-82d2538b-c484-48ae-aafa-06608035ae24 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:30.062830 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ccff39db-d69a-460c-b2fe-ff27edf57437 req-82d2538b-c484-48ae-aafa-06608035ae24 service nova] Creating event network-vif-plugged:22ad6515-0ea9-46ea-b637-abe57e0376b9 for instance 0e14a4e9-2c60-4604-a670-dd4ea589e5f4 on n-h2-858383-15 Oct 24 10:34:30.063770 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ccff39db-d69a-460c-b2fe-ff27edf57437 req-82d2538b-c484-48ae-aafa-06608035ae24 service nova] Creating event network-vif-plugged:b2def801-647c-479d-9e34-cb0b4d60448e for instance 513ca608-24c9-45f9-8fb9-e231d92c7262 on n-h2-858383-15 Oct 24 10:34:30.073370 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-ccff39db-d69a-460c-b2fe-ff27edf57437 req-82d2538b-c484-48ae-aafa-06608035ae24 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061952 Oct 24 10:34:30.074437 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1218/2352] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:30.081774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8d527f3b-62f4-4a4d-8621-f442b9ccc434 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:30.083581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8d527f3b-62f4-4a4d-8621-f442b9ccc434 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:30.090634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d527f3b-62f4-4a4d-8621-f442b9ccc434 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:30.091351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d527f3b-62f4-4a4d-8621-f442b9ccc434 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:30.092133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d527f3b-62f4-4a4d-8621-f442b9ccc434 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:30.093115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d527f3b-62f4-4a4d-8621-f442b9ccc434 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:30.094535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d527f3b-62f4-4a4d-8621-f442b9ccc434 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:30.095306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d527f3b-62f4-4a4d-8621-f442b9ccc434 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:30.189163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-71a2ac62-7924-47ef-90a0-2ea2bbe59b68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:30.233487 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-71a2ac62-7924-47ef-90a0-2ea2bbe59b68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5" status: 200 len: 1314 microversion: 2.1 time: 0.628529 Oct 24 10:34:30.240475 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1135/2353] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:29 2022] GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5 => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:30.548099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d527f3b-62f4-4a4d-8621-f442b9ccc434 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:30.559229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d527f3b-62f4-4a4d-8621-f442b9ccc434 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:30.561764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d527f3b-62f4-4a4d-8621-f442b9ccc434 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:30.563823 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8d527f3b-62f4-4a4d-8621-f442b9ccc434 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1478 microversion: 2.25 time: 0.487993 Oct 24 10:34:30.564582 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1219/2354] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:30 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1478 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:30.602410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b881a86d-4199-4075-b3a1-6ed97b4ebf39 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:30.603670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b881a86d-4199-4075-b3a1-6ed97b4ebf39 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:30.611218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fc427a56-554b-48f0-936b-3b1c4072d318 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:30.619623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fc427a56-554b-48f0-936b-3b1c4072d318 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:30.637755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b881a86d-4199-4075-b3a1-6ed97b4ebf39 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:30.638251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b881a86d-4199-4075-b3a1-6ed97b4ebf39 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:30.638691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b881a86d-4199-4075-b3a1-6ed97b4ebf39 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:30.639411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b881a86d-4199-4075-b3a1-6ed97b4ebf39 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:30.639857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b881a86d-4199-4075-b3a1-6ed97b4ebf39 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:30.640283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b881a86d-4199-4075-b3a1-6ed97b4ebf39 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:30.646793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fc427a56-554b-48f0-936b-3b1c4072d318 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:30.647293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fc427a56-554b-48f0-936b-3b1c4072d318 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:30.649378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fc427a56-554b-48f0-936b-3b1c4072d318 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:30.653432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fc427a56-554b-48f0-936b-3b1c4072d318 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:30.654933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fc427a56-554b-48f0-936b-3b1c4072d318 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:30.660166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fc427a56-554b-48f0-936b-3b1c4072d318 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:30.815433 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fc427a56-554b-48f0-936b-3b1c4072d318 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.208499 Oct 24 10:34:30.822794 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1220/2355] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:34:30 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments => generated 197 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:34:31.039666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6a126c62-8234-4ff3-ae90-1f67892f65f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:31.040568 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6a126c62-8234-4ff3-ae90-1f67892f65f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:31.053306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:31.056035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a126c62-8234-4ff3-ae90-1f67892f65f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:31.062051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a126c62-8234-4ff3-ae90-1f67892f65f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:31.063228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a126c62-8234-4ff3-ae90-1f67892f65f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:31.064228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a126c62-8234-4ff3-ae90-1f67892f65f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:31.064721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a126c62-8234-4ff3-ae90-1f67892f65f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:31.065184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a126c62-8234-4ff3-ae90-1f67892f65f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:31.083146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:31.209256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=8 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:31.488982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-b881a86d-4199-4075-b3a1-6ed97b4ebf39 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'services' on Instance uuid c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:34:31.514640 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b881a86d-4199-4075-b3a1-6ed97b4ebf39 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1973 microversion: 2.25 time: 0.922517 Oct 24 10:34:31.516052 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1136/2356] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:30 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1973 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:31.522832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-18056b10-230a-4c01-9f10-b849147fe34e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:31.523876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-18056b10-230a-4c01-9f10-b849147fe34e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:31.533360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18056b10-230a-4c01-9f10-b849147fe34e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:31.534188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18056b10-230a-4c01-9f10-b849147fe34e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:31.534904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18056b10-230a-4c01-9f10-b849147fe34e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:31.536984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18056b10-230a-4c01-9f10-b849147fe34e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:31.537709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18056b10-230a-4c01-9f10-b849147fe34e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:31.538405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18056b10-230a-4c01-9f10-b849147fe34e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:31.639148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6a126c62-8234-4ff3-ae90-1f67892f65f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:31.653389 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6a126c62-8234-4ff3-ae90-1f67892f65f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1315 microversion: 2.1 time: 0.619360 Oct 24 10:34:31.665624 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1221/2357] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:31 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1315 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:31.679539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0cb38fc8-4f8b-4a2c-8917-f287449bdcb4 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:31.680567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0cb38fc8-4f8b-4a2c-8917-f287449bdcb4 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:31.688820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:31.690551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0cb38fc8-4f8b-4a2c-8917-f287449bdcb4 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:31.691871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0cb38fc8-4f8b-4a2c-8917-f287449bdcb4 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:31.692812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0cb38fc8-4f8b-4a2c-8917-f287449bdcb4 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:31.693880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0cb38fc8-4f8b-4a2c-8917-f287449bdcb4 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:31.694562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0cb38fc8-4f8b-4a2c-8917-f287449bdcb4 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:31.696014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0cb38fc8-4f8b-4a2c-8917-f287449bdcb4 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:32.043363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-18056b10-230a-4c01-9f10-b849147fe34e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:32.071537 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-18056b10-230a-4c01-9f10-b849147fe34e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5" status: 200 len: 1314 microversion: 2.1 time: 0.554113 Oct 24 10:34:32.072141 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1137/2358] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:31 2022] GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5 => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:32.085918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b3c7402a-aeef-4bce-a70f-e6d1c464c362 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:32.088212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b3c7402a-aeef-4bce-a70f-e6d1c464c362 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:32.106894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3c7402a-aeef-4bce-a70f-e6d1c464c362 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:32.107396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3c7402a-aeef-4bce-a70f-e6d1c464c362 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:32.107943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3c7402a-aeef-4bce-a70f-e6d1c464c362 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:32.109307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3c7402a-aeef-4bce-a70f-e6d1c464c362 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:32.109772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3c7402a-aeef-4bce-a70f-e6d1c464c362 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:32.110210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3c7402a-aeef-4bce-a70f-e6d1c464c362 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:32.114660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:32.150940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-0cb38fc8-4f8b-4a2c-8917-f287449bdcb4 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'services' on Instance uuid c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:34:32.185885 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b3c7402a-aeef-4bce-a70f-e6d1c464c362 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112640 Oct 24 10:34:32.188938 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1138/2359] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:34:32 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:32.221536 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0cb38fc8-4f8b-4a2c-8917-f287449bdcb4 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1973 microversion: 2.25 time: 0.554305 Oct 24 10:34:32.229899 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1222/2360] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:31 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1973 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:32.250089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8de0fa56-fb7a-4a1c-a93c-4c5a2759b5c6 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:32.254691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8de0fa56-fb7a-4a1c-a93c-4c5a2759b5c6 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:32.256110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8de0fa56-fb7a-4a1c-a93c-4c5a2759b5c6 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:32.260352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8de0fa56-fb7a-4a1c-a93c-4c5a2759b5c6 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:32.261563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8de0fa56-fb7a-4a1c-a93c-4c5a2759b5c6 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:32.262280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8de0fa56-fb7a-4a1c-a93c-4c5a2759b5c6 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:32.262949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8de0fa56-fb7a-4a1c-a93c-4c5a2759b5c6 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:32.327167 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8de0fa56-fb7a-4a1c-a93c-4c5a2759b5c6 tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.080878 Oct 24 10:34:32.328479 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1139/2361] 10.222.0.50 () {60 vars in 1217 bytes} [Mon Oct 24 10:34:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:34:32.341736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-18ca0c12-e4ac-4c87-9a0f-a13899f11a1f tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-15", "block_migration": "auto"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:32.344428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-18ca0c12-e4ac-4c87-9a0f-a13899f11a1f tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:32.354677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18ca0c12-e4ac-4c87-9a0f-a13899f11a1f tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:32.355488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18ca0c12-e4ac-4c87-9a0f-a13899f11a1f tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:32.358281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18ca0c12-e4ac-4c87-9a0f-a13899f11a1f tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:32.359570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18ca0c12-e4ac-4c87-9a0f-a13899f11a1f tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:32.360055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18ca0c12-e4ac-4c87-9a0f-a13899f11a1f tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:32.360499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18ca0c12-e4ac-4c87-9a0f-a13899f11a1f tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:32.461192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-18ca0c12-e4ac-4c87-9a0f-a13899f11a1f tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'flavor' on Instance uuid c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:34:32.501524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-18ca0c12-e4ac-4c87-9a0f-a13899f11a1f tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Going to try to live migrate instance to n-h2-858383-15 {{(pid=120426) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 24 10:34:32.684497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2551c325-7482-4abf-8c8a-f456e0fa49e8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:32.685373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2551c325-7482-4abf-8c8a-f456e0fa49e8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:32.698094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2551c325-7482-4abf-8c8a-f456e0fa49e8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:32.700058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2551c325-7482-4abf-8c8a-f456e0fa49e8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:32.702046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2551c325-7482-4abf-8c8a-f456e0fa49e8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:32.709076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2551c325-7482-4abf-8c8a-f456e0fa49e8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:32.710346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2551c325-7482-4abf-8c8a-f456e0fa49e8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:32.714169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2551c325-7482-4abf-8c8a-f456e0fa49e8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:33.074255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2551c325-7482-4abf-8c8a-f456e0fa49e8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:33.091576 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2551c325-7482-4abf-8c8a-f456e0fa49e8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1503 microversion: 2.1 time: 0.412298 Oct 24 10:34:33.092793 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1140/2362] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:32 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1503 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:33.101144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8257d38d-9c94-4da2-ab09-599d3ccdc5b8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:33.105807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8257d38d-9c94-4da2-ab09-599d3ccdc5b8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:33.120746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8257d38d-9c94-4da2-ab09-599d3ccdc5b8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:33.121547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8257d38d-9c94-4da2-ab09-599d3ccdc5b8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:33.122764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8257d38d-9c94-4da2-ab09-599d3ccdc5b8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:33.124417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8257d38d-9c94-4da2-ab09-599d3ccdc5b8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:33.126834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8257d38d-9c94-4da2-ab09-599d3ccdc5b8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:33.127503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8257d38d-9c94-4da2-ab09-599d3ccdc5b8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:33.420204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8257d38d-9c94-4da2-ab09-599d3ccdc5b8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:33.430075 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8257d38d-9c94-4da2-ab09-599d3ccdc5b8 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5" status: 200 len: 1314 microversion: 2.1 time: 0.333452 Oct 24 10:34:33.436262 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1141/2363] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:33 2022] GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:34:33.447592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-400fd3f5-6b88-4eb6-bf59-c508d0bc4c79 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2077462351"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:33.448379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-400fd3f5-6b88-4eb6-bf59-c508d0bc4c79 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:33.465036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-400fd3f5-6b88-4eb6-bf59-c508d0bc4c79 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:33.465811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-400fd3f5-6b88-4eb6-bf59-c508d0bc4c79 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:33.466511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-400fd3f5-6b88-4eb6-bf59-c508d0bc4c79 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:33.467395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-400fd3f5-6b88-4eb6-bf59-c508d0bc4c79 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:33.477179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-400fd3f5-6b88-4eb6-bf59-c508d0bc4c79 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:33.477847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-400fd3f5-6b88-4eb6-bf59-c508d0bc4c79 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:33.796603 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.network.security_group_api [None req-400fd3f5-6b88-4eb6-bf59-c508d0bc4c79 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Adding security group a46c983e-76a2-403e-baa4-ac7c01c3761d to port 22ad6515-0ea9-46ea-b637-abe57e0376b9 Oct 24 10:34:34.880495 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-400fd3f5-6b88-4eb6-bf59-c508d0bc4c79 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "POST /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4/action" status: 202 len: 0 microversion: 2.1 time: 1.442700 Oct 24 10:34:34.881508 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1142/2364] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:34:33 2022] POST /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4/action => generated 0 bytes in 1444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:34:34.886721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eede3a92-ccff-41ce-8937-83103be5cb96 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:34.897532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eede3a92-ccff-41ce-8937-83103be5cb96 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:34.911330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eede3a92-ccff-41ce-8937-83103be5cb96 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:34.912915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eede3a92-ccff-41ce-8937-83103be5cb96 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:34.913517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eede3a92-ccff-41ce-8937-83103be5cb96 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:34.918511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eede3a92-ccff-41ce-8937-83103be5cb96 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:34.921584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eede3a92-ccff-41ce-8937-83103be5cb96 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:34.923559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eede3a92-ccff-41ce-8937-83103be5cb96 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:34.975358 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eede3a92-ccff-41ce-8937-83103be5cb96 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092377 Oct 24 10:34:34.985700 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1143/2365] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:34:34 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:34:34.991065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c17e5de3-4826-4417-a05f-968f46863235 req-39723afb-0c4d-48a8-b943-ab7e7bec6f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25185635-1966-4f64-8616-7698ea9e04c5", "name": "network-vif-plugged", "status": "completed", "tag": "3b489847-d634-4d76-a8f5-79292a60ebab"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:35.009276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:35.011376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c17e5de3-4826-4417-a05f-968f46863235 req-39723afb-0c4d-48a8-b943-ab7e7bec6f33 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:35.012315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c17e5de3-4826-4417-a05f-968f46863235 req-39723afb-0c4d-48a8-b943-ab7e7bec6f33 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:35.012935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c17e5de3-4826-4417-a05f-968f46863235 req-39723afb-0c4d-48a8-b943-ab7e7bec6f33 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:35.039068 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c17e5de3-4826-4417-a05f-968f46863235 req-39723afb-0c4d-48a8-b943-ab7e7bec6f33 service nova] Creating event network-vif-plugged:3b489847-d634-4d76-a8f5-79292a60ebab for instance 25185635-1966-4f64-8616-7698ea9e04c5 on n-h2-858383-15 Oct 24 10:34:35.059244 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c17e5de3-4826-4417-a05f-968f46863235 req-39723afb-0c4d-48a8-b943-ab7e7bec6f33 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071513 Oct 24 10:34:35.059516 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1144/2366] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:35.066907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4a8e82cc-9a33-400a-91ee-35d4df1c13b0 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:35.082669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4a8e82cc-9a33-400a-91ee-35d4df1c13b0 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:35.117159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a8e82cc-9a33-400a-91ee-35d4df1c13b0 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:35.117986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a8e82cc-9a33-400a-91ee-35d4df1c13b0 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:35.125137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a8e82cc-9a33-400a-91ee-35d4df1c13b0 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:35.127124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a8e82cc-9a33-400a-91ee-35d4df1c13b0 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:35.141918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a8e82cc-9a33-400a-91ee-35d4df1c13b0 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:35.142728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a8e82cc-9a33-400a-91ee-35d4df1c13b0 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:35.572014 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-18ca0c12-e4ac-4c87-9a0f-a13899f11a1f tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d/action" status: 202 len: 0 microversion: 2.25 time: 3.234164 Oct 24 10:34:35.573819 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1223/2367] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Oct 24 10:34:32 2022] POST /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d/action => generated 0 bytes in 3237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:34:35.579304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e7d7448c-a82d-469f-9077-97f9c53c5b6e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-470094115"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:35.580950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e7d7448c-a82d-469f-9077-97f9c53c5b6e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:35.587962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4a8e82cc-9a33-400a-91ee-35d4df1c13b0 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:35.607221 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4a8e82cc-9a33-400a-91ee-35d4df1c13b0 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5" status: 200 len: 1314 microversion: 2.1 time: 0.535958 Oct 24 10:34:35.609673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7d7448c-a82d-469f-9077-97f9c53c5b6e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:35.612242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7d7448c-a82d-469f-9077-97f9c53c5b6e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:35.613029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7d7448c-a82d-469f-9077-97f9c53c5b6e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:35.616055 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1145/2368] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:35 2022] GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:35.616549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7d7448c-a82d-469f-9077-97f9c53c5b6e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:35.617839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7d7448c-a82d-469f-9077-97f9c53c5b6e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:35.618557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7d7448c-a82d-469f-9077-97f9c53c5b6e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:35.640026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3ab6c15d-c9d8-4bec-8a17-e2982e9d191c req-f39783f5-70b2-42b1-a2e7-3a3bb0c4f173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e14a4e9-2c60-4604-a670-dd4ea589e5f4", "tag": "22ad6515-0ea9-46ea-b637-abe57e0376b9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:35.712266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3ab6c15d-c9d8-4bec-8a17-e2982e9d191c req-f39783f5-70b2-42b1-a2e7-3a3bb0c4f173 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:35.724256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3ab6c15d-c9d8-4bec-8a17-e2982e9d191c req-f39783f5-70b2-42b1-a2e7-3a3bb0c4f173 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:35.725166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3ab6c15d-c9d8-4bec-8a17-e2982e9d191c req-f39783f5-70b2-42b1-a2e7-3a3bb0c4f173 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:35.755994 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3ab6c15d-c9d8-4bec-8a17-e2982e9d191c req-f39783f5-70b2-42b1-a2e7-3a3bb0c4f173 service nova] Creating event network-changed:22ad6515-0ea9-46ea-b637-abe57e0376b9 for instance 0e14a4e9-2c60-4604-a670-dd4ea589e5f4 on n-h2-858383-15 Oct 24 10:34:35.766564 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3ab6c15d-c9d8-4bec-8a17-e2982e9d191c req-f39783f5-70b2-42b1-a2e7-3a3bb0c4f173 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146141 Oct 24 10:34:35.767653 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1146/2369] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:35.774058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d4a7f07-2572-4b1a-a863-f19c8483170d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-864909374", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "edd81caa-e7a0-4a5c-8a00-b4009b337655"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:35.842339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-0d4a7f07-2572-4b1a-a863-f19c8483170d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] validate_networks() for [('edd81caa-e7a0-4a5c-8a00-b4009b337655', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:34:36.334165 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.network.security_group_api [None req-e7d7448c-a82d-469f-9077-97f9c53c5b6e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Adding security group f3525e21-8afd-4841-ba09-7233d57abc4c to port 22ad6515-0ea9-46ea-b637-abe57e0376b9 Oct 24 10:34:37.829088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0d4a7f07-2572-4b1a-a863-f19c8483170d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:34:37.830350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0d4a7f07-2572-4b1a-a863-f19c8483170d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:34:37.831094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0d4a7f07-2572-4b1a-a863-f19c8483170d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:34:37.832344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0d4a7f07-2572-4b1a-a863-f19c8483170d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:34:37.833598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0d4a7f07-2572-4b1a-a863-f19c8483170d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:34:37.877956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d4a7f07-2572-4b1a-a863-f19c8483170d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:37.880215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d4a7f07-2572-4b1a-a863-f19c8483170d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:37.881081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d4a7f07-2572-4b1a-a863-f19c8483170d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:37.882392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d4a7f07-2572-4b1a-a863-f19c8483170d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:37.885498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d4a7f07-2572-4b1a-a863-f19c8483170d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:37.886180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d4a7f07-2572-4b1a-a863-f19c8483170d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:37.915546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0d4a7f07-2572-4b1a-a863-f19c8483170d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Getting quotas for project db7036c053ec42a98e784dbdc396c532. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:34:37.924498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0d4a7f07-2572-4b1a-a863-f19c8483170d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Getting quotas for user 001a2dd2081241c397719005e1d52eec and project db7036c053ec42a98e784dbdc396c532. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:34:37.939538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0d4a7f07-2572-4b1a-a863-f19c8483170d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:34:37.943329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0d4a7f07-2572-4b1a-a863-f19c8483170d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:34:38.024439 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0d4a7f07-2572-4b1a-a863-f19c8483170d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.254340 Oct 24 10:34:38.025976 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1147/2370] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:34:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:34:38.054306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33ea8ace-5486-477a-a702-724da6fb94cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:38.055555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-33ea8ace-5486-477a-a702-724da6fb94cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:38.064287 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e7d7448c-a82d-469f-9077-97f9c53c5b6e tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "POST /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4/action" status: 202 len: 0 microversion: 2.1 time: 2.489052 Oct 24 10:34:38.065457 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1224/2371] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:34:35 2022] POST /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4/action => generated 0 bytes in 2491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:34:38.066742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33ea8ace-5486-477a-a702-724da6fb94cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:38.069028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33ea8ace-5486-477a-a702-724da6fb94cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:38.070712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33ea8ace-5486-477a-a702-724da6fb94cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:38.071736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33ea8ace-5486-477a-a702-724da6fb94cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:38.072433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33ea8ace-5486-477a-a702-724da6fb94cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:38.074920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33ea8ace-5486-477a-a702-724da6fb94cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:38.077689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0f9225b6-432c-45fb-bd9e-644d0fa9d752 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:38.078479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0f9225b6-432c-45fb-bd9e-644d0fa9d752 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:38.100599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f9225b6-432c-45fb-bd9e-644d0fa9d752 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:38.104586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f9225b6-432c-45fb-bd9e-644d0fa9d752 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:38.105219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f9225b6-432c-45fb-bd9e-644d0fa9d752 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:38.105979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f9225b6-432c-45fb-bd9e-644d0fa9d752 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:38.111119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f9225b6-432c-45fb-bd9e-644d0fa9d752 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:38.111800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f9225b6-432c-45fb-bd9e-644d0fa9d752 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:38.811433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-33ea8ace-5486-477a-a702-724da6fb94cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:38.826277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-33ea8ace-5486-477a-a702-724da6fb94cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:38.836394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-33ea8ace-5486-477a-a702-724da6fb94cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:38.841996 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-33ea8ace-5486-477a-a702-724da6fb94cb tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1488 microversion: 2.25 time: 0.809784 Oct 24 10:34:38.843269 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1148/2372] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:38 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1488 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:38.861778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-185e3e41-0eb7-45f1-a7f5-1982c0bc6b77 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:38.883470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-185e3e41-0eb7-45f1-a7f5-1982c0bc6b77 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:38.888175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-185e3e41-0eb7-45f1-a7f5-1982c0bc6b77 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Searching by: {'deleted': False, 'project_id': '3ac4ab050ff04fcab31bd2716c109436'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:34:38.912143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-185e3e41-0eb7-45f1-a7f5-1982c0bc6b77 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:38.913003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-185e3e41-0eb7-45f1-a7f5-1982c0bc6b77 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:38.913747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-185e3e41-0eb7-45f1-a7f5-1982c0bc6b77 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:38.914849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-185e3e41-0eb7-45f1-a7f5-1982c0bc6b77 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:38.915527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-185e3e41-0eb7-45f1-a7f5-1982c0bc6b77 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:38.916556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-185e3e41-0eb7-45f1-a7f5-1982c0bc6b77 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:38.966360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0f9225b6-432c-45fb-bd9e-644d0fa9d752 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:38.997619 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0f9225b6-432c-45fb-bd9e-644d0fa9d752 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5" status: 200 len: 1464 microversion: 2.1 time: 0.927363 Oct 24 10:34:39.014342 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1225/2373] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:38 2022] GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5 => generated 1464 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:39.031464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1cfdf13d-b61b-4351-b558-fd5e8df06066 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:39.043067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1cfdf13d-b61b-4351-b558-fd5e8df06066 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:39.064077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1cfdf13d-b61b-4351-b558-fd5e8df06066 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:39.064989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1cfdf13d-b61b-4351-b558-fd5e8df06066 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:39.067259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1cfdf13d-b61b-4351-b558-fd5e8df06066 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:39.070746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1cfdf13d-b61b-4351-b558-fd5e8df06066 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:39.071430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1cfdf13d-b61b-4351-b558-fd5e8df06066 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:39.072070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1cfdf13d-b61b-4351-b558-fd5e8df06066 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:39.156642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.multi_cell_list [None req-185e3e41-0eb7-45f1-a7f5-1982c0bc6b77 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120425) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:34:39.308033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1cfdf13d-b61b-4351-b558-fd5e8df06066 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:39.322247 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1cfdf13d-b61b-4351-b558-fd5e8df06066 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35" status: 200 len: 1221 microversion: 2.1 time: 0.302335 Oct 24 10:34:39.322956 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1226/2374] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:39 2022] GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35 => generated 1221 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:39.371159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7f26dc37-bebd-44e6-b1ff-f5e1b788b17f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:39.373922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7f26dc37-bebd-44e6-b1ff-f5e1b788b17f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:39.392402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f26dc37-bebd-44e6-b1ff-f5e1b788b17f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:39.395583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f26dc37-bebd-44e6-b1ff-f5e1b788b17f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:39.396095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f26dc37-bebd-44e6-b1ff-f5e1b788b17f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:39.396858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f26dc37-bebd-44e6-b1ff-f5e1b788b17f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:39.402679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f26dc37-bebd-44e6-b1ff-f5e1b788b17f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:39.403297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f26dc37-bebd-44e6-b1ff-f5e1b788b17f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:39.419438 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-185e3e41-0eb7-45f1-a7f5-1982c0bc6b77 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.567344 Oct 24 10:34:39.421291 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1149/2375] 10.222.0.50 () {58 vars in 1125 bytes} [Mon Oct 24 10:34:38 2022] GET /compute/v2.1/servers => generated 339 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:39.429476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-9a92a529-e4b4-4235-8ec8-a91c84f4901f req-685e1918-b2a6-4742-8ffb-d7a10fd79b1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e14a4e9-2c60-4604-a670-dd4ea589e5f4", "tag": "22ad6515-0ea9-46ea-b637-abe57e0376b9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:39.459303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9a92a529-e4b4-4235-8ec8-a91c84f4901f req-685e1918-b2a6-4742-8ffb-d7a10fd79b1b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:39.459808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9a92a529-e4b4-4235-8ec8-a91c84f4901f req-685e1918-b2a6-4742-8ffb-d7a10fd79b1b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:39.460251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9a92a529-e4b4-4235-8ec8-a91c84f4901f req-685e1918-b2a6-4742-8ffb-d7a10fd79b1b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:39.491433 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-9a92a529-e4b4-4235-8ec8-a91c84f4901f req-685e1918-b2a6-4742-8ffb-d7a10fd79b1b service nova] Creating event network-changed:22ad6515-0ea9-46ea-b637-abe57e0376b9 for instance 0e14a4e9-2c60-4604-a670-dd4ea589e5f4 on n-h2-858383-15 Oct 24 10:34:39.497531 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-9a92a529-e4b4-4235-8ec8-a91c84f4901f req-685e1918-b2a6-4742-8ffb-d7a10fd79b1b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074780 Oct 24 10:34:39.498065 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1150/2376] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:39.959521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d815f5d3-f7fd-4110-88e3-c66b6c098535 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:39.971976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d815f5d3-f7fd-4110-88e3-c66b6c098535 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Searching by: {'deleted': False, 'project_id': '19fbbed22f0c4513a722ba0431bf0e0e'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:34:39.999446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d815f5d3-f7fd-4110-88e3-c66b6c098535 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:40.000175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d815f5d3-f7fd-4110-88e3-c66b6c098535 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:40.002864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d815f5d3-f7fd-4110-88e3-c66b6c098535 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:40.005581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d815f5d3-f7fd-4110-88e3-c66b6c098535 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:40.008317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d815f5d3-f7fd-4110-88e3-c66b6c098535 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:40.009244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d815f5d3-f7fd-4110-88e3-c66b6c098535 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:40.171558 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7f26dc37-bebd-44e6-b1ff-f5e1b788b17f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.847480 Oct 24 10:34:40.182704 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1227/2377] 10.222.0.50 () {58 vars in 1293 bytes} [Mon Oct 24 10:34:39 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4/os-security-groups => generated 1157 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:40.187831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d4c684f2-b1f6-4a68-8ae1-daa8ec04d6f4 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:40.199500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d4c684f2-b1f6-4a68-8ae1-daa8ec04d6f4 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:40.208148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d4c684f2-b1f6-4a68-8ae1-daa8ec04d6f4 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Searching by: {'deleted': False, 'project_id': '3ac4ab050ff04fcab31bd2716c109436'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:34:40.225307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c684f2-b1f6-4a68-8ae1-daa8ec04d6f4 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:40.226051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c684f2-b1f6-4a68-8ae1-daa8ec04d6f4 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:40.226659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c684f2-b1f6-4a68-8ae1-daa8ec04d6f4 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:40.227579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c684f2-b1f6-4a68-8ae1-daa8ec04d6f4 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:40.234194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c684f2-b1f6-4a68-8ae1-daa8ec04d6f4 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:40.234879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c684f2-b1f6-4a68-8ae1-daa8ec04d6f4 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:40.248297 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d815f5d3-f7fd-4110-88e3-c66b6c098535 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.748887 Oct 24 10:34:40.249195 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1151/2378] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:34:39 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:34:40.274789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d83dfbd8-1bb6-45e5-bcbd-3e63113bcefc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:40.275856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d83dfbd8-1bb6-45e5-bcbd-3e63113bcefc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:40.282695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d83dfbd8-1bb6-45e5-bcbd-3e63113bcefc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:40.284214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d83dfbd8-1bb6-45e5-bcbd-3e63113bcefc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:40.285301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d83dfbd8-1bb6-45e5-bcbd-3e63113bcefc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:40.286583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d83dfbd8-1bb6-45e5-bcbd-3e63113bcefc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:40.287387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d83dfbd8-1bb6-45e5-bcbd-3e63113bcefc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:40.288059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d83dfbd8-1bb6-45e5-bcbd-3e63113bcefc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:40.445340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-d4c684f2-b1f6-4a68-8ae1-daa8ec04d6f4 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:34:40.567106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d4c684f2-b1f6-4a68-8ae1-daa8ec04d6f4 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:40.574310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c684f2-b1f6-4a68-8ae1-daa8ec04d6f4 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:40.575091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c684f2-b1f6-4a68-8ae1-daa8ec04d6f4 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:40.575762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c684f2-b1f6-4a68-8ae1-daa8ec04d6f4 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:40.976386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d83dfbd8-1bb6-45e5-bcbd-3e63113bcefc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:40.992569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d83dfbd8-1bb6-45e5-bcbd-3e63113bcefc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:41.006597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d83dfbd8-1bb6-45e5-bcbd-3e63113bcefc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:41.016091 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d83dfbd8-1bb6-45e5-bcbd-3e63113bcefc tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1488 microversion: 2.25 time: 0.751611 Oct 24 10:34:41.031389 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1152/2379] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:40 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1488 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:41.054106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b8a18a93-6ce7-4438-a450-c9b01ee8cf8f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Action: 'create', calling method: .version_select at 0x7f04d5012dc0>, body: {"security_group": {"name": " tempest-securitygroup -51750394 ", "description": "tempest-description-903160090"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:41.157975 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d4c684f2-b1f6-4a68-8ae1-daa8ec04d6f4 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.973793 Oct 24 10:34:41.159182 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1228/2380] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:34:40 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:41.188176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-41fb6842-4e73-47a3-b55b-1937fd2df97b tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:41.217672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-41fb6842-4e73-47a3-b55b-1937fd2df97b tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Searching by: {'deleted': False} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:34:41.238496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41fb6842-4e73-47a3-b55b-1937fd2df97b tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:41.239080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41fb6842-4e73-47a3-b55b-1937fd2df97b tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:41.239525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41fb6842-4e73-47a3-b55b-1937fd2df97b tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:41.240340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41fb6842-4e73-47a3-b55b-1937fd2df97b tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:41.240791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41fb6842-4e73-47a3-b55b-1937fd2df97b tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:41.241243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41fb6842-4e73-47a3-b55b-1937fd2df97b tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:41.586921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-41fb6842-4e73-47a3-b55b-1937fd2df97b tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:34:41.596481 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b8a18a93-6ce7-4438-a450-c9b01ee8cf8f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.562048 Oct 24 10:34:41.597925 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1153/2381] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:34:41 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:41.602807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b8be7f32-c332-4204-ab39-d2c08caaba11 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:41.603896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b8be7f32-c332-4204-ab39-d2c08caaba11 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:41.621175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8be7f32-c332-4204-ab39-d2c08caaba11 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:41.623554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8be7f32-c332-4204-ab39-d2c08caaba11 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:41.625489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8be7f32-c332-4204-ab39-d2c08caaba11 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:41.633305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8be7f32-c332-4204-ab39-d2c08caaba11 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:41.638278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8be7f32-c332-4204-ab39-d2c08caaba11 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:41.640617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8be7f32-c332-4204-ab39-d2c08caaba11 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:41.794266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b8be7f32-c332-4204-ab39-d2c08caaba11 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:41.802644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41fb6842-4e73-47a3-b55b-1937fd2df97b tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:41.803356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41fb6842-4e73-47a3-b55b-1937fd2df97b tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:41.803979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41fb6842-4e73-47a3-b55b-1937fd2df97b tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:41.808768 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b8be7f32-c332-4204-ab39-d2c08caaba11 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35" status: 200 len: 1275 microversion: 2.1 time: 0.208280 Oct 24 10:34:41.809553 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1154/2382] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:41 2022] GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35 => generated 1275 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:41.832543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e5676436-8231-4189-ae6b-8a4bbf62eb50 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:41.849650 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e5676436-8231-4189-ae6b-8a4bbf62eb50 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023160 Oct 24 10:34:41.856213 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1155/2383] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:34:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:41.861150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c499a559-18eb-4ad4-85d5-ae6bff93413c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d500b550>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:42.022307 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c499a559-18eb-4ad4-85d5-ae6bff93413c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/be3fc4f1-89b1-4eac-9f5f-0397258f2095" status: 200 len: 221 microversion: 2.1 time: 0.164771 Oct 24 10:34:42.023844 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1156/2384] 10.222.0.50 () {58 vars in 1269 bytes} [Mon Oct 24 10:34:41 2022] GET /compute/v2.1/os-security-groups/be3fc4f1-89b1-4eac-9f5f-0397258f2095 => generated 221 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:42.043672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f29a6d96-172a-4ed4-8718-637a11cdc3ec tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d0a08ca0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:43.277781 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-41fb6842-4e73-47a3-b55b-1937fd2df97b tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 20228 microversion: 2.1 time: 2.102948 Oct 24 10:34:43.279851 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1229/2385] 10.222.0.50 () {58 vars in 1171 bytes} [Mon Oct 24 10:34:41 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 20228 bytes in 2106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:34:43.285248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f4f47e7e-e573-4b27-ae2e-b2c7f9bbb0c0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:43.287479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f4f47e7e-e573-4b27-ae2e-b2c7f9bbb0c0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:43.327317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4f47e7e-e573-4b27-ae2e-b2c7f9bbb0c0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:43.336475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4f47e7e-e573-4b27-ae2e-b2c7f9bbb0c0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:43.337300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4f47e7e-e573-4b27-ae2e-b2c7f9bbb0c0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:43.338215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4f47e7e-e573-4b27-ae2e-b2c7f9bbb0c0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:43.338979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4f47e7e-e573-4b27-ae2e-b2c7f9bbb0c0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:43.339258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4f47e7e-e573-4b27-ae2e-b2c7f9bbb0c0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:43.367423 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f29a6d96-172a-4ed4-8718-637a11cdc3ec tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/be3fc4f1-89b1-4eac-9f5f-0397258f2095" status: 202 len: 0 microversion: 2.1 time: 1.327883 Oct 24 10:34:43.368624 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1157/2386] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:34:42 2022] DELETE /compute/v2.1/os-security-groups/be3fc4f1-89b1-4eac-9f5f-0397258f2095 => generated 0 bytes in 1330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:34:43.375136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-35a34660-eb71-49f8-8185-6450d56930f9 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:43.376150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-35a34660-eb71-49f8-8185-6450d56930f9 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:43.392649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35a34660-eb71-49f8-8185-6450d56930f9 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:43.395604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35a34660-eb71-49f8-8185-6450d56930f9 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:43.397397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35a34660-eb71-49f8-8185-6450d56930f9 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:43.398393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35a34660-eb71-49f8-8185-6450d56930f9 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:43.400626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35a34660-eb71-49f8-8185-6450d56930f9 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:43.401336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35a34660-eb71-49f8-8185-6450d56930f9 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:43.498392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-35a34660-eb71-49f8-8185-6450d56930f9 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:34:43.731719 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-35a34660-eb71-49f8-8185-6450d56930f9 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f" status: 204 len: 0 microversion: 2.1 time: 0.361552 Oct 24 10:34:43.734787 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1158/2387] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:34:43 2022] DELETE /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:34:43.746007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3bce009b-6f33-4427-8cba-8c7e479d00a6 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:43.747230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3bce009b-6f33-4427-8cba-8c7e479d00a6 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:43.771107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bce009b-6f33-4427-8cba-8c7e479d00a6 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:43.771656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bce009b-6f33-4427-8cba-8c7e479d00a6 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:43.772115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bce009b-6f33-4427-8cba-8c7e479d00a6 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:43.773065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bce009b-6f33-4427-8cba-8c7e479d00a6 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:43.773857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bce009b-6f33-4427-8cba-8c7e479d00a6 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:43.775122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bce009b-6f33-4427-8cba-8c7e479d00a6 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:43.865911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f4f47e7e-e573-4b27-ae2e-b2c7f9bbb0c0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:43.877910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f4f47e7e-e573-4b27-ae2e-b2c7f9bbb0c0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:43.882296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f4f47e7e-e573-4b27-ae2e-b2c7f9bbb0c0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:43.892710 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f4f47e7e-e573-4b27-ae2e-b2c7f9bbb0c0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1488 microversion: 2.25 time: 0.611635 Oct 24 10:34:43.894482 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1230/2388] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:43 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1488 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:43.902057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-82411d5a-f1cd-4a0f-a8e1-b304d99ab063 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:43.917870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-82411d5a-f1cd-4a0f-a8e1-b304d99ab063 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Searching by: {'deleted': False, 'project_id': '19fbbed22f0c4513a722ba0431bf0e0e'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:34:43.930220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82411d5a-f1cd-4a0f-a8e1-b304d99ab063 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:43.932633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82411d5a-f1cd-4a0f-a8e1-b304d99ab063 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:43.938414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82411d5a-f1cd-4a0f-a8e1-b304d99ab063 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:43.938599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82411d5a-f1cd-4a0f-a8e1-b304d99ab063 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:43.939186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82411d5a-f1cd-4a0f-a8e1-b304d99ab063 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:43.939671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82411d5a-f1cd-4a0f-a8e1-b304d99ab063 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:43.984081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3bce009b-6f33-4427-8cba-8c7e479d00a6 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:43.995040 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3bce009b-6f33-4427-8cba-8c7e479d00a6 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35" status: 200 len: 1317 microversion: 2.1 time: 0.258403 Oct 24 10:34:43.995845 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1159/2389] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:43 2022] GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:44.001757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb6a7085-bc8f-4371-a11d-dd2f8b633c67 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d10ac8b0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:44.017097 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-82411d5a-f1cd-4a0f-a8e1-b304d99ab063 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?tenant_id=ddcca0b4ac864e36a9732a13c93171d3" status: 200 len: 15 microversion: 2.1 time: 0.121103 Oct 24 10:34:44.017695 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1231/2390] 10.222.0.50 () {58 vars in 1231 bytes} [Mon Oct 24 10:34:43 2022] GET /compute/v2.1/servers/detail?tenant_id=ddcca0b4ac864e36a9732a13c93171d3 => generated 15 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:34:44.027692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4228be1f-6cf7-4528-b462-41895d49130d tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:44.030572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4228be1f-6cf7-4528-b462-41895d49130d tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:44.030737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG neutronclient.v2_0.client [None req-bb6a7085-bc8f-4371-a11d-dd2f8b633c67 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group be3fc4f1-89b1-4eac-9f5f-0397258f2095 does not exist", "detail": ""}} {{(pid=120425) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:34:44.031290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.security_group_api [None req-bb6a7085-bc8f-4371-a11d-dd2f8b633c67 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Neutron security group be3fc4f1-89b1-4eac-9f5f-0397258f2095 not found {{(pid=120425) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 10:34:44.032636 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-bb6a7085-bc8f-4371-a11d-dd2f8b633c67 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] HTTP exception thrown: Security group be3fc4f1-89b1-4eac-9f5f-0397258f2095 does not exist Oct 24 10:34:44.032636 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-46632ffc-bd07-47cd-adad-99f2c343ee42'] Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb6a7085-bc8f-4371-a11d-dd2f8b633c67 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Request method failure captured: Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-security-groups/be3fc4f1-89b1-4eac-9f5f-0397258f2095 HTTP/1.1 Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmoaXPClcPLJ9gE_6C5GjDQZGdene0OObxZB0Z9ED_DBUfNEOv3AFVz9Sj51DSTvjG5d4L4G0Y7Y2LCJ3yblYYRp_EY66mnirefPs52lqIDsBuo9XJUGZQDidaxp2-3kvGCo_yrNtYTWeu7uqgvMarg1Wuv91gUnqbIjaBzXZEG6tDA Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/60b1c666c4914debad43704393d651cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_60b1c666c4914debad43704393d651cf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6aeb81e9b2fa4796813c607234174af6 Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: exception: Security group be3fc4f1-89b1-4eac-9f5f-0397258f2095 does not exist Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-46632ffc-bd07-47cd-adad-99f2c343ee42'] Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'be3fc4f1-89b1-4eac-9f5f-0397258f2095'} Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:34:44.040720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group be3fc4f1-89b1-4eac-9f5f-0397258f2095 does not exist Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46632ffc-bd07-47cd-adad-99f2c343ee42'] Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group be3fc4f1-89b1-4eac-9f5f-0397258f2095 does not exist Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46632ffc-bd07-47cd-adad-99f2c343ee42'] Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group be3fc4f1-89b1-4eac-9f5f-0397258f2095 does not exist Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46632ffc-bd07-47cd-adad-99f2c343ee42'] Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group be3fc4f1-89b1-4eac-9f5f-0397258f2095 does not exist Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46632ffc-bd07-47cd-adad-99f2c343ee42'] Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb6a7085-bc8f-4371-a11d-dd2f8b633c67 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Returning 404 to user: Security group be3fc4f1-89b1-4eac-9f5f-0397258f2095 does not exist Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-46632ffc-bd07-47cd-adad-99f2c343ee42'] {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bb6a7085-bc8f-4371-a11d-dd2f8b633c67 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/be3fc4f1-89b1-4eac-9f5f-0397258f2095" status: 404 len: 194 microversion: 2.1 time: 0.045698 Oct 24 10:34:44.044750 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1160/2391] 10.222.0.50 () {58 vars in 1269 bytes} [Mon Oct 24 10:34:43 2022] GET /compute/v2.1/os-security-groups/be3fc4f1-89b1-4eac-9f5f-0397258f2095 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:34:44.054461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-79398d54-0c1b-4a49-a9ad-e8957d197460 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Action: 'create', calling method: .version_select at 0x7f04d0a085e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1694357272", "description": "tempest-description-569571594"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:44.054877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4228be1f-6cf7-4528-b462-41895d49130d tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:44.055589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4228be1f-6cf7-4528-b462-41895d49130d tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:44.058312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4228be1f-6cf7-4528-b462-41895d49130d tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:44.059340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4228be1f-6cf7-4528-b462-41895d49130d tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:44.060195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4228be1f-6cf7-4528-b462-41895d49130d tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:44.060796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4228be1f-6cf7-4528-b462-41895d49130d tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:44.438350 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-79398d54-0c1b-4a49-a9ad-e8957d197460 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.388751 Oct 24 10:34:44.439430 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1161/2392] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:34:44 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:44.444959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-663275f0-f96c-4859-a37a-a261a567e515 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:44.458739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-663275f0-f96c-4859-a37a-a261a567e515 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Searching by: {'tenant_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'deleted': False} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:34:44.468979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-663275f0-f96c-4859-a37a-a261a567e515 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:44.472957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-663275f0-f96c-4859-a37a-a261a567e515 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:44.473534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-663275f0-f96c-4859-a37a-a261a567e515 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:44.475927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-663275f0-f96c-4859-a37a-a261a567e515 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:44.476651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-663275f0-f96c-4859-a37a-a261a567e515 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:44.478450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-663275f0-f96c-4859-a37a-a261a567e515 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:44.485899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4228be1f-6cf7-4528-b462-41895d49130d tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:44.495273 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4228be1f-6cf7-4528-b462-41895d49130d tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f" status: 200 len: 1715 microversion: 2.1 time: 0.471656 Oct 24 10:34:44.507958 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1232/2393] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:44 2022] GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f => generated 1715 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:44.525069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c663f617-01f7-434d-ada2-b899e4ece8c1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Action: 'create', calling method: .version_select at 0x7f04d0df7f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1067976935", "description": "tempest-description-459145902"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:44.564647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.multi_cell_list [None req-663275f0-f96c-4859-a37a-a261a567e515 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120425) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:34:44.739360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:44.837147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-663275f0-f96c-4859-a37a-a261a567e515 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:44.837984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-663275f0-f96c-4859-a37a-a261a567e515 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:44.840399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-663275f0-f96c-4859-a37a-a261a567e515 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:45.392684 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c663f617-01f7-434d-ada2-b899e4ece8c1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.883416 Oct 24 10:34:45.395410 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1233/2394] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:34:44 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:45.400682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-913a9443-429a-45af-97ed-8eb6a2a0f177 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:45.401663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-913a9443-429a-45af-97ed-8eb6a2a0f177 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:45.417618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-913a9443-429a-45af-97ed-8eb6a2a0f177 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:45.418801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-913a9443-429a-45af-97ed-8eb6a2a0f177 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:45.424230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-913a9443-429a-45af-97ed-8eb6a2a0f177 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:45.426130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-913a9443-429a-45af-97ed-8eb6a2a0f177 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:45.426841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-913a9443-429a-45af-97ed-8eb6a2a0f177 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:45.427503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-913a9443-429a-45af-97ed-8eb6a2a0f177 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:45.448144 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-663275f0-f96c-4859-a37a-a261a567e515 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ddcca0b4ac864e36a9732a13c93171d3" status: 200 len: 4832 microversion: 2.1 time: 1.007452 Oct 24 10:34:45.449868 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1162/2395] 10.222.0.50 () {58 vars in 1257 bytes} [Mon Oct 24 10:34:44 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ddcca0b4ac864e36a9732a13c93171d3 => generated 4832 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:45.456030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8c21401c-8a9a-4bd0-b998-feebcb21aa40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:45.457650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8c21401c-8a9a-4bd0-b998-feebcb21aa40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:45.473269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8c21401c-8a9a-4bd0-b998-feebcb21aa40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:45.473780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8c21401c-8a9a-4bd0-b998-feebcb21aa40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:45.480295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8c21401c-8a9a-4bd0-b998-feebcb21aa40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:45.481358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8c21401c-8a9a-4bd0-b998-feebcb21aa40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:45.481858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8c21401c-8a9a-4bd0-b998-feebcb21aa40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:45.482307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8c21401c-8a9a-4bd0-b998-feebcb21aa40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:46.007664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-913a9443-429a-45af-97ed-8eb6a2a0f177 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:46.022314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-913a9443-429a-45af-97ed-8eb6a2a0f177 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:46.027011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-913a9443-429a-45af-97ed-8eb6a2a0f177 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:46.033809 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-913a9443-429a-45af-97ed-8eb6a2a0f177 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1488 microversion: 2.25 time: 0.635409 Oct 24 10:34:46.053068 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1234/2396] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:45 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1488 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:46.075915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8eeb5ec6-50f4-414b-9cbc-5b5a890daa9c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Action: 'create', calling method: .version_select at 0x7f04d087c9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-592160726", "description": "tempest-description-653934300"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:46.094674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8c21401c-8a9a-4bd0-b998-feebcb21aa40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:46.107759 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8c21401c-8a9a-4bd0-b998-feebcb21aa40 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35" status: 200 len: 1317 microversion: 2.1 time: 0.656548 Oct 24 10:34:46.113739 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1163/2397] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:45 2022] GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35 => generated 1317 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:46.124371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-44604623-f281-4c78-899e-cc18e0e6e602 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:46.151449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-44604623-f281-4c78-899e-cc18e0e6e602 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Searching by: {'tenant_id': '19fbbed22f0c4513a722ba0431bf0e0e', 'deleted': False} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:34:46.164245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44604623-f281-4c78-899e-cc18e0e6e602 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:46.164967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44604623-f281-4c78-899e-cc18e0e6e602 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:46.166705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44604623-f281-4c78-899e-cc18e0e6e602 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:46.169890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44604623-f281-4c78-899e-cc18e0e6e602 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:46.171452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44604623-f281-4c78-899e-cc18e0e6e602 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:46.172775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44604623-f281-4c78-899e-cc18e0e6e602 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:46.251962 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-44604623-f281-4c78-899e-cc18e0e6e602 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=19fbbed22f0c4513a722ba0431bf0e0e" status: 200 len: 15 microversion: 2.1 time: 0.136511 Oct 24 10:34:46.253705 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1164/2398] 10.222.0.50 () {58 vars in 1257 bytes} [Mon Oct 24 10:34:46 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=19fbbed22f0c4513a722ba0431bf0e0e => generated 15 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:34:46.261339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e2798ce3-2f4d-43a4-abc9-d0df7fbccd1e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:46.265607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e2798ce3-2f4d-43a4-abc9-d0df7fbccd1e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:46.279874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2798ce3-2f4d-43a4-abc9-d0df7fbccd1e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:46.283221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2798ce3-2f4d-43a4-abc9-d0df7fbccd1e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:46.283801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2798ce3-2f4d-43a4-abc9-d0df7fbccd1e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:46.298118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2798ce3-2f4d-43a4-abc9-d0df7fbccd1e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:46.299042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2798ce3-2f4d-43a4-abc9-d0df7fbccd1e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:46.299977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2798ce3-2f4d-43a4-abc9-d0df7fbccd1e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:46.782308 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8eeb5ec6-50f4-414b-9cbc-5b5a890daa9c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.724958 Oct 24 10:34:46.783204 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1235/2399] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:34:46 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:46.789310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c8f382cf-8715-43dd-bc1a-5465e791406c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:46.819621 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c8f382cf-8715-43dd-bc1a-5465e791406c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.019139 Oct 24 10:34:46.821918 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1236/2400] 10.222.0.50 () {58 vars in 1189 bytes} [Mon Oct 24 10:34:46 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:34:46.828207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aa1e41ce-f7cc-414d-be01-1324c6d01538 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d06f5c10>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:47.179221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e2798ce3-2f4d-43a4-abc9-d0df7fbccd1e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:47.192383 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e2798ce3-2f4d-43a4-abc9-d0df7fbccd1e tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f" status: 200 len: 1715 microversion: 2.1 time: 0.937505 Oct 24 10:34:47.198224 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1165/2401] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:46 2022] GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f => generated 1715 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:47.214201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-240b7bdd-ee5d-4a02-981a-5a551575571a req-e3c4b777-6c4b-4d09-9563-0930eb195eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9d7d55-3dee-4605-a8ac-594a62bb5d35", "tag": "f176994c-7a9f-41c3-9a48-3b16c092cacd"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:47.234997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-240b7bdd-ee5d-4a02-981a-5a551575571a req-e3c4b777-6c4b-4d09-9563-0930eb195eb1 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:47.235718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-240b7bdd-ee5d-4a02-981a-5a551575571a req-e3c4b777-6c4b-4d09-9563-0930eb195eb1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:47.240070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-240b7bdd-ee5d-4a02-981a-5a551575571a req-e3c4b777-6c4b-4d09-9563-0930eb195eb1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:47.257892 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-240b7bdd-ee5d-4a02-981a-5a551575571a req-e3c4b777-6c4b-4d09-9563-0930eb195eb1 service nova] Creating event network-changed:f176994c-7a9f-41c3-9a48-3b16c092cacd for instance bf9d7d55-3dee-4605-a8ac-594a62bb5d35 on n-h1-858383-15 Oct 24 10:34:47.263234 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-240b7bdd-ee5d-4a02-981a-5a551575571a req-e3c4b777-6c4b-4d09-9563-0930eb195eb1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058559 Oct 24 10:34:47.264545 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1166/2402] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:47.270414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6a6b9451-856c-4adf-869e-889cab02dcad tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:47.273512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6a6b9451-856c-4adf-869e-889cab02dcad tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:47.280784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a6b9451-856c-4adf-869e-889cab02dcad tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:47.281629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a6b9451-856c-4adf-869e-889cab02dcad tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:47.282265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a6b9451-856c-4adf-869e-889cab02dcad tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:47.283177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a6b9451-856c-4adf-869e-889cab02dcad tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:47.283810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a6b9451-856c-4adf-869e-889cab02dcad tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:47.284999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a6b9451-856c-4adf-869e-889cab02dcad tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:47.421671 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6a6b9451-856c-4adf-869e-889cab02dcad tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43/action" status: 202 len: 0 microversion: 2.1 time: 0.155518 Oct 24 10:34:47.423701 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1167/2403] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:34:47 2022] POST /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:34:47.437565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8125407b-4069-4c71-b68c-b8b8ece8268e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:47.438938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8125407b-4069-4c71-b68c-b8b8ece8268e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:47.447915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8125407b-4069-4c71-b68c-b8b8ece8268e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:47.448619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8125407b-4069-4c71-b68c-b8b8ece8268e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:47.449647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8125407b-4069-4c71-b68c-b8b8ece8268e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:47.451355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8125407b-4069-4c71-b68c-b8b8ece8268e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:47.451906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8125407b-4069-4c71-b68c-b8b8ece8268e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:47.452567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8125407b-4069-4c71-b68c-b8b8ece8268e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:48.010959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8125407b-4069-4c71-b68c-b8b8ece8268e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:48.021212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8125407b-4069-4c71-b68c-b8b8ece8268e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:48.022762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8125407b-4069-4c71-b68c-b8b8ece8268e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:48.024215 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8125407b-4069-4c71-b68c-b8b8ece8268e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1488 microversion: 2.25 time: 0.596879 Oct 24 10:34:48.024782 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1168/2404] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:47 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1488 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:48.037551 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aa1e41ce-f7cc-414d-be01-1324c6d01538 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 1.214297 Oct 24 10:34:48.038118 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1237/2405] 10.222.0.50 () {58 vars in 1158 bytes} [Mon Oct 24 10:34:46 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:48.043079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-02324f2a-e29e-4cc1-8c2f-b32b8cc3d8bf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:48.048498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7d71d39c-26ca-4e9b-ab8c-a53d425a8ce4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:48.058295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-02324f2a-e29e-4cc1-8c2f-b32b8cc3d8bf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:48.059403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7d71d39c-26ca-4e9b-ab8c-a53d425a8ce4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:48.063604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-02324f2a-e29e-4cc1-8c2f-b32b8cc3d8bf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:34:48.086343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d71d39c-26ca-4e9b-ab8c-a53d425a8ce4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:48.086897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d71d39c-26ca-4e9b-ab8c-a53d425a8ce4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:48.087364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d71d39c-26ca-4e9b-ab8c-a53d425a8ce4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:48.088233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d71d39c-26ca-4e9b-ab8c-a53d425a8ce4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:48.088762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d71d39c-26ca-4e9b-ab8c-a53d425a8ce4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:48.089143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d71d39c-26ca-4e9b-ab8c-a53d425a8ce4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:48.091459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02324f2a-e29e-4cc1-8c2f-b32b8cc3d8bf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:48.093307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02324f2a-e29e-4cc1-8c2f-b32b8cc3d8bf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:48.093752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02324f2a-e29e-4cc1-8c2f-b32b8cc3d8bf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:48.094495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02324f2a-e29e-4cc1-8c2f-b32b8cc3d8bf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:48.094951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02324f2a-e29e-4cc1-8c2f-b32b8cc3d8bf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:48.095373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02324f2a-e29e-4cc1-8c2f-b32b8cc3d8bf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:48.338576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-02324f2a-e29e-4cc1-8c2f-b32b8cc3d8bf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:34:48.406956 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-02324f2a-e29e-4cc1-8c2f-b32b8cc3d8bf tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.367504 Oct 24 10:34:48.408175 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1238/2406] 10.222.0.50 () {58 vars in 1150 bytes} [Mon Oct 24 10:34:48 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:48.418200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a8b1cd92-a568-4e91-85c2-0ef14510a7c0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d09ab1f0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:49.544594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7d71d39c-26ca-4e9b-ab8c-a53d425a8ce4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:49.559078 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7d71d39c-26ca-4e9b-ab8c-a53d425a8ce4 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35" status: 200 len: 1317 microversion: 2.1 time: 1.527415 Oct 24 10:34:49.565060 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1169/2407] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:48 2022] GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35 => generated 1317 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:49.570636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-af635685-8eba-483d-a364-db36989f3b74 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:49.574638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-af635685-8eba-483d-a364-db36989f3b74 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:49.594873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af635685-8eba-483d-a364-db36989f3b74 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:49.595598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af635685-8eba-483d-a364-db36989f3b74 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:49.599566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af635685-8eba-483d-a364-db36989f3b74 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:49.600607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af635685-8eba-483d-a364-db36989f3b74 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:49.601265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af635685-8eba-483d-a364-db36989f3b74 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:49.601982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af635685-8eba-483d-a364-db36989f3b74 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:49.821105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-af635685-8eba-483d-a364-db36989f3b74 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:49.830213 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-af635685-8eba-483d-a364-db36989f3b74 tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f" status: 200 len: 1647 microversion: 2.1 time: 0.263696 Oct 24 10:34:49.833699 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1170/2408] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:49 2022] GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f => generated 1647 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:49.848468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-06e00bc1-bfd0-4d82-b535-af29415001a8 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:49.851042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-06e00bc1-bfd0-4d82-b535-af29415001a8 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:49.863761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06e00bc1-bfd0-4d82-b535-af29415001a8 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:49.873437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06e00bc1-bfd0-4d82-b535-af29415001a8 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:49.874475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06e00bc1-bfd0-4d82-b535-af29415001a8 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:49.875835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06e00bc1-bfd0-4d82-b535-af29415001a8 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:49.876853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06e00bc1-bfd0-4d82-b535-af29415001a8 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:49.877511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06e00bc1-bfd0-4d82-b535-af29415001a8 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:50.044660 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-06e00bc1-bfd0-4d82-b535-af29415001a8 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43/action" status: 202 len: 0 microversion: 2.1 time: 0.200240 Oct 24 10:34:50.052601 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1171/2409] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:34:49 2022] POST /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:34:50.071126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-093b2f52-873d-4462-b1db-736165f11010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:50.072615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-093b2f52-873d-4462-b1db-736165f11010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:50.080083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-093b2f52-873d-4462-b1db-736165f11010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:50.085637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-093b2f52-873d-4462-b1db-736165f11010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:50.086506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-093b2f52-873d-4462-b1db-736165f11010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:50.087509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-093b2f52-873d-4462-b1db-736165f11010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:50.088179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-093b2f52-873d-4462-b1db-736165f11010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:50.089112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-093b2f52-873d-4462-b1db-736165f11010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:50.199125 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a8b1cd92-a568-4e91-85c2-0ef14510a7c0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/87709edc-0b6a-4094-895a-de3e403a2127" status: 202 len: 0 microversion: 2.1 time: 1.788845 Oct 24 10:34:50.200041 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1239/2410] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:34:48 2022] DELETE /compute/v2.1/os-security-groups/87709edc-0b6a-4094-895a-de3e403a2127 => generated 0 bytes in 1791 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:34:50.206518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-08403492-3d7e-4f6b-9fa3-92b2e7e1cb4b req-7fb6e103-8f20-4f99-b336-154fd3ed6d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7254c068-e068-42f0-b0bd-1fb8ed98104f", "name": "network-vif-deleted", "tag": "e9ece899-4bb1-4d03-a940-7ed49dc6da77"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:50.266155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-08403492-3d7e-4f6b-9fa3-92b2e7e1cb4b req-7fb6e103-8f20-4f99-b336-154fd3ed6d70 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:50.267223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-08403492-3d7e-4f6b-9fa3-92b2e7e1cb4b req-7fb6e103-8f20-4f99-b336-154fd3ed6d70 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:50.267937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-08403492-3d7e-4f6b-9fa3-92b2e7e1cb4b req-7fb6e103-8f20-4f99-b336-154fd3ed6d70 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:50.286677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:50.301396 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-08403492-3d7e-4f6b-9fa3-92b2e7e1cb4b req-7fb6e103-8f20-4f99-b336-154fd3ed6d70 service nova] Creating event network-vif-deleted:e9ece899-4bb1-4d03-a940-7ed49dc6da77 for instance 7254c068-e068-42f0-b0bd-1fb8ed98104f on n-h1-858383-15 Oct 24 10:34:50.321108 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-08403492-3d7e-4f6b-9fa3-92b2e7e1cb4b req-7fb6e103-8f20-4f99-b336-154fd3ed6d70 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116938 Oct 24 10:34:50.322108 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1240/2411] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:50.336375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-748fd400-1d9e-47dc-aaaa-3d1f5efc5836 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:50.337371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-748fd400-1d9e-47dc-aaaa-3d1f5efc5836 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:50.357460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-748fd400-1d9e-47dc-aaaa-3d1f5efc5836 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:50.358453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-748fd400-1d9e-47dc-aaaa-3d1f5efc5836 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:50.359465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-748fd400-1d9e-47dc-aaaa-3d1f5efc5836 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:50.360530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-748fd400-1d9e-47dc-aaaa-3d1f5efc5836 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:50.361370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-748fd400-1d9e-47dc-aaaa-3d1f5efc5836 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:50.369573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-748fd400-1d9e-47dc-aaaa-3d1f5efc5836 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:50.464522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-093b2f52-873d-4462-b1db-736165f11010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:50.473918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-093b2f52-873d-4462-b1db-736165f11010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:50.478588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-093b2f52-873d-4462-b1db-736165f11010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:50.482190 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-093b2f52-873d-4462-b1db-736165f11010 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1488 microversion: 2.25 time: 0.428409 Oct 24 10:34:50.488703 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1172/2412] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:50 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1488 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:50.495966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09f45500-22f1-4d74-a754-b11d637ed02a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d4f80820>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:50.553028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG neutronclient.v2_0.client [None req-09f45500-22f1-4d74-a754-b11d637ed02a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 87709edc-0b6a-4094-895a-de3e403a2127 does not exist", "detail": ""}} {{(pid=120425) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:34:50.553751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.security_group_api [None req-09f45500-22f1-4d74-a754-b11d637ed02a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Neutron security group 87709edc-0b6a-4094-895a-de3e403a2127 not found {{(pid=120425) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 10:34:50.554377 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-09f45500-22f1-4d74-a754-b11d637ed02a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] HTTP exception thrown: Security group 87709edc-0b6a-4094-895a-de3e403a2127 does not exist Oct 24 10:34:50.554377 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-48378cc9-de4e-4e28-a4eb-7fb852ed16ac'] Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09f45500-22f1-4d74-a754-b11d637ed02a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Request method failure captured: Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-security-groups/87709edc-0b6a-4094-895a-de3e403a2127 HTTP/1.1 Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmoaXPClcPLJ9gE_6C5GjDQZGdene0OObxZB0Z9ED_DBUfNEOv3AFVz9Sj51DSTvjG5d4L4G0Y7Y2LCJ3yblYYRp_EY66mnirefPs52lqIDsBuo9XJUGZQDidaxp2-3kvGCo_yrNtYTWeu7uqgvMarg1Wuv91gUnqbIjaBzXZEG6tDA Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/60b1c666c4914debad43704393d651cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_60b1c666c4914debad43704393d651cf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6aeb81e9b2fa4796813c607234174af6 Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: exception: Security group 87709edc-0b6a-4094-895a-de3e403a2127 does not exist Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-48378cc9-de4e-4e28-a4eb-7fb852ed16ac'] Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '87709edc-0b6a-4094-895a-de3e403a2127'} Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:34:50.556495 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 87709edc-0b6a-4094-895a-de3e403a2127 does not exist Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48378cc9-de4e-4e28-a4eb-7fb852ed16ac'] Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 87709edc-0b6a-4094-895a-de3e403a2127 does not exist Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48378cc9-de4e-4e28-a4eb-7fb852ed16ac'] Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 87709edc-0b6a-4094-895a-de3e403a2127 does not exist Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48378cc9-de4e-4e28-a4eb-7fb852ed16ac'] Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 87709edc-0b6a-4094-895a-de3e403a2127 does not exist Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48378cc9-de4e-4e28-a4eb-7fb852ed16ac'] Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09f45500-22f1-4d74-a754-b11d637ed02a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Returning 404 to user: Security group 87709edc-0b6a-4094-895a-de3e403a2127 does not exist Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-48378cc9-de4e-4e28-a4eb-7fb852ed16ac'] {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:34:50.560057 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-09f45500-22f1-4d74-a754-b11d637ed02a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/87709edc-0b6a-4094-895a-de3e403a2127" status: 404 len: 194 microversion: 2.1 time: 0.069315 Oct 24 10:34:50.566713 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1173/2413] 10.222.0.50 () {58 vars in 1269 bytes} [Mon Oct 24 10:34:50 2022] GET /compute/v2.1/os-security-groups/87709edc-0b6a-4094-895a-de3e403a2127 => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:34:50.568650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f58fff99-8a7e-4728-bbd6-39a1beca2267 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d0b12e50>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:50.750437 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-748fd400-1d9e-47dc-aaaa-3d1f5efc5836 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1616 microversion: 2.1 time: 0.426789 Oct 24 10:34:50.754619 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1241/2414] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:50 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1616 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:50.783199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0ef279aa-7015-4d53-a523-915cb9fe7a44 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:50.784495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0ef279aa-7015-4d53-a523-915cb9fe7a44 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:50.817484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ef279aa-7015-4d53-a523-915cb9fe7a44 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:50.818843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ef279aa-7015-4d53-a523-915cb9fe7a44 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:50.819534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ef279aa-7015-4d53-a523-915cb9fe7a44 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:50.822328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ef279aa-7015-4d53-a523-915cb9fe7a44 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:50.822740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ef279aa-7015-4d53-a523-915cb9fe7a44 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:50.823180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ef279aa-7015-4d53-a523-915cb9fe7a44 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:51.148755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0ef279aa-7015-4d53-a523-915cb9fe7a44 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:51.162976 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0ef279aa-7015-4d53-a523-915cb9fe7a44 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35" status: 200 len: 1317 microversion: 2.1 time: 0.390859 Oct 24 10:34:51.165534 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1242/2415] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:50 2022] GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35 => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:51.174367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0f486bcf-ee74-41cf-a840-ee554fd9f53c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:51.175698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0f486bcf-ee74-41cf-a840-ee554fd9f53c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:51.198699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f486bcf-ee74-41cf-a840-ee554fd9f53c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:51.199424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f486bcf-ee74-41cf-a840-ee554fd9f53c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:51.200605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f486bcf-ee74-41cf-a840-ee554fd9f53c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:51.202495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f486bcf-ee74-41cf-a840-ee554fd9f53c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:51.204255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f486bcf-ee74-41cf-a840-ee554fd9f53c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:51.204872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f486bcf-ee74-41cf-a840-ee554fd9f53c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:51.790612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:51.802001 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f58fff99-8a7e-4728-bbd6-39a1beca2267 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/defa3b6e-9861-4e3f-8891-3e8e05ad33d5" status: 202 len: 0 microversion: 2.1 time: 1.228216 Oct 24 10:34:51.802001 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1174/2416] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:34:50 2022] DELETE /compute/v2.1/os-security-groups/defa3b6e-9861-4e3f-8891-3e8e05ad33d5 => generated 0 bytes in 1233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:34:51.803474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-32026439-3043-4568-bded-bfc4c38ac12f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:51.804116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-32026439-3043-4568-bded-bfc4c38ac12f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:51.817090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32026439-3043-4568-bded-bfc4c38ac12f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:51.817646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32026439-3043-4568-bded-bfc4c38ac12f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:51.818238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32026439-3043-4568-bded-bfc4c38ac12f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:51.819245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32026439-3043-4568-bded-bfc4c38ac12f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:51.819515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32026439-3043-4568-bded-bfc4c38ac12f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:51.820128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32026439-3043-4568-bded-bfc4c38ac12f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:51.849159 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0f486bcf-ee74-41cf-a840-ee554fd9f53c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1616 microversion: 2.1 time: 0.681867 Oct 24 10:34:51.849755 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1243/2417] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:51 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1616 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:51.864789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9ca605a2-ad10-40a1-b839-ffbaa0512c10 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:51.864789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9ca605a2-ad10-40a1-b839-ffbaa0512c10 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:51.864789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ca605a2-ad10-40a1-b839-ffbaa0512c10 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:51.864789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ca605a2-ad10-40a1-b839-ffbaa0512c10 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:51.864789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ca605a2-ad10-40a1-b839-ffbaa0512c10 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:51.864789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ca605a2-ad10-40a1-b839-ffbaa0512c10 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:51.864789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ca605a2-ad10-40a1-b839-ffbaa0512c10 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:51.864789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ca605a2-ad10-40a1-b839-ffbaa0512c10 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:51.892190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32026439-3043-4568-bded-bfc4c38ac12f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:51.894864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32026439-3043-4568-bded-bfc4c38ac12f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:51.895646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32026439-3043-4568-bded-bfc4c38ac12f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:51.896305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-32026439-3043-4568-bded-bfc4c38ac12f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lazy-loading 'fault' on Instance uuid 7254c068-e068-42f0-b0bd-1fb8ed98104f {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:34:52.175747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-32026439-3043-4568-bded-bfc4c38ac12f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8044061b791543b6971fd889ad161161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac4ab050ff04fcab31bd2716c109436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:52.189884 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-32026439-3043-4568-bded-bfc4c38ac12f tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f" status: 200 len: 1367 microversion: 2.1 time: 0.391571 Oct 24 10:34:52.193774 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1175/2418] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:51 2022] GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f => generated 1367 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:52.205643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31adb0bf-88ef-43d1-80b0-694245ffa649 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d13dc670>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:52.260951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG neutronclient.v2_0.client [None req-31adb0bf-88ef-43d1-80b0-694245ffa649 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group defa3b6e-9861-4e3f-8891-3e8e05ad33d5 does not exist", "detail": ""}} {{(pid=120425) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:34:52.263003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.security_group_api [None req-31adb0bf-88ef-43d1-80b0-694245ffa649 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Neutron security group defa3b6e-9861-4e3f-8891-3e8e05ad33d5 not found {{(pid=120425) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 10:34:52.263856 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-31adb0bf-88ef-43d1-80b0-694245ffa649 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] HTTP exception thrown: Security group defa3b6e-9861-4e3f-8891-3e8e05ad33d5 does not exist Oct 24 10:34:52.263856 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-197deba2-c370-4768-ad28-546ced3c293a'] Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31adb0bf-88ef-43d1-80b0-694245ffa649 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Request method failure captured: Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-security-groups/defa3b6e-9861-4e3f-8891-3e8e05ad33d5 HTTP/1.1 Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmoaXPClcPLJ9gE_6C5GjDQZGdene0OObxZB0Z9ED_DBUfNEOv3AFVz9Sj51DSTvjG5d4L4G0Y7Y2LCJ3yblYYRp_EY66mnirefPs52lqIDsBuo9XJUGZQDidaxp2-3kvGCo_yrNtYTWeu7uqgvMarg1Wuv91gUnqbIjaBzXZEG6tDA Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/60b1c666c4914debad43704393d651cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_60b1c666c4914debad43704393d651cf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6aeb81e9b2fa4796813c607234174af6 Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: exception: Security group defa3b6e-9861-4e3f-8891-3e8e05ad33d5 does not exist Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-197deba2-c370-4768-ad28-546ced3c293a'] Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'defa3b6e-9861-4e3f-8891-3e8e05ad33d5'} Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:34:52.267827 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group defa3b6e-9861-4e3f-8891-3e8e05ad33d5 does not exist Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-197deba2-c370-4768-ad28-546ced3c293a'] Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group defa3b6e-9861-4e3f-8891-3e8e05ad33d5 does not exist Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-197deba2-c370-4768-ad28-546ced3c293a'] Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group defa3b6e-9861-4e3f-8891-3e8e05ad33d5 does not exist Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-197deba2-c370-4768-ad28-546ced3c293a'] Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group defa3b6e-9861-4e3f-8891-3e8e05ad33d5 does not exist Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-197deba2-c370-4768-ad28-546ced3c293a'] Oct 24 10:34:52.271990 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:52.278901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31adb0bf-88ef-43d1-80b0-694245ffa649 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Returning 404 to user: Security group defa3b6e-9861-4e3f-8891-3e8e05ad33d5 does not exist Oct 24 10:34:52.278901 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-197deba2-c370-4768-ad28-546ced3c293a'] {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:34:52.281082 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31adb0bf-88ef-43d1-80b0-694245ffa649 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/defa3b6e-9861-4e3f-8891-3e8e05ad33d5" status: 404 len: 194 microversion: 2.1 time: 0.083766 Oct 24 10:34:52.281999 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1176/2419] 10.222.0.50 () {58 vars in 1269 bytes} [Mon Oct 24 10:34:52 2022] GET /compute/v2.1/os-security-groups/defa3b6e-9861-4e3f-8891-3e8e05ad33d5 => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:34:52.295535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ea3a2d17-cd28-4c8f-acaf-186339391029 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:52.295831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9ca605a2-ad10-40a1-b839-ffbaa0512c10 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:52.308095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9ca605a2-ad10-40a1-b839-ffbaa0512c10 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:52.309599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9ca605a2-ad10-40a1-b839-ffbaa0512c10 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:52.312772 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9ca605a2-ad10-40a1-b839-ffbaa0512c10 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1488 microversion: 2.25 time: 0.462057 Oct 24 10:34:52.315033 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1244/2420] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:51 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1488 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:52.320749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8db654c6-b968-48b6-b327-b85ac65b65ae tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:52.323344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8db654c6-b968-48b6-b327-b85ac65b65ae tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:52.336170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ea3a2d17-cd28-4c8f-acaf-186339391029 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Searching by: {'host': 'n-h2-858383-15', 'deleted': False} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:34:52.337967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8db654c6-b968-48b6-b327-b85ac65b65ae tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:52.341085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8db654c6-b968-48b6-b327-b85ac65b65ae tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:52.342796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8db654c6-b968-48b6-b327-b85ac65b65ae tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:52.343744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8db654c6-b968-48b6-b327-b85ac65b65ae tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:52.345895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8db654c6-b968-48b6-b327-b85ac65b65ae tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:52.354678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8db654c6-b968-48b6-b327-b85ac65b65ae tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:52.365163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea3a2d17-cd28-4c8f-acaf-186339391029 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:52.373812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea3a2d17-cd28-4c8f-acaf-186339391029 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:52.374052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea3a2d17-cd28-4c8f-acaf-186339391029 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:52.377112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea3a2d17-cd28-4c8f-acaf-186339391029 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:52.377689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea3a2d17-cd28-4c8f-acaf-186339391029 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:52.378286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea3a2d17-cd28-4c8f-acaf-186339391029 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:52.604152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.multi_cell_list [None req-ea3a2d17-cd28-4c8f-acaf-186339391029 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=120425) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:34:52.696723 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ea3a2d17-cd28-4c8f-acaf-186339391029 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] 10.222.0.50 "GET /compute/v2.1/servers?host=n-h2-858383-15&all_tenants=1" status: 200 len: 2321 microversion: 2.1 time: 0.410990 Oct 24 10:34:52.707914 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1177/2421] 10.222.0.50 () {58 vars in 1192 bytes} [Mon Oct 24 10:34:52 2022] GET /compute/v2.1/servers?host=n-h2-858383-15&all_tenants=1 => generated 2321 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:52.714028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2559a58c-53c8-4b41-9973-14d0964d97c4 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d500b280>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:53.446590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8db654c6-b968-48b6-b327-b85ac65b65ae tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:53.465448 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8db654c6-b968-48b6-b327-b85ac65b65ae tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35" status: 200 len: 1317 microversion: 2.1 time: 1.148671 Oct 24 10:34:53.466344 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1245/2422] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:52 2022] GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35 => generated 1317 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:53.471190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-45d46337-6c57-4418-8fb6-4ecf90c4acc4 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:53.482533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-45d46337-6c57-4418-8fb6-4ecf90c4acc4 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:34:53.491117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-45d46337-6c57-4418-8fb6-4ecf90c4acc4 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:53.492059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-45d46337-6c57-4418-8fb6-4ecf90c4acc4 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:53.493130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-45d46337-6c57-4418-8fb6-4ecf90c4acc4 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:53.495202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-45d46337-6c57-4418-8fb6-4ecf90c4acc4 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:53.495724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-45d46337-6c57-4418-8fb6-4ecf90c4acc4 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:53.496224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-45d46337-6c57-4418-8fb6-4ecf90c4acc4 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:53.604113 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-45d46337-6c57-4418-8fb6-4ecf90c4acc4 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] 10.222.0.50 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.136427 Oct 24 10:34:53.609379 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1246/2423] 10.222.0.50 () {58 vars in 1196 bytes} [Mon Oct 24 10:34:53 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:34:53.622045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-43599ac4-e40f-435c-8c2b-4c8e9811ec2b tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:53.622926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-43599ac4-e40f-435c-8c2b-4c8e9811ec2b tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] [instance: 7254c068-e068-42f0-b0bd-1fb8ed98104f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:53.629766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43599ac4-e40f-435c-8c2b-4c8e9811ec2b tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:53.630328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43599ac4-e40f-435c-8c2b-4c8e9811ec2b tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:53.630909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43599ac4-e40f-435c-8c2b-4c8e9811ec2b tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:53.631523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43599ac4-e40f-435c-8c2b-4c8e9811ec2b tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:53.632239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43599ac4-e40f-435c-8c2b-4c8e9811ec2b tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:53.633336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43599ac4-e40f-435c-8c2b-4c8e9811ec2b tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:53.649833 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-43599ac4-e40f-435c-8c2b-4c8e9811ec2b tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] HTTP exception thrown: Instance 7254c068-e068-42f0-b0bd-1fb8ed98104f could not be found. Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-43599ac4-e40f-435c-8c2b-4c8e9811ec2b tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Request method failure captured: Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f HTTP/1.1 Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmnZRgNU3apcq-PvXlMDYogJWzMCMzwtJqm8m9i4FCq4Jx1sb8gGlUf3zEiz5ZIKOt4OGAW62isqiyOcgucBjLzX3y6dfvR56Ho8pxGS_d3UQga8y82qjMaYjUVl09xUAcxq43Qq6yJ3FgPU8wf7bovR6MyvrKnTVPinRCwGxKgboVc Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 3ac4ab050ff04fcab31bd2716c109436 Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersTestManualDisk-1065098358 Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3ac4ab050ff04fcab31bd2716c109436"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3ac4ab050ff04fcab31bd2716c109436"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3ac4ab050ff04fcab31bd2716c109436"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3ac4ab050ff04fcab31bd2716c109436", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersTestManualDisk-1065098358 Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 3ac4ab050ff04fcab31bd2716c109436 Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersTestManualDisk-1065098358 Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersTestManualDisk-1065098358-project Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 8044061b791543b6971fd889ad161161 Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersTestManualDisk-1065098358-project Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 7254c068-e068-42f0-b0bd-1fb8ed98104f could not be found. Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '7254c068-e068-42f0-b0bd-1fb8ed98104f'} Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7254c068-e068-42f0-b0bd-1fb8ed98104f could not be found. Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7254c068-e068-42f0-b0bd-1fb8ed98104f could not be found. Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:53.651644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:34:53.661106 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:53.661106 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:53.661106 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:53.661106 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:34:53.661106 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:34:53.661106 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7254c068-e068-42f0-b0bd-1fb8ed98104f could not be found. Oct 24 10:34:53.661106 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:34:53.661106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-43599ac4-e40f-435c-8c2b-4c8e9811ec2b tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Returning 404 to user: Instance 7254c068-e068-42f0-b0bd-1fb8ed98104f could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:34:53.661106 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-43599ac4-e40f-435c-8c2b-4c8e9811ec2b tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f" status: 404 len: 111 microversion: 2.1 time: 0.046811 Oct 24 10:34:53.661106 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1247/2424] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:53 2022] GET /compute/v2.1/servers/7254c068-e068-42f0-b0bd-1fb8ed98104f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:34:53.663761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-09cf98cd-1ad2-43de-a7fa-ead578833f0d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:53.664509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-09cf98cd-1ad2-43de-a7fa-ead578833f0d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:53.671393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09cf98cd-1ad2-43de-a7fa-ead578833f0d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:53.671876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09cf98cd-1ad2-43de-a7fa-ead578833f0d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:53.672307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09cf98cd-1ad2-43de-a7fa-ead578833f0d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:53.673311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09cf98cd-1ad2-43de-a7fa-ead578833f0d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:53.673914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09cf98cd-1ad2-43de-a7fa-ead578833f0d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:53.674619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09cf98cd-1ad2-43de-a7fa-ead578833f0d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:53.801318 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2559a58c-53c8-4b41-9973-14d0964d97c4 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/a344396a-986e-412b-a7b0-51c1b7f7dc78" status: 202 len: 0 microversion: 2.1 time: 1.091932 Oct 24 10:34:53.802524 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1178/2425] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:34:52 2022] DELETE /compute/v2.1/os-security-groups/a344396a-986e-412b-a7b0-51c1b7f7dc78 => generated 0 bytes in 1094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:34:53.808548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a73dae81-dfd5-4d43-b44b-11bb13ea24c6 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:53.811538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a73dae81-dfd5-4d43-b44b-11bb13ea24c6 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:53.821492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a73dae81-dfd5-4d43-b44b-11bb13ea24c6 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:53.822238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a73dae81-dfd5-4d43-b44b-11bb13ea24c6 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:53.822854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a73dae81-dfd5-4d43-b44b-11bb13ea24c6 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:53.824034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a73dae81-dfd5-4d43-b44b-11bb13ea24c6 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:53.824658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a73dae81-dfd5-4d43-b44b-11bb13ea24c6 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:53.825295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a73dae81-dfd5-4d43-b44b-11bb13ea24c6 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:53.898004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:53.936294 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a73dae81-dfd5-4d43-b44b-11bb13ea24c6 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43/action" status: 202 len: 0 microversion: 2.1 time: 0.131964 Oct 24 10:34:53.942869 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1179/2426] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:34:53 2022] POST /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:34:53.953331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3bcb00dc-de9d-40ff-a372-f02298f32b7c tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] Calling method '.version_select at 0x7f04d0da03a0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:53.990601 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3bcb00dc-de9d-40ff-a372-f02298f32b7c tempest-ServersTestManualDisk-1065098358 tempest-ServersTestManualDisk-1065098358-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507993324" status: 202 len: 0 microversion: 2.1 time: 0.045967 Oct 24 10:34:54.009840 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1180/2427] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Oct 24 10:34:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507993324 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:34:54.015874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-09cf98cd-1ad2-43de-a7fa-ead578833f0d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:54.025767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4d00fbde-f66c-49ed-a593-925cf3645e9c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d0a08310>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:54.029946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-09cf98cd-1ad2-43de-a7fa-ead578833f0d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:54.031431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-09cf98cd-1ad2-43de-a7fa-ead578833f0d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:54.034062 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-09cf98cd-1ad2-43de-a7fa-ead578833f0d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1488 microversion: 2.25 time: 0.374291 Oct 24 10:34:54.034665 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1248/2428] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:53 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1488 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:54.055101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:54.057872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:54.082313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:54.087122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:54.087590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:54.088373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:54.088863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:54.089308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:54.100171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG neutronclient.v2_0.client [None req-4d00fbde-f66c-49ed-a593-925cf3645e9c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a344396a-986e-412b-a7b0-51c1b7f7dc78 does not exist", "detail": ""}} {{(pid=120425) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:34:54.100774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.security_group_api [None req-4d00fbde-f66c-49ed-a593-925cf3645e9c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Neutron security group a344396a-986e-412b-a7b0-51c1b7f7dc78 not found {{(pid=120425) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 10:34:54.101322 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-4d00fbde-f66c-49ed-a593-925cf3645e9c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] HTTP exception thrown: Security group a344396a-986e-412b-a7b0-51c1b7f7dc78 does not exist Oct 24 10:34:54.101322 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-38ed7233-829d-4c74-8f01-bfbe24e8f849'] Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4d00fbde-f66c-49ed-a593-925cf3645e9c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Request method failure captured: Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-security-groups/a344396a-986e-412b-a7b0-51c1b7f7dc78 HTTP/1.1 Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmoaXPClcPLJ9gE_6C5GjDQZGdene0OObxZB0Z9ED_DBUfNEOv3AFVz9Sj51DSTvjG5d4L4G0Y7Y2LCJ3yblYYRp_EY66mnirefPs52lqIDsBuo9XJUGZQDidaxp2-3kvGCo_yrNtYTWeu7uqgvMarg1Wuv91gUnqbIjaBzXZEG6tDA Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/60b1c666c4914debad43704393d651cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_60b1c666c4914debad43704393d651cf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6aeb81e9b2fa4796813c607234174af6 Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: exception: Security group a344396a-986e-412b-a7b0-51c1b7f7dc78 does not exist Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-38ed7233-829d-4c74-8f01-bfbe24e8f849'] Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'a344396a-986e-412b-a7b0-51c1b7f7dc78'} Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:34:54.103145 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a344396a-986e-412b-a7b0-51c1b7f7dc78 does not exist Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38ed7233-829d-4c74-8f01-bfbe24e8f849'] Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a344396a-986e-412b-a7b0-51c1b7f7dc78 does not exist Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38ed7233-829d-4c74-8f01-bfbe24e8f849'] Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a344396a-986e-412b-a7b0-51c1b7f7dc78 does not exist Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38ed7233-829d-4c74-8f01-bfbe24e8f849'] Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a344396a-986e-412b-a7b0-51c1b7f7dc78 does not exist Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38ed7233-829d-4c74-8f01-bfbe24e8f849'] Oct 24 10:34:54.107134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:54.110348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4d00fbde-f66c-49ed-a593-925cf3645e9c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Returning 404 to user: Security group a344396a-986e-412b-a7b0-51c1b7f7dc78 does not exist Oct 24 10:34:54.110348 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-38ed7233-829d-4c74-8f01-bfbe24e8f849'] {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:34:54.111417 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4d00fbde-f66c-49ed-a593-925cf3645e9c tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/a344396a-986e-412b-a7b0-51c1b7f7dc78" status: 404 len: 194 microversion: 2.1 time: 0.099014 Oct 24 10:34:54.116333 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1181/2429] 10.222.0.50 () {58 vars in 1269 bytes} [Mon Oct 24 10:34:54 2022] GET /compute/v2.1/os-security-groups/a344396a-986e-412b-a7b0-51c1b7f7dc78 => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:34:54.128672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c015c54-4c25-4905-8a23-04bc0c4029ee tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d0f5c670>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:54.270969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:34:54.273508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:34:54.274009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:34:54.274443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:34:54.276678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:34:54.367844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:54.377396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:54.378922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:54.379658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:54.380592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:54.381548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:54.383754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:54.419402 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7d5df3ea-b304-4798-ada4-db376d0c3f92 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "POST /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43/action" status: 202 len: 1067 microversion: 2.1 time: 0.380976 Oct 24 10:34:54.420414 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1249/2430] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:34:54 2022] POST /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43/action => generated 1067 bytes in 383 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 24 10:34:54.429626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-41482902-2226-4dbe-bc78-f590bbb674b5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:54.430600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-41482902-2226-4dbe-bc78-f590bbb674b5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:54.443667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41482902-2226-4dbe-bc78-f590bbb674b5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:54.444474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41482902-2226-4dbe-bc78-f590bbb674b5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:54.445749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41482902-2226-4dbe-bc78-f590bbb674b5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:54.446678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41482902-2226-4dbe-bc78-f590bbb674b5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:54.447734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41482902-2226-4dbe-bc78-f590bbb674b5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:54.448327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41482902-2226-4dbe-bc78-f590bbb674b5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:54.694206 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4c015c54-4c25-4905-8a23-04bc0c4029ee tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.576485 Oct 24 10:34:54.695007 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1182/2431] 10.222.0.50 () {58 vars in 1158 bytes} [Mon Oct 24 10:34:54 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:54.772362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-41482902-2226-4dbe-bc78-f590bbb674b5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:54.784636 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-41482902-2226-4dbe-bc78-f590bbb674b5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.362776 Oct 24 10:34:54.785491 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1250/2432] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:54 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:54.809284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:54.810396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9ce182db-b789-47fb-9466-deb9be37dc6b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:54.811206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9ce182db-b789-47fb-9466-deb9be37dc6b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:54.823302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce182db-b789-47fb-9466-deb9be37dc6b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:54.823792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce182db-b789-47fb-9466-deb9be37dc6b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:54.824435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce182db-b789-47fb-9466-deb9be37dc6b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:54.825766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce182db-b789-47fb-9466-deb9be37dc6b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:54.826790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce182db-b789-47fb-9466-deb9be37dc6b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:54.827280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce182db-b789-47fb-9466-deb9be37dc6b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:54.881403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cb233e7d-b3d2-45f2-b000-23e2d4ca4db2 tempest-FlavorsV2NegativeTest-165115626 tempest-FlavorsV2NegativeTest-165115626-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:54.892496 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cb233e7d-b3d2-45f2-b000-23e2d4ca4db2 tempest-FlavorsV2NegativeTest-165115626 tempest-FlavorsV2NegativeTest-165115626-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.195269 Oct 24 10:34:54.893961 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1183/2433] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:34:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:55.042483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-9228b39c-6a28-47c7-953a-ac8b418ee859 req-5da6cf29-a319-42b0-9b54-a4e494f96edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9d7d55-3dee-4605-a8ac-594a62bb5d35", "name": "network-vif-plugged", "status": "completed", "tag": "f176994c-7a9f-41c3-9a48-3b16c092cacd"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:55.075905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9228b39c-6a28-47c7-953a-ac8b418ee859 req-5da6cf29-a319-42b0-9b54-a4e494f96edf service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:55.078642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9228b39c-6a28-47c7-953a-ac8b418ee859 req-5da6cf29-a319-42b0-9b54-a4e494f96edf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:55.080160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9228b39c-6a28-47c7-953a-ac8b418ee859 req-5da6cf29-a319-42b0-9b54-a4e494f96edf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:55.100084 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-9228b39c-6a28-47c7-953a-ac8b418ee859 req-5da6cf29-a319-42b0-9b54-a4e494f96edf service nova] Creating event network-vif-plugged:f176994c-7a9f-41c3-9a48-3b16c092cacd for instance bf9d7d55-3dee-4605-a8ac-594a62bb5d35 on n-h1-858383-15 Oct 24 10:34:55.106637 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-9228b39c-6a28-47c7-953a-ac8b418ee859 req-5da6cf29-a319-42b0-9b54-a4e494f96edf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210967 Oct 24 10:34:55.107766 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1184/2434] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:55.113803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9ce182db-b789-47fb-9466-deb9be37dc6b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:55.120219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6198ad5b-ef47-4d13-b72d-a931fd2da61e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:55.121358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6198ad5b-ef47-4d13-b72d-a931fd2da61e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:55.126303 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9ce182db-b789-47fb-9466-deb9be37dc6b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1471 microversion: 2.1 time: 0.339206 Oct 24 10:34:55.128053 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1251/2435] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:54 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1471 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:55.131259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6198ad5b-ef47-4d13-b72d-a931fd2da61e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:55.132279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6198ad5b-ef47-4d13-b72d-a931fd2da61e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:55.133074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6198ad5b-ef47-4d13-b72d-a931fd2da61e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:55.134739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6198ad5b-ef47-4d13-b72d-a931fd2da61e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:55.135412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6198ad5b-ef47-4d13-b72d-a931fd2da61e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:55.136065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6198ad5b-ef47-4d13-b72d-a931fd2da61e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:55.154324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ada1382b-4179-49e6-8729-0eb44a0c38c9 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Action: 'create', calling method: .version_select at 0x7f04d09404c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1892126366", "description": "tempest-description-1813992851"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:55.450400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6198ad5b-ef47-4d13-b72d-a931fd2da61e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:55.465452 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6198ad5b-ef47-4d13-b72d-a931fd2da61e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35" status: 200 len: 1317 microversion: 2.1 time: 0.350385 Oct 24 10:34:55.467415 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1185/2436] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:55 2022] GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:55.477376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c15c50aa-19a0-42f4-a0ea-47f0e49e6d95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1641831364"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:55.482754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c15c50aa-19a0-42f4-a0ea-47f0e49e6d95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:55.494619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c15c50aa-19a0-42f4-a0ea-47f0e49e6d95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:55.495310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c15c50aa-19a0-42f4-a0ea-47f0e49e6d95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:55.495916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c15c50aa-19a0-42f4-a0ea-47f0e49e6d95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:55.496773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c15c50aa-19a0-42f4-a0ea-47f0e49e6d95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:55.497438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c15c50aa-19a0-42f4-a0ea-47f0e49e6d95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:55.498563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c15c50aa-19a0-42f4-a0ea-47f0e49e6d95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:55.667074 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ada1382b-4179-49e6-8729-0eb44a0c38c9 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.536776 Oct 24 10:34:55.678581 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1252/2437] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:34:55 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:55.678581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0355cc9b-4a02-40d9-91c6-ccf7adacadc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:55.678581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0355cc9b-4a02-40d9-91c6-ccf7adacadc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:55.684321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0355cc9b-4a02-40d9-91c6-ccf7adacadc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:55.684815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0355cc9b-4a02-40d9-91c6-ccf7adacadc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:55.685287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0355cc9b-4a02-40d9-91c6-ccf7adacadc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:55.686002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0355cc9b-4a02-40d9-91c6-ccf7adacadc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:55.692287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0355cc9b-4a02-40d9-91c6-ccf7adacadc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:55.693389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0355cc9b-4a02-40d9-91c6-ccf7adacadc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:55.828183 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c15c50aa-19a0-42f4-a0ea-47f0e49e6d95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 202 len: 0 microversion: 2.1 time: 0.357227 Oct 24 10:34:55.828794 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1186/2438] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:34:55 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 24 10:34:55.836453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd102862-a7dd-4724-9d84-fc72bf02eab7 tempest-FlavorsV2NegativeTest-165115626 tempest-FlavorsV2NegativeTest-165115626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1043209842", "imageRef": "492a6b2c-8529-439a-bdc0-275126add25b", "flavorRef": "452"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:55.910683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-bd102862-a7dd-4724-9d84-fc72bf02eab7 tempest-FlavorsV2NegativeTest-165115626 tempest-FlavorsV2NegativeTest-165115626-project] validate_networks() for None {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:34:55.983955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0355cc9b-4a02-40d9-91c6-ccf7adacadc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:55.995907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0355cc9b-4a02-40d9-91c6-ccf7adacadc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:55.998494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0355cc9b-4a02-40d9-91c6-ccf7adacadc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:56.000479 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0355cc9b-4a02-40d9-91c6-ccf7adacadc0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1488 microversion: 2.25 time: 0.331382 Oct 24 10:34:56.001170 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1253/2439] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:55 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1488 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:56.009310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-589c2e40-15cc-4dd4-b515-1b5420e011b1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Action: 'create', calling method: .version_select at 0x7f04d05ac280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-587164822", "description": "tempest-description-1591594362"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:56.348905 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-bd102862-a7dd-4724-9d84-fc72bf02eab7 tempest-FlavorsV2NegativeTest-165115626 tempest-FlavorsV2NegativeTest-165115626-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd102862-a7dd-4724-9d84-fc72bf02eab7 tempest-FlavorsV2NegativeTest-165115626 tempest-FlavorsV2NegativeTest-165115626-project] Request method failure captured: Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 143 Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpOygMPIBqEj3dnFXtfqgcq-x8ad5q97BXKcQEquiHW-2FIlag6LcuHtMCVbl7fJ9oW3gb_kwJhxK0snu1oy4v5yWxqNnT_JYUvPwm_W5VtPdZXwSV8YkDQF9aVYOGwqE5tmnVc7Y9SXHsvO3E5YqRHnAv_FEJbZgxkawRdHvbWWZ0 Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 1c862c9cdae749bc914626392766e8f6 Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-FlavorsV2NegativeTest-165115626 Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1c862c9cdae749bc914626392766e8f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1c862c9cdae749bc914626392766e8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1c862c9cdae749bc914626392766e8f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1c862c9cdae749bc914626392766e8f6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-FlavorsV2NegativeTest-165115626 Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 1c862c9cdae749bc914626392766e8f6 Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-165115626 Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-FlavorsV2NegativeTest-165115626-project Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 8a1f2bfc54dc4254b1bd6fa0404210b8 Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-FlavorsV2NegativeTest-165115626-project Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1043209842", "imageRef": "492a6b2c-8529-439a-bdc0-275126add25b", "flavorRef": "452"}} Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: exception: Flavor's memory is too small for requested image. Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1043209842', 'imageRef': '492a6b2c-8529-439a-bdc0-275126add25b', 'flavorRef': '452'}}} Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:34:56.350958 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:34:56.354887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:34:56.354887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:34:56.354887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 10:34:56.354887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 24 10:34:56.354887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 24 10:34:56.354887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 24 10:34:56.354887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:56.354887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:34:56.354887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:56.354887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:34:56.354887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:34:56.354887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:34:56.354887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:34:56.354887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:34:56.354887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 24 10:34:56.354887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:34:56.357263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd102862-a7dd-4724-9d84-fc72bf02eab7 tempest-FlavorsV2NegativeTest-165115626 tempest-FlavorsV2NegativeTest-165115626-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:34:56.358209 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bd102862-a7dd-4724-9d84-fc72bf02eab7 tempest-FlavorsV2NegativeTest-165115626 tempest-FlavorsV2NegativeTest-165115626-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.528259 Oct 24 10:34:56.358996 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1187/2440] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:34:55 2022] POST /compute/v2.1/servers => generated 93 bytes in 530 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 10:34:56.374760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-24a11363-eacc-4926-b9a4-b7f369ed222d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:56.375436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-24a11363-eacc-4926-b9a4-b7f369ed222d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:56.387762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24a11363-eacc-4926-b9a4-b7f369ed222d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:56.388876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24a11363-eacc-4926-b9a4-b7f369ed222d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:56.389410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24a11363-eacc-4926-b9a4-b7f369ed222d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:56.390313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24a11363-eacc-4926-b9a4-b7f369ed222d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:56.390931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24a11363-eacc-4926-b9a4-b7f369ed222d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:56.391691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24a11363-eacc-4926-b9a4-b7f369ed222d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:56.530712 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-589c2e40-15cc-4dd4-b515-1b5420e011b1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.527469 Oct 24 10:34:56.551212 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1254/2441] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:34:56 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:56.560286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f680b9eb-ad6c-4f23-b1bb-0954932239d5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:56.562445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f680b9eb-ad6c-4f23-b1bb-0954932239d5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:56.573539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f680b9eb-ad6c-4f23-b1bb-0954932239d5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:56.574900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f680b9eb-ad6c-4f23-b1bb-0954932239d5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:56.575553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f680b9eb-ad6c-4f23-b1bb-0954932239d5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:56.578511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f680b9eb-ad6c-4f23-b1bb-0954932239d5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:56.583355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f680b9eb-ad6c-4f23-b1bb-0954932239d5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:56.584478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f680b9eb-ad6c-4f23-b1bb-0954932239d5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:56.718089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-24a11363-eacc-4926-b9a4-b7f369ed222d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:56.728059 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-24a11363-eacc-4926-b9a4-b7f369ed222d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1681 microversion: 2.1 time: 0.367862 Oct 24 10:34:56.729211 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1188/2442] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:56 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1681 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:56.748339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e1b85208-2573-4271-bd19-3b837bab2f9b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:56.749027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e1b85208-2573-4271-bd19-3b837bab2f9b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:56.759001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1b85208-2573-4271-bd19-3b837bab2f9b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:56.759503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1b85208-2573-4271-bd19-3b837bab2f9b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:56.759949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1b85208-2573-4271-bd19-3b837bab2f9b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:56.760668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1b85208-2573-4271-bd19-3b837bab2f9b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:56.761297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1b85208-2573-4271-bd19-3b837bab2f9b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:56.761729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1b85208-2573-4271-bd19-3b837bab2f9b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:56.996906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f680b9eb-ad6c-4f23-b1bb-0954932239d5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:57.012019 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f680b9eb-ad6c-4f23-b1bb-0954932239d5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1471 microversion: 2.1 time: 0.454406 Oct 24 10:34:57.037764 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1255/2443] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:56 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1471 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:57.057946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-353a4ce1-0172-4676-bffa-28d311af5a6a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1580962294", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "f8aaf736-bcc8-4efe-a0af-ff2b8190b625"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:57.138867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e1b85208-2573-4271-bd19-3b837bab2f9b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:57.164723 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e1b85208-2573-4271-bd19-3b837bab2f9b tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35" status: 200 len: 1317 microversion: 2.1 time: 0.434347 Oct 24 10:34:57.166918 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1189/2444] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:56 2022] GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35 => generated 1317 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:57.173047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-353a4ce1-0172-4676-bffa-28d311af5a6a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] validate_networks() for [('f8aaf736-bcc8-4efe-a0af-ff2b8190b625', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:34:57.180005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f9302fd0-b61a-4a92-b07b-37a8ec4154ae req-4807750c-9958-458c-bbb3-3c9db7a7f26b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d", "name": "network-vif-unplugged", "status": "completed", "tag": "4787ea89-a905-45b9-ba75-416fa72d12e3"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:57.203355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:34:57.212360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f9302fd0-b61a-4a92-b07b-37a8ec4154ae req-4807750c-9958-458c-bbb3-3c9db7a7f26b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:57.213546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f9302fd0-b61a-4a92-b07b-37a8ec4154ae req-4807750c-9958-458c-bbb3-3c9db7a7f26b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:57.214206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f9302fd0-b61a-4a92-b07b-37a8ec4154ae req-4807750c-9958-458c-bbb3-3c9db7a7f26b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:57.233064 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f9302fd0-b61a-4a92-b07b-37a8ec4154ae req-4807750c-9958-458c-bbb3-3c9db7a7f26b service nova] Creating event network-vif-unplugged:4787ea89-a905-45b9-ba75-416fa72d12e3 for instance c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d on n-h1-858383-15 Oct 24 10:34:57.241553 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f9302fd0-b61a-4a92-b07b-37a8ec4154ae req-4807750c-9958-458c-bbb3-3c9db7a7f26b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072091 Oct 24 10:34:57.243189 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1190/2445] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:57.249819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-84f3ff15-f53d-440b-ba42-91493ce051a5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:57.250846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-84f3ff15-f53d-440b-ba42-91493ce051a5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:57.262119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84f3ff15-f53d-440b-ba42-91493ce051a5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:57.262908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84f3ff15-f53d-440b-ba42-91493ce051a5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:57.263906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84f3ff15-f53d-440b-ba42-91493ce051a5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:57.265208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84f3ff15-f53d-440b-ba42-91493ce051a5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:57.266070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84f3ff15-f53d-440b-ba42-91493ce051a5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:57.266825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84f3ff15-f53d-440b-ba42-91493ce051a5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:57.840714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-84f3ff15-f53d-440b-ba42-91493ce051a5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:57.857423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-84f3ff15-f53d-440b-ba42-91493ce051a5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:57.867827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-84f3ff15-f53d-440b-ba42-91493ce051a5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:57.870593 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-84f3ff15-f53d-440b-ba42-91493ce051a5 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1488 microversion: 2.25 time: 0.625708 Oct 24 10:34:57.878621 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1191/2446] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:57 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1488 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:34:57.893984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f2b74a41-e991-4d8a-9530-4569572b1789 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:57.894891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f2b74a41-e991-4d8a-9530-4569572b1789 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:57.912430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2b74a41-e991-4d8a-9530-4569572b1789 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:57.913129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2b74a41-e991-4d8a-9530-4569572b1789 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:57.913664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2b74a41-e991-4d8a-9530-4569572b1789 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:57.914475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2b74a41-e991-4d8a-9530-4569572b1789 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:57.915887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2b74a41-e991-4d8a-9530-4569572b1789 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:57.917537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2b74a41-e991-4d8a-9530-4569572b1789 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:58.420399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f2b74a41-e991-4d8a-9530-4569572b1789 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:58.433856 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f2b74a41-e991-4d8a-9530-4569572b1789 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1689 microversion: 2.1 time: 0.553167 Oct 24 10:34:58.435129 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1192/2447] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:57 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1689 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:58.443612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3da3b2cb-c3cb-4d33-a9b6-60879b3a2db2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:58.447089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3da3b2cb-c3cb-4d33-a9b6-60879b3a2db2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:58.464584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3da3b2cb-c3cb-4d33-a9b6-60879b3a2db2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:58.465507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3da3b2cb-c3cb-4d33-a9b6-60879b3a2db2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:58.465923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3da3b2cb-c3cb-4d33-a9b6-60879b3a2db2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:58.466637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3da3b2cb-c3cb-4d33-a9b6-60879b3a2db2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:58.467284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3da3b2cb-c3cb-4d33-a9b6-60879b3a2db2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:58.467722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3da3b2cb-c3cb-4d33-a9b6-60879b3a2db2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:58.734097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-353a4ce1-0172-4676-bffa-28d311af5a6a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:34:58.734679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-353a4ce1-0172-4676-bffa-28d311af5a6a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:34:58.734991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-353a4ce1-0172-4676-bffa-28d311af5a6a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:34:58.735534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-353a4ce1-0172-4676-bffa-28d311af5a6a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:34:58.736268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-353a4ce1-0172-4676-bffa-28d311af5a6a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:34:58.761305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-353a4ce1-0172-4676-bffa-28d311af5a6a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:58.762626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-353a4ce1-0172-4676-bffa-28d311af5a6a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:58.763100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-353a4ce1-0172-4676-bffa-28d311af5a6a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:58.763928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-353a4ce1-0172-4676-bffa-28d311af5a6a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:58.764401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-353a4ce1-0172-4676-bffa-28d311af5a6a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:58.764857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-353a4ce1-0172-4676-bffa-28d311af5a6a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:58.817437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-353a4ce1-0172-4676-bffa-28d311af5a6a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Getting quotas for project 60b1c666c4914debad43704393d651cf. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:34:58.831976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-353a4ce1-0172-4676-bffa-28d311af5a6a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Getting quotas for user 6aeb81e9b2fa4796813c607234174af6 and project 60b1c666c4914debad43704393d651cf. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:34:58.862763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-353a4ce1-0172-4676-bffa-28d311af5a6a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:34:58.870629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-353a4ce1-0172-4676-bffa-28d311af5a6a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:34:59.048309 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-353a4ce1-0172-4676-bffa-28d311af5a6a tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.001874 Oct 24 10:34:59.049019 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1256/2448] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:34:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:34:59.058419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bfb3f4d0-1af8-45e4-aa65-d880e9eeb163 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:59.060997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bfb3f4d0-1af8-45e4-aa65-d880e9eeb163 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:59.084150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bfb3f4d0-1af8-45e4-aa65-d880e9eeb163 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:59.085832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bfb3f4d0-1af8-45e4-aa65-d880e9eeb163 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:59.087810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bfb3f4d0-1af8-45e4-aa65-d880e9eeb163 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:59.089158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bfb3f4d0-1af8-45e4-aa65-d880e9eeb163 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:59.091150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bfb3f4d0-1af8-45e4-aa65-d880e9eeb163 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:59.091794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bfb3f4d0-1af8-45e4-aa65-d880e9eeb163 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:59.146169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3da3b2cb-c3cb-4d33-a9b6-60879b3a2db2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:59.159105 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3da3b2cb-c3cb-4d33-a9b6-60879b3a2db2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1471 microversion: 2.1 time: 0.722005 Oct 24 10:34:59.163489 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1193/2449] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:58 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1471 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:59.184821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-88e2942d-bfdd-4bfd-8dcb-d094b8186f8c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:59.187580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-88e2942d-bfdd-4bfd-8dcb-d094b8186f8c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:59.204112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88e2942d-bfdd-4bfd-8dcb-d094b8186f8c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:59.204718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88e2942d-bfdd-4bfd-8dcb-d094b8186f8c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:59.205265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88e2942d-bfdd-4bfd-8dcb-d094b8186f8c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:59.206953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88e2942d-bfdd-4bfd-8dcb-d094b8186f8c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:59.207869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88e2942d-bfdd-4bfd-8dcb-d094b8186f8c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:59.208449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88e2942d-bfdd-4bfd-8dcb-d094b8186f8c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:59.474111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bfb3f4d0-1af8-45e4-aa65-d880e9eeb163 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:59.511839 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bfb3f4d0-1af8-45e4-aa65-d880e9eeb163 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35" status: 200 len: 1508 microversion: 2.1 time: 0.457259 Oct 24 10:34:59.512738 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1257/2450] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:59 2022] GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35 => generated 1508 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:59.551112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-28ab8b25-e157-4c5e-a8c7-1bb3c92b927b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:59.551819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-28ab8b25-e157-4c5e-a8c7-1bb3c92b927b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:59.762924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-28ab8b25-e157-4c5e-a8c7-1bb3c92b927b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:34:59.778372 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-28ab8b25-e157-4c5e-a8c7-1bb3c92b927b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1216 microversion: 2.1 time: 0.257950 Oct 24 10:34:59.782162 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1258/2451] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:59 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1216 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:34:59.792413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-837bb3e0-0825-4a8d-82d2-560fda56badf req-2f6609d6-f6e4-4760-9ac8-83331e20fafd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d", "tag": "4787ea89-a905-45b9-ba75-416fa72d12e3"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:34:59.809527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-837bb3e0-0825-4a8d-82d2-560fda56badf req-2f6609d6-f6e4-4760-9ac8-83331e20fafd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:59.810647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-837bb3e0-0825-4a8d-82d2-560fda56badf req-2f6609d6-f6e4-4760-9ac8-83331e20fafd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:59.811380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-837bb3e0-0825-4a8d-82d2-560fda56badf req-2f6609d6-f6e4-4760-9ac8-83331e20fafd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:59.825819 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-837bb3e0-0825-4a8d-82d2-560fda56badf req-2f6609d6-f6e4-4760-9ac8-83331e20fafd service nova] Creating event network-changed:4787ea89-a905-45b9-ba75-416fa72d12e3 for instance c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d on n-h1-858383-15 Oct 24 10:34:59.833017 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-837bb3e0-0825-4a8d-82d2-560fda56badf req-2f6609d6-f6e4-4760-9ac8-83331e20fafd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048898 Oct 24 10:34:59.834082 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1259/2452] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:34:59.839963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-345256a3-c1fd-4d51-b473-a14ef70313fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:34:59.841274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-345256a3-c1fd-4d51-b473-a14ef70313fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:34:59.849963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-345256a3-c1fd-4d51-b473-a14ef70313fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:59.850984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-345256a3-c1fd-4d51-b473-a14ef70313fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:59.851711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-345256a3-c1fd-4d51-b473-a14ef70313fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:34:59.852650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-345256a3-c1fd-4d51-b473-a14ef70313fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:34:59.853375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-345256a3-c1fd-4d51-b473-a14ef70313fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:34:59.854023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-345256a3-c1fd-4d51-b473-a14ef70313fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:00.454400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-88e2942d-bfdd-4bfd-8dcb-d094b8186f8c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:00.466895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-88e2942d-bfdd-4bfd-8dcb-d094b8186f8c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:00.470235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-88e2942d-bfdd-4bfd-8dcb-d094b8186f8c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:00.477791 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-88e2942d-bfdd-4bfd-8dcb-d094b8186f8c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1488 microversion: 2.25 time: 1.300964 Oct 24 10:35:00.479083 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1194/2453] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:34:59 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1488 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:35:00.490094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b09021c2-90de-47eb-b36f-54ab5585ec5d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:00.491138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b09021c2-90de-47eb-b36f-54ab5585ec5d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:00.511048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b09021c2-90de-47eb-b36f-54ab5585ec5d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:00.511961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b09021c2-90de-47eb-b36f-54ab5585ec5d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:00.512692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b09021c2-90de-47eb-b36f-54ab5585ec5d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:00.513726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b09021c2-90de-47eb-b36f-54ab5585ec5d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:00.514440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b09021c2-90de-47eb-b36f-54ab5585ec5d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:00.515788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b09021c2-90de-47eb-b36f-54ab5585ec5d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:00.586902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-345256a3-c1fd-4d51-b473-a14ef70313fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:00.600981 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-345256a3-c1fd-4d51-b473-a14ef70313fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1689 microversion: 2.1 time: 0.765465 Oct 24 10:35:00.622062 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1260/2454] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:34:59 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1689 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:00.804504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-de9c5c4e-edaf-41c8-bc7b-1b9987815f88 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:00.805437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-de9c5c4e-edaf-41c8-bc7b-1b9987815f88 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:00.820202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de9c5c4e-edaf-41c8-bc7b-1b9987815f88 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:00.820939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de9c5c4e-edaf-41c8-bc7b-1b9987815f88 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:00.821578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de9c5c4e-edaf-41c8-bc7b-1b9987815f88 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:00.822524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de9c5c4e-edaf-41c8-bc7b-1b9987815f88 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:00.823214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de9c5c4e-edaf-41c8-bc7b-1b9987815f88 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:00.824060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de9c5c4e-edaf-41c8-bc7b-1b9987815f88 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:00.829820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:00.911140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b09021c2-90de-47eb-b36f-54ab5585ec5d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:00.927355 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b09021c2-90de-47eb-b36f-54ab5585ec5d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1471 microversion: 2.1 time: 0.446764 Oct 24 10:35:00.928872 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1195/2455] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:00 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1471 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:00.934245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-854066a3-84b3-415a-9fd0-db08f2d36638 req-06c9ed20-6c02-4760-af1d-b9c8b810442e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513ca608-24c9-45f9-8fb9-e231d92c7262", "name": "network-vif-unplugged", "status": "completed", "tag": "b2def801-647c-479d-9e34-cb0b4d60448e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:00.949548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-854066a3-84b3-415a-9fd0-db08f2d36638 req-06c9ed20-6c02-4760-af1d-b9c8b810442e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:00.950279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-854066a3-84b3-415a-9fd0-db08f2d36638 req-06c9ed20-6c02-4760-af1d-b9c8b810442e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:00.951898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-854066a3-84b3-415a-9fd0-db08f2d36638 req-06c9ed20-6c02-4760-af1d-b9c8b810442e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:00.967892 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-854066a3-84b3-415a-9fd0-db08f2d36638 req-06c9ed20-6c02-4760-af1d-b9c8b810442e service nova] Creating event network-vif-unplugged:b2def801-647c-479d-9e34-cb0b4d60448e for instance 513ca608-24c9-45f9-8fb9-e231d92c7262 on n-h2-858383-15 Oct 24 10:35:00.975787 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-854066a3-84b3-415a-9fd0-db08f2d36638 req-06c9ed20-6c02-4760-af1d-b9c8b810442e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045056 Oct 24 10:35:00.976873 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1196/2456] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:35:01.069276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-de9c5c4e-edaf-41c8-bc7b-1b9987815f88 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:01.082924 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-de9c5c4e-edaf-41c8-bc7b-1b9987815f88 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1268 microversion: 2.1 time: 0.282272 Oct 24 10:35:01.083529 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1261/2457] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:00 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1268 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:35:01.516116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7692d3f8-0c64-4bd2-b6ce-3d3cad940a11 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:01.518267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7692d3f8-0c64-4bd2-b6ce-3d3cad940a11 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:01.530548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7692d3f8-0c64-4bd2-b6ce-3d3cad940a11 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:01.532742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7692d3f8-0c64-4bd2-b6ce-3d3cad940a11 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:01.536877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7692d3f8-0c64-4bd2-b6ce-3d3cad940a11 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:01.538078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7692d3f8-0c64-4bd2-b6ce-3d3cad940a11 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:01.541472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7692d3f8-0c64-4bd2-b6ce-3d3cad940a11 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:01.544545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7692d3f8-0c64-4bd2-b6ce-3d3cad940a11 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:01.637594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-77cb68d8-2244-4daa-9956-585e62736272 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:01.638315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-77cb68d8-2244-4daa-9956-585e62736272 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:01.648190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77cb68d8-2244-4daa-9956-585e62736272 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:01.649487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77cb68d8-2244-4daa-9956-585e62736272 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:01.653441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77cb68d8-2244-4daa-9956-585e62736272 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:01.654449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77cb68d8-2244-4daa-9956-585e62736272 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:01.655161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77cb68d8-2244-4daa-9956-585e62736272 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:01.655804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77cb68d8-2244-4daa-9956-585e62736272 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:02.516900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=14 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:02.580797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-77cb68d8-2244-4daa-9956-585e62736272 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:02.591466 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-77cb68d8-2244-4daa-9956-585e62736272 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1689 microversion: 2.1 time: 0.957865 Oct 24 10:35:02.615652 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1262/2458] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:01 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1689 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:35:02.641363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1efbfe6d-d6c1-445c-8f8d-2f1a94536c00 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:02.647594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1efbfe6d-d6c1-445c-8f8d-2f1a94536c00 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:02.657800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:02.672461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1efbfe6d-d6c1-445c-8f8d-2f1a94536c00 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:02.673038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1efbfe6d-d6c1-445c-8f8d-2f1a94536c00 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:02.675145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1efbfe6d-d6c1-445c-8f8d-2f1a94536c00 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:02.677928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1efbfe6d-d6c1-445c-8f8d-2f1a94536c00 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:02.678798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1efbfe6d-d6c1-445c-8f8d-2f1a94536c00 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:02.680685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1efbfe6d-d6c1-445c-8f8d-2f1a94536c00 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:02.837408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7692d3f8-0c64-4bd2-b6ce-3d3cad940a11 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:02.852648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7692d3f8-0c64-4bd2-b6ce-3d3cad940a11 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:02.856026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7692d3f8-0c64-4bd2-b6ce-3d3cad940a11 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:02.859355 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7692d3f8-0c64-4bd2-b6ce-3d3cad940a11 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1488 microversion: 2.25 time: 1.347576 Oct 24 10:35:02.868997 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1197/2459] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:01 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1488 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:35:02.877454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-37eebfb6-529f-4309-88c2-3a3ee33b00a2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:02.878536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-37eebfb6-529f-4309-88c2-3a3ee33b00a2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:02.892023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37eebfb6-529f-4309-88c2-3a3ee33b00a2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:02.894981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37eebfb6-529f-4309-88c2-3a3ee33b00a2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:02.895430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37eebfb6-529f-4309-88c2-3a3ee33b00a2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:02.897805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37eebfb6-529f-4309-88c2-3a3ee33b00a2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:02.899355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37eebfb6-529f-4309-88c2-3a3ee33b00a2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:02.902681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37eebfb6-529f-4309-88c2-3a3ee33b00a2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:03.118879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-37eebfb6-529f-4309-88c2-3a3ee33b00a2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:03.135368 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-37eebfb6-529f-4309-88c2-3a3ee33b00a2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1274 microversion: 2.1 time: 0.268186 Oct 24 10:35:03.136181 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1198/2460] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:02 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1274 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:03.150066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c539a3f7-ae66-4ff9-b92c-ac33767fd0c7 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0dc7b920-a6bc-4385-a316-3283be102ee4"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:03.157872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c539a3f7-ae66-4ff9-b92c-ac33767fd0c7 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:03.173709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c539a3f7-ae66-4ff9-b92c-ac33767fd0c7 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:03.174788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c539a3f7-ae66-4ff9-b92c-ac33767fd0c7 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:03.176970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c539a3f7-ae66-4ff9-b92c-ac33767fd0c7 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:03.177985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c539a3f7-ae66-4ff9-b92c-ac33767fd0c7 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:03.179308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c539a3f7-ae66-4ff9-b92c-ac33767fd0c7 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:03.180577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c539a3f7-ae66-4ff9-b92c-ac33767fd0c7 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:03.333728 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-c539a3f7-ae66-4ff9-b92c-ac33767fd0c7 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] HTTP exception thrown: Volume 66e019c0-d9b4-4e2c-9217-9decf012956e could not be found. Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c539a3f7-ae66-4ff9-b92c-ac33767fd0c7 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] Request method failure captured: Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: request: PUT /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35/os-volume_attachments/66e019c0-d9b4-4e2c-9217-9decf012956e HTTP/1.1 Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 74 Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmmIHpOAZ4NMsZ1sVf1-OdcvEKc2DWxYiNwGUiKVqqs1_fGNvH6iIqLHrMrpSEZ3Z6t2rFG1krgN8UWki85p-xzr-nK4aW9056NP6RQVTXMobSVFkO5FWIgdpl1qnFgObQmnM5z3QEC31k12Kebtu2A3sqJEz3jKiOzeErnqldu2aEQ Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 09d8c73d56ca4b03881b78ecf50ae23a Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesAdminNegativeTest-82074864 Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/09d8c73d56ca4b03881b78ecf50ae23a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/09d8c73d56ca4b03881b78ecf50ae23a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/09d8c73d56ca4b03881b78ecf50ae23a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_09d8c73d56ca4b03881b78ecf50ae23a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-VolumesAdminNegativeTest-82074864 Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 09d8c73d56ca4b03881b78ecf50ae23a Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-82074864 Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-VolumesAdminNegativeTest-82074864-project-admin Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5d5d10c152f5439894b4aca72763e0d5 Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-VolumesAdminNegativeTest-82074864-project-admin Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: {"volumeAttachment": {"volumeId": "0dc7b920-a6bc-4385-a316-3283be102ee4"}} Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: exception: Volume 66e019c0-d9b4-4e2c-9217-9decf012956e could not be found. Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'server_id': 'bf9d7d55-3dee-4605-a8ac-594a62bb5d35', 'id': '66e019c0-d9b4-4e2c-9217-9decf012956e', 'body': {'volumeAttachment': {'volumeId': '0dc7b920-a6bc-4385-a316-3283be102ee4'}}} Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66e019c0-d9b4-4e2c-9217-9decf012956e could not be found. (HTTP 404) (Request-ID: req-2b2aec03-c72c-42bf-bb24-6b370dc9df76) Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 10:35:03.336167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66e019c0-d9b4-4e2c-9217-9decf012956e could not be found. Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66e019c0-d9b4-4e2c-9217-9decf012956e could not be found. Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66e019c0-d9b4-4e2c-9217-9decf012956e could not be found. Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c539a3f7-ae66-4ff9-b92c-ac33767fd0c7 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] Returning 404 to user: Volume 66e019c0-d9b4-4e2c-9217-9decf012956e could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c539a3f7-ae66-4ff9-b92c-ac33767fd0c7 tempest-VolumesAdminNegativeTest-82074864 tempest-VolumesAdminNegativeTest-82074864-project-admin] 10.222.0.50 "PUT /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35/os-volume_attachments/66e019c0-d9b4-4e2c-9217-9decf012956e" status: 404 len: 109 microversion: 2.1 time: 0.198828 Oct 24 10:35:03.339890 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1199/2461] 10.222.0.50 () {60 vars in 1433 bytes} [Mon Oct 24 10:35:03 2022] PUT /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35/os-volume_attachments/66e019c0-d9b4-4e2c-9217-9decf012956e => generated 109 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:35:03.385571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1efbfe6d-d6c1-445c-8f8d-2f1a94536c00 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:03.398001 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1efbfe6d-d6c1-445c-8f8d-2f1a94536c00 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1471 microversion: 2.1 time: 0.779805 Oct 24 10:35:03.398790 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1263/2462] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:02 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1471 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:03.620269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-826c80f4-e256-4f57-81c2-7b0a5e7a840f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:03.620931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-826c80f4-e256-4f57-81c2-7b0a5e7a840f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:03.641298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-826c80f4-e256-4f57-81c2-7b0a5e7a840f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:03.653498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-826c80f4-e256-4f57-81c2-7b0a5e7a840f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:03.655150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-826c80f4-e256-4f57-81c2-7b0a5e7a840f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:03.667621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-826c80f4-e256-4f57-81c2-7b0a5e7a840f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:03.668657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-826c80f4-e256-4f57-81c2-7b0a5e7a840f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:03.669344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-826c80f4-e256-4f57-81c2-7b0a5e7a840f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:03.896031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ea4a624c-ac20-4274-9b4f-454ed5ec2f5e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:03.897259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ea4a624c-ac20-4274-9b4f-454ed5ec2f5e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:03.918534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea4a624c-ac20-4274-9b4f-454ed5ec2f5e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:03.919310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea4a624c-ac20-4274-9b4f-454ed5ec2f5e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:03.919926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea4a624c-ac20-4274-9b4f-454ed5ec2f5e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:03.920910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea4a624c-ac20-4274-9b4f-454ed5ec2f5e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:03.922988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea4a624c-ac20-4274-9b4f-454ed5ec2f5e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:03.924399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea4a624c-ac20-4274-9b4f-454ed5ec2f5e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:04.296959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-826c80f4-e256-4f57-81c2-7b0a5e7a840f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:04.306303 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-826c80f4-e256-4f57-81c2-7b0a5e7a840f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1684 microversion: 2.1 time: 0.690243 Oct 24 10:35:04.317500 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1200/2463] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:03 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1684 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:04.328510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e25bde91-da75-493e-858b-c1c6d6ad1a98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:04.331631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e25bde91-da75-493e-858b-c1c6d6ad1a98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:04.355318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e25bde91-da75-493e-858b-c1c6d6ad1a98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:04.356594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e25bde91-da75-493e-858b-c1c6d6ad1a98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:04.359493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e25bde91-da75-493e-858b-c1c6d6ad1a98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:04.364820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e25bde91-da75-493e-858b-c1c6d6ad1a98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:04.366141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e25bde91-da75-493e-858b-c1c6d6ad1a98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:04.368385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e25bde91-da75-493e-858b-c1c6d6ad1a98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:05.358528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ea4a624c-ac20-4274-9b4f-454ed5ec2f5e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:05.369232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ea4a624c-ac20-4274-9b4f-454ed5ec2f5e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:05.375305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ea4a624c-ac20-4274-9b4f-454ed5ec2f5e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:05.381263 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ea4a624c-ac20-4274-9b4f-454ed5ec2f5e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1488 microversion: 2.25 time: 1.491040 Oct 24 10:35:05.385215 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1264/2464] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:03 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1488 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:35:05.399644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-19495953-1fad-4934-b2ad-747f3cd2e640 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:05.405865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-19495953-1fad-4934-b2ad-747f3cd2e640 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:05.427381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19495953-1fad-4934-b2ad-747f3cd2e640 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:05.431691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19495953-1fad-4934-b2ad-747f3cd2e640 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:05.432346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19495953-1fad-4934-b2ad-747f3cd2e640 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:05.433402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19495953-1fad-4934-b2ad-747f3cd2e640 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:05.434165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19495953-1fad-4934-b2ad-747f3cd2e640 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:05.452998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19495953-1fad-4934-b2ad-747f3cd2e640 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:05.614349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e25bde91-da75-493e-858b-c1c6d6ad1a98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:05.630596 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e25bde91-da75-493e-858b-c1c6d6ad1a98 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1316 microversion: 2.1 time: 1.310718 Oct 24 10:35:05.631989 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1201/2465] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:04 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1316 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:05.676051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10cbc262-cc31-4d81-95b1-58615fd01f7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:05.676808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-10cbc262-cc31-4d81-95b1-58615fd01f7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:05.723635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10cbc262-cc31-4d81-95b1-58615fd01f7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:05.726244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10cbc262-cc31-4d81-95b1-58615fd01f7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:05.729106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10cbc262-cc31-4d81-95b1-58615fd01f7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:05.739184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10cbc262-cc31-4d81-95b1-58615fd01f7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:05.740169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10cbc262-cc31-4d81-95b1-58615fd01f7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:05.740858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10cbc262-cc31-4d81-95b1-58615fd01f7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:05.755367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:06.457119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-19495953-1fad-4934-b2ad-747f3cd2e640 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:06.472687 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-19495953-1fad-4934-b2ad-747f3cd2e640 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1471 microversion: 2.1 time: 1.082324 Oct 24 10:35:06.473602 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1265/2466] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:05 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1471 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:06.488268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-10cbc262-cc31-4d81-95b1-58615fd01f7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:06.490310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-edd403c4-1663-4b2a-9985-c373e3ec1061 req-20375409-5859-4fd2-9621-80ec446c006c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513ca608-24c9-45f9-8fb9-e231d92c7262", "name": "network-vif-plugged", "status": "completed", "tag": "b2def801-647c-479d-9e34-cb0b4d60448e"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:06.506065 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10cbc262-cc31-4d81-95b1-58615fd01f7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1684 microversion: 2.1 time: 0.851046 Oct 24 10:35:06.509170 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1202/2467] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:05 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1684 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:06.521676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-65b2a29e-e6bb-41cf-838d-8aaf164fc013 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:06.526727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-65b2a29e-e6bb-41cf-838d-8aaf164fc013 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:06.532088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-edd403c4-1663-4b2a-9985-c373e3ec1061 req-20375409-5859-4fd2-9621-80ec446c006c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:06.532868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-edd403c4-1663-4b2a-9985-c373e3ec1061 req-20375409-5859-4fd2-9621-80ec446c006c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:06.534290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-edd403c4-1663-4b2a-9985-c373e3ec1061 req-20375409-5859-4fd2-9621-80ec446c006c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:06.555748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65b2a29e-e6bb-41cf-838d-8aaf164fc013 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:06.563392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65b2a29e-e6bb-41cf-838d-8aaf164fc013 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:06.565463 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-edd403c4-1663-4b2a-9985-c373e3ec1061 req-20375409-5859-4fd2-9621-80ec446c006c service nova] Creating event network-vif-plugged:b2def801-647c-479d-9e34-cb0b4d60448e for instance 513ca608-24c9-45f9-8fb9-e231d92c7262 on n-h2-858383-15 Oct 24 10:35:06.567399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65b2a29e-e6bb-41cf-838d-8aaf164fc013 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:06.569881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65b2a29e-e6bb-41cf-838d-8aaf164fc013 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:06.570363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65b2a29e-e6bb-41cf-838d-8aaf164fc013 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:06.574642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65b2a29e-e6bb-41cf-838d-8aaf164fc013 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:06.586313 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-edd403c4-1663-4b2a-9985-c373e3ec1061 req-20375409-5859-4fd2-9621-80ec446c006c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106040 Oct 24 10:35:06.590858 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1266/2468] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:35:06.656879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d363bbc-cbcb-4cd4-8f22-6094e5d2e6f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:06.660729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2d363bbc-cbcb-4cd4-8f22-6094e5d2e6f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:06.680234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d363bbc-cbcb-4cd4-8f22-6094e5d2e6f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:06.681184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d363bbc-cbcb-4cd4-8f22-6094e5d2e6f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:06.684045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d363bbc-cbcb-4cd4-8f22-6094e5d2e6f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:06.685693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d363bbc-cbcb-4cd4-8f22-6094e5d2e6f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:06.687009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d363bbc-cbcb-4cd4-8f22-6094e5d2e6f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:06.701628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d363bbc-cbcb-4cd4-8f22-6094e5d2e6f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:07.485746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-65b2a29e-e6bb-41cf-838d-8aaf164fc013 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:07.504636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-65b2a29e-e6bb-41cf-838d-8aaf164fc013 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:07.507085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-65b2a29e-e6bb-41cf-838d-8aaf164fc013 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:07.515117 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-65b2a29e-e6bb-41cf-838d-8aaf164fc013 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1488 microversion: 2.25 time: 1.000719 Oct 24 10:35:07.516387 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1203/2469] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:06 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1488 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:35:07.517431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2d363bbc-cbcb-4cd4-8f22-6094e5d2e6f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:07.530102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-82ac2a3b-9e00-4d70-9983-df95e7341136 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:07.532706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-82ac2a3b-9e00-4d70-9983-df95e7341136 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:07.533881 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2d363bbc-cbcb-4cd4-8f22-6094e5d2e6f8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1316 microversion: 2.1 time: 0.877446 Oct 24 10:35:07.540387 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1267/2470] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:06 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1316 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:07.548574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82ac2a3b-9e00-4d70-9983-df95e7341136 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:07.551027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82ac2a3b-9e00-4d70-9983-df95e7341136 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:07.552116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82ac2a3b-9e00-4d70-9983-df95e7341136 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:07.553828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82ac2a3b-9e00-4d70-9983-df95e7341136 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:07.556188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82ac2a3b-9e00-4d70-9983-df95e7341136 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:07.556779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82ac2a3b-9e00-4d70-9983-df95e7341136 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:07.561883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-84eb60b6-846b-4983-b19c-279302c66326 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:07.568985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-84eb60b6-846b-4983-b19c-279302c66326 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:07.614445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84eb60b6-846b-4983-b19c-279302c66326 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:07.621231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84eb60b6-846b-4983-b19c-279302c66326 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:07.625172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84eb60b6-846b-4983-b19c-279302c66326 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:07.627941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84eb60b6-846b-4983-b19c-279302c66326 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:07.639472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84eb60b6-846b-4983-b19c-279302c66326 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:07.640177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84eb60b6-846b-4983-b19c-279302c66326 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:08.120362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-82ac2a3b-9e00-4d70-9983-df95e7341136 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:08.139458 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-82ac2a3b-9e00-4d70-9983-df95e7341136 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1471 microversion: 2.1 time: 0.613729 Oct 24 10:35:08.140714 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1204/2471] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:07 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1471 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:08.434901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-84eb60b6-846b-4983-b19c-279302c66326 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:08.448505 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-84eb60b6-846b-4983-b19c-279302c66326 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1684 microversion: 2.1 time: 0.906922 Oct 24 10:35:08.449534 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1268/2472] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:07 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1684 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:08.547677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d56ce050-4823-4dca-b235-06e65ae63dc9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:08.550354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d56ce050-4823-4dca-b235-06e65ae63dc9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:08.567976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d2f08249-b162-4d1b-851f-8f79201697eb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:08.570489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d56ce050-4823-4dca-b235-06e65ae63dc9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:08.571107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d56ce050-4823-4dca-b235-06e65ae63dc9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:08.571568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d56ce050-4823-4dca-b235-06e65ae63dc9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:08.572312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d56ce050-4823-4dca-b235-06e65ae63dc9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:08.572771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d56ce050-4823-4dca-b235-06e65ae63dc9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:08.573101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d2f08249-b162-4d1b-851f-8f79201697eb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:08.573232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d56ce050-4823-4dca-b235-06e65ae63dc9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:08.590476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2f08249-b162-4d1b-851f-8f79201697eb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:08.594530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2f08249-b162-4d1b-851f-8f79201697eb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:08.595209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2f08249-b162-4d1b-851f-8f79201697eb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:08.596897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2f08249-b162-4d1b-851f-8f79201697eb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:08.599595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2f08249-b162-4d1b-851f-8f79201697eb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:08.603387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2f08249-b162-4d1b-851f-8f79201697eb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:08.789454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=12 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:09.234730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d2f08249-b162-4d1b-851f-8f79201697eb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:09.249588 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d2f08249-b162-4d1b-851f-8f79201697eb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1316 microversion: 2.1 time: 0.685983 Oct 24 10:35:09.265921 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1269/2473] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:08 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1316 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:09.265921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1c1a4ebb-eda0-4716-a527-696da8825a37 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:09.265921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1c1a4ebb-eda0-4716-a527-696da8825a37 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:09.292616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c1a4ebb-eda0-4716-a527-696da8825a37 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:09.293143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c1a4ebb-eda0-4716-a527-696da8825a37 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:09.301348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c1a4ebb-eda0-4716-a527-696da8825a37 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:09.302114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c1a4ebb-eda0-4716-a527-696da8825a37 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:09.302777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c1a4ebb-eda0-4716-a527-696da8825a37 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:09.303376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c1a4ebb-eda0-4716-a527-696da8825a37 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:09.495592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d56ce050-4823-4dca-b235-06e65ae63dc9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:09.510527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d56ce050-4823-4dca-b235-06e65ae63dc9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:09.516416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d56ce050-4823-4dca-b235-06e65ae63dc9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:09.518924 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d56ce050-4823-4dca-b235-06e65ae63dc9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1488 microversion: 2.25 time: 0.976705 Oct 24 10:35:09.523085 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1205/2474] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:08 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1488 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:35:09.537396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3bd32b95-a5ab-4365-8738-8d432b24b6e5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:09.538197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3bd32b95-a5ab-4365-8738-8d432b24b6e5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:09.553394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bd32b95-a5ab-4365-8738-8d432b24b6e5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:09.558909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bd32b95-a5ab-4365-8738-8d432b24b6e5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:09.560486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bd32b95-a5ab-4365-8738-8d432b24b6e5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:09.561781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bd32b95-a5ab-4365-8738-8d432b24b6e5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:09.562477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bd32b95-a5ab-4365-8738-8d432b24b6e5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:09.563668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bd32b95-a5ab-4365-8738-8d432b24b6e5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:09.634258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3bd32b95-a5ab-4365-8738-8d432b24b6e5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:35:09.744381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1c1a4ebb-eda0-4716-a527-696da8825a37 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:09.752971 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1c1a4ebb-eda0-4716-a527-696da8825a37 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1471 microversion: 2.1 time: 0.497338 Oct 24 10:35:09.773982 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1270/2475] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:09 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1471 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:09.779077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d429ae40-c7ab-4946-97fa-3774145a3f95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:09.782228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d429ae40-c7ab-4946-97fa-3774145a3f95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:09.796826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=8 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:09.799603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d429ae40-c7ab-4946-97fa-3774145a3f95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:09.804010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d429ae40-c7ab-4946-97fa-3774145a3f95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:09.804729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d429ae40-c7ab-4946-97fa-3774145a3f95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:09.805870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d429ae40-c7ab-4946-97fa-3774145a3f95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:09.806528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d429ae40-c7ab-4946-97fa-3774145a3f95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:09.807206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d429ae40-c7ab-4946-97fa-3774145a3f95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:09.889146 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3bd32b95-a5ab-4365-8738-8d432b24b6e5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35" status: 204 len: 0 microversion: 2.1 time: 0.362142 Oct 24 10:35:09.889753 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1206/2476] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:35:09 2022] DELETE /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:35:09.901215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-51e2c094-6551-463e-ae1b-2889dd0da38e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:09.901215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-51e2c094-6551-463e-ae1b-2889dd0da38e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:09.913835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51e2c094-6551-463e-ae1b-2889dd0da38e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:09.914344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51e2c094-6551-463e-ae1b-2889dd0da38e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:09.914792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51e2c094-6551-463e-ae1b-2889dd0da38e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:09.930809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51e2c094-6551-463e-ae1b-2889dd0da38e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:09.931675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51e2c094-6551-463e-ae1b-2889dd0da38e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:09.932331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51e2c094-6551-463e-ae1b-2889dd0da38e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:10.169760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d429ae40-c7ab-4946-97fa-3774145a3f95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:10.200522 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d429ae40-c7ab-4946-97fa-3774145a3f95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1684 microversion: 2.1 time: 0.420545 Oct 24 10:35:10.201197 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1271/2477] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:09 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1684 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:10.280168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-24b9cfe6-38d1-470b-adea-004bfe440e0d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:10.302952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-24b9cfe6-38d1-470b-adea-004bfe440e0d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:10.319223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24b9cfe6-38d1-470b-adea-004bfe440e0d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:10.333058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24b9cfe6-38d1-470b-adea-004bfe440e0d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:10.335488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24b9cfe6-38d1-470b-adea-004bfe440e0d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:10.338115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24b9cfe6-38d1-470b-adea-004bfe440e0d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:10.341631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24b9cfe6-38d1-470b-adea-004bfe440e0d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:10.342986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24b9cfe6-38d1-470b-adea-004bfe440e0d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:10.346410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-51e2c094-6551-463e-ae1b-2889dd0da38e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:10.356227 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-51e2c094-6551-463e-ae1b-2889dd0da38e tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35" status: 200 len: 1514 microversion: 2.1 time: 0.461349 Oct 24 10:35:10.364511 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1207/2478] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:09 2022] GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35 => generated 1514 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:35:10.554655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-42c14b9b-afb8-47d7-96ab-952060f46f1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:10.555287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-42c14b9b-afb8-47d7-96ab-952060f46f1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:10.573592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42c14b9b-afb8-47d7-96ab-952060f46f1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:10.574696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42c14b9b-afb8-47d7-96ab-952060f46f1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:10.575170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42c14b9b-afb8-47d7-96ab-952060f46f1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:10.578849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42c14b9b-afb8-47d7-96ab-952060f46f1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:10.579548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42c14b9b-afb8-47d7-96ab-952060f46f1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:10.581708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42c14b9b-afb8-47d7-96ab-952060f46f1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:11.632568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-42c14b9b-afb8-47d7-96ab-952060f46f1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:11.655941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-24b9cfe6-38d1-470b-adea-004bfe440e0d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:11.663115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-42c14b9b-afb8-47d7-96ab-952060f46f1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:11.668430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-42c14b9b-afb8-47d7-96ab-952060f46f1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:11.681508 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-42c14b9b-afb8-47d7-96ab-952060f46f1e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1488 microversion: 2.25 time: 1.133870 Oct 24 10:35:11.685411 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-24b9cfe6-38d1-470b-adea-004bfe440e0d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1316 microversion: 2.1 time: 1.408456 Oct 24 10:35:11.688528 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1208/2479] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:10 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1488 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:35:11.691724 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1272/2480] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:10 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1316 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:11.713093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-161cf55b-98cd-4cf7-b5c7-5e5ff1788558 req-c6daded6-7e8b-4753-9b56-0c7f39c46214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa641844-507b-4fa0-ac8e-5ffbefa678bd", "tag": "021e97e0-485d-4b3c-86bf-0d92baa70132"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:11.713694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-de9e2ff9-a14e-48de-9f46-3b2089d0fb52 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:11.715783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-de9e2ff9-a14e-48de-9f46-3b2089d0fb52 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:11.749885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de9e2ff9-a14e-48de-9f46-3b2089d0fb52 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:11.761606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de9e2ff9-a14e-48de-9f46-3b2089d0fb52 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:11.762928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de9e2ff9-a14e-48de-9f46-3b2089d0fb52 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:11.765675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de9e2ff9-a14e-48de-9f46-3b2089d0fb52 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:11.767769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de9e2ff9-a14e-48de-9f46-3b2089d0fb52 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:11.769668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-161cf55b-98cd-4cf7-b5c7-5e5ff1788558 req-c6daded6-7e8b-4753-9b56-0c7f39c46214 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:11.770393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de9e2ff9-a14e-48de-9f46-3b2089d0fb52 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:11.772154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-161cf55b-98cd-4cf7-b5c7-5e5ff1788558 req-c6daded6-7e8b-4753-9b56-0c7f39c46214 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:11.776573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-161cf55b-98cd-4cf7-b5c7-5e5ff1788558 req-c6daded6-7e8b-4753-9b56-0c7f39c46214 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:11.809283 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-161cf55b-98cd-4cf7-b5c7-5e5ff1788558 req-c6daded6-7e8b-4753-9b56-0c7f39c46214 service nova] Creating event network-changed:021e97e0-485d-4b3c-86bf-0d92baa70132 for instance aa641844-507b-4fa0-ac8e-5ffbefa678bd on n-h1-858383-15 Oct 24 10:35:11.824828 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-161cf55b-98cd-4cf7-b5c7-5e5ff1788558 req-c6daded6-7e8b-4753-9b56-0c7f39c46214 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131871 Oct 24 10:35:11.828377 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1209/2481] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:35:11.836441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d3faea79-289f-426e-bc1e-c3c994029058 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:11.843080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d3faea79-289f-426e-bc1e-c3c994029058 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:11.855193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3faea79-289f-426e-bc1e-c3c994029058 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:11.857401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3faea79-289f-426e-bc1e-c3c994029058 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:11.858280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3faea79-289f-426e-bc1e-c3c994029058 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:11.859436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3faea79-289f-426e-bc1e-c3c994029058 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:11.864212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3faea79-289f-426e-bc1e-c3c994029058 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:11.865362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3faea79-289f-426e-bc1e-c3c994029058 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:12.564561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-de9e2ff9-a14e-48de-9f46-3b2089d0fb52 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:12.574001 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-de9e2ff9-a14e-48de-9f46-3b2089d0fb52 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1471 microversion: 2.1 time: 0.880230 Oct 24 10:35:12.578543 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1273/2482] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:11 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1471 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:12.591237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-14c36b17-4832-4132-ad2b-1ecce1db4299 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:12.593235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-14c36b17-4832-4132-ad2b-1ecce1db4299 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:12.609583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14c36b17-4832-4132-ad2b-1ecce1db4299 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:12.610076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14c36b17-4832-4132-ad2b-1ecce1db4299 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:12.610508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14c36b17-4832-4132-ad2b-1ecce1db4299 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:12.611261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14c36b17-4832-4132-ad2b-1ecce1db4299 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:12.611711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14c36b17-4832-4132-ad2b-1ecce1db4299 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:12.612217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14c36b17-4832-4132-ad2b-1ecce1db4299 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:12.707997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d3faea79-289f-426e-bc1e-c3c994029058 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:12.721858 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d3faea79-289f-426e-bc1e-c3c994029058 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1684 microversion: 2.1 time: 0.891828 Oct 24 10:35:12.728513 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1210/2483] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:11 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1684 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:12.742491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-58a8d055-60c6-4650-9c77-84f2e38f4fb0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:12.749757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-58a8d055-60c6-4650-9c77-84f2e38f4fb0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:12.807513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58a8d055-60c6-4650-9c77-84f2e38f4fb0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:12.808358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58a8d055-60c6-4650-9c77-84f2e38f4fb0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:12.809096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58a8d055-60c6-4650-9c77-84f2e38f4fb0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:12.810364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58a8d055-60c6-4650-9c77-84f2e38f4fb0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:12.811065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58a8d055-60c6-4650-9c77-84f2e38f4fb0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:12.811767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58a8d055-60c6-4650-9c77-84f2e38f4fb0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:13.292608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-14c36b17-4832-4132-ad2b-1ecce1db4299 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:13.365440 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-14c36b17-4832-4132-ad2b-1ecce1db4299 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35" status: 200 len: 1514 microversion: 2.1 time: 0.785508 Oct 24 10:35:13.366043 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1274/2484] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:12 2022] GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35 => generated 1514 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:13.390521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8bec76d2-afc2-428e-8d63-206067dae16e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:13.391154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8bec76d2-afc2-428e-8d63-206067dae16e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:13.398296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bec76d2-afc2-428e-8d63-206067dae16e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:13.399071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bec76d2-afc2-428e-8d63-206067dae16e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:13.399676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bec76d2-afc2-428e-8d63-206067dae16e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:13.400564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bec76d2-afc2-428e-8d63-206067dae16e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:13.401911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bec76d2-afc2-428e-8d63-206067dae16e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:13.402542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bec76d2-afc2-428e-8d63-206067dae16e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:13.775410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-58a8d055-60c6-4650-9c77-84f2e38f4fb0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:13.793706 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-58a8d055-60c6-4650-9c77-84f2e38f4fb0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1316 microversion: 2.1 time: 1.063123 Oct 24 10:35:13.794816 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1211/2485] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:12 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1316 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:13.801062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9c33d828-0c63-48b0-8e74-b285346e709d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:13.802212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9c33d828-0c63-48b0-8e74-b285346e709d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:13.809161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c33d828-0c63-48b0-8e74-b285346e709d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:13.810151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c33d828-0c63-48b0-8e74-b285346e709d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:13.810790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c33d828-0c63-48b0-8e74-b285346e709d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:13.811742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c33d828-0c63-48b0-8e74-b285346e709d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:13.812647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c33d828-0c63-48b0-8e74-b285346e709d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:13.813985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c33d828-0c63-48b0-8e74-b285346e709d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:14.295114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8bec76d2-afc2-428e-8d63-206067dae16e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:14.310547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8bec76d2-afc2-428e-8d63-206067dae16e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:14.313229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8bec76d2-afc2-428e-8d63-206067dae16e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:14.316942 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8bec76d2-afc2-428e-8d63-206067dae16e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1488 microversion: 2.25 time: 0.931156 Oct 24 10:35:14.318671 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1275/2486] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:13 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1488 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:35:14.331824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-19d15a93-e0f6-4edf-8911-b127bb8b593e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:14.333714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-19d15a93-e0f6-4edf-8911-b127bb8b593e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:14.344631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19d15a93-e0f6-4edf-8911-b127bb8b593e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:14.345524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19d15a93-e0f6-4edf-8911-b127bb8b593e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:14.349543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19d15a93-e0f6-4edf-8911-b127bb8b593e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:14.352513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19d15a93-e0f6-4edf-8911-b127bb8b593e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:14.356703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9c33d828-0c63-48b0-8e74-b285346e709d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:14.357228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19d15a93-e0f6-4edf-8911-b127bb8b593e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:14.363702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19d15a93-e0f6-4edf-8911-b127bb8b593e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:14.366721 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9c33d828-0c63-48b0-8e74-b285346e709d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1471 microversion: 2.1 time: 0.570696 Oct 24 10:35:14.367308 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1212/2487] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:13 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1471 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:14.396528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1a129dcd-45d4-4124-b782-d2910081ea2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:14.397427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1a129dcd-45d4-4124-b782-d2910081ea2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:14.413241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a129dcd-45d4-4124-b782-d2910081ea2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:14.414034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a129dcd-45d4-4124-b782-d2910081ea2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:14.419034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a129dcd-45d4-4124-b782-d2910081ea2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:14.419982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a129dcd-45d4-4124-b782-d2910081ea2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:14.420603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a129dcd-45d4-4124-b782-d2910081ea2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:14.421375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a129dcd-45d4-4124-b782-d2910081ea2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:14.786133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-19d15a93-e0f6-4edf-8911-b127bb8b593e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:14.801297 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-19d15a93-e0f6-4edf-8911-b127bb8b593e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1684 microversion: 2.1 time: 0.480677 Oct 24 10:35:14.804800 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1276/2488] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:14 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1684 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:14.826279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ae6b739e-7796-448a-9a14-f03e3a91c445 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:14.826902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ae6b739e-7796-448a-9a14-f03e3a91c445 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:14.839022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae6b739e-7796-448a-9a14-f03e3a91c445 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:14.839535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae6b739e-7796-448a-9a14-f03e3a91c445 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:14.840012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae6b739e-7796-448a-9a14-f03e3a91c445 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:14.840782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae6b739e-7796-448a-9a14-f03e3a91c445 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:14.841282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae6b739e-7796-448a-9a14-f03e3a91c445 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:14.846021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae6b739e-7796-448a-9a14-f03e3a91c445 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:15.034149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1a129dcd-45d4-4124-b782-d2910081ea2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:15.042723 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1a129dcd-45d4-4124-b782-d2910081ea2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35" status: 200 len: 1514 microversion: 2.1 time: 0.652691 Oct 24 10:35:15.047869 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1213/2489] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:14 2022] GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35 => generated 1514 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:15.396354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ae6b739e-7796-448a-9a14-f03e3a91c445 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:15.406232 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ae6b739e-7796-448a-9a14-f03e3a91c445 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1316 microversion: 2.1 time: 0.583864 Oct 24 10:35:15.418358 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1277/2490] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:14 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1316 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:15.460453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ef4bec27-fec1-4d10-bf2f-495aa536f58d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:15.463475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ef4bec27-fec1-4d10-bf2f-495aa536f58d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:15.490606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef4bec27-fec1-4d10-bf2f-495aa536f58d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:15.502262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef4bec27-fec1-4d10-bf2f-495aa536f58d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:15.502885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef4bec27-fec1-4d10-bf2f-495aa536f58d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:15.503658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef4bec27-fec1-4d10-bf2f-495aa536f58d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:15.504123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef4bec27-fec1-4d10-bf2f-495aa536f58d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:15.508265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef4bec27-fec1-4d10-bf2f-495aa536f58d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:15.581565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:15.585764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-cc0d987a-d960-462b-ab1f-20c5eca54f81 req-5aa8e949-7db0-46f8-8b56-c50917636e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9d7d55-3dee-4605-a8ac-594a62bb5d35", "name": "network-vif-deleted", "tag": "f176994c-7a9f-41c3-9a48-3b16c092cacd"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:15.599802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cc0d987a-d960-462b-ab1f-20c5eca54f81 req-5aa8e949-7db0-46f8-8b56-c50917636e60 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:15.600442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cc0d987a-d960-462b-ab1f-20c5eca54f81 req-5aa8e949-7db0-46f8-8b56-c50917636e60 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:15.601018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cc0d987a-d960-462b-ab1f-20c5eca54f81 req-5aa8e949-7db0-46f8-8b56-c50917636e60 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:15.620531 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-cc0d987a-d960-462b-ab1f-20c5eca54f81 req-5aa8e949-7db0-46f8-8b56-c50917636e60 service nova] Creating event network-vif-deleted:f176994c-7a9f-41c3-9a48-3b16c092cacd for instance bf9d7d55-3dee-4605-a8ac-594a62bb5d35 on n-h1-858383-15 Oct 24 10:35:15.660787 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-cc0d987a-d960-462b-ab1f-20c5eca54f81 req-5aa8e949-7db0-46f8-8b56-c50917636e60 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.401202 Oct 24 10:35:15.670844 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1214/2491] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:35:15.692788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e7b43a23-3602-4564-84af-27e2ff218d61 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:15.698717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e7b43a23-3602-4564-84af-27e2ff218d61 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:15.717940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7b43a23-3602-4564-84af-27e2ff218d61 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:15.718758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7b43a23-3602-4564-84af-27e2ff218d61 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:15.719344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7b43a23-3602-4564-84af-27e2ff218d61 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:15.723051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7b43a23-3602-4564-84af-27e2ff218d61 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:15.723549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7b43a23-3602-4564-84af-27e2ff218d61 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:15.723993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7b43a23-3602-4564-84af-27e2ff218d61 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:16.511855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ef4bec27-fec1-4d10-bf2f-495aa536f58d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:16.568211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ef4bec27-fec1-4d10-bf2f-495aa536f58d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:16.571381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ef4bec27-fec1-4d10-bf2f-495aa536f58d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:16.589687 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ef4bec27-fec1-4d10-bf2f-495aa536f58d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1488 microversion: 2.25 time: 1.147822 Oct 24 10:35:16.590700 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1278/2492] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:15 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1488 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:35:16.609679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-36f5cc14-2837-436a-a2da-23c981cfeb87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:16.618864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-36f5cc14-2837-436a-a2da-23c981cfeb87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:16.642931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e7b43a23-3602-4564-84af-27e2ff218d61 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:16.647167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36f5cc14-2837-436a-a2da-23c981cfeb87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:16.653432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36f5cc14-2837-436a-a2da-23c981cfeb87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:16.657012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36f5cc14-2837-436a-a2da-23c981cfeb87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:16.658721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36f5cc14-2837-436a-a2da-23c981cfeb87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:16.666131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36f5cc14-2837-436a-a2da-23c981cfeb87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:16.668514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36f5cc14-2837-436a-a2da-23c981cfeb87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:16.677554 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e7b43a23-3602-4564-84af-27e2ff218d61 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1471 microversion: 2.1 time: 1.005751 Oct 24 10:35:16.683519 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1215/2493] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:15 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1471 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:16.699622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-042b51c4-ab27-43df-a24f-55230eee0b2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:16.702008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-042b51c4-ab27-43df-a24f-55230eee0b2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:16.720671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-042b51c4-ab27-43df-a24f-55230eee0b2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:16.723345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-042b51c4-ab27-43df-a24f-55230eee0b2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:16.729273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-042b51c4-ab27-43df-a24f-55230eee0b2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:16.730708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-042b51c4-ab27-43df-a24f-55230eee0b2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:16.731322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-042b51c4-ab27-43df-a24f-55230eee0b2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:16.731924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-042b51c4-ab27-43df-a24f-55230eee0b2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:16.805424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-042b51c4-ab27-43df-a24f-55230eee0b2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:16.806309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-042b51c4-ab27-43df-a24f-55230eee0b2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:16.806980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-042b51c4-ab27-43df-a24f-55230eee0b2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:16.807742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-042b51c4-ab27-43df-a24f-55230eee0b2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lazy-loading 'fault' on Instance uuid bf9d7d55-3dee-4605-a8ac-594a62bb5d35 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:35:17.040163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-042b51c4-ab27-43df-a24f-55230eee0b2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:17.056973 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-042b51c4-ab27-43df-a24f-55230eee0b2d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35" status: 200 len: 1307 microversion: 2.1 time: 0.370968 Oct 24 10:35:17.073590 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1216/2494] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:16 2022] GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35 => generated 1307 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:17.079081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4eed7589-62cb-4fec-944a-b9e8d3647ab3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:17.080043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4eed7589-62cb-4fec-944a-b9e8d3647ab3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:17.086647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4eed7589-62cb-4fec-944a-b9e8d3647ab3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:17.087411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4eed7589-62cb-4fec-944a-b9e8d3647ab3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:17.088007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4eed7589-62cb-4fec-944a-b9e8d3647ab3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:17.089353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4eed7589-62cb-4fec-944a-b9e8d3647ab3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:17.089944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4eed7589-62cb-4fec-944a-b9e8d3647ab3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:17.090499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4eed7589-62cb-4fec-944a-b9e8d3647ab3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:17.582403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4eed7589-62cb-4fec-944a-b9e8d3647ab3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:17.602565 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4eed7589-62cb-4fec-944a-b9e8d3647ab3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1316 microversion: 2.1 time: 0.521663 Oct 24 10:35:17.612680 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1217/2495] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:17 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1316 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:17.630894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3c7216d3-9b0f-4242-aeae-a565e658d26b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:17.641666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3c7216d3-9b0f-4242-aeae-a565e658d26b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:17.691230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c7216d3-9b0f-4242-aeae-a565e658d26b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:17.694970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c7216d3-9b0f-4242-aeae-a565e658d26b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:17.695745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c7216d3-9b0f-4242-aeae-a565e658d26b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:17.696782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c7216d3-9b0f-4242-aeae-a565e658d26b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:17.700491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c7216d3-9b0f-4242-aeae-a565e658d26b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:17.701203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c7216d3-9b0f-4242-aeae-a565e658d26b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:17.717898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:17.881032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-36f5cc14-2837-436a-a2da-23c981cfeb87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:17.890268 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-36f5cc14-2837-436a-a2da-23c981cfeb87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1684 microversion: 2.1 time: 1.298295 Oct 24 10:35:17.890852 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1279/2496] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:16 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1684 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:17.918781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5cb92316-e579-40a6-9f33-36824287d999 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:17.919546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5cb92316-e579-40a6-9f33-36824287d999 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:17.946244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5cb92316-e579-40a6-9f33-36824287d999 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:17.946742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5cb92316-e579-40a6-9f33-36824287d999 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:17.961651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5cb92316-e579-40a6-9f33-36824287d999 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:17.967127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5cb92316-e579-40a6-9f33-36824287d999 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:17.967814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5cb92316-e579-40a6-9f33-36824287d999 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:17.969358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5cb92316-e579-40a6-9f33-36824287d999 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:18.635274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5cb92316-e579-40a6-9f33-36824287d999 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:18.651193 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5cb92316-e579-40a6-9f33-36824287d999 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1471 microversion: 2.1 time: 0.748935 Oct 24 10:35:18.673982 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1280/2497] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:17 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1471 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:18.681849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-26fdd043-9131-4ec8-a0d1-e1ae32577644 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:18.682713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-26fdd043-9131-4ec8-a0d1-e1ae32577644 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: bf9d7d55-3dee-4605-a8ac-594a62bb5d35] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:18.690059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26fdd043-9131-4ec8-a0d1-e1ae32577644 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:18.690797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26fdd043-9131-4ec8-a0d1-e1ae32577644 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:18.691430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26fdd043-9131-4ec8-a0d1-e1ae32577644 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:18.692323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26fdd043-9131-4ec8-a0d1-e1ae32577644 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:18.693157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26fdd043-9131-4ec8-a0d1-e1ae32577644 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:18.693748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26fdd043-9131-4ec8-a0d1-e1ae32577644 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:18.711896 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-26fdd043-9131-4ec8-a0d1-e1ae32577644 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] HTTP exception thrown: Instance bf9d7d55-3dee-4605-a8ac-594a62bb5d35 could not be found. Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-26fdd043-9131-4ec8-a0d1-e1ae32577644 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Request method failure captured: Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35 HTTP/1.1 Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmlvXThbXLsuc60903IlFWvzoOP7NLp_6ipnXI7kX4_8IDbFyDLTgmbIXwcmQFSlJlmZQNlnWJ11urjleUOV1pOOnLUe3-x4-F5M5nRDszb_zx-wtv7D9CHGiRXQkfR5DNJpF671MivwvmRsILQC8PC1BD0H07meMXgD3WIPzZeea-0 Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: db7036c053ec42a98e784dbdc396c532 Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-VolumesAdminNegativeTest-1309437485 Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/db7036c053ec42a98e784dbdc396c532"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/db7036c053ec42a98e784dbdc396c532"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/db7036c053ec42a98e784dbdc396c532"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_db7036c053ec42a98e784dbdc396c532", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-VolumesAdminNegativeTest-1309437485 Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: db7036c053ec42a98e784dbdc396c532 Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1309437485 Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-VolumesAdminNegativeTest-1309437485-project Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 001a2dd2081241c397719005e1d52eec Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-VolumesAdminNegativeTest-1309437485-project Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance bf9d7d55-3dee-4605-a8ac-594a62bb5d35 could not be found. Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'bf9d7d55-3dee-4605-a8ac-594a62bb5d35'} Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf9d7d55-3dee-4605-a8ac-594a62bb5d35 could not be found. Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf9d7d55-3dee-4605-a8ac-594a62bb5d35 could not be found. Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:18.714764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:18.720663 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:18.720663 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:35:18.720663 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:35:18.720663 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:35:18.720663 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:35:18.720663 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf9d7d55-3dee-4605-a8ac-594a62bb5d35 could not be found. Oct 24 10:35:18.720663 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:18.722260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-26fdd043-9131-4ec8-a0d1-e1ae32577644 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Returning 404 to user: Instance bf9d7d55-3dee-4605-a8ac-594a62bb5d35 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:35:18.723283 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-26fdd043-9131-4ec8-a0d1-e1ae32577644 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35" status: 404 len: 111 microversion: 2.1 time: 0.047971 Oct 24 10:35:18.726829 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1281/2498] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:18 2022] GET /compute/v2.1/servers/bf9d7d55-3dee-4605-a8ac-594a62bb5d35 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:35:18.732147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0cab7a2c-1f4d-4145-b83f-2a455628f515 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:18.732663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c7216d3-9b0f-4242-aeae-a565e658d26b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:18.733553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0cab7a2c-1f4d-4145-b83f-2a455628f515 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:18.742391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0cab7a2c-1f4d-4145-b83f-2a455628f515 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:18.743070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0cab7a2c-1f4d-4145-b83f-2a455628f515 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:18.743682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0cab7a2c-1f4d-4145-b83f-2a455628f515 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:18.744550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0cab7a2c-1f4d-4145-b83f-2a455628f515 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:18.746942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0cab7a2c-1f4d-4145-b83f-2a455628f515 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:18.747588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0cab7a2c-1f4d-4145-b83f-2a455628f515 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:18.754197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c7216d3-9b0f-4242-aeae-a565e658d26b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:18.756817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c7216d3-9b0f-4242-aeae-a565e658d26b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:18.767002 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3c7216d3-9b0f-4242-aeae-a565e658d26b tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1478 microversion: 2.25 time: 1.147029 Oct 24 10:35:18.777129 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1218/2499] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:17 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1478 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:35:18.800116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2efa670d-0eae-41d8-826d-94658f47b32c tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '.version_select at 0x7f04d0ca8160>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:18.816423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2efa670d-0eae-41d8-826d-94658f47b32c tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:18.816961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2efa670d-0eae-41d8-826d-94658f47b32c tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:18.817481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2efa670d-0eae-41d8-826d-94658f47b32c tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:18.872142 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2efa670d-0eae-41d8-826d-94658f47b32c tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1960 microversion: 2.25 time: 0.076110 Oct 24 10:35:18.880230 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1219/2500] 10.222.0.50 () {60 vars in 1184 bytes} [Mon Oct 24 10:35:18 2022] GET /compute/v2.1/os-migrations => generated 1960 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:35:18.896411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-65969068-008d-45ba-9517-37078dc485ea tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:18.897327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-65969068-008d-45ba-9517-37078dc485ea tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:18.933163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65969068-008d-45ba-9517-37078dc485ea tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:18.934510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65969068-008d-45ba-9517-37078dc485ea tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:18.934971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65969068-008d-45ba-9517-37078dc485ea tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:18.936064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65969068-008d-45ba-9517-37078dc485ea tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:18.939019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65969068-008d-45ba-9517-37078dc485ea tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:18.941227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65969068-008d-45ba-9517-37078dc485ea tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:21.423906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-65969068-008d-45ba-9517-37078dc485ea tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] Lazy-loading 'services' on Instance uuid c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:35:21.463204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0cab7a2c-1f4d-4145-b83f-2a455628f515 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:21.479796 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0cab7a2c-1f4d-4145-b83f-2a455628f515 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1316 microversion: 2.1 time: 2.751580 Oct 24 10:35:21.482791 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-65969068-008d-45ba-9517-37078dc485ea tempest-LiveAutoBlockMigrationV225Test-795191399 tempest-LiveAutoBlockMigrationV225Test-795191399-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1973 microversion: 2.25 time: 2.596049 Oct 24 10:35:21.483460 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1282/2501] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:18 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1316 bytes in 2756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:21.500025 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1220/2502] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:18 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1973 bytes in 2614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:35:21.504817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-524733f9-d960-4c88-b4cc-4147c694364f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:21.509018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-524733f9-d960-4c88-b4cc-4147c694364f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:21.521329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1b9f4656-7fbb-43a1-9bbd-331d139c9933 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:21.527513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1b9f4656-7fbb-43a1-9bbd-331d139c9933 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:21.542503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-524733f9-d960-4c88-b4cc-4147c694364f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:21.546152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-524733f9-d960-4c88-b4cc-4147c694364f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:21.547283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-524733f9-d960-4c88-b4cc-4147c694364f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:21.551672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-524733f9-d960-4c88-b4cc-4147c694364f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:21.555571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-524733f9-d960-4c88-b4cc-4147c694364f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:21.558682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-524733f9-d960-4c88-b4cc-4147c694364f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:21.559729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b9f4656-7fbb-43a1-9bbd-331d139c9933 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:21.560867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b9f4656-7fbb-43a1-9bbd-331d139c9933 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:21.569884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b9f4656-7fbb-43a1-9bbd-331d139c9933 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:21.573068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b9f4656-7fbb-43a1-9bbd-331d139c9933 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:21.573454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b9f4656-7fbb-43a1-9bbd-331d139c9933 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:21.578902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b9f4656-7fbb-43a1-9bbd-331d139c9933 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:22.515118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-524733f9-d960-4c88-b4cc-4147c694364f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:22.524599 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-524733f9-d960-4c88-b4cc-4147c694364f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1684 microversion: 2.1 time: 1.039523 Oct 24 10:35:22.528162 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1283/2503] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:21 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1684 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:22.540955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-643df3a1-946b-43c2-ad69-4bfdf3313e21 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:22.542069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-643df3a1-946b-43c2-ad69-4bfdf3313e21 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:22.552601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-643df3a1-946b-43c2-ad69-4bfdf3313e21 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:22.553403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-643df3a1-946b-43c2-ad69-4bfdf3313e21 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:22.554146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-643df3a1-946b-43c2-ad69-4bfdf3313e21 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:22.558885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-643df3a1-946b-43c2-ad69-4bfdf3313e21 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:22.559847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-643df3a1-946b-43c2-ad69-4bfdf3313e21 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:22.561384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-643df3a1-946b-43c2-ad69-4bfdf3313e21 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:22.592469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-643df3a1-946b-43c2-ad69-4bfdf3313e21 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:35:22.726246 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-643df3a1-946b-43c2-ad69-4bfdf3313e21 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 204 len: 0 microversion: 2.25 time: 0.194896 Oct 24 10:35:22.727013 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1284/2504] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:35:22 2022] DELETE /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:35:22.738459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e100b53b-b2e8-4f7c-b5cb-cd7fc46da5cc tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:22.739280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e100b53b-b2e8-4f7c-b5cb-cd7fc46da5cc tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:22.748044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e100b53b-b2e8-4f7c-b5cb-cd7fc46da5cc tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:22.748580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e100b53b-b2e8-4f7c-b5cb-cd7fc46da5cc tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:22.749248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e100b53b-b2e8-4f7c-b5cb-cd7fc46da5cc tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:22.750200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e100b53b-b2e8-4f7c-b5cb-cd7fc46da5cc tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:22.750863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e100b53b-b2e8-4f7c-b5cb-cd7fc46da5cc tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:22.752256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e100b53b-b2e8-4f7c-b5cb-cd7fc46da5cc tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:22.856402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1b9f4656-7fbb-43a1-9bbd-331d139c9933 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:22.880646 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1b9f4656-7fbb-43a1-9bbd-331d139c9933 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1477 microversion: 2.1 time: 1.376609 Oct 24 10:35:22.885035 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1221/2505] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:21 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1477 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:22.901008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6e50cf14-6964-4813-a454-d66b177806a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:22.901008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6e50cf14-6964-4813-a454-d66b177806a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:22.921326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e50cf14-6964-4813-a454-d66b177806a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:22.921854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e50cf14-6964-4813-a454-d66b177806a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:22.922323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e50cf14-6964-4813-a454-d66b177806a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:22.929772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e50cf14-6964-4813-a454-d66b177806a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:22.930614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e50cf14-6964-4813-a454-d66b177806a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:22.931849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e50cf14-6964-4813-a454-d66b177806a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:23.746143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e100b53b-b2e8-4f7c-b5cb-cd7fc46da5cc tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:23.757371 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e100b53b-b2e8-4f7c-b5cb-cd7fc46da5cc tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1316 microversion: 2.1 time: 1.024249 Oct 24 10:35:23.759879 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1285/2506] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:22 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1316 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:23.771219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ee7993cf-9c0a-4b9e-8406-cdc33eaf1b4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:23.773545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ee7993cf-9c0a-4b9e-8406-cdc33eaf1b4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:23.789224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee7993cf-9c0a-4b9e-8406-cdc33eaf1b4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:23.793560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee7993cf-9c0a-4b9e-8406-cdc33eaf1b4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:23.795571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee7993cf-9c0a-4b9e-8406-cdc33eaf1b4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:23.798681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee7993cf-9c0a-4b9e-8406-cdc33eaf1b4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:23.801639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee7993cf-9c0a-4b9e-8406-cdc33eaf1b4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:23.803501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee7993cf-9c0a-4b9e-8406-cdc33eaf1b4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:23.953916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6e50cf14-6964-4813-a454-d66b177806a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:23.974174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6e50cf14-6964-4813-a454-d66b177806a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:23.982521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6e50cf14-6964-4813-a454-d66b177806a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:23.994569 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6e50cf14-6964-4813-a454-d66b177806a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1484 microversion: 2.25 time: 1.106331 Oct 24 10:35:23.999652 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1222/2507] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:22 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1484 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:35:24.008418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8409b857-5bcd-4bb8-bc57-8acc52aa3b21 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:24.035244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8409b857-5bcd-4bb8-bc57-8acc52aa3b21 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:24.066974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8409b857-5bcd-4bb8-bc57-8acc52aa3b21 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:24.070079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8409b857-5bcd-4bb8-bc57-8acc52aa3b21 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:24.071582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8409b857-5bcd-4bb8-bc57-8acc52aa3b21 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:24.072581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8409b857-5bcd-4bb8-bc57-8acc52aa3b21 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:24.078268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8409b857-5bcd-4bb8-bc57-8acc52aa3b21 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:24.080003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8409b857-5bcd-4bb8-bc57-8acc52aa3b21 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:24.732687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ee7993cf-9c0a-4b9e-8406-cdc33eaf1b4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:24.747882 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ee7993cf-9c0a-4b9e-8406-cdc33eaf1b4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1684 microversion: 2.1 time: 0.985150 Oct 24 10:35:24.749426 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1286/2508] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:23 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1684 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:24.797259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8409b857-5bcd-4bb8-bc57-8acc52aa3b21 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:24.810724 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8409b857-5bcd-4bb8-bc57-8acc52aa3b21 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1477 microversion: 2.1 time: 0.808469 Oct 24 10:35:24.826037 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1223/2509] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:24 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1477 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:24.852862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-5192e6de-bd86-4064-bb24-b201504a930a req-8774bae4-6bf9-44e5-9eaf-37324407edd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d", "name": "network-vif-deleted", "tag": "4787ea89-a905-45b9-ba75-416fa72d12e3"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:24.919658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5192e6de-bd86-4064-bb24-b201504a930a req-8774bae4-6bf9-44e5-9eaf-37324407edd3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:24.930600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5192e6de-bd86-4064-bb24-b201504a930a req-8774bae4-6bf9-44e5-9eaf-37324407edd3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:24.934190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5192e6de-bd86-4064-bb24-b201504a930a req-8774bae4-6bf9-44e5-9eaf-37324407edd3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:24.960156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ee10cf7d-c477-467d-8101-c89e34317206 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-873272815", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "7e246fd4-526c-4b90-abc8-eb217581a916"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:24.972646 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-5192e6de-bd86-4064-bb24-b201504a930a req-8774bae4-6bf9-44e5-9eaf-37324407edd3 service nova] Creating event network-vif-deleted:4787ea89-a905-45b9-ba75-416fa72d12e3 for instance c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d on n-h2-858383-15 Oct 24 10:35:24.982729 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-5192e6de-bd86-4064-bb24-b201504a930a req-8774bae4-6bf9-44e5-9eaf-37324407edd3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154058 Oct 24 10:35:24.992737 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1224/2510] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:35:25.004805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-48126ac7-c0d4-42c7-b006-a46fe2531765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:25.005929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-48126ac7-c0d4-42c7-b006-a46fe2531765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:25.037859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48126ac7-c0d4-42c7-b006-a46fe2531765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:25.041476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48126ac7-c0d4-42c7-b006-a46fe2531765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:25.042166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48126ac7-c0d4-42c7-b006-a46fe2531765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:25.043147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48126ac7-c0d4-42c7-b006-a46fe2531765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:25.045221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48126ac7-c0d4-42c7-b006-a46fe2531765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:25.046958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48126ac7-c0d4-42c7-b006-a46fe2531765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:25.174050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-ee10cf7d-c477-467d-8101-c89e34317206 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] validate_networks() for [('7e246fd4-526c-4b90-abc8-eb217581a916', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:35:26.413512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-48126ac7-c0d4-42c7-b006-a46fe2531765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:26.424549 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-48126ac7-c0d4-42c7-b006-a46fe2531765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1316 microversion: 2.1 time: 1.430259 Oct 24 10:35:26.442413 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1225/2511] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:24 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1316 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:26.450814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-983121c7-8109-42eb-81de-f30d67ba781d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:26.451835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-983121c7-8109-42eb-81de-f30d67ba781d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:26.465714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-983121c7-8109-42eb-81de-f30d67ba781d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:26.466591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-983121c7-8109-42eb-81de-f30d67ba781d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:26.467275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-983121c7-8109-42eb-81de-f30d67ba781d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:26.474130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-983121c7-8109-42eb-81de-f30d67ba781d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:26.474878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-983121c7-8109-42eb-81de-f30d67ba781d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:26.475646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-983121c7-8109-42eb-81de-f30d67ba781d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:26.643662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-983121c7-8109-42eb-81de-f30d67ba781d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:26.668561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-983121c7-8109-42eb-81de-f30d67ba781d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:26.672643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-983121c7-8109-42eb-81de-f30d67ba781d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:26.674935 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-983121c7-8109-42eb-81de-f30d67ba781d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1266 microversion: 2.25 time: 0.231305 Oct 24 10:35:26.678642 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1226/2512] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:26 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:35:26.691938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-76f93ae3-89d2-47ae-b881-a5cf777ca71d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:26.692970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-76f93ae3-89d2-47ae-b881-a5cf777ca71d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:26.703158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-76f93ae3-89d2-47ae-b881-a5cf777ca71d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:26.709594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-76f93ae3-89d2-47ae-b881-a5cf777ca71d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:26.710367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-76f93ae3-89d2-47ae-b881-a5cf777ca71d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:26.711368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-76f93ae3-89d2-47ae-b881-a5cf777ca71d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:26.712046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-76f93ae3-89d2-47ae-b881-a5cf777ca71d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:26.712771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-76f93ae3-89d2-47ae-b881-a5cf777ca71d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:26.781899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-76f93ae3-89d2-47ae-b881-a5cf777ca71d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:35:26.990609 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-76f93ae3-89d2-47ae-b881-a5cf777ca71d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf" status: 204 len: 0 microversion: 2.1 time: 0.310285 Oct 24 10:35:26.991815 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1227/2513] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:35:26 2022] DELETE /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:35:27.003853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f2f159a9-0a1a-416d-b813-962a46881a75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:27.005093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f2f159a9-0a1a-416d-b813-962a46881a75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:27.018629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2f159a9-0a1a-416d-b813-962a46881a75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:27.019511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2f159a9-0a1a-416d-b813-962a46881a75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:27.020540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2f159a9-0a1a-416d-b813-962a46881a75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:27.025117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2f159a9-0a1a-416d-b813-962a46881a75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:27.025986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2f159a9-0a1a-416d-b813-962a46881a75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:27.026654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2f159a9-0a1a-416d-b813-962a46881a75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:27.522801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ee10cf7d-c477-467d-8101-c89e34317206 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:35:27.523248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ee10cf7d-c477-467d-8101-c89e34317206 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:35:27.524002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ee10cf7d-c477-467d-8101-c89e34317206 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:35:27.524754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ee10cf7d-c477-467d-8101-c89e34317206 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:35:27.525202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ee10cf7d-c477-467d-8101-c89e34317206 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:35:27.545244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee10cf7d-c477-467d-8101-c89e34317206 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:27.551410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee10cf7d-c477-467d-8101-c89e34317206 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:27.552327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee10cf7d-c477-467d-8101-c89e34317206 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:27.555529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee10cf7d-c477-467d-8101-c89e34317206 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:27.558817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee10cf7d-c477-467d-8101-c89e34317206 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:27.561590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee10cf7d-c477-467d-8101-c89e34317206 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:27.632136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f2f159a9-0a1a-416d-b813-962a46881a75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:27.643119 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f2f159a9-0a1a-416d-b813-962a46881a75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1684 microversion: 2.1 time: 0.649770 Oct 24 10:35:27.643723 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1228/2514] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:26 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1684 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:27.647976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-ee10cf7d-c477-467d-8101-c89e34317206 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Getting quotas for project eb78fe6939ec43d99fe6b1ba24a68287. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:35:27.681839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7db99212-43dd-486c-9a3d-b1c1d6e36d70 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:27.682501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7db99212-43dd-486c-9a3d-b1c1d6e36d70 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:27.692129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:27.693639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7db99212-43dd-486c-9a3d-b1c1d6e36d70 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:27.694137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7db99212-43dd-486c-9a3d-b1c1d6e36d70 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:27.694583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7db99212-43dd-486c-9a3d-b1c1d6e36d70 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:27.695430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7db99212-43dd-486c-9a3d-b1c1d6e36d70 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:27.695904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7db99212-43dd-486c-9a3d-b1c1d6e36d70 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:27.701882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7db99212-43dd-486c-9a3d-b1c1d6e36d70 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:27.716003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-ee10cf7d-c477-467d-8101-c89e34317206 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Getting quotas for user 2a7e183a1d4240f28566a318b7e70dee and project eb78fe6939ec43d99fe6b1ba24a68287. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:35:27.767235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ee10cf7d-c477-467d-8101-c89e34317206 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:35:27.769684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ee10cf7d-c477-467d-8101-c89e34317206 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:35:27.959184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7db99212-43dd-486c-9a3d-b1c1d6e36d70 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:27.963046 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ee10cf7d-c477-467d-8101-c89e34317206 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.212264 Oct 24 10:35:27.981840 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7db99212-43dd-486c-9a3d-b1c1d6e36d70 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1477 microversion: 2.1 time: 0.311019 Oct 24 10:35:27.982009 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1287/2515] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:35:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:35:27.982540 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1229/2516] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:27 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1477 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:27.988924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-dae79ec3-1de3-49dc-93f5-0cfbf03952a4 req-85c6d436-e955-4052-86ce-51160d47ff11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485d2945-20d9-4620-a9e5-004680c44d43", "name": "network-vif-plugged", "status": "completed", "tag": "ceedad81-43a8-4ff1-9629-690de6218202"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:27.997253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4275136e-8b6b-4a2c-8cc8-55a7b7157fb5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:27.999279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4275136e-8b6b-4a2c-8cc8-55a7b7157fb5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:28.012877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4275136e-8b6b-4a2c-8cc8-55a7b7157fb5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:28.013451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4275136e-8b6b-4a2c-8cc8-55a7b7157fb5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:28.015044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4275136e-8b6b-4a2c-8cc8-55a7b7157fb5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:28.015797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4275136e-8b6b-4a2c-8cc8-55a7b7157fb5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:28.016261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4275136e-8b6b-4a2c-8cc8-55a7b7157fb5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:28.019677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4275136e-8b6b-4a2c-8cc8-55a7b7157fb5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:28.038650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dae79ec3-1de3-49dc-93f5-0cfbf03952a4 req-85c6d436-e955-4052-86ce-51160d47ff11 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:28.039258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dae79ec3-1de3-49dc-93f5-0cfbf03952a4 req-85c6d436-e955-4052-86ce-51160d47ff11 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:28.039781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dae79ec3-1de3-49dc-93f5-0cfbf03952a4 req-85c6d436-e955-4052-86ce-51160d47ff11 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:28.065944 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-dae79ec3-1de3-49dc-93f5-0cfbf03952a4 req-85c6d436-e955-4052-86ce-51160d47ff11 service nova] Creating event network-vif-plugged:ceedad81-43a8-4ff1-9629-690de6218202 for instance 485d2945-20d9-4620-a9e5-004680c44d43 on n-h2-858383-15 Oct 24 10:35:28.081444 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-dae79ec3-1de3-49dc-93f5-0cfbf03952a4 req-85c6d436-e955-4052-86ce-51160d47ff11 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097865 Oct 24 10:35:28.082732 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1288/2517] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:35:28.091853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d4bb80dd-e11b-4cb3-92ce-fe646d2cca7f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:28.101859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d4bb80dd-e11b-4cb3-92ce-fe646d2cca7f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:28.114239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4bb80dd-e11b-4cb3-92ce-fe646d2cca7f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:28.118931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4bb80dd-e11b-4cb3-92ce-fe646d2cca7f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:28.119615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4bb80dd-e11b-4cb3-92ce-fe646d2cca7f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:28.120521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4bb80dd-e11b-4cb3-92ce-fe646d2cca7f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:28.121355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4bb80dd-e11b-4cb3-92ce-fe646d2cca7f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:28.123484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4bb80dd-e11b-4cb3-92ce-fe646d2cca7f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:28.526076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4275136e-8b6b-4a2c-8cc8-55a7b7157fb5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:28.561787 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4275136e-8b6b-4a2c-8cc8-55a7b7157fb5 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf" status: 200 len: 1679 microversion: 2.1 time: 0.573131 Oct 24 10:35:28.562796 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1230/2518] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:27 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf => generated 1679 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:28.679061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d4bb80dd-e11b-4cb3-92ce-fe646d2cca7f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:28.696652 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d4bb80dd-e11b-4cb3-92ce-fe646d2cca7f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1316 microversion: 2.1 time: 0.612440 Oct 24 10:35:28.705003 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1289/2519] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:28 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1316 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:28.713989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-42adaef4-91a3-4fe0-bb4d-c79d978fb49d tempest-FloatingIPDetailsNegativeTestJSON-1243221633 tempest-FloatingIPDetailsNegativeTestJSON-1243221633-project] Calling method '.version_select at 0x7f04d4eee430>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:28.715453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-302f45b9-0fa2-4a98-823a-43a6fc3d5bb9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:28.716457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-302f45b9-0fa2-4a98-823a-43a6fc3d5bb9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:28.730592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-302f45b9-0fa2-4a98-823a-43a6fc3d5bb9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:28.731410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-302f45b9-0fa2-4a98-823a-43a6fc3d5bb9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:28.733977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-302f45b9-0fa2-4a98-823a-43a6fc3d5bb9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:28.735041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-302f45b9-0fa2-4a98-823a-43a6fc3d5bb9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:28.737111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-302f45b9-0fa2-4a98-823a-43a6fc3d5bb9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:28.738707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-302f45b9-0fa2-4a98-823a-43a6fc3d5bb9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:29.114435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG neutronclient.v2_0.client [None req-42adaef4-91a3-4fe0-bb4d-c79d978fb49d tempest-FloatingIPDetailsNegativeTestJSON-1243221633 tempest-FloatingIPDetailsNegativeTestJSON-1243221633-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 807063bc-fb22-4594-bd62-fee8e554b735 could not be found", "detail": ""}} {{(pid=120425) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:35:29.115342 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-42adaef4-91a3-4fe0-bb4d-c79d978fb49d tempest-FloatingIPDetailsNegativeTestJSON-1243221633 tempest-FloatingIPDetailsNegativeTestJSON-1243221633-project] HTTP exception thrown: Floating IP not found for ID 807063bc-fb22-4594-bd62-fee8e554b735 Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-42adaef4-91a3-4fe0-bb4d-c79d978fb49d tempest-FloatingIPDetailsNegativeTestJSON-1243221633 tempest-FloatingIPDetailsNegativeTestJSON-1243221633-project] Request method failure captured: Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-floating-ips/807063bc-fb22-4594-bd62-fee8e554b735 HTTP/1.1 Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpvQD1d2hCYv8YiphL7NBB3O6As-TeP85b1pSgkkRoit44RHHJL8RkFr5x8u3SQzg6y8Dj69f0wINfNq4Eee3PconxE3Kw2M-PhJJHSWILt1q2wOEta0ua4HCFgoZ_j2Oj-uQs61XkGtkvPHGudCevyLj0mPV468Te28CvOM8rErvc Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 2b28127bd7a74776adf929e1400e81b0 Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1243221633 Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b28127bd7a74776adf929e1400e81b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b28127bd7a74776adf929e1400e81b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b28127bd7a74776adf929e1400e81b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b28127bd7a74776adf929e1400e81b0", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1243221633 Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 2b28127bd7a74776adf929e1400e81b0 Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1243221633 Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1243221633-project Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 733d80e69e9a4ec3a91a3e7ea0ea8f72 Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1243221633-project Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: exception: Floating IP not found for ID 807063bc-fb22-4594-bd62-fee8e554b735 Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '807063bc-fb22-4594-bd62-fee8e554b735'} Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:35:29.117663 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 807063bc-fb22-4594-bd62-fee8e554b735 could not be found Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9fb4ecb-9555-4785-acbb-c8980ad4bfb3'] Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 807063bc-fb22-4594-bd62-fee8e554b735. Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 807063bc-fb22-4594-bd62-fee8e554b735 Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 807063bc-fb22-4594-bd62-fee8e554b735 Oct 24 10:35:29.122000 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:29.126004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-42adaef4-91a3-4fe0-bb4d-c79d978fb49d tempest-FloatingIPDetailsNegativeTestJSON-1243221633 tempest-FloatingIPDetailsNegativeTestJSON-1243221633-project] Returning 404 to user: Floating IP not found for ID 807063bc-fb22-4594-bd62-fee8e554b735 {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:35:29.127413 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-42adaef4-91a3-4fe0-bb4d-c79d978fb49d tempest-FloatingIPDetailsNegativeTestJSON-1243221633 tempest-FloatingIPDetailsNegativeTestJSON-1243221633-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/807063bc-fb22-4594-bd62-fee8e554b735" status: 404 len: 111 microversion: 2.1 time: 0.562284 Oct 24 10:35:29.128141 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1231/2520] 10.222.0.50 () {58 vars in 1260 bytes} [Mon Oct 24 10:35:28 2022] GET /compute/v2.1/os-floating-ips/807063bc-fb22-4594-bd62-fee8e554b735 => generated 111 bytes in 565 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:35:29.137188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-75a73405-9141-4ea1-935b-922a5633f2c8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:29.146403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-75a73405-9141-4ea1-935b-922a5633f2c8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:29.502113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-302f45b9-0fa2-4a98-823a-43a6fc3d5bb9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:29.520403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-302f45b9-0fa2-4a98-823a-43a6fc3d5bb9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:29.525168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-302f45b9-0fa2-4a98-823a-43a6fc3d5bb9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:29.527429 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-302f45b9-0fa2-4a98-823a-43a6fc3d5bb9 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1266 microversion: 2.25 time: 0.820189 Oct 24 10:35:29.528194 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1290/2521] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:28 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1266 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:35:29.559731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3b1fe8d2-eb2b-436d-9ae5-bfb25a2e2a48 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:29.562188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3b1fe8d2-eb2b-436d-9ae5-bfb25a2e2a48 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:29.583261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1fe8d2-eb2b-436d-9ae5-bfb25a2e2a48 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:29.585554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1fe8d2-eb2b-436d-9ae5-bfb25a2e2a48 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:29.587720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1fe8d2-eb2b-436d-9ae5-bfb25a2e2a48 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:29.589480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1fe8d2-eb2b-436d-9ae5-bfb25a2e2a48 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:29.590969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1fe8d2-eb2b-436d-9ae5-bfb25a2e2a48 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:29.591741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1fe8d2-eb2b-436d-9ae5-bfb25a2e2a48 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:29.614219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-75a73405-9141-4ea1-935b-922a5633f2c8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:29.625710 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-75a73405-9141-4ea1-935b-922a5633f2c8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 200 len: 1214 microversion: 2.1 time: 0.496212 Oct 24 10:35:29.627850 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1232/2522] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:29 2022] GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 1214 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:29.646426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-203949b2-0d48-4f1b-97dc-c74730d67c15 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:29.651797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-203949b2-0d48-4f1b-97dc-c74730d67c15 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:29.673752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-203949b2-0d48-4f1b-97dc-c74730d67c15 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:29.676178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-203949b2-0d48-4f1b-97dc-c74730d67c15 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:29.678234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-203949b2-0d48-4f1b-97dc-c74730d67c15 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:29.679793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-203949b2-0d48-4f1b-97dc-c74730d67c15 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:29.683559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-203949b2-0d48-4f1b-97dc-c74730d67c15 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:29.687138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-203949b2-0d48-4f1b-97dc-c74730d67c15 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:30.454108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3b1fe8d2-eb2b-436d-9ae5-bfb25a2e2a48 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:30.467347 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3b1fe8d2-eb2b-436d-9ae5-bfb25a2e2a48 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1684 microversion: 2.1 time: 0.933855 Oct 24 10:35:30.472332 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1291/2523] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:29 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1684 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:30.484888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aa6a4491-9e9f-4673-b2ef-df5227328e88 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:30.486816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aa6a4491-9e9f-4673-b2ef-df5227328e88 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:30.503051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-203949b2-0d48-4f1b-97dc-c74730d67c15 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:30.519302 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-203949b2-0d48-4f1b-97dc-c74730d67c15 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1477 microversion: 2.1 time: 0.886672 Oct 24 10:35:30.519862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa6a4491-9e9f-4673-b2ef-df5227328e88 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:30.521455 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1233/2524] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:29 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1477 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:30.523201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa6a4491-9e9f-4673-b2ef-df5227328e88 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:30.523872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa6a4491-9e9f-4673-b2ef-df5227328e88 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:30.527928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa6a4491-9e9f-4673-b2ef-df5227328e88 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:30.528605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa6a4491-9e9f-4673-b2ef-df5227328e88 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:30.534375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa6a4491-9e9f-4673-b2ef-df5227328e88 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:30.545574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b3396b0-8751-49a1-89e5-31bd5a0eefee tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:30.551147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8b3396b0-8751-49a1-89e5-31bd5a0eefee tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:30.574773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b3396b0-8751-49a1-89e5-31bd5a0eefee tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:30.576709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b3396b0-8751-49a1-89e5-31bd5a0eefee tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:30.580205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b3396b0-8751-49a1-89e5-31bd5a0eefee tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:30.583958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b3396b0-8751-49a1-89e5-31bd5a0eefee tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:30.585901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b3396b0-8751-49a1-89e5-31bd5a0eefee tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:30.586550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b3396b0-8751-49a1-89e5-31bd5a0eefee tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:31.118218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8b3396b0-8751-49a1-89e5-31bd5a0eefee tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:31.127729 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b3396b0-8751-49a1-89e5-31bd5a0eefee tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1316 microversion: 2.1 time: 0.601967 Oct 24 10:35:31.135747 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1234/2525] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:30 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1316 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:31.157698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-34dc799e-e611-4e6b-b635-d347d00ab206 req-0ed289ff-42a4-44de-9900-227485f2981a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa641844-507b-4fa0-ac8e-5ffbefa678bd", "name": "network-vif-plugged", "status": "completed", "tag": "021e97e0-485d-4b3c-86bf-0d92baa70132"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:31.196299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-34dc799e-e611-4e6b-b635-d347d00ab206 req-0ed289ff-42a4-44de-9900-227485f2981a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:31.199401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-34dc799e-e611-4e6b-b635-d347d00ab206 req-0ed289ff-42a4-44de-9900-227485f2981a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:31.200630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-34dc799e-e611-4e6b-b635-d347d00ab206 req-0ed289ff-42a4-44de-9900-227485f2981a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:31.242228 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-34dc799e-e611-4e6b-b635-d347d00ab206 req-0ed289ff-42a4-44de-9900-227485f2981a service nova] Creating event network-vif-plugged:021e97e0-485d-4b3c-86bf-0d92baa70132 for instance aa641844-507b-4fa0-ac8e-5ffbefa678bd on n-h1-858383-15 Oct 24 10:35:31.255218 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-34dc799e-e611-4e6b-b635-d347d00ab206 req-0ed289ff-42a4-44de-9900-227485f2981a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113777 Oct 24 10:35:31.258143 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1235/2526] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:35:31.268700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5ad1b21e-6385-480b-964b-e5a408896c03 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:31.269758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5ad1b21e-6385-480b-964b-e5a408896c03 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:31.277447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ad1b21e-6385-480b-964b-e5a408896c03 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:31.278191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ad1b21e-6385-480b-964b-e5a408896c03 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:31.278796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ad1b21e-6385-480b-964b-e5a408896c03 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:31.279665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ad1b21e-6385-480b-964b-e5a408896c03 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:31.281045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ad1b21e-6385-480b-964b-e5a408896c03 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:31.281719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ad1b21e-6385-480b-964b-e5a408896c03 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:31.464033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5ad1b21e-6385-480b-964b-e5a408896c03 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:31.466507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:31.475845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5ad1b21e-6385-480b-964b-e5a408896c03 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:31.493634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5ad1b21e-6385-480b-964b-e5a408896c03 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:31.494920 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5ad1b21e-6385-480b-964b-e5a408896c03 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1266 microversion: 2.25 time: 0.235410 Oct 24 10:35:31.495827 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1236/2527] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:31 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:35:31.500473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad69ccbf-0ac5-4b2f-8e68-abad6d970cd7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:31.501630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad69ccbf-0ac5-4b2f-8e68-abad6d970cd7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:31.530176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad69ccbf-0ac5-4b2f-8e68-abad6d970cd7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:31.530814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad69ccbf-0ac5-4b2f-8e68-abad6d970cd7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:31.531104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad69ccbf-0ac5-4b2f-8e68-abad6d970cd7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:31.531841 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad69ccbf-0ac5-4b2f-8e68-abad6d970cd7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:31.532577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad69ccbf-0ac5-4b2f-8e68-abad6d970cd7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:31.533066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad69ccbf-0ac5-4b2f-8e68-abad6d970cd7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:31.588409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aa6a4491-9e9f-4673-b2ef-df5227328e88 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:31.605792 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aa6a4491-9e9f-4673-b2ef-df5227328e88 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf" status: 200 len: 1679 microversion: 2.1 time: 1.130467 Oct 24 10:35:31.608099 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1292/2528] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:30 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf => generated 1679 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:31.621740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b853443a-0122-457e-87d6-df7ff4ea976b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:31.623456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b853443a-0122-457e-87d6-df7ff4ea976b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:31.652303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b853443a-0122-457e-87d6-df7ff4ea976b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:31.653285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b853443a-0122-457e-87d6-df7ff4ea976b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:31.653904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b853443a-0122-457e-87d6-df7ff4ea976b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:31.654782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b853443a-0122-457e-87d6-df7ff4ea976b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:31.656661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b853443a-0122-457e-87d6-df7ff4ea976b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:31.662468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b853443a-0122-457e-87d6-df7ff4ea976b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:31.971752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ad69ccbf-0ac5-4b2f-8e68-abad6d970cd7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:31.987631 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad69ccbf-0ac5-4b2f-8e68-abad6d970cd7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 200 len: 1272 microversion: 2.1 time: 0.490644 Oct 24 10:35:31.989137 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1237/2529] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:31 2022] GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 1272 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:32.001513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2961da48-3dd3-445c-9daf-035406189b63 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:32.002539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2961da48-3dd3-445c-9daf-035406189b63 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:32.023629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2961da48-3dd3-445c-9daf-035406189b63 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:32.024811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2961da48-3dd3-445c-9daf-035406189b63 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:32.026284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2961da48-3dd3-445c-9daf-035406189b63 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:32.027746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2961da48-3dd3-445c-9daf-035406189b63 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:32.048313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2961da48-3dd3-445c-9daf-035406189b63 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:32.050383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2961da48-3dd3-445c-9daf-035406189b63 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:32.757800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b853443a-0122-457e-87d6-df7ff4ea976b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:32.766984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2961da48-3dd3-445c-9daf-035406189b63 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:32.770695 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b853443a-0122-457e-87d6-df7ff4ea976b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1684 microversion: 2.1 time: 1.161350 Oct 24 10:35:32.774736 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2961da48-3dd3-445c-9daf-035406189b63 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1463 microversion: 2.1 time: 0.784374 Oct 24 10:35:32.775325 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1238/2530] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:31 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1463 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:32.794514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-97115711-e899-4f39-8361-061d23c7d11d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:32.794514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-97115711-e899-4f39-8361-061d23c7d11d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:32.796292 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1293/2531] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:31 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1684 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:32.818101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97115711-e899-4f39-8361-061d23c7d11d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:32.818448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97115711-e899-4f39-8361-061d23c7d11d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:32.818883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97115711-e899-4f39-8361-061d23c7d11d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:32.819596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97115711-e899-4f39-8361-061d23c7d11d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:32.820051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97115711-e899-4f39-8361-061d23c7d11d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:32.820430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c17e8809-7f26-43ff-93ca-4e0bc2ecbff3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:32.820555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97115711-e899-4f39-8361-061d23c7d11d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:32.823134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c17e8809-7f26-43ff-93ca-4e0bc2ecbff3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:32.844062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:32.864969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c17e8809-7f26-43ff-93ca-4e0bc2ecbff3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:32.867988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c17e8809-7f26-43ff-93ca-4e0bc2ecbff3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:32.871080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c17e8809-7f26-43ff-93ca-4e0bc2ecbff3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:32.874071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c17e8809-7f26-43ff-93ca-4e0bc2ecbff3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:32.874558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c17e8809-7f26-43ff-93ca-4e0bc2ecbff3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:32.875001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c17e8809-7f26-43ff-93ca-4e0bc2ecbff3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:33.146688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c17e8809-7f26-43ff-93ca-4e0bc2ecbff3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:33.156375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c17e8809-7f26-43ff-93ca-4e0bc2ecbff3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:33.166456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c17e8809-7f26-43ff-93ca-4e0bc2ecbff3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:33.168719 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c17e8809-7f26-43ff-93ca-4e0bc2ecbff3 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1266 microversion: 2.25 time: 0.365934 Oct 24 10:35:33.174127 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1294/2532] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:32 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1266 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:35:33.190071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1bb565e3-6274-43fd-a0ed-3d398e6ebc4d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:33.190869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1bb565e3-6274-43fd-a0ed-3d398e6ebc4d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:33.218795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1bb565e3-6274-43fd-a0ed-3d398e6ebc4d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:33.219956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1bb565e3-6274-43fd-a0ed-3d398e6ebc4d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:33.229614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1bb565e3-6274-43fd-a0ed-3d398e6ebc4d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:33.230680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1bb565e3-6274-43fd-a0ed-3d398e6ebc4d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:33.231395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1bb565e3-6274-43fd-a0ed-3d398e6ebc4d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:33.232039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1bb565e3-6274-43fd-a0ed-3d398e6ebc4d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:33.296594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:34.055503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1bb565e3-6274-43fd-a0ed-3d398e6ebc4d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:34.073733 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1bb565e3-6274-43fd-a0ed-3d398e6ebc4d tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf" status: 200 len: 1612 microversion: 2.1 time: 0.898202 Oct 24 10:35:34.077276 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1295/2533] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:33 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf => generated 1612 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:34.096514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7b365c2e-5d92-4364-b576-5d108a518fd3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:34.097643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7b365c2e-5d92-4364-b576-5d108a518fd3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:34.112815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b365c2e-5d92-4364-b576-5d108a518fd3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:34.114738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b365c2e-5d92-4364-b576-5d108a518fd3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:34.115363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b365c2e-5d92-4364-b576-5d108a518fd3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:34.117304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b365c2e-5d92-4364-b576-5d108a518fd3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:34.121189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b365c2e-5d92-4364-b576-5d108a518fd3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:34.137761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b365c2e-5d92-4364-b576-5d108a518fd3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:34.309965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-97115711-e899-4f39-8361-061d23c7d11d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:34.341253 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-97115711-e899-4f39-8361-061d23c7d11d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1316 microversion: 2.1 time: 1.558871 Oct 24 10:35:34.360903 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1239/2534] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:32 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1316 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:34.368676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-599cd6bc-a49c-4e2d-92af-739dc3210510 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:34.369554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-599cd6bc-a49c-4e2d-92af-739dc3210510 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:34.376809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-599cd6bc-a49c-4e2d-92af-739dc3210510 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:34.377641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-599cd6bc-a49c-4e2d-92af-739dc3210510 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:34.378233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-599cd6bc-a49c-4e2d-92af-739dc3210510 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:34.379132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-599cd6bc-a49c-4e2d-92af-739dc3210510 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:34.379744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-599cd6bc-a49c-4e2d-92af-739dc3210510 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:34.380331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-599cd6bc-a49c-4e2d-92af-739dc3210510 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:34.521541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-599cd6bc-a49c-4e2d-92af-739dc3210510 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:34.531535 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-599cd6bc-a49c-4e2d-92af-739dc3210510 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 200 len: 1272 microversion: 2.1 time: 0.168830 Oct 24 10:35:34.538572 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1240/2535] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:34 2022] GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:34.554772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9f0ef48b-870a-49ba-99cc-a6db477c3642 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:34.564520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9f0ef48b-870a-49ba-99cc-a6db477c3642 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:34.590172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f0ef48b-870a-49ba-99cc-a6db477c3642 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:34.590775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f0ef48b-870a-49ba-99cc-a6db477c3642 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:34.591218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f0ef48b-870a-49ba-99cc-a6db477c3642 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:34.600231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f0ef48b-870a-49ba-99cc-a6db477c3642 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:34.600795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f0ef48b-870a-49ba-99cc-a6db477c3642 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:34.604552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f0ef48b-870a-49ba-99cc-a6db477c3642 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:34.607775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7b365c2e-5d92-4364-b576-5d108a518fd3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:34.624560 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7b365c2e-5d92-4364-b576-5d108a518fd3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1463 microversion: 2.1 time: 0.543355 Oct 24 10:35:34.630703 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1296/2536] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:34 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1463 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:34.644603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ddd604b7-fe58-4dee-8ddf-0896b37e984d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:34.645443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ddd604b7-fe58-4dee-8ddf-0896b37e984d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:34.657792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddd604b7-fe58-4dee-8ddf-0896b37e984d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:34.662515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddd604b7-fe58-4dee-8ddf-0896b37e984d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:34.662848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddd604b7-fe58-4dee-8ddf-0896b37e984d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:34.663698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddd604b7-fe58-4dee-8ddf-0896b37e984d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:34.664262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddd604b7-fe58-4dee-8ddf-0896b37e984d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:34.664788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddd604b7-fe58-4dee-8ddf-0896b37e984d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:35.081627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ddd604b7-fe58-4dee-8ddf-0896b37e984d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:35.094882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ddd604b7-fe58-4dee-8ddf-0896b37e984d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:35.102375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ddd604b7-fe58-4dee-8ddf-0896b37e984d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:35.110569 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ddd604b7-fe58-4dee-8ddf-0896b37e984d tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 200 len: 1266 microversion: 2.25 time: 0.475007 Oct 24 10:35:35.111748 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1297/2537] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:34 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 1266 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:35:35.116736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:35.129034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:35.140099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:35.143757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:35.144752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:35.146430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:35.150860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:35.155316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:35.237964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9f0ef48b-870a-49ba-99cc-a6db477c3642 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:35.248655 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9f0ef48b-870a-49ba-99cc-a6db477c3642 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1684 microversion: 2.1 time: 0.708456 Oct 24 10:35:35.263666 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1241/2538] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:34 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1684 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:35.278854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fa009f92-120a-45cd-a166-8b59e87c6b74 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:35.290382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fa009f92-120a-45cd-a166-8b59e87c6b74 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:35.308050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa009f92-120a-45cd-a166-8b59e87c6b74 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:35.310531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa009f92-120a-45cd-a166-8b59e87c6b74 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:35.311594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa009f92-120a-45cd-a166-8b59e87c6b74 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:35.315565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa009f92-120a-45cd-a166-8b59e87c6b74 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:35.316306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa009f92-120a-45cd-a166-8b59e87c6b74 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:35.319793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa009f92-120a-45cd-a166-8b59e87c6b74 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:35.411343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:35:35.411835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:35:35.412308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:35:35.412746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:35:35.413252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:35:35.562999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:35.571271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fa009f92-120a-45cd-a166-8b59e87c6b74 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '001a2dd2081241c397719005e1d52eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7036c053ec42a98e784dbdc396c532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:35.580727 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fa009f92-120a-45cd-a166-8b59e87c6b74 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf" status: 200 len: 1612 microversion: 2.1 time: 0.310694 Oct 24 10:35:35.589956 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1242/2539] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:35 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf => generated 1612 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:35.593408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:35.599522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:35.599790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:35.600526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:35.606516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:35.607002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:35.612718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a76da808-9cdd-4a51-8994-621b4c567735 req-5968d8ae-ecac-4bb5-9a9b-995abd0290f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8832f22-83eb-47c3-8597-614ff8f28ecf", "name": "network-vif-deleted", "tag": "03d79102-62cf-4d9f-a210-b0d94c109df9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:35.646742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a76da808-9cdd-4a51-8994-621b4c567735 req-5968d8ae-ecac-4bb5-9a9b-995abd0290f2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:35.647451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a76da808-9cdd-4a51-8994-621b4c567735 req-5968d8ae-ecac-4bb5-9a9b-995abd0290f2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:35.648099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a76da808-9cdd-4a51-8994-621b4c567735 req-5968d8ae-ecac-4bb5-9a9b-995abd0290f2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:35.682544 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a76da808-9cdd-4a51-8994-621b4c567735 req-5968d8ae-ecac-4bb5-9a9b-995abd0290f2 service nova] Creating event network-vif-deleted:03d79102-62cf-4d9f-a210-b0d94c109df9 for instance a8832f22-83eb-47c3-8597-614ff8f28ecf on n-h1-858383-15 Oct 24 10:35:35.694897 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6d9e2592-02ba-4d56-98bf-76f4711d3e5f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "POST /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43/action" status: 202 len: 1067 microversion: 2.1 time: 0.581892 Oct 24 10:35:35.707126 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a76da808-9cdd-4a51-8994-621b4c567735 req-5968d8ae-ecac-4bb5-9a9b-995abd0290f2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115684 Oct 24 10:35:35.720934 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1298/2540] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:35:35 2022] POST /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43/action => generated 1067 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 24 10:35:35.722482 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1243/2541] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:35:35.731870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-77ab1a72-81db-4d7f-9649-b895ace7d2b2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:35.738776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-77ab1a72-81db-4d7f-9649-b895ace7d2b2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:35.744993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-168da60f-49ff-4cda-99b3-e5fd8493d1c8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:35.747680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-168da60f-49ff-4cda-99b3-e5fd8493d1c8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:35.762043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77ab1a72-81db-4d7f-9649-b895ace7d2b2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:35.767604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77ab1a72-81db-4d7f-9649-b895ace7d2b2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:35.771743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-168da60f-49ff-4cda-99b3-e5fd8493d1c8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:35.772306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77ab1a72-81db-4d7f-9649-b895ace7d2b2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:35.773395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-168da60f-49ff-4cda-99b3-e5fd8493d1c8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:35.776619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77ab1a72-81db-4d7f-9649-b895ace7d2b2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:35.777743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-168da60f-49ff-4cda-99b3-e5fd8493d1c8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:35.778356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77ab1a72-81db-4d7f-9649-b895ace7d2b2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:35.778855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-168da60f-49ff-4cda-99b3-e5fd8493d1c8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:35.781158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77ab1a72-81db-4d7f-9649-b895ace7d2b2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:35.782129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-168da60f-49ff-4cda-99b3-e5fd8493d1c8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:35.783179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-168da60f-49ff-4cda-99b3-e5fd8493d1c8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:36.419212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-77ab1a72-81db-4d7f-9649-b895ace7d2b2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:36.431099 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-77ab1a72-81db-4d7f-9649-b895ace7d2b2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1504 microversion: 2.1 time: 0.715271 Oct 24 10:35:36.440983 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1299/2542] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:35 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1504 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:36.448033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-90a2d615-0f3c-4e9c-bb49-8fa466bad02d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:36.454557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-90a2d615-0f3c-4e9c-bb49-8fa466bad02d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:36.481661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90a2d615-0f3c-4e9c-bb49-8fa466bad02d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:36.488880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90a2d615-0f3c-4e9c-bb49-8fa466bad02d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:36.489639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90a2d615-0f3c-4e9c-bb49-8fa466bad02d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:36.494868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90a2d615-0f3c-4e9c-bb49-8fa466bad02d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:36.503453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90a2d615-0f3c-4e9c-bb49-8fa466bad02d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:36.504468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90a2d615-0f3c-4e9c-bb49-8fa466bad02d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:36.574293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-168da60f-49ff-4cda-99b3-e5fd8493d1c8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:36.586966 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-168da60f-49ff-4cda-99b3-e5fd8493d1c8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 200 len: 1314 microversion: 2.1 time: 0.857347 Oct 24 10:35:36.587870 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1244/2543] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:35 2022] GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 1314 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:36.603144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0c89067-43ab-4c06-878c-b53da9303f47 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:36.605608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f0c89067-43ab-4c06-878c-b53da9303f47 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:36.627190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0c89067-43ab-4c06-878c-b53da9303f47 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:36.629376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0c89067-43ab-4c06-878c-b53da9303f47 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:36.630281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0c89067-43ab-4c06-878c-b53da9303f47 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:36.632043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0c89067-43ab-4c06-878c-b53da9303f47 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:36.632973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0c89067-43ab-4c06-878c-b53da9303f47 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:36.634641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0c89067-43ab-4c06-878c-b53da9303f47 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:36.665119 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-f0c89067-43ab-4c06-878c-b53da9303f47 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] HTTP exception thrown: Instance c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d could not be found. Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0c89067-43ab-4c06-878c-b53da9303f47 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Request method failure captured: Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d HTTP/1.1 Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmiEGXqHM3GeBkwvgAIOGM9egi_ztJyROimdJrwIo08X6fBi6u4wFuEkksoFlS93QOqTqAn69QbiMQ5NiDEb7Rz_BZB9z_UfFecYCL-E41_qJpcIPKDzl-JGkZOjXaFAa1d_PpJ--8R7XNWf0dlQjU6o5hFX-BCN3hfIaVN8qGrScWA Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.25 Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9f2d317e42584b41b11c1668de6657bd Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-726845486 Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9f2d317e42584b41b11c1668de6657bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9f2d317e42584b41b11c1668de6657bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9f2d317e42584b41b11c1668de6657bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9f2d317e42584b41b11c1668de6657bd", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-726845486 Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9f2d317e42584b41b11c1668de6657bd Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-726845486 Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-LiveAutoBlockMigrationV225Test-726845486-project Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 66ca4f9e7ffb447ebf740c52f6a098c2 Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-726845486-project Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d could not be found. Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d'} Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d could not be found. Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d could not be found. Oct 24 10:35:36.670387 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:36.675826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:36.675826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:36.675826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:36.675826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:35:36.675826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:35:36.675826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:35:36.675826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:35:36.675826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d could not be found. Oct 24 10:35:36.675826 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:35:36.681634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0c89067-43ab-4c06-878c-b53da9303f47 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Returning 404 to user: Instance c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:35:36.682750 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f0c89067-43ab-4c06-878c-b53da9303f47 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d" status: 404 len: 111 microversion: 2.25 time: 0.093944 Oct 24 10:35:36.683792 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1245/2544] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:36 2022] GET /compute/v2.1/servers/c5d0ba56-3846-47b8-9aa3-ab6b7dfb183d => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:35:36.696535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e04597b-d06d-4017-9405-716e262cf6f3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:36.697236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0e04597b-d06d-4017-9405-716e262cf6f3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:36.707082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e04597b-d06d-4017-9405-716e262cf6f3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:36.708493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e04597b-d06d-4017-9405-716e262cf6f3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:36.711153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e04597b-d06d-4017-9405-716e262cf6f3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:36.714136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e04597b-d06d-4017-9405-716e262cf6f3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:36.715460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e04597b-d06d-4017-9405-716e262cf6f3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:36.716161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e04597b-d06d-4017-9405-716e262cf6f3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:37.259639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0e04597b-d06d-4017-9405-716e262cf6f3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:37.271825 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e04597b-d06d-4017-9405-716e262cf6f3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.583920 Oct 24 10:35:37.272861 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1246/2545] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:36 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:37.289097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8615152d-0340-476e-b2c3-5f3919bc0efa tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1892126366"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:37.290085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8615152d-0340-476e-b2c3-5f3919bc0efa tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:37.300543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8615152d-0340-476e-b2c3-5f3919bc0efa tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:37.301985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8615152d-0340-476e-b2c3-5f3919bc0efa tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:37.304575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8615152d-0340-476e-b2c3-5f3919bc0efa tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:37.305472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8615152d-0340-476e-b2c3-5f3919bc0efa tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:37.307826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8615152d-0340-476e-b2c3-5f3919bc0efa tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:37.308419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8615152d-0340-476e-b2c3-5f3919bc0efa tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:37.343284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-90a2d615-0f3c-4e9c-bb49-8fa466bad02d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:37.361197 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-90a2d615-0f3c-4e9c-bb49-8fa466bad02d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1472 microversion: 2.1 time: 0.913832 Oct 24 10:35:37.362895 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1300/2546] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:36 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1472 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:37.372895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6fed58f8-42c4-471d-97a9-9e4a3f2dced7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:37.377336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6fed58f8-42c4-471d-97a9-9e4a3f2dced7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] [instance: a8832f22-83eb-47c3-8597-614ff8f28ecf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:37.386482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6fed58f8-42c4-471d-97a9-9e4a3f2dced7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:37.387587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6fed58f8-42c4-471d-97a9-9e4a3f2dced7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:37.388624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6fed58f8-42c4-471d-97a9-9e4a3f2dced7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:37.390376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6fed58f8-42c4-471d-97a9-9e4a3f2dced7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:37.391584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6fed58f8-42c4-471d-97a9-9e4a3f2dced7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:37.392314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6fed58f8-42c4-471d-97a9-9e4a3f2dced7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:37.430559 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-6fed58f8-42c4-471d-97a9-9e4a3f2dced7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] HTTP exception thrown: Instance a8832f22-83eb-47c3-8597-614ff8f28ecf could not be found. Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6fed58f8-42c4-471d-97a9-9e4a3f2dced7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Request method failure captured: Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf HTTP/1.1 Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmlvXThbXLsuc60903IlFWvzoOP7NLp_6ipnXI7kX4_8IDbFyDLTgmbIXwcmQFSlJlmZQNlnWJ11urjleUOV1pOOnLUe3-x4-F5M5nRDszb_zx-wtv7D9CHGiRXQkfR5DNJpF671MivwvmRsILQC8PC1BD0H07meMXgD3WIPzZeea-0 Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: db7036c053ec42a98e784dbdc396c532 Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-VolumesAdminNegativeTest-1309437485 Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/db7036c053ec42a98e784dbdc396c532"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/db7036c053ec42a98e784dbdc396c532"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/db7036c053ec42a98e784dbdc396c532"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_db7036c053ec42a98e784dbdc396c532", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-VolumesAdminNegativeTest-1309437485 Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: db7036c053ec42a98e784dbdc396c532 Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1309437485 Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-VolumesAdminNegativeTest-1309437485-project Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 001a2dd2081241c397719005e1d52eec Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-VolumesAdminNegativeTest-1309437485-project Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance a8832f22-83eb-47c3-8597-614ff8f28ecf could not be found. Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'a8832f22-83eb-47c3-8597-614ff8f28ecf'} Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8832f22-83eb-47c3-8597-614ff8f28ecf could not be found. Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8832f22-83eb-47c3-8597-614ff8f28ecf could not be found. Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:37.435296 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:37.440234 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:37.440234 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:35:37.440234 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:35:37.440234 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:35:37.440234 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:35:37.440234 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8832f22-83eb-47c3-8597-614ff8f28ecf could not be found. Oct 24 10:35:37.440234 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:37.444372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6fed58f8-42c4-471d-97a9-9e4a3f2dced7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Returning 404 to user: Instance a8832f22-83eb-47c3-8597-614ff8f28ecf could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:35:37.451403 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6fed58f8-42c4-471d-97a9-9e4a3f2dced7 tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf" status: 404 len: 111 microversion: 2.1 time: 0.085160 Oct 24 10:35:37.456331 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1301/2547] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:37 2022] GET /compute/v2.1/servers/a8832f22-83eb-47c3-8597-614ff8f28ecf => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:35:37.467428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-173464b3-df15-44a1-ad57-6412bcb6f92c tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] Calling method '.version_select at 0x7f04d4e7a280>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:37.523421 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-173464b3-df15-44a1-ad57-6412bcb6f92c tempest-VolumesAdminNegativeTest-1309437485 tempest-VolumesAdminNegativeTest-1309437485-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-454012539" status: 202 len: 0 microversion: 2.1 time: 0.062802 Oct 24 10:35:37.525061 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1302/2548] 10.222.0.50 () {58 vars in 1218 bytes} [Mon Oct 24 10:35:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-454012539 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:35:37.546088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ca0a4f67-0017-45dd-bd53-4e2f0d6d970d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:37.548017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ca0a4f67-0017-45dd-bd53-4e2f0d6d970d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:37.556374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca0a4f67-0017-45dd-bd53-4e2f0d6d970d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:37.557272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca0a4f67-0017-45dd-bd53-4e2f0d6d970d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:37.557978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca0a4f67-0017-45dd-bd53-4e2f0d6d970d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:37.559479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca0a4f67-0017-45dd-bd53-4e2f0d6d970d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:37.560242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca0a4f67-0017-45dd-bd53-4e2f0d6d970d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:37.561004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca0a4f67-0017-45dd-bd53-4e2f0d6d970d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:37.614868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:37.746805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:38.268534 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.network.security_group_api [None req-8615152d-0340-476e-b2c3-5f3919bc0efa tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Adding security group d70454a8-4e2e-4065-9816-0d5866e457b5 to port 021e97e0-485d-4b3c-86bf-0d92baa70132 Oct 24 10:35:38.301963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ca0a4f67-0017-45dd-bd53-4e2f0d6d970d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:38.312281 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ca0a4f67-0017-45dd-bd53-4e2f0d6d970d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.772063 Oct 24 10:35:38.322059 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1303/2549] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:37 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:38.327251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4b0bc96b-e2d2-4d88-9738-57016cc0b930 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:38.328175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4b0bc96b-e2d2-4d88-9738-57016cc0b930 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:38.350533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b0bc96b-e2d2-4d88-9738-57016cc0b930 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:38.351282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b0bc96b-e2d2-4d88-9738-57016cc0b930 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:38.351935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b0bc96b-e2d2-4d88-9738-57016cc0b930 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:38.352991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b0bc96b-e2d2-4d88-9738-57016cc0b930 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:38.353861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b0bc96b-e2d2-4d88-9738-57016cc0b930 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:38.354513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b0bc96b-e2d2-4d88-9738-57016cc0b930 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:38.802518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4b0bc96b-e2d2-4d88-9738-57016cc0b930 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:38.820480 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4b0bc96b-e2d2-4d88-9738-57016cc0b930 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 200 len: 1314 microversion: 2.1 time: 0.494223 Oct 24 10:35:38.821252 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1304/2550] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:38 2022] GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:38.833360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bd4656d3-2646-4e9f-8e8e-74ddc7c4ffc6 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:38.837067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bd4656d3-2646-4e9f-8e8e-74ddc7c4ffc6 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:38.850112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd4656d3-2646-4e9f-8e8e-74ddc7c4ffc6 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:38.853566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd4656d3-2646-4e9f-8e8e-74ddc7c4ffc6 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:38.854482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd4656d3-2646-4e9f-8e8e-74ddc7c4ffc6 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:38.856293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd4656d3-2646-4e9f-8e8e-74ddc7c4ffc6 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:38.860642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd4656d3-2646-4e9f-8e8e-74ddc7c4ffc6 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:38.861460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd4656d3-2646-4e9f-8e8e-74ddc7c4ffc6 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:39.581692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bd4656d3-2646-4e9f-8e8e-74ddc7c4ffc6 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:39.589792 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bd4656d3-2646-4e9f-8e8e-74ddc7c4ffc6 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1472 microversion: 2.1 time: 0.766741 Oct 24 10:35:39.623081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:39.629250 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1305/2551] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:38 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1472 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:39.760055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-d7936d4b-4409-442a-a2b9-d0c7c50a2f5d req-acc6e48d-055b-422a-85ee-157ed08b01cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04f00dc8-0ba7-47ad-8ed1-28b0643335b1", "tag": "eec00c99-eece-4a67-bf29-aa26055bfbfd"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:39.786160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d7936d4b-4409-442a-a2b9-d0c7c50a2f5d req-acc6e48d-055b-422a-85ee-157ed08b01cd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:39.786970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d7936d4b-4409-442a-a2b9-d0c7c50a2f5d req-acc6e48d-055b-422a-85ee-157ed08b01cd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:39.787936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d7936d4b-4409-442a-a2b9-d0c7c50a2f5d req-acc6e48d-055b-422a-85ee-157ed08b01cd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:39.814084 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-d7936d4b-4409-442a-a2b9-d0c7c50a2f5d req-acc6e48d-055b-422a-85ee-157ed08b01cd service nova] Creating event network-changed:eec00c99-eece-4a67-bf29-aa26055bfbfd for instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 on n-h1-858383-15 Oct 24 10:35:39.834951 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-d7936d4b-4409-442a-a2b9-d0c7c50a2f5d req-acc6e48d-055b-422a-85ee-157ed08b01cd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204244 Oct 24 10:35:39.851745 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1306/2552] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:35:39.876290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a9c94f6e-c107-412d-a0b2-d4b2aadda8dd req-5156c7e2-1937-4070-bfe6-461380909e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513ca608-24c9-45f9-8fb9-e231d92c7262", "name": "network-vif-unplugged", "status": "completed", "tag": "b2def801-647c-479d-9e34-cb0b4d60448e"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:39.927494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a9c94f6e-c107-412d-a0b2-d4b2aadda8dd req-5156c7e2-1937-4070-bfe6-461380909e6c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:39.953075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a9c94f6e-c107-412d-a0b2-d4b2aadda8dd req-5156c7e2-1937-4070-bfe6-461380909e6c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:39.954062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a9c94f6e-c107-412d-a0b2-d4b2aadda8dd req-5156c7e2-1937-4070-bfe6-461380909e6c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:39.991615 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a9c94f6e-c107-412d-a0b2-d4b2aadda8dd req-5156c7e2-1937-4070-bfe6-461380909e6c service nova] Creating event network-vif-unplugged:b2def801-647c-479d-9e34-cb0b4d60448e for instance 513ca608-24c9-45f9-8fb9-e231d92c7262 on n-h2-858383-15 Oct 24 10:35:40.027890 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a9c94f6e-c107-412d-a0b2-d4b2aadda8dd req-5156c7e2-1937-4070-bfe6-461380909e6c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.174207 Oct 24 10:35:40.028509 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1307/2553] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:35:40.049697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-91795a5d-12b2-47c8-b2b2-a0f66ca506f8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:40.050515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-91795a5d-12b2-47c8-b2b2-a0f66ca506f8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:40.062857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91795a5d-12b2-47c8-b2b2-a0f66ca506f8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:40.063352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91795a5d-12b2-47c8-b2b2-a0f66ca506f8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:40.063794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91795a5d-12b2-47c8-b2b2-a0f66ca506f8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:40.064525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91795a5d-12b2-47c8-b2b2-a0f66ca506f8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:40.081216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91795a5d-12b2-47c8-b2b2-a0f66ca506f8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:40.093508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91795a5d-12b2-47c8-b2b2-a0f66ca506f8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:41.091193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-91795a5d-12b2-47c8-b2b2-a0f66ca506f8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:41.100622 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-91795a5d-12b2-47c8-b2b2-a0f66ca506f8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 200 len: 1314 microversion: 2.1 time: 1.070843 Oct 24 10:35:41.101254 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1308/2554] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:40 2022] GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 1314 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:41.110939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4c400bfe-fc20-4594-a9dc-d79e41efb362 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:41.120256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4c400bfe-fc20-4594-a9dc-d79e41efb362 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:41.135479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c400bfe-fc20-4594-a9dc-d79e41efb362 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:41.136206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c400bfe-fc20-4594-a9dc-d79e41efb362 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:41.138459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c400bfe-fc20-4594-a9dc-d79e41efb362 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:41.139435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c400bfe-fc20-4594-a9dc-d79e41efb362 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:41.140584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c400bfe-fc20-4594-a9dc-d79e41efb362 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:41.141568 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c400bfe-fc20-4594-a9dc-d79e41efb362 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:41.309279 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8615152d-0340-476e-b2c3-5f3919bc0efa tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "POST /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd/action" status: 202 len: 0 microversion: 2.1 time: 4.034302 Oct 24 10:35:41.316858 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1247/2555] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:35:37 2022] POST /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd/action => generated 0 bytes in 4043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:35:41.326353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c3429a53-d7f7-4f81-ae63-a6d283ca5703 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:41.327415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c3429a53-d7f7-4f81-ae63-a6d283ca5703 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:41.349979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3429a53-d7f7-4f81-ae63-a6d283ca5703 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:41.351022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3429a53-d7f7-4f81-ae63-a6d283ca5703 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:41.351959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3429a53-d7f7-4f81-ae63-a6d283ca5703 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:41.357227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3429a53-d7f7-4f81-ae63-a6d283ca5703 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:41.357964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3429a53-d7f7-4f81-ae63-a6d283ca5703 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:41.359032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3429a53-d7f7-4f81-ae63-a6d283ca5703 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:41.396983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4c400bfe-fc20-4594-a9dc-d79e41efb362 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:41.408262 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4c400bfe-fc20-4594-a9dc-d79e41efb362 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.301625 Oct 24 10:35:41.413898 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1309/2556] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:41 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:41.426684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-2292b7d2-8944-4ac8-8dcb-368155038146 req-d3e51f9d-db5a-4969-a2c7-846ad16581ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa641844-507b-4fa0-ac8e-5ffbefa678bd", "tag": "021e97e0-485d-4b3c-86bf-0d92baa70132"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:41.449236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2292b7d2-8944-4ac8-8dcb-368155038146 req-d3e51f9d-db5a-4969-a2c7-846ad16581ee service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:41.467476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2292b7d2-8944-4ac8-8dcb-368155038146 req-d3e51f9d-db5a-4969-a2c7-846ad16581ee service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:41.469947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2292b7d2-8944-4ac8-8dcb-368155038146 req-d3e51f9d-db5a-4969-a2c7-846ad16581ee service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:41.509535 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-2292b7d2-8944-4ac8-8dcb-368155038146 req-d3e51f9d-db5a-4969-a2c7-846ad16581ee service nova] Creating event network-changed:021e97e0-485d-4b3c-86bf-0d92baa70132 for instance aa641844-507b-4fa0-ac8e-5ffbefa678bd on n-h1-858383-15 Oct 24 10:35:41.521805 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-2292b7d2-8944-4ac8-8dcb-368155038146 req-d3e51f9d-db5a-4969-a2c7-846ad16581ee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106034 Oct 24 10:35:41.525356 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1310/2557] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:35:41.535065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3535e13-2c6f-4704-80e3-44ccf02bccc6 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d4e1a9d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:41.731550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c3429a53-d7f7-4f81-ae63-a6d283ca5703 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:41.757769 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c3429a53-d7f7-4f81-ae63-a6d283ca5703 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1472 microversion: 2.1 time: 0.434453 Oct 24 10:35:41.758977 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1248/2558] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:41 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1472 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:41.776527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00922413-0049-4cb7-bf7b-04af2e3e209a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:41.782214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00922413-0049-4cb7-bf7b-04af2e3e209a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:41.813333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00922413-0049-4cb7-bf7b-04af2e3e209a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:41.814113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00922413-0049-4cb7-bf7b-04af2e3e209a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:41.814582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00922413-0049-4cb7-bf7b-04af2e3e209a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:41.825897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00922413-0049-4cb7-bf7b-04af2e3e209a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:41.826405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00922413-0049-4cb7-bf7b-04af2e3e209a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:41.826835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00922413-0049-4cb7-bf7b-04af2e3e209a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:42.394493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG neutronclient.v2_0.client [None req-f3535e13-2c6f-4704-80e3-44ccf02bccc6 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group d70454a8-4e2e-4065-9816-0d5866e457b5 in use.", "detail": ""}} {{(pid=120426) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:35:42.395177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-00922413-0049-4cb7-bf7b-04af2e3e209a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:42.396393 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-f3535e13-2c6f-4704-80e3-44ccf02bccc6 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] HTTP exception thrown: Security Group d70454a8-4e2e-4065-9816-0d5866e457b5 in use. Oct 24 10:35:42.396393 n-d-858383-15 devstack@n-api.service[120426]: Neutron server returns request_ids: ['req-6fdc051e-8d2c-43af-9f44-424bedf68a11'] Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3535e13-2c6f-4704-80e3-44ccf02bccc6 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Request method failure captured: Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/os-security-groups/d70454a8-4e2e-4065-9816-0d5866e457b5 HTTP/1.1 Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmoaXPClcPLJ9gE_6C5GjDQZGdene0OObxZB0Z9ED_DBUfNEOv3AFVz9Sj51DSTvjG5d4L4G0Y7Y2LCJ3yblYYRp_EY66mnirefPs52lqIDsBuo9XJUGZQDidaxp2-3kvGCo_yrNtYTWeu7uqgvMarg1Wuv91gUnqbIjaBzXZEG6tDA Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/60b1c666c4914debad43704393d651cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_60b1c666c4914debad43704393d651cf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 6aeb81e9b2fa4796813c607234174af6 Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: exception: Security Group d70454a8-4e2e-4065-9816-0d5866e457b5 in use. Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: Neutron server returns request_ids: ['req-6fdc051e-8d2c-43af-9f44-424bedf68a11'] Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'd70454a8-4e2e-4065-9816-0d5866e457b5'} Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:35:42.399491 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group d70454a8-4e2e-4065-9816-0d5866e457b5 in use. Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6fdc051e-8d2c-43af-9f44-424bedf68a11'] Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group d70454a8-4e2e-4065-9816-0d5866e457b5 in use. Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6fdc051e-8d2c-43af-9f44-424bedf68a11'] Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group d70454a8-4e2e-4065-9816-0d5866e457b5 in use. Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6fdc051e-8d2c-43af-9f44-424bedf68a11'] Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group d70454a8-4e2e-4065-9816-0d5866e457b5 in use. Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6fdc051e-8d2c-43af-9f44-424bedf68a11'] Oct 24 10:35:42.404470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:42.427937 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-00922413-0049-4cb7-bf7b-04af2e3e209a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.663342 Oct 24 10:35:42.430965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3535e13-2c6f-4704-80e3-44ccf02bccc6 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Returning 400 to user: Security Group d70454a8-4e2e-4065-9816-0d5866e457b5 in use. Oct 24 10:35:42.430965 n-d-858383-15 devstack@n-api.service[120426]: Neutron server returns request_ids: ['req-6fdc051e-8d2c-43af-9f44-424bedf68a11'] {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:35:42.432250 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f3535e13-2c6f-4704-80e3-44ccf02bccc6 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/d70454a8-4e2e-4065-9816-0d5866e457b5" status: 400 len: 185 microversion: 2.1 time: 0.905511 Oct 24 10:35:42.441971 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1311/2559] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:35:41 2022] DELETE /compute/v2.1/os-security-groups/d70454a8-4e2e-4065-9816-0d5866e457b5 => generated 185 bytes in 916 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:35:42.446696 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1249/2560] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:41 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:42.454171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-abdf93d9-27ee-4d39-a49a-5a851ecad7a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:42.457899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-abdf93d9-27ee-4d39-a49a-5a851ecad7a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:42.461442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5f65dcc9-4e27-429c-a48f-96862b7ee590 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:42.466050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5f65dcc9-4e27-429c-a48f-96862b7ee590 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:42.477907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abdf93d9-27ee-4d39-a49a-5a851ecad7a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:42.480613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abdf93d9-27ee-4d39-a49a-5a851ecad7a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:42.481308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abdf93d9-27ee-4d39-a49a-5a851ecad7a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:42.483244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abdf93d9-27ee-4d39-a49a-5a851ecad7a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:42.485154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f65dcc9-4e27-429c-a48f-96862b7ee590 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:42.486037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f65dcc9-4e27-429c-a48f-96862b7ee590 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:42.486246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abdf93d9-27ee-4d39-a49a-5a851ecad7a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:42.486477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f65dcc9-4e27-429c-a48f-96862b7ee590 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:42.487192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f65dcc9-4e27-429c-a48f-96862b7ee590 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:42.487862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abdf93d9-27ee-4d39-a49a-5a851ecad7a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:42.492189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f65dcc9-4e27-429c-a48f-96862b7ee590 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:42.493076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f65dcc9-4e27-429c-a48f-96862b7ee590 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:42.659623 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5f65dcc9-4e27-429c-a48f-96862b7ee590 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "POST /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd/action" status: 202 len: 0 microversion: 2.1 time: 0.208919 Oct 24 10:35:42.664467 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1250/2561] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:35:42 2022] POST /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:35:42.678190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4ce1970f-13d4-4c7d-a963-00e147df5beb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:42.680047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4ce1970f-13d4-4c7d-a963-00e147df5beb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:42.695728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ce1970f-13d4-4c7d-a963-00e147df5beb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:42.698988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ce1970f-13d4-4c7d-a963-00e147df5beb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:42.699444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ce1970f-13d4-4c7d-a963-00e147df5beb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:42.700178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ce1970f-13d4-4c7d-a963-00e147df5beb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:42.700637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ce1970f-13d4-4c7d-a963-00e147df5beb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:42.701092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ce1970f-13d4-4c7d-a963-00e147df5beb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:43.436585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-abdf93d9-27ee-4d39-a49a-5a851ecad7a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:43.450536 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-abdf93d9-27ee-4d39-a49a-5a851ecad7a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 200 len: 1314 microversion: 2.1 time: 1.006328 Oct 24 10:35:43.452725 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1312/2562] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:42 2022] GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 1314 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:43.461082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-88fb9d62-9593-40a5-8e9d-8bc42076985b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:43.461997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-88fb9d62-9593-40a5-8e9d-8bc42076985b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:43.470275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88fb9d62-9593-40a5-8e9d-8bc42076985b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:43.471544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88fb9d62-9593-40a5-8e9d-8bc42076985b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:43.472249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88fb9d62-9593-40a5-8e9d-8bc42076985b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:43.473446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88fb9d62-9593-40a5-8e9d-8bc42076985b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:43.474118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88fb9d62-9593-40a5-8e9d-8bc42076985b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:43.474771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88fb9d62-9593-40a5-8e9d-8bc42076985b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:43.591744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4ce1970f-13d4-4c7d-a963-00e147df5beb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:43.607858 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4ce1970f-13d4-4c7d-a963-00e147df5beb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.941595 Oct 24 10:35:43.628304 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1251/2563] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:42 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:43.644496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b4456a31-5895-4d49-af72-99cdf3ceb0a9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:43.645676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b4456a31-5895-4d49-af72-99cdf3ceb0a9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:43.674215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4456a31-5895-4d49-af72-99cdf3ceb0a9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:43.675964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4456a31-5895-4d49-af72-99cdf3ceb0a9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:43.676637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4456a31-5895-4d49-af72-99cdf3ceb0a9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:43.679429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4456a31-5895-4d49-af72-99cdf3ceb0a9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:43.680127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4456a31-5895-4d49-af72-99cdf3ceb0a9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:43.680661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4456a31-5895-4d49-af72-99cdf3ceb0a9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:44.196384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-88fb9d62-9593-40a5-8e9d-8bc42076985b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:44.211293 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-88fb9d62-9593-40a5-8e9d-8bc42076985b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1575 microversion: 2.1 time: 0.753126 Oct 24 10:35:44.214661 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1313/2564] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:43 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1575 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:44.224025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4d4294bc-30ea-4ead-80b8-cffe6d8eb4e2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:44.227174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4d4294bc-30ea-4ead-80b8-cffe6d8eb4e2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:44.246024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d4294bc-30ea-4ead-80b8-cffe6d8eb4e2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:44.249110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d4294bc-30ea-4ead-80b8-cffe6d8eb4e2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:44.249789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d4294bc-30ea-4ead-80b8-cffe6d8eb4e2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:44.250929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d4294bc-30ea-4ead-80b8-cffe6d8eb4e2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:44.252926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d4294bc-30ea-4ead-80b8-cffe6d8eb4e2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:44.253579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d4294bc-30ea-4ead-80b8-cffe6d8eb4e2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:44.280205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b4456a31-5895-4d49-af72-99cdf3ceb0a9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:44.290319 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b4456a31-5895-4d49-af72-99cdf3ceb0a9 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1472 microversion: 2.1 time: 0.654996 Oct 24 10:35:44.290905 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1252/2565] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:43 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1472 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:44.303146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0083fcd1-ea2b-4982-bd09-c228f59aa50f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:44.306184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0083fcd1-ea2b-4982-bd09-c228f59aa50f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:44.314095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4d4294bc-30ea-4ead-80b8-cffe6d8eb4e2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:35:44.321770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0083fcd1-ea2b-4982-bd09-c228f59aa50f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:44.323646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0083fcd1-ea2b-4982-bd09-c228f59aa50f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:44.323797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:44.329920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0083fcd1-ea2b-4982-bd09-c228f59aa50f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:44.330935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0083fcd1-ea2b-4982-bd09-c228f59aa50f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:44.331577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0083fcd1-ea2b-4982-bd09-c228f59aa50f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:44.332173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0083fcd1-ea2b-4982-bd09-c228f59aa50f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:44.421965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:44.486150 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4d4294bc-30ea-4ead-80b8-cffe6d8eb4e2 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "DELETE /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 204 len: 0 microversion: 2.25 time: 0.269518 Oct 24 10:35:44.489233 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1314/2566] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:35:44 2022] DELETE /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:35:44.498273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3b276fea-39ac-4e7a-a148-03b786731ee1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:44.499151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3b276fea-39ac-4e7a-a148-03b786731ee1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:44.521996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b276fea-39ac-4e7a-a148-03b786731ee1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:44.526059 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0083fcd1-ea2b-4982-bd09-c228f59aa50f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 202 len: 0 microversion: 2.1 time: 0.226528 Oct 24 10:35:44.526703 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1253/2567] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:35:44 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:35:44.527095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b276fea-39ac-4e7a-a148-03b786731ee1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:44.527735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b276fea-39ac-4e7a-a148-03b786731ee1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:44.535054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b276fea-39ac-4e7a-a148-03b786731ee1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:44.535805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b276fea-39ac-4e7a-a148-03b786731ee1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:44.536779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b276fea-39ac-4e7a-a148-03b786731ee1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:44.539559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d667162-03aa-45b4-8d72-f4fbdb8295ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:44.540412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0d667162-03aa-45b4-8d72-f4fbdb8295ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:44.566744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d667162-03aa-45b4-8d72-f4fbdb8295ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:44.567538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d667162-03aa-45b4-8d72-f4fbdb8295ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:44.568257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d667162-03aa-45b4-8d72-f4fbdb8295ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:44.575888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d667162-03aa-45b4-8d72-f4fbdb8295ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:44.578025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d667162-03aa-45b4-8d72-f4fbdb8295ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:44.580911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d667162-03aa-45b4-8d72-f4fbdb8295ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:45.475784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0d667162-03aa-45b4-8d72-f4fbdb8295ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:45.492776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0d667162-03aa-45b4-8d72-f4fbdb8295ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:45.495285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0d667162-03aa-45b4-8d72-f4fbdb8295ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:45.497890 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0d667162-03aa-45b4-8d72-f4fbdb8295ed tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1730 microversion: 2.25 time: 0.963643 Oct 24 10:35:45.499699 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1254/2568] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:44 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1730 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:35:45.506493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9384ef07-dc89-46bf-a55b-d9155c64a54e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:45.507794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9384ef07-dc89-46bf-a55b-d9155c64a54e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:45.516391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9384ef07-dc89-46bf-a55b-d9155c64a54e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:45.518210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9384ef07-dc89-46bf-a55b-d9155c64a54e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:45.518823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9384ef07-dc89-46bf-a55b-d9155c64a54e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:45.520881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9384ef07-dc89-46bf-a55b-d9155c64a54e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:45.521637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9384ef07-dc89-46bf-a55b-d9155c64a54e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:45.522758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9384ef07-dc89-46bf-a55b-d9155c64a54e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:45.554070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3b276fea-39ac-4e7a-a148-03b786731ee1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:45.570434 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3b276fea-39ac-4e7a-a148-03b786731ee1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 200 len: 1314 microversion: 2.1 time: 1.079530 Oct 24 10:35:45.571054 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1315/2569] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:44 2022] GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 1314 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:45.575747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-18bb3b15-64cd-40cc-b4aa-d39b71cb9c77 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:45.576365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-18bb3b15-64cd-40cc-b4aa-d39b71cb9c77 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:45.596439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18bb3b15-64cd-40cc-b4aa-d39b71cb9c77 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:45.596969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18bb3b15-64cd-40cc-b4aa-d39b71cb9c77 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:45.597419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18bb3b15-64cd-40cc-b4aa-d39b71cb9c77 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:45.598142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18bb3b15-64cd-40cc-b4aa-d39b71cb9c77 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:45.598608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18bb3b15-64cd-40cc-b4aa-d39b71cb9c77 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:45.599040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18bb3b15-64cd-40cc-b4aa-d39b71cb9c77 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:46.105329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-18bb3b15-64cd-40cc-b4aa-d39b71cb9c77 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:46.114891 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-18bb3b15-64cd-40cc-b4aa-d39b71cb9c77 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1575 microversion: 2.1 time: 0.542628 Oct 24 10:35:46.115817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9384ef07-dc89-46bf-a55b-d9155c64a54e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:46.142528 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1316/2570] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:45 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1575 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:46.149228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-22ba2203-3a62-4858-82ae-072768c63bfa tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:46.150231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-22ba2203-3a62-4858-82ae-072768c63bfa tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:46.158641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22ba2203-3a62-4858-82ae-072768c63bfa tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:46.161127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22ba2203-3a62-4858-82ae-072768c63bfa tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:46.162226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22ba2203-3a62-4858-82ae-072768c63bfa tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:46.163179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22ba2203-3a62-4858-82ae-072768c63bfa tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:46.164121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22ba2203-3a62-4858-82ae-072768c63bfa tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:46.166091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22ba2203-3a62-4858-82ae-072768c63bfa tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:46.167492 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9384ef07-dc89-46bf-a55b-d9155c64a54e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1673 microversion: 2.1 time: 0.664643 Oct 24 10:35:46.168976 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1255/2571] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:45 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1673 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:46.445258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-22ba2203-3a62-4858-82ae-072768c63bfa tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:46.455898 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-22ba2203-3a62-4858-82ae-072768c63bfa tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1472 microversion: 2.1 time: 0.312183 Oct 24 10:35:46.457945 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1317/2572] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:46 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1472 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:46.533506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e7069e1f-5b67-46dc-aa0d-0f592cc5ca6c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:46.535150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e7069e1f-5b67-46dc-aa0d-0f592cc5ca6c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:46.547704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7069e1f-5b67-46dc-aa0d-0f592cc5ca6c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:46.548462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7069e1f-5b67-46dc-aa0d-0f592cc5ca6c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:46.549095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7069e1f-5b67-46dc-aa0d-0f592cc5ca6c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:46.550119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7069e1f-5b67-46dc-aa0d-0f592cc5ca6c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:46.550570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7069e1f-5b67-46dc-aa0d-0f592cc5ca6c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:46.551177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7069e1f-5b67-46dc-aa0d-0f592cc5ca6c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:46.602577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-713f7195-096d-44a7-95af-511e039f268b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:46.603202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-713f7195-096d-44a7-95af-511e039f268b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:46.613717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-713f7195-096d-44a7-95af-511e039f268b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:46.614729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-713f7195-096d-44a7-95af-511e039f268b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:46.615361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-713f7195-096d-44a7-95af-511e039f268b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:46.616404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-713f7195-096d-44a7-95af-511e039f268b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:46.617115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-713f7195-096d-44a7-95af-511e039f268b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:46.618318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-713f7195-096d-44a7-95af-511e039f268b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:47.014896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e7069e1f-5b67-46dc-aa0d-0f592cc5ca6c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:47.027902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e7069e1f-5b67-46dc-aa0d-0f592cc5ca6c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:47.030419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e7069e1f-5b67-46dc-aa0d-0f592cc5ca6c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:47.037009 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e7069e1f-5b67-46dc-aa0d-0f592cc5ca6c tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1730 microversion: 2.25 time: 0.510763 Oct 24 10:35:47.049202 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1256/2573] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:46 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1730 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:35:47.049202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-09f2105d-a659-4df4-8e40-06e0390132de req-3f2352f1-8627-4c32-b9bc-4550c9f34e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f00dc8-0ba7-47ad-8ed1-28b0643335b1", "name": "network-vif-plugged", "status": "completed", "tag": "eec00c99-eece-4a67-bf29-aa26055bfbfd"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:47.079836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-09f2105d-a659-4df4-8e40-06e0390132de req-3f2352f1-8627-4c32-b9bc-4550c9f34e89 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:47.083385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-09f2105d-a659-4df4-8e40-06e0390132de req-3f2352f1-8627-4c32-b9bc-4550c9f34e89 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:47.085457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-09f2105d-a659-4df4-8e40-06e0390132de req-3f2352f1-8627-4c32-b9bc-4550c9f34e89 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:47.114487 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-09f2105d-a659-4df4-8e40-06e0390132de req-3f2352f1-8627-4c32-b9bc-4550c9f34e89 service nova] Creating event network-vif-plugged:eec00c99-eece-4a67-bf29-aa26055bfbfd for instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 on n-h1-858383-15 Oct 24 10:35:47.137159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-713f7195-096d-44a7-95af-511e039f268b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:47.149458 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-713f7195-096d-44a7-95af-511e039f268b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 200 len: 1314 microversion: 2.1 time: 0.548568 Oct 24 10:35:47.152350 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1318/2574] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:46 2022] GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:35:47.165462 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-09f2105d-a659-4df4-8e40-06e0390132de req-3f2352f1-8627-4c32-b9bc-4550c9f34e89 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110816 Oct 24 10:35:47.173996 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1257/2575] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:35:47.178921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0021db18-307d-48a9-912a-bcc1b728b519 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:47.180863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0021db18-307d-48a9-912a-bcc1b728b519 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:47.208939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e627e934-3b8e-41fb-a8eb-1782524870d5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:47.212554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e627e934-3b8e-41fb-a8eb-1782524870d5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:47.233337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0021db18-307d-48a9-912a-bcc1b728b519 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:47.235671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0021db18-307d-48a9-912a-bcc1b728b519 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:47.236367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0021db18-307d-48a9-912a-bcc1b728b519 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:47.239505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0021db18-307d-48a9-912a-bcc1b728b519 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:47.241565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0021db18-307d-48a9-912a-bcc1b728b519 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:47.244570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0021db18-307d-48a9-912a-bcc1b728b519 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:47.252294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e627e934-3b8e-41fb-a8eb-1782524870d5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:47.252928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e627e934-3b8e-41fb-a8eb-1782524870d5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:47.266797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e627e934-3b8e-41fb-a8eb-1782524870d5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:47.267682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e627e934-3b8e-41fb-a8eb-1782524870d5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:47.276279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e627e934-3b8e-41fb-a8eb-1782524870d5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:47.277138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e627e934-3b8e-41fb-a8eb-1782524870d5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:47.651266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e627e934-3b8e-41fb-a8eb-1782524870d5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:47.659159 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e627e934-3b8e-41fb-a8eb-1782524870d5 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1673 microversion: 2.1 time: 0.469283 Oct 24 10:35:47.659747 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1258/2576] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:47 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1673 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:47.673537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-916181f0-e44c-4800-ba6c-53b8799682ba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:47.675839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-916181f0-e44c-4800-ba6c-53b8799682ba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:47.694697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-916181f0-e44c-4800-ba6c-53b8799682ba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:47.695462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-916181f0-e44c-4800-ba6c-53b8799682ba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:47.706192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-916181f0-e44c-4800-ba6c-53b8799682ba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:47.707139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-916181f0-e44c-4800-ba6c-53b8799682ba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:47.707773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-916181f0-e44c-4800-ba6c-53b8799682ba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:47.708362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-916181f0-e44c-4800-ba6c-53b8799682ba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:47.921173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0021db18-307d-48a9-912a-bcc1b728b519 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:47.931908 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0021db18-307d-48a9-912a-bcc1b728b519 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1580 microversion: 2.1 time: 0.778230 Oct 24 10:35:47.932776 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1319/2577] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:47 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1580 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:48.073245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1da860e5-ece1-4866-87e5-b7d01310b5f6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:48.075037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1da860e5-ece1-4866-87e5-b7d01310b5f6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:48.106070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1da860e5-ece1-4866-87e5-b7d01310b5f6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:48.107157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1da860e5-ece1-4866-87e5-b7d01310b5f6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:48.111566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1da860e5-ece1-4866-87e5-b7d01310b5f6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:48.113287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1da860e5-ece1-4866-87e5-b7d01310b5f6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:48.115323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1da860e5-ece1-4866-87e5-b7d01310b5f6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:48.143000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1da860e5-ece1-4866-87e5-b7d01310b5f6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:48.186218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-916181f0-e44c-4800-ba6c-53b8799682ba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:48.197882 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-916181f0-e44c-4800-ba6c-53b8799682ba tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1472 microversion: 2.1 time: 0.533422 Oct 24 10:35:48.198717 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1259/2578] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:47 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1472 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:48.220943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b4127c00-2652-4845-8e4d-90c2d5b4f97e req-dbec69a6-b37c-4d9b-a714-006a141b116a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e4585f-945b-462a-aac7-5a7af22f160d", "name": "network-vif-deleted", "tag": "37825a2f-34ee-4e53-ae99-2a22e0da2d1b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:48.231098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b4127c00-2652-4845-8e4d-90c2d5b4f97e req-dbec69a6-b37c-4d9b-a714-006a141b116a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:48.231823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b4127c00-2652-4845-8e4d-90c2d5b4f97e req-dbec69a6-b37c-4d9b-a714-006a141b116a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:48.232424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b4127c00-2652-4845-8e4d-90c2d5b4f97e req-dbec69a6-b37c-4d9b-a714-006a141b116a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:48.248498 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b4127c00-2652-4845-8e4d-90c2d5b4f97e req-dbec69a6-b37c-4d9b-a714-006a141b116a service nova] Creating event network-vif-deleted:37825a2f-34ee-4e53-ae99-2a22e0da2d1b for instance 07e4585f-945b-462a-aac7-5a7af22f160d on n-h2-858383-15 Oct 24 10:35:48.256280 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b4127c00-2652-4845-8e4d-90c2d5b4f97e req-dbec69a6-b37c-4d9b-a714-006a141b116a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041574 Oct 24 10:35:48.257267 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1260/2579] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:35:48.263068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d3921d34-3116-4b31-b656-8b4592c41cec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:48.263951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d3921d34-3116-4b31-b656-8b4592c41cec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:48.271252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3921d34-3116-4b31-b656-8b4592c41cec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:48.271957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3921d34-3116-4b31-b656-8b4592c41cec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:48.272491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3921d34-3116-4b31-b656-8b4592c41cec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:48.273639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3921d34-3116-4b31-b656-8b4592c41cec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:48.274230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3921d34-3116-4b31-b656-8b4592c41cec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:48.274960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3921d34-3116-4b31-b656-8b4592c41cec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:48.313081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1da860e5-ece1-4866-87e5-b7d01310b5f6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:48.326457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1da860e5-ece1-4866-87e5-b7d01310b5f6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:48.330588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1da860e5-ece1-4866-87e5-b7d01310b5f6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:48.337442 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1da860e5-ece1-4866-87e5-b7d01310b5f6 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 200 len: 1664 microversion: 2.25 time: 0.265131 Oct 24 10:35:48.338493 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1320/2580] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:48 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 1664 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:35:48.686437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bea85e7f-da2c-48de-95cf-cbef74ae4265 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:48.687059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bea85e7f-da2c-48de-95cf-cbef74ae4265 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:48.700211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bea85e7f-da2c-48de-95cf-cbef74ae4265 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:48.701518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bea85e7f-da2c-48de-95cf-cbef74ae4265 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:48.714954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bea85e7f-da2c-48de-95cf-cbef74ae4265 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:48.717450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bea85e7f-da2c-48de-95cf-cbef74ae4265 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:48.718053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bea85e7f-da2c-48de-95cf-cbef74ae4265 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:48.721090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bea85e7f-da2c-48de-95cf-cbef74ae4265 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:48.972616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d3921d34-3116-4b31-b656-8b4592c41cec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:48.988371 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d3921d34-3116-4b31-b656-8b4592c41cec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 200 len: 1314 microversion: 2.1 time: 0.725918 Oct 24 10:35:48.989995 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1261/2581] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:48 2022] GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:48.994849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-824b9269-ce20-4a6c-a66b-908b0a55e4df tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:48.995644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-824b9269-ce20-4a6c-a66b-908b0a55e4df tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:49.006086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-824b9269-ce20-4a6c-a66b-908b0a55e4df tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:49.006589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-824b9269-ce20-4a6c-a66b-908b0a55e4df tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:49.007024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-824b9269-ce20-4a6c-a66b-908b0a55e4df tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:49.007904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-824b9269-ce20-4a6c-a66b-908b0a55e4df tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:49.008517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-824b9269-ce20-4a6c-a66b-908b0a55e4df tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:49.009199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-824b9269-ce20-4a6c-a66b-908b0a55e4df tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:49.164159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bea85e7f-da2c-48de-95cf-cbef74ae4265 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:49.172027 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bea85e7f-da2c-48de-95cf-cbef74ae4265 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.489682 Oct 24 10:35:49.181283 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1321/2582] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:48 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:35:49.196092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6a047696-2f1d-4f59-9543-1cd002d92d00 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:49.198922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6a047696-2f1d-4f59-9543-1cd002d92d00 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:49.206160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a047696-2f1d-4f59-9543-1cd002d92d00 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:49.206859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a047696-2f1d-4f59-9543-1cd002d92d00 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:49.207479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a047696-2f1d-4f59-9543-1cd002d92d00 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:49.208394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a047696-2f1d-4f59-9543-1cd002d92d00 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:49.209056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a047696-2f1d-4f59-9543-1cd002d92d00 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:49.209636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a047696-2f1d-4f59-9543-1cd002d92d00 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:49.317306 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6a047696-2f1d-4f59-9543-1cd002d92d00 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 200 len: 322 microversion: 2.1 time: 0.125031 Oct 24 10:35:49.323425 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1322/2583] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:35:49 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 322 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:35:49.329744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7f1c1977-16be-4c29-9ca0-a28c5b4cfd68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:49.330447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7f1c1977-16be-4c29-9ca0-a28c5b4cfd68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:49.346001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f1c1977-16be-4c29-9ca0-a28c5b4cfd68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:49.347082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f1c1977-16be-4c29-9ca0-a28c5b4cfd68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:49.347685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f1c1977-16be-4c29-9ca0-a28c5b4cfd68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:49.363291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f1c1977-16be-4c29-9ca0-a28c5b4cfd68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:49.368506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f1c1977-16be-4c29-9ca0-a28c5b4cfd68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:49.368506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f1c1977-16be-4c29-9ca0-a28c5b4cfd68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:49.961419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-824b9269-ce20-4a6c-a66b-908b0a55e4df tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:49.983975 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-824b9269-ce20-4a6c-a66b-908b0a55e4df tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1573 microversion: 2.1 time: 0.986319 Oct 24 10:35:49.986317 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1262/2584] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:48 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1573 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:49.998532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1bb5926b-4473-4a73-9572-1905575a5a69 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:50.002398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1bb5926b-4473-4a73-9572-1905575a5a69 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:50.031291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bb5926b-4473-4a73-9572-1905575a5a69 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:50.032294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bb5926b-4473-4a73-9572-1905575a5a69 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:50.033505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bb5926b-4473-4a73-9572-1905575a5a69 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:50.034666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bb5926b-4473-4a73-9572-1905575a5a69 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:50.035383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bb5926b-4473-4a73-9572-1905575a5a69 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:50.037737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bb5926b-4473-4a73-9572-1905575a5a69 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:50.064171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7f1c1977-16be-4c29-9ca0-a28c5b4cfd68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:50.081017 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7f1c1977-16be-4c29-9ca0-a28c5b4cfd68 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1472 microversion: 2.1 time: 0.751136 Oct 24 10:35:50.095338 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1323/2585] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:49 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1472 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:50.105775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cccb7974-bdfb-4432-9cec-572f038d47a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:50.108170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cccb7974-bdfb-4432-9cec-572f038d47a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 07e4585f-945b-462a-aac7-5a7af22f160d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:50.126963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cccb7974-bdfb-4432-9cec-572f038d47a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:50.127494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cccb7974-bdfb-4432-9cec-572f038d47a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:50.127935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cccb7974-bdfb-4432-9cec-572f038d47a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:50.128660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cccb7974-bdfb-4432-9cec-572f038d47a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:50.129140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cccb7974-bdfb-4432-9cec-572f038d47a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:50.129573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cccb7974-bdfb-4432-9cec-572f038d47a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:50.180698 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-cccb7974-bdfb-4432-9cec-572f038d47a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] HTTP exception thrown: Instance 07e4585f-945b-462a-aac7-5a7af22f160d could not be found. Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cccb7974-bdfb-4432-9cec-572f038d47a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Request method failure captured: Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d HTTP/1.1 Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmiEGXqHM3GeBkwvgAIOGM9egi_ztJyROimdJrwIo08X6fBi6u4wFuEkksoFlS93QOqTqAn69QbiMQ5NiDEb7Rz_BZB9z_UfFecYCL-E41_qJpcIPKDzl-JGkZOjXaFAa1d_PpJ--8R7XNWf0dlQjU6o5hFX-BCN3hfIaVN8qGrScWA Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-Openstack-Nova-Api-Version: 2.25 Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9f2d317e42584b41b11c1668de6657bd Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-726845486 Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9f2d317e42584b41b11c1668de6657bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9f2d317e42584b41b11c1668de6657bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9f2d317e42584b41b11c1668de6657bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9f2d317e42584b41b11c1668de6657bd", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-726845486 Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9f2d317e42584b41b11c1668de6657bd Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-726845486 Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-LiveAutoBlockMigrationV225Test-726845486-project Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 66ca4f9e7ffb447ebf740c52f6a098c2 Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-726845486-project Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 07e4585f-945b-462a-aac7-5a7af22f160d could not be found. Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '07e4585f-945b-462a-aac7-5a7af22f160d'} Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07e4585f-945b-462a-aac7-5a7af22f160d could not be found. Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07e4585f-945b-462a-aac7-5a7af22f160d could not be found. Oct 24 10:35:50.182439 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:50.186128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:50.186128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:50.186128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:50.186128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:35:50.186128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:35:50.186128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:35:50.186128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:35:50.186128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07e4585f-945b-462a-aac7-5a7af22f160d could not be found. Oct 24 10:35:50.186128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:50.186128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cccb7974-bdfb-4432-9cec-572f038d47a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Returning 404 to user: Instance 07e4585f-945b-462a-aac7-5a7af22f160d could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:35:50.186128 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cccb7974-bdfb-4432-9cec-572f038d47a1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d" status: 404 len: 111 microversion: 2.25 time: 0.087821 Oct 24 10:35:50.197302 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1324/2586] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:50 2022] GET /compute/v2.1/servers/07e4585f-945b-462a-aac7-5a7af22f160d => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:35:50.202713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-893c5b1c-e362-41ed-bbdd-a8c0bf950b70 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-587164822"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:50.203337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-893c5b1c-e362-41ed-bbdd-a8c0bf950b70 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:50.219706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-893c5b1c-e362-41ed-bbdd-a8c0bf950b70 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:50.221209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-893c5b1c-e362-41ed-bbdd-a8c0bf950b70 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:50.221916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-893c5b1c-e362-41ed-bbdd-a8c0bf950b70 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:50.225052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-893c5b1c-e362-41ed-bbdd-a8c0bf950b70 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:50.227334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-893c5b1c-e362-41ed-bbdd-a8c0bf950b70 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:50.228493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-893c5b1c-e362-41ed-bbdd-a8c0bf950b70 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:50.427587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1bb5926b-4473-4a73-9572-1905575a5a69 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:50.443733 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1bb5926b-4473-4a73-9572-1905575a5a69 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.451660 Oct 24 10:35:50.444404 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1263/2587] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:49 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:50.449461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0f1f20f9-51bc-45d2-a5bc-9ef614a424ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:50.450074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0f1f20f9-51bc-45d2-a5bc-9ef614a424ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:50.471130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f1f20f9-51bc-45d2-a5bc-9ef614a424ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:50.471624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f1f20f9-51bc-45d2-a5bc-9ef614a424ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:50.472061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f1f20f9-51bc-45d2-a5bc-9ef614a424ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:50.472770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f1f20f9-51bc-45d2-a5bc-9ef614a424ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:50.473283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f1f20f9-51bc-45d2-a5bc-9ef614a424ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:50.473705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f1f20f9-51bc-45d2-a5bc-9ef614a424ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:50.787709 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.network.security_group_api [None req-893c5b1c-e362-41ed-bbdd-a8c0bf950b70 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Adding security group 196a9850-7be7-40d1-94ba-e6c42b71f7f2 to port 021e97e0-485d-4b3c-86bf-0d92baa70132 Oct 24 10:35:50.947587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0f1f20f9-51bc-45d2-a5bc-9ef614a424ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:50.955058 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0f1f20f9-51bc-45d2-a5bc-9ef614a424ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 200 len: 1500 microversion: 2.1 time: 0.509226 Oct 24 10:35:50.956445 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1264/2588] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:50 2022] GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 1500 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:50.969307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be313866-4822-40a9-98ea-6b31d52a374f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '.version_select at 0x7f04d0b33820>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:51.008028 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-be313866-4822-40a9-98ea-6b31d52a374f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1852502053" status: 204 len: 0 microversion: 2.25 time: 0.050050 Oct 24 10:35:51.009046 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1265/2589] 10.222.0.50 () {60 vars in 1262 bytes} [Mon Oct 24 10:35:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1852502053 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:35:51.016014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1462c8e3-7f39-4c84-9b63-70c92b91a964 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:51.017022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1462c8e3-7f39-4c84-9b63-70c92b91a964 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:51.025346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1462c8e3-7f39-4c84-9b63-70c92b91a964 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:51.026305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1462c8e3-7f39-4c84-9b63-70c92b91a964 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:51.026970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1462c8e3-7f39-4c84-9b63-70c92b91a964 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:51.028293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1462c8e3-7f39-4c84-9b63-70c92b91a964 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:51.028933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1462c8e3-7f39-4c84-9b63-70c92b91a964 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:51.029519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1462c8e3-7f39-4c84-9b63-70c92b91a964 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:51.458124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1462c8e3-7f39-4c84-9b63-70c92b91a964 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:51.471102 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1462c8e3-7f39-4c84-9b63-70c92b91a964 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.460507 Oct 24 10:35:51.473395 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1266/2590] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:51 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:51.481530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ac46c07c-8494-4a17-b4c8-66aca3164960 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:51.482345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ac46c07c-8494-4a17-b4c8-66aca3164960 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:51.495208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac46c07c-8494-4a17-b4c8-66aca3164960 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:51.496300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac46c07c-8494-4a17-b4c8-66aca3164960 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:51.497632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac46c07c-8494-4a17-b4c8-66aca3164960 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:51.498598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac46c07c-8494-4a17-b4c8-66aca3164960 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:51.499265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac46c07c-8494-4a17-b4c8-66aca3164960 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:51.499937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac46c07c-8494-4a17-b4c8-66aca3164960 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:51.536211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ac46c07c-8494-4a17-b4c8-66aca3164960 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:35:51.630438 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-893c5b1c-e362-41ed-bbdd-a8c0bf950b70 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "POST /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd/action" status: 202 len: 0 microversion: 2.1 time: 1.431581 Oct 24 10:35:51.634757 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1325/2591] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:35:50 2022] POST /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd/action => generated 0 bytes in 1436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:35:51.642155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-828ee784-fb47-4c9a-a126-d2c60f8327c5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:51.643045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-828ee784-fb47-4c9a-a126-d2c60f8327c5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:51.660927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-828ee784-fb47-4c9a-a126-d2c60f8327c5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:51.661650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-828ee784-fb47-4c9a-a126-d2c60f8327c5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:51.662793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-828ee784-fb47-4c9a-a126-d2c60f8327c5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:51.664691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-828ee784-fb47-4c9a-a126-d2c60f8327c5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:51.666824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-828ee784-fb47-4c9a-a126-d2c60f8327c5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:51.668690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-828ee784-fb47-4c9a-a126-d2c60f8327c5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:51.704540 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ac46c07c-8494-4a17-b4c8-66aca3164960 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "DELETE /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 204 len: 0 microversion: 2.1 time: 0.229541 Oct 24 10:35:51.705397 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1267/2592] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:35:51 2022] DELETE /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:35:51.715846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c50ebcb-a4a4-4bb4-9792-57a47b047b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:51.719914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4c50ebcb-a4a4-4bb4-9792-57a47b047b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:51.736598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c50ebcb-a4a4-4bb4-9792-57a47b047b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:51.737477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c50ebcb-a4a4-4bb4-9792-57a47b047b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:51.738204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c50ebcb-a4a4-4bb4-9792-57a47b047b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:51.739275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c50ebcb-a4a4-4bb4-9792-57a47b047b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:51.740291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c50ebcb-a4a4-4bb4-9792-57a47b047b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:51.740966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c50ebcb-a4a4-4bb4-9792-57a47b047b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:52.063950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-828ee784-fb47-4c9a-a126-d2c60f8327c5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:52.071831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c50ebcb-a4a4-4bb4-9792-57a47b047b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:52.078510 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-828ee784-fb47-4c9a-a126-d2c60f8327c5 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1472 microversion: 2.1 time: 0.440367 Oct 24 10:35:52.079981 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1326/2593] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:51 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1472 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:52.083565 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4c50ebcb-a4a4-4bb4-9792-57a47b047b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.376794 Oct 24 10:35:52.086198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6127ed6e-62e9-4169-a027-67452895f1e1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d0970310>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:52.101157 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1268/2594] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:51 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:52.109855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a3a4425b-ebed-4fff-b7a0-fef776a8bf6d req-02e5ea67-28fd-4370-8550-7ae12a8f8a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa641844-507b-4fa0-ac8e-5ffbefa678bd", "tag": "021e97e0-485d-4b3c-86bf-0d92baa70132"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:52.120877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a3a4425b-ebed-4fff-b7a0-fef776a8bf6d req-02e5ea67-28fd-4370-8550-7ae12a8f8a80 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:52.121800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a3a4425b-ebed-4fff-b7a0-fef776a8bf6d req-02e5ea67-28fd-4370-8550-7ae12a8f8a80 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:52.122440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a3a4425b-ebed-4fff-b7a0-fef776a8bf6d req-02e5ea67-28fd-4370-8550-7ae12a8f8a80 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:52.137814 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a3a4425b-ebed-4fff-b7a0-fef776a8bf6d req-02e5ea67-28fd-4370-8550-7ae12a8f8a80 service nova] Creating event network-changed:021e97e0-485d-4b3c-86bf-0d92baa70132 for instance aa641844-507b-4fa0-ac8e-5ffbefa678bd on n-h1-858383-15 Oct 24 10:35:52.150617 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a3a4425b-ebed-4fff-b7a0-fef776a8bf6d req-02e5ea67-28fd-4370-8550-7ae12a8f8a80 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047215 Oct 24 10:35:52.154143 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1269/2595] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:35:52.163587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f17baa1b-56d0-4d4c-990f-f71b0f638a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:52.165625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f17baa1b-56d0-4d4c-990f-f71b0f638a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:52.180322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17baa1b-56d0-4d4c-990f-f71b0f638a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:52.181223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17baa1b-56d0-4d4c-990f-f71b0f638a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:52.181959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17baa1b-56d0-4d4c-990f-f71b0f638a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:52.183241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17baa1b-56d0-4d4c-990f-f71b0f638a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:52.185163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17baa1b-56d0-4d4c-990f-f71b0f638a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:52.186202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17baa1b-56d0-4d4c-990f-f71b0f638a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:52.786585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG neutronclient.v2_0.client [None req-6127ed6e-62e9-4169-a027-67452895f1e1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 196a9850-7be7-40d1-94ba-e6c42b71f7f2 in use.", "detail": ""}} {{(pid=120426) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:35:52.789568 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-6127ed6e-62e9-4169-a027-67452895f1e1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] HTTP exception thrown: Security Group 196a9850-7be7-40d1-94ba-e6c42b71f7f2 in use. Oct 24 10:35:52.789568 n-d-858383-15 devstack@n-api.service[120426]: Neutron server returns request_ids: ['req-25f62221-b98d-469d-8147-a810620679e9'] Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6127ed6e-62e9-4169-a027-67452895f1e1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Request method failure captured: Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/os-security-groups/196a9850-7be7-40d1-94ba-e6c42b71f7f2 HTTP/1.1 Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmoaXPClcPLJ9gE_6C5GjDQZGdene0OObxZB0Z9ED_DBUfNEOv3AFVz9Sj51DSTvjG5d4L4G0Y7Y2LCJ3yblYYRp_EY66mnirefPs52lqIDsBuo9XJUGZQDidaxp2-3kvGCo_yrNtYTWeu7uqgvMarg1Wuv91gUnqbIjaBzXZEG6tDA Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/60b1c666c4914debad43704393d651cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_60b1c666c4914debad43704393d651cf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 6aeb81e9b2fa4796813c607234174af6 Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: exception: Security Group 196a9850-7be7-40d1-94ba-e6c42b71f7f2 in use. Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: Neutron server returns request_ids: ['req-25f62221-b98d-469d-8147-a810620679e9'] Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '196a9850-7be7-40d1-94ba-e6c42b71f7f2'} Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:35:52.797190 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 196a9850-7be7-40d1-94ba-e6c42b71f7f2 in use. Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25f62221-b98d-469d-8147-a810620679e9'] Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 196a9850-7be7-40d1-94ba-e6c42b71f7f2 in use. Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25f62221-b98d-469d-8147-a810620679e9'] Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 196a9850-7be7-40d1-94ba-e6c42b71f7f2 in use. Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25f62221-b98d-469d-8147-a810620679e9'] Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 196a9850-7be7-40d1-94ba-e6c42b71f7f2 in use. Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25f62221-b98d-469d-8147-a810620679e9'] Oct 24 10:35:52.801720 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:35:52.807890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6127ed6e-62e9-4169-a027-67452895f1e1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Returning 400 to user: Security Group 196a9850-7be7-40d1-94ba-e6c42b71f7f2 in use. Oct 24 10:35:52.807890 n-d-858383-15 devstack@n-api.service[120426]: Neutron server returns request_ids: ['req-25f62221-b98d-469d-8147-a810620679e9'] {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:35:52.809105 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6127ed6e-62e9-4169-a027-67452895f1e1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/196a9850-7be7-40d1-94ba-e6c42b71f7f2" status: 400 len: 185 microversion: 2.1 time: 0.727542 Oct 24 10:35:52.811413 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1327/2596] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:35:52 2022] DELETE /compute/v2.1/os-security-groups/196a9850-7be7-40d1-94ba-e6c42b71f7f2 => generated 185 bytes in 731 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:35:52.819189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-06aa84e6-3a29-485a-a28d-ede0d580e998 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:52.823253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-06aa84e6-3a29-485a-a28d-ede0d580e998 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:52.835278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06aa84e6-3a29-485a-a28d-ede0d580e998 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:52.837590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06aa84e6-3a29-485a-a28d-ede0d580e998 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:52.838361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06aa84e6-3a29-485a-a28d-ede0d580e998 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:52.839820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06aa84e6-3a29-485a-a28d-ede0d580e998 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:52.841046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06aa84e6-3a29-485a-a28d-ede0d580e998 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:52.841685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06aa84e6-3a29-485a-a28d-ede0d580e998 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:52.885708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f17baa1b-56d0-4d4c-990f-f71b0f638a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:52.898432 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f17baa1b-56d0-4d4c-990f-f71b0f638a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 200 len: 1506 microversion: 2.1 time: 0.739912 Oct 24 10:35:52.900708 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1270/2597] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:52 2022] GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 1506 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:52.910162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e7937b3a-8c8a-4e55-8076-de04d5ccc4d1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:52.913446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e7937b3a-8c8a-4e55-8076-de04d5ccc4d1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:52.925754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7937b3a-8c8a-4e55-8076-de04d5ccc4d1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:52.926254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7937b3a-8c8a-4e55-8076-de04d5ccc4d1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:52.926694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7937b3a-8c8a-4e55-8076-de04d5ccc4d1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:52.927399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7937b3a-8c8a-4e55-8076-de04d5ccc4d1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:52.927849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7937b3a-8c8a-4e55-8076-de04d5ccc4d1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:52.928271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7937b3a-8c8a-4e55-8076-de04d5ccc4d1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:52.932746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:52.993545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e7937b3a-8c8a-4e55-8076-de04d5ccc4d1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:35:53.163529 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e7937b3a-8c8a-4e55-8076-de04d5ccc4d1 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 204 len: 0 microversion: 2.1 time: 0.255895 Oct 24 10:35:53.165618 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1271/2598] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:35:52 2022] DELETE /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:35:53.179427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-db54464c-1840-4421-82cb-2f5c573b0d9e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:53.180299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-db54464c-1840-4421-82cb-2f5c573b0d9e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:53.188025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:53.190340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db54464c-1840-4421-82cb-2f5c573b0d9e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:53.191046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db54464c-1840-4421-82cb-2f5c573b0d9e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:53.192090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db54464c-1840-4421-82cb-2f5c573b0d9e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:53.193398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db54464c-1840-4421-82cb-2f5c573b0d9e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:53.194046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db54464c-1840-4421-82cb-2f5c573b0d9e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:53.194638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db54464c-1840-4421-82cb-2f5c573b0d9e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:53.244369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-db54464c-1840-4421-82cb-2f5c573b0d9e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:35:53.419538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-06aa84e6-3a29-485a-a28d-ede0d580e998 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:53.436939 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-06aa84e6-3a29-485a-a28d-ede0d580e998 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.622612 Oct 24 10:35:53.438666 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1328/2599] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:52 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:53.440205 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-db54464c-1840-4421-82cb-2f5c573b0d9e tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 204 len: 0 microversion: 2.25 time: 0.271834 Oct 24 10:35:53.441277 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1272/2600] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:35:53 2022] DELETE /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:35:53.448270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c7e257c-3da5-43c1-a958-bbfa657d21a0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:53.449691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4c7e257c-3da5-43c1-a958-bbfa657d21a0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:53.450474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4f173895-76e6-4211-9743-080f9fcaec1f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:53.451719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4f173895-76e6-4211-9743-080f9fcaec1f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:53.459385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c7e257c-3da5-43c1-a958-bbfa657d21a0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:53.460264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c7e257c-3da5-43c1-a958-bbfa657d21a0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:53.460765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c7e257c-3da5-43c1-a958-bbfa657d21a0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:53.461553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c7e257c-3da5-43c1-a958-bbfa657d21a0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:53.462174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c7e257c-3da5-43c1-a958-bbfa657d21a0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:53.462651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c7e257c-3da5-43c1-a958-bbfa657d21a0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:53.467190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f173895-76e6-4211-9743-080f9fcaec1f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:53.468710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f173895-76e6-4211-9743-080f9fcaec1f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:53.471036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f173895-76e6-4211-9743-080f9fcaec1f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:53.472120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f173895-76e6-4211-9743-080f9fcaec1f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:53.474852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f173895-76e6-4211-9743-080f9fcaec1f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:53.475535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f173895-76e6-4211-9743-080f9fcaec1f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:53.869472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4f173895-76e6-4211-9743-080f9fcaec1f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:53.874365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c7e257c-3da5-43c1-a958-bbfa657d21a0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:53.885170 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4c7e257c-3da5-43c1-a958-bbfa657d21a0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1647 microversion: 2.1 time: 0.442360 Oct 24 10:35:53.885757 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1273/2601] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:53 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1647 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:53.888148 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4f173895-76e6-4211-9743-080f9fcaec1f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1472 microversion: 2.1 time: 0.446434 Oct 24 10:35:53.900476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b58b413f-6f7d-44a7-822c-f85dd03330de tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:53.900476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b58b413f-6f7d-44a7-822c-f85dd03330de tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:53.910051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b58b413f-6f7d-44a7-822c-f85dd03330de tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:53.910051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b58b413f-6f7d-44a7-822c-f85dd03330de tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:53.910051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b58b413f-6f7d-44a7-822c-f85dd03330de tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:53.910051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b58b413f-6f7d-44a7-822c-f85dd03330de tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:53.910051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b58b413f-6f7d-44a7-822c-f85dd03330de tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:53.910051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b58b413f-6f7d-44a7-822c-f85dd03330de tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:53.911329 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1329/2602] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:53 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1472 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:53.921083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e9d583fb-66ac-4e20-bc15-1a3395eef3ce tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-303028233", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "4c723f9d-e03c-43f2-9281-1f2dfc935187"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:54.058580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-e9d583fb-66ac-4e20-bc15-1a3395eef3ce tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] validate_networks() for [('4c723f9d-e03c-43f2-9281-1f2dfc935187', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:35:54.194548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b58b413f-6f7d-44a7-822c-f85dd03330de tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:54.211551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b58b413f-6f7d-44a7-822c-f85dd03330de tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:54.213026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b58b413f-6f7d-44a7-822c-f85dd03330de tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:54.215252 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b58b413f-6f7d-44a7-822c-f85dd03330de tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1548 microversion: 2.25 time: 0.328549 Oct 24 10:35:54.233838 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1274/2603] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:53 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1548 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:35:54.254641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f27e2c72-d018-4c54-a019-3dc955776167 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:54.254984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f27e2c72-d018-4c54-a019-3dc955776167 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:54.262515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f27e2c72-d018-4c54-a019-3dc955776167 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:54.263384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f27e2c72-d018-4c54-a019-3dc955776167 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:54.264046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f27e2c72-d018-4c54-a019-3dc955776167 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:54.265048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f27e2c72-d018-4c54-a019-3dc955776167 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:54.268260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f27e2c72-d018-4c54-a019-3dc955776167 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:54.268260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f27e2c72-d018-4c54-a019-3dc955776167 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:55.091075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f27e2c72-d018-4c54-a019-3dc955776167 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:55.102904 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f27e2c72-d018-4c54-a019-3dc955776167 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 200 len: 1506 microversion: 2.1 time: 0.867561 Oct 24 10:35:55.103501 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1275/2604] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:54 2022] GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 1506 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:55.126137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ad0f13b-1ade-4ba9-82ac-18ad7d5833d3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:55.126770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0ad0f13b-1ade-4ba9-82ac-18ad7d5833d3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:55.153455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ad0f13b-1ade-4ba9-82ac-18ad7d5833d3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:55.153966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ad0f13b-1ade-4ba9-82ac-18ad7d5833d3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:55.154415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ad0f13b-1ade-4ba9-82ac-18ad7d5833d3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:55.155150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ad0f13b-1ade-4ba9-82ac-18ad7d5833d3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:55.155613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ad0f13b-1ade-4ba9-82ac-18ad7d5833d3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:55.156844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ad0f13b-1ade-4ba9-82ac-18ad7d5833d3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:56.199156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0ad0f13b-1ade-4ba9-82ac-18ad7d5833d3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:56.207797 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0ad0f13b-1ade-4ba9-82ac-18ad7d5833d3 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1647 microversion: 2.1 time: 1.103245 Oct 24 10:35:56.208240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e9d583fb-66ac-4e20-bc15-1a3395eef3ce tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:35:56.209255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e9d583fb-66ac-4e20-bc15-1a3395eef3ce tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:35:56.209978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e9d583fb-66ac-4e20-bc15-1a3395eef3ce tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:35:56.210560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e9d583fb-66ac-4e20-bc15-1a3395eef3ce tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:35:56.211156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e9d583fb-66ac-4e20-bc15-1a3395eef3ce tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:35:56.213182 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1276/2605] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:55 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1647 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:56.220994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f4a2e0ed-a799-4966-9df3-199562e5a75e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:56.222101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9d583fb-66ac-4e20-bc15-1a3395eef3ce tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:56.222821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9d583fb-66ac-4e20-bc15-1a3395eef3ce tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:56.223612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9d583fb-66ac-4e20-bc15-1a3395eef3ce tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:56.224736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9d583fb-66ac-4e20-bc15-1a3395eef3ce tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:56.225407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9d583fb-66ac-4e20-bc15-1a3395eef3ce tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:56.226429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9d583fb-66ac-4e20-bc15-1a3395eef3ce tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:56.227599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f4a2e0ed-a799-4966-9df3-199562e5a75e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:56.234908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4a2e0ed-a799-4966-9df3-199562e5a75e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:56.235759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4a2e0ed-a799-4966-9df3-199562e5a75e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:56.236446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4a2e0ed-a799-4966-9df3-199562e5a75e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:56.238792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4a2e0ed-a799-4966-9df3-199562e5a75e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:56.239493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4a2e0ed-a799-4966-9df3-199562e5a75e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:56.240157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4a2e0ed-a799-4966-9df3-199562e5a75e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:56.261780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-e9d583fb-66ac-4e20-bc15-1a3395eef3ce tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Getting quotas for project 4878c0e43a9d4db8ba5c6590b43624f0. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:35:56.272782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-e9d583fb-66ac-4e20-bc15-1a3395eef3ce tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Getting quotas for user 45500f699a6f463b8755f0417b24151c and project 4878c0e43a9d4db8ba5c6590b43624f0. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:35:56.309477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e9d583fb-66ac-4e20-bc15-1a3395eef3ce tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:35:56.327410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e9d583fb-66ac-4e20-bc15-1a3395eef3ce tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:35:56.394672 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e9d583fb-66ac-4e20-bc15-1a3395eef3ce tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.482071 Oct 24 10:35:56.395620 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1330/2606] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:35:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:35:56.400999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-918a521d-f41d-4c04-9698-ba3747c6a8d0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:56.402972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-918a521d-f41d-4c04-9698-ba3747c6a8d0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:56.409950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-918a521d-f41d-4c04-9698-ba3747c6a8d0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:56.410804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-918a521d-f41d-4c04-9698-ba3747c6a8d0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:56.412426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-918a521d-f41d-4c04-9698-ba3747c6a8d0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:56.413811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-918a521d-f41d-4c04-9698-ba3747c6a8d0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:56.414591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-918a521d-f41d-4c04-9698-ba3747c6a8d0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:56.415250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-918a521d-f41d-4c04-9698-ba3747c6a8d0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:56.606274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-918a521d-f41d-4c04-9698-ba3747c6a8d0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:56.628223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-918a521d-f41d-4c04-9698-ba3747c6a8d0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:56.635359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-918a521d-f41d-4c04-9698-ba3747c6a8d0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:56.640199 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-918a521d-f41d-4c04-9698-ba3747c6a8d0 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1506 microversion: 2.25 time: 0.241919 Oct 24 10:35:56.666098 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1331/2607] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:56 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1506 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:35:56.673722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0bdce23a-cbda-4cf4-ab5c-3fb206463e31 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:56.680792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0bdce23a-cbda-4cf4-ab5c-3fb206463e31 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:56.692219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bdce23a-cbda-4cf4-ab5c-3fb206463e31 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:56.692750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bdce23a-cbda-4cf4-ab5c-3fb206463e31 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:56.693309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bdce23a-cbda-4cf4-ab5c-3fb206463e31 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:56.694223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bdce23a-cbda-4cf4-ab5c-3fb206463e31 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:56.694848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bdce23a-cbda-4cf4-ab5c-3fb206463e31 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:56.695534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bdce23a-cbda-4cf4-ab5c-3fb206463e31 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:57.384393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0bdce23a-cbda-4cf4-ab5c-3fb206463e31 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:57.389182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:57.402857 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0bdce23a-cbda-4cf4-ab5c-3fb206463e31 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 200 len: 1506 microversion: 2.1 time: 0.735256 Oct 24 10:35:57.406963 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1332/2608] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:56 2022] GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 1506 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:57.418006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e6aebd92-62d7-429d-aac7-0082d7b2d266 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:57.419746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e6aebd92-62d7-429d-aac7-0082d7b2d266 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:57.426310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f4a2e0ed-a799-4966-9df3-199562e5a75e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:57.441162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:35:57.445629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6aebd92-62d7-429d-aac7-0082d7b2d266 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:57.446143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6aebd92-62d7-429d-aac7-0082d7b2d266 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:57.450779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6aebd92-62d7-429d-aac7-0082d7b2d266 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:57.454952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6aebd92-62d7-429d-aac7-0082d7b2d266 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:57.456105 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f4a2e0ed-a799-4966-9df3-199562e5a75e tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1472 microversion: 2.1 time: 1.241376 Oct 24 10:35:57.456457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6aebd92-62d7-429d-aac7-0082d7b2d266 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:57.456739 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1277/2609] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:56 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1472 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:57.461537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6aebd92-62d7-429d-aac7-0082d7b2d266 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:57.471856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef42c89e-a9c8-472b-babb-c053aac53872 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:57.472801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ef42c89e-a9c8-472b-babb-c053aac53872 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:57.481795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef42c89e-a9c8-472b-babb-c053aac53872 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:57.482539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef42c89e-a9c8-472b-babb-c053aac53872 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:57.483127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef42c89e-a9c8-472b-babb-c053aac53872 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:57.484972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef42c89e-a9c8-472b-babb-c053aac53872 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:57.487900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef42c89e-a9c8-472b-babb-c053aac53872 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:57.488534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef42c89e-a9c8-472b-babb-c053aac53872 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:58.288924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e6aebd92-62d7-429d-aac7-0082d7b2d266 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:58.306603 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e6aebd92-62d7-429d-aac7-0082d7b2d266 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1210 microversion: 2.1 time: 0.898337 Oct 24 10:35:58.325724 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1333/2610] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:57 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1210 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:58.341424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-f6d38a96-3643-45a9-bd78-31eb14ec4be9 req-0ac81d99-b675-4f1b-ad49-b11456f4c401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d7180f-82cf-4113-824a-6350d013baf1", "name": "network-vif-deleted", "tag": "af23d072-0dd6-45cf-9412-eb509fb3c310"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:58.360872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f6d38a96-3643-45a9-bd78-31eb14ec4be9 req-0ac81d99-b675-4f1b-ad49-b11456f4c401 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:58.369717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f6d38a96-3643-45a9-bd78-31eb14ec4be9 req-0ac81d99-b675-4f1b-ad49-b11456f4c401 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:58.370436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f6d38a96-3643-45a9-bd78-31eb14ec4be9 req-0ac81d99-b675-4f1b-ad49-b11456f4c401 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:58.408626 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f6d38a96-3643-45a9-bd78-31eb14ec4be9 req-0ac81d99-b675-4f1b-ad49-b11456f4c401 service nova] Creating event network-vif-deleted:af23d072-0dd6-45cf-9412-eb509fb3c310 for instance b9d7180f-82cf-4113-824a-6350d013baf1 on n-h2-858383-15 Oct 24 10:35:58.417273 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-f6d38a96-3643-45a9-bd78-31eb14ec4be9 req-0ac81d99-b675-4f1b-ad49-b11456f4c401 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084239 Oct 24 10:35:58.423043 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1334/2611] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:35:58.431829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-f6dcf1bc-d242-4cde-8332-9dfa18187db6 req-bb3cf875-f984-49f1-8993-ddb25efff8dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f00dc8-0ba7-47ad-8ed1-28b0643335b1", "name": "network-vif-unplugged", "status": "completed", "tag": "eec00c99-eece-4a67-bf29-aa26055bfbfd"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:35:58.468015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f6dcf1bc-d242-4cde-8332-9dfa18187db6 req-bb3cf875-f984-49f1-8993-ddb25efff8dc service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:58.474969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f6dcf1bc-d242-4cde-8332-9dfa18187db6 req-bb3cf875-f984-49f1-8993-ddb25efff8dc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:58.476226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f6dcf1bc-d242-4cde-8332-9dfa18187db6 req-bb3cf875-f984-49f1-8993-ddb25efff8dc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:58.507477 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f6dcf1bc-d242-4cde-8332-9dfa18187db6 req-bb3cf875-f984-49f1-8993-ddb25efff8dc service nova] Creating event network-vif-unplugged:eec00c99-eece-4a67-bf29-aa26055bfbfd for instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 on n-h1-858383-15 Oct 24 10:35:58.518772 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-f6dcf1bc-d242-4cde-8332-9dfa18187db6 req-bb3cf875-f984-49f1-8993-ddb25efff8dc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093949 Oct 24 10:35:58.526282 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1335/2612] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:35:58.546009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c4414216-c7e0-4a53-aaa9-97a39efdfc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:58.554859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c4414216-c7e0-4a53-aaa9-97a39efdfc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:58.575130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4414216-c7e0-4a53-aaa9-97a39efdfc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:58.575712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4414216-c7e0-4a53-aaa9-97a39efdfc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:58.576151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4414216-c7e0-4a53-aaa9-97a39efdfc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:58.576983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4414216-c7e0-4a53-aaa9-97a39efdfc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:58.584916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4414216-c7e0-4a53-aaa9-97a39efdfc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:58.585574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4414216-c7e0-4a53-aaa9-97a39efdfc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:58.660959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4414216-c7e0-4a53-aaa9-97a39efdfc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:58.662082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4414216-c7e0-4a53-aaa9-97a39efdfc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:58.662546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4414216-c7e0-4a53-aaa9-97a39efdfc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:58.663013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-c4414216-c7e0-4a53-aaa9-97a39efdfc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lazy-loading 'fault' on Instance uuid b9d7180f-82cf-4113-824a-6350d013baf1 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:35:58.719432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ef42c89e-a9c8-472b-babb-c053aac53872 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:58.763017 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef42c89e-a9c8-472b-babb-c053aac53872 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1647 microversion: 2.1 time: 1.301968 Oct 24 10:35:58.763663 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1278/2613] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:57 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1647 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:58.776109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-22f410aa-a64b-4344-95ce-c82ef419522d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:58.784487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-22f410aa-a64b-4344-95ce-c82ef419522d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:58.805801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22f410aa-a64b-4344-95ce-c82ef419522d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:58.806652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22f410aa-a64b-4344-95ce-c82ef419522d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:58.807879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22f410aa-a64b-4344-95ce-c82ef419522d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:58.809395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22f410aa-a64b-4344-95ce-c82ef419522d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:58.811428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22f410aa-a64b-4344-95ce-c82ef419522d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:58.813228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22f410aa-a64b-4344-95ce-c82ef419522d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:58.891745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c4414216-c7e0-4a53-aaa9-97a39efdfc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:58.899975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22f410aa-a64b-4344-95ce-c82ef419522d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:58.901198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22f410aa-a64b-4344-95ce-c82ef419522d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:58.901959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22f410aa-a64b-4344-95ce-c82ef419522d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:58.902652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-22f410aa-a64b-4344-95ce-c82ef419522d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lazy-loading 'fault' on Instance uuid 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:35:58.903443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c4414216-c7e0-4a53-aaa9-97a39efdfc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:58.906314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c4414216-c7e0-4a53-aaa9-97a39efdfc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:58.908814 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c4414216-c7e0-4a53-aaa9-97a39efdfc79 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 200 len: 1350 microversion: 2.25 time: 0.380900 Oct 24 10:35:58.922304 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1336/2614] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:35:58 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 1350 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:35:58.936865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-530a2bb3-5023-420b-9827-14eaa331c95b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:58.938270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-530a2bb3-5023-420b-9827-14eaa331c95b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:58.949433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-530a2bb3-5023-420b-9827-14eaa331c95b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:58.950070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-530a2bb3-5023-420b-9827-14eaa331c95b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:58.950839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-530a2bb3-5023-420b-9827-14eaa331c95b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:58.951806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-530a2bb3-5023-420b-9827-14eaa331c95b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:58.952639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-530a2bb3-5023-420b-9827-14eaa331c95b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:58.953396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-530a2bb3-5023-420b-9827-14eaa331c95b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:59.078807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-22f410aa-a64b-4344-95ce-c82ef419522d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:59.087161 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-22f410aa-a64b-4344-95ce-c82ef419522d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 200 len: 1304 microversion: 2.1 time: 0.320449 Oct 24 10:35:59.094272 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1279/2615] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:58 2022] GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 1304 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:59.331334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-da0bfdaf-0676-4de0-b1a9-75c4f5b6cfeb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:59.331987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-da0bfdaf-0676-4de0-b1a9-75c4f5b6cfeb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:59.342454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da0bfdaf-0676-4de0-b1a9-75c4f5b6cfeb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:59.342961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da0bfdaf-0676-4de0-b1a9-75c4f5b6cfeb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:59.345944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da0bfdaf-0676-4de0-b1a9-75c4f5b6cfeb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:59.346695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da0bfdaf-0676-4de0-b1a9-75c4f5b6cfeb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:59.347171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da0bfdaf-0676-4de0-b1a9-75c4f5b6cfeb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:59.347604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da0bfdaf-0676-4de0-b1a9-75c4f5b6cfeb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:59.468421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-530a2bb3-5023-420b-9827-14eaa331c95b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:59.480288 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-530a2bb3-5023-420b-9827-14eaa331c95b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1472 microversion: 2.1 time: 0.556365 Oct 24 10:35:59.481139 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1337/2616] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:58 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1472 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:35:59.587775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-da0bfdaf-0676-4de0-b1a9-75c4f5b6cfeb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:35:59.602350 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-da0bfdaf-0676-4de0-b1a9-75c4f5b6cfeb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1272 microversion: 2.1 time: 0.275708 Oct 24 10:35:59.604260 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1280/2617] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:59 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1272 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:35:59.796350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b19f4faa-a1e9-44c3-afdc-edb03476b329 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:35:59.797166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b19f4faa-a1e9-44c3-afdc-edb03476b329 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:35:59.806663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b19f4faa-a1e9-44c3-afdc-edb03476b329 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:59.807433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b19f4faa-a1e9-44c3-afdc-edb03476b329 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:59.808037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b19f4faa-a1e9-44c3-afdc-edb03476b329 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:59.808952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b19f4faa-a1e9-44c3-afdc-edb03476b329 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:59.809609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b19f4faa-a1e9-44c3-afdc-edb03476b329 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:59.810250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b19f4faa-a1e9-44c3-afdc-edb03476b329 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:59.884844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b19f4faa-a1e9-44c3-afdc-edb03476b329 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:35:59.885916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b19f4faa-a1e9-44c3-afdc-edb03476b329 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:35:59.891624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b19f4faa-a1e9-44c3-afdc-edb03476b329 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:35:59.895137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-b19f4faa-a1e9-44c3-afdc-edb03476b329 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lazy-loading 'fault' on Instance uuid aa641844-507b-4fa0-ac8e-5ffbefa678bd {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:36:00.073681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e4dcb5f-f1a5-4973-ad05-feefc7e4741d tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Action: 'create', calling method: .version_select at 0x7f04d4e28a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-122074407", "description": "tempest-description-1837165387"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:00.098917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b19f4faa-a1e9-44c3-afdc-edb03476b329 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:00.109655 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b19f4faa-a1e9-44c3-afdc-edb03476b329 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 200 len: 1306 microversion: 2.1 time: 0.317713 Oct 24 10:36:00.110386 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1281/2618] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:35:59 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 1306 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:36:00.119157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d448e7f-4f88-4d98-83c0-763ed68298b1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:00.125885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0d448e7f-4f88-4d98-83c0-763ed68298b1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: b9d7180f-82cf-4113-824a-6350d013baf1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:00.142142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d448e7f-4f88-4d98-83c0-763ed68298b1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:00.144008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d448e7f-4f88-4d98-83c0-763ed68298b1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:00.147028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d448e7f-4f88-4d98-83c0-763ed68298b1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:00.148060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d448e7f-4f88-4d98-83c0-763ed68298b1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:00.149937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d448e7f-4f88-4d98-83c0-763ed68298b1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:00.151673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d448e7f-4f88-4d98-83c0-763ed68298b1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:00.197536 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-0d448e7f-4f88-4d98-83c0-763ed68298b1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] HTTP exception thrown: Instance b9d7180f-82cf-4113-824a-6350d013baf1 could not be found. Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d448e7f-4f88-4d98-83c0-763ed68298b1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Request method failure captured: Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 HTTP/1.1 Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmiEGXqHM3GeBkwvgAIOGM9egi_ztJyROimdJrwIo08X6fBi6u4wFuEkksoFlS93QOqTqAn69QbiMQ5NiDEb7Rz_BZB9z_UfFecYCL-E41_qJpcIPKDzl-JGkZOjXaFAa1d_PpJ--8R7XNWf0dlQjU6o5hFX-BCN3hfIaVN8qGrScWA Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.25 Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9f2d317e42584b41b11c1668de6657bd Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-726845486 Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9f2d317e42584b41b11c1668de6657bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9f2d317e42584b41b11c1668de6657bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9f2d317e42584b41b11c1668de6657bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9f2d317e42584b41b11c1668de6657bd", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-726845486 Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9f2d317e42584b41b11c1668de6657bd Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-726845486 Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-LiveAutoBlockMigrationV225Test-726845486-project Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 66ca4f9e7ffb447ebf740c52f6a098c2 Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-726845486-project Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance b9d7180f-82cf-4113-824a-6350d013baf1 could not be found. Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'b9d7180f-82cf-4113-824a-6350d013baf1'} Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d7180f-82cf-4113-824a-6350d013baf1 could not be found. Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d7180f-82cf-4113-824a-6350d013baf1 could not be found. Oct 24 10:36:00.204350 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:00.208514 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:00.208514 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:00.208514 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:00.208514 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:00.208514 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:00.208514 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:36:00.208514 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:36:00.208514 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d7180f-82cf-4113-824a-6350d013baf1 could not be found. Oct 24 10:36:00.208514 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:00.208514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d448e7f-4f88-4d98-83c0-763ed68298b1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Returning 404 to user: Instance b9d7180f-82cf-4113-824a-6350d013baf1 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:36:00.211341 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0d448e7f-4f88-4d98-83c0-763ed68298b1 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1" status: 404 len: 111 microversion: 2.25 time: 0.096124 Oct 24 10:36:00.216066 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1282/2619] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:36:00 2022] GET /compute/v2.1/servers/b9d7180f-82cf-4113-824a-6350d013baf1 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:36:00.221836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b13a7155-81b3-44a7-b062-d4bd9cd03780 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:00.228667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b13a7155-81b3-44a7-b062-d4bd9cd03780 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:00.243097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b13a7155-81b3-44a7-b062-d4bd9cd03780 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:00.244514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b13a7155-81b3-44a7-b062-d4bd9cd03780 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:00.246079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b13a7155-81b3-44a7-b062-d4bd9cd03780 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:00.246953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b13a7155-81b3-44a7-b062-d4bd9cd03780 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:00.248053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b13a7155-81b3-44a7-b062-d4bd9cd03780 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:00.249944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b13a7155-81b3-44a7-b062-d4bd9cd03780 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:00.299844 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-b13a7155-81b3-44a7-b062-d4bd9cd03780 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 could not be found. Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b13a7155-81b3-44a7-b062-d4bd9cd03780 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 HTTP/1.1 Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 could not be found. Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '04f00dc8-0ba7-47ad-8ed1-28b0643335b1'} Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 could not be found. Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 could not be found. Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:00.309539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:00.315484 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:00.315484 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:00.315484 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:00.315484 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:36:00.315484 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:36:00.315484 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 could not be found. Oct 24 10:36:00.315484 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:00.315484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b13a7155-81b3-44a7-b062-d4bd9cd03780 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:36:00.315484 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b13a7155-81b3-44a7-b062-d4bd9cd03780 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 404 len: 111 microversion: 2.1 time: 0.096212 Oct 24 10:36:00.337849 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1283/2620] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:00 2022] GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:36:00.362335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-912dc785-4257-4b05-972e-f6889babe5ee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:00.363868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-912dc785-4257-4b05-972e-f6889babe5ee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:00.383328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-912dc785-4257-4b05-972e-f6889babe5ee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:00.383829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-912dc785-4257-4b05-972e-f6889babe5ee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:00.388984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-912dc785-4257-4b05-972e-f6889babe5ee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:00.389871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-912dc785-4257-4b05-972e-f6889babe5ee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:00.391181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-912dc785-4257-4b05-972e-f6889babe5ee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:00.391680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-912dc785-4257-4b05-972e-f6889babe5ee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:00.473879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-912dc785-4257-4b05-972e-f6889babe5ee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:36:00.506839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:00.518621 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3e4dcb5f-f1a5-4973-ad05-feefc7e4741d tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.752076 Oct 24 10:36:00.519250 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1338/2621] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:35:59 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:00.523802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a5544cec-7e96-46e2-a5f0-68148a7c1fd3 req-243fb37f-2389-499a-98bc-c621266e4ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa641844-507b-4fa0-ac8e-5ffbefa678bd", "name": "network-vif-deleted", "tag": "021e97e0-485d-4b3c-86bf-0d92baa70132"}, {"server_uuid": "04f00dc8-0ba7-47ad-8ed1-28b0643335b1", "name": "network-vif-deleted", "tag": "eec00c99-eece-4a67-bf29-aa26055bfbfd"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:00.557138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a5544cec-7e96-46e2-a5f0-68148a7c1fd3 req-243fb37f-2389-499a-98bc-c621266e4ae3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:00.557914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a5544cec-7e96-46e2-a5f0-68148a7c1fd3 req-243fb37f-2389-499a-98bc-c621266e4ae3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:00.558560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a5544cec-7e96-46e2-a5f0-68148a7c1fd3 req-243fb37f-2389-499a-98bc-c621266e4ae3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:00.575265 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a5544cec-7e96-46e2-a5f0-68148a7c1fd3 req-243fb37f-2389-499a-98bc-c621266e4ae3 service nova] Creating event network-vif-deleted:021e97e0-485d-4b3c-86bf-0d92baa70132 for instance aa641844-507b-4fa0-ac8e-5ffbefa678bd on n-h1-858383-15 Oct 24 10:36:00.575895 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a5544cec-7e96-46e2-a5f0-68148a7c1fd3 req-243fb37f-2389-499a-98bc-c621266e4ae3 service nova] Creating event network-vif-deleted:eec00c99-eece-4a67-bf29-aa26055bfbfd for instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 on n-h1-858383-15 Oct 24 10:36:00.589607 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a5544cec-7e96-46e2-a5f0-68148a7c1fd3 req-243fb37f-2389-499a-98bc-c621266e4ae3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063550 Oct 24 10:36:00.590415 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1339/2622] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:00.600421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6a27c053-fecf-403c-99db-a1a13aa7b096 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:00.602921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6a27c053-fecf-403c-99db-a1a13aa7b096 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:00.616125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a27c053-fecf-403c-99db-a1a13aa7b096 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:00.616760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a27c053-fecf-403c-99db-a1a13aa7b096 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:00.617364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a27c053-fecf-403c-99db-a1a13aa7b096 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:00.618329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a27c053-fecf-403c-99db-a1a13aa7b096 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:00.618980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a27c053-fecf-403c-99db-a1a13aa7b096 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:00.619692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6a27c053-fecf-403c-99db-a1a13aa7b096 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:00.679193 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-912dc785-4257-4b05-972e-f6889babe5ee tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "DELETE /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 204 len: 0 microversion: 2.25 time: 0.339824 Oct 24 10:36:00.680269 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1284/2623] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:36:00 2022] DELETE /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:36:00.690390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cb365dc6-306e-4953-a95d-d25f82e99d92 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Action: 'create', calling method: .version_select at 0x7f04d50381f0>, body: {"security_group_rule": {"parent_group_id": "38d441a4-45ed-460e-85f3-d90770bcaca6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:01.014764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6a27c053-fecf-403c-99db-a1a13aa7b096 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:01.023797 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6a27c053-fecf-403c-99db-a1a13aa7b096 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1472 microversion: 2.1 time: 0.431763 Oct 24 10:36:01.033213 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1340/2624] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:00 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1472 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:01.038296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7eb212b3-bcb9-4553-aa4b-053475d782fc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1606035427", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "7e246fd4-526c-4b90-abc8-eb217581a916"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:01.173350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-7eb212b3-bcb9-4553-aa4b-053475d782fc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] validate_networks() for [('7e246fd4-526c-4b90-abc8-eb217581a916', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:36:01.883891 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cb365dc6-306e-4953-a95d-d25f82e99d92 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.202083 Oct 24 10:36:01.884814 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1285/2625] 10.222.0.50 () {60 vars in 1195 bytes} [Mon Oct 24 10:36:00 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:01.889579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a121aad9-f847-492c-8b1e-52e095a06859 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:01.890948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a121aad9-f847-492c-8b1e-52e095a06859 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:01.900895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a121aad9-f847-492c-8b1e-52e095a06859 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:01.901620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a121aad9-f847-492c-8b1e-52e095a06859 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:01.902319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a121aad9-f847-492c-8b1e-52e095a06859 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:01.903269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a121aad9-f847-492c-8b1e-52e095a06859 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:01.903938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a121aad9-f847-492c-8b1e-52e095a06859 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:01.904568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a121aad9-f847-492c-8b1e-52e095a06859 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:02.357922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a121aad9-f847-492c-8b1e-52e095a06859 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:02.370767 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a121aad9-f847-492c-8b1e-52e095a06859 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1314 microversion: 2.1 time: 0.484030 Oct 24 10:36:02.386709 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1286/2626] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:01 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:02.397664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b941e4aa-10e8-40bf-bcbe-e1199603895f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:02.398579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b941e4aa-10e8-40bf-bcbe-e1199603895f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:02.408550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b941e4aa-10e8-40bf-bcbe-e1199603895f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:02.409320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b941e4aa-10e8-40bf-bcbe-e1199603895f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:02.409958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b941e4aa-10e8-40bf-bcbe-e1199603895f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:02.410838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b941e4aa-10e8-40bf-bcbe-e1199603895f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:02.411453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b941e4aa-10e8-40bf-bcbe-e1199603895f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:02.412136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b941e4aa-10e8-40bf-bcbe-e1199603895f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:02.679958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7eb212b3-bcb9-4553-aa4b-053475d782fc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:36:02.680492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7eb212b3-bcb9-4553-aa4b-053475d782fc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:36:02.681088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7eb212b3-bcb9-4553-aa4b-053475d782fc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:36:02.681600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7eb212b3-bcb9-4553-aa4b-053475d782fc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:36:02.682112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7eb212b3-bcb9-4553-aa4b-053475d782fc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:36:02.700580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b941e4aa-10e8-40bf-bcbe-e1199603895f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:02.709315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7eb212b3-bcb9-4553-aa4b-053475d782fc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:02.713301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7eb212b3-bcb9-4553-aa4b-053475d782fc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:02.714035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7eb212b3-bcb9-4553-aa4b-053475d782fc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:02.714274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b941e4aa-10e8-40bf-bcbe-e1199603895f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:02.715243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7eb212b3-bcb9-4553-aa4b-053475d782fc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:02.716752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b941e4aa-10e8-40bf-bcbe-e1199603895f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:02.717343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7eb212b3-bcb9-4553-aa4b-053475d782fc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:02.718853 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b941e4aa-10e8-40bf-bcbe-e1199603895f tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 200 len: 1563 microversion: 2.25 time: 0.330708 Oct 24 10:36:02.719490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7eb212b3-bcb9-4553-aa4b-053475d782fc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:02.741931 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1287/2627] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:36:02 2022] GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 1563 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:36:02.746967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-81a3da6b-33ec-41e3-900e-e98b9933f3a9 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:02.747805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-81a3da6b-33ec-41e3-900e-e98b9933f3a9 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:02.747941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-7eb212b3-bcb9-4553-aa4b-053475d782fc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Getting quotas for project eb78fe6939ec43d99fe6b1ba24a68287. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:36:02.754558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-7eb212b3-bcb9-4553-aa4b-053475d782fc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Getting quotas for user 2a7e183a1d4240f28566a318b7e70dee and project eb78fe6939ec43d99fe6b1ba24a68287. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:36:02.765128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81a3da6b-33ec-41e3-900e-e98b9933f3a9 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:02.765900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81a3da6b-33ec-41e3-900e-e98b9933f3a9 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:02.766511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81a3da6b-33ec-41e3-900e-e98b9933f3a9 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:02.767227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81a3da6b-33ec-41e3-900e-e98b9933f3a9 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:02.769332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81a3da6b-33ec-41e3-900e-e98b9933f3a9 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:02.770137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81a3da6b-33ec-41e3-900e-e98b9933f3a9 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:02.783104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7eb212b3-bcb9-4553-aa4b-053475d782fc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:36:02.785865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7eb212b3-bcb9-4553-aa4b-053475d782fc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:36:02.796614 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-81a3da6b-33ec-41e3-900e-e98b9933f3a9 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] HTTP exception thrown: Instance aa641844-507b-4fa0-ac8e-5ffbefa678bd could not be found. Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-81a3da6b-33ec-41e3-900e-e98b9933f3a9 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Request method failure captured: Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd HTTP/1.1 Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmoaXPClcPLJ9gE_6C5GjDQZGdene0OObxZB0Z9ED_DBUfNEOv3AFVz9Sj51DSTvjG5d4L4G0Y7Y2LCJ3yblYYRp_EY66mnirefPs52lqIDsBuo9XJUGZQDidaxp2-3kvGCo_yrNtYTWeu7uqgvMarg1Wuv91gUnqbIjaBzXZEG6tDA Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/60b1c666c4914debad43704393d651cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_60b1c666c4914debad43704393d651cf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6aeb81e9b2fa4796813c607234174af6 Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance aa641844-507b-4fa0-ac8e-5ffbefa678bd could not be found. Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'aa641844-507b-4fa0-ac8e-5ffbefa678bd'} Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa641844-507b-4fa0-ac8e-5ffbefa678bd could not be found. Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa641844-507b-4fa0-ac8e-5ffbefa678bd could not be found. Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:02.798944 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:02.803183 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:02.803183 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:02.803183 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:02.803183 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:36:02.803183 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:36:02.803183 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa641844-507b-4fa0-ac8e-5ffbefa678bd could not be found. Oct 24 10:36:02.803183 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:02.804776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-81a3da6b-33ec-41e3-900e-e98b9933f3a9 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Returning 404 to user: Instance aa641844-507b-4fa0-ac8e-5ffbefa678bd could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:36:02.806370 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-81a3da6b-33ec-41e3-900e-e98b9933f3a9 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 404 len: 111 microversion: 2.1 time: 0.063004 Oct 24 10:36:02.807429 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1288/2628] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:02 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:36:02.813719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7b018e0c-6dd5-468b-94e2-4b53f6fd9df4 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Action: 'create', calling method: .version_select at 0x7f04d0aa3040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1601261272", "description": "tempest-description-1123178821"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:02.878566 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7eb212b3-bcb9-4553-aa4b-053475d782fc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.838563 Oct 24 10:36:02.879746 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1341/2629] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:36:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:36:02.888082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cdc9a22d-3b29-4535-8c49-b85fcc60e7e2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:02.897348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cdc9a22d-3b29-4535-8c49-b85fcc60e7e2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:02.931065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cdc9a22d-3b29-4535-8c49-b85fcc60e7e2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:02.931726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cdc9a22d-3b29-4535-8c49-b85fcc60e7e2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:02.932268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cdc9a22d-3b29-4535-8c49-b85fcc60e7e2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:02.933129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cdc9a22d-3b29-4535-8c49-b85fcc60e7e2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:02.933687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cdc9a22d-3b29-4535-8c49-b85fcc60e7e2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:02.934213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cdc9a22d-3b29-4535-8c49-b85fcc60e7e2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:03.116486 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7b018e0c-6dd5-468b-94e2-4b53f6fd9df4 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.307713 Oct 24 10:36:03.124911 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1289/2630] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:36:02 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:03.127330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-cbd7bed3-8810-4752-b4e8-a4b0c2dc230f req-1fe9a6a2-2587-4ea7-8a57-e6a3bff4c6fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eac13fe-2828-4885-b82d-af682e20a40c", "tag": "428c6441-9cf1-49b0-9ba0-9f7d5db1dc14"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:03.142623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cbd7bed3-8810-4752-b4e8-a4b0c2dc230f req-1fe9a6a2-2587-4ea7-8a57-e6a3bff4c6fe service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:03.143350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cbd7bed3-8810-4752-b4e8-a4b0c2dc230f req-1fe9a6a2-2587-4ea7-8a57-e6a3bff4c6fe service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:03.144040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cbd7bed3-8810-4752-b4e8-a4b0c2dc230f req-1fe9a6a2-2587-4ea7-8a57-e6a3bff4c6fe service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:03.159159 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-cbd7bed3-8810-4752-b4e8-a4b0c2dc230f req-1fe9a6a2-2587-4ea7-8a57-e6a3bff4c6fe service nova] Creating event network-changed:428c6441-9cf1-49b0-9ba0-9f7d5db1dc14 for instance 8eac13fe-2828-4885-b82d-af682e20a40c on n-h1-858383-15 Oct 24 10:36:03.165501 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-cbd7bed3-8810-4752-b4e8-a4b0c2dc230f req-1fe9a6a2-2587-4ea7-8a57-e6a3bff4c6fe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046268 Oct 24 10:36:03.166393 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1290/2631] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:03.173237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-403e4a46-2f6f-45b9-b550-cbf79fa7d76d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d0aa3af0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:03.264971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cdc9a22d-3b29-4535-8c49-b85fcc60e7e2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:03.277028 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cdc9a22d-3b29-4535-8c49-b85fcc60e7e2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1472 microversion: 2.1 time: 0.395664 Oct 24 10:36:03.277618 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1342/2632] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:02 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1472 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:03.282959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-89f2dd15-5943-4181-9d90-67e437056508 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:03.287264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-89f2dd15-5943-4181-9d90-67e437056508 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:03.405243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-89f2dd15-5943-4181-9d90-67e437056508 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:03.415728 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-89f2dd15-5943-4181-9d90-67e437056508 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1215 microversion: 2.1 time: 0.135084 Oct 24 10:36:03.434053 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1343/2633] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:03 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1215 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:03.434053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-66285186-2a64-4d33-9ff9-51a4a1d430a2 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Action: 'create', calling method: .version_select at 0x7f04d4e93820>, body: {"security_group_rule": {"parent_group_id": "3d351b5a-8c29-428a-8e50-d97a03618137", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:03.701952 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-403e4a46-2f6f-45b9-b550-cbf79fa7d76d tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/d70454a8-4e2e-4065-9816-0d5866e457b5" status: 202 len: 0 microversion: 2.1 time: 0.533906 Oct 24 10:36:03.704808 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1291/2634] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:03 2022] DELETE /compute/v2.1/os-security-groups/d70454a8-4e2e-4065-9816-0d5866e457b5 => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:36:03.710982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-619dbcdd-dc07-4f06-bec3-3e6d52c6c6a8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:03.713101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-619dbcdd-dc07-4f06-bec3-3e6d52c6c6a8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:03.730119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-619dbcdd-dc07-4f06-bec3-3e6d52c6c6a8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:03.733203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-619dbcdd-dc07-4f06-bec3-3e6d52c6c6a8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:03.736351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-619dbcdd-dc07-4f06-bec3-3e6d52c6c6a8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:03.739852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-619dbcdd-dc07-4f06-bec3-3e6d52c6c6a8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:03.743407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-619dbcdd-dc07-4f06-bec3-3e6d52c6c6a8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:03.745250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-619dbcdd-dc07-4f06-bec3-3e6d52c6c6a8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:03.994901 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-66285186-2a64-4d33-9ff9-51a4a1d430a2 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.575889 Oct 24 10:36:03.995973 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1344/2635] 10.222.0.50 () {60 vars in 1195 bytes} [Mon Oct 24 10:36:03 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:04.008486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-be60c596-b565-4813-a2e8-69ea1d0affcb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d4eb9820>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:04.044000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-619dbcdd-dc07-4f06-bec3-3e6d52c6c6a8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:04.057556 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-619dbcdd-dc07-4f06-bec3-3e6d52c6c6a8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1314 microversion: 2.1 time: 0.351220 Oct 24 10:36:04.060637 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1292/2636] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:03 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:04.068004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3235d3f4-b2eb-4379-bf17-11d991ac9795 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:04.069298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3235d3f4-b2eb-4379-bf17-11d991ac9795 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:04.081173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3235d3f4-b2eb-4379-bf17-11d991ac9795 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:04.082760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3235d3f4-b2eb-4379-bf17-11d991ac9795 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:04.083639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3235d3f4-b2eb-4379-bf17-11d991ac9795 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:04.085078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3235d3f4-b2eb-4379-bf17-11d991ac9795 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:04.085952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3235d3f4-b2eb-4379-bf17-11d991ac9795 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:04.087070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3235d3f4-b2eb-4379-bf17-11d991ac9795 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:04.205970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3235d3f4-b2eb-4379-bf17-11d991ac9795 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:04.218562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3235d3f4-b2eb-4379-bf17-11d991ac9795 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:04.220901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3235d3f4-b2eb-4379-bf17-11d991ac9795 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ca4f9e7ffb447ebf740c52f6a098c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2d317e42584b41b11c1668de6657bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:04.223202 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3235d3f4-b2eb-4379-bf17-11d991ac9795 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 200 len: 1521 microversion: 2.25 time: 0.160612 Oct 24 10:36:04.224151 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1293/2637] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:36:04 2022] GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:36:04.231240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9741d336-d564-45b5-adba-905ac9081080 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Action: 'create', calling method: .version_select at 0x7f04d0bb3e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-992753487", "description": "tempest-description-811201408"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:04.403152 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-be60c596-b565-4813-a2e8-69ea1d0affcb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/196a9850-7be7-40d1-94ba-e6c42b71f7f2" status: 202 len: 0 microversion: 2.1 time: 0.405882 Oct 24 10:36:04.411838 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1345/2638] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:03 2022] DELETE /compute/v2.1/os-security-groups/196a9850-7be7-40d1-94ba-e6c42b71f7f2 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:36:04.417549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0978b37d-3053-4266-83a4-b4afb8a7be73 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:04.418432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0978b37d-3053-4266-83a4-b4afb8a7be73 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:04.431262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0978b37d-3053-4266-83a4-b4afb8a7be73 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:04.432567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0978b37d-3053-4266-83a4-b4afb8a7be73 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:04.433205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0978b37d-3053-4266-83a4-b4afb8a7be73 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:04.434076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0978b37d-3053-4266-83a4-b4afb8a7be73 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:04.434701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0978b37d-3053-4266-83a4-b4afb8a7be73 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:04.435658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0978b37d-3053-4266-83a4-b4afb8a7be73 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:04.563016 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9741d336-d564-45b5-adba-905ac9081080 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.334362 Oct 24 10:36:04.574841 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1294/2639] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:36:04 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:04.580615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e437985f-5be3-4b24-bb63-1593dee09cf6 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Action: 'create', calling method: .version_select at 0x7f04d5038940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-476298342", "description": "tempest-description-2034930342"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:04.678693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0978b37d-3053-4266-83a4-b4afb8a7be73 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:04.689270 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0978b37d-3053-4266-83a4-b4afb8a7be73 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1472 microversion: 2.1 time: 0.275434 Oct 24 10:36:04.690076 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1346/2640] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:04 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1472 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:04.695117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6b09a5fb-0a9d-4a1d-a17e-e70f6793178d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:04.695723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6b09a5fb-0a9d-4a1d-a17e-e70f6793178d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:04.702848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b09a5fb-0a9d-4a1d-a17e-e70f6793178d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:04.703264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b09a5fb-0a9d-4a1d-a17e-e70f6793178d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:04.703883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b09a5fb-0a9d-4a1d-a17e-e70f6793178d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:04.704714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b09a5fb-0a9d-4a1d-a17e-e70f6793178d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:04.707042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b09a5fb-0a9d-4a1d-a17e-e70f6793178d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:04.707479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b09a5fb-0a9d-4a1d-a17e-e70f6793178d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:04.803749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6b09a5fb-0a9d-4a1d-a17e-e70f6793178d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:04.813073 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6b09a5fb-0a9d-4a1d-a17e-e70f6793178d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1267 microversion: 2.1 time: 0.121661 Oct 24 10:36:04.813674 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1347/2641] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:04 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1267 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:04.870487 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e437985f-5be3-4b24-bb63-1593dee09cf6 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.294469 Oct 24 10:36:04.871361 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1295/2642] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:36:04 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:04.877266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ac49c4b6-4bfb-4898-9994-541833df1500 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Action: 'create', calling method: .version_select at 0x7f04d0b335e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1850977934", "description": "tempest-description-1356450546"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:05.016985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ddaec54f-1e3f-4b50-92e8-374c0c7910ff tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-288518962", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:05.079888 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ac49c4b6-4bfb-4898-9994-541833df1500 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.207182 Oct 24 10:36:05.081588 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1296/2643] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:36:04 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:05.098597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bbc417a9-a015-4248-b166-eaf213697bc8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Action: 'update', calling method: .version_select at 0x7f04d4fe0d30>, body: {"security_group": {"name": "tempest-sg-hth-1541883373", "description": "tempest-description-hth-1394578663"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:05.105281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-ddaec54f-1e3f-4b50-92e8-374c0c7910ff tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:36:05.398803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ddaec54f-1e3f-4b50-92e8-374c0c7910ff tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:36:05.399658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ddaec54f-1e3f-4b50-92e8-374c0c7910ff tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:36:05.400321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ddaec54f-1e3f-4b50-92e8-374c0c7910ff tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:36:05.401036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ddaec54f-1e3f-4b50-92e8-374c0c7910ff tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:36:05.401726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ddaec54f-1e3f-4b50-92e8-374c0c7910ff tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:36:05.412685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaec54f-1e3f-4b50-92e8-374c0c7910ff tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:05.413541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaec54f-1e3f-4b50-92e8-374c0c7910ff tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:05.414136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaec54f-1e3f-4b50-92e8-374c0c7910ff tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:05.415157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaec54f-1e3f-4b50-92e8-374c0c7910ff tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:05.415798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaec54f-1e3f-4b50-92e8-374c0c7910ff tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:05.416203 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bbc417a9-a015-4248-b166-eaf213697bc8 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "PUT /compute/v2.1/os-security-groups/72eaecce-f2d7-425c-9251-85266027ecee" status: 200 len: 218 microversion: 2.1 time: 0.322800 Oct 24 10:36:05.417075 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1297/2644] 10.222.0.50 () {60 vars in 1290 bytes} [Mon Oct 24 10:36:05 2022] PUT /compute/v2.1/os-security-groups/72eaecce-f2d7-425c-9251-85266027ecee => generated 218 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:05.423345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a1eba71b-4a91-4f0d-a7c3-fffe320a6771 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:05.424242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a1eba71b-4a91-4f0d-a7c3-fffe320a6771 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:05.426526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaec54f-1e3f-4b50-92e8-374c0c7910ff tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:05.432455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1eba71b-4a91-4f0d-a7c3-fffe320a6771 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:05.433180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1eba71b-4a91-4f0d-a7c3-fffe320a6771 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:05.433926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1eba71b-4a91-4f0d-a7c3-fffe320a6771 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:05.435482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1eba71b-4a91-4f0d-a7c3-fffe320a6771 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:05.436145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1eba71b-4a91-4f0d-a7c3-fffe320a6771 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:05.438616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1eba71b-4a91-4f0d-a7c3-fffe320a6771 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:05.447132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-ddaec54f-1e3f-4b50-92e8-374c0c7910ff tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Getting quotas for project 96c125be93d647e1b2c0fdd4ae2efb14. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:36:05.452453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-ddaec54f-1e3f-4b50-92e8-374c0c7910ff tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Getting quotas for user ed9fe821ad1b43f2988dd30521c6c335 and project 96c125be93d647e1b2c0fdd4ae2efb14. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:36:05.466123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ddaec54f-1e3f-4b50-92e8-374c0c7910ff tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:36:05.476372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ddaec54f-1e3f-4b50-92e8-374c0c7910ff tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:36:05.530640 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ddaec54f-1e3f-4b50-92e8-374c0c7910ff tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715617 Oct 24 10:36:05.531884 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1348/2645] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:36:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:36:05.542570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d30387ed-f88e-43ea-aeb1-1f6b2004370a tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Action: 'create', calling method: .version_select at 0x7f04d4ea4d30>, body: {"security_group_rule": {"parent_group_id": "9c04cac8-91e3-400f-9e13-8db5d62e8a8b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "38683dea-2883-409a-bc55-eb08098f0599"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:05.633775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a1eba71b-4a91-4f0d-a7c3-fffe320a6771 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:05.645106 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a1eba71b-4a91-4f0d-a7c3-fffe320a6771 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1314 microversion: 2.1 time: 0.226735 Oct 24 10:36:05.645825 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1298/2646] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:05 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:05.650373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-9b210163-e61e-4768-ab0d-728e13b921f0 req-bfbc3e4b-a759-4efa-a471-15df691ed3bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c264bc-70a7-4b1b-a29a-d5bbb2884809", "name": "network-vif-deleted", "tag": "8db04e7c-b441-4bfb-89ad-0f6839db6290"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:05.668020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9b210163-e61e-4768-ab0d-728e13b921f0 req-bfbc3e4b-a759-4efa-a471-15df691ed3bc service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:05.668507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9b210163-e61e-4768-ab0d-728e13b921f0 req-bfbc3e4b-a759-4efa-a471-15df691ed3bc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:05.668965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9b210163-e61e-4768-ab0d-728e13b921f0 req-bfbc3e4b-a759-4efa-a471-15df691ed3bc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:05.682617 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-9b210163-e61e-4768-ab0d-728e13b921f0 req-bfbc3e4b-a759-4efa-a471-15df691ed3bc service nova] Creating event network-vif-deleted:8db04e7c-b441-4bfb-89ad-0f6839db6290 for instance 77c264bc-70a7-4b1b-a29a-d5bbb2884809 on n-h2-858383-15 Oct 24 10:36:05.689724 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-9b210163-e61e-4768-ab0d-728e13b921f0 req-bfbc3e4b-a759-4efa-a471-15df691ed3bc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042419 Oct 24 10:36:05.690850 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1299/2647] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:05.696982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7d5c4fab-149f-456b-a9c2-fef26d2cfa98 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:05.697855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7d5c4fab-149f-456b-a9c2-fef26d2cfa98 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] [instance: 77c264bc-70a7-4b1b-a29a-d5bbb2884809] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:05.705211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d5c4fab-149f-456b-a9c2-fef26d2cfa98 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:05.705700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d5c4fab-149f-456b-a9c2-fef26d2cfa98 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:05.706134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d5c4fab-149f-456b-a9c2-fef26d2cfa98 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:05.706840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d5c4fab-149f-456b-a9c2-fef26d2cfa98 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:05.707290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d5c4fab-149f-456b-a9c2-fef26d2cfa98 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:05.707831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d5c4fab-149f-456b-a9c2-fef26d2cfa98 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:05.727875 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-7d5c4fab-149f-456b-a9c2-fef26d2cfa98 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] HTTP exception thrown: Instance 77c264bc-70a7-4b1b-a29a-d5bbb2884809 could not be found. Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7d5c4fab-149f-456b-a9c2-fef26d2cfa98 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Request method failure captured: Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 HTTP/1.1 Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmiEGXqHM3GeBkwvgAIOGM9egi_ztJyROimdJrwIo08X6fBi6u4wFuEkksoFlS93QOqTqAn69QbiMQ5NiDEb7Rz_BZB9z_UfFecYCL-E41_qJpcIPKDzl-JGkZOjXaFAa1d_PpJ--8R7XNWf0dlQjU6o5hFX-BCN3hfIaVN8qGrScWA Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.25 Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9f2d317e42584b41b11c1668de6657bd Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-726845486 Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9f2d317e42584b41b11c1668de6657bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9f2d317e42584b41b11c1668de6657bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9f2d317e42584b41b11c1668de6657bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9f2d317e42584b41b11c1668de6657bd", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-726845486 Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9f2d317e42584b41b11c1668de6657bd Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-726845486 Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-LiveAutoBlockMigrationV225Test-726845486-project Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 66ca4f9e7ffb447ebf740c52f6a098c2 Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-726845486-project Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 77c264bc-70a7-4b1b-a29a-d5bbb2884809 could not be found. Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '77c264bc-70a7-4b1b-a29a-d5bbb2884809'} Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c264bc-70a7-4b1b-a29a-d5bbb2884809 could not be found. Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c264bc-70a7-4b1b-a29a-d5bbb2884809 could not be found. Oct 24 10:36:05.729935 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:05.735964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:05.735964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:05.735964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:05.735964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:05.735964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:05.735964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:36:05.735964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:36:05.735964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c264bc-70a7-4b1b-a29a-d5bbb2884809 could not be found. Oct 24 10:36:05.735964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:05.735964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7d5c4fab-149f-456b-a9c2-fef26d2cfa98 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] Returning 404 to user: Instance 77c264bc-70a7-4b1b-a29a-d5bbb2884809 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:36:05.735964 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7d5c4fab-149f-456b-a9c2-fef26d2cfa98 tempest-LiveAutoBlockMigrationV225Test-726845486 tempest-LiveAutoBlockMigrationV225Test-726845486-project] 10.222.0.50 "GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809" status: 404 len: 111 microversion: 2.25 time: 0.041438 Oct 24 10:36:05.738860 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1300/2648] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:36:05 2022] GET /compute/v2.1/servers/77c264bc-70a7-4b1b-a29a-d5bbb2884809 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:36:05.745429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-93df15e9-6766-49a8-a460-1817e140222f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d0bb3af0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:05.824046 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-93df15e9-6766-49a8-a460-1817e140222f tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/72eaecce-f2d7-425c-9251-85266027ecee" status: 200 len: 218 microversion: 2.1 time: 0.083702 Oct 24 10:36:05.824724 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1301/2649] 10.222.0.50 () {58 vars in 1269 bytes} [Mon Oct 24 10:36:05 2022] GET /compute/v2.1/os-security-groups/72eaecce-f2d7-425c-9251-85266027ecee => generated 218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:05.829997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-89d4f222-0fa9-4e2e-b0df-5f58ec1067f1 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:05.831082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-89d4f222-0fa9-4e2e-b0df-5f58ec1067f1 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:05.947964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-89d4f222-0fa9-4e2e-b0df-5f58ec1067f1 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9fe821ad1b43f2988dd30521c6c335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c125be93d647e1b2c0fdd4ae2efb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:05.962588 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-89d4f222-0fa9-4e2e-b0df-5f58ec1067f1 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 200 len: 1216 microversion: 2.1 time: 0.136389 Oct 24 10:36:05.966542 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1302/2650] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:05 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 1216 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:05.975990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b64ae8f9-de5a-4f28-b864-97ca7adee5fd tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:05.978945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b64ae8f9-de5a-4f28-b864-97ca7adee5fd tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:05.986656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b64ae8f9-de5a-4f28-b864-97ca7adee5fd tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:05.988134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b64ae8f9-de5a-4f28-b864-97ca7adee5fd tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:05.989146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b64ae8f9-de5a-4f28-b864-97ca7adee5fd tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:05.990244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b64ae8f9-de5a-4f28-b864-97ca7adee5fd tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:05.991439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b64ae8f9-de5a-4f28-b864-97ca7adee5fd tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:05.994407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b64ae8f9-de5a-4f28-b864-97ca7adee5fd tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:06.053410 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d30387ed-f88e-43ea-aeb1-1f6b2004370a tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.520080 Oct 24 10:36:06.063031 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1349/2651] 10.222.0.50 () {60 vars in 1195 bytes} [Mon Oct 24 10:36:05 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:06.063031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3fd9838f-d22d-4827-a7de-0a6d7f6a3aeb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d4e1ad30>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:06.334568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b64ae8f9-de5a-4f28-b864-97ca7adee5fd tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:06.343074 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b64ae8f9-de5a-4f28-b864-97ca7adee5fd tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1472 microversion: 2.1 time: 0.374243 Oct 24 10:36:06.343666 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1303/2652] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:05 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1472 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:06.348400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00bffa34-341a-47e1-8316-390aa2c5187c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:06.349061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00bffa34-341a-47e1-8316-390aa2c5187c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:06.355757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00bffa34-341a-47e1-8316-390aa2c5187c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:06.356446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00bffa34-341a-47e1-8316-390aa2c5187c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:06.357166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00bffa34-341a-47e1-8316-390aa2c5187c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:06.358051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00bffa34-341a-47e1-8316-390aa2c5187c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:06.359245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00bffa34-341a-47e1-8316-390aa2c5187c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:06.359825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00bffa34-341a-47e1-8316-390aa2c5187c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:06.487109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-00bffa34-341a-47e1-8316-390aa2c5187c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:06.502521 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-00bffa34-341a-47e1-8316-390aa2c5187c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1267 microversion: 2.1 time: 0.154496 Oct 24 10:36:06.503998 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1304/2653] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:06 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:06.509014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5644c5a1-836b-40f7-8d49-cb16e64229a7 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Action: 'create', calling method: .version_select at 0x7f04d4fe0ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-308863314", "description": "tempest-description-1214072189"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:06.711950 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3fd9838f-d22d-4827-a7de-0a6d7f6a3aeb tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/72eaecce-f2d7-425c-9251-85266027ecee" status: 202 len: 0 microversion: 2.1 time: 0.656000 Oct 24 10:36:06.715577 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1350/2654] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:06 2022] DELETE /compute/v2.1/os-security-groups/72eaecce-f2d7-425c-9251-85266027ecee => generated 0 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:36:06.717616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7bd054b1-817f-4c14-ba03-e8d06f958ba1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:06.718546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7bd054b1-817f-4c14-ba03-e8d06f958ba1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:06.736618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7bd054b1-817f-4c14-ba03-e8d06f958ba1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:06.737069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7bd054b1-817f-4c14-ba03-e8d06f958ba1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:06.737504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7bd054b1-817f-4c14-ba03-e8d06f958ba1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:06.738206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7bd054b1-817f-4c14-ba03-e8d06f958ba1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:06.738653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7bd054b1-817f-4c14-ba03-e8d06f958ba1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:06.739085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7bd054b1-817f-4c14-ba03-e8d06f958ba1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:07.060262 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5644c5a1-836b-40f7-8d49-cb16e64229a7 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.555089 Oct 24 10:36:07.061081 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1305/2655] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:36:06 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:07.067144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a4af76e2-f935-4e19-bd17-4a0a7984fc69 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:07.068207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a4af76e2-f935-4e19-bd17-4a0a7984fc69 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:07.075198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4af76e2-f935-4e19-bd17-4a0a7984fc69 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:07.075976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4af76e2-f935-4e19-bd17-4a0a7984fc69 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:07.076418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4af76e2-f935-4e19-bd17-4a0a7984fc69 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:07.077903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4af76e2-f935-4e19-bd17-4a0a7984fc69 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:07.078839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4af76e2-f935-4e19-bd17-4a0a7984fc69 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:07.080030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4af76e2-f935-4e19-bd17-4a0a7984fc69 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:07.106182 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-a4af76e2-f935-4e19-bd17-4a0a7984fc69 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] HTTP exception thrown: Instance aa641844-507b-4fa0-ac8e-5ffbefa678bd could not be found. Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a4af76e2-f935-4e19-bd17-4a0a7984fc69 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Request method failure captured: Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd HTTP/1.1 Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmoaXPClcPLJ9gE_6C5GjDQZGdene0OObxZB0Z9ED_DBUfNEOv3AFVz9Sj51DSTvjG5d4L4G0Y7Y2LCJ3yblYYRp_EY66mnirefPs52lqIDsBuo9XJUGZQDidaxp2-3kvGCo_yrNtYTWeu7uqgvMarg1Wuv91gUnqbIjaBzXZEG6tDA Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/60b1c666c4914debad43704393d651cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_60b1c666c4914debad43704393d651cf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6aeb81e9b2fa4796813c607234174af6 Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance aa641844-507b-4fa0-ac8e-5ffbefa678bd could not be found. Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'aa641844-507b-4fa0-ac8e-5ffbefa678bd'} Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa641844-507b-4fa0-ac8e-5ffbefa678bd could not be found. Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:36:07.107825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:36:07.111829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa641844-507b-4fa0-ac8e-5ffbefa678bd could not be found. Oct 24 10:36:07.111829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:07.111829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:07.111829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:07.111829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:07.111829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:07.111829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:07.111829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:36:07.111829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:36:07.111829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa641844-507b-4fa0-ac8e-5ffbefa678bd could not be found. Oct 24 10:36:07.111829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:07.114768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a4af76e2-f935-4e19-bd17-4a0a7984fc69 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Returning 404 to user: Instance aa641844-507b-4fa0-ac8e-5ffbefa678bd could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:36:07.115652 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a4af76e2-f935-4e19-bd17-4a0a7984fc69 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 404 len: 111 microversion: 2.1 time: 0.052621 Oct 24 10:36:07.116731 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1306/2656] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:36:07 2022] DELETE /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:36:07.122531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5ab7bf62-3b47-4fbd-9b8a-51de76fdc594 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:07.123475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5ab7bf62-3b47-4fbd-9b8a-51de76fdc594 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:07.132562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ab7bf62-3b47-4fbd-9b8a-51de76fdc594 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:07.133327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ab7bf62-3b47-4fbd-9b8a-51de76fdc594 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:07.134028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ab7bf62-3b47-4fbd-9b8a-51de76fdc594 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:07.134819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ab7bf62-3b47-4fbd-9b8a-51de76fdc594 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:07.135352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ab7bf62-3b47-4fbd-9b8a-51de76fdc594 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:07.136008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ab7bf62-3b47-4fbd-9b8a-51de76fdc594 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:07.241493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7bd054b1-817f-4c14-ba03-e8d06f958ba1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:07.251254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5ab7bf62-3b47-4fbd-9b8a-51de76fdc594 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9fe821ad1b43f2988dd30521c6c335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c125be93d647e1b2c0fdd4ae2efb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:07.253930 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7bd054b1-817f-4c14-ba03-e8d06f958ba1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1314 microversion: 2.1 time: 0.540326 Oct 24 10:36:07.254692 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1351/2657] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:06 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:07.263473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6af37368-a98b-44c9-8ac0-2604fba374be tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Action: 'create', calling method: .version_select at 0x7f04d0df7dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-220070714", "description": "tempest-description-2072660701"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:07.268947 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5ab7bf62-3b47-4fbd-9b8a-51de76fdc594 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 200 len: 1268 microversion: 2.1 time: 0.150283 Oct 24 10:36:07.273767 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1307/2658] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:07 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:07.294543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0f4ac05e-aaff-4268-aa14-184eeb160d50 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:07.295437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0f4ac05e-aaff-4268-aa14-184eeb160d50 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: aa641844-507b-4fa0-ac8e-5ffbefa678bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:07.303714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f4ac05e-aaff-4268-aa14-184eeb160d50 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:07.304288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f4ac05e-aaff-4268-aa14-184eeb160d50 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:07.304810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f4ac05e-aaff-4268-aa14-184eeb160d50 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:07.305650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f4ac05e-aaff-4268-aa14-184eeb160d50 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:07.306178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f4ac05e-aaff-4268-aa14-184eeb160d50 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:07.306778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f4ac05e-aaff-4268-aa14-184eeb160d50 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:07.323523 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-0f4ac05e-aaff-4268-aa14-184eeb160d50 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] HTTP exception thrown: Instance aa641844-507b-4fa0-ac8e-5ffbefa678bd could not be found. Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0f4ac05e-aaff-4268-aa14-184eeb160d50 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Request method failure captured: Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd HTTP/1.1 Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmoaXPClcPLJ9gE_6C5GjDQZGdene0OObxZB0Z9ED_DBUfNEOv3AFVz9Sj51DSTvjG5d4L4G0Y7Y2LCJ3yblYYRp_EY66mnirefPs52lqIDsBuo9XJUGZQDidaxp2-3kvGCo_yrNtYTWeu7uqgvMarg1Wuv91gUnqbIjaBzXZEG6tDA Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/60b1c666c4914debad43704393d651cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_60b1c666c4914debad43704393d651cf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6aeb81e9b2fa4796813c607234174af6 Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance aa641844-507b-4fa0-ac8e-5ffbefa678bd could not be found. Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'aa641844-507b-4fa0-ac8e-5ffbefa678bd'} Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa641844-507b-4fa0-ac8e-5ffbefa678bd could not be found. Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa641844-507b-4fa0-ac8e-5ffbefa678bd could not be found. Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:07.325336 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:07.330427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:07.330427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:07.330427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:07.330427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:36:07.330427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:36:07.330427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa641844-507b-4fa0-ac8e-5ffbefa678bd could not be found. Oct 24 10:36:07.330427 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:07.331686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0f4ac05e-aaff-4268-aa14-184eeb160d50 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Returning 404 to user: Instance aa641844-507b-4fa0-ac8e-5ffbefa678bd could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:36:07.332894 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0f4ac05e-aaff-4268-aa14-184eeb160d50 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd" status: 404 len: 111 microversion: 2.1 time: 0.047257 Oct 24 10:36:07.333624 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1308/2659] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:07 2022] GET /compute/v2.1/servers/aa641844-507b-4fa0-ac8e-5ffbefa678bd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:36:07.341505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fedb24b2-f232-47a3-96cd-81e431078ac6 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d500bee0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:07.417786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG neutronclient.v2_0.client [None req-fedb24b2-f232-47a3-96cd-81e431078ac6 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 196a9850-7be7-40d1-94ba-e6c42b71f7f2 does not exist", "detail": ""}} {{(pid=120425) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:36:07.418772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.security_group_api [None req-fedb24b2-f232-47a3-96cd-81e431078ac6 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Neutron security group 196a9850-7be7-40d1-94ba-e6c42b71f7f2 not found {{(pid=120425) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 10:36:07.419577 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-fedb24b2-f232-47a3-96cd-81e431078ac6 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] HTTP exception thrown: Security group 196a9850-7be7-40d1-94ba-e6c42b71f7f2 does not exist Oct 24 10:36:07.419577 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-f0c90bf9-7a8e-4358-8fae-a698ffe926be'] Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fedb24b2-f232-47a3-96cd-81e431078ac6 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Request method failure captured: Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/os-security-groups/196a9850-7be7-40d1-94ba-e6c42b71f7f2 HTTP/1.1 Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmoaXPClcPLJ9gE_6C5GjDQZGdene0OObxZB0Z9ED_DBUfNEOv3AFVz9Sj51DSTvjG5d4L4G0Y7Y2LCJ3yblYYRp_EY66mnirefPs52lqIDsBuo9XJUGZQDidaxp2-3kvGCo_yrNtYTWeu7uqgvMarg1Wuv91gUnqbIjaBzXZEG6tDA Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/60b1c666c4914debad43704393d651cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_60b1c666c4914debad43704393d651cf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6aeb81e9b2fa4796813c607234174af6 Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: exception: Security group 196a9850-7be7-40d1-94ba-e6c42b71f7f2 does not exist Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-f0c90bf9-7a8e-4358-8fae-a698ffe926be'] Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '196a9850-7be7-40d1-94ba-e6c42b71f7f2'} Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:36:07.422254 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 196a9850-7be7-40d1-94ba-e6c42b71f7f2 does not exist Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0c90bf9-7a8e-4358-8fae-a698ffe926be'] Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 196a9850-7be7-40d1-94ba-e6c42b71f7f2 does not exist Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0c90bf9-7a8e-4358-8fae-a698ffe926be'] Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 196a9850-7be7-40d1-94ba-e6c42b71f7f2 does not exist Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0c90bf9-7a8e-4358-8fae-a698ffe926be'] Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 196a9850-7be7-40d1-94ba-e6c42b71f7f2 does not exist Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0c90bf9-7a8e-4358-8fae-a698ffe926be'] Oct 24 10:36:07.426371 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:07.432897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fedb24b2-f232-47a3-96cd-81e431078ac6 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Returning 404 to user: Security group 196a9850-7be7-40d1-94ba-e6c42b71f7f2 does not exist Oct 24 10:36:07.432897 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-f0c90bf9-7a8e-4358-8fae-a698ffe926be'] {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:36:07.434065 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fedb24b2-f232-47a3-96cd-81e431078ac6 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/196a9850-7be7-40d1-94ba-e6c42b71f7f2" status: 404 len: 194 microversion: 2.1 time: 0.096275 Oct 24 10:36:07.438589 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1309/2660] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:07 2022] DELETE /compute/v2.1/os-security-groups/196a9850-7be7-40d1-94ba-e6c42b71f7f2 => generated 194 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:36:07.444967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d9dacad3-de8f-402f-b0e9-9a5375d57987 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:07.445915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d9dacad3-de8f-402f-b0e9-9a5375d57987 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:07.455792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9dacad3-de8f-402f-b0e9-9a5375d57987 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:07.456608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9dacad3-de8f-402f-b0e9-9a5375d57987 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:07.457349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9dacad3-de8f-402f-b0e9-9a5375d57987 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:07.458289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9dacad3-de8f-402f-b0e9-9a5375d57987 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:07.458925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9dacad3-de8f-402f-b0e9-9a5375d57987 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:07.459544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9dacad3-de8f-402f-b0e9-9a5375d57987 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:08.112282 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6af37368-a98b-44c9-8ac0-2604fba374be tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.855253 Oct 24 10:36:08.112752 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1352/2661] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:36:07 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:08.126337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8ce4ce48-ea48-4bae-b96b-ca2afe925bc0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d4e228b0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:08.141314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d9dacad3-de8f-402f-b0e9-9a5375d57987 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:08.151429 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d9dacad3-de8f-402f-b0e9-9a5375d57987 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1472 microversion: 2.1 time: 0.711103 Oct 24 10:36:08.152624 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1310/2662] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:07 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1472 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:08.168651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e64be74-519a-4ad0-9b6b-e083c3669bce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:08.169716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e64be74-519a-4ad0-9b6b-e083c3669bce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:08.178352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e64be74-519a-4ad0-9b6b-e083c3669bce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:08.179196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e64be74-519a-4ad0-9b6b-e083c3669bce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:08.179736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e64be74-519a-4ad0-9b6b-e083c3669bce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:08.180543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e64be74-519a-4ad0-9b6b-e083c3669bce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:08.181143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e64be74-519a-4ad0-9b6b-e083c3669bce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:08.181712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e64be74-519a-4ad0-9b6b-e083c3669bce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:08.268035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG neutronclient.v2_0.client [None req-8ce4ce48-ea48-4bae-b96b-ca2afe925bc0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d70454a8-4e2e-4065-9816-0d5866e457b5 does not exist", "detail": ""}} {{(pid=120426) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:36:08.269089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.security_group_api [None req-8ce4ce48-ea48-4bae-b96b-ca2afe925bc0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Neutron security group d70454a8-4e2e-4065-9816-0d5866e457b5 not found {{(pid=120426) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 10:36:08.269731 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-8ce4ce48-ea48-4bae-b96b-ca2afe925bc0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] HTTP exception thrown: Security group d70454a8-4e2e-4065-9816-0d5866e457b5 does not exist Oct 24 10:36:08.269731 n-d-858383-15 devstack@n-api.service[120426]: Neutron server returns request_ids: ['req-3dd55c8f-aacf-4125-a6e2-38705284845b'] Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8ce4ce48-ea48-4bae-b96b-ca2afe925bc0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Request method failure captured: Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/os-security-groups/d70454a8-4e2e-4065-9816-0d5866e457b5 HTTP/1.1 Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmoaXPClcPLJ9gE_6C5GjDQZGdene0OObxZB0Z9ED_DBUfNEOv3AFVz9Sj51DSTvjG5d4L4G0Y7Y2LCJ3yblYYRp_EY66mnirefPs52lqIDsBuo9XJUGZQDidaxp2-3kvGCo_yrNtYTWeu7uqgvMarg1Wuv91gUnqbIjaBzXZEG6tDA Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/60b1c666c4914debad43704393d651cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_60b1c666c4914debad43704393d651cf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 6aeb81e9b2fa4796813c607234174af6 Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: exception: Security group d70454a8-4e2e-4065-9816-0d5866e457b5 does not exist Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: Neutron server returns request_ids: ['req-3dd55c8f-aacf-4125-a6e2-38705284845b'] Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'd70454a8-4e2e-4065-9816-0d5866e457b5'} Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:36:08.273955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d70454a8-4e2e-4065-9816-0d5866e457b5 does not exist Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3dd55c8f-aacf-4125-a6e2-38705284845b'] Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d70454a8-4e2e-4065-9816-0d5866e457b5 does not exist Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3dd55c8f-aacf-4125-a6e2-38705284845b'] Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d70454a8-4e2e-4065-9816-0d5866e457b5 does not exist Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3dd55c8f-aacf-4125-a6e2-38705284845b'] Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d70454a8-4e2e-4065-9816-0d5866e457b5 does not exist Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3dd55c8f-aacf-4125-a6e2-38705284845b'] Oct 24 10:36:08.278564 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:08.286256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8ce4ce48-ea48-4bae-b96b-ca2afe925bc0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Returning 404 to user: Security group d70454a8-4e2e-4065-9816-0d5866e457b5 does not exist Oct 24 10:36:08.286256 n-d-858383-15 devstack@n-api.service[120426]: Neutron server returns request_ids: ['req-3dd55c8f-aacf-4125-a6e2-38705284845b'] {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:36:08.287341 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8ce4ce48-ea48-4bae-b96b-ca2afe925bc0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/d70454a8-4e2e-4065-9816-0d5866e457b5" status: 404 len: 194 microversion: 2.1 time: 0.173208 Oct 24 10:36:08.289401 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1353/2663] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:08 2022] DELETE /compute/v2.1/os-security-groups/d70454a8-4e2e-4065-9816-0d5866e457b5 => generated 194 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:36:08.301971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4b28b434-e33f-4014-8dd7-0ed2f1d4852c tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Action: 'create', calling method: .version_select at 0x7f04d4e93820>, body: {"security_group_rule": {"parent_group_id": "3a2696e9-bcef-4926-8e45-45d1ce108fb4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "6cd9c041-3b5f-4962-9276-836388d3389f"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:08.304448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1e64be74-519a-4ad0-9b6b-e083c3669bce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:08.323872 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1e64be74-519a-4ad0-9b6b-e083c3669bce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1273 microversion: 2.1 time: 0.169921 Oct 24 10:36:08.325366 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1311/2664] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:08 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1273 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:08.332300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b5724498-13b2-4345-8ad1-dfbb4866f8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:08.333582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b5724498-13b2-4345-8ad1-dfbb4866f8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:08.342752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5724498-13b2-4345-8ad1-dfbb4866f8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:08.380769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5724498-13b2-4345-8ad1-dfbb4866f8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:08.387399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5724498-13b2-4345-8ad1-dfbb4866f8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:08.388873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5724498-13b2-4345-8ad1-dfbb4866f8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:08.389381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5724498-13b2-4345-8ad1-dfbb4866f8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:08.390373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5724498-13b2-4345-8ad1-dfbb4866f8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:08.816157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b5724498-13b2-4345-8ad1-dfbb4866f8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:08.823754 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b5724498-13b2-4345-8ad1-dfbb4866f8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1314 microversion: 2.1 time: 0.497225 Oct 24 10:36:08.837224 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1312/2665] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:08 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:08.844537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0cbda0c4-21d8-4861-aa4b-61f9d79a6860 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d0a333a0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:08.928119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG neutronclient.v2_0.client [None req-0cbda0c4-21d8-4861-aa4b-61f9d79a6860 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a344396a-986e-412b-a7b0-51c1b7f7dc78 does not exist", "detail": ""}} {{(pid=120425) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:36:08.930313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.security_group_api [None req-0cbda0c4-21d8-4861-aa4b-61f9d79a6860 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Neutron security group a344396a-986e-412b-a7b0-51c1b7f7dc78 not found {{(pid=120425) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 10:36:08.931693 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-0cbda0c4-21d8-4861-aa4b-61f9d79a6860 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] HTTP exception thrown: Security group a344396a-986e-412b-a7b0-51c1b7f7dc78 does not exist Oct 24 10:36:08.931693 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-9ad10e08-d3f6-46b3-8015-3826381bb32e'] Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0cbda0c4-21d8-4861-aa4b-61f9d79a6860 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Request method failure captured: Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/os-security-groups/a344396a-986e-412b-a7b0-51c1b7f7dc78 HTTP/1.1 Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmoaXPClcPLJ9gE_6C5GjDQZGdene0OObxZB0Z9ED_DBUfNEOv3AFVz9Sj51DSTvjG5d4L4G0Y7Y2LCJ3yblYYRp_EY66mnirefPs52lqIDsBuo9XJUGZQDidaxp2-3kvGCo_yrNtYTWeu7uqgvMarg1Wuv91gUnqbIjaBzXZEG6tDA Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/60b1c666c4914debad43704393d651cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_60b1c666c4914debad43704393d651cf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6aeb81e9b2fa4796813c607234174af6 Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: exception: Security group a344396a-986e-412b-a7b0-51c1b7f7dc78 does not exist Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-9ad10e08-d3f6-46b3-8015-3826381bb32e'] Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'a344396a-986e-412b-a7b0-51c1b7f7dc78'} Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:36:08.937686 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a344396a-986e-412b-a7b0-51c1b7f7dc78 does not exist Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ad10e08-d3f6-46b3-8015-3826381bb32e'] Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a344396a-986e-412b-a7b0-51c1b7f7dc78 does not exist Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ad10e08-d3f6-46b3-8015-3826381bb32e'] Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a344396a-986e-412b-a7b0-51c1b7f7dc78 does not exist Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ad10e08-d3f6-46b3-8015-3826381bb32e'] Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a344396a-986e-412b-a7b0-51c1b7f7dc78 does not exist Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ad10e08-d3f6-46b3-8015-3826381bb32e'] Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0cbda0c4-21d8-4861-aa4b-61f9d79a6860 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Returning 404 to user: Security group a344396a-986e-412b-a7b0-51c1b7f7dc78 does not exist Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-9ad10e08-d3f6-46b3-8015-3826381bb32e'] {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:36:08.941581 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0cbda0c4-21d8-4861-aa4b-61f9d79a6860 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/a344396a-986e-412b-a7b0-51c1b7f7dc78" status: 404 len: 194 microversion: 2.1 time: 0.101825 Oct 24 10:36:08.949616 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1313/2666] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:08 2022] DELETE /compute/v2.1/os-security-groups/a344396a-986e-412b-a7b0-51c1b7f7dc78 => generated 194 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:36:08.988023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-794862b6-3bdb-4045-92dd-33b7a9f6eee0 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:08.989407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-794862b6-3bdb-4045-92dd-33b7a9f6eee0 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:09.021101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-794862b6-3bdb-4045-92dd-33b7a9f6eee0 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:09.021278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-794862b6-3bdb-4045-92dd-33b7a9f6eee0 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:09.021671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-794862b6-3bdb-4045-92dd-33b7a9f6eee0 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:09.022448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-794862b6-3bdb-4045-92dd-33b7a9f6eee0 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:09.022908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-794862b6-3bdb-4045-92dd-33b7a9f6eee0 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:09.023376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-794862b6-3bdb-4045-92dd-33b7a9f6eee0 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:09.263435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-794862b6-3bdb-4045-92dd-33b7a9f6eee0 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9fe821ad1b43f2988dd30521c6c335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c125be93d647e1b2c0fdd4ae2efb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:09.278731 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-794862b6-3bdb-4045-92dd-33b7a9f6eee0 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 200 len: 1274 microversion: 2.1 time: 0.331358 Oct 24 10:36:09.292869 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1314/2667] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:08 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 1274 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:09.292869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-98899563-015e-46b5-9d8b-359d42abf71b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d0a33ee0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:09.397773 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4b28b434-e33f-4014-8dd7-0ed2f1d4852c tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.102851 Oct 24 10:36:09.399057 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1354/2668] 10.222.0.50 () {60 vars in 1195 bytes} [Mon Oct 24 10:36:08 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:09.407005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bbf22ef5-ebec-4b54-a82d-7e3ea010977c tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:09.408092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bbf22ef5-ebec-4b54-a82d-7e3ea010977c tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:09.419786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbf22ef5-ebec-4b54-a82d-7e3ea010977c tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:09.420595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbf22ef5-ebec-4b54-a82d-7e3ea010977c tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:09.421483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbf22ef5-ebec-4b54-a82d-7e3ea010977c tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:09.424321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbf22ef5-ebec-4b54-a82d-7e3ea010977c tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:09.425379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbf22ef5-ebec-4b54-a82d-7e3ea010977c tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:09.426154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbf22ef5-ebec-4b54-a82d-7e3ea010977c tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:09.487649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG neutronclient.v2_0.client [None req-98899563-015e-46b5-9d8b-359d42abf71b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group defa3b6e-9861-4e3f-8891-3e8e05ad33d5 does not exist", "detail": ""}} {{(pid=120425) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:36:09.488538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.security_group_api [None req-98899563-015e-46b5-9d8b-359d42abf71b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Neutron security group defa3b6e-9861-4e3f-8891-3e8e05ad33d5 not found {{(pid=120425) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 10:36:09.489322 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-98899563-015e-46b5-9d8b-359d42abf71b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] HTTP exception thrown: Security group defa3b6e-9861-4e3f-8891-3e8e05ad33d5 does not exist Oct 24 10:36:09.489322 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-862717f4-e004-4edc-9c40-d2a0cc4f26bb'] Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-98899563-015e-46b5-9d8b-359d42abf71b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Request method failure captured: Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/os-security-groups/defa3b6e-9861-4e3f-8891-3e8e05ad33d5 HTTP/1.1 Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmoaXPClcPLJ9gE_6C5GjDQZGdene0OObxZB0Z9ED_DBUfNEOv3AFVz9Sj51DSTvjG5d4L4G0Y7Y2LCJ3yblYYRp_EY66mnirefPs52lqIDsBuo9XJUGZQDidaxp2-3kvGCo_yrNtYTWeu7uqgvMarg1Wuv91gUnqbIjaBzXZEG6tDA Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/60b1c666c4914debad43704393d651cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_60b1c666c4914debad43704393d651cf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6aeb81e9b2fa4796813c607234174af6 Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: exception: Security group defa3b6e-9861-4e3f-8891-3e8e05ad33d5 does not exist Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-862717f4-e004-4edc-9c40-d2a0cc4f26bb'] Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'defa3b6e-9861-4e3f-8891-3e8e05ad33d5'} Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:36:09.492383 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group defa3b6e-9861-4e3f-8891-3e8e05ad33d5 does not exist Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-862717f4-e004-4edc-9c40-d2a0cc4f26bb'] Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group defa3b6e-9861-4e3f-8891-3e8e05ad33d5 does not exist Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-862717f4-e004-4edc-9c40-d2a0cc4f26bb'] Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group defa3b6e-9861-4e3f-8891-3e8e05ad33d5 does not exist Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-862717f4-e004-4edc-9c40-d2a0cc4f26bb'] Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group defa3b6e-9861-4e3f-8891-3e8e05ad33d5 does not exist Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-862717f4-e004-4edc-9c40-d2a0cc4f26bb'] Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-98899563-015e-46b5-9d8b-359d42abf71b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Returning 404 to user: Security group defa3b6e-9861-4e3f-8891-3e8e05ad33d5 does not exist Oct 24 10:36:09.497600 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-862717f4-e004-4edc-9c40-d2a0cc4f26bb'] {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:36:09.502427 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-98899563-015e-46b5-9d8b-359d42abf71b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/defa3b6e-9861-4e3f-8891-3e8e05ad33d5" status: 404 len: 194 microversion: 2.1 time: 0.214189 Oct 24 10:36:09.503196 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1315/2669] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:09 2022] DELETE /compute/v2.1/os-security-groups/defa3b6e-9861-4e3f-8891-3e8e05ad33d5 => generated 194 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:36:09.509378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e03fcc17-db03-422a-b3cd-b5db1e1540ea tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:09.521831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e03fcc17-db03-422a-b3cd-b5db1e1540ea tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:09.538365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e03fcc17-db03-422a-b3cd-b5db1e1540ea tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:09.539131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e03fcc17-db03-422a-b3cd-b5db1e1540ea tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:09.539786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e03fcc17-db03-422a-b3cd-b5db1e1540ea tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:09.540692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e03fcc17-db03-422a-b3cd-b5db1e1540ea tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:09.541388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e03fcc17-db03-422a-b3cd-b5db1e1540ea tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:09.542142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e03fcc17-db03-422a-b3cd-b5db1e1540ea tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:09.909305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bbf22ef5-ebec-4b54-a82d-7e3ea010977c tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:09.924761 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bbf22ef5-ebec-4b54-a82d-7e3ea010977c tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1478 microversion: 2.1 time: 0.524407 Oct 24 10:36:09.926338 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1355/2670] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:09 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1478 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:09.928865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e03fcc17-db03-422a-b3cd-b5db1e1540ea tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:09.934196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e57c70f3-2e26-40fd-b7be-cea6a33ab2c6 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Calling method '.version_select at 0x7f04d4e1a430>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:09.945203 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e03fcc17-db03-422a-b3cd-b5db1e1540ea tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1315 microversion: 2.1 time: 0.439705 Oct 24 10:36:09.958184 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1316/2671] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:09 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:09.974176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b26becca-017a-4baa-aaa0-201d61fa3e0b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d0a33430>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:10.071868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG neutronclient.v2_0.client [None req-b26becca-017a-4baa-aaa0-201d61fa3e0b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 87709edc-0b6a-4094-895a-de3e403a2127 does not exist", "detail": ""}} {{(pid=120425) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:36:10.072933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.security_group_api [None req-b26becca-017a-4baa-aaa0-201d61fa3e0b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Neutron security group 87709edc-0b6a-4094-895a-de3e403a2127 not found {{(pid=120425) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 10:36:10.074416 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-b26becca-017a-4baa-aaa0-201d61fa3e0b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] HTTP exception thrown: Security group 87709edc-0b6a-4094-895a-de3e403a2127 does not exist Oct 24 10:36:10.074416 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-226d1c75-4f77-45e5-bdb6-25f4b2121177'] Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b26becca-017a-4baa-aaa0-201d61fa3e0b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Request method failure captured: Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/os-security-groups/87709edc-0b6a-4094-895a-de3e403a2127 HTTP/1.1 Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmoaXPClcPLJ9gE_6C5GjDQZGdene0OObxZB0Z9ED_DBUfNEOv3AFVz9Sj51DSTvjG5d4L4G0Y7Y2LCJ3yblYYRp_EY66mnirefPs52lqIDsBuo9XJUGZQDidaxp2-3kvGCo_yrNtYTWeu7uqgvMarg1Wuv91gUnqbIjaBzXZEG6tDA Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/60b1c666c4914debad43704393d651cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_60b1c666c4914debad43704393d651cf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6aeb81e9b2fa4796813c607234174af6 Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: exception: Security group 87709edc-0b6a-4094-895a-de3e403a2127 does not exist Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-226d1c75-4f77-45e5-bdb6-25f4b2121177'] Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '87709edc-0b6a-4094-895a-de3e403a2127'} Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:36:10.077851 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 87709edc-0b6a-4094-895a-de3e403a2127 does not exist Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-226d1c75-4f77-45e5-bdb6-25f4b2121177'] Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 87709edc-0b6a-4094-895a-de3e403a2127 does not exist Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-226d1c75-4f77-45e5-bdb6-25f4b2121177'] Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 87709edc-0b6a-4094-895a-de3e403a2127 does not exist Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-226d1c75-4f77-45e5-bdb6-25f4b2121177'] Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 87709edc-0b6a-4094-895a-de3e403a2127 does not exist Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-226d1c75-4f77-45e5-bdb6-25f4b2121177'] Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b26becca-017a-4baa-aaa0-201d61fa3e0b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Returning 404 to user: Security group 87709edc-0b6a-4094-895a-de3e403a2127 does not exist Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-226d1c75-4f77-45e5-bdb6-25f4b2121177'] {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:36:10.082085 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b26becca-017a-4baa-aaa0-201d61fa3e0b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/87709edc-0b6a-4094-895a-de3e403a2127" status: 404 len: 194 microversion: 2.1 time: 0.119989 Oct 24 10:36:10.087759 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1317/2672] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:09 2022] DELETE /compute/v2.1/os-security-groups/87709edc-0b6a-4094-895a-de3e403a2127 => generated 194 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:36:10.090073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ee8ac21-292d-498b-a849-c418aba4b544 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:10.090692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ee8ac21-292d-498b-a849-c418aba4b544 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:10.102064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ee8ac21-292d-498b-a849-c418aba4b544 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:10.102590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ee8ac21-292d-498b-a849-c418aba4b544 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:10.103027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ee8ac21-292d-498b-a849-c418aba4b544 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:10.103823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ee8ac21-292d-498b-a849-c418aba4b544 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:10.104308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ee8ac21-292d-498b-a849-c418aba4b544 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:10.105290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ee8ac21-292d-498b-a849-c418aba4b544 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:10.111203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:10.588285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2ee8ac21-292d-498b-a849-c418aba4b544 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:10.598163 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ee8ac21-292d-498b-a849-c418aba4b544 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1314 microversion: 2.1 time: 0.512347 Oct 24 10:36:10.613112 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1318/2673] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:10 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:10.619696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b0e5052-94de-46c8-a17e-c0747af37cd0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d11740d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:11.045269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG neutronclient.v2_0.client [None req-8b0e5052-94de-46c8-a17e-c0747af37cd0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group be3fc4f1-89b1-4eac-9f5f-0397258f2095 does not exist", "detail": ""}} {{(pid=120425) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:36:11.046808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.security_group_api [None req-8b0e5052-94de-46c8-a17e-c0747af37cd0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Neutron security group be3fc4f1-89b1-4eac-9f5f-0397258f2095 not found {{(pid=120425) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 10:36:11.047711 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-8b0e5052-94de-46c8-a17e-c0747af37cd0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] HTTP exception thrown: Security group be3fc4f1-89b1-4eac-9f5f-0397258f2095 does not exist Oct 24 10:36:11.047711 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-ce37c2f6-66a9-48ed-946e-f97b94fdb51e'] Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b0e5052-94de-46c8-a17e-c0747af37cd0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Request method failure captured: Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/os-security-groups/be3fc4f1-89b1-4eac-9f5f-0397258f2095 HTTP/1.1 Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmoaXPClcPLJ9gE_6C5GjDQZGdene0OObxZB0Z9ED_DBUfNEOv3AFVz9Sj51DSTvjG5d4L4G0Y7Y2LCJ3yblYYRp_EY66mnirefPs52lqIDsBuo9XJUGZQDidaxp2-3kvGCo_yrNtYTWeu7uqgvMarg1Wuv91gUnqbIjaBzXZEG6tDA Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/60b1c666c4914debad43704393d651cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_60b1c666c4914debad43704393d651cf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6aeb81e9b2fa4796813c607234174af6 Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: exception: Security group be3fc4f1-89b1-4eac-9f5f-0397258f2095 does not exist Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-ce37c2f6-66a9-48ed-946e-f97b94fdb51e'] Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'be3fc4f1-89b1-4eac-9f5f-0397258f2095'} Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:36:11.049902 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group be3fc4f1-89b1-4eac-9f5f-0397258f2095 does not exist Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce37c2f6-66a9-48ed-946e-f97b94fdb51e'] Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group be3fc4f1-89b1-4eac-9f5f-0397258f2095 does not exist Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce37c2f6-66a9-48ed-946e-f97b94fdb51e'] Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group be3fc4f1-89b1-4eac-9f5f-0397258f2095 does not exist Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce37c2f6-66a9-48ed-946e-f97b94fdb51e'] Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group be3fc4f1-89b1-4eac-9f5f-0397258f2095 does not exist Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce37c2f6-66a9-48ed-946e-f97b94fdb51e'] Oct 24 10:36:11.054293 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:11.059161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b0e5052-94de-46c8-a17e-c0747af37cd0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Returning 404 to user: Security group be3fc4f1-89b1-4eac-9f5f-0397258f2095 does not exist Oct 24 10:36:11.059161 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-ce37c2f6-66a9-48ed-946e-f97b94fdb51e'] {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:36:11.060379 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b0e5052-94de-46c8-a17e-c0747af37cd0 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/be3fc4f1-89b1-4eac-9f5f-0397258f2095" status: 404 len: 194 microversion: 2.1 time: 0.445929 Oct 24 10:36:11.061336 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1319/2674] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:10 2022] DELETE /compute/v2.1/os-security-groups/be3fc4f1-89b1-4eac-9f5f-0397258f2095 => generated 194 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:36:11.066730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b88c2ea-193d-4861-bd81-42d07bc9698a tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:11.067896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8b88c2ea-193d-4861-bd81-42d07bc9698a tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:11.076455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b88c2ea-193d-4861-bd81-42d07bc9698a tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:11.077352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b88c2ea-193d-4861-bd81-42d07bc9698a tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:11.078220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b88c2ea-193d-4861-bd81-42d07bc9698a tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:11.079408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b88c2ea-193d-4861-bd81-42d07bc9698a tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:11.080223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b88c2ea-193d-4861-bd81-42d07bc9698a tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:11.080954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b88c2ea-193d-4861-bd81-42d07bc9698a tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:11.257354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8b88c2ea-193d-4861-bd81-42d07bc9698a tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9fe821ad1b43f2988dd30521c6c335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c125be93d647e1b2c0fdd4ae2efb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:11.268733 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b88c2ea-193d-4861-bd81-42d07bc9698a tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 200 len: 1274 microversion: 2.1 time: 0.205952 Oct 24 10:36:11.270329 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1320/2675] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:11 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 1274 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:11.275571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-48f6317f-ed49-4ea8-a16c-0b69ffae0652 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:11.276821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-48f6317f-ed49-4ea8-a16c-0b69ffae0652 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:11.286502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48f6317f-ed49-4ea8-a16c-0b69ffae0652 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:11.288005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48f6317f-ed49-4ea8-a16c-0b69ffae0652 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:11.288727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48f6317f-ed49-4ea8-a16c-0b69ffae0652 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:11.289634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48f6317f-ed49-4ea8-a16c-0b69ffae0652 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:11.290380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48f6317f-ed49-4ea8-a16c-0b69ffae0652 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:11.291237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48f6317f-ed49-4ea8-a16c-0b69ffae0652 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:11.369469 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e57c70f3-2e26-40fd-b7be-cea6a33ab2c6 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/6cd9c041-3b5f-4962-9276-836388d3389f" status: 202 len: 0 microversion: 2.1 time: 1.441771 Oct 24 10:36:11.376649 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1356/2676] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:09 2022] DELETE /compute/v2.1/os-security-groups/6cd9c041-3b5f-4962-9276-836388d3389f => generated 0 bytes in 1449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:36:11.382922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-937d8e40-a45e-495b-b0a4-84292302c741 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:11.383910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-937d8e40-a45e-495b-b0a4-84292302c741 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:11.398658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-937d8e40-a45e-495b-b0a4-84292302c741 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:11.400305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-937d8e40-a45e-495b-b0a4-84292302c741 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:11.402111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-937d8e40-a45e-495b-b0a4-84292302c741 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:11.403207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-937d8e40-a45e-495b-b0a4-84292302c741 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:11.403904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-937d8e40-a45e-495b-b0a4-84292302c741 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:11.406661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-937d8e40-a45e-495b-b0a4-84292302c741 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:11.694546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-48f6317f-ed49-4ea8-a16c-0b69ffae0652 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:11.703424 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-48f6317f-ed49-4ea8-a16c-0b69ffae0652 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1478 microversion: 2.1 time: 0.431374 Oct 24 10:36:11.715076 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1321/2677] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:11 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1478 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:11.721210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-505c7e72-0698-4f9c-a4fe-74d83540a794 req-cb70b534-2b51-4576-bda9-d5383c82da55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485d2945-20d9-4620-a9e5-004680c44d43", "name": "network-vif-unplugged", "status": "completed", "tag": "ceedad81-43a8-4ff1-9629-690de6218202"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:11.742131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-505c7e72-0698-4f9c-a4fe-74d83540a794 req-cb70b534-2b51-4576-bda9-d5383c82da55 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:11.759453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-937d8e40-a45e-495b-b0a4-84292302c741 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:11.764253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-505c7e72-0698-4f9c-a4fe-74d83540a794 req-cb70b534-2b51-4576-bda9-d5383c82da55 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:11.769759 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-937d8e40-a45e-495b-b0a4-84292302c741 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1315 microversion: 2.1 time: 0.391660 Oct 24 10:36:11.770404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-505c7e72-0698-4f9c-a4fe-74d83540a794 req-cb70b534-2b51-4576-bda9-d5383c82da55 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:11.773739 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1357/2678] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:11 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:11.785439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3dd907d6-1121-47bd-97c4-169dbbea8765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:11.786906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3dd907d6-1121-47bd-97c4-169dbbea8765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:11.799811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dd907d6-1121-47bd-97c4-169dbbea8765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:11.801618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dd907d6-1121-47bd-97c4-169dbbea8765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:11.802232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dd907d6-1121-47bd-97c4-169dbbea8765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:11.803443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dd907d6-1121-47bd-97c4-169dbbea8765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:11.804063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dd907d6-1121-47bd-97c4-169dbbea8765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:11.804658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dd907d6-1121-47bd-97c4-169dbbea8765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:11.805087 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-505c7e72-0698-4f9c-a4fe-74d83540a794 req-cb70b534-2b51-4576-bda9-d5383c82da55 service nova] Creating event network-vif-unplugged:ceedad81-43a8-4ff1-9629-690de6218202 for instance 485d2945-20d9-4620-a9e5-004680c44d43 on n-h2-858383-15 Oct 24 10:36:11.816788 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-505c7e72-0698-4f9c-a4fe-74d83540a794 req-cb70b534-2b51-4576-bda9-d5383c82da55 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100078 Oct 24 10:36:11.817833 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1322/2679] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:11.837285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0faa802f-1a0d-4cb6-b464-379a15c1a244 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Calling method '.version_select at 0x7f04d4fe0940>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:11.862826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3dd907d6-1121-47bd-97c4-169dbbea8765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:36:11.929520 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0faa802f-1a0d-4cb6-b464-379a15c1a244 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/3a2696e9-bcef-4926-8e45-45d1ce108fb4" status: 200 len: 247 microversion: 2.1 time: 0.109948 Oct 24 10:36:11.931025 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1323/2680] 10.222.0.50 () {58 vars in 1269 bytes} [Mon Oct 24 10:36:11 2022] GET /compute/v2.1/os-security-groups/3a2696e9-bcef-4926-8e45-45d1ce108fb4 => generated 247 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:11.936252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2d567b99-f67b-4211-8fb0-82d338ddab98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:11.937477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2d567b99-f67b-4211-8fb0-82d338ddab98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:11.953134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d567b99-f67b-4211-8fb0-82d338ddab98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:11.954125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d567b99-f67b-4211-8fb0-82d338ddab98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:11.956919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d567b99-f67b-4211-8fb0-82d338ddab98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:11.957940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d567b99-f67b-4211-8fb0-82d338ddab98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:11.958420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d567b99-f67b-4211-8fb0-82d338ddab98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:11.958879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d567b99-f67b-4211-8fb0-82d338ddab98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:11.997814 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3dd907d6-1121-47bd-97c4-169dbbea8765 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 204 len: 0 microversion: 2.1 time: 0.222284 Oct 24 10:36:12.002979 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1358/2681] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:36:11 2022] DELETE /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:36:12.011182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-be12e7cd-675b-465e-be08-12f606a5b377 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Action: 'create', calling method: .version_select at 0x7f04d0962a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1252293309", "description": "tempest-description-612970887"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:12.363755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2d567b99-f67b-4211-8fb0-82d338ddab98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:12.376908 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2d567b99-f67b-4211-8fb0-82d338ddab98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1314 microversion: 2.1 time: 0.444275 Oct 24 10:36:12.378124 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1324/2682] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:11 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:12.383159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ecff9b31-c350-4851-99b1-5b76215ecd62 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:12.383976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ecff9b31-c350-4851-99b1-5b76215ecd62 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:12.390923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecff9b31-c350-4851-99b1-5b76215ecd62 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:12.391669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecff9b31-c350-4851-99b1-5b76215ecd62 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:12.392277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecff9b31-c350-4851-99b1-5b76215ecd62 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:12.393294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecff9b31-c350-4851-99b1-5b76215ecd62 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:12.393899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecff9b31-c350-4851-99b1-5b76215ecd62 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:12.394494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecff9b31-c350-4851-99b1-5b76215ecd62 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:12.618510 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-be12e7cd-675b-465e-be08-12f606a5b377 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.608688 Oct 24 10:36:12.621239 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1359/2683] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:36:12 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:12.636500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a585eb8f-e19f-484a-acf2-8e7b25ea47a3 req-e1bdfdae-de6d-4605-bb1b-01841af97f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b", "tag": "2d820800-6db0-4bcd-9d32-e49d1a19862a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:12.665392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a585eb8f-e19f-484a-acf2-8e7b25ea47a3 req-e1bdfdae-de6d-4605-bb1b-01841af97f89 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:12.665871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a585eb8f-e19f-484a-acf2-8e7b25ea47a3 req-e1bdfdae-de6d-4605-bb1b-01841af97f89 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:12.666303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a585eb8f-e19f-484a-acf2-8e7b25ea47a3 req-e1bdfdae-de6d-4605-bb1b-01841af97f89 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:12.678953 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a585eb8f-e19f-484a-acf2-8e7b25ea47a3 req-e1bdfdae-de6d-4605-bb1b-01841af97f89 service nova] Creating event network-changed:2d820800-6db0-4bcd-9d32-e49d1a19862a for instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b on n-h1-858383-15 Oct 24 10:36:12.685113 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a585eb8f-e19f-484a-acf2-8e7b25ea47a3 req-e1bdfdae-de6d-4605-bb1b-01841af97f89 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062291 Oct 24 10:36:12.686056 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1360/2684] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:12.692025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-78514c2c-8158-45ac-a3cd-e9a7b6f90dcd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:12.692729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-78514c2c-8158-45ac-a3cd-e9a7b6f90dcd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:12.699025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78514c2c-8158-45ac-a3cd-e9a7b6f90dcd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:12.699514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78514c2c-8158-45ac-a3cd-e9a7b6f90dcd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:12.699958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78514c2c-8158-45ac-a3cd-e9a7b6f90dcd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:12.700735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78514c2c-8158-45ac-a3cd-e9a7b6f90dcd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:12.701238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78514c2c-8158-45ac-a3cd-e9a7b6f90dcd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:12.702890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78514c2c-8158-45ac-a3cd-e9a7b6f90dcd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:12.770960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ecff9b31-c350-4851-99b1-5b76215ecd62 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:12.778864 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ecff9b31-c350-4851-99b1-5b76215ecd62 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1646 microversion: 2.1 time: 0.399468 Oct 24 10:36:12.780038 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1325/2685] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:12 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1646 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:12.785155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-abd03268-d3d7-45ea-9463-42f7db363da1 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Action: 'create', calling method: .version_select at 0x7f04d0c9da60>, body: {"security_group_rule": {"parent_group_id": "74888f0f-de89-4c7e-839a-1d0242cea571", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:13.031500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-78514c2c-8158-45ac-a3cd-e9a7b6f90dcd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9fe821ad1b43f2988dd30521c6c335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c125be93d647e1b2c0fdd4ae2efb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:13.040536 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-78514c2c-8158-45ac-a3cd-e9a7b6f90dcd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 200 len: 1316 microversion: 2.1 time: 0.352732 Oct 24 10:36:13.041177 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1361/2686] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:12 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 1316 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:13.046172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dc6ddbca-db7a-4711-8328-c3b76dec61ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:13.047084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dc6ddbca-db7a-4711-8328-c3b76dec61ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:13.053942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc6ddbca-db7a-4711-8328-c3b76dec61ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:13.054748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc6ddbca-db7a-4711-8328-c3b76dec61ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:13.055441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc6ddbca-db7a-4711-8328-c3b76dec61ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:13.056570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc6ddbca-db7a-4711-8328-c3b76dec61ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:13.057483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc6ddbca-db7a-4711-8328-c3b76dec61ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:13.058170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc6ddbca-db7a-4711-8328-c3b76dec61ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:13.087173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:13.286485 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-abd03268-d3d7-45ea-9463-42f7db363da1 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.505003 Oct 24 10:36:13.294853 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1326/2687] 10.222.0.50 () {60 vars in 1195 bytes} [Mon Oct 24 10:36:12 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:13.295299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a4460d26-fec7-4d22-9059-5a41203fe6d2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:13.296080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a4460d26-fec7-4d22-9059-5a41203fe6d2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:13.302749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dc6ddbca-db7a-4711-8328-c3b76dec61ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:13.304865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4460d26-fec7-4d22-9059-5a41203fe6d2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:13.312232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4460d26-fec7-4d22-9059-5a41203fe6d2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:13.312946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4460d26-fec7-4d22-9059-5a41203fe6d2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:13.314464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4460d26-fec7-4d22-9059-5a41203fe6d2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:13.315096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4460d26-fec7-4d22-9059-5a41203fe6d2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:13.315704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4460d26-fec7-4d22-9059-5a41203fe6d2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:13.352321 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dc6ddbca-db7a-4711-8328-c3b76dec61ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1478 microversion: 2.1 time: 0.309634 Oct 24 10:36:13.353532 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1362/2688] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:13 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1478 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:13.362764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-01edbf3c-0e2a-473b-9292-da1b8d740c11 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Action: 'create', calling method: .version_select at 0x7f04d4eb9c10>, body: {"security_group_rule": {"parent_group_id": "74888f0f-de89-4c7e-839a-1d0242cea571", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:13.611288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a4460d26-fec7-4d22-9059-5a41203fe6d2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:13.633261 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a4460d26-fec7-4d22-9059-5a41203fe6d2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1315 microversion: 2.1 time: 0.340810 Oct 24 10:36:13.633899 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1327/2689] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:13 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:13.646925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dc14f18a-5edb-410e-8b1b-452f887aff4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:13.648502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dc14f18a-5edb-410e-8b1b-452f887aff4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:13.661345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc14f18a-5edb-410e-8b1b-452f887aff4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:13.661859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc14f18a-5edb-410e-8b1b-452f887aff4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:13.662301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc14f18a-5edb-410e-8b1b-452f887aff4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:13.663034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc14f18a-5edb-410e-8b1b-452f887aff4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:13.665535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc14f18a-5edb-410e-8b1b-452f887aff4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:13.666116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc14f18a-5edb-410e-8b1b-452f887aff4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:13.711516 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-01edbf3c-0e2a-473b-9292-da1b8d740c11 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.356509 Oct 24 10:36:13.712725 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1363/2690] 10.222.0.50 () {60 vars in 1195 bytes} [Mon Oct 24 10:36:13 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:13.724585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8f545bc0-6c99-4b3c-9a9b-2dbe7df32df2 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Calling method '.version_select at 0x7f04d4e3cee0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:13.828810 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8f545bc0-6c99-4b3c-9a9b-2dbe7df32df2 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/74888f0f-de89-4c7e-839a-1d0242cea571" status: 200 len: 664 microversion: 2.1 time: 0.107806 Oct 24 10:36:13.829536 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1364/2691] 10.222.0.50 () {58 vars in 1269 bytes} [Mon Oct 24 10:36:13 2022] GET /compute/v2.1/os-security-groups/74888f0f-de89-4c7e-839a-1d0242cea571 => generated 664 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:36:13.841816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-57ce956a-0f5d-4535-9e8e-c487dd3faa13 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:13.842642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-57ce956a-0f5d-4535-9e8e-c487dd3faa13 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:13.851064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-57ce956a-0f5d-4535-9e8e-c487dd3faa13 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:13.851639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-57ce956a-0f5d-4535-9e8e-c487dd3faa13 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:13.852149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-57ce956a-0f5d-4535-9e8e-c487dd3faa13 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:13.852961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-57ce956a-0f5d-4535-9e8e-c487dd3faa13 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:13.853641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-57ce956a-0f5d-4535-9e8e-c487dd3faa13 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:13.854070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-57ce956a-0f5d-4535-9e8e-c487dd3faa13 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:13.857401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dc14f18a-5edb-410e-8b1b-452f887aff4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:13.866951 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dc14f18a-5edb-410e-8b1b-452f887aff4d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1314 microversion: 2.1 time: 0.229187 Oct 24 10:36:13.867632 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1328/2692] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:13 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:13.872271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a9001c42-dab3-434a-b31b-45b08bf5bc3b req-79a0c472-17f5-44ac-934b-b84ed6774be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eac13fe-2828-4885-b82d-af682e20a40c", "name": "network-vif-plugged", "status": "completed", "tag": "428c6441-9cf1-49b0-9ba0-9f7d5db1dc14"}, {"server_uuid": "485d2945-20d9-4620-a9e5-004680c44d43", "name": "network-vif-plugged", "status": "completed", "tag": "ceedad81-43a8-4ff1-9629-690de6218202"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:13.895828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:13.910032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a9001c42-dab3-434a-b31b-45b08bf5bc3b req-79a0c472-17f5-44ac-934b-b84ed6774be4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:13.910629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a9001c42-dab3-434a-b31b-45b08bf5bc3b req-79a0c472-17f5-44ac-934b-b84ed6774be4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:13.911170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a9001c42-dab3-434a-b31b-45b08bf5bc3b req-79a0c472-17f5-44ac-934b-b84ed6774be4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:13.926441 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a9001c42-dab3-434a-b31b-45b08bf5bc3b req-79a0c472-17f5-44ac-934b-b84ed6774be4 service nova] Creating event network-vif-plugged:428c6441-9cf1-49b0-9ba0-9f7d5db1dc14 for instance 8eac13fe-2828-4885-b82d-af682e20a40c on n-h1-858383-15 Oct 24 10:36:13.927304 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a9001c42-dab3-434a-b31b-45b08bf5bc3b req-79a0c472-17f5-44ac-934b-b84ed6774be4 service nova] Creating event network-vif-plugged:ceedad81-43a8-4ff1-9629-690de6218202 for instance 485d2945-20d9-4620-a9e5-004680c44d43 on n-h2-858383-15 Oct 24 10:36:13.937546 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a9001c42-dab3-434a-b31b-45b08bf5bc3b req-79a0c472-17f5-44ac-934b-b84ed6774be4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067642 Oct 24 10:36:13.939896 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1329/2693] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:13.947838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-004c34af-70bd-49e7-b165-1106e1e4e6a9 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Calling method '.version_select at 0x7f04d4e8d700>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:14.238239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-57ce956a-0f5d-4535-9e8e-c487dd3faa13 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:14.257224 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-57ce956a-0f5d-4535-9e8e-c487dd3faa13 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1646 microversion: 2.1 time: 0.425328 Oct 24 10:36:14.268896 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1365/2694] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:13 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1646 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:14.268896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-894806d2-8a37-41ce-80c6-4a6bc2968f76 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:14.268896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-894806d2-8a37-41ce-80c6-4a6bc2968f76 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:14.272442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-894806d2-8a37-41ce-80c6-4a6bc2968f76 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:14.274368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-894806d2-8a37-41ce-80c6-4a6bc2968f76 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:14.274992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-894806d2-8a37-41ce-80c6-4a6bc2968f76 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:14.275724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-894806d2-8a37-41ce-80c6-4a6bc2968f76 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:14.276230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-894806d2-8a37-41ce-80c6-4a6bc2968f76 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:14.276718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-894806d2-8a37-41ce-80c6-4a6bc2968f76 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:14.323686 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-004c34af-70bd-49e7-b165-1106e1e4e6a9 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-group-rules/0a6039ed-7b8e-45e4-bff0-7dc3c353e0c0" status: 202 len: 0 microversion: 2.1 time: 0.381354 Oct 24 10:36:14.323943 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1330/2695] 10.222.0.50 () {58 vars in 1287 bytes} [Mon Oct 24 10:36:13 2022] DELETE /compute/v2.1/os-security-group-rules/0a6039ed-7b8e-45e4-bff0-7dc3c353e0c0 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:36:14.338542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e9bac5c5-01e8-4d5c-b5e2-7c75a8bc0981 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Calling method '.version_select at 0x7f04d4fe0a60>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:14.667940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-894806d2-8a37-41ce-80c6-4a6bc2968f76 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9fe821ad1b43f2988dd30521c6c335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c125be93d647e1b2c0fdd4ae2efb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:14.676599 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-894806d2-8a37-41ce-80c6-4a6bc2968f76 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 200 len: 1316 microversion: 2.1 time: 0.417316 Oct 24 10:36:14.677900 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1366/2696] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:14 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 1316 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:14.682897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1f3713e5-9703-4842-8f1d-bfb12095890b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:14.683729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1f3713e5-9703-4842-8f1d-bfb12095890b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:14.691677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f3713e5-9703-4842-8f1d-bfb12095890b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:14.693088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f3713e5-9703-4842-8f1d-bfb12095890b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:14.694371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f3713e5-9703-4842-8f1d-bfb12095890b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:14.695347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f3713e5-9703-4842-8f1d-bfb12095890b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:14.696058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f3713e5-9703-4842-8f1d-bfb12095890b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:14.697427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f3713e5-9703-4842-8f1d-bfb12095890b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:15.017712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1f3713e5-9703-4842-8f1d-bfb12095890b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:15.027181 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1f3713e5-9703-4842-8f1d-bfb12095890b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1478 microversion: 2.1 time: 0.347748 Oct 24 10:36:15.027923 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1367/2697] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:14 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1478 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:15.035241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6ea239ee-329e-4b4c-a818-2f9dfaf238ac tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:15.036146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6ea239ee-329e-4b4c-a818-2f9dfaf238ac tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:15.043725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ea239ee-329e-4b4c-a818-2f9dfaf238ac tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:15.044115 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e9bac5c5-01e8-4d5c-b5e2-7c75a8bc0981 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/74888f0f-de89-4c7e-839a-1d0242cea571" status: 202 len: 0 microversion: 2.1 time: 0.709670 Oct 24 10:36:15.045073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ea239ee-329e-4b4c-a818-2f9dfaf238ac tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:15.046405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ea239ee-329e-4b4c-a818-2f9dfaf238ac tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:15.047495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ea239ee-329e-4b4c-a818-2f9dfaf238ac tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:15.047957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ea239ee-329e-4b4c-a818-2f9dfaf238ac tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:15.048390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ea239ee-329e-4b4c-a818-2f9dfaf238ac tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:15.049666 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1331/2698] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:14 2022] DELETE /compute/v2.1/os-security-groups/74888f0f-de89-4c7e-839a-1d0242cea571 => generated 0 bytes in 716 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:36:15.056655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-be624518-f80e-4a82-bb68-5a3553030970 req-f0b816e1-b56f-4f5d-a817-008b3b0dc716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42e16c14-6d0e-49a5-9948-298c2e667999", "tag": "bddb3b72-49df-48b0-b7ca-ad03dc04e320"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:15.080215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-be624518-f80e-4a82-bb68-5a3553030970 req-f0b816e1-b56f-4f5d-a817-008b3b0dc716 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:15.088783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-be624518-f80e-4a82-bb68-5a3553030970 req-f0b816e1-b56f-4f5d-a817-008b3b0dc716 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:15.089270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-be624518-f80e-4a82-bb68-5a3553030970 req-f0b816e1-b56f-4f5d-a817-008b3b0dc716 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:15.101839 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-be624518-f80e-4a82-bb68-5a3553030970 req-f0b816e1-b56f-4f5d-a817-008b3b0dc716 service nova] Creating event network-changed:bddb3b72-49df-48b0-b7ca-ad03dc04e320 for instance 42e16c14-6d0e-49a5-9948-298c2e667999 on n-h2-858383-15 Oct 24 10:36:15.107559 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-be624518-f80e-4a82-bb68-5a3553030970 req-f0b816e1-b56f-4f5d-a817-008b3b0dc716 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056255 Oct 24 10:36:15.108714 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1332/2699] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:15.116138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-78372697-161e-4672-a96a-ba2164babcc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:15.117110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-78372697-161e-4672-a96a-ba2164babcc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:15.124285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78372697-161e-4672-a96a-ba2164babcc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:15.125128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78372697-161e-4672-a96a-ba2164babcc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:15.125648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78372697-161e-4672-a96a-ba2164babcc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:15.126370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78372697-161e-4672-a96a-ba2164babcc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:15.126833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78372697-161e-4672-a96a-ba2164babcc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:15.127261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78372697-161e-4672-a96a-ba2164babcc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:15.437049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6ea239ee-329e-4b4c-a818-2f9dfaf238ac tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:15.440482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:15.449352 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6ea239ee-329e-4b4c-a818-2f9dfaf238ac tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1315 microversion: 2.1 time: 0.419810 Oct 24 10:36:15.450265 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1368/2700] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:15 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:15.471519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ed1d1690-2d2b-423a-a50c-39a708f0ac6e tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Calling method '.version_select at 0x7f04d4e93790>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:15.477228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=20 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:15.871710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG neutronclient.v2_0.client [None req-ed1d1690-2d2b-423a-a50c-39a708f0ac6e tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6cd9c041-3b5f-4962-9276-836388d3389f does not exist", "detail": ""}} {{(pid=120426) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:36:15.873066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.security_group_api [None req-ed1d1690-2d2b-423a-a50c-39a708f0ac6e tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Neutron security group 6cd9c041-3b5f-4962-9276-836388d3389f not found {{(pid=120426) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 10:36:15.874143 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-ed1d1690-2d2b-423a-a50c-39a708f0ac6e tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] HTTP exception thrown: Security group 6cd9c041-3b5f-4962-9276-836388d3389f does not exist Oct 24 10:36:15.874143 n-d-858383-15 devstack@n-api.service[120426]: Neutron server returns request_ids: ['req-575b95fd-2329-4ea2-99f3-3a7b317694bf'] Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ed1d1690-2d2b-423a-a50c-39a708f0ac6e tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Request method failure captured: Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/os-security-groups/6cd9c041-3b5f-4962-9276-836388d3389f HTTP/1.1 Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmqPM0DtU6Is7TGkDaygjB_b9jq6CXicHoS6S5XaO3rBSGCBgEpf_a-Hr9HlwjjBACQOE4Gtbu6kzA5jEhZqYxGan7Ircslfyh6Pi_gK23iJPAJ1oRS6sgPfHTNZCkE01WWX_pmi8D-rjMmjg78bgavTc1Oc8wOkuczAgbnS56Ql00I Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: a6a63a77e7a74cacba4fe95e5bccaefd Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1215572518 Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6a63a77e7a74cacba4fe95e5bccaefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6a63a77e7a74cacba4fe95e5bccaefd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a6a63a77e7a74cacba4fe95e5bccaefd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a6a63a77e7a74cacba4fe95e5bccaefd", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1215572518 Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: a6a63a77e7a74cacba4fe95e5bccaefd Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1215572518 Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-SecurityGroupRulesTestJSON-1215572518-project Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 2baee21470e144f78f74812cebcef6b5 Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1215572518-project Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: exception: Security group 6cd9c041-3b5f-4962-9276-836388d3389f does not exist Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: Neutron server returns request_ids: ['req-575b95fd-2329-4ea2-99f3-3a7b317694bf'] Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '6cd9c041-3b5f-4962-9276-836388d3389f'} Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:36:15.877791 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6cd9c041-3b5f-4962-9276-836388d3389f does not exist Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-575b95fd-2329-4ea2-99f3-3a7b317694bf'] Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6cd9c041-3b5f-4962-9276-836388d3389f does not exist Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-575b95fd-2329-4ea2-99f3-3a7b317694bf'] Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6cd9c041-3b5f-4962-9276-836388d3389f does not exist Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-575b95fd-2329-4ea2-99f3-3a7b317694bf'] Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6cd9c041-3b5f-4962-9276-836388d3389f does not exist Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-575b95fd-2329-4ea2-99f3-3a7b317694bf'] Oct 24 10:36:15.882892 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:15.886653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-78372697-161e-4672-a96a-ba2164babcc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:15.889736 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-78372697-161e-4672-a96a-ba2164babcc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1314 microversion: 2.1 time: 0.777873 Oct 24 10:36:15.889934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ed1d1690-2d2b-423a-a50c-39a708f0ac6e tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Returning 404 to user: Security group 6cd9c041-3b5f-4962-9276-836388d3389f does not exist Oct 24 10:36:15.889934 n-d-858383-15 devstack@n-api.service[120426]: Neutron server returns request_ids: ['req-575b95fd-2329-4ea2-99f3-3a7b317694bf'] {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:36:15.889934 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ed1d1690-2d2b-423a-a50c-39a708f0ac6e tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/6cd9c041-3b5f-4962-9276-836388d3389f" status: 404 len: 194 microversion: 2.1 time: 0.422239 Oct 24 10:36:15.891167 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1369/2701] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:15 2022] DELETE /compute/v2.1/os-security-groups/6cd9c041-3b5f-4962-9276-836388d3389f => generated 194 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:36:15.902142 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1333/2702] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:15 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1314 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:15.911005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ae281a06-f937-4a08-8cb7-53de6b112cde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:15.911636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ae281a06-f937-4a08-8cb7-53de6b112cde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:15.917252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3a672a35-4d2f-445d-a8bf-ab13efaa7047 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:15.917941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae281a06-f937-4a08-8cb7-53de6b112cde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:15.918058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3a672a35-4d2f-445d-a8bf-ab13efaa7047 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:15.918440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae281a06-f937-4a08-8cb7-53de6b112cde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:15.918948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae281a06-f937-4a08-8cb7-53de6b112cde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:15.919670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae281a06-f937-4a08-8cb7-53de6b112cde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:15.920134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae281a06-f937-4a08-8cb7-53de6b112cde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:15.920686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae281a06-f937-4a08-8cb7-53de6b112cde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:15.939693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a672a35-4d2f-445d-a8bf-ab13efaa7047 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:15.940424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a672a35-4d2f-445d-a8bf-ab13efaa7047 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:15.941462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a672a35-4d2f-445d-a8bf-ab13efaa7047 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:15.943953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a672a35-4d2f-445d-a8bf-ab13efaa7047 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:15.945437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a672a35-4d2f-445d-a8bf-ab13efaa7047 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:15.946333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a672a35-4d2f-445d-a8bf-ab13efaa7047 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:15.975540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:16.081843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3a672a35-4d2f-445d-a8bf-ab13efaa7047 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aeb81e9b2fa4796813c607234174af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b1c666c4914debad43704393d651cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:16.101093 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3a672a35-4d2f-445d-a8bf-ab13efaa7047 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 200 len: 1300 microversion: 2.1 time: 0.208477 Oct 24 10:36:16.102202 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1370/2703] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:15 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 1300 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:16.109978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5bbb3085-6bb8-42e8-9765-c2c64fb47667 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Calling method '.version_select at 0x7f04d4e3cc10>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:16.356034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ae281a06-f937-4a08-8cb7-53de6b112cde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9fe821ad1b43f2988dd30521c6c335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c125be93d647e1b2c0fdd4ae2efb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:16.367971 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ae281a06-f937-4a08-8cb7-53de6b112cde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 200 len: 1316 microversion: 2.1 time: 0.464475 Oct 24 10:36:16.377171 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1334/2704] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:15 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:16.377171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-25c37dec-4c9f-496c-8593-3944694928c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:16.377171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-25c37dec-4c9f-496c-8593-3944694928c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:16.385140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25c37dec-4c9f-496c-8593-3944694928c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:16.386244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25c37dec-4c9f-496c-8593-3944694928c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:16.386687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25c37dec-4c9f-496c-8593-3944694928c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:16.387396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25c37dec-4c9f-496c-8593-3944694928c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:16.388437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25c37dec-4c9f-496c-8593-3944694928c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:16.388905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25c37dec-4c9f-496c-8593-3944694928c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:16.596243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-25c37dec-4c9f-496c-8593-3944694928c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:16.609551 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-25c37dec-4c9f-496c-8593-3944694928c1 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1463 microversion: 2.1 time: 0.235849 Oct 24 10:36:16.612531 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1335/2705] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:16 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1463 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:16.620716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-29941a79-d223-4276-bc20-5bb555019f11 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:16.622306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-29941a79-d223-4276-bc20-5bb555019f11 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:16.633180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29941a79-d223-4276-bc20-5bb555019f11 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:16.633863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29941a79-d223-4276-bc20-5bb555019f11 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:16.634586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29941a79-d223-4276-bc20-5bb555019f11 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:16.635356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29941a79-d223-4276-bc20-5bb555019f11 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:16.635808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29941a79-d223-4276-bc20-5bb555019f11 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:16.636233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29941a79-d223-4276-bc20-5bb555019f11 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:16.644176 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5bbb3085-6bb8-42e8-9765-c2c64fb47667 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/3a2696e9-bcef-4926-8e45-45d1ce108fb4" status: 202 len: 0 microversion: 2.1 time: 0.540339 Oct 24 10:36:16.645523 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1371/2706] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:16 2022] DELETE /compute/v2.1/os-security-groups/3a2696e9-bcef-4926-8e45-45d1ce108fb4 => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:36:16.651485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e83d8aa6-1748-4ac6-be59-12f3465a0e12 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:16.654076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e83d8aa6-1748-4ac6-be59-12f3465a0e12 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:16.670105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e83d8aa6-1748-4ac6-be59-12f3465a0e12 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:16.671570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e83d8aa6-1748-4ac6-be59-12f3465a0e12 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:16.672234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e83d8aa6-1748-4ac6-be59-12f3465a0e12 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:16.673274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e83d8aa6-1748-4ac6-be59-12f3465a0e12 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:16.673983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e83d8aa6-1748-4ac6-be59-12f3465a0e12 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:16.675817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e83d8aa6-1748-4ac6-be59-12f3465a0e12 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:16.934166 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e83d8aa6-1748-4ac6-be59-12f3465a0e12 tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43/action" status: 202 len: 0 microversion: 2.1 time: 0.286944 Oct 24 10:36:16.944521 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1372/2707] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:36:16 2022] POST /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:36:16.975859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4504ceba-34f8-4e35-b016-a9b8a071746c tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Calling method '.version_select at 0x7f04d4e93670>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:16.977339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-29941a79-d223-4276-bc20-5bb555019f11 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:16.988902 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-29941a79-d223-4276-bc20-5bb555019f11 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1315 microversion: 2.1 time: 0.374278 Oct 24 10:36:16.990028 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1336/2708] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:16 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:16.996907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-570900b4-8cc5-462e-81f9-a532ce718bbf tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:16.999185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-570900b4-8cc5-462e-81f9-a532ce718bbf tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:17.017582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-570900b4-8cc5-462e-81f9-a532ce718bbf tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:17.018092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-570900b4-8cc5-462e-81f9-a532ce718bbf tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:17.020706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-570900b4-8cc5-462e-81f9-a532ce718bbf tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:17.021483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-570900b4-8cc5-462e-81f9-a532ce718bbf tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:17.021958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-570900b4-8cc5-462e-81f9-a532ce718bbf tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:17.022403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-570900b4-8cc5-462e-81f9-a532ce718bbf tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:17.431840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-570900b4-8cc5-462e-81f9-a532ce718bbf tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:17.442150 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-570900b4-8cc5-462e-81f9-a532ce718bbf tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1314 microversion: 2.1 time: 0.450163 Oct 24 10:36:17.457509 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1337/2709] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:16 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:17.463408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e0457e26-2acd-47b6-90be-04d7cbcbeabb tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:17.464478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e0457e26-2acd-47b6-90be-04d7cbcbeabb tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:17.471978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0457e26-2acd-47b6-90be-04d7cbcbeabb tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:17.472677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0457e26-2acd-47b6-90be-04d7cbcbeabb tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:17.473159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0457e26-2acd-47b6-90be-04d7cbcbeabb tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:17.473865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0457e26-2acd-47b6-90be-04d7cbcbeabb tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:17.474495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0457e26-2acd-47b6-90be-04d7cbcbeabb tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:17.475109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0457e26-2acd-47b6-90be-04d7cbcbeabb tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:17.508686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0457e26-2acd-47b6-90be-04d7cbcbeabb tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:17.509469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0457e26-2acd-47b6-90be-04d7cbcbeabb tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:17.509902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0457e26-2acd-47b6-90be-04d7cbcbeabb tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:17.510515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-e0457e26-2acd-47b6-90be-04d7cbcbeabb tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lazy-loading 'fault' on Instance uuid 485d2945-20d9-4620-a9e5-004680c44d43 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:36:17.793459 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4504ceba-34f8-4e35-b016-a9b8a071746c tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/38683dea-2883-409a-bc55-eb08098f0599" status: 202 len: 0 microversion: 2.1 time: 0.848058 Oct 24 10:36:17.794052 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1373/2710] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:16 2022] DELETE /compute/v2.1/os-security-groups/38683dea-2883-409a-bc55-eb08098f0599 => generated 0 bytes in 849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:36:17.799585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6ea7b2e2-a656-47b3-922b-788b741ef98b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:17.800199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6ea7b2e2-a656-47b3-922b-788b741ef98b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] [instance: 0e14a4e9-2c60-4604-a670-dd4ea589e5f4] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:17.809959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ea7b2e2-a656-47b3-922b-788b741ef98b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:17.811131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ea7b2e2-a656-47b3-922b-788b741ef98b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:17.811586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ea7b2e2-a656-47b3-922b-788b741ef98b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:17.812307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ea7b2e2-a656-47b3-922b-788b741ef98b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:17.813018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ea7b2e2-a656-47b3-922b-788b741ef98b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:17.813642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ea7b2e2-a656-47b3-922b-788b741ef98b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:17.830936 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-6ea7b2e2-a656-47b3-922b-788b741ef98b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] HTTP exception thrown: Instance 0e14a4e9-2c60-4604-a670-dd4ea589e5f4 could not be found. Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6ea7b2e2-a656-47b3-922b-788b741ef98b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Request method failure captured: Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 HTTP/1.1 Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmoaXPClcPLJ9gE_6C5GjDQZGdene0OObxZB0Z9ED_DBUfNEOv3AFVz9Sj51DSTvjG5d4L4G0Y7Y2LCJ3yblYYRp_EY66mnirefPs52lqIDsBuo9XJUGZQDidaxp2-3kvGCo_yrNtYTWeu7uqgvMarg1Wuv91gUnqbIjaBzXZEG6tDA Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/60b1c666c4914debad43704393d651cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/60b1c666c4914debad43704393d651cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_60b1c666c4914debad43704393d651cf", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 60b1c666c4914debad43704393d651cf Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1871338820 Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 6aeb81e9b2fa4796813c607234174af6 Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-SecurityGroupsTestJSON-1871338820-project Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 0e14a4e9-2c60-4604-a670-dd4ea589e5f4 could not be found. Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '0e14a4e9-2c60-4604-a670-dd4ea589e5f4'} Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e14a4e9-2c60-4604-a670-dd4ea589e5f4 could not be found. Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e14a4e9-2c60-4604-a670-dd4ea589e5f4 could not be found. Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:17.832857 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:17.837993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:17.837993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:17.837993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:17.837993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:36:17.837993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:36:17.837993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e14a4e9-2c60-4604-a670-dd4ea589e5f4 could not be found. Oct 24 10:36:17.837993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:17.837993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6ea7b2e2-a656-47b3-922b-788b741ef98b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Returning 404 to user: Instance 0e14a4e9-2c60-4604-a670-dd4ea589e5f4 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:36:17.837993 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6ea7b2e2-a656-47b3-922b-788b741ef98b tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4" status: 404 len: 111 microversion: 2.1 time: 0.039281 Oct 24 10:36:17.839212 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e0457e26-2acd-47b6-90be-04d7cbcbeabb tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1599 microversion: 2.1 time: 0.378184 Oct 24 10:36:17.839212 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1338/2711] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:17 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1599 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:17.849874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-169e4741-bb6a-4485-aad1-d29a47dd1d51 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:17.850777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-169e4741-bb6a-4485-aad1-d29a47dd1d51 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:17.853472 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1374/2712] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:17 2022] GET /compute/v2.1/servers/0e14a4e9-2c60-4604-a670-dd4ea589e5f4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:36:17.859081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-ee9e5ab5-2bda-469d-8bbd-b3b7c9b93c3d req-6e57c0fd-e227-4a02-a7ef-417a9df43d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e14a4e9-2c60-4604-a670-dd4ea589e5f4", "name": "network-vif-deleted", "tag": "22ad6515-0ea9-46ea-b637-abe57e0376b9"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:17.859990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-169e4741-bb6a-4485-aad1-d29a47dd1d51 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:17.861024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-169e4741-bb6a-4485-aad1-d29a47dd1d51 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:17.861638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-169e4741-bb6a-4485-aad1-d29a47dd1d51 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:17.862515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-169e4741-bb6a-4485-aad1-d29a47dd1d51 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:17.863151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-169e4741-bb6a-4485-aad1-d29a47dd1d51 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:17.864088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-169e4741-bb6a-4485-aad1-d29a47dd1d51 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:17.870297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ee9e5ab5-2bda-469d-8bbd-b3b7c9b93c3d req-6e57c0fd-e227-4a02-a7ef-417a9df43d22 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:17.870780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ee9e5ab5-2bda-469d-8bbd-b3b7c9b93c3d req-6e57c0fd-e227-4a02-a7ef-417a9df43d22 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:17.871213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ee9e5ab5-2bda-469d-8bbd-b3b7c9b93c3d req-6e57c0fd-e227-4a02-a7ef-417a9df43d22 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:17.883201 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ee9e5ab5-2bda-469d-8bbd-b3b7c9b93c3d req-6e57c0fd-e227-4a02-a7ef-417a9df43d22 service nova] Creating event network-vif-deleted:22ad6515-0ea9-46ea-b637-abe57e0376b9 for instance 0e14a4e9-2c60-4604-a670-dd4ea589e5f4 on n-h2-858383-15 Oct 24 10:36:17.888088 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-ee9e5ab5-2bda-469d-8bbd-b3b7c9b93c3d req-6e57c0fd-e227-4a02-a7ef-417a9df43d22 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033141 Oct 24 10:36:17.888866 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1375/2713] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:17.894329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ef721632-ebd8-4828-8d52-eeabe8b1914d tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Calling method '.version_select at 0x7f04d4eb94c0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:18.084124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-169e4741-bb6a-4485-aad1-d29a47dd1d51 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9fe821ad1b43f2988dd30521c6c335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c125be93d647e1b2c0fdd4ae2efb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:18.094276 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-169e4741-bb6a-4485-aad1-d29a47dd1d51 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 200 len: 1316 microversion: 2.1 time: 0.255598 Oct 24 10:36:18.095779 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1339/2714] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:17 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:18.100598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-94fcc594-ebed-422f-a381-4c2d40f5d397 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d0f09a60>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:18.293473 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ef721632-ebd8-4828-8d52-eeabe8b1914d tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/9c04cac8-91e3-400f-9e13-8db5d62e8a8b" status: 202 len: 0 microversion: 2.1 time: 0.402915 Oct 24 10:36:18.294404 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1376/2715] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:17 2022] DELETE /compute/v2.1/os-security-groups/9c04cac8-91e3-400f-9e13-8db5d62e8a8b => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:36:18.302139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9bedeac7-b19e-42b5-9d1b-46c78229a47c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:18.307831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9bedeac7-b19e-42b5-9d1b-46c78229a47c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:18.326772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bedeac7-b19e-42b5-9d1b-46c78229a47c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:18.327555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bedeac7-b19e-42b5-9d1b-46c78229a47c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:18.328173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bedeac7-b19e-42b5-9d1b-46c78229a47c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:18.339847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bedeac7-b19e-42b5-9d1b-46c78229a47c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:18.340805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bedeac7-b19e-42b5-9d1b-46c78229a47c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:18.342939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bedeac7-b19e-42b5-9d1b-46c78229a47c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:18.423896 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-94fcc594-ebed-422f-a381-4c2d40f5d397 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/f3525e21-8afd-4841-ba09-7233d57abc4c" status: 202 len: 0 microversion: 2.1 time: 0.327100 Oct 24 10:36:18.424783 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1340/2716] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:18 2022] DELETE /compute/v2.1/os-security-groups/f3525e21-8afd-4841-ba09-7233d57abc4c => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:36:18.429741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2c1fed63-afd9-47b1-b7be-172910aef05b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:18.430703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2c1fed63-afd9-47b1-b7be-172910aef05b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:18.460116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c1fed63-afd9-47b1-b7be-172910aef05b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:18.462707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c1fed63-afd9-47b1-b7be-172910aef05b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:18.464320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c1fed63-afd9-47b1-b7be-172910aef05b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:18.465245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c1fed63-afd9-47b1-b7be-172910aef05b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:18.465739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c1fed63-afd9-47b1-b7be-172910aef05b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:18.466165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c1fed63-afd9-47b1-b7be-172910aef05b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:18.470788 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9bedeac7-b19e-42b5-9d1b-46c78229a47c tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43/action" status: 202 len: 0 microversion: 2.1 time: 0.173416 Oct 24 10:36:18.472771 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1377/2717] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:36:18 2022] POST /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:36:18.478897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0a8bbd75-8936-4158-8777-fd14b80c9087 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Calling method '.version_select at 0x7f04d4e28d30>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:18.668060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c1fed63-afd9-47b1-b7be-172910aef05b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:18.678907 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2c1fed63-afd9-47b1-b7be-172910aef05b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1315 microversion: 2.1 time: 0.252855 Oct 24 10:36:18.679510 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1341/2718] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:18 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:18.698888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-039296fc-a754-4bec-a978-5ece070e64b2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] Calling method '.version_select at 0x7f04d0f093a0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:18.854565 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0a8bbd75-8936-4158-8777-fd14b80c9087 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/3d351b5a-8c29-428a-8e50-d97a03618137" status: 202 len: 0 microversion: 2.1 time: 0.380321 Oct 24 10:36:18.855610 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1378/2719] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:18 2022] DELETE /compute/v2.1/os-security-groups/3d351b5a-8c29-428a-8e50-d97a03618137 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:36:18.862580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-15e5ac76-a161-4188-9370-d25d4a314177 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:18.863417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-15e5ac76-a161-4188-9370-d25d4a314177 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:18.876221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15e5ac76-a161-4188-9370-d25d4a314177 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:18.876817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15e5ac76-a161-4188-9370-d25d4a314177 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:18.877615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15e5ac76-a161-4188-9370-d25d4a314177 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:18.878984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15e5ac76-a161-4188-9370-d25d4a314177 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:18.882040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15e5ac76-a161-4188-9370-d25d4a314177 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:18.897746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15e5ac76-a161-4188-9370-d25d4a314177 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:19.132765 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-039296fc-a754-4bec-a978-5ece070e64b2 tempest-SecurityGroupsTestJSON-1871338820 tempest-SecurityGroupsTestJSON-1871338820-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/a46c983e-76a2-403e-baa4-ac7c01c3761d" status: 202 len: 0 microversion: 2.1 time: 0.438206 Oct 24 10:36:19.136505 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1342/2720] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:18 2022] DELETE /compute/v2.1/os-security-groups/a46c983e-76a2-403e-baa4-ac7c01c3761d => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:36:19.137903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6e491709-55ef-424b-bd0e-1394732b51ca tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:19.138524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6e491709-55ef-424b-bd0e-1394732b51ca tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:19.151955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e491709-55ef-424b-bd0e-1394732b51ca tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:19.152457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e491709-55ef-424b-bd0e-1394732b51ca tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:19.152930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e491709-55ef-424b-bd0e-1394732b51ca tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:19.153647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e491709-55ef-424b-bd0e-1394732b51ca tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:19.157115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e491709-55ef-424b-bd0e-1394732b51ca tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:19.160341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e491709-55ef-424b-bd0e-1394732b51ca tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:19.199948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:19.434599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-15e5ac76-a161-4188-9370-d25d4a314177 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:19.460596 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-15e5ac76-a161-4188-9370-d25d4a314177 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1501 microversion: 2.1 time: 0.603296 Oct 24 10:36:19.482786 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1379/2721] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:18 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1501 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:19.496113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-746b0858-2fa6-4c5d-9fa6-8e5311313a51 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] Calling method '.version_select at 0x7f04d4e1f0d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:19.644363 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6e491709-55ef-424b-bd0e-1394732b51ca tempest-ServersAdminTestJSON-1523075954 tempest-ServersAdminTestJSON-1523075954-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1616 microversion: 2.1 time: 0.509832 Oct 24 10:36:19.661648 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1343/2722] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:19 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1616 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:19.661648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a3578be5-ae54-4e34-b695-107fbbcb34db tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:19.661648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a3578be5-ae54-4e34-b695-107fbbcb34db tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:19.661648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3578be5-ae54-4e34-b695-107fbbcb34db tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:19.661648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3578be5-ae54-4e34-b695-107fbbcb34db tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:19.661648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3578be5-ae54-4e34-b695-107fbbcb34db tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:19.665545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3578be5-ae54-4e34-b695-107fbbcb34db tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:19.671149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3578be5-ae54-4e34-b695-107fbbcb34db tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:19.674929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3578be5-ae54-4e34-b695-107fbbcb34db tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:19.935098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a3578be5-ae54-4e34-b695-107fbbcb34db tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9fe821ad1b43f2988dd30521c6c335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c125be93d647e1b2c0fdd4ae2efb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:19.945901 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a3578be5-ae54-4e34-b695-107fbbcb34db tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 200 len: 1316 microversion: 2.1 time: 0.299852 Oct 24 10:36:19.949893 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1344/2723] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:19 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:19.954927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c1803848-d2ba-4665-86ed-23aaa25ec201 req-38cb0aff-89c7-4cf9-bf93-1b3c7e5d8f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b", "name": "network-vif-plugged", "status": "completed", "tag": "2d820800-6db0-4bcd-9d32-e49d1a19862a"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:19.988311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c1803848-d2ba-4665-86ed-23aaa25ec201 req-38cb0aff-89c7-4cf9-bf93-1b3c7e5d8f3e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:19.989044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c1803848-d2ba-4665-86ed-23aaa25ec201 req-38cb0aff-89c7-4cf9-bf93-1b3c7e5d8f3e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:19.992772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c1803848-d2ba-4665-86ed-23aaa25ec201 req-38cb0aff-89c7-4cf9-bf93-1b3c7e5d8f3e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:20.031022 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c1803848-d2ba-4665-86ed-23aaa25ec201 req-38cb0aff-89c7-4cf9-bf93-1b3c7e5d8f3e service nova] Creating event network-vif-plugged:2d820800-6db0-4bcd-9d32-e49d1a19862a for instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b on n-h1-858383-15 Oct 24 10:36:20.050016 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c1803848-d2ba-4665-86ed-23aaa25ec201 req-38cb0aff-89c7-4cf9-bf93-1b3c7e5d8f3e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098532 Oct 24 10:36:20.050690 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1345/2724] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:20.056309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-01ba9368-11e8-4216-9d26-7171c3c2f11a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:20.073402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01ba9368-11e8-4216-9d26-7171c3c2f11a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:20.073902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01ba9368-11e8-4216-9d26-7171c3c2f11a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:20.074351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01ba9368-11e8-4216-9d26-7171c3c2f11a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:20.132173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-01ba9368-11e8-4216-9d26-7171c3c2f11a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Going to try to stop instance {{(pid=120425) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 10:36:20.242767 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-01ba9368-11e8-4216-9d26-7171c3c2f11a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c/action" status: 202 len: 0 microversion: 2.1 time: 0.189306 Oct 24 10:36:20.262223 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1346/2725] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:36:20 2022] POST /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:36:20.285050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-86c81bfe-d0e6-41c7-9303-4bd1c1afd047 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:20.286036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-86c81bfe-d0e6-41c7-9303-4bd1c1afd047 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:20.302908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86c81bfe-d0e6-41c7-9303-4bd1c1afd047 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:20.303414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86c81bfe-d0e6-41c7-9303-4bd1c1afd047 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:20.303859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86c81bfe-d0e6-41c7-9303-4bd1c1afd047 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:20.304580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86c81bfe-d0e6-41c7-9303-4bd1c1afd047 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:20.307639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86c81bfe-d0e6-41c7-9303-4bd1c1afd047 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:20.309538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86c81bfe-d0e6-41c7-9303-4bd1c1afd047 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:20.344947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-86c81bfe-d0e6-41c7-9303-4bd1c1afd047 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:36:20.475153 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-86c81bfe-d0e6-41c7-9303-4bd1c1afd047 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "DELETE /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5" status: 204 len: 0 microversion: 2.1 time: 0.210932 Oct 24 10:36:20.476294 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1347/2726] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:36:20 2022] DELETE /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:36:20.493016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cfd4f2cc-c4e6-4fac-b9cf-871284cebc6b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:20.494025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cfd4f2cc-c4e6-4fac-b9cf-871284cebc6b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:20.507652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfd4f2cc-c4e6-4fac-b9cf-871284cebc6b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:20.508232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfd4f2cc-c4e6-4fac-b9cf-871284cebc6b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:20.508703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfd4f2cc-c4e6-4fac-b9cf-871284cebc6b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:20.514510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfd4f2cc-c4e6-4fac-b9cf-871284cebc6b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:20.515279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfd4f2cc-c4e6-4fac-b9cf-871284cebc6b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:20.515753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfd4f2cc-c4e6-4fac-b9cf-871284cebc6b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:20.640664 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-746b0858-2fa6-4c5d-9fa6-8e5311313a51 tempest-SecurityGroupRulesTestJSON-1215572518 tempest-SecurityGroupRulesTestJSON-1215572518-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/38d441a4-45ed-460e-85f3-d90770bcaca6" status: 202 len: 0 microversion: 2.1 time: 1.152872 Oct 24 10:36:20.643958 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1380/2727] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:36:19 2022] DELETE /compute/v2.1/os-security-groups/38d441a4-45ed-460e-85f3-d90770bcaca6 => generated 0 bytes in 1160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:36:20.650054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e7e43c42-e69d-4abf-93ca-7ab6f53f83fb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:20.651033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e7e43c42-e69d-4abf-93ca-7ab6f53f83fb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:20.659866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7e43c42-e69d-4abf-93ca-7ab6f53f83fb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:20.661384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7e43c42-e69d-4abf-93ca-7ab6f53f83fb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:20.684563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7e43c42-e69d-4abf-93ca-7ab6f53f83fb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:20.692824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7e43c42-e69d-4abf-93ca-7ab6f53f83fb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:20.695677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7e43c42-e69d-4abf-93ca-7ab6f53f83fb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:20.698668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7e43c42-e69d-4abf-93ca-7ab6f53f83fb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:20.768063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cfd4f2cc-c4e6-4fac-b9cf-871284cebc6b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:20.776248 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cfd4f2cc-c4e6-4fac-b9cf-871284cebc6b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1315 microversion: 2.1 time: 0.298711 Oct 24 10:36:20.777450 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1348/2728] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:20 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:20.786892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b9af4a55-b0f8-498c-834f-7984fc0e227d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:20.787749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b9af4a55-b0f8-498c-834f-7984fc0e227d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:20.795050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9af4a55-b0f8-498c-834f-7984fc0e227d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:20.796822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9af4a55-b0f8-498c-834f-7984fc0e227d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:20.797517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9af4a55-b0f8-498c-834f-7984fc0e227d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:20.799783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9af4a55-b0f8-498c-834f-7984fc0e227d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:20.801315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9af4a55-b0f8-498c-834f-7984fc0e227d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:20.802243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9af4a55-b0f8-498c-834f-7984fc0e227d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:21.162210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e7e43c42-e69d-4abf-93ca-7ab6f53f83fb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:21.171069 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e7e43c42-e69d-4abf-93ca-7ab6f53f83fb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1511 microversion: 2.1 time: 0.524909 Oct 24 10:36:21.171947 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1381/2729] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:20 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1511 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:21.176713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-80e6c8c0-66fb-4d90-8e0b-c0b37693d011 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:21.177434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-80e6c8c0-66fb-4d90-8e0b-c0b37693d011 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:21.180457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:21.184158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80e6c8c0-66fb-4d90-8e0b-c0b37693d011 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:21.184723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80e6c8c0-66fb-4d90-8e0b-c0b37693d011 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:21.185262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80e6c8c0-66fb-4d90-8e0b-c0b37693d011 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:21.186262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80e6c8c0-66fb-4d90-8e0b-c0b37693d011 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:21.186928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80e6c8c0-66fb-4d90-8e0b-c0b37693d011 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:21.187786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80e6c8c0-66fb-4d90-8e0b-c0b37693d011 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:21.216442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9af4a55-b0f8-498c-834f-7984fc0e227d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:21.227708 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b9af4a55-b0f8-498c-834f-7984fc0e227d tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5" status: 200 len: 1470 microversion: 2.1 time: 0.449066 Oct 24 10:36:21.229460 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1349/2730] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:20 2022] GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5 => generated 1470 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:21.381659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-80e6c8c0-66fb-4d90-8e0b-c0b37693d011 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9fe821ad1b43f2988dd30521c6c335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c125be93d647e1b2c0fdd4ae2efb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:21.397215 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-80e6c8c0-66fb-4d90-8e0b-c0b37693d011 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 200 len: 1316 microversion: 2.1 time: 0.219630 Oct 24 10:36:21.397872 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1382/2731] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:21 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:21.802036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b81f2af2-5906-4f41-b98d-decef0014ff3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:21.803322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b81f2af2-5906-4f41-b98d-decef0014ff3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:21.818200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b81f2af2-5906-4f41-b98d-decef0014ff3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:21.818935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b81f2af2-5906-4f41-b98d-decef0014ff3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:21.819551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b81f2af2-5906-4f41-b98d-decef0014ff3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:21.822066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b81f2af2-5906-4f41-b98d-decef0014ff3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:21.822718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b81f2af2-5906-4f41-b98d-decef0014ff3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:21.823635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b81f2af2-5906-4f41-b98d-decef0014ff3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:22.201701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-176f6775-2b37-4f2c-8527-c3bfeb26a0fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:22.202337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-176f6775-2b37-4f2c-8527-c3bfeb26a0fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:22.211917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-176f6775-2b37-4f2c-8527-c3bfeb26a0fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:22.212884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-176f6775-2b37-4f2c-8527-c3bfeb26a0fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:22.213835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-176f6775-2b37-4f2c-8527-c3bfeb26a0fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:22.214781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-176f6775-2b37-4f2c-8527-c3bfeb26a0fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:22.215462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-176f6775-2b37-4f2c-8527-c3bfeb26a0fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:22.216102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-176f6775-2b37-4f2c-8527-c3bfeb26a0fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:22.268519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b81f2af2-5906-4f41-b98d-decef0014ff3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:22.285188 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b81f2af2-5906-4f41-b98d-decef0014ff3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1315 microversion: 2.1 time: 0.487170 Oct 24 10:36:22.303713 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1350/2732] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:21 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:22.310335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad5f0d47-b5a6-4f72-bad1-deeb4827291f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:22.311703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad5f0d47-b5a6-4f72-bad1-deeb4827291f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:22.320229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad5f0d47-b5a6-4f72-bad1-deeb4827291f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:22.321160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad5f0d47-b5a6-4f72-bad1-deeb4827291f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:22.321824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad5f0d47-b5a6-4f72-bad1-deeb4827291f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:22.322759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad5f0d47-b5a6-4f72-bad1-deeb4827291f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:22.323819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad5f0d47-b5a6-4f72-bad1-deeb4827291f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:22.324485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad5f0d47-b5a6-4f72-bad1-deeb4827291f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:22.799188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-176f6775-2b37-4f2c-8527-c3bfeb26a0fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:22.807933 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-176f6775-2b37-4f2c-8527-c3bfeb26a0fc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1511 microversion: 2.1 time: 0.613424 Oct 24 10:36:22.821666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ad5f0d47-b5a6-4f72-bad1-deeb4827291f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:22.822191 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1383/2733] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:22 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1511 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:36:22.836025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7f572d7f-d2ce-49db-9462-5cc9e6c1e7de tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:22.836453 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad5f0d47-b5a6-4f72-bad1-deeb4827291f tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5" status: 200 len: 1470 microversion: 2.1 time: 0.526373 Oct 24 10:36:22.837471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7f572d7f-d2ce-49db-9462-5cc9e6c1e7de tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:22.840793 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1351/2734] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:22 2022] GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5 => generated 1470 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:22.846932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f572d7f-d2ce-49db-9462-5cc9e6c1e7de tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:22.847556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f572d7f-d2ce-49db-9462-5cc9e6c1e7de tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:22.848082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f572d7f-d2ce-49db-9462-5cc9e6c1e7de tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:22.849051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f572d7f-d2ce-49db-9462-5cc9e6c1e7de tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:22.849759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f572d7f-d2ce-49db-9462-5cc9e6c1e7de tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:22.850391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f572d7f-d2ce-49db-9462-5cc9e6c1e7de tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:23.312017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c22abdb-817c-43c3-a41e-cfee5790ad85 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:23.314796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4c22abdb-817c-43c3-a41e-cfee5790ad85 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:23.325350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c22abdb-817c-43c3-a41e-cfee5790ad85 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:23.341059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c22abdb-817c-43c3-a41e-cfee5790ad85 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:23.342826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c22abdb-817c-43c3-a41e-cfee5790ad85 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:23.344235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c22abdb-817c-43c3-a41e-cfee5790ad85 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:23.346681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c22abdb-817c-43c3-a41e-cfee5790ad85 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:23.347283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c22abdb-817c-43c3-a41e-cfee5790ad85 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:23.391409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7f572d7f-d2ce-49db-9462-5cc9e6c1e7de tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9fe821ad1b43f2988dd30521c6c335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c125be93d647e1b2c0fdd4ae2efb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:23.407400 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7f572d7f-d2ce-49db-9462-5cc9e6c1e7de tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 200 len: 1316 microversion: 2.1 time: 0.584018 Oct 24 10:36:23.417147 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1384/2735] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:22 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 1316 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:23.784476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c22abdb-817c-43c3-a41e-cfee5790ad85 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:23.793571 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4c22abdb-817c-43c3-a41e-cfee5790ad85 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1501 microversion: 2.1 time: 0.486080 Oct 24 10:36:23.796355 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1352/2736] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:23 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1501 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:23.838394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-44b80f47-150a-4026-b085-e2d525f273de tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:23.839353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-44b80f47-150a-4026-b085-e2d525f273de tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:23.857063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44b80f47-150a-4026-b085-e2d525f273de tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:23.866708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fef8674c-006a-48af-98fe-5d5711ec1f19 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:23.868766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fef8674c-006a-48af-98fe-5d5711ec1f19 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:23.871611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44b80f47-150a-4026-b085-e2d525f273de tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:23.876118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44b80f47-150a-4026-b085-e2d525f273de tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:23.878769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44b80f47-150a-4026-b085-e2d525f273de tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:23.886021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44b80f47-150a-4026-b085-e2d525f273de tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:23.889633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44b80f47-150a-4026-b085-e2d525f273de tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:23.912409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fef8674c-006a-48af-98fe-5d5711ec1f19 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:23.916864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fef8674c-006a-48af-98fe-5d5711ec1f19 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:23.918867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fef8674c-006a-48af-98fe-5d5711ec1f19 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:23.922311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fef8674c-006a-48af-98fe-5d5711ec1f19 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:23.928241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fef8674c-006a-48af-98fe-5d5711ec1f19 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:23.929499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fef8674c-006a-48af-98fe-5d5711ec1f19 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:23.985062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:24.489994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-44b80f47-150a-4026-b085-e2d525f273de tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:24.500519 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-44b80f47-150a-4026-b085-e2d525f273de tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1511 microversion: 2.1 time: 0.667335 Oct 24 10:36:24.508618 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1385/2737] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:23 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1511 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:36:24.535200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a4f2cd29-9e7c-4a78-a54f-7f37683cf3e5 req-0654b171-8349-4e63-809c-bb15ca5e57d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e16c14-6d0e-49a5-9948-298c2e667999", "name": "network-vif-plugged", "status": "completed", "tag": "bddb3b72-49df-48b0-b7ca-ad03dc04e320"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:24.535740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fef8674c-006a-48af-98fe-5d5711ec1f19 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:24.546879 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fef8674c-006a-48af-98fe-5d5711ec1f19 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5" status: 200 len: 1470 microversion: 2.1 time: 0.685748 Oct 24 10:36:24.558331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a4f2cd29-9e7c-4a78-a54f-7f37683cf3e5 req-0654b171-8349-4e63-809c-bb15ca5e57d4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:24.558807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a4f2cd29-9e7c-4a78-a54f-7f37683cf3e5 req-0654b171-8349-4e63-809c-bb15ca5e57d4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:24.559329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a4f2cd29-9e7c-4a78-a54f-7f37683cf3e5 req-0654b171-8349-4e63-809c-bb15ca5e57d4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:24.566652 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1353/2738] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:23 2022] GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5 => generated 1470 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:36:24.577626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7b3bf193-e9af-44b3-aab5-6d5e5d675748 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:24.578539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7b3bf193-e9af-44b3-aab5-6d5e5d675748 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:24.588682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b3bf193-e9af-44b3-aab5-6d5e5d675748 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:24.590440 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a4f2cd29-9e7c-4a78-a54f-7f37683cf3e5 req-0654b171-8349-4e63-809c-bb15ca5e57d4 service nova] Creating event network-vif-plugged:bddb3b72-49df-48b0-b7ca-ad03dc04e320 for instance 42e16c14-6d0e-49a5-9948-298c2e667999 on n-h2-858383-15 Oct 24 10:36:24.595831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b3bf193-e9af-44b3-aab5-6d5e5d675748 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:24.596323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b3bf193-e9af-44b3-aab5-6d5e5d675748 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:24.597131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b3bf193-e9af-44b3-aab5-6d5e5d675748 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:24.597602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b3bf193-e9af-44b3-aab5-6d5e5d675748 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:24.598030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b3bf193-e9af-44b3-aab5-6d5e5d675748 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:24.604646 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a4f2cd29-9e7c-4a78-a54f-7f37683cf3e5 req-0654b171-8349-4e63-809c-bb15ca5e57d4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090809 Oct 24 10:36:24.606351 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1386/2739] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:24.626757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-f6c0aa3a-b55e-4051-9c0e-d18770c7b545 req-de203a37-d074-487e-8c9f-ab05c4faf866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25185635-1966-4f64-8616-7698ea9e04c5", "name": "network-vif-deleted", "tag": "3b489847-d634-4d76-a8f5-79292a60ebab"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:24.670792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f6c0aa3a-b55e-4051-9c0e-d18770c7b545 req-de203a37-d074-487e-8c9f-ab05c4faf866 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:24.677627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f6c0aa3a-b55e-4051-9c0e-d18770c7b545 req-de203a37-d074-487e-8c9f-ab05c4faf866 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:24.678326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f6c0aa3a-b55e-4051-9c0e-d18770c7b545 req-de203a37-d074-487e-8c9f-ab05c4faf866 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:24.719476 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f6c0aa3a-b55e-4051-9c0e-d18770c7b545 req-de203a37-d074-487e-8c9f-ab05c4faf866 service nova] Creating event network-vif-deleted:3b489847-d634-4d76-a8f5-79292a60ebab for instance 25185635-1966-4f64-8616-7698ea9e04c5 on n-h2-858383-15 Oct 24 10:36:24.728522 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-f6c0aa3a-b55e-4051-9c0e-d18770c7b545 req-de203a37-d074-487e-8c9f-ab05c4faf866 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107309 Oct 24 10:36:24.730714 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1387/2740] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:36:25.539080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-961884b7-d738-41fe-ad15-bbb262583ddb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:25.540996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-961884b7-d738-41fe-ad15-bbb262583ddb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:25.551197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-961884b7-d738-41fe-ad15-bbb262583ddb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:25.551670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-961884b7-d738-41fe-ad15-bbb262583ddb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:25.552404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-961884b7-d738-41fe-ad15-bbb262583ddb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:25.553547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-961884b7-d738-41fe-ad15-bbb262583ddb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:25.554457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-961884b7-d738-41fe-ad15-bbb262583ddb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:25.555479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-961884b7-d738-41fe-ad15-bbb262583ddb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:25.922008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7b3bf193-e9af-44b3-aab5-6d5e5d675748 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9fe821ad1b43f2988dd30521c6c335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c125be93d647e1b2c0fdd4ae2efb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:25.937802 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7b3bf193-e9af-44b3-aab5-6d5e5d675748 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 200 len: 1316 microversion: 2.1 time: 1.369917 Oct 24 10:36:25.953615 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1354/2741] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:24 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 1316 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:25.959105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c18eae53-c724-43f1-bab2-3382557c7d69 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:25.959737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c18eae53-c724-43f1-bab2-3382557c7d69 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:25.972294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c18eae53-c724-43f1-bab2-3382557c7d69 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:25.972792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c18eae53-c724-43f1-bab2-3382557c7d69 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:25.979306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c18eae53-c724-43f1-bab2-3382557c7d69 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:25.980715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c18eae53-c724-43f1-bab2-3382557c7d69 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:25.981253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c18eae53-c724-43f1-bab2-3382557c7d69 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:25.981672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c18eae53-c724-43f1-bab2-3382557c7d69 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:26.070658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c18eae53-c724-43f1-bab2-3382557c7d69 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:26.071373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c18eae53-c724-43f1-bab2-3382557c7d69 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:26.074438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c18eae53-c724-43f1-bab2-3382557c7d69 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:26.075323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-c18eae53-c724-43f1-bab2-3382557c7d69 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lazy-loading 'fault' on Instance uuid 25185635-1966-4f64-8616-7698ea9e04c5 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:36:26.132982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-961884b7-d738-41fe-ad15-bbb262583ddb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:26.142687 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-961884b7-d738-41fe-ad15-bbb262583ddb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1511 microversion: 2.1 time: 0.612260 Oct 24 10:36:26.149704 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1388/2742] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:25 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1511 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:36:26.165718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c18eae53-c724-43f1-bab2-3382557c7d69 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:26.178063 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c18eae53-c724-43f1-bab2-3382557c7d69 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5" status: 200 len: 1304 microversion: 2.1 time: 0.223022 Oct 24 10:36:26.193458 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1355/2743] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:25 2022] GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5 => generated 1304 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:26.466754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0d7f8c7e-f46d-41e2-9127-ec92e18c3e1d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bd8f994-6f74-4786-a29c-5e3d812a3960"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:26.470251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0d7f8c7e-f46d-41e2-9127-ec92e18c3e1d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:26.482146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d7f8c7e-f46d-41e2-9127-ec92e18c3e1d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:26.483175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d7f8c7e-f46d-41e2-9127-ec92e18c3e1d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:26.483629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d7f8c7e-f46d-41e2-9127-ec92e18c3e1d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:26.484323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d7f8c7e-f46d-41e2-9127-ec92e18c3e1d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:26.484777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d7f8c7e-f46d-41e2-9127-ec92e18c3e1d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:26.485245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d7f8c7e-f46d-41e2-9127-ec92e18c3e1d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:26.965400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd4e8c61-7771-48d9-b7d7-fa71fe76ccdd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:26.967841 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bd4e8c61-7771-48d9-b7d7-fa71fe76ccdd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:26.983646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd4e8c61-7771-48d9-b7d7-fa71fe76ccdd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:26.991717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd4e8c61-7771-48d9-b7d7-fa71fe76ccdd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:26.994850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd4e8c61-7771-48d9-b7d7-fa71fe76ccdd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:26.995876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd4e8c61-7771-48d9-b7d7-fa71fe76ccdd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:26.996699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd4e8c61-7771-48d9-b7d7-fa71fe76ccdd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:26.997655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd4e8c61-7771-48d9-b7d7-fa71fe76ccdd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:27.010775 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0d7f8c7e-f46d-41e2-9127-ec92e18c3e1d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "POST /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547882 Oct 24 10:36:27.017218 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1389/2744] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 10:36:26 2022] POST /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b/os-volume_attachments => generated 194 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:27.169565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-922f9a6b-56da-4de5-a15e-93f30eb8791b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:27.171089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-922f9a6b-56da-4de5-a15e-93f30eb8791b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:27.189967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-922f9a6b-56da-4de5-a15e-93f30eb8791b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:27.190478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-922f9a6b-56da-4de5-a15e-93f30eb8791b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:27.192903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-922f9a6b-56da-4de5-a15e-93f30eb8791b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:27.195371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-922f9a6b-56da-4de5-a15e-93f30eb8791b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:27.195934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-922f9a6b-56da-4de5-a15e-93f30eb8791b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:27.196304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-922f9a6b-56da-4de5-a15e-93f30eb8791b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:27.995419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bd4e8c61-7771-48d9-b7d7-fa71fe76ccdd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9fe821ad1b43f2988dd30521c6c335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c125be93d647e1b2c0fdd4ae2efb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:28.007251 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bd4e8c61-7771-48d9-b7d7-fa71fe76ccdd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 200 len: 1465 microversion: 2.1 time: 1.046079 Oct 24 10:36:28.016429 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1356/2745] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:26 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 1465 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:28.022096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8a0c1f9a-0856-4753-9d7d-4a5094b74f64 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:28.023074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8a0c1f9a-0856-4753-9d7d-4a5094b74f64 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 25185635-1966-4f64-8616-7698ea9e04c5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:28.043875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a0c1f9a-0856-4753-9d7d-4a5094b74f64 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:28.049532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a0c1f9a-0856-4753-9d7d-4a5094b74f64 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:28.050554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a0c1f9a-0856-4753-9d7d-4a5094b74f64 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:28.051841 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a0c1f9a-0856-4753-9d7d-4a5094b74f64 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:28.052712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a0c1f9a-0856-4753-9d7d-4a5094b74f64 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:28.053559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a0c1f9a-0856-4753-9d7d-4a5094b74f64 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:28.068674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-922f9a6b-56da-4de5-a15e-93f30eb8791b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:28.097635 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-922f9a6b-56da-4de5-a15e-93f30eb8791b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1511 microversion: 2.1 time: 0.932539 Oct 24 10:36:28.099300 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1390/2746] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:27 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1511 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:36:28.116991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c890a870-1660-46ef-bef9-5f50ebaeb84c tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1397171568", "metadata": {"image_type": "test"}}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:28.120269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c890a870-1660-46ef-bef9-5f50ebaeb84c tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:28.151006 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-8a0c1f9a-0856-4753-9d7d-4a5094b74f64 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] HTTP exception thrown: Instance 25185635-1966-4f64-8616-7698ea9e04c5 could not be found. Oct 24 10:36:28.153196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c890a870-1660-46ef-bef9-5f50ebaeb84c tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:28.153697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c890a870-1660-46ef-bef9-5f50ebaeb84c tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:28.154140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c890a870-1660-46ef-bef9-5f50ebaeb84c tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:28.154953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c890a870-1660-46ef-bef9-5f50ebaeb84c tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:28.157979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c890a870-1660-46ef-bef9-5f50ebaeb84c tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:28.158545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c890a870-1660-46ef-bef9-5f50ebaeb84c tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8a0c1f9a-0856-4753-9d7d-4a5094b74f64 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Request method failure captured: Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5 HTTP/1.1 Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmoRCorloGwW7oTgp02sFMNl-ArDlSTQtfkZYqiItVJ7vpC_bypZ0beiSl4RgCdizheQoZwmYbNhiMUpa1NWxDdP160s0KzqRIM4DnIJG0HUEOmpGJ2xZLlhLKASWMgYzimMxkw-JEV8hbh8e3ThTLZ_0lniCmhNNdVKCKbLBitUXWQ Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: ddcca0b4ac864e36a9732a13c93171d3 Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersAdminTestJSON-1660363665 Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ddcca0b4ac864e36a9732a13c93171d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ddcca0b4ac864e36a9732a13c93171d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ddcca0b4ac864e36a9732a13c93171d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ddcca0b4ac864e36a9732a13c93171d3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersAdminTestJSON-1660363665 Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: ddcca0b4ac864e36a9732a13c93171d3 Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersAdminTestJSON-1660363665 Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersAdminTestJSON-1660363665-project Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5ab9827c96bb42fa8975d46618243d33 Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersAdminTestJSON-1660363665-project Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 25185635-1966-4f64-8616-7698ea9e04c5 could not be found. Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '25185635-1966-4f64-8616-7698ea9e04c5'} Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25185635-1966-4f64-8616-7698ea9e04c5 could not be found. Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25185635-1966-4f64-8616-7698ea9e04c5 could not be found. Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:28.160055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:28.164614 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:28.164614 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:28.164614 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:28.164614 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:36:28.164614 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:36:28.164614 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25185635-1966-4f64-8616-7698ea9e04c5 could not be found. Oct 24 10:36:28.164614 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:36:28.166694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8a0c1f9a-0856-4753-9d7d-4a5094b74f64 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Returning 404 to user: Instance 25185635-1966-4f64-8616-7698ea9e04c5 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:36:28.167752 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8a0c1f9a-0856-4753-9d7d-4a5094b74f64 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5" status: 404 len: 111 microversion: 2.1 time: 0.149972 Oct 24 10:36:28.172058 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1357/2747] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:28 2022] GET /compute/v2.1/servers/25185635-1966-4f64-8616-7698ea9e04c5 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:36:28.196914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-202f8004-d7a2-40ff-b22b-f254ac37bd97 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:28.199605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-202f8004-d7a2-40ff-b22b-f254ac37bd97 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:28.212921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-202f8004-d7a2-40ff-b22b-f254ac37bd97 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:28.213432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-202f8004-d7a2-40ff-b22b-f254ac37bd97 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:28.216025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-202f8004-d7a2-40ff-b22b-f254ac37bd97 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:28.217413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-202f8004-d7a2-40ff-b22b-f254ac37bd97 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:28.218038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-202f8004-d7a2-40ff-b22b-f254ac37bd97 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:28.218332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-202f8004-d7a2-40ff-b22b-f254ac37bd97 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:28.260501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-c890a870-1660-46ef-bef9-5f50ebaeb84c tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Getting quotas for project 96c125be93d647e1b2c0fdd4ae2efb14. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:36:28.267730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:28.276612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-c890a870-1660-46ef-bef9-5f50ebaeb84c tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Getting quotas for user ed9fe821ad1b43f2988dd30521c6c335 and project 96c125be93d647e1b2c0fdd4ae2efb14. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:36:28.307783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-202f8004-d7a2-40ff-b22b-f254ac37bd97 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:36:28.522306 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-202f8004-d7a2-40ff-b22b-f254ac37bd97 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "DELETE /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 204 len: 0 microversion: 2.1 time: 0.344718 Oct 24 10:36:28.524334 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1358/2748] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:36:28 2022] DELETE /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:36:28.550152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5b18aef8-67a5-49ec-a3c8-9486e3630f4b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:28.565921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5b18aef8-67a5-49ec-a3c8-9486e3630f4b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:28.582375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b18aef8-67a5-49ec-a3c8-9486e3630f4b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:28.585806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b18aef8-67a5-49ec-a3c8-9486e3630f4b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:28.588403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b18aef8-67a5-49ec-a3c8-9486e3630f4b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:28.592387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b18aef8-67a5-49ec-a3c8-9486e3630f4b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:28.600334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b18aef8-67a5-49ec-a3c8-9486e3630f4b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:28.602729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b18aef8-67a5-49ec-a3c8-9486e3630f4b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:28.864216 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c890a870-1660-46ef-bef9-5f50ebaeb84c tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "POST /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999/action" status: 202 len: 0 microversion: 2.1 time: 0.762956 Oct 24 10:36:28.882872 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1391/2749] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:36:28 2022] POST /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999/action => generated 0 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 10:36:28.888925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1d852bcf-09a3-4fda-931a-6a6f82f84174 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d4e7a1f0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:29.040424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5b18aef8-67a5-49ec-a3c8-9486e3630f4b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:29.042849 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1d852bcf-09a3-4fda-931a-6a6f82f84174 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.158372 Oct 24 10:36:29.043789 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1392/2750] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:28 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:29.065392 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5b18aef8-67a5-49ec-a3c8-9486e3630f4b tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1469 microversion: 2.1 time: 0.532722 Oct 24 10:36:29.066995 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1359/2751] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:28 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1469 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:29.128637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a7f51c09-1972-40c4-b5e8-664c1dc75cd6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:29.129420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a7f51c09-1972-40c4-b5e8-664c1dc75cd6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:29.161950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7f51c09-1972-40c4-b5e8-664c1dc75cd6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:29.162455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7f51c09-1972-40c4-b5e8-664c1dc75cd6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:29.166027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7f51c09-1972-40c4-b5e8-664c1dc75cd6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:29.168245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7f51c09-1972-40c4-b5e8-664c1dc75cd6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:29.168743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7f51c09-1972-40c4-b5e8-664c1dc75cd6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:29.176786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7f51c09-1972-40c4-b5e8-664c1dc75cd6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:29.578839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a7f51c09-1972-40c4-b5e8-664c1dc75cd6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:29.592782 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a7f51c09-1972-40c4-b5e8-664c1dc75cd6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1511 microversion: 2.1 time: 0.470327 Oct 24 10:36:29.609862 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1393/2752] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:29 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1511 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:30.072750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-933682fa-9676-4138-ab28-5a930398597e tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d0354280>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:30.095977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c355e960-783f-4bf3-b5fb-295462856bca tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:30.096664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c355e960-783f-4bf3-b5fb-295462856bca tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:30.110700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c355e960-783f-4bf3-b5fb-295462856bca tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:30.133821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c355e960-783f-4bf3-b5fb-295462856bca tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:30.133821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c355e960-783f-4bf3-b5fb-295462856bca tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:30.134576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c355e960-783f-4bf3-b5fb-295462856bca tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:30.134976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c355e960-783f-4bf3-b5fb-295462856bca tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:30.135408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c355e960-783f-4bf3-b5fb-295462856bca tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:30.221496 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-933682fa-9676-4138-ab28-5a930398597e tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.149780 Oct 24 10:36:30.223156 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1360/2753] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:30 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:30.508615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-61c554e7-7bbf-493e-813b-84943cfb3110 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1651882930", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:30.618276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-61c554e7-7bbf-493e-813b-84943cfb3110 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] validate_networks() for None {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:36:30.684789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c355e960-783f-4bf3-b5fb-295462856bca tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:30.697374 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c355e960-783f-4bf3-b5fb-295462856bca tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1469 microversion: 2.1 time: 0.606392 Oct 24 10:36:30.698076 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1394/2754] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:30 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1469 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:36:30.713884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a4c25eea-8d55-485a-92a6-c20c9a987692 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:30.714861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a4c25eea-8d55-485a-92a6-c20c9a987692 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:30.721761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4c25eea-8d55-485a-92a6-c20c9a987692 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:30.722553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4c25eea-8d55-485a-92a6-c20c9a987692 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:30.723211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4c25eea-8d55-485a-92a6-c20c9a987692 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:30.724135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4c25eea-8d55-485a-92a6-c20c9a987692 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:30.724805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4c25eea-8d55-485a-92a6-c20c9a987692 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:30.725498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4c25eea-8d55-485a-92a6-c20c9a987692 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:31.232005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a4c25eea-8d55-485a-92a6-c20c9a987692 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:31.246642 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a4c25eea-8d55-485a-92a6-c20c9a987692 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1511 microversion: 2.1 time: 0.536020 Oct 24 10:36:31.261768 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1395/2755] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:30 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1511 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:31.269007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e54f6646-a0a7-488a-b609-237499ca3f2a tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d0402940>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:31.277166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-61c554e7-7bbf-493e-813b-84943cfb3110 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:36:31.278611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-61c554e7-7bbf-493e-813b-84943cfb3110 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:36:31.281335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-61c554e7-7bbf-493e-813b-84943cfb3110 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:36:31.281990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-61c554e7-7bbf-493e-813b-84943cfb3110 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:36:31.282621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-61c554e7-7bbf-493e-813b-84943cfb3110 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:36:31.298420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61c554e7-7bbf-493e-813b-84943cfb3110 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:31.299463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61c554e7-7bbf-493e-813b-84943cfb3110 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:31.300004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61c554e7-7bbf-493e-813b-84943cfb3110 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:31.301121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61c554e7-7bbf-493e-813b-84943cfb3110 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:31.301812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61c554e7-7bbf-493e-813b-84943cfb3110 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:31.302343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61c554e7-7bbf-493e-813b-84943cfb3110 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:31.326019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-61c554e7-7bbf-493e-813b-84943cfb3110 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Getting quotas for project a3656fcc947f4652a6eae2e31be21ada. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:36:31.333538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-61c554e7-7bbf-493e-813b-84943cfb3110 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Getting quotas for user f71950ff4118494288b1088fd7c700cd and project a3656fcc947f4652a6eae2e31be21ada. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:36:31.336334 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e54f6646-a0a7-488a-b609-237499ca3f2a tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.081582 Oct 24 10:36:31.337280 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1396/2756] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:31 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:31.348952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-61c554e7-7bbf-493e-813b-84943cfb3110 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:36:31.351511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-61c554e7-7bbf-493e-813b-84943cfb3110 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:36:31.426410 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-61c554e7-7bbf-493e-813b-84943cfb3110 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.173116 Oct 24 10:36:31.431262 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1361/2757] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:36:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 10:36:31.442545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-070e835c-5d53-463b-86f1-424d05a6b3c1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:31.443352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-070e835c-5d53-463b-86f1-424d05a6b3c1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:31.724817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-295e6e14-4598-477d-85ea-e4dd140f20d3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:31.726085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-295e6e14-4598-477d-85ea-e4dd140f20d3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:31.735233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-295e6e14-4598-477d-85ea-e4dd140f20d3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:31.736117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-295e6e14-4598-477d-85ea-e4dd140f20d3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:31.737288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-295e6e14-4598-477d-85ea-e4dd140f20d3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:31.738250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-295e6e14-4598-477d-85ea-e4dd140f20d3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:31.739139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-295e6e14-4598-477d-85ea-e4dd140f20d3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:31.740713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-295e6e14-4598-477d-85ea-e4dd140f20d3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:31.773511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-070e835c-5d53-463b-86f1-424d05a6b3c1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:31.786239 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-070e835c-5d53-463b-86f1-424d05a6b3c1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7" status: 200 len: 1219 microversion: 2.1 time: 0.345404 Oct 24 10:36:31.796997 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1397/2758] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:31 2022] GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 => generated 1219 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:32.178789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-d67843f2-c49e-4162-b90c-7fdc2e261e09 req-95e0bc1e-96e2-4e1e-81ae-6cadaef59c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60354b63-afb2-4624-8a37-aeda3bf88672", "name": "network-vif-deleted", "tag": "72f5ab98-427f-4f57-a27f-b04761c1e779"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:32.200286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d67843f2-c49e-4162-b90c-7fdc2e261e09 req-95e0bc1e-96e2-4e1e-81ae-6cadaef59c04 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:32.202430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d67843f2-c49e-4162-b90c-7fdc2e261e09 req-95e0bc1e-96e2-4e1e-81ae-6cadaef59c04 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:32.203202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d67843f2-c49e-4162-b90c-7fdc2e261e09 req-95e0bc1e-96e2-4e1e-81ae-6cadaef59c04 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:32.223824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-295e6e14-4598-477d-85ea-e4dd140f20d3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:32.229679 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-d67843f2-c49e-4162-b90c-7fdc2e261e09 req-95e0bc1e-96e2-4e1e-81ae-6cadaef59c04 service nova] Creating event network-vif-deleted:72f5ab98-427f-4f57-a27f-b04761c1e779 for instance 60354b63-afb2-4624-8a37-aeda3bf88672 on n-h1-858383-15 Oct 24 10:36:32.238142 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-d67843f2-c49e-4162-b90c-7fdc2e261e09 req-95e0bc1e-96e2-4e1e-81ae-6cadaef59c04 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063064 Oct 24 10:36:32.239915 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1398/2759] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:36:32.246973 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-295e6e14-4598-477d-85ea-e4dd140f20d3 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1469 microversion: 2.1 time: 0.521583 Oct 24 10:36:32.248935 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1362/2760] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:31 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1469 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:32.280781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-441b8079-e51d-4d9f-a833-4402daec84f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:32.282348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-441b8079-e51d-4d9f-a833-4402daec84f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:32.292956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-441b8079-e51d-4d9f-a833-4402daec84f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:32.294259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-441b8079-e51d-4d9f-a833-4402daec84f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:32.296169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-441b8079-e51d-4d9f-a833-4402daec84f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:32.298832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-441b8079-e51d-4d9f-a833-4402daec84f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:32.299548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-441b8079-e51d-4d9f-a833-4402daec84f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:32.300200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-441b8079-e51d-4d9f-a833-4402daec84f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:32.353507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b7db7c1-7152-495a-beff-9ada46cba1b2 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d0f09430>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:32.493964 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b7db7c1-7152-495a-beff-9ada46cba1b2 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.123641 Oct 24 10:36:32.505281 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1363/2761] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:32 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:32.813251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6f449c19-e150-4183-9444-3a5cf0e8ee6d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:32.814126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6f449c19-e150-4183-9444-3a5cf0e8ee6d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:32.826501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f449c19-e150-4183-9444-3a5cf0e8ee6d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:32.829967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-441b8079-e51d-4d9f-a833-4402daec84f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:32.836955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f449c19-e150-4183-9444-3a5cf0e8ee6d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:32.837402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f449c19-e150-4183-9444-3a5cf0e8ee6d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:32.858088 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-441b8079-e51d-4d9f-a833-4402daec84f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1511 microversion: 2.1 time: 0.577677 Oct 24 10:36:32.859201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f449c19-e150-4183-9444-3a5cf0e8ee6d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:32.861870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f449c19-e150-4183-9444-3a5cf0e8ee6d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:32.862588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f449c19-e150-4183-9444-3a5cf0e8ee6d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:32.873484 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1399/2762] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:32 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1511 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:33.057935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6f449c19-e150-4183-9444-3a5cf0e8ee6d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:33.069308 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6f449c19-e150-4183-9444-3a5cf0e8ee6d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7" status: 200 len: 1223 microversion: 2.1 time: 0.260651 Oct 24 10:36:33.070829 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1364/2763] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:32 2022] GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 => generated 1223 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:33.272381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d56057fe-7592-4c93-b370-35f8e234b58a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:33.273686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d56057fe-7592-4c93-b370-35f8e234b58a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:33.306467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d56057fe-7592-4c93-b370-35f8e234b58a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:33.308526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d56057fe-7592-4c93-b370-35f8e234b58a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:33.310178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d56057fe-7592-4c93-b370-35f8e234b58a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:33.312158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d56057fe-7592-4c93-b370-35f8e234b58a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:33.313285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d56057fe-7592-4c93-b370-35f8e234b58a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:33.322856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d56057fe-7592-4c93-b370-35f8e234b58a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:33.442317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d56057fe-7592-4c93-b370-35f8e234b58a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:33.443151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d56057fe-7592-4c93-b370-35f8e234b58a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:33.444683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d56057fe-7592-4c93-b370-35f8e234b58a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:33.445756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-d56057fe-7592-4c93-b370-35f8e234b58a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lazy-loading 'fault' on Instance uuid 60354b63-afb2-4624-8a37-aeda3bf88672 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:36:33.527008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-07f9b0d7-00db-46ba-aa16-b07f8e8e11c5 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d035c160>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:33.564372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d56057fe-7592-4c93-b370-35f8e234b58a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:33.578804 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d56057fe-7592-4c93-b370-35f8e234b58a tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 200 len: 1303 microversion: 2.1 time: 0.309452 Oct 24 10:36:33.582334 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1400/2764] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:33 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 1303 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:36:33.635888 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-07f9b0d7-00db-46ba-aa16-b07f8e8e11c5 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.123378 Oct 24 10:36:33.635888 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1365/2765] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:33 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:36:33.893205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ced4c84e-61a5-402a-851b-c8c5a1f8c657 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:33.894148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ced4c84e-61a5-402a-851b-c8c5a1f8c657 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:33.914759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ced4c84e-61a5-402a-851b-c8c5a1f8c657 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:33.915255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ced4c84e-61a5-402a-851b-c8c5a1f8c657 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:33.915692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ced4c84e-61a5-402a-851b-c8c5a1f8c657 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:33.926757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ced4c84e-61a5-402a-851b-c8c5a1f8c657 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:33.929108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ced4c84e-61a5-402a-851b-c8c5a1f8c657 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:33.930094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ced4c84e-61a5-402a-851b-c8c5a1f8c657 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:34.096114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-79b4d93f-9c38-474d-ba8b-8a9f85f1a0d1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:34.097241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-79b4d93f-9c38-474d-ba8b-8a9f85f1a0d1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:34.112059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79b4d93f-9c38-474d-ba8b-8a9f85f1a0d1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:34.112568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79b4d93f-9c38-474d-ba8b-8a9f85f1a0d1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:34.128011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79b4d93f-9c38-474d-ba8b-8a9f85f1a0d1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:34.137070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79b4d93f-9c38-474d-ba8b-8a9f85f1a0d1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:34.139417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79b4d93f-9c38-474d-ba8b-8a9f85f1a0d1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:34.144029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79b4d93f-9c38-474d-ba8b-8a9f85f1a0d1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:34.281846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ced4c84e-61a5-402a-851b-c8c5a1f8c657 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:34.294931 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ced4c84e-61a5-402a-851b-c8c5a1f8c657 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1511 microversion: 2.1 time: 0.408968 Oct 24 10:36:34.297294 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1401/2766] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:33 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1511 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:34.408244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-79b4d93f-9c38-474d-ba8b-8a9f85f1a0d1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:34.426838 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-79b4d93f-9c38-474d-ba8b-8a9f85f1a0d1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7" status: 200 len: 1271 microversion: 2.1 time: 0.336548 Oct 24 10:36:34.428419 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1366/2767] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:34 2022] GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 => generated 1271 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:34.632276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-392e84ad-de79-4c0b-8456-1b8e7aca6902 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:34.633396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-392e84ad-de79-4c0b-8456-1b8e7aca6902 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 60354b63-afb2-4624-8a37-aeda3bf88672] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:34.652584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-81d52498-b4b7-4293-83be-78a3399aa882 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d0bb3dc0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:34.679349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-392e84ad-de79-4c0b-8456-1b8e7aca6902 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:34.679854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-392e84ad-de79-4c0b-8456-1b8e7aca6902 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:34.684352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-392e84ad-de79-4c0b-8456-1b8e7aca6902 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:34.688610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-392e84ad-de79-4c0b-8456-1b8e7aca6902 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:34.694981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-392e84ad-de79-4c0b-8456-1b8e7aca6902 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:34.695735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-392e84ad-de79-4c0b-8456-1b8e7aca6902 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:34.729816 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-392e84ad-de79-4c0b-8456-1b8e7aca6902 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] HTTP exception thrown: Instance 60354b63-afb2-4624-8a37-aeda3bf88672 could not be found. Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-392e84ad-de79-4c0b-8456-1b8e7aca6902 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Request method failure captured: Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 HTTP/1.1 Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmoRCorloGwW7oTgp02sFMNl-ArDlSTQtfkZYqiItVJ7vpC_bypZ0beiSl4RgCdizheQoZwmYbNhiMUpa1NWxDdP160s0KzqRIM4DnIJG0HUEOmpGJ2xZLlhLKASWMgYzimMxkw-JEV8hbh8e3ThTLZ_0lniCmhNNdVKCKbLBitUXWQ Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: ddcca0b4ac864e36a9732a13c93171d3 Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersAdminTestJSON-1660363665 Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ddcca0b4ac864e36a9732a13c93171d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ddcca0b4ac864e36a9732a13c93171d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ddcca0b4ac864e36a9732a13c93171d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ddcca0b4ac864e36a9732a13c93171d3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersAdminTestJSON-1660363665 Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: ddcca0b4ac864e36a9732a13c93171d3 Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersAdminTestJSON-1660363665 Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersAdminTestJSON-1660363665-project Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 5ab9827c96bb42fa8975d46618243d33 Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersAdminTestJSON-1660363665-project Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 60354b63-afb2-4624-8a37-aeda3bf88672 could not be found. Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '60354b63-afb2-4624-8a37-aeda3bf88672'} Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60354b63-afb2-4624-8a37-aeda3bf88672 could not be found. Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60354b63-afb2-4624-8a37-aeda3bf88672 could not be found. Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:34.736552 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:34.741472 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:34.741472 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:34.741472 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:34.741472 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:36:34.741472 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:36:34.741472 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60354b63-afb2-4624-8a37-aeda3bf88672 could not be found. Oct 24 10:36:34.741472 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:34.747413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-392e84ad-de79-4c0b-8456-1b8e7aca6902 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Returning 404 to user: Instance 60354b63-afb2-4624-8a37-aeda3bf88672 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:36:34.749235 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-392e84ad-de79-4c0b-8456-1b8e7aca6902 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672" status: 404 len: 111 microversion: 2.1 time: 0.130952 Oct 24 10:36:34.750081 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1402/2768] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:34 2022] GET /compute/v2.1/servers/60354b63-afb2-4624-8a37-aeda3bf88672 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:36:34.760620 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-81d52498-b4b7-4293-83be-78a3399aa882 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.112577 Oct 24 10:36:34.762482 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1367/2769] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:34 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:36:34.774209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-af1cbe12-9fd0-46ee-9b42-450a2f9d5903 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:34.774756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-af1cbe12-9fd0-46ee-9b42-450a2f9d5903 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:34.789790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af1cbe12-9fd0-46ee-9b42-450a2f9d5903 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:34.791174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af1cbe12-9fd0-46ee-9b42-450a2f9d5903 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:34.793454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af1cbe12-9fd0-46ee-9b42-450a2f9d5903 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:34.797174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af1cbe12-9fd0-46ee-9b42-450a2f9d5903 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:34.799105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af1cbe12-9fd0-46ee-9b42-450a2f9d5903 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:34.801030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af1cbe12-9fd0-46ee-9b42-450a2f9d5903 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:34.880503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-af1cbe12-9fd0-46ee-9b42-450a2f9d5903 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:36:34.918913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:35.108592 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-af1cbe12-9fd0-46ee-9b42-450a2f9d5903 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "DELETE /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 204 len: 0 microversion: 2.1 time: 0.352314 Oct 24 10:36:35.109951 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1403/2770] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:36:34 2022] DELETE /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:36:35.139544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-08334b01-6449-48f4-a8da-22a8a8579a96 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:35.140785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-08334b01-6449-48f4-a8da-22a8a8579a96 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:35.181859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08334b01-6449-48f4-a8da-22a8a8579a96 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:35.183462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08334b01-6449-48f4-a8da-22a8a8579a96 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:35.184117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08334b01-6449-48f4-a8da-22a8a8579a96 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:35.187280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08334b01-6449-48f4-a8da-22a8a8579a96 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:35.187755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08334b01-6449-48f4-a8da-22a8a8579a96 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:35.189872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08334b01-6449-48f4-a8da-22a8a8579a96 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:35.327164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-78747b84-3c16-4e3e-a88b-8a0dd23641fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:35.329359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-78747b84-3c16-4e3e-a88b-8a0dd23641fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:35.349557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78747b84-3c16-4e3e-a88b-8a0dd23641fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:35.352030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78747b84-3c16-4e3e-a88b-8a0dd23641fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:35.365518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78747b84-3c16-4e3e-a88b-8a0dd23641fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:35.375167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78747b84-3c16-4e3e-a88b-8a0dd23641fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:35.378664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78747b84-3c16-4e3e-a88b-8a0dd23641fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:35.380459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78747b84-3c16-4e3e-a88b-8a0dd23641fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:35.952932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-08334b01-6449-48f4-a8da-22a8a8579a96 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:35.975218 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-08334b01-6449-48f4-a8da-22a8a8579a96 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1469 microversion: 2.1 time: 0.859849 Oct 24 10:36:35.978351 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1368/2771] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:35 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1469 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:36:36.002565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-08aea917-578b-4b1d-8c30-8e3e2a9c4196 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:36.003458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-08aea917-578b-4b1d-8c30-8e3e2a9c4196 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:36.018965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08aea917-578b-4b1d-8c30-8e3e2a9c4196 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:36.019462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08aea917-578b-4b1d-8c30-8e3e2a9c4196 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:36.019898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08aea917-578b-4b1d-8c30-8e3e2a9c4196 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:36.021537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08aea917-578b-4b1d-8c30-8e3e2a9c4196 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:36.022194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08aea917-578b-4b1d-8c30-8e3e2a9c4196 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:36.022780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08aea917-578b-4b1d-8c30-8e3e2a9c4196 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:36.065847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-78747b84-3c16-4e3e-a88b-8a0dd23641fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:36.085727 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-78747b84-3c16-4e3e-a88b-8a0dd23641fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1511 microversion: 2.1 time: 0.767000 Oct 24 10:36:36.090013 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1404/2772] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:35 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1511 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:36.111599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-047002b9-7eed-4d08-9335-db4dfca1b2bb tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d04024c0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:36.258069 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-047002b9-7eed-4d08-9335-db4dfca1b2bb tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.163825 Oct 24 10:36:36.259993 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1405/2773] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:36 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:36.478646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-08aea917-578b-4b1d-8c30-8e3e2a9c4196 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:36.488746 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-08aea917-578b-4b1d-8c30-8e3e2a9c4196 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7" status: 200 len: 1277 microversion: 2.1 time: 0.508676 Oct 24 10:36:36.509512 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1369/2774] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:35 2022] GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 => generated 1277 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:36.611303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-3782ee64-f615-459c-a388-e73d4c95603b req-e8889505-2546-4d9a-bbf1-1437d18006fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e16c14-6d0e-49a5-9948-298c2e667999", "name": "network-vif-plugged", "status": "completed", "tag": "bddb3b72-49df-48b0-b7ca-ad03dc04e320"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:36.639048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3782ee64-f615-459c-a388-e73d4c95603b req-e8889505-2546-4d9a-bbf1-1437d18006fd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:36.643660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3782ee64-f615-459c-a388-e73d4c95603b req-e8889505-2546-4d9a-bbf1-1437d18006fd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:36.648867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3782ee64-f615-459c-a388-e73d4c95603b req-e8889505-2546-4d9a-bbf1-1437d18006fd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:36.667033 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-3782ee64-f615-459c-a388-e73d4c95603b req-e8889505-2546-4d9a-bbf1-1437d18006fd service nova] Creating event network-vif-plugged:bddb3b72-49df-48b0-b7ca-ad03dc04e320 for instance 42e16c14-6d0e-49a5-9948-298c2e667999 on n-h2-858383-15 Oct 24 10:36:36.680082 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-3782ee64-f615-459c-a388-e73d4c95603b req-e8889505-2546-4d9a-bbf1-1437d18006fd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073271 Oct 24 10:36:36.681584 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1406/2775] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:37.011801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-786f48cc-a3d5-4339-8681-cb68043394ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:37.013087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-786f48cc-a3d5-4339-8681-cb68043394ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:37.039747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-786f48cc-a3d5-4339-8681-cb68043394ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:37.045546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-786f48cc-a3d5-4339-8681-cb68043394ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:37.046535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-786f48cc-a3d5-4339-8681-cb68043394ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:37.047523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-786f48cc-a3d5-4339-8681-cb68043394ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:37.048222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-786f48cc-a3d5-4339-8681-cb68043394ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:37.048930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-786f48cc-a3d5-4339-8681-cb68043394ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:37.130435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5494ca75-18ce-41c7-89ba-0fe1370e1c2c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:37.131178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5494ca75-18ce-41c7-89ba-0fe1370e1c2c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:37.143485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5494ca75-18ce-41c7-89ba-0fe1370e1c2c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:37.143989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5494ca75-18ce-41c7-89ba-0fe1370e1c2c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:37.151851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5494ca75-18ce-41c7-89ba-0fe1370e1c2c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:37.152671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5494ca75-18ce-41c7-89ba-0fe1370e1c2c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:37.153194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5494ca75-18ce-41c7-89ba-0fe1370e1c2c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:37.153639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5494ca75-18ce-41c7-89ba-0fe1370e1c2c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:37.504172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-786f48cc-a3d5-4339-8681-cb68043394ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:37.518607 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-786f48cc-a3d5-4339-8681-cb68043394ed tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1469 microversion: 2.1 time: 0.512544 Oct 24 10:36:37.519561 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1370/2776] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:37 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1469 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:37.604580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5494ca75-18ce-41c7-89ba-0fe1370e1c2c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:37.620492 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5494ca75-18ce-41c7-89ba-0fe1370e1c2c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1511 microversion: 2.1 time: 0.510826 Oct 24 10:36:37.621451 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1407/2777] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:37 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1511 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:37.637702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b3317471-80bf-4732-b4e9-396e77505de8 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d4df3670>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:37.711359 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b3317471-80bf-4732-b4e9-396e77505de8 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.088615 Oct 24 10:36:37.712144 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1408/2778] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:37 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:37.723323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4eee5dab-0378-4e1d-9a48-0cabb10a7e10 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:37.723948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4eee5dab-0378-4e1d-9a48-0cabb10a7e10 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:37.730470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-70f5e05f-b616-4b2b-a1e4-7b4c209eaaf1 tempest-AZV2TestJSON-1058671186 tempest-AZV2TestJSON-1058671186-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:37.733548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f5e05f-b616-4b2b-a1e4-7b4c209eaaf1 tempest-AZV2TestJSON-1058671186 tempest-AZV2TestJSON-1058671186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:37.734227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f5e05f-b616-4b2b-a1e4-7b4c209eaaf1 tempest-AZV2TestJSON-1058671186 tempest-AZV2TestJSON-1058671186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:37.734822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f5e05f-b616-4b2b-a1e4-7b4c209eaaf1 tempest-AZV2TestJSON-1058671186 tempest-AZV2TestJSON-1058671186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:37.736701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f5e05f-b616-4b2b-a1e4-7b4c209eaaf1 tempest-AZV2TestJSON-1058671186 tempest-AZV2TestJSON-1058671186-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:37.736867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4eee5dab-0378-4e1d-9a48-0cabb10a7e10 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:37.737284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4eee5dab-0378-4e1d-9a48-0cabb10a7e10 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:37.737727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4eee5dab-0378-4e1d-9a48-0cabb10a7e10 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:37.738101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f5e05f-b616-4b2b-a1e4-7b4c209eaaf1 tempest-AZV2TestJSON-1058671186 tempest-AZV2TestJSON-1058671186-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:37.738555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4eee5dab-0378-4e1d-9a48-0cabb10a7e10 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:37.739079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4eee5dab-0378-4e1d-9a48-0cabb10a7e10 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:37.739504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4eee5dab-0378-4e1d-9a48-0cabb10a7e10 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:37.742506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f5e05f-b616-4b2b-a1e4-7b4c209eaaf1 tempest-AZV2TestJSON-1058671186 tempest-AZV2TestJSON-1058671186-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:37.785650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:37.813773 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-70f5e05f-b616-4b2b-a1e4-7b4c209eaaf1 tempest-AZV2TestJSON-1058671186 tempest-AZV2TestJSON-1058671186-project] 10.222.0.50 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.293033 Oct 24 10:36:37.814798 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1371/2779] 10.222.0.50 () {58 vars in 1164 bytes} [Mon Oct 24 10:36:37 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:36:38.545639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7dbed89c-f55b-423e-9dcb-094302b856d2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:38.547022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7dbed89c-f55b-423e-9dcb-094302b856d2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:38.572315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dbed89c-f55b-423e-9dcb-094302b856d2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:38.573792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dbed89c-f55b-423e-9dcb-094302b856d2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:38.576793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dbed89c-f55b-423e-9dcb-094302b856d2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:38.577834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dbed89c-f55b-423e-9dcb-094302b856d2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:38.579675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dbed89c-f55b-423e-9dcb-094302b856d2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:38.580401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dbed89c-f55b-423e-9dcb-094302b856d2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:39.234727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7dbed89c-f55b-423e-9dcb-094302b856d2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab9827c96bb42fa8975d46618243d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcca0b4ac864e36a9732a13c93171d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:39.249183 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7dbed89c-f55b-423e-9dcb-094302b856d2 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 200 len: 1427 microversion: 2.1 time: 0.708070 Oct 24 10:36:39.251168 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1372/2780] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:38 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 1427 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:39.258222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10dfed93-9a91-4ec1-993f-aad8256dab03 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:39.259075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-10dfed93-9a91-4ec1-993f-aad8256dab03 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:39.267258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10dfed93-9a91-4ec1-993f-aad8256dab03 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:39.268055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10dfed93-9a91-4ec1-993f-aad8256dab03 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:39.268877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10dfed93-9a91-4ec1-993f-aad8256dab03 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:39.269971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10dfed93-9a91-4ec1-993f-aad8256dab03 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:39.270651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10dfed93-9a91-4ec1-993f-aad8256dab03 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:39.271357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10dfed93-9a91-4ec1-993f-aad8256dab03 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:40.537468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4eee5dab-0378-4e1d-9a48-0cabb10a7e10 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:40.552555 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4eee5dab-0378-4e1d-9a48-0cabb10a7e10 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7" status: 200 len: 1319 microversion: 2.1 time: 2.839284 Oct 24 10:36:40.569496 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1409/2781] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:37 2022] GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 => generated 1319 bytes in 2856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:40.574649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bc915d50-5ee4-4f06-b71b-f473831c0271 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d0a92b80>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:40.643539 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bc915d50-5ee4-4f06-b71b-f473831c0271 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.072588 Oct 24 10:36:40.644115 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1410/2782] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:40 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:40.657636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-7d8daf84-1b61-4ab6-9059-a45f50154c62 req-1e73c607-827a-4b49-a222-3735b70362b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485d2945-20d9-4620-a9e5-004680c44d43", "name": "network-vif-deleted", "tag": "ceedad81-43a8-4ff1-9629-690de6218202"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:40.671661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7d8daf84-1b61-4ab6-9059-a45f50154c62 req-1e73c607-827a-4b49-a222-3735b70362b5 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:40.672631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7d8daf84-1b61-4ab6-9059-a45f50154c62 req-1e73c607-827a-4b49-a222-3735b70362b5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:40.673255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7d8daf84-1b61-4ab6-9059-a45f50154c62 req-1e73c607-827a-4b49-a222-3735b70362b5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:40.694108 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-7d8daf84-1b61-4ab6-9059-a45f50154c62 req-1e73c607-827a-4b49-a222-3735b70362b5 service nova] Creating event network-vif-deleted:ceedad81-43a8-4ff1-9629-690de6218202 for instance 485d2945-20d9-4620-a9e5-004680c44d43 on n-h2-858383-15 Oct 24 10:36:40.707363 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-7d8daf84-1b61-4ab6-9059-a45f50154c62 req-1e73c607-827a-4b49-a222-3735b70362b5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052184 Oct 24 10:36:40.708808 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1411/2783] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:40.720472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54a9245e-c1f6-448c-827e-7d6a44874246 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:40.721193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-54a9245e-c1f6-448c-827e-7d6a44874246 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] [instance: 485d2945-20d9-4620-a9e5-004680c44d43] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:40.735628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54a9245e-c1f6-448c-827e-7d6a44874246 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:40.740035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54a9245e-c1f6-448c-827e-7d6a44874246 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:40.740671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54a9245e-c1f6-448c-827e-7d6a44874246 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:40.741636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54a9245e-c1f6-448c-827e-7d6a44874246 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:40.742306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54a9245e-c1f6-448c-827e-7d6a44874246 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:40.743470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54a9245e-c1f6-448c-827e-7d6a44874246 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:40.776065 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-54a9245e-c1f6-448c-827e-7d6a44874246 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] HTTP exception thrown: Instance 485d2945-20d9-4620-a9e5-004680c44d43 could not be found. Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54a9245e-c1f6-448c-827e-7d6a44874246 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Request method failure captured: Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 HTTP/1.1 Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmoRCorloGwW7oTgp02sFMNl-ArDlSTQtfkZYqiItVJ7vpC_bypZ0beiSl4RgCdizheQoZwmYbNhiMUpa1NWxDdP160s0KzqRIM4DnIJG0HUEOmpGJ2xZLlhLKASWMgYzimMxkw-JEV8hbh8e3ThTLZ_0lniCmhNNdVKCKbLBitUXWQ Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: ddcca0b4ac864e36a9732a13c93171d3 Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersAdminTestJSON-1660363665 Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ddcca0b4ac864e36a9732a13c93171d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ddcca0b4ac864e36a9732a13c93171d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ddcca0b4ac864e36a9732a13c93171d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ddcca0b4ac864e36a9732a13c93171d3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersAdminTestJSON-1660363665 Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: ddcca0b4ac864e36a9732a13c93171d3 Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersAdminTestJSON-1660363665 Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersAdminTestJSON-1660363665-project Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 5ab9827c96bb42fa8975d46618243d33 Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersAdminTestJSON-1660363665-project Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 485d2945-20d9-4620-a9e5-004680c44d43 could not be found. Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '485d2945-20d9-4620-a9e5-004680c44d43'} Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 485d2945-20d9-4620-a9e5-004680c44d43 could not be found. Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 485d2945-20d9-4620-a9e5-004680c44d43 could not be found. Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:40.780554 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:40.784376 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:40.784376 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:40.784376 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:40.784376 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:36:40.784376 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:36:40.784376 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 485d2945-20d9-4620-a9e5-004680c44d43 could not be found. Oct 24 10:36:40.784376 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:40.788009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54a9245e-c1f6-448c-827e-7d6a44874246 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] Returning 404 to user: Instance 485d2945-20d9-4620-a9e5-004680c44d43 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:36:40.789095 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-54a9245e-c1f6-448c-827e-7d6a44874246 tempest-ServersAdminTestJSON-1660363665 tempest-ServersAdminTestJSON-1660363665-project] 10.222.0.50 "GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43" status: 404 len: 111 microversion: 2.1 time: 0.076663 Oct 24 10:36:40.789782 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1412/2784] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:40 2022] GET /compute/v2.1/servers/485d2945-20d9-4620-a9e5-004680c44d43 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:36:40.921006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-10dfed93-9a91-4ec1-993f-aad8256dab03 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:40.934853 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10dfed93-9a91-4ec1-993f-aad8256dab03 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1511 microversion: 2.1 time: 1.681384 Oct 24 10:36:40.954543 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1373/2785] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:39 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1511 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:41.580288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b5d9d5b1-90e4-4eb4-a1e3-d6372e7a5255 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:41.581597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b5d9d5b1-90e4-4eb4-a1e3-d6372e7a5255 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:41.588754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5d9d5b1-90e4-4eb4-a1e3-d6372e7a5255 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:41.589506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5d9d5b1-90e4-4eb4-a1e3-d6372e7a5255 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:41.590232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5d9d5b1-90e4-4eb4-a1e3-d6372e7a5255 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:41.591212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5d9d5b1-90e4-4eb4-a1e3-d6372e7a5255 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:41.592007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5d9d5b1-90e4-4eb4-a1e3-d6372e7a5255 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:41.592656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5d9d5b1-90e4-4eb4-a1e3-d6372e7a5255 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:41.659479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e186d40e-00d5-4e39-b607-32c3239c0f94 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d0ca8b80>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:41.670009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:41.749379 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e186d40e-00d5-4e39-b607-32c3239c0f94 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.093850 Oct 24 10:36:41.759287 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1374/2786] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:41 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:41.783207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:41.962730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-64a4f9ba-9e9d-4e6a-b7e6-da898b4e3b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:41.964069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-64a4f9ba-9e9d-4e6a-b7e6-da898b4e3b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:41.985155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64a4f9ba-9e9d-4e6a-b7e6-da898b4e3b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:41.986715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64a4f9ba-9e9d-4e6a-b7e6-da898b4e3b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:41.987175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64a4f9ba-9e9d-4e6a-b7e6-da898b4e3b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:41.987933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64a4f9ba-9e9d-4e6a-b7e6-da898b4e3b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:41.988397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64a4f9ba-9e9d-4e6a-b7e6-da898b4e3b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:41.995617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64a4f9ba-9e9d-4e6a-b7e6-da898b4e3b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:42.132325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b5d9d5b1-90e4-4eb4-a1e3-d6372e7a5255 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:42.150377 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b5d9d5b1-90e4-4eb4-a1e3-d6372e7a5255 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7" status: 200 len: 1319 microversion: 2.1 time: 0.577712 Oct 24 10:36:42.155010 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1413/2787] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:41 2022] GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 => generated 1319 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:42.464950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-03391186-00eb-4b9f-87ea-bc19927c50d1 req-f123a8b6-013a-44e1-81ac-1a37a7b66e19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3221498d-a495-448e-8adc-3a661c1a86a7", "tag": "efe0dee8-9cb1-4db6-a07b-50240e5390f2"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:42.476961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-03391186-00eb-4b9f-87ea-bc19927c50d1 req-f123a8b6-013a-44e1-81ac-1a37a7b66e19 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:42.478424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-03391186-00eb-4b9f-87ea-bc19927c50d1 req-f123a8b6-013a-44e1-81ac-1a37a7b66e19 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:42.479136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-03391186-00eb-4b9f-87ea-bc19927c50d1 req-f123a8b6-013a-44e1-81ac-1a37a7b66e19 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:42.499254 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-03391186-00eb-4b9f-87ea-bc19927c50d1 req-f123a8b6-013a-44e1-81ac-1a37a7b66e19 service nova] Creating event network-changed:efe0dee8-9cb1-4db6-a07b-50240e5390f2 for instance 3221498d-a495-448e-8adc-3a661c1a86a7 on n-h1-858383-15 Oct 24 10:36:42.507279 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-03391186-00eb-4b9f-87ea-bc19927c50d1 req-f123a8b6-013a-44e1-81ac-1a37a7b66e19 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046818 Oct 24 10:36:42.508478 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1414/2788] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:36:42.525619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-64a4f9ba-9e9d-4e6a-b7e6-da898b4e3b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:42.537006 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-64a4f9ba-9e9d-4e6a-b7e6-da898b4e3b5a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1511 microversion: 2.1 time: 0.578990 Oct 24 10:36:42.538504 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1375/2789] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:41 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1511 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:36:42.766550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dede5fd0-1cae-4bbb-a9d2-573cfbc36e93 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d04fd280>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:42.855814 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dede5fd0-1cae-4bbb-a9d2-573cfbc36e93 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.094319 Oct 24 10:36:42.866628 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1415/2790] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:42 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:43.183463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9ec9c119-235b-4020-9ce0-35a024fc1a49 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:43.184703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9ec9c119-235b-4020-9ce0-35a024fc1a49 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:43.200942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ec9c119-235b-4020-9ce0-35a024fc1a49 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:43.205997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ec9c119-235b-4020-9ce0-35a024fc1a49 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:43.207398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ec9c119-235b-4020-9ce0-35a024fc1a49 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:43.213480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ec9c119-235b-4020-9ce0-35a024fc1a49 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:43.214237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ec9c119-235b-4020-9ce0-35a024fc1a49 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:43.215019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ec9c119-235b-4020-9ce0-35a024fc1a49 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:43.566051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-af3c4f8d-5569-4ab8-a54d-3c5b17ab76f7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:43.568008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-af3c4f8d-5569-4ab8-a54d-3c5b17ab76f7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:43.582146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af3c4f8d-5569-4ab8-a54d-3c5b17ab76f7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:43.584106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af3c4f8d-5569-4ab8-a54d-3c5b17ab76f7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:43.588408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af3c4f8d-5569-4ab8-a54d-3c5b17ab76f7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:43.593070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af3c4f8d-5569-4ab8-a54d-3c5b17ab76f7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:43.594277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af3c4f8d-5569-4ab8-a54d-3c5b17ab76f7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:43.595325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af3c4f8d-5569-4ab8-a54d-3c5b17ab76f7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:43.766663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9ec9c119-235b-4020-9ce0-35a024fc1a49 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:43.781281 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9ec9c119-235b-4020-9ce0-35a024fc1a49 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7" status: 200 len: 1319 microversion: 2.1 time: 0.602899 Oct 24 10:36:43.802610 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1376/2791] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:43 2022] GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 => generated 1319 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:43.883423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10819c1d-a4a5-4a68-bfc6-ab0c981f9836 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d034e1f0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:43.989588 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10819c1d-a4a5-4a68-bfc6-ab0c981f9836 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.110761 Oct 24 10:36:43.990908 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1377/2792] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:43 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:44.225088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-af3c4f8d-5569-4ab8-a54d-3c5b17ab76f7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:44.240717 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-af3c4f8d-5569-4ab8-a54d-3c5b17ab76f7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1511 microversion: 2.1 time: 0.679281 Oct 24 10:36:44.244712 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1416/2793] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:43 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1511 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:44.332527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4122da37-db5b-48ea-be7d-f339ccbdc882 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:44.333007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4122da37-db5b-48ea-be7d-f339ccbdc882 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:44.358444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4122da37-db5b-48ea-be7d-f339ccbdc882 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:44.358954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4122da37-db5b-48ea-be7d-f339ccbdc882 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:44.359406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4122da37-db5b-48ea-be7d-f339ccbdc882 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:44.362442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4122da37-db5b-48ea-be7d-f339ccbdc882 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:44.363836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4122da37-db5b-48ea-be7d-f339ccbdc882 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:44.364469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4122da37-db5b-48ea-be7d-f339ccbdc882 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:44.408960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4122da37-db5b-48ea-be7d-f339ccbdc882 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:36:44.543821 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4122da37-db5b-48ea-be7d-f339ccbdc882 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "DELETE /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 204 len: 0 microversion: 2.1 time: 0.214930 Oct 24 10:36:44.549423 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1378/2794] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:36:44 2022] DELETE /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:36:44.554558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5e9af185-0824-4da4-a98d-e46090a82329 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:44.556274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5e9af185-0824-4da4-a98d-e46090a82329 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:44.584755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e9af185-0824-4da4-a98d-e46090a82329 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:44.585958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e9af185-0824-4da4-a98d-e46090a82329 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:44.587238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e9af185-0824-4da4-a98d-e46090a82329 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:44.588244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e9af185-0824-4da4-a98d-e46090a82329 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:44.588947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e9af185-0824-4da4-a98d-e46090a82329 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:44.589602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e9af185-0824-4da4-a98d-e46090a82329 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:44.809523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3273fa48-3d1a-478a-94c9-470c12adb3a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:44.811571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3273fa48-3d1a-478a-94c9-470c12adb3a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:44.818618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3273fa48-3d1a-478a-94c9-470c12adb3a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:44.819111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3273fa48-3d1a-478a-94c9-470c12adb3a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:44.819740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3273fa48-3d1a-478a-94c9-470c12adb3a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:44.820621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3273fa48-3d1a-478a-94c9-470c12adb3a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:44.821382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3273fa48-3d1a-478a-94c9-470c12adb3a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:44.822004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3273fa48-3d1a-478a-94c9-470c12adb3a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:44.829900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:45.353849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5e9af185-0824-4da4-a98d-e46090a82329 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:45.367040 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5e9af185-0824-4da4-a98d-e46090a82329 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1553 microversion: 2.1 time: 0.813092 Oct 24 10:36:45.367610 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1417/2795] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:44 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1553 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:45.386225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-613eda3d-a04c-4322-8d3b-6d1b19930740 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d06f5940>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:45.465858 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-613eda3d-a04c-4322-8d3b-6d1b19930740 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.096768 Oct 24 10:36:45.467634 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1418/2796] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:45 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:45.475413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ac266a15-f1ed-4b91-9799-fa4fd2a11f1f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:45.476378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ac266a15-f1ed-4b91-9799-fa4fd2a11f1f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:45.483759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac266a15-f1ed-4b91-9799-fa4fd2a11f1f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:45.484652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac266a15-f1ed-4b91-9799-fa4fd2a11f1f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:45.485284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac266a15-f1ed-4b91-9799-fa4fd2a11f1f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:45.486220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac266a15-f1ed-4b91-9799-fa4fd2a11f1f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:45.486847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac266a15-f1ed-4b91-9799-fa4fd2a11f1f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:45.487428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac266a15-f1ed-4b91-9799-fa4fd2a11f1f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:45.758006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3273fa48-3d1a-478a-94c9-470c12adb3a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:45.773325 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3273fa48-3d1a-478a-94c9-470c12adb3a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7" status: 200 len: 1319 microversion: 2.1 time: 0.968654 Oct 24 10:36:45.791675 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1379/2797] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:44 2022] GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 => generated 1319 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:36:45.978940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ac266a15-f1ed-4b91-9799-fa4fd2a11f1f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:46.004178 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ac266a15-f1ed-4b91-9799-fa4fd2a11f1f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1511 microversion: 2.1 time: 0.529609 Oct 24 10:36:46.008264 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1419/2798] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:45 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1511 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:46.396108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1540b719-24dc-4415-8a42-399326e05387 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:46.396860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1540b719-24dc-4415-8a42-399326e05387 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:46.410392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1540b719-24dc-4415-8a42-399326e05387 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:46.410889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1540b719-24dc-4415-8a42-399326e05387 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:46.411321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1540b719-24dc-4415-8a42-399326e05387 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:46.412020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1540b719-24dc-4415-8a42-399326e05387 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:46.412653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1540b719-24dc-4415-8a42-399326e05387 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:46.417884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1540b719-24dc-4415-8a42-399326e05387 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:46.483206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d06f2678-8261-45c6-8a76-6c3e7be01b95 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d06f54c0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:46.611159 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d06f2678-8261-45c6-8a76-6c3e7be01b95 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.131735 Oct 24 10:36:46.612671 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1420/2799] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:46 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:36:46.805129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c08b128d-c562-4fd6-9787-23d7ad653e12 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:46.805768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c08b128d-c562-4fd6-9787-23d7ad653e12 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:46.828968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c08b128d-c562-4fd6-9787-23d7ad653e12 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:46.829460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c08b128d-c562-4fd6-9787-23d7ad653e12 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:46.829913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c08b128d-c562-4fd6-9787-23d7ad653e12 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:46.830658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c08b128d-c562-4fd6-9787-23d7ad653e12 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:46.831118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c08b128d-c562-4fd6-9787-23d7ad653e12 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:46.831550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c08b128d-c562-4fd6-9787-23d7ad653e12 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:47.483814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1540b719-24dc-4415-8a42-399326e05387 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:47.496817 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1540b719-24dc-4415-8a42-399326e05387 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1553 microversion: 2.1 time: 1.105173 Oct 24 10:36:47.497635 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1380/2800] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:46 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1553 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:47.512760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-854f27cd-598a-4131-8374-be3a62351c1d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:47.516634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-854f27cd-598a-4131-8374-be3a62351c1d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:47.538903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-854f27cd-598a-4131-8374-be3a62351c1d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:47.541291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-854f27cd-598a-4131-8374-be3a62351c1d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:47.546233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-854f27cd-598a-4131-8374-be3a62351c1d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:47.548287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-854f27cd-598a-4131-8374-be3a62351c1d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:47.551030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-854f27cd-598a-4131-8374-be3a62351c1d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:47.553148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-854f27cd-598a-4131-8374-be3a62351c1d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:47.763404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:48.256488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c08b128d-c562-4fd6-9787-23d7ad653e12 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:48.269586 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c08b128d-c562-4fd6-9787-23d7ad653e12 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7" status: 200 len: 1319 microversion: 2.1 time: 1.469867 Oct 24 10:36:48.285828 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1421/2801] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:46 2022] GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 => generated 1319 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:48.499073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-854f27cd-598a-4131-8374-be3a62351c1d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:48.514227 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-854f27cd-598a-4131-8374-be3a62351c1d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1488 microversion: 2.1 time: 1.014912 Oct 24 10:36:48.518060 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1381/2802] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:47 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1488 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:48.529406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ddb49352-c8f1-42f3-97e9-cfaec3f6bdc6 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d4fe0550>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:48.606963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eb72d7df-84a7-4778-8d1d-280707d82b01 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-245506115", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": "none"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:48.676219 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ddb49352-c8f1-42f3-97e9-cfaec3f6bdc6 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.155617 Oct 24 10:36:48.685679 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1382/2803] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:48 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:48.696268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e27e3db-6511-4e18-989f-cdd488040dca tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:48.702210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0e27e3db-6511-4e18-989f-cdd488040dca tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:48.716287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e27e3db-6511-4e18-989f-cdd488040dca tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:48.717406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e27e3db-6511-4e18-989f-cdd488040dca tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:48.718076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e27e3db-6511-4e18-989f-cdd488040dca tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:48.721441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e27e3db-6511-4e18-989f-cdd488040dca tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:48.722209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e27e3db-6511-4e18-989f-cdd488040dca tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:48.723705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e27e3db-6511-4e18-989f-cdd488040dca tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:48.746395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-eb72d7df-84a7-4778-8d1d-280707d82b01 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:36:48.746518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-eb72d7df-84a7-4778-8d1d-280707d82b01 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:36:48.746950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-eb72d7df-84a7-4778-8d1d-280707d82b01 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:36:48.747945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-eb72d7df-84a7-4778-8d1d-280707d82b01 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:36:48.748484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-eb72d7df-84a7-4778-8d1d-280707d82b01 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:36:48.765089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb72d7df-84a7-4778-8d1d-280707d82b01 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:48.765790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb72d7df-84a7-4778-8d1d-280707d82b01 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:48.766398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb72d7df-84a7-4778-8d1d-280707d82b01 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:48.767314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb72d7df-84a7-4778-8d1d-280707d82b01 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:48.767929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb72d7df-84a7-4778-8d1d-280707d82b01 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:48.768521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb72d7df-84a7-4778-8d1d-280707d82b01 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:48.811641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-eb72d7df-84a7-4778-8d1d-280707d82b01 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Getting quotas for project a6d258f0ae58493da0efc5df77e54c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:36:48.818146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-eb72d7df-84a7-4778-8d1d-280707d82b01 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Getting quotas for user 7ebdd581042344cd908a42c7ba111fb4 and project a6d258f0ae58493da0efc5df77e54c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:36:48.836996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-eb72d7df-84a7-4778-8d1d-280707d82b01 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:36:48.839681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-eb72d7df-84a7-4778-8d1d-280707d82b01 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:36:48.932615 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-eb72d7df-84a7-4778-8d1d-280707d82b01 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.645239 Oct 24 10:36:48.935864 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1422/2804] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Oct 24 10:36:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 10:36:48.972922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bb2ee02b-4a3d-4fd1-a8c4-a4d25e54a726 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:48.991259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bb2ee02b-4a3d-4fd1-a8c4-a4d25e54a726 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:49.026964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb2ee02b-4a3d-4fd1-a8c4-a4d25e54a726 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:49.027538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb2ee02b-4a3d-4fd1-a8c4-a4d25e54a726 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:49.028169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb2ee02b-4a3d-4fd1-a8c4-a4d25e54a726 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:49.029245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb2ee02b-4a3d-4fd1-a8c4-a4d25e54a726 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:49.029974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb2ee02b-4a3d-4fd1-a8c4-a4d25e54a726 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:49.034021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb2ee02b-4a3d-4fd1-a8c4-a4d25e54a726 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:49.186622 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bb2ee02b-4a3d-4fd1-a8c4-a4d25e54a726 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 200 len: 188 microversion: 2.1 time: 0.249282 Oct 24 10:36:49.187181 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1423/2805] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:36:48 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 188 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:49.200783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2da9189a-ce45-47e1-9652-ea0bf2ef9522 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:49.209346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2da9189a-ce45-47e1-9652-ea0bf2ef9522 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:49.222708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:49.362082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0e27e3db-6511-4e18-989f-cdd488040dca tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:49.387871 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e27e3db-6511-4e18-989f-cdd488040dca tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1553 microversion: 2.1 time: 0.696116 Oct 24 10:36:49.393948 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1383/2806] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:48 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1553 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:49.422876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5d623664-f125-4343-87dc-c0c2ff4ded4b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:49.423833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5d623664-f125-4343-87dc-c0c2ff4ded4b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:49.453190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d623664-f125-4343-87dc-c0c2ff4ded4b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:49.457929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d623664-f125-4343-87dc-c0c2ff4ded4b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:49.465182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d623664-f125-4343-87dc-c0c2ff4ded4b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:49.469681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d623664-f125-4343-87dc-c0c2ff4ded4b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:49.472185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d623664-f125-4343-87dc-c0c2ff4ded4b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:49.477100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d623664-f125-4343-87dc-c0c2ff4ded4b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:49.690720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2da9189a-ce45-47e1-9652-ea0bf2ef9522 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:49.703708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2da9189a-ce45-47e1-9652-ea0bf2ef9522 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:49.713606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2da9189a-ce45-47e1-9652-ea0bf2ef9522 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:49.750411 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2da9189a-ce45-47e1-9652-ea0bf2ef9522 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1452 microversion: 2.91 time: 0.561949 Oct 24 10:36:49.751830 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1424/2807] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:36:49 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1452 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:36:49.777247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9d5d9af1-c387-4c8f-b143-a068a1b83c39 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:49.778725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9d5d9af1-c387-4c8f-b143-a068a1b83c39 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:49.803066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d5d9af1-c387-4c8f-b143-a068a1b83c39 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:49.803776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d5d9af1-c387-4c8f-b143-a068a1b83c39 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:49.804398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d5d9af1-c387-4c8f-b143-a068a1b83c39 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:49.805368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d5d9af1-c387-4c8f-b143-a068a1b83c39 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:49.805917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d5d9af1-c387-4c8f-b143-a068a1b83c39 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:49.806439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d5d9af1-c387-4c8f-b143-a068a1b83c39 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:50.297571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5d623664-f125-4343-87dc-c0c2ff4ded4b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:50.319010 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5d623664-f125-4343-87dc-c0c2ff4ded4b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.921263 Oct 24 10:36:50.321440 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1384/2808] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:49 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:50.339235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eb64eaf5-77ce-4444-90f4-8cecd11b3b7e tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d031d940>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:50.420395 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eb64eaf5-77ce-4444-90f4-8cecd11b3b7e tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.094400 Oct 24 10:36:50.421594 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1385/2809] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:50 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:50.427846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5535c7d6-c312-4b9a-aecb-dee0a0df4e89 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:50.428688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5535c7d6-c312-4b9a-aecb-dee0a0df4e89 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:50.436558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5535c7d6-c312-4b9a-aecb-dee0a0df4e89 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:50.437089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5535c7d6-c312-4b9a-aecb-dee0a0df4e89 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:50.444392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5535c7d6-c312-4b9a-aecb-dee0a0df4e89 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:50.445196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5535c7d6-c312-4b9a-aecb-dee0a0df4e89 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:50.446051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5535c7d6-c312-4b9a-aecb-dee0a0df4e89 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:50.446714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5535c7d6-c312-4b9a-aecb-dee0a0df4e89 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:50.654393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9d5d9af1-c387-4c8f-b143-a068a1b83c39 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:50.674545 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9d5d9af1-c387-4c8f-b143-a068a1b83c39 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7" status: 200 len: 1319 microversion: 2.1 time: 0.919847 Oct 24 10:36:50.675555 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1425/2810] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:49 2022] GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 => generated 1319 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:50.709982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-073c06c2-cca2-48ac-a490-5faf89a4f588 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:50.713292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-073c06c2-cca2-48ac-a490-5faf89a4f588 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:50.728674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-073c06c2-cca2-48ac-a490-5faf89a4f588 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:50.729673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-073c06c2-cca2-48ac-a490-5faf89a4f588 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:50.730315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-073c06c2-cca2-48ac-a490-5faf89a4f588 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:50.731837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-073c06c2-cca2-48ac-a490-5faf89a4f588 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:50.734652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-073c06c2-cca2-48ac-a490-5faf89a4f588 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:50.736605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-073c06c2-cca2-48ac-a490-5faf89a4f588 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:50.855870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5535c7d6-c312-4b9a-aecb-dee0a0df4e89 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:50.873747 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5535c7d6-c312-4b9a-aecb-dee0a0df4e89 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.450770 Oct 24 10:36:50.874628 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1386/2811] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:50 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:50.892351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e7e102b3-2cd7-456d-b184-77ec22973033 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:50.904104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e7e102b3-2cd7-456d-b184-77ec22973033 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:50.916870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7e102b3-2cd7-456d-b184-77ec22973033 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:50.918767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7e102b3-2cd7-456d-b184-77ec22973033 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:50.921765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7e102b3-2cd7-456d-b184-77ec22973033 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:50.922805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7e102b3-2cd7-456d-b184-77ec22973033 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:50.923453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7e102b3-2cd7-456d-b184-77ec22973033 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:50.927623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7e102b3-2cd7-456d-b184-77ec22973033 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:52.173899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e7e102b3-2cd7-456d-b184-77ec22973033 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:52.190531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-073c06c2-cca2-48ac-a490-5faf89a4f588 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:52.195948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e7e102b3-2cd7-456d-b184-77ec22973033 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:52.206111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e7e102b3-2cd7-456d-b184-77ec22973033 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:52.207993 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-073c06c2-cca2-48ac-a490-5faf89a4f588 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1511 microversion: 2.1 time: 1.515789 Oct 24 10:36:52.213251 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1426/2812] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:50 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1511 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:52.230522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4113d206-c81b-434d-8d80-146d6f391b44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:52.232660 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e7e102b3-2cd7-456d-b184-77ec22973033 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1504 microversion: 2.91 time: 1.356033 Oct 24 10:36:52.238613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4113d206-c81b-434d-8d80-146d6f391b44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:52.242939 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1387/2813] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:36:50 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1504 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:36:52.259297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4113d206-c81b-434d-8d80-146d6f391b44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:52.260595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4113d206-c81b-434d-8d80-146d6f391b44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:52.261077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-0a6147ad-ad19-4dbf-b90d-e3d9f6fcd4f3 req-1ef7e17a-9684-45d8-bf41-9b0490d4bb8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b", "name": "network-vif-deleted", "tag": "2d820800-6db0-4bcd-9d32-e49d1a19862a"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:52.272330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4113d206-c81b-434d-8d80-146d6f391b44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:52.273388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4113d206-c81b-434d-8d80-146d6f391b44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:52.281145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4113d206-c81b-434d-8d80-146d6f391b44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:52.281841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4113d206-c81b-434d-8d80-146d6f391b44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:52.300479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0a6147ad-ad19-4dbf-b90d-e3d9f6fcd4f3 req-1ef7e17a-9684-45d8-bf41-9b0490d4bb8f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:52.301827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0a6147ad-ad19-4dbf-b90d-e3d9f6fcd4f3 req-1ef7e17a-9684-45d8-bf41-9b0490d4bb8f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:52.303798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0a6147ad-ad19-4dbf-b90d-e3d9f6fcd4f3 req-1ef7e17a-9684-45d8-bf41-9b0490d4bb8f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:52.339112 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-0a6147ad-ad19-4dbf-b90d-e3d9f6fcd4f3 req-1ef7e17a-9684-45d8-bf41-9b0490d4bb8f service nova] Creating event network-vif-deleted:2d820800-6db0-4bcd-9d32-e49d1a19862a for instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b on n-h1-858383-15 Oct 24 10:36:52.353354 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-0a6147ad-ad19-4dbf-b90d-e3d9f6fcd4f3 req-1ef7e17a-9684-45d8-bf41-9b0490d4bb8f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107114 Oct 24 10:36:52.355366 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1388/2814] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:52.375412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8591271f-168a-4ed2-a9b8-dc97cc4ab400 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d0351040>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:52.461989 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8591271f-168a-4ed2-a9b8-dc97cc4ab400 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.102915 Oct 24 10:36:52.462775 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1389/2815] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:52 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:52.476473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-626542e8-a105-4d40-92f0-da2df17a5d54 req-cb2f8152-eb49-403f-ac5f-6e63960f15bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3221498d-a495-448e-8adc-3a661c1a86a7", "name": "network-vif-plugged", "status": "completed", "tag": "efe0dee8-9cb1-4db6-a07b-50240e5390f2"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:52.519701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-626542e8-a105-4d40-92f0-da2df17a5d54 req-cb2f8152-eb49-403f-ac5f-6e63960f15bb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:52.520319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-626542e8-a105-4d40-92f0-da2df17a5d54 req-cb2f8152-eb49-403f-ac5f-6e63960f15bb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:52.521353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-626542e8-a105-4d40-92f0-da2df17a5d54 req-cb2f8152-eb49-403f-ac5f-6e63960f15bb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:52.563525 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-626542e8-a105-4d40-92f0-da2df17a5d54 req-cb2f8152-eb49-403f-ac5f-6e63960f15bb service nova] Creating event network-vif-plugged:efe0dee8-9cb1-4db6-a07b-50240e5390f2 for instance 3221498d-a495-448e-8adc-3a661c1a86a7 on n-h1-858383-15 Oct 24 10:36:52.578256 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-626542e8-a105-4d40-92f0-da2df17a5d54 req-cb2f8152-eb49-403f-ac5f-6e63960f15bb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113437 Oct 24 10:36:52.583491 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1390/2816] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:36:52.598299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b2102095-5104-4ba5-aa3a-35e5ab8e3a41 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:52.601949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b2102095-5104-4ba5-aa3a-35e5ab8e3a41 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:52.616701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2102095-5104-4ba5-aa3a-35e5ab8e3a41 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:52.617497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2102095-5104-4ba5-aa3a-35e5ab8e3a41 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:52.618114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2102095-5104-4ba5-aa3a-35e5ab8e3a41 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:52.618985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2102095-5104-4ba5-aa3a-35e5ab8e3a41 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:52.621757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2102095-5104-4ba5-aa3a-35e5ab8e3a41 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:52.622586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2102095-5104-4ba5-aa3a-35e5ab8e3a41 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:52.945448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4113d206-c81b-434d-8d80-146d6f391b44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:52.958123 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4113d206-c81b-434d-8d80-146d6f391b44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.743905 Oct 24 10:36:52.958728 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1427/2817] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:52 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:52.993207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4c93dc30-3644-4fd9-a393-bfe45ff11666 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:52.994271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4c93dc30-3644-4fd9-a393-bfe45ff11666 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:53.014852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c93dc30-3644-4fd9-a393-bfe45ff11666 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:53.017882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c93dc30-3644-4fd9-a393-bfe45ff11666 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:53.018822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c93dc30-3644-4fd9-a393-bfe45ff11666 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:53.021095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c93dc30-3644-4fd9-a393-bfe45ff11666 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:53.021808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c93dc30-3644-4fd9-a393-bfe45ff11666 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:53.023231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c93dc30-3644-4fd9-a393-bfe45ff11666 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:53.248069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b2102095-5104-4ba5-aa3a-35e5ab8e3a41 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:53.264223 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b2102095-5104-4ba5-aa3a-35e5ab8e3a41 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7" status: 200 len: 1319 microversion: 2.1 time: 0.674599 Oct 24 10:36:53.265300 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1391/2818] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:52 2022] GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 => generated 1319 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:53.282182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4967d1ec-85d8-4b44-8e61-d72840a016cf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:53.284009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4967d1ec-85d8-4b44-8e61-d72840a016cf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:53.315055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4967d1ec-85d8-4b44-8e61-d72840a016cf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:53.319257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4967d1ec-85d8-4b44-8e61-d72840a016cf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:53.319976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4967d1ec-85d8-4b44-8e61-d72840a016cf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:53.322595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4967d1ec-85d8-4b44-8e61-d72840a016cf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:53.328991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4967d1ec-85d8-4b44-8e61-d72840a016cf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:53.331919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4967d1ec-85d8-4b44-8e61-d72840a016cf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:53.578656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4c93dc30-3644-4fd9-a393-bfe45ff11666 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:53.592138 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4c93dc30-3644-4fd9-a393-bfe45ff11666 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.607490 Oct 24 10:36:53.592961 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1428/2819] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:52 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:36:53.610869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8fec3f79-0b0b-4586-8c1b-c79249093768 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:53.613017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8fec3f79-0b0b-4586-8c1b-c79249093768 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:53.630658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fec3f79-0b0b-4586-8c1b-c79249093768 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:53.635862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fec3f79-0b0b-4586-8c1b-c79249093768 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:53.637252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fec3f79-0b0b-4586-8c1b-c79249093768 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:53.639710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fec3f79-0b0b-4586-8c1b-c79249093768 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:53.640485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fec3f79-0b0b-4586-8c1b-c79249093768 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:53.641300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fec3f79-0b0b-4586-8c1b-c79249093768 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:53.691408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4967d1ec-85d8-4b44-8e61-d72840a016cf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:53.710421 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4967d1ec-85d8-4b44-8e61-d72840a016cf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1346 microversion: 2.1 time: 0.440749 Oct 24 10:36:53.714382 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1392/2820] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:53 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1346 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:53.728637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-16c272a0-8b80-4fb9-8a82-8d767594286e tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d0aa3c10>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:53.850947 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-16c272a0-8b80-4fb9-8a82-8d767594286e tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.127959 Oct 24 10:36:53.857017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8fec3f79-0b0b-4586-8c1b-c79249093768 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:53.861156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:53.870005 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1393/2821] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:53 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:53.875611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8fec3f79-0b0b-4586-8c1b-c79249093768 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:53.882973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8fec3f79-0b0b-4586-8c1b-c79249093768 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:53.884712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80a2db8b-31f5-46fd-bc4a-8dfa925a0a60 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-62509716", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "4c723f9d-e03c-43f2-9281-1f2dfc935187"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:53.894145 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8fec3f79-0b0b-4586-8c1b-c79249093768 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1510 microversion: 2.91 time: 0.296281 Oct 24 10:36:53.900066 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1429/2822] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:36:53 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1510 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:36:54.027093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-80a2db8b-31f5-46fd-bc4a-8dfa925a0a60 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] validate_networks() for [('4c723f9d-e03c-43f2-9281-1f2dfc935187', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:36:54.288530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d45fe0c7-b8e7-4d24-8490-1b714bb56db1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:54.289196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d45fe0c7-b8e7-4d24-8490-1b714bb56db1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:54.303340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d45fe0c7-b8e7-4d24-8490-1b714bb56db1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:54.315540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d45fe0c7-b8e7-4d24-8490-1b714bb56db1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:54.317382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d45fe0c7-b8e7-4d24-8490-1b714bb56db1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:54.318429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d45fe0c7-b8e7-4d24-8490-1b714bb56db1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:54.322256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d45fe0c7-b8e7-4d24-8490-1b714bb56db1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:54.323410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d45fe0c7-b8e7-4d24-8490-1b714bb56db1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:55.186364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d45fe0c7-b8e7-4d24-8490-1b714bb56db1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:55.216503 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d45fe0c7-b8e7-4d24-8490-1b714bb56db1 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7" status: 200 len: 1319 microversion: 2.1 time: 0.931484 Oct 24 10:36:55.222257 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1430/2823] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:54 2022] GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 => generated 1319 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:55.258541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c0932f66-fae3-42fc-9850-5b3f4d45c898 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:55.260242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c0932f66-fae3-42fc-9850-5b3f4d45c898 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:55.296822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0932f66-fae3-42fc-9850-5b3f4d45c898 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:55.299107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0932f66-fae3-42fc-9850-5b3f4d45c898 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:55.300059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0932f66-fae3-42fc-9850-5b3f4d45c898 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:55.301845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0932f66-fae3-42fc-9850-5b3f4d45c898 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:55.305794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0932f66-fae3-42fc-9850-5b3f4d45c898 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:55.307077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0932f66-fae3-42fc-9850-5b3f4d45c898 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:55.534772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c0932f66-fae3-42fc-9850-5b3f4d45c898 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:55.546313 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c0932f66-fae3-42fc-9850-5b3f4d45c898 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1346 microversion: 2.1 time: 0.322361 Oct 24 10:36:55.547574 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1431/2824] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:55 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1346 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:55.552814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-399c57be-e0db-48cc-9a77-e6ae69a098dd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d4df3160>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:55.614104 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-399c57be-e0db-48cc-9a77-e6ae69a098dd tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.064524 Oct 24 10:36:55.615390 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1432/2825] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:55 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:55.620668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4d9e161f-d1a0-4f47-b84c-5971a2defcf7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:55.621722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4d9e161f-d1a0-4f47-b84c-5971a2defcf7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:55.630280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d9e161f-d1a0-4f47-b84c-5971a2defcf7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:55.631023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d9e161f-d1a0-4f47-b84c-5971a2defcf7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:55.631663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d9e161f-d1a0-4f47-b84c-5971a2defcf7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:55.632940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d9e161f-d1a0-4f47-b84c-5971a2defcf7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:55.633585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d9e161f-d1a0-4f47-b84c-5971a2defcf7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:55.634318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d9e161f-d1a0-4f47-b84c-5971a2defcf7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:55.753068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4d9e161f-d1a0-4f47-b84c-5971a2defcf7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:55.780325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4d9e161f-d1a0-4f47-b84c-5971a2defcf7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:55.782032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4d9e161f-d1a0-4f47-b84c-5971a2defcf7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:55.802514 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4d9e161f-d1a0-4f47-b84c-5971a2defcf7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1510 microversion: 2.91 time: 0.185754 Oct 24 10:36:55.821556 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1433/2826] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:36:55 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:36:56.146990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-80a2db8b-31f5-46fd-bc4a-8dfa925a0a60 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:36:56.147563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-80a2db8b-31f5-46fd-bc4a-8dfa925a0a60 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:36:56.147918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-80a2db8b-31f5-46fd-bc4a-8dfa925a0a60 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:36:56.148515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-80a2db8b-31f5-46fd-bc4a-8dfa925a0a60 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:36:56.148963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-80a2db8b-31f5-46fd-bc4a-8dfa925a0a60 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:36:56.164675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80a2db8b-31f5-46fd-bc4a-8dfa925a0a60 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:56.165511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80a2db8b-31f5-46fd-bc4a-8dfa925a0a60 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:56.166190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80a2db8b-31f5-46fd-bc4a-8dfa925a0a60 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:56.169670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80a2db8b-31f5-46fd-bc4a-8dfa925a0a60 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:56.170166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80a2db8b-31f5-46fd-bc4a-8dfa925a0a60 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:56.173437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80a2db8b-31f5-46fd-bc4a-8dfa925a0a60 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:56.199410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-80a2db8b-31f5-46fd-bc4a-8dfa925a0a60 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Getting quotas for project 4878c0e43a9d4db8ba5c6590b43624f0. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:36:56.211597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-80a2db8b-31f5-46fd-bc4a-8dfa925a0a60 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Getting quotas for user 45500f699a6f463b8755f0417b24151c and project 4878c0e43a9d4db8ba5c6590b43624f0. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:36:56.250694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3b23e2e9-8fd9-49b7-95ac-ebcb3582d247 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:56.251396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3b23e2e9-8fd9-49b7-95ac-ebcb3582d247 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:56.257230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-80a2db8b-31f5-46fd-bc4a-8dfa925a0a60 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:36:56.260178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-80a2db8b-31f5-46fd-bc4a-8dfa925a0a60 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:36:56.263846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b23e2e9-8fd9-49b7-95ac-ebcb3582d247 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:56.264527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b23e2e9-8fd9-49b7-95ac-ebcb3582d247 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:56.265211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b23e2e9-8fd9-49b7-95ac-ebcb3582d247 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:56.277055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b23e2e9-8fd9-49b7-95ac-ebcb3582d247 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:56.277761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b23e2e9-8fd9-49b7-95ac-ebcb3582d247 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:56.280631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b23e2e9-8fd9-49b7-95ac-ebcb3582d247 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:56.413849 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-80a2db8b-31f5-46fd-bc4a-8dfa925a0a60 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.540007 Oct 24 10:36:56.415546 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1394/2827] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:36:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:36:56.427950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-726daf75-160f-4198-b683-be850d97f28e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:56.428600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-726daf75-160f-4198-b683-be850d97f28e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:56.958174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-726daf75-160f-4198-b683-be850d97f28e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:56.977399 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-726daf75-160f-4198-b683-be850d97f28e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1213 microversion: 2.1 time: 0.551917 Oct 24 10:36:56.979281 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1395/2828] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:56 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1213 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:57.018168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6f3b92ff-6be4-41b3-9244-704806180a03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:57.025202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6f3b92ff-6be4-41b3-9244-704806180a03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:57.046431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f3b92ff-6be4-41b3-9244-704806180a03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:57.051171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f3b92ff-6be4-41b3-9244-704806180a03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:57.051867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f3b92ff-6be4-41b3-9244-704806180a03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:57.055919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f3b92ff-6be4-41b3-9244-704806180a03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:57.056677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f3b92ff-6be4-41b3-9244-704806180a03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:57.057315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f3b92ff-6be4-41b3-9244-704806180a03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:57.332940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3b23e2e9-8fd9-49b7-95ac-ebcb3582d247 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:57.353165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6f3b92ff-6be4-41b3-9244-704806180a03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:57.358263 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3b23e2e9-8fd9-49b7-95ac-ebcb3582d247 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7" status: 200 len: 1469 microversion: 2.1 time: 1.112265 Oct 24 10:36:57.371345 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1434/2829] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:56 2022] GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 => generated 1469 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:36:57.379223 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6f3b92ff-6be4-41b3-9244-704806180a03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1346 microversion: 2.1 time: 0.378189 Oct 24 10:36:57.384673 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1396/2830] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:56 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1346 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:57.395211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0eacfb95-fdb6-484c-84b3-3c276ebf6f17 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d4df3670>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:57.412475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b9309d2b-be4e-4397-805d-4f39320aa690 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:57.417418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b9309d2b-be4e-4397-805d-4f39320aa690 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:57.438691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9309d2b-be4e-4397-805d-4f39320aa690 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:57.441853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9309d2b-be4e-4397-805d-4f39320aa690 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:57.444717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9309d2b-be4e-4397-805d-4f39320aa690 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:57.449703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9309d2b-be4e-4397-805d-4f39320aa690 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:57.450465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9309d2b-be4e-4397-805d-4f39320aa690 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:57.450911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9309d2b-be4e-4397-805d-4f39320aa690 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:57.514134 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0eacfb95-fdb6-484c-84b3-3c276ebf6f17 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.140501 Oct 24 10:36:57.527834 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1435/2831] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:57 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:57.702704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9309d2b-be4e-4397-805d-4f39320aa690 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:57.721052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9309d2b-be4e-4397-805d-4f39320aa690 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:57.725904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9309d2b-be4e-4397-805d-4f39320aa690 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:57.742909 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b9309d2b-be4e-4397-805d-4f39320aa690 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1531 microversion: 2.91 time: 0.353163 Oct 24 10:36:57.756944 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1397/2832] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:36:57 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1531 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:36:58.207680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a4d3b128-d913-4b5d-a4b2-c4c7919db7d5 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-469555117", "block_migration": true, "disk_over_commit": false}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:36:58.218681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a4d3b128-d913-4b5d-a4b2-c4c7919db7d5 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:58.239097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4d3b128-d913-4b5d-a4b2-c4c7919db7d5 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:58.239938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4d3b128-d913-4b5d-a4b2-c4c7919db7d5 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:58.241100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4d3b128-d913-4b5d-a4b2-c4c7919db7d5 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:58.242253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4d3b128-d913-4b5d-a4b2-c4c7919db7d5 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:58.243776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4d3b128-d913-4b5d-a4b2-c4c7919db7d5 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:58.244417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4d3b128-d913-4b5d-a4b2-c4c7919db7d5 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:58.585280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fd9ac132-7af1-4b80-9c1d-6884f9d646a1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:58.585785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fd9ac132-7af1-4b80-9c1d-6884f9d646a1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:58.596868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd9ac132-7af1-4b80-9c1d-6884f9d646a1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:58.597392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd9ac132-7af1-4b80-9c1d-6884f9d646a1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:58.597815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd9ac132-7af1-4b80-9c1d-6884f9d646a1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:58.607072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd9ac132-7af1-4b80-9c1d-6884f9d646a1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:58.608459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd9ac132-7af1-4b80-9c1d-6884f9d646a1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:58.611682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd9ac132-7af1-4b80-9c1d-6884f9d646a1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:58.785512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:36:58.829906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-a4d3b128-d913-4b5d-a4b2-c4c7919db7d5 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lazy-loading 'flavor' on Instance uuid 3221498d-a495-448e-8adc-3a661c1a86a7 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:36:58.855178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a4d3b128-d913-4b5d-a4b2-c4c7919db7d5 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Going to try to live migrate instance to tempest-host-469555117 {{(pid=120426) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 24 10:36:58.880964 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-a4d3b128-d913-4b5d-a4b2-c4c7919db7d5 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] HTTP exception thrown: Compute host tempest-host-469555117 could not be found. Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a4d3b128-d913-4b5d-a4b2-c4c7919db7d5 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Request method failure captured: Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7/action HTTP/1.1 Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 106 Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmqt2aNJBD5RSTyqllzIdHaz9HdwC1iQrpSeVyvC0_PBEE3n4lQWFrScnnyBz0qE4WXW0riSLByDU7OTMmp7xv_9A5KnWDGh5JkWhcBNM2JcZGQINUOSMwOHNGYklIUuE_dfLbJvShQQg3kBFP_MAEHBTDPQgSxp-s8d-PLXjuWC43Y Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: f888917a18194ea5b05b3851f03d3e08 Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-LiveMigrationNegativeTest-410604715 Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f888917a18194ea5b05b3851f03d3e08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f888917a18194ea5b05b3851f03d3e08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f888917a18194ea5b05b3851f03d3e08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f888917a18194ea5b05b3851f03d3e08", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-LiveMigrationNegativeTest-410604715 Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: f888917a18194ea5b05b3851f03d3e08 Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-410604715 Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-LiveMigrationNegativeTest-410604715-project-admin Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: d84cce5285a84e52b8687fcef27c749f Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-LiveMigrationNegativeTest-410604715-project-admin Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: {"os-migrateLive": {"host": "tempest-host-469555117", "block_migration": true, "disk_over_commit": false}} Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: exception: Compute host tempest-host-469555117 could not be found. Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '3221498d-a495-448e-8adc-3a661c1a86a7', 'body': {'os-migrateLive': {'host': 'tempest-host-469555117', 'block_migration': True, 'disk_over_commit': False}}} Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5490, in live_migrate Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 24 10:36:58.894419 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-469555117 could not be found. Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-469555117 could not be found. Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-469555117 could not be found. Oct 24 10:36:58.899082 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:36:58.903848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a4d3b128-d913-4b5d-a4b2-c4c7919db7d5 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Returning 400 to user: Compute host tempest-host-469555117 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:36:58.905622 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a4d3b128-d913-4b5d-a4b2-c4c7919db7d5 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7/action" status: 400 len: 99 microversion: 2.1 time: 1.372889 Oct 24 10:36:58.906739 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1436/2833] 10.222.0.50 () {60 vars in 1279 bytes} [Mon Oct 24 10:36:57 2022] POST /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7/action => generated 99 bytes in 1378 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 10:36:58.912446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e5f6677c-1744-4b73-ad1b-bd41ac712a28 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:58.913662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e5f6677c-1744-4b73-ad1b-bd41ac712a28 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:58.928491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5f6677c-1744-4b73-ad1b-bd41ac712a28 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:58.932999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5f6677c-1744-4b73-ad1b-bd41ac712a28 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:58.934587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5f6677c-1744-4b73-ad1b-bd41ac712a28 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:58.937123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5f6677c-1744-4b73-ad1b-bd41ac712a28 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:58.937886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5f6677c-1744-4b73-ad1b-bd41ac712a28 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:58.938503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5f6677c-1744-4b73-ad1b-bd41ac712a28 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:59.161998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e5f6677c-1744-4b73-ad1b-bd41ac712a28 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:59.182580 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e5f6677c-1744-4b73-ad1b-bd41ac712a28 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1265 microversion: 2.1 time: 0.267662 Oct 24 10:36:59.183491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-fd9ac132-7af1-4b80-9c1d-6884f9d646a1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lazy-loading 'services' on Instance uuid 64cc15e2-c27b-4e1d-8673-338e434031db {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:36:59.185126 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1437/2834] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:58 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:59.200667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ffc4c9be-c0c3-404f-a5d1-3d34e721fa54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:59.207437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ffc4c9be-c0c3-404f-a5d1-3d34e721fa54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:59.242683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffc4c9be-c0c3-404f-a5d1-3d34e721fa54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:59.245760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffc4c9be-c0c3-404f-a5d1-3d34e721fa54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:59.247874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffc4c9be-c0c3-404f-a5d1-3d34e721fa54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:59.249296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffc4c9be-c0c3-404f-a5d1-3d34e721fa54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:59.250256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffc4c9be-c0c3-404f-a5d1-3d34e721fa54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:59.251134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffc4c9be-c0c3-404f-a5d1-3d34e721fa54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:59.253463 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fd9ac132-7af1-4b80-9c1d-6884f9d646a1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1938 microversion: 2.91 time: 1.478282 Oct 24 10:36:59.281981 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1398/2835] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:36:57 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1938 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:36:59.297172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-76872f1f-ab0c-4e64-a2e6-a34f0406e7a5 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d0ca8b80>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:59.377516 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-76872f1f-ab0c-4e64-a2e6-a34f0406e7a5 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.094314 Oct 24 10:36:59.379292 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1399/2836] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:36:59 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:59.390834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-93652cb0-cb6a-4b25-9d20-270f99e466f8 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:59.400815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-93652cb0-cb6a-4b25-9d20-270f99e466f8 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:59.423526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93652cb0-cb6a-4b25-9d20-270f99e466f8 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:59.424200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93652cb0-cb6a-4b25-9d20-270f99e466f8 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:59.424822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93652cb0-cb6a-4b25-9d20-270f99e466f8 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:59.425726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93652cb0-cb6a-4b25-9d20-270f99e466f8 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:59.426342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93652cb0-cb6a-4b25-9d20-270f99e466f8 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:59.426933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93652cb0-cb6a-4b25-9d20-270f99e466f8 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:59.447489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ffc4c9be-c0c3-404f-a5d1-3d34e721fa54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:36:59.474852 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ffc4c9be-c0c3-404f-a5d1-3d34e721fa54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1346 microversion: 2.1 time: 0.287822 Oct 24 10:36:59.475329 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1438/2837] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:59 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1346 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:36:59.504334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-81bcfb98-86ff-4da4-9398-95a6f00a964e tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:36:59.508454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-81bcfb98-86ff-4da4-9398-95a6f00a964e tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:36:59.521168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81bcfb98-86ff-4da4-9398-95a6f00a964e tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:59.521944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81bcfb98-86ff-4da4-9398-95a6f00a964e tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:59.529777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81bcfb98-86ff-4da4-9398-95a6f00a964e tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:59.530866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81bcfb98-86ff-4da4-9398-95a6f00a964e tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:36:59.531504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81bcfb98-86ff-4da4-9398-95a6f00a964e tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:36:59.532231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81bcfb98-86ff-4da4-9398-95a6f00a964e tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:36:59.702977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=8 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:00.002748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-81bcfb98-86ff-4da4-9398-95a6f00a964e tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lazy-loading 'services' on Instance uuid 64cc15e2-c27b-4e1d-8673-338e434031db {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:37:00.081483 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-81bcfb98-86ff-4da4-9398-95a6f00a964e tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1938 microversion: 2.91 time: 0.583410 Oct 24 10:37:00.082774 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1439/2838] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:36:59 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1938 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:00.120272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-364895d4-47d0-4a46-97d0-0db22b09ffd4 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:00.144630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-364895d4-47d0-4a46-97d0-0db22b09ffd4 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:00.154574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-364895d4-47d0-4a46-97d0-0db22b09ffd4 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:00.155432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-364895d4-47d0-4a46-97d0-0db22b09ffd4 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:00.156159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-93652cb0-cb6a-4b25-9d20-270f99e466f8 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:00.157598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-364895d4-47d0-4a46-97d0-0db22b09ffd4 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:00.162793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-364895d4-47d0-4a46-97d0-0db22b09ffd4 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:00.168048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-364895d4-47d0-4a46-97d0-0db22b09ffd4 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:00.169620 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-93652cb0-cb6a-4b25-9d20-270f99e466f8 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7" status: 200 len: 1469 microversion: 2.1 time: 0.788787 Oct 24 10:37:00.170224 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1400/2839] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:36:59 2022] GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 => generated 1469 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:00.225607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a3aab74b-5492-4ea4-9e42-247734862513 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:00.230929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a3aab74b-5492-4ea4-9e42-247734862513 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:00.240255 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-364895d4-47d0-4a46-97d0-0db22b09ffd4 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.126912 Oct 24 10:37:00.243377 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1440/2840] 10.222.0.50 () {60 vars in 1217 bytes} [Mon Oct 24 10:37:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:37:00.255404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3aab74b-5492-4ea4-9e42-247734862513 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:00.263817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3aab74b-5492-4ea4-9e42-247734862513 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:00.264595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-00a6d8e1-20f4-4362-9f43-8bdc7a54f333 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:00.265275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3aab74b-5492-4ea4-9e42-247734862513 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:00.267289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3aab74b-5492-4ea4-9e42-247734862513 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:00.267487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-00a6d8e1-20f4-4362-9f43-8bdc7a54f333 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:00.273845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3aab74b-5492-4ea4-9e42-247734862513 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:00.274531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3aab74b-5492-4ea4-9e42-247734862513 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:00.303578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00a6d8e1-20f4-4362-9f43-8bdc7a54f333 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:00.304264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00a6d8e1-20f4-4362-9f43-8bdc7a54f333 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:00.306577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00a6d8e1-20f4-4362-9f43-8bdc7a54f333 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:00.307431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00a6d8e1-20f4-4362-9f43-8bdc7a54f333 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:00.311760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00a6d8e1-20f4-4362-9f43-8bdc7a54f333 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:00.312362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00a6d8e1-20f4-4362-9f43-8bdc7a54f333 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:00.381905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-00a6d8e1-20f4-4362-9f43-8bdc7a54f333 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lazy-loading 'flavor' on Instance uuid 64cc15e2-c27b-4e1d-8673-338e434031db {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:37:00.578944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a3aab74b-5492-4ea4-9e42-247734862513 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:00.596272 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a3aab74b-5492-4ea4-9e42-247734862513 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1271 microversion: 2.1 time: 0.382098 Oct 24 10:37:00.610309 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1401/2841] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:00 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1271 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:00.630836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f8e409b5-96ec-4df4-bd55-a93c31dfa5a8 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d4f81af0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:00.787966 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f8e409b5-96ec-4df4-bd55-a93c31dfa5a8 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.175759 Oct 24 10:37:00.788558 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1402/2842] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:37:00 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:00.799768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3df4faab-c141-4275-b21a-2ef0b7af6b58 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1919594061", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:01.057376 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-00a6d8e1-20f4-4362-9f43-8bdc7a54f333 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "POST /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db/action" status: 202 len: 0 microversion: 2.91 time: 0.799961 Oct 24 10:37:01.058539 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1441/2843] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Oct 24 10:37:00 2022] POST /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db/action => generated 0 bytes in 802 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 24 10:37:01.103796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4290bb24-471d-43d5-98a5-f543c5e32074 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:01.104620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4290bb24-471d-43d5-98a5-f543c5e32074 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:01.142250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-3df4faab-c141-4275-b21a-2ef0b7af6b58 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] validate_networks() for None {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:37:01.143525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4290bb24-471d-43d5-98a5-f543c5e32074 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:01.144026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4290bb24-471d-43d5-98a5-f543c5e32074 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:01.153749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4290bb24-471d-43d5-98a5-f543c5e32074 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:01.155549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4290bb24-471d-43d5-98a5-f543c5e32074 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:01.157400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4290bb24-471d-43d5-98a5-f543c5e32074 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:01.159317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4290bb24-471d-43d5-98a5-f543c5e32074 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:01.610469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4290bb24-471d-43d5-98a5-f543c5e32074 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:01.626064 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4290bb24-471d-43d5-98a5-f543c5e32074 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1346 microversion: 2.1 time: 0.565272 Oct 24 10:37:01.626979 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1442/2844] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:01 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1346 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:01.636372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-821073e8-84b8-49d5-adb9-e7392cc81c84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:01.639943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-821073e8-84b8-49d5-adb9-e7392cc81c84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:01.662669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-821073e8-84b8-49d5-adb9-e7392cc81c84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:01.664221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-821073e8-84b8-49d5-adb9-e7392cc81c84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:01.665703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-821073e8-84b8-49d5-adb9-e7392cc81c84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:01.667858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-821073e8-84b8-49d5-adb9-e7392cc81c84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:01.669626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-821073e8-84b8-49d5-adb9-e7392cc81c84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:01.670988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-821073e8-84b8-49d5-adb9-e7392cc81c84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:01.794652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-3df4faab-c141-4275-b21a-2ef0b7af6b58 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:37:01.795625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-3df4faab-c141-4275-b21a-2ef0b7af6b58 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:37:01.796628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-3df4faab-c141-4275-b21a-2ef0b7af6b58 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:37:01.797813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-3df4faab-c141-4275-b21a-2ef0b7af6b58 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:37:01.798419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-3df4faab-c141-4275-b21a-2ef0b7af6b58 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:37:01.827104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3df4faab-c141-4275-b21a-2ef0b7af6b58 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:01.829200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3df4faab-c141-4275-b21a-2ef0b7af6b58 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:01.829722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3df4faab-c141-4275-b21a-2ef0b7af6b58 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:01.830555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3df4faab-c141-4275-b21a-2ef0b7af6b58 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:01.831016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-821073e8-84b8-49d5-adb9-e7392cc81c84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:01.831151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3df4faab-c141-4275-b21a-2ef0b7af6b58 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:01.831441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3df4faab-c141-4275-b21a-2ef0b7af6b58 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:01.841687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-821073e8-84b8-49d5-adb9-e7392cc81c84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:01.843268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-821073e8-84b8-49d5-adb9-e7392cc81c84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:01.851016 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-821073e8-84b8-49d5-adb9-e7392cc81c84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.221250 Oct 24 10:37:01.852023 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1443/2845] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:01 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:01.865824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5b627112-e41b-4aed-91fe-99a0361d6eba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:01.866745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5b627112-e41b-4aed-91fe-99a0361d6eba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:01.882629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b627112-e41b-4aed-91fe-99a0361d6eba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:01.883140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b627112-e41b-4aed-91fe-99a0361d6eba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:01.883591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b627112-e41b-4aed-91fe-99a0361d6eba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:01.884321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b627112-e41b-4aed-91fe-99a0361d6eba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:01.888777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b627112-e41b-4aed-91fe-99a0361d6eba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:01.891184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b627112-e41b-4aed-91fe-99a0361d6eba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:01.922979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-3df4faab-c141-4275-b21a-2ef0b7af6b58 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Getting quotas for project a3656fcc947f4652a6eae2e31be21ada. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:37:01.947421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-3df4faab-c141-4275-b21a-2ef0b7af6b58 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Getting quotas for user f71950ff4118494288b1088fd7c700cd and project a3656fcc947f4652a6eae2e31be21ada. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:37:01.995525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3df4faab-c141-4275-b21a-2ef0b7af6b58 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:37:02.009264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3df4faab-c141-4275-b21a-2ef0b7af6b58 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:37:02.082768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5b627112-e41b-4aed-91fe-99a0361d6eba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:02.095830 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5b627112-e41b-4aed-91fe-99a0361d6eba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1271 microversion: 2.1 time: 0.237551 Oct 24 10:37:02.097070 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1444/2846] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:01 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:02.108628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e48c6df-d793-4aeb-87dd-9fa93ea9ad7a tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d06f55e0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:02.157454 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3df4faab-c141-4275-b21a-2ef0b7af6b58 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.361144 Oct 24 10:37:02.158757 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1403/2847] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:37:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:37:02.172064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-51891498-8c41-477a-bea8-4a2f50bef06e tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:02.178241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-51891498-8c41-477a-bea8-4a2f50bef06e tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:02.270064 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1e48c6df-d793-4aeb-87dd-9fa93ea9ad7a tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.171682 Oct 24 10:37:02.279666 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1445/2848] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:37:02 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:02.455186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-51891498-8c41-477a-bea8-4a2f50bef06e tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:02.466503 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-51891498-8c41-477a-bea8-4a2f50bef06e tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1219 microversion: 2.1 time: 0.298667 Oct 24 10:37:02.467961 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1404/2849] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:02 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1219 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:02.656446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-62fefff8-f842-44f9-a1cf-075cbaf2e87f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:02.657176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-62fefff8-f842-44f9-a1cf-075cbaf2e87f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:02.702358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-62fefff8-f842-44f9-a1cf-075cbaf2e87f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:02.702884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-62fefff8-f842-44f9-a1cf-075cbaf2e87f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:02.707565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-62fefff8-f842-44f9-a1cf-075cbaf2e87f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:02.712260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-62fefff8-f842-44f9-a1cf-075cbaf2e87f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:02.714039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-62fefff8-f842-44f9-a1cf-075cbaf2e87f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:02.725260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-62fefff8-f842-44f9-a1cf-075cbaf2e87f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:02.862076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-62fefff8-f842-44f9-a1cf-075cbaf2e87f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:02.862591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-62fefff8-f842-44f9-a1cf-075cbaf2e87f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:02.863033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-62fefff8-f842-44f9-a1cf-075cbaf2e87f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:02.878533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-62fefff8-f842-44f9-a1cf-075cbaf2e87f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lazy-loading 'fault' on Instance uuid afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:37:02.883712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7aec5958-d115-4a11-bf85-47d40f82132c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:02.884918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7aec5958-d115-4a11-bf85-47d40f82132c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:02.904916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7aec5958-d115-4a11-bf85-47d40f82132c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:02.905545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7aec5958-d115-4a11-bf85-47d40f82132c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:02.911485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7aec5958-d115-4a11-bf85-47d40f82132c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:02.917486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7aec5958-d115-4a11-bf85-47d40f82132c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:02.918460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7aec5958-d115-4a11-bf85-47d40f82132c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:02.919967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7aec5958-d115-4a11-bf85-47d40f82132c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:03.029659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-62fefff8-f842-44f9-a1cf-075cbaf2e87f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:03.090264 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-62fefff8-f842-44f9-a1cf-075cbaf2e87f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 200 len: 1351 microversion: 2.1 time: 0.430481 Oct 24 10:37:03.091050 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1446/2850] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:02 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 1351 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:03.135722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bd9bc6fa-a935-4f0c-bb48-24be5a665fc7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:03.136336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bd9bc6fa-a935-4f0c-bb48-24be5a665fc7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:03.150435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7aec5958-d115-4a11-bf85-47d40f82132c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:03.162327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7aec5958-d115-4a11-bf85-47d40f82132c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:03.169634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd9bc6fa-a935-4f0c-bb48-24be5a665fc7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:03.170166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd9bc6fa-a935-4f0c-bb48-24be5a665fc7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:03.170618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd9bc6fa-a935-4f0c-bb48-24be5a665fc7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:03.173402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7aec5958-d115-4a11-bf85-47d40f82132c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:03.178766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd9bc6fa-a935-4f0c-bb48-24be5a665fc7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:03.179526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd9bc6fa-a935-4f0c-bb48-24be5a665fc7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:03.181471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd9bc6fa-a935-4f0c-bb48-24be5a665fc7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:03.204341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:03.206319 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7aec5958-d115-4a11-bf85-47d40f82132c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.327286 Oct 24 10:37:03.218133 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1405/2851] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:02 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:03.295316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-026a4f99-8276-4293-8c1e-4fc2f9dced1d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d0aa3550>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:03.377242 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-026a4f99-8276-4293-8c1e-4fc2f9dced1d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1424 microversion: 2.1 time: 0.086317 Oct 24 10:37:03.377838 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1406/2852] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:37:03 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1424 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:03.417617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bd9bc6fa-a935-4f0c-bb48-24be5a665fc7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:03.431270 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bd9bc6fa-a935-4f0c-bb48-24be5a665fc7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1271 microversion: 2.1 time: 0.296397 Oct 24 10:37:03.434594 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1447/2853] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:03 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1271 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:03.491031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3ff38c8c-7bf7-4c93-8fa9-123614b1f112 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:03.492000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3ff38c8c-7bf7-4c93-8fa9-123614b1f112 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:03.494289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:03.636293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3ff38c8c-7bf7-4c93-8fa9-123614b1f112 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:03.655773 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3ff38c8c-7bf7-4c93-8fa9-123614b1f112 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1219 microversion: 2.1 time: 0.168644 Oct 24 10:37:03.657097 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1407/2854] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:03 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1219 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:04.116426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dc024555-66f4-4ae3-ad5d-3d9a14f9ad32 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:04.133726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dc024555-66f4-4ae3-ad5d-3d9a14f9ad32 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:04.145645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc024555-66f4-4ae3-ad5d-3d9a14f9ad32 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:04.149945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc024555-66f4-4ae3-ad5d-3d9a14f9ad32 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:04.150771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc024555-66f4-4ae3-ad5d-3d9a14f9ad32 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:04.151528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc024555-66f4-4ae3-ad5d-3d9a14f9ad32 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:04.151999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc024555-66f4-4ae3-ad5d-3d9a14f9ad32 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:04.152429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc024555-66f4-4ae3-ad5d-3d9a14f9ad32 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:04.194976 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-dc024555-66f4-4ae3-ad5d-3d9a14f9ad32 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dc024555-66f4-4ae3-ad5d-3d9a14f9ad32 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b HTTP/1.1 Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b'} Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:04.213982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:04.219576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:04.219576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:04.219576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:04.219576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:37:04.219576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:37:04.219576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:37:04.219576 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:04.219576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dc024555-66f4-4ae3-ad5d-3d9a14f9ad32 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:37:04.220194 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dc024555-66f4-4ae3-ad5d-3d9a14f9ad32 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 404 len: 111 microversion: 2.1 time: 0.107980 Oct 24 10:37:04.221605 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1448/2855] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:04 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:37:04.251962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7e80d63d-aa71-4e4f-9830-9df9643ee724 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:04.252650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7e80d63d-aa71-4e4f-9830-9df9643ee724 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:04.264653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e80d63d-aa71-4e4f-9830-9df9643ee724 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:04.268905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e80d63d-aa71-4e4f-9830-9df9643ee724 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:04.269542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e80d63d-aa71-4e4f-9830-9df9643ee724 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:04.270278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e80d63d-aa71-4e4f-9830-9df9643ee724 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:04.271018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e80d63d-aa71-4e4f-9830-9df9643ee724 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:04.271612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e80d63d-aa71-4e4f-9830-9df9643ee724 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:04.337309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:04.393554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d95e76ca-1948-4dbd-af29-a2183f943c9c tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d09abc10>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:04.469769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7e80d63d-aa71-4e4f-9830-9df9643ee724 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:04.474065 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d95e76ca-1948-4dbd-af29-a2183f943c9c tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1433 microversion: 2.1 time: 0.084373 Oct 24 10:37:04.480728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7e80d63d-aa71-4e4f-9830-9df9643ee724 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:04.482320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7e80d63d-aa71-4e4f-9830-9df9643ee724 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:04.485845 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1449/2856] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:37:04 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1433 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:04.500318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6be7c85e-8c52-4001-887b-814695757ca3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:04.500486 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7e80d63d-aa71-4e4f-9830-9df9643ee724 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.251937 Oct 24 10:37:04.501368 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1408/2857] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:04 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:04.517339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-29883779-d847-4b58-b4a9-fe2a458157b9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:04.517545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6be7c85e-8c52-4001-887b-814695757ca3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:04.518593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-29883779-d847-4b58-b4a9-fe2a458157b9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:04.529256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29883779-d847-4b58-b4a9-fe2a458157b9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:04.531487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29883779-d847-4b58-b4a9-fe2a458157b9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:04.532146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29883779-d847-4b58-b4a9-fe2a458157b9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:04.534018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29883779-d847-4b58-b4a9-fe2a458157b9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:04.537532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29883779-d847-4b58-b4a9-fe2a458157b9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:04.538416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29883779-d847-4b58-b4a9-fe2a458157b9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:04.544483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6be7c85e-8c52-4001-887b-814695757ca3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:04.547123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6be7c85e-8c52-4001-887b-814695757ca3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:04.549095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6be7c85e-8c52-4001-887b-814695757ca3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:04.551666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6be7c85e-8c52-4001-887b-814695757ca3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:04.552366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6be7c85e-8c52-4001-887b-814695757ca3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:04.554673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6be7c85e-8c52-4001-887b-814695757ca3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:04.608429 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-6be7c85e-8c52-4001-887b-814695757ca3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6be7c85e-8c52-4001-887b-814695757ca3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b/os-volume_attachments HTTP/1.1 Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'server_id': 'afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b'} Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:37:04.617723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:37:04.621845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:37:04.621845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:04.621845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:04.621845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:04.621845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:04.621845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:04.621845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:04.621845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:37:04.621845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:37:04.621845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:37:04.621845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:04.621845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6be7c85e-8c52-4001-887b-814695757ca3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:37:04.623704 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6be7c85e-8c52-4001-887b-814695757ca3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.135887 Oct 24 10:37:04.629115 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1450/2858] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:37:04 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b/os-volume_attachments => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:37:04.653710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8294a81d-a820-4106-87da-83cd80be2e6b tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d0a3dc10>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:04.744217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-29883779-d847-4b58-b4a9-fe2a458157b9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:04.761419 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8294a81d-a820-4106-87da-83cd80be2e6b tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 200 len: 1433 microversion: 2.1 time: 0.128746 Oct 24 10:37:04.766445 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-29883779-d847-4b58-b4a9-fe2a458157b9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1271 microversion: 2.1 time: 0.263622 Oct 24 10:37:04.773118 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1451/2859] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:37:04 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 1433 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:04.785576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8a222679-f2e3-4e6f-95ba-3d2bfcf9e90d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:04.786201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8a222679-f2e3-4e6f-95ba-3d2bfcf9e90d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:04.794242 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1409/2860] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:04 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1271 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:04.805412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6f872731-73dc-4e61-b0a1-fc842bf92bde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:04.806042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6f872731-73dc-4e61-b0a1-fc842bf92bde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:04.808392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a222679-f2e3-4e6f-95ba-3d2bfcf9e90d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:04.809385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a222679-f2e3-4e6f-95ba-3d2bfcf9e90d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:04.811210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a222679-f2e3-4e6f-95ba-3d2bfcf9e90d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:04.813771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a222679-f2e3-4e6f-95ba-3d2bfcf9e90d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:04.814438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a222679-f2e3-4e6f-95ba-3d2bfcf9e90d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:04.816067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a222679-f2e3-4e6f-95ba-3d2bfcf9e90d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:04.838983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f872731-73dc-4e61-b0a1-fc842bf92bde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:04.842212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f872731-73dc-4e61-b0a1-fc842bf92bde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:04.843129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f872731-73dc-4e61-b0a1-fc842bf92bde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:04.844050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f872731-73dc-4e61-b0a1-fc842bf92bde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:04.846087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f872731-73dc-4e61-b0a1-fc842bf92bde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:04.846700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f872731-73dc-4e61-b0a1-fc842bf92bde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:04.994669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8a222679-f2e3-4e6f-95ba-3d2bfcf9e90d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:05.009656 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8a222679-f2e3-4e6f-95ba-3d2bfcf9e90d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1271 microversion: 2.1 time: 0.235410 Oct 24 10:37:05.013199 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1452/2861] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:04 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:05.092630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-175fd9f5-da03-472f-9562-c61476c3816c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-110345335", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "7e246fd4-526c-4b90-abc8-eb217581a916"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:05.206246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-175fd9f5-da03-472f-9562-c61476c3816c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] validate_networks() for [('7e246fd4-526c-4b90-abc8-eb217581a916', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:37:05.531454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6f872731-73dc-4e61-b0a1-fc842bf92bde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9fe821ad1b43f2988dd30521c6c335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c125be93d647e1b2c0fdd4ae2efb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:05.545468 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6f872731-73dc-4e61-b0a1-fc842bf92bde tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 200 len: 1478 microversion: 2.1 time: 0.747350 Oct 24 10:37:05.546524 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1410/2862] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:04 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 1478 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:05.553147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b794b4df-4991-4d94-8d93-806e9f8dcd96 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:05.556546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b794b4df-4991-4d94-8d93-806e9f8dcd96 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:05.574747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b794b4df-4991-4d94-8d93-806e9f8dcd96 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:05.575634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b794b4df-4991-4d94-8d93-806e9f8dcd96 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:05.585719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b794b4df-4991-4d94-8d93-806e9f8dcd96 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:05.587781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b794b4df-4991-4d94-8d93-806e9f8dcd96 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:05.593096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b794b4df-4991-4d94-8d93-806e9f8dcd96 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:05.593775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b794b4df-4991-4d94-8d93-806e9f8dcd96 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:05.739071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b794b4df-4991-4d94-8d93-806e9f8dcd96 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:05.751195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b794b4df-4991-4d94-8d93-806e9f8dcd96 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:05.758879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b794b4df-4991-4d94-8d93-806e9f8dcd96 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:05.766051 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b794b4df-4991-4d94-8d93-806e9f8dcd96 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.216577 Oct 24 10:37:05.774188 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1411/2863] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:05 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:05.800292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fb1cacb8-1855-443b-b3c6-cc5930cb3be8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:05.801191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fb1cacb8-1855-443b-b3c6-cc5930cb3be8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:05.810135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb1cacb8-1855-443b-b3c6-cc5930cb3be8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:05.810905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb1cacb8-1855-443b-b3c6-cc5930cb3be8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:05.811511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb1cacb8-1855-443b-b3c6-cc5930cb3be8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:05.813183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb1cacb8-1855-443b-b3c6-cc5930cb3be8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:05.813866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb1cacb8-1855-443b-b3c6-cc5930cb3be8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:05.814466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb1cacb8-1855-443b-b3c6-cc5930cb3be8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:06.110411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-175fd9f5-da03-472f-9562-c61476c3816c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:37:06.110845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-175fd9f5-da03-472f-9562-c61476c3816c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:37:06.111327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-175fd9f5-da03-472f-9562-c61476c3816c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:37:06.111741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-175fd9f5-da03-472f-9562-c61476c3816c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:37:06.112159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-175fd9f5-da03-472f-9562-c61476c3816c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:37:06.133007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-175fd9f5-da03-472f-9562-c61476c3816c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:06.136202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-175fd9f5-da03-472f-9562-c61476c3816c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:06.136888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-175fd9f5-da03-472f-9562-c61476c3816c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:06.144076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-175fd9f5-da03-472f-9562-c61476c3816c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:06.144875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-175fd9f5-da03-472f-9562-c61476c3816c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:06.146890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-175fd9f5-da03-472f-9562-c61476c3816c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:06.149388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fb1cacb8-1855-443b-b3c6-cc5930cb3be8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:06.158010 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fb1cacb8-1855-443b-b3c6-cc5930cb3be8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1313 microversion: 2.1 time: 0.366710 Oct 24 10:37:06.161761 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1412/2864] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:05 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:37:06.173294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31180d76-f632-4c2e-99c2-4c4b38a9edf7 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:06.174594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31180d76-f632-4c2e-99c2-4c4b38a9edf7 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:06.191688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31180d76-f632-4c2e-99c2-4c4b38a9edf7 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:06.193896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31180d76-f632-4c2e-99c2-4c4b38a9edf7 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:06.194584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31180d76-f632-4c2e-99c2-4c4b38a9edf7 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:06.196818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31180d76-f632-4c2e-99c2-4c4b38a9edf7 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:06.198158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31180d76-f632-4c2e-99c2-4c4b38a9edf7 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:06.201397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31180d76-f632-4c2e-99c2-4c4b38a9edf7 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:06.208234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-175fd9f5-da03-472f-9562-c61476c3816c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Getting quotas for project eb78fe6939ec43d99fe6b1ba24a68287. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:37:06.228269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-175fd9f5-da03-472f-9562-c61476c3816c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Getting quotas for user 2a7e183a1d4240f28566a318b7e70dee and project eb78fe6939ec43d99fe6b1ba24a68287. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:37:06.268164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-175fd9f5-da03-472f-9562-c61476c3816c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:37:06.270966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-175fd9f5-da03-472f-9562-c61476c3816c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 0ffa8f50-8adf-4345-a522-82987d57b4d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:37:06.360468 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-175fd9f5-da03-472f-9562-c61476c3816c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.272738 Oct 24 10:37:06.361161 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1453/2865] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:37:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:37:06.372622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-745edcfd-9ea9-4206-9dc8-c9e0a9f17de6 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:06.373575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-745edcfd-9ea9-4206-9dc8-c9e0a9f17de6 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 0ffa8f50-8adf-4345-a522-82987d57b4d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:06.402468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-31180d76-f632-4c2e-99c2-4c4b38a9edf7 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:06.440315 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31180d76-f632-4c2e-99c2-4c4b38a9edf7 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1277 microversion: 2.1 time: 0.263469 Oct 24 10:37:06.445541 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1413/2866] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:06 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1277 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:06.465065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-745edcfd-9ea9-4206-9dc8-c9e0a9f17de6 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:06.475482 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-745edcfd-9ea9-4206-9dc8-c9e0a9f17de6 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffa8f50-8adf-4345-a522-82987d57b4d1" status: 200 len: 1214 microversion: 2.1 time: 0.106813 Oct 24 10:37:06.476908 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1454/2867] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:06 2022] GET /compute/v2.1/servers/0ffa8f50-8adf-4345-a522-82987d57b4d1 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:37:06.503203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0050a0f-291b-4e8f-8054-a37786f649ce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:06.503691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f0050a0f-291b-4e8f-8054-a37786f649ce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 0ffa8f50-8adf-4345-a522-82987d57b4d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:06.533986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f0050a0f-291b-4e8f-8054-a37786f649ce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 0ffa8f50-8adf-4345-a522-82987d57b4d1] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:37:06.572498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-573c1335-2405-484f-9a08-94de29aba20f tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:06.573617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-573c1335-2405-484f-9a08-94de29aba20f tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:06.594751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-573c1335-2405-484f-9a08-94de29aba20f tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:06.596427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-573c1335-2405-484f-9a08-94de29aba20f tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:06.599239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-573c1335-2405-484f-9a08-94de29aba20f tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:06.601699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-573c1335-2405-484f-9a08-94de29aba20f tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:06.604670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-573c1335-2405-484f-9a08-94de29aba20f tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:06.607770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-573c1335-2405-484f-9a08-94de29aba20f tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:07.075274 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.scheduler.client.report [None req-f0050a0f-291b-4e8f-8054-a37786f649ce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Deleted allocations for instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 Oct 24 10:37:07.084419 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.compute.api [None req-f0050a0f-291b-4e8f-8054-a37786f649ce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 0ffa8f50-8adf-4345-a522-82987d57b4d1] Instance Mapping does not exist while attempting local delete cleanup. Oct 24 10:37:07.085727 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f0050a0f-291b-4e8f-8054-a37786f649ce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0ffa8f50-8adf-4345-a522-82987d57b4d1" status: 204 len: 0 microversion: 2.1 time: 0.586732 Oct 24 10:37:07.086841 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1414/2868] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:37:06 2022] DELETE /compute/v2.1/servers/0ffa8f50-8adf-4345-a522-82987d57b4d1 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:37:07.113271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-573c1335-2405-484f-9a08-94de29aba20f tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9fe821ad1b43f2988dd30521c6c335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c125be93d647e1b2c0fdd4ae2efb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:07.114189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2402dcd6-9d23-4109-97f6-745cd62c7ac2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:07.114892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2402dcd6-9d23-4109-97f6-745cd62c7ac2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:07.135628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2402dcd6-9d23-4109-97f6-745cd62c7ac2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:07.136330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2402dcd6-9d23-4109-97f6-745cd62c7ac2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:07.136575 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-573c1335-2405-484f-9a08-94de29aba20f tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 200 len: 1465 microversion: 2.1 time: 0.571849 Oct 24 10:37:07.137750 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1455/2869] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:06 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 1465 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:07.148219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a69cb1ed-2cfb-4ab1-b029-5b29a57bcbfe tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:07.151867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a69cb1ed-2cfb-4ab1-b029-5b29a57bcbfe tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 0ffa8f50-8adf-4345-a522-82987d57b4d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:07.156252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2402dcd6-9d23-4109-97f6-745cd62c7ac2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:07.159663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2402dcd6-9d23-4109-97f6-745cd62c7ac2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:07.160956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2402dcd6-9d23-4109-97f6-745cd62c7ac2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:07.163428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2402dcd6-9d23-4109-97f6-745cd62c7ac2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:07.168754 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-a69cb1ed-2cfb-4ab1-b029-5b29a57bcbfe tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 could not be found. Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a69cb1ed-2cfb-4ab1-b029-5b29a57bcbfe tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/0ffa8f50-8adf-4345-a522-82987d57b4d1 HTTP/1.1 Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 could not be found. Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '0ffa8f50-8adf-4345-a522-82987d57b4d1'} Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 could not be found. Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 could not be found. Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:07.189140 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:07.193981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:07.193981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:37:07.193981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:37:07.193981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 could not be found. Oct 24 10:37:07.193981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:07.193981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a69cb1ed-2cfb-4ab1-b029-5b29a57bcbfe tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:37:07.194363 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a69cb1ed-2cfb-4ab1-b029-5b29a57bcbfe tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffa8f50-8adf-4345-a522-82987d57b4d1" status: 404 len: 111 microversion: 2.1 time: 0.047215 Oct 24 10:37:07.195140 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1456/2870] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:07 2022] GET /compute/v2.1/servers/0ffa8f50-8adf-4345-a522-82987d57b4d1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:37:07.217361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6aa2c176-f477-42bf-837a-88762b367439 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d09ab820>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:07.313583 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6aa2c176-f477-42bf-837a-88762b367439 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/a9689e0d-06ef-475e-9c75-9e39befd50b7" status: 200 len: 784 microversion: 2.1 time: 0.117307 Oct 24 10:37:07.314520 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1457/2871] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:37:07 2022] GET /compute/v2.1/images/a9689e0d-06ef-475e-9c75-9e39befd50b7 => generated 784 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:07.327541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f91129df-5ea3-4ae2-949c-deb75e45035a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:07.328510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f91129df-5ea3-4ae2-949c-deb75e45035a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:07.342774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f91129df-5ea3-4ae2-949c-deb75e45035a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:07.343665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f91129df-5ea3-4ae2-949c-deb75e45035a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:07.344331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f91129df-5ea3-4ae2-949c-deb75e45035a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:07.345317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f91129df-5ea3-4ae2-949c-deb75e45035a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:07.345995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f91129df-5ea3-4ae2-949c-deb75e45035a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:07.353487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f91129df-5ea3-4ae2-949c-deb75e45035a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:07.369267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2402dcd6-9d23-4109-97f6-745cd62c7ac2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:07.405521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2402dcd6-9d23-4109-97f6-745cd62c7ac2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:07.411533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2402dcd6-9d23-4109-97f6-745cd62c7ac2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:07.438270 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2402dcd6-9d23-4109-97f6-745cd62c7ac2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.344922 Oct 24 10:37:07.446327 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1415/2872] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:07 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:07.470574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3ddb435a-53f0-4588-b2fc-c6a02d22a8b3 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:07.492065 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3ddb435a-53f0-4588-b2fc-c6a02d22a8b3 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043132 Oct 24 10:37:07.502192 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1416/2873] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:37:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:07.509838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a6ee3670-95ac-45e4-bba5-075538df8420 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1554966313", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "7e246fd4-526c-4b90-abc8-eb217581a916"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:07.586851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-a6ee3670-95ac-45e4-bba5-075538df8420 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] validate_networks() for [('7e246fd4-526c-4b90-abc8-eb217581a916', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:37:08.366180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f91129df-5ea3-4ae2-949c-deb75e45035a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:08.389537 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f91129df-5ea3-4ae2-949c-deb75e45035a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1313 microversion: 2.1 time: 1.069931 Oct 24 10:37:08.391068 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1458/2874] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:07 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1313 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:08.420303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-93da3c81-56cc-42d4-947b-366bf3dc6716 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:08.428763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-93da3c81-56cc-42d4-947b-366bf3dc6716 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:08.460032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93da3c81-56cc-42d4-947b-366bf3dc6716 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:08.460550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93da3c81-56cc-42d4-947b-366bf3dc6716 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:08.461054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93da3c81-56cc-42d4-947b-366bf3dc6716 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:08.462345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93da3c81-56cc-42d4-947b-366bf3dc6716 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:08.462819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93da3c81-56cc-42d4-947b-366bf3dc6716 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:08.463905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93da3c81-56cc-42d4-947b-366bf3dc6716 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:08.663339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-93da3c81-56cc-42d4-947b-366bf3dc6716 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:08.683426 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-93da3c81-56cc-42d4-947b-366bf3dc6716 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1277 microversion: 2.1 time: 0.287029 Oct 24 10:37:08.699933 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1459/2875] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:08 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1277 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:08.714303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-71475ec4-7419-4867-842a-476158a1993a tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d4e3c700>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:09.241809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a6ee3670-95ac-45e4-bba5-075538df8420 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:37:09.242193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a6ee3670-95ac-45e4-bba5-075538df8420 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:37:09.242655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a6ee3670-95ac-45e4-bba5-075538df8420 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:37:09.243147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a6ee3670-95ac-45e4-bba5-075538df8420 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:37:09.243623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a6ee3670-95ac-45e4-bba5-075538df8420 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:37:09.260785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6ee3670-95ac-45e4-bba5-075538df8420 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:09.261319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6ee3670-95ac-45e4-bba5-075538df8420 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:09.261764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6ee3670-95ac-45e4-bba5-075538df8420 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:09.263136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6ee3670-95ac-45e4-bba5-075538df8420 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:09.266798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6ee3670-95ac-45e4-bba5-075538df8420 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:09.267445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6ee3670-95ac-45e4-bba5-075538df8420 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:09.316394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-a6ee3670-95ac-45e4-bba5-075538df8420 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Getting quotas for project eb78fe6939ec43d99fe6b1ba24a68287. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:37:09.325984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-a6ee3670-95ac-45e4-bba5-075538df8420 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Getting quotas for user 2a7e183a1d4240f28566a318b7e70dee and project eb78fe6939ec43d99fe6b1ba24a68287. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:37:09.344112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a6ee3670-95ac-45e4-bba5-075538df8420 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:37:09.347686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a6ee3670-95ac-45e4-bba5-075538df8420 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:37:09.422364 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a6ee3670-95ac-45e4-bba5-075538df8420 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.917006 Oct 24 10:37:09.423268 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1417/2876] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:37:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:37:09.430505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f34bf49b-e958-4e00-9be1-4a9d903ac24e req-79dd3932-8778-4d59-ab22-64d0df468094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e16c14-6d0e-49a5-9948-298c2e667999", "name": "network-vif-unplugged", "status": "completed", "tag": "bddb3b72-49df-48b0-b7ca-ad03dc04e320"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:09.447275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f34bf49b-e958-4e00-9be1-4a9d903ac24e req-79dd3932-8778-4d59-ab22-64d0df468094 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:09.447932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f34bf49b-e958-4e00-9be1-4a9d903ac24e req-79dd3932-8778-4d59-ab22-64d0df468094 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:09.448482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f34bf49b-e958-4e00-9be1-4a9d903ac24e req-79dd3932-8778-4d59-ab22-64d0df468094 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:09.464622 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f34bf49b-e958-4e00-9be1-4a9d903ac24e req-79dd3932-8778-4d59-ab22-64d0df468094 service nova] Creating event network-vif-unplugged:bddb3b72-49df-48b0-b7ca-ad03dc04e320 for instance 42e16c14-6d0e-49a5-9948-298c2e667999 on n-h2-858383-15 Oct 24 10:37:09.471918 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f34bf49b-e958-4e00-9be1-4a9d903ac24e req-79dd3932-8778-4d59-ab22-64d0df468094 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046759 Oct 24 10:37:09.473572 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1418/2877] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:09.503044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5dd43769-be5b-4845-88d5-62c15c4775f7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:09.517021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5dd43769-be5b-4845-88d5-62c15c4775f7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:09.533653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dd43769-be5b-4845-88d5-62c15c4775f7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:09.537062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dd43769-be5b-4845-88d5-62c15c4775f7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:09.538500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dd43769-be5b-4845-88d5-62c15c4775f7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:09.540275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dd43769-be5b-4845-88d5-62c15c4775f7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:09.541949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dd43769-be5b-4845-88d5-62c15c4775f7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:09.545167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dd43769-be5b-4845-88d5-62c15c4775f7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:09.724304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5dd43769-be5b-4845-88d5-62c15c4775f7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:09.768917 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-71475ec4-7419-4867-842a-476158a1993a tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "DELETE /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 204 len: 0 microversion: 2.1 time: 1.066991 Oct 24 10:37:09.769423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5dd43769-be5b-4845-88d5-62c15c4775f7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:09.770479 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1460/2878] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:08 2022] DELETE /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 0 bytes in 1069 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:37:09.772187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5dd43769-be5b-4845-88d5-62c15c4775f7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:09.776689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-be50c67d-0dcd-4991-82bc-36414d2c9b72 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:09.778159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-be50c67d-0dcd-4991-82bc-36414d2c9b72 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:09.790310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be50c67d-0dcd-4991-82bc-36414d2c9b72 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:09.793996 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5dd43769-be5b-4845-88d5-62c15c4775f7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.318426 Oct 24 10:37:09.795743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be50c67d-0dcd-4991-82bc-36414d2c9b72 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:09.797834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be50c67d-0dcd-4991-82bc-36414d2c9b72 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:09.799884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be50c67d-0dcd-4991-82bc-36414d2c9b72 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:09.807771 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1419/2879] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:09 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:09.810072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be50c67d-0dcd-4991-82bc-36414d2c9b72 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:09.810712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be50c67d-0dcd-4991-82bc-36414d2c9b72 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:09.818921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6655cf67-3a84-46fd-a671-79af7e49d6cb tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:09.820822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6655cf67-3a84-46fd-a671-79af7e49d6cb tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:10.042166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6655cf67-3a84-46fd-a671-79af7e49d6cb tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:10.056533 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6655cf67-3a84-46fd-a671-79af7e49d6cb tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 200 len: 1215 microversion: 2.1 time: 0.244224 Oct 24 10:37:10.058663 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1420/2880] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:09 2022] GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 1215 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:10.071154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e92a6a65-e200-477a-930b-98d22fadec1a req-b86dcafa-1312-4dd2-8c27-ed17368d0f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1387bd9a-747c-4e8b-a30a-136d41dc39e6", "tag": "51a23f09-0127-4838-82ec-0a7b4009705c"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:10.099977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e92a6a65-e200-477a-930b-98d22fadec1a req-b86dcafa-1312-4dd2-8c27-ed17368d0f46 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:10.100895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e92a6a65-e200-477a-930b-98d22fadec1a req-b86dcafa-1312-4dd2-8c27-ed17368d0f46 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:10.101533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e92a6a65-e200-477a-930b-98d22fadec1a req-b86dcafa-1312-4dd2-8c27-ed17368d0f46 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:10.130312 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e92a6a65-e200-477a-930b-98d22fadec1a req-b86dcafa-1312-4dd2-8c27-ed17368d0f46 service nova] Creating event network-changed:51a23f09-0127-4838-82ec-0a7b4009705c for instance 1387bd9a-747c-4e8b-a30a-136d41dc39e6 on n-h2-858383-15 Oct 24 10:37:10.141652 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e92a6a65-e200-477a-930b-98d22fadec1a req-b86dcafa-1312-4dd2-8c27-ed17368d0f46 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081492 Oct 24 10:37:10.148286 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1421/2881] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:10.157243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-839fe1fb-a95d-4864-8884-37de774918a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:10.160668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-839fe1fb-a95d-4864-8884-37de774918a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:10.176563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-839fe1fb-a95d-4864-8884-37de774918a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:10.178750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-839fe1fb-a95d-4864-8884-37de774918a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:10.179443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-839fe1fb-a95d-4864-8884-37de774918a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:10.185835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-839fe1fb-a95d-4864-8884-37de774918a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:10.186730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-839fe1fb-a95d-4864-8884-37de774918a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:10.187383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-839fe1fb-a95d-4864-8884-37de774918a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:10.413808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-be50c67d-0dcd-4991-82bc-36414d2c9b72 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:10.426952 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-be50c67d-0dcd-4991-82bc-36414d2c9b72 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1313 microversion: 2.1 time: 0.654848 Oct 24 10:37:10.430593 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1461/2882] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:09 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1313 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:10.445689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bda03070-a104-4777-9139-e418b6df28d1 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d0bb7670>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:10.522325 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-bda03070-a104-4777-9139-e418b6df28d1 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] HTTP exception thrown: Image not found. Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bda03070-a104-4777-9139-e418b6df28d1 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Request method failure captured: Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 HTTP/1.1 Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmqUdKhAQppvt-50F_-rVZdLGuSL_jHdWKd3XzK_GHAWsZlymvlv_uOlROl61F_Z4Spvk60AvFdizQpFomiWcyMXv9yfn-Nko_FNUXMKndp4X39esqqYJ1eh-GkUQESTQMr1KA2aXTS_PZz2LsZIqWosJObJipOJNhlsflpXH4tFaPU Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 96c125be93d647e1b2c0fdd4ae2efb14 Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesOneServerTestJSON-2062039880 Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96c125be93d647e1b2c0fdd4ae2efb14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96c125be93d647e1b2c0fdd4ae2efb14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/96c125be93d647e1b2c0fdd4ae2efb14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_96c125be93d647e1b2c0fdd4ae2efb14", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesOneServerTestJSON-2062039880 Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 96c125be93d647e1b2c0fdd4ae2efb14 Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2062039880 Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesOneServerTestJSON-2062039880-project Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ed9fe821ad1b43f2988dd30521c6c335 Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesOneServerTestJSON-2062039880-project Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: exception: Image not found. Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'cb6a56ae-b5a1-4db6-af7c-483168d12e95'} Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cb6a56ae-b5a1-4db6-af7c-483168d12e95 Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 10:37:10.525367 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cb6a56ae-b5a1-4db6-af7c-483168d12e95 could not be found. Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bda03070-a104-4777-9139-e418b6df28d1 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Returning 404 to user: Image not found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bda03070-a104-4777-9139-e418b6df28d1 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 404 len: 62 microversion: 2.1 time: 0.095062 Oct 24 10:37:10.531845 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1462/2883] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:37:10 2022] GET /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:37:10.553617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3136c73-eac4-48d4-b621-81cfdb8d81fb tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-874055865"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:10.578922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f3136c73-eac4-48d4-b621-81cfdb8d81fb tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:10.610064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3136c73-eac4-48d4-b621-81cfdb8d81fb tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:10.618343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3136c73-eac4-48d4-b621-81cfdb8d81fb tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:10.621015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3136c73-eac4-48d4-b621-81cfdb8d81fb tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:10.625916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3136c73-eac4-48d4-b621-81cfdb8d81fb tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:10.628984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3136c73-eac4-48d4-b621-81cfdb8d81fb tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:10.633238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3136c73-eac4-48d4-b621-81cfdb8d81fb tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:11.204344 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f3136c73-eac4-48d4-b621-81cfdb8d81fb tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "POST /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999/action" status: 202 len: 0 microversion: 2.1 time: 0.664467 Oct 24 10:37:11.207879 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1463/2884] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:37:10 2022] POST /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 10:37:11.245143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-81dd1059-8bf6-48a6-ad4d-14718cd20fc5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:11.247948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-81dd1059-8bf6-48a6-ad4d-14718cd20fc5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:11.259647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81dd1059-8bf6-48a6-ad4d-14718cd20fc5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:11.260408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81dd1059-8bf6-48a6-ad4d-14718cd20fc5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:11.261146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81dd1059-8bf6-48a6-ad4d-14718cd20fc5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:11.262459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81dd1059-8bf6-48a6-ad4d-14718cd20fc5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:11.263249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81dd1059-8bf6-48a6-ad4d-14718cd20fc5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:11.264040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81dd1059-8bf6-48a6-ad4d-14718cd20fc5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:11.282699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-839fe1fb-a95d-4864-8884-37de774918a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:11.305059 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-839fe1fb-a95d-4864-8884-37de774918a3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1319 microversion: 2.1 time: 1.142943 Oct 24 10:37:11.306342 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1422/2885] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:10 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1319 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:11.312701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c4386f9d-c451-42d8-a4e0-fcef9cb37173 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:11.313528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c4386f9d-c451-42d8-a4e0-fcef9cb37173 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:11.326377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4386f9d-c451-42d8-a4e0-fcef9cb37173 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:11.327208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4386f9d-c451-42d8-a4e0-fcef9cb37173 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:11.329389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4386f9d-c451-42d8-a4e0-fcef9cb37173 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:11.330487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4386f9d-c451-42d8-a4e0-fcef9cb37173 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:11.332494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4386f9d-c451-42d8-a4e0-fcef9cb37173 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:11.333148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4386f9d-c451-42d8-a4e0-fcef9cb37173 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:11.559326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-81dd1059-8bf6-48a6-ad4d-14718cd20fc5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:11.566805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c4386f9d-c451-42d8-a4e0-fcef9cb37173 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:11.578521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-81dd1059-8bf6-48a6-ad4d-14718cd20fc5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:11.582655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-81dd1059-8bf6-48a6-ad4d-14718cd20fc5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:11.587578 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c4386f9d-c451-42d8-a4e0-fcef9cb37173 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 200 len: 1267 microversion: 2.1 time: 0.279663 Oct 24 10:37:11.595278 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-81dd1059-8bf6-48a6-ad4d-14718cd20fc5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.385628 Oct 24 10:37:11.597857 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1423/2887] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:11 2022] GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 1267 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:11.598000 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1464/2887] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:11 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:11.612630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4d96b527-3a00-4ad5-85fd-739942f90321 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:11.612935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-427d3be9-0df4-4005-9eaf-198afc60be8f tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d09abb80>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:11.613682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4d96b527-3a00-4ad5-85fd-739942f90321 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:11.620096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d96b527-3a00-4ad5-85fd-739942f90321 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:11.622560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d96b527-3a00-4ad5-85fd-739942f90321 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:11.624663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d96b527-3a00-4ad5-85fd-739942f90321 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:11.625578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d96b527-3a00-4ad5-85fd-739942f90321 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:11.628728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d96b527-3a00-4ad5-85fd-739942f90321 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:11.629339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d96b527-3a00-4ad5-85fd-739942f90321 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:11.716442 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-427d3be9-0df4-4005-9eaf-198afc60be8f tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/a6a29568-f119-462b-a029-b97ca22a3d5c" status: 200 len: 1428 microversion: 2.1 time: 0.116327 Oct 24 10:37:11.718237 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1465/2888] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:37:11 2022] GET /compute/v2.1/images/a6a29568-f119-462b-a029-b97ca22a3d5c => generated 1428 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:12.179040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-71ae7361-85fe-4356-8295-b6c6676030bb req-641ef865-af40-4eaa-bf58-ec686f27cdc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e", "tag": "0774dbc4-01ad-46fa-8867-bb741a085411"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:12.194153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:12.197127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-71ae7361-85fe-4356-8295-b6c6676030bb req-641ef865-af40-4eaa-bf58-ec686f27cdc6 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:12.198161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-71ae7361-85fe-4356-8295-b6c6676030bb req-641ef865-af40-4eaa-bf58-ec686f27cdc6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:12.200092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-71ae7361-85fe-4356-8295-b6c6676030bb req-641ef865-af40-4eaa-bf58-ec686f27cdc6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:12.219503 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-71ae7361-85fe-4356-8295-b6c6676030bb req-641ef865-af40-4eaa-bf58-ec686f27cdc6 service nova] Creating event network-changed:0774dbc4-01ad-46fa-8867-bb741a085411 for instance d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e on n-h1-858383-15 Oct 24 10:37:12.228977 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-71ae7361-85fe-4356-8295-b6c6676030bb req-641ef865-af40-4eaa-bf58-ec686f27cdc6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054426 Oct 24 10:37:12.230033 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1466/2889] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:12.333377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e9aabfe-17b5-4fb5-93e0-f30cd7876148 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:12.334486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1e9aabfe-17b5-4fb5-93e0-f30cd7876148 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:12.343052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e9aabfe-17b5-4fb5-93e0-f30cd7876148 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:12.344444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e9aabfe-17b5-4fb5-93e0-f30cd7876148 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:12.345174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e9aabfe-17b5-4fb5-93e0-f30cd7876148 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:12.348335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e9aabfe-17b5-4fb5-93e0-f30cd7876148 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:12.349092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e9aabfe-17b5-4fb5-93e0-f30cd7876148 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:12.349745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e9aabfe-17b5-4fb5-93e0-f30cd7876148 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:12.809344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4d96b527-3a00-4ad5-85fd-739942f90321 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:12.820227 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4d96b527-3a00-4ad5-85fd-739942f90321 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1313 microversion: 2.1 time: 1.220953 Oct 24 10:37:12.822581 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1424/2890] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:11 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1313 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:12.841270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-92d0a386-b44b-408f-a0da-b891a147600a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:12.842141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-92d0a386-b44b-408f-a0da-b891a147600a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:12.849003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92d0a386-b44b-408f-a0da-b891a147600a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:12.849602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92d0a386-b44b-408f-a0da-b891a147600a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:12.850165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92d0a386-b44b-408f-a0da-b891a147600a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:12.850971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92d0a386-b44b-408f-a0da-b891a147600a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:12.851731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92d0a386-b44b-408f-a0da-b891a147600a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:12.852308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92d0a386-b44b-408f-a0da-b891a147600a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:13.055699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-92d0a386-b44b-408f-a0da-b891a147600a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:13.068276 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-92d0a386-b44b-408f-a0da-b891a147600a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 200 len: 1273 microversion: 2.1 time: 0.244109 Oct 24 10:37:13.069207 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1425/2891] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:12 2022] GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:13.084972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dc029e9a-fd36-4a93-8b30-7d8af32ba6f0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:13.085802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dc029e9a-fd36-4a93-8b30-7d8af32ba6f0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:13.098491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc029e9a-fd36-4a93-8b30-7d8af32ba6f0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:13.099281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc029e9a-fd36-4a93-8b30-7d8af32ba6f0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:13.100150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc029e9a-fd36-4a93-8b30-7d8af32ba6f0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:13.101247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc029e9a-fd36-4a93-8b30-7d8af32ba6f0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:13.101898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc029e9a-fd36-4a93-8b30-7d8af32ba6f0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:13.106708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1e9aabfe-17b5-4fb5-93e0-f30cd7876148 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:13.107561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc029e9a-fd36-4a93-8b30-7d8af32ba6f0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:13.115134 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1e9aabfe-17b5-4fb5-93e0-f30cd7876148 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1319 microversion: 2.1 time: 0.786979 Oct 24 10:37:13.115736 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1467/2892] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:12 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1319 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:13.152560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cec493d8-051d-4e38-b975-13993ce4cfe0 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d0a8f8b0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:13.245195 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cec493d8-051d-4e38-b975-13993ce4cfe0 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/a6a29568-f119-462b-a029-b97ca22a3d5c" status: 200 len: 1428 microversion: 2.1 time: 0.108986 Oct 24 10:37:13.245867 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1468/2893] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:37:13 2022] GET /compute/v2.1/images/a6a29568-f119-462b-a029-b97ca22a3d5c => generated 1428 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:13.347671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dc029e9a-fd36-4a93-8b30-7d8af32ba6f0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:13.369519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dc029e9a-fd36-4a93-8b30-7d8af32ba6f0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:13.371022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dc029e9a-fd36-4a93-8b30-7d8af32ba6f0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:13.396681 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dc029e9a-fd36-4a93-8b30-7d8af32ba6f0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.326139 Oct 24 10:37:13.397946 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1426/2894] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:13 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:13.850444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1a113ec0-a446-416c-a37e-937d6df38496 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:13.851641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1a113ec0-a446-416c-a37e-937d6df38496 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:13.869893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a113ec0-a446-416c-a37e-937d6df38496 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:13.872093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a113ec0-a446-416c-a37e-937d6df38496 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:13.873045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a113ec0-a446-416c-a37e-937d6df38496 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:13.874512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a113ec0-a446-416c-a37e-937d6df38496 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:13.875824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a113ec0-a446-416c-a37e-937d6df38496 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:13.876470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a113ec0-a446-416c-a37e-937d6df38496 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:14.097072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d1692970-c153-40e3-8213-cc7327bec47d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:14.097754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d1692970-c153-40e3-8213-cc7327bec47d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:14.104418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1692970-c153-40e3-8213-cc7327bec47d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:14.104944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1692970-c153-40e3-8213-cc7327bec47d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:14.105388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1692970-c153-40e3-8213-cc7327bec47d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:14.106857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1692970-c153-40e3-8213-cc7327bec47d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:14.107410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1692970-c153-40e3-8213-cc7327bec47d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:14.108036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1692970-c153-40e3-8213-cc7327bec47d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:14.274175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d1692970-c153-40e3-8213-cc7327bec47d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:14.303453 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d1692970-c153-40e3-8213-cc7327bec47d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 200 len: 1273 microversion: 2.1 time: 0.210042 Oct 24 10:37:14.304622 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1427/2895] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:14 2022] GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 1273 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:37:14.311037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3c32060b-438e-47fa-b1b5-aefdc3c7b399 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:14.312140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3c32060b-438e-47fa-b1b5-aefdc3c7b399 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:14.329180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c32060b-438e-47fa-b1b5-aefdc3c7b399 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:14.335287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c32060b-438e-47fa-b1b5-aefdc3c7b399 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:14.335986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c32060b-438e-47fa-b1b5-aefdc3c7b399 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:14.336932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c32060b-438e-47fa-b1b5-aefdc3c7b399 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:14.338144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c32060b-438e-47fa-b1b5-aefdc3c7b399 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:14.339480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c32060b-438e-47fa-b1b5-aefdc3c7b399 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:15.065465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1a113ec0-a446-416c-a37e-937d6df38496 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:15.085807 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1a113ec0-a446-416c-a37e-937d6df38496 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1313 microversion: 2.1 time: 1.241746 Oct 24 10:37:15.088644 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1469/2896] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:13 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1313 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:15.100112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-faa0aa5b-fd59-40de-805a-2bfe1b672026 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d0b33f70>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:15.165265 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-faa0aa5b-fd59-40de-805a-2bfe1b672026 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/a6a29568-f119-462b-a029-b97ca22a3d5c" status: 200 len: 1428 microversion: 2.1 time: 0.075197 Oct 24 10:37:15.166393 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1470/2897] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:37:15 2022] GET /compute/v2.1/images/a6a29568-f119-462b-a029-b97ca22a3d5c => generated 1428 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:15.173953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7a3b9d70-0c81-4fe5-bc67-d7c7c25ad7c0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:15.174798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7a3b9d70-0c81-4fe5-bc67-d7c7c25ad7c0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:15.185812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a3b9d70-0c81-4fe5-bc67-d7c7c25ad7c0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:15.187011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a3b9d70-0c81-4fe5-bc67-d7c7c25ad7c0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:15.188416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a3b9d70-0c81-4fe5-bc67-d7c7c25ad7c0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:15.189387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a3b9d70-0c81-4fe5-bc67-d7c7c25ad7c0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:15.190018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a3b9d70-0c81-4fe5-bc67-d7c7c25ad7c0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:15.190638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a3b9d70-0c81-4fe5-bc67-d7c7c25ad7c0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:15.348214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c32060b-438e-47fa-b1b5-aefdc3c7b399 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:15.360774 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3c32060b-438e-47fa-b1b5-aefdc3c7b399 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1319 microversion: 2.1 time: 1.054759 Oct 24 10:37:15.362751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7a3b9d70-0c81-4fe5-bc67-d7c7c25ad7c0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:15.365519 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1428/2898] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:14 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1319 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:15.388453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad3d1cda-a65c-472b-a72d-8d2b0cfda596 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:15.389287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad3d1cda-a65c-472b-a72d-8d2b0cfda596 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:15.390324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7a3b9d70-0c81-4fe5-bc67-d7c7c25ad7c0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:15.391805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7a3b9d70-0c81-4fe5-bc67-d7c7c25ad7c0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:15.401069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3d1cda-a65c-472b-a72d-8d2b0cfda596 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:15.401913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3d1cda-a65c-472b-a72d-8d2b0cfda596 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:15.403125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3d1cda-a65c-472b-a72d-8d2b0cfda596 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:15.404982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3d1cda-a65c-472b-a72d-8d2b0cfda596 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:15.405776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3d1cda-a65c-472b-a72d-8d2b0cfda596 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:15.406319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3d1cda-a65c-472b-a72d-8d2b0cfda596 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:15.407840 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7a3b9d70-0c81-4fe5-bc67-d7c7c25ad7c0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.239983 Oct 24 10:37:15.409404 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1471/2899] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:15 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:16.113287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b94c3cfd-fa67-47a6-afa6-fae84f918e30 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:16.114114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b94c3cfd-fa67-47a6-afa6-fae84f918e30 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:16.143999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b94c3cfd-fa67-47a6-afa6-fae84f918e30 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:16.144531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b94c3cfd-fa67-47a6-afa6-fae84f918e30 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:16.147266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b94c3cfd-fa67-47a6-afa6-fae84f918e30 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:16.150425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b94c3cfd-fa67-47a6-afa6-fae84f918e30 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:16.150980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b94c3cfd-fa67-47a6-afa6-fae84f918e30 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:16.152613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b94c3cfd-fa67-47a6-afa6-fae84f918e30 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:16.183019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:16.474612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=8 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:17.045783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ad3d1cda-a65c-472b-a72d-8d2b0cfda596 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:17.057373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:17.064222 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad3d1cda-a65c-472b-a72d-8d2b0cfda596 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 200 len: 1315 microversion: 2.1 time: 1.688704 Oct 24 10:37:17.067188 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1429/2900] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:15 2022] GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 1315 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:17.084565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c6708e1f-c965-4b68-a471-df1d939aafb7 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d0ae59d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:17.204127 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c6708e1f-c965-4b68-a471-df1d939aafb7 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/a6a29568-f119-462b-a029-b97ca22a3d5c" status: 200 len: 1428 microversion: 2.1 time: 0.135087 Oct 24 10:37:17.204706 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1430/2901] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:37:17 2022] GET /compute/v2.1/images/a6a29568-f119-462b-a029-b97ca22a3d5c => generated 1428 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:17.217818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-89884380-f8aa-406b-b266-249535dabdd3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:17.221479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-89884380-f8aa-406b-b266-249535dabdd3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:17.239722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89884380-f8aa-406b-b266-249535dabdd3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:17.247161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89884380-f8aa-406b-b266-249535dabdd3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:17.248169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89884380-f8aa-406b-b266-249535dabdd3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:17.249137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89884380-f8aa-406b-b266-249535dabdd3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:17.249768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89884380-f8aa-406b-b266-249535dabdd3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:17.250394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89884380-f8aa-406b-b266-249535dabdd3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:17.538446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b94c3cfd-fa67-47a6-afa6-fae84f918e30 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:17.547734 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b94c3cfd-fa67-47a6-afa6-fae84f918e30 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1313 microversion: 2.1 time: 1.438439 Oct 24 10:37:17.574778 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1472/2902] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:16 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1313 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:17.579695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6e224d32-9da5-4eb0-9e33-c45932b86d2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:17.580516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6e224d32-9da5-4eb0-9e33-c45932b86d2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:17.598252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e224d32-9da5-4eb0-9e33-c45932b86d2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:17.599771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e224d32-9da5-4eb0-9e33-c45932b86d2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:17.600403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e224d32-9da5-4eb0-9e33-c45932b86d2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:17.601329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e224d32-9da5-4eb0-9e33-c45932b86d2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:17.601956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e224d32-9da5-4eb0-9e33-c45932b86d2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:17.602555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e224d32-9da5-4eb0-9e33-c45932b86d2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:17.730466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-89884380-f8aa-406b-b266-249535dabdd3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:17.747234 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-89884380-f8aa-406b-b266-249535dabdd3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1319 microversion: 2.1 time: 0.537290 Oct 24 10:37:17.748039 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1431/2903] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:17 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1319 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:17.758414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-593cabb2-c513-4e00-9486-a2521d5c481b req-1b3d3f17-f1ce-4734-b685-707b486dc740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e16c14-6d0e-49a5-9948-298c2e667999", "name": "network-vif-plugged", "status": "completed", "tag": "bddb3b72-49df-48b0-b7ca-ad03dc04e320"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:17.786573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e224d32-9da5-4eb0-9e33-c45932b86d2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:17.795931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e224d32-9da5-4eb0-9e33-c45932b86d2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:17.797430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e224d32-9da5-4eb0-9e33-c45932b86d2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:17.800361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-593cabb2-c513-4e00-9486-a2521d5c481b req-1b3d3f17-f1ce-4734-b685-707b486dc740 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:17.801239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-593cabb2-c513-4e00-9486-a2521d5c481b req-1b3d3f17-f1ce-4734-b685-707b486dc740 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:17.801833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-593cabb2-c513-4e00-9486-a2521d5c481b req-1b3d3f17-f1ce-4734-b685-707b486dc740 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:17.822592 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-593cabb2-c513-4e00-9486-a2521d5c481b req-1b3d3f17-f1ce-4734-b685-707b486dc740 service nova] Creating event network-vif-plugged:bddb3b72-49df-48b0-b7ca-ad03dc04e320 for instance 42e16c14-6d0e-49a5-9948-298c2e667999 on n-h2-858383-15 Oct 24 10:37:17.822840 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6e224d32-9da5-4eb0-9e33-c45932b86d2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.241562 Oct 24 10:37:17.833665 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1473/2904] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:17 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:17.833665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4b4a3cf8-be87-4b56-8164-0f5702dff11f tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-919433802", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "e934c9e3-bf74-4316-a7bd-f3032fc5af25"}, {"uuid": "803ffbf2-a9e6-4a7a-904d-28b9ea850a48"}, {"uuid": "e934c9e3-bf74-4316-a7bd-f3032fc5af25"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:17.865982 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-593cabb2-c513-4e00-9486-a2521d5c481b req-1b3d3f17-f1ce-4734-b685-707b486dc740 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106849 Oct 24 10:37:17.867054 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1432/2905] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:17.989039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-4b4a3cf8-be87-4b56-8164-0f5702dff11f tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] validate_networks() for [('e934c9e3-bf74-4316-a7bd-f3032fc5af25', None, None, None, None, None), ('803ffbf2-a9e6-4a7a-904d-28b9ea850a48', None, None, None, None, None), ('e934c9e3-bf74-4316-a7bd-f3032fc5af25', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:37:18.102635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a17f2340-4ae3-48cb-a3fe-600c36bac04d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:18.103448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a17f2340-4ae3-48cb-a3fe-600c36bac04d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:18.118542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a17f2340-4ae3-48cb-a3fe-600c36bac04d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:18.119166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a17f2340-4ae3-48cb-a3fe-600c36bac04d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:18.119726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a17f2340-4ae3-48cb-a3fe-600c36bac04d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:18.121705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a17f2340-4ae3-48cb-a3fe-600c36bac04d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:18.125302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a17f2340-4ae3-48cb-a3fe-600c36bac04d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:18.129838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a17f2340-4ae3-48cb-a3fe-600c36bac04d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:19.030576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a17f2340-4ae3-48cb-a3fe-600c36bac04d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:19.039429 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a17f2340-4ae3-48cb-a3fe-600c36bac04d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 200 len: 1315 microversion: 2.1 time: 0.943562 Oct 24 10:37:19.057158 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1433/2906] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:18 2022] GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 1315 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:19.063635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f72cf482-d51e-4fa3-802a-5cd21bd5a257 req-2c92f137-d5f0-43b4-b979-93d64e158c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "431e0a67-61ff-4331-bebc-5f382784f7af", "tag": "e5afb3de-c385-4af2-9119-cd813e858528"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:19.075621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f72cf482-d51e-4fa3-802a-5cd21bd5a257 req-2c92f137-d5f0-43b4-b979-93d64e158c73 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:19.076417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f72cf482-d51e-4fa3-802a-5cd21bd5a257 req-2c92f137-d5f0-43b4-b979-93d64e158c73 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:19.077207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f72cf482-d51e-4fa3-802a-5cd21bd5a257 req-2c92f137-d5f0-43b4-b979-93d64e158c73 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:19.099591 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f72cf482-d51e-4fa3-802a-5cd21bd5a257 req-2c92f137-d5f0-43b4-b979-93d64e158c73 service nova] Creating event network-changed:e5afb3de-c385-4af2-9119-cd813e858528 for instance 431e0a67-61ff-4331-bebc-5f382784f7af on n-h1-858383-15 Oct 24 10:37:19.109754 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f72cf482-d51e-4fa3-802a-5cd21bd5a257 req-2c92f137-d5f0-43b4-b979-93d64e158c73 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050365 Oct 24 10:37:19.137556 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1434/2907] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:19.159656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3ae4aa05-cbee-43a6-9a5d-a43832bdffd0 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d0293670>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:19.290065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:20.053091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=28 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:20.994015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-4b4a3cf8-be87-4b56-8164-0f5702dff11f tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:37:20.995401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-4b4a3cf8-be87-4b56-8164-0f5702dff11f tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:37:20.996801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-4b4a3cf8-be87-4b56-8164-0f5702dff11f tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:37:20.997859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-4b4a3cf8-be87-4b56-8164-0f5702dff11f tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:37:20.998791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-4b4a3cf8-be87-4b56-8164-0f5702dff11f tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:37:21.029990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b4a3cf8-be87-4b56-8164-0f5702dff11f tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:21.030758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b4a3cf8-be87-4b56-8164-0f5702dff11f tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:21.031475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b4a3cf8-be87-4b56-8164-0f5702dff11f tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:21.033771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b4a3cf8-be87-4b56-8164-0f5702dff11f tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:21.034411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b4a3cf8-be87-4b56-8164-0f5702dff11f tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:21.035006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b4a3cf8-be87-4b56-8164-0f5702dff11f tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:21.062496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-4b4a3cf8-be87-4b56-8164-0f5702dff11f tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Getting quotas for project 19a51abc0b7c4b01ad379e50663a2000. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:37:21.070587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-4b4a3cf8-be87-4b56-8164-0f5702dff11f tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Getting quotas for user 83d2c201d9e348c8a2ff17525693a3ab and project 19a51abc0b7c4b01ad379e50663a2000. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:37:21.104208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4b4a3cf8-be87-4b56-8164-0f5702dff11f tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:37:21.108123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4b4a3cf8-be87-4b56-8164-0f5702dff11f tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:37:21.253587 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4b4a3cf8-be87-4b56-8164-0f5702dff11f tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.428200 Oct 24 10:37:21.255275 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1474/2908] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:37:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:37:21.288938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0735e460-df70-43a3-9bca-1ee9dbbbaa95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:21.295215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0735e460-df70-43a3-9bca-1ee9dbbbaa95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:21.301931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0735e460-df70-43a3-9bca-1ee9dbbbaa95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:21.302709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0735e460-df70-43a3-9bca-1ee9dbbbaa95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:21.303490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0735e460-df70-43a3-9bca-1ee9dbbbaa95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:21.304521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0735e460-df70-43a3-9bca-1ee9dbbbaa95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:21.305320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0735e460-df70-43a3-9bca-1ee9dbbbaa95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:21.305992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0735e460-df70-43a3-9bca-1ee9dbbbaa95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:21.554618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0735e460-df70-43a3-9bca-1ee9dbbbaa95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:21.558953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:21.570307 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0735e460-df70-43a3-9bca-1ee9dbbbaa95 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1313 microversion: 2.1 time: 0.300400 Oct 24 10:37:21.571141 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1475/2909] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:21 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:21.588130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ee713ef3-eefc-4c27-94fe-91dea4fbf4ec tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:21.589179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ee713ef3-eefc-4c27-94fe-91dea4fbf4ec tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:21.600103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee713ef3-eefc-4c27-94fe-91dea4fbf4ec tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:21.601068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee713ef3-eefc-4c27-94fe-91dea4fbf4ec tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:21.601859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee713ef3-eefc-4c27-94fe-91dea4fbf4ec tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:21.602822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee713ef3-eefc-4c27-94fe-91dea4fbf4ec tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:21.603508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee713ef3-eefc-4c27-94fe-91dea4fbf4ec tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:21.604801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee713ef3-eefc-4c27-94fe-91dea4fbf4ec tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:21.904072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ee713ef3-eefc-4c27-94fe-91dea4fbf4ec tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:21.918229 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ee713ef3-eefc-4c27-94fe-91dea4fbf4ec tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1319 microversion: 2.1 time: 0.343090 Oct 24 10:37:21.920262 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1476/2910] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:21 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:21.926563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-114bdac0-232c-4bf0-90d7-26941aa8b6e2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:21.927441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-114bdac0-232c-4bf0-90d7-26941aa8b6e2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:21.934360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-114bdac0-232c-4bf0-90d7-26941aa8b6e2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:21.935120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-114bdac0-232c-4bf0-90d7-26941aa8b6e2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:21.936015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-114bdac0-232c-4bf0-90d7-26941aa8b6e2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:21.936533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-114bdac0-232c-4bf0-90d7-26941aa8b6e2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:21.937251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-114bdac0-232c-4bf0-90d7-26941aa8b6e2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:21.937804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-114bdac0-232c-4bf0-90d7-26941aa8b6e2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:22.093215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-114bdac0-232c-4bf0-90d7-26941aa8b6e2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:22.110867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-114bdac0-232c-4bf0-90d7-26941aa8b6e2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:22.113234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-114bdac0-232c-4bf0-90d7-26941aa8b6e2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:22.141417 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-114bdac0-232c-4bf0-90d7-26941aa8b6e2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.219801 Oct 24 10:37:22.142354 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1477/2911] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:21 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:22.172472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d3384b25-a8b7-47f4-8ada-6e287c3c6724 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:22.175442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d3384b25-a8b7-47f4-8ada-6e287c3c6724 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:22.192271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3384b25-a8b7-47f4-8ada-6e287c3c6724 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:22.192773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3384b25-a8b7-47f4-8ada-6e287c3c6724 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:22.193302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3384b25-a8b7-47f4-8ada-6e287c3c6724 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:22.214510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3384b25-a8b7-47f4-8ada-6e287c3c6724 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:22.217314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3384b25-a8b7-47f4-8ada-6e287c3c6724 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:22.221580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3384b25-a8b7-47f4-8ada-6e287c3c6724 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:22.905543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d3384b25-a8b7-47f4-8ada-6e287c3c6724 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:22.922921 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d3384b25-a8b7-47f4-8ada-6e287c3c6724 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 200 len: 1315 microversion: 2.1 time: 0.774674 Oct 24 10:37:22.936883 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1478/2912] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:22 2022] GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 1315 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:22.949932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8568d2e9-09b2-4a4e-8102-281573d9d2a7 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:22.956017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8568d2e9-09b2-4a4e-8102-281573d9d2a7 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:22.971600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8568d2e9-09b2-4a4e-8102-281573d9d2a7 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:22.973521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8568d2e9-09b2-4a4e-8102-281573d9d2a7 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:22.974161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8568d2e9-09b2-4a4e-8102-281573d9d2a7 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:22.976289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8568d2e9-09b2-4a4e-8102-281573d9d2a7 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:22.976742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8568d2e9-09b2-4a4e-8102-281573d9d2a7 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:22.977222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8568d2e9-09b2-4a4e-8102-281573d9d2a7 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:23.310547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8568d2e9-09b2-4a4e-8102-281573d9d2a7 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:23.323848 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8568d2e9-09b2-4a4e-8102-281573d9d2a7 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1208 microversion: 2.1 time: 0.393827 Oct 24 10:37:23.326417 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1479/2913] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:22 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1208 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:23.331855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6162f264-936b-4807-94ba-50b189bcaa44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:23.332942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6162f264-936b-4807-94ba-50b189bcaa44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:23.350461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6162f264-936b-4807-94ba-50b189bcaa44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:23.351283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6162f264-936b-4807-94ba-50b189bcaa44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:23.351922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6162f264-936b-4807-94ba-50b189bcaa44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:23.352939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6162f264-936b-4807-94ba-50b189bcaa44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:23.353650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6162f264-936b-4807-94ba-50b189bcaa44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:23.363263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6162f264-936b-4807-94ba-50b189bcaa44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:23.933711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6162f264-936b-4807-94ba-50b189bcaa44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:23.942738 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6162f264-936b-4807-94ba-50b189bcaa44 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1313 microversion: 2.1 time: 0.614990 Oct 24 10:37:23.956334 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1480/2914] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:23 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1313 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:23.956334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3f8b6e4-1e50-4ae8-b631-23fde071a477 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:23.956334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f3f8b6e4-1e50-4ae8-b631-23fde071a477 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:23.957676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3f8b6e4-1e50-4ae8-b631-23fde071a477 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:23.957676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3f8b6e4-1e50-4ae8-b631-23fde071a477 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:23.958006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3f8b6e4-1e50-4ae8-b631-23fde071a477 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:23.958708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3f8b6e4-1e50-4ae8-b631-23fde071a477 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:23.959167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3f8b6e4-1e50-4ae8-b631-23fde071a477 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:23.960239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3f8b6e4-1e50-4ae8-b631-23fde071a477 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:24.487849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3f8b6e4-1e50-4ae8-b631-23fde071a477 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:24.501905 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f3f8b6e4-1e50-4ae8-b631-23fde071a477 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1319 microversion: 2.1 time: 0.557180 Oct 24 10:37:24.502713 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1481/2915] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:23 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1319 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:24.511090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cd4965f5-9921-43d0-a88a-f3cec5f945c1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:24.514687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cd4965f5-9921-43d0-a88a-f3cec5f945c1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:24.526483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd4965f5-9921-43d0-a88a-f3cec5f945c1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:24.529888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd4965f5-9921-43d0-a88a-f3cec5f945c1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:24.530570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd4965f5-9921-43d0-a88a-f3cec5f945c1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:24.531498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd4965f5-9921-43d0-a88a-f3cec5f945c1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:24.540064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd4965f5-9921-43d0-a88a-f3cec5f945c1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:24.540793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd4965f5-9921-43d0-a88a-f3cec5f945c1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:24.645308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cd4965f5-9921-43d0-a88a-f3cec5f945c1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:24.653908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cd4965f5-9921-43d0-a88a-f3cec5f945c1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:24.658675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cd4965f5-9921-43d0-a88a-f3cec5f945c1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:24.691685 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cd4965f5-9921-43d0-a88a-f3cec5f945c1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.184378 Oct 24 10:37:24.695623 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1482/2916] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:24 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:24.703103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ac15769a-564e-4625-87ee-f68dc2a8c6bf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:24.718058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ac15769a-564e-4625-87ee-f68dc2a8c6bf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:24.730436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac15769a-564e-4625-87ee-f68dc2a8c6bf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:24.731398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac15769a-564e-4625-87ee-f68dc2a8c6bf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:24.732032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac15769a-564e-4625-87ee-f68dc2a8c6bf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:24.733065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac15769a-564e-4625-87ee-f68dc2a8c6bf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:24.734052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac15769a-564e-4625-87ee-f68dc2a8c6bf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:24.734720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac15769a-564e-4625-87ee-f68dc2a8c6bf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:25.885531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ac15769a-564e-4625-87ee-f68dc2a8c6bf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:25.894786 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ac15769a-564e-4625-87ee-f68dc2a8c6bf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 200 len: 1315 microversion: 2.1 time: 1.197457 Oct 24 10:37:25.897572 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1483/2917] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:24 2022] GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 1315 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:25.926278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-fe21f3a9-c9de-47f1-a309-568e466cd67b req-41857ffa-a0e1-4142-b814-1aa88ac8c59e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e", "name": "network-vif-plugged", "status": "completed", "tag": "0774dbc4-01ad-46fa-8867-bb741a085411"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:25.951199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-fe21f3a9-c9de-47f1-a309-568e466cd67b req-41857ffa-a0e1-4142-b814-1aa88ac8c59e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:25.952923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-fe21f3a9-c9de-47f1-a309-568e466cd67b req-41857ffa-a0e1-4142-b814-1aa88ac8c59e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:25.953806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-fe21f3a9-c9de-47f1-a309-568e466cd67b req-41857ffa-a0e1-4142-b814-1aa88ac8c59e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:25.982714 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-fe21f3a9-c9de-47f1-a309-568e466cd67b req-41857ffa-a0e1-4142-b814-1aa88ac8c59e service nova] Creating event network-vif-plugged:0774dbc4-01ad-46fa-8867-bb741a085411 for instance d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e on n-h1-858383-15 Oct 24 10:37:26.002255 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-fe21f3a9-c9de-47f1-a309-568e466cd67b req-41857ffa-a0e1-4142-b814-1aa88ac8c59e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080747 Oct 24 10:37:26.003894 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1484/2918] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:26.013892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e4d6dd53-4a76-4cdb-a99a-5d98df830d28 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:26.014619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e4d6dd53-4a76-4cdb-a99a-5d98df830d28 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:26.030963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e4d6dd53-4a76-4cdb-a99a-5d98df830d28 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:26.036589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e4d6dd53-4a76-4cdb-a99a-5d98df830d28 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:26.037410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e4d6dd53-4a76-4cdb-a99a-5d98df830d28 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:26.038184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e4d6dd53-4a76-4cdb-a99a-5d98df830d28 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:26.038666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e4d6dd53-4a76-4cdb-a99a-5d98df830d28 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:26.039090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e4d6dd53-4a76-4cdb-a99a-5d98df830d28 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:26.387522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e4d6dd53-4a76-4cdb-a99a-5d98df830d28 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:26.403223 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e4d6dd53-4a76-4cdb-a99a-5d98df830d28 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1312 microversion: 2.1 time: 0.395948 Oct 24 10:37:26.403223 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1485/2919] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:26 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1312 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:26.416878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c7e7eb35-dcd4-4b65-a36e-9a0ead2aa310 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:26.417863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c7e7eb35-dcd4-4b65-a36e-9a0ead2aa310 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:26.425107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7e7eb35-dcd4-4b65-a36e-9a0ead2aa310 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:26.425789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7e7eb35-dcd4-4b65-a36e-9a0ead2aa310 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:26.426336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7e7eb35-dcd4-4b65-a36e-9a0ead2aa310 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:26.427512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7e7eb35-dcd4-4b65-a36e-9a0ead2aa310 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:26.428103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7e7eb35-dcd4-4b65-a36e-9a0ead2aa310 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:26.428635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7e7eb35-dcd4-4b65-a36e-9a0ead2aa310 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:26.799270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c7e7eb35-dcd4-4b65-a36e-9a0ead2aa310 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:26.811722 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c7e7eb35-dcd4-4b65-a36e-9a0ead2aa310 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1313 microversion: 2.1 time: 0.403293 Oct 24 10:37:26.815460 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1486/2920] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:26 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:26.824223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-30d73713-c3f4-4fa1-bf25-f783c064afe3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:26.825496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-30d73713-c3f4-4fa1-bf25-f783c064afe3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:26.850103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30d73713-c3f4-4fa1-bf25-f783c064afe3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:26.851082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30d73713-c3f4-4fa1-bf25-f783c064afe3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:26.851796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30d73713-c3f4-4fa1-bf25-f783c064afe3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:26.856356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30d73713-c3f4-4fa1-bf25-f783c064afe3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:26.858952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30d73713-c3f4-4fa1-bf25-f783c064afe3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:26.860337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30d73713-c3f4-4fa1-bf25-f783c064afe3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:27.561932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-30d73713-c3f4-4fa1-bf25-f783c064afe3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:27.595007 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-30d73713-c3f4-4fa1-bf25-f783c064afe3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1319 microversion: 2.1 time: 0.778408 Oct 24 10:37:27.614059 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1487/2921] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:26 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1319 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:27.634747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-392bdc34-dcc0-4321-9391-ca7b9b159310 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:27.635391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-392bdc34-dcc0-4321-9391-ca7b9b159310 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:27.667731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-392bdc34-dcc0-4321-9391-ca7b9b159310 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:27.672058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-392bdc34-dcc0-4321-9391-ca7b9b159310 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:27.673371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-392bdc34-dcc0-4321-9391-ca7b9b159310 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:27.678628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-392bdc34-dcc0-4321-9391-ca7b9b159310 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:27.680267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-392bdc34-dcc0-4321-9391-ca7b9b159310 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:27.682845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-392bdc34-dcc0-4321-9391-ca7b9b159310 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:27.880240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-392bdc34-dcc0-4321-9391-ca7b9b159310 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:27.904691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-392bdc34-dcc0-4321-9391-ca7b9b159310 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:27.907357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-392bdc34-dcc0-4321-9391-ca7b9b159310 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:27.913951 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-392bdc34-dcc0-4321-9391-ca7b9b159310 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1558 microversion: 2.91 time: 0.298045 Oct 24 10:37:27.918489 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1488/2922] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:27 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1558 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:27.929083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aab912ce-76b0-40fa-a381-54bbd1e35b63 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:27.934936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aab912ce-76b0-40fa-a381-54bbd1e35b63 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:27.955002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aab912ce-76b0-40fa-a381-54bbd1e35b63 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:27.956627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aab912ce-76b0-40fa-a381-54bbd1e35b63 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:27.957635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aab912ce-76b0-40fa-a381-54bbd1e35b63 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:27.974843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aab912ce-76b0-40fa-a381-54bbd1e35b63 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:27.975943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aab912ce-76b0-40fa-a381-54bbd1e35b63 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:27.979479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aab912ce-76b0-40fa-a381-54bbd1e35b63 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:28.364216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aab912ce-76b0-40fa-a381-54bbd1e35b63 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:28.385090 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aab912ce-76b0-40fa-a381-54bbd1e35b63 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 200 len: 1315 microversion: 2.1 time: 0.459837 Oct 24 10:37:28.387191 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1489/2923] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:27 2022] GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:28.404945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bad13a3c-92af-451b-b2d7-0d845e2eca52 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:28.411682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bad13a3c-92af-451b-b2d7-0d845e2eca52 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:28.431393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bad13a3c-92af-451b-b2d7-0d845e2eca52 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:28.432590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bad13a3c-92af-451b-b2d7-0d845e2eca52 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:28.433891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bad13a3c-92af-451b-b2d7-0d845e2eca52 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:28.435262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bad13a3c-92af-451b-b2d7-0d845e2eca52 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:28.435975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bad13a3c-92af-451b-b2d7-0d845e2eca52 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:28.436637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bad13a3c-92af-451b-b2d7-0d845e2eca52 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:28.739401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bad13a3c-92af-451b-b2d7-0d845e2eca52 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:28.759814 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bad13a3c-92af-451b-b2d7-0d845e2eca52 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1333 microversion: 2.1 time: 0.370833 Oct 24 10:37:28.762176 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1490/2924] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:28 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1333 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:28.768661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-26387a32-6f18-4369-8f7a-6edd462a000e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:28.769641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-26387a32-6f18-4369-8f7a-6edd462a000e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:28.778016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26387a32-6f18-4369-8f7a-6edd462a000e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:28.779321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26387a32-6f18-4369-8f7a-6edd462a000e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:28.780234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26387a32-6f18-4369-8f7a-6edd462a000e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:28.781321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26387a32-6f18-4369-8f7a-6edd462a000e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:28.782022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26387a32-6f18-4369-8f7a-6edd462a000e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:28.782674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26387a32-6f18-4369-8f7a-6edd462a000e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:29.075152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:29.084328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=17 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:29.169757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-26387a32-6f18-4369-8f7a-6edd462a000e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:29.183816 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-26387a32-6f18-4369-8f7a-6edd462a000e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1313 microversion: 2.1 time: 0.418804 Oct 24 10:37:29.184670 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1491/2925] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:28 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:29.205183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-be4798ae-d06d-4856-85ab-2de87b78ce8e req-5b9a1c3a-0502-4994-bf15-6f8d04b06cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1387bd9a-747c-4e8b-a30a-136d41dc39e6", "name": "network-vif-plugged", "status": "completed", "tag": "51a23f09-0127-4838-82ec-0a7b4009705c"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:29.271361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-be4798ae-d06d-4856-85ab-2de87b78ce8e req-5b9a1c3a-0502-4994-bf15-6f8d04b06cd3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:29.271848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-be4798ae-d06d-4856-85ab-2de87b78ce8e req-5b9a1c3a-0502-4994-bf15-6f8d04b06cd3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:29.272285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-be4798ae-d06d-4856-85ab-2de87b78ce8e req-5b9a1c3a-0502-4994-bf15-6f8d04b06cd3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:29.332451 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-be4798ae-d06d-4856-85ab-2de87b78ce8e req-5b9a1c3a-0502-4994-bf15-6f8d04b06cd3 service nova] Creating event network-vif-plugged:51a23f09-0127-4838-82ec-0a7b4009705c for instance 1387bd9a-747c-4e8b-a30a-136d41dc39e6 on n-h2-858383-15 Oct 24 10:37:29.353506 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-be4798ae-d06d-4856-85ab-2de87b78ce8e req-5b9a1c3a-0502-4994-bf15-6f8d04b06cd3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150788 Oct 24 10:37:29.359039 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1492/2926] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:29.373474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6287115f-2c8c-4190-9066-c63288ecc745 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:29.375738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6287115f-2c8c-4190-9066-c63288ecc745 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:29.398654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6287115f-2c8c-4190-9066-c63288ecc745 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:29.399153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6287115f-2c8c-4190-9066-c63288ecc745 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:29.399611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6287115f-2c8c-4190-9066-c63288ecc745 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:29.400323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6287115f-2c8c-4190-9066-c63288ecc745 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:29.408130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6287115f-2c8c-4190-9066-c63288ecc745 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:29.409780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6287115f-2c8c-4190-9066-c63288ecc745 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:29.803641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6287115f-2c8c-4190-9066-c63288ecc745 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:29.807265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:29.816406 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6287115f-2c8c-4190-9066-c63288ecc745 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1468 microversion: 2.1 time: 0.456018 Oct 24 10:37:29.821247 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1493/2927] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:29 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1468 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:29.828431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0dd1f03c-9125-460a-88a8-67ff7e6413e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:29.835480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0dd1f03c-9125-460a-88a8-67ff7e6413e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:29.849155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0dd1f03c-9125-460a-88a8-67ff7e6413e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:29.852738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0dd1f03c-9125-460a-88a8-67ff7e6413e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:29.853848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0dd1f03c-9125-460a-88a8-67ff7e6413e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:29.854979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0dd1f03c-9125-460a-88a8-67ff7e6413e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:29.859124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0dd1f03c-9125-460a-88a8-67ff7e6413e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:29.859855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0dd1f03c-9125-460a-88a8-67ff7e6413e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:30.064355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0dd1f03c-9125-460a-88a8-67ff7e6413e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:30.102422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0dd1f03c-9125-460a-88a8-67ff7e6413e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:30.109089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0dd1f03c-9125-460a-88a8-67ff7e6413e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:30.126365 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0dd1f03c-9125-460a-88a8-67ff7e6413e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.303772 Oct 24 10:37:30.129164 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1494/2928] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:29 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:30.148602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8776e11b-f6d3-4bf4-84b7-29876ca2fa72 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:30.150346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8776e11b-f6d3-4bf4-84b7-29876ca2fa72 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:30.159725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8776e11b-f6d3-4bf4-84b7-29876ca2fa72 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:30.160624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8776e11b-f6d3-4bf4-84b7-29876ca2fa72 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:30.161268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8776e11b-f6d3-4bf4-84b7-29876ca2fa72 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:30.162191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8776e11b-f6d3-4bf4-84b7-29876ca2fa72 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:30.163707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8776e11b-f6d3-4bf4-84b7-29876ca2fa72 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:30.164414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8776e11b-f6d3-4bf4-84b7-29876ca2fa72 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:30.430939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8776e11b-f6d3-4bf4-84b7-29876ca2fa72 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:30.448409 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8776e11b-f6d3-4bf4-84b7-29876ca2fa72 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 200 len: 1315 microversion: 2.1 time: 0.317076 Oct 24 10:37:30.450311 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1495/2929] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:30 2022] GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:30.456107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aeb1e6d8-48a0-4d91-b035-9a638031c7a5 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:30.457738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aeb1e6d8-48a0-4d91-b035-9a638031c7a5 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:30.465735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aeb1e6d8-48a0-4d91-b035-9a638031c7a5 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:30.466717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aeb1e6d8-48a0-4d91-b035-9a638031c7a5 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:30.467492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aeb1e6d8-48a0-4d91-b035-9a638031c7a5 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:30.468411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aeb1e6d8-48a0-4d91-b035-9a638031c7a5 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:30.469323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aeb1e6d8-48a0-4d91-b035-9a638031c7a5 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:30.470357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aeb1e6d8-48a0-4d91-b035-9a638031c7a5 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:30.765680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aeb1e6d8-48a0-4d91-b035-9a638031c7a5 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:30.779308 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aeb1e6d8-48a0-4d91-b035-9a638031c7a5 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1354 microversion: 2.1 time: 0.327295 Oct 24 10:37:30.780781 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1496/2930] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:30 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1354 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:30.788825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b4ae0d14-dd04-40fb-995e-04ea36e1e42b tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:30.789772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b4ae0d14-dd04-40fb-995e-04ea36e1e42b tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:30.799469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ae0d14-dd04-40fb-995e-04ea36e1e42b tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:30.800544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ae0d14-dd04-40fb-995e-04ea36e1e42b tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:30.801448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ae0d14-dd04-40fb-995e-04ea36e1e42b tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:30.802761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ae0d14-dd04-40fb-995e-04ea36e1e42b tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:30.803550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ae0d14-dd04-40fb-995e-04ea36e1e42b tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:30.803992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ae0d14-dd04-40fb-995e-04ea36e1e42b tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:30.851795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-b4ae0d14-dd04-40fb-995e-04ea36e1e42b tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lazy-loading 'flavor' on Instance uuid d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:37:30.979625 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b4ae0d14-dd04-40fb-995e-04ea36e1e42b tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e/action" status: 202 len: 0 microversion: 2.1 time: 0.195092 Oct 24 10:37:30.984447 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1497/2931] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:37:30 2022] POST /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:37:30.996001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-471b2611-1975-4e46-836c-75f28110713a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:30.996778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-471b2611-1975-4e46-836c-75f28110713a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:31.017183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-471b2611-1975-4e46-836c-75f28110713a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:31.018729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-471b2611-1975-4e46-836c-75f28110713a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:31.020884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-471b2611-1975-4e46-836c-75f28110713a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:31.021655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-471b2611-1975-4e46-836c-75f28110713a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:31.022121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-471b2611-1975-4e46-836c-75f28110713a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:31.022556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-471b2611-1975-4e46-836c-75f28110713a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:31.059983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:31.092786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:31.406858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-471b2611-1975-4e46-836c-75f28110713a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:31.426665 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-471b2611-1975-4e46-836c-75f28110713a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1313 microversion: 2.1 time: 0.440881 Oct 24 10:37:31.440864 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1498/2932] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:30 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1313 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:31.440864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7015dc1a-0e2b-45df-9cb1-ca2d5cea684a tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:31.440864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7015dc1a-0e2b-45df-9cb1-ca2d5cea684a tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:31.446445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7015dc1a-0e2b-45df-9cb1-ca2d5cea684a tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:31.446945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7015dc1a-0e2b-45df-9cb1-ca2d5cea684a tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:31.447395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7015dc1a-0e2b-45df-9cb1-ca2d5cea684a tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:31.448179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7015dc1a-0e2b-45df-9cb1-ca2d5cea684a tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:31.448733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7015dc1a-0e2b-45df-9cb1-ca2d5cea684a tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:31.449953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7015dc1a-0e2b-45df-9cb1-ca2d5cea684a tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:31.722228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7015dc1a-0e2b-45df-9cb1-ca2d5cea684a tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:31.736718 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7015dc1a-0e2b-45df-9cb1-ca2d5cea684a tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1476 microversion: 2.1 time: 0.307695 Oct 24 10:37:31.757259 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1499/2933] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:31 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1476 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:31.774196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-94909025-3de7-4cab-8e1c-f772f68dc6a3 req-90e9aff5-b3b7-4dbf-a03b-a2cb4645289e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78eb5c2b-4d4b-43b1-86bd-4fe986f4461d", "tag": "e57ada83-946f-4aba-ae66-02d7b2b4a864"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:31.791513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-94909025-3de7-4cab-8e1c-f772f68dc6a3 req-90e9aff5-b3b7-4dbf-a03b-a2cb4645289e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:31.792273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-94909025-3de7-4cab-8e1c-f772f68dc6a3 req-90e9aff5-b3b7-4dbf-a03b-a2cb4645289e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:31.792934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-94909025-3de7-4cab-8e1c-f772f68dc6a3 req-90e9aff5-b3b7-4dbf-a03b-a2cb4645289e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:31.806079 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-94909025-3de7-4cab-8e1c-f772f68dc6a3 req-90e9aff5-b3b7-4dbf-a03b-a2cb4645289e service nova] Creating event network-changed:e57ada83-946f-4aba-ae66-02d7b2b4a864 for instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d on n-h2-858383-15 Oct 24 10:37:31.813357 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-94909025-3de7-4cab-8e1c-f772f68dc6a3 req-90e9aff5-b3b7-4dbf-a03b-a2cb4645289e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054390 Oct 24 10:37:31.813972 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1500/2934] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:31.826519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f48bec75-8456-4a60-a780-b402bffadfef tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:31.827251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f48bec75-8456-4a60-a780-b402bffadfef tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:31.851515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f48bec75-8456-4a60-a780-b402bffadfef tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:31.854464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f48bec75-8456-4a60-a780-b402bffadfef tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:31.855022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f48bec75-8456-4a60-a780-b402bffadfef tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:31.857910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f48bec75-8456-4a60-a780-b402bffadfef tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:31.858416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f48bec75-8456-4a60-a780-b402bffadfef tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:31.858894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f48bec75-8456-4a60-a780-b402bffadfef tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:32.041159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f48bec75-8456-4a60-a780-b402bffadfef tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:32.057193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f48bec75-8456-4a60-a780-b402bffadfef tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:32.058239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f48bec75-8456-4a60-a780-b402bffadfef tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:32.071950 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f48bec75-8456-4a60-a780-b402bffadfef tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.256721 Oct 24 10:37:32.072550 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1501/2935] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:31 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:32.086829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-160a4032-a899-4f36-aa25-dbc831387ad4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:32.086829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-160a4032-a899-4f36-aa25-dbc831387ad4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:32.094668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-160a4032-a899-4f36-aa25-dbc831387ad4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:32.095610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-160a4032-a899-4f36-aa25-dbc831387ad4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:32.095610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-160a4032-a899-4f36-aa25-dbc831387ad4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:32.096285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-160a4032-a899-4f36-aa25-dbc831387ad4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:32.096823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-160a4032-a899-4f36-aa25-dbc831387ad4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:32.097283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-160a4032-a899-4f36-aa25-dbc831387ad4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:32.451915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-160a4032-a899-4f36-aa25-dbc831387ad4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:32.463416 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-160a4032-a899-4f36-aa25-dbc831387ad4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 200 len: 1315 microversion: 2.1 time: 0.389724 Oct 24 10:37:32.478259 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1502/2936] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:32 2022] GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:32.488520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-f4832ed0-59c6-422a-87ef-c9a469dec4d5 req-7c6fc9a2-44af-4014-a4a9-39dfb2138857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "431e0a67-61ff-4331-bebc-5f382784f7af", "name": "network-vif-plugged", "status": "completed", "tag": "e5afb3de-c385-4af2-9119-cd813e858528"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:32.501432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f4832ed0-59c6-422a-87ef-c9a469dec4d5 req-7c6fc9a2-44af-4014-a4a9-39dfb2138857 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:32.502462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f4832ed0-59c6-422a-87ef-c9a469dec4d5 req-7c6fc9a2-44af-4014-a4a9-39dfb2138857 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:32.503110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f4832ed0-59c6-422a-87ef-c9a469dec4d5 req-7c6fc9a2-44af-4014-a4a9-39dfb2138857 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:32.525546 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f4832ed0-59c6-422a-87ef-c9a469dec4d5 req-7c6fc9a2-44af-4014-a4a9-39dfb2138857 service nova] Creating event network-vif-plugged:e5afb3de-c385-4af2-9119-cd813e858528 for instance 431e0a67-61ff-4331-bebc-5f382784f7af on n-h1-858383-15 Oct 24 10:37:32.536036 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-f4832ed0-59c6-422a-87ef-c9a469dec4d5 req-7c6fc9a2-44af-4014-a4a9-39dfb2138857 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055328 Oct 24 10:37:32.551120 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1503/2937] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:32.563419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b66f9169-097c-4dfc-afce-18bed4522272 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:32.565024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b66f9169-097c-4dfc-afce-18bed4522272 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:32.579072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:32.583124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b66f9169-097c-4dfc-afce-18bed4522272 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:32.583839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b66f9169-097c-4dfc-afce-18bed4522272 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:32.584516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b66f9169-097c-4dfc-afce-18bed4522272 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:32.585587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b66f9169-097c-4dfc-afce-18bed4522272 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:32.586238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b66f9169-097c-4dfc-afce-18bed4522272 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:32.587924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b66f9169-097c-4dfc-afce-18bed4522272 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:33.088555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b66f9169-097c-4dfc-afce-18bed4522272 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:33.099214 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b66f9169-097c-4dfc-afce-18bed4522272 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1354 microversion: 2.1 time: 0.546427 Oct 24 10:37:33.104643 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1504/2938] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:32 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1354 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:33.111939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2ee72d8f-7fae-4e66-8a10-70945b15f656 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:33.112560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2ee72d8f-7fae-4e66-8a10-70945b15f656 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:33.142884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ee72d8f-7fae-4e66-8a10-70945b15f656 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:33.143378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ee72d8f-7fae-4e66-8a10-70945b15f656 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:33.143814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ee72d8f-7fae-4e66-8a10-70945b15f656 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:33.144528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ee72d8f-7fae-4e66-8a10-70945b15f656 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:33.145005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ee72d8f-7fae-4e66-8a10-70945b15f656 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:33.145432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ee72d8f-7fae-4e66-8a10-70945b15f656 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:33.486402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2ee72d8f-7fae-4e66-8a10-70945b15f656 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:33.500381 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2ee72d8f-7fae-4e66-8a10-70945b15f656 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1500 microversion: 2.1 time: 0.389158 Oct 24 10:37:33.501141 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1505/2939] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:33 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1500 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:33.515273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9f8c7df0-c255-42a2-8c71-11dabaa29b1e tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:33.516202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9f8c7df0-c255-42a2-8c71-11dabaa29b1e tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:33.528272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f8c7df0-c255-42a2-8c71-11dabaa29b1e tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:33.530690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f8c7df0-c255-42a2-8c71-11dabaa29b1e tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:33.536563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f8c7df0-c255-42a2-8c71-11dabaa29b1e tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:33.537654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f8c7df0-c255-42a2-8c71-11dabaa29b1e tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:33.538321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f8c7df0-c255-42a2-8c71-11dabaa29b1e tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:33.538962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f8c7df0-c255-42a2-8c71-11dabaa29b1e tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:33.721827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9f8c7df0-c255-42a2-8c71-11dabaa29b1e tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:33.737108 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9f8c7df0-c255-42a2-8c71-11dabaa29b1e tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1459 microversion: 2.1 time: 0.233506 Oct 24 10:37:33.738563 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1506/2940] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:33 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1459 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:33.746391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b7070af8-7d4a-4867-b534-fd093fc9dd43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:33.747525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b7070af8-7d4a-4867-b534-fd093fc9dd43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:33.756184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7070af8-7d4a-4867-b534-fd093fc9dd43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:33.759585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7070af8-7d4a-4867-b534-fd093fc9dd43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:33.761111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7070af8-7d4a-4867-b534-fd093fc9dd43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:33.762807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7070af8-7d4a-4867-b534-fd093fc9dd43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:33.764156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7070af8-7d4a-4867-b534-fd093fc9dd43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:33.765330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7070af8-7d4a-4867-b534-fd093fc9dd43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:33.923844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b7070af8-7d4a-4867-b534-fd093fc9dd43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:33.941236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b7070af8-7d4a-4867-b534-fd093fc9dd43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:33.943243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b7070af8-7d4a-4867-b534-fd093fc9dd43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:33.952123 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b7070af8-7d4a-4867-b534-fd093fc9dd43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.211376 Oct 24 10:37:33.964988 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1507/2941] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:33 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:33.965735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c6e163bc-ba64-458a-a3f2-256727edea23 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:33.976977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c6e163bc-ba64-458a-a3f2-256727edea23 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:34.006485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6e163bc-ba64-458a-a3f2-256727edea23 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:34.007435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6e163bc-ba64-458a-a3f2-256727edea23 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:34.008192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6e163bc-ba64-458a-a3f2-256727edea23 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:34.009494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6e163bc-ba64-458a-a3f2-256727edea23 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:34.009965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6e163bc-ba64-458a-a3f2-256727edea23 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:34.010395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6e163bc-ba64-458a-a3f2-256727edea23 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:34.335587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c6e163bc-ba64-458a-a3f2-256727edea23 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:34.350081 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c6e163bc-ba64-458a-a3f2-256727edea23 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 200 len: 1315 microversion: 2.1 time: 0.393300 Oct 24 10:37:34.371012 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1508/2942] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:33 2022] GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:34.384404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c564403f-91d2-4749-a0a2-cc146ebf5ccd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:34.388740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c564403f-91d2-4749-a0a2-cc146ebf5ccd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:34.410717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c564403f-91d2-4749-a0a2-cc146ebf5ccd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:34.412359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c564403f-91d2-4749-a0a2-cc146ebf5ccd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:34.413705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c564403f-91d2-4749-a0a2-cc146ebf5ccd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:34.415128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c564403f-91d2-4749-a0a2-cc146ebf5ccd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:34.423188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c564403f-91d2-4749-a0a2-cc146ebf5ccd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:34.423877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c564403f-91d2-4749-a0a2-cc146ebf5ccd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:34.517889 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c564403f-91d2-4749-a0a2-cc146ebf5ccd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6/action" status: 200 len: 14 microversion: 2.1 time: 0.141392 Oct 24 10:37:34.518544 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1509/2943] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:37:34 2022] POST /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:37:34.523909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2524db0c-154a-4680-97d5-a682f841f4e7 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:34.524786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2524db0c-154a-4680-97d5-a682f841f4e7 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:34.538860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2524db0c-154a-4680-97d5-a682f841f4e7 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:34.539353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2524db0c-154a-4680-97d5-a682f841f4e7 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:34.539801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2524db0c-154a-4680-97d5-a682f841f4e7 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:34.540516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2524db0c-154a-4680-97d5-a682f841f4e7 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:34.540997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2524db0c-154a-4680-97d5-a682f841f4e7 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:34.541428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2524db0c-154a-4680-97d5-a682f841f4e7 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:34.576062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:35.208521 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2524db0c-154a-4680-97d5-a682f841f4e7 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1612 microversion: 2.1 time: 0.688526 Oct 24 10:37:35.225568 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1510/2944] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:34 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1612 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:35.249138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fb46711e-a0e0-4518-9cb0-f8a21e58527b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:35.250325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fb46711e-a0e0-4518-9cb0-f8a21e58527b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:35.257355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb46711e-a0e0-4518-9cb0-f8a21e58527b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:35.259986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb46711e-a0e0-4518-9cb0-f8a21e58527b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:35.260638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb46711e-a0e0-4518-9cb0-f8a21e58527b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:35.264401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb46711e-a0e0-4518-9cb0-f8a21e58527b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:35.265285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb46711e-a0e0-4518-9cb0-f8a21e58527b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:35.267962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb46711e-a0e0-4518-9cb0-f8a21e58527b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:35.596226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fb46711e-a0e0-4518-9cb0-f8a21e58527b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:35.606143 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fb46711e-a0e0-4518-9cb0-f8a21e58527b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1354 microversion: 2.1 time: 0.379194 Oct 24 10:37:35.610242 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1511/2945] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:35 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1354 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:35.621633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-cfb0bb0b-356d-4b02-86cf-f08d516695a7 req-e58b1b49-df5d-4903-b78e-96003cb5b56b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78eb5c2b-4d4b-43b1-86bd-4fe986f4461d", "tag": "067afe80-c1e2-463c-894b-11a5109a94e8"}, {"name": "network-changed", "server_uuid": "78eb5c2b-4d4b-43b1-86bd-4fe986f4461d", "tag": "fd833a93-632c-47be-8b1d-8e3c9376cdc4"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:35.632147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cfb0bb0b-356d-4b02-86cf-f08d516695a7 req-e58b1b49-df5d-4903-b78e-96003cb5b56b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:35.632905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cfb0bb0b-356d-4b02-86cf-f08d516695a7 req-e58b1b49-df5d-4903-b78e-96003cb5b56b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:35.633520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cfb0bb0b-356d-4b02-86cf-f08d516695a7 req-e58b1b49-df5d-4903-b78e-96003cb5b56b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:35.646917 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-cfb0bb0b-356d-4b02-86cf-f08d516695a7 req-e58b1b49-df5d-4903-b78e-96003cb5b56b service nova] Creating event network-changed:067afe80-c1e2-463c-894b-11a5109a94e8 for instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d on n-h2-858383-15 Oct 24 10:37:35.648026 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-cfb0bb0b-356d-4b02-86cf-f08d516695a7 req-e58b1b49-df5d-4903-b78e-96003cb5b56b service nova] Creating event network-changed:fd833a93-632c-47be-8b1d-8e3c9376cdc4 for instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d on n-h2-858383-15 Oct 24 10:37:35.655063 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-cfb0bb0b-356d-4b02-86cf-f08d516695a7 req-e58b1b49-df5d-4903-b78e-96003cb5b56b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042788 Oct 24 10:37:35.656238 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1512/2946] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:35.662624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4fb3107d-cd3d-4f83-9edc-88e63fa0b99c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:35.664170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4fb3107d-cd3d-4f83-9edc-88e63fa0b99c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:35.673728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4fb3107d-cd3d-4f83-9edc-88e63fa0b99c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:35.674761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4fb3107d-cd3d-4f83-9edc-88e63fa0b99c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:35.675368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4fb3107d-cd3d-4f83-9edc-88e63fa0b99c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:35.676366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4fb3107d-cd3d-4f83-9edc-88e63fa0b99c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:35.677059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4fb3107d-cd3d-4f83-9edc-88e63fa0b99c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:35.677959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4fb3107d-cd3d-4f83-9edc-88e63fa0b99c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:35.778150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4fb3107d-cd3d-4f83-9edc-88e63fa0b99c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:35.795082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4fb3107d-cd3d-4f83-9edc-88e63fa0b99c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:35.798865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4fb3107d-cd3d-4f83-9edc-88e63fa0b99c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:35.810284 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4fb3107d-cd3d-4f83-9edc-88e63fa0b99c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.149983 Oct 24 10:37:35.811574 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1513/2947] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:35 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:35.816326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aacdcb39-e336-4b07-ad86-b275098a7903 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:35.822032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aacdcb39-e336-4b07-ad86-b275098a7903 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:35.822765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aacdcb39-e336-4b07-ad86-b275098a7903 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:35.823505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aacdcb39-e336-4b07-ad86-b275098a7903 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:35.826048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aacdcb39-e336-4b07-ad86-b275098a7903 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:35.826712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aacdcb39-e336-4b07-ad86-b275098a7903 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:35.827321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aacdcb39-e336-4b07-ad86-b275098a7903 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:35.856875 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aacdcb39-e336-4b07-ad86-b275098a7903 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.043973 Oct 24 10:37:35.858356 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1514/2948] 10.222.0.50 () {58 vars in 1176 bytes} [Mon Oct 24 10:37:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:35.863524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-67ee4f9d-9e77-4fbe-acf0-769355a34ac2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:35.864318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-67ee4f9d-9e77-4fbe-acf0-769355a34ac2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:35.875380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-67ee4f9d-9e77-4fbe-acf0-769355a34ac2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:35.876131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-67ee4f9d-9e77-4fbe-acf0-769355a34ac2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:35.876769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-67ee4f9d-9e77-4fbe-acf0-769355a34ac2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:35.877498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-67ee4f9d-9e77-4fbe-acf0-769355a34ac2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:35.878110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-67ee4f9d-9e77-4fbe-acf0-769355a34ac2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:35.878694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-67ee4f9d-9e77-4fbe-acf0-769355a34ac2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:36.202611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-67ee4f9d-9e77-4fbe-acf0-769355a34ac2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:36.214795 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-67ee4f9d-9e77-4fbe-acf0-769355a34ac2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 200 len: 1501 microversion: 2.1 time: 0.355009 Oct 24 10:37:36.215428 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1515/2949] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:35 2022] GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 1501 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:36.224639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7ee9c19f-fc76-4424-8d26-a5fc264b720a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:36.226895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7ee9c19f-fc76-4424-8d26-a5fc264b720a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:36.244521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ee9c19f-fc76-4424-8d26-a5fc264b720a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:36.244521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ee9c19f-fc76-4424-8d26-a5fc264b720a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:36.244521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ee9c19f-fc76-4424-8d26-a5fc264b720a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:36.247928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ee9c19f-fc76-4424-8d26-a5fc264b720a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:36.248572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ee9c19f-fc76-4424-8d26-a5fc264b720a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:36.249248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ee9c19f-fc76-4424-8d26-a5fc264b720a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:36.331015 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7ee9c19f-fc76-4424-8d26-a5fc264b720a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6/action" status: 200 len: 14 microversion: 2.1 time: 0.114305 Oct 24 10:37:36.334569 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1516/2950] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:37:36 2022] POST /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:37:36.337282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-330c63e4-5123-43fc-97aa-2230ad3f99c1 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-15", "block_migration": true, "disk_over_commit": false}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:36.343379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-330c63e4-5123-43fc-97aa-2230ad3f99c1 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:36.362004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330c63e4-5123-43fc-97aa-2230ad3f99c1 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:36.362534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330c63e4-5123-43fc-97aa-2230ad3f99c1 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:36.362984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330c63e4-5123-43fc-97aa-2230ad3f99c1 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:36.363721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330c63e4-5123-43fc-97aa-2230ad3f99c1 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:36.364196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330c63e4-5123-43fc-97aa-2230ad3f99c1 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:36.368418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-330c63e4-5123-43fc-97aa-2230ad3f99c1 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:36.429525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-330c63e4-5123-43fc-97aa-2230ad3f99c1 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Lazy-loading 'flavor' on Instance uuid d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:37:36.446498 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-330c63e4-5123-43fc-97aa-2230ad3f99c1 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e while it is in vm_state suspended Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-330c63e4-5123-43fc-97aa-2230ad3f99c1 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Request method failure captured: Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e/action HTTP/1.1 Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 98 Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmqt2aNJBD5RSTyqllzIdHaz9HdwC1iQrpSeVyvC0_PBEE3n4lQWFrScnnyBz0qE4WXW0riSLByDU7OTMmp7xv_9A5KnWDGh5JkWhcBNM2JcZGQINUOSMwOHNGYklIUuE_dfLbJvShQQg3kBFP_MAEHBTDPQgSxp-s8d-PLXjuWC43Y Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: f888917a18194ea5b05b3851f03d3e08 Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-LiveMigrationNegativeTest-410604715 Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f888917a18194ea5b05b3851f03d3e08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f888917a18194ea5b05b3851f03d3e08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f888917a18194ea5b05b3851f03d3e08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f888917a18194ea5b05b3851f03d3e08", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-LiveMigrationNegativeTest-410604715 Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: f888917a18194ea5b05b3851f03d3e08 Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-410604715 Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-LiveMigrationNegativeTest-410604715-project-admin Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: d84cce5285a84e52b8687fcef27c749f Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-LiveMigrationNegativeTest-410604715-project-admin Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: {"os-migrateLive": {"host": "n-h2-858383-15", "block_migration": true, "disk_over_commit": false}} Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: exception: Cannot 'os-migrateLive' instance d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e while it is in vm_state suspended Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'd75c44b3-bbad-4e45-99b7-8ce9c2bdd79e', 'body': {'os-migrateLive': {'host': 'n-h2-858383-15', 'block_migration': True, 'disk_over_commit': False}}} Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:36.448192 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e while it is in vm_state suspended Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e while it is in vm_state suspended Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-330c63e4-5123-43fc-97aa-2230ad3f99c1 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e while it is in vm_state suspended {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-330c63e4-5123-43fc-97aa-2230ad3f99c1 tempest-LiveMigrationNegativeTest-410604715 tempest-LiveMigrationNegativeTest-410604715-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e/action" status: 409 len: 155 microversion: 2.1 time: 0.117475 Oct 24 10:37:36.452819 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1517/2951] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:37:36 2022] POST /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e/action => generated 155 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:37:36.457540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-497f3794-03fb-4d67-bfe0-52ca72fdc790 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:36.457540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-497f3794-03fb-4d67-bfe0-52ca72fdc790 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:36.464645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-497f3794-03fb-4d67-bfe0-52ca72fdc790 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:36.465283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-497f3794-03fb-4d67-bfe0-52ca72fdc790 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:36.466458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-497f3794-03fb-4d67-bfe0-52ca72fdc790 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:36.467419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-497f3794-03fb-4d67-bfe0-52ca72fdc790 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:36.467929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-497f3794-03fb-4d67-bfe0-52ca72fdc790 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:36.468367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-497f3794-03fb-4d67-bfe0-52ca72fdc790 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:36.678315 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-497f3794-03fb-4d67-bfe0-52ca72fdc790 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "POST /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af/action" status: 202 len: 0 microversion: 2.1 time: 0.214681 Oct 24 10:37:36.679032 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1518/2952] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:37:36 2022] POST /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:37:36.694416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6c43908f-cfe3-4900-b999-6ef9c4535244 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:36.696340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6c43908f-cfe3-4900-b999-6ef9c4535244 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:36.717531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c43908f-cfe3-4900-b999-6ef9c4535244 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:36.719492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c43908f-cfe3-4900-b999-6ef9c4535244 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:36.722240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c43908f-cfe3-4900-b999-6ef9c4535244 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:36.727001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c43908f-cfe3-4900-b999-6ef9c4535244 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:36.727636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c43908f-cfe3-4900-b999-6ef9c4535244 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:36.728450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c43908f-cfe3-4900-b999-6ef9c4535244 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:36.787550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6c43908f-cfe3-4900-b999-6ef9c4535244 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:37:36.951525 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6c43908f-cfe3-4900-b999-6ef9c4535244 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 204 len: 0 microversion: 2.1 time: 0.266382 Oct 24 10:37:36.959256 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1519/2953] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:37:36 2022] DELETE /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:37:36.974838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-520fdb5e-4af6-4d65-a016-513bc8135384 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:36.979460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-520fdb5e-4af6-4d65-a016-513bc8135384 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:36.994608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-520fdb5e-4af6-4d65-a016-513bc8135384 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:37.000010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-520fdb5e-4af6-4d65-a016-513bc8135384 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:37.005079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-520fdb5e-4af6-4d65-a016-513bc8135384 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:37.006231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-520fdb5e-4af6-4d65-a016-513bc8135384 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:37.006930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-520fdb5e-4af6-4d65-a016-513bc8135384 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:37.007716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-520fdb5e-4af6-4d65-a016-513bc8135384 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:37.259192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-520fdb5e-4af6-4d65-a016-513bc8135384 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:37.269014 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-520fdb5e-4af6-4d65-a016-513bc8135384 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1354 microversion: 2.1 time: 0.303061 Oct 24 10:37:37.270189 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1520/2954] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:36 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1354 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:37.275233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9868433f-25f6-4112-83f0-4a2fca8f0d54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:37.276147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9868433f-25f6-4112-83f0-4a2fca8f0d54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:37.283547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9868433f-25f6-4112-83f0-4a2fca8f0d54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:37.284333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9868433f-25f6-4112-83f0-4a2fca8f0d54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:37.285126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9868433f-25f6-4112-83f0-4a2fca8f0d54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:37.286361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9868433f-25f6-4112-83f0-4a2fca8f0d54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:37.287042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9868433f-25f6-4112-83f0-4a2fca8f0d54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:37.287671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9868433f-25f6-4112-83f0-4a2fca8f0d54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:37.487193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9868433f-25f6-4112-83f0-4a2fca8f0d54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:37.501773 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9868433f-25f6-4112-83f0-4a2fca8f0d54 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 200 len: 1486 microversion: 2.1 time: 0.229135 Oct 24 10:37:37.502910 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1521/2955] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:37 2022] GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 1486 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:37.509545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-478f6388-9776-45ef-b24f-50b1fa84d9d4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:37.510598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-478f6388-9776-45ef-b24f-50b1fa84d9d4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:37.518064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-478f6388-9776-45ef-b24f-50b1fa84d9d4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:37.518554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-478f6388-9776-45ef-b24f-50b1fa84d9d4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:37.519057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-478f6388-9776-45ef-b24f-50b1fa84d9d4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:37.519765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-478f6388-9776-45ef-b24f-50b1fa84d9d4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:37.520217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-478f6388-9776-45ef-b24f-50b1fa84d9d4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:37.520640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-478f6388-9776-45ef-b24f-50b1fa84d9d4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:37.620311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-478f6388-9776-45ef-b24f-50b1fa84d9d4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:37.630275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-478f6388-9776-45ef-b24f-50b1fa84d9d4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:37.639535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-478f6388-9776-45ef-b24f-50b1fa84d9d4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:37.650268 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-478f6388-9776-45ef-b24f-50b1fa84d9d4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.146115 Oct 24 10:37:37.663701 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1522/2956] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:37 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:37.677964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a3bbecec-8c65-4676-a758-71141af8a976 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:37.680152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a3bbecec-8c65-4676-a758-71141af8a976 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:37.693011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3bbecec-8c65-4676-a758-71141af8a976 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:37.693879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3bbecec-8c65-4676-a758-71141af8a976 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:37.695352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3bbecec-8c65-4676-a758-71141af8a976 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:37.696664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3bbecec-8c65-4676-a758-71141af8a976 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:37.697862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3bbecec-8c65-4676-a758-71141af8a976 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:37.698874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3bbecec-8c65-4676-a758-71141af8a976 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:37.950000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a3bbecec-8c65-4676-a758-71141af8a976 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:37.969693 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a3bbecec-8c65-4676-a758-71141af8a976 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1465 microversion: 2.1 time: 0.316556 Oct 24 10:37:37.970304 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1523/2957] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:37 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1465 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:37.980594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5d8c1c64-6f55-4bde-9d55-f0e7219271c3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:38.001794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5d8c1c64-6f55-4bde-9d55-f0e7219271c3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:38.013486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d8c1c64-6f55-4bde-9d55-f0e7219271c3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:38.014001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d8c1c64-6f55-4bde-9d55-f0e7219271c3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:38.014455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d8c1c64-6f55-4bde-9d55-f0e7219271c3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:38.015199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d8c1c64-6f55-4bde-9d55-f0e7219271c3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:38.015665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d8c1c64-6f55-4bde-9d55-f0e7219271c3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:38.016089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d8c1c64-6f55-4bde-9d55-f0e7219271c3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:38.099837 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5d8c1c64-6f55-4bde-9d55-f0e7219271c3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6/action" status: 200 len: 14 microversion: 2.1 time: 0.128226 Oct 24 10:37:38.100493 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1524/2958] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:37:37 2022] POST /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:37:38.112153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1b9c5132-3cde-447f-957d-a262235d0bf1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:38.112750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1b9c5132-3cde-447f-957d-a262235d0bf1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:38.163445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b9c5132-3cde-447f-957d-a262235d0bf1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:38.164159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b9c5132-3cde-447f-957d-a262235d0bf1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:38.165155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b9c5132-3cde-447f-957d-a262235d0bf1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:38.166084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b9c5132-3cde-447f-957d-a262235d0bf1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:38.166701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b9c5132-3cde-447f-957d-a262235d0bf1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:38.170487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b9c5132-3cde-447f-957d-a262235d0bf1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:38.204549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1b9c5132-3cde-447f-957d-a262235d0bf1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:37:38.247911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:38.341444 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1b9c5132-3cde-447f-957d-a262235d0bf1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "DELETE /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 204 len: 0 microversion: 2.1 time: 0.234950 Oct 24 10:37:38.342900 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1525/2959] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:37:38 2022] DELETE /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:37:38.352210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f05bcfe6-59cd-4f23-987a-ea800e085293 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:38.352983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f05bcfe6-59cd-4f23-987a-ea800e085293 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:38.363196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f05bcfe6-59cd-4f23-987a-ea800e085293 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:38.364249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f05bcfe6-59cd-4f23-987a-ea800e085293 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:38.364695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f05bcfe6-59cd-4f23-987a-ea800e085293 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:38.366093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f05bcfe6-59cd-4f23-987a-ea800e085293 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:38.366551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f05bcfe6-59cd-4f23-987a-ea800e085293 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:38.366993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f05bcfe6-59cd-4f23-987a-ea800e085293 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:38.764878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f05bcfe6-59cd-4f23-987a-ea800e085293 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:38.779269 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f05bcfe6-59cd-4f23-987a-ea800e085293 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1354 microversion: 2.1 time: 0.434469 Oct 24 10:37:38.782282 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1526/2960] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:38 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1354 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:38.794852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6e925464-8286-43c5-82c5-8b31280bc6d1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:38.797810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6e925464-8286-43c5-82c5-8b31280bc6d1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:38.819984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e925464-8286-43c5-82c5-8b31280bc6d1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:38.820666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e925464-8286-43c5-82c5-8b31280bc6d1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:38.821063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e925464-8286-43c5-82c5-8b31280bc6d1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:38.822077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e925464-8286-43c5-82c5-8b31280bc6d1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:38.828239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e925464-8286-43c5-82c5-8b31280bc6d1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:38.828810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e925464-8286-43c5-82c5-8b31280bc6d1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:39.147299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e925464-8286-43c5-82c5-8b31280bc6d1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:39.161176 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6e925464-8286-43c5-82c5-8b31280bc6d1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 200 len: 1492 microversion: 2.1 time: 0.377339 Oct 24 10:37:39.164123 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1527/2961] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:38 2022] GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 1492 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:39.174762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ba52e460-0b5f-4a99-8c34-68ea9c9000ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:39.176473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ba52e460-0b5f-4a99-8c34-68ea9c9000ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:39.194957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba52e460-0b5f-4a99-8c34-68ea9c9000ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:39.195643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba52e460-0b5f-4a99-8c34-68ea9c9000ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:39.196171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba52e460-0b5f-4a99-8c34-68ea9c9000ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:39.197096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba52e460-0b5f-4a99-8c34-68ea9c9000ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:39.197629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba52e460-0b5f-4a99-8c34-68ea9c9000ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:39.198126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba52e460-0b5f-4a99-8c34-68ea9c9000ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:39.328432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ba52e460-0b5f-4a99-8c34-68ea9c9000ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:39.344945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ba52e460-0b5f-4a99-8c34-68ea9c9000ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:39.350209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ba52e460-0b5f-4a99-8c34-68ea9c9000ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:39.368933 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ba52e460-0b5f-4a99-8c34-68ea9c9000ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.192948 Oct 24 10:37:39.370603 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1528/2962] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:39 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:39.389200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-95220992-92b1-4393-b85a-c0409ecdd00d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:39.391517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-95220992-92b1-4393-b85a-c0409ecdd00d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:39.406823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95220992-92b1-4393-b85a-c0409ecdd00d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:39.407613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95220992-92b1-4393-b85a-c0409ecdd00d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:39.408444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95220992-92b1-4393-b85a-c0409ecdd00d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:39.411660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95220992-92b1-4393-b85a-c0409ecdd00d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:39.412699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95220992-92b1-4393-b85a-c0409ecdd00d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:39.413325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95220992-92b1-4393-b85a-c0409ecdd00d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:39.775081 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3ae4aa05-cbee-43a6-9a5d-a43832bdffd0 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/a6a29568-f119-462b-a029-b97ca22a3d5c" status: 200 len: 1428 microversion: 2.1 time: 20.635622 Oct 24 10:37:39.777518 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1435/2963] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:37:19 2022] GET /compute/v2.1/images/a6a29568-f119-462b-a029-b97ca22a3d5c => generated 1428 bytes in 20639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:39.783962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-70678f7c-19a7-426b-803d-8c95794698c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:39.787436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-70678f7c-19a7-426b-803d-8c95794698c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:39.803471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70678f7c-19a7-426b-803d-8c95794698c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:39.804413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70678f7c-19a7-426b-803d-8c95794698c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:39.805371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70678f7c-19a7-426b-803d-8c95794698c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:39.806736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70678f7c-19a7-426b-803d-8c95794698c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:39.807483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70678f7c-19a7-426b-803d-8c95794698c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:39.807975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70678f7c-19a7-426b-803d-8c95794698c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:39.891963 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-70678f7c-19a7-426b-803d-8c95794698c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6/action" status: 200 len: 14 microversion: 2.1 time: 0.112450 Oct 24 10:37:39.892919 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1436/2964] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:37:39 2022] POST /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:37:39.903046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-95220992-92b1-4393-b85a-c0409ecdd00d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:39.907141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4a2e49c5-4c1a-4607-966f-d5cf186b0d57 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:39.910085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4a2e49c5-4c1a-4607-966f-d5cf186b0d57 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:39.910923 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-95220992-92b1-4393-b85a-c0409ecdd00d tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1465 microversion: 2.1 time: 0.535176 Oct 24 10:37:39.921313 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1529/2965] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:39 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1465 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:39.937547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a2e49c5-4c1a-4607-966f-d5cf186b0d57 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:39.943253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a2e49c5-4c1a-4607-966f-d5cf186b0d57 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:39.946173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a2e49c5-4c1a-4607-966f-d5cf186b0d57 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:39.947123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a2e49c5-4c1a-4607-966f-d5cf186b0d57 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:39.950146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a2e49c5-4c1a-4607-966f-d5cf186b0d57 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:39.951693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a2e49c5-4c1a-4607-966f-d5cf186b0d57 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:40.188970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d6664463-6eca-425b-8d82-372ef866671c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:40.189611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d6664463-6eca-425b-8d82-372ef866671c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:40.205531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6664463-6eca-425b-8d82-372ef866671c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:40.206226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6664463-6eca-425b-8d82-372ef866671c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:40.206840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6664463-6eca-425b-8d82-372ef866671c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:40.207627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6664463-6eca-425b-8d82-372ef866671c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:40.208092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6664463-6eca-425b-8d82-372ef866671c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:40.208549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6664463-6eca-425b-8d82-372ef866671c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:41.479156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4a2e49c5-4c1a-4607-966f-d5cf186b0d57 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:41.499207 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4a2e49c5-4c1a-4607-966f-d5cf186b0d57 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1354 microversion: 2.1 time: 1.598862 Oct 24 10:37:41.500147 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1437/2966] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:39 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1354 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:41.517056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-71d2daac-7888-475a-85bb-10b623cd2467 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:41.517692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-71d2daac-7888-475a-85bb-10b623cd2467 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:41.526433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71d2daac-7888-475a-85bb-10b623cd2467 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:41.526816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71d2daac-7888-475a-85bb-10b623cd2467 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:41.527394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71d2daac-7888-475a-85bb-10b623cd2467 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:41.528139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71d2daac-7888-475a-85bb-10b623cd2467 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:41.538460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71d2daac-7888-475a-85bb-10b623cd2467 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:41.539225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71d2daac-7888-475a-85bb-10b623cd2467 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:41.757732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-71d2daac-7888-475a-85bb-10b623cd2467 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:41.773964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-71d2daac-7888-475a-85bb-10b623cd2467 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:41.778430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-71d2daac-7888-475a-85bb-10b623cd2467 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:41.836313 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-71d2daac-7888-475a-85bb-10b623cd2467 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.335055 Oct 24 10:37:41.853147 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1438/2967] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:41 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:41.867535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d6664463-6eca-425b-8d82-372ef866671c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:41.871855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be6f34a3-59a1-4a31-ba2e-c8828b38aa68 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d02a4040>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:41.881947 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d6664463-6eca-425b-8d82-372ef866671c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 200 len: 1492 microversion: 2.1 time: 1.696686 Oct 24 10:37:41.882977 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1530/2968] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:40 2022] GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 1492 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:37:41.897291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-635f8003-e6b6-4fb1-83d5-323c6c61c495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:41.900102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-635f8003-e6b6-4fb1-83d5-323c6c61c495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:41.935857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-635f8003-e6b6-4fb1-83d5-323c6c61c495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:41.936524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-635f8003-e6b6-4fb1-83d5-323c6c61c495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:41.937131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-635f8003-e6b6-4fb1-83d5-323c6c61c495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:41.938089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-635f8003-e6b6-4fb1-83d5-323c6c61c495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:41.938673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-635f8003-e6b6-4fb1-83d5-323c6c61c495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:41.942063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-635f8003-e6b6-4fb1-83d5-323c6c61c495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:42.000786 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-be6f34a3-59a1-4a31-ba2e-c8828b38aa68 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/a6a29568-f119-462b-a029-b97ca22a3d5c" status: 200 len: 1437 microversion: 2.1 time: 0.148525 Oct 24 10:37:42.004643 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1439/2969] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:37:41 2022] GET /compute/v2.1/images/a6a29568-f119-462b-a029-b97ca22a3d5c => generated 1437 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:42.011913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3e2e17a3-3c70-45d7-b0b1-7ce205efb8aa tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:42.040935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3e2e17a3-3c70-45d7-b0b1-7ce205efb8aa tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:42.056941 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-635f8003-e6b6-4fb1-83d5-323c6c61c495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6/action" status: 200 len: 14 microversion: 2.1 time: 0.172306 Oct 24 10:37:42.058991 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1531/2970] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:37:41 2022] POST /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:37:42.066566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-1f9c182a-75e6-49b2-b34d-11d10cccdf2c req-4c1c30d1-b319-4a13-8a30-f55e0c6ebb1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "431e0a67-61ff-4331-bebc-5f382784f7af", "name": "network-vif-deleted", "tag": "e5afb3de-c385-4af2-9119-cd813e858528"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:42.074075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e2e17a3-3c70-45d7-b0b1-7ce205efb8aa tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:42.097062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1f9c182a-75e6-49b2-b34d-11d10cccdf2c req-4c1c30d1-b319-4a13-8a30-f55e0c6ebb1a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:42.102690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1f9c182a-75e6-49b2-b34d-11d10cccdf2c req-4c1c30d1-b319-4a13-8a30-f55e0c6ebb1a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:42.104733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1f9c182a-75e6-49b2-b34d-11d10cccdf2c req-4c1c30d1-b319-4a13-8a30-f55e0c6ebb1a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:42.110766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e2e17a3-3c70-45d7-b0b1-7ce205efb8aa tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:42.113173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e2e17a3-3c70-45d7-b0b1-7ce205efb8aa tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:42.117766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e2e17a3-3c70-45d7-b0b1-7ce205efb8aa tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:42.126756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e2e17a3-3c70-45d7-b0b1-7ce205efb8aa tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:42.129104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e2e17a3-3c70-45d7-b0b1-7ce205efb8aa tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:42.137946 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-1f9c182a-75e6-49b2-b34d-11d10cccdf2c req-4c1c30d1-b319-4a13-8a30-f55e0c6ebb1a service nova] Creating event network-vif-deleted:e5afb3de-c385-4af2-9119-cd813e858528 for instance 431e0a67-61ff-4331-bebc-5f382784f7af on n-h1-858383-15 Oct 24 10:37:42.148805 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-1f9c182a-75e6-49b2-b34d-11d10cccdf2c req-4c1c30d1-b319-4a13-8a30-f55e0c6ebb1a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088066 Oct 24 10:37:42.155562 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1532/2971] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:42.163078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-22055a62-b0fa-4791-be32-26a9ade8df15 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d15d5a60>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:42.279562 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-22055a62-b0fa-4791-be32-26a9ade8df15 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/images/a6a29568-f119-462b-a029-b97ca22a3d5c" status: 200 len: 1437 microversion: 2.1 time: 0.122248 Oct 24 10:37:42.280295 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1533/2972] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:37:42 2022] GET /compute/v2.1/images/a6a29568-f119-462b-a029-b97ca22a3d5c => generated 1437 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:42.296233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-898fa3b1-347b-4eb9-8d2f-6d5469e3e1bc tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:42.297335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-898fa3b1-347b-4eb9-8d2f-6d5469e3e1bc tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:42.317084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-898fa3b1-347b-4eb9-8d2f-6d5469e3e1bc tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:42.324499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-898fa3b1-347b-4eb9-8d2f-6d5469e3e1bc tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:42.325292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-898fa3b1-347b-4eb9-8d2f-6d5469e3e1bc tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:42.326286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-898fa3b1-347b-4eb9-8d2f-6d5469e3e1bc tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:42.326951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-898fa3b1-347b-4eb9-8d2f-6d5469e3e1bc tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:42.327595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-898fa3b1-347b-4eb9-8d2f-6d5469e3e1bc tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:42.850495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3e2e17a3-3c70-45d7-b0b1-7ce205efb8aa tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:42.862683 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3e2e17a3-3c70-45d7-b0b1-7ce205efb8aa tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 200 len: 1465 microversion: 2.1 time: 0.854993 Oct 24 10:37:42.863460 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1440/2973] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:42 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 1465 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:42.882275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0352790d-3195-486a-83fb-b42d446ab304 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:42.883233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0352790d-3195-486a-83fb-b42d446ab304 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:42.908750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0352790d-3195-486a-83fb-b42d446ab304 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:42.909286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0352790d-3195-486a-83fb-b42d446ab304 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:42.909727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0352790d-3195-486a-83fb-b42d446ab304 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:42.910446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0352790d-3195-486a-83fb-b42d446ab304 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:42.919271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0352790d-3195-486a-83fb-b42d446ab304 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:42.920046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0352790d-3195-486a-83fb-b42d446ab304 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:43.014816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-898fa3b1-347b-4eb9-8d2f-6d5469e3e1bc tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9fe821ad1b43f2988dd30521c6c335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c125be93d647e1b2c0fdd4ae2efb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:43.023883 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-898fa3b1-347b-4eb9-8d2f-6d5469e3e1bc tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 200 len: 1465 microversion: 2.1 time: 0.732095 Oct 24 10:37:43.029150 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1534/2974] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:42 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 1465 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:37:43.039650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-49b7fa99-d562-4917-871c-25e4e36a369f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:43.040570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-49b7fa99-d562-4917-871c-25e4e36a369f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:43.047770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49b7fa99-d562-4917-871c-25e4e36a369f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:43.049271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49b7fa99-d562-4917-871c-25e4e36a369f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:43.049932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49b7fa99-d562-4917-871c-25e4e36a369f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:43.050867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49b7fa99-d562-4917-871c-25e4e36a369f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:43.051552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49b7fa99-d562-4917-871c-25e4e36a369f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:43.052187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49b7fa99-d562-4917-871c-25e4e36a369f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:43.355536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-49b7fa99-d562-4917-871c-25e4e36a369f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:43.380851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-49b7fa99-d562-4917-871c-25e4e36a369f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:43.382661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-49b7fa99-d562-4917-871c-25e4e36a369f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:43.402282 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-49b7fa99-d562-4917-871c-25e4e36a369f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.369495 Oct 24 10:37:43.403168 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1535/2975] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:43 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:43.416750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-527e41bb-2dd4-42d7-935d-650e7abb0810 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:43.418856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-527e41bb-2dd4-42d7-935d-650e7abb0810 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:43.434944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-527e41bb-2dd4-42d7-935d-650e7abb0810 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:43.436728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-527e41bb-2dd4-42d7-935d-650e7abb0810 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:43.439065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-527e41bb-2dd4-42d7-935d-650e7abb0810 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:43.440650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-527e41bb-2dd4-42d7-935d-650e7abb0810 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:43.443473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-527e41bb-2dd4-42d7-935d-650e7abb0810 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:43.444180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-527e41bb-2dd4-42d7-935d-650e7abb0810 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:43.488426 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-527e41bb-2dd4-42d7-935d-650e7abb0810 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance 431e0a67-61ff-4331-bebc-5f382784f7af could not be found. Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-527e41bb-2dd4-42d7-935d-650e7abb0810 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af HTTP/1.1 Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 431e0a67-61ff-4331-bebc-5f382784f7af could not be found. Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '431e0a67-61ff-4331-bebc-5f382784f7af'} Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 431e0a67-61ff-4331-bebc-5f382784f7af could not be found. Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 431e0a67-61ff-4331-bebc-5f382784f7af could not be found. Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:43.503219 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:43.508343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:43.508343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:43.508343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:43.508343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:37:43.508343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:37:43.508343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 431e0a67-61ff-4331-bebc-5f382784f7af could not be found. Oct 24 10:37:43.508343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:43.508343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-527e41bb-2dd4-42d7-935d-650e7abb0810 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance 431e0a67-61ff-4331-bebc-5f382784f7af could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:37:43.509759 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-527e41bb-2dd4-42d7-935d-650e7abb0810 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 404 len: 111 microversion: 2.1 time: 0.105382 Oct 24 10:37:43.511425 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1536/2976] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:43 2022] GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:37:43.526087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a6bc9488-3610-4848-b1fb-cbe523e27cf0 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d0f0d8b0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:43.776530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0352790d-3195-486a-83fb-b42d446ab304 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:43.787284 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0352790d-3195-486a-83fb-b42d446ab304 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1354 microversion: 2.1 time: 0.922992 Oct 24 10:37:43.795804 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1441/2977] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:42 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1354 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:43.815451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e776dba0-5ebe-40ae-b6b7-a9d47876fcc0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:43.851099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e776dba0-5ebe-40ae-b6b7-a9d47876fcc0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:43.869723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e776dba0-5ebe-40ae-b6b7-a9d47876fcc0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:43.870904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e776dba0-5ebe-40ae-b6b7-a9d47876fcc0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:43.872927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e776dba0-5ebe-40ae-b6b7-a9d47876fcc0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:43.874897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e776dba0-5ebe-40ae-b6b7-a9d47876fcc0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:43.876749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e776dba0-5ebe-40ae-b6b7-a9d47876fcc0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:43.879068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e776dba0-5ebe-40ae-b6b7-a9d47876fcc0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:43.994487 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e776dba0-5ebe-40ae-b6b7-a9d47876fcc0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6/action" status: 200 len: 14 microversion: 2.1 time: 0.182824 Oct 24 10:37:43.996202 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1442/2978] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:37:43 2022] POST /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:37:44.001621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c9337329-cad5-4179-ae28-bbcc4c782e6d req-7984bd67-fc34-4bc7-a16d-d26eaf18bcce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e", "name": "network-vif-deleted", "tag": "0774dbc4-01ad-46fa-8867-bb741a085411"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:44.047077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c9337329-cad5-4179-ae28-bbcc4c782e6d req-7984bd67-fc34-4bc7-a16d-d26eaf18bcce service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:44.047575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c9337329-cad5-4179-ae28-bbcc4c782e6d req-7984bd67-fc34-4bc7-a16d-d26eaf18bcce service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:44.049603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c9337329-cad5-4179-ae28-bbcc4c782e6d req-7984bd67-fc34-4bc7-a16d-d26eaf18bcce service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:44.092015 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c9337329-cad5-4179-ae28-bbcc4c782e6d req-7984bd67-fc34-4bc7-a16d-d26eaf18bcce service nova] Creating event network-vif-deleted:0774dbc4-01ad-46fa-8867-bb741a085411 for instance d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e on n-h1-858383-15 Oct 24 10:37:44.103979 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c9337329-cad5-4179-ae28-bbcc4c782e6d req-7984bd67-fc34-4bc7-a16d-d26eaf18bcce service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106036 Oct 24 10:37:44.112928 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1443/2979] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:44.119305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-27e1dc5c-c81c-497a-be5c-d594f84d2260 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-590799634", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "7e246fd4-526c-4b90-abc8-eb217581a916"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:44.685847 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a6bc9488-3610-4848-b1fb-cbe523e27cf0 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "DELETE /compute/v2.1/images/a6a29568-f119-462b-a029-b97ca22a3d5c" status: 204 len: 0 microversion: 2.1 time: 1.172584 Oct 24 10:37:44.686560 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1537/2980] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:43 2022] DELETE /compute/v2.1/images/a6a29568-f119-462b-a029-b97ca22a3d5c => generated 0 bytes in 1175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:37:44.692167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a7a67cb6-e0f4-4504-b17f-06aa8acea97b tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:44.693024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a7a67cb6-e0f4-4504-b17f-06aa8acea97b tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:44.721582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7a67cb6-e0f4-4504-b17f-06aa8acea97b tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:44.722080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7a67cb6-e0f4-4504-b17f-06aa8acea97b tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:44.722518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7a67cb6-e0f4-4504-b17f-06aa8acea97b tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:44.728007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7a67cb6-e0f4-4504-b17f-06aa8acea97b tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:44.728522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7a67cb6-e0f4-4504-b17f-06aa8acea97b tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:44.729003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7a67cb6-e0f4-4504-b17f-06aa8acea97b tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:44.765930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-27e1dc5c-c81c-497a-be5c-d594f84d2260 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] validate_networks() for [('7e246fd4-526c-4b90-abc8-eb217581a916', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:37:44.773627 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-a7a67cb6-e0f4-4504-b17f-06aa8acea97b tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] HTTP exception thrown: Instance d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e could not be found. Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a7a67cb6-e0f4-4504-b17f-06aa8acea97b tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Request method failure captured: Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e HTTP/1.1 Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmqsP5CvsDc-5XiauS6sB8HrUshRrewWwrGKJRtGfx8TnxDb62lRJMw6XROkLglVgHQXuQxepsCTJ-c6nyVBFLe6LImVnrYmclwLYcmaIjucDltQryKEmJzrAcFul-qJKBx3AwKNY6BPMpVxN5vaAVvQz6mgoP8b-SsiAWiW9cTUNMc Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: a3656fcc947f4652a6eae2e31be21ada Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-LiveMigrationNegativeTest-187572556 Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a3656fcc947f4652a6eae2e31be21ada"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a3656fcc947f4652a6eae2e31be21ada"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a3656fcc947f4652a6eae2e31be21ada"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a3656fcc947f4652a6eae2e31be21ada", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-LiveMigrationNegativeTest-187572556 Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: a3656fcc947f4652a6eae2e31be21ada Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-187572556 Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-LiveMigrationNegativeTest-187572556-project Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: f71950ff4118494288b1088fd7c700cd Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-LiveMigrationNegativeTest-187572556-project Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e could not be found. Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'd75c44b3-bbad-4e45-99b7-8ce9c2bdd79e'} Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e could not be found. Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e could not be found. Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:44.775197 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:44.780186 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:44.780186 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:44.780186 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:44.780186 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:37:44.780186 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:37:44.780186 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e could not be found. Oct 24 10:37:44.780186 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:44.780186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a7a67cb6-e0f4-4504-b17f-06aa8acea97b tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Returning 404 to user: Instance d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:37:44.803242 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a7a67cb6-e0f4-4504-b17f-06aa8acea97b tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e" status: 404 len: 111 microversion: 2.1 time: 0.088882 Oct 24 10:37:44.805219 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1538/2981] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:44 2022] GET /compute/v2.1/servers/d75c44b3-bbad-4e45-99b7-8ce9c2bdd79e => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:37:44.819140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-33bb2a43-d65f-49ab-8471-ba58ba1a0c5c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:44.820163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-33bb2a43-d65f-49ab-8471-ba58ba1a0c5c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:44.838232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33bb2a43-d65f-49ab-8471-ba58ba1a0c5c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:44.844087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33bb2a43-d65f-49ab-8471-ba58ba1a0c5c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:44.845233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33bb2a43-d65f-49ab-8471-ba58ba1a0c5c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:44.846172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33bb2a43-d65f-49ab-8471-ba58ba1a0c5c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:44.847071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33bb2a43-d65f-49ab-8471-ba58ba1a0c5c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:44.847693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33bb2a43-d65f-49ab-8471-ba58ba1a0c5c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:45.158305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-33bb2a43-d65f-49ab-8471-ba58ba1a0c5c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:45.178085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-33bb2a43-d65f-49ab-8471-ba58ba1a0c5c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:45.182921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-33bb2a43-d65f-49ab-8471-ba58ba1a0c5c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:45.204279 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-33bb2a43-d65f-49ab-8471-ba58ba1a0c5c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.397378 Oct 24 10:37:45.208969 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1539/2982] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:44 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:45.228811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0c97f7b6-a89e-4871-9404-f0a662a5c6ee tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '.version_select at 0x7f04d07f8c10>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:45.269621 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-0c97f7b6-a89e-4871-9404-f0a662a5c6ee tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] HTTP exception thrown: Image not found. Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0c97f7b6-a89e-4871-9404-f0a662a5c6ee tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Request method failure captured: Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 HTTP/1.1 Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmqUdKhAQppvt-50F_-rVZdLGuSL_jHdWKd3XzK_GHAWsZlymvlv_uOlROl61F_Z4Spvk60AvFdizQpFomiWcyMXv9yfn-Nko_FNUXMKndp4X39esqqYJ1eh-GkUQESTQMr1KA2aXTS_PZz2LsZIqWosJObJipOJNhlsflpXH4tFaPU Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 96c125be93d647e1b2c0fdd4ae2efb14 Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesOneServerTestJSON-2062039880 Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96c125be93d647e1b2c0fdd4ae2efb14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96c125be93d647e1b2c0fdd4ae2efb14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/96c125be93d647e1b2c0fdd4ae2efb14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_96c125be93d647e1b2c0fdd4ae2efb14", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesOneServerTestJSON-2062039880 Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 96c125be93d647e1b2c0fdd4ae2efb14 Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2062039880 Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesOneServerTestJSON-2062039880-project Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ed9fe821ad1b43f2988dd30521c6c335 Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesOneServerTestJSON-2062039880-project Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: exception: Image not found. Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'cb6a56ae-b5a1-4db6-af7c-483168d12e95'} Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cb6a56ae-b5a1-4db6-af7c-483168d12e95 to delete Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cb6a56ae-b5a1-4db6-af7c-483168d12e95 could not be found. Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:45.271688 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0c97f7b6-a89e-4871-9404-f0a662a5c6ee tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Returning 404 to user: Image not found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:37:45.276266 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0c97f7b6-a89e-4871-9404-f0a662a5c6ee tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "DELETE /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95" status: 404 len: 62 microversion: 2.1 time: 0.061099 Oct 24 10:37:45.278009 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1540/2983] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:45 2022] DELETE /compute/v2.1/images/cb6a56ae-b5a1-4db6-af7c-483168d12e95 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:37:45.289364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-77d05c30-843a-40cb-b9a5-5f270b2bf9cb tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:45.289880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-77d05c30-843a-40cb-b9a5-5f270b2bf9cb tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:45.335993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77d05c30-843a-40cb-b9a5-5f270b2bf9cb tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:45.336503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77d05c30-843a-40cb-b9a5-5f270b2bf9cb tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:45.336997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77d05c30-843a-40cb-b9a5-5f270b2bf9cb tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:45.341135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77d05c30-843a-40cb-b9a5-5f270b2bf9cb tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:45.341643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77d05c30-843a-40cb-b9a5-5f270b2bf9cb tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:45.342084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77d05c30-843a-40cb-b9a5-5f270b2bf9cb tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:45.414561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-77d05c30-843a-40cb-b9a5-5f270b2bf9cb tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:37:45.626556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:45.646963 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-77d05c30-843a-40cb-b9a5-5f270b2bf9cb tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7" status: 204 len: 0 microversion: 2.1 time: 0.368270 Oct 24 10:37:45.657172 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1541/2984] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:37:45 2022] DELETE /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:37:45.662850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0c1e3d1b-d8fe-460d-aa60-2a7cd45346ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:45.663557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0c1e3d1b-d8fe-460d-aa60-2a7cd45346ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:45.694852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c1e3d1b-d8fe-460d-aa60-2a7cd45346ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:45.696074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c1e3d1b-d8fe-460d-aa60-2a7cd45346ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:45.696674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c1e3d1b-d8fe-460d-aa60-2a7cd45346ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:45.697579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c1e3d1b-d8fe-460d-aa60-2a7cd45346ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:45.698391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c1e3d1b-d8fe-460d-aa60-2a7cd45346ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:45.699097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c1e3d1b-d8fe-460d-aa60-2a7cd45346ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:45.837149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:45.890503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-27e1dc5c-c81c-497a-be5c-d594f84d2260 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:37:45.891108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-27e1dc5c-c81c-497a-be5c-d594f84d2260 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:37:45.891412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-27e1dc5c-c81c-497a-be5c-d594f84d2260 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:37:45.892108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-27e1dc5c-c81c-497a-be5c-d594f84d2260 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:37:45.892540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-27e1dc5c-c81c-497a-be5c-d594f84d2260 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:37:45.911024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27e1dc5c-c81c-497a-be5c-d594f84d2260 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:45.911898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27e1dc5c-c81c-497a-be5c-d594f84d2260 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:45.914292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27e1dc5c-c81c-497a-be5c-d594f84d2260 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:45.930500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27e1dc5c-c81c-497a-be5c-d594f84d2260 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:45.933075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27e1dc5c-c81c-497a-be5c-d594f84d2260 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:45.933951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27e1dc5c-c81c-497a-be5c-d594f84d2260 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:45.992166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-27e1dc5c-c81c-497a-be5c-d594f84d2260 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Getting quotas for project eb78fe6939ec43d99fe6b1ba24a68287. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:37:46.006159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-27e1dc5c-c81c-497a-be5c-d594f84d2260 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Getting quotas for user 2a7e183a1d4240f28566a318b7e70dee and project eb78fe6939ec43d99fe6b1ba24a68287. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:37:46.044180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-27e1dc5c-c81c-497a-be5c-d594f84d2260 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:37:46.046583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-27e1dc5c-c81c-497a-be5c-d594f84d2260 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:37:46.132028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0c1e3d1b-d8fe-460d-aa60-2a7cd45346ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:46.146702 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0c1e3d1b-d8fe-460d-aa60-2a7cd45346ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1354 microversion: 2.1 time: 0.484914 Oct 24 10:37:46.147948 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1542/2985] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:45 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1354 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:46.164556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a9694ee2-9be4-4275-89a1-249ec124b509 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:46.170101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a9694ee2-9be4-4275-89a1-249ec124b509 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:46.189774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9694ee2-9be4-4275-89a1-249ec124b509 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:46.191417 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-27e1dc5c-c81c-497a-be5c-d594f84d2260 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.076445 Oct 24 10:37:46.194436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9694ee2-9be4-4275-89a1-249ec124b509 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:46.195309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9694ee2-9be4-4275-89a1-249ec124b509 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:46.196539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9694ee2-9be4-4275-89a1-249ec124b509 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:46.197222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9694ee2-9be4-4275-89a1-249ec124b509 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:46.198205 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1444/2986] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:37:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:37:46.206594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9694ee2-9be4-4275-89a1-249ec124b509 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:46.236627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dafe3b03-2a8f-4d6a-b200-02a06b2e6b1d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:46.237194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dafe3b03-2a8f-4d6a-b200-02a06b2e6b1d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:46.254813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dafe3b03-2a8f-4d6a-b200-02a06b2e6b1d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:46.255328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dafe3b03-2a8f-4d6a-b200-02a06b2e6b1d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:46.255778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dafe3b03-2a8f-4d6a-b200-02a06b2e6b1d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:46.258389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dafe3b03-2a8f-4d6a-b200-02a06b2e6b1d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:46.261969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dafe3b03-2a8f-4d6a-b200-02a06b2e6b1d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:46.262619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dafe3b03-2a8f-4d6a-b200-02a06b2e6b1d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:46.335338 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a9694ee2-9be4-4275-89a1-249ec124b509 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6/action" status: 200 len: 16399 microversion: 2.1 time: 0.183687 Oct 24 10:37:46.343153 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1543/2987] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:37:46 2022] POST /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6/action => generated 16399 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:37:46.346155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dafe3b03-2a8f-4d6a-b200-02a06b2e6b1d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:37:46.348927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-116a4d9d-3167-4dc5-acfb-aa9418b3a158 req-5934ee00-443e-4589-9871-2ce4145e1f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e16c14-6d0e-49a5-9948-298c2e667999", "name": "network-vif-unplugged", "status": "completed", "tag": "bddb3b72-49df-48b0-b7ca-ad03dc04e320"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:46.374501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-116a4d9d-3167-4dc5-acfb-aa9418b3a158 req-5934ee00-443e-4589-9871-2ce4145e1f14 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:46.374998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-116a4d9d-3167-4dc5-acfb-aa9418b3a158 req-5934ee00-443e-4589-9871-2ce4145e1f14 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:46.375439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-116a4d9d-3167-4dc5-acfb-aa9418b3a158 req-5934ee00-443e-4589-9871-2ce4145e1f14 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:46.408504 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-116a4d9d-3167-4dc5-acfb-aa9418b3a158 req-5934ee00-443e-4589-9871-2ce4145e1f14 service nova] Creating event network-vif-unplugged:bddb3b72-49df-48b0-b7ca-ad03dc04e320 for instance 42e16c14-6d0e-49a5-9948-298c2e667999 on n-h2-858383-15 Oct 24 10:37:46.419853 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-116a4d9d-3167-4dc5-acfb-aa9418b3a158 req-5934ee00-443e-4589-9871-2ce4145e1f14 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075104 Oct 24 10:37:46.424147 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1544/2988] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:46.436993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-19480217-aa25-4635-8381-3f0baa036cac tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:46.437712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-19480217-aa25-4635-8381-3f0baa036cac tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:46.459821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19480217-aa25-4635-8381-3f0baa036cac tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:46.462300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19480217-aa25-4635-8381-3f0baa036cac tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:46.462300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19480217-aa25-4635-8381-3f0baa036cac tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:46.466319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19480217-aa25-4635-8381-3f0baa036cac tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:46.466814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19480217-aa25-4635-8381-3f0baa036cac tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:46.478517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19480217-aa25-4635-8381-3f0baa036cac tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:46.638169 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dafe3b03-2a8f-4d6a-b200-02a06b2e6b1d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "DELETE /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 204 len: 0 microversion: 2.1 time: 0.435869 Oct 24 10:37:46.645671 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1445/2989] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:37:46 2022] DELETE /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:37:46.657631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e5319983-0a48-4061-a189-f316570c7b43 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:46.661092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e5319983-0a48-4061-a189-f316570c7b43 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:46.830405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e5319983-0a48-4061-a189-f316570c7b43 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:46.860142 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e5319983-0a48-4061-a189-f316570c7b43 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1214 microversion: 2.1 time: 0.204942 Oct 24 10:37:46.875179 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1446/2990] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:46 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1214 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:46.892786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-444074fb-fba7-4c9f-a287-055ccb0d98f8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:46.893411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-444074fb-fba7-4c9f-a287-055ccb0d98f8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:46.906619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-444074fb-fba7-4c9f-a287-055ccb0d98f8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:46.909825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-444074fb-fba7-4c9f-a287-055ccb0d98f8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:46.910509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-444074fb-fba7-4c9f-a287-055ccb0d98f8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:46.913165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-444074fb-fba7-4c9f-a287-055ccb0d98f8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:46.913838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-444074fb-fba7-4c9f-a287-055ccb0d98f8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:46.914446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-444074fb-fba7-4c9f-a287-055ccb0d98f8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:47.081023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-19480217-aa25-4635-8381-3f0baa036cac tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:47.106339 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-19480217-aa25-4635-8381-3f0baa036cac tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7" status: 200 len: 1475 microversion: 2.1 time: 0.680133 Oct 24 10:37:47.124003 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1545/2991] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:46 2022] GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 => generated 1475 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:47.137293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9484299e-1338-41c3-9e08-f4a1413c3413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:47.141791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9484299e-1338-41c3-9e08-f4a1413c3413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:47.147968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-444074fb-fba7-4c9f-a287-055ccb0d98f8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:47.156878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9484299e-1338-41c3-9e08-f4a1413c3413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:47.157423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9484299e-1338-41c3-9e08-f4a1413c3413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:47.157875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9484299e-1338-41c3-9e08-f4a1413c3413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:47.158391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-444074fb-fba7-4c9f-a287-055ccb0d98f8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:47.158611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9484299e-1338-41c3-9e08-f4a1413c3413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:47.160529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-444074fb-fba7-4c9f-a287-055ccb0d98f8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:47.167637 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-444074fb-fba7-4c9f-a287-055ccb0d98f8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.290801 Oct 24 10:37:47.167900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9484299e-1338-41c3-9e08-f4a1413c3413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:47.168460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9484299e-1338-41c3-9e08-f4a1413c3413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:47.169381 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1447/2992] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:46 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:47.174773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-66f6a688-9850-48d2-9cbf-41d2e6a51178 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:47.175581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-66f6a688-9850-48d2-9cbf-41d2e6a51178 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:47.178241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:47.183829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66f6a688-9850-48d2-9cbf-41d2e6a51178 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:47.184707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66f6a688-9850-48d2-9cbf-41d2e6a51178 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:47.185328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66f6a688-9850-48d2-9cbf-41d2e6a51178 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:47.186215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66f6a688-9850-48d2-9cbf-41d2e6a51178 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:47.186814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66f6a688-9850-48d2-9cbf-41d2e6a51178 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:47.187400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66f6a688-9850-48d2-9cbf-41d2e6a51178 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:47.499110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-66f6a688-9850-48d2-9cbf-41d2e6a51178 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9fe821ad1b43f2988dd30521c6c335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c125be93d647e1b2c0fdd4ae2efb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:47.515657 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-66f6a688-9850-48d2-9cbf-41d2e6a51178 tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 200 len: 1471 microversion: 2.1 time: 0.342665 Oct 24 10:37:47.518958 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1448/2993] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:47 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 1471 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:47.536857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4dee3274-a85f-4957-8ca5-b870e7325e3a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:47.537694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4dee3274-a85f-4957-8ca5-b870e7325e3a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:47.551675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4dee3274-a85f-4957-8ca5-b870e7325e3a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:47.554595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4dee3274-a85f-4957-8ca5-b870e7325e3a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:47.555257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4dee3274-a85f-4957-8ca5-b870e7325e3a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:47.556996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4dee3274-a85f-4957-8ca5-b870e7325e3a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:47.558228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4dee3274-a85f-4957-8ca5-b870e7325e3a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:47.561290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4dee3274-a85f-4957-8ca5-b870e7325e3a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:48.086207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9484299e-1338-41c3-9e08-f4a1413c3413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:48.103071 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9484299e-1338-41c3-9e08-f4a1413c3413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.977048 Oct 24 10:37:48.133977 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1546/2994] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:47 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:48.151123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a2ca2c16-14fc-4181-bcf7-5f2b8460b78d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:48.153037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a2ca2c16-14fc-4181-bcf7-5f2b8460b78d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:48.161541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2ca2c16-14fc-4181-bcf7-5f2b8460b78d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:48.162969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2ca2c16-14fc-4181-bcf7-5f2b8460b78d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:48.163705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2ca2c16-14fc-4181-bcf7-5f2b8460b78d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:48.164774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2ca2c16-14fc-4181-bcf7-5f2b8460b78d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:48.165617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2ca2c16-14fc-4181-bcf7-5f2b8460b78d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:48.166986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2ca2c16-14fc-4181-bcf7-5f2b8460b78d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:48.455620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a2ca2c16-14fc-4181-bcf7-5f2b8460b78d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:48.468153 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a2ca2c16-14fc-4181-bcf7-5f2b8460b78d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1266 microversion: 2.1 time: 0.332935 Oct 24 10:37:48.473197 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1547/2995] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:48 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:48.509136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-33bf11f0-d487-4e21-908d-e0f2302a2d53 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:48.513519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-33bf11f0-d487-4e21-908d-e0f2302a2d53 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:48.531369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4dee3274-a85f-4957-8ca5-b870e7325e3a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:48.546610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33bf11f0-d487-4e21-908d-e0f2302a2d53 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:48.547611 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4dee3274-a85f-4957-8ca5-b870e7325e3a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1354 microversion: 2.1 time: 1.026163 Oct 24 10:37:48.549476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33bf11f0-d487-4e21-908d-e0f2302a2d53 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:48.549730 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1449/2996] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:47 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1354 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:48.563404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c4da0417-0070-4cb3-b4c4-a4b8e6f3d56c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:48.569287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c4da0417-0070-4cb3-b4c4-a4b8e6f3d56c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:48.571424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33bf11f0-d487-4e21-908d-e0f2302a2d53 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:48.575106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33bf11f0-d487-4e21-908d-e0f2302a2d53 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:48.577244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33bf11f0-d487-4e21-908d-e0f2302a2d53 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:48.577978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33bf11f0-d487-4e21-908d-e0f2302a2d53 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:48.591397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4da0417-0070-4cb3-b4c4-a4b8e6f3d56c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:48.592781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4da0417-0070-4cb3-b4c4-a4b8e6f3d56c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:48.598390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4da0417-0070-4cb3-b4c4-a4b8e6f3d56c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:48.599424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4da0417-0070-4cb3-b4c4-a4b8e6f3d56c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:48.600171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4da0417-0070-4cb3-b4c4-a4b8e6f3d56c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:48.600947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4da0417-0070-4cb3-b4c4-a4b8e6f3d56c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:49.706604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-33bf11f0-d487-4e21-908d-e0f2302a2d53 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71950ff4118494288b1088fd7c700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3656fcc947f4652a6eae2e31be21ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:49.719781 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-33bf11f0-d487-4e21-908d-e0f2302a2d53 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7" status: 200 len: 1475 microversion: 2.1 time: 1.243908 Oct 24 10:37:49.734674 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1548/2997] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:48 2022] GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 => generated 1475 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:49.737025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c4da0417-0070-4cb3-b4c4-a4b8e6f3d56c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:49.751998 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c4da0417-0070-4cb3-b4c4-a4b8e6f3d56c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 1.199843 Oct 24 10:37:49.755206 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1450/2998] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:48 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:49.767391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-39f7a8d9-eb63-432b-aa17-bf500d5acbb5 req-99b83f65-5a05-4fee-b70f-b66ece1007c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78eb5c2b-4d4b-43b1-86bd-4fe986f4461d", "name": "network-vif-plugged", "status": "completed", "tag": "e57ada83-946f-4aba-ae66-02d7b2b4a864"}, {"server_uuid": "78eb5c2b-4d4b-43b1-86bd-4fe986f4461d", "name": "network-vif-plugged", "status": "completed", "tag": "067afe80-c1e2-463c-894b-11a5109a94e8"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:49.770629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0ecc727f-1acd-49b4-9ffc-95ddd810200b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:49.778610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0ecc727f-1acd-49b4-9ffc-95ddd810200b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:49.795912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-39f7a8d9-eb63-432b-aa17-bf500d5acbb5 req-99b83f65-5a05-4fee-b70f-b66ece1007c4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:49.798825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-39f7a8d9-eb63-432b-aa17-bf500d5acbb5 req-99b83f65-5a05-4fee-b70f-b66ece1007c4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:49.801283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-39f7a8d9-eb63-432b-aa17-bf500d5acbb5 req-99b83f65-5a05-4fee-b70f-b66ece1007c4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:49.806664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ecc727f-1acd-49b4-9ffc-95ddd810200b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:49.807169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ecc727f-1acd-49b4-9ffc-95ddd810200b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:49.813502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ecc727f-1acd-49b4-9ffc-95ddd810200b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:49.814272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ecc727f-1acd-49b4-9ffc-95ddd810200b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:49.814749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ecc727f-1acd-49b4-9ffc-95ddd810200b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:49.815183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ecc727f-1acd-49b4-9ffc-95ddd810200b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:49.838541 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-39f7a8d9-eb63-432b-aa17-bf500d5acbb5 req-99b83f65-5a05-4fee-b70f-b66ece1007c4 service nova] Creating event network-vif-plugged:e57ada83-946f-4aba-ae66-02d7b2b4a864 for instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d on n-h2-858383-15 Oct 24 10:37:49.839342 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-39f7a8d9-eb63-432b-aa17-bf500d5acbb5 req-99b83f65-5a05-4fee-b70f-b66ece1007c4 service nova] Creating event network-vif-plugged:067afe80-c1e2-463c-894b-11a5109a94e8 for instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d on n-h2-858383-15 Oct 24 10:37:49.853135 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-39f7a8d9-eb63-432b-aa17-bf500d5acbb5 req-99b83f65-5a05-4fee-b70f-b66ece1007c4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.095005 Oct 24 10:37:49.856455 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1451/2999] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:49.878603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4f425530-7217-4ae6-ad30-abbf8ecef97d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:49.880194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4f425530-7217-4ae6-ad30-abbf8ecef97d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:49.910520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f425530-7217-4ae6-ad30-abbf8ecef97d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:49.912120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f425530-7217-4ae6-ad30-abbf8ecef97d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:49.912875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f425530-7217-4ae6-ad30-abbf8ecef97d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:49.915469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f425530-7217-4ae6-ad30-abbf8ecef97d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:49.931729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f425530-7217-4ae6-ad30-abbf8ecef97d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:49.933471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f425530-7217-4ae6-ad30-abbf8ecef97d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:50.243173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0ecc727f-1acd-49b4-9ffc-95ddd810200b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:50.261813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0ecc727f-1acd-49b4-9ffc-95ddd810200b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:50.264419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0ecc727f-1acd-49b4-9ffc-95ddd810200b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:50.273394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4f425530-7217-4ae6-ad30-abbf8ecef97d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9fe821ad1b43f2988dd30521c6c335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c125be93d647e1b2c0fdd4ae2efb14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:50.286169 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4f425530-7217-4ae6-ad30-abbf8ecef97d tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 200 len: 1429 microversion: 2.1 time: 0.426506 Oct 24 10:37:50.315875 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0ecc727f-1acd-49b4-9ffc-95ddd810200b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.575250 Oct 24 10:37:50.322500 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1452/3000] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:49 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 1429 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:50.326550 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1549/3001] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:49 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:50.356080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6724c77f-58c2-4634-a7b2-df540b8195cd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:50.359401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6724c77f-58c2-4634-a7b2-df540b8195cd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:50.362595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6c3458a1-05b2-4b07-bf58-738ec54fa2cd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:50.364330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6c3458a1-05b2-4b07-bf58-738ec54fa2cd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:50.379641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6724c77f-58c2-4634-a7b2-df540b8195cd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:50.382155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6724c77f-58c2-4634-a7b2-df540b8195cd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:50.384475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6724c77f-58c2-4634-a7b2-df540b8195cd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:50.388702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6724c77f-58c2-4634-a7b2-df540b8195cd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:50.394215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6724c77f-58c2-4634-a7b2-df540b8195cd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:50.395136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6724c77f-58c2-4634-a7b2-df540b8195cd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:50.408322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c3458a1-05b2-4b07-bf58-738ec54fa2cd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:50.409766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c3458a1-05b2-4b07-bf58-738ec54fa2cd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:50.410559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c3458a1-05b2-4b07-bf58-738ec54fa2cd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:50.411698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c3458a1-05b2-4b07-bf58-738ec54fa2cd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:50.413382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c3458a1-05b2-4b07-bf58-738ec54fa2cd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:50.414112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c3458a1-05b2-4b07-bf58-738ec54fa2cd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:51.013386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6724c77f-58c2-4634-a7b2-df540b8195cd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:51.028010 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6724c77f-58c2-4634-a7b2-df540b8195cd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1272 microversion: 2.1 time: 0.698593 Oct 24 10:37:51.036948 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1453/3002] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:50 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1272 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:51.043385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-224be5d0-d43f-4f27-88b8-02a0be55a183 req-8adadc04-1909-4d8f-aa1b-cb041bb8c5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3221498d-a495-448e-8adc-3a661c1a86a7", "name": "network-vif-deleted", "tag": "efe0dee8-9cb1-4db6-a07b-50240e5390f2"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:51.062404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-224be5d0-d43f-4f27-88b8-02a0be55a183 req-8adadc04-1909-4d8f-aa1b-cb041bb8c5f8 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:51.071043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-224be5d0-d43f-4f27-88b8-02a0be55a183 req-8adadc04-1909-4d8f-aa1b-cb041bb8c5f8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:51.076579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-224be5d0-d43f-4f27-88b8-02a0be55a183 req-8adadc04-1909-4d8f-aa1b-cb041bb8c5f8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:51.115150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6c3458a1-05b2-4b07-bf58-738ec54fa2cd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:51.169255 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6c3458a1-05b2-4b07-bf58-738ec54fa2cd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1354 microversion: 2.1 time: 0.837333 Oct 24 10:37:51.173246 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1550/3003] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:50 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1354 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:51.188568 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-224be5d0-d43f-4f27-88b8-02a0be55a183 req-8adadc04-1909-4d8f-aa1b-cb041bb8c5f8 service nova] Creating event network-vif-deleted:efe0dee8-9cb1-4db6-a07b-50240e5390f2 for instance 3221498d-a495-448e-8adc-3a661c1a86a7 on n-h1-858383-15 Oct 24 10:37:51.199954 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-224be5d0-d43f-4f27-88b8-02a0be55a183 req-8adadc04-1909-4d8f-aa1b-cb041bb8c5f8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161099 Oct 24 10:37:51.200551 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1454/3004] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:51.203438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b20d3832-1042-42ae-8158-dc2c1d5a4a7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:51.204033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b20d3832-1042-42ae-8158-dc2c1d5a4a7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:51.223580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b20d3832-1042-42ae-8158-dc2c1d5a4a7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:51.224086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b20d3832-1042-42ae-8158-dc2c1d5a4a7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:51.224530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b20d3832-1042-42ae-8158-dc2c1d5a4a7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:51.225315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b20d3832-1042-42ae-8158-dc2c1d5a4a7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:51.225779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b20d3832-1042-42ae-8158-dc2c1d5a4a7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:51.226375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b20d3832-1042-42ae-8158-dc2c1d5a4a7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:51.230383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a7f9dc75-4077-47d9-9ad2-135816227302 req-85353c0c-1ff5-4e2e-9b26-35857ed88c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e16c14-6d0e-49a5-9948-298c2e667999", "name": "network-vif-deleted", "tag": "bddb3b72-49df-48b0-b7ca-ad03dc04e320"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:51.290541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a7f9dc75-4077-47d9-9ad2-135816227302 req-85353c0c-1ff5-4e2e-9b26-35857ed88c3c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:51.295293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a7f9dc75-4077-47d9-9ad2-135816227302 req-85353c0c-1ff5-4e2e-9b26-35857ed88c3c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:51.296213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a7f9dc75-4077-47d9-9ad2-135816227302 req-85353c0c-1ff5-4e2e-9b26-35857ed88c3c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:51.347994 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a7f9dc75-4077-47d9-9ad2-135816227302 req-85353c0c-1ff5-4e2e-9b26-35857ed88c3c service nova] Creating event network-vif-deleted:bddb3b72-49df-48b0-b7ca-ad03dc04e320 for instance 42e16c14-6d0e-49a5-9948-298c2e667999 on n-h2-858383-15 Oct 24 10:37:51.371517 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a7f9dc75-4077-47d9-9ad2-135816227302 req-85353c0c-1ff5-4e2e-9b26-35857ed88c3c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156526 Oct 24 10:37:51.377653 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1455/3005] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:51.404185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-90314d23-3dca-4bf1-a0b2-881d15eefde3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:51.412300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-90314d23-3dca-4bf1-a0b2-881d15eefde3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] [instance: 3221498d-a495-448e-8adc-3a661c1a86a7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:51.444260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90314d23-3dca-4bf1-a0b2-881d15eefde3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:51.444763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90314d23-3dca-4bf1-a0b2-881d15eefde3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:51.445269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90314d23-3dca-4bf1-a0b2-881d15eefde3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:51.445983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90314d23-3dca-4bf1-a0b2-881d15eefde3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:51.446434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90314d23-3dca-4bf1-a0b2-881d15eefde3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:51.446858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90314d23-3dca-4bf1-a0b2-881d15eefde3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:51.499046 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-90314d23-3dca-4bf1-a0b2-881d15eefde3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] HTTP exception thrown: Instance 3221498d-a495-448e-8adc-3a661c1a86a7 could not be found. Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-90314d23-3dca-4bf1-a0b2-881d15eefde3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Request method failure captured: Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 HTTP/1.1 Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmqsP5CvsDc-5XiauS6sB8HrUshRrewWwrGKJRtGfx8TnxDb62lRJMw6XROkLglVgHQXuQxepsCTJ-c6nyVBFLe6LImVnrYmclwLYcmaIjucDltQryKEmJzrAcFul-qJKBx3AwKNY6BPMpVxN5vaAVvQz6mgoP8b-SsiAWiW9cTUNMc Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: a3656fcc947f4652a6eae2e31be21ada Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-LiveMigrationNegativeTest-187572556 Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a3656fcc947f4652a6eae2e31be21ada"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a3656fcc947f4652a6eae2e31be21ada"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a3656fcc947f4652a6eae2e31be21ada"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a3656fcc947f4652a6eae2e31be21ada", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-LiveMigrationNegativeTest-187572556 Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: a3656fcc947f4652a6eae2e31be21ada Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-187572556 Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-LiveMigrationNegativeTest-187572556-project Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: f71950ff4118494288b1088fd7c700cd Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-LiveMigrationNegativeTest-187572556-project Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 3221498d-a495-448e-8adc-3a661c1a86a7 could not be found. Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '3221498d-a495-448e-8adc-3a661c1a86a7'} Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3221498d-a495-448e-8adc-3a661c1a86a7 could not be found. Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3221498d-a495-448e-8adc-3a661c1a86a7 could not be found. Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:51.510111 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:37:51.515584 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:51.515584 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:51.515584 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:51.515584 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:37:51.515584 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:37:51.515584 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3221498d-a495-448e-8adc-3a661c1a86a7 could not be found. Oct 24 10:37:51.515584 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:37:51.521243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-90314d23-3dca-4bf1-a0b2-881d15eefde3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] Returning 404 to user: Instance 3221498d-a495-448e-8adc-3a661c1a86a7 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:37:51.525043 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-90314d23-3dca-4bf1-a0b2-881d15eefde3 tempest-LiveMigrationNegativeTest-187572556 tempest-LiveMigrationNegativeTest-187572556-project] 10.222.0.50 "GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7" status: 404 len: 111 microversion: 2.1 time: 0.145853 Oct 24 10:37:51.531988 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1456/3006] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:51 2022] GET /compute/v2.1/servers/3221498d-a495-448e-8adc-3a661c1a86a7 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:37:51.555047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cbaac303-cd8b-48ab-abe2-3e8be96ae9ba tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:51.556621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cbaac303-cd8b-48ab-abe2-3e8be96ae9ba tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] [instance: 42e16c14-6d0e-49a5-9948-298c2e667999] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:51.578881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbaac303-cd8b-48ab-abe2-3e8be96ae9ba tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:51.595407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbaac303-cd8b-48ab-abe2-3e8be96ae9ba tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:51.599265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbaac303-cd8b-48ab-abe2-3e8be96ae9ba tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:51.600327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbaac303-cd8b-48ab-abe2-3e8be96ae9ba tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:51.600809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbaac303-cd8b-48ab-abe2-3e8be96ae9ba tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:51.604250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbaac303-cd8b-48ab-abe2-3e8be96ae9ba tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:51.652386 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-cbaac303-cd8b-48ab-abe2-3e8be96ae9ba tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] HTTP exception thrown: Instance 42e16c14-6d0e-49a5-9948-298c2e667999 could not be found. Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cbaac303-cd8b-48ab-abe2-3e8be96ae9ba tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Request method failure captured: Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 HTTP/1.1 Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmqUdKhAQppvt-50F_-rVZdLGuSL_jHdWKd3XzK_GHAWsZlymvlv_uOlROl61F_Z4Spvk60AvFdizQpFomiWcyMXv9yfn-Nko_FNUXMKndp4X39esqqYJ1eh-GkUQESTQMr1KA2aXTS_PZz2LsZIqWosJObJipOJNhlsflpXH4tFaPU Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 96c125be93d647e1b2c0fdd4ae2efb14 Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesOneServerTestJSON-2062039880 Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96c125be93d647e1b2c0fdd4ae2efb14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96c125be93d647e1b2c0fdd4ae2efb14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/96c125be93d647e1b2c0fdd4ae2efb14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_96c125be93d647e1b2c0fdd4ae2efb14", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesOneServerTestJSON-2062039880 Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 96c125be93d647e1b2c0fdd4ae2efb14 Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2062039880 Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesOneServerTestJSON-2062039880-project Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ed9fe821ad1b43f2988dd30521c6c335 Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesOneServerTestJSON-2062039880-project Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 42e16c14-6d0e-49a5-9948-298c2e667999 could not be found. Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '42e16c14-6d0e-49a5-9948-298c2e667999'} Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42e16c14-6d0e-49a5-9948-298c2e667999 could not be found. Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42e16c14-6d0e-49a5-9948-298c2e667999 could not be found. Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:51.656422 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:37:51.660255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:51.660255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:51.660255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:51.660255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:37:51.660255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:37:51.660255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42e16c14-6d0e-49a5-9948-298c2e667999 could not be found. Oct 24 10:37:51.660255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:37:51.660255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cbaac303-cd8b-48ab-abe2-3e8be96ae9ba tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] Returning 404 to user: Instance 42e16c14-6d0e-49a5-9948-298c2e667999 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:37:51.660255 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cbaac303-cd8b-48ab-abe2-3e8be96ae9ba tempest-ImagesOneServerTestJSON-2062039880 tempest-ImagesOneServerTestJSON-2062039880-project] 10.222.0.50 "GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999" status: 404 len: 111 microversion: 2.1 time: 0.125939 Oct 24 10:37:51.664328 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1457/3007] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:51 2022] GET /compute/v2.1/servers/42e16c14-6d0e-49a5-9948-298c2e667999 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:37:51.679550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a04a354e-66b8-4562-8f26-488bfe4dec84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:51.681596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a04a354e-66b8-4562-8f26-488bfe4dec84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:51.751343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a04a354e-66b8-4562-8f26-488bfe4dec84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:51.754623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a04a354e-66b8-4562-8f26-488bfe4dec84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:51.757554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a04a354e-66b8-4562-8f26-488bfe4dec84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:51.760154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a04a354e-66b8-4562-8f26-488bfe4dec84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:51.767200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a04a354e-66b8-4562-8f26-488bfe4dec84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:51.768117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a04a354e-66b8-4562-8f26-488bfe4dec84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:51.796463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:51.931658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b20d3832-1042-42ae-8158-dc2c1d5a4a7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:51.958365 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b20d3832-1042-42ae-8158-dc2c1d5a4a7a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.774142 Oct 24 10:37:51.965347 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1551/3008] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:51 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:51.976726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-1c5087b2-36d3-4365-a2ac-64bfd7ac741d req-94cd7c82-932f-4a5f-84cf-ce81e9b77b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78eb5c2b-4d4b-43b1-86bd-4fe986f4461d", "name": "network-vif-plugged", "status": "completed", "tag": "fd833a93-632c-47be-8b1d-8e3c9376cdc4"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:52.018793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1c5087b2-36d3-4365-a2ac-64bfd7ac741d req-94cd7c82-932f-4a5f-84cf-ce81e9b77b09 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:52.024814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1c5087b2-36d3-4365-a2ac-64bfd7ac741d req-94cd7c82-932f-4a5f-84cf-ce81e9b77b09 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:52.027676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1c5087b2-36d3-4365-a2ac-64bfd7ac741d req-94cd7c82-932f-4a5f-84cf-ce81e9b77b09 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:52.062933 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-1c5087b2-36d3-4365-a2ac-64bfd7ac741d req-94cd7c82-932f-4a5f-84cf-ce81e9b77b09 service nova] Creating event network-vif-plugged:fd833a93-632c-47be-8b1d-8e3c9376cdc4 for instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d on n-h2-858383-15 Oct 24 10:37:52.090811 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-1c5087b2-36d3-4365-a2ac-64bfd7ac741d req-94cd7c82-932f-4a5f-84cf-ce81e9b77b09 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123018 Oct 24 10:37:52.091842 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1552/3009] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:52.103353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9f331ddd-9b22-4376-a95a-0c5c630d0e08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:52.111181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9f331ddd-9b22-4376-a95a-0c5c630d0e08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:52.146816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f331ddd-9b22-4376-a95a-0c5c630d0e08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:52.147411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f331ddd-9b22-4376-a95a-0c5c630d0e08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:52.147642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f331ddd-9b22-4376-a95a-0c5c630d0e08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:52.153782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f331ddd-9b22-4376-a95a-0c5c630d0e08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:52.167986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f331ddd-9b22-4376-a95a-0c5c630d0e08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:52.168761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f331ddd-9b22-4376-a95a-0c5c630d0e08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:52.263737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a04a354e-66b8-4562-8f26-488bfe4dec84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:52.278121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a04a354e-66b8-4562-8f26-488bfe4dec84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:52.283463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a04a354e-66b8-4562-8f26-488bfe4dec84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:52.299370 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a04a354e-66b8-4562-8f26-488bfe4dec84 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.633084 Oct 24 10:37:52.301593 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1458/3010] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:51 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:52.313712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-08b3d306-1b87-4e8b-96d4-60c60e958633 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:52.314570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-08b3d306-1b87-4e8b-96d4-60c60e958633 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:52.326870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08b3d306-1b87-4e8b-96d4-60c60e958633 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:52.328784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08b3d306-1b87-4e8b-96d4-60c60e958633 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:52.330044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08b3d306-1b87-4e8b-96d4-60c60e958633 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:52.331012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08b3d306-1b87-4e8b-96d4-60c60e958633 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:52.332867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08b3d306-1b87-4e8b-96d4-60c60e958633 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:52.334306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08b3d306-1b87-4e8b-96d4-60c60e958633 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:53.164221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-08b3d306-1b87-4e8b-96d4-60c60e958633 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:53.187051 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-08b3d306-1b87-4e8b-96d4-60c60e958633 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1314 microversion: 2.1 time: 0.882029 Oct 24 10:37:53.201862 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1459/3011] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:52 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1314 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:53.218727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f44ff381-8b32-420e-9075-524edb00515e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:53.219610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f44ff381-8b32-420e-9075-524edb00515e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:53.234252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f44ff381-8b32-420e-9075-524edb00515e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:53.237419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f44ff381-8b32-420e-9075-524edb00515e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:53.238363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f44ff381-8b32-420e-9075-524edb00515e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:53.250340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f44ff381-8b32-420e-9075-524edb00515e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:53.251643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f44ff381-8b32-420e-9075-524edb00515e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:53.252688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f44ff381-8b32-420e-9075-524edb00515e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:53.633885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9f331ddd-9b22-4376-a95a-0c5c630d0e08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:53.649463 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9f331ddd-9b22-4376-a95a-0c5c630d0e08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 1.555009 Oct 24 10:37:53.653910 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1553/3012] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:52 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:53.659743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a18c6e7f-d424-4984-8c8d-272663efca1e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:53.660559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a18c6e7f-d424-4984-8c8d-272663efca1e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:53.678252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a18c6e7f-d424-4984-8c8d-272663efca1e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:53.679574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a18c6e7f-d424-4984-8c8d-272663efca1e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:53.685992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a18c6e7f-d424-4984-8c8d-272663efca1e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:53.690954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a18c6e7f-d424-4984-8c8d-272663efca1e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:53.692510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a18c6e7f-d424-4984-8c8d-272663efca1e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:53.694533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a18c6e7f-d424-4984-8c8d-272663efca1e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:53.813715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f44ff381-8b32-420e-9075-524edb00515e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:53.826594 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f44ff381-8b32-420e-9075-524edb00515e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1354 microversion: 2.1 time: 0.616998 Oct 24 10:37:53.829688 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1460/3013] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:53 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1354 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:53.857268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-60a7632f-95da-4e49-9b2a-b0ee14c0872d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:53.858123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-60a7632f-95da-4e49-9b2a-b0ee14c0872d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:53.885293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60a7632f-95da-4e49-9b2a-b0ee14c0872d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:53.887436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60a7632f-95da-4e49-9b2a-b0ee14c0872d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:53.889706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60a7632f-95da-4e49-9b2a-b0ee14c0872d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:53.891125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60a7632f-95da-4e49-9b2a-b0ee14c0872d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:53.892978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60a7632f-95da-4e49-9b2a-b0ee14c0872d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:53.893610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60a7632f-95da-4e49-9b2a-b0ee14c0872d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:53.948700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a18c6e7f-d424-4984-8c8d-272663efca1e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:53.970870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a18c6e7f-d424-4984-8c8d-272663efca1e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:53.975626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a18c6e7f-d424-4984-8c8d-272663efca1e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:53.984256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-60a7632f-95da-4e49-9b2a-b0ee14c0872d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Locking {{(pid=120425) lock /opt/stack/nova/nova/compute/api.py:4847}} Oct 24 10:37:54.006961 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a18c6e7f-d424-4984-8c8d-272663efca1e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.347166 Oct 24 10:37:54.013617 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1554/3014] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:53 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:54.174933 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-60a7632f-95da-4e49-9b2a-b0ee14c0872d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 202 len: 0 microversion: 2.1 time: 0.335465 Oct 24 10:37:54.175683 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1461/3015] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:37:53 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:37:54.186094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ffeec547-bccd-4b23-bbc6-1e75c87ef958 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:54.187554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ffeec547-bccd-4b23-bbc6-1e75c87ef958 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:54.214889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-52720641-d137-4882-8028-82af9289ef53 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:54.215594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffeec547-bccd-4b23-bbc6-1e75c87ef958 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:54.221685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffeec547-bccd-4b23-bbc6-1e75c87ef958 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:54.222412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffeec547-bccd-4b23-bbc6-1e75c87ef958 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:54.223403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffeec547-bccd-4b23-bbc6-1e75c87ef958 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:54.224456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-52720641-d137-4882-8028-82af9289ef53 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:54.225069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffeec547-bccd-4b23-bbc6-1e75c87ef958 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:54.226616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffeec547-bccd-4b23-bbc6-1e75c87ef958 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:54.244199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52720641-d137-4882-8028-82af9289ef53 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:54.244751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52720641-d137-4882-8028-82af9289ef53 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:54.253184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52720641-d137-4882-8028-82af9289ef53 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:54.254861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52720641-d137-4882-8028-82af9289ef53 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:54.255348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52720641-d137-4882-8028-82af9289ef53 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:54.255773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52720641-d137-4882-8028-82af9289ef53 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:55.612640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ffeec547-bccd-4b23-bbc6-1e75c87ef958 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:55.629513 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ffeec547-bccd-4b23-bbc6-1e75c87ef958 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 1.446893 Oct 24 10:37:55.630346 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1555/3016] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:54 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:55.646473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-52720641-d137-4882-8028-82af9289ef53 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:55.658251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-465d8e86-2862-47da-aa34-58aebd1a4931 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:55.660930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-465d8e86-2862-47da-aa34-58aebd1a4931 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:55.666126 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-52720641-d137-4882-8028-82af9289ef53 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1314 microversion: 2.1 time: 1.455283 Oct 24 10:37:55.668382 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1462/3017] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:54 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1314 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:55.677759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-08290b60-af2b-4a60-8bc6-2b8fef52c513 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:55.678678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-08290b60-af2b-4a60-8bc6-2b8fef52c513 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:55.682924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-465d8e86-2862-47da-aa34-58aebd1a4931 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:55.686437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-465d8e86-2862-47da-aa34-58aebd1a4931 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:55.688749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-465d8e86-2862-47da-aa34-58aebd1a4931 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:55.691836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-465d8e86-2862-47da-aa34-58aebd1a4931 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:55.693015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-465d8e86-2862-47da-aa34-58aebd1a4931 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:55.693596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-465d8e86-2862-47da-aa34-58aebd1a4931 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:55.696852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08290b60-af2b-4a60-8bc6-2b8fef52c513 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:55.697872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08290b60-af2b-4a60-8bc6-2b8fef52c513 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:55.699879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08290b60-af2b-4a60-8bc6-2b8fef52c513 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:55.701833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08290b60-af2b-4a60-8bc6-2b8fef52c513 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:55.702478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08290b60-af2b-4a60-8bc6-2b8fef52c513 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:55.704223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08290b60-af2b-4a60-8bc6-2b8fef52c513 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:55.893969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-08290b60-af2b-4a60-8bc6-2b8fef52c513 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:55.903327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-08290b60-af2b-4a60-8bc6-2b8fef52c513 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:55.907821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-08290b60-af2b-4a60-8bc6-2b8fef52c513 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:55.919809 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-08290b60-af2b-4a60-8bc6-2b8fef52c513 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.249976 Oct 24 10:37:55.926999 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1463/3018] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:55 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:55.932023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-4d28d684-adf7-4544-8a22-bcc424051598 req-d769f97b-cc61-4f36-bf7b-6ca5ce4420a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d4c883-f34d-4326-8505-2d66bd047dc8", "tag": "0c4d075a-267d-4bd1-8a69-d9825c34d8a2"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:55.961945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4d28d684-adf7-4544-8a22-bcc424051598 req-d769f97b-cc61-4f36-bf7b-6ca5ce4420a2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:55.962651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4d28d684-adf7-4544-8a22-bcc424051598 req-d769f97b-cc61-4f36-bf7b-6ca5ce4420a2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:55.963258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4d28d684-adf7-4544-8a22-bcc424051598 req-d769f97b-cc61-4f36-bf7b-6ca5ce4420a2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:55.976397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:56.000732 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-4d28d684-adf7-4544-8a22-bcc424051598 req-d769f97b-cc61-4f36-bf7b-6ca5ce4420a2 service nova] Creating event network-changed:0c4d075a-267d-4bd1-8a69-d9825c34d8a2 for instance 18d4c883-f34d-4326-8505-2d66bd047dc8 on n-h1-858383-15 Oct 24 10:37:56.009391 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-4d28d684-adf7-4544-8a22-bcc424051598 req-d769f97b-cc61-4f36-bf7b-6ca5ce4420a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080755 Oct 24 10:37:56.019011 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1464/3019] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:56.078900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-465d8e86-2862-47da-aa34-58aebd1a4931 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:56.091734 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-465d8e86-2862-47da-aa34-58aebd1a4931 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1802 microversion: 2.1 time: 0.459437 Oct 24 10:37:56.109365 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1556/3020] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:55 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1802 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:56.146526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ebf0a455-1911-4084-aff7-01dbe08ee3a0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:56.171683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebf0a455-1911-4084-aff7-01dbe08ee3a0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:56.183224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebf0a455-1911-4084-aff7-01dbe08ee3a0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:56.184131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebf0a455-1911-4084-aff7-01dbe08ee3a0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:56.513842 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-ebf0a455-1911-4084-aff7-01dbe08ee3a0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] HTTP exception thrown: Instance 513ca608-24c9-45f9-8fb9-e231d92c7262 is locked Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ebf0a455-1911-4084-aff7-01dbe08ee3a0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Request method failure captured: Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action HTTP/1.1 Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 15 Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmmuJrxb1XlWB_avRxRliGRWB1RGcH6tFur30cSKqOzu2vxHhNtoBzNqu_iNWZYArPhjvCegW23YNaUUHwXw7ggKhvTGZpm4y2TCmcCle2W-rg0Uf0xse67nTky9VDrkBwyVUxKaUO1HKMfXPydd2Jmdynf6tgSS0X6qgnwmk8AaC6o Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4878c0e43a9d4db8ba5c6590b43624f0 Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerActionsTestJSON-1882077751 Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4878c0e43a9d4db8ba5c6590b43624f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4878c0e43a9d4db8ba5c6590b43624f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4878c0e43a9d4db8ba5c6590b43624f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4878c0e43a9d4db8ba5c6590b43624f0", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerActionsTestJSON-1882077751 Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4878c0e43a9d4db8ba5c6590b43624f0 Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerActionsTestJSON-1882077751 Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerActionsTestJSON-1882077751-project Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 45500f699a6f463b8755f0417b24151c Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerActionsTestJSON-1882077751-project Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: {"os-stop": {}} Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 513ca608-24c9-45f9-8fb9-e231d92c7262 is locked Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '513ca608-24c9-45f9-8fb9-e231d92c7262', 'body': {'os-stop': {}}} Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 513ca608-24c9-45f9-8fb9-e231d92c7262 is locked Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 513ca608-24c9-45f9-8fb9-e231d92c7262 is locked Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 513ca608-24c9-45f9-8fb9-e231d92c7262 is locked Oct 24 10:37:56.518024 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:37:56.526672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ebf0a455-1911-4084-aff7-01dbe08ee3a0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Returning 409 to user: Instance 513ca608-24c9-45f9-8fb9-e231d92c7262 is locked {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:37:56.528822 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ebf0a455-1911-4084-aff7-01dbe08ee3a0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 409 len: 107 microversion: 2.1 time: 0.397154 Oct 24 10:37:56.535296 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1557/3021] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:37:56 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 107 bytes in 404 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:37:56.552498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7b3412b9-fe66-4d50-b493-95ef725477c4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:56.553384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7b3412b9-fe66-4d50-b493-95ef725477c4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:56.575527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b3412b9-fe66-4d50-b493-95ef725477c4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:56.576557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b3412b9-fe66-4d50-b493-95ef725477c4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:56.578604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b3412b9-fe66-4d50-b493-95ef725477c4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:56.581280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b3412b9-fe66-4d50-b493-95ef725477c4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:56.584187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b3412b9-fe66-4d50-b493-95ef725477c4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:56.585108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b3412b9-fe66-4d50-b493-95ef725477c4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:56.708740 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7b3412b9-fe66-4d50-b493-95ef725477c4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d/ips" status: 200 len: 216 microversion: 2.1 time: 0.164756 Oct 24 10:37:56.724422 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1558/3022] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Oct 24 10:37:56 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d/ips => generated 216 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:56.737452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7c3eef39-bdda-4756-b3c0-d7526ce13f2b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:56.752492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7c3eef39-bdda-4756-b3c0-d7526ce13f2b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:56.779274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c3eef39-bdda-4756-b3c0-d7526ce13f2b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:56.786002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c3eef39-bdda-4756-b3c0-d7526ce13f2b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:56.789947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c3eef39-bdda-4756-b3c0-d7526ce13f2b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:56.791277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c3eef39-bdda-4756-b3c0-d7526ce13f2b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:56.793408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c3eef39-bdda-4756-b3c0-d7526ce13f2b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:56.796705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c3eef39-bdda-4756-b3c0-d7526ce13f2b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:56.819857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d6b21103-79f1-4c83-9a8d-494850e8617b tempest-ListImagesTestJSON-1689740378 tempest-ListImagesTestJSON-1689740378-project] Calling method '.version_select at 0x7f04d0a02670>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:56.852491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:56.893751 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d6b21103-79f1-4c83-9a8d-494850e8617b tempest-ListImagesTestJSON-1689740378 tempest-ListImagesTestJSON-1689740378-project] 10.222.0.50 "GET /compute/v2.1/images/a9689e0d-06ef-475e-9c75-9e39befd50b7" status: 200 len: 784 microversion: 2.1 time: 0.873040 Oct 24 10:37:56.895034 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1465/3023] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:37:56 2022] GET /compute/v2.1/images/a9689e0d-06ef-475e-9c75-9e39befd50b7 => generated 784 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:56.912081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ac091208-bb89-46fb-8628-6c3088ee4b24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:56.919753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ac091208-bb89-46fb-8628-6c3088ee4b24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:56.937132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac091208-bb89-46fb-8628-6c3088ee4b24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:56.938069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac091208-bb89-46fb-8628-6c3088ee4b24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:56.938799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac091208-bb89-46fb-8628-6c3088ee4b24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:56.939862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac091208-bb89-46fb-8628-6c3088ee4b24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:56.940568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac091208-bb89-46fb-8628-6c3088ee4b24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:56.941677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac091208-bb89-46fb-8628-6c3088ee4b24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:56.946083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7c3eef39-bdda-4756-b3c0-d7526ce13f2b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Unlocking {{(pid=120426) unlock /opt/stack/nova/nova/compute/api.py:4876}} Oct 24 10:37:57.108402 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7c3eef39-bdda-4756-b3c0-d7526ce13f2b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 202 len: 0 microversion: 2.1 time: 0.382424 Oct 24 10:37:57.109582 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1559/3024] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:37:56 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:37:57.116704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-435e5e96-2c4e-40d3-8db2-4372a249706b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:57.117724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-435e5e96-2c4e-40d3-8db2-4372a249706b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:57.125170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-435e5e96-2c4e-40d3-8db2-4372a249706b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:57.126077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-435e5e96-2c4e-40d3-8db2-4372a249706b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:57.126787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-435e5e96-2c4e-40d3-8db2-4372a249706b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:57.127783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-435e5e96-2c4e-40d3-8db2-4372a249706b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:57.128484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-435e5e96-2c4e-40d3-8db2-4372a249706b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:57.129154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-435e5e96-2c4e-40d3-8db2-4372a249706b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:57.184490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-435e5e96-2c4e-40d3-8db2-4372a249706b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:37:57.238991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:57.339681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ac091208-bb89-46fb-8628-6c3088ee4b24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:57.351811 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ac091208-bb89-46fb-8628-6c3088ee4b24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1314 microversion: 2.1 time: 0.452435 Oct 24 10:37:57.353408 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1466/3025] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:56 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:57.364033 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-435e5e96-2c4e-40d3-8db2-4372a249706b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "DELETE /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 204 len: 0 microversion: 2.1 time: 0.252531 Oct 24 10:37:57.366029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f33350e9-37f5-42b7-8ed5-0e41a719a9b9 tempest-ListImagesTestJSON-1689740378 tempest-ListImagesTestJSON-1689740378-project] Calling method '.version_select at 0x7f04d0216790>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:57.368214 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1560/3026] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:37:57 2022] DELETE /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:37:57.382992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c2464f85-aa24-455d-8b39-1ddf868fe6b7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:57.383928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c2464f85-aa24-455d-8b39-1ddf868fe6b7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:57.405745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2464f85-aa24-455d-8b39-1ddf868fe6b7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:57.406249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2464f85-aa24-455d-8b39-1ddf868fe6b7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:57.409626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2464f85-aa24-455d-8b39-1ddf868fe6b7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:57.410389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2464f85-aa24-455d-8b39-1ddf868fe6b7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:57.410870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2464f85-aa24-455d-8b39-1ddf868fe6b7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:57.411689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2464f85-aa24-455d-8b39-1ddf868fe6b7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:57.519403 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f33350e9-37f5-42b7-8ed5-0e41a719a9b9 tempest-ListImagesTestJSON-1689740378 tempest-ListImagesTestJSON-1689740378-project] 10.222.0.50 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.159963 Oct 24 10:37:57.519985 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1467/3027] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Oct 24 10:37:57 2022] GET /compute/v2.1/images => generated 445 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:57.530912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-62ca3a36-13a7-4ca8-ac6d-6be518b684e6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:37:57.549255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62ca3a36-13a7-4ca8-ac6d-6be518b684e6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:57.549754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62ca3a36-13a7-4ca8-ac6d-6be518b684e6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:57.552953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62ca3a36-13a7-4ca8-ac6d-6be518b684e6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:57.600224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-62ca3a36-13a7-4ca8-ac6d-6be518b684e6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Going to try to stop instance {{(pid=120425) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 10:37:57.640856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c2464f85-aa24-455d-8b39-1ddf868fe6b7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:57.649638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c2464f85-aa24-455d-8b39-1ddf868fe6b7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:57.658117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c2464f85-aa24-455d-8b39-1ddf868fe6b7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:57.671970 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c2464f85-aa24-455d-8b39-1ddf868fe6b7 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.300079 Oct 24 10:37:57.673051 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1561/3028] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:57 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:37:57.679722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-216c4b56-c389-4c40-b68b-13dfa133537e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:57.686761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-216c4b56-c389-4c40-b68b-13dfa133537e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:57.702802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-216c4b56-c389-4c40-b68b-13dfa133537e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:57.703647 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-62ca3a36-13a7-4ca8-ac6d-6be518b684e6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 202 len: 0 microversion: 2.1 time: 0.181618 Oct 24 10:37:57.705599 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1468/3029] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:37:57 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:37:57.705888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-216c4b56-c389-4c40-b68b-13dfa133537e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:57.706055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-216c4b56-c389-4c40-b68b-13dfa133537e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:57.707093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-216c4b56-c389-4c40-b68b-13dfa133537e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:57.709133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-216c4b56-c389-4c40-b68b-13dfa133537e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:57.710205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-216c4b56-c389-4c40-b68b-13dfa133537e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:57.717653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-327e5bba-20c8-4210-9560-4df222280426 tempest-ListImagesTestJSON-1689740378 tempest-ListImagesTestJSON-1689740378-project] Calling method '.version_select at 0x7f04d0208040>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:57.825211 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-327e5bba-20c8-4210-9560-4df222280426 tempest-ListImagesTestJSON-1689740378 tempest-ListImagesTestJSON-1689740378-project] 10.222.0.50 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.117734 Oct 24 10:37:57.826691 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1469/3030] 10.222.0.50 () {58 vars in 1143 bytes} [Mon Oct 24 10:37:57 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:37:57.832723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80184ff6-d132-4e3d-9ee2-12e0cbb575ae tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:57.833735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-80184ff6-d132-4e3d-9ee2-12e0cbb575ae tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:57.845799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80184ff6-d132-4e3d-9ee2-12e0cbb575ae tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:57.846548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80184ff6-d132-4e3d-9ee2-12e0cbb575ae tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:57.847229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80184ff6-d132-4e3d-9ee2-12e0cbb575ae tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:57.851195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80184ff6-d132-4e3d-9ee2-12e0cbb575ae tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:57.852162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80184ff6-d132-4e3d-9ee2-12e0cbb575ae tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:57.853000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80184ff6-d132-4e3d-9ee2-12e0cbb575ae tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:58.137302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-216c4b56-c389-4c40-b68b-13dfa133537e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:58.146282 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-216c4b56-c389-4c40-b68b-13dfa133537e tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1808 microversion: 2.1 time: 0.470174 Oct 24 10:37:58.147682 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1562/3031] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:57 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1808 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:58.375815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f513f1a6-3f90-4c16-a0c1-9ca05b8a9aa4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:58.380371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f513f1a6-3f90-4c16-a0c1-9ca05b8a9aa4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:58.409234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f513f1a6-3f90-4c16-a0c1-9ca05b8a9aa4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:58.410164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f513f1a6-3f90-4c16-a0c1-9ca05b8a9aa4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:58.411446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f513f1a6-3f90-4c16-a0c1-9ca05b8a9aa4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:58.412323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f513f1a6-3f90-4c16-a0c1-9ca05b8a9aa4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:58.412970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f513f1a6-3f90-4c16-a0c1-9ca05b8a9aa4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:58.413603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f513f1a6-3f90-4c16-a0c1-9ca05b8a9aa4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:58.601509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-80184ff6-d132-4e3d-9ee2-12e0cbb575ae tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:58.614534 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-80184ff6-d132-4e3d-9ee2-12e0cbb575ae tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1681 microversion: 2.1 time: 0.785996 Oct 24 10:37:58.617609 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1470/3032] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:57 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1681 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:58.704081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fd1c6cba-efef-4b87-a479-672b828543c4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:58.704681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f513f1a6-3f90-4c16-a0c1-9ca05b8a9aa4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:58.704856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fd1c6cba-efef-4b87-a479-672b828543c4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:58.715722 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f513f1a6-3f90-4c16-a0c1-9ca05b8a9aa4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1314 microversion: 2.1 time: 0.343867 Oct 24 10:37:58.719075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd1c6cba-efef-4b87-a479-672b828543c4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:58.719618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd1c6cba-efef-4b87-a479-672b828543c4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:58.720075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd1c6cba-efef-4b87-a479-672b828543c4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:58.720827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd1c6cba-efef-4b87-a479-672b828543c4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:58.731709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd1c6cba-efef-4b87-a479-672b828543c4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:58.732274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd1c6cba-efef-4b87-a479-672b828543c4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:58.733649 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1563/3033] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:58 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:37:58.882851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fd1c6cba-efef-4b87-a479-672b828543c4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:58.903418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fd1c6cba-efef-4b87-a479-672b828543c4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:58.905148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fd1c6cba-efef-4b87-a479-672b828543c4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:58.917319 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fd1c6cba-efef-4b87-a479-672b828543c4 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.216531 Oct 24 10:37:58.919457 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1471/3034] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:58 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:37:59.178755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5f422fba-7c2f-4cbe-971a-a47f0e0b18bb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:59.179424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5f422fba-7c2f-4cbe-971a-a47f0e0b18bb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:59.204897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f422fba-7c2f-4cbe-971a-a47f0e0b18bb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:59.204897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f422fba-7c2f-4cbe-971a-a47f0e0b18bb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:59.204897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f422fba-7c2f-4cbe-971a-a47f0e0b18bb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:59.204897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f422fba-7c2f-4cbe-971a-a47f0e0b18bb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:59.204897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f422fba-7c2f-4cbe-971a-a47f0e0b18bb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:59.204897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f422fba-7c2f-4cbe-971a-a47f0e0b18bb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:59.482838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5f422fba-7c2f-4cbe-971a-a47f0e0b18bb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:59.497327 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5f422fba-7c2f-4cbe-971a-a47f0e0b18bb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1808 microversion: 2.1 time: 0.324478 Oct 24 10:37:59.498223 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1564/3035] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:59 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1808 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:59.642527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9eb2da54-6439-4c07-84f5-7d52a75bb1f9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:59.643327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9eb2da54-6439-4c07-84f5-7d52a75bb1f9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:59.656787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eb2da54-6439-4c07-84f5-7d52a75bb1f9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:59.658645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eb2da54-6439-4c07-84f5-7d52a75bb1f9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:59.659224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eb2da54-6439-4c07-84f5-7d52a75bb1f9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:59.661660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eb2da54-6439-4c07-84f5-7d52a75bb1f9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:59.662342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eb2da54-6439-4c07-84f5-7d52a75bb1f9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:59.665616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eb2da54-6439-4c07-84f5-7d52a75bb1f9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:59.739719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-38a854be-3df1-4736-9630-45c18cb971e8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:59.741319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-38a854be-3df1-4736-9630-45c18cb971e8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:59.754547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38a854be-3df1-4736-9630-45c18cb971e8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:59.756186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38a854be-3df1-4736-9630-45c18cb971e8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:59.758479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38a854be-3df1-4736-9630-45c18cb971e8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:59.760209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38a854be-3df1-4736-9630-45c18cb971e8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:59.760999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38a854be-3df1-4736-9630-45c18cb971e8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:59.762503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38a854be-3df1-4736-9630-45c18cb971e8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:59.918975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9eb2da54-6439-4c07-84f5-7d52a75bb1f9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:37:59.936431 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9eb2da54-6439-4c07-84f5-7d52a75bb1f9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1681 microversion: 2.1 time: 0.296521 Oct 24 10:37:59.937991 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1472/3036] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:59 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1681 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:37:59.951166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7b518797-e91a-47e5-826c-03adbaf972d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:37:59.952300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7b518797-e91a-47e5-826c-03adbaf972d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:37:59.967747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:37:59.975104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b518797-e91a-47e5-826c-03adbaf972d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:59.976185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b518797-e91a-47e5-826c-03adbaf972d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:59.979726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b518797-e91a-47e5-826c-03adbaf972d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:37:59.980877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b518797-e91a-47e5-826c-03adbaf972d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:37:59.982859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b518797-e91a-47e5-826c-03adbaf972d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:37:59.984197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b518797-e91a-47e5-826c-03adbaf972d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:00.211844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7b518797-e91a-47e5-826c-03adbaf972d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:00.226233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7b518797-e91a-47e5-826c-03adbaf972d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:00.231198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7b518797-e91a-47e5-826c-03adbaf972d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:00.248244 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7b518797-e91a-47e5-826c-03adbaf972d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.302575 Oct 24 10:38:00.262211 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1473/3037] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:37:59 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:00.492264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-38a854be-3df1-4736-9630-45c18cb971e8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:00.516570 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-38a854be-3df1-4736-9630-45c18cb971e8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1314 microversion: 2.1 time: 0.780695 Oct 24 10:38:00.532258 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1565/3038] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:37:59 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1314 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:38:00.540347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1ddee2d9-f3d8-45a0-89d7-42b83009632a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:00.541397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1ddee2d9-f3d8-45a0-89d7-42b83009632a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:00.555277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ddee2d9-f3d8-45a0-89d7-42b83009632a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:00.556734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ddee2d9-f3d8-45a0-89d7-42b83009632a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:00.559196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ddee2d9-f3d8-45a0-89d7-42b83009632a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:00.561433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ddee2d9-f3d8-45a0-89d7-42b83009632a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:00.562758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ddee2d9-f3d8-45a0-89d7-42b83009632a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:00.566373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ddee2d9-f3d8-45a0-89d7-42b83009632a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:00.963942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d3d9aecf-75d8-4b63-8939-6e325cd6c1e2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:00.965682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d3d9aecf-75d8-4b63-8939-6e325cd6c1e2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:00.981648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3d9aecf-75d8-4b63-8939-6e325cd6c1e2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:00.986487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3d9aecf-75d8-4b63-8939-6e325cd6c1e2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:00.987172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3d9aecf-75d8-4b63-8939-6e325cd6c1e2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:00.988084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3d9aecf-75d8-4b63-8939-6e325cd6c1e2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:00.991959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3d9aecf-75d8-4b63-8939-6e325cd6c1e2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:00.993239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3d9aecf-75d8-4b63-8939-6e325cd6c1e2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:01.313428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1ddee2d9-f3d8-45a0-89d7-42b83009632a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:01.325983 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1ddee2d9-f3d8-45a0-89d7-42b83009632a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1808 microversion: 2.1 time: 0.787271 Oct 24 10:38:01.349013 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1474/3039] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:00 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1808 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:01.355802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d09454b-d7e7-4bb7-8ed2-cc7f7cface3b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:01.363945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0d09454b-d7e7-4bb7-8ed2-cc7f7cface3b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:01.375796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d09454b-d7e7-4bb7-8ed2-cc7f7cface3b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:01.380979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d09454b-d7e7-4bb7-8ed2-cc7f7cface3b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:01.381823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d09454b-d7e7-4bb7-8ed2-cc7f7cface3b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:01.382886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d09454b-d7e7-4bb7-8ed2-cc7f7cface3b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:01.383588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d09454b-d7e7-4bb7-8ed2-cc7f7cface3b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:01.384249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d09454b-d7e7-4bb7-8ed2-cc7f7cface3b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:01.402592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:01.641911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0d09454b-d7e7-4bb7-8ed2-cc7f7cface3b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:01.658549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0d09454b-d7e7-4bb7-8ed2-cc7f7cface3b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:01.660109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0d09454b-d7e7-4bb7-8ed2-cc7f7cface3b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:01.668902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d3d9aecf-75d8-4b63-8939-6e325cd6c1e2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:01.676097 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0d09454b-d7e7-4bb7-8ed2-cc7f7cface3b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.325456 Oct 24 10:38:01.676852 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1475/3040] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:01 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:01.677179 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d3d9aecf-75d8-4b63-8939-6e325cd6c1e2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1681 microversion: 2.1 time: 0.717547 Oct 24 10:38:01.681776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a52a7428-d5b6-4237-ab64-7f629b9e1981 req-0aad657b-6cc9-4b7c-8d13-54e61f79403b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78eb5c2b-4d4b-43b1-86bd-4fe986f4461d", "name": "network-vif-deleted", "tag": "fd833a93-632c-47be-8b1d-8e3c9376cdc4"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:01.697740 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1566/3041] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:00 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1681 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:38:01.702954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-be581c2a-c6b2-49ef-8cfb-3acb57c8d793 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:01.708752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a52a7428-d5b6-4237-ab64-7f629b9e1981 req-0aad657b-6cc9-4b7c-8d13-54e61f79403b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:01.709423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a52a7428-d5b6-4237-ab64-7f629b9e1981 req-0aad657b-6cc9-4b7c-8d13-54e61f79403b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:01.709963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a52a7428-d5b6-4237-ab64-7f629b9e1981 req-0aad657b-6cc9-4b7c-8d13-54e61f79403b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:01.714821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-be581c2a-c6b2-49ef-8cfb-3acb57c8d793 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:01.722481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be581c2a-c6b2-49ef-8cfb-3acb57c8d793 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:01.722977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be581c2a-c6b2-49ef-8cfb-3acb57c8d793 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:01.723417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be581c2a-c6b2-49ef-8cfb-3acb57c8d793 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:01.724127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be581c2a-c6b2-49ef-8cfb-3acb57c8d793 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:01.724583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be581c2a-c6b2-49ef-8cfb-3acb57c8d793 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:01.725039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be581c2a-c6b2-49ef-8cfb-3acb57c8d793 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:01.729558 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a52a7428-d5b6-4237-ab64-7f629b9e1981 req-0aad657b-6cc9-4b7c-8d13-54e61f79403b service nova] Creating event network-vif-deleted:fd833a93-632c-47be-8b1d-8e3c9376cdc4 for instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d on n-h2-858383-15 Oct 24 10:38:01.739770 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a52a7428-d5b6-4237-ab64-7f629b9e1981 req-0aad657b-6cc9-4b7c-8d13-54e61f79403b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058041 Oct 24 10:38:01.741279 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1476/3042] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:02.352804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d6312a43-8729-485b-8dcd-6b6ad87ccf94 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:02.354308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d6312a43-8729-485b-8dcd-6b6ad87ccf94 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:02.372154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6312a43-8729-485b-8dcd-6b6ad87ccf94 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:02.376669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6312a43-8729-485b-8dcd-6b6ad87ccf94 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:02.378104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6312a43-8729-485b-8dcd-6b6ad87ccf94 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:02.381863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6312a43-8729-485b-8dcd-6b6ad87ccf94 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:02.384775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6312a43-8729-485b-8dcd-6b6ad87ccf94 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:02.385399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6312a43-8729-485b-8dcd-6b6ad87ccf94 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:03.183748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d6312a43-8729-485b-8dcd-6b6ad87ccf94 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:03.194251 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d6312a43-8729-485b-8dcd-6b6ad87ccf94 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 200 len: 1651 microversion: 2.1 time: 0.846327 Oct 24 10:38:03.196007 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1477/3043] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:02 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 1651 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:03.202652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-21664975-e822-488d-a655-541ee8e28281 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:03.203773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-21664975-e822-488d-a655-541ee8e28281 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:03.215184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21664975-e822-488d-a655-541ee8e28281 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:03.215865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21664975-e822-488d-a655-541ee8e28281 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:03.216491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21664975-e822-488d-a655-541ee8e28281 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:03.217432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21664975-e822-488d-a655-541ee8e28281 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:03.218047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21664975-e822-488d-a655-541ee8e28281 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:03.218932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21664975-e822-488d-a655-541ee8e28281 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:03.586910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-be581c2a-c6b2-49ef-8cfb-3acb57c8d793 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:03.598303 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-be581c2a-c6b2-49ef-8cfb-3acb57c8d793 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1314 microversion: 2.1 time: 1.899132 Oct 24 10:38:03.599469 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1567/3044] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:01 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1314 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:03.604650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c0091da2-b8d3-4063-9db9-b0b4047fbd57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:03.614612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c0091da2-b8d3-4063-9db9-b0b4047fbd57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:03.624809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0091da2-b8d3-4063-9db9-b0b4047fbd57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:03.629560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0091da2-b8d3-4063-9db9-b0b4047fbd57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:03.630268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0091da2-b8d3-4063-9db9-b0b4047fbd57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:03.631183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0091da2-b8d3-4063-9db9-b0b4047fbd57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:03.633531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0091da2-b8d3-4063-9db9-b0b4047fbd57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:03.634172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0091da2-b8d3-4063-9db9-b0b4047fbd57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:04.912889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c0091da2-b8d3-4063-9db9-b0b4047fbd57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:04.927721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c0091da2-b8d3-4063-9db9-b0b4047fbd57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:04.951789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c0091da2-b8d3-4063-9db9-b0b4047fbd57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:04.962615 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c0091da2-b8d3-4063-9db9-b0b4047fbd57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 1.361809 Oct 24 10:38:04.988515 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1568/3045] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:03 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:04.993796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a7a31fdf-c730-4881-97d4-0d3aacb915d0 req-7cf3ad5c-5120-44b5-b343-b7c903194e2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d4c883-f34d-4326-8505-2d66bd047dc8", "name": "network-vif-plugged", "status": "completed", "tag": "0c4d075a-267d-4bd1-8a69-d9825c34d8a2"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:05.010503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a7a31fdf-c730-4881-97d4-0d3aacb915d0 req-7cf3ad5c-5120-44b5-b343-b7c903194e2f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:05.011375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a7a31fdf-c730-4881-97d4-0d3aacb915d0 req-7cf3ad5c-5120-44b5-b343-b7c903194e2f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:05.017356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a7a31fdf-c730-4881-97d4-0d3aacb915d0 req-7cf3ad5c-5120-44b5-b343-b7c903194e2f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:05.053503 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a7a31fdf-c730-4881-97d4-0d3aacb915d0 req-7cf3ad5c-5120-44b5-b343-b7c903194e2f service nova] Creating event network-vif-plugged:0c4d075a-267d-4bd1-8a69-d9825c34d8a2 for instance 18d4c883-f34d-4326-8505-2d66bd047dc8 on n-h1-858383-15 Oct 24 10:38:05.063080 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a7a31fdf-c730-4881-97d4-0d3aacb915d0 req-7cf3ad5c-5120-44b5-b343-b7c903194e2f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072297 Oct 24 10:38:05.066012 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1569/3046] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:05.089721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-3bcc9341-24aa-4a82-9561-42d322862bfa req-f8cd5195-85e7-46d2-81c9-8c7483fb271b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78eb5c2b-4d4b-43b1-86bd-4fe986f4461d", "name": "network-vif-deleted", "tag": "067afe80-c1e2-463c-894b-11a5109a94e8"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:05.126388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3bcc9341-24aa-4a82-9561-42d322862bfa req-f8cd5195-85e7-46d2-81c9-8c7483fb271b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:05.130071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3bcc9341-24aa-4a82-9561-42d322862bfa req-f8cd5195-85e7-46d2-81c9-8c7483fb271b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:05.133758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3bcc9341-24aa-4a82-9561-42d322862bfa req-f8cd5195-85e7-46d2-81c9-8c7483fb271b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:05.154711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-21664975-e822-488d-a655-541ee8e28281 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:05.168719 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-21664975-e822-488d-a655-541ee8e28281 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1681 microversion: 2.1 time: 1.971143 Oct 24 10:38:05.174419 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1478/3047] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:03 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1681 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:05.187806 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-3bcc9341-24aa-4a82-9561-42d322862bfa req-f8cd5195-85e7-46d2-81c9-8c7483fb271b service nova] Creating event network-vif-deleted:067afe80-c1e2-463c-894b-11a5109a94e8 for instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d on n-h2-858383-15 Oct 24 10:38:05.193022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-722f0aba-e118-4c32-8e2b-8b496b409a64 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:05.194883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-722f0aba-e118-4c32-8e2b-8b496b409a64 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:05.203094 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-3bcc9341-24aa-4a82-9561-42d322862bfa req-f8cd5195-85e7-46d2-81c9-8c7483fb271b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128779 Oct 24 10:38:05.206114 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1570/3048] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:05.217443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-722f0aba-e118-4c32-8e2b-8b496b409a64 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:05.220588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-722f0aba-e118-4c32-8e2b-8b496b409a64 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:05.222658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-722f0aba-e118-4c32-8e2b-8b496b409a64 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:05.223426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-722f0aba-e118-4c32-8e2b-8b496b409a64 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:05.232100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-74dc5799-e9e5-430b-a8eb-6525a76dc28f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:05.234212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-722f0aba-e118-4c32-8e2b-8b496b409a64 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:05.234722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-722f0aba-e118-4c32-8e2b-8b496b409a64 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:05.238601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-74dc5799-e9e5-430b-a8eb-6525a76dc28f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:05.269900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-74dc5799-e9e5-430b-a8eb-6525a76dc28f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:05.270748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-74dc5799-e9e5-430b-a8eb-6525a76dc28f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:05.273925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-74dc5799-e9e5-430b-a8eb-6525a76dc28f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:05.274982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-74dc5799-e9e5-430b-a8eb-6525a76dc28f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:05.276774 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-722f0aba-e118-4c32-8e2b-8b496b409a64 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] HTTP exception thrown: Instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d could not be found. Oct 24 10:38:05.277365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-74dc5799-e9e5-430b-a8eb-6525a76dc28f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-722f0aba-e118-4c32-8e2b-8b496b409a64 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Request method failure captured: Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d HTTP/1.1 Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmrU0qOkxUYxPy1TFCBlk8lEUDstc_ijm7c5gtwX9g8vT6Fz_reafeRRu0EpE5OniPvhMFBGjQjJYBUXsxUYkPiR1ixj5KSaN0o-driXZFbdK1SxQdKkrFO8kfGl9k62ggVatqCXLHGNMIwiVsT5EZVcvm2J2xqV-qZ1S1vAInUUJC4 Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 19a51abc0b7c4b01ad379e50663a2000 Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersTestMultiNic-119742743 Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/19a51abc0b7c4b01ad379e50663a2000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/19a51abc0b7c4b01ad379e50663a2000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/19a51abc0b7c4b01ad379e50663a2000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_19a51abc0b7c4b01ad379e50663a2000", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersTestMultiNic-119742743 Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 19a51abc0b7c4b01ad379e50663a2000 Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersTestMultiNic-119742743 Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersTestMultiNic-119742743-project Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 83d2c201d9e348c8a2ff17525693a3ab Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersTestMultiNic-119742743-project Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d could not be found. Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '78eb5c2b-4d4b-43b1-86bd-4fe986f4461d'} Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d could not be found. Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d could not be found. Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:38:05.278767 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:38:05.283536 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:38:05.283536 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:38:05.283536 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:38:05.283536 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:38:05.283536 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:38:05.283536 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d could not be found. Oct 24 10:38:05.283536 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:38:05.283536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-722f0aba-e118-4c32-8e2b-8b496b409a64 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Returning 404 to user: Instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:38:05.283536 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-722f0aba-e118-4c32-8e2b-8b496b409a64 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 404 len: 111 microversion: 2.1 time: 0.104784 Oct 24 10:38:05.288021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-74dc5799-e9e5-430b-a8eb-6525a76dc28f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:05.289167 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1479/3049] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:05 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:38:06.003132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2c43fcc3-f3d5-44e1-a193-433972295e83 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:06.004070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2c43fcc3-f3d5-44e1-a193-433972295e83 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:06.023792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c43fcc3-f3d5-44e1-a193-433972295e83 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:06.031595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c43fcc3-f3d5-44e1-a193-433972295e83 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:06.033161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c43fcc3-f3d5-44e1-a193-433972295e83 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:06.035573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c43fcc3-f3d5-44e1-a193-433972295e83 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:06.036424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c43fcc3-f3d5-44e1-a193-433972295e83 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:06.037260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c43fcc3-f3d5-44e1-a193-433972295e83 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:06.253528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c43fcc3-f3d5-44e1-a193-433972295e83 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:06.272651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c43fcc3-f3d5-44e1-a193-433972295e83 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:06.274177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c43fcc3-f3d5-44e1-a193-433972295e83 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:06.315419 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2c43fcc3-f3d5-44e1-a193-433972295e83 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.322590 Oct 24 10:38:06.316306 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1480/3050] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:05 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:06.335912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-65ce9de3-7a8d-4631-84f1-d030ee9578d9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:06.339634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-65ce9de3-7a8d-4631-84f1-d030ee9578d9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:06.353121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65ce9de3-7a8d-4631-84f1-d030ee9578d9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:06.357623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65ce9de3-7a8d-4631-84f1-d030ee9578d9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:06.358330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65ce9de3-7a8d-4631-84f1-d030ee9578d9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:06.365472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65ce9de3-7a8d-4631-84f1-d030ee9578d9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:06.367549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65ce9de3-7a8d-4631-84f1-d030ee9578d9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:06.370918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65ce9de3-7a8d-4631-84f1-d030ee9578d9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:06.402996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-74dc5799-e9e5-430b-a8eb-6525a76dc28f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:06.418719 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-74dc5799-e9e5-430b-a8eb-6525a76dc28f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1314 microversion: 2.1 time: 1.210741 Oct 24 10:38:06.425811 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1571/3051] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:05 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1314 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:07.354941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-51ea0de8-a70a-4e15-8d64-9eb8dec9bbbb tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:07.358560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-51ea0de8-a70a-4e15-8d64-9eb8dec9bbbb tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:07.383314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51ea0de8-a70a-4e15-8d64-9eb8dec9bbbb tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:07.384244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51ea0de8-a70a-4e15-8d64-9eb8dec9bbbb tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:07.388692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51ea0de8-a70a-4e15-8d64-9eb8dec9bbbb tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:07.389990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51ea0de8-a70a-4e15-8d64-9eb8dec9bbbb tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:07.390845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51ea0de8-a70a-4e15-8d64-9eb8dec9bbbb tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:07.391745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51ea0de8-a70a-4e15-8d64-9eb8dec9bbbb tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:07.622091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-65ce9de3-7a8d-4631-84f1-d030ee9578d9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:07.645806 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-65ce9de3-7a8d-4631-84f1-d030ee9578d9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1681 microversion: 2.1 time: 1.325562 Oct 24 10:38:07.646454 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1481/3052] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:06 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1681 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:07.658138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80d58fb0-afad-4023-bb7f-f1ea3aa6e3ec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:07.659049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-80d58fb0-afad-4023-bb7f-f1ea3aa6e3ec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:07.692733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80d58fb0-afad-4023-bb7f-f1ea3aa6e3ec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:07.693520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80d58fb0-afad-4023-bb7f-f1ea3aa6e3ec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:07.694243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80d58fb0-afad-4023-bb7f-f1ea3aa6e3ec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:07.694934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80d58fb0-afad-4023-bb7f-f1ea3aa6e3ec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:07.695375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80d58fb0-afad-4023-bb7f-f1ea3aa6e3ec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:07.695974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80d58fb0-afad-4023-bb7f-f1ea3aa6e3ec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:07.740067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-51ea0de8-a70a-4e15-8d64-9eb8dec9bbbb tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:07.765820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-51ea0de8-a70a-4e15-8d64-9eb8dec9bbbb tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:07.792815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-51ea0de8-a70a-4e15-8d64-9eb8dec9bbbb tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:07.837670 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-51ea0de8-a70a-4e15-8d64-9eb8dec9bbbb tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.494349 Oct 24 10:38:07.870004 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1572/3053] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:07 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:07.881497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-62308de8-4221-4999-be52-da33c71c8fad req-07927b3e-3bfd-4ed6-97e2-375de1998ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78eb5c2b-4d4b-43b1-86bd-4fe986f4461d", "name": "network-vif-deleted", "tag": "e57ada83-946f-4aba-ae66-02d7b2b4a864"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:07.923827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-62308de8-4221-4999-be52-da33c71c8fad req-07927b3e-3bfd-4ed6-97e2-375de1998ac8 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:07.925173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-62308de8-4221-4999-be52-da33c71c8fad req-07927b3e-3bfd-4ed6-97e2-375de1998ac8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:07.926931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-62308de8-4221-4999-be52-da33c71c8fad req-07927b3e-3bfd-4ed6-97e2-375de1998ac8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:07.957608 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-62308de8-4221-4999-be52-da33c71c8fad req-07927b3e-3bfd-4ed6-97e2-375de1998ac8 service nova] Creating event network-vif-deleted:e57ada83-946f-4aba-ae66-02d7b2b4a864 for instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d on n-h2-858383-15 Oct 24 10:38:07.971410 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-62308de8-4221-4999-be52-da33c71c8fad req-07927b3e-3bfd-4ed6-97e2-375de1998ac8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096990 Oct 24 10:38:07.973365 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1573/3054] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:08.391836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a263363e-eecc-412f-b7c7-3626ee8bdbbb tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1059140205", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "a1fa283f-da81-47e1-9c78-7033f9bbd34a"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:08.487018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-80d58fb0-afad-4023-bb7f-f1ea3aa6e3ec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:08.499081 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-80d58fb0-afad-4023-bb7f-f1ea3aa6e3ec tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1500 microversion: 2.1 time: 0.850471 Oct 24 10:38:08.513172 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1482/3055] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:07 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1500 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:08.524292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3236446f-22be-44a2-8641-45037df72ab2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:08.524863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3236446f-22be-44a2-8641-45037df72ab2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:08.534469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-a263363e-eecc-412f-b7c7-3626ee8bdbbb tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] validate_networks() for [('a1fa283f-da81-47e1-9c78-7033f9bbd34a', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:38:08.550453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3236446f-22be-44a2-8641-45037df72ab2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:08.551068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3236446f-22be-44a2-8641-45037df72ab2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:08.552144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3236446f-22be-44a2-8641-45037df72ab2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:08.553676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3236446f-22be-44a2-8641-45037df72ab2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:08.558126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3236446f-22be-44a2-8641-45037df72ab2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:08.561449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3236446f-22be-44a2-8641-45037df72ab2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:08.679594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-3236446f-22be-44a2-8641-45037df72ab2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lazy-loading 'flavor' on Instance uuid 18d4c883-f34d-4326-8505-2d66bd047dc8 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:38:09.202146 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3236446f-22be-44a2-8641-45037df72ab2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "POST /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8/action" status: 202 len: 0 microversion: 2.1 time: 0.681685 Oct 24 10:38:09.207438 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1483/3056] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:38:08 2022] POST /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8/action => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:38:09.214530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c5d5bbc4-1098-4fef-9721-df17cc636856 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:09.216304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c5d5bbc4-1098-4fef-9721-df17cc636856 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:09.231324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5d5bbc4-1098-4fef-9721-df17cc636856 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:09.232175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5d5bbc4-1098-4fef-9721-df17cc636856 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:09.233013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5d5bbc4-1098-4fef-9721-df17cc636856 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:09.234429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5d5bbc4-1098-4fef-9721-df17cc636856 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:09.235101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5d5bbc4-1098-4fef-9721-df17cc636856 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:09.235732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5d5bbc4-1098-4fef-9721-df17cc636856 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:10.402286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c5d5bbc4-1098-4fef-9721-df17cc636856 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:10.413886 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c5d5bbc4-1098-4fef-9721-df17cc636856 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1681 microversion: 2.1 time: 1.204237 Oct 24 10:38:10.420121 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1484/3057] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:09 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1681 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:10.440094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-287ffc4a-5735-4cbb-adb2-0b47f142ce40 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:10.441153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-287ffc4a-5735-4cbb-adb2-0b47f142ce40 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:10.448126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-287ffc4a-5735-4cbb-adb2-0b47f142ce40 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:10.452602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-287ffc4a-5735-4cbb-adb2-0b47f142ce40 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:10.453417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-287ffc4a-5735-4cbb-adb2-0b47f142ce40 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:10.454399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-287ffc4a-5735-4cbb-adb2-0b47f142ce40 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:10.458087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-287ffc4a-5735-4cbb-adb2-0b47f142ce40 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:10.458801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-287ffc4a-5735-4cbb-adb2-0b47f142ce40 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:10.767458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-287ffc4a-5735-4cbb-adb2-0b47f142ce40 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:10.778942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-287ffc4a-5735-4cbb-adb2-0b47f142ce40 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:10.785129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-287ffc4a-5735-4cbb-adb2-0b47f142ce40 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:10.801048 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-287ffc4a-5735-4cbb-adb2-0b47f142ce40 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1535 microversion: 2.91 time: 0.378006 Oct 24 10:38:10.822574 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1485/3058] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:10 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1535 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:10.868327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9a8b6d05-d1ee-4d28-aacd-a8464d662fd3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:10.875431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9a8b6d05-d1ee-4d28-aacd-a8464d662fd3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:10.892776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a8b6d05-d1ee-4d28-aacd-a8464d662fd3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:10.893671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a8b6d05-d1ee-4d28-aacd-a8464d662fd3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:10.894395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a8b6d05-d1ee-4d28-aacd-a8464d662fd3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:10.895346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a8b6d05-d1ee-4d28-aacd-a8464d662fd3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:10.896032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a8b6d05-d1ee-4d28-aacd-a8464d662fd3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:10.896714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a8b6d05-d1ee-4d28-aacd-a8464d662fd3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:11.267637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a263363e-eecc-412f-b7c7-3626ee8bdbbb tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:38:11.268530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a263363e-eecc-412f-b7c7-3626ee8bdbbb tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:38:11.269201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a263363e-eecc-412f-b7c7-3626ee8bdbbb tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:38:11.269983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a263363e-eecc-412f-b7c7-3626ee8bdbbb tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:38:11.270569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a263363e-eecc-412f-b7c7-3626ee8bdbbb tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:38:11.284708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a263363e-eecc-412f-b7c7-3626ee8bdbbb tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:11.285450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a263363e-eecc-412f-b7c7-3626ee8bdbbb tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:11.286209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a263363e-eecc-412f-b7c7-3626ee8bdbbb tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:11.287297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a263363e-eecc-412f-b7c7-3626ee8bdbbb tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:11.288098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a263363e-eecc-412f-b7c7-3626ee8bdbbb tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:11.288699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a263363e-eecc-412f-b7c7-3626ee8bdbbb tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:11.336369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-a263363e-eecc-412f-b7c7-3626ee8bdbbb tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Getting quotas for project d34be11df0f94fabb99d567ed559cfa7. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:38:11.359398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-a263363e-eecc-412f-b7c7-3626ee8bdbbb tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Getting quotas for user a88eecfbcd0f4acf8edffbb8fb604f42 and project d34be11df0f94fabb99d567ed559cfa7. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:38:11.403476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a263363e-eecc-412f-b7c7-3626ee8bdbbb tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:38:11.406490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a263363e-eecc-412f-b7c7-3626ee8bdbbb tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:38:11.498836 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a263363e-eecc-412f-b7c7-3626ee8bdbbb tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.327024 Oct 24 10:38:11.501212 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1574/3059] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:38:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:38:11.559149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1c987ea2-5319-430d-8b02-6ce2845a1ca3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:11.559149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1c987ea2-5319-430d-8b02-6ce2845a1ca3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:11.584075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c987ea2-5319-430d-8b02-6ce2845a1ca3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:11.586030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c987ea2-5319-430d-8b02-6ce2845a1ca3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:11.587841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c987ea2-5319-430d-8b02-6ce2845a1ca3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:11.589875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c987ea2-5319-430d-8b02-6ce2845a1ca3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:11.591752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c987ea2-5319-430d-8b02-6ce2845a1ca3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:11.593436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c987ea2-5319-430d-8b02-6ce2845a1ca3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:12.162552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9a8b6d05-d1ee-4d28-aacd-a8464d662fd3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:12.174294 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9a8b6d05-d1ee-4d28-aacd-a8464d662fd3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1506 microversion: 2.1 time: 1.349694 Oct 24 10:38:12.182225 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1486/3060] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:10 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1506 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:12.200467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ed0d6d44-b8be-47ca-a0ba-3a2c8a8a2573 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-625972963", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "a1fa283f-da81-47e1-9c78-7033f9bbd34a"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:12.316009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-ed0d6d44-b8be-47ca-a0ba-3a2c8a8a2573 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] validate_networks() for [('a1fa283f-da81-47e1-9c78-7033f9bbd34a', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:38:12.597658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1c987ea2-5319-430d-8b02-6ce2845a1ca3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:12.613116 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1c987ea2-5319-430d-8b02-6ce2845a1ca3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1658 microversion: 2.1 time: 1.110730 Oct 24 10:38:12.614157 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1575/3061] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:11 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1658 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:12.623439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-152369b8-245c-40ea-a172-68d5a3254d5a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:12.632016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-152369b8-245c-40ea-a172-68d5a3254d5a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:12.634436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:12.647287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-152369b8-245c-40ea-a172-68d5a3254d5a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:12.648016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-152369b8-245c-40ea-a172-68d5a3254d5a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:12.648245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-152369b8-245c-40ea-a172-68d5a3254d5a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:12.649071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-152369b8-245c-40ea-a172-68d5a3254d5a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:12.649533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-152369b8-245c-40ea-a172-68d5a3254d5a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:12.650040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-152369b8-245c-40ea-a172-68d5a3254d5a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:12.951404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-152369b8-245c-40ea-a172-68d5a3254d5a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:12.971006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-152369b8-245c-40ea-a172-68d5a3254d5a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:12.974873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-152369b8-245c-40ea-a172-68d5a3254d5a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:12.998618 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-152369b8-245c-40ea-a172-68d5a3254d5a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1535 microversion: 2.91 time: 0.382375 Oct 24 10:38:13.001318 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1576/3062] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:12 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1535 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:13.014426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0c3331b0-eeff-4025-92c8-b23c6a6af4ef tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:13.040503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c3331b0-eeff-4025-92c8-b23c6a6af4ef tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:13.042298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c3331b0-eeff-4025-92c8-b23c6a6af4ef tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:13.044581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c3331b0-eeff-4025-92c8-b23c6a6af4ef tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:13.114338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0c3331b0-eeff-4025-92c8-b23c6a6af4ef tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Going to try to start instance {{(pid=120426) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 10:38:13.290968 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0c3331b0-eeff-4025-92c8-b23c6a6af4ef tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 202 len: 0 microversion: 2.1 time: 0.288147 Oct 24 10:38:13.295785 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1577/3063] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:38:13 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:38:13.315396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4e0446fb-54d2-4646-b477-169a9622cfb7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:13.316399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4e0446fb-54d2-4646-b477-169a9622cfb7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:13.329485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e0446fb-54d2-4646-b477-169a9622cfb7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:13.329994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e0446fb-54d2-4646-b477-169a9622cfb7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:13.330446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e0446fb-54d2-4646-b477-169a9622cfb7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:13.331350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e0446fb-54d2-4646-b477-169a9622cfb7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:13.336043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e0446fb-54d2-4646-b477-169a9622cfb7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:13.336567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e0446fb-54d2-4646-b477-169a9622cfb7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:13.406846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:14.589990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4e0446fb-54d2-4646-b477-169a9622cfb7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:14.597847 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4e0446fb-54d2-4646-b477-169a9622cfb7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1506 microversion: 2.1 time: 1.300567 Oct 24 10:38:14.598434 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1578/3064] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:13 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1506 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:14.613379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a33884f0-6653-4d22-bbc1-2f38fb10ac4c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:14.614544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a33884f0-6653-4d22-bbc1-2f38fb10ac4c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:14.629981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a33884f0-6653-4d22-bbc1-2f38fb10ac4c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:14.630490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a33884f0-6653-4d22-bbc1-2f38fb10ac4c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:14.630952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a33884f0-6653-4d22-bbc1-2f38fb10ac4c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:14.632407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a33884f0-6653-4d22-bbc1-2f38fb10ac4c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:14.635718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a33884f0-6653-4d22-bbc1-2f38fb10ac4c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:14.636664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a33884f0-6653-4d22-bbc1-2f38fb10ac4c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:15.086660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ed0d6d44-b8be-47ca-a0ba-3a2c8a8a2573 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:38:15.087208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ed0d6d44-b8be-47ca-a0ba-3a2c8a8a2573 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:38:15.088588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ed0d6d44-b8be-47ca-a0ba-3a2c8a8a2573 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:38:15.089243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ed0d6d44-b8be-47ca-a0ba-3a2c8a8a2573 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:38:15.089857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ed0d6d44-b8be-47ca-a0ba-3a2c8a8a2573 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:38:15.117411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed0d6d44-b8be-47ca-a0ba-3a2c8a8a2573 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:15.118422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed0d6d44-b8be-47ca-a0ba-3a2c8a8a2573 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:15.119369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed0d6d44-b8be-47ca-a0ba-3a2c8a8a2573 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:15.120624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed0d6d44-b8be-47ca-a0ba-3a2c8a8a2573 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:15.121427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed0d6d44-b8be-47ca-a0ba-3a2c8a8a2573 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:15.124571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed0d6d44-b8be-47ca-a0ba-3a2c8a8a2573 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:15.149100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a33884f0-6653-4d22-bbc1-2f38fb10ac4c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:15.159282 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a33884f0-6653-4d22-bbc1-2f38fb10ac4c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1667 microversion: 2.1 time: 0.553252 Oct 24 10:38:15.178491 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1579/3065] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:14 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1667 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:15.180369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ed0d6d44-b8be-47ca-a0ba-3a2c8a8a2573 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Getting quotas for project d34be11df0f94fabb99d567ed559cfa7. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:38:15.187352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ed0d6d44-b8be-47ca-a0ba-3a2c8a8a2573 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Getting quotas for user a88eecfbcd0f4acf8edffbb8fb604f42 and project d34be11df0f94fabb99d567ed559cfa7. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:38:15.204282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-415120d3-9466-4e78-a39c-c17872a1cfe1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:15.205371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-415120d3-9466-4e78-a39c-c17872a1cfe1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:15.212040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-415120d3-9466-4e78-a39c-c17872a1cfe1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:15.214741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-415120d3-9466-4e78-a39c-c17872a1cfe1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:15.215478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-415120d3-9466-4e78-a39c-c17872a1cfe1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:15.218539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-415120d3-9466-4e78-a39c-c17872a1cfe1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:15.218971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ed0d6d44-b8be-47ca-a0ba-3a2c8a8a2573 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:38:15.220496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-415120d3-9466-4e78-a39c-c17872a1cfe1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:15.221101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-415120d3-9466-4e78-a39c-c17872a1cfe1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:15.222433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ed0d6d44-b8be-47ca-a0ba-3a2c8a8a2573 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 2f024708-057e-4eda-9894-fb480a85c693] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:38:15.338820 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ed0d6d44-b8be-47ca-a0ba-3a2c8a8a2573 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.152104 Oct 24 10:38:15.354559 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1487/3066] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:38:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:38:15.373838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-992522f9-faf9-470e-a35e-cc47d4031b5a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Action: 'create', calling method: .version_select at 0x7f04d5038b80>, body: {"keypair": {"name": "tempest-keypair-1363163816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIunb99SrhRnOCif9EWBVhWVKQfc1oGOKr5AhEtQodOEY0mdtSNmLuAmJoC2OHUJNLMKCiyUqSadF9KS/T1z/pzw0N341kbly+oV7hAOuPcF+z4guFTFq0NaI18JN6NETg=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:15.425989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-415120d3-9466-4e78-a39c-c17872a1cfe1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:15.434095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-992522f9-faf9-470e-a35e-cc47d4031b5a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Getting quotas for project 2eb64e6d84904f1083116b5aed79f7f2. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:38:15.443611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-415120d3-9466-4e78-a39c-c17872a1cfe1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:15.450938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-415120d3-9466-4e78-a39c-c17872a1cfe1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:15.465326 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-415120d3-9466-4e78-a39c-c17872a1cfe1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1478 microversion: 2.91 time: 0.285473 Oct 24 10:38:15.466285 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1580/3067] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:15 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1478 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:15.467745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-992522f9-faf9-470e-a35e-cc47d4031b5a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Getting quotas for user 6052fe343c86452f9183b383fcc85183 and project 2eb64e6d84904f1083116b5aed79f7f2. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:38:15.474008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-29a45204-861e-423a-bbce-2880f94be3a6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-49544845", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "451", "networks": [{"uuid": "a1fa283f-da81-47e1-9c78-7033f9bbd34a"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:15.518142 n-d-858383-15 devstack@n-api.service[120425]: ERROR oslo.messaging._drivers.impl_rabbit [None req-992522f9-faf9-470e-a35e-cc47d4031b5a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [0abf7c05-d150-487f-8c63-68138362ab14] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 10:38:15.576437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-29a45204-861e-423a-bbce-2880f94be3a6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] validate_networks() for [('a1fa283f-da81-47e1-9c78-7033f9bbd34a', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:38:16.385261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-29a45204-861e-423a-bbce-2880f94be3a6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:38:16.385913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-29a45204-861e-423a-bbce-2880f94be3a6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:38:16.386248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-29a45204-861e-423a-bbce-2880f94be3a6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:38:16.386655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-29a45204-861e-423a-bbce-2880f94be3a6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:38:16.387061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-29a45204-861e-423a-bbce-2880f94be3a6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:38:16.406076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29a45204-861e-423a-bbce-2880f94be3a6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:16.406566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29a45204-861e-423a-bbce-2880f94be3a6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:16.406998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29a45204-861e-423a-bbce-2880f94be3a6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:16.407719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29a45204-861e-423a-bbce-2880f94be3a6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:16.408168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29a45204-861e-423a-bbce-2880f94be3a6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:16.408591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29a45204-861e-423a-bbce-2880f94be3a6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:16.455521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-29a45204-861e-423a-bbce-2880f94be3a6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Getting quotas for project d34be11df0f94fabb99d567ed559cfa7. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:38:16.468484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-29a45204-861e-423a-bbce-2880f94be3a6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Getting quotas for user a88eecfbcd0f4acf8edffbb8fb604f42 and project d34be11df0f94fabb99d567ed559cfa7. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:38:16.496557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-29a45204-861e-423a-bbce-2880f94be3a6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:38:16.501121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-29a45204-861e-423a-bbce-2880f94be3a6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:38:16.526324 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [None req-992522f9-faf9-470e-a35e-cc47d4031b5a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [0abf7c05-d150-487f-8c63-68138362ab14] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 58022. Oct 24 10:38:16.554445 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-992522f9-faf9-470e-a35e-cc47d4031b5a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 1.198266 Oct 24 10:38:16.562607 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1488/3068] 10.222.0.50 () {62 vars in 1200 bytes} [Mon Oct 24 10:38:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1207 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 10:38:16.579448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-946ab29c-2b83-4be5-b58d-6be05b2717e7 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-858383-15"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:16.582177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-946ab29c-2b83-4be5-b58d-6be05b2717e7 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:16.593702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-946ab29c-2b83-4be5-b58d-6be05b2717e7 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:16.594247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-946ab29c-2b83-4be5-b58d-6be05b2717e7 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:16.597598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-946ab29c-2b83-4be5-b58d-6be05b2717e7 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:16.598561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-946ab29c-2b83-4be5-b58d-6be05b2717e7 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:16.599684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-946ab29c-2b83-4be5-b58d-6be05b2717e7 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:16.601574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-946ab29c-2b83-4be5-b58d-6be05b2717e7 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:16.639586 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-29a45204-861e-423a-bbce-2880f94be3a6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.169686 Oct 24 10:38:16.641065 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1581/3069] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:38:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:38:16.661149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3bed2d8e-2220-4d37-8bd7-c68e4c9814d5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:16.663990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3bed2d8e-2220-4d37-8bd7-c68e4c9814d5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:16.677864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3bed2d8e-2220-4d37-8bd7-c68e4c9814d5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:16.679810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3bed2d8e-2220-4d37-8bd7-c68e4c9814d5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:16.680765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3bed2d8e-2220-4d37-8bd7-c68e4c9814d5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:16.682344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3bed2d8e-2220-4d37-8bd7-c68e4c9814d5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:16.683030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3bed2d8e-2220-4d37-8bd7-c68e4c9814d5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:16.683688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3bed2d8e-2220-4d37-8bd7-c68e4c9814d5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:16.813037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-946ab29c-2b83-4be5-b58d-6be05b2717e7 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-858383-15". {{(pid=120425) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 24 10:38:16.949661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3bed2d8e-2220-4d37-8bd7-c68e4c9814d5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:17.015207 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-946ab29c-2b83-4be5-b58d-6be05b2717e7 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db/action" status: 202 len: 0 microversion: 2.91 time: 0.451154 Oct 24 10:38:17.016133 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1489/3070] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Oct 24 10:38:16 2022] POST /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:38:17.022744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-62d76572-27ec-404f-b784-3beb56469600 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:17.023372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-62d76572-27ec-404f-b784-3beb56469600 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:17.031898 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3bed2d8e-2220-4d37-8bd7-c68e4c9814d5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1506 microversion: 2.1 time: 0.386342 Oct 24 10:38:17.035946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62d76572-27ec-404f-b784-3beb56469600 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:17.036529 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1582/3071] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:16 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:17.049678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62d76572-27ec-404f-b784-3beb56469600 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:17.049678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62d76572-27ec-404f-b784-3beb56469600 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:17.049678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62d76572-27ec-404f-b784-3beb56469600 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:17.049678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62d76572-27ec-404f-b784-3beb56469600 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:17.049678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62d76572-27ec-404f-b784-3beb56469600 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:17.063958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3b68849b-819a-4dec-83f0-20c1492c9a79 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:17.066862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3b68849b-819a-4dec-83f0-20c1492c9a79 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:17.343747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3b68849b-819a-4dec-83f0-20c1492c9a79 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:17.355190 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3b68849b-819a-4dec-83f0-20c1492c9a79 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 200 len: 1219 microversion: 2.1 time: 0.312546 Oct 24 10:38:17.358741 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1583/3072] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:17 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 1219 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:17.374301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-774058b4-7cd0-41bb-aea4-4249f7996ae9 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:17.383470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-774058b4-7cd0-41bb-aea4-4249f7996ae9 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:17.402247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-774058b4-7cd0-41bb-aea4-4249f7996ae9 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:17.406073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-774058b4-7cd0-41bb-aea4-4249f7996ae9 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:17.406806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-774058b4-7cd0-41bb-aea4-4249f7996ae9 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:17.410220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-774058b4-7cd0-41bb-aea4-4249f7996ae9 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:17.411443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-774058b4-7cd0-41bb-aea4-4249f7996ae9 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:17.412711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-774058b4-7cd0-41bb-aea4-4249f7996ae9 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:17.501498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-62d76572-27ec-404f-b784-3beb56469600 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:17.535452 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-62d76572-27ec-404f-b784-3beb56469600 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1667 microversion: 2.1 time: 0.518001 Oct 24 10:38:17.536133 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1490/3073] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:17 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1667 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:17.706889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e0ada5b0-b0ab-4a06-98ee-9cc54330dd8a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1870977053", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "f49ca961-6c05-4d39-9f58-83a1313d4b7d"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:17.721959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-774058b4-7cd0-41bb-aea4-4249f7996ae9 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:17.742165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-774058b4-7cd0-41bb-aea4-4249f7996ae9 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:17.747420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-774058b4-7cd0-41bb-aea4-4249f7996ae9 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:17.761482 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-774058b4-7cd0-41bb-aea4-4249f7996ae9 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1486 microversion: 2.91 time: 0.399107 Oct 24 10:38:17.763073 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1584/3074] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:17 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1486 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:17.826405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-e0ada5b0-b0ab-4a06-98ee-9cc54330dd8a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] validate_networks() for [('f49ca961-6c05-4d39-9f58-83a1313d4b7d', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:38:18.066840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2131b39a-93e2-4212-9d46-fd7fe6d76288 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:18.067456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2131b39a-93e2-4212-9d46-fd7fe6d76288 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:18.077078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2131b39a-93e2-4212-9d46-fd7fe6d76288 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:18.081870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2131b39a-93e2-4212-9d46-fd7fe6d76288 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:18.082327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2131b39a-93e2-4212-9d46-fd7fe6d76288 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:18.083066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2131b39a-93e2-4212-9d46-fd7fe6d76288 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:18.089037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2131b39a-93e2-4212-9d46-fd7fe6d76288 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:18.089959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2131b39a-93e2-4212-9d46-fd7fe6d76288 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:19.185497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2131b39a-93e2-4212-9d46-fd7fe6d76288 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:19.201040 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2131b39a-93e2-4212-9d46-fd7fe6d76288 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1506 microversion: 2.1 time: 1.137916 Oct 24 10:38:19.213588 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1585/3075] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:18 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1506 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:38:19.228927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0a378b1d-1540-44ac-bd80-1f688b422b44 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:19.230747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0a378b1d-1540-44ac-bd80-1f688b422b44 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:19.246060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a378b1d-1540-44ac-bd80-1f688b422b44 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:19.247402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a378b1d-1540-44ac-bd80-1f688b422b44 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:19.249448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a378b1d-1540-44ac-bd80-1f688b422b44 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:19.250873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a378b1d-1540-44ac-bd80-1f688b422b44 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:19.256154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a378b1d-1540-44ac-bd80-1f688b422b44 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:19.256709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a378b1d-1540-44ac-bd80-1f688b422b44 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:20.061247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0a378b1d-1540-44ac-bd80-1f688b422b44 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:20.069943 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0a378b1d-1540-44ac-bd80-1f688b422b44 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 200 len: 1277 microversion: 2.1 time: 0.855140 Oct 24 10:38:20.071072 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1586/3076] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:19 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 1277 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:20.076596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b8a0c1e1-06e8-4482-8b56-b0458ae07d20 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:20.084889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b8a0c1e1-06e8-4482-8b56-b0458ae07d20 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:20.098173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8a0c1e1-06e8-4482-8b56-b0458ae07d20 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:20.099063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8a0c1e1-06e8-4482-8b56-b0458ae07d20 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:20.099934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8a0c1e1-06e8-4482-8b56-b0458ae07d20 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:20.101028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8a0c1e1-06e8-4482-8b56-b0458ae07d20 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:20.101727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8a0c1e1-06e8-4482-8b56-b0458ae07d20 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:20.102345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8a0c1e1-06e8-4482-8b56-b0458ae07d20 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:20.692640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b8a0c1e1-06e8-4482-8b56-b0458ae07d20 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:20.732292 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b8a0c1e1-06e8-4482-8b56-b0458ae07d20 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.648970 Oct 24 10:38:20.741348 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1587/3077] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:20 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:20.797715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-38c8a78e-5fa8-4752-bd55-edbe905088f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:20.801747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-38c8a78e-5fa8-4752-bd55-edbe905088f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:20.819705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38c8a78e-5fa8-4752-bd55-edbe905088f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:20.823417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38c8a78e-5fa8-4752-bd55-edbe905088f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:20.827159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38c8a78e-5fa8-4752-bd55-edbe905088f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:20.828101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38c8a78e-5fa8-4752-bd55-edbe905088f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:20.828694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38c8a78e-5fa8-4752-bd55-edbe905088f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:20.829260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38c8a78e-5fa8-4752-bd55-edbe905088f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:21.034252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e0ada5b0-b0ab-4a06-98ee-9cc54330dd8a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:38:21.035083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e0ada5b0-b0ab-4a06-98ee-9cc54330dd8a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:38:21.036531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e0ada5b0-b0ab-4a06-98ee-9cc54330dd8a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:38:21.037164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e0ada5b0-b0ab-4a06-98ee-9cc54330dd8a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:38:21.037795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e0ada5b0-b0ab-4a06-98ee-9cc54330dd8a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:38:21.043932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-38c8a78e-5fa8-4752-bd55-edbe905088f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:21.054042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-38c8a78e-5fa8-4752-bd55-edbe905088f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:21.060438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-38c8a78e-5fa8-4752-bd55-edbe905088f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:21.086683 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-38c8a78e-5fa8-4752-bd55-edbe905088f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.340532 Oct 24 10:38:21.091616 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1588/3078] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:20 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:21.112063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aab1f47c-4f02-4d06-b933-b005872c37fe tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:21.113017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aab1f47c-4f02-4d06-b933-b005872c37fe tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:21.148056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aab1f47c-4f02-4d06-b933-b005872c37fe tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:21.153595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aab1f47c-4f02-4d06-b933-b005872c37fe tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:21.154260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aab1f47c-4f02-4d06-b933-b005872c37fe tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:21.161850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0ada5b0-b0ab-4a06-98ee-9cc54330dd8a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:21.162174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aab1f47c-4f02-4d06-b933-b005872c37fe tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:21.162370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0ada5b0-b0ab-4a06-98ee-9cc54330dd8a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:21.163013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aab1f47c-4f02-4d06-b933-b005872c37fe tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:21.163626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aab1f47c-4f02-4d06-b933-b005872c37fe tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:21.170744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0ada5b0-b0ab-4a06-98ee-9cc54330dd8a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:21.173821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0ada5b0-b0ab-4a06-98ee-9cc54330dd8a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:21.174338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0ada5b0-b0ab-4a06-98ee-9cc54330dd8a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:21.174801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0ada5b0-b0ab-4a06-98ee-9cc54330dd8a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:21.247410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-e0ada5b0-b0ab-4a06-98ee-9cc54330dd8a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Getting quotas for project 5edfb6d8f84547399863eec5c89e6933. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:38:21.259133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-e0ada5b0-b0ab-4a06-98ee-9cc54330dd8a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Getting quotas for user 1f089833f359473ebfa681931e8ffc06 and project 5edfb6d8f84547399863eec5c89e6933. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:38:21.298824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e0ada5b0-b0ab-4a06-98ee-9cc54330dd8a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:38:21.302665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e0ada5b0-b0ab-4a06-98ee-9cc54330dd8a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:38:21.463851 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e0ada5b0-b0ab-4a06-98ee-9cc54330dd8a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.902233 Oct 24 10:38:21.470229 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1491/3079] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:38:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:38:21.493095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c31c6a5a-4f76-42a8-bbfe-f4c70c8daadc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:21.496136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c31c6a5a-4f76-42a8-bbfe-f4c70c8daadc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:21.522658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c31c6a5a-4f76-42a8-bbfe-f4c70c8daadc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:21.523344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c31c6a5a-4f76-42a8-bbfe-f4c70c8daadc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:21.525742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c31c6a5a-4f76-42a8-bbfe-f4c70c8daadc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:21.526669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c31c6a5a-4f76-42a8-bbfe-f4c70c8daadc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:21.530693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c31c6a5a-4f76-42a8-bbfe-f4c70c8daadc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:21.532605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c31c6a5a-4f76-42a8-bbfe-f4c70c8daadc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:21.598999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:21.657069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aab1f47c-4f02-4d06-b933-b005872c37fe tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:21.674668 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aab1f47c-4f02-4d06-b933-b005872c37fe tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1506 microversion: 2.1 time: 0.565415 Oct 24 10:38:21.678729 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1589/3080] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:21 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1506 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:21.687862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-49500ce5-0fc3-4130-a447-daf7752e3887 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:21.703432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-49500ce5-0fc3-4130-a447-daf7752e3887 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:21.769837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49500ce5-0fc3-4130-a447-daf7752e3887 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:21.773377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49500ce5-0fc3-4130-a447-daf7752e3887 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:21.779752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49500ce5-0fc3-4130-a447-daf7752e3887 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:21.782454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49500ce5-0fc3-4130-a447-daf7752e3887 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:21.784032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49500ce5-0fc3-4130-a447-daf7752e3887 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:21.789380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49500ce5-0fc3-4130-a447-daf7752e3887 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:22.127873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-49500ce5-0fc3-4130-a447-daf7752e3887 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:22.141372 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-49500ce5-0fc3-4130-a447-daf7752e3887 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 200 len: 1277 microversion: 2.1 time: 0.457246 Oct 24 10:38:22.158662 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1590/3081] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:21 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 1277 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:22.170622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8aebf42b-a369-44a9-81d0-27f5080c1e5f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:22.175629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8aebf42b-a369-44a9-81d0-27f5080c1e5f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:22.323337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8aebf42b-a369-44a9-81d0-27f5080c1e5f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:22.332143 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8aebf42b-a369-44a9-81d0-27f5080c1e5f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1225 microversion: 2.1 time: 0.170549 Oct 24 10:38:22.334711 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1591/3082] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:22 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1225 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:22.345774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6c2c3144-88dd-41c1-bc94-e4852ecd21d1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:22.347921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6c2c3144-88dd-41c1-bc94-e4852ecd21d1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:22.365242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c2c3144-88dd-41c1-bc94-e4852ecd21d1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:22.366300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c2c3144-88dd-41c1-bc94-e4852ecd21d1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:22.367945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c2c3144-88dd-41c1-bc94-e4852ecd21d1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:22.370934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c2c3144-88dd-41c1-bc94-e4852ecd21d1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:22.373247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c2c3144-88dd-41c1-bc94-e4852ecd21d1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:22.373900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c2c3144-88dd-41c1-bc94-e4852ecd21d1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:22.519977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c31c6a5a-4f76-42a8-bbfe-f4c70c8daadc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:22.532156 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c31c6a5a-4f76-42a8-bbfe-f4c70c8daadc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 1.057954 Oct 24 10:38:22.551451 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1492/3083] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:21 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:22.566761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8a15bf71-14ca-4ee8-8366-560d6d914042 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:22.570022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8a15bf71-14ca-4ee8-8366-560d6d914042 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:22.584742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a15bf71-14ca-4ee8-8366-560d6d914042 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:22.585458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a15bf71-14ca-4ee8-8366-560d6d914042 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:22.586068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a15bf71-14ca-4ee8-8366-560d6d914042 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:22.588653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a15bf71-14ca-4ee8-8366-560d6d914042 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:22.590814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a15bf71-14ca-4ee8-8366-560d6d914042 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:22.591442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a15bf71-14ca-4ee8-8366-560d6d914042 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:22.674895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6c2c3144-88dd-41c1-bc94-e4852ecd21d1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:22.679947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8a15bf71-14ca-4ee8-8366-560d6d914042 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Unlocking {{(pid=120425) unlock /opt/stack/nova/nova/compute/api.py:4876}} Oct 24 10:38:22.687197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6c2c3144-88dd-41c1-bc94-e4852ecd21d1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:22.699734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6c2c3144-88dd-41c1-bc94-e4852ecd21d1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:22.718968 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6c2c3144-88dd-41c1-bc94-e4852ecd21d1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.382913 Oct 24 10:38:22.745080 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1592/3084] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:22 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:22.750363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-529969db-ce37-42e6-a130-8b8da53a93bd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:22.755895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-529969db-ce37-42e6-a130-8b8da53a93bd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:22.770362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-529969db-ce37-42e6-a130-8b8da53a93bd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:22.771196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-529969db-ce37-42e6-a130-8b8da53a93bd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:22.771856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-529969db-ce37-42e6-a130-8b8da53a93bd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:22.772772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-529969db-ce37-42e6-a130-8b8da53a93bd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:22.773453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-529969db-ce37-42e6-a130-8b8da53a93bd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:22.774099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-529969db-ce37-42e6-a130-8b8da53a93bd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:22.879919 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8a15bf71-14ca-4ee8-8366-560d6d914042 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 202 len: 0 microversion: 2.1 time: 0.320660 Oct 24 10:38:22.881907 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1493/3085] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:38:22 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:38:22.902217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09fee49b-4009-4ec3-b80f-a4cd8241e1ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:22.903871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09fee49b-4009-4ec3-b80f-a4cd8241e1ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:22.920828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09fee49b-4009-4ec3-b80f-a4cd8241e1ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:22.922611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09fee49b-4009-4ec3-b80f-a4cd8241e1ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:22.923355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09fee49b-4009-4ec3-b80f-a4cd8241e1ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:22.927072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09fee49b-4009-4ec3-b80f-a4cd8241e1ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:22.928970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09fee49b-4009-4ec3-b80f-a4cd8241e1ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:22.929613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09fee49b-4009-4ec3-b80f-a4cd8241e1ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:23.234695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-529969db-ce37-42e6-a130-8b8da53a93bd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:23.246973 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-529969db-ce37-42e6-a130-8b8da53a93bd tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1506 microversion: 2.1 time: 0.497382 Oct 24 10:38:23.249654 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1593/3086] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:22 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:23.280294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-26188ce5-2150-4402-a3aa-031895474b77 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:23.282789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-26188ce5-2150-4402-a3aa-031895474b77 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:23.302655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26188ce5-2150-4402-a3aa-031895474b77 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:23.303286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26188ce5-2150-4402-a3aa-031895474b77 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:23.303880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26188ce5-2150-4402-a3aa-031895474b77 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:23.304686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26188ce5-2150-4402-a3aa-031895474b77 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:23.305244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26188ce5-2150-4402-a3aa-031895474b77 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:23.305902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26188ce5-2150-4402-a3aa-031895474b77 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:23.967601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-09fee49b-4009-4ec3-b80f-a4cd8241e1ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:23.986635 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-09fee49b-4009-4ec3-b80f-a4cd8241e1ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 1.096243 Oct 24 10:38:23.990671 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1494/3087] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:22 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:24.003122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-278f8095-8b49-42e4-b1d1-613ae4b6e2fd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:24.011310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-278f8095-8b49-42e4-b1d1-613ae4b6e2fd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:24.030376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-278f8095-8b49-42e4-b1d1-613ae4b6e2fd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:24.033474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-278f8095-8b49-42e4-b1d1-613ae4b6e2fd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:24.035251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-278f8095-8b49-42e4-b1d1-613ae4b6e2fd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:24.041923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-278f8095-8b49-42e4-b1d1-613ae4b6e2fd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:24.043208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-278f8095-8b49-42e4-b1d1-613ae4b6e2fd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:24.044641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-278f8095-8b49-42e4-b1d1-613ae4b6e2fd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:24.385722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-278f8095-8b49-42e4-b1d1-613ae4b6e2fd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:24.396263 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-278f8095-8b49-42e4-b1d1-613ae4b6e2fd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1277 microversion: 2.1 time: 0.404036 Oct 24 10:38:24.429806 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1495/3088] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:23 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1277 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:24.443653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa41aff5-defb-46f5-8367-9c214fb90a9d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:24.449195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa41aff5-defb-46f5-8367-9c214fb90a9d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:24.469926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-26188ce5-2150-4402-a3aa-031895474b77 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:24.473830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa41aff5-defb-46f5-8367-9c214fb90a9d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:24.474333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa41aff5-defb-46f5-8367-9c214fb90a9d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:24.474780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa41aff5-defb-46f5-8367-9c214fb90a9d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:24.475512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa41aff5-defb-46f5-8367-9c214fb90a9d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:24.480480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa41aff5-defb-46f5-8367-9c214fb90a9d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:24.481037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa41aff5-defb-46f5-8367-9c214fb90a9d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:24.513649 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-26188ce5-2150-4402-a3aa-031895474b77 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 200 len: 1319 microversion: 2.1 time: 1.232430 Oct 24 10:38:24.517171 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1594/3089] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:23 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 1319 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:24.527428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-11aac132-4090-4c10-9510-8a6e0e47343e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:24.528061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-11aac132-4090-4c10-9510-8a6e0e47343e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:24.551071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11aac132-4090-4c10-9510-8a6e0e47343e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:24.553618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11aac132-4090-4c10-9510-8a6e0e47343e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:24.555051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11aac132-4090-4c10-9510-8a6e0e47343e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:24.557698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11aac132-4090-4c10-9510-8a6e0e47343e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:24.563353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11aac132-4090-4c10-9510-8a6e0e47343e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:24.564150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11aac132-4090-4c10-9510-8a6e0e47343e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:24.821951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa41aff5-defb-46f5-8367-9c214fb90a9d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:24.843556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa41aff5-defb-46f5-8367-9c214fb90a9d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:24.852817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa41aff5-defb-46f5-8367-9c214fb90a9d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:24.869866 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa41aff5-defb-46f5-8367-9c214fb90a9d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.435576 Oct 24 10:38:24.893425 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1496/3090] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:24 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:24.912902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fe73cf55-4bf0-4816-bf0d-f44c69a3ea75 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:24.929800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fe73cf55-4bf0-4816-bf0d-f44c69a3ea75 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:24.937480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:24.953748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe73cf55-4bf0-4816-bf0d-f44c69a3ea75 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:24.954629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe73cf55-4bf0-4816-bf0d-f44c69a3ea75 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:24.955308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe73cf55-4bf0-4816-bf0d-f44c69a3ea75 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:24.956299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe73cf55-4bf0-4816-bf0d-f44c69a3ea75 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:24.957263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe73cf55-4bf0-4816-bf0d-f44c69a3ea75 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:24.957974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe73cf55-4bf0-4816-bf0d-f44c69a3ea75 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:25.025562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-11aac132-4090-4c10-9510-8a6e0e47343e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:25.038780 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-11aac132-4090-4c10-9510-8a6e0e47343e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.520456 Oct 24 10:38:25.055882 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1595/3091] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:24 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:25.077225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-33b3eb10-4b42-466c-be30-eea1e25b2f5e req-42882ec0-1d2b-41a0-bc07-6f83cbf8537f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "665a2c20-ef11-4810-ac96-2f122fac8fe0", "tag": "a3161b7b-9b11-409b-90be-1243d8ca4b72"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:25.099898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-33b3eb10-4b42-466c-be30-eea1e25b2f5e req-42882ec0-1d2b-41a0-bc07-6f83cbf8537f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:25.105343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-33b3eb10-4b42-466c-be30-eea1e25b2f5e req-42882ec0-1d2b-41a0-bc07-6f83cbf8537f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:25.106935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-33b3eb10-4b42-466c-be30-eea1e25b2f5e req-42882ec0-1d2b-41a0-bc07-6f83cbf8537f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:25.149912 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-33b3eb10-4b42-466c-be30-eea1e25b2f5e req-42882ec0-1d2b-41a0-bc07-6f83cbf8537f service nova] Creating event network-changed:a3161b7b-9b11-409b-90be-1243d8ca4b72 for instance 665a2c20-ef11-4810-ac96-2f122fac8fe0 on n-h1-858383-15 Oct 24 10:38:25.163743 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-33b3eb10-4b42-466c-be30-eea1e25b2f5e req-42882ec0-1d2b-41a0-bc07-6f83cbf8537f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096221 Oct 24 10:38:25.183525 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1596/3092] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:25.198998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ccdafc01-3705-48be-a959-57b83dfd6df3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:25.199727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ccdafc01-3705-48be-a959-57b83dfd6df3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:25.223811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ccdafc01-3705-48be-a959-57b83dfd6df3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:25.229220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ccdafc01-3705-48be-a959-57b83dfd6df3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:25.230139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ccdafc01-3705-48be-a959-57b83dfd6df3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:25.231139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ccdafc01-3705-48be-a959-57b83dfd6df3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:25.232151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ccdafc01-3705-48be-a959-57b83dfd6df3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:25.233777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ccdafc01-3705-48be-a959-57b83dfd6df3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:25.489520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fe73cf55-4bf0-4816-bf0d-f44c69a3ea75 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:25.503469 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fe73cf55-4bf0-4816-bf0d-f44c69a3ea75 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1506 microversion: 2.1 time: 0.604187 Oct 24 10:38:25.506837 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1497/3093] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:24 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1506 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:25.524164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e10a8aa5-021f-470c-a2ba-3ce21d6a3eb8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:25.528491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e10a8aa5-021f-470c-a2ba-3ce21d6a3eb8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:25.542097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e10a8aa5-021f-470c-a2ba-3ce21d6a3eb8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:25.542871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e10a8aa5-021f-470c-a2ba-3ce21d6a3eb8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:25.544126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e10a8aa5-021f-470c-a2ba-3ce21d6a3eb8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:25.545275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e10a8aa5-021f-470c-a2ba-3ce21d6a3eb8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:25.545945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e10a8aa5-021f-470c-a2ba-3ce21d6a3eb8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:25.546785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e10a8aa5-021f-470c-a2ba-3ce21d6a3eb8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:25.922070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ccdafc01-3705-48be-a959-57b83dfd6df3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:25.931019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e10a8aa5-021f-470c-a2ba-3ce21d6a3eb8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:25.935721 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ccdafc01-3705-48be-a959-57b83dfd6df3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.746705 Oct 24 10:38:25.936781 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1597/3094] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:25 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:25.944359 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e10a8aa5-021f-470c-a2ba-3ce21d6a3eb8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1285 microversion: 2.1 time: 0.435421 Oct 24 10:38:25.947374 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1498/3095] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:25 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1285 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:25.958084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2b4dfdb2-fd2d-4e8b-b654-847110c4a4f1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:25.961319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2b4dfdb2-fd2d-4e8b-b654-847110c4a4f1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:25.968089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8c82cbc7-19fb-4216-812b-2077bf250861 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-513934494", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "14269a3f-cd0c-43c0-b31b-06c23cce5c4c"}, {"port": "00f84ee5-49b5-45e0-85df-7a095215e973", "tag": "port-1"}, {"port": "5c925253-c5f1-4fd7-94c7-b873209b466a", "tag": "port-2"}, {"uuid": "31faf487-18c8-47ad-84db-92cbdaa60e31", "tag": "net-1"}, {"uuid": "31faf487-18c8-47ad-84db-92cbdaa60e31"}, {"uuid": "9e17e0a6-4418-4d1e-aad8-1de539b68cc9", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "9e17e0a6-4418-4d1e-aad8-1de539b68cc9", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ddaa2b75-6cef-448e-8d13-dc1d963687c1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "d489e002-a472-4b7a-84ef-4cce98fe25f2", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "33f62db4-69c7-43a9-9df1-77610ac73fdb", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--561921727"}], "key_name": "tempest-keypair-1363163816", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:25.981107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b4dfdb2-fd2d-4e8b-b654-847110c4a4f1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:25.981942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b4dfdb2-fd2d-4e8b-b654-847110c4a4f1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:25.982647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b4dfdb2-fd2d-4e8b-b654-847110c4a4f1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:25.985720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b4dfdb2-fd2d-4e8b-b654-847110c4a4f1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:25.988004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b4dfdb2-fd2d-4e8b-b654-847110c4a4f1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:25.989858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b4dfdb2-fd2d-4e8b-b654-847110c4a4f1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:26.373775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-8c82cbc7-19fb-4216-812b-2077bf250861 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] validate_networks() for [('14269a3f-cd0c-43c0-b31b-06c23cce5c4c', None, None, None, None, None), (None, None, '00f84ee5-49b5-45e0-85df-7a095215e973', None, None, None), (None, None, '5c925253-c5f1-4fd7-94c7-b873209b466a', None, None, None), ('31faf487-18c8-47ad-84db-92cbdaa60e31', None, None, None, None, None), ('31faf487-18c8-47ad-84db-92cbdaa60e31', None, None, None, None, None), ('9e17e0a6-4418-4d1e-aad8-1de539b68cc9', '10.2.2.100', None, None, None, None), ('9e17e0a6-4418-4d1e-aad8-1de539b68cc9', '10.2.2.200', None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:38:26.422510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:27.255640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2b4dfdb2-fd2d-4e8b-b654-847110c4a4f1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:27.284911 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2b4dfdb2-fd2d-4e8b-b654-847110c4a4f1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 200 len: 1319 microversion: 2.1 time: 1.322707 Oct 24 10:38:27.285595 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1499/3096] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:25 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 1319 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:27.299890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f5477830-dac8-49ec-9607-9be3535508f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:27.321747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f5477830-dac8-49ec-9607-9be3535508f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:27.337723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5477830-dac8-49ec-9607-9be3535508f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:27.339353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5477830-dac8-49ec-9607-9be3535508f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:27.341797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5477830-dac8-49ec-9607-9be3535508f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:27.343028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5477830-dac8-49ec-9607-9be3535508f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:27.347862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5477830-dac8-49ec-9607-9be3535508f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:27.348636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5477830-dac8-49ec-9607-9be3535508f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:27.566024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f5477830-dac8-49ec-9607-9be3535508f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:27.584995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f5477830-dac8-49ec-9607-9be3535508f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:27.587016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f5477830-dac8-49ec-9607-9be3535508f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:27.601541 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f5477830-dac8-49ec-9607-9be3535508f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.313001 Oct 24 10:38:27.629733 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1500/3097] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:27 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:27.636502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-97d5b60c-6732-48ef-94e0-f5b4aaea2b75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:27.645751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-97d5b60c-6732-48ef-94e0-f5b4aaea2b75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:27.662086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97d5b60c-6732-48ef-94e0-f5b4aaea2b75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:27.663467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97d5b60c-6732-48ef-94e0-f5b4aaea2b75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:27.665543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97d5b60c-6732-48ef-94e0-f5b4aaea2b75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:27.666751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97d5b60c-6732-48ef-94e0-f5b4aaea2b75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:27.673838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97d5b60c-6732-48ef-94e0-f5b4aaea2b75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:27.674750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97d5b60c-6732-48ef-94e0-f5b4aaea2b75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:27.827533 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-97d5b60c-6732-48ef-94e0-f5b4aaea2b75 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 202 len: 0 microversion: 2.1 time: 0.195320 Oct 24 10:38:27.833332 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1501/3098] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:38:27 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:38:27.850986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ca2f6fd-a63d-4cbb-a430-30939f199c70 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-991634295", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "cede900e-37fd-48b5-8a72-90d83af395cc"}, {"uuid": "c784ae1c-8e48-4f13-b9e4-3f8699e689ca"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:27.999465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-2ca2f6fd-a63d-4cbb-a430-30939f199c70 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] validate_networks() for [('cede900e-37fd-48b5-8a72-90d83af395cc', None, None, None, None, None), ('c784ae1c-8e48-4f13-b9e4-3f8699e689ca', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:38:31.098275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2ca2f6fd-a63d-4cbb-a430-30939f199c70 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:38:31.100059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2ca2f6fd-a63d-4cbb-a430-30939f199c70 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:38:31.101181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2ca2f6fd-a63d-4cbb-a430-30939f199c70 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:38:31.102477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2ca2f6fd-a63d-4cbb-a430-30939f199c70 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:38:31.104374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2ca2f6fd-a63d-4cbb-a430-30939f199c70 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:38:31.130370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ca2f6fd-a63d-4cbb-a430-30939f199c70 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:31.131278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ca2f6fd-a63d-4cbb-a430-30939f199c70 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:31.132139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ca2f6fd-a63d-4cbb-a430-30939f199c70 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:31.141370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ca2f6fd-a63d-4cbb-a430-30939f199c70 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:31.142456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ca2f6fd-a63d-4cbb-a430-30939f199c70 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:31.143294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ca2f6fd-a63d-4cbb-a430-30939f199c70 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:31.214327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-2ca2f6fd-a63d-4cbb-a430-30939f199c70 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Getting quotas for project 19a51abc0b7c4b01ad379e50663a2000. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:38:31.232078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-2ca2f6fd-a63d-4cbb-a430-30939f199c70 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Getting quotas for user 83d2c201d9e348c8a2ff17525693a3ab and project 19a51abc0b7c4b01ad379e50663a2000. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:38:31.297994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ca2f6fd-a63d-4cbb-a430-30939f199c70 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:38:31.308013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ca2f6fd-a63d-4cbb-a430-30939f199c70 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:38:31.445853 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ca2f6fd-a63d-4cbb-a430-30939f199c70 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.610754 Oct 24 10:38:31.446704 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1502/3099] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:38:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:38:31.465842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4e262915-97a5-47f4-892e-e7510da403aa tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:31.467209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4e262915-97a5-47f4-892e-e7510da403aa tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:31.476075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e262915-97a5-47f4-892e-e7510da403aa tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:31.477181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e262915-97a5-47f4-892e-e7510da403aa tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:31.478477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e262915-97a5-47f4-892e-e7510da403aa tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:31.479716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e262915-97a5-47f4-892e-e7510da403aa tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:31.480746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e262915-97a5-47f4-892e-e7510da403aa tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:31.481478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e262915-97a5-47f4-892e-e7510da403aa tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:32.340290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=16 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:32.452161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4e262915-97a5-47f4-892e-e7510da403aa tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:32.464192 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4e262915-97a5-47f4-892e-e7510da403aa tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1506 microversion: 2.1 time: 1.014034 Oct 24 10:38:32.465165 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1503/3100] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:31 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1506 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:32.474976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2f7c9ac1-2cff-43c6-832f-90ef0a3ca0f4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:32.480366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2f7c9ac1-2cff-43c6-832f-90ef0a3ca0f4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:32.487502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f7c9ac1-2cff-43c6-832f-90ef0a3ca0f4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:32.497621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f7c9ac1-2cff-43c6-832f-90ef0a3ca0f4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:32.498365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f7c9ac1-2cff-43c6-832f-90ef0a3ca0f4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:32.499326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f7c9ac1-2cff-43c6-832f-90ef0a3ca0f4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:32.499787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f7c9ac1-2cff-43c6-832f-90ef0a3ca0f4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:32.500222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f7c9ac1-2cff-43c6-832f-90ef0a3ca0f4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:32.929802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2f7c9ac1-2cff-43c6-832f-90ef0a3ca0f4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:32.939137 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2f7c9ac1-2cff-43c6-832f-90ef0a3ca0f4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1325 microversion: 2.1 time: 0.472003 Oct 24 10:38:32.940610 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1504/3101] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:32 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1325 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:32.946312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-89e502cd-3e5e-458d-b695-a5ffb807736a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:32.947257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-89e502cd-3e5e-458d-b695-a5ffb807736a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:32.954496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89e502cd-3e5e-458d-b695-a5ffb807736a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:32.955206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89e502cd-3e5e-458d-b695-a5ffb807736a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:32.955804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89e502cd-3e5e-458d-b695-a5ffb807736a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:32.956681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89e502cd-3e5e-458d-b695-a5ffb807736a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:32.957342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89e502cd-3e5e-458d-b695-a5ffb807736a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:32.957935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89e502cd-3e5e-458d-b695-a5ffb807736a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:33.819864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-89e502cd-3e5e-458d-b695-a5ffb807736a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:33.827811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:33.836509 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-89e502cd-3e5e-458d-b695-a5ffb807736a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1656 microversion: 2.1 time: 0.893750 Oct 24 10:38:33.838538 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1505/3102] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:32 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1656 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:33.849714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-03fb604b-d5e7-461d-b551-6552007b4814 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:33.851217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-03fb604b-d5e7-461d-b551-6552007b4814 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:33.871474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03fb604b-d5e7-461d-b551-6552007b4814 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:33.872459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03fb604b-d5e7-461d-b551-6552007b4814 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:33.873169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03fb604b-d5e7-461d-b551-6552007b4814 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:33.874231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03fb604b-d5e7-461d-b551-6552007b4814 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:33.874908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03fb604b-d5e7-461d-b551-6552007b4814 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:33.875592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03fb604b-d5e7-461d-b551-6552007b4814 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:34.225708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-03fb604b-d5e7-461d-b551-6552007b4814 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:34.247566 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-03fb604b-d5e7-461d-b551-6552007b4814 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 200 len: 1319 microversion: 2.1 time: 0.406865 Oct 24 10:38:34.248930 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1506/3103] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:33 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:34.271073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be1b5306-d873-4c3e-ae1c-dafd6d2f2a7d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:34.271994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-be1b5306-d873-4c3e-ae1c-dafd6d2f2a7d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:34.280523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be1b5306-d873-4c3e-ae1c-dafd6d2f2a7d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:34.281390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be1b5306-d873-4c3e-ae1c-dafd6d2f2a7d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:34.282116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be1b5306-d873-4c3e-ae1c-dafd6d2f2a7d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:34.283217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be1b5306-d873-4c3e-ae1c-dafd6d2f2a7d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:34.283934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be1b5306-d873-4c3e-ae1c-dafd6d2f2a7d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:34.284605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be1b5306-d873-4c3e-ae1c-dafd6d2f2a7d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:34.403272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-be1b5306-d873-4c3e-ae1c-dafd6d2f2a7d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:34.419478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-be1b5306-d873-4c3e-ae1c-dafd6d2f2a7d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:34.422114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-be1b5306-d873-4c3e-ae1c-dafd6d2f2a7d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:34.428239 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-be1b5306-d873-4c3e-ae1c-dafd6d2f2a7d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.177924 Oct 24 10:38:34.428581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8c82cbc7-19fb-4216-812b-2077bf250861 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:38:34.429167 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1507/3104] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:34 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:34.442144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c6e4df35-aa23-4d69-9274-7863bead2043 req-ac527b74-0bd9-4158-941a-84ff227906c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f024708-057e-4eda-9894-fb480a85c693", "tag": "69109537-4e24-42aa-9a6d-200c27c96bbc"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:34.444553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8c82cbc7-19fb-4216-812b-2077bf250861 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:38:34.445385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8c82cbc7-19fb-4216-812b-2077bf250861 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:38:34.446209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8c82cbc7-19fb-4216-812b-2077bf250861 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:38:34.452049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8c82cbc7-19fb-4216-812b-2077bf250861 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:38:34.456279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c6e4df35-aa23-4d69-9274-7863bead2043 req-ac527b74-0bd9-4158-941a-84ff227906c1 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:34.456798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c6e4df35-aa23-4d69-9274-7863bead2043 req-ac527b74-0bd9-4158-941a-84ff227906c1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:34.457449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c6e4df35-aa23-4d69-9274-7863bead2043 req-ac527b74-0bd9-4158-941a-84ff227906c1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:34.464204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c82cbc7-19fb-4216-812b-2077bf250861 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:34.467233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c82cbc7-19fb-4216-812b-2077bf250861 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:34.467906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c82cbc7-19fb-4216-812b-2077bf250861 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:34.470873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c82cbc7-19fb-4216-812b-2077bf250861 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:34.473042 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c6e4df35-aa23-4d69-9274-7863bead2043 req-ac527b74-0bd9-4158-941a-84ff227906c1 service nova] Creating event network-changed:69109537-4e24-42aa-9a6d-200c27c96bbc for instance 2f024708-057e-4eda-9894-fb480a85c693 on n-h2-858383-15 Oct 24 10:38:34.480483 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c6e4df35-aa23-4d69-9274-7863bead2043 req-ac527b74-0bd9-4158-941a-84ff227906c1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049716 Oct 24 10:38:34.481745 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1508/3105] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:34.488271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-8565ddca-98a8-4018-b44e-77870027e492 req-d54134d5-baeb-458d-a2be-452a2bacc38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1095b21-85ef-46b9-b67c-fcfc5c4f38c1", "tag": "044f4eed-9250-4d71-b78a-ec50886a1625"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:34.488922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c82cbc7-19fb-4216-812b-2077bf250861 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:34.489527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c82cbc7-19fb-4216-812b-2077bf250861 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:34.500158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8565ddca-98a8-4018-b44e-77870027e492 req-d54134d5-baeb-458d-a2be-452a2bacc38b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:34.501062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8565ddca-98a8-4018-b44e-77870027e492 req-d54134d5-baeb-458d-a2be-452a2bacc38b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:34.501685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8565ddca-98a8-4018-b44e-77870027e492 req-d54134d5-baeb-458d-a2be-452a2bacc38b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:34.517056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-8c82cbc7-19fb-4216-812b-2077bf250861 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Getting quotas for project 2eb64e6d84904f1083116b5aed79f7f2. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:38:34.523429 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-8565ddca-98a8-4018-b44e-77870027e492 req-d54134d5-baeb-458d-a2be-452a2bacc38b service nova] Creating event network-changed:044f4eed-9250-4d71-b78a-ec50886a1625 for instance d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 on n-h1-858383-15 Oct 24 10:38:34.524160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-8c82cbc7-19fb-4216-812b-2077bf250861 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Getting quotas for user 6052fe343c86452f9183b383fcc85183 and project 2eb64e6d84904f1083116b5aed79f7f2. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:38:34.538694 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-8565ddca-98a8-4018-b44e-77870027e492 req-d54134d5-baeb-458d-a2be-452a2bacc38b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055322 Oct 24 10:38:34.539845 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1509/3106] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:34.546495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-778b4b5b-1957-4ddb-b8bd-2c9a3a5ac002 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:34.547275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-778b4b5b-1957-4ddb-b8bd-2c9a3a5ac002 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:34.554120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-778b4b5b-1957-4ddb-b8bd-2c9a3a5ac002 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:34.554690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-778b4b5b-1957-4ddb-b8bd-2c9a3a5ac002 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:34.555200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-778b4b5b-1957-4ddb-b8bd-2c9a3a5ac002 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:34.556975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-778b4b5b-1957-4ddb-b8bd-2c9a3a5ac002 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:34.557573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-778b4b5b-1957-4ddb-b8bd-2c9a3a5ac002 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:34.558073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-778b4b5b-1957-4ddb-b8bd-2c9a3a5ac002 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:34.647625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-778b4b5b-1957-4ddb-b8bd-2c9a3a5ac002 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:34.656956 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-778b4b5b-1957-4ddb-b8bd-2c9a3a5ac002 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1282 microversion: 2.1 time: 0.114538 Oct 24 10:38:34.657724 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1510/3107] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:34 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1282 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:34.662395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be88c0cb-2b3e-49ab-a868-822a716ec558 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:34.663014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-be88c0cb-2b3e-49ab-a868-822a716ec558 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:34.675131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be88c0cb-2b3e-49ab-a868-822a716ec558 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:34.675869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be88c0cb-2b3e-49ab-a868-822a716ec558 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:34.676323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be88c0cb-2b3e-49ab-a868-822a716ec558 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:34.677300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be88c0cb-2b3e-49ab-a868-822a716ec558 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:34.677772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be88c0cb-2b3e-49ab-a868-822a716ec558 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:34.678208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be88c0cb-2b3e-49ab-a868-822a716ec558 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:34.768077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8c82cbc7-19fb-4216-812b-2077bf250861 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:38:34.771050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8c82cbc7-19fb-4216-812b-2077bf250861 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ddaa2b75-6cef-448e-8d13-dc1d963687c1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d489e002-a472-4b7a-84ef-4cce98fe25f2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='33f62db4-69c7-43a9-9df1-77610ac73fdb',volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:38:34.836007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-be88c0cb-2b3e-49ab-a868-822a716ec558 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:34.844663 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-be88c0cb-2b3e-49ab-a868-822a716ec558 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1506 microversion: 2.1 time: 0.185737 Oct 24 10:38:34.857548 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1511/3108] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:34 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:34.867119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d8959a8e-11a8-45e9-a503-eb53c7ac34a1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:34.868071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d8959a8e-11a8-45e9-a503-eb53c7ac34a1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:34.874940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8959a8e-11a8-45e9-a503-eb53c7ac34a1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:34.875311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8959a8e-11a8-45e9-a503-eb53c7ac34a1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:34.875782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8959a8e-11a8-45e9-a503-eb53c7ac34a1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:34.876562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8959a8e-11a8-45e9-a503-eb53c7ac34a1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:34.877062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8959a8e-11a8-45e9-a503-eb53c7ac34a1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:34.885334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8959a8e-11a8-45e9-a503-eb53c7ac34a1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:34.970049 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d8959a8e-11a8-45e9-a503-eb53c7ac34a1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 202 len: 0 microversion: 2.1 time: 0.111016 Oct 24 10:38:34.971328 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1512/3109] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:38:34 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:38:34.978874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b718196f-5fab-4535-b3db-4c5f5bea1015 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:34.979854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b718196f-5fab-4535-b3db-4c5f5bea1015 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:34.989501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b718196f-5fab-4535-b3db-4c5f5bea1015 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:34.990009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b718196f-5fab-4535-b3db-4c5f5bea1015 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:34.990453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b718196f-5fab-4535-b3db-4c5f5bea1015 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:34.991202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b718196f-5fab-4535-b3db-4c5f5bea1015 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:34.991665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b718196f-5fab-4535-b3db-4c5f5bea1015 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:34.992099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b718196f-5fab-4535-b3db-4c5f5bea1015 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:35.238536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b718196f-5fab-4535-b3db-4c5f5bea1015 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:35.248932 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b718196f-5fab-4535-b3db-4c5f5bea1015 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1325 microversion: 2.1 time: 0.275395 Oct 24 10:38:35.250239 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1513/3110] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:34 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1325 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:35.256762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fcdabf1f-2b8e-454a-a02d-4f512a17105e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:35.257669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fcdabf1f-2b8e-454a-a02d-4f512a17105e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:35.271343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcdabf1f-2b8e-454a-a02d-4f512a17105e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:35.273059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcdabf1f-2b8e-454a-a02d-4f512a17105e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:35.275407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcdabf1f-2b8e-454a-a02d-4f512a17105e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:35.278476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcdabf1f-2b8e-454a-a02d-4f512a17105e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:35.280360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcdabf1f-2b8e-454a-a02d-4f512a17105e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:35.284552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcdabf1f-2b8e-454a-a02d-4f512a17105e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:35.291769 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8c82cbc7-19fb-4216-812b-2077bf250861 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 9.353616 Oct 24 10:38:35.293167 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1598/3111] 10.222.0.50 () {62 vars in 1189 bytes} [Mon Oct 24 10:38:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 9356 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 10:38:35.300399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ee3083c7-6fc5-4231-84cc-29ee1c88f383 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:35.301377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ee3083c7-6fc5-4231-84cc-29ee1c88f383 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:35.310083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee3083c7-6fc5-4231-84cc-29ee1c88f383 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:35.310859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee3083c7-6fc5-4231-84cc-29ee1c88f383 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:35.311521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee3083c7-6fc5-4231-84cc-29ee1c88f383 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:35.312593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee3083c7-6fc5-4231-84cc-29ee1c88f383 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:35.313285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee3083c7-6fc5-4231-84cc-29ee1c88f383 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:35.313929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee3083c7-6fc5-4231-84cc-29ee1c88f383 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:35.319392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:35.625375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fcdabf1f-2b8e-454a-a02d-4f512a17105e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:35.635202 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fcdabf1f-2b8e-454a-a02d-4f512a17105e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1663 microversion: 2.1 time: 0.383317 Oct 24 10:38:35.636104 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1514/3112] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:35 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1663 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:35.640967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-59f5101a-041b-46bb-b9a2-53502a821707 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:35.642018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-59f5101a-041b-46bb-b9a2-53502a821707 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:35.733858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-59f5101a-041b-46bb-b9a2-53502a821707 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:35.738861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ee3083c7-6fc5-4231-84cc-29ee1c88f383 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:35.743214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-59f5101a-041b-46bb-b9a2-53502a821707 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:35.746310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-59f5101a-041b-46bb-b9a2-53502a821707 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:35.748313 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-59f5101a-041b-46bb-b9a2-53502a821707 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1285 microversion: 2.32 time: 0.111085 Oct 24 10:38:35.749789 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1515/3113] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:35 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:35.756004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9016af9f-e9ca-4f3b-b0c0-1a448c36c562 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:35.756856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9016af9f-e9ca-4f3b-b0c0-1a448c36c562 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:35.763850 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ee3083c7-6fc5-4231-84cc-29ee1c88f383 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 200 len: 1319 microversion: 2.1 time: 0.469083 Oct 24 10:38:35.765873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9016af9f-e9ca-4f3b-b0c0-1a448c36c562 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:35.766593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9016af9f-e9ca-4f3b-b0c0-1a448c36c562 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:35.767237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9016af9f-e9ca-4f3b-b0c0-1a448c36c562 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:35.768407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9016af9f-e9ca-4f3b-b0c0-1a448c36c562 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:35.769077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9016af9f-e9ca-4f3b-b0c0-1a448c36c562 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:35.769748 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1599/3114] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:35 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:35.770376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9016af9f-e9ca-4f3b-b0c0-1a448c36c562 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:35.785540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-8b8539e1-1e45-44ca-ad05-31805c222372 req-af9f31b6-8219-4fe9-977b-2b0867341ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "665a2c20-ef11-4810-ac96-2f122fac8fe0", "name": "network-vif-plugged", "status": "completed", "tag": "a3161b7b-9b11-409b-90be-1243d8ca4b72"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:35.800440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8b8539e1-1e45-44ca-ad05-31805c222372 req-af9f31b6-8219-4fe9-977b-2b0867341ffe service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:35.801065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8b8539e1-1e45-44ca-ad05-31805c222372 req-af9f31b6-8219-4fe9-977b-2b0867341ffe service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:35.801571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8b8539e1-1e45-44ca-ad05-31805c222372 req-af9f31b6-8219-4fe9-977b-2b0867341ffe service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:35.820616 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-8b8539e1-1e45-44ca-ad05-31805c222372 req-af9f31b6-8219-4fe9-977b-2b0867341ffe service nova] Creating event network-vif-plugged:a3161b7b-9b11-409b-90be-1243d8ca4b72 for instance 665a2c20-ef11-4810-ac96-2f122fac8fe0 on n-h1-858383-15 Oct 24 10:38:35.827955 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-8b8539e1-1e45-44ca-ad05-31805c222372 req-af9f31b6-8219-4fe9-977b-2b0867341ffe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056766 Oct 24 10:38:35.829270 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1600/3115] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:35.836673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d431138-55a6-4695-a143-9f007afb16b2 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:35.837915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2d431138-55a6-4695-a143-9f007afb16b2 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:35.844603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d431138-55a6-4695-a143-9f007afb16b2 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:35.845452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d431138-55a6-4695-a143-9f007afb16b2 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:35.846148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d431138-55a6-4695-a143-9f007afb16b2 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:35.847341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d431138-55a6-4695-a143-9f007afb16b2 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:35.847804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d431138-55a6-4695-a143-9f007afb16b2 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:35.848236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d431138-55a6-4695-a143-9f007afb16b2 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:35.849058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9016af9f-e9ca-4f3b-b0c0-1a448c36c562 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:35.860729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9016af9f-e9ca-4f3b-b0c0-1a448c36c562 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:35.862613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9016af9f-e9ca-4f3b-b0c0-1a448c36c562 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:35.870037 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9016af9f-e9ca-4f3b-b0c0-1a448c36c562 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.118729 Oct 24 10:38:35.871294 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1516/3116] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:35 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:35.876338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68896ec7-a338-4da2-b0ee-89118162a1ed tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:35.876986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-68896ec7-a338-4da2-b0ee-89118162a1ed tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:35.894336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68896ec7-a338-4da2-b0ee-89118162a1ed tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:35.894834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68896ec7-a338-4da2-b0ee-89118162a1ed tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:35.895335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68896ec7-a338-4da2-b0ee-89118162a1ed tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:35.896130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68896ec7-a338-4da2-b0ee-89118162a1ed tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:35.904357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68896ec7-a338-4da2-b0ee-89118162a1ed tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:35.905139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68896ec7-a338-4da2-b0ee-89118162a1ed tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:35.924518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2d431138-55a6-4695-a143-9f007afb16b2 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:35.934767 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2d431138-55a6-4695-a143-9f007afb16b2 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1282 microversion: 2.1 time: 0.103979 Oct 24 10:38:35.935662 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1601/3117] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:35 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1282 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:36.136312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-68896ec7-a338-4da2-b0ee-89118162a1ed tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:36.145278 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-68896ec7-a338-4da2-b0ee-89118162a1ed tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1506 microversion: 2.1 time: 0.272516 Oct 24 10:38:36.146076 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1517/3118] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:35 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:36.276354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f4cfcf38-82ee-4902-a1b9-507d1fddfe42 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:36.277252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f4cfcf38-82ee-4902-a1b9-507d1fddfe42 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:36.286802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4cfcf38-82ee-4902-a1b9-507d1fddfe42 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:36.291083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4cfcf38-82ee-4902-a1b9-507d1fddfe42 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:36.291739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4cfcf38-82ee-4902-a1b9-507d1fddfe42 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:36.293395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4cfcf38-82ee-4902-a1b9-507d1fddfe42 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:36.295990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4cfcf38-82ee-4902-a1b9-507d1fddfe42 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:36.296630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4cfcf38-82ee-4902-a1b9-507d1fddfe42 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:36.511681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-0f379abd-4084-4734-b47d-e857479385b3 req-01745136-6f05-4878-8d65-dffb4957305a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7aeb942-aab8-4051-b5ac-b4cab02dc9d0", "tag": "60451826-6729-43c6-9b77-3e8ecaa7c65d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:36.532956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0f379abd-4084-4734-b47d-e857479385b3 req-01745136-6f05-4878-8d65-dffb4957305a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:36.533350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0f379abd-4084-4734-b47d-e857479385b3 req-01745136-6f05-4878-8d65-dffb4957305a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:36.533803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0f379abd-4084-4734-b47d-e857479385b3 req-01745136-6f05-4878-8d65-dffb4957305a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:36.546879 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-0f379abd-4084-4734-b47d-e857479385b3 req-01745136-6f05-4878-8d65-dffb4957305a service nova] Creating event network-changed:60451826-6729-43c6-9b77-3e8ecaa7c65d for instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 on n-h2-858383-15 Oct 24 10:38:36.554568 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-0f379abd-4084-4734-b47d-e857479385b3 req-01745136-6f05-4878-8d65-dffb4957305a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050179 Oct 24 10:38:36.556439 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1518/3119] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:36.656972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f4cfcf38-82ee-4902-a1b9-507d1fddfe42 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:36.666102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00d5f340-1c20-4e6d-94de-b40bd8eed2a4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:36.667621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00d5f340-1c20-4e6d-94de-b40bd8eed2a4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:36.691205 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f4cfcf38-82ee-4902-a1b9-507d1fddfe42 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1325 microversion: 2.1 time: 0.414566 Oct 24 10:38:36.693671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00d5f340-1c20-4e6d-94de-b40bd8eed2a4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:36.693903 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1602/3120] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:36 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1325 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:36.714696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00d5f340-1c20-4e6d-94de-b40bd8eed2a4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:36.715792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00d5f340-1c20-4e6d-94de-b40bd8eed2a4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:36.718219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00d5f340-1c20-4e6d-94de-b40bd8eed2a4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:36.718969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00d5f340-1c20-4e6d-94de-b40bd8eed2a4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:36.719690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00d5f340-1c20-4e6d-94de-b40bd8eed2a4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:36.780537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8c38fb70-2897-419a-8769-2d263c4f6a16 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:36.781342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8c38fb70-2897-419a-8769-2d263c4f6a16 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:36.795718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c38fb70-2897-419a-8769-2d263c4f6a16 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:36.797160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c38fb70-2897-419a-8769-2d263c4f6a16 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:36.797603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c38fb70-2897-419a-8769-2d263c4f6a16 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:36.799682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c38fb70-2897-419a-8769-2d263c4f6a16 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:36.805153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c38fb70-2897-419a-8769-2d263c4f6a16 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:36.805721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c38fb70-2897-419a-8769-2d263c4f6a16 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:36.967737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8c38fb70-2897-419a-8769-2d263c4f6a16 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:36.988361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8c38fb70-2897-419a-8769-2d263c4f6a16 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:36.990564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8c38fb70-2897-419a-8769-2d263c4f6a16 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:36.993405 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8c38fb70-2897-419a-8769-2d263c4f6a16 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1519 microversion: 2.32 time: 0.217184 Oct 24 10:38:37.005870 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1603/3121] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:36 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:37.027196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-abd1f483-4023-49e7-a921-09daeb6e205b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:37.027980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-abd1f483-4023-49e7-a921-09daeb6e205b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:37.032406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:37.038198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abd1f483-4023-49e7-a921-09daeb6e205b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:37.038921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abd1f483-4023-49e7-a921-09daeb6e205b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:37.039675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abd1f483-4023-49e7-a921-09daeb6e205b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:37.040770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abd1f483-4023-49e7-a921-09daeb6e205b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:37.041516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abd1f483-4023-49e7-a921-09daeb6e205b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:37.042174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abd1f483-4023-49e7-a921-09daeb6e205b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:37.167521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-00d5f340-1c20-4e6d-94de-b40bd8eed2a4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:37.181692 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-00d5f340-1c20-4e6d-94de-b40bd8eed2a4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.522691 Oct 24 10:38:37.188289 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1519/3122] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:36 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:38:37.198996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9272c4e9-6aaa-41c7-ba36-16c184401b54 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:37.201019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9272c4e9-6aaa-41c7-ba36-16c184401b54 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:37.208439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9272c4e9-6aaa-41c7-ba36-16c184401b54 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:37.208896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9272c4e9-6aaa-41c7-ba36-16c184401b54 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:37.209542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9272c4e9-6aaa-41c7-ba36-16c184401b54 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:37.210455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9272c4e9-6aaa-41c7-ba36-16c184401b54 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:37.211161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9272c4e9-6aaa-41c7-ba36-16c184401b54 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:37.212470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9272c4e9-6aaa-41c7-ba36-16c184401b54 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:37.254804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-abd1f483-4023-49e7-a921-09daeb6e205b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:37.267815 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-abd1f483-4023-49e7-a921-09daeb6e205b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 200 len: 1319 microversion: 2.1 time: 0.259323 Oct 24 10:38:37.281047 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1604/3123] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:37 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:37.292569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fe937e1f-f165-466d-b865-77768b8f490c tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:37.293627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fe937e1f-f165-466d-b865-77768b8f490c tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:37.311285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe937e1f-f165-466d-b865-77768b8f490c tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:37.312100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe937e1f-f165-466d-b865-77768b8f490c tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:37.316042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe937e1f-f165-466d-b865-77768b8f490c tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:37.316965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe937e1f-f165-466d-b865-77768b8f490c tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:37.317517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe937e1f-f165-466d-b865-77768b8f490c tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:37.318031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe937e1f-f165-466d-b865-77768b8f490c tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:37.418933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9272c4e9-6aaa-41c7-ba36-16c184401b54 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:37.431643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9272c4e9-6aaa-41c7-ba36-16c184401b54 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:37.434101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9272c4e9-6aaa-41c7-ba36-16c184401b54 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:37.445587 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9272c4e9-6aaa-41c7-ba36-16c184401b54 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.255990 Oct 24 10:38:37.450625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fe937e1f-f165-466d-b865-77768b8f490c tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:37.474328 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1520/3124] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:37 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:37.474572 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fe937e1f-f165-466d-b865-77768b8f490c tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1270 microversion: 2.1 time: 0.190609 Oct 24 10:38:37.478432 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1605/3125] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:37 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1270 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:37.486384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3b826f35-565c-417c-9311-14d34032ffd2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:37.489533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3b826f35-565c-417c-9311-14d34032ffd2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:37.494942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5676849a-ee0b-4c66-b15b-f01c57260af8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:37.496155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5676849a-ee0b-4c66-b15b-f01c57260af8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:37.498357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b826f35-565c-417c-9311-14d34032ffd2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:37.498857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b826f35-565c-417c-9311-14d34032ffd2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:37.499294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b826f35-565c-417c-9311-14d34032ffd2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:37.501026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b826f35-565c-417c-9311-14d34032ffd2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:37.501564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b826f35-565c-417c-9311-14d34032ffd2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:37.502026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b826f35-565c-417c-9311-14d34032ffd2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:37.504878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5676849a-ee0b-4c66-b15b-f01c57260af8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:37.506008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5676849a-ee0b-4c66-b15b-f01c57260af8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:37.506690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5676849a-ee0b-4c66-b15b-f01c57260af8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:37.507479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5676849a-ee0b-4c66-b15b-f01c57260af8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:37.508182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5676849a-ee0b-4c66-b15b-f01c57260af8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:37.508688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5676849a-ee0b-4c66-b15b-f01c57260af8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:37.744695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5676849a-ee0b-4c66-b15b-f01c57260af8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:37.748418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3b826f35-565c-417c-9311-14d34032ffd2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:37.756399 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3b826f35-565c-417c-9311-14d34032ffd2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1527 microversion: 2.1 time: 0.284350 Oct 24 10:38:37.757601 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1521/3126] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:37 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1527 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:37.758923 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5676849a-ee0b-4c66-b15b-f01c57260af8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.278418 Oct 24 10:38:37.759935 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1606/3127] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:37 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:37.763213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-72a06f94-08b4-4b18-8db3-8ca606de6b5b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:37.764018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-72a06f94-08b4-4b18-8db3-8ca606de6b5b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:37.770254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72a06f94-08b4-4b18-8db3-8ca606de6b5b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:37.770970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72a06f94-08b4-4b18-8db3-8ca606de6b5b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:37.771610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72a06f94-08b4-4b18-8db3-8ca606de6b5b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:37.772497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72a06f94-08b4-4b18-8db3-8ca606de6b5b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:37.773257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72a06f94-08b4-4b18-8db3-8ca606de6b5b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:37.773876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72a06f94-08b4-4b18-8db3-8ca606de6b5b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:37.789567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7defb0b3-1ca8-40f7-a77c-d26d49b4c1c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:37.791910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7defb0b3-1ca8-40f7-a77c-d26d49b4c1c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:37.806864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7defb0b3-1ca8-40f7-a77c-d26d49b4c1c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:37.810625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7defb0b3-1ca8-40f7-a77c-d26d49b4c1c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:37.811218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7defb0b3-1ca8-40f7-a77c-d26d49b4c1c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:37.812145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7defb0b3-1ca8-40f7-a77c-d26d49b4c1c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:37.813282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7defb0b3-1ca8-40f7-a77c-d26d49b4c1c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:37.817074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7defb0b3-1ca8-40f7-a77c-d26d49b4c1c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:38.191843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-72a06f94-08b4-4b18-8db3-8ca606de6b5b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:38.197536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7defb0b3-1ca8-40f7-a77c-d26d49b4c1c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:38.210637 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7defb0b3-1ca8-40f7-a77c-d26d49b4c1c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.425519 Oct 24 10:38:38.214258 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1607/3128] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:37 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:38:38.229948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-30e09e80-1445-42c2-9c60-c481a6328705 req-a05c747c-62ca-4bcb-bd15-fedefd1dc110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f024708-057e-4eda-9894-fb480a85c693", "name": "network-vif-plugged", "status": "completed", "tag": "69109537-4e24-42aa-9a6d-200c27c96bbc"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:38.238710 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-72a06f94-08b4-4b18-8db3-8ca606de6b5b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1325 microversion: 2.1 time: 0.468838 Oct 24 10:38:38.246143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-30e09e80-1445-42c2-9c60-c481a6328705 req-a05c747c-62ca-4bcb-bd15-fedefd1dc110 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:38.246633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-30e09e80-1445-42c2-9c60-c481a6328705 req-a05c747c-62ca-4bcb-bd15-fedefd1dc110 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:38.247074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-30e09e80-1445-42c2-9c60-c481a6328705 req-a05c747c-62ca-4bcb-bd15-fedefd1dc110 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:38.256287 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1522/3129] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:37 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1325 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:38.265250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fdeb79be-0d45-4a1e-91ce-115c9081e691 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:38.266372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fdeb79be-0d45-4a1e-91ce-115c9081e691 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:38.284271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdeb79be-0d45-4a1e-91ce-115c9081e691 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:38.284782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdeb79be-0d45-4a1e-91ce-115c9081e691 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:38.286570 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-30e09e80-1445-42c2-9c60-c481a6328705 req-a05c747c-62ca-4bcb-bd15-fedefd1dc110 service nova] Creating event network-vif-plugged:69109537-4e24-42aa-9a6d-200c27c96bbc for instance 2f024708-057e-4eda-9894-fb480a85c693 on n-h2-858383-15 Oct 24 10:38:38.288311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdeb79be-0d45-4a1e-91ce-115c9081e691 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:38.289820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdeb79be-0d45-4a1e-91ce-115c9081e691 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:38.292247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdeb79be-0d45-4a1e-91ce-115c9081e691 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:38.292916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdeb79be-0d45-4a1e-91ce-115c9081e691 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:38.300421 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-30e09e80-1445-42c2-9c60-c481a6328705 req-a05c747c-62ca-4bcb-bd15-fedefd1dc110 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083243 Oct 24 10:38:38.301160 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1608/3130] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:38.312902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f6445f49-2f35-476d-952d-f19fac5ffa6e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:38.321072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f6445f49-2f35-476d-952d-f19fac5ffa6e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:38.330225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6445f49-2f35-476d-952d-f19fac5ffa6e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:38.330927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6445f49-2f35-476d-952d-f19fac5ffa6e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:38.331547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6445f49-2f35-476d-952d-f19fac5ffa6e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:38.332429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6445f49-2f35-476d-952d-f19fac5ffa6e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:38.333068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6445f49-2f35-476d-952d-f19fac5ffa6e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:38.333648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6445f49-2f35-476d-952d-f19fac5ffa6e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:38.508260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fdeb79be-0d45-4a1e-91ce-115c9081e691 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:38.534204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fdeb79be-0d45-4a1e-91ce-115c9081e691 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:38.537506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fdeb79be-0d45-4a1e-91ce-115c9081e691 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:38.542765 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fdeb79be-0d45-4a1e-91ce-115c9081e691 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1575 microversion: 2.32 time: 0.284821 Oct 24 10:38:38.545875 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1523/3131] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:38 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1575 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:38.551336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5ee2a72-f5f5-4759-a365-67786e1706bf tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:38.552199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d5ee2a72-f5f5-4759-a365-67786e1706bf tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:38.561484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ee2a72-f5f5-4759-a365-67786e1706bf tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:38.561977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ee2a72-f5f5-4759-a365-67786e1706bf tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:38.562556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ee2a72-f5f5-4759-a365-67786e1706bf tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:38.563271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ee2a72-f5f5-4759-a365-67786e1706bf tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:38.563737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ee2a72-f5f5-4759-a365-67786e1706bf tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:38.564124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ee2a72-f5f5-4759-a365-67786e1706bf tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:38.642867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:38.648742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f6445f49-2f35-476d-952d-f19fac5ffa6e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:38.659622 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f6445f49-2f35-476d-952d-f19fac5ffa6e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.355688 Oct 24 10:38:38.661393 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1609/3132] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:38 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:38.669573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-23f321f6-56d3-4e0b-aa43-e0d570610fba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:38.670685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-23f321f6-56d3-4e0b-aa43-e0d570610fba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:38.678200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23f321f6-56d3-4e0b-aa43-e0d570610fba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:38.679729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23f321f6-56d3-4e0b-aa43-e0d570610fba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:38.680184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23f321f6-56d3-4e0b-aa43-e0d570610fba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:38.682312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23f321f6-56d3-4e0b-aa43-e0d570610fba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:38.682762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23f321f6-56d3-4e0b-aa43-e0d570610fba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:38.683200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23f321f6-56d3-4e0b-aa43-e0d570610fba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:38.806675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-23f321f6-56d3-4e0b-aa43-e0d570610fba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:38.815669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-23f321f6-56d3-4e0b-aa43-e0d570610fba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:38.817510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-23f321f6-56d3-4e0b-aa43-e0d570610fba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:38.824437 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-23f321f6-56d3-4e0b-aa43-e0d570610fba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.161867 Oct 24 10:38:38.825658 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1610/3133] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:38 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:38.833438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-960bcbc2-6843-4911-b7b3-89d208aa73cb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:38.834311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-960bcbc2-6843-4911-b7b3-89d208aa73cb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:38.841327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-960bcbc2-6843-4911-b7b3-89d208aa73cb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:38.842189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-960bcbc2-6843-4911-b7b3-89d208aa73cb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:38.842884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-960bcbc2-6843-4911-b7b3-89d208aa73cb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:38.843824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-960bcbc2-6843-4911-b7b3-89d208aa73cb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:38.844498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-960bcbc2-6843-4911-b7b3-89d208aa73cb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:38.845266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-960bcbc2-6843-4911-b7b3-89d208aa73cb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:38.919491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d5ee2a72-f5f5-4759-a365-67786e1706bf tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:38.934473 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d5ee2a72-f5f5-4759-a365-67786e1706bf tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 200 len: 1319 microversion: 2.1 time: 0.381825 Oct 24 10:38:38.950491 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1524/3134] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:38 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 1319 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:38.955440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-794756af-fd19-4512-8abb-ba53b137e439 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:38.956257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-794756af-fd19-4512-8abb-ba53b137e439 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:38.963834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-794756af-fd19-4512-8abb-ba53b137e439 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:38.964516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-794756af-fd19-4512-8abb-ba53b137e439 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:38.965144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-794756af-fd19-4512-8abb-ba53b137e439 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:38.966013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-794756af-fd19-4512-8abb-ba53b137e439 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:38.966638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-794756af-fd19-4512-8abb-ba53b137e439 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:38.967064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-794756af-fd19-4512-8abb-ba53b137e439 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:39.038864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-960bcbc2-6843-4911-b7b3-89d208aa73cb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:39.051303 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-960bcbc2-6843-4911-b7b3-89d208aa73cb tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1312 microversion: 2.1 time: 0.224356 Oct 24 10:38:39.052671 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1611/3135] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:38 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1312 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:39.064599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9790c4f6-cefc-4977-b644-e9babe181551 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:39.065586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9790c4f6-cefc-4977-b644-e9babe181551 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:39.081554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9790c4f6-cefc-4977-b644-e9babe181551 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:39.081554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9790c4f6-cefc-4977-b644-e9babe181551 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:39.081554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9790c4f6-cefc-4977-b644-e9babe181551 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:39.081554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9790c4f6-cefc-4977-b644-e9babe181551 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:39.081554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9790c4f6-cefc-4977-b644-e9babe181551 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:39.081554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9790c4f6-cefc-4977-b644-e9babe181551 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:39.239543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-794756af-fd19-4512-8abb-ba53b137e439 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:39.250748 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-794756af-fd19-4512-8abb-ba53b137e439 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.298816 Oct 24 10:38:39.271897 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1525/3136] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:38 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:39.287985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2c8e1ade-0ec8-4e84-bee7-82d8f8969f83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:39.288914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2c8e1ade-0ec8-4e84-bee7-82d8f8969f83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:39.292042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9790c4f6-cefc-4977-b644-e9babe181551 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:39.298578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c8e1ade-0ec8-4e84-bee7-82d8f8969f83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:39.299376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c8e1ade-0ec8-4e84-bee7-82d8f8969f83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:39.300017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c8e1ade-0ec8-4e84-bee7-82d8f8969f83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:39.301073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c8e1ade-0ec8-4e84-bee7-82d8f8969f83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:39.301722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c8e1ade-0ec8-4e84-bee7-82d8f8969f83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:39.302374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c8e1ade-0ec8-4e84-bee7-82d8f8969f83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:39.309470 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9790c4f6-cefc-4977-b644-e9babe181551 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1527 microversion: 2.1 time: 0.255184 Oct 24 10:38:39.310288 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1612/3137] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:39 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1527 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:39.325413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9b1458f2-4396-491f-9f3f-627b9ee72770 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:39.326045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9b1458f2-4396-491f-9f3f-627b9ee72770 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:39.332400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b1458f2-4396-491f-9f3f-627b9ee72770 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:39.333175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b1458f2-4396-491f-9f3f-627b9ee72770 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:39.333908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b1458f2-4396-491f-9f3f-627b9ee72770 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:39.334806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b1458f2-4396-491f-9f3f-627b9ee72770 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:39.335268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b1458f2-4396-491f-9f3f-627b9ee72770 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:39.335696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b1458f2-4396-491f-9f3f-627b9ee72770 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:39.594271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c8e1ade-0ec8-4e84-bee7-82d8f8969f83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:39.606402 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2c8e1ade-0ec8-4e84-bee7-82d8f8969f83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1325 microversion: 2.1 time: 0.324453 Oct 24 10:38:39.616867 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1526/3138] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:39 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1325 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:39.617177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9b1458f2-4396-491f-9f3f-627b9ee72770 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:39.617440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-818af7ec-1d72-4b41-88a5-40d84511a468 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:39.618744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-818af7ec-1d72-4b41-88a5-40d84511a468 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:39.619144 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9b1458f2-4396-491f-9f3f-627b9ee72770 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.300492 Oct 24 10:38:39.619735 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1613/3139] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:39 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:39.626471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-818af7ec-1d72-4b41-88a5-40d84511a468 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:39.627352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-818af7ec-1d72-4b41-88a5-40d84511a468 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:39.628367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-818af7ec-1d72-4b41-88a5-40d84511a468 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:39.629649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-818af7ec-1d72-4b41-88a5-40d84511a468 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:39.630346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-818af7ec-1d72-4b41-88a5-40d84511a468 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:39.631638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-818af7ec-1d72-4b41-88a5-40d84511a468 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:39.758373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-818af7ec-1d72-4b41-88a5-40d84511a468 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:39.769208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-818af7ec-1d72-4b41-88a5-40d84511a468 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:39.771082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-818af7ec-1d72-4b41-88a5-40d84511a468 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:39.772516 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-818af7ec-1d72-4b41-88a5-40d84511a468 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1575 microversion: 2.32 time: 0.163850 Oct 24 10:38:39.783898 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1527/3140] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:39 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:39.865770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5da9e2e8-8a2a-4b44-9e1d-5638db149d15 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:39.867682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5da9e2e8-8a2a-4b44-9e1d-5638db149d15 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:39.880048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5da9e2e8-8a2a-4b44-9e1d-5638db149d15 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:39.883041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5da9e2e8-8a2a-4b44-9e1d-5638db149d15 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:39.883600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5da9e2e8-8a2a-4b44-9e1d-5638db149d15 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:39.885019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5da9e2e8-8a2a-4b44-9e1d-5638db149d15 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:39.885500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5da9e2e8-8a2a-4b44-9e1d-5638db149d15 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:39.885934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5da9e2e8-8a2a-4b44-9e1d-5638db149d15 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:39.958723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-46f3b8f3-f4ad-4671-b204-7401bef892e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:39.959267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-46f3b8f3-f4ad-4671-b204-7401bef892e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:39.975330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46f3b8f3-f4ad-4671-b204-7401bef892e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:39.975962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46f3b8f3-f4ad-4671-b204-7401bef892e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:39.976419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46f3b8f3-f4ad-4671-b204-7401bef892e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:39.977315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46f3b8f3-f4ad-4671-b204-7401bef892e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:39.978058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46f3b8f3-f4ad-4671-b204-7401bef892e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:39.978756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-46f3b8f3-f4ad-4671-b204-7401bef892e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:40.046054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5da9e2e8-8a2a-4b44-9e1d-5638db149d15 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:40.055092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5da9e2e8-8a2a-4b44-9e1d-5638db149d15 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:40.056546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5da9e2e8-8a2a-4b44-9e1d-5638db149d15 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:40.078333 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5da9e2e8-8a2a-4b44-9e1d-5638db149d15 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.215108 Oct 24 10:38:40.096863 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1614/3141] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:39 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:40.096863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d2ad50d-e03b-4532-94fc-c6222f1e4faf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:40.100173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2d2ad50d-e03b-4532-94fc-c6222f1e4faf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:40.109439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d2ad50d-e03b-4532-94fc-c6222f1e4faf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:40.109942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d2ad50d-e03b-4532-94fc-c6222f1e4faf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:40.110383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d2ad50d-e03b-4532-94fc-c6222f1e4faf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:40.111196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d2ad50d-e03b-4532-94fc-c6222f1e4faf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:40.111636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d2ad50d-e03b-4532-94fc-c6222f1e4faf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:40.112065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d2ad50d-e03b-4532-94fc-c6222f1e4faf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:40.381235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-46f3b8f3-f4ad-4671-b204-7401bef892e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:40.387661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2d2ad50d-e03b-4532-94fc-c6222f1e4faf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:40.397099 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-46f3b8f3-f4ad-4671-b204-7401bef892e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 200 len: 1319 microversion: 2.1 time: 0.442402 Oct 24 10:38:40.397953 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1528/3142] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:39 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 1319 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:38:40.401088 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2d2ad50d-e03b-4532-94fc-c6222f1e4faf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1333 microversion: 2.1 time: 0.318658 Oct 24 10:38:40.401667 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1615/3143] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:40 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1333 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:40.421589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-59028e8f-04eb-41d1-a472-4dff52689a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:40.422213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-59028e8f-04eb-41d1-a472-4dff52689a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:40.442046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59028e8f-04eb-41d1-a472-4dff52689a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:40.442546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59028e8f-04eb-41d1-a472-4dff52689a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:40.442987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59028e8f-04eb-41d1-a472-4dff52689a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:40.443714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59028e8f-04eb-41d1-a472-4dff52689a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:40.444174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59028e8f-04eb-41d1-a472-4dff52689a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:40.444603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59028e8f-04eb-41d1-a472-4dff52689a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:40.631977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-27068016-304c-4cfb-9273-b577eaaa29a0 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:40.633105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-27068016-304c-4cfb-9273-b577eaaa29a0 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:40.648614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27068016-304c-4cfb-9273-b577eaaa29a0 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:40.649170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27068016-304c-4cfb-9273-b577eaaa29a0 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:40.650260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27068016-304c-4cfb-9273-b577eaaa29a0 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:40.651620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27068016-304c-4cfb-9273-b577eaaa29a0 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:40.652339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27068016-304c-4cfb-9273-b577eaaa29a0 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:40.652971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27068016-304c-4cfb-9273-b577eaaa29a0 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:41.173892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:41.196971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-27068016-304c-4cfb-9273-b577eaaa29a0 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:41.199321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-59028e8f-04eb-41d1-a472-4dff52689a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:41.210700 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-59028e8f-04eb-41d1-a472-4dff52689a95 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1527 microversion: 2.1 time: 0.811125 Oct 24 10:38:41.211299 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1529/3144] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:40 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1527 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:41.213073 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-27068016-304c-4cfb-9273-b577eaaa29a0 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1325 microversion: 2.1 time: 0.583332 Oct 24 10:38:41.213945 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1616/3145] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:40 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1325 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:38:41.233195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-597f9de1-6a53-4b5c-a38d-56a7b807bdff tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:41.233195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-597f9de1-6a53-4b5c-a38d-56a7b807bdff tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:41.245604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3ec81c06-b594-45d7-bfc3-8f53b0118ae5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:41.246560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3ec81c06-b594-45d7-bfc3-8f53b0118ae5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:41.256454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ec81c06-b594-45d7-bfc3-8f53b0118ae5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:41.257146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-597f9de1-6a53-4b5c-a38d-56a7b807bdff tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:41.257673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-597f9de1-6a53-4b5c-a38d-56a7b807bdff tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:41.258118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-597f9de1-6a53-4b5c-a38d-56a7b807bdff tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:41.258700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ec81c06-b594-45d7-bfc3-8f53b0118ae5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:41.259515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-597f9de1-6a53-4b5c-a38d-56a7b807bdff tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:41.259998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-597f9de1-6a53-4b5c-a38d-56a7b807bdff tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:41.260317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ec81c06-b594-45d7-bfc3-8f53b0118ae5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:41.260461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-597f9de1-6a53-4b5c-a38d-56a7b807bdff tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:41.261390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ec81c06-b594-45d7-bfc3-8f53b0118ae5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:41.262092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ec81c06-b594-45d7-bfc3-8f53b0118ae5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:41.262678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ec81c06-b594-45d7-bfc3-8f53b0118ae5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:41.297500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:41.766291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-597f9de1-6a53-4b5c-a38d-56a7b807bdff tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:41.768045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3ec81c06-b594-45d7-bfc3-8f53b0118ae5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:41.781734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-597f9de1-6a53-4b5c-a38d-56a7b807bdff tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:41.781938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3ec81c06-b594-45d7-bfc3-8f53b0118ae5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:41.783198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-597f9de1-6a53-4b5c-a38d-56a7b807bdff tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:41.784466 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-597f9de1-6a53-4b5c-a38d-56a7b807bdff tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1593 microversion: 2.32 time: 0.567905 Oct 24 10:38:41.785299 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1530/3146] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:41 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1593 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:41.807954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3ec81c06-b594-45d7-bfc3-8f53b0118ae5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:41.810225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-9f516c88-5048-4b4a-b81f-6963b7573a3d req-aa8317eb-bbe5-4227-b477-80ebc61c5475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "105cd729-f8cb-45e7-bb34-030c45097242", "tag": "32092da1-897c-436e-8027-df8400cdaf1f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:41.823761 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3ec81c06-b594-45d7-bfc3-8f53b0118ae5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1531 microversion: 2.91 time: 0.585297 Oct 24 10:38:41.831198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9f516c88-5048-4b4a-b81f-6963b7573a3d req-aa8317eb-bbe5-4227-b477-80ebc61c5475 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:41.831945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9f516c88-5048-4b4a-b81f-6963b7573a3d req-aa8317eb-bbe5-4227-b477-80ebc61c5475 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:41.832386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9f516c88-5048-4b4a-b81f-6963b7573a3d req-aa8317eb-bbe5-4227-b477-80ebc61c5475 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:41.846333 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1617/3147] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:41 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1531 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:41.851999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-104e4b33-f418-47e7-9963-362c79f504c1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:41.861408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-104e4b33-f418-47e7-9963-362c79f504c1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:41.878994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-104e4b33-f418-47e7-9963-362c79f504c1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:41.879577 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-9f516c88-5048-4b4a-b81f-6963b7573a3d req-aa8317eb-bbe5-4227-b477-80ebc61c5475 service nova] Creating event network-changed:32092da1-897c-436e-8027-df8400cdaf1f for instance 105cd729-f8cb-45e7-bb34-030c45097242 on n-h1-858383-15 Oct 24 10:38:41.880243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-104e4b33-f418-47e7-9963-362c79f504c1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:41.881355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-104e4b33-f418-47e7-9963-362c79f504c1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:41.889897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-104e4b33-f418-47e7-9963-362c79f504c1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:41.890852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-104e4b33-f418-47e7-9963-362c79f504c1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:41.891513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-104e4b33-f418-47e7-9963-362c79f504c1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:41.917537 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-9f516c88-5048-4b4a-b81f-6963b7573a3d req-aa8317eb-bbe5-4227-b477-80ebc61c5475 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093734 Oct 24 10:38:41.933242 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1531/3148] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:41.941334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d42fd8c9-ff5a-4b10-8391-41a6b5c42d39 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:41.957340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d42fd8c9-ff5a-4b10-8391-41a6b5c42d39 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:41.970900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42fd8c9-ff5a-4b10-8391-41a6b5c42d39 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:41.971392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42fd8c9-ff5a-4b10-8391-41a6b5c42d39 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:41.971831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42fd8c9-ff5a-4b10-8391-41a6b5c42d39 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:41.972544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42fd8c9-ff5a-4b10-8391-41a6b5c42d39 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:41.984703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42fd8c9-ff5a-4b10-8391-41a6b5c42d39 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:41.985049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42fd8c9-ff5a-4b10-8391-41a6b5c42d39 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:42.607012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d42fd8c9-ff5a-4b10-8391-41a6b5c42d39 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:42.620604 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d42fd8c9-ff5a-4b10-8391-41a6b5c42d39 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1333 microversion: 2.1 time: 0.683037 Oct 24 10:38:42.621895 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1532/3149] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:41 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1333 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:42.626854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e964e923-814b-4da9-8a8b-a774b14dc876 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:42.638009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e964e923-814b-4da9-8a8b-a774b14dc876 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:42.641487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-104e4b33-f418-47e7-9963-362c79f504c1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:42.650482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e964e923-814b-4da9-8a8b-a774b14dc876 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:42.652743 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-104e4b33-f418-47e7-9963-362c79f504c1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 200 len: 1319 microversion: 2.1 time: 0.805210 Oct 24 10:38:42.668933 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1618/3150] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:41 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 1319 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:42.669484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e964e923-814b-4da9-8a8b-a774b14dc876 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:42.670020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e964e923-814b-4da9-8a8b-a774b14dc876 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:42.670798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e964e923-814b-4da9-8a8b-a774b14dc876 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:42.671433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e964e923-814b-4da9-8a8b-a774b14dc876 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:42.671877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e964e923-814b-4da9-8a8b-a774b14dc876 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:42.675202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1535605c-a093-44ab-bebe-2e3b7cb3cc38 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:42.676073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1535605c-a093-44ab-bebe-2e3b7cb3cc38 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:42.689711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1535605c-a093-44ab-bebe-2e3b7cb3cc38 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:42.690482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1535605c-a093-44ab-bebe-2e3b7cb3cc38 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:42.691150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1535605c-a093-44ab-bebe-2e3b7cb3cc38 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:42.692097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1535605c-a093-44ab-bebe-2e3b7cb3cc38 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:42.692781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1535605c-a093-44ab-bebe-2e3b7cb3cc38 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:42.693467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1535605c-a093-44ab-bebe-2e3b7cb3cc38 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:43.022040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-e964e923-814b-4da9-8a8b-a774b14dc876 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lazy-loading 'services' on Instance uuid 64cc15e2-c27b-4e1d-8673-338e434031db {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:38:43.098246 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e964e923-814b-4da9-8a8b-a774b14dc876 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1938 microversion: 2.91 time: 0.468142 Oct 24 10:38:43.113450 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1533/3151] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:42 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1938 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:43.150176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b7f63417-1fd6-4898-a9d9-4cdc316a093f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:43.151005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b7f63417-1fd6-4898-a9d9-4cdc316a093f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:43.153206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:43.163392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b7f63417-1fd6-4898-a9d9-4cdc316a093f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:43.164250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b7f63417-1fd6-4898-a9d9-4cdc316a093f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:43.164792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b7f63417-1fd6-4898-a9d9-4cdc316a093f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:43.165944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b7f63417-1fd6-4898-a9d9-4cdc316a093f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:43.166657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b7f63417-1fd6-4898-a9d9-4cdc316a093f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:43.173648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b7f63417-1fd6-4898-a9d9-4cdc316a093f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:43.373825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1535605c-a093-44ab-bebe-2e3b7cb3cc38 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:43.383183 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1535605c-a093-44ab-bebe-2e3b7cb3cc38 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1527 microversion: 2.1 time: 0.712295 Oct 24 10:38:43.386146 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1619/3152] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:42 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1527 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:43.406040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-22cb17c3-f3cb-4e5e-bd6f-eec5e3f420ce req-0506f906-bd9d-4eee-97aa-525e6cdc7c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1095b21-85ef-46b9-b67c-fcfc5c4f38c1", "name": "network-vif-plugged", "status": "completed", "tag": "044f4eed-9250-4d71-b78a-ec50886a1625"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:43.432861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-22cb17c3-f3cb-4e5e-bd6f-eec5e3f420ce req-0506f906-bd9d-4eee-97aa-525e6cdc7c9d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:43.433720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-22cb17c3-f3cb-4e5e-bd6f-eec5e3f420ce req-0506f906-bd9d-4eee-97aa-525e6cdc7c9d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:43.434314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-22cb17c3-f3cb-4e5e-bd6f-eec5e3f420ce req-0506f906-bd9d-4eee-97aa-525e6cdc7c9d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:43.453765 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-22cb17c3-f3cb-4e5e-bd6f-eec5e3f420ce req-0506f906-bd9d-4eee-97aa-525e6cdc7c9d service nova] Creating event network-vif-plugged:044f4eed-9250-4d71-b78a-ec50886a1625 for instance d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 on n-h1-858383-15 Oct 24 10:38:43.460125 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-22cb17c3-f3cb-4e5e-bd6f-eec5e3f420ce req-0506f906-bd9d-4eee-97aa-525e6cdc7c9d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072191 Oct 24 10:38:43.461607 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1620/3153] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:43.462413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b7f63417-1fd6-4898-a9d9-4cdc316a093f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:43.468591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-76a79da8-207d-4082-89cf-815b57c14b65 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:43.470070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-76a79da8-207d-4082-89cf-815b57c14b65 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:43.473639 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b7f63417-1fd6-4898-a9d9-4cdc316a093f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1325 microversion: 2.1 time: 0.358546 Oct 24 10:38:43.474407 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1534/3154] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:43 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1325 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:43.477909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a79da8-207d-4082-89cf-815b57c14b65 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:43.478982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a79da8-207d-4082-89cf-815b57c14b65 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:43.479603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a79da8-207d-4082-89cf-815b57c14b65 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:43.480505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a79da8-207d-4082-89cf-815b57c14b65 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:43.481186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a79da8-207d-4082-89cf-815b57c14b65 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:43.481832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a79da8-207d-4082-89cf-815b57c14b65 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:43.482538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9db02a4f-89e9-4b5d-aaac-9fc61d2610d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:43.483320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9db02a4f-89e9-4b5d-aaac-9fc61d2610d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:43.494389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9db02a4f-89e9-4b5d-aaac-9fc61d2610d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:43.495221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9db02a4f-89e9-4b5d-aaac-9fc61d2610d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:43.495929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9db02a4f-89e9-4b5d-aaac-9fc61d2610d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:43.497194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9db02a4f-89e9-4b5d-aaac-9fc61d2610d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:43.497915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9db02a4f-89e9-4b5d-aaac-9fc61d2610d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:43.498586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9db02a4f-89e9-4b5d-aaac-9fc61d2610d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:43.530451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-9db02a4f-89e9-4b5d-aaac-9fc61d2610d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lazy-loading 'flavor' on Instance uuid 64cc15e2-c27b-4e1d-8673-338e434031db {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:38:43.638544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-76a79da8-207d-4082-89cf-815b57c14b65 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:43.649550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-76a79da8-207d-4082-89cf-815b57c14b65 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:43.652218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-76a79da8-207d-4082-89cf-815b57c14b65 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:43.653909 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-76a79da8-207d-4082-89cf-815b57c14b65 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1593 microversion: 2.32 time: 0.190193 Oct 24 10:38:43.654976 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1621/3155] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:43 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1593 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:43.661152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-442f57e2-3a9f-4e0f-b2ec-9152b9aed32d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:43.662868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-442f57e2-3a9f-4e0f-b2ec-9152b9aed32d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:43.671264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-442f57e2-3a9f-4e0f-b2ec-9152b9aed32d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:43.672092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-442f57e2-3a9f-4e0f-b2ec-9152b9aed32d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:43.673329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-442f57e2-3a9f-4e0f-b2ec-9152b9aed32d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:43.674252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-442f57e2-3a9f-4e0f-b2ec-9152b9aed32d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:43.674926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-442f57e2-3a9f-4e0f-b2ec-9152b9aed32d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:43.675531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-442f57e2-3a9f-4e0f-b2ec-9152b9aed32d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:43.983677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-442f57e2-3a9f-4e0f-b2ec-9152b9aed32d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:43.996618 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-442f57e2-3a9f-4e0f-b2ec-9152b9aed32d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1333 microversion: 2.1 time: 0.340193 Oct 24 10:38:43.998867 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1622/3156] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:43 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1333 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:44.011281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7ffa8bfd-db2f-4681-af29-4c3c65307077 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:44.012272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7ffa8bfd-db2f-4681-af29-4c3c65307077 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:44.022620 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9db02a4f-89e9-4b5d-aaac-9fc61d2610d5 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "POST /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db/action" status: 202 len: 0 microversion: 2.91 time: 0.545761 Oct 24 10:38:44.023314 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1535/3157] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Oct 24 10:38:43 2022] POST /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:38:44.026159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ffa8bfd-db2f-4681-af29-4c3c65307077 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:44.026974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ffa8bfd-db2f-4681-af29-4c3c65307077 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:44.027421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ffa8bfd-db2f-4681-af29-4c3c65307077 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:44.030896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ffa8bfd-db2f-4681-af29-4c3c65307077 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:44.032598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ffa8bfd-db2f-4681-af29-4c3c65307077 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:44.033824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ffa8bfd-db2f-4681-af29-4c3c65307077 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:44.041987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d496c97c-03dd-462c-94e7-6a462ec45d1d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:44.045111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d496c97c-03dd-462c-94e7-6a462ec45d1d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:44.062192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d496c97c-03dd-462c-94e7-6a462ec45d1d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:44.063006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d496c97c-03dd-462c-94e7-6a462ec45d1d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:44.063811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d496c97c-03dd-462c-94e7-6a462ec45d1d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:44.064772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d496c97c-03dd-462c-94e7-6a462ec45d1d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:44.065436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d496c97c-03dd-462c-94e7-6a462ec45d1d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:44.067106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d496c97c-03dd-462c-94e7-6a462ec45d1d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:44.260012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d496c97c-03dd-462c-94e7-6a462ec45d1d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:44.270540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d496c97c-03dd-462c-94e7-6a462ec45d1d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:44.272007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d496c97c-03dd-462c-94e7-6a462ec45d1d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:44.287921 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d496c97c-03dd-462c-94e7-6a462ec45d1d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.252595 Oct 24 10:38:44.291013 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1536/3158] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:44 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:44.324699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7ffa8bfd-db2f-4681-af29-4c3c65307077 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:44.333886 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7ffa8bfd-db2f-4681-af29-4c3c65307077 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 200 len: 1319 microversion: 2.1 time: 0.333460 Oct 24 10:38:44.334816 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1623/3159] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:43 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:44.410722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0def3e65-efc6-4cc9-957b-6ea4791e71a8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:44.411666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0def3e65-efc6-4cc9-957b-6ea4791e71a8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:44.431056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0def3e65-efc6-4cc9-957b-6ea4791e71a8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:44.431582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0def3e65-efc6-4cc9-957b-6ea4791e71a8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:44.433410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0def3e65-efc6-4cc9-957b-6ea4791e71a8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:44.435246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0def3e65-efc6-4cc9-957b-6ea4791e71a8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:44.449554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0def3e65-efc6-4cc9-957b-6ea4791e71a8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:44.451259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0def3e65-efc6-4cc9-957b-6ea4791e71a8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:44.503073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e22ae4f8-1bf8-448d-a615-5d3dce269815 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:44.503927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e22ae4f8-1bf8-448d-a615-5d3dce269815 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:44.531347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:44.536567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e22ae4f8-1bf8-448d-a615-5d3dce269815 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:44.545696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e22ae4f8-1bf8-448d-a615-5d3dce269815 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:44.549356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e22ae4f8-1bf8-448d-a615-5d3dce269815 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:44.550743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e22ae4f8-1bf8-448d-a615-5d3dce269815 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:44.556278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e22ae4f8-1bf8-448d-a615-5d3dce269815 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:44.566072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e22ae4f8-1bf8-448d-a615-5d3dce269815 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:44.569640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:44.914515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0def3e65-efc6-4cc9-957b-6ea4791e71a8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:44.927635 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0def3e65-efc6-4cc9-957b-6ea4791e71a8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1522 microversion: 2.1 time: 0.522995 Oct 24 10:38:44.944772 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1537/3160] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:44 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1522 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:44.945510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5dbd8a2c-f333-4229-bf60-91082fe93bdb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:44.946770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5dbd8a2c-f333-4229-bf60-91082fe93bdb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:44.960588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dbd8a2c-f333-4229-bf60-91082fe93bdb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:44.961111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dbd8a2c-f333-4229-bf60-91082fe93bdb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:44.961553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dbd8a2c-f333-4229-bf60-91082fe93bdb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:44.968172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dbd8a2c-f333-4229-bf60-91082fe93bdb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:44.975245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e22ae4f8-1bf8-448d-a615-5d3dce269815 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:44.979911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dbd8a2c-f333-4229-bf60-91082fe93bdb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:44.980369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dbd8a2c-f333-4229-bf60-91082fe93bdb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:44.989990 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e22ae4f8-1bf8-448d-a615-5d3dce269815 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1325 microversion: 2.1 time: 0.492015 Oct 24 10:38:44.990900 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1624/3161] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:44 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1325 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:38:45.015211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-0d7f46b8-a7ab-4313-913c-3ca849a358bb req-79739444-b5e3-488f-b6d8-8d8008e4b595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "105cd729-f8cb-45e7-bb34-030c45097242", "tag": "76b30b9d-a037-4816-acb6-e4ef6e3d401f"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:45.045131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-0d7f46b8-a7ab-4313-913c-3ca849a358bb req-79739444-b5e3-488f-b6d8-8d8008e4b595 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:45.048638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-0d7f46b8-a7ab-4313-913c-3ca849a358bb req-79739444-b5e3-488f-b6d8-8d8008e4b595 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:45.053099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-0d7f46b8-a7ab-4313-913c-3ca849a358bb req-79739444-b5e3-488f-b6d8-8d8008e4b595 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:45.072608 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-0d7f46b8-a7ab-4313-913c-3ca849a358bb req-79739444-b5e3-488f-b6d8-8d8008e4b595 service nova] Creating event network-changed:76b30b9d-a037-4816-acb6-e4ef6e3d401f for instance 105cd729-f8cb-45e7-bb34-030c45097242 on n-h1-858383-15 Oct 24 10:38:45.090066 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-0d7f46b8-a7ab-4313-913c-3ca849a358bb req-79739444-b5e3-488f-b6d8-8d8008e4b595 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078742 Oct 24 10:38:45.091244 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1625/3162] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:45.108746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-da642e88-21eb-40aa-8e39-733f6dcdb43a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:45.109475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-da642e88-21eb-40aa-8e39-733f6dcdb43a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:45.127681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da642e88-21eb-40aa-8e39-733f6dcdb43a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:45.128480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da642e88-21eb-40aa-8e39-733f6dcdb43a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:45.131598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da642e88-21eb-40aa-8e39-733f6dcdb43a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:45.132552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da642e88-21eb-40aa-8e39-733f6dcdb43a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:45.138321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da642e88-21eb-40aa-8e39-733f6dcdb43a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:45.141049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da642e88-21eb-40aa-8e39-733f6dcdb43a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:45.319086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5dbd8a2c-f333-4229-bf60-91082fe93bdb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:45.337861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5dbd8a2c-f333-4229-bf60-91082fe93bdb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:45.357992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5dbd8a2c-f333-4229-bf60-91082fe93bdb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:45.359992 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5dbd8a2c-f333-4229-bf60-91082fe93bdb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1660 microversion: 2.32 time: 0.423653 Oct 24 10:38:45.377193 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1538/3163] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:44 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1660 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:45.383839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-04a4cb0d-7bd9-405f-be38-199728330c85 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:45.385102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-04a4cb0d-7bd9-405f-be38-199728330c85 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:45.413985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04a4cb0d-7bd9-405f-be38-199728330c85 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:45.417470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04a4cb0d-7bd9-405f-be38-199728330c85 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:45.418332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04a4cb0d-7bd9-405f-be38-199728330c85 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:45.419303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04a4cb0d-7bd9-405f-be38-199728330c85 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:45.420017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04a4cb0d-7bd9-405f-be38-199728330c85 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:45.420748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04a4cb0d-7bd9-405f-be38-199728330c85 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:45.467225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:45.470247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-da642e88-21eb-40aa-8e39-733f6dcdb43a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:45.500263 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-da642e88-21eb-40aa-8e39-733f6dcdb43a tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1333 microversion: 2.1 time: 0.394343 Oct 24 10:38:45.502066 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1626/3164] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:45 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1333 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:45.507175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-30ced6cd-47a5-4e9e-b477-621819509e0d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:45.513610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-30ced6cd-47a5-4e9e-b477-621819509e0d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:45.521491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30ced6cd-47a5-4e9e-b477-621819509e0d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:45.522207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30ced6cd-47a5-4e9e-b477-621819509e0d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:45.534567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30ced6cd-47a5-4e9e-b477-621819509e0d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:45.540049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30ced6cd-47a5-4e9e-b477-621819509e0d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:45.541073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30ced6cd-47a5-4e9e-b477-621819509e0d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:45.542473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30ced6cd-47a5-4e9e-b477-621819509e0d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:45.582060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-04a4cb0d-7bd9-405f-be38-199728330c85 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:45.602138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-04a4cb0d-7bd9-405f-be38-199728330c85 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:45.617647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-04a4cb0d-7bd9-405f-be38-199728330c85 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:45.626320 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-04a4cb0d-7bd9-405f-be38-199728330c85 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.247667 Oct 24 10:38:45.627449 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1539/3165] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:45 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:45.658737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-cd21a858-b387-4900-9c7a-ef5a07d90b11 req-31db0a6e-e87c-4ba7-809f-c3992669a56e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d4c883-f34d-4326-8505-2d66bd047dc8", "name": "network-vif-plugged", "status": "completed", "tag": "0c4d075a-267d-4bd1-8a69-d9825c34d8a2"}, {"server_uuid": "a7aeb942-aab8-4051-b5ac-b4cab02dc9d0", "name": "network-vif-plugged", "status": "completed", "tag": "60451826-6729-43c6-9b77-3e8ecaa7c65d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:45.686868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cd21a858-b387-4900-9c7a-ef5a07d90b11 req-31db0a6e-e87c-4ba7-809f-c3992669a56e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:45.687614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cd21a858-b387-4900-9c7a-ef5a07d90b11 req-31db0a6e-e87c-4ba7-809f-c3992669a56e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:45.688359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cd21a858-b387-4900-9c7a-ef5a07d90b11 req-31db0a6e-e87c-4ba7-809f-c3992669a56e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:45.712071 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-cd21a858-b387-4900-9c7a-ef5a07d90b11 req-31db0a6e-e87c-4ba7-809f-c3992669a56e service nova] Creating event network-vif-plugged:0c4d075a-267d-4bd1-8a69-d9825c34d8a2 for instance 18d4c883-f34d-4326-8505-2d66bd047dc8 on n-h1-858383-15 Oct 24 10:38:45.717600 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-cd21a858-b387-4900-9c7a-ef5a07d90b11 req-31db0a6e-e87c-4ba7-809f-c3992669a56e service nova] Creating event network-vif-plugged:60451826-6729-43c6-9b77-3e8ecaa7c65d for instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 on n-h2-858383-15 Oct 24 10:38:45.740686 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-cd21a858-b387-4900-9c7a-ef5a07d90b11 req-31db0a6e-e87c-4ba7-809f-c3992669a56e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.090043 Oct 24 10:38:45.743456 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1540/3166] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:45.792715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-30ced6cd-47a5-4e9e-b477-621819509e0d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:45.809021 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-30ced6cd-47a5-4e9e-b477-621819509e0d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 200 len: 1319 microversion: 2.1 time: 0.305632 Oct 24 10:38:45.812909 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1627/3167] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:45 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:45.949441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=24 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:45.953687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7d6e61cf-3363-4bcc-976d-ab8bc91eadf9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:45.954428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7d6e61cf-3363-4bcc-976d-ab8bc91eadf9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:45.989650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d6e61cf-3363-4bcc-976d-ab8bc91eadf9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:45.990456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d6e61cf-3363-4bcc-976d-ab8bc91eadf9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:45.991071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d6e61cf-3363-4bcc-976d-ab8bc91eadf9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:45.999348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d6e61cf-3363-4bcc-976d-ab8bc91eadf9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:46.000016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d6e61cf-3363-4bcc-976d-ab8bc91eadf9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:46.000646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d6e61cf-3363-4bcc-976d-ab8bc91eadf9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:46.020662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-238c65f8-3ff5-469f-b623-d7b5b0fee67d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:46.022290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-238c65f8-3ff5-469f-b623-d7b5b0fee67d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:46.039441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-238c65f8-3ff5-469f-b623-d7b5b0fee67d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:46.043622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-238c65f8-3ff5-469f-b623-d7b5b0fee67d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:46.044320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-238c65f8-3ff5-469f-b623-d7b5b0fee67d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:46.045274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-238c65f8-3ff5-469f-b623-d7b5b0fee67d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:46.047838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-238c65f8-3ff5-469f-b623-d7b5b0fee67d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:46.048533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-238c65f8-3ff5-469f-b623-d7b5b0fee67d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:46.356815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7d6e61cf-3363-4bcc-976d-ab8bc91eadf9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:46.375725 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7d6e61cf-3363-4bcc-976d-ab8bc91eadf9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1522 microversion: 2.1 time: 0.425657 Oct 24 10:38:46.377089 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1541/3168] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:45 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:46.382450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-238c65f8-3ff5-469f-b623-d7b5b0fee67d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:46.397665 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-238c65f8-3ff5-469f-b623-d7b5b0fee67d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1325 microversion: 2.1 time: 0.381855 Oct 24 10:38:46.398788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-53d0ad0f-6f32-4845-93c8-c35f96a988d5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:46.402802 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1628/3169] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:46 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1325 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:38:46.431163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-53d0ad0f-6f32-4845-93c8-c35f96a988d5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:46.438077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53d0ad0f-6f32-4845-93c8-c35f96a988d5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:46.438849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53d0ad0f-6f32-4845-93c8-c35f96a988d5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:46.439456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53d0ad0f-6f32-4845-93c8-c35f96a988d5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:46.440352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53d0ad0f-6f32-4845-93c8-c35f96a988d5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:46.441074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53d0ad0f-6f32-4845-93c8-c35f96a988d5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:46.441670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53d0ad0f-6f32-4845-93c8-c35f96a988d5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:46.530641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0d47e64a-1ed5-4103-8409-9e26177c5eb1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:46.531792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0d47e64a-1ed5-4103-8409-9e26177c5eb1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:46.565286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d47e64a-1ed5-4103-8409-9e26177c5eb1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:46.569540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d47e64a-1ed5-4103-8409-9e26177c5eb1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:46.573974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d47e64a-1ed5-4103-8409-9e26177c5eb1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:46.578051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d47e64a-1ed5-4103-8409-9e26177c5eb1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:46.578693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d47e64a-1ed5-4103-8409-9e26177c5eb1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:46.580680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d47e64a-1ed5-4103-8409-9e26177c5eb1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:46.824689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-53d0ad0f-6f32-4845-93c8-c35f96a988d5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:46.857764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-53d0ad0f-6f32-4845-93c8-c35f96a988d5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:46.859412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-53d0ad0f-6f32-4845-93c8-c35f96a988d5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:46.861860 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-53d0ad0f-6f32-4845-93c8-c35f96a988d5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1660 microversion: 2.32 time: 0.465888 Oct 24 10:38:46.862770 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1542/3170] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:46 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1660 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:46.867894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d8b9eebd-5181-4ce8-b4af-b0ec6113f441 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:46.869371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d8b9eebd-5181-4ce8-b4af-b0ec6113f441 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:46.876537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8b9eebd-5181-4ce8-b4af-b0ec6113f441 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:46.887407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8b9eebd-5181-4ce8-b4af-b0ec6113f441 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:46.888502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8b9eebd-5181-4ce8-b4af-b0ec6113f441 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:46.889652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8b9eebd-5181-4ce8-b4af-b0ec6113f441 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:46.890302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8b9eebd-5181-4ce8-b4af-b0ec6113f441 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:46.890976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8b9eebd-5181-4ce8-b4af-b0ec6113f441 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:46.958053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0d47e64a-1ed5-4103-8409-9e26177c5eb1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:46.966467 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0d47e64a-1ed5-4103-8409-9e26177c5eb1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1333 microversion: 2.1 time: 0.442783 Oct 24 10:38:46.967045 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1629/3171] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:46 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1333 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:38:46.976525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bb77965d-01ff-461d-a695-4763186190e9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:46.977167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bb77965d-01ff-461d-a695-4763186190e9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:47.003717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb77965d-01ff-461d-a695-4763186190e9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:47.004381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb77965d-01ff-461d-a695-4763186190e9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:47.004823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb77965d-01ff-461d-a695-4763186190e9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:47.005553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb77965d-01ff-461d-a695-4763186190e9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:47.006004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb77965d-01ff-461d-a695-4763186190e9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:47.006484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb77965d-01ff-461d-a695-4763186190e9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:47.093573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d8b9eebd-5181-4ce8-b4af-b0ec6113f441 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:47.108616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d8b9eebd-5181-4ce8-b4af-b0ec6113f441 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:47.112567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d8b9eebd-5181-4ce8-b4af-b0ec6113f441 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:47.130421 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d8b9eebd-5181-4ce8-b4af-b0ec6113f441 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.266303 Oct 24 10:38:47.131032 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1543/3172] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:46 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:47.401822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6520dc3d-53a7-44b5-9e7c-50bd77f80ddf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:47.403136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6520dc3d-53a7-44b5-9e7c-50bd77f80ddf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:47.428223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6520dc3d-53a7-44b5-9e7c-50bd77f80ddf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:47.428940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6520dc3d-53a7-44b5-9e7c-50bd77f80ddf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:47.432441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6520dc3d-53a7-44b5-9e7c-50bd77f80ddf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:47.433617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6520dc3d-53a7-44b5-9e7c-50bd77f80ddf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:47.434263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6520dc3d-53a7-44b5-9e7c-50bd77f80ddf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:47.434851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6520dc3d-53a7-44b5-9e7c-50bd77f80ddf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:47.725303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bb77965d-01ff-461d-a695-4763186190e9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:47.742676 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bb77965d-01ff-461d-a695-4763186190e9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 200 len: 1510 microversion: 2.1 time: 0.774575 Oct 24 10:38:47.749023 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1630/3173] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:46 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 1510 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:47.760675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f807dbea-ae7b-4009-8b76-8b6e9af1765c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:47.765721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f807dbea-ae7b-4009-8b76-8b6e9af1765c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:47.784328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f807dbea-ae7b-4009-8b76-8b6e9af1765c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:47.791377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f807dbea-ae7b-4009-8b76-8b6e9af1765c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:47.800402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f807dbea-ae7b-4009-8b76-8b6e9af1765c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:47.802431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f807dbea-ae7b-4009-8b76-8b6e9af1765c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:47.803796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f807dbea-ae7b-4009-8b76-8b6e9af1765c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:47.804432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f807dbea-ae7b-4009-8b76-8b6e9af1765c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:48.091520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6520dc3d-53a7-44b5-9e7c-50bd77f80ddf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:48.100817 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6520dc3d-53a7-44b5-9e7c-50bd77f80ddf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1522 microversion: 2.1 time: 0.704837 Oct 24 10:38:48.104789 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1544/3174] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:47 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1522 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:48.109832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-caac4eaa-9af1-4201-85a3-80af0cea2e0f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:48.121730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-caac4eaa-9af1-4201-85a3-80af0cea2e0f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:48.138141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-caac4eaa-9af1-4201-85a3-80af0cea2e0f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:48.138757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-caac4eaa-9af1-4201-85a3-80af0cea2e0f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:48.139312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-caac4eaa-9af1-4201-85a3-80af0cea2e0f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:48.140315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-caac4eaa-9af1-4201-85a3-80af0cea2e0f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:48.140695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-caac4eaa-9af1-4201-85a3-80af0cea2e0f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:48.141387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-caac4eaa-9af1-4201-85a3-80af0cea2e0f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:48.396333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f807dbea-ae7b-4009-8b76-8b6e9af1765c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:48.410219 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f807dbea-ae7b-4009-8b76-8b6e9af1765c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1325 microversion: 2.1 time: 0.657125 Oct 24 10:38:48.417044 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1631/3175] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:47 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1325 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:48.428223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e40f4fc8-5604-4900-80f8-d65980cbaf81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:48.428877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e40f4fc8-5604-4900-80f8-d65980cbaf81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:48.443319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e40f4fc8-5604-4900-80f8-d65980cbaf81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:48.444640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e40f4fc8-5604-4900-80f8-d65980cbaf81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:48.445902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e40f4fc8-5604-4900-80f8-d65980cbaf81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:48.447188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e40f4fc8-5604-4900-80f8-d65980cbaf81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:48.447830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e40f4fc8-5604-4900-80f8-d65980cbaf81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:48.448449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e40f4fc8-5604-4900-80f8-d65980cbaf81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:48.455988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-caac4eaa-9af1-4201-85a3-80af0cea2e0f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:48.469852 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-caac4eaa-9af1-4201-85a3-80af0cea2e0f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1513 microversion: 2.1 time: 0.363668 Oct 24 10:38:48.476215 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1545/3176] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:48 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1513 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:48.481992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e8acdc93-dd5b-418a-9cbd-bfe0798f01ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:48.486473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e8acdc93-dd5b-418a-9cbd-bfe0798f01ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:48.501604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8acdc93-dd5b-418a-9cbd-bfe0798f01ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:48.506694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8acdc93-dd5b-418a-9cbd-bfe0798f01ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:48.507450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8acdc93-dd5b-418a-9cbd-bfe0798f01ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:48.508386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8acdc93-dd5b-418a-9cbd-bfe0798f01ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:48.511348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8acdc93-dd5b-418a-9cbd-bfe0798f01ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:48.511955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8acdc93-dd5b-418a-9cbd-bfe0798f01ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:48.842003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e40f4fc8-5604-4900-80f8-d65980cbaf81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:48.852000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e40f4fc8-5604-4900-80f8-d65980cbaf81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:48.854462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e40f4fc8-5604-4900-80f8-d65980cbaf81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:48.861873 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e40f4fc8-5604-4900-80f8-d65980cbaf81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1706 microversion: 2.32 time: 0.443651 Oct 24 10:38:48.863982 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1632/3177] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:48 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1706 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:48.869554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e002a2b-93fc-4e7b-be3b-bae2496cb077 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:48.884780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3e002a2b-93fc-4e7b-be3b-bae2496cb077 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:48.892599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e002a2b-93fc-4e7b-be3b-bae2496cb077 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:48.893543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e002a2b-93fc-4e7b-be3b-bae2496cb077 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:48.894277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e002a2b-93fc-4e7b-be3b-bae2496cb077 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:48.895236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e002a2b-93fc-4e7b-be3b-bae2496cb077 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:48.895927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e002a2b-93fc-4e7b-be3b-bae2496cb077 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:48.896594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e002a2b-93fc-4e7b-be3b-bae2496cb077 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:49.257589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e8acdc93-dd5b-418a-9cbd-bfe0798f01ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:49.279468 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e8acdc93-dd5b-418a-9cbd-bfe0798f01ed tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1333 microversion: 2.1 time: 0.801768 Oct 24 10:38:49.283613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3e002a2b-93fc-4e7b-be3b-bae2496cb077 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:49.298667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3e002a2b-93fc-4e7b-be3b-bae2496cb077 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:49.300038 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1546/3178] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:48 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1333 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:49.310190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3e002a2b-93fc-4e7b-be3b-bae2496cb077 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:49.327999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-77f8d318-0954-4576-974f-401db629d861 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:49.328821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-77f8d318-0954-4576-974f-401db629d861 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 2f024708-057e-4eda-9894-fb480a85c693] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:49.336163 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3e002a2b-93fc-4e7b-be3b-bae2496cb077 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.470640 Oct 24 10:38:49.349530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77f8d318-0954-4576-974f-401db629d861 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:49.350063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77f8d318-0954-4576-974f-401db629d861 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:49.350526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77f8d318-0954-4576-974f-401db629d861 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:49.351275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77f8d318-0954-4576-974f-401db629d861 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:49.351747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77f8d318-0954-4576-974f-401db629d861 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:49.352533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77f8d318-0954-4576-974f-401db629d861 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:49.369538 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1633/3179] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:48 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:49.382805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-92bcd988-38fb-411b-a193-901cfa0866f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:49.384527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-92bcd988-38fb-411b-a193-901cfa0866f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:49.391887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92bcd988-38fb-411b-a193-901cfa0866f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:49.392720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92bcd988-38fb-411b-a193-901cfa0866f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:49.393377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92bcd988-38fb-411b-a193-901cfa0866f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:49.394285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92bcd988-38fb-411b-a193-901cfa0866f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:49.394965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92bcd988-38fb-411b-a193-901cfa0866f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:49.395586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92bcd988-38fb-411b-a193-901cfa0866f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:49.665666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-77f8d318-0954-4576-974f-401db629d861 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:49.681402 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-77f8d318-0954-4576-974f-401db629d861 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693" status: 200 len: 1511 microversion: 2.1 time: 0.378951 Oct 24 10:38:49.682370 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1547/3180] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:49 2022] GET /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693 => generated 1511 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:49.689313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e2d613e8-8af9-465d-9192-e8246b470b3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:49.690322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e2d613e8-8af9-465d-9192-e8246b470b3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:49.698588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-92bcd988-38fb-411b-a193-901cfa0866f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:49.700037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2d613e8-8af9-465d-9192-e8246b470b3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:49.700782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2d613e8-8af9-465d-9192-e8246b470b3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:49.701751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2d613e8-8af9-465d-9192-e8246b470b3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:49.702728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2d613e8-8af9-465d-9192-e8246b470b3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:49.703422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2d613e8-8af9-465d-9192-e8246b470b3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:49.704041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2d613e8-8af9-465d-9192-e8246b470b3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:49.707828 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-92bcd988-38fb-411b-a193-901cfa0866f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1522 microversion: 2.1 time: 0.337098 Oct 24 10:38:49.708422 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1634/3181] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:49 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:49.713551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-77538017-c62b-4c3b-8a86-5a715c12a9e1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:49.724688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-77538017-c62b-4c3b-8a86-5a715c12a9e1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:49.735960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-77538017-c62b-4c3b-8a86-5a715c12a9e1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:38:49.762148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77538017-c62b-4c3b-8a86-5a715c12a9e1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:49.762984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77538017-c62b-4c3b-8a86-5a715c12a9e1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:49.763671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77538017-c62b-4c3b-8a86-5a715c12a9e1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:49.765369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77538017-c62b-4c3b-8a86-5a715c12a9e1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:49.766072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77538017-c62b-4c3b-8a86-5a715c12a9e1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:49.766734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77538017-c62b-4c3b-8a86-5a715c12a9e1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:49.825548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:49.889603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-77538017-c62b-4c3b-8a86-5a715c12a9e1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:38:49.951834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e2d613e8-8af9-465d-9192-e8246b470b3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:49.969509 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e2d613e8-8af9-465d-9192-e8246b470b3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1521 microversion: 2.1 time: 0.285341 Oct 24 10:38:49.970684 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1548/3182] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:49 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:49.975680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5187afe5-2e29-43af-a09c-fde154fb485f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:49.978130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5187afe5-2e29-43af-a09c-fde154fb485f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:49.989985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5187afe5-2e29-43af-a09c-fde154fb485f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:49.992441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5187afe5-2e29-43af-a09c-fde154fb485f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:49.993221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5187afe5-2e29-43af-a09c-fde154fb485f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:49.995719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5187afe5-2e29-43af-a09c-fde154fb485f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:49.996435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5187afe5-2e29-43af-a09c-fde154fb485f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:49.998246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5187afe5-2e29-43af-a09c-fde154fb485f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:50.010354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-77538017-c62b-4c3b-8a86-5a715c12a9e1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:50.023550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77538017-c62b-4c3b-8a86-5a715c12a9e1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:50.029102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77538017-c62b-4c3b-8a86-5a715c12a9e1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:50.029877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77538017-c62b-4c3b-8a86-5a715c12a9e1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:50.316478 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-77538017-c62b-4c3b-8a86-5a715c12a9e1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 0.606502 Oct 24 10:38:50.317112 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1635/3183] 10.222.0.50 () {58 vars in 1167 bytes} [Mon Oct 24 10:38:49 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:50.320591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5187afe5-2e29-43af-a09c-fde154fb485f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:50.322714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9e0a9389-7be4-4ef1-9072-0331f0097347 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:50.323532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9e0a9389-7be4-4ef1-9072-0331f0097347 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:50.335110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e0a9389-7be4-4ef1-9072-0331f0097347 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:50.335615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e0a9389-7be4-4ef1-9072-0331f0097347 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:50.336051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e0a9389-7be4-4ef1-9072-0331f0097347 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:50.336800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e0a9389-7be4-4ef1-9072-0331f0097347 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:50.337292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e0a9389-7be4-4ef1-9072-0331f0097347 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:50.337787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e0a9389-7be4-4ef1-9072-0331f0097347 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:50.345821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5187afe5-2e29-43af-a09c-fde154fb485f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:50.349312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5187afe5-2e29-43af-a09c-fde154fb485f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:50.350567 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5187afe5-2e29-43af-a09c-fde154fb485f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1752 microversion: 2.32 time: 0.378729 Oct 24 10:38:50.351144 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1549/3184] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:49 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1752 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:50.370087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-784de253-5928-4b04-aed7-19fc7fa8423d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:50.370727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-784de253-5928-4b04-aed7-19fc7fa8423d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:50.390676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-784de253-5928-4b04-aed7-19fc7fa8423d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:50.391194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-784de253-5928-4b04-aed7-19fc7fa8423d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:50.391646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-784de253-5928-4b04-aed7-19fc7fa8423d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:50.401870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-784de253-5928-4b04-aed7-19fc7fa8423d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:50.402317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-784de253-5928-4b04-aed7-19fc7fa8423d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:50.402909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-784de253-5928-4b04-aed7-19fc7fa8423d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:50.661554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9e0a9389-7be4-4ef1-9072-0331f0097347 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:50.672494 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9e0a9389-7be4-4ef1-9072-0331f0097347 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1521 microversion: 2.1 time: 0.354192 Oct 24 10:38:50.675054 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1636/3185] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:50 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:50.692612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-11ca32c3-f717-4388-b50b-d8ea7441da70 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:50.705709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-11ca32c3-f717-4388-b50b-d8ea7441da70 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:50.714529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-11ca32c3-f717-4388-b50b-d8ea7441da70 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1059140205', 'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:38:50.725671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ca32c3-f717-4388-b50b-d8ea7441da70 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:50.728620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ca32c3-f717-4388-b50b-d8ea7441da70 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:50.729248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ca32c3-f717-4388-b50b-d8ea7441da70 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:50.732035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ca32c3-f717-4388-b50b-d8ea7441da70 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:50.732605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ca32c3-f717-4388-b50b-d8ea7441da70 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:50.733147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ca32c3-f717-4388-b50b-d8ea7441da70 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:50.738819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-784de253-5928-4b04-aed7-19fc7fa8423d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:50.760727 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-784de253-5928-4b04-aed7-19fc7fa8423d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1333 microversion: 2.1 time: 0.406610 Oct 24 10:38:50.763393 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1550/3186] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:50 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1333 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:50.777039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8f8e36c2-bc51-4d25-99f6-063c4c541423 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:50.778167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8f8e36c2-bc51-4d25-99f6-063c4c541423 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:50.806366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f8e36c2-bc51-4d25-99f6-063c4c541423 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:50.806995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f8e36c2-bc51-4d25-99f6-063c4c541423 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:50.807451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f8e36c2-bc51-4d25-99f6-063c4c541423 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:50.814502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f8e36c2-bc51-4d25-99f6-063c4c541423 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:50.814985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f8e36c2-bc51-4d25-99f6-063c4c541423 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:50.815423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f8e36c2-bc51-4d25-99f6-063c4c541423 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:50.941175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-11ca32c3-f717-4388-b50b-d8ea7441da70 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:38:51.061347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8f8e36c2-bc51-4d25-99f6-063c4c541423 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:51.078718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8f8e36c2-bc51-4d25-99f6-063c4c541423 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:51.083301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-11ca32c3-f717-4388-b50b-d8ea7441da70 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:51.086429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8f8e36c2-bc51-4d25-99f6-063c4c541423 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:51.098812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ca32c3-f717-4388-b50b-d8ea7441da70 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:51.099283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ca32c3-f717-4388-b50b-d8ea7441da70 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:51.107879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ca32c3-f717-4388-b50b-d8ea7441da70 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:51.110544 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8f8e36c2-bc51-4d25-99f6-063c4c541423 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.344746 Oct 24 10:38:51.136926 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1551/3187] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:50 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:51.146752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a13c38db-7ca6-425b-885c-321b5fa32677 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2144696194", "metadata": {"": ""}}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a13c38db-7ca6-425b-885c-321b5fa32677 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Request method failure captured: Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0/action HTTP/1.1 Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 107 Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmsZ6iCeMLTpciKzT-IOd-jSbp-Ock4X7vHFbSgox-iuMV2hxDyst1XnTlhe7a0yhnti-D3qlDTVLsDNpGHmdQxuIxzHTz6ZfOA3sAyV-nTFUvtxnUe0hLrgWnomxwn6YBZ-Qwy9VkVlCsoa7UEzkg7FPtyXY6LqjelB4oPUwFh9rLg Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5edfb6d8f84547399863eec5c89e6933", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 1f089833f359473ebfa681931e8ffc06 Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2144696194", "metadata": {"": ""}}} Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'a7aeb942-aab8-4051-b5ac-b4cab02dc9d0', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2144696194', 'metadata': {'': ''}}}} Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'': ''} Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:38:51.157617 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a13c38db-7ca6-425b-885c-321b5fa32677 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a13c38db-7ca6-425b-885c-321b5fa32677 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "POST /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0/action" status: 400 len: 170 microversion: 2.1 time: 0.021132 Oct 24 10:38:51.162988 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1552/3188] 10.222.0.50 () {60 vars in 1279 bytes} [Mon Oct 24 10:38:51 2022] POST /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0/action => generated 170 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:38:51.167525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0fd32c26-4bed-43df-81c1-ed70f110c114 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:51.168156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0fd32c26-4bed-43df-81c1-ed70f110c114 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:51.175322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fd32c26-4bed-43df-81c1-ed70f110c114 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:51.175980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fd32c26-4bed-43df-81c1-ed70f110c114 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:51.176427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fd32c26-4bed-43df-81c1-ed70f110c114 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:51.177164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fd32c26-4bed-43df-81c1-ed70f110c114 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:51.177617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fd32c26-4bed-43df-81c1-ed70f110c114 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:51.178039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fd32c26-4bed-43df-81c1-ed70f110c114 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:51.972608 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-11ca32c3-f717-4388-b50b-d8ea7441da70 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1059140205" status: 200 len: 1516 microversion: 2.1 time: 1.284085 Oct 24 10:38:51.973906 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1637/3189] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:38:50 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1059140205 => generated 1516 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:51.991878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f1d308c0-135d-4142-ac6d-88a1ec754408 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:51.993477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f1d308c0-135d-4142-ac6d-88a1ec754408 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:52.010351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1d308c0-135d-4142-ac6d-88a1ec754408 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:52.011198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1d308c0-135d-4142-ac6d-88a1ec754408 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:52.011660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1d308c0-135d-4142-ac6d-88a1ec754408 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:52.012546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1d308c0-135d-4142-ac6d-88a1ec754408 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:52.013055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1d308c0-135d-4142-ac6d-88a1ec754408 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:52.013497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1d308c0-135d-4142-ac6d-88a1ec754408 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:52.028575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0fd32c26-4bed-43df-81c1-ed70f110c114 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:52.072903 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0fd32c26-4bed-43df-81c1-ed70f110c114 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1522 microversion: 2.1 time: 0.911491 Oct 24 10:38:52.087383 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1553/3190] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:51 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1522 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:52.104197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ed513f4e-3ebc-4c4c-b51a-943c993127e9 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:52.110930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ed513f4e-3ebc-4c4c-b51a-943c993127e9 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:52.135141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed513f4e-3ebc-4c4c-b51a-943c993127e9 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:52.136259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed513f4e-3ebc-4c4c-b51a-943c993127e9 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:52.137050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed513f4e-3ebc-4c4c-b51a-943c993127e9 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:52.160660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed513f4e-3ebc-4c4c-b51a-943c993127e9 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:52.161365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed513f4e-3ebc-4c4c-b51a-943c993127e9 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:52.161838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed513f4e-3ebc-4c4c-b51a-943c993127e9 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:52.405525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f1d308c0-135d-4142-ac6d-88a1ec754408 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:52.413276 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f1d308c0-135d-4142-ac6d-88a1ec754408 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1521 microversion: 2.1 time: 0.426002 Oct 24 10:38:52.413869 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1638/3191] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:51 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:52.435545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1ab7df52-1208-448d-9716-8f0503c81a69 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:52.435545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1ab7df52-1208-448d-9716-8f0503c81a69 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:52.448535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ab7df52-1208-448d-9716-8f0503c81a69 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:52.449644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ab7df52-1208-448d-9716-8f0503c81a69 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:52.450105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ab7df52-1208-448d-9716-8f0503c81a69 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:52.450811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ab7df52-1208-448d-9716-8f0503c81a69 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:52.451261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ab7df52-1208-448d-9716-8f0503c81a69 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:52.451684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ab7df52-1208-448d-9716-8f0503c81a69 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:52.558002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ed513f4e-3ebc-4c4c-b51a-943c993127e9 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:52.601512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ed513f4e-3ebc-4c4c-b51a-943c993127e9 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:52.603459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ed513f4e-3ebc-4c4c-b51a-943c993127e9 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:52.611251 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ed513f4e-3ebc-4c4c-b51a-943c993127e9 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1798 microversion: 2.32 time: 0.522419 Oct 24 10:38:52.617377 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1554/3192] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:52 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1798 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:52.655174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e8108e3-03c8-4cf9-b981-0e56b5209d6b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:52.678743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1e8108e3-03c8-4cf9-b981-0e56b5209d6b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:52.680030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e8108e3-03c8-4cf9-b981-0e56b5209d6b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:38:52.699466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e8108e3-03c8-4cf9-b981-0e56b5209d6b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:52.702283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e8108e3-03c8-4cf9-b981-0e56b5209d6b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:52.710262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e8108e3-03c8-4cf9-b981-0e56b5209d6b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:52.714920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e8108e3-03c8-4cf9-b981-0e56b5209d6b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:52.716464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e8108e3-03c8-4cf9-b981-0e56b5209d6b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:52.717492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e8108e3-03c8-4cf9-b981-0e56b5209d6b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:52.893588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1ab7df52-1208-448d-9716-8f0503c81a69 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:52.902999 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1ab7df52-1208-448d-9716-8f0503c81a69 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1333 microversion: 2.1 time: 0.487939 Oct 24 10:38:52.903590 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1639/3193] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:52 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1333 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:52.914579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.multi_cell_list [None req-1e8108e3-03c8-4cf9-b981-0e56b5209d6b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120425) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:38:52.926952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7e71e669-ba91-4051-8f6f-c8e227c26f22 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:52.927557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7e71e669-ba91-4051-8f6f-c8e227c26f22 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:52.938302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e71e669-ba91-4051-8f6f-c8e227c26f22 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:52.938789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e71e669-ba91-4051-8f6f-c8e227c26f22 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:52.939223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e71e669-ba91-4051-8f6f-c8e227c26f22 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:52.942185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e71e669-ba91-4051-8f6f-c8e227c26f22 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:52.942656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e71e669-ba91-4051-8f6f-c8e227c26f22 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:52.943091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e71e669-ba91-4051-8f6f-c8e227c26f22 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:53.087535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1e8108e3-03c8-4cf9-b981-0e56b5209d6b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:53.094113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7e71e669-ba91-4051-8f6f-c8e227c26f22 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:53.104707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7e71e669-ba91-4051-8f6f-c8e227c26f22 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:53.105045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e8108e3-03c8-4cf9-b981-0e56b5209d6b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:53.105045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e8108e3-03c8-4cf9-b981-0e56b5209d6b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:53.105045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e8108e3-03c8-4cf9-b981-0e56b5209d6b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:53.113835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7e71e669-ba91-4051-8f6f-c8e227c26f22 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:53.127543 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7e71e669-ba91-4051-8f6f-c8e227c26f22 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.208427 Oct 24 10:38:53.128321 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1640/3194] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:52 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:53.174871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-50b2659b-40c4-45fd-8f69-9907a0bf9e3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:53.175394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-50b2659b-40c4-45fd-8f69-9907a0bf9e3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:53.200868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50b2659b-40c4-45fd-8f69-9907a0bf9e3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:53.201369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50b2659b-40c4-45fd-8f69-9907a0bf9e3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:53.205608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50b2659b-40c4-45fd-8f69-9907a0bf9e3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:53.207462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50b2659b-40c4-45fd-8f69-9907a0bf9e3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:53.208426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50b2659b-40c4-45fd-8f69-9907a0bf9e3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:53.209939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50b2659b-40c4-45fd-8f69-9907a0bf9e3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:53.720689 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1e8108e3-03c8-4cf9-b981-0e56b5209d6b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 1.101739 Oct 24 10:38:53.722108 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1555/3195] 10.222.0.50 () {58 vars in 1173 bytes} [Mon Oct 24 10:38:52 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:53.728820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3a61979e-1af4-4c2e-9b5e-71988c7d559d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:53.730604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3a61979e-1af4-4c2e-9b5e-71988c7d559d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:53.743871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a61979e-1af4-4c2e-9b5e-71988c7d559d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:53.746906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a61979e-1af4-4c2e-9b5e-71988c7d559d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:53.748929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a61979e-1af4-4c2e-9b5e-71988c7d559d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:53.750080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a61979e-1af4-4c2e-9b5e-71988c7d559d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:53.753757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a61979e-1af4-4c2e-9b5e-71988c7d559d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:53.754800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a61979e-1af4-4c2e-9b5e-71988c7d559d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:53.768410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-50b2659b-40c4-45fd-8f69-9907a0bf9e3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:53.784001 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-50b2659b-40c4-45fd-8f69-9907a0bf9e3c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1521 microversion: 2.1 time: 0.620637 Oct 24 10:38:53.785209 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1641/3196] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:53 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1521 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:53.790396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-447d769d-6186-49ef-9785-b83fb352da44 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:53.793271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-447d769d-6186-49ef-9785-b83fb352da44 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:53.807403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-447d769d-6186-49ef-9785-b83fb352da44 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:53.810387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-447d769d-6186-49ef-9785-b83fb352da44 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:53.811766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-447d769d-6186-49ef-9785-b83fb352da44 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:53.813662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-447d769d-6186-49ef-9785-b83fb352da44 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:53.816822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-447d769d-6186-49ef-9785-b83fb352da44 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:53.817521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-447d769d-6186-49ef-9785-b83fb352da44 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:54.042200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3a61979e-1af4-4c2e-9b5e-71988c7d559d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:54.055220 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3a61979e-1af4-4c2e-9b5e-71988c7d559d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1522 microversion: 2.1 time: 0.329713 Oct 24 10:38:54.057809 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1556/3197] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:53 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:54.068634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fc2e3d12-76d7-448c-9198-44de9ed8086a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:54.078468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fc2e3d12-76d7-448c-9198-44de9ed8086a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:54.084289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.compute.servers [None req-fc2e3d12-76d7-448c-9198-44de9ed8086a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Removing options 'limit' from query {{(pid=120425) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 24 10:38:54.091970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fc2e3d12-76d7-448c-9198-44de9ed8086a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:38:54.102047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc2e3d12-76d7-448c-9198-44de9ed8086a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:54.102866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc2e3d12-76d7-448c-9198-44de9ed8086a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:54.103538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc2e3d12-76d7-448c-9198-44de9ed8086a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:54.107835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc2e3d12-76d7-448c-9198-44de9ed8086a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:54.108594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc2e3d12-76d7-448c-9198-44de9ed8086a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:54.109316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc2e3d12-76d7-448c-9198-44de9ed8086a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:54.147102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:54.170762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fc2e3d12-76d7-448c-9198-44de9ed8086a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:54.179063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc2e3d12-76d7-448c-9198-44de9ed8086a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:54.180791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc2e3d12-76d7-448c-9198-44de9ed8086a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:54.181853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc2e3d12-76d7-448c-9198-44de9ed8086a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:54.213862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-447d769d-6186-49ef-9785-b83fb352da44 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:54.225421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-447d769d-6186-49ef-9785-b83fb352da44 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:54.231263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-447d769d-6186-49ef-9785-b83fb352da44 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:54.237393 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-447d769d-6186-49ef-9785-b83fb352da44 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1844 microversion: 2.32 time: 0.449548 Oct 24 10:38:54.240822 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1642/3198] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:53 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1844 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:54.255073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1d31c83c-5203-4218-8522-cb18b0589104 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1896779507", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1d31c83c-5203-4218-8522-cb18b0589104 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Request method failure captured: Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0/action HTTP/1.1 Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 619 Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmsZ6iCeMLTpciKzT-IOd-jSbp-Ock4X7vHFbSgox-iuMV2hxDyst1XnTlhe7a0yhnti-D3qlDTVLsDNpGHmdQxuIxzHTz6ZfOA3sAyV-nTFUvtxnUe0hLrgWnomxwn6YBZ-Qwy9VkVlCsoa7UEzkg7FPtyXY6LqjelB4oPUwFh9rLg Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5edfb6d8f84547399863eec5c89e6933", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 1f089833f359473ebfa681931e8ffc06 Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1896779507", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'a7aeb942-aab8-4051-b5ac-b4cab02dc9d0', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1896779507', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:38:54.271674 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 24 10:38:54.275869 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:54.283061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1d31c83c-5203-4218-8522-cb18b0589104 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:38:54.284147 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1d31c83c-5203-4218-8522-cb18b0589104 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "POST /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0/action" status: 400 len: 938 microversion: 2.1 time: 0.041946 Oct 24 10:38:54.287694 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1643/3199] 10.222.0.50 () {60 vars in 1279 bytes} [Mon Oct 24 10:38:54 2022] POST /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0/action => generated 938 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:38:54.301787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f27e43dd-51cc-4365-99ca-f52ee6aab05b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:54.303869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f27e43dd-51cc-4365-99ca-f52ee6aab05b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:54.330612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27e43dd-51cc-4365-99ca-f52ee6aab05b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:54.331177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27e43dd-51cc-4365-99ca-f52ee6aab05b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:54.331639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27e43dd-51cc-4365-99ca-f52ee6aab05b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:54.332409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27e43dd-51cc-4365-99ca-f52ee6aab05b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:54.332918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27e43dd-51cc-4365-99ca-f52ee6aab05b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:54.333424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27e43dd-51cc-4365-99ca-f52ee6aab05b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:54.512465 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fc2e3d12-76d7-448c-9198-44de9ed8086a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.452790 Oct 24 10:38:54.513409 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1557/3200] 10.222.0.50 () {58 vars in 1161 bytes} [Mon Oct 24 10:38:54 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:54.518695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-985c88cb-6584-4eda-99a6-1077d16f9f3c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:54.519551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-985c88cb-6584-4eda-99a6-1077d16f9f3c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:54.537693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-985c88cb-6584-4eda-99a6-1077d16f9f3c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:54.538181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-985c88cb-6584-4eda-99a6-1077d16f9f3c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:54.541232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-985c88cb-6584-4eda-99a6-1077d16f9f3c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:54.546404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-985c88cb-6584-4eda-99a6-1077d16f9f3c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:54.547400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-985c88cb-6584-4eda-99a6-1077d16f9f3c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:54.550712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-985c88cb-6584-4eda-99a6-1077d16f9f3c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:54.677896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f27e43dd-51cc-4365-99ca-f52ee6aab05b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:54.694742 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f27e43dd-51cc-4365-99ca-f52ee6aab05b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1333 microversion: 2.1 time: 0.405741 Oct 24 10:38:54.698072 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1644/3201] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:54 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1333 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:54.712429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54b948fd-d49a-4bbb-ad80-b143f2f41061 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:54.713449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-54b948fd-d49a-4bbb-ad80-b143f2f41061 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:54.729904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54b948fd-d49a-4bbb-ad80-b143f2f41061 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:54.733366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54b948fd-d49a-4bbb-ad80-b143f2f41061 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:54.733836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54b948fd-d49a-4bbb-ad80-b143f2f41061 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:54.736203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54b948fd-d49a-4bbb-ad80-b143f2f41061 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:54.739119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54b948fd-d49a-4bbb-ad80-b143f2f41061 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:54.740252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54b948fd-d49a-4bbb-ad80-b143f2f41061 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:54.770604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-985c88cb-6584-4eda-99a6-1077d16f9f3c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:54.782777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-985c88cb-6584-4eda-99a6-1077d16f9f3c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:54.788298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-985c88cb-6584-4eda-99a6-1077d16f9f3c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:54.798800 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-985c88cb-6584-4eda-99a6-1077d16f9f3c tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.284328 Oct 24 10:38:54.801327 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1558/3202] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:54 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:54.816877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e42b51f8-017d-4674-a408-82782927ce92 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:54.827029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e42b51f8-017d-4674-a408-82782927ce92 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:54.829296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e42b51f8-017d-4674-a408-82782927ce92 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:38:54.845562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e42b51f8-017d-4674-a408-82782927ce92 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:54.846681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e42b51f8-017d-4674-a408-82782927ce92 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:54.848003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e42b51f8-017d-4674-a408-82782927ce92 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:54.851369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e42b51f8-017d-4674-a408-82782927ce92 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:54.852612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e42b51f8-017d-4674-a408-82782927ce92 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:54.855375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e42b51f8-017d-4674-a408-82782927ce92 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:54.975287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-54b948fd-d49a-4bbb-ad80-b143f2f41061 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:54.988269 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-54b948fd-d49a-4bbb-ad80-b143f2f41061 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1521 microversion: 2.1 time: 0.288952 Oct 24 10:38:54.989436 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1645/3203] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:54 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:54.994630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-e73dd76d-334f-46e7-8b43-37eef4fde190 req-297ce3a8-a219-4116-9229-04f9725753af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "tag": "02b89d7c-b6a2-401d-89a3-9361e02645ab"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:55.005777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e73dd76d-334f-46e7-8b43-37eef4fde190 req-297ce3a8-a219-4116-9229-04f9725753af service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:55.007247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e73dd76d-334f-46e7-8b43-37eef4fde190 req-297ce3a8-a219-4116-9229-04f9725753af service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:55.007915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e73dd76d-334f-46e7-8b43-37eef4fde190 req-297ce3a8-a219-4116-9229-04f9725753af service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:55.028757 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-e73dd76d-334f-46e7-8b43-37eef4fde190 req-297ce3a8-a219-4116-9229-04f9725753af service nova] Creating event network-changed:02b89d7c-b6a2-401d-89a3-9361e02645ab for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:38:55.045925 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-e73dd76d-334f-46e7-8b43-37eef4fde190 req-297ce3a8-a219-4116-9229-04f9725753af service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054901 Oct 24 10:38:55.048719 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1646/3204] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:55.063201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-419430a0-aaaf-4fc9-bea8-f9248a0c2201 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:55.065740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-419430a0-aaaf-4fc9-bea8-f9248a0c2201 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:55.083067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:55.084107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.multi_cell_list [None req-e42b51f8-017d-4674-a408-82782927ce92 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120425) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:38:55.092916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-419430a0-aaaf-4fc9-bea8-f9248a0c2201 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:55.093829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-419430a0-aaaf-4fc9-bea8-f9248a0c2201 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:55.094854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-419430a0-aaaf-4fc9-bea8-f9248a0c2201 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:55.099188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-419430a0-aaaf-4fc9-bea8-f9248a0c2201 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:55.100608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-419430a0-aaaf-4fc9-bea8-f9248a0c2201 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:55.101323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-419430a0-aaaf-4fc9-bea8-f9248a0c2201 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:55.268946 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e42b51f8-017d-4674-a408-82782927ce92 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.466164 Oct 24 10:38:55.270896 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1559/3205] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:38:54 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:55.286471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2714364c-b5e8-43df-98f2-646588a3c22c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:55.287965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2714364c-b5e8-43df-98f2-646588a3c22c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:55.303635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2714364c-b5e8-43df-98f2-646588a3c22c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:55.304459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2714364c-b5e8-43df-98f2-646588a3c22c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:55.306048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2714364c-b5e8-43df-98f2-646588a3c22c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:55.310086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2714364c-b5e8-43df-98f2-646588a3c22c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:55.310960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2714364c-b5e8-43df-98f2-646588a3c22c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:55.313292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2714364c-b5e8-43df-98f2-646588a3c22c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:55.483839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-419430a0-aaaf-4fc9-bea8-f9248a0c2201 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:55.493450 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-419430a0-aaaf-4fc9-bea8-f9248a0c2201 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1521 microversion: 2.1 time: 0.442338 Oct 24 10:38:55.512863 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1647/3206] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:55 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1521 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:55.519634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-75c7eb23-319f-4d91-9f8a-81f825bdf2cd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:55.519634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-75c7eb23-319f-4d91-9f8a-81f825bdf2cd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:55.530213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-75c7eb23-319f-4d91-9f8a-81f825bdf2cd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:55.530970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-75c7eb23-319f-4d91-9f8a-81f825bdf2cd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:55.531601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-75c7eb23-319f-4d91-9f8a-81f825bdf2cd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:55.532490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-75c7eb23-319f-4d91-9f8a-81f825bdf2cd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:55.533139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-75c7eb23-319f-4d91-9f8a-81f825bdf2cd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:55.533800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-75c7eb23-319f-4d91-9f8a-81f825bdf2cd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:55.749069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2714364c-b5e8-43df-98f2-646588a3c22c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:55.758170 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2714364c-b5e8-43df-98f2-646588a3c22c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1522 microversion: 2.1 time: 0.482709 Oct 24 10:38:55.773730 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1560/3207] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:55 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1522 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:55.785296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-65afc906-fd6d-4180-b8e5-3425c2395614 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:55.791847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-65afc906-fd6d-4180-b8e5-3425c2395614 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:55.792671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.compute.servers [None req-65afc906-fd6d-4180-b8e5-3425c2395614 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Removing options 'limit' from query {{(pid=120425) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 24 10:38:55.794246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-65afc906-fd6d-4180-b8e5-3425c2395614 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:38:55.800336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65afc906-fd6d-4180-b8e5-3425c2395614 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:55.801239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65afc906-fd6d-4180-b8e5-3425c2395614 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:55.801891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65afc906-fd6d-4180-b8e5-3425c2395614 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:55.804183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65afc906-fd6d-4180-b8e5-3425c2395614 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:55.805241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65afc906-fd6d-4180-b8e5-3425c2395614 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:55.806891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65afc906-fd6d-4180-b8e5-3425c2395614 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:55.814410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-75c7eb23-319f-4d91-9f8a-81f825bdf2cd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:55.834255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-75c7eb23-319f-4d91-9f8a-81f825bdf2cd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:55.837701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-75c7eb23-319f-4d91-9f8a-81f825bdf2cd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:55.840571 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-75c7eb23-319f-4d91-9f8a-81f825bdf2cd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1844 microversion: 2.32 time: 0.338233 Oct 24 10:38:55.842840 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1648/3208] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:55 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1844 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:55.851211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2afcd1f5-1412-450b-a9ff-c14e1dcc62c1 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2afcd1f5-1412-450b-a9ff-c14e1dcc62c1 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Request method failure captured: Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0/action HTTP/1.1 Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 285 Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmsZ6iCeMLTpciKzT-IOd-jSbp-Ock4X7vHFbSgox-iuMV2hxDyst1XnTlhe7a0yhnti-D3qlDTVLsDNpGHmdQxuIxzHTz6ZfOA3sAyV-nTFUvtxnUe0hLrgWnomxwn6YBZ-Qwy9VkVlCsoa7UEzkg7FPtyXY6LqjelB4oPUwFh9rLg Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5edfb6d8f84547399863eec5c89e6933", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 1f089833f359473ebfa681931e8ffc06 Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'a7aeb942-aab8-4051-b5ac-b4cab02dc9d0', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:55.863373 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 10:38:55.866763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:55.872924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2afcd1f5-1412-450b-a9ff-c14e1dcc62c1 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:38:55.874433 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2afcd1f5-1412-450b-a9ff-c14e1dcc62c1 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "POST /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0/action" status: 400 len: 619 microversion: 2.1 time: 0.030010 Oct 24 10:38:55.880714 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1649/3209] 10.222.0.50 () {60 vars in 1279 bytes} [Mon Oct 24 10:38:55 2022] POST /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0/action => generated 619 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:38:55.886567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e74a45ee-4d1a-45fd-b9fa-e5ed1f190f15 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:55.889903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.multi_cell_list [None req-65afc906-fd6d-4180-b8e5-3425c2395614 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120425) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:38:55.893774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e74a45ee-4d1a-45fd-b9fa-e5ed1f190f15 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:55.916472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e74a45ee-4d1a-45fd-b9fa-e5ed1f190f15 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:55.917299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e74a45ee-4d1a-45fd-b9fa-e5ed1f190f15 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:55.918028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e74a45ee-4d1a-45fd-b9fa-e5ed1f190f15 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:55.918889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e74a45ee-4d1a-45fd-b9fa-e5ed1f190f15 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:55.919497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e74a45ee-4d1a-45fd-b9fa-e5ed1f190f15 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:55.920079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e74a45ee-4d1a-45fd-b9fa-e5ed1f190f15 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:55.953531 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-65afc906-fd6d-4180-b8e5-3425c2395614 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.171431 Oct 24 10:38:55.956090 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1561/3210] 10.222.0.50 () {58 vars in 1150 bytes} [Mon Oct 24 10:38:55 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:55.961044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7a6e28bb-7b17-4ae6-8e22-da86b28e8860 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:55.961946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7a6e28bb-7b17-4ae6-8e22-da86b28e8860 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:55.978430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a6e28bb-7b17-4ae6-8e22-da86b28e8860 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:55.981381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a6e28bb-7b17-4ae6-8e22-da86b28e8860 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:55.982078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a6e28bb-7b17-4ae6-8e22-da86b28e8860 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:55.984481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a6e28bb-7b17-4ae6-8e22-da86b28e8860 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:56.000299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a6e28bb-7b17-4ae6-8e22-da86b28e8860 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:56.001074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a6e28bb-7b17-4ae6-8e22-da86b28e8860 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:56.163247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7a6e28bb-7b17-4ae6-8e22-da86b28e8860 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:56.172208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7a6e28bb-7b17-4ae6-8e22-da86b28e8860 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:56.178752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7a6e28bb-7b17-4ae6-8e22-da86b28e8860 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:56.189912 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7a6e28bb-7b17-4ae6-8e22-da86b28e8860 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.232590 Oct 24 10:38:56.209345 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1562/3211] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:55 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:56.209345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7562836e-f2b9-4438-bc88-d0ee6c8f0103 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:56.210024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7562836e-f2b9-4438-bc88-d0ee6c8f0103 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:56.221692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7562836e-f2b9-4438-bc88-d0ee6c8f0103 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:56.222995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7562836e-f2b9-4438-bc88-d0ee6c8f0103 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:56.223549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7562836e-f2b9-4438-bc88-d0ee6c8f0103 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:56.224378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7562836e-f2b9-4438-bc88-d0ee6c8f0103 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:56.225133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7562836e-f2b9-4438-bc88-d0ee6c8f0103 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:56.225677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7562836e-f2b9-4438-bc88-d0ee6c8f0103 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:56.293018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e74a45ee-4d1a-45fd-b9fa-e5ed1f190f15 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:56.307430 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e74a45ee-4d1a-45fd-b9fa-e5ed1f190f15 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1333 microversion: 2.1 time: 0.423367 Oct 24 10:38:56.309347 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1650/3212] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:55 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1333 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:56.319781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-43f040c2-7429-4651-b8a7-97adf4a91b74 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:56.335433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-43f040c2-7429-4651-b8a7-97adf4a91b74 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:56.338500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-43f040c2-7429-4651-b8a7-97adf4a91b74 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:38:56.344400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43f040c2-7429-4651-b8a7-97adf4a91b74 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:56.345131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43f040c2-7429-4651-b8a7-97adf4a91b74 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:56.345629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43f040c2-7429-4651-b8a7-97adf4a91b74 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:56.346436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43f040c2-7429-4651-b8a7-97adf4a91b74 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:56.346892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43f040c2-7429-4651-b8a7-97adf4a91b74 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:56.347390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43f040c2-7429-4651-b8a7-97adf4a91b74 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:56.442300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-43f040c2-7429-4651-b8a7-97adf4a91b74 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:38:56.473782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7562836e-f2b9-4438-bc88-d0ee6c8f0103 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:56.484584 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7562836e-f2b9-4438-bc88-d0ee6c8f0103 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1521 microversion: 2.1 time: 0.288476 Oct 24 10:38:56.499287 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1563/3213] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:56 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:56.516880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-96cb14d4-71eb-4061-8149-96ce4e6bbc47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:56.517703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-96cb14d4-71eb-4061-8149-96ce4e6bbc47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:56.527281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96cb14d4-71eb-4061-8149-96ce4e6bbc47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:56.528035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96cb14d4-71eb-4061-8149-96ce4e6bbc47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:56.528546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96cb14d4-71eb-4061-8149-96ce4e6bbc47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:56.529521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96cb14d4-71eb-4061-8149-96ce4e6bbc47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:56.530801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96cb14d4-71eb-4061-8149-96ce4e6bbc47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:56.531452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96cb14d4-71eb-4061-8149-96ce4e6bbc47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:56.539981 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-43f040c2-7429-4651-b8a7-97adf4a91b74 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.228220 Oct 24 10:38:56.548702 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1651/3214] 10.222.0.50 () {58 vars in 1125 bytes} [Mon Oct 24 10:38:56 2022] GET /compute/v2.1/servers => generated 1009 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:56.553690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-44e02aeb-8178-4e5d-b7c1-c40e5259f004 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:56.569019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-44e02aeb-8178-4e5d-b7c1-c40e5259f004 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:56.569734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-44e02aeb-8178-4e5d-b7c1-c40e5259f004 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:38:56.597685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44e02aeb-8178-4e5d-b7c1-c40e5259f004 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:56.598175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44e02aeb-8178-4e5d-b7c1-c40e5259f004 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:56.598622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44e02aeb-8178-4e5d-b7c1-c40e5259f004 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:56.599359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44e02aeb-8178-4e5d-b7c1-c40e5259f004 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:56.599818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44e02aeb-8178-4e5d-b7c1-c40e5259f004 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:56.600251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44e02aeb-8178-4e5d-b7c1-c40e5259f004 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:56.730182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-44e02aeb-8178-4e5d-b7c1-c40e5259f004 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:38:56.833701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:38:56.838960 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-44e02aeb-8178-4e5d-b7c1-c40e5259f004 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 344 microversion: 2.1 time: 0.288610 Oct 24 10:38:56.850476 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1652/3215] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:38:56 2022] GET /compute/v2.1/servers?flavor=451 => generated 344 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:56.860614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-96cb14d4-71eb-4061-8149-96ce4e6bbc47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:56.871241 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-96cb14d4-71eb-4061-8149-96ce4e6bbc47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1521 microversion: 2.1 time: 0.362330 Oct 24 10:38:56.876371 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1564/3216] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:56 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:56.879535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cf90f7e8-f416-4661-99cb-72231066cc07 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:56.884390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cf90f7e8-f416-4661-99cb-72231066cc07 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:56.888667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-af8dac68-2dd3-43fe-a8bb-2c485a830eb4 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:56.902048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-af8dac68-2dd3-43fe-a8bb-2c485a830eb4 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:56.902901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.compute.servers [None req-af8dac68-2dd3-43fe-a8bb-2c485a830eb4 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Removing options 'limit' from query {{(pid=120425) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 24 10:38:56.903862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-af8dac68-2dd3-43fe-a8bb-2c485a830eb4 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:38:56.904390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf90f7e8-f416-4661-99cb-72231066cc07 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:56.904936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf90f7e8-f416-4661-99cb-72231066cc07 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:56.917347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf90f7e8-f416-4661-99cb-72231066cc07 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:56.919132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af8dac68-2dd3-43fe-a8bb-2c485a830eb4 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:56.919916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af8dac68-2dd3-43fe-a8bb-2c485a830eb4 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:56.920192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf90f7e8-f416-4661-99cb-72231066cc07 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:56.920626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf90f7e8-f416-4661-99cb-72231066cc07 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:56.921092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf90f7e8-f416-4661-99cb-72231066cc07 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:56.921636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af8dac68-2dd3-43fe-a8bb-2c485a830eb4 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:56.922786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af8dac68-2dd3-43fe-a8bb-2c485a830eb4 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:56.923597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af8dac68-2dd3-43fe-a8bb-2c485a830eb4 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:56.924242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af8dac68-2dd3-43fe-a8bb-2c485a830eb4 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:56.958208 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-af8dac68-2dd3-43fe-a8bb-2c485a830eb4 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=1" status: 200 len: 483 microversion: 2.1 time: 0.080176 Oct 24 10:38:56.959859 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1565/3217] 10.222.0.50 () {58 vars in 1140 bytes} [Mon Oct 24 10:38:56 2022] GET /compute/v2.1/servers?limit=1 => generated 483 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:56.967642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2cd71f9c-91de-43b9-a5ae-9ca20d1e00bd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:56.968759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2cd71f9c-91de-43b9-a5ae-9ca20d1e00bd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:56.979397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cd71f9c-91de-43b9-a5ae-9ca20d1e00bd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:56.980175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cd71f9c-91de-43b9-a5ae-9ca20d1e00bd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:56.980862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cd71f9c-91de-43b9-a5ae-9ca20d1e00bd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:56.981828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cd71f9c-91de-43b9-a5ae-9ca20d1e00bd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:56.982732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cd71f9c-91de-43b9-a5ae-9ca20d1e00bd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:56.983688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cd71f9c-91de-43b9-a5ae-9ca20d1e00bd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:57.424976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cf90f7e8-f416-4661-99cb-72231066cc07 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:57.438075 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cf90f7e8-f416-4661-99cb-72231066cc07 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1522 microversion: 2.1 time: 0.585197 Oct 24 10:38:57.439408 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1653/3218] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:56 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1522 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:57.451000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-be6dac96-9dd9-4a2b-aaa7-0f30ff0d14fe tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1029723600"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:57.455773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-be6dac96-9dd9-4a2b-aaa7-0f30ff0d14fe tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:57.467933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be6dac96-9dd9-4a2b-aaa7-0f30ff0d14fe tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:57.469742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be6dac96-9dd9-4a2b-aaa7-0f30ff0d14fe tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:57.470505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be6dac96-9dd9-4a2b-aaa7-0f30ff0d14fe tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:57.473627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be6dac96-9dd9-4a2b-aaa7-0f30ff0d14fe tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:57.474553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be6dac96-9dd9-4a2b-aaa7-0f30ff0d14fe tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:57.477818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be6dac96-9dd9-4a2b-aaa7-0f30ff0d14fe tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:57.518274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2cd71f9c-91de-43b9-a5ae-9ca20d1e00bd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:57.528686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2cd71f9c-91de-43b9-a5ae-9ca20d1e00bd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:57.530156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2cd71f9c-91de-43b9-a5ae-9ca20d1e00bd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:57.531322 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2cd71f9c-91de-43b9-a5ae-9ca20d1e00bd tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1865 microversion: 2.32 time: 0.570137 Oct 24 10:38:57.531889 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1566/3219] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:56 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1865 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:57.543010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f592ddbd-0f20-4792-8b1d-30debb492f7f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:57.548693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f592ddbd-0f20-4792-8b1d-30debb492f7f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:57.549425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f592ddbd-0f20-4792-8b1d-30debb492f7f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1059140205', 'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:38:57.554740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f592ddbd-0f20-4792-8b1d-30debb492f7f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:57.555260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f592ddbd-0f20-4792-8b1d-30debb492f7f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:57.555695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f592ddbd-0f20-4792-8b1d-30debb492f7f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:57.556411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f592ddbd-0f20-4792-8b1d-30debb492f7f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:57.557968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f592ddbd-0f20-4792-8b1d-30debb492f7f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:57.558407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f592ddbd-0f20-4792-8b1d-30debb492f7f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:57.671851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.multi_cell_list [None req-f592ddbd-0f20-4792-8b1d-30debb492f7f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120425) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:38:57.754998 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f592ddbd-0f20-4792-8b1d-30debb492f7f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1059140205" status: 200 len: 346 microversion: 2.1 time: 0.221664 Oct 24 10:38:57.756395 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1567/3220] 10.222.0.50 () {58 vars in 1242 bytes} [Mon Oct 24 10:38:57 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1059140205 => generated 346 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:57.761604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9e867318-24d8-4931-97cb-b04a989e6b2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:57.762220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9e867318-24d8-4931-97cb-b04a989e6b2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:57.770115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e867318-24d8-4931-97cb-b04a989e6b2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:57.770257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e867318-24d8-4931-97cb-b04a989e6b2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:57.770624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e867318-24d8-4931-97cb-b04a989e6b2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:57.771336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e867318-24d8-4931-97cb-b04a989e6b2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:57.771788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e867318-24d8-4931-97cb-b04a989e6b2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:57.772219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e867318-24d8-4931-97cb-b04a989e6b2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:57.902088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9e867318-24d8-4931-97cb-b04a989e6b2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:57.918333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9e867318-24d8-4931-97cb-b04a989e6b2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:57.919671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9e867318-24d8-4931-97cb-b04a989e6b2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:57.927455 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9e867318-24d8-4931-97cb-b04a989e6b2e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.169956 Oct 24 10:38:57.928274 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1568/3221] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:57 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:57.944669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9145173e-3225-490f-b331-a21046fbd522 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:57.949736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9145173e-3225-490f-b331-a21046fbd522 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:57.952596 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-be6dac96-9dd9-4a2b-aaa7-0f30ff0d14fe tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "POST /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0/action" status: 202 len: 0 microversion: 2.1 time: 0.509668 Oct 24 10:38:57.964254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9145173e-3225-490f-b331-a21046fbd522 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:57.965055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9145173e-3225-490f-b331-a21046fbd522 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:57.967142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9145173e-3225-490f-b331-a21046fbd522 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:57.967574 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1654/3222] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:38:57 2022] POST /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 10:38:57.968319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9145173e-3225-490f-b331-a21046fbd522 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:57.969337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9145173e-3225-490f-b331-a21046fbd522 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:57.970369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9145173e-3225-490f-b331-a21046fbd522 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:57.989802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-16478eb3-891f-42fa-81eb-22a559eaae70 req-156b266b-b9ac-4b8e-9a3a-150b70c299c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "tag": "00f84ee5-49b5-45e0-85df-7a095215e973"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:58.006847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-16478eb3-891f-42fa-81eb-22a559eaae70 req-156b266b-b9ac-4b8e-9a3a-150b70c299c0 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:58.007325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-16478eb3-891f-42fa-81eb-22a559eaae70 req-156b266b-b9ac-4b8e-9a3a-150b70c299c0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:58.015141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-16478eb3-891f-42fa-81eb-22a559eaae70 req-156b266b-b9ac-4b8e-9a3a-150b70c299c0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:58.036520 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-16478eb3-891f-42fa-81eb-22a559eaae70 req-156b266b-b9ac-4b8e-9a3a-150b70c299c0 service nova] Creating event network-changed:00f84ee5-49b5-45e0-85df-7a095215e973 for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:38:58.046850 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-16478eb3-891f-42fa-81eb-22a559eaae70 req-156b266b-b9ac-4b8e-9a3a-150b70c299c0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077682 Oct 24 10:38:58.050453 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1655/3223] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:58.059977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-121ff2a5-a957-41c9-bf67-eeb41262ee4e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:58.078557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-121ff2a5-a957-41c9-bf67-eeb41262ee4e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:58.079052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-121ff2a5-a957-41c9-bf67-eeb41262ee4e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:58.079494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-121ff2a5-a957-41c9-bf67-eeb41262ee4e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:58.155655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-121ff2a5-a957-41c9-bf67-eeb41262ee4e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Going to try to stop instance {{(pid=120426) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 10:38:58.257563 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-121ff2a5-a957-41c9-bf67-eeb41262ee4e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "POST /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0/action" status: 202 len: 0 microversion: 2.1 time: 0.205266 Oct 24 10:38:58.261388 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1656/3224] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:38:58 2022] POST /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:38:58.296260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-97beae19-091d-4b3e-8d3b-b58734c101df tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-982918026"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:58.307043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-97beae19-091d-4b3e-8d3b-b58734c101df tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:58.333515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-97beae19-091d-4b3e-8d3b-b58734c101df tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:58.334034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-97beae19-091d-4b3e-8d3b-b58734c101df tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:58.334482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-97beae19-091d-4b3e-8d3b-b58734c101df tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:58.335190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-97beae19-091d-4b3e-8d3b-b58734c101df tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:58.338315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9145173e-3225-490f-b331-a21046fbd522 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:58.339524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-97beae19-091d-4b3e-8d3b-b58734c101df tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:58.340013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-97beae19-091d-4b3e-8d3b-b58734c101df tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:58.357711 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9145173e-3225-490f-b331-a21046fbd522 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1333 microversion: 2.1 time: 0.426127 Oct 24 10:38:58.371998 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1569/3225] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:57 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1333 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:58.371998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-2744dc3f-e777-440c-93f9-b9b438af0925 req-a3625ac1-4eb8-408d-a9de-8de9471dbc50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "105cd729-f8cb-45e7-bb34-030c45097242", "name": "network-vif-plugged", "status": "completed", "tag": "76b30b9d-a037-4816-acb6-e4ef6e3d401f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:38:58.389717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2744dc3f-e777-440c-93f9-b9b438af0925 req-a3625ac1-4eb8-408d-a9de-8de9471dbc50 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:58.395084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2744dc3f-e777-440c-93f9-b9b438af0925 req-a3625ac1-4eb8-408d-a9de-8de9471dbc50 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:58.395740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2744dc3f-e777-440c-93f9-b9b438af0925 req-a3625ac1-4eb8-408d-a9de-8de9471dbc50 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:58.424451 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-2744dc3f-e777-440c-93f9-b9b438af0925 req-a3625ac1-4eb8-408d-a9de-8de9471dbc50 service nova] Creating event network-vif-plugged:76b30b9d-a037-4816-acb6-e4ef6e3d401f for instance 105cd729-f8cb-45e7-bb34-030c45097242 on n-h1-858383-15 Oct 24 10:38:58.430882 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-2744dc3f-e777-440c-93f9-b9b438af0925 req-a3625ac1-4eb8-408d-a9de-8de9471dbc50 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070240 Oct 24 10:38:58.431945 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1570/3226] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:38:58.438279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2e5ea08d-5530-458b-b2ee-5d8b4e4cc4c9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:58.439854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2e5ea08d-5530-458b-b2ee-5d8b4e4cc4c9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:58.447167 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-97beae19-091d-4b3e-8d3b-b58734c101df tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] HTTP exception thrown: Cannot 'createImage' instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 while it is in task_state image_snapshot Oct 24 10:38:58.447413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e5ea08d-5530-458b-b2ee-5d8b4e4cc4c9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:58.448370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e5ea08d-5530-458b-b2ee-5d8b4e4cc4c9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:58.448955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e5ea08d-5530-458b-b2ee-5d8b4e4cc4c9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-97beae19-091d-4b3e-8d3b-b58734c101df tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Request method failure captured: Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0/action HTTP/1.1 Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 84 Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmsZ6iCeMLTpciKzT-IOd-jSbp-Ock4X7vHFbSgox-iuMV2hxDyst1XnTlhe7a0yhnti-D3qlDTVLsDNpGHmdQxuIxzHTz6ZfOA3sAyV-nTFUvtxnUe0hLrgWnomxwn6YBZ-Qwy9VkVlCsoa7UEzkg7FPtyXY6LqjelB4oPUwFh9rLg Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5edfb6d8f84547399863eec5c89e6933", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 1f089833f359473ebfa681931e8ffc06 Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-982918026"}} Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: exception: Cannot 'createImage' instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 while it is in task_state image_snapshot Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'a7aeb942-aab8-4051-b5ac-b4cab02dc9d0', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-982918026'}}} Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 10:38:58.449128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 while it is in task_state image_snapshot Oct 24 10:38:58.455939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:58.455939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:38:58.455939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:58.455939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:38:58.455939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:38:58.455939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:38:58.455939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:38:58.455939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:38:58.455939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 while it is in task_state image_snapshot Oct 24 10:38:58.455939 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:38:58.455939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-97beae19-091d-4b3e-8d3b-b58734c101df tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Returning 409 to user: Cannot 'createImage' instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 while it is in task_state image_snapshot {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:38:58.456959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e5ea08d-5530-458b-b2ee-5d8b4e4cc4c9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:58.456959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e5ea08d-5530-458b-b2ee-5d8b4e4cc4c9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:58.457150 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-97beae19-091d-4b3e-8d3b-b58734c101df tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "POST /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0/action" status: 409 len: 159 microversion: 2.1 time: 0.173844 Oct 24 10:38:58.457252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e5ea08d-5530-458b-b2ee-5d8b4e4cc4c9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:58.462010 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1657/3227] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:38:58 2022] POST /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0/action => generated 159 bytes in 199 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:38:58.472563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d382001-e0b6-4cd3-8178-2da1aa9e1ead tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '.version_select at 0x7f04d065e8b0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:58.743079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2e5ea08d-5530-458b-b2ee-5d8b4e4cc4c9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:58.748154 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2d382001-e0b6-4cd3-8178-2da1aa9e1ead tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "DELETE /compute/v2.1/images/59e62947-0481-44bd-8125-62850c366558" status: 204 len: 0 microversion: 2.1 time: 0.284853 Oct 24 10:38:58.748726 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1658/3228] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:58 2022] DELETE /compute/v2.1/images/59e62947-0481-44bd-8125-62850c366558 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:38:58.753479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-23c5a2ff-8b94-4061-a133-ff0d8a581f83 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:58.754520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-23c5a2ff-8b94-4061-a133-ff0d8a581f83 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:58.756059 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2e5ea08d-5530-458b-b2ee-5d8b4e4cc4c9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1523 microversion: 2.1 time: 0.322791 Oct 24 10:38:58.772863 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1571/3229] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:58 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:58.772863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7950ac50-05bc-4cc4-a987-49f63000340b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:58.772863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7950ac50-05bc-4cc4-a987-49f63000340b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:58.772863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7950ac50-05bc-4cc4-a987-49f63000340b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:58.772863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7950ac50-05bc-4cc4-a987-49f63000340b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:58.772863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7950ac50-05bc-4cc4-a987-49f63000340b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:58.772863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7950ac50-05bc-4cc4-a987-49f63000340b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:58.773530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7950ac50-05bc-4cc4-a987-49f63000340b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:58.773849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7950ac50-05bc-4cc4-a987-49f63000340b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:58.783680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23c5a2ff-8b94-4061-a133-ff0d8a581f83 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:58.784203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23c5a2ff-8b94-4061-a133-ff0d8a581f83 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:58.784777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23c5a2ff-8b94-4061-a133-ff0d8a581f83 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:58.788371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23c5a2ff-8b94-4061-a133-ff0d8a581f83 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:58.788864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23c5a2ff-8b94-4061-a133-ff0d8a581f83 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:58.789323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23c5a2ff-8b94-4061-a133-ff0d8a581f83 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:59.137813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7950ac50-05bc-4cc4-a987-49f63000340b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:59.157713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7950ac50-05bc-4cc4-a987-49f63000340b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:59.162565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7950ac50-05bc-4cc4-a987-49f63000340b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:59.164012 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7950ac50-05bc-4cc4-a987-49f63000340b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1865 microversion: 2.32 time: 0.405890 Oct 24 10:38:59.166661 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1572/3230] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:58 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1865 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:59.176274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7c742d85-6028-4670-96b3-e8e6da0eeeed tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:59.181749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7c742d85-6028-4670-96b3-e8e6da0eeeed tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:59.185616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-23c5a2ff-8b94-4061-a133-ff0d8a581f83 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:59.192483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c742d85-6028-4670-96b3-e8e6da0eeeed tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:59.196722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c742d85-6028-4670-96b3-e8e6da0eeeed tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:59.197554 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-23c5a2ff-8b94-4061-a133-ff0d8a581f83 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1522 microversion: 2.1 time: 0.447733 Oct 24 10:38:59.199271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c742d85-6028-4670-96b3-e8e6da0eeeed tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:59.199498 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1659/3231] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:58 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:59.215257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-56081055-d806-47eb-b95e-7d9ce0e664ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:59.217694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-56081055-d806-47eb-b95e-7d9ce0e664ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:59.218901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c742d85-6028-4670-96b3-e8e6da0eeeed tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:59.220975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c742d85-6028-4670-96b3-e8e6da0eeeed tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:59.223189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c742d85-6028-4670-96b3-e8e6da0eeeed tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:59.233076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56081055-d806-47eb-b95e-7d9ce0e664ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:59.233881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56081055-d806-47eb-b95e-7d9ce0e664ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:59.234609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56081055-d806-47eb-b95e-7d9ce0e664ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:59.235759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56081055-d806-47eb-b95e-7d9ce0e664ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:59.236406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56081055-d806-47eb-b95e-7d9ce0e664ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:59.237015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56081055-d806-47eb-b95e-7d9ce0e664ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:59.337917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-56081055-d806-47eb-b95e-7d9ce0e664ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:59.362599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-56081055-d806-47eb-b95e-7d9ce0e664ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:59.393368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-56081055-d806-47eb-b95e-7d9ce0e664ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:59.419446 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-56081055-d806-47eb-b95e-7d9ce0e664ab tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.212064 Oct 24 10:38:59.419839 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1660/3232] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:38:59 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:38:59.440041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e0e7d528-bd05-483d-9100-8764073f3305 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:59.440677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e0e7d528-bd05-483d-9100-8764073f3305 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:59.479601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0e7d528-bd05-483d-9100-8764073f3305 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:59.484658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0e7d528-bd05-483d-9100-8764073f3305 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:59.495157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0e7d528-bd05-483d-9100-8764073f3305 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:59.496003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0e7d528-bd05-483d-9100-8764073f3305 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:59.496497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0e7d528-bd05-483d-9100-8764073f3305 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:59.496976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0e7d528-bd05-483d-9100-8764073f3305 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:59.820238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7c742d85-6028-4670-96b3-e8e6da0eeeed tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:59.829076 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7c742d85-6028-4670-96b3-e8e6da0eeeed tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1533 microversion: 2.1 time: 0.660618 Oct 24 10:38:59.830180 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1573/3233] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:59 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1533 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:59.837053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6fdede33-4aa5-440e-98da-2c1043772c7d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:38:59.837672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6fdede33-4aa5-440e-98da-2c1043772c7d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:38:59.847714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e0e7d528-bd05-483d-9100-8764073f3305 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:38:59.861279 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e0e7d528-bd05-483d-9100-8764073f3305 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1333 microversion: 2.1 time: 0.435538 Oct 24 10:38:59.861279 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1661/3234] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:59 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1333 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:38:59.862096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fdede33-4aa5-440e-98da-2c1043772c7d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:59.862600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fdede33-4aa5-440e-98da-2c1043772c7d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:59.863042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fdede33-4aa5-440e-98da-2c1043772c7d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:59.863772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fdede33-4aa5-440e-98da-2c1043772c7d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:38:59.864230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fdede33-4aa5-440e-98da-2c1043772c7d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:38:59.864663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fdede33-4aa5-440e-98da-2c1043772c7d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:38:59.872186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:00.197288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-253268ba-a6d3-4cbd-a19e-607d8df97d28 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:00.199238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-253268ba-a6d3-4cbd-a19e-607d8df97d28 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:00.207452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-253268ba-a6d3-4cbd-a19e-607d8df97d28 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:00.208261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-253268ba-a6d3-4cbd-a19e-607d8df97d28 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:00.208906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-253268ba-a6d3-4cbd-a19e-607d8df97d28 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:00.209812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-253268ba-a6d3-4cbd-a19e-607d8df97d28 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:00.212727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-253268ba-a6d3-4cbd-a19e-607d8df97d28 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:00.216256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6fdede33-4aa5-440e-98da-2c1043772c7d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:00.228283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-253268ba-a6d3-4cbd-a19e-607d8df97d28 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:00.233718 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6fdede33-4aa5-440e-98da-2c1043772c7d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1523 microversion: 2.1 time: 0.400116 Oct 24 10:39:00.237673 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1574/3235] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:38:59 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1523 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:00.253338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-85ff0bee-a430-433f-9dae-67b2a524ef5c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:00.254444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-85ff0bee-a430-433f-9dae-67b2a524ef5c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:00.288229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-85ff0bee-a430-433f-9dae-67b2a524ef5c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:00.288722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-85ff0bee-a430-433f-9dae-67b2a524ef5c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:00.292074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-85ff0bee-a430-433f-9dae-67b2a524ef5c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:00.292866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-85ff0bee-a430-433f-9dae-67b2a524ef5c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:00.297350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-85ff0bee-a430-433f-9dae-67b2a524ef5c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:00.297805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-85ff0bee-a430-433f-9dae-67b2a524ef5c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:00.689515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-253268ba-a6d3-4cbd-a19e-607d8df97d28 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:00.701089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-253268ba-a6d3-4cbd-a19e-607d8df97d28 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:00.704047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-253268ba-a6d3-4cbd-a19e-607d8df97d28 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:00.709892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-85ff0bee-a430-433f-9dae-67b2a524ef5c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:00.715740 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-253268ba-a6d3-4cbd-a19e-607d8df97d28 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1886 microversion: 2.32 time: 0.525608 Oct 24 10:39:00.720415 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-85ff0bee-a430-433f-9dae-67b2a524ef5c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1522 microversion: 2.1 time: 0.481588 Oct 24 10:39:00.722006 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1662/3236] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:00 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1886 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:00.722779 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1575/3237] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:00 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:00.738203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-631b3a1e-a8eb-4945-8b05-73d10de69d8b req-cd1cd710-5f36-4535-a8fb-f8af63b883bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "105cd729-f8cb-45e7-bb34-030c45097242", "name": "network-vif-plugged", "status": "completed", "tag": "32092da1-897c-436e-8027-df8400cdaf1f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:00.744688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6e8d259a-794f-421c-b383-c7f13bfdba37 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:00.754594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6e8d259a-794f-421c-b383-c7f13bfdba37 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:00.768191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e8d259a-794f-421c-b383-c7f13bfdba37 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:00.768670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e8d259a-794f-421c-b383-c7f13bfdba37 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:00.773499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e8d259a-794f-421c-b383-c7f13bfdba37 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:00.776548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e8d259a-794f-421c-b383-c7f13bfdba37 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:00.779578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e8d259a-794f-421c-b383-c7f13bfdba37 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:00.780265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e8d259a-794f-421c-b383-c7f13bfdba37 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:00.781496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:00.784639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-631b3a1e-a8eb-4945-8b05-73d10de69d8b req-cd1cd710-5f36-4535-a8fb-f8af63b883bd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:00.785744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-631b3a1e-a8eb-4945-8b05-73d10de69d8b req-cd1cd710-5f36-4535-a8fb-f8af63b883bd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:00.786562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-631b3a1e-a8eb-4945-8b05-73d10de69d8b req-cd1cd710-5f36-4535-a8fb-f8af63b883bd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:00.815825 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-631b3a1e-a8eb-4945-8b05-73d10de69d8b req-cd1cd710-5f36-4535-a8fb-f8af63b883bd service nova] Creating event network-vif-plugged:32092da1-897c-436e-8027-df8400cdaf1f for instance 105cd729-f8cb-45e7-bb34-030c45097242 on n-h1-858383-15 Oct 24 10:39:00.839260 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-631b3a1e-a8eb-4945-8b05-73d10de69d8b req-cd1cd710-5f36-4535-a8fb-f8af63b883bd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101962 Oct 24 10:39:00.840919 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1576/3238] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:00.854684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bc7cc810-589b-4822-8e16-09730e09b9c7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:00.855403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bc7cc810-589b-4822-8e16-09730e09b9c7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:00.868245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc7cc810-589b-4822-8e16-09730e09b9c7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:00.870100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc7cc810-589b-4822-8e16-09730e09b9c7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:00.870760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc7cc810-589b-4822-8e16-09730e09b9c7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:00.871746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc7cc810-589b-4822-8e16-09730e09b9c7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:00.872439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc7cc810-589b-4822-8e16-09730e09b9c7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:00.873147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc7cc810-589b-4822-8e16-09730e09b9c7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:00.999916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e8d259a-794f-421c-b383-c7f13bfdba37 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:01.015409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e8d259a-794f-421c-b383-c7f13bfdba37 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:01.024976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e8d259a-794f-421c-b383-c7f13bfdba37 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:01.034986 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6e8d259a-794f-421c-b383-c7f13bfdba37 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.301300 Oct 24 10:39:01.036693 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1663/3239] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:00 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:01.056984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4c282385-0c11-4410-8b55-06c05f720364 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:01.058137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4c282385-0c11-4410-8b55-06c05f720364 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:01.082353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:01.089210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c282385-0c11-4410-8b55-06c05f720364 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:01.095864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c282385-0c11-4410-8b55-06c05f720364 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:01.096628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c282385-0c11-4410-8b55-06c05f720364 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:01.099868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c282385-0c11-4410-8b55-06c05f720364 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:01.102915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c282385-0c11-4410-8b55-06c05f720364 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:01.104549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c282385-0c11-4410-8b55-06c05f720364 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:01.248416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bc7cc810-589b-4822-8e16-09730e09b9c7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:01.261206 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bc7cc810-589b-4822-8e16-09730e09b9c7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1539 microversion: 2.1 time: 0.411053 Oct 24 10:39:01.267670 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1577/3240] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:00 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1539 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:39:01.272442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e224b7ca-0bca-4430-83d6-ddb91fcf177b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:01.287599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e224b7ca-0bca-4430-83d6-ddb91fcf177b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:01.310203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e224b7ca-0bca-4430-83d6-ddb91fcf177b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:01.314892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e224b7ca-0bca-4430-83d6-ddb91fcf177b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:01.321503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e224b7ca-0bca-4430-83d6-ddb91fcf177b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:01.325862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e224b7ca-0bca-4430-83d6-ddb91fcf177b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:01.327324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e224b7ca-0bca-4430-83d6-ddb91fcf177b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:01.335067 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e224b7ca-0bca-4430-83d6-ddb91fcf177b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:01.558461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4c282385-0c11-4410-8b55-06c05f720364 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:01.570177 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4c282385-0c11-4410-8b55-06c05f720364 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1333 microversion: 2.1 time: 0.532139 Oct 24 10:39:01.573500 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1664/3241] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:01 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1333 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:01.578259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-ffc8e6a5-04f1-4e78-a9cd-db07b12707c0 req-c03c3458-cd97-4956-9fe4-07dad02a3b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "tag": "5c925253-c5f1-4fd7-94c7-b873209b466a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:01.602591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e224b7ca-0bca-4430-83d6-ddb91fcf177b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:01.615626 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e224b7ca-0bca-4430-83d6-ddb91fcf177b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1523 microversion: 2.1 time: 0.346936 Oct 24 10:39:01.621532 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1578/3242] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:01 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1523 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:01.623584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ffc8e6a5-04f1-4e78-a9cd-db07b12707c0 req-c03c3458-cd97-4956-9fe4-07dad02a3b31 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:01.624683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ffc8e6a5-04f1-4e78-a9cd-db07b12707c0 req-c03c3458-cd97-4956-9fe4-07dad02a3b31 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:01.625291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ffc8e6a5-04f1-4e78-a9cd-db07b12707c0 req-c03c3458-cd97-4956-9fe4-07dad02a3b31 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:01.639221 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ffc8e6a5-04f1-4e78-a9cd-db07b12707c0 req-c03c3458-cd97-4956-9fe4-07dad02a3b31 service nova] Creating event network-changed:5c925253-c5f1-4fd7-94c7-b873209b466a for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:39:01.645971 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-ffc8e6a5-04f1-4e78-a9cd-db07b12707c0 req-c03c3458-cd97-4956-9fe4-07dad02a3b31 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071027 Oct 24 10:39:01.647242 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1665/3243] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:01.749057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-98d03fdd-2609-4a2e-b069-6945d83cd0a7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:01.749678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-98d03fdd-2609-4a2e-b069-6945d83cd0a7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:01.765462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-25932e6a-0a7b-4527-87e8-37b3f09f38a1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:01.766590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-25932e6a-0a7b-4527-87e8-37b3f09f38a1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:01.776191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98d03fdd-2609-4a2e-b069-6945d83cd0a7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:01.776698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98d03fdd-2609-4a2e-b069-6945d83cd0a7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:01.779353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25932e6a-0a7b-4527-87e8-37b3f09f38a1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:01.788103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25932e6a-0a7b-4527-87e8-37b3f09f38a1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:01.788562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25932e6a-0a7b-4527-87e8-37b3f09f38a1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:01.789910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25932e6a-0a7b-4527-87e8-37b3f09f38a1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:01.790365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25932e6a-0a7b-4527-87e8-37b3f09f38a1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:01.790877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25932e6a-0a7b-4527-87e8-37b3f09f38a1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:01.793064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98d03fdd-2609-4a2e-b069-6945d83cd0a7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:01.793838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98d03fdd-2609-4a2e-b069-6945d83cd0a7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:01.794506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98d03fdd-2609-4a2e-b069-6945d83cd0a7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:01.795180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98d03fdd-2609-4a2e-b069-6945d83cd0a7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:02.302865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-25932e6a-0a7b-4527-87e8-37b3f09f38a1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:02.317387 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-25932e6a-0a7b-4527-87e8-37b3f09f38a1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1522 microversion: 2.1 time: 0.555993 Oct 24 10:39:02.317998 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1666/3244] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:01 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1522 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:02.328464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-84448747-640c-4ff4-938a-3059f8183316 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:02.334484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-84448747-640c-4ff4-938a-3059f8183316 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:02.353437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84448747-640c-4ff4-938a-3059f8183316 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:02.354712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84448747-640c-4ff4-938a-3059f8183316 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:02.355182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84448747-640c-4ff4-938a-3059f8183316 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:02.356053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84448747-640c-4ff4-938a-3059f8183316 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:02.356527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84448747-640c-4ff4-938a-3059f8183316 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:02.357008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84448747-640c-4ff4-938a-3059f8183316 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:02.385602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-98d03fdd-2609-4a2e-b069-6945d83cd0a7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:02.408315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-98d03fdd-2609-4a2e-b069-6945d83cd0a7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:02.413183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-98d03fdd-2609-4a2e-b069-6945d83cd0a7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:02.415123 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-98d03fdd-2609-4a2e-b069-6945d83cd0a7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1886 microversion: 2.32 time: 0.670833 Oct 24 10:39:02.418249 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1579/3245] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:01 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1886 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:02.430800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eb8603d4-09b2-4dba-bcc9-ad46866cfc83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:02.433942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eb8603d4-09b2-4dba-bcc9-ad46866cfc83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:02.448778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb8603d4-09b2-4dba-bcc9-ad46866cfc83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:02.453022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb8603d4-09b2-4dba-bcc9-ad46866cfc83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:02.453807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb8603d4-09b2-4dba-bcc9-ad46866cfc83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:02.454748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb8603d4-09b2-4dba-bcc9-ad46866cfc83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:02.455387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb8603d4-09b2-4dba-bcc9-ad46866cfc83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:02.456006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb8603d4-09b2-4dba-bcc9-ad46866cfc83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:02.530891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-84448747-640c-4ff4-938a-3059f8183316 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:02.546934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-84448747-640c-4ff4-938a-3059f8183316 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:02.548770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-84448747-640c-4ff4-938a-3059f8183316 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:02.557425 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-84448747-640c-4ff4-938a-3059f8183316 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.237646 Oct 24 10:39:02.558950 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1667/3246] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:02 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:02.600166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a6188ed5-7cf0-48ab-b79f-c8ef312cc5b4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:02.603036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a6188ed5-7cf0-48ab-b79f-c8ef312cc5b4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:02.635462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6188ed5-7cf0-48ab-b79f-c8ef312cc5b4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:02.635983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6188ed5-7cf0-48ab-b79f-c8ef312cc5b4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:02.638538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6188ed5-7cf0-48ab-b79f-c8ef312cc5b4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:02.639322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6188ed5-7cf0-48ab-b79f-c8ef312cc5b4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:02.639795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6188ed5-7cf0-48ab-b79f-c8ef312cc5b4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:02.640240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6188ed5-7cf0-48ab-b79f-c8ef312cc5b4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:02.874670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a6188ed5-7cf0-48ab-b79f-c8ef312cc5b4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:02.883656 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a6188ed5-7cf0-48ab-b79f-c8ef312cc5b4 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1333 microversion: 2.1 time: 0.291394 Oct 24 10:39:02.889944 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1668/3247] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:02 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1333 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:02.894738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c11acbbb-0c4c-44d6-8213-d3537dfffc4f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:02.897148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c11acbbb-0c4c-44d6-8213-d3537dfffc4f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:02.910709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c11acbbb-0c4c-44d6-8213-d3537dfffc4f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:02.913717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c11acbbb-0c4c-44d6-8213-d3537dfffc4f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:02.915006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c11acbbb-0c4c-44d6-8213-d3537dfffc4f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:02.916722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c11acbbb-0c4c-44d6-8213-d3537dfffc4f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:02.920209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c11acbbb-0c4c-44d6-8213-d3537dfffc4f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:02.920860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c11acbbb-0c4c-44d6-8213-d3537dfffc4f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:02.953282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eb8603d4-09b2-4dba-bcc9-ad46866cfc83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:02.962068 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eb8603d4-09b2-4dba-bcc9-ad46866cfc83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1534 microversion: 2.1 time: 0.539027 Oct 24 10:39:02.968605 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1580/3248] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:02 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1534 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:02.975033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:02.980708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-cf74ad9b-40d1-4d67-adf2-2d10f305c521 req-f8cfe7f4-8b34-4fcb-8f53-1adeca2bbb9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7aeb942-aab8-4051-b5ac-b4cab02dc9d0", "name": "network-vif-plugged", "status": "completed", "tag": "60451826-6729-43c6-9b77-3e8ecaa7c65d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:03.022565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cf74ad9b-40d1-4d67-adf2-2d10f305c521 req-f8cfe7f4-8b34-4fcb-8f53-1adeca2bbb9f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:03.023108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cf74ad9b-40d1-4d67-adf2-2d10f305c521 req-f8cfe7f4-8b34-4fcb-8f53-1adeca2bbb9f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:03.024709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cf74ad9b-40d1-4d67-adf2-2d10f305c521 req-f8cfe7f4-8b34-4fcb-8f53-1adeca2bbb9f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:03.065868 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-cf74ad9b-40d1-4d67-adf2-2d10f305c521 req-f8cfe7f4-8b34-4fcb-8f53-1adeca2bbb9f service nova] Creating event network-vif-plugged:60451826-6729-43c6-9b77-3e8ecaa7c65d for instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 on n-h2-858383-15 Oct 24 10:39:03.079117 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-cf74ad9b-40d1-4d67-adf2-2d10f305c521 req-f8cfe7f4-8b34-4fcb-8f53-1adeca2bbb9f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109134 Oct 24 10:39:03.083334 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1581/3249] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:03.154039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c11acbbb-0c4c-44d6-8213-d3537dfffc4f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:03.163228 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c11acbbb-0c4c-44d6-8213-d3537dfffc4f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1523 microversion: 2.1 time: 0.271991 Oct 24 10:39:03.181488 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1669/3250] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:02 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1523 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:03.348821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-74f029de-b23b-4166-a91e-fa09f0f9b1a7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:03.350437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-74f029de-b23b-4166-a91e-fa09f0f9b1a7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:03.373178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74f029de-b23b-4166-a91e-fa09f0f9b1a7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:03.374248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74f029de-b23b-4166-a91e-fa09f0f9b1a7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:03.375347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74f029de-b23b-4166-a91e-fa09f0f9b1a7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:03.376784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74f029de-b23b-4166-a91e-fa09f0f9b1a7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:03.378860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74f029de-b23b-4166-a91e-fa09f0f9b1a7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:03.380462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74f029de-b23b-4166-a91e-fa09f0f9b1a7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:03.450354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-404d9f0a-cc1f-4de3-9222-456cab0f4687 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:03.450962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-404d9f0a-cc1f-4de3-9222-456cab0f4687 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:03.468185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-404d9f0a-cc1f-4de3-9222-456cab0f4687 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:03.469456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-404d9f0a-cc1f-4de3-9222-456cab0f4687 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:03.473431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-404d9f0a-cc1f-4de3-9222-456cab0f4687 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:03.478336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-404d9f0a-cc1f-4de3-9222-456cab0f4687 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:03.479115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-404d9f0a-cc1f-4de3-9222-456cab0f4687 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:03.479718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-404d9f0a-cc1f-4de3-9222-456cab0f4687 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:03.834858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-74f029de-b23b-4166-a91e-fa09f0f9b1a7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:03.845247 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-74f029de-b23b-4166-a91e-fa09f0f9b1a7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1522 microversion: 2.1 time: 0.502270 Oct 24 10:39:03.848573 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1582/3251] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:03 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:03.855159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2dc87814-0cad-46d2-8068-59ac14bb4aca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:03.856138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2dc87814-0cad-46d2-8068-59ac14bb4aca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:03.871725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2dc87814-0cad-46d2-8068-59ac14bb4aca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:03.875626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2dc87814-0cad-46d2-8068-59ac14bb4aca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:03.878010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2dc87814-0cad-46d2-8068-59ac14bb4aca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:03.881754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2dc87814-0cad-46d2-8068-59ac14bb4aca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:03.882431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2dc87814-0cad-46d2-8068-59ac14bb4aca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:03.885370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2dc87814-0cad-46d2-8068-59ac14bb4aca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:03.925619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-404d9f0a-cc1f-4de3-9222-456cab0f4687 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:03.942147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-404d9f0a-cc1f-4de3-9222-456cab0f4687 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:03.948225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-404d9f0a-cc1f-4de3-9222-456cab0f4687 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:03.952328 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-404d9f0a-cc1f-4de3-9222-456cab0f4687 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1886 microversion: 2.32 time: 0.507003 Oct 24 10:39:03.955438 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1670/3252] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:03 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1886 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:39:03.966303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5433aeaa-236e-4059-a501-003946df6e08 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:03.967920 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5433aeaa-236e-4059-a501-003946df6e08 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:03.981854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5433aeaa-236e-4059-a501-003946df6e08 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:03.995334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5433aeaa-236e-4059-a501-003946df6e08 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:03.997138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5433aeaa-236e-4059-a501-003946df6e08 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:03.999401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5433aeaa-236e-4059-a501-003946df6e08 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:04.000104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5433aeaa-236e-4059-a501-003946df6e08 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:04.001091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5433aeaa-236e-4059-a501-003946df6e08 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:04.056710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2dc87814-0cad-46d2-8068-59ac14bb4aca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:04.065479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2dc87814-0cad-46d2-8068-59ac14bb4aca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:04.066910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2dc87814-0cad-46d2-8068-59ac14bb4aca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:04.099035 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2dc87814-0cad-46d2-8068-59ac14bb4aca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.248231 Oct 24 10:39:04.104061 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1583/3253] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:03 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:04.135201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7c4dc3b3-4f39-46b5-ab90-bc35b6afb03b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:04.135827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7c4dc3b3-4f39-46b5-ab90-bc35b6afb03b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:04.168269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c4dc3b3-4f39-46b5-ab90-bc35b6afb03b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:04.169383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c4dc3b3-4f39-46b5-ab90-bc35b6afb03b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:04.170001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c4dc3b3-4f39-46b5-ab90-bc35b6afb03b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:04.177845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c4dc3b3-4f39-46b5-ab90-bc35b6afb03b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:04.178573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c4dc3b3-4f39-46b5-ab90-bc35b6afb03b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:04.179178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c4dc3b3-4f39-46b5-ab90-bc35b6afb03b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:04.180522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:04.448886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5433aeaa-236e-4059-a501-003946df6e08 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:04.462352 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5433aeaa-236e-4059-a501-003946df6e08 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1667 microversion: 2.1 time: 0.504569 Oct 24 10:39:04.463157 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1671/3254] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:03 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1667 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:04.474840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-99cc77c5-f2bb-49cf-a78a-fa0a889114f5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:04.475869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-99cc77c5-f2bb-49cf-a78a-fa0a889114f5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:04.491623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99cc77c5-f2bb-49cf-a78a-fa0a889114f5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:04.493150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99cc77c5-f2bb-49cf-a78a-fa0a889114f5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:04.494237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99cc77c5-f2bb-49cf-a78a-fa0a889114f5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:04.495289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99cc77c5-f2bb-49cf-a78a-fa0a889114f5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:04.495913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99cc77c5-f2bb-49cf-a78a-fa0a889114f5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:04.496507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99cc77c5-f2bb-49cf-a78a-fa0a889114f5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:04.561179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7c4dc3b3-4f39-46b5-ab90-bc35b6afb03b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:04.574584 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7c4dc3b3-4f39-46b5-ab90-bc35b6afb03b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1521 microversion: 2.1 time: 0.461448 Oct 24 10:39:04.575611 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1584/3255] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:04 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:04.590875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-868b336b-8471-484c-8676-9aef7b832edd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:04.591809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-868b336b-8471-484c-8676-9aef7b832edd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:04.611309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-868b336b-8471-484c-8676-9aef7b832edd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:04.612204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-868b336b-8471-484c-8676-9aef7b832edd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:04.612816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-868b336b-8471-484c-8676-9aef7b832edd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:04.613743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-868b336b-8471-484c-8676-9aef7b832edd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:04.615110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-868b336b-8471-484c-8676-9aef7b832edd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:04.616083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-868b336b-8471-484c-8676-9aef7b832edd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:04.678604 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-868b336b-8471-484c-8676-9aef7b832edd tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242/ips" status: 200 len: 178 microversion: 2.1 time: 0.099402 Oct 24 10:39:04.682682 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1585/3256] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Oct 24 10:39:04 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242/ips => generated 178 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:04.690980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a560dae1-50fb-45a5-994f-6ee77275c38a req-d616691c-0c70-4bca-9c26-0329c64de64e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "tag": "718e738e-bf66-4482-a3d8-5ddfccb459f6"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:04.717925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a560dae1-50fb-45a5-994f-6ee77275c38a req-d616691c-0c70-4bca-9c26-0329c64de64e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:04.720499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a560dae1-50fb-45a5-994f-6ee77275c38a req-d616691c-0c70-4bca-9c26-0329c64de64e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:04.721178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a560dae1-50fb-45a5-994f-6ee77275c38a req-d616691c-0c70-4bca-9c26-0329c64de64e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:04.763387 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a560dae1-50fb-45a5-994f-6ee77275c38a req-d616691c-0c70-4bca-9c26-0329c64de64e service nova] Creating event network-changed:718e738e-bf66-4482-a3d8-5ddfccb459f6 for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:39:04.778597 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a560dae1-50fb-45a5-994f-6ee77275c38a req-d616691c-0c70-4bca-9c26-0329c64de64e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093900 Oct 24 10:39:04.779695 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1586/3257] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:04.800232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7fd59f7b-e153-47e3-a61f-31a754ef4933 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:04.800918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7fd59f7b-e153-47e3-a61f-31a754ef4933 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:04.817471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fd59f7b-e153-47e3-a61f-31a754ef4933 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:04.817975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fd59f7b-e153-47e3-a61f-31a754ef4933 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:04.818427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fd59f7b-e153-47e3-a61f-31a754ef4933 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:04.822600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fd59f7b-e153-47e3-a61f-31a754ef4933 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:04.823095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fd59f7b-e153-47e3-a61f-31a754ef4933 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:04.823539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fd59f7b-e153-47e3-a61f-31a754ef4933 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:04.878010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-99cc77c5-f2bb-49cf-a78a-fa0a889114f5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:04.889549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7fd59f7b-e153-47e3-a61f-31a754ef4933 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:39:04.891400 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-99cc77c5-f2bb-49cf-a78a-fa0a889114f5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1523 microversion: 2.1 time: 0.425289 Oct 24 10:39:04.892176 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1672/3258] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:04 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1523 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:04.910745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ca3bc0d0-00d1-464d-b195-bfd965d31486 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:04.914446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ca3bc0d0-00d1-464d-b195-bfd965d31486 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:04.926230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca3bc0d0-00d1-464d-b195-bfd965d31486 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:04.939872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca3bc0d0-00d1-464d-b195-bfd965d31486 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:04.942547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca3bc0d0-00d1-464d-b195-bfd965d31486 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:04.944435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca3bc0d0-00d1-464d-b195-bfd965d31486 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:04.946570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca3bc0d0-00d1-464d-b195-bfd965d31486 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:04.948882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca3bc0d0-00d1-464d-b195-bfd965d31486 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:05.022794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ca3bc0d0-00d1-464d-b195-bfd965d31486 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:39:05.093998 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7fd59f7b-e153-47e3-a61f-31a754ef4933 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 204 len: 0 microversion: 2.1 time: 0.306316 Oct 24 10:39:05.096676 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1587/3259] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:39:04 2022] DELETE /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:39:05.104610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d7f479b9-9b76-421b-878c-d7f771ec785f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:05.106077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d7f479b9-9b76-421b-878c-d7f771ec785f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:05.135174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7f479b9-9b76-421b-878c-d7f771ec785f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:05.135672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7f479b9-9b76-421b-878c-d7f771ec785f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:05.136110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7f479b9-9b76-421b-878c-d7f771ec785f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:05.136819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7f479b9-9b76-421b-878c-d7f771ec785f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:05.137300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7f479b9-9b76-421b-878c-d7f771ec785f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:05.137721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7f479b9-9b76-421b-878c-d7f771ec785f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:05.276142 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ca3bc0d0-00d1-464d-b195-bfd965d31486 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "DELETE /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 204 len: 0 microversion: 2.1 time: 0.381396 Oct 24 10:39:05.276938 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1673/3260] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:39:04 2022] DELETE /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:39:05.287164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5423d739-4838-4cc5-bd52-9275671e41ec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:05.287874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5423d739-4838-4cc5-bd52-9275671e41ec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:05.303288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5423d739-4838-4cc5-bd52-9275671e41ec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:05.303797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5423d739-4838-4cc5-bd52-9275671e41ec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:05.304241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5423d739-4838-4cc5-bd52-9275671e41ec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:05.306220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5423d739-4838-4cc5-bd52-9275671e41ec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:05.306708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5423d739-4838-4cc5-bd52-9275671e41ec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:05.307146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5423d739-4838-4cc5-bd52-9275671e41ec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:05.804694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d7f479b9-9b76-421b-878c-d7f771ec785f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:05.820370 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d7f479b9-9b76-421b-878c-d7f771ec785f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1522 microversion: 2.1 time: 0.721220 Oct 24 10:39:05.833770 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1588/3261] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:05 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1522 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:05.843287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-49884950-edf4-426e-8355-21b1ab7650f2 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:05.852343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-49884950-edf4-426e-8355-21b1ab7650f2 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:05.868522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49884950-edf4-426e-8355-21b1ab7650f2 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:05.870622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49884950-edf4-426e-8355-21b1ab7650f2 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:05.870939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49884950-edf4-426e-8355-21b1ab7650f2 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:05.871689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49884950-edf4-426e-8355-21b1ab7650f2 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:05.872160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49884950-edf4-426e-8355-21b1ab7650f2 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:05.872595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49884950-edf4-426e-8355-21b1ab7650f2 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:05.886516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5423d739-4838-4cc5-bd52-9275671e41ec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:05.901965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5423d739-4838-4cc5-bd52-9275671e41ec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:05.907295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5423d739-4838-4cc5-bd52-9275671e41ec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:05.908669 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5423d739-4838-4cc5-bd52-9275671e41ec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1886 microversion: 2.32 time: 0.627226 Oct 24 10:39:05.910494 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1674/3262] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:05 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1886 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:05.935008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-85eed30a-0f5b-44b8-8fee-46c1ce9eab3f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:05.935008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-85eed30a-0f5b-44b8-8fee-46c1ce9eab3f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:05.977255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85eed30a-0f5b-44b8-8fee-46c1ce9eab3f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:05.977778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85eed30a-0f5b-44b8-8fee-46c1ce9eab3f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:05.978233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85eed30a-0f5b-44b8-8fee-46c1ce9eab3f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:05.978976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85eed30a-0f5b-44b8-8fee-46c1ce9eab3f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:05.979438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85eed30a-0f5b-44b8-8fee-46c1ce9eab3f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:05.982891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85eed30a-0f5b-44b8-8fee-46c1ce9eab3f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:06.170394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-85eed30a-0f5b-44b8-8fee-46c1ce9eab3f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:06.185454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-85eed30a-0f5b-44b8-8fee-46c1ce9eab3f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:06.187154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-85eed30a-0f5b-44b8-8fee-46c1ce9eab3f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:06.199809 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-85eed30a-0f5b-44b8-8fee-46c1ce9eab3f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.269965 Oct 24 10:39:06.204070 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1675/3263] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:05 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:06.210727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-81544c11-a293-4a2a-889b-b9973e513299 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:06.217584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-81544c11-a293-4a2a-889b-b9973e513299 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:06.236318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81544c11-a293-4a2a-889b-b9973e513299 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:06.236817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81544c11-a293-4a2a-889b-b9973e513299 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:06.243619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81544c11-a293-4a2a-889b-b9973e513299 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:06.244388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81544c11-a293-4a2a-889b-b9973e513299 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:06.244872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81544c11-a293-4a2a-889b-b9973e513299 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:06.245305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81544c11-a293-4a2a-889b-b9973e513299 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:06.266396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-49884950-edf4-426e-8355-21b1ab7650f2 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:06.276293 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-49884950-edf4-426e-8355-21b1ab7650f2 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1527 microversion: 2.1 time: 0.436789 Oct 24 10:39:06.279195 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1589/3264] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:05 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1527 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:06.291165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-40af651b-2a30-446a-b4d0-df973edf2a1d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:06.291769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-40af651b-2a30-446a-b4d0-df973edf2a1d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:06.307782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40af651b-2a30-446a-b4d0-df973edf2a1d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:06.308281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40af651b-2a30-446a-b4d0-df973edf2a1d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:06.308715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40af651b-2a30-446a-b4d0-df973edf2a1d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:06.310872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40af651b-2a30-446a-b4d0-df973edf2a1d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:06.311332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40af651b-2a30-446a-b4d0-df973edf2a1d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:06.311757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40af651b-2a30-446a-b4d0-df973edf2a1d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:06.572920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-40af651b-2a30-446a-b4d0-df973edf2a1d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:06.581424 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-40af651b-2a30-446a-b4d0-df973edf2a1d tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1523 microversion: 2.1 time: 0.301117 Oct 24 10:39:06.582004 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1590/3265] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:06 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:06.614838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-12ba0abb-7499-4551-a0dc-e67fbcad4eb2 req-dcfe1d22-749d-4075-8c8c-7ff49276790e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7aeb942-aab8-4051-b5ac-b4cab02dc9d0", "name": "network-vif-unplugged", "status": "completed", "tag": "60451826-6729-43c6-9b77-3e8ecaa7c65d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:06.628706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-12ba0abb-7499-4551-a0dc-e67fbcad4eb2 req-dcfe1d22-749d-4075-8c8c-7ff49276790e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:06.629382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-12ba0abb-7499-4551-a0dc-e67fbcad4eb2 req-dcfe1d22-749d-4075-8c8c-7ff49276790e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:06.629821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-12ba0abb-7499-4551-a0dc-e67fbcad4eb2 req-dcfe1d22-749d-4075-8c8c-7ff49276790e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:06.631446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=8 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:06.642346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-81544c11-a293-4a2a-889b-b9973e513299 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:06.657428 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-81544c11-a293-4a2a-889b-b9973e513299 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1673 microversion: 2.1 time: 0.450163 Oct 24 10:39:06.660916 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1676/3266] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:06 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1673 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:06.669227 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-12ba0abb-7499-4551-a0dc-e67fbcad4eb2 req-dcfe1d22-749d-4075-8c8c-7ff49276790e service nova] Creating event network-vif-unplugged:60451826-6729-43c6-9b77-3e8ecaa7c65d for instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 on n-h2-858383-15 Oct 24 10:39:06.685488 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-12ba0abb-7499-4551-a0dc-e67fbcad4eb2 req-dcfe1d22-749d-4075-8c8c-7ff49276790e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082851 Oct 24 10:39:06.690317 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1591/3267] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:06.846387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-163cf5e0-3dfb-4dfc-abba-2761d0258398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:06.847442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-163cf5e0-3dfb-4dfc-abba-2761d0258398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:06.860921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-163cf5e0-3dfb-4dfc-abba-2761d0258398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:06.861677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-163cf5e0-3dfb-4dfc-abba-2761d0258398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:06.863160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-163cf5e0-3dfb-4dfc-abba-2761d0258398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:06.865628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-163cf5e0-3dfb-4dfc-abba-2761d0258398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:06.868239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-163cf5e0-3dfb-4dfc-abba-2761d0258398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:06.868926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-163cf5e0-3dfb-4dfc-abba-2761d0258398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:06.938630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-825cfe4e-7791-4a1a-a841-106b124b0af1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:06.939700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-825cfe4e-7791-4a1a-a841-106b124b0af1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:06.955536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-825cfe4e-7791-4a1a-a841-106b124b0af1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:06.956285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-825cfe4e-7791-4a1a-a841-106b124b0af1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:06.959215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-825cfe4e-7791-4a1a-a841-106b124b0af1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:06.960309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-825cfe4e-7791-4a1a-a841-106b124b0af1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:06.961273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-825cfe4e-7791-4a1a-a841-106b124b0af1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:06.977964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-825cfe4e-7791-4a1a-a841-106b124b0af1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:06.983430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:07.441595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-163cf5e0-3dfb-4dfc-abba-2761d0258398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:07.458381 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-163cf5e0-3dfb-4dfc-abba-2761d0258398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1522 microversion: 2.1 time: 0.615798 Oct 24 10:39:07.459293 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1677/3268] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:06 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1522 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:07.468929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b77e1412-389b-4842-961d-0990939c3f43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:07.469821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b77e1412-389b-4842-961d-0990939c3f43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:07.487451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b77e1412-389b-4842-961d-0990939c3f43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:07.488356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b77e1412-389b-4842-961d-0990939c3f43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:07.489070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b77e1412-389b-4842-961d-0990939c3f43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:07.491367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b77e1412-389b-4842-961d-0990939c3f43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:07.494186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b77e1412-389b-4842-961d-0990939c3f43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:07.494838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b77e1412-389b-4842-961d-0990939c3f43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:07.535206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-825cfe4e-7791-4a1a-a841-106b124b0af1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:07.551411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-825cfe4e-7791-4a1a-a841-106b124b0af1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:07.560763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-825cfe4e-7791-4a1a-a841-106b124b0af1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:07.562623 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-825cfe4e-7791-4a1a-a841-106b124b0af1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1886 microversion: 2.32 time: 0.628939 Oct 24 10:39:07.577460 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1592/3269] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:06 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1886 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:07.582448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7e5684dc-d1e0-4ecd-abc4-540634b0d70e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:07.585607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7e5684dc-d1e0-4ecd-abc4-540634b0d70e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:07.598296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e5684dc-d1e0-4ecd-abc4-540634b0d70e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:07.603176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e5684dc-d1e0-4ecd-abc4-540634b0d70e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:07.603884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e5684dc-d1e0-4ecd-abc4-540634b0d70e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:07.608741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e5684dc-d1e0-4ecd-abc4-540634b0d70e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:07.609477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e5684dc-d1e0-4ecd-abc4-540634b0d70e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:07.610580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e5684dc-d1e0-4ecd-abc4-540634b0d70e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:07.623083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:07.720034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b77e1412-389b-4842-961d-0990939c3f43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:07.734448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b77e1412-389b-4842-961d-0990939c3f43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:07.735982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b77e1412-389b-4842-961d-0990939c3f43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:07.752276 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b77e1412-389b-4842-961d-0990939c3f43 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.291628 Oct 24 10:39:07.752901 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1678/3270] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:07 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:07.770151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-465877ed-e85e-45bd-a159-0eab083ca379 req-d7e1c6dc-41a5-44c5-9260-dcc61566ffe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "tag": "ea2571c6-ad05-4432-860b-c122aa8355bc"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:07.788957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-465877ed-e85e-45bd-a159-0eab083ca379 req-d7e1c6dc-41a5-44c5-9260-dcc61566ffe2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:07.790270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-465877ed-e85e-45bd-a159-0eab083ca379 req-d7e1c6dc-41a5-44c5-9260-dcc61566ffe2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:07.790880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-465877ed-e85e-45bd-a159-0eab083ca379 req-d7e1c6dc-41a5-44c5-9260-dcc61566ffe2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:07.816511 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-465877ed-e85e-45bd-a159-0eab083ca379 req-d7e1c6dc-41a5-44c5-9260-dcc61566ffe2 service nova] Creating event network-changed:ea2571c6-ad05-4432-860b-c122aa8355bc for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:39:07.834727 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-465877ed-e85e-45bd-a159-0eab083ca379 req-d7e1c6dc-41a5-44c5-9260-dcc61566ffe2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080271 Oct 24 10:39:07.835986 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1679/3271] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:07.841539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ade2c1ac-8b48-4d15-b3cf-61f76b98be63 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:07.843075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ade2c1ac-8b48-4d15-b3cf-61f76b98be63 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:07.860623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ade2c1ac-8b48-4d15-b3cf-61f76b98be63 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:07.861440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ade2c1ac-8b48-4d15-b3cf-61f76b98be63 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:07.862072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ade2c1ac-8b48-4d15-b3cf-61f76b98be63 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:07.862957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ade2c1ac-8b48-4d15-b3cf-61f76b98be63 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:07.863604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ade2c1ac-8b48-4d15-b3cf-61f76b98be63 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:07.864197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ade2c1ac-8b48-4d15-b3cf-61f76b98be63 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:08.080480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7e5684dc-d1e0-4ecd-abc4-540634b0d70e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:08.092809 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7e5684dc-d1e0-4ecd-abc4-540634b0d70e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1527 microversion: 2.1 time: 0.513953 Oct 24 10:39:08.114559 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1593/3272] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:07 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1527 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:08.129610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0c0be636-b332-4dd2-b712-d138b2f3f7ae tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:08.130357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0c0be636-b332-4dd2-b712-d138b2f3f7ae tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:08.141309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c0be636-b332-4dd2-b712-d138b2f3f7ae tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:08.141847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c0be636-b332-4dd2-b712-d138b2f3f7ae tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:08.142299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c0be636-b332-4dd2-b712-d138b2f3f7ae tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:08.149871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c0be636-b332-4dd2-b712-d138b2f3f7ae tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:08.150436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c0be636-b332-4dd2-b712-d138b2f3f7ae tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:08.151382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c0be636-b332-4dd2-b712-d138b2f3f7ae tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:08.341662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ade2c1ac-8b48-4d15-b3cf-61f76b98be63 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:08.355460 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ade2c1ac-8b48-4d15-b3cf-61f76b98be63 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1523 microversion: 2.1 time: 0.518041 Oct 24 10:39:08.356062 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1680/3273] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:07 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1523 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:08.440961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0c0be636-b332-4dd2-b712-d138b2f3f7ae tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:08.457800 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0c0be636-b332-4dd2-b712-d138b2f3f7ae tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1652 microversion: 2.1 time: 0.341856 Oct 24 10:39:08.459934 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1594/3274] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:08 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1652 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:08.483157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d24b084c-78ca-4d87-b08d-3361ed1bd3eb tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:08.483709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d24b084c-78ca-4d87-b08d-3361ed1bd3eb tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:08.494863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d24b084c-78ca-4d87-b08d-3361ed1bd3eb tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:08.495376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d24b084c-78ca-4d87-b08d-3361ed1bd3eb tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:08.497090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d24b084c-78ca-4d87-b08d-3361ed1bd3eb tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:08.500206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d24b084c-78ca-4d87-b08d-3361ed1bd3eb tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:08.500745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d24b084c-78ca-4d87-b08d-3361ed1bd3eb tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:08.501232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d24b084c-78ca-4d87-b08d-3361ed1bd3eb tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:08.604462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9e934f5a-bd8a-476f-88ba-e05a47777cb5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:08.605142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9e934f5a-bd8a-476f-88ba-e05a47777cb5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:08.622101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e934f5a-bd8a-476f-88ba-e05a47777cb5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:08.627713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e934f5a-bd8a-476f-88ba-e05a47777cb5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:08.628255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e934f5a-bd8a-476f-88ba-e05a47777cb5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:08.630777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e934f5a-bd8a-476f-88ba-e05a47777cb5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:08.633993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e934f5a-bd8a-476f-88ba-e05a47777cb5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:08.636948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e934f5a-bd8a-476f-88ba-e05a47777cb5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:09.268797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d24b084c-78ca-4d87-b08d-3361ed1bd3eb tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:09.283411 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d24b084c-78ca-4d87-b08d-3361ed1bd3eb tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1522 microversion: 2.1 time: 0.804138 Oct 24 10:39:09.284025 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1681/3275] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:08 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1522 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:09.300715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e815125f-bb7f-4b19-926e-45d1b0dd9945 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:09.307467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e815125f-bb7f-4b19-926e-45d1b0dd9945 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:09.330585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e815125f-bb7f-4b19-926e-45d1b0dd9945 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:09.335017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e815125f-bb7f-4b19-926e-45d1b0dd9945 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:09.335734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e815125f-bb7f-4b19-926e-45d1b0dd9945 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:09.336608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e815125f-bb7f-4b19-926e-45d1b0dd9945 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:09.337117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e815125f-bb7f-4b19-926e-45d1b0dd9945 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:09.338008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e815125f-bb7f-4b19-926e-45d1b0dd9945 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:10.237853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9e934f5a-bd8a-476f-88ba-e05a47777cb5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:10.278300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9e934f5a-bd8a-476f-88ba-e05a47777cb5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:10.284218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9e934f5a-bd8a-476f-88ba-e05a47777cb5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:10.289700 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9e934f5a-bd8a-476f-88ba-e05a47777cb5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1886 microversion: 2.32 time: 1.686974 Oct 24 10:39:10.307928 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1595/3276] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:08 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1886 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:10.317861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e815125f-bb7f-4b19-926e-45d1b0dd9945 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:10.329774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fd594570-f27a-4513-85c4-934238fcfab7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:10.331206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fd594570-f27a-4513-85c4-934238fcfab7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:10.346854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e815125f-bb7f-4b19-926e-45d1b0dd9945 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:10.347413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd594570-f27a-4513-85c4-934238fcfab7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:10.348591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd594570-f27a-4513-85c4-934238fcfab7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:10.349946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e815125f-bb7f-4b19-926e-45d1b0dd9945 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:10.353155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd594570-f27a-4513-85c4-934238fcfab7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:10.354644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd594570-f27a-4513-85c4-934238fcfab7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:10.355305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd594570-f27a-4513-85c4-934238fcfab7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:10.355866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd594570-f27a-4513-85c4-934238fcfab7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:10.363003 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e815125f-bb7f-4b19-926e-45d1b0dd9945 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 1.072713 Oct 24 10:39:10.378981 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1682/3277] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:09 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:10.395952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f17a86ae-22e3-41ca-81f7-f015485ef6ce tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:10.399768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f17a86ae-22e3-41ca-81f7-f015485ef6ce tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:10.437751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f17a86ae-22e3-41ca-81f7-f015485ef6ce tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:10.443747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f17a86ae-22e3-41ca-81f7-f015485ef6ce tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:10.444565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f17a86ae-22e3-41ca-81f7-f015485ef6ce tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:10.447370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f17a86ae-22e3-41ca-81f7-f015485ef6ce tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:10.450688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f17a86ae-22e3-41ca-81f7-f015485ef6ce tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:10.451743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f17a86ae-22e3-41ca-81f7-f015485ef6ce tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:10.618298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fd594570-f27a-4513-85c4-934238fcfab7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:10.632696 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fd594570-f27a-4513-85c4-934238fcfab7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1485 microversion: 2.1 time: 0.323247 Oct 24 10:39:10.645088 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1596/3278] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:10 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1485 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:10.660619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5033ab1e-94d5-4d61-b931-ffe49a03180b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:10.661268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5033ab1e-94d5-4d61-b931-ffe49a03180b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:10.673281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5033ab1e-94d5-4d61-b931-ffe49a03180b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:10.673787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5033ab1e-94d5-4d61-b931-ffe49a03180b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:10.674231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5033ab1e-94d5-4d61-b931-ffe49a03180b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:10.677497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5033ab1e-94d5-4d61-b931-ffe49a03180b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:10.678225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5033ab1e-94d5-4d61-b931-ffe49a03180b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:10.678865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5033ab1e-94d5-4d61-b931-ffe49a03180b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:10.855442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5033ab1e-94d5-4d61-b931-ffe49a03180b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:10.874367 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5033ab1e-94d5-4d61-b931-ffe49a03180b tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1610 microversion: 2.1 time: 0.228056 Oct 24 10:39:10.875601 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1597/3279] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:10 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1610 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:10.880692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-12ccd67f-0c30-4a15-a18c-045977909a3e req-742cf52c-be19-46bf-b21e-770d4ea6841b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "105cd729-f8cb-45e7-bb34-030c45097242", "name": "network-vif-unplugged", "status": "completed", "tag": "32092da1-897c-436e-8027-df8400cdaf1f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:10.892063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-12ccd67f-0c30-4a15-a18c-045977909a3e req-742cf52c-be19-46bf-b21e-770d4ea6841b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:10.892877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-12ccd67f-0c30-4a15-a18c-045977909a3e req-742cf52c-be19-46bf-b21e-770d4ea6841b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:10.893521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-12ccd67f-0c30-4a15-a18c-045977909a3e req-742cf52c-be19-46bf-b21e-770d4ea6841b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:10.915617 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-12ccd67f-0c30-4a15-a18c-045977909a3e req-742cf52c-be19-46bf-b21e-770d4ea6841b service nova] Creating event network-vif-unplugged:32092da1-897c-436e-8027-df8400cdaf1f for instance 105cd729-f8cb-45e7-bb34-030c45097242 on n-h1-858383-15 Oct 24 10:39:10.923917 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-12ccd67f-0c30-4a15-a18c-045977909a3e req-742cf52c-be19-46bf-b21e-770d4ea6841b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046627 Oct 24 10:39:10.925373 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1598/3280] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:10.937313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-13051945-6b2f-4b2e-bf7a-153424a0652b req-8826b88b-eaab-45e5-9128-9f30ee9ef14a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "105cd729-f8cb-45e7-bb34-030c45097242", "name": "network-vif-deleted", "tag": "76b30b9d-a037-4816-acb6-e4ef6e3d401f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:10.952586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-13051945-6b2f-4b2e-bf7a-153424a0652b req-8826b88b-eaab-45e5-9128-9f30ee9ef14a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:10.953100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-13051945-6b2f-4b2e-bf7a-153424a0652b req-8826b88b-eaab-45e5-9128-9f30ee9ef14a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:10.953552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-13051945-6b2f-4b2e-bf7a-153424a0652b req-8826b88b-eaab-45e5-9128-9f30ee9ef14a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:10.974454 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-13051945-6b2f-4b2e-bf7a-153424a0652b req-8826b88b-eaab-45e5-9128-9f30ee9ef14a service nova] Creating event network-vif-deleted:76b30b9d-a037-4816-acb6-e4ef6e3d401f for instance 105cd729-f8cb-45e7-bb34-030c45097242 on n-h1-858383-15 Oct 24 10:39:10.980061 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-13051945-6b2f-4b2e-bf7a-153424a0652b req-8826b88b-eaab-45e5-9128-9f30ee9ef14a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053003 Oct 24 10:39:10.980679 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1599/3281] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:10.987684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ebcf1521-d2ff-48af-a56c-47815a16eef6 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:10.988401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ebcf1521-d2ff-48af-a56c-47815a16eef6 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:10.997162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebcf1521-d2ff-48af-a56c-47815a16eef6 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:10.997919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebcf1521-d2ff-48af-a56c-47815a16eef6 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:10.998547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebcf1521-d2ff-48af-a56c-47815a16eef6 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:11.000716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebcf1521-d2ff-48af-a56c-47815a16eef6 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:11.002029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebcf1521-d2ff-48af-a56c-47815a16eef6 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:11.002722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebcf1521-d2ff-48af-a56c-47815a16eef6 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:11.153410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f17a86ae-22e3-41ca-81f7-f015485ef6ce tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:11.195293 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f17a86ae-22e3-41ca-81f7-f015485ef6ce tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1500 microversion: 2.1 time: 0.814575 Oct 24 10:39:11.205060 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1683/3282] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:10 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1500 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:11.229143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-69497e84-ac70-4e38-b3ff-3e6572a9ebd2 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:11.251312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-69497e84-ac70-4e38-b3ff-3e6572a9ebd2 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:11.252561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-69497e84-ac70-4e38-b3ff-3e6572a9ebd2 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:39:11.266296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69497e84-ac70-4e38-b3ff-3e6572a9ebd2 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:11.267189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69497e84-ac70-4e38-b3ff-3e6572a9ebd2 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:11.271442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69497e84-ac70-4e38-b3ff-3e6572a9ebd2 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:11.286258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69497e84-ac70-4e38-b3ff-3e6572a9ebd2 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:11.287652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69497e84-ac70-4e38-b3ff-3e6572a9ebd2 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:11.288202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69497e84-ac70-4e38-b3ff-3e6572a9ebd2 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:11.333270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-69497e84-ac70-4e38-b3ff-3e6572a9ebd2 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:39:11.340427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:11.355555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ebcf1521-d2ff-48af-a56c-47815a16eef6 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:11.365784 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ebcf1521-d2ff-48af-a56c-47815a16eef6 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1522 microversion: 2.1 time: 0.383096 Oct 24 10:39:11.366594 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1600/3283] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:10 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:11.374419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b20ad23a-7811-4e56-a72f-6e3d38660eec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:11.375336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b20ad23a-7811-4e56-a72f-6e3d38660eec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:11.376500 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-69497e84-ac70-4e38-b3ff-3e6572a9ebd2 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.152457 Oct 24 10:39:11.377552 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1684/3284] 10.222.0.50 () {58 vars in 1154 bytes} [Mon Oct 24 10:39:11 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:11.387590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b20ad23a-7811-4e56-a72f-6e3d38660eec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:11.388211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b20ad23a-7811-4e56-a72f-6e3d38660eec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:11.388794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b20ad23a-7811-4e56-a72f-6e3d38660eec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:11.389659 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b20ad23a-7811-4e56-a72f-6e3d38660eec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:11.390334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b20ad23a-7811-4e56-a72f-6e3d38660eec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:11.390867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b20ad23a-7811-4e56-a72f-6e3d38660eec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:11.392529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-78d6f5f5-f233-4d54-b431-31d28076e4a0 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:11.397667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78d6f5f5-f233-4d54-b431-31d28076e4a0 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:11.399253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78d6f5f5-f233-4d54-b431-31d28076e4a0 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:11.399660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78d6f5f5-f233-4d54-b431-31d28076e4a0 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:11.423437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-78d6f5f5-f233-4d54-b431-31d28076e4a0 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Going to try to start instance {{(pid=120426) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 10:39:11.479568 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-78d6f5f5-f233-4d54-b431-31d28076e4a0 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "POST /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0/action" status: 202 len: 0 microversion: 2.1 time: 0.093383 Oct 24 10:39:11.481292 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1685/3285] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:39:11 2022] POST /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:39:11.490570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cc86648e-06bc-4083-8722-9a248c9c7660 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:11.491868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cc86648e-06bc-4083-8722-9a248c9c7660 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:11.502423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc86648e-06bc-4083-8722-9a248c9c7660 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:11.503442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc86648e-06bc-4083-8722-9a248c9c7660 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:11.504595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc86648e-06bc-4083-8722-9a248c9c7660 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:11.505692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc86648e-06bc-4083-8722-9a248c9c7660 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:11.506342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc86648e-06bc-4083-8722-9a248c9c7660 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:11.506982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc86648e-06bc-4083-8722-9a248c9c7660 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:11.608059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cc86648e-06bc-4083-8722-9a248c9c7660 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:11.621380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cc86648e-06bc-4083-8722-9a248c9c7660 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:11.623637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cc86648e-06bc-4083-8722-9a248c9c7660 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:11.631386 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cc86648e-06bc-4083-8722-9a248c9c7660 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.148595 Oct 24 10:39:11.634124 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1686/3286] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:11 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:11.639495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b55d1727-a2e7-4d63-b9a0-3dc85b7e7ae8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:11.640509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b55d1727-a2e7-4d63-b9a0-3dc85b7e7ae8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:11.646959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b55d1727-a2e7-4d63-b9a0-3dc85b7e7ae8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:11.647930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b55d1727-a2e7-4d63-b9a0-3dc85b7e7ae8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:11.648706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b55d1727-a2e7-4d63-b9a0-3dc85b7e7ae8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:11.649681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b55d1727-a2e7-4d63-b9a0-3dc85b7e7ae8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:11.650350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b55d1727-a2e7-4d63-b9a0-3dc85b7e7ae8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:11.650850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b55d1727-a2e7-4d63-b9a0-3dc85b7e7ae8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:11.681284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b20ad23a-7811-4e56-a72f-6e3d38660eec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:11.696555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b20ad23a-7811-4e56-a72f-6e3d38660eec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:11.698866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b20ad23a-7811-4e56-a72f-6e3d38660eec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:11.706796 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b20ad23a-7811-4e56-a72f-6e3d38660eec tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.336510 Oct 24 10:39:11.718055 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1601/3287] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:11 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:11.722867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d470aed5-5c40-4553-b188-bcb3a34dbe68 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:11.726057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d470aed5-5c40-4553-b188-bcb3a34dbe68 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:11.733806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d470aed5-5c40-4553-b188-bcb3a34dbe68 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:11.734410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d470aed5-5c40-4553-b188-bcb3a34dbe68 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:11.734955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d470aed5-5c40-4553-b188-bcb3a34dbe68 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:11.736121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d470aed5-5c40-4553-b188-bcb3a34dbe68 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:11.737962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d470aed5-5c40-4553-b188-bcb3a34dbe68 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:11.738641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d470aed5-5c40-4553-b188-bcb3a34dbe68 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:11.784635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d470aed5-5c40-4553-b188-bcb3a34dbe68 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:11.785170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d470aed5-5c40-4553-b188-bcb3a34dbe68 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:11.785609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d470aed5-5c40-4553-b188-bcb3a34dbe68 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:11.786296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-d470aed5-5c40-4553-b188-bcb3a34dbe68 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lazy-loading 'fault' on Instance uuid a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:39:11.844410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d470aed5-5c40-4553-b188-bcb3a34dbe68 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:11.854879 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d470aed5-5c40-4553-b188-bcb3a34dbe68 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 200 len: 1315 microversion: 2.1 time: 0.143793 Oct 24 10:39:11.855800 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1602/3288] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:11 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:11.874614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b55d1727-a2e7-4d63-b9a0-3dc85b7e7ae8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:11.883395 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b55d1727-a2e7-4d63-b9a0-3dc85b7e7ae8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1509 microversion: 2.1 time: 0.247843 Oct 24 10:39:11.884523 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1687/3289] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:11 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:11.910545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fca61dbf-2ffa-4a48-be87-883e0291b2bf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:11.911165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fca61dbf-2ffa-4a48-be87-883e0291b2bf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:11.918727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fca61dbf-2ffa-4a48-be87-883e0291b2bf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:11.919216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fca61dbf-2ffa-4a48-be87-883e0291b2bf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:11.919837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fca61dbf-2ffa-4a48-be87-883e0291b2bf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:11.920547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fca61dbf-2ffa-4a48-be87-883e0291b2bf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:11.921038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fca61dbf-2ffa-4a48-be87-883e0291b2bf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:11.921471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fca61dbf-2ffa-4a48-be87-883e0291b2bf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:11.955021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fca61dbf-2ffa-4a48-be87-883e0291b2bf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:11.955425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fca61dbf-2ffa-4a48-be87-883e0291b2bf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:11.955864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fca61dbf-2ffa-4a48-be87-883e0291b2bf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:11.956501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-fca61dbf-2ffa-4a48-be87-883e0291b2bf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lazy-loading 'fault' on Instance uuid 105cd729-f8cb-45e7-bb34-030c45097242 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:39:12.068328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fca61dbf-2ffa-4a48-be87-883e0291b2bf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d2c201d9e348c8a2ff17525693a3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a51abc0b7c4b01ad379e50663a2000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:12.080159 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fca61dbf-2ffa-4a48-be87-883e0291b2bf tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 200 len: 1302 microversion: 2.1 time: 0.174421 Oct 24 10:39:12.085474 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1603/3290] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:11 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 1302 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:12.391765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b8c1702d-66a1-4ef7-a4b4-9e3f8a459f73 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:12.392725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b8c1702d-66a1-4ef7-a4b4-9e3f8a459f73 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:12.396535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:12.405937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8c1702d-66a1-4ef7-a4b4-9e3f8a459f73 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:12.406997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8c1702d-66a1-4ef7-a4b4-9e3f8a459f73 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:12.408102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8c1702d-66a1-4ef7-a4b4-9e3f8a459f73 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:12.409428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8c1702d-66a1-4ef7-a4b4-9e3f8a459f73 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:12.411636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8c1702d-66a1-4ef7-a4b4-9e3f8a459f73 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:12.413207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8c1702d-66a1-4ef7-a4b4-9e3f8a459f73 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:12.646003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b8c1702d-66a1-4ef7-a4b4-9e3f8a459f73 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:12.668284 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b8c1702d-66a1-4ef7-a4b4-9e3f8a459f73 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1504 microversion: 2.1 time: 0.280382 Oct 24 10:39:12.668812 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1688/3291] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:12 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1504 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:12.688685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eeefcff7-25fb-44ce-a273-8094f0c15d4f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:12.689349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eeefcff7-25fb-44ce-a273-8094f0c15d4f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:12.700435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eeefcff7-25fb-44ce-a273-8094f0c15d4f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:12.701062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eeefcff7-25fb-44ce-a273-8094f0c15d4f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:12.714555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eeefcff7-25fb-44ce-a273-8094f0c15d4f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:12.715965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eeefcff7-25fb-44ce-a273-8094f0c15d4f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:12.719096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eeefcff7-25fb-44ce-a273-8094f0c15d4f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:12.720634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eeefcff7-25fb-44ce-a273-8094f0c15d4f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:12.743573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b5ee5d69-2119-4ba2-b564-e74393834a43 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:12.744533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b5ee5d69-2119-4ba2-b564-e74393834a43 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:12.760314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5ee5d69-2119-4ba2-b564-e74393834a43 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:12.761869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5ee5d69-2119-4ba2-b564-e74393834a43 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:12.762564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5ee5d69-2119-4ba2-b564-e74393834a43 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:12.763459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5ee5d69-2119-4ba2-b564-e74393834a43 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:12.764124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5ee5d69-2119-4ba2-b564-e74393834a43 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:12.766315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5ee5d69-2119-4ba2-b564-e74393834a43 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:12.848649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eeefcff7-25fb-44ce-a273-8094f0c15d4f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:12.867933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eeefcff7-25fb-44ce-a273-8094f0c15d4f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:12.869892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eeefcff7-25fb-44ce-a273-8094f0c15d4f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:12.880180 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eeefcff7-25fb-44ce-a273-8094f0c15d4f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.213158 Oct 24 10:39:12.887026 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1604/3292] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:12 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:12.892229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-85a61f6b-1b32-4a30-9ae1-8722815cdbf9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:12.895029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-85a61f6b-1b32-4a30-9ae1-8722815cdbf9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:12.909538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-85a61f6b-1b32-4a30-9ae1-8722815cdbf9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:12.910402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-85a61f6b-1b32-4a30-9ae1-8722815cdbf9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:12.911025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-85a61f6b-1b32-4a30-9ae1-8722815cdbf9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:12.911919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-85a61f6b-1b32-4a30-9ae1-8722815cdbf9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:12.912530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-85a61f6b-1b32-4a30-9ae1-8722815cdbf9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:12.913154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-85a61f6b-1b32-4a30-9ae1-8722815cdbf9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:12.930775 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-85a61f6b-1b32-4a30-9ae1-8722815cdbf9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] HTTP exception thrown: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 could not be found. Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-85a61f6b-1b32-4a30-9ae1-8722815cdbf9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Request method failure captured: Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 HTTP/1.1 Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmsZ6iCeMLTpciKzT-IOd-jSbp-Ock4X7vHFbSgox-iuMV2hxDyst1XnTlhe7a0yhnti-D3qlDTVLsDNpGHmdQxuIxzHTz6ZfOA3sAyV-nTFUvtxnUe0hLrgWnomxwn6YBZ-Qwy9VkVlCsoa7UEzkg7FPtyXY6LqjelB4oPUwFh9rLg Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5edfb6d8f84547399863eec5c89e6933", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 1f089833f359473ebfa681931e8ffc06 Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 could not be found. Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'a7aeb942-aab8-4051-b5ac-b4cab02dc9d0'} Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 could not be found. Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 could not be found. Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:12.932645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:12.937864 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:12.937864 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:12.937864 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:12.937864 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:12.937864 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:39:12.937864 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:39:12.937864 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 could not be found. Oct 24 10:39:12.937864 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:12.939642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-85a61f6b-1b32-4a30-9ae1-8722815cdbf9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Returning 404 to user: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:39:12.940869 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-85a61f6b-1b32-4a30-9ae1-8722815cdbf9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 404 len: 111 microversion: 2.1 time: 0.052372 Oct 24 10:39:12.941911 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1605/3293] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:12 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:39:12.947332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1d613214-30be-40df-8f17-123b4b94eb1e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:12.948574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1d613214-30be-40df-8f17-123b4b94eb1e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:12.955983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d613214-30be-40df-8f17-123b4b94eb1e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:12.956744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d613214-30be-40df-8f17-123b4b94eb1e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:12.957425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d613214-30be-40df-8f17-123b4b94eb1e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:12.958339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d613214-30be-40df-8f17-123b4b94eb1e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:12.959506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d613214-30be-40df-8f17-123b4b94eb1e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:12.960125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d613214-30be-40df-8f17-123b4b94eb1e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:13.231812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b5ee5d69-2119-4ba2-b564-e74393834a43 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:13.247889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1d613214-30be-40df-8f17-123b4b94eb1e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:13.254026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b5ee5d69-2119-4ba2-b564-e74393834a43 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:13.255829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b5ee5d69-2119-4ba2-b564-e74393834a43 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:13.256714 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1d613214-30be-40df-8f17-123b4b94eb1e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1509 microversion: 2.1 time: 0.313614 Oct 24 10:39:13.257060 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b5ee5d69-2119-4ba2-b564-e74393834a43 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.520415 Oct 24 10:39:13.272876 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1689/3294] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:12 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:13.272876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b8c09f33-afd7-4ffd-9da7-82d30dd84db5 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Action: 'create', calling method: .version_select at 0x7f04d012d700>, body: {"keypair": {"name": "tempest-keypair-1308045681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUJMwJ0x1TZMDpVgMEbEOwZIM71jymKuK/DhBlVtLpcwfUTJQZhxVpnD/IA8JfcBG/6nQd9fZvP4HRdPULszjvoXvI4YW+Pxv4FQHx0COndWy5/1qGYsUF6y6D197ZRXA=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:13.274672 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1606/3295] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:12 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1509 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:13.280452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-2e1970f6-db14-4e72-a5f5-6ea4db7eafc2 req-44001016-d3f8-4330-9e92-8100b8316b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7aeb942-aab8-4051-b5ac-b4cab02dc9d0", "name": "network-vif-deleted", "tag": "60451826-6729-43c6-9b77-3e8ecaa7c65d"}, {"server_uuid": "105cd729-f8cb-45e7-bb34-030c45097242", "name": "network-vif-deleted", "tag": "32092da1-897c-436e-8027-df8400cdaf1f"}, {"name": "network-changed", "server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "tag": "5f14f77f-dfb8-4e0c-9fc7-42fa81786d65"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:13.293072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2e1970f6-db14-4e72-a5f5-6ea4db7eafc2 req-44001016-d3f8-4330-9e92-8100b8316b92 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:13.293831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2e1970f6-db14-4e72-a5f5-6ea4db7eafc2 req-44001016-d3f8-4330-9e92-8100b8316b92 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:13.294426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2e1970f6-db14-4e72-a5f5-6ea4db7eafc2 req-44001016-d3f8-4330-9e92-8100b8316b92 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:13.297937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-b8c09f33-afd7-4ffd-9da7-82d30dd84db5 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Getting quotas for project 5edfb6d8f84547399863eec5c89e6933. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:39:13.310548 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-2e1970f6-db14-4e72-a5f5-6ea4db7eafc2 req-44001016-d3f8-4330-9e92-8100b8316b92 service nova] Creating event network-vif-deleted:60451826-6729-43c6-9b77-3e8ecaa7c65d for instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 on n-h2-858383-15 Oct 24 10:39:13.311356 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-2e1970f6-db14-4e72-a5f5-6ea4db7eafc2 req-44001016-d3f8-4330-9e92-8100b8316b92 service nova] Creating event network-vif-deleted:32092da1-897c-436e-8027-df8400cdaf1f for instance 105cd729-f8cb-45e7-bb34-030c45097242 on n-h1-858383-15 Oct 24 10:39:13.312015 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-2e1970f6-db14-4e72-a5f5-6ea4db7eafc2 req-44001016-d3f8-4330-9e92-8100b8316b92 service nova] Creating event network-changed:5f14f77f-dfb8-4e0c-9fc7-42fa81786d65 for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:39:13.315047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-b8c09f33-afd7-4ffd-9da7-82d30dd84db5 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Getting quotas for user 1f089833f359473ebfa681931e8ffc06 and project 5edfb6d8f84547399863eec5c89e6933. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:39:13.327542 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-2e1970f6-db14-4e72-a5f5-6ea4db7eafc2 req-44001016-d3f8-4330-9e92-8100b8316b92 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.050263 Oct 24 10:39:13.328295 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1607/3296] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:13.334335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e03870b-4de7-484e-9c4d-484f676c1cc1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:13.335347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e03870b-4de7-484e-9c4d-484f676c1cc1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:13.346128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e03870b-4de7-484e-9c4d-484f676c1cc1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:13.346895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e03870b-4de7-484e-9c4d-484f676c1cc1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:13.347575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e03870b-4de7-484e-9c4d-484f676c1cc1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:13.348530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e03870b-4de7-484e-9c4d-484f676c1cc1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:13.349172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e03870b-4de7-484e-9c4d-484f676c1cc1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:13.349817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e03870b-4de7-484e-9c4d-484f676c1cc1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:13.377591 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-1e03870b-4de7-484e-9c4d-484f676c1cc1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] HTTP exception thrown: Instance 105cd729-f8cb-45e7-bb34-030c45097242 could not be found. Oct 24 10:39:13.385509 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b8c09f33-afd7-4ffd-9da7-82d30dd84db5 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126204 Oct 24 10:39:13.387238 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1690/3297] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:39:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e03870b-4de7-484e-9c4d-484f676c1cc1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Request method failure captured: Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 HTTP/1.1 Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmrU0qOkxUYxPy1TFCBlk8lEUDstc_ijm7c5gtwX9g8vT6Fz_reafeRRu0EpE5OniPvhMFBGjQjJYBUXsxUYkPiR1ixj5KSaN0o-driXZFbdK1SxQdKkrFO8kfGl9k62ggVatqCXLHGNMIwiVsT5EZVcvm2J2xqV-qZ1S1vAInUUJC4 Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 19a51abc0b7c4b01ad379e50663a2000 Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersTestMultiNic-119742743 Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/19a51abc0b7c4b01ad379e50663a2000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/19a51abc0b7c4b01ad379e50663a2000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/19a51abc0b7c4b01ad379e50663a2000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_19a51abc0b7c4b01ad379e50663a2000", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersTestMultiNic-119742743 Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 19a51abc0b7c4b01ad379e50663a2000 Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersTestMultiNic-119742743 Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersTestMultiNic-119742743-project Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 83d2c201d9e348c8a2ff17525693a3ab Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersTestMultiNic-119742743-project Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 105cd729-f8cb-45e7-bb34-030c45097242 could not be found. Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '105cd729-f8cb-45e7-bb34-030c45097242'} Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 105cd729-f8cb-45e7-bb34-030c45097242 could not be found. Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 105cd729-f8cb-45e7-bb34-030c45097242 could not be found. Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:13.390650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:13.395442 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:13.395442 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:13.395442 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:13.395442 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:39:13.395442 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:39:13.395442 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 105cd729-f8cb-45e7-bb34-030c45097242 could not be found. Oct 24 10:39:13.395442 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:13.399153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e03870b-4de7-484e-9c4d-484f676c1cc1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Returning 404 to user: Instance 105cd729-f8cb-45e7-bb34-030c45097242 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:39:13.400627 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1e03870b-4de7-484e-9c4d-484f676c1cc1 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 404 len: 111 microversion: 2.1 time: 0.070399 Oct 24 10:39:13.401445 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1608/3298] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:13 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:39:13.407694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8c74ac29-0e96-426b-b59b-c07f11525e41 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:13.412418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8c74ac29-0e96-426b-b59b-c07f11525e41 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:13.423299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c74ac29-0e96-426b-b59b-c07f11525e41 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:13.424131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c74ac29-0e96-426b-b59b-c07f11525e41 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:13.425113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c74ac29-0e96-426b-b59b-c07f11525e41 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:13.426004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c74ac29-0e96-426b-b59b-c07f11525e41 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:13.426686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c74ac29-0e96-426b-b59b-c07f11525e41 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:13.427116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c74ac29-0e96-426b-b59b-c07f11525e41 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:13.546394 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8c74ac29-0e96-426b-b59b-c07f11525e41 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 202 len: 0 microversion: 2.1 time: 0.157286 Oct 24 10:39:13.548191 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1691/3299] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:39:13 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:39:13.556599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80af8dde-e461-4ea6-898e-8f9a973d273c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:13.557247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-80af8dde-e461-4ea6-898e-8f9a973d273c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:13.566522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80af8dde-e461-4ea6-898e-8f9a973d273c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:13.571642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80af8dde-e461-4ea6-898e-8f9a973d273c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:13.572219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80af8dde-e461-4ea6-898e-8f9a973d273c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:13.573118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80af8dde-e461-4ea6-898e-8f9a973d273c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:13.575032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80af8dde-e461-4ea6-898e-8f9a973d273c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:13.578923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80af8dde-e461-4ea6-898e-8f9a973d273c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:13.693887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-38e06d84-1161-4d09-b08d-2cd5382064d3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:13.694606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-38e06d84-1161-4d09-b08d-2cd5382064d3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:13.715114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38e06d84-1161-4d09-b08d-2cd5382064d3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:13.716199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38e06d84-1161-4d09-b08d-2cd5382064d3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:13.718352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38e06d84-1161-4d09-b08d-2cd5382064d3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:13.720929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38e06d84-1161-4d09-b08d-2cd5382064d3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:13.722538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38e06d84-1161-4d09-b08d-2cd5382064d3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:13.723707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38e06d84-1161-4d09-b08d-2cd5382064d3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:14.261460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-38e06d84-1161-4d09-b08d-2cd5382064d3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:14.277722 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-38e06d84-1161-4d09-b08d-2cd5382064d3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1504 microversion: 2.1 time: 0.588048 Oct 24 10:39:14.279310 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1692/3300] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:13 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1504 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:14.296193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a1931921-a751-425e-ad22-f566b3ff0857 req-a91279ac-9b66-4355-bea6-1b0047e90fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d4c883-f34d-4326-8505-2d66bd047dc8", "name": "network-vif-unplugged", "status": "completed", "tag": "0c4d075a-267d-4bd1-8a69-d9825c34d8a2"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:14.312662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a1931921-a751-425e-ad22-f566b3ff0857 req-a91279ac-9b66-4355-bea6-1b0047e90fb4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:14.313984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a1931921-a751-425e-ad22-f566b3ff0857 req-a91279ac-9b66-4355-bea6-1b0047e90fb4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:14.314788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a1931921-a751-425e-ad22-f566b3ff0857 req-a91279ac-9b66-4355-bea6-1b0047e90fb4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:14.330108 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a1931921-a751-425e-ad22-f566b3ff0857 req-a91279ac-9b66-4355-bea6-1b0047e90fb4 service nova] Creating event network-vif-unplugged:0c4d075a-267d-4bd1-8a69-d9825c34d8a2 for instance 18d4c883-f34d-4326-8505-2d66bd047dc8 on n-h1-858383-15 Oct 24 10:39:14.338125 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a1931921-a751-425e-ad22-f566b3ff0857 req-a91279ac-9b66-4355-bea6-1b0047e90fb4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056630 Oct 24 10:39:14.339307 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1693/3301] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:14.348687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-80af8dde-e461-4ea6-898e-8f9a973d273c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:14.361004 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-80af8dde-e461-4ea6-898e-8f9a973d273c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1673 microversion: 2.1 time: 0.809124 Oct 24 10:39:14.363922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6e78ccf6-15d5-4010-bf71-1ed64d522f5d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:14.365190 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1609/3302] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:13 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1673 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:14.367721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6e78ccf6-15d5-4010-bf71-1ed64d522f5d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:14.372414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-af97baa3-8d0f-4f45-8bda-6078431cf8e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:14.374127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-af97baa3-8d0f-4f45-8bda-6078431cf8e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:14.380810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e78ccf6-15d5-4010-bf71-1ed64d522f5d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:14.381354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e78ccf6-15d5-4010-bf71-1ed64d522f5d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:14.381803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e78ccf6-15d5-4010-bf71-1ed64d522f5d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:14.382526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e78ccf6-15d5-4010-bf71-1ed64d522f5d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:14.383748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e78ccf6-15d5-4010-bf71-1ed64d522f5d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:14.384210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e78ccf6-15d5-4010-bf71-1ed64d522f5d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:14.384584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af97baa3-8d0f-4f45-8bda-6078431cf8e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:14.385601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af97baa3-8d0f-4f45-8bda-6078431cf8e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:14.387261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af97baa3-8d0f-4f45-8bda-6078431cf8e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:14.388302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af97baa3-8d0f-4f45-8bda-6078431cf8e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:14.389028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af97baa3-8d0f-4f45-8bda-6078431cf8e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:14.389677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af97baa3-8d0f-4f45-8bda-6078431cf8e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:14.569172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e78ccf6-15d5-4010-bf71-1ed64d522f5d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:14.593707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e78ccf6-15d5-4010-bf71-1ed64d522f5d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:14.595369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e78ccf6-15d5-4010-bf71-1ed64d522f5d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:14.603509 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6e78ccf6-15d5-4010-bf71-1ed64d522f5d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.262683 Oct 24 10:39:14.605204 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1694/3303] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:14 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:14.623408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2b6ff137-0031-4d0f-8f5a-6b21e95cec2f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:14.624818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2b6ff137-0031-4d0f-8f5a-6b21e95cec2f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:14.632732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b6ff137-0031-4d0f-8f5a-6b21e95cec2f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:14.633912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b6ff137-0031-4d0f-8f5a-6b21e95cec2f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:14.634535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b6ff137-0031-4d0f-8f5a-6b21e95cec2f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:14.635635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b6ff137-0031-4d0f-8f5a-6b21e95cec2f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:14.636438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b6ff137-0031-4d0f-8f5a-6b21e95cec2f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:14.637082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b6ff137-0031-4d0f-8f5a-6b21e95cec2f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:15.031891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-af97baa3-8d0f-4f45-8bda-6078431cf8e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:15.046892 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-af97baa3-8d0f-4f45-8bda-6078431cf8e3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1509 microversion: 2.1 time: 0.678881 Oct 24 10:39:15.049324 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1610/3304] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:14 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1509 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:15.176037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2b6ff137-0031-4d0f-8f5a-6b21e95cec2f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:15.187680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2b6ff137-0031-4d0f-8f5a-6b21e95cec2f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:15.189148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2b6ff137-0031-4d0f-8f5a-6b21e95cec2f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:15.190320 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2b6ff137-0031-4d0f-8f5a-6b21e95cec2f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.583973 Oct 24 10:39:15.190887 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1695/3305] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:14 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:15.310472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9a89bde2-047e-4d62-bacf-cd03991b3054 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:15.311506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9a89bde2-047e-4d62-bacf-cd03991b3054 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:15.322903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a89bde2-047e-4d62-bacf-cd03991b3054 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:15.323657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a89bde2-047e-4d62-bacf-cd03991b3054 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:15.325346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a89bde2-047e-4d62-bacf-cd03991b3054 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:15.327678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a89bde2-047e-4d62-bacf-cd03991b3054 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:15.330186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a89bde2-047e-4d62-bacf-cd03991b3054 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:15.330856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a89bde2-047e-4d62-bacf-cd03991b3054 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:15.395515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ac1a324c-98c9-4ffc-9efd-310324ab8a8f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:15.396145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ac1a324c-98c9-4ffc-9efd-310324ab8a8f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:15.405534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac1a324c-98c9-4ffc-9efd-310324ab8a8f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:15.405956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac1a324c-98c9-4ffc-9efd-310324ab8a8f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:15.406398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac1a324c-98c9-4ffc-9efd-310324ab8a8f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:15.407107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac1a324c-98c9-4ffc-9efd-310324ab8a8f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:15.407560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac1a324c-98c9-4ffc-9efd-310324ab8a8f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:15.410545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:15.413424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac1a324c-98c9-4ffc-9efd-310324ab8a8f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:16.383751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ac1a324c-98c9-4ffc-9efd-310324ab8a8f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:16.392079 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ac1a324c-98c9-4ffc-9efd-310324ab8a8f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1673 microversion: 2.1 time: 1.000273 Oct 24 10:39:16.392283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9a89bde2-047e-4d62-bacf-cd03991b3054 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:16.405623 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1696/3306] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:15 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1673 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:39:16.409947 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9a89bde2-047e-4d62-bacf-cd03991b3054 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1504 microversion: 2.1 time: 1.106348 Oct 24 10:39:16.410969 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1611/3307] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:15 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1504 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:16.416106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-89f705f5-55b6-4f8f-983b-ae4e3eaeba7a req-627c5814-69f5-41d9-b116-f6dc4b8633c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "tag": "a9abbed7-ca02-4124-abca-3fe10fe22ee4"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:16.423462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6692ec19-6e24-4c4c-ac5c-19de4cbfab7f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:16.427058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6692ec19-6e24-4c4c-ac5c-19de4cbfab7f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:16.427740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-89f705f5-55b6-4f8f-983b-ae4e3eaeba7a req-627c5814-69f5-41d9-b116-f6dc4b8633c0 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:16.428366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-89f705f5-55b6-4f8f-983b-ae4e3eaeba7a req-627c5814-69f5-41d9-b116-f6dc4b8633c0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:16.429113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-89f705f5-55b6-4f8f-983b-ae4e3eaeba7a req-627c5814-69f5-41d9-b116-f6dc4b8633c0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:16.440226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6692ec19-6e24-4c4c-ac5c-19de4cbfab7f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:16.441331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6692ec19-6e24-4c4c-ac5c-19de4cbfab7f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:16.442043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6692ec19-6e24-4c4c-ac5c-19de4cbfab7f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:16.443373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6692ec19-6e24-4c4c-ac5c-19de4cbfab7f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:16.444086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6692ec19-6e24-4c4c-ac5c-19de4cbfab7f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:16.444814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6692ec19-6e24-4c4c-ac5c-19de4cbfab7f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:16.448206 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-89f705f5-55b6-4f8f-983b-ae4e3eaeba7a req-627c5814-69f5-41d9-b116-f6dc4b8633c0 service nova] Creating event network-changed:a9abbed7-ca02-4124-abca-3fe10fe22ee4 for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:39:16.464585 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-89f705f5-55b6-4f8f-983b-ae4e3eaeba7a req-627c5814-69f5-41d9-b116-f6dc4b8633c0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057055 Oct 24 10:39:16.468440 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1697/3308] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:16.473886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-46c25745-3478-4294-af16-4fc39ab5c2de tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:16.475004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-46c25745-3478-4294-af16-4fc39ab5c2de tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:16.487665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46c25745-3478-4294-af16-4fc39ab5c2de tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:16.489404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46c25745-3478-4294-af16-4fc39ab5c2de tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:16.490335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46c25745-3478-4294-af16-4fc39ab5c2de tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:16.491453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46c25745-3478-4294-af16-4fc39ab5c2de tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:16.492774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46c25745-3478-4294-af16-4fc39ab5c2de tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:16.494054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46c25745-3478-4294-af16-4fc39ab5c2de tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:16.575404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6692ec19-6e24-4c4c-ac5c-19de4cbfab7f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:16.585494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6692ec19-6e24-4c4c-ac5c-19de4cbfab7f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:16.588149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6692ec19-6e24-4c4c-ac5c-19de4cbfab7f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:16.595244 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6692ec19-6e24-4c4c-ac5c-19de4cbfab7f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1558 microversion: 2.91 time: 0.182534 Oct 24 10:39:16.596354 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1612/3309] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:16 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:16.603923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cb58979f-6266-4a97-a8b8-9fc1c32f5817 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:16.605161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cb58979f-6266-4a97-a8b8-9fc1c32f5817 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:16.612331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb58979f-6266-4a97-a8b8-9fc1c32f5817 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:16.613159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb58979f-6266-4a97-a8b8-9fc1c32f5817 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:16.613880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb58979f-6266-4a97-a8b8-9fc1c32f5817 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:16.615130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb58979f-6266-4a97-a8b8-9fc1c32f5817 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:16.615812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb58979f-6266-4a97-a8b8-9fc1c32f5817 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:16.616515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb58979f-6266-4a97-a8b8-9fc1c32f5817 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:16.858521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-46c25745-3478-4294-af16-4fc39ab5c2de tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:16.870646 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-46c25745-3478-4294-af16-4fc39ab5c2de tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1513 microversion: 2.1 time: 0.400846 Oct 24 10:39:16.885428 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1698/3310] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:16 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1513 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:16.901601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cb58979f-6266-4a97-a8b8-9fc1c32f5817 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:16.910093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d0bf1291-bb6e-4c79-ab79-f919c8a2e359 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:16.911496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cb58979f-6266-4a97-a8b8-9fc1c32f5817 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:16.912957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cb58979f-6266-4a97-a8b8-9fc1c32f5817 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:16.914848 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cb58979f-6266-4a97-a8b8-9fc1c32f5817 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.316458 Oct 24 10:39:16.915415 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1613/3311] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:16 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:16.923988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d0bf1291-bb6e-4c79-ab79-f919c8a2e359 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:16.925355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.compute.servers [None req-d0bf1291-bb6e-4c79-ab79-f919c8a2e359 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Removing options 'limit' from query {{(pid=120426) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 24 10:39:16.926243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d0bf1291-bb6e-4c79-ab79-f919c8a2e359 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:39:16.927488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0bf1291-bb6e-4c79-ab79-f919c8a2e359 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:16.928092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0bf1291-bb6e-4c79-ab79-f919c8a2e359 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:16.929025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0bf1291-bb6e-4c79-ab79-f919c8a2e359 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:16.930465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0bf1291-bb6e-4c79-ab79-f919c8a2e359 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:16.931158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0bf1291-bb6e-4c79-ab79-f919c8a2e359 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:16.931674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0bf1291-bb6e-4c79-ab79-f919c8a2e359 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:16.933786 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d0bf1291-bb6e-4c79-ab79-f919c8a2e359 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.040204 Oct 24 10:39:16.934550 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1699/3312] 10.222.0.50 () {58 vars in 1140 bytes} [Mon Oct 24 10:39:16 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:39:16.953845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a8862d9c-2285-4c1a-8687-c4dec632e3b6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:16.954561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a8862d9c-2285-4c1a-8687-c4dec632e3b6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:16.961493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8862d9c-2285-4c1a-8687-c4dec632e3b6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:16.962340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8862d9c-2285-4c1a-8687-c4dec632e3b6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:16.962992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8862d9c-2285-4c1a-8687-c4dec632e3b6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:16.963794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8862d9c-2285-4c1a-8687-c4dec632e3b6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:16.964342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8862d9c-2285-4c1a-8687-c4dec632e3b6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:16.965004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8862d9c-2285-4c1a-8687-c4dec632e3b6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:17.103626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a8862d9c-2285-4c1a-8687-c4dec632e3b6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:17.111849 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a8862d9c-2285-4c1a-8687-c4dec632e3b6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1513 microversion: 2.1 time: 0.168875 Oct 24 10:39:17.112644 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1614/3313] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:16 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:17.135525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3928401a-95ea-49b5-b0c0-df95ac0aba41 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:17.136061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3928401a-95ea-49b5-b0c0-df95ac0aba41 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 2f024708-057e-4eda-9894-fb480a85c693] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:17.142422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3928401a-95ea-49b5-b0c0-df95ac0aba41 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:17.143057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3928401a-95ea-49b5-b0c0-df95ac0aba41 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:17.143499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3928401a-95ea-49b5-b0c0-df95ac0aba41 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:17.144195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3928401a-95ea-49b5-b0c0-df95ac0aba41 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:17.144647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3928401a-95ea-49b5-b0c0-df95ac0aba41 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:17.145101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3928401a-95ea-49b5-b0c0-df95ac0aba41 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:17.287791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3928401a-95ea-49b5-b0c0-df95ac0aba41 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:17.298364 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3928401a-95ea-49b5-b0c0-df95ac0aba41 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693" status: 200 len: 1511 microversion: 2.1 time: 0.167452 Oct 24 10:39:17.300218 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1700/3314] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:17 2022] GET /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:17.324675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-966e9a4e-704e-4a12-974e-cedb31390503 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:17.325688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-966e9a4e-704e-4a12-974e-cedb31390503 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:17.332089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-966e9a4e-704e-4a12-974e-cedb31390503 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:17.332671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-966e9a4e-704e-4a12-974e-cedb31390503 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:17.333207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-966e9a4e-704e-4a12-974e-cedb31390503 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:17.334022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-966e9a4e-704e-4a12-974e-cedb31390503 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:17.334550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-966e9a4e-704e-4a12-974e-cedb31390503 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:17.335194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-966e9a4e-704e-4a12-974e-cedb31390503 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:17.423773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d6343814-f7dc-4e42-85d5-c4c740df4246 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:17.425050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d6343814-f7dc-4e42-85d5-c4c740df4246 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:17.435894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6343814-f7dc-4e42-85d5-c4c740df4246 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:17.436883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6343814-f7dc-4e42-85d5-c4c740df4246 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:17.438070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6343814-f7dc-4e42-85d5-c4c740df4246 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:17.439166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6343814-f7dc-4e42-85d5-c4c740df4246 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:17.439929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6343814-f7dc-4e42-85d5-c4c740df4246 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:17.440523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6343814-f7dc-4e42-85d5-c4c740df4246 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:17.530647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-966e9a4e-704e-4a12-974e-cedb31390503 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:17.539384 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-966e9a4e-704e-4a12-974e-cedb31390503 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 200 len: 1510 microversion: 2.1 time: 0.221837 Oct 24 10:39:17.540000 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1615/3315] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:17 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:17.557844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-df503963-fc42-4504-92fd-c31abe11d8ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:17.559033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-df503963-fc42-4504-92fd-c31abe11d8ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:17.565239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df503963-fc42-4504-92fd-c31abe11d8ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:17.565723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df503963-fc42-4504-92fd-c31abe11d8ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:17.566330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df503963-fc42-4504-92fd-c31abe11d8ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:17.567034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df503963-fc42-4504-92fd-c31abe11d8ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:17.567484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df503963-fc42-4504-92fd-c31abe11d8ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:17.567903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df503963-fc42-4504-92fd-c31abe11d8ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:17.603286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d6343814-f7dc-4e42-85d5-c4c740df4246 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:17.612058 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d6343814-f7dc-4e42-85d5-c4c740df4246 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.194078 Oct 24 10:39:17.616875 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1701/3316] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:17 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:39:17.621761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4817073d-82c5-474a-9b5c-f3f5deb4a520 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:17.634257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4817073d-82c5-474a-9b5c-f3f5deb4a520 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:17.634257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4817073d-82c5-474a-9b5c-f3f5deb4a520 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:39:17.761667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4817073d-82c5-474a-9b5c-f3f5deb4a520 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:17.762878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4817073d-82c5-474a-9b5c-f3f5deb4a520 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:17.763328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4817073d-82c5-474a-9b5c-f3f5deb4a520 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:17.764277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4817073d-82c5-474a-9b5c-f3f5deb4a520 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:17.764981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4817073d-82c5-474a-9b5c-f3f5deb4a520 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:17.765395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4817073d-82c5-474a-9b5c-f3f5deb4a520 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:17.792506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-df503963-fc42-4504-92fd-c31abe11d8ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:17.800628 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-df503963-fc42-4504-92fd-c31abe11d8ab tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 200 len: 1447 microversion: 2.1 time: 0.259379 Oct 24 10:39:17.801627 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1616/3317] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:17 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 1447 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:17.807052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9fc9802b-f4be-41c1-8554-c781c8f36766 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:17.807820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9fc9802b-f4be-41c1-8554-c781c8f36766 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:17.814114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fc9802b-f4be-41c1-8554-c781c8f36766 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:17.814792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fc9802b-f4be-41c1-8554-c781c8f36766 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:17.815418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fc9802b-f4be-41c1-8554-c781c8f36766 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:17.816271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fc9802b-f4be-41c1-8554-c781c8f36766 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:17.816903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fc9802b-f4be-41c1-8554-c781c8f36766 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:17.817481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fc9802b-f4be-41c1-8554-c781c8f36766 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:17.869183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:17.875071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-4817073d-82c5-474a-9b5c-f3f5deb4a520 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:39:17.887268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9fc9802b-f4be-41c1-8554-c781c8f36766 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:17.903056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9fc9802b-f4be-41c1-8554-c781c8f36766 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:17.904857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9fc9802b-f4be-41c1-8554-c781c8f36766 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:17.911136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:17.915533 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9fc9802b-f4be-41c1-8554-c781c8f36766 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1558 microversion: 2.91 time: 0.111090 Oct 24 10:39:17.916272 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1617/3318] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:17 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1558 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:17.922023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2a7155eb-96ef-4063-99c1-23355b3ecaef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:17.922820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2a7155eb-96ef-4063-99c1-23355b3ecaef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:17.931095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a7155eb-96ef-4063-99c1-23355b3ecaef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:17.931594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a7155eb-96ef-4063-99c1-23355b3ecaef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:17.932075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a7155eb-96ef-4063-99c1-23355b3ecaef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:17.932976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a7155eb-96ef-4063-99c1-23355b3ecaef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:17.933558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a7155eb-96ef-4063-99c1-23355b3ecaef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:17.934209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a7155eb-96ef-4063-99c1-23355b3ecaef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:17.971807 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4817073d-82c5-474a-9b5c-f3f5deb4a520 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 346 microversion: 2.1 time: 0.356889 Oct 24 10:39:17.972932 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1702/3319] 10.222.0.50 () {58 vars in 1154 bytes} [Mon Oct 24 10:39:17 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 346 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:17.983095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2a7155eb-96ef-4063-99c1-23355b3ecaef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:39:17.989236 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.compute.api [None req-2a7155eb-96ef-4063-99c1-23355b3ecaef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Working on deleting snapshot 46be8062-03a2-48c8-ab0c-94723954f7c6 from shelved instance... Oct 24 10:39:17.990010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-55567014-ae43-46aa-ae48-eea27cb04706 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:17.990765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-55567014-ae43-46aa-ae48-eea27cb04706 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:17.999524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55567014-ae43-46aa-ae48-eea27cb04706 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:18.000391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55567014-ae43-46aa-ae48-eea27cb04706 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:18.000959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55567014-ae43-46aa-ae48-eea27cb04706 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:18.002385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55567014-ae43-46aa-ae48-eea27cb04706 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:18.002961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55567014-ae43-46aa-ae48-eea27cb04706 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:18.003486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55567014-ae43-46aa-ae48-eea27cb04706 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:18.409895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-55567014-ae43-46aa-ae48-eea27cb04706 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:18.420950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-55567014-ae43-46aa-ae48-eea27cb04706 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:18.434881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-55567014-ae43-46aa-ae48-eea27cb04706 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:18.436095 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-55567014-ae43-46aa-ae48-eea27cb04706 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.461347 Oct 24 10:39:18.451841 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1703/3320] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:17 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:18.463768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-79c7b399-547f-43bd-a154-8442000568ed tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:18.464395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-79c7b399-547f-43bd-a154-8442000568ed tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:18.480994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79c7b399-547f-43bd-a154-8442000568ed tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:18.481815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79c7b399-547f-43bd-a154-8442000568ed tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:18.482441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79c7b399-547f-43bd-a154-8442000568ed tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:18.483318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79c7b399-547f-43bd-a154-8442000568ed tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:18.484017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79c7b399-547f-43bd-a154-8442000568ed tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:18.484794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79c7b399-547f-43bd-a154-8442000568ed tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:18.712496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-79c7b399-547f-43bd-a154-8442000568ed tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:18.729123 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-79c7b399-547f-43bd-a154-8442000568ed tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1513 microversion: 2.1 time: 0.275970 Oct 24 10:39:18.731093 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1704/3321] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:18 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1513 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:18.767496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-94cd6ca3-6ca6-41f6-baed-e753ce51617a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:18.768307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-94cd6ca3-6ca6-41f6-baed-e753ce51617a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 2f024708-057e-4eda-9894-fb480a85c693] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:18.771488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2a7155eb-96ef-4063-99c1-23355b3ecaef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Doing local delete in cell 75e76125-592d-4292-bea1-3b51451d7165(cell1) {{(pid=120425) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 24 10:39:18.772806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a7155eb-96ef-4063-99c1-23355b3ecaef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:18.773990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a7155eb-96ef-4063-99c1-23355b3ecaef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:18.774390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a7155eb-96ef-4063-99c1-23355b3ecaef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:18.777409 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.compute.api [None req-2a7155eb-96ef-4063-99c1-23355b3ecaef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 24 10:39:18.778401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94cd6ca3-6ca6-41f6-baed-e753ce51617a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:18.779034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94cd6ca3-6ca6-41f6-baed-e753ce51617a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:18.779479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94cd6ca3-6ca6-41f6-baed-e753ce51617a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:18.780416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94cd6ca3-6ca6-41f6-baed-e753ce51617a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:18.781432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94cd6ca3-6ca6-41f6-baed-e753ce51617a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:18.782078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94cd6ca3-6ca6-41f6-baed-e753ce51617a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:18.803517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-2a7155eb-96ef-4063-99c1-23355b3ecaef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] deallocate_for_instance() {{(pid=120425) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 24 10:39:19.294388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94cd6ca3-6ca6-41f6-baed-e753ce51617a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:19.307933 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-94cd6ca3-6ca6-41f6-baed-e753ce51617a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693" status: 200 len: 1511 microversion: 2.1 time: 0.557802 Oct 24 10:39:19.308431 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1705/3322] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:18 2022] GET /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693 => generated 1511 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:19.323179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f6e6d07f-1d0f-4f24-8157-da33201b2e90 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:19.325319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f6e6d07f-1d0f-4f24-8157-da33201b2e90 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:19.341860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6e6d07f-1d0f-4f24-8157-da33201b2e90 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:19.345407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6e6d07f-1d0f-4f24-8157-da33201b2e90 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:19.346071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6e6d07f-1d0f-4f24-8157-da33201b2e90 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:19.348181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6e6d07f-1d0f-4f24-8157-da33201b2e90 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:19.349131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6e6d07f-1d0f-4f24-8157-da33201b2e90 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:19.352047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6e6d07f-1d0f-4f24-8157-da33201b2e90 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:19.556059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f6e6d07f-1d0f-4f24-8157-da33201b2e90 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:19.576760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f6e6d07f-1d0f-4f24-8157-da33201b2e90 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:19.581431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f6e6d07f-1d0f-4f24-8157-da33201b2e90 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:19.606182 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f6e6d07f-1d0f-4f24-8157-da33201b2e90 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.292212 Oct 24 10:39:19.607868 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1706/3323] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:19 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:19.618871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fcb77319-9a92-4ba4-b271-f542df01baa6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:19.622025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fcb77319-9a92-4ba4-b271-f542df01baa6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:19.641068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fcb77319-9a92-4ba4-b271-f542df01baa6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:19.644220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fcb77319-9a92-4ba4-b271-f542df01baa6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:19.645940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fcb77319-9a92-4ba4-b271-f542df01baa6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:19.649197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fcb77319-9a92-4ba4-b271-f542df01baa6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:19.651552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fcb77319-9a92-4ba4-b271-f542df01baa6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:19.653530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fcb77319-9a92-4ba4-b271-f542df01baa6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:19.947288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fcb77319-9a92-4ba4-b271-f542df01baa6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:19.967949 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fcb77319-9a92-4ba4-b271-f542df01baa6 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 200 len: 1510 microversion: 2.1 time: 0.358513 Oct 24 10:39:19.986977 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1707/3324] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:19 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 1510 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:19.997989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fe78cec4-7980-43da-9516-a308ea7f57af tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:19.998355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fe78cec4-7980-43da-9516-a308ea7f57af tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:20.014904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe78cec4-7980-43da-9516-a308ea7f57af tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:20.015404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe78cec4-7980-43da-9516-a308ea7f57af tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:20.023204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe78cec4-7980-43da-9516-a308ea7f57af tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:20.024573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe78cec4-7980-43da-9516-a308ea7f57af tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:20.026217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe78cec4-7980-43da-9516-a308ea7f57af tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:20.027000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe78cec4-7980-43da-9516-a308ea7f57af tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:20.079870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-2a7155eb-96ef-4063-99c1-23355b3ecaef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Updating instance_info_cache with network_info: [] {{(pid=120425) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 10:39:20.325231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fe78cec4-7980-43da-9516-a308ea7f57af tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:20.338060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fe78cec4-7980-43da-9516-a308ea7f57af tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:20.339709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fe78cec4-7980-43da-9516-a308ea7f57af tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:20.341339 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fe78cec4-7980-43da-9516-a308ea7f57af tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.353012 Oct 24 10:39:20.361796 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1708/3325] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:19 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:20.368402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-88edb323-48ae-45f9-a95a-6dfc2730b3c0 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:20.369172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-88edb323-48ae-45f9-a95a-6dfc2730b3c0 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:20.376291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88edb323-48ae-45f9-a95a-6dfc2730b3c0 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:20.377004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88edb323-48ae-45f9-a95a-6dfc2730b3c0 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:20.377586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88edb323-48ae-45f9-a95a-6dfc2730b3c0 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:20.378462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88edb323-48ae-45f9-a95a-6dfc2730b3c0 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:20.379026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88edb323-48ae-45f9-a95a-6dfc2730b3c0 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:20.379856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88edb323-48ae-45f9-a95a-6dfc2730b3c0 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:20.397709 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-88edb323-48ae-45f9-a95a-6dfc2730b3c0 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] HTTP exception thrown: Instance 105cd729-f8cb-45e7-bb34-030c45097242 could not be found. Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-88edb323-48ae-45f9-a95a-6dfc2730b3c0 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Request method failure captured: Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 HTTP/1.1 Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmrU0qOkxUYxPy1TFCBlk8lEUDstc_ijm7c5gtwX9g8vT6Fz_reafeRRu0EpE5OniPvhMFBGjQjJYBUXsxUYkPiR1ixj5KSaN0o-driXZFbdK1SxQdKkrFO8kfGl9k62ggVatqCXLHGNMIwiVsT5EZVcvm2J2xqV-qZ1S1vAInUUJC4 Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 19a51abc0b7c4b01ad379e50663a2000 Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersTestMultiNic-119742743 Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/19a51abc0b7c4b01ad379e50663a2000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/19a51abc0b7c4b01ad379e50663a2000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/19a51abc0b7c4b01ad379e50663a2000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_19a51abc0b7c4b01ad379e50663a2000", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersTestMultiNic-119742743 Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 19a51abc0b7c4b01ad379e50663a2000 Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersTestMultiNic-119742743 Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersTestMultiNic-119742743-project Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 83d2c201d9e348c8a2ff17525693a3ab Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersTestMultiNic-119742743-project Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 105cd729-f8cb-45e7-bb34-030c45097242 could not be found. Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '105cd729-f8cb-45e7-bb34-030c45097242'} Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 105cd729-f8cb-45e7-bb34-030c45097242 could not be found. Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:39:20.400569 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:39:20.405363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 105cd729-f8cb-45e7-bb34-030c45097242 could not be found. Oct 24 10:39:20.405363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.405363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:20.405363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.405363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:20.405363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:20.405363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:20.405363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:39:20.405363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:39:20.405363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 105cd729-f8cb-45e7-bb34-030c45097242 could not be found. Oct 24 10:39:20.405363 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.405363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-88edb323-48ae-45f9-a95a-6dfc2730b3c0 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Returning 404 to user: Instance 105cd729-f8cb-45e7-bb34-030c45097242 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:39:20.412952 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-88edb323-48ae-45f9-a95a-6dfc2730b3c0 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "DELETE /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 404 len: 111 microversion: 2.1 time: 0.042310 Oct 24 10:39:20.413831 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1709/3326] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:39:20 2022] DELETE /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:39:20.423316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e43518ff-280e-4c9b-929f-2e113e546cfa tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:20.431519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e43518ff-280e-4c9b-929f-2e113e546cfa tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:20.432766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e43518ff-280e-4c9b-929f-2e113e546cfa tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:39:20.438544 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2a7155eb-96ef-4063-99c1-23355b3ecaef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "DELETE /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 204 len: 0 microversion: 2.1 time: 2.520330 Oct 24 10:39:20.440173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e43518ff-280e-4c9b-929f-2e113e546cfa tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:20.443989 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1618/3327] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:39:17 2022] DELETE /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 0 bytes in 2524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:39:20.444756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e43518ff-280e-4c9b-929f-2e113e546cfa tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:20.446164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e43518ff-280e-4c9b-929f-2e113e546cfa tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:20.447351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e43518ff-280e-4c9b-929f-2e113e546cfa tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:20.447982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b4f3a727-30f3-4a4a-b20f-6bc57c81888b req-450d4aa3-af48-40d1-8ac5-c1a422b32983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d4c883-f34d-4326-8505-2d66bd047dc8", "name": "network-vif-deleted", "tag": "0c4d075a-267d-4bd1-8a69-d9825c34d8a2"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:20.448151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e43518ff-280e-4c9b-929f-2e113e546cfa tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:20.449379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e43518ff-280e-4c9b-929f-2e113e546cfa tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:20.464774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b4f3a727-30f3-4a4a-b20f-6bc57c81888b req-450d4aa3-af48-40d1-8ac5-c1a422b32983 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:20.465178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b4f3a727-30f3-4a4a-b20f-6bc57c81888b req-450d4aa3-af48-40d1-8ac5-c1a422b32983 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:20.465617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b4f3a727-30f3-4a4a-b20f-6bc57c81888b req-450d4aa3-af48-40d1-8ac5-c1a422b32983 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:20.481348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.compute.server_external_events [req-b4f3a727-30f3-4a4a-b20f-6bc57c81888b req-450d4aa3-af48-40d1-8ac5-c1a422b32983 service nova] Unable to find a host for instance 18d4c883-f34d-4326-8505-2d66bd047dc8. Dropping event network-vif-deleted {{(pid=120425) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 24 10:39:20.482252 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b4f3a727-30f3-4a4a-b20f-6bc57c81888b req-450d4aa3-af48-40d1-8ac5-c1a422b32983 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.039785 Oct 24 10:39:20.484793 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1619/3328] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 24 10:39:20.490133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5224f4d-9564-4071-aeac-40103930864d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:20.490692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d5224f4d-9564-4071-aeac-40103930864d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 105cd729-f8cb-45e7-bb34-030c45097242] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:20.494952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-e43518ff-280e-4c9b-929f-2e113e546cfa tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:39:20.497750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5224f4d-9564-4071-aeac-40103930864d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:20.498257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5224f4d-9564-4071-aeac-40103930864d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:20.498834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5224f4d-9564-4071-aeac-40103930864d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:20.499776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5224f4d-9564-4071-aeac-40103930864d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:20.500246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5224f4d-9564-4071-aeac-40103930864d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:20.500866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5224f4d-9564-4071-aeac-40103930864d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:20.520605 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-d5224f4d-9564-4071-aeac-40103930864d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] HTTP exception thrown: Instance 105cd729-f8cb-45e7-bb34-030c45097242 could not be found. Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5224f4d-9564-4071-aeac-40103930864d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Request method failure captured: Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 HTTP/1.1 Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmrU0qOkxUYxPy1TFCBlk8lEUDstc_ijm7c5gtwX9g8vT6Fz_reafeRRu0EpE5OniPvhMFBGjQjJYBUXsxUYkPiR1ixj5KSaN0o-driXZFbdK1SxQdKkrFO8kfGl9k62ggVatqCXLHGNMIwiVsT5EZVcvm2J2xqV-qZ1S1vAInUUJC4 Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 19a51abc0b7c4b01ad379e50663a2000 Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersTestMultiNic-119742743 Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/19a51abc0b7c4b01ad379e50663a2000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/19a51abc0b7c4b01ad379e50663a2000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/19a51abc0b7c4b01ad379e50663a2000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_19a51abc0b7c4b01ad379e50663a2000", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersTestMultiNic-119742743 Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 19a51abc0b7c4b01ad379e50663a2000 Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersTestMultiNic-119742743 Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersTestMultiNic-119742743-project Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 83d2c201d9e348c8a2ff17525693a3ab Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersTestMultiNic-119742743-project Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 105cd729-f8cb-45e7-bb34-030c45097242 could not be found. Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '105cd729-f8cb-45e7-bb34-030c45097242'} Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 105cd729-f8cb-45e7-bb34-030c45097242 could not be found. Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 105cd729-f8cb-45e7-bb34-030c45097242 could not be found. Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:20.522887 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.528900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:20.528900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:20.528900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:20.528900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:39:20.528900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:39:20.528900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 105cd729-f8cb-45e7-bb34-030c45097242 could not be found. Oct 24 10:39:20.528900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.528900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5224f4d-9564-4071-aeac-40103930864d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Returning 404 to user: Instance 105cd729-f8cb-45e7-bb34-030c45097242 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:39:20.528900 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d5224f4d-9564-4071-aeac-40103930864d tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242" status: 404 len: 111 microversion: 2.1 time: 0.039786 Oct 24 10:39:20.529481 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1620/3329] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:20 2022] GET /compute/v2.1/servers/105cd729-f8cb-45e7-bb34-030c45097242 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:39:20.541456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd0aa9d7-4e20-4d6a-a9f4-4409725d8eba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:20.542337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bd0aa9d7-4e20-4d6a-a9f4-4409725d8eba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:20.555764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd0aa9d7-4e20-4d6a-a9f4-4409725d8eba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:20.556271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd0aa9d7-4e20-4d6a-a9f4-4409725d8eba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:20.556861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd0aa9d7-4e20-4d6a-a9f4-4409725d8eba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:20.558283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd0aa9d7-4e20-4d6a-a9f4-4409725d8eba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:20.558805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd0aa9d7-4e20-4d6a-a9f4-4409725d8eba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:20.559286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd0aa9d7-4e20-4d6a-a9f4-4409725d8eba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:20.562566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e43518ff-280e-4c9b-929f-2e113e546cfa tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:20.571909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e43518ff-280e-4c9b-929f-2e113e546cfa tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:20.572665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e43518ff-280e-4c9b-929f-2e113e546cfa tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:20.573287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e43518ff-280e-4c9b-929f-2e113e546cfa tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:20.588732 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-bd0aa9d7-4e20-4d6a-a9f4-4409725d8eba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance 18d4c883-f34d-4326-8505-2d66bd047dc8 could not be found. Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd0aa9d7-4e20-4d6a-a9f4-4409725d8eba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 HTTP/1.1 Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 18d4c883-f34d-4326-8505-2d66bd047dc8 could not be found. Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '18d4c883-f34d-4326-8505-2d66bd047dc8'} Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d4c883-f34d-4326-8505-2d66bd047dc8 could not be found. Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d4c883-f34d-4326-8505-2d66bd047dc8 could not be found. Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:20.591627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.596456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:20.596456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:20.596456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:20.596456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:39:20.596456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:39:20.596456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d4c883-f34d-4326-8505-2d66bd047dc8 could not be found. Oct 24 10:39:20.596456 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.596456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd0aa9d7-4e20-4d6a-a9f4-4409725d8eba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance 18d4c883-f34d-4326-8505-2d66bd047dc8 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:39:20.596456 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bd0aa9d7-4e20-4d6a-a9f4-4409725d8eba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 404 len: 111 microversion: 2.1 time: 0.062727 Oct 24 10:39:20.610484 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1621/3330] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:20 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:39:20.620074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-424a0cbc-7a0b-42ea-a428-b96251b78f33 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-829952890", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:20.693900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-424a0cbc-7a0b-42ea-a428-b96251b78f33 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] validate_networks() for [('f49ca961-6c05-4d39-9f58-83a1313d4b7d', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:39:20.829524 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e43518ff-280e-4c9b-929f-2e113e546cfa tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.413927 Oct 24 10:39:20.830492 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1710/3331] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:39:20 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:20.836092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9853cfc9-a512-4624-ad28-10ddb6689830 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:20.837899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9853cfc9-a512-4624-ad28-10ddb6689830 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:20.854773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9853cfc9-a512-4624-ad28-10ddb6689830 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:20.855674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9853cfc9-a512-4624-ad28-10ddb6689830 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:20.856344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9853cfc9-a512-4624-ad28-10ddb6689830 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:20.857307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9853cfc9-a512-4624-ad28-10ddb6689830 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:20.857990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9853cfc9-a512-4624-ad28-10ddb6689830 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:20.858642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9853cfc9-a512-4624-ad28-10ddb6689830 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:20.888766 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-9853cfc9-a512-4624-ad28-10ddb6689830 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] HTTP exception thrown: Instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d could not be found. Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9853cfc9-a512-4624-ad28-10ddb6689830 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Request method failure captured: Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d HTTP/1.1 Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmrU0qOkxUYxPy1TFCBlk8lEUDstc_ijm7c5gtwX9g8vT6Fz_reafeRRu0EpE5OniPvhMFBGjQjJYBUXsxUYkPiR1ixj5KSaN0o-driXZFbdK1SxQdKkrFO8kfGl9k62ggVatqCXLHGNMIwiVsT5EZVcvm2J2xqV-qZ1S1vAInUUJC4 Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 19a51abc0b7c4b01ad379e50663a2000 Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersTestMultiNic-119742743 Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/19a51abc0b7c4b01ad379e50663a2000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/19a51abc0b7c4b01ad379e50663a2000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/19a51abc0b7c4b01ad379e50663a2000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_19a51abc0b7c4b01ad379e50663a2000", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersTestMultiNic-119742743 Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 19a51abc0b7c4b01ad379e50663a2000 Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersTestMultiNic-119742743 Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersTestMultiNic-119742743-project Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 83d2c201d9e348c8a2ff17525693a3ab Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersTestMultiNic-119742743-project Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d could not be found. Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '78eb5c2b-4d4b-43b1-86bd-4fe986f4461d'} Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d could not be found. Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:39:20.890713 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:39:20.896089 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d could not be found. Oct 24 10:39:20.896089 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.896089 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:20.896089 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.896089 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:20.896089 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:20.896089 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:20.896089 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:39:20.896089 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:39:20.896089 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d could not be found. Oct 24 10:39:20.896089 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:20.900390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9853cfc9-a512-4624-ad28-10ddb6689830 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Returning 404 to user: Instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:39:20.901902 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9853cfc9-a512-4624-ad28-10ddb6689830 tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "DELETE /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 404 len: 111 microversion: 2.1 time: 0.070238 Oct 24 10:39:20.902672 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1711/3332] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:39:20 2022] DELETE /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:39:20.913109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3b57268-c648-4ecc-9389-92a1026573e8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:20.914265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f3b57268-c648-4ecc-9389-92a1026573e8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:20.922062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3b57268-c648-4ecc-9389-92a1026573e8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:20.922839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3b57268-c648-4ecc-9389-92a1026573e8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:20.923476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3b57268-c648-4ecc-9389-92a1026573e8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:20.924483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3b57268-c648-4ecc-9389-92a1026573e8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:20.925170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3b57268-c648-4ecc-9389-92a1026573e8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:20.925788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3b57268-c648-4ecc-9389-92a1026573e8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:21.040243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3b57268-c648-4ecc-9389-92a1026573e8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:21.057002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3b57268-c648-4ecc-9389-92a1026573e8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:21.059296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3b57268-c648-4ecc-9389-92a1026573e8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:21.073534 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f3b57268-c648-4ecc-9389-92a1026573e8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.166906 Oct 24 10:39:21.074919 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1712/3333] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:20 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:21.080508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9b38c7f8-56db-43be-aab7-e668773a3739 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-181693809", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "7e246fd4-526c-4b90-abc8-eb217581a916"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:21.157171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-9b38c7f8-56db-43be-aab7-e668773a3739 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] validate_networks() for [('7e246fd4-526c-4b90-abc8-eb217581a916', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:39:21.515687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-424a0cbc-7a0b-42ea-a428-b96251b78f33 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:39:21.516198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-424a0cbc-7a0b-42ea-a428-b96251b78f33 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:39:21.516580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-424a0cbc-7a0b-42ea-a428-b96251b78f33 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:39:21.517029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-424a0cbc-7a0b-42ea-a428-b96251b78f33 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:39:21.517508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-424a0cbc-7a0b-42ea-a428-b96251b78f33 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:39:21.532527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-424a0cbc-7a0b-42ea-a428-b96251b78f33 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:21.533050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-424a0cbc-7a0b-42ea-a428-b96251b78f33 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:21.534664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-424a0cbc-7a0b-42ea-a428-b96251b78f33 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:21.537093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-424a0cbc-7a0b-42ea-a428-b96251b78f33 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:21.537621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-424a0cbc-7a0b-42ea-a428-b96251b78f33 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:21.538496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-424a0cbc-7a0b-42ea-a428-b96251b78f33 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:21.600115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-424a0cbc-7a0b-42ea-a428-b96251b78f33 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Getting quotas for project 5edfb6d8f84547399863eec5c89e6933. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:39:21.611686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-424a0cbc-7a0b-42ea-a428-b96251b78f33 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Getting quotas for user 1f089833f359473ebfa681931e8ffc06 and project 5edfb6d8f84547399863eec5c89e6933. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:39:21.644266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-424a0cbc-7a0b-42ea-a428-b96251b78f33 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:39:21.656893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-424a0cbc-7a0b-42ea-a428-b96251b78f33 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:39:21.744524 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-424a0cbc-7a0b-42ea-a428-b96251b78f33 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.132472 Oct 24 10:39:21.745953 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1622/3334] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:39:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:39:21.752209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5c4d5474-c194-49bc-b39c-22d22a1b415b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:21.760155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5c4d5474-c194-49bc-b39c-22d22a1b415b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:21.760992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c4d5474-c194-49bc-b39c-22d22a1b415b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:39:21.973598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c4d5474-c194-49bc-b39c-22d22a1b415b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:21.974117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c4d5474-c194-49bc-b39c-22d22a1b415b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:21.974847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c4d5474-c194-49bc-b39c-22d22a1b415b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:21.975620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c4d5474-c194-49bc-b39c-22d22a1b415b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:21.976089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c4d5474-c194-49bc-b39c-22d22a1b415b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:21.977372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c4d5474-c194-49bc-b39c-22d22a1b415b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:21.986646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-9b38c7f8-56db-43be-aab7-e668773a3739 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:39:21.987156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-9b38c7f8-56db-43be-aab7-e668773a3739 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:39:21.987538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-9b38c7f8-56db-43be-aab7-e668773a3739 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:39:21.987942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-9b38c7f8-56db-43be-aab7-e668773a3739 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:39:21.988664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-9b38c7f8-56db-43be-aab7-e668773a3739 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:39:22.006525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b38c7f8-56db-43be-aab7-e668773a3739 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:22.007246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b38c7f8-56db-43be-aab7-e668773a3739 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:22.008640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b38c7f8-56db-43be-aab7-e668773a3739 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:22.009407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b38c7f8-56db-43be-aab7-e668773a3739 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:22.013640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b38c7f8-56db-43be-aab7-e668773a3739 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:22.014224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b38c7f8-56db-43be-aab7-e668773a3739 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:22.046265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-9b38c7f8-56db-43be-aab7-e668773a3739 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Getting quotas for project eb78fe6939ec43d99fe6b1ba24a68287. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:39:22.054793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-9b38c7f8-56db-43be-aab7-e668773a3739 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Getting quotas for user 2a7e183a1d4240f28566a318b7e70dee and project eb78fe6939ec43d99fe6b1ba24a68287. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:39:22.076101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9b38c7f8-56db-43be-aab7-e668773a3739 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:39:22.078990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9b38c7f8-56db-43be-aab7-e668773a3739 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:39:22.105603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.multi_cell_list [None req-5c4d5474-c194-49bc-b39c-22d22a1b415b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120425) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:39:22.182097 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5c4d5474-c194-49bc-b39c-22d22a1b415b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.434817 Oct 24 10:39:22.183340 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1623/3335] 10.222.0.50 () {58 vars in 1150 bytes} [Mon Oct 24 10:39:21 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:22.188172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e838036a-238c-4708-a4c4-a8e9b434e3ac tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:22.188987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e838036a-238c-4708-a4c4-a8e9b434e3ac tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] [instance: 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:22.196980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e838036a-238c-4708-a4c4-a8e9b434e3ac tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:22.197884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e838036a-238c-4708-a4c4-a8e9b434e3ac tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:22.199006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e838036a-238c-4708-a4c4-a8e9b434e3ac tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:22.199947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e838036a-238c-4708-a4c4-a8e9b434e3ac tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:22.200579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e838036a-238c-4708-a4c4-a8e9b434e3ac tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:22.201206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e838036a-238c-4708-a4c4-a8e9b434e3ac tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:22.206187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:22.221264 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-e838036a-238c-4708-a4c4-a8e9b434e3ac tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] HTTP exception thrown: Instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d could not be found. Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e838036a-238c-4708-a4c4-a8e9b434e3ac tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Request method failure captured: Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d HTTP/1.1 Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmrU0qOkxUYxPy1TFCBlk8lEUDstc_ijm7c5gtwX9g8vT6Fz_reafeRRu0EpE5OniPvhMFBGjQjJYBUXsxUYkPiR1ixj5KSaN0o-driXZFbdK1SxQdKkrFO8kfGl9k62ggVatqCXLHGNMIwiVsT5EZVcvm2J2xqV-qZ1S1vAInUUJC4 Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 19a51abc0b7c4b01ad379e50663a2000 Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersTestMultiNic-119742743 Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/19a51abc0b7c4b01ad379e50663a2000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/19a51abc0b7c4b01ad379e50663a2000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/19a51abc0b7c4b01ad379e50663a2000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_19a51abc0b7c4b01ad379e50663a2000", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersTestMultiNic-119742743 Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 19a51abc0b7c4b01ad379e50663a2000 Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersTestMultiNic-119742743 Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersTestMultiNic-119742743-project Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 83d2c201d9e348c8a2ff17525693a3ab Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersTestMultiNic-119742743-project Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d could not be found. Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '78eb5c2b-4d4b-43b1-86bd-4fe986f4461d'} Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d could not be found. Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d could not be found. Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:22.223825 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:22.228802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:22.228802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:22.228802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:22.228802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:39:22.228802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:39:22.228802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d could not be found. Oct 24 10:39:22.228802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:22.228802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e838036a-238c-4708-a4c4-a8e9b434e3ac tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] Returning 404 to user: Instance 78eb5c2b-4d4b-43b1-86bd-4fe986f4461d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:39:22.228802 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e838036a-238c-4708-a4c4-a8e9b434e3ac tempest-ServersTestMultiNic-119742743 tempest-ServersTestMultiNic-119742743-project] 10.222.0.50 "GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d" status: 404 len: 111 microversion: 2.1 time: 0.041190 Oct 24 10:39:22.231408 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9b38c7f8-56db-43be-aab7-e668773a3739 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.154634 Oct 24 10:39:22.231713 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1713/3336] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:39:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:39:22.236986 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1624/3337] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:22 2022] GET /compute/v2.1/servers/78eb5c2b-4d4b-43b1-86bd-4fe986f4461d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:39:22.245562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-81173d50-801f-4659-bef9-ad781af4fe61 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:22.248349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-81173d50-801f-4659-bef9-ad781af4fe61 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:22.248485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b6695768-67bd-4411-8ba9-0e070676d52a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:22.249084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b6695768-67bd-4411-8ba9-0e070676d52a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:22.269897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6695768-67bd-4411-8ba9-0e070676d52a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:22.270364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6695768-67bd-4411-8ba9-0e070676d52a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:22.271030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6695768-67bd-4411-8ba9-0e070676d52a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:22.271996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6695768-67bd-4411-8ba9-0e070676d52a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:22.272620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6695768-67bd-4411-8ba9-0e070676d52a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:22.273816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6695768-67bd-4411-8ba9-0e070676d52a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:22.644411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-81173d50-801f-4659-bef9-ad781af4fe61 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:22.653159 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-81173d50-801f-4659-bef9-ad781af4fe61 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1224 microversion: 2.1 time: 0.411558 Oct 24 10:39:22.657194 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1625/3338] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:22 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1224 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:22.662419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1354f954-16ac-4cb9-a825-660fd9031fdc tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:22.667550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1354f954-16ac-4cb9-a825-660fd9031fdc tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:22.684616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1354f954-16ac-4cb9-a825-660fd9031fdc tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:22.685148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1354f954-16ac-4cb9-a825-660fd9031fdc tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:22.686086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1354f954-16ac-4cb9-a825-660fd9031fdc tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:22.686782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1354f954-16ac-4cb9-a825-660fd9031fdc tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:22.691749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1354f954-16ac-4cb9-a825-660fd9031fdc tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:22.694414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1354f954-16ac-4cb9-a825-660fd9031fdc tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:22.987347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1354f954-16ac-4cb9-a825-660fd9031fdc tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:22.998360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1354f954-16ac-4cb9-a825-660fd9031fdc tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:23.002363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1354f954-16ac-4cb9-a825-660fd9031fdc tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:23.020400 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1354f954-16ac-4cb9-a825-660fd9031fdc tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.361846 Oct 24 10:39:23.032263 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1626/3339] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:22 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:23.037766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d64c1c03-e03f-4f92-ae47-ceefcc8b8303 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:23.044361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d64c1c03-e03f-4f92-ae47-ceefcc8b8303 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:23.049732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d64c1c03-e03f-4f92-ae47-ceefcc8b8303 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:39:23.065519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d64c1c03-e03f-4f92-ae47-ceefcc8b8303 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:23.066125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d64c1c03-e03f-4f92-ae47-ceefcc8b8303 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:23.069362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d64c1c03-e03f-4f92-ae47-ceefcc8b8303 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:23.070584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d64c1c03-e03f-4f92-ae47-ceefcc8b8303 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:23.071392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d64c1c03-e03f-4f92-ae47-ceefcc8b8303 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:23.073036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d64c1c03-e03f-4f92-ae47-ceefcc8b8303 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:23.102417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b6695768-67bd-4411-8ba9-0e070676d52a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:23.131639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b6695768-67bd-4411-8ba9-0e070676d52a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:23.134091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b6695768-67bd-4411-8ba9-0e070676d52a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:23.136118 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b6695768-67bd-4411-8ba9-0e070676d52a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.903273 Oct 24 10:39:23.136919 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1714/3340] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:22 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:23.144073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e1db72c2-9950-41a6-9491-b9e71758e19f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:23.145524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e1db72c2-9950-41a6-9491-b9e71758e19f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:23.156203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1db72c2-9950-41a6-9491-b9e71758e19f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:23.157092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1db72c2-9950-41a6-9491-b9e71758e19f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:23.157826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1db72c2-9950-41a6-9491-b9e71758e19f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:23.158769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1db72c2-9950-41a6-9491-b9e71758e19f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:23.159422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1db72c2-9950-41a6-9491-b9e71758e19f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:23.160308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1db72c2-9950-41a6-9491-b9e71758e19f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:23.323984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.multi_cell_list [None req-d64c1c03-e03f-4f92-ae47-ceefcc8b8303 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120425) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:39:23.505317 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d64c1c03-e03f-4f92-ae47-ceefcc8b8303 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.471191 Oct 24 10:39:23.508599 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1627/3341] 10.222.0.50 () {58 vars in 1212 bytes} [Mon Oct 24 10:39:23 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:23.524863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-01ebf723-5a86-4691-89fe-92663765f706 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:23.530947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-01ebf723-5a86-4691-89fe-92663765f706 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:23.532138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-01ebf723-5a86-4691-89fe-92663765f706 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:39:23.539293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01ebf723-5a86-4691-89fe-92663765f706 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:23.540694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01ebf723-5a86-4691-89fe-92663765f706 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:23.542033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01ebf723-5a86-4691-89fe-92663765f706 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:23.544770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01ebf723-5a86-4691-89fe-92663765f706 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:23.545578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01ebf723-5a86-4691-89fe-92663765f706 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:23.546895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01ebf723-5a86-4691-89fe-92663765f706 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:23.664465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.multi_cell_list [None req-01ebf723-5a86-4691-89fe-92663765f706 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120425) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:39:23.728814 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-01ebf723-5a86-4691-89fe-92663765f706 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.209232 Oct 24 10:39:23.737323 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1628/3342] 10.222.0.50 () {58 vars in 1196 bytes} [Mon Oct 24 10:39:23 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:23.744589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-beeda979-3882-497e-a9a2-c22ff3bf5cdf tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:23.745493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-beeda979-3882-497e-a9a2-c22ff3bf5cdf tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:23.751720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beeda979-3882-497e-a9a2-c22ff3bf5cdf tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:23.752440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beeda979-3882-497e-a9a2-c22ff3bf5cdf tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:23.753102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beeda979-3882-497e-a9a2-c22ff3bf5cdf tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:23.753983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beeda979-3882-497e-a9a2-c22ff3bf5cdf tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:23.754863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beeda979-3882-497e-a9a2-c22ff3bf5cdf tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:23.755456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beeda979-3882-497e-a9a2-c22ff3bf5cdf tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:23.850728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e1db72c2-9950-41a6-9491-b9e71758e19f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:23.869760 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e1db72c2-9950-41a6-9491-b9e71758e19f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1218 microversion: 2.1 time: 0.731399 Oct 24 10:39:23.871742 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1715/3343] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:23 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1218 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:23.877026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f9c7778d-d398-4aad-9a06-66994f1caf72 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:23.893711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f9c7778d-d398-4aad-9a06-66994f1caf72 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:23.896352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f9c7778d-d398-4aad-9a06-66994f1caf72 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'name': '1059140205', 'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:39:23.902483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9c7778d-d398-4aad-9a06-66994f1caf72 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:23.902965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9c7778d-d398-4aad-9a06-66994f1caf72 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:23.903399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9c7778d-d398-4aad-9a06-66994f1caf72 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:23.904218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9c7778d-d398-4aad-9a06-66994f1caf72 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:23.904667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9c7778d-d398-4aad-9a06-66994f1caf72 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:23.905154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9c7778d-d398-4aad-9a06-66994f1caf72 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:23.964255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-beeda979-3882-497e-a9a2-c22ff3bf5cdf tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:23.979973 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-beeda979-3882-497e-a9a2-c22ff3bf5cdf tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1276 microversion: 2.1 time: 0.239666 Oct 24 10:39:23.982000 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1629/3344] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:23 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1276 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:24.056388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b42424b1-7446-4903-92fa-a13ac20ea8ca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:24.057463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b42424b1-7446-4903-92fa-a13ac20ea8ca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:24.087766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b42424b1-7446-4903-92fa-a13ac20ea8ca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:24.090487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b42424b1-7446-4903-92fa-a13ac20ea8ca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:24.093416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b42424b1-7446-4903-92fa-a13ac20ea8ca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:24.094890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b42424b1-7446-4903-92fa-a13ac20ea8ca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:24.097782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b42424b1-7446-4903-92fa-a13ac20ea8ca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:24.102549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b42424b1-7446-4903-92fa-a13ac20ea8ca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:24.134259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-f9c7778d-d398-4aad-9a06-66994f1caf72 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:39:24.279424 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f9c7778d-d398-4aad-9a06-66994f1caf72 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers?name=1059140205" status: 200 len: 346 microversion: 2.1 time: 0.406039 Oct 24 10:39:24.284450 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1716/3345] 10.222.0.50 () {58 vars in 1156 bytes} [Mon Oct 24 10:39:23 2022] GET /compute/v2.1/servers?name=1059140205 => generated 346 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:24.290445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-836f03bd-e713-499e-b01b-ce31077f87a8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:24.291213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-836f03bd-e713-499e-b01b-ce31077f87a8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:24.297951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-836f03bd-e713-499e-b01b-ce31077f87a8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:24.298824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-836f03bd-e713-499e-b01b-ce31077f87a8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:24.299367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-836f03bd-e713-499e-b01b-ce31077f87a8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:24.300198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-836f03bd-e713-499e-b01b-ce31077f87a8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:24.300785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-836f03bd-e713-499e-b01b-ce31077f87a8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:24.301344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-836f03bd-e713-499e-b01b-ce31077f87a8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:24.312588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b42424b1-7446-4903-92fa-a13ac20ea8ca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:24.322534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b42424b1-7446-4903-92fa-a13ac20ea8ca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:24.324028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b42424b1-7446-4903-92fa-a13ac20ea8ca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:24.359532 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b42424b1-7446-4903-92fa-a13ac20ea8ca tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.310185 Oct 24 10:39:24.378818 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1630/3346] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:24 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:24.389563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-83ae03dd-5d19-4b84-b4f6-776685a8f83f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:24.407142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-83ae03dd-5d19-4b84-b4f6-776685a8f83f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:24.408086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-83ae03dd-5d19-4b84-b4f6-776685a8f83f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:39:24.422724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83ae03dd-5d19-4b84-b4f6-776685a8f83f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:24.423217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83ae03dd-5d19-4b84-b4f6-776685a8f83f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:24.423662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83ae03dd-5d19-4b84-b4f6-776685a8f83f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:24.424601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83ae03dd-5d19-4b84-b4f6-776685a8f83f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:24.425302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83ae03dd-5d19-4b84-b4f6-776685a8f83f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:24.428345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83ae03dd-5d19-4b84-b4f6-776685a8f83f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:24.638810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.multi_cell_list [None req-83ae03dd-5d19-4b84-b4f6-776685a8f83f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120425) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:39:24.764796 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-83ae03dd-5d19-4b84-b4f6-776685a8f83f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.383792 Oct 24 10:39:24.779059 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1631/3347] 10.222.0.50 () {58 vars in 1154 bytes} [Mon Oct 24 10:39:24 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:24.785371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-22ccb688-fb51-4ad3-85b8-2a78b458501b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:24.792430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-22ccb688-fb51-4ad3-85b8-2a78b458501b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:24.793327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-22ccb688-fb51-4ad3-85b8-2a78b458501b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-105914020', 'deleted': False, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:39:24.799742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22ccb688-fb51-4ad3-85b8-2a78b458501b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:24.800462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22ccb688-fb51-4ad3-85b8-2a78b458501b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:24.801069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22ccb688-fb51-4ad3-85b8-2a78b458501b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:24.803906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22ccb688-fb51-4ad3-85b8-2a78b458501b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:24.807482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22ccb688-fb51-4ad3-85b8-2a78b458501b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:24.808148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22ccb688-fb51-4ad3-85b8-2a78b458501b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:24.943268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.multi_cell_list [None req-22ccb688-fb51-4ad3-85b8-2a78b458501b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120425) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:39:25.020668 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-22ccb688-fb51-4ad3-85b8-2a78b458501b tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-105914020" status: 200 len: 346 microversion: 2.1 time: 0.239203 Oct 24 10:39:25.022435 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1632/3348] 10.222.0.50 () {58 vars in 1228 bytes} [Mon Oct 24 10:39:24 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-105914020 => generated 346 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:25.029519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-098577bf-9314-4469-a73d-c64bc434ef01 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:25.029519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-098577bf-9314-4469-a73d-c64bc434ef01 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:25.041820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-098577bf-9314-4469-a73d-c64bc434ef01 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:25.043070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-098577bf-9314-4469-a73d-c64bc434ef01 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:25.043629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-098577bf-9314-4469-a73d-c64bc434ef01 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:25.044460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-098577bf-9314-4469-a73d-c64bc434ef01 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:25.045070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-098577bf-9314-4469-a73d-c64bc434ef01 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:25.045595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-098577bf-9314-4469-a73d-c64bc434ef01 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:25.052332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-836f03bd-e713-499e-b01b-ce31077f87a8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:25.065749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-836f03bd-e713-499e-b01b-ce31077f87a8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:25.067712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-836f03bd-e713-499e-b01b-ce31077f87a8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:25.069170 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-836f03bd-e713-499e-b01b-ce31077f87a8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.783477 Oct 24 10:39:25.071005 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1717/3349] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:24 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:25.080816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-93d2c844-a76e-4337-bb8c-98053ca3001f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:25.081830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-93d2c844-a76e-4337-bb8c-98053ca3001f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:25.091353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93d2c844-a76e-4337-bb8c-98053ca3001f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:25.092513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93d2c844-a76e-4337-bb8c-98053ca3001f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:25.094100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93d2c844-a76e-4337-bb8c-98053ca3001f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:25.095080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93d2c844-a76e-4337-bb8c-98053ca3001f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:25.095784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93d2c844-a76e-4337-bb8c-98053ca3001f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:25.096455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93d2c844-a76e-4337-bb8c-98053ca3001f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:25.378224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-098577bf-9314-4469-a73d-c64bc434ef01 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:25.396195 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-098577bf-9314-4469-a73d-c64bc434ef01 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1274 microversion: 2.1 time: 0.371912 Oct 24 10:39:25.397117 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1633/3350] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:25 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1274 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:25.403033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-79bfa96b-b059-4779-9c07-a3fc794f814a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:25.403525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-79bfa96b-b059-4779-9c07-a3fc794f814a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:25.414926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79bfa96b-b059-4779-9c07-a3fc794f814a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:25.415739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79bfa96b-b059-4779-9c07-a3fc794f814a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:25.416404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79bfa96b-b059-4779-9c07-a3fc794f814a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:25.417312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79bfa96b-b059-4779-9c07-a3fc794f814a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:25.417923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79bfa96b-b059-4779-9c07-a3fc794f814a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:25.418531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79bfa96b-b059-4779-9c07-a3fc794f814a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:25.427716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-93d2c844-a76e-4337-bb8c-98053ca3001f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:25.438772 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-93d2c844-a76e-4337-bb8c-98053ca3001f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1282 microversion: 2.1 time: 0.366318 Oct 24 10:39:25.440259 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1718/3351] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:25 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1282 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:25.451248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-79bfa96b-b059-4779-9c07-a3fc794f814a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:39:25.451407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ae443b2d-3ca1-40b1-ad02-673870f7768e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:25.451979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ae443b2d-3ca1-40b1-ad02-673870f7768e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:25.473751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae443b2d-3ca1-40b1-ad02-673870f7768e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:25.474546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae443b2d-3ca1-40b1-ad02-673870f7768e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:25.475170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae443b2d-3ca1-40b1-ad02-673870f7768e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:25.476247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae443b2d-3ca1-40b1-ad02-673870f7768e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:25.477688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae443b2d-3ca1-40b1-ad02-673870f7768e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:25.480985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae443b2d-3ca1-40b1-ad02-673870f7768e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:25.564172 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-79bfa96b-b059-4779-9c07-a3fc794f814a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 204 len: 0 microversion: 2.1 time: 0.165086 Oct 24 10:39:25.565296 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1634/3352] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:39:25 2022] DELETE /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:39:25.576431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2e43fe96-9bf3-41fb-8cd1-03ecd008bdf5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:25.577412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2e43fe96-9bf3-41fb-8cd1-03ecd008bdf5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:25.586177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e43fe96-9bf3-41fb-8cd1-03ecd008bdf5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:25.587005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e43fe96-9bf3-41fb-8cd1-03ecd008bdf5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:25.587985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e43fe96-9bf3-41fb-8cd1-03ecd008bdf5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:25.589278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e43fe96-9bf3-41fb-8cd1-03ecd008bdf5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:25.589916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e43fe96-9bf3-41fb-8cd1-03ecd008bdf5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:25.590832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e43fe96-9bf3-41fb-8cd1-03ecd008bdf5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:25.779491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ae443b2d-3ca1-40b1-ad02-673870f7768e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:25.791329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:25.803606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ae443b2d-3ca1-40b1-ad02-673870f7768e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:25.807580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ae443b2d-3ca1-40b1-ad02-673870f7768e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:25.820802 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ae443b2d-3ca1-40b1-ad02-673870f7768e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.379453 Oct 24 10:39:25.833894 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1719/3353] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:25 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:25.897524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2e43fe96-9bf3-41fb-8cd1-03ecd008bdf5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:25.910054 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2e43fe96-9bf3-41fb-8cd1-03ecd008bdf5 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 200 len: 1516 microversion: 2.1 time: 0.338158 Oct 24 10:39:25.912172 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1635/3354] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:25 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 1516 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:26.101429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b9351b6d-9051-4776-a103-29a605aa3077 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:26.102351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b9351b6d-9051-4776-a103-29a605aa3077 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:26.110230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b9351b6d-9051-4776-a103-29a605aa3077 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:26.111004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b9351b6d-9051-4776-a103-29a605aa3077 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:26.111644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b9351b6d-9051-4776-a103-29a605aa3077 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:26.112557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b9351b6d-9051-4776-a103-29a605aa3077 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:26.113259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b9351b6d-9051-4776-a103-29a605aa3077 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:26.113865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b9351b6d-9051-4776-a103-29a605aa3077 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:26.420897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2e7b19e8-ee6c-4908-a45f-355aee241e6d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:26.422199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2e7b19e8-ee6c-4908-a45f-355aee241e6d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:26.431081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e7b19e8-ee6c-4908-a45f-355aee241e6d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:26.432210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e7b19e8-ee6c-4908-a45f-355aee241e6d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:26.432946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e7b19e8-ee6c-4908-a45f-355aee241e6d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:26.435806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e7b19e8-ee6c-4908-a45f-355aee241e6d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:26.436511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e7b19e8-ee6c-4908-a45f-355aee241e6d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:26.437091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e7b19e8-ee6c-4908-a45f-355aee241e6d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:26.586464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b9351b6d-9051-4776-a103-29a605aa3077 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:26.596961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2e7b19e8-ee6c-4908-a45f-355aee241e6d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:26.613454 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2e7b19e8-ee6c-4908-a45f-355aee241e6d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1272 microversion: 2.1 time: 0.196719 Oct 24 10:39:26.618513 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1636/3355] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:26 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1272 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:26.628204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b9351b6d-9051-4776-a103-29a605aa3077 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:26.631884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b9351b6d-9051-4776-a103-29a605aa3077 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:26.637765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-78ebf712-b902-40ca-af40-04e3735561dc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:26.640405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-78ebf712-b902-40ca-af40-04e3735561dc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:26.641164 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b9351b6d-9051-4776-a103-29a605aa3077 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.542896 Oct 24 10:39:26.642016 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1720/3356] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:26 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:26.649871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78ebf712-b902-40ca-af40-04e3735561dc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:26.650767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78ebf712-b902-40ca-af40-04e3735561dc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:26.651283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78ebf712-b902-40ca-af40-04e3735561dc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:26.652060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78ebf712-b902-40ca-af40-04e3735561dc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:26.652590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78ebf712-b902-40ca-af40-04e3735561dc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:26.653176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78ebf712-b902-40ca-af40-04e3735561dc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:26.852110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c8d13d80-0551-4ce6-b4ec-202d6b6c48f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:26.852972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c8d13d80-0551-4ce6-b4ec-202d6b6c48f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:26.867572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8d13d80-0551-4ce6-b4ec-202d6b6c48f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:26.868278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8d13d80-0551-4ce6-b4ec-202d6b6c48f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:26.873154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8d13d80-0551-4ce6-b4ec-202d6b6c48f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:26.875131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8d13d80-0551-4ce6-b4ec-202d6b6c48f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:26.876513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8d13d80-0551-4ce6-b4ec-202d6b6c48f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:26.876996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8d13d80-0551-4ce6-b4ec-202d6b6c48f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:27.471245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c8d13d80-0551-4ce6-b4ec-202d6b6c48f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:27.484952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-78ebf712-b902-40ca-af40-04e3735561dc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:27.498749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c8d13d80-0551-4ce6-b4ec-202d6b6c48f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:27.499351 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-78ebf712-b902-40ca-af40-04e3735561dc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1324 microversion: 2.1 time: 0.875989 Oct 24 10:39:27.499977 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1637/3357] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:26 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1324 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:27.506654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c8d13d80-0551-4ce6-b4ec-202d6b6c48f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:27.516784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9889c12-1451-4129-ac2a-b654367d66b1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:27.517431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f9889c12-1451-4129-ac2a-b654367d66b1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:27.518246 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c8d13d80-0551-4ce6-b4ec-202d6b6c48f1 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.672333 Oct 24 10:39:27.539555 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1721/3358] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:26 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:27.545578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9889c12-1451-4129-ac2a-b654367d66b1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:27.548413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9889c12-1451-4129-ac2a-b654367d66b1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:27.550915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9889c12-1451-4129-ac2a-b654367d66b1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:27.555130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9889c12-1451-4129-ac2a-b654367d66b1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:27.556146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9889c12-1451-4129-ac2a-b654367d66b1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:27.558299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9889c12-1451-4129-ac2a-b654367d66b1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:27.651208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6c355879-ff2f-4452-bf8f-90622c8b4916 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:27.652564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6c355879-ff2f-4452-bf8f-90622c8b4916 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:27.658267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:27.665142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c355879-ff2f-4452-bf8f-90622c8b4916 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:27.665981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c355879-ff2f-4452-bf8f-90622c8b4916 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:27.666855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c355879-ff2f-4452-bf8f-90622c8b4916 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:27.670019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c355879-ff2f-4452-bf8f-90622c8b4916 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:27.671691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c355879-ff2f-4452-bf8f-90622c8b4916 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:27.672259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c355879-ff2f-4452-bf8f-90622c8b4916 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:28.045845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6c355879-ff2f-4452-bf8f-90622c8b4916 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:28.075655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f9889c12-1451-4129-ac2a-b654367d66b1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:28.086293 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6c355879-ff2f-4452-bf8f-90622c8b4916 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1272 microversion: 2.1 time: 0.443091 Oct 24 10:39:28.087543 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f9889c12-1451-4129-ac2a-b654367d66b1 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 200 len: 1516 microversion: 2.1 time: 0.583955 Oct 24 10:39:28.091857 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1638/3359] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:27 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 1516 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:28.098145 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1722/3360] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:27 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1272 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:39:28.142503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-9e1e7316-d3ca-46e8-8b93-541d8fc2ca53 req-27882e84-3e6e-4ac8-828d-9da84dcb9abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1095b21-85ef-46b9-b67c-fcfc5c4f38c1", "name": "network-vif-deleted", "tag": "044f4eed-9250-4d71-b78a-ec50886a1625"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:28.150112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-30770b37-65dc-4050-8953-e3d119cc2361 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:28.152944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-30770b37-65dc-4050-8953-e3d119cc2361 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:28.157474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9e1e7316-d3ca-46e8-8b93-541d8fc2ca53 req-27882e84-3e6e-4ac8-828d-9da84dcb9abd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:28.157974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9e1e7316-d3ca-46e8-8b93-541d8fc2ca53 req-27882e84-3e6e-4ac8-828d-9da84dcb9abd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:28.160623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9e1e7316-d3ca-46e8-8b93-541d8fc2ca53 req-27882e84-3e6e-4ac8-828d-9da84dcb9abd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:28.165635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30770b37-65dc-4050-8953-e3d119cc2361 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:28.166204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30770b37-65dc-4050-8953-e3d119cc2361 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:28.166654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30770b37-65dc-4050-8953-e3d119cc2361 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:28.167380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30770b37-65dc-4050-8953-e3d119cc2361 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:28.167841 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30770b37-65dc-4050-8953-e3d119cc2361 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:28.168277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30770b37-65dc-4050-8953-e3d119cc2361 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:28.172822 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-9e1e7316-d3ca-46e8-8b93-541d8fc2ca53 req-27882e84-3e6e-4ac8-828d-9da84dcb9abd service nova] Creating event network-vif-deleted:044f4eed-9250-4d71-b78a-ec50886a1625 for instance d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 on n-h1-858383-15 Oct 24 10:39:28.181742 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-9e1e7316-d3ca-46e8-8b93-541d8fc2ca53 req-27882e84-3e6e-4ac8-828d-9da84dcb9abd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044595 Oct 24 10:39:28.189147 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1723/3361] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:39:28.220241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:28.528269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-808641c5-d639-46fe-a592-bd9306f31003 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:28.529025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-808641c5-d639-46fe-a592-bd9306f31003 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:28.552052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-808641c5-d639-46fe-a592-bd9306f31003 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:28.555925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-808641c5-d639-46fe-a592-bd9306f31003 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:28.561441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-808641c5-d639-46fe-a592-bd9306f31003 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:28.562849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-808641c5-d639-46fe-a592-bd9306f31003 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:28.565832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-808641c5-d639-46fe-a592-bd9306f31003 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:28.567932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-808641c5-d639-46fe-a592-bd9306f31003 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:28.761938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-30770b37-65dc-4050-8953-e3d119cc2361 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:28.800854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-30770b37-65dc-4050-8953-e3d119cc2361 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:28.805654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-30770b37-65dc-4050-8953-e3d119cc2361 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:28.806680 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-30770b37-65dc-4050-8953-e3d119cc2361 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.713802 Oct 24 10:39:28.807257 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1639/3362] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:28 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:28.834798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4476dee1-d119-4d92-8cd1-df3fbda36e46 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:28.838847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4476dee1-d119-4d92-8cd1-df3fbda36e46 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:28.848626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4476dee1-d119-4d92-8cd1-df3fbda36e46 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:28.856187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4476dee1-d119-4d92-8cd1-df3fbda36e46 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:28.856814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4476dee1-d119-4d92-8cd1-df3fbda36e46 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:28.857837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4476dee1-d119-4d92-8cd1-df3fbda36e46 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:28.858546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4476dee1-d119-4d92-8cd1-df3fbda36e46 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:28.859214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4476dee1-d119-4d92-8cd1-df3fbda36e46 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:29.166218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4476dee1-d119-4d92-8cd1-df3fbda36e46 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:29.185666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4476dee1-d119-4d92-8cd1-df3fbda36e46 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:29.188285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4476dee1-d119-4d92-8cd1-df3fbda36e46 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:29.194406 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4476dee1-d119-4d92-8cd1-df3fbda36e46 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.371419 Oct 24 10:39:29.210442 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1640/3363] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:28 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:29.224762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33fbbb02-a381-4e70-9f5f-b0933e419243 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:29.225730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-33fbbb02-a381-4e70-9f5f-b0933e419243 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: d1095b21-85ef-46b9-b67c-fcfc5c4f38c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:29.238498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33fbbb02-a381-4e70-9f5f-b0933e419243 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:29.240276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33fbbb02-a381-4e70-9f5f-b0933e419243 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:29.242529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33fbbb02-a381-4e70-9f5f-b0933e419243 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:29.245335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33fbbb02-a381-4e70-9f5f-b0933e419243 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:29.247555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33fbbb02-a381-4e70-9f5f-b0933e419243 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:29.248348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33fbbb02-a381-4e70-9f5f-b0933e419243 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:29.286243 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-33fbbb02-a381-4e70-9f5f-b0933e419243 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] HTTP exception thrown: Instance d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 could not be found. Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33fbbb02-a381-4e70-9f5f-b0933e419243 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Request method failure captured: Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 HTTP/1.1 Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmsPiBOsklhFVGZSWGiPK17yrCSH_2l4prkPuAzlfu1fF5i2q59oxKCLqek5-AMtqoL5OAq_NX2ur96taO9B7TYRnx8i-loPjQfAzK9r5bp4PtTlyCNhYyQTjAFBaizHONnQIkybQGzbdWp1A-1dluds8f7OHGR8v8ESV0F-kr0TERI Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: d34be11df0f94fabb99d567ed559cfa7 Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ListServerFiltersTestJSON-416462304 Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d34be11df0f94fabb99d567ed559cfa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d34be11df0f94fabb99d567ed559cfa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d34be11df0f94fabb99d567ed559cfa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d34be11df0f94fabb99d567ed559cfa7", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ListServerFiltersTestJSON-416462304 Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: d34be11df0f94fabb99d567ed559cfa7 Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-416462304 Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ListServerFiltersTestJSON-416462304-project Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a88eecfbcd0f4acf8edffbb8fb604f42 Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ListServerFiltersTestJSON-416462304-project Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 could not be found. Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'd1095b21-85ef-46b9-b67c-fcfc5c4f38c1'} Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 could not be found. Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 could not be found. Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:29.291750 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:29.295903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:29.295903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:29.295903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:29.295903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:39:29.295903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:39:29.295903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 could not be found. Oct 24 10:39:29.295903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:29.298614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33fbbb02-a381-4e70-9f5f-b0933e419243 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Returning 404 to user: Instance d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:39:29.299575 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-33fbbb02-a381-4e70-9f5f-b0933e419243 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1" status: 404 len: 111 microversion: 2.1 time: 0.087463 Oct 24 10:39:29.303850 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1641/3364] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:29 2022] GET /compute/v2.1/servers/d1095b21-85ef-46b9-b67c-fcfc5c4f38c1 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:39:29.310408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10a70a67-b523-42b4-b331-e7edc5ab4674 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:29.311362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-10a70a67-b523-42b4-b331-e7edc5ab4674 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:29.318568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a70a67-b523-42b4-b331-e7edc5ab4674 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:29.321051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a70a67-b523-42b4-b331-e7edc5ab4674 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:29.326090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a70a67-b523-42b4-b331-e7edc5ab4674 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:29.329237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a70a67-b523-42b4-b331-e7edc5ab4674 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:29.329957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a70a67-b523-42b4-b331-e7edc5ab4674 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:29.330919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a70a67-b523-42b4-b331-e7edc5ab4674 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:29.640416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-808641c5-d639-46fe-a592-bd9306f31003 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:29.649776 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-808641c5-d639-46fe-a592-bd9306f31003 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1324 microversion: 2.1 time: 1.126895 Oct 24 10:39:29.661439 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1724/3365] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:28 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1324 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:39:29.672206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-df982e43-08fc-4cbd-b55c-e38a89b1e46a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:29.673071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-df982e43-08fc-4cbd-b55c-e38a89b1e46a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 2f024708-057e-4eda-9894-fb480a85c693] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:29.682178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df982e43-08fc-4cbd-b55c-e38a89b1e46a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:29.682961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df982e43-08fc-4cbd-b55c-e38a89b1e46a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:29.683648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df982e43-08fc-4cbd-b55c-e38a89b1e46a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:29.684591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df982e43-08fc-4cbd-b55c-e38a89b1e46a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:29.685291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df982e43-08fc-4cbd-b55c-e38a89b1e46a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:29.685929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df982e43-08fc-4cbd-b55c-e38a89b1e46a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:29.715621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-df982e43-08fc-4cbd-b55c-e38a89b1e46a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 2f024708-057e-4eda-9894-fb480a85c693] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:39:29.870876 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-df982e43-08fc-4cbd-b55c-e38a89b1e46a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693" status: 204 len: 0 microversion: 2.1 time: 0.207557 Oct 24 10:39:29.871467 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1725/3366] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:39:29 2022] DELETE /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:39:29.881202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-61b140eb-eaf1-4836-9837-193bf064ff96 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:29.882049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-61b140eb-eaf1-4836-9837-193bf064ff96 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:29.894061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61b140eb-eaf1-4836-9837-193bf064ff96 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:29.895311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61b140eb-eaf1-4836-9837-193bf064ff96 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:29.896559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61b140eb-eaf1-4836-9837-193bf064ff96 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:29.897550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61b140eb-eaf1-4836-9837-193bf064ff96 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:29.898829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61b140eb-eaf1-4836-9837-193bf064ff96 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:29.899504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61b140eb-eaf1-4836-9837-193bf064ff96 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:30.095332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-10a70a67-b523-42b4-b331-e7edc5ab4674 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:30.111944 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10a70a67-b523-42b4-b331-e7edc5ab4674 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1314 microversion: 2.1 time: 0.805381 Oct 24 10:39:30.127907 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1642/3367] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:29 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1314 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:30.127907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cd37f524-fc88-44cd-8f1d-366a7b2c73cd tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:30.127907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cd37f524-fc88-44cd-8f1d-366a7b2c73cd tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 2f024708-057e-4eda-9894-fb480a85c693] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:30.127907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd37f524-fc88-44cd-8f1d-366a7b2c73cd tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:30.127907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd37f524-fc88-44cd-8f1d-366a7b2c73cd tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:30.127907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd37f524-fc88-44cd-8f1d-366a7b2c73cd tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:30.129988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd37f524-fc88-44cd-8f1d-366a7b2c73cd tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:30.130544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd37f524-fc88-44cd-8f1d-366a7b2c73cd tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:30.131074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd37f524-fc88-44cd-8f1d-366a7b2c73cd tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:30.604014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-61b140eb-eaf1-4836-9837-193bf064ff96 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:30.635304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-61b140eb-eaf1-4836-9837-193bf064ff96 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:30.639855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-61b140eb-eaf1-4836-9837-193bf064ff96 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:30.641412 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-61b140eb-eaf1-4836-9837-193bf064ff96 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.768856 Oct 24 10:39:30.645183 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1726/3368] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:29 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:30.654572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-8a7b5db7-9338-49aa-8262-ef6822c82b74 req-2efd457f-4daa-4adc-b4af-575bbfd9f7fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27efcba4-7aac-4be7-890d-dc0baeff7a5d", "tag": "860912bd-1ba7-4863-b73c-e6b2649b53b8"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:30.684594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8a7b5db7-9338-49aa-8262-ef6822c82b74 req-2efd457f-4daa-4adc-b4af-575bbfd9f7fb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:30.685116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8a7b5db7-9338-49aa-8262-ef6822c82b74 req-2efd457f-4daa-4adc-b4af-575bbfd9f7fb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:30.685559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8a7b5db7-9338-49aa-8262-ef6822c82b74 req-2efd457f-4daa-4adc-b4af-575bbfd9f7fb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:30.716762 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-8a7b5db7-9338-49aa-8262-ef6822c82b74 req-2efd457f-4daa-4adc-b4af-575bbfd9f7fb service nova] Creating event network-changed:860912bd-1ba7-4863-b73c-e6b2649b53b8 for instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d on n-h1-858383-15 Oct 24 10:39:30.729142 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-8a7b5db7-9338-49aa-8262-ef6822c82b74 req-2efd457f-4daa-4adc-b4af-575bbfd9f7fb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080809 Oct 24 10:39:30.730048 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1727/3369] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:30.744512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-70291b18-128b-4f39-af39-b12c7a2e5f5b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:30.746702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-70291b18-128b-4f39-af39-b12c7a2e5f5b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:30.753618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70291b18-128b-4f39-af39-b12c7a2e5f5b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:30.754580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70291b18-128b-4f39-af39-b12c7a2e5f5b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:30.755196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70291b18-128b-4f39-af39-b12c7a2e5f5b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:30.756108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70291b18-128b-4f39-af39-b12c7a2e5f5b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:30.756731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70291b18-128b-4f39-af39-b12c7a2e5f5b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:30.758093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70291b18-128b-4f39-af39-b12c7a2e5f5b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:30.906591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-70291b18-128b-4f39-af39-b12c7a2e5f5b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:30.915857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-70291b18-128b-4f39-af39-b12c7a2e5f5b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:30.930793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-70291b18-128b-4f39-af39-b12c7a2e5f5b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:30.936523 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-70291b18-128b-4f39-af39-b12c7a2e5f5b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.200740 Oct 24 10:39:30.937547 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1728/3370] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:30 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:30.942270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dda44f97-5492-4c8a-8814-1ef9b0acd33d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:30.942858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dda44f97-5492-4c8a-8814-1ef9b0acd33d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:30.962977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dda44f97-5492-4c8a-8814-1ef9b0acd33d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:30.966522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dda44f97-5492-4c8a-8814-1ef9b0acd33d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:30.967218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dda44f97-5492-4c8a-8814-1ef9b0acd33d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:30.970056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dda44f97-5492-4c8a-8814-1ef9b0acd33d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:30.973451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dda44f97-5492-4c8a-8814-1ef9b0acd33d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:30.973913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dda44f97-5492-4c8a-8814-1ef9b0acd33d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:31.044084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cd37f524-fc88-44cd-8f1d-366a7b2c73cd tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:31.076502 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cd37f524-fc88-44cd-8f1d-366a7b2c73cd tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693" status: 200 len: 1517 microversion: 2.1 time: 0.962319 Oct 24 10:39:31.079906 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1643/3371] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:30 2022] GET /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693 => generated 1517 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:31.143403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e891551c-6af9-471b-8b4e-673da43de212 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:31.145176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e891551c-6af9-471b-8b4e-673da43de212 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:31.160344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e891551c-6af9-471b-8b4e-673da43de212 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:31.164424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e891551c-6af9-471b-8b4e-673da43de212 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:31.165360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e891551c-6af9-471b-8b4e-673da43de212 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:31.166422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e891551c-6af9-471b-8b4e-673da43de212 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:31.167257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e891551c-6af9-471b-8b4e-673da43de212 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:31.168485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e891551c-6af9-471b-8b4e-673da43de212 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:31.407016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dda44f97-5492-4c8a-8814-1ef9b0acd33d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:31.421050 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dda44f97-5492-4c8a-8814-1ef9b0acd33d tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1324 microversion: 2.1 time: 0.482300 Oct 24 10:39:31.427581 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1729/3372] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:30 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1324 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:31.570895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e891551c-6af9-471b-8b4e-673da43de212 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:31.579220 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e891551c-6af9-471b-8b4e-673da43de212 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1314 microversion: 2.1 time: 0.445800 Oct 24 10:39:31.584273 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1644/3373] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:31 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:31.672049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-96713db2-4949-4b57-ae2b-eafa3fa702fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:31.672597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-96713db2-4949-4b57-ae2b-eafa3fa702fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:31.680713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96713db2-4949-4b57-ae2b-eafa3fa702fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:31.681236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96713db2-4949-4b57-ae2b-eafa3fa702fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:31.682560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96713db2-4949-4b57-ae2b-eafa3fa702fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:31.683865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96713db2-4949-4b57-ae2b-eafa3fa702fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:31.684557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96713db2-4949-4b57-ae2b-eafa3fa702fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:31.685239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96713db2-4949-4b57-ae2b-eafa3fa702fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:31.967836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3d6dba88-b99c-452b-8601-ad6d953383e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:31.968621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3d6dba88-b99c-452b-8601-ad6d953383e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:31.991432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d6dba88-b99c-452b-8601-ad6d953383e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:31.992489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d6dba88-b99c-452b-8601-ad6d953383e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:31.992986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d6dba88-b99c-452b-8601-ad6d953383e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:31.993733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d6dba88-b99c-452b-8601-ad6d953383e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:31.994198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d6dba88-b99c-452b-8601-ad6d953383e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:31.994633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d6dba88-b99c-452b-8601-ad6d953383e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:32.066489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=12 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:32.442855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3d6dba88-b99c-452b-8601-ad6d953383e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:32.459577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3d6dba88-b99c-452b-8601-ad6d953383e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:32.469353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3d6dba88-b99c-452b-8601-ad6d953383e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:32.493840 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3d6dba88-b99c-452b-8601-ad6d953383e6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.529955 Oct 24 10:39:32.512675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-96713db2-4949-4b57-ae2b-eafa3fa702fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:32.523265 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1645/3374] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:31 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:39:32.526818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-96713db2-4949-4b57-ae2b-eafa3fa702fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:32.533093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-96713db2-4949-4b57-ae2b-eafa3fa702fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:32.534702 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-96713db2-4949-4b57-ae2b-eafa3fa702fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.866917 Oct 24 10:39:32.537467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b21f0890-93ce-4752-9394-27f4412da4f8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:32.537767 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1730/3375] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:31 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:32.544002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7aa8315e-bc72-4986-9b00-fad0182a75d6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:32.549895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7aa8315e-bc72-4986-9b00-fad0182a75d6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:32.551825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b21f0890-93ce-4752-9394-27f4412da4f8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 2f024708-057e-4eda-9894-fb480a85c693] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:32.565392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7aa8315e-bc72-4986-9b00-fad0182a75d6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:32.566483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7aa8315e-bc72-4986-9b00-fad0182a75d6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:32.567172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7aa8315e-bc72-4986-9b00-fad0182a75d6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:32.568271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7aa8315e-bc72-4986-9b00-fad0182a75d6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:32.569020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7aa8315e-bc72-4986-9b00-fad0182a75d6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:32.572061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7aa8315e-bc72-4986-9b00-fad0182a75d6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:32.573683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b21f0890-93ce-4752-9394-27f4412da4f8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:32.575101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b21f0890-93ce-4752-9394-27f4412da4f8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:32.583190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b21f0890-93ce-4752-9394-27f4412da4f8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:32.584369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b21f0890-93ce-4752-9394-27f4412da4f8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:32.585066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b21f0890-93ce-4752-9394-27f4412da4f8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:32.586177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b21f0890-93ce-4752-9394-27f4412da4f8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:32.668081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:33.030745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7aa8315e-bc72-4986-9b00-fad0182a75d6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:33.046971 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7aa8315e-bc72-4986-9b00-fad0182a75d6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1324 microversion: 2.1 time: 0.507248 Oct 24 10:39:33.047586 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1731/3376] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:32 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1324 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:33.064911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3a641ed8-476b-4cea-8cbb-a46a797e388f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:33.067073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3a641ed8-476b-4cea-8cbb-a46a797e388f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:33.075288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a641ed8-476b-4cea-8cbb-a46a797e388f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:33.075610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a641ed8-476b-4cea-8cbb-a46a797e388f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:33.076287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a641ed8-476b-4cea-8cbb-a46a797e388f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:33.077062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a641ed8-476b-4cea-8cbb-a46a797e388f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:33.077532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a641ed8-476b-4cea-8cbb-a46a797e388f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:33.077963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a641ed8-476b-4cea-8cbb-a46a797e388f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:33.309691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b21f0890-93ce-4752-9394-27f4412da4f8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:33.318947 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b21f0890-93ce-4752-9394-27f4412da4f8 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693" status: 200 len: 1517 microversion: 2.1 time: 0.793372 Oct 24 10:39:33.325333 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1646/3377] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:32 2022] GET /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693 => generated 1517 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:33.331402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-fe3c726e-61dd-4704-8ff2-1803102fc881 req-ae133dc2-ddff-49ee-8fa0-21e655720295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f9e553-a2d6-4c33-8f37-2cd23977137a", "tag": "7f7f6e60-119a-48e8-b07a-627be75820a9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:33.377881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fe3c726e-61dd-4704-8ff2-1803102fc881 req-ae133dc2-ddff-49ee-8fa0-21e655720295 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:33.378310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fe3c726e-61dd-4704-8ff2-1803102fc881 req-ae133dc2-ddff-49ee-8fa0-21e655720295 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:33.385543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fe3c726e-61dd-4704-8ff2-1803102fc881 req-ae133dc2-ddff-49ee-8fa0-21e655720295 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:33.411741 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-fe3c726e-61dd-4704-8ff2-1803102fc881 req-ae133dc2-ddff-49ee-8fa0-21e655720295 service nova] Creating event network-changed:7f7f6e60-119a-48e8-b07a-627be75820a9 for instance 81f9e553-a2d6-4c33-8f37-2cd23977137a on n-h1-858383-15 Oct 24 10:39:33.428699 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-fe3c726e-61dd-4704-8ff2-1803102fc881 req-ae133dc2-ddff-49ee-8fa0-21e655720295 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101832 Oct 24 10:39:33.429918 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1647/3378] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:33.527313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2b0bef6a-ff54-4881-869d-76484ac6e614 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:33.528015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2b0bef6a-ff54-4881-869d-76484ac6e614 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:33.537572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b0bef6a-ff54-4881-869d-76484ac6e614 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:33.538076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b0bef6a-ff54-4881-869d-76484ac6e614 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:33.538589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b0bef6a-ff54-4881-869d-76484ac6e614 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:33.539308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b0bef6a-ff54-4881-869d-76484ac6e614 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:33.539764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b0bef6a-ff54-4881-869d-76484ac6e614 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:33.540188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b0bef6a-ff54-4881-869d-76484ac6e614 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:33.548881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3a641ed8-476b-4cea-8cbb-a46a797e388f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:33.567599 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3a641ed8-476b-4cea-8cbb-a46a797e388f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1314 microversion: 2.1 time: 0.511758 Oct 24 10:39:33.588198 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1732/3379] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:33 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:33.594458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-efb32d91-96d7-4c8d-aa21-3d66e6c36d6f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:33.595087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-efb32d91-96d7-4c8d-aa21-3d66e6c36d6f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:33.603244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-efb32d91-96d7-4c8d-aa21-3d66e6c36d6f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:33.603749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-efb32d91-96d7-4c8d-aa21-3d66e6c36d6f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:33.604196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-efb32d91-96d7-4c8d-aa21-3d66e6c36d6f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:33.604937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-efb32d91-96d7-4c8d-aa21-3d66e6c36d6f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:33.605399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-efb32d91-96d7-4c8d-aa21-3d66e6c36d6f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:33.605831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-efb32d91-96d7-4c8d-aa21-3d66e6c36d6f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:33.796430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2b0bef6a-ff54-4881-869d-76484ac6e614 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:33.808014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2b0bef6a-ff54-4881-869d-76484ac6e614 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:33.810249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2b0bef6a-ff54-4881-869d-76484ac6e614 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:33.829060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:33.836475 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2b0bef6a-ff54-4881-869d-76484ac6e614 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.309415 Oct 24 10:39:33.837176 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1648/3380] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:33 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:39:33.969677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=10 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:34.074611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dcb3926a-a2e7-409c-9fc8-7cea6770a485 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:34.075628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dcb3926a-a2e7-409c-9fc8-7cea6770a485 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:34.091618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcb3926a-a2e7-409c-9fc8-7cea6770a485 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:34.104699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcb3926a-a2e7-409c-9fc8-7cea6770a485 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:34.108388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcb3926a-a2e7-409c-9fc8-7cea6770a485 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:34.109412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcb3926a-a2e7-409c-9fc8-7cea6770a485 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:34.110395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcb3926a-a2e7-409c-9fc8-7cea6770a485 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:34.111254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcb3926a-a2e7-409c-9fc8-7cea6770a485 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:34.330636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-efb32d91-96d7-4c8d-aa21-3d66e6c36d6f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:34.345106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-efb32d91-96d7-4c8d-aa21-3d66e6c36d6f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:34.355172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-efb32d91-96d7-4c8d-aa21-3d66e6c36d6f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:34.358895 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-efb32d91-96d7-4c8d-aa21-3d66e6c36d6f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.769536 Oct 24 10:39:34.377698 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1733/3381] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:33 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:34.391306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-458fe589-6bdb-4c42-ac79-9477990fbb6e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:34.394304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-458fe589-6bdb-4c42-ac79-9477990fbb6e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 2f024708-057e-4eda-9894-fb480a85c693] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:34.407803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-458fe589-6bdb-4c42-ac79-9477990fbb6e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:34.408297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-458fe589-6bdb-4c42-ac79-9477990fbb6e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:34.408739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-458fe589-6bdb-4c42-ac79-9477990fbb6e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:34.414402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-458fe589-6bdb-4c42-ac79-9477990fbb6e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:34.415278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-458fe589-6bdb-4c42-ac79-9477990fbb6e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:34.417936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-458fe589-6bdb-4c42-ac79-9477990fbb6e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:34.498943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dcb3926a-a2e7-409c-9fc8-7cea6770a485 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:34.515453 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dcb3926a-a2e7-409c-9fc8-7cea6770a485 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1324 microversion: 2.1 time: 0.446976 Oct 24 10:39:34.517540 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1649/3382] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:34 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1324 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:34.597631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-69c923fb-1cc0-4ccb-8552-b03b960969f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:34.598919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-69c923fb-1cc0-4ccb-8552-b03b960969f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:34.619377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69c923fb-1cc0-4ccb-8552-b03b960969f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:34.620369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69c923fb-1cc0-4ccb-8552-b03b960969f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:34.621662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69c923fb-1cc0-4ccb-8552-b03b960969f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:34.624939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69c923fb-1cc0-4ccb-8552-b03b960969f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:34.625915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69c923fb-1cc0-4ccb-8552-b03b960969f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:34.628707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69c923fb-1cc0-4ccb-8552-b03b960969f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:34.872228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:34.877059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-458fe589-6bdb-4c42-ac79-9477990fbb6e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:34.888656 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-458fe589-6bdb-4c42-ac79-9477990fbb6e tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693" status: 200 len: 1517 microversion: 2.1 time: 0.509368 Oct 24 10:39:34.893393 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1734/3383] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:34 2022] GET /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693 => generated 1517 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:34.901449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b3e7c42d-706b-4b09-a36d-f09bd8cf0b69 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:34.904979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b3e7c42d-706b-4b09-a36d-f09bd8cf0b69 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:34.918626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3e7c42d-706b-4b09-a36d-f09bd8cf0b69 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:34.920594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3e7c42d-706b-4b09-a36d-f09bd8cf0b69 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:34.922453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3e7c42d-706b-4b09-a36d-f09bd8cf0b69 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:34.923414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3e7c42d-706b-4b09-a36d-f09bd8cf0b69 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:34.925127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3e7c42d-706b-4b09-a36d-f09bd8cf0b69 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:34.930990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3e7c42d-706b-4b09-a36d-f09bd8cf0b69 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:34.940253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-69c923fb-1cc0-4ccb-8552-b03b960969f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:34.956613 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-69c923fb-1cc0-4ccb-8552-b03b960969f3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1314 microversion: 2.1 time: 0.362821 Oct 24 10:39:34.957339 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1650/3384] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:34 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:34.999846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-381328df-bf4f-4f40-a064-081a87269004 req-c2a6d02c-e1ca-48fa-b343-05f342faf09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f024708-057e-4eda-9894-fb480a85c693", "name": "network-vif-deleted", "tag": "69109537-4e24-42aa-9a6d-200c27c96bbc"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:35.022657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-381328df-bf4f-4f40-a064-081a87269004 req-c2a6d02c-e1ca-48fa-b343-05f342faf09e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:35.024666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-381328df-bf4f-4f40-a064-081a87269004 req-c2a6d02c-e1ca-48fa-b343-05f342faf09e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:35.025425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-381328df-bf4f-4f40-a064-081a87269004 req-c2a6d02c-e1ca-48fa-b343-05f342faf09e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:35.048406 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-381328df-bf4f-4f40-a064-081a87269004 req-c2a6d02c-e1ca-48fa-b343-05f342faf09e service nova] Creating event network-vif-deleted:69109537-4e24-42aa-9a6d-200c27c96bbc for instance 2f024708-057e-4eda-9894-fb480a85c693 on n-h2-858383-15 Oct 24 10:39:35.055262 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-381328df-bf4f-4f40-a064-081a87269004 req-c2a6d02c-e1ca-48fa-b343-05f342faf09e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065028 Oct 24 10:39:35.056378 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1651/3385] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:35.137765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b3e7c42d-706b-4b09-a36d-f09bd8cf0b69 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:35.158931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b3e7c42d-706b-4b09-a36d-f09bd8cf0b69 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:35.160436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b3e7c42d-706b-4b09-a36d-f09bd8cf0b69 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:35.175940 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b3e7c42d-706b-4b09-a36d-f09bd8cf0b69 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.280933 Oct 24 10:39:35.209506 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1735/3386] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:34 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:35.393743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-16be958d-8375-49d6-9b7a-807325604f1b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:35.394553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-16be958d-8375-49d6-9b7a-807325604f1b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:35.411808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16be958d-8375-49d6-9b7a-807325604f1b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:35.412391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16be958d-8375-49d6-9b7a-807325604f1b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:35.412928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16be958d-8375-49d6-9b7a-807325604f1b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:35.413740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16be958d-8375-49d6-9b7a-807325604f1b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:35.414484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16be958d-8375-49d6-9b7a-807325604f1b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:35.414977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16be958d-8375-49d6-9b7a-807325604f1b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:35.544694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-50a0d79c-a3ce-448b-a600-360ed8f66331 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:35.545342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-50a0d79c-a3ce-448b-a600-360ed8f66331 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:35.560466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50a0d79c-a3ce-448b-a600-360ed8f66331 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:35.563627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50a0d79c-a3ce-448b-a600-360ed8f66331 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:35.564094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50a0d79c-a3ce-448b-a600-360ed8f66331 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:35.564815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50a0d79c-a3ce-448b-a600-360ed8f66331 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:35.565338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50a0d79c-a3ce-448b-a600-360ed8f66331 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:35.565776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50a0d79c-a3ce-448b-a600-360ed8f66331 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:35.625368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:35.915680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-16be958d-8375-49d6-9b7a-807325604f1b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:35.936912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-16be958d-8375-49d6-9b7a-807325604f1b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:35.938545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-16be958d-8375-49d6-9b7a-807325604f1b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:35.939878 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-16be958d-8375-49d6-9b7a-807325604f1b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.550991 Oct 24 10:39:35.940583 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1652/3387] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:35 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:35.946112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-92fe97dc-0919-49a9-a52a-8b4bcf56120c tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:35.957745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-92fe97dc-0919-49a9-a52a-8b4bcf56120c tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 2f024708-057e-4eda-9894-fb480a85c693] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:35.964419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92fe97dc-0919-49a9-a52a-8b4bcf56120c tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:35.965876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92fe97dc-0919-49a9-a52a-8b4bcf56120c tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:35.966546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92fe97dc-0919-49a9-a52a-8b4bcf56120c tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:35.967638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92fe97dc-0919-49a9-a52a-8b4bcf56120c tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:35.968152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92fe97dc-0919-49a9-a52a-8b4bcf56120c tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:35.968689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92fe97dc-0919-49a9-a52a-8b4bcf56120c tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:35.987288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-50a0d79c-a3ce-448b-a600-360ed8f66331 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:35.996574 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-50a0d79c-a3ce-448b-a600-360ed8f66331 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1324 microversion: 2.1 time: 0.456219 Oct 24 10:39:35.997912 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1736/3388] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:35 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1324 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:36.002861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2fd15d5b-1566-4ff2-b45d-9a4eef1272ef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:36.006894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2fd15d5b-1566-4ff2-b45d-9a4eef1272ef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:36.035631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fd15d5b-1566-4ff2-b45d-9a4eef1272ef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:36.037163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fd15d5b-1566-4ff2-b45d-9a4eef1272ef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:36.037163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fd15d5b-1566-4ff2-b45d-9a4eef1272ef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:36.040488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fd15d5b-1566-4ff2-b45d-9a4eef1272ef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:36.042034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fd15d5b-1566-4ff2-b45d-9a4eef1272ef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:36.042499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fd15d5b-1566-4ff2-b45d-9a4eef1272ef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:36.078032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92fe97dc-0919-49a9-a52a-8b4bcf56120c tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:36.081020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92fe97dc-0919-49a9-a52a-8b4bcf56120c tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:36.082737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92fe97dc-0919-49a9-a52a-8b4bcf56120c tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:36.084346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-92fe97dc-0919-49a9-a52a-8b4bcf56120c tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lazy-loading 'fault' on Instance uuid 2f024708-057e-4eda-9894-fb480a85c693 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:39:36.312064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-92fe97dc-0919-49a9-a52a-8b4bcf56120c tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:36.330515 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-92fe97dc-0919-49a9-a52a-8b4bcf56120c tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693" status: 200 len: 1310 microversion: 2.1 time: 0.388072 Oct 24 10:39:36.352988 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1653/3389] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:35 2022] GET /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693 => generated 1310 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:36.390231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6fe09d3a-51ab-4101-82a5-ed9d8e262ea6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:36.390873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6fe09d3a-51ab-4101-82a5-ed9d8e262ea6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:36.417218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fe09d3a-51ab-4101-82a5-ed9d8e262ea6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:36.417646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fe09d3a-51ab-4101-82a5-ed9d8e262ea6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:36.418099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fe09d3a-51ab-4101-82a5-ed9d8e262ea6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:36.418856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fe09d3a-51ab-4101-82a5-ed9d8e262ea6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:36.419334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fe09d3a-51ab-4101-82a5-ed9d8e262ea6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:36.419778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fe09d3a-51ab-4101-82a5-ed9d8e262ea6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:36.446664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2fd15d5b-1566-4ff2-b45d-9a4eef1272ef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:36.468270 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2fd15d5b-1566-4ff2-b45d-9a4eef1272ef tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1314 microversion: 2.1 time: 0.468019 Oct 24 10:39:36.494314 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1737/3390] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:35 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:36.607379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6fe09d3a-51ab-4101-82a5-ed9d8e262ea6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:36.617963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6fe09d3a-51ab-4101-82a5-ed9d8e262ea6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:36.619916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6fe09d3a-51ab-4101-82a5-ed9d8e262ea6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:36.627007 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6fe09d3a-51ab-4101-82a5-ed9d8e262ea6 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.269314 Oct 24 10:39:36.628176 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1654/3391] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:36 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:36.970183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6e9c5ba6-2537-44c8-9270-c89ee66707fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:36.970973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6e9c5ba6-2537-44c8-9270-c89ee66707fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:36.989177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e9c5ba6-2537-44c8-9270-c89ee66707fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:36.990088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e9c5ba6-2537-44c8-9270-c89ee66707fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:36.991321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e9c5ba6-2537-44c8-9270-c89ee66707fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:37.006303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e9c5ba6-2537-44c8-9270-c89ee66707fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:37.009411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e9c5ba6-2537-44c8-9270-c89ee66707fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:37.015055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e9c5ba6-2537-44c8-9270-c89ee66707fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:37.025161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c89afeda-4c02-494d-8c0b-2bc08f56cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:37.025932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c89afeda-4c02-494d-8c0b-2bc08f56cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:37.034549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c89afeda-4c02-494d-8c0b-2bc08f56cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:37.038063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c89afeda-4c02-494d-8c0b-2bc08f56cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:37.038868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c89afeda-4c02-494d-8c0b-2bc08f56cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:37.040894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c89afeda-4c02-494d-8c0b-2bc08f56cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:37.042276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c89afeda-4c02-494d-8c0b-2bc08f56cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:37.043539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c89afeda-4c02-494d-8c0b-2bc08f56cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:37.536914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c89afeda-4c02-494d-8c0b-2bc08f56cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:37.579510 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c89afeda-4c02-494d-8c0b-2bc08f56cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1324 microversion: 2.1 time: 0.559598 Oct 24 10:39:37.581583 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1655/3392] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:37 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1324 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:37.588517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-52b84885-9839-4b84-8b2b-525a2a82ba9a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:37.589459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-52b84885-9839-4b84-8b2b-525a2a82ba9a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 2f024708-057e-4eda-9894-fb480a85c693] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:37.597070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52b84885-9839-4b84-8b2b-525a2a82ba9a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:37.597571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52b84885-9839-4b84-8b2b-525a2a82ba9a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:37.598286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52b84885-9839-4b84-8b2b-525a2a82ba9a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:37.599163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52b84885-9839-4b84-8b2b-525a2a82ba9a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:37.621259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52b84885-9839-4b84-8b2b-525a2a82ba9a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:37.626110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52b84885-9839-4b84-8b2b-525a2a82ba9a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:37.664944 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-52b84885-9839-4b84-8b2b-525a2a82ba9a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] HTTP exception thrown: Instance 2f024708-057e-4eda-9894-fb480a85c693 could not be found. Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-52b84885-9839-4b84-8b2b-525a2a82ba9a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Request method failure captured: Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693 HTTP/1.1 Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmsPiBOsklhFVGZSWGiPK17yrCSH_2l4prkPuAzlfu1fF5i2q59oxKCLqek5-AMtqoL5OAq_NX2ur96taO9B7TYRnx8i-loPjQfAzK9r5bp4PtTlyCNhYyQTjAFBaizHONnQIkybQGzbdWp1A-1dluds8f7OHGR8v8ESV0F-kr0TERI Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: d34be11df0f94fabb99d567ed559cfa7 Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ListServerFiltersTestJSON-416462304 Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d34be11df0f94fabb99d567ed559cfa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d34be11df0f94fabb99d567ed559cfa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d34be11df0f94fabb99d567ed559cfa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d34be11df0f94fabb99d567ed559cfa7", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ListServerFiltersTestJSON-416462304 Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: d34be11df0f94fabb99d567ed559cfa7 Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-416462304 Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ListServerFiltersTestJSON-416462304-project Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a88eecfbcd0f4acf8edffbb8fb604f42 Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ListServerFiltersTestJSON-416462304-project Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 2f024708-057e-4eda-9894-fb480a85c693 could not be found. Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '2f024708-057e-4eda-9894-fb480a85c693'} Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f024708-057e-4eda-9894-fb480a85c693 could not be found. Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f024708-057e-4eda-9894-fb480a85c693 could not be found. Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:37.666941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:37.672034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:37.672034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:37.672034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:37.672034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:39:37.672034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:39:37.672034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f024708-057e-4eda-9894-fb480a85c693 could not be found. Oct 24 10:39:37.672034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:39:37.673672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-52b84885-9839-4b84-8b2b-525a2a82ba9a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Returning 404 to user: Instance 2f024708-057e-4eda-9894-fb480a85c693 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:39:37.674908 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-52b84885-9839-4b84-8b2b-525a2a82ba9a tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693" status: 404 len: 111 microversion: 2.1 time: 0.091978 Oct 24 10:39:37.679816 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1656/3393] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:37 2022] GET /compute/v2.1/servers/2f024708-057e-4eda-9894-fb480a85c693 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:39:37.686183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8d8b2d22-5226-475a-b315-7be3d537dc13 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:37.687204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8d8b2d22-5226-475a-b315-7be3d537dc13 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:37.694432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d8b2d22-5226-475a-b315-7be3d537dc13 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:37.695366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d8b2d22-5226-475a-b315-7be3d537dc13 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:37.696144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d8b2d22-5226-475a-b315-7be3d537dc13 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:37.697267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d8b2d22-5226-475a-b315-7be3d537dc13 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:37.697923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d8b2d22-5226-475a-b315-7be3d537dc13 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:37.698557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d8b2d22-5226-475a-b315-7be3d537dc13 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:37.827668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e9c5ba6-2537-44c8-9270-c89ee66707fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:37.843180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e9c5ba6-2537-44c8-9270-c89ee66707fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:37.852743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e9c5ba6-2537-44c8-9270-c89ee66707fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:37.854466 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6e9c5ba6-2537-44c8-9270-c89ee66707fe tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.889538 Oct 24 10:39:37.865358 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1738/3394] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:36 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:37.872037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e3821279-28c1-4c32-b910-bfa15fc088d3 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:37.873706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e3821279-28c1-4c32-b910-bfa15fc088d3 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:37.880932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3821279-28c1-4c32-b910-bfa15fc088d3 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:37.881803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3821279-28c1-4c32-b910-bfa15fc088d3 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:37.883268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3821279-28c1-4c32-b910-bfa15fc088d3 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:37.884280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3821279-28c1-4c32-b910-bfa15fc088d3 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:37.884958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3821279-28c1-4c32-b910-bfa15fc088d3 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:37.885766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3821279-28c1-4c32-b910-bfa15fc088d3 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:38.071414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e3821279-28c1-4c32-b910-bfa15fc088d3 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:38.084040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e3821279-28c1-4c32-b910-bfa15fc088d3 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:38.086778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e3821279-28c1-4c32-b910-bfa15fc088d3 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:38.095714 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e3821279-28c1-4c32-b910-bfa15fc088d3 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1553 microversion: 2.91 time: 0.228742 Oct 24 10:39:38.097627 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1739/3395] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:37 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1553 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:38.110089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2f8c312e-6676-40f2-8db9-2770cc6534d0 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:38.111926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2f8c312e-6676-40f2-8db9-2770cc6534d0 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:38.121525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f8c312e-6676-40f2-8db9-2770cc6534d0 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:38.122277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f8c312e-6676-40f2-8db9-2770cc6534d0 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:38.122931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f8c312e-6676-40f2-8db9-2770cc6534d0 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:38.123843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f8c312e-6676-40f2-8db9-2770cc6534d0 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:38.124473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f8c312e-6676-40f2-8db9-2770cc6534d0 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:38.125100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f8c312e-6676-40f2-8db9-2770cc6534d0 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:38.138889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8d8b2d22-5226-475a-b315-7be3d537dc13 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:38.147767 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8d8b2d22-5226-475a-b315-7be3d537dc13 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1314 microversion: 2.1 time: 0.466400 Oct 24 10:39:38.151606 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1657/3396] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:37 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:38.160707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-19a61921-9efc-4684-9d68-4ca412bb789d req-654377e0-94a2-492e-ac9d-c486222acb06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27efcba4-7aac-4be7-890d-dc0baeff7a5d", "name": "network-vif-plugged", "status": "completed", "tag": "860912bd-1ba7-4863-b73c-e6b2649b53b8"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:38.167939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2f8c312e-6676-40f2-8db9-2770cc6534d0 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:39:38.179910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-19a61921-9efc-4684-9d68-4ca412bb789d req-654377e0-94a2-492e-ac9d-c486222acb06 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:38.180920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-19a61921-9efc-4684-9d68-4ca412bb789d req-654377e0-94a2-492e-ac9d-c486222acb06 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:38.181387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-19a61921-9efc-4684-9d68-4ca412bb789d req-654377e0-94a2-492e-ac9d-c486222acb06 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:38.197272 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-19a61921-9efc-4684-9d68-4ca412bb789d req-654377e0-94a2-492e-ac9d-c486222acb06 service nova] Creating event network-vif-plugged:860912bd-1ba7-4863-b73c-e6b2649b53b8 for instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d on n-h1-858383-15 Oct 24 10:39:38.208011 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-19a61921-9efc-4684-9d68-4ca412bb789d req-654377e0-94a2-492e-ac9d-c486222acb06 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048863 Oct 24 10:39:38.213208 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1658/3397] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:38.334359 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2f8c312e-6676-40f2-8db9-2770cc6534d0 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "DELETE /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 204 len: 0 microversion: 2.1 time: 0.232826 Oct 24 10:39:38.334359 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1740/3398] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:39:38 2022] DELETE /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:39:38.343864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a1c5f6e3-33dc-4146-82b5-58f0f0cc0799 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:38.344564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a1c5f6e3-33dc-4146-82b5-58f0f0cc0799 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:38.360736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1c5f6e3-33dc-4146-82b5-58f0f0cc0799 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:38.361800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1c5f6e3-33dc-4146-82b5-58f0f0cc0799 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:38.362411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1c5f6e3-33dc-4146-82b5-58f0f0cc0799 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:38.363547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1c5f6e3-33dc-4146-82b5-58f0f0cc0799 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:38.364166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1c5f6e3-33dc-4146-82b5-58f0f0cc0799 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:38.365168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1c5f6e3-33dc-4146-82b5-58f0f0cc0799 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:38.377196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:38.610129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b6a8e350-07a7-4c45-b805-84040b93afbd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:38.611170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b6a8e350-07a7-4c45-b805-84040b93afbd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:38.623277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6a8e350-07a7-4c45-b805-84040b93afbd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:38.624118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6a8e350-07a7-4c45-b805-84040b93afbd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:38.624976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6a8e350-07a7-4c45-b805-84040b93afbd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:38.625898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6a8e350-07a7-4c45-b805-84040b93afbd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:38.629866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6a8e350-07a7-4c45-b805-84040b93afbd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:38.630321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6a8e350-07a7-4c45-b805-84040b93afbd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:38.888754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b6a8e350-07a7-4c45-b805-84040b93afbd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:38.897298 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b6a8e350-07a7-4c45-b805-84040b93afbd tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1324 microversion: 2.1 time: 0.291513 Oct 24 10:39:38.901712 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1741/3399] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:38 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1324 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:38.912724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-937a6a50-26ab-470b-889f-a05a86d7a68f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:38.917136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-937a6a50-26ab-470b-889f-a05a86d7a68f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:38.928430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-937a6a50-26ab-470b-889f-a05a86d7a68f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:38.931113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-937a6a50-26ab-470b-889f-a05a86d7a68f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:38.932360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-937a6a50-26ab-470b-889f-a05a86d7a68f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:38.934253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-937a6a50-26ab-470b-889f-a05a86d7a68f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:38.935188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-937a6a50-26ab-470b-889f-a05a86d7a68f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:38.937143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-937a6a50-26ab-470b-889f-a05a86d7a68f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:38.955991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a1c5f6e3-33dc-4146-82b5-58f0f0cc0799 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:38.970719 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a1c5f6e3-33dc-4146-82b5-58f0f0cc0799 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1519 microversion: 2.1 time: 0.629314 Oct 24 10:39:38.972646 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1659/3400] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:38 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1519 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:39.134798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3b6ba7f3-6105-4e51-9a83-582319ae5595 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:39.135311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3b6ba7f3-6105-4e51-9a83-582319ae5595 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:39.146590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b6ba7f3-6105-4e51-9a83-582319ae5595 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:39.147177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b6ba7f3-6105-4e51-9a83-582319ae5595 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:39.147543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b6ba7f3-6105-4e51-9a83-582319ae5595 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:39.155314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b6ba7f3-6105-4e51-9a83-582319ae5595 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:39.155314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b6ba7f3-6105-4e51-9a83-582319ae5595 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:39.155729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b6ba7f3-6105-4e51-9a83-582319ae5595 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:39.224287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-937a6a50-26ab-470b-889f-a05a86d7a68f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:39.236020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-937a6a50-26ab-470b-889f-a05a86d7a68f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:39.237498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-937a6a50-26ab-470b-889f-a05a86d7a68f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:39.238681 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-937a6a50-26ab-470b-889f-a05a86d7a68f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.335724 Oct 24 10:39:39.240187 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1742/3401] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:38 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:39.246157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9d3d66f1-7c0a-4805-9f75-72d818931503 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:39.247167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9d3d66f1-7c0a-4805-9f75-72d818931503 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:39.269255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d3d66f1-7c0a-4805-9f75-72d818931503 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:39.271044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d3d66f1-7c0a-4805-9f75-72d818931503 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:39.271044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d3d66f1-7c0a-4805-9f75-72d818931503 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:39.271044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d3d66f1-7c0a-4805-9f75-72d818931503 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:39.271777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d3d66f1-7c0a-4805-9f75-72d818931503 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:39.272216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9d3d66f1-7c0a-4805-9f75-72d818931503 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:39.311052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3b6ba7f3-6105-4e51-9a83-582319ae5595 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:39.324634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3b6ba7f3-6105-4e51-9a83-582319ae5595 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:39.326149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3b6ba7f3-6105-4e51-9a83-582319ae5595 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:39.349511 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3b6ba7f3-6105-4e51-9a83-582319ae5595 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1535 microversion: 2.91 time: 0.220249 Oct 24 10:39:39.358495 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1660/3402] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:39 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1535 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:39.531687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9d3d66f1-7c0a-4805-9f75-72d818931503 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:39.543337 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9d3d66f1-7c0a-4805-9f75-72d818931503 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1314 microversion: 2.1 time: 0.301836 Oct 24 10:39:39.544265 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1743/3403] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:39 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:39.925057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef5c4426-77d2-436d-a60a-a516f952ab5c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:39.926017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ef5c4426-77d2-436d-a60a-a516f952ab5c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:39.939016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef5c4426-77d2-436d-a60a-a516f952ab5c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:39.941250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef5c4426-77d2-436d-a60a-a516f952ab5c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:39.942929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef5c4426-77d2-436d-a60a-a516f952ab5c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:39.945521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef5c4426-77d2-436d-a60a-a516f952ab5c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:39.948720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef5c4426-77d2-436d-a60a-a516f952ab5c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:39.949069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef5c4426-77d2-436d-a60a-a516f952ab5c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:39.999560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-99d60788-be86-4e69-ac02-693f483eb0fc tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:40.000528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-99d60788-be86-4e69-ac02-693f483eb0fc tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:40.008919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99d60788-be86-4e69-ac02-693f483eb0fc tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:40.009748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99d60788-be86-4e69-ac02-693f483eb0fc tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:40.010407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99d60788-be86-4e69-ac02-693f483eb0fc tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:40.011331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99d60788-be86-4e69-ac02-693f483eb0fc tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:40.012128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99d60788-be86-4e69-ac02-693f483eb0fc tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:40.012759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99d60788-be86-4e69-ac02-693f483eb0fc tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:40.182014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ef5c4426-77d2-436d-a60a-a516f952ab5c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:40.191152 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef5c4426-77d2-436d-a60a-a516f952ab5c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1324 microversion: 2.1 time: 0.270595 Oct 24 10:39:40.192176 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1661/3404] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:39 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1324 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:40.208670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-99d60788-be86-4e69-ac02-693f483eb0fc tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:40.217055 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-99d60788-be86-4e69-ac02-693f483eb0fc tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1519 microversion: 2.1 time: 0.221323 Oct 24 10:39:40.217733 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1744/3405] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:39 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:39:40.269009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7a38decd-ce4d-44bb-9675-a8121f7b2ddc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:40.269516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7a38decd-ce4d-44bb-9675-a8121f7b2ddc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:40.275667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a38decd-ce4d-44bb-9675-a8121f7b2ddc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:40.276159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a38decd-ce4d-44bb-9675-a8121f7b2ddc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:40.276594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a38decd-ce4d-44bb-9675-a8121f7b2ddc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:40.277313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a38decd-ce4d-44bb-9675-a8121f7b2ddc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:40.277771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a38decd-ce4d-44bb-9675-a8121f7b2ddc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:40.278193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7a38decd-ce4d-44bb-9675-a8121f7b2ddc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:40.397402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dc553457-683d-46eb-964d-f92bd2be1cba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:40.398813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dc553457-683d-46eb-964d-f92bd2be1cba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:40.407041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc553457-683d-46eb-964d-f92bd2be1cba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:40.407908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc553457-683d-46eb-964d-f92bd2be1cba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:40.408722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc553457-683d-46eb-964d-f92bd2be1cba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:40.409695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc553457-683d-46eb-964d-f92bd2be1cba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:40.410994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc553457-683d-46eb-964d-f92bd2be1cba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:40.412133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc553457-683d-46eb-964d-f92bd2be1cba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:40.544189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dc553457-683d-46eb-964d-f92bd2be1cba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:40.554727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dc553457-683d-46eb-964d-f92bd2be1cba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:40.557497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dc553457-683d-46eb-964d-f92bd2be1cba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:40.565449 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dc553457-683d-46eb-964d-f92bd2be1cba tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1535 microversion: 2.91 time: 0.174877 Oct 24 10:39:40.585062 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1745/3406] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:40 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1535 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:40.602163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f769ac39-c160-4fe3-a5d4-f0470a6661c7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:40.604390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f769ac39-c160-4fe3-a5d4-f0470a6661c7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:40.612393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f769ac39-c160-4fe3-a5d4-f0470a6661c7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:40.613717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f769ac39-c160-4fe3-a5d4-f0470a6661c7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:40.614474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f769ac39-c160-4fe3-a5d4-f0470a6661c7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:40.615967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f769ac39-c160-4fe3-a5d4-f0470a6661c7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:40.617209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f769ac39-c160-4fe3-a5d4-f0470a6661c7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:40.617897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f769ac39-c160-4fe3-a5d4-f0470a6661c7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:40.642626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7a38decd-ce4d-44bb-9675-a8121f7b2ddc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:40.660501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7a38decd-ce4d-44bb-9675-a8121f7b2ddc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:40.662583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7a38decd-ce4d-44bb-9675-a8121f7b2ddc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:40.665123 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7a38decd-ce4d-44bb-9675-a8121f7b2ddc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.400015 Oct 24 10:39:40.666258 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1662/3407] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:40 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:40.977228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f769ac39-c160-4fe3-a5d4-f0470a6661c7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:40.994125 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f769ac39-c160-4fe3-a5d4-f0470a6661c7 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1314 microversion: 2.1 time: 0.403159 Oct 24 10:39:40.995111 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1746/3408] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:40 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:41.215103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ed9e427f-3837-4488-b9ee-4b8062263911 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:41.215912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ed9e427f-3837-4488-b9ee-4b8062263911 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:41.230675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed9e427f-3837-4488-b9ee-4b8062263911 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:41.230675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed9e427f-3837-4488-b9ee-4b8062263911 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:41.230675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed9e427f-3837-4488-b9ee-4b8062263911 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:41.231341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed9e427f-3837-4488-b9ee-4b8062263911 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:41.232881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed9e427f-3837-4488-b9ee-4b8062263911 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:41.233456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed9e427f-3837-4488-b9ee-4b8062263911 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:41.240824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c63ac229-c6be-4131-8527-dae7a8673ad9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:41.242542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c63ac229-c6be-4131-8527-dae7a8673ad9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:41.283813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c63ac229-c6be-4131-8527-dae7a8673ad9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:41.284851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c63ac229-c6be-4131-8527-dae7a8673ad9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:41.293219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c63ac229-c6be-4131-8527-dae7a8673ad9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:41.295896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c63ac229-c6be-4131-8527-dae7a8673ad9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:41.296414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c63ac229-c6be-4131-8527-dae7a8673ad9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:41.300941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c63ac229-c6be-4131-8527-dae7a8673ad9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:41.893572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ed9e427f-3837-4488-b9ee-4b8062263911 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:41.904319 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ed9e427f-3837-4488-b9ee-4b8062263911 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1520 microversion: 2.1 time: 0.693422 Oct 24 10:39:41.906360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c63ac229-c6be-4131-8527-dae7a8673ad9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:41.910900 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1663/3409] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:41 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1520 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:41.919429 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c63ac229-c6be-4131-8527-dae7a8673ad9 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1519 microversion: 2.1 time: 0.683465 Oct 24 10:39:41.921091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4ffa98b4-fe24-445a-82cf-840d5d1fce0f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:41.926278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4ffa98b4-fe24-445a-82cf-840d5d1fce0f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:41.935355 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1747/3410] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:41 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1519 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:39:41.937469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ffa98b4-fe24-445a-82cf-840d5d1fce0f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:41.938066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ffa98b4-fe24-445a-82cf-840d5d1fce0f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:41.940985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-72ec7ef3-6d77-41eb-a0de-e4c26c950921 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:41.941585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ffa98b4-fe24-445a-82cf-840d5d1fce0f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:41.942434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ffa98b4-fe24-445a-82cf-840d5d1fce0f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:41.942992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ffa98b4-fe24-445a-82cf-840d5d1fce0f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:41.943509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ffa98b4-fe24-445a-82cf-840d5d1fce0f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:41.946445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-72ec7ef3-6d77-41eb-a0de-e4c26c950921 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:41.963844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72ec7ef3-6d77-41eb-a0de-e4c26c950921 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:41.964352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72ec7ef3-6d77-41eb-a0de-e4c26c950921 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:41.965020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72ec7ef3-6d77-41eb-a0de-e4c26c950921 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:41.965929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72ec7ef3-6d77-41eb-a0de-e4c26c950921 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:41.966561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72ec7ef3-6d77-41eb-a0de-e4c26c950921 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:41.967161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72ec7ef3-6d77-41eb-a0de-e4c26c950921 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:42.071201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4ffa98b4-fe24-445a-82cf-840d5d1fce0f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:42.094372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4ffa98b4-fe24-445a-82cf-840d5d1fce0f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:42.095917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4ffa98b4-fe24-445a-82cf-840d5d1fce0f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:42.111338 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4ffa98b4-fe24-445a-82cf-840d5d1fce0f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1478 microversion: 2.91 time: 0.199129 Oct 24 10:39:42.111952 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1664/3411] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:41 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1478 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:42.117408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-16b45136-550e-473d-a45d-6c85e3dbb934 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:42.121671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-16b45136-550e-473d-a45d-6c85e3dbb934 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:42.144034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16b45136-550e-473d-a45d-6c85e3dbb934 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:42.144894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16b45136-550e-473d-a45d-6c85e3dbb934 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:42.145579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16b45136-550e-473d-a45d-6c85e3dbb934 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:42.146524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16b45136-550e-473d-a45d-6c85e3dbb934 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:42.149091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16b45136-550e-473d-a45d-6c85e3dbb934 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:42.150042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16b45136-550e-473d-a45d-6c85e3dbb934 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:42.608245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-72ec7ef3-6d77-41eb-a0de-e4c26c950921 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:42.624044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-72ec7ef3-6d77-41eb-a0de-e4c26c950921 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:42.626034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-72ec7ef3-6d77-41eb-a0de-e4c26c950921 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:42.627446 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-72ec7ef3-6d77-41eb-a0de-e4c26c950921 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.690825 Oct 24 10:39:42.628241 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1748/3412] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:41 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:42.633734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6daa65f3-bcb9-4b22-84d1-51fd34eb973e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:42.634616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6daa65f3-bcb9-4b22-84d1-51fd34eb973e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:42.644172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6daa65f3-bcb9-4b22-84d1-51fd34eb973e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:42.645107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6daa65f3-bcb9-4b22-84d1-51fd34eb973e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:42.645789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6daa65f3-bcb9-4b22-84d1-51fd34eb973e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:42.646987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6daa65f3-bcb9-4b22-84d1-51fd34eb973e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:42.648969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6daa65f3-bcb9-4b22-84d1-51fd34eb973e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:42.649498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6daa65f3-bcb9-4b22-84d1-51fd34eb973e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:42.655893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-16b45136-550e-473d-a45d-6c85e3dbb934 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:42.671410 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-16b45136-550e-473d-a45d-6c85e3dbb934 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1520 microversion: 2.1 time: 0.557789 Oct 24 10:39:42.675917 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1665/3413] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:42 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1520 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:42.684699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c7e07ffb-29f0-411c-8ab5-3afa3ae50026 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-858383-15"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:42.692777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c7e07ffb-29f0-411c-8ab5-3afa3ae50026 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:42.715452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7e07ffb-29f0-411c-8ab5-3afa3ae50026 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:42.717887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7e07ffb-29f0-411c-8ab5-3afa3ae50026 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:42.718598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7e07ffb-29f0-411c-8ab5-3afa3ae50026 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:42.721182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7e07ffb-29f0-411c-8ab5-3afa3ae50026 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:42.722319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7e07ffb-29f0-411c-8ab5-3afa3ae50026 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:42.729590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7e07ffb-29f0-411c-8ab5-3afa3ae50026 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:42.784098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c7e07ffb-29f0-411c-8ab5-3afa3ae50026 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-858383-15". {{(pid=120425) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 24 10:39:42.902789 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c7e07ffb-29f0-411c-8ab5-3afa3ae50026 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db/action" status: 202 len: 0 microversion: 2.91 time: 0.225382 Oct 24 10:39:42.909417 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1666/3414] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Oct 24 10:39:42 2022] POST /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:39:42.922344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-7f786296-fefc-4993-83e8-b94ade391f04 req-355f780e-7f2a-4f1c-b175-349fc01f6c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f9e553-a2d6-4c33-8f37-2cd23977137a", "name": "network-vif-plugged", "status": "completed", "tag": "7f7f6e60-119a-48e8-b07a-627be75820a9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:42.938534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7f786296-fefc-4993-83e8-b94ade391f04 req-355f780e-7f2a-4f1c-b175-349fc01f6c24 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:42.945697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7f786296-fefc-4993-83e8-b94ade391f04 req-355f780e-7f2a-4f1c-b175-349fc01f6c24 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:42.946564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7f786296-fefc-4993-83e8-b94ade391f04 req-355f780e-7f2a-4f1c-b175-349fc01f6c24 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:42.979590 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-7f786296-fefc-4993-83e8-b94ade391f04 req-355f780e-7f2a-4f1c-b175-349fc01f6c24 service nova] Creating event network-vif-plugged:7f7f6e60-119a-48e8-b07a-627be75820a9 for instance 81f9e553-a2d6-4c33-8f37-2cd23977137a on n-h1-858383-15 Oct 24 10:39:42.986505 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-7f786296-fefc-4993-83e8-b94ade391f04 req-355f780e-7f2a-4f1c-b175-349fc01f6c24 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075818 Oct 24 10:39:42.987276 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1667/3415] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:42.998135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d7debdc8-6568-4caf-9ba6-00160f8ccdf6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2022906743"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:43.000875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d7debdc8-6568-4caf-9ba6-00160f8ccdf6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:43.014444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7debdc8-6568-4caf-9ba6-00160f8ccdf6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:43.015036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7debdc8-6568-4caf-9ba6-00160f8ccdf6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:43.015508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7debdc8-6568-4caf-9ba6-00160f8ccdf6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:43.017703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7debdc8-6568-4caf-9ba6-00160f8ccdf6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:43.018318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7debdc8-6568-4caf-9ba6-00160f8ccdf6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:43.018779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7debdc8-6568-4caf-9ba6-00160f8ccdf6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:43.100323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6daa65f3-bcb9-4b22-84d1-51fd34eb973e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:43.109903 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6daa65f3-bcb9-4b22-84d1-51fd34eb973e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1314 microversion: 2.1 time: 0.480377 Oct 24 10:39:43.110493 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1749/3416] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:42 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:43.124932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-f5df6367-dce6-44d2-bbde-cd20db9e7f40 req-365a3eb3-cd8a-4cc8-9e71-fb99ba7a1e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "665a2c20-ef11-4810-ac96-2f122fac8fe0", "name": "network-vif-deleted", "tag": "a3161b7b-9b11-409b-90be-1243d8ca4b72"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:43.148467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f5df6367-dce6-44d2-bbde-cd20db9e7f40 req-365a3eb3-cd8a-4cc8-9e71-fb99ba7a1e96 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:43.148996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f5df6367-dce6-44d2-bbde-cd20db9e7f40 req-365a3eb3-cd8a-4cc8-9e71-fb99ba7a1e96 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:43.149444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f5df6367-dce6-44d2-bbde-cd20db9e7f40 req-365a3eb3-cd8a-4cc8-9e71-fb99ba7a1e96 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:43.184675 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f5df6367-dce6-44d2-bbde-cd20db9e7f40 req-365a3eb3-cd8a-4cc8-9e71-fb99ba7a1e96 service nova] Creating event network-vif-deleted:a3161b7b-9b11-409b-90be-1243d8ca4b72 for instance 665a2c20-ef11-4810-ac96-2f122fac8fe0 on n-h1-858383-15 Oct 24 10:39:43.191047 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-f5df6367-dce6-44d2-bbde-cd20db9e7f40 req-365a3eb3-cd8a-4cc8-9e71-fb99ba7a1e96 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079175 Oct 24 10:39:43.191679 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1750/3417] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:43.216194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-427dd93a-b515-4365-be53-1011035556be tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:43.218918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-427dd93a-b515-4365-be53-1011035556be tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:43.237509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-427dd93a-b515-4365-be53-1011035556be tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:43.238228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-427dd93a-b515-4365-be53-1011035556be tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:43.238854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-427dd93a-b515-4365-be53-1011035556be tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:43.239921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-427dd93a-b515-4365-be53-1011035556be tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:43.240723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-427dd93a-b515-4365-be53-1011035556be tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:43.241151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-427dd93a-b515-4365-be53-1011035556be tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:43.359430 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d7debdc8-6568-4caf-9ba6-00160f8ccdf6 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "POST /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d/action" status: 202 len: 0 microversion: 2.1 time: 0.365205 Oct 24 10:39:43.366051 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1668/3418] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:39:42 2022] POST /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 10:39:43.372700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3c5b5924-610b-431b-ac29-815573c753b3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:43.375085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3c5b5924-610b-431b-ac29-815573c753b3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:43.404467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c5b5924-610b-431b-ac29-815573c753b3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:43.408560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c5b5924-610b-431b-ac29-815573c753b3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:43.409188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c5b5924-610b-431b-ac29-815573c753b3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:43.410025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c5b5924-610b-431b-ac29-815573c753b3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:43.410593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c5b5924-610b-431b-ac29-815573c753b3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:43.413664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c5b5924-610b-431b-ac29-815573c753b3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:43.501116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-427dd93a-b515-4365-be53-1011035556be tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:43.505871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:43.515748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c5b5924-610b-431b-ac29-815573c753b3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:43.519397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c5b5924-610b-431b-ac29-815573c753b3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:43.520451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c5b5924-610b-431b-ac29-815573c753b3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:43.521258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-427dd93a-b515-4365-be53-1011035556be tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:43.523773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-427dd93a-b515-4365-be53-1011035556be tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:43.526696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-3c5b5924-610b-431b-ac29-815573c753b3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lazy-loading 'fault' on Instance uuid 665a2c20-ef11-4810-ac96-2f122fac8fe0 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:39:43.543967 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-427dd93a-b515-4365-be53-1011035556be tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1486 microversion: 2.91 time: 0.351071 Oct 24 10:39:43.546363 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1751/3419] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:43 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1486 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:43.566199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-93bcc034-8e4a-4655-8a53-be62d9114100 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '.version_select at 0x7f04d00b6dc0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:43.707500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c5b5924-610b-431b-ac29-815573c753b3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88eecfbcd0f4acf8edffbb8fb604f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34be11df0f94fabb99d567ed559cfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:43.719118 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3c5b5924-610b-431b-ac29-815573c753b3 tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 200 len: 1311 microversion: 2.1 time: 0.356795 Oct 24 10:39:43.720474 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1669/3420] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:43 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 1311 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:43.725274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3466e84f-e075-4624-aa25-031d790d8e75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:43.729238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3466e84f-e075-4624-aa25-031d790d8e75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:43.739643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3466e84f-e075-4624-aa25-031d790d8e75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:43.742609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3466e84f-e075-4624-aa25-031d790d8e75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:43.751901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3466e84f-e075-4624-aa25-031d790d8e75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:43.752681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3466e84f-e075-4624-aa25-031d790d8e75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:43.753196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3466e84f-e075-4624-aa25-031d790d8e75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:43.753639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3466e84f-e075-4624-aa25-031d790d8e75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:43.944222 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-93bcc034-8e4a-4655-8a53-be62d9114100 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "DELETE /compute/v2.1/images/7450176f-f233-4925-a56d-8b6b5aaea2b3" status: 204 len: 0 microversion: 2.1 time: 0.396561 Oct 24 10:39:43.945058 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1752/3421] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:43 2022] DELETE /compute/v2.1/images/7450176f-f233-4925-a56d-8b6b5aaea2b3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:39:43.953891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-474925f8-556a-4509-920a-124fbd7ba240 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '.version_select at 0x7f04d008da60>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:44.001327 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-474925f8-556a-4509-920a-124fbd7ba240 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] HTTP exception thrown: Image not found. Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-474925f8-556a-4509-920a-124fbd7ba240 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Request method failure captured: Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/images/7450176f-f233-4925-a56d-8b6b5aaea2b3 HTTP/1.1 Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmsZ6iCeMLTpciKzT-IOd-jSbp-Ock4X7vHFbSgox-iuMV2hxDyst1XnTlhe7a0yhnti-D3qlDTVLsDNpGHmdQxuIxzHTz6ZfOA3sAyV-nTFUvtxnUe0hLrgWnomxwn6YBZ-Qwy9VkVlCsoa7UEzkg7FPtyXY6LqjelB4oPUwFh9rLg Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5edfb6d8f84547399863eec5c89e6933", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 1f089833f359473ebfa681931e8ffc06 Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: exception: Image not found. Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '7450176f-f233-4925-a56d-8b6b5aaea2b3'} Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7450176f-f233-4925-a56d-8b6b5aaea2b3 Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 24 10:39:44.003458 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7450176f-f233-4925-a56d-8b6b5aaea2b3 could not be found. Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-474925f8-556a-4509-920a-124fbd7ba240 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Returning 404 to user: Image not found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-474925f8-556a-4509-920a-124fbd7ba240 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/images/7450176f-f233-4925-a56d-8b6b5aaea2b3" status: 404 len: 62 microversion: 2.1 time: 0.055746 Oct 24 10:39:44.008064 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1753/3422] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Oct 24 10:39:43 2022] GET /compute/v2.1/images/7450176f-f233-4925-a56d-8b6b5aaea2b3 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:39:44.014408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e4b19baa-8fa1-4220-8c71-09c1f35f3158 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:44.014577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e4b19baa-8fa1-4220-8c71-09c1f35f3158 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:44.029379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e4b19baa-8fa1-4220-8c71-09c1f35f3158 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:44.030193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e4b19baa-8fa1-4220-8c71-09c1f35f3158 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:44.031184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e4b19baa-8fa1-4220-8c71-09c1f35f3158 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:44.032134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e4b19baa-8fa1-4220-8c71-09c1f35f3158 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:44.032897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e4b19baa-8fa1-4220-8c71-09c1f35f3158 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:44.036193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e4b19baa-8fa1-4220-8c71-09c1f35f3158 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:44.352672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3466e84f-e075-4624-aa25-031d790d8e75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:44.364133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e4b19baa-8fa1-4220-8c71-09c1f35f3158 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:44.383458 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e4b19baa-8fa1-4220-8c71-09c1f35f3158 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1532 microversion: 2.1 time: 0.373097 Oct 24 10:39:44.386751 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1754/3423] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:44 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1532 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:39:44.389303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3466e84f-e075-4624-aa25-031d790d8e75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:44.391796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3466e84f-e075-4624-aa25-031d790d8e75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:44.393926 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3466e84f-e075-4624-aa25-031d790d8e75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.672265 Oct 24 10:39:44.412606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8739f5cb-c229-4880-9ce2-7d8ab4915cce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:44.414373 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1670/3424] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:43 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:44.415242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8739f5cb-c229-4880-9ce2-7d8ab4915cce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:44.422126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8739f5cb-c229-4880-9ce2-7d8ab4915cce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:44.423156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8739f5cb-c229-4880-9ce2-7d8ab4915cce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:44.423828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8739f5cb-c229-4880-9ce2-7d8ab4915cce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:44.425257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8739f5cb-c229-4880-9ce2-7d8ab4915cce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:44.426133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8739f5cb-c229-4880-9ce2-7d8ab4915cce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:44.426735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8739f5cb-c229-4880-9ce2-7d8ab4915cce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:44.578623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b2c5e68a-d520-4150-8d24-c8b339ce9728 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:44.579492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b2c5e68a-d520-4150-8d24-c8b339ce9728 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:44.590909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2c5e68a-d520-4150-8d24-c8b339ce9728 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:44.593105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2c5e68a-d520-4150-8d24-c8b339ce9728 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:44.596533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2c5e68a-d520-4150-8d24-c8b339ce9728 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:44.597767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2c5e68a-d520-4150-8d24-c8b339ce9728 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:44.598569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2c5e68a-d520-4150-8d24-c8b339ce9728 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:44.599321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2c5e68a-d520-4150-8d24-c8b339ce9728 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:44.680795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8739f5cb-c229-4880-9ce2-7d8ab4915cce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:44.689891 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8739f5cb-c229-4880-9ce2-7d8ab4915cce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1314 microversion: 2.1 time: 0.301767 Oct 24 10:39:44.713740 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1755/3425] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:44 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:44.732612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b2c5e68a-d520-4150-8d24-c8b339ce9728 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:44.741984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b2c5e68a-d520-4150-8d24-c8b339ce9728 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:44.744389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8295cbcd-5026-4c10-98a7-1d06a4b2918f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:44.745377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8295cbcd-5026-4c10-98a7-1d06a4b2918f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] [instance: 665a2c20-ef11-4810-ac96-2f122fac8fe0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:44.753431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8295cbcd-5026-4c10-98a7-1d06a4b2918f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:44.754564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8295cbcd-5026-4c10-98a7-1d06a4b2918f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:44.755143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b2c5e68a-d520-4150-8d24-c8b339ce9728 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:44.755285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8295cbcd-5026-4c10-98a7-1d06a4b2918f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:44.755977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8295cbcd-5026-4c10-98a7-1d06a4b2918f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:44.756482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8295cbcd-5026-4c10-98a7-1d06a4b2918f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:44.757370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8295cbcd-5026-4c10-98a7-1d06a4b2918f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:44.762515 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b2c5e68a-d520-4150-8d24-c8b339ce9728 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1486 microversion: 2.91 time: 0.187645 Oct 24 10:39:44.763376 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1671/3426] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:44 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1486 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:39:44.774069 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-8295cbcd-5026-4c10-98a7-1d06a4b2918f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] HTTP exception thrown: Instance 665a2c20-ef11-4810-ac96-2f122fac8fe0 could not be found. Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8295cbcd-5026-4c10-98a7-1d06a4b2918f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Request method failure captured: Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 HTTP/1.1 Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmsPiBOsklhFVGZSWGiPK17yrCSH_2l4prkPuAzlfu1fF5i2q59oxKCLqek5-AMtqoL5OAq_NX2ur96taO9B7TYRnx8i-loPjQfAzK9r5bp4PtTlyCNhYyQTjAFBaizHONnQIkybQGzbdWp1A-1dluds8f7OHGR8v8ESV0F-kr0TERI Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: d34be11df0f94fabb99d567ed559cfa7 Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ListServerFiltersTestJSON-416462304 Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d34be11df0f94fabb99d567ed559cfa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d34be11df0f94fabb99d567ed559cfa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d34be11df0f94fabb99d567ed559cfa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d34be11df0f94fabb99d567ed559cfa7", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ListServerFiltersTestJSON-416462304 Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: d34be11df0f94fabb99d567ed559cfa7 Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-416462304 Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ListServerFiltersTestJSON-416462304-project Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a88eecfbcd0f4acf8edffbb8fb604f42 Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ListServerFiltersTestJSON-416462304-project Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 665a2c20-ef11-4810-ac96-2f122fac8fe0 could not be found. Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '665a2c20-ef11-4810-ac96-2f122fac8fe0'} Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 665a2c20-ef11-4810-ac96-2f122fac8fe0 could not be found. Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 665a2c20-ef11-4810-ac96-2f122fac8fe0 could not be found. Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:39:44.776087 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:44.781578 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:39:44.781578 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:39:44.781578 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:39:44.781578 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:39:44.781578 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:39:44.781578 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 665a2c20-ef11-4810-ac96-2f122fac8fe0 could not be found. Oct 24 10:39:44.781578 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:39:44.783131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8295cbcd-5026-4c10-98a7-1d06a4b2918f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] Returning 404 to user: Instance 665a2c20-ef11-4810-ac96-2f122fac8fe0 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:39:44.784429 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8295cbcd-5026-4c10-98a7-1d06a4b2918f tempest-ListServerFiltersTestJSON-416462304 tempest-ListServerFiltersTestJSON-416462304-project] 10.222.0.50 "GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0" status: 404 len: 111 microversion: 2.1 time: 0.044938 Oct 24 10:39:44.789497 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1756/3427] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:44 2022] GET /compute/v2.1/servers/665a2c20-ef11-4810-ac96-2f122fac8fe0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:39:45.412719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-16ad1121-1f3a-4a93-8924-5db7cb0a5231 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:45.414909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-16ad1121-1f3a-4a93-8924-5db7cb0a5231 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:45.424263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b94d3725-93cb-4506-a22a-a395065f73b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:45.426381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b94d3725-93cb-4506-a22a-a395065f73b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:45.436751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16ad1121-1f3a-4a93-8924-5db7cb0a5231 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:45.437737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16ad1121-1f3a-4a93-8924-5db7cb0a5231 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:45.438533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16ad1121-1f3a-4a93-8924-5db7cb0a5231 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:45.439824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16ad1121-1f3a-4a93-8924-5db7cb0a5231 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:45.443464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16ad1121-1f3a-4a93-8924-5db7cb0a5231 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:45.446357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16ad1121-1f3a-4a93-8924-5db7cb0a5231 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:45.465396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b94d3725-93cb-4506-a22a-a395065f73b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:45.470502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b94d3725-93cb-4506-a22a-a395065f73b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:45.471261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b94d3725-93cb-4506-a22a-a395065f73b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:45.472209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b94d3725-93cb-4506-a22a-a395065f73b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:45.472977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b94d3725-93cb-4506-a22a-a395065f73b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:45.474001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b94d3725-93cb-4506-a22a-a395065f73b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:45.749980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b94d3725-93cb-4506-a22a-a395065f73b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:45.763402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b94d3725-93cb-4506-a22a-a395065f73b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:45.765227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b94d3725-93cb-4506-a22a-a395065f73b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:45.767000 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b94d3725-93cb-4506-a22a-a395065f73b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.348353 Oct 24 10:39:45.790050 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1757/3428] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:45 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:45.801405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f6ecb022-8921-4c3f-a142-f52e4800ee64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:45.802250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f6ecb022-8921-4c3f-a142-f52e4800ee64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:45.813597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-16ad1121-1f3a-4a93-8924-5db7cb0a5231 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:45.825324 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-16ad1121-1f3a-4a93-8924-5db7cb0a5231 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1532 microversion: 2.1 time: 0.420766 Oct 24 10:39:45.826516 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1672/3429] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:45 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1532 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:45.827788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6ecb022-8921-4c3f-a142-f52e4800ee64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:45.828488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6ecb022-8921-4c3f-a142-f52e4800ee64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:45.829541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6ecb022-8921-4c3f-a142-f52e4800ee64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:45.830420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6ecb022-8921-4c3f-a142-f52e4800ee64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:45.831060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6ecb022-8921-4c3f-a142-f52e4800ee64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:45.831797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c513c168-20d7-4e54-a0c9-dcc383dc7271 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:45.831942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6ecb022-8921-4c3f-a142-f52e4800ee64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:45.832580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c513c168-20d7-4e54-a0c9-dcc383dc7271 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:45.842462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c513c168-20d7-4e54-a0c9-dcc383dc7271 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:45.843117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c513c168-20d7-4e54-a0c9-dcc383dc7271 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:45.844192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c513c168-20d7-4e54-a0c9-dcc383dc7271 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:45.845059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c513c168-20d7-4e54-a0c9-dcc383dc7271 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:45.845646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c513c168-20d7-4e54-a0c9-dcc383dc7271 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:45.846317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c513c168-20d7-4e54-a0c9-dcc383dc7271 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:45.875828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:45.955111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c513c168-20d7-4e54-a0c9-dcc383dc7271 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:45.969205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c513c168-20d7-4e54-a0c9-dcc383dc7271 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:45.971464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c513c168-20d7-4e54-a0c9-dcc383dc7271 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:45.979263 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c513c168-20d7-4e54-a0c9-dcc383dc7271 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.151235 Oct 24 10:39:45.980308 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1673/3430] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:45 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:46.041345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f6ecb022-8921-4c3f-a142-f52e4800ee64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:46.051909 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f6ecb022-8921-4c3f-a142-f52e4800ee64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1500 microversion: 2.1 time: 0.264021 Oct 24 10:39:46.052868 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1758/3431] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:45 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1500 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:46.079157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9aafb9ea-3072-4d74-91b9-7534fd7563ba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:46.086960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9aafb9ea-3072-4d74-91b9-7534fd7563ba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:46.087702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9aafb9ea-3072-4d74-91b9-7534fd7563ba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:46.088305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9aafb9ea-3072-4d74-91b9-7534fd7563ba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:46.112511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9aafb9ea-3072-4d74-91b9-7534fd7563ba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Going to try to stop instance {{(pid=120425) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 10:39:46.169503 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9aafb9ea-3072-4d74-91b9-7534fd7563ba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "POST /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a/action" status: 202 len: 0 microversion: 2.1 time: 0.094613 Oct 24 10:39:46.170871 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1674/3432] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:39:46 2022] POST /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:39:46.180379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6d6fc33f-c4ae-41e5-8116-3e0b182f5561 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:46.181890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6d6fc33f-c4ae-41e5-8116-3e0b182f5561 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:46.189736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d6fc33f-c4ae-41e5-8116-3e0b182f5561 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:46.190596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d6fc33f-c4ae-41e5-8116-3e0b182f5561 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:46.191463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d6fc33f-c4ae-41e5-8116-3e0b182f5561 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:46.198251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d6fc33f-c4ae-41e5-8116-3e0b182f5561 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:46.199423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d6fc33f-c4ae-41e5-8116-3e0b182f5561 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:46.200382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d6fc33f-c4ae-41e5-8116-3e0b182f5561 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:46.438444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6d6fc33f-c4ae-41e5-8116-3e0b182f5561 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:46.451492 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6d6fc33f-c4ae-41e5-8116-3e0b182f5561 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1510 microversion: 2.1 time: 0.276085 Oct 24 10:39:46.452870 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1759/3433] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:46 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1510 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:39:46.801539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2379272b-73e9-443b-a775-9c6fe9d8cdb1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:46.802500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2379272b-73e9-443b-a775-9c6fe9d8cdb1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:46.825105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2379272b-73e9-443b-a775-9c6fe9d8cdb1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:46.826297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2379272b-73e9-443b-a775-9c6fe9d8cdb1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:46.827670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2379272b-73e9-443b-a775-9c6fe9d8cdb1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:46.829729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2379272b-73e9-443b-a775-9c6fe9d8cdb1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:46.830336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2379272b-73e9-443b-a775-9c6fe9d8cdb1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:46.830659 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2379272b-73e9-443b-a775-9c6fe9d8cdb1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:46.852335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-11fffad2-1ceb-45af-8d88-8d166e99635c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:46.853527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-11fffad2-1ceb-45af-8d88-8d166e99635c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:46.869494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11fffad2-1ceb-45af-8d88-8d166e99635c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:46.870398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11fffad2-1ceb-45af-8d88-8d166e99635c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:46.871299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11fffad2-1ceb-45af-8d88-8d166e99635c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:46.872281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11fffad2-1ceb-45af-8d88-8d166e99635c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:46.873230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11fffad2-1ceb-45af-8d88-8d166e99635c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:46.874576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11fffad2-1ceb-45af-8d88-8d166e99635c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:47.636194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2379272b-73e9-443b-a775-9c6fe9d8cdb1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:47.649049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2379272b-73e9-443b-a775-9c6fe9d8cdb1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:47.664058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2379272b-73e9-443b-a775-9c6fe9d8cdb1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:47.679469 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2379272b-73e9-443b-a775-9c6fe9d8cdb1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.869286 Oct 24 10:39:47.687176 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1675/3434] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:46 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:47.716157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-11fffad2-1ceb-45af-8d88-8d166e99635c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:47.727376 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-11fffad2-1ceb-45af-8d88-8d166e99635c tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1538 microversion: 2.1 time: 0.881060 Oct 24 10:39:47.728905 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1760/3435] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:46 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1538 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:39:47.752804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a3ec252f-5607-42e6-bbff-985047fcbe93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:47.753579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a3ec252f-5607-42e6-bbff-985047fcbe93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:47.767352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3ec252f-5607-42e6-bbff-985047fcbe93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:47.767857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3ec252f-5607-42e6-bbff-985047fcbe93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:47.768299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3ec252f-5607-42e6-bbff-985047fcbe93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:47.773997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3ec252f-5607-42e6-bbff-985047fcbe93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:47.774789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3ec252f-5607-42e6-bbff-985047fcbe93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:47.775614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3ec252f-5607-42e6-bbff-985047fcbe93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:47.940516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a3ec252f-5607-42e6-bbff-985047fcbe93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:47.959324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a3ec252f-5607-42e6-bbff-985047fcbe93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:47.961721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a3ec252f-5607-42e6-bbff-985047fcbe93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:47.969132 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a3ec252f-5607-42e6-bbff-985047fcbe93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.239072 Oct 24 10:39:47.970578 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1761/3436] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:47 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:47.977946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e8424400-14b1-4d22-9262-4989ec259f21 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:47.978920 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e8424400-14b1-4d22-9262-4989ec259f21 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:47.993743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:47.997471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8424400-14b1-4d22-9262-4989ec259f21 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:47.998482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8424400-14b1-4d22-9262-4989ec259f21 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:47.999671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8424400-14b1-4d22-9262-4989ec259f21 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:48.004545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8424400-14b1-4d22-9262-4989ec259f21 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:48.011985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8424400-14b1-4d22-9262-4989ec259f21 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:48.012732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8424400-14b1-4d22-9262-4989ec259f21 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:48.101015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d3b47880-4b51-42d8-85ec-c38e4b2dbc21 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1162937534", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:48.216803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-d3b47880-4b51-42d8-85ec-c38e4b2dbc21 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] validate_networks() for [('2f404f10-8852-4540-8970-2699670e99c9', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:39:48.695045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e8424400-14b1-4d22-9262-4989ec259f21 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:48.705369 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e8424400-14b1-4d22-9262-4989ec259f21 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1510 microversion: 2.1 time: 0.733446 Oct 24 10:39:48.709581 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1762/3437] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:47 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1510 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:48.721750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aeeef60a-b5f5-4203-a5ce-1c1d76ec8f71 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:48.723918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aeeef60a-b5f5-4203-a5ce-1c1d76ec8f71 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:48.739401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aeeef60a-b5f5-4203-a5ce-1c1d76ec8f71 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:48.740290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aeeef60a-b5f5-4203-a5ce-1c1d76ec8f71 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:48.740992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aeeef60a-b5f5-4203-a5ce-1c1d76ec8f71 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:48.744802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aeeef60a-b5f5-4203-a5ce-1c1d76ec8f71 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:48.745673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aeeef60a-b5f5-4203-a5ce-1c1d76ec8f71 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:48.746336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aeeef60a-b5f5-4203-a5ce-1c1d76ec8f71 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:50.191147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aeeef60a-b5f5-4203-a5ce-1c1d76ec8f71 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:50.214732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aeeef60a-b5f5-4203-a5ce-1c1d76ec8f71 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:50.218762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aeeef60a-b5f5-4203-a5ce-1c1d76ec8f71 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:50.223503 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aeeef60a-b5f5-4203-a5ce-1c1d76ec8f71 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 1.510589 Oct 24 10:39:50.224105 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1763/3438] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:48 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:50.238768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b7b4b8b1-69f1-4e7f-bb5b-350cdf10dceb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:50.240064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b7b4b8b1-69f1-4e7f-bb5b-350cdf10dceb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:50.259513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7b4b8b1-69f1-4e7f-bb5b-350cdf10dceb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:50.262087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7b4b8b1-69f1-4e7f-bb5b-350cdf10dceb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:50.263495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7b4b8b1-69f1-4e7f-bb5b-350cdf10dceb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:50.269125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7b4b8b1-69f1-4e7f-bb5b-350cdf10dceb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:50.270019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7b4b8b1-69f1-4e7f-bb5b-350cdf10dceb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:50.270911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7b4b8b1-69f1-4e7f-bb5b-350cdf10dceb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:50.565318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d3b47880-4b51-42d8-85ec-c38e4b2dbc21 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:39:50.565849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d3b47880-4b51-42d8-85ec-c38e4b2dbc21 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:39:50.566328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d3b47880-4b51-42d8-85ec-c38e4b2dbc21 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:39:50.566743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d3b47880-4b51-42d8-85ec-c38e4b2dbc21 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:39:50.567272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d3b47880-4b51-42d8-85ec-c38e4b2dbc21 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:39:50.597091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3b47880-4b51-42d8-85ec-c38e4b2dbc21 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:50.597950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3b47880-4b51-42d8-85ec-c38e4b2dbc21 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:50.598586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3b47880-4b51-42d8-85ec-c38e4b2dbc21 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:50.601995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3b47880-4b51-42d8-85ec-c38e4b2dbc21 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:50.602719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3b47880-4b51-42d8-85ec-c38e4b2dbc21 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:50.604409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3b47880-4b51-42d8-85ec-c38e4b2dbc21 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:50.631306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b7b4b8b1-69f1-4e7f-bb5b-350cdf10dceb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:50.643384 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b7b4b8b1-69f1-4e7f-bb5b-350cdf10dceb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1538 microversion: 2.1 time: 0.417697 Oct 24 10:39:50.646201 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1764/3439] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:50 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1538 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:50.654105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-d3b47880-4b51-42d8-85ec-c38e4b2dbc21 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Getting quotas for project f906dc4e8ae44a1c8af9906fc14e28b1. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:39:50.656641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-30005fb0-9bfb-4c25-bf69-19dbd46a05de tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:50.657655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-30005fb0-9bfb-4c25-bf69-19dbd46a05de tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:50.661091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-d3b47880-4b51-42d8-85ec-c38e4b2dbc21 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Getting quotas for user 51c4584d7b5948358fef63edcf40667d and project f906dc4e8ae44a1c8af9906fc14e28b1. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:39:50.673408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30005fb0-9bfb-4c25-bf69-19dbd46a05de tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:50.678259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30005fb0-9bfb-4c25-bf69-19dbd46a05de tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:50.679680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30005fb0-9bfb-4c25-bf69-19dbd46a05de tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:50.680953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30005fb0-9bfb-4c25-bf69-19dbd46a05de tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:50.684257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30005fb0-9bfb-4c25-bf69-19dbd46a05de tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:50.685093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30005fb0-9bfb-4c25-bf69-19dbd46a05de tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:50.721356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d3b47880-4b51-42d8-85ec-c38e4b2dbc21 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:39:50.723592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d3b47880-4b51-42d8-85ec-c38e4b2dbc21 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:39:50.846958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-30005fb0-9bfb-4c25-bf69-19dbd46a05de tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:50.852163 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d3b47880-4b51-42d8-85ec-c38e4b2dbc21 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.163271 Oct 24 10:39:50.856363 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1676/3440] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:39:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 3168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:39:50.864117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-30005fb0-9bfb-4c25-bf69-19dbd46a05de tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:50.867261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a5ab4cd0-3110-4888-ba76-01fc329d3f65 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:50.871170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-30005fb0-9bfb-4c25-bf69-19dbd46a05de tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:50.877099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a5ab4cd0-3110-4888-ba76-01fc329d3f65 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:50.890239 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-30005fb0-9bfb-4c25-bf69-19dbd46a05de tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.238196 Oct 24 10:39:50.890841 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1765/3441] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:50 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:50.895826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5ab4cd0-3110-4888-ba76-01fc329d3f65 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:50.896635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5ab4cd0-3110-4888-ba76-01fc329d3f65 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:50.897461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5ab4cd0-3110-4888-ba76-01fc329d3f65 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:50.898416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5ab4cd0-3110-4888-ba76-01fc329d3f65 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:50.899093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5ab4cd0-3110-4888-ba76-01fc329d3f65 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:50.899412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c9607274-3ab1-4a29-a989-cd0204ce6751 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:50.900044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c9607274-3ab1-4a29-a989-cd0204ce6751 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:50.900296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5ab4cd0-3110-4888-ba76-01fc329d3f65 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:51.131460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c9607274-3ab1-4a29-a989-cd0204ce6751 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:51.157253 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c9607274-3ab1-4a29-a989-cd0204ce6751 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1223 microversion: 2.1 time: 0.249803 Oct 24 10:39:51.157941 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1766/3442] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:50 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1223 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:51.252260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ab695743-176e-4b50-a1c9-ca92b6feedc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:51.253060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ab695743-176e-4b50-a1c9-ca92b6feedc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:51.266870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab695743-176e-4b50-a1c9-ca92b6feedc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:51.269224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab695743-176e-4b50-a1c9-ca92b6feedc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:51.270931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab695743-176e-4b50-a1c9-ca92b6feedc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:51.274880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab695743-176e-4b50-a1c9-ca92b6feedc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:51.275957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab695743-176e-4b50-a1c9-ca92b6feedc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:51.280161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab695743-176e-4b50-a1c9-ca92b6feedc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:51.668093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a5ab4cd0-3110-4888-ba76-01fc329d3f65 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:51.682314 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a5ab4cd0-3110-4888-ba76-01fc329d3f65 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1510 microversion: 2.1 time: 0.824723 Oct 24 10:39:51.689779 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1677/3443] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:50 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1510 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:51.734143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68cb51e5-270d-4be1-a79b-2749e49a939a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:51.740510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-68cb51e5-270d-4be1-a79b-2749e49a939a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:51.758790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68cb51e5-270d-4be1-a79b-2749e49a939a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:51.760326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68cb51e5-270d-4be1-a79b-2749e49a939a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:51.762902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68cb51e5-270d-4be1-a79b-2749e49a939a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:51.764474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68cb51e5-270d-4be1-a79b-2749e49a939a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:51.767766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68cb51e5-270d-4be1-a79b-2749e49a939a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:51.769479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68cb51e5-270d-4be1-a79b-2749e49a939a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:52.012608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ab695743-176e-4b50-a1c9-ca92b6feedc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:52.075257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ab695743-176e-4b50-a1c9-ca92b6feedc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:52.082964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ab695743-176e-4b50-a1c9-ca92b6feedc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:52.091612 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ab695743-176e-4b50-a1c9-ca92b6feedc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.840716 Oct 24 10:39:52.093950 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1767/3444] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:51 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:39:52.106995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0e69f5b1-c185-4540-bf7a-82da44bff8f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:52.109290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0e69f5b1-c185-4540-bf7a-82da44bff8f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:52.145077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e69f5b1-c185-4540-bf7a-82da44bff8f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:52.152003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e69f5b1-c185-4540-bf7a-82da44bff8f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:52.154642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e69f5b1-c185-4540-bf7a-82da44bff8f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:52.157909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e69f5b1-c185-4540-bf7a-82da44bff8f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:52.158434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e69f5b1-c185-4540-bf7a-82da44bff8f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:52.160607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e69f5b1-c185-4540-bf7a-82da44bff8f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:52.486443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0e69f5b1-c185-4540-bf7a-82da44bff8f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:52.498726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0e69f5b1-c185-4540-bf7a-82da44bff8f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:52.502220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0e69f5b1-c185-4540-bf7a-82da44bff8f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:52.524092 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0e69f5b1-c185-4540-bf7a-82da44bff8f2 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.428709 Oct 24 10:39:52.531382 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1768/3445] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:52 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:52.547923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-511b7803-d138-4ba8-ba13-3ff1ac05c1d7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:52.552200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-511b7803-d138-4ba8-ba13-3ff1ac05c1d7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:52.578659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-511b7803-d138-4ba8-ba13-3ff1ac05c1d7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:52.581782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-511b7803-d138-4ba8-ba13-3ff1ac05c1d7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:52.583531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-511b7803-d138-4ba8-ba13-3ff1ac05c1d7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:52.585593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-511b7803-d138-4ba8-ba13-3ff1ac05c1d7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:52.587806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-511b7803-d138-4ba8-ba13-3ff1ac05c1d7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:52.592699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-511b7803-d138-4ba8-ba13-3ff1ac05c1d7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:52.809795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-511b7803-d138-4ba8-ba13-3ff1ac05c1d7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:52.821952 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-511b7803-d138-4ba8-ba13-3ff1ac05c1d7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1275 microversion: 2.1 time: 0.289041 Oct 24 10:39:52.822566 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1769/3446] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:52 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1275 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:52.833476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-762b4ba8-96cf-4245-a36e-e2c5627da934 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:52.843485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-762b4ba8-96cf-4245-a36e-e2c5627da934 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:52.847634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-68cb51e5-270d-4be1-a79b-2749e49a939a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:52.861681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-762b4ba8-96cf-4245-a36e-e2c5627da934 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:52.863522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-762b4ba8-96cf-4245-a36e-e2c5627da934 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:52.864172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-762b4ba8-96cf-4245-a36e-e2c5627da934 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:52.867265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-762b4ba8-96cf-4245-a36e-e2c5627da934 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:52.868091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-762b4ba8-96cf-4245-a36e-e2c5627da934 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:52.868710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-762b4ba8-96cf-4245-a36e-e2c5627da934 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:52.875962 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-68cb51e5-270d-4be1-a79b-2749e49a939a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1538 microversion: 2.1 time: 1.181513 Oct 24 10:39:52.880098 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1678/3447] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:51 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1538 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:53.089446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-762b4ba8-96cf-4245-a36e-e2c5627da934 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:53.100096 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-762b4ba8-96cf-4245-a36e-e2c5627da934 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1510 microversion: 2.1 time: 0.273293 Oct 24 10:39:53.101728 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1770/3448] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:52 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1510 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:53.129777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b8f6978d-597f-4e67-bcb1-b0af58770f5a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:53.130498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b8f6978d-597f-4e67-bcb1-b0af58770f5a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:53.157937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8f6978d-597f-4e67-bcb1-b0af58770f5a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:53.159163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8f6978d-597f-4e67-bcb1-b0af58770f5a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:53.161610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8f6978d-597f-4e67-bcb1-b0af58770f5a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:53.165237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8f6978d-597f-4e67-bcb1-b0af58770f5a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:53.166075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8f6978d-597f-4e67-bcb1-b0af58770f5a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:53.169428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8f6978d-597f-4e67-bcb1-b0af58770f5a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:53.572645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c3f84427-ce80-4c7e-a1c9-e6bd2c3caed0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:53.575577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c3f84427-ce80-4c7e-a1c9-e6bd2c3caed0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:53.599185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3f84427-ce80-4c7e-a1c9-e6bd2c3caed0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:53.599703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3f84427-ce80-4c7e-a1c9-e6bd2c3caed0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:53.602395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3f84427-ce80-4c7e-a1c9-e6bd2c3caed0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:53.604971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3f84427-ce80-4c7e-a1c9-e6bd2c3caed0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:53.606341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3f84427-ce80-4c7e-a1c9-e6bd2c3caed0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:53.608022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3f84427-ce80-4c7e-a1c9-e6bd2c3caed0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:53.867243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c3f84427-ce80-4c7e-a1c9-e6bd2c3caed0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:53.887710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c3f84427-ce80-4c7e-a1c9-e6bd2c3caed0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:53.896231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c3f84427-ce80-4c7e-a1c9-e6bd2c3caed0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:53.924094 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c3f84427-ce80-4c7e-a1c9-e6bd2c3caed0 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.349107 Oct 24 10:39:53.941099 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1771/3449] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:53 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:53.941243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b8f6978d-597f-4e67-bcb1-b0af58770f5a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:53.941711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1d6336c5-20a8-4c6d-af1c-3466032dc963 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:53.941816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b8f6978d-597f-4e67-bcb1-b0af58770f5a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:53.950889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1d6336c5-20a8-4c6d-af1c-3466032dc963 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:53.953492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b8f6978d-597f-4e67-bcb1-b0af58770f5a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:53.955050 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b8f6978d-597f-4e67-bcb1-b0af58770f5a tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.832178 Oct 24 10:39:53.956106 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1679/3450] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:53 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:53.967602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-41e063f6-5a73-4e87-8f45-16faf2737587 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:53.968562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-41e063f6-5a73-4e87-8f45-16faf2737587 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:53.985469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d6336c5-20a8-4c6d-af1c-3466032dc963 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:53.985929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d6336c5-20a8-4c6d-af1c-3466032dc963 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:53.986459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41e063f6-5a73-4e87-8f45-16faf2737587 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:53.987422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41e063f6-5a73-4e87-8f45-16faf2737587 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:53.988452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41e063f6-5a73-4e87-8f45-16faf2737587 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:53.990619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d6336c5-20a8-4c6d-af1c-3466032dc963 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:53.991821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d6336c5-20a8-4c6d-af1c-3466032dc963 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:53.992596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d6336c5-20a8-4c6d-af1c-3466032dc963 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:53.992790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41e063f6-5a73-4e87-8f45-16faf2737587 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:53.993313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41e063f6-5a73-4e87-8f45-16faf2737587 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:53.993755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41e063f6-5a73-4e87-8f45-16faf2737587 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:53.994361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d6336c5-20a8-4c6d-af1c-3466032dc963 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:54.000518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:54.269532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1d6336c5-20a8-4c6d-af1c-3466032dc963 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:54.297042 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1d6336c5-20a8-4c6d-af1c-3466032dc963 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1281 microversion: 2.1 time: 0.366146 Oct 24 10:39:54.321617 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1772/3451] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:53 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1281 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:54.337728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d8188eb4-8c74-4d74-8327-d23cb0daf434 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:54.338518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d8188eb4-8c74-4d74-8327-d23cb0daf434 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:54.370716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8188eb4-8c74-4d74-8327-d23cb0daf434 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:54.372459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8188eb4-8c74-4d74-8327-d23cb0daf434 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:54.375682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8188eb4-8c74-4d74-8327-d23cb0daf434 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:54.376849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8188eb4-8c74-4d74-8327-d23cb0daf434 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:54.384435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8188eb4-8c74-4d74-8327-d23cb0daf434 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:54.387145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8188eb4-8c74-4d74-8327-d23cb0daf434 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:54.701481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-41e063f6-5a73-4e87-8f45-16faf2737587 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:54.715490 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-41e063f6-5a73-4e87-8f45-16faf2737587 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1520 microversion: 2.1 time: 0.758152 Oct 24 10:39:54.722031 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1680/3452] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:53 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1520 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:54.750511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b18b2c01-2613-4a8f-9676-04a1e598cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:54.753611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b18b2c01-2613-4a8f-9676-04a1e598cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:54.780251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b18b2c01-2613-4a8f-9676-04a1e598cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:54.784432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b18b2c01-2613-4a8f-9676-04a1e598cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:54.784867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b18b2c01-2613-4a8f-9676-04a1e598cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:54.785644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b18b2c01-2613-4a8f-9676-04a1e598cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:54.786102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b18b2c01-2613-4a8f-9676-04a1e598cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:54.786539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b18b2c01-2613-4a8f-9676-04a1e598cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:54.845139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d8188eb4-8c74-4d74-8327-d23cb0daf434 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:54.854467 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d8188eb4-8c74-4d74-8327-d23cb0daf434 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1510 microversion: 2.1 time: 0.531495 Oct 24 10:39:54.855063 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1773/3453] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:54 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1510 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:54.911922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b18b2c01-2613-4a8f-9676-04a1e598cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:39:54.963814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2f2b7a6d-5457-4237-ac98-50062bd31374 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:54.964697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2f2b7a6d-5457-4237-ac98-50062bd31374 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:54.974624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f2b7a6d-5457-4237-ac98-50062bd31374 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:54.983853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f2b7a6d-5457-4237-ac98-50062bd31374 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:54.984601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f2b7a6d-5457-4237-ac98-50062bd31374 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:54.985550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f2b7a6d-5457-4237-ac98-50062bd31374 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:54.993620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f2b7a6d-5457-4237-ac98-50062bd31374 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:54.994331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f2b7a6d-5457-4237-ac98-50062bd31374 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:55.154506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:55.197268 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b18b2c01-2613-4a8f-9676-04a1e598cd2b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "DELETE /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 204 len: 0 microversion: 2.1 time: 0.452954 Oct 24 10:39:55.198278 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1681/3454] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:39:54 2022] DELETE /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 10:39:55.213842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-77c63b8e-c63f-4f22-b36f-ca62cd93382f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:55.215026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-77c63b8e-c63f-4f22-b36f-ca62cd93382f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:55.230879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2f2b7a6d-5457-4237-ac98-50062bd31374 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:55.231140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77c63b8e-c63f-4f22-b36f-ca62cd93382f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:55.232034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77c63b8e-c63f-4f22-b36f-ca62cd93382f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:55.232704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77c63b8e-c63f-4f22-b36f-ca62cd93382f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:55.234072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77c63b8e-c63f-4f22-b36f-ca62cd93382f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:55.235430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77c63b8e-c63f-4f22-b36f-ca62cd93382f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:55.236077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77c63b8e-c63f-4f22-b36f-ca62cd93382f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:55.239582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2f2b7a6d-5457-4237-ac98-50062bd31374 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:55.258950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2f2b7a6d-5457-4237-ac98-50062bd31374 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:55.272047 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2f2b7a6d-5457-4237-ac98-50062bd31374 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.313509 Oct 24 10:39:55.283460 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1774/3455] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:54 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:55.293494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c8a564a8-0b44-49ba-9e44-6e65537b4f87 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:55.296776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c8a564a8-0b44-49ba-9e44-6e65537b4f87 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:55.318863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8a564a8-0b44-49ba-9e44-6e65537b4f87 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:55.319798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8a564a8-0b44-49ba-9e44-6e65537b4f87 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:55.320410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8a564a8-0b44-49ba-9e44-6e65537b4f87 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:55.324611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8a564a8-0b44-49ba-9e44-6e65537b4f87 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:55.333594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8a564a8-0b44-49ba-9e44-6e65537b4f87 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:55.334431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8a564a8-0b44-49ba-9e44-6e65537b4f87 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:55.687397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c8a564a8-0b44-49ba-9e44-6e65537b4f87 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:55.702400 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c8a564a8-0b44-49ba-9e44-6e65537b4f87 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1526 microversion: 2.1 time: 0.417319 Oct 24 10:39:55.716863 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1775/3456] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:55 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1526 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:55.717518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-43530e47-9afe-4178-a144-7c2bf414cb79 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:55.717686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-43530e47-9afe-4178-a144-7c2bf414cb79 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:55.743831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43530e47-9afe-4178-a144-7c2bf414cb79 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:55.746740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43530e47-9afe-4178-a144-7c2bf414cb79 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:55.747313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43530e47-9afe-4178-a144-7c2bf414cb79 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:55.748346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43530e47-9afe-4178-a144-7c2bf414cb79 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:55.751320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43530e47-9afe-4178-a144-7c2bf414cb79 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:55.753638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43530e47-9afe-4178-a144-7c2bf414cb79 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:55.759189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-77c63b8e-c63f-4f22-b36f-ca62cd93382f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:55.770273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-77c63b8e-c63f-4f22-b36f-ca62cd93382f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:55.792619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-77c63b8e-c63f-4f22-b36f-ca62cd93382f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:55.796743 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-77c63b8e-c63f-4f22-b36f-ca62cd93382f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.597065 Oct 24 10:39:55.800747 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1682/3457] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:55 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:55.870432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-43530e47-9afe-4178-a144-7c2bf414cb79 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:55.881080 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-43530e47-9afe-4178-a144-7c2bf414cb79 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1281 microversion: 2.1 time: 0.174144 Oct 24 10:39:55.882992 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1776/3458] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:55 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1281 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:55.900970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9e27cd74-0ccb-4c7a-8821-eedfafc1f1c3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:55.901592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9e27cd74-0ccb-4c7a-8821-eedfafc1f1c3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:55.925681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e27cd74-0ccb-4c7a-8821-eedfafc1f1c3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:55.925936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e27cd74-0ccb-4c7a-8821-eedfafc1f1c3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:55.926694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e27cd74-0ccb-4c7a-8821-eedfafc1f1c3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:55.927737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e27cd74-0ccb-4c7a-8821-eedfafc1f1c3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:55.930178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e27cd74-0ccb-4c7a-8821-eedfafc1f1c3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:55.930823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e27cd74-0ccb-4c7a-8821-eedfafc1f1c3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:56.151892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9e27cd74-0ccb-4c7a-8821-eedfafc1f1c3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:56.159652 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9e27cd74-0ccb-4c7a-8821-eedfafc1f1c3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1510 microversion: 2.1 time: 0.277539 Oct 24 10:39:56.174215 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1683/3459] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:55 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1510 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:39:56.281195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-d3738f41-1f35-423c-9f91-c5d21c843325 req-d05c9437-4445-4996-a5d1-0f10e5d30a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27efcba4-7aac-4be7-890d-dc0baeff7a5d", "name": "network-vif-plugged", "status": "completed", "tag": "860912bd-1ba7-4863-b73c-e6b2649b53b8"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:56.299773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d3738f41-1f35-423c-9f91-c5d21c843325 req-d05c9437-4445-4996-a5d1-0f10e5d30a34 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:56.300747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d3738f41-1f35-423c-9f91-c5d21c843325 req-d05c9437-4445-4996-a5d1-0f10e5d30a34 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:56.301224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d3738f41-1f35-423c-9f91-c5d21c843325 req-d05c9437-4445-4996-a5d1-0f10e5d30a34 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:56.309416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d49b3224-efcb-4cf5-9944-70e59c26ba3e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:56.310424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d49b3224-efcb-4cf5-9944-70e59c26ba3e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:56.319796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d49b3224-efcb-4cf5-9944-70e59c26ba3e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:56.320384 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-d3738f41-1f35-423c-9f91-c5d21c843325 req-d05c9437-4445-4996-a5d1-0f10e5d30a34 service nova] Creating event network-vif-plugged:860912bd-1ba7-4863-b73c-e6b2649b53b8 for instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d on n-h1-858383-15 Oct 24 10:39:56.327945 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-d3738f41-1f35-423c-9f91-c5d21c843325 req-d05c9437-4445-4996-a5d1-0f10e5d30a34 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.252338 Oct 24 10:39:56.329011 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1777/3460] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:39:56.329286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d49b3224-efcb-4cf5-9944-70e59c26ba3e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:56.329762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d49b3224-efcb-4cf5-9944-70e59c26ba3e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:56.330520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d49b3224-efcb-4cf5-9944-70e59c26ba3e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:56.330996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d49b3224-efcb-4cf5-9944-70e59c26ba3e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:56.331432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d49b3224-efcb-4cf5-9944-70e59c26ba3e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:56.454498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d49b3224-efcb-4cf5-9944-70e59c26ba3e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:56.468174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d49b3224-efcb-4cf5-9944-70e59c26ba3e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:56.470852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d49b3224-efcb-4cf5-9944-70e59c26ba3e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:56.480634 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d49b3224-efcb-4cf5-9944-70e59c26ba3e tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.175420 Oct 24 10:39:56.482017 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1684/3461] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:56 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:56.732871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-93535db3-4c4a-4caf-90ea-e4e187549e09 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:56.733970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-93535db3-4c4a-4caf-90ea-e4e187549e09 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:56.741651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93535db3-4c4a-4caf-90ea-e4e187549e09 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:56.742561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93535db3-4c4a-4caf-90ea-e4e187549e09 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:56.743496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93535db3-4c4a-4caf-90ea-e4e187549e09 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:56.744477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93535db3-4c4a-4caf-90ea-e4e187549e09 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:56.745288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93535db3-4c4a-4caf-90ea-e4e187549e09 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:56.745836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93535db3-4c4a-4caf-90ea-e4e187549e09 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:56.836711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d05454aa-22f2-47b6-aa32-5da40d0b8dc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:56.838035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d05454aa-22f2-47b6-aa32-5da40d0b8dc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:56.856529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d05454aa-22f2-47b6-aa32-5da40d0b8dc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:56.857609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d05454aa-22f2-47b6-aa32-5da40d0b8dc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:56.858311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d05454aa-22f2-47b6-aa32-5da40d0b8dc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:56.860690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d05454aa-22f2-47b6-aa32-5da40d0b8dc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:56.861512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d05454aa-22f2-47b6-aa32-5da40d0b8dc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:56.862253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d05454aa-22f2-47b6-aa32-5da40d0b8dc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:57.106740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-93535db3-4c4a-4caf-90ea-e4e187549e09 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:57.157031 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-93535db3-4c4a-4caf-90ea-e4e187549e09 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1526 microversion: 2.1 time: 0.424845 Oct 24 10:39:57.162293 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1778/3462] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:56 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1526 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:57.179594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4bd8b12c-9d28-499f-8a1a-75512c018fb6 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:57.180914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4bd8b12c-9d28-499f-8a1a-75512c018fb6 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:57.198783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bd8b12c-9d28-499f-8a1a-75512c018fb6 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:57.203639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bd8b12c-9d28-499f-8a1a-75512c018fb6 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:57.206533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bd8b12c-9d28-499f-8a1a-75512c018fb6 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:57.208903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bd8b12c-9d28-499f-8a1a-75512c018fb6 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:57.211907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bd8b12c-9d28-499f-8a1a-75512c018fb6 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:57.215438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bd8b12c-9d28-499f-8a1a-75512c018fb6 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:57.686412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d05454aa-22f2-47b6-aa32-5da40d0b8dc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:57.706148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d05454aa-22f2-47b6-aa32-5da40d0b8dc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:57.713155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d05454aa-22f2-47b6-aa32-5da40d0b8dc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:57.715863 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d05454aa-22f2-47b6-aa32-5da40d0b8dc4 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.884963 Oct 24 10:39:57.718522 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1685/3463] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:56 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:39:57.731921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1529a43d-76cd-4334-be7e-a96cab286fdc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:57.737031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1529a43d-76cd-4334-be7e-a96cab286fdc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:57.750751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1529a43d-76cd-4334-be7e-a96cab286fdc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:57.752050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1529a43d-76cd-4334-be7e-a96cab286fdc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:57.758573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1529a43d-76cd-4334-be7e-a96cab286fdc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:57.759554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1529a43d-76cd-4334-be7e-a96cab286fdc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:57.760193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1529a43d-76cd-4334-be7e-a96cab286fdc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:57.760805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1529a43d-76cd-4334-be7e-a96cab286fdc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:58.143316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4bd8b12c-9d28-499f-8a1a-75512c018fb6 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:58.157601 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4bd8b12c-9d28-499f-8a1a-75512c018fb6 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1323 microversion: 2.1 time: 0.992572 Oct 24 10:39:58.160807 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1779/3464] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:57 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1323 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:58.187179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6e26b72d-05f3-4f07-ad71-60d3fddd3a30 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:58.187806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6e26b72d-05f3-4f07-ad71-60d3fddd3a30 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:58.204867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1529a43d-76cd-4334-be7e-a96cab286fdc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:58.228951 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1529a43d-76cd-4334-be7e-a96cab286fdc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1510 microversion: 2.1 time: 0.507425 Oct 24 10:39:58.247152 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1686/3465] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:57 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1510 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:58.247502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e26b72d-05f3-4f07-ad71-60d3fddd3a30 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:58.249709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e26b72d-05f3-4f07-ad71-60d3fddd3a30 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:58.253345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e26b72d-05f3-4f07-ad71-60d3fddd3a30 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:58.254119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e26b72d-05f3-4f07-ad71-60d3fddd3a30 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:58.259343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-81fcb739-fd71-4257-9f70-de1fe939264e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:58.262020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e26b72d-05f3-4f07-ad71-60d3fddd3a30 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:58.264792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e26b72d-05f3-4f07-ad71-60d3fddd3a30 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:58.265150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-81fcb739-fd71-4257-9f70-de1fe939264e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:58.279562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81fcb739-fd71-4257-9f70-de1fe939264e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:58.286194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81fcb739-fd71-4257-9f70-de1fe939264e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:58.289106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81fcb739-fd71-4257-9f70-de1fe939264e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:58.295643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81fcb739-fd71-4257-9f70-de1fe939264e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:58.296176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81fcb739-fd71-4257-9f70-de1fe939264e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:58.297721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81fcb739-fd71-4257-9f70-de1fe939264e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:58.494757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e26b72d-05f3-4f07-ad71-60d3fddd3a30 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:58.510924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e26b72d-05f3-4f07-ad71-60d3fddd3a30 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:58.523968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e26b72d-05f3-4f07-ad71-60d3fddd3a30 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:58.539571 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6e26b72d-05f3-4f07-ad71-60d3fddd3a30 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.374629 Oct 24 10:39:58.540645 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1780/3466] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:58 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:39:58.552887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-f75451fc-e0e8-4147-b369-4943ac4baa69 req-01594270-26e7-408f-99ab-76024dbd4e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27efcba4-7aac-4be7-890d-dc0baeff7a5d", "name": "network-vif-unplugged", "status": "completed", "tag": "860912bd-1ba7-4863-b73c-e6b2649b53b8"}, {"server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "name": "network-vif-plugged", "status": "completed", "tag": "718e738e-bf66-4482-a3d8-5ddfccb459f6"}, {"server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "name": "network-vif-plugged", "status": "completed", "tag": "5c925253-c5f1-4fd7-94c7-b873209b466a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:58.584544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f75451fc-e0e8-4147-b369-4943ac4baa69 req-01594270-26e7-408f-99ab-76024dbd4e8c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:58.586407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f75451fc-e0e8-4147-b369-4943ac4baa69 req-01594270-26e7-408f-99ab-76024dbd4e8c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:58.587709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f75451fc-e0e8-4147-b369-4943ac4baa69 req-01594270-26e7-408f-99ab-76024dbd4e8c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:58.637346 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f75451fc-e0e8-4147-b369-4943ac4baa69 req-01594270-26e7-408f-99ab-76024dbd4e8c service nova] Creating event network-vif-unplugged:860912bd-1ba7-4863-b73c-e6b2649b53b8 for instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d on n-h1-858383-15 Oct 24 10:39:58.637931 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f75451fc-e0e8-4147-b369-4943ac4baa69 req-01594270-26e7-408f-99ab-76024dbd4e8c service nova] Creating event network-vif-plugged:718e738e-bf66-4482-a3d8-5ddfccb459f6 for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:39:58.638446 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f75451fc-e0e8-4147-b369-4943ac4baa69 req-01594270-26e7-408f-99ab-76024dbd4e8c service nova] Creating event network-vif-plugged:5c925253-c5f1-4fd7-94c7-b873209b466a for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:39:58.657570 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-f75451fc-e0e8-4147-b369-4943ac4baa69 req-01594270-26e7-408f-99ab-76024dbd4e8c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.108085 Oct 24 10:39:58.659325 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1781/3467] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:39:58.760018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0141ad39-4a56-4a52-9d1b-0124e06f9502 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:58.762953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0141ad39-4a56-4a52-9d1b-0124e06f9502 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:58.784575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0141ad39-4a56-4a52-9d1b-0124e06f9502 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:58.786032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0141ad39-4a56-4a52-9d1b-0124e06f9502 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:58.789954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0141ad39-4a56-4a52-9d1b-0124e06f9502 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:58.793478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0141ad39-4a56-4a52-9d1b-0124e06f9502 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:58.795485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0141ad39-4a56-4a52-9d1b-0124e06f9502 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:58.797757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0141ad39-4a56-4a52-9d1b-0124e06f9502 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:58.814635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-81fcb739-fd71-4257-9f70-de1fe939264e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:58.827574 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-81fcb739-fd71-4257-9f70-de1fe939264e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1526 microversion: 2.1 time: 0.583678 Oct 24 10:39:58.836205 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1687/3468] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:58 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1526 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:59.049594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e698751c-9b3b-438a-8ab4-67eea3dcc424 req-4e8355cb-062c-463d-befe-4f5ce582c456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a4302c3-6ad2-41af-94ec-649390645fa1", "tag": "d195e830-67e1-435c-98bc-d0ae1282481d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:39:59.089206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e698751c-9b3b-438a-8ab4-67eea3dcc424 req-4e8355cb-062c-463d-befe-4f5ce582c456 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:59.091068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e698751c-9b3b-438a-8ab4-67eea3dcc424 req-4e8355cb-062c-463d-befe-4f5ce582c456 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:59.092069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e698751c-9b3b-438a-8ab4-67eea3dcc424 req-4e8355cb-062c-463d-befe-4f5ce582c456 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:59.099440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:39:59.119023 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e698751c-9b3b-438a-8ab4-67eea3dcc424 req-4e8355cb-062c-463d-befe-4f5ce582c456 service nova] Creating event network-changed:d195e830-67e1-435c-98bc-d0ae1282481d for instance 8a4302c3-6ad2-41af-94ec-649390645fa1 on n-h2-858383-15 Oct 24 10:39:59.129000 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e698751c-9b3b-438a-8ab4-67eea3dcc424 req-4e8355cb-062c-463d-befe-4f5ce582c456 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092062 Oct 24 10:39:59.131460 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1688/3469] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:39:59.192716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9fa3f7a1-08d8-4b65-bd9c-94c3d7b5a658 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:59.193713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9fa3f7a1-08d8-4b65-bd9c-94c3d7b5a658 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:59.206879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fa3f7a1-08d8-4b65-bd9c-94c3d7b5a658 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:59.213458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fa3f7a1-08d8-4b65-bd9c-94c3d7b5a658 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:59.214225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fa3f7a1-08d8-4b65-bd9c-94c3d7b5a658 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:59.214916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fa3f7a1-08d8-4b65-bd9c-94c3d7b5a658 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:59.215402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fa3f7a1-08d8-4b65-bd9c-94c3d7b5a658 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:59.215842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fa3f7a1-08d8-4b65-bd9c-94c3d7b5a658 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:59.656926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0141ad39-4a56-4a52-9d1b-0124e06f9502 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:59.674708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0141ad39-4a56-4a52-9d1b-0124e06f9502 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:59.680347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0141ad39-4a56-4a52-9d1b-0124e06f9502 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:59.685130 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0141ad39-4a56-4a52-9d1b-0124e06f9502 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.930940 Oct 24 10:39:59.690307 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1782/3470] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:58 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:39:59.695949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4cc45b5c-6c8a-49ea-9a55-bf6080b58706 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:59.704493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4cc45b5c-6c8a-49ea-9a55-bf6080b58706 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:59.719187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4cc45b5c-6c8a-49ea-9a55-bf6080b58706 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:59.722060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4cc45b5c-6c8a-49ea-9a55-bf6080b58706 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:59.724036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4cc45b5c-6c8a-49ea-9a55-bf6080b58706 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:59.726529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4cc45b5c-6c8a-49ea-9a55-bf6080b58706 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:59.729312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4cc45b5c-6c8a-49ea-9a55-bf6080b58706 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:59.730657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4cc45b5c-6c8a-49ea-9a55-bf6080b58706 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:59.805014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9fa3f7a1-08d8-4b65-bd9c-94c3d7b5a658 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:39:59.831554 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9fa3f7a1-08d8-4b65-bd9c-94c3d7b5a658 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1323 microversion: 2.1 time: 0.645211 Oct 24 10:39:59.850551 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1689/3471] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:59 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1323 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:39:59.878567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-82a24e90-fde9-4bcb-b3b9-e35ab6537faa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:39:59.880219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-82a24e90-fde9-4bcb-b3b9-e35ab6537faa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:39:59.899720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82a24e90-fde9-4bcb-b3b9-e35ab6537faa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:59.900472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82a24e90-fde9-4bcb-b3b9-e35ab6537faa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:59.901337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82a24e90-fde9-4bcb-b3b9-e35ab6537faa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:39:59.903007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82a24e90-fde9-4bcb-b3b9-e35ab6537faa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:39:59.905140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82a24e90-fde9-4bcb-b3b9-e35ab6537faa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:39:59.906163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82a24e90-fde9-4bcb-b3b9-e35ab6537faa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:00.089616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-82a24e90-fde9-4bcb-b3b9-e35ab6537faa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:00.099879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-82a24e90-fde9-4bcb-b3b9-e35ab6537faa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:00.107875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-82a24e90-fde9-4bcb-b3b9-e35ab6537faa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:00.141593 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-82a24e90-fde9-4bcb-b3b9-e35ab6537faa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.283632 Oct 24 10:40:00.157278 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1690/3472] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:39:59 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:40:00.169889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-17bff83b-840e-47ea-a9af-0b77b8318597 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:00.170818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-17bff83b-840e-47ea-a9af-0b77b8318597 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:00.177433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17bff83b-840e-47ea-a9af-0b77b8318597 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:00.184095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17bff83b-840e-47ea-a9af-0b77b8318597 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:00.184917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17bff83b-840e-47ea-a9af-0b77b8318597 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:00.185914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17bff83b-840e-47ea-a9af-0b77b8318597 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:00.186592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17bff83b-840e-47ea-a9af-0b77b8318597 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:00.187226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17bff83b-840e-47ea-a9af-0b77b8318597 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:00.404328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4cc45b5c-6c8a-49ea-9a55-bf6080b58706 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:00.418135 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4cc45b5c-6c8a-49ea-9a55-bf6080b58706 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1510 microversion: 2.1 time: 0.726451 Oct 24 10:40:00.419045 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1783/3473] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:39:59 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1510 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:00.631166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:00.661870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-e19969be-1726-4e68-8c5e-b592dd975c8d req-51566ccc-5cc2-4307-86d9-c87825bbf97c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27efcba4-7aac-4be7-890d-dc0baeff7a5d", "name": "network-vif-deleted", "tag": "860912bd-1ba7-4863-b73c-e6b2649b53b8"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:00.691000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e19969be-1726-4e68-8c5e-b592dd975c8d req-51566ccc-5cc2-4307-86d9-c87825bbf97c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:00.691791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e19969be-1726-4e68-8c5e-b592dd975c8d req-51566ccc-5cc2-4307-86d9-c87825bbf97c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:00.692241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e19969be-1726-4e68-8c5e-b592dd975c8d req-51566ccc-5cc2-4307-86d9-c87825bbf97c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:00.703695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:00.731276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-17bff83b-840e-47ea-a9af-0b77b8318597 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:00.743226 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-17bff83b-840e-47ea-a9af-0b77b8318597 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1526 microversion: 2.1 time: 0.584356 Oct 24 10:40:00.743904 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-e19969be-1726-4e68-8c5e-b592dd975c8d req-51566ccc-5cc2-4307-86d9-c87825bbf97c service nova] Creating event network-vif-deleted:860912bd-1ba7-4863-b73c-e6b2649b53b8 for instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d on n-h1-858383-15 Oct 24 10:40:00.751533 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-e19969be-1726-4e68-8c5e-b592dd975c8d req-51566ccc-5cc2-4307-86d9-c87825bbf97c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093755 Oct 24 10:40:00.752652 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1691/3474] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:00 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1526 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:00.753436 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1784/3475] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:00.774010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8223647f-9e45-4b12-843b-a11e55e80305 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:00.777066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7319a498-1f35-403a-9cad-b73fbf70cc50 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:00.777704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8223647f-9e45-4b12-843b-a11e55e80305 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:00.777845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7319a498-1f35-403a-9cad-b73fbf70cc50 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:00.786336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7319a498-1f35-403a-9cad-b73fbf70cc50 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:00.787143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7319a498-1f35-403a-9cad-b73fbf70cc50 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:00.788456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7319a498-1f35-403a-9cad-b73fbf70cc50 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:00.789503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7319a498-1f35-403a-9cad-b73fbf70cc50 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:00.790352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7319a498-1f35-403a-9cad-b73fbf70cc50 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:00.791176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7319a498-1f35-403a-9cad-b73fbf70cc50 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:00.793238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8223647f-9e45-4b12-843b-a11e55e80305 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:00.797289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8223647f-9e45-4b12-843b-a11e55e80305 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:00.798101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8223647f-9e45-4b12-843b-a11e55e80305 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:00.803942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8223647f-9e45-4b12-843b-a11e55e80305 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:00.805223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8223647f-9e45-4b12-843b-a11e55e80305 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:00.805936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8223647f-9e45-4b12-843b-a11e55e80305 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:01.134563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7319a498-1f35-403a-9cad-b73fbf70cc50 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:01.145542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:01.177791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7319a498-1f35-403a-9cad-b73fbf70cc50 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:01.182234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7319a498-1f35-403a-9cad-b73fbf70cc50 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:01.189655 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7319a498-1f35-403a-9cad-b73fbf70cc50 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.434262 Oct 24 10:40:01.196103 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1785/3476] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:40:00 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:40:01.204243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aa9b91b2-ec0c-49a6-8a62-c4636923b3e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:01.206079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aa9b91b2-ec0c-49a6-8a62-c4636923b3e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:01.221901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa9b91b2-ec0c-49a6-8a62-c4636923b3e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:01.225792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa9b91b2-ec0c-49a6-8a62-c4636923b3e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:01.226630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa9b91b2-ec0c-49a6-8a62-c4636923b3e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:01.239942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa9b91b2-ec0c-49a6-8a62-c4636923b3e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:01.240455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa9b91b2-ec0c-49a6-8a62-c4636923b3e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:01.241329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa9b91b2-ec0c-49a6-8a62-c4636923b3e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:01.265945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8223647f-9e45-4b12-843b-a11e55e80305 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:01.282295 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8223647f-9e45-4b12-843b-a11e55e80305 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.522568 Oct 24 10:40:01.285630 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1692/3477] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:00 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:01.292590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b0c1b038-ec1c-4774-8512-a1ca6f2aba96 req-275d8190-6296-4206-872c-1fc2df8d6633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "name": "network-vif-plugged", "status": "completed", "tag": "ea2571c6-ad05-4432-860b-c122aa8355bc"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:01.307778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b0c1b038-ec1c-4774-8512-a1ca6f2aba96 req-275d8190-6296-4206-872c-1fc2df8d6633 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:01.309496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b0c1b038-ec1c-4774-8512-a1ca6f2aba96 req-275d8190-6296-4206-872c-1fc2df8d6633 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:01.310238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b0c1b038-ec1c-4774-8512-a1ca6f2aba96 req-275d8190-6296-4206-872c-1fc2df8d6633 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:01.339270 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b0c1b038-ec1c-4774-8512-a1ca6f2aba96 req-275d8190-6296-4206-872c-1fc2df8d6633 service nova] Creating event network-vif-plugged:ea2571c6-ad05-4432-860b-c122aa8355bc for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:40:01.355728 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b0c1b038-ec1c-4774-8512-a1ca6f2aba96 req-275d8190-6296-4206-872c-1fc2df8d6633 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068062 Oct 24 10:40:01.369232 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1693/3478] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:01.374858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-89d1e406-9712-4f76-b8ab-84fc2da24cb8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:01.375579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-89d1e406-9712-4f76-b8ab-84fc2da24cb8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:01.384393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89d1e406-9712-4f76-b8ab-84fc2da24cb8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:01.384925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89d1e406-9712-4f76-b8ab-84fc2da24cb8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:01.385379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89d1e406-9712-4f76-b8ab-84fc2da24cb8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:01.386665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89d1e406-9712-4f76-b8ab-84fc2da24cb8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:01.386665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89d1e406-9712-4f76-b8ab-84fc2da24cb8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:01.386985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89d1e406-9712-4f76-b8ab-84fc2da24cb8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:01.669960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-89d1e406-9712-4f76-b8ab-84fc2da24cb8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:01.682800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-89d1e406-9712-4f76-b8ab-84fc2da24cb8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:01.684349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-89d1e406-9712-4f76-b8ab-84fc2da24cb8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:01.718312 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-89d1e406-9712-4f76-b8ab-84fc2da24cb8 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.347657 Oct 24 10:40:01.719222 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1694/3479] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:40:01 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:40:01.724059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-422f96f0-375d-480a-9cb8-61877ec2737b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:01.734127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-422f96f0-375d-480a-9cb8-61877ec2737b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:01.760574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-422f96f0-375d-480a-9cb8-61877ec2737b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:01.761195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-422f96f0-375d-480a-9cb8-61877ec2737b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:01.761649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-422f96f0-375d-480a-9cb8-61877ec2737b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:01.762582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-422f96f0-375d-480a-9cb8-61877ec2737b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:01.763028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aa9b91b2-ec0c-49a6-8a62-c4636923b3e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:01.767137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-422f96f0-375d-480a-9cb8-61877ec2737b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:01.767848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-422f96f0-375d-480a-9cb8-61877ec2737b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:01.772453 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aa9b91b2-ec0c-49a6-8a62-c4636923b3e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1323 microversion: 2.1 time: 0.574232 Oct 24 10:40:01.785410 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1786/3480] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:01 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1323 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:01.825027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-44868e6c-f54d-4fae-b117-f80a5ac9f7c2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:01.839342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-44868e6c-f54d-4fae-b117-f80a5ac9f7c2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:01.860207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44868e6c-f54d-4fae-b117-f80a5ac9f7c2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:01.860738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44868e6c-f54d-4fae-b117-f80a5ac9f7c2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:01.861259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44868e6c-f54d-4fae-b117-f80a5ac9f7c2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:01.862007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44868e6c-f54d-4fae-b117-f80a5ac9f7c2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:01.862459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44868e6c-f54d-4fae-b117-f80a5ac9f7c2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:01.862890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44868e6c-f54d-4fae-b117-f80a5ac9f7c2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:02.306561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-422f96f0-375d-480a-9cb8-61877ec2737b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:02.318231 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-422f96f0-375d-480a-9cb8-61877ec2737b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.597695 Oct 24 10:40:02.335679 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1695/3481] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:01 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:02.347560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f6304652-a78c-43b7-8c6a-1217f42358c8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:02.351754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f6304652-a78c-43b7-8c6a-1217f42358c8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:02.360463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6304652-a78c-43b7-8c6a-1217f42358c8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:02.361002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6304652-a78c-43b7-8c6a-1217f42358c8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:02.361727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6304652-a78c-43b7-8c6a-1217f42358c8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:02.362697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6304652-a78c-43b7-8c6a-1217f42358c8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:02.363381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6304652-a78c-43b7-8c6a-1217f42358c8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:02.364053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6304652-a78c-43b7-8c6a-1217f42358c8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:02.366828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-44868e6c-f54d-4fae-b117-f80a5ac9f7c2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:02.375779 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-44868e6c-f54d-4fae-b117-f80a5ac9f7c2 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1510 microversion: 2.1 time: 0.585703 Oct 24 10:40:02.376379 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1787/3482] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:01 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1510 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:02.385495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8d75c264-e7e4-4dc4-adf0-9a52721d9a45 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:02.386365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8d75c264-e7e4-4dc4-adf0-9a52721d9a45 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:02.393694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d75c264-e7e4-4dc4-adf0-9a52721d9a45 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:02.394957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d75c264-e7e4-4dc4-adf0-9a52721d9a45 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:02.395647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d75c264-e7e4-4dc4-adf0-9a52721d9a45 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:02.396622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d75c264-e7e4-4dc4-adf0-9a52721d9a45 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:02.397912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d75c264-e7e4-4dc4-adf0-9a52721d9a45 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:02.399139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d75c264-e7e4-4dc4-adf0-9a52721d9a45 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:02.413947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6304652-a78c-43b7-8c6a-1217f42358c8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:02.414542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6304652-a78c-43b7-8c6a-1217f42358c8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:02.415079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6304652-a78c-43b7-8c6a-1217f42358c8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:02.415607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-f6304652-a78c-43b7-8c6a-1217f42358c8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lazy-loading 'fault' on Instance uuid 27efcba4-7aac-4be7-890d-dc0baeff7a5d {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:40:02.482266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f6304652-a78c-43b7-8c6a-1217f42358c8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:02.499493 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f6304652-a78c-43b7-8c6a-1217f42358c8 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1314 microversion: 2.1 time: 0.161587 Oct 24 10:40:02.502657 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1696/3483] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:02 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:02.513716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b99c82b1-623c-419a-a043-0db1203f16ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:02.515728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b99c82b1-623c-419a-a043-0db1203f16ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:02.525033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b99c82b1-623c-419a-a043-0db1203f16ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:02.525871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b99c82b1-623c-419a-a043-0db1203f16ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:02.526514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b99c82b1-623c-419a-a043-0db1203f16ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:02.527597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b99c82b1-623c-419a-a043-0db1203f16ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:02.528069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b99c82b1-623c-419a-a043-0db1203f16ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:02.528544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b99c82b1-623c-419a-a043-0db1203f16ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:02.765173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d75c264-e7e4-4dc4-adf0-9a52721d9a45 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:02.791312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d75c264-e7e4-4dc4-adf0-9a52721d9a45 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:02.795525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d75c264-e7e4-4dc4-adf0-9a52721d9a45 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:02.797114 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8d75c264-e7e4-4dc4-adf0-9a52721d9a45 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.419638 Oct 24 10:40:02.816310 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1788/3484] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:40:02 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:40:02.816310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2f721aee-d655-4c10-ba58-83554fb32b93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:02.816310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2f721aee-d655-4c10-ba58-83554fb32b93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:02.818859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f721aee-d655-4c10-ba58-83554fb32b93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:02.819685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f721aee-d655-4c10-ba58-83554fb32b93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:02.820720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f721aee-d655-4c10-ba58-83554fb32b93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:02.821065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f721aee-d655-4c10-ba58-83554fb32b93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:02.821530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f721aee-d655-4c10-ba58-83554fb32b93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:02.822136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f721aee-d655-4c10-ba58-83554fb32b93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:02.844499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b99c82b1-623c-419a-a043-0db1203f16ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:02.854427 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b99c82b1-623c-419a-a043-0db1203f16ad tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.350445 Oct 24 10:40:02.858300 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1697/3485] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:02 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:02.876617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b574a961-fe2a-4720-94ed-a8c298590c63 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:02.877711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b574a961-fe2a-4720-94ed-a8c298590c63 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:02.886079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b574a961-fe2a-4720-94ed-a8c298590c63 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:02.886697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b574a961-fe2a-4720-94ed-a8c298590c63 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:02.887405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b574a961-fe2a-4720-94ed-a8c298590c63 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:02.888132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b574a961-fe2a-4720-94ed-a8c298590c63 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:02.888614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b574a961-fe2a-4720-94ed-a8c298590c63 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:02.889069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b574a961-fe2a-4720-94ed-a8c298590c63 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:02.935926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2f721aee-d655-4c10-ba58-83554fb32b93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:02.946835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2f721aee-d655-4c10-ba58-83554fb32b93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:02.949136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2f721aee-d655-4c10-ba58-83554fb32b93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:02.956030 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2f721aee-d655-4c10-ba58-83554fb32b93 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.150375 Oct 24 10:40:02.956738 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1789/3486] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:40:02 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:40:02.983035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d9dc9d35-9146-4a8e-af98-9f3f7147dcba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:02.983983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d9dc9d35-9146-4a8e-af98-9f3f7147dcba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:02.991563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9dc9d35-9146-4a8e-af98-9f3f7147dcba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:02.992268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9dc9d35-9146-4a8e-af98-9f3f7147dcba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:02.992910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9dc9d35-9146-4a8e-af98-9f3f7147dcba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:02.994161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9dc9d35-9146-4a8e-af98-9f3f7147dcba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:02.994795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9dc9d35-9146-4a8e-af98-9f3f7147dcba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:02.995396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9dc9d35-9146-4a8e-af98-9f3f7147dcba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:03.360548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b574a961-fe2a-4720-94ed-a8c298590c63 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:03.373888 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b574a961-fe2a-4720-94ed-a8c298590c63 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1323 microversion: 2.1 time: 0.500153 Oct 24 10:40:03.376648 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1698/3487] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:02 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1323 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:03.395105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e162dbf0-d3d9-4f76-b0cf-7a88bb79f345 req-de3d72c8-896f-44b3-a5a4-5766b231bac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "name": "network-vif-plugged", "status": "completed", "tag": "00f84ee5-49b5-45e0-85df-7a095215e973"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:03.417140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e162dbf0-d3d9-4f76-b0cf-7a88bb79f345 req-de3d72c8-896f-44b3-a5a4-5766b231bac1 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:03.417726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e162dbf0-d3d9-4f76-b0cf-7a88bb79f345 req-de3d72c8-896f-44b3-a5a4-5766b231bac1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:03.418177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e162dbf0-d3d9-4f76-b0cf-7a88bb79f345 req-de3d72c8-896f-44b3-a5a4-5766b231bac1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:03.445725 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e162dbf0-d3d9-4f76-b0cf-7a88bb79f345 req-de3d72c8-896f-44b3-a5a4-5766b231bac1 service nova] Creating event network-vif-plugged:00f84ee5-49b5-45e0-85df-7a095215e973 for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:40:03.456345 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e162dbf0-d3d9-4f76-b0cf-7a88bb79f345 req-de3d72c8-896f-44b3-a5a4-5766b231bac1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065014 Oct 24 10:40:03.458497 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1699/3488] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:40:03.466827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-87b059c6-75df-46a9-99f6-0673420a1e0a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:03.467777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-87b059c6-75df-46a9-99f6-0673420a1e0a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:03.475304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87b059c6-75df-46a9-99f6-0673420a1e0a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:03.476576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87b059c6-75df-46a9-99f6-0673420a1e0a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:03.477225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87b059c6-75df-46a9-99f6-0673420a1e0a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:03.479856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87b059c6-75df-46a9-99f6-0673420a1e0a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:03.480485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87b059c6-75df-46a9-99f6-0673420a1e0a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:03.481124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87b059c6-75df-46a9-99f6-0673420a1e0a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:03.542371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d9dc9d35-9146-4a8e-af98-9f3f7147dcba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:03.551067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:03.557039 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d9dc9d35-9146-4a8e-af98-9f3f7147dcba tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.577055 Oct 24 10:40:03.558878 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1790/3489] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:02 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:03.565591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-61da7824-356a-43e3-a204-a901267904b5 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:03.566646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-61da7824-356a-43e3-a204-a901267904b5 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:03.577437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61da7824-356a-43e3-a204-a901267904b5 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:03.578344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61da7824-356a-43e3-a204-a901267904b5 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:03.579516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61da7824-356a-43e3-a204-a901267904b5 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:03.581895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61da7824-356a-43e3-a204-a901267904b5 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:03.582926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61da7824-356a-43e3-a204-a901267904b5 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:03.584204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61da7824-356a-43e3-a204-a901267904b5 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:03.675981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61da7824-356a-43e3-a204-a901267904b5 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:03.676506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61da7824-356a-43e3-a204-a901267904b5 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:03.676991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61da7824-356a-43e3-a204-a901267904b5 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:03.677558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-61da7824-356a-43e3-a204-a901267904b5 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lazy-loading 'fault' on Instance uuid 27efcba4-7aac-4be7-890d-dc0baeff7a5d {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:40:03.703179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-87b059c6-75df-46a9-99f6-0673420a1e0a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:03.717877 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-87b059c6-75df-46a9-99f6-0673420a1e0a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1510 microversion: 2.1 time: 0.255650 Oct 24 10:40:03.718836 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1700/3490] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:03 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1510 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:03.749595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-61da7824-356a-43e3-a204-a901267904b5 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:03.758611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09b4080e-665f-422b-8d62-c2fafbb1fd3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1248205815", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "4c723f9d-e03c-43f2-9281-1f2dfc935187"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:03.779581 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-61da7824-356a-43e3-a204-a901267904b5 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 200 len: 1314 microversion: 2.1 time: 0.218681 Oct 24 10:40:03.796561 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1791/3491] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:03 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:03.824595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cfa7f690-ad39-48d8-be9d-41101b97c1c7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:03.825544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cfa7f690-ad39-48d8-be9d-41101b97c1c7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:03.839447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfa7f690-ad39-48d8-be9d-41101b97c1c7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:03.840306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfa7f690-ad39-48d8-be9d-41101b97c1c7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:03.840582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfa7f690-ad39-48d8-be9d-41101b97c1c7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:03.841337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfa7f690-ad39-48d8-be9d-41101b97c1c7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:03.841829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfa7f690-ad39-48d8-be9d-41101b97c1c7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:03.842258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfa7f690-ad39-48d8-be9d-41101b97c1c7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:03.877566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-09b4080e-665f-422b-8d62-c2fafbb1fd3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] validate_networks() for [('4c723f9d-e03c-43f2-9281-1f2dfc935187', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:40:04.854076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cfa7f690-ad39-48d8-be9d-41101b97c1c7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:04.868665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cfa7f690-ad39-48d8-be9d-41101b97c1c7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:04.886913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cfa7f690-ad39-48d8-be9d-41101b97c1c7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:04.888956 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cfa7f690-ad39-48d8-be9d-41101b97c1c7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 1.068961 Oct 24 10:40:04.905376 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1792/3492] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:40:03 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:40:04.915217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c20b6f98-091c-49f0-8e43-80718aaf99fa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:04.916761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c20b6f98-091c-49f0-8e43-80718aaf99fa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:04.930051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c20b6f98-091c-49f0-8e43-80718aaf99fa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:04.937551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c20b6f98-091c-49f0-8e43-80718aaf99fa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:04.938500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c20b6f98-091c-49f0-8e43-80718aaf99fa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:04.940224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c20b6f98-091c-49f0-8e43-80718aaf99fa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:04.946665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c20b6f98-091c-49f0-8e43-80718aaf99fa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:04.947638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c20b6f98-091c-49f0-8e43-80718aaf99fa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:05.070016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c20b6f98-091c-49f0-8e43-80718aaf99fa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:05.082499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c20b6f98-091c-49f0-8e43-80718aaf99fa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:05.085196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c20b6f98-091c-49f0-8e43-80718aaf99fa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:05.093187 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c20b6f98-091c-49f0-8e43-80718aaf99fa tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.190976 Oct 24 10:40:05.110903 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1793/3493] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:40:04 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:40:05.147599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-891feec8-4f29-4782-8372-8207c4897bd9 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:05.148380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-891feec8-4f29-4782-8372-8207c4897bd9 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:05.191135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-891feec8-4f29-4782-8372-8207c4897bd9 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:05.191631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-891feec8-4f29-4782-8372-8207c4897bd9 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:05.192080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-891feec8-4f29-4782-8372-8207c4897bd9 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:05.192810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-891feec8-4f29-4782-8372-8207c4897bd9 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:05.196977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-891feec8-4f29-4782-8372-8207c4897bd9 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:05.197434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-891feec8-4f29-4782-8372-8207c4897bd9 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:05.597575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-09b4080e-665f-422b-8d62-c2fafbb1fd3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:40:05.598706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-09b4080e-665f-422b-8d62-c2fafbb1fd3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:40:05.599771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-09b4080e-665f-422b-8d62-c2fafbb1fd3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:40:05.601049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-09b4080e-665f-422b-8d62-c2fafbb1fd3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:40:05.601704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-09b4080e-665f-422b-8d62-c2fafbb1fd3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:40:05.612720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-891feec8-4f29-4782-8372-8207c4897bd9 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:05.621120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09b4080e-665f-422b-8d62-c2fafbb1fd3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:05.621908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09b4080e-665f-422b-8d62-c2fafbb1fd3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:05.622646 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-891feec8-4f29-4782-8372-8207c4897bd9 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1323 microversion: 2.1 time: 0.510587 Oct 24 10:40:05.623284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09b4080e-665f-422b-8d62-c2fafbb1fd3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:05.623967 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1794/3494] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:05 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1323 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:05.628093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09b4080e-665f-422b-8d62-c2fafbb1fd3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:05.628706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09b4080e-665f-422b-8d62-c2fafbb1fd3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:05.629137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c098e5fc-92aa-4d7a-ac5e-573e33c9deba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:05.629627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09b4080e-665f-422b-8d62-c2fafbb1fd3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:05.630651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c098e5fc-92aa-4d7a-ac5e-573e33c9deba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:05.637289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c098e5fc-92aa-4d7a-ac5e-573e33c9deba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:05.637979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c098e5fc-92aa-4d7a-ac5e-573e33c9deba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:05.638743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c098e5fc-92aa-4d7a-ac5e-573e33c9deba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:05.639645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c098e5fc-92aa-4d7a-ac5e-573e33c9deba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:05.640266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c098e5fc-92aa-4d7a-ac5e-573e33c9deba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:05.641245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c098e5fc-92aa-4d7a-ac5e-573e33c9deba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:05.673421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-09b4080e-665f-422b-8d62-c2fafbb1fd3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Getting quotas for project 4878c0e43a9d4db8ba5c6590b43624f0. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:40:05.690612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-09b4080e-665f-422b-8d62-c2fafbb1fd3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Getting quotas for user 45500f699a6f463b8755f0417b24151c and project 4878c0e43a9d4db8ba5c6590b43624f0. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:40:05.715964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09b4080e-665f-422b-8d62-c2fafbb1fd3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:40:05.719973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09b4080e-665f-422b-8d62-c2fafbb1fd3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:40:05.796662 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-09b4080e-665f-422b-8d62-c2fafbb1fd3a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.042552 Oct 24 10:40:05.797795 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1701/3495] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:40:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 10:40:05.820894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-08b59ee9-308c-4d28-b644-1b6ee4ffe341 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:05.826545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-08b59ee9-308c-4d28-b644-1b6ee4ffe341 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:05.837598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08b59ee9-308c-4d28-b644-1b6ee4ffe341 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:05.838495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08b59ee9-308c-4d28-b644-1b6ee4ffe341 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:05.839782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08b59ee9-308c-4d28-b644-1b6ee4ffe341 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:05.840780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08b59ee9-308c-4d28-b644-1b6ee4ffe341 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:05.841546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08b59ee9-308c-4d28-b644-1b6ee4ffe341 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:05.842313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08b59ee9-308c-4d28-b644-1b6ee4ffe341 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:05.866739 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-08b59ee9-308c-4d28-b644-1b6ee4ffe341 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] HTTP exception thrown: Instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d could not be found. Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-08b59ee9-308c-4d28-b644-1b6ee4ffe341 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Request method failure captured: Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d HTTP/1.1 Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmsZ6iCeMLTpciKzT-IOd-jSbp-Ock4X7vHFbSgox-iuMV2hxDyst1XnTlhe7a0yhnti-D3qlDTVLsDNpGHmdQxuIxzHTz6ZfOA3sAyV-nTFUvtxnUe0hLrgWnomxwn6YBZ-Qwy9VkVlCsoa7UEzkg7FPtyXY6LqjelB4oPUwFh9rLg Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5edfb6d8f84547399863eec5c89e6933", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 1f089833f359473ebfa681931e8ffc06 Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d could not be found. Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '27efcba4-7aac-4be7-890d-dc0baeff7a5d'} Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d could not be found. Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d could not be found. Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:05.869952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:05.875324 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:05.875324 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:05.875324 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:05.875324 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:05.875324 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:05.875324 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:05.875324 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d could not be found. Oct 24 10:40:05.875324 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:05.883049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-08b59ee9-308c-4d28-b644-1b6ee4ffe341 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Returning 404 to user: Instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:05.885131 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-08b59ee9-308c-4d28-b644-1b6ee4ffe341 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 404 len: 111 microversion: 2.1 time: 0.084882 Oct 24 10:40:05.897994 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1702/3496] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:05 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:40:05.926740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c098e5fc-92aa-4d7a-ac5e-573e33c9deba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:05.940025 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c098e5fc-92aa-4d7a-ac5e-573e33c9deba tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1510 microversion: 2.1 time: 0.314799 Oct 24 10:40:05.943306 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1795/3497] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:05 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1510 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:05.957390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-9e26b80e-c6b8-47ee-9db4-8a0dde6e13b1 req-7b438026-3766-425b-8fb3-d483b50dd077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "name": "network-vif-plugged", "status": "completed", "tag": "02b89d7c-b6a2-401d-89a3-9361e02645ab"}, {"server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "name": "network-vif-plugged", "status": "completed", "tag": "a9abbed7-ca02-4124-abca-3fe10fe22ee4"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:05.995361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9e26b80e-c6b8-47ee-9db4-8a0dde6e13b1 req-7b438026-3766-425b-8fb3-d483b50dd077 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:05.996128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9e26b80e-c6b8-47ee-9db4-8a0dde6e13b1 req-7b438026-3766-425b-8fb3-d483b50dd077 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:05.996805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9e26b80e-c6b8-47ee-9db4-8a0dde6e13b1 req-7b438026-3766-425b-8fb3-d483b50dd077 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:06.036586 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-9e26b80e-c6b8-47ee-9db4-8a0dde6e13b1 req-7b438026-3766-425b-8fb3-d483b50dd077 service nova] Creating event network-vif-plugged:02b89d7c-b6a2-401d-89a3-9361e02645ab for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:40:06.037202 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-9e26b80e-c6b8-47ee-9db4-8a0dde6e13b1 req-7b438026-3766-425b-8fb3-d483b50dd077 service nova] Creating event network-vif-plugged:a9abbed7-ca02-4124-abca-3fe10fe22ee4 for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:40:06.050964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b4fd6b10-86ff-4321-9fda-e8de1f4ab614 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-2433689", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "ff41b91b-118e-46eb-851c-6a8ee75889d3"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:06.065956 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-9e26b80e-c6b8-47ee-9db4-8a0dde6e13b1 req-7b438026-3766-425b-8fb3-d483b50dd077 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.118730 Oct 24 10:40:06.073195 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1796/3498] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:06.106593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-70909cc1-3273-4ef4-ab13-57025d4fe1fb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:06.114905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-70909cc1-3273-4ef4-ab13-57025d4fe1fb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:06.219425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-b4fd6b10-86ff-4321-9fda-e8de1f4ab614 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] validate_networks() for [('ff41b91b-118e-46eb-851c-6a8ee75889d3', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:40:06.226660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-70909cc1-3273-4ef4-ab13-57025d4fe1fb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:06.237167 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-70909cc1-3273-4ef4-ab13-57025d4fe1fb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1215 microversion: 2.1 time: 0.162423 Oct 24 10:40:06.255528 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1797/3499] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:06 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1215 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:06.263318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7042ddd2-401a-4f9a-b664-e9f355964ae3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:06.264443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7042ddd2-401a-4f9a-b664-e9f355964ae3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:06.276423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7042ddd2-401a-4f9a-b664-e9f355964ae3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:06.276423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7042ddd2-401a-4f9a-b664-e9f355964ae3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:06.276423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7042ddd2-401a-4f9a-b664-e9f355964ae3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:06.276423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7042ddd2-401a-4f9a-b664-e9f355964ae3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:06.277626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7042ddd2-401a-4f9a-b664-e9f355964ae3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:06.277626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7042ddd2-401a-4f9a-b664-e9f355964ae3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:06.917879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7042ddd2-401a-4f9a-b664-e9f355964ae3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:06.931857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7042ddd2-401a-4f9a-b664-e9f355964ae3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:06.933344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7042ddd2-401a-4f9a-b664-e9f355964ae3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:06.941027 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7042ddd2-401a-4f9a-b664-e9f355964ae3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.683953 Oct 24 10:40:06.958691 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1798/3500] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:40:06 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:40:06.968232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-27b37243-c5aa-484f-94fd-2c24a66f7e91 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:06.969225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-27b37243-c5aa-484f-94fd-2c24a66f7e91 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:06.976563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27b37243-c5aa-484f-94fd-2c24a66f7e91 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:06.977428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27b37243-c5aa-484f-94fd-2c24a66f7e91 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:06.978110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27b37243-c5aa-484f-94fd-2c24a66f7e91 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:06.979199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27b37243-c5aa-484f-94fd-2c24a66f7e91 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:06.979937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27b37243-c5aa-484f-94fd-2c24a66f7e91 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:06.980639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27b37243-c5aa-484f-94fd-2c24a66f7e91 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:07.119691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-27b37243-c5aa-484f-94fd-2c24a66f7e91 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:07.130702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-27b37243-c5aa-484f-94fd-2c24a66f7e91 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:07.135191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-27b37243-c5aa-484f-94fd-2c24a66f7e91 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:07.155624 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-27b37243-c5aa-484f-94fd-2c24a66f7e91 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.187963 Oct 24 10:40:07.156388 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1799/3501] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:40:06 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:40:07.167386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d07b25ab-812a-4f4b-a26d-002293cafa0b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1980584669", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:07.269913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-d07b25ab-812a-4f4b-a26d-002293cafa0b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] validate_networks() for [('f49ca961-6c05-4d39-9f58-83a1313d4b7d', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:40:07.338944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-b4fd6b10-86ff-4321-9fda-e8de1f4ab614 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:40:07.339518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-b4fd6b10-86ff-4321-9fda-e8de1f4ab614 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:40:07.340049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-b4fd6b10-86ff-4321-9fda-e8de1f4ab614 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:40:07.340627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-b4fd6b10-86ff-4321-9fda-e8de1f4ab614 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:40:07.341251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-b4fd6b10-86ff-4321-9fda-e8de1f4ab614 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:40:07.363460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4fd6b10-86ff-4321-9fda-e8de1f4ab614 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:07.364939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4fd6b10-86ff-4321-9fda-e8de1f4ab614 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:07.365404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4fd6b10-86ff-4321-9fda-e8de1f4ab614 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:07.366881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4fd6b10-86ff-4321-9fda-e8de1f4ab614 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:07.367840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4fd6b10-86ff-4321-9fda-e8de1f4ab614 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:07.368772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4fd6b10-86ff-4321-9fda-e8de1f4ab614 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:07.395831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-b4fd6b10-86ff-4321-9fda-e8de1f4ab614 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Getting quotas for project 090743f0fdd0463fbd220eebe9c67651. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:40:07.411032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-b4fd6b10-86ff-4321-9fda-e8de1f4ab614 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Getting quotas for user 418cfb97b2444502bedf855f9f147734 and project 090743f0fdd0463fbd220eebe9c67651. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:40:07.437879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b4fd6b10-86ff-4321-9fda-e8de1f4ab614 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:40:07.440129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b4fd6b10-86ff-4321-9fda-e8de1f4ab614 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:40:07.521506 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b4fd6b10-86ff-4321-9fda-e8de1f4ab614 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.621906 Oct 24 10:40:07.528812 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1703/3502] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:40:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:40:07.534388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ae38f6f1-0c4a-4ede-a3a3-91ef42902596 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:07.535085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ae38f6f1-0c4a-4ede-a3a3-91ef42902596 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:07.546447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae38f6f1-0c4a-4ede-a3a3-91ef42902596 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:07.547541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae38f6f1-0c4a-4ede-a3a3-91ef42902596 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:07.547997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae38f6f1-0c4a-4ede-a3a3-91ef42902596 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:07.575659 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae38f6f1-0c4a-4ede-a3a3-91ef42902596 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:07.576198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae38f6f1-0c4a-4ede-a3a3-91ef42902596 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:07.576657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae38f6f1-0c4a-4ede-a3a3-91ef42902596 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:07.985380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ae38f6f1-0c4a-4ede-a3a3-91ef42902596 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:07.997483 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ae38f6f1-0c4a-4ede-a3a3-91ef42902596 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1323 microversion: 2.1 time: 0.470744 Oct 24 10:40:08.002634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d07b25ab-812a-4f4b-a26d-002293cafa0b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:40:08.003635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d07b25ab-812a-4f4b-a26d-002293cafa0b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:40:08.004629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d07b25ab-812a-4f4b-a26d-002293cafa0b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:40:08.005323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d07b25ab-812a-4f4b-a26d-002293cafa0b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:40:08.005966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d07b25ab-812a-4f4b-a26d-002293cafa0b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:40:08.010980 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1704/3503] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:07 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1323 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:08.015474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:08.024991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d07b25ab-812a-4f4b-a26d-002293cafa0b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:08.025845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d07b25ab-812a-4f4b-a26d-002293cafa0b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:08.026538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d07b25ab-812a-4f4b-a26d-002293cafa0b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:08.027544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d07b25ab-812a-4f4b-a26d-002293cafa0b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:08.028255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d07b25ab-812a-4f4b-a26d-002293cafa0b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:08.028977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d07b25ab-812a-4f4b-a26d-002293cafa0b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:08.037501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0be05402-a193-483d-9451-9250c8e23188 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:08.038165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0be05402-a193-483d-9451-9250c8e23188 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:08.051040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d07b25ab-812a-4f4b-a26d-002293cafa0b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Getting quotas for project 5edfb6d8f84547399863eec5c89e6933. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:40:08.059556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d07b25ab-812a-4f4b-a26d-002293cafa0b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Getting quotas for user 1f089833f359473ebfa681931e8ffc06 and project 5edfb6d8f84547399863eec5c89e6933. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:40:08.065797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0be05402-a193-483d-9451-9250c8e23188 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:08.066308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0be05402-a193-483d-9451-9250c8e23188 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:08.066763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0be05402-a193-483d-9451-9250c8e23188 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:08.067495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0be05402-a193-483d-9451-9250c8e23188 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:08.067964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0be05402-a193-483d-9451-9250c8e23188 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:08.078552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d07b25ab-812a-4f4b-a26d-002293cafa0b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:40:08.081467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d07b25ab-812a-4f4b-a26d-002293cafa0b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:40:08.086796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0be05402-a193-483d-9451-9250c8e23188 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:08.181320 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d07b25ab-812a-4f4b-a26d-002293cafa0b tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.023266 Oct 24 10:40:08.188776 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1800/3504] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:40:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:40:08.194862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5fec6c09-54ed-4d58-a683-05a29c2bf930 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:08.195847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5fec6c09-54ed-4d58-a683-05a29c2bf930 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:08.203674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fec6c09-54ed-4d58-a683-05a29c2bf930 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:08.204432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fec6c09-54ed-4d58-a683-05a29c2bf930 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:08.205297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fec6c09-54ed-4d58-a683-05a29c2bf930 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:08.206419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fec6c09-54ed-4d58-a683-05a29c2bf930 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:08.207118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fec6c09-54ed-4d58-a683-05a29c2bf930 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:08.208191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fec6c09-54ed-4d58-a683-05a29c2bf930 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:08.435245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5fec6c09-54ed-4d58-a683-05a29c2bf930 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:08.455929 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5fec6c09-54ed-4d58-a683-05a29c2bf930 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1219 microversion: 2.1 time: 0.260775 Oct 24 10:40:08.460278 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1801/3505] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:08 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1219 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:08.480399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8db1bb11-5395-4623-9c95-9cc47285a4d2 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:08.481077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8db1bb11-5395-4623-9c95-9cc47285a4d2 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:08.536351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0be05402-a193-483d-9451-9250c8e23188 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:08.549179 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0be05402-a193-483d-9451-9250c8e23188 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1510 microversion: 2.1 time: 0.528404 Oct 24 10:40:08.552170 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1705/3506] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:08 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1510 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:08.566381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-124ad591-329d-4cd6-bdfd-6432dec99230 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:08.567456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-124ad591-329d-4cd6-bdfd-6432dec99230 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:08.581236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-124ad591-329d-4cd6-bdfd-6432dec99230 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:08.585206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-124ad591-329d-4cd6-bdfd-6432dec99230 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:08.586226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-124ad591-329d-4cd6-bdfd-6432dec99230 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:08.587235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-124ad591-329d-4cd6-bdfd-6432dec99230 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:08.588078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-124ad591-329d-4cd6-bdfd-6432dec99230 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:08.588819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-124ad591-329d-4cd6-bdfd-6432dec99230 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:08.640722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8db1bb11-5395-4623-9c95-9cc47285a4d2 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418cfb97b2444502bedf855f9f147734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090743f0fdd0463fbd220eebe9c67651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:08.648804 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8db1bb11-5395-4623-9c95-9cc47285a4d2 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 200 len: 1214 microversion: 2.1 time: 0.187241 Oct 24 10:40:08.663869 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1802/3507] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:08 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 1214 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:08.674788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cbc5baf1-c2e1-411e-94a9-93409febde57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:08.675415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cbc5baf1-c2e1-411e-94a9-93409febde57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:08.687873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbc5baf1-c2e1-411e-94a9-93409febde57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:08.688294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbc5baf1-c2e1-411e-94a9-93409febde57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:08.688742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbc5baf1-c2e1-411e-94a9-93409febde57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:08.703980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbc5baf1-c2e1-411e-94a9-93409febde57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:08.704478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbc5baf1-c2e1-411e-94a9-93409febde57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:08.706729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbc5baf1-c2e1-411e-94a9-93409febde57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:08.907462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cbc5baf1-c2e1-411e-94a9-93409febde57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:08.917916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cbc5baf1-c2e1-411e-94a9-93409febde57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:08.920362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cbc5baf1-c2e1-411e-94a9-93409febde57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:08.926467 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cbc5baf1-c2e1-411e-94a9-93409febde57 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.261056 Oct 24 10:40:08.947722 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1803/3508] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:40:08 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:40:08.960484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-749f645c-dc7b-4f26-8728-3df718266d09 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:08.961484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-749f645c-dc7b-4f26-8728-3df718266d09 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:08.979618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-124ad591-329d-4cd6-bdfd-6432dec99230 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:08.998923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-124ad591-329d-4cd6-bdfd-6432dec99230 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:09.001049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-124ad591-329d-4cd6-bdfd-6432dec99230 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:09.002278 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-124ad591-329d-4cd6-bdfd-6432dec99230 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.447585 Oct 24 10:40:09.002878 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1706/3509] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:40:08 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:40:09.010297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-79333013-09ac-4c16-8a64-4fa864542c6b req-3de954e0-8441-4198-b538-46fcc0f858d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "name": "network-vif-plugged", "status": "completed", "tag": "5f14f77f-dfb8-4e0c-9fc7-42fa81786d65"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:09.023767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-79333013-09ac-4c16-8a64-4fa864542c6b req-3de954e0-8441-4198-b538-46fcc0f858d9 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:09.024501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-79333013-09ac-4c16-8a64-4fa864542c6b req-3de954e0-8441-4198-b538-46fcc0f858d9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:09.025237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-79333013-09ac-4c16-8a64-4fa864542c6b req-3de954e0-8441-4198-b538-46fcc0f858d9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:09.052952 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-79333013-09ac-4c16-8a64-4fa864542c6b req-3de954e0-8441-4198-b538-46fcc0f858d9 service nova] Creating event network-vif-plugged:5f14f77f-dfb8-4e0c-9fc7-42fa81786d65 for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:40:09.061130 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-79333013-09ac-4c16-8a64-4fa864542c6b req-3de954e0-8441-4198-b538-46fcc0f858d9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056695 Oct 24 10:40:09.062474 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1707/3510] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:09.069254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a866dd31-09e3-478e-b865-124e6ea981e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:09.071450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a866dd31-09e3-478e-b865-124e6ea981e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:09.078923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-749f645c-dc7b-4f26-8728-3df718266d09 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:09.087139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a866dd31-09e3-478e-b865-124e6ea981e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:09.088932 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-749f645c-dc7b-4f26-8728-3df718266d09 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1225 microversion: 2.1 time: 0.152849 Oct 24 10:40:09.091608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a866dd31-09e3-478e-b865-124e6ea981e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:09.092521 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1804/3511] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:08 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1225 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:09.093079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a866dd31-09e3-478e-b865-124e6ea981e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:09.094867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a866dd31-09e3-478e-b865-124e6ea981e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:09.095544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a866dd31-09e3-478e-b865-124e6ea981e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:09.096257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a866dd31-09e3-478e-b865-124e6ea981e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:09.466370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a866dd31-09e3-478e-b865-124e6ea981e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:09.479036 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a866dd31-09e3-478e-b865-124e6ea981e1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1323 microversion: 2.1 time: 0.412063 Oct 24 10:40:09.480040 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1708/3512] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:09 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1323 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:09.483671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-93d252e7-a217-4841-a21d-1cadbbf39568 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:09.484375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-93d252e7-a217-4841-a21d-1cadbbf39568 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:09.502625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93d252e7-a217-4841-a21d-1cadbbf39568 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:09.503139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93d252e7-a217-4841-a21d-1cadbbf39568 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:09.503589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93d252e7-a217-4841-a21d-1cadbbf39568 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:09.504586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93d252e7-a217-4841-a21d-1cadbbf39568 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:09.505077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93d252e7-a217-4841-a21d-1cadbbf39568 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:09.531932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93d252e7-a217-4841-a21d-1cadbbf39568 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:09.575158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1025ef5c-435c-4456-bef3-1aead0e5bfd4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:09.576992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1025ef5c-435c-4456-bef3-1aead0e5bfd4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:09.583711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1025ef5c-435c-4456-bef3-1aead0e5bfd4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:09.584745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1025ef5c-435c-4456-bef3-1aead0e5bfd4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:09.585284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1025ef5c-435c-4456-bef3-1aead0e5bfd4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:09.586242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1025ef5c-435c-4456-bef3-1aead0e5bfd4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:09.586886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1025ef5c-435c-4456-bef3-1aead0e5bfd4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:09.587664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1025ef5c-435c-4456-bef3-1aead0e5bfd4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:09.593168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:09.669042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-93d252e7-a217-4841-a21d-1cadbbf39568 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:09.681268 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-93d252e7-a217-4841-a21d-1cadbbf39568 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1267 microversion: 2.1 time: 0.201852 Oct 24 10:40:09.681868 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1805/3513] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:09 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:40:09.688004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e3b627b8-b16b-470e-8ce5-9645bca003c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:09.688852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e3b627b8-b16b-470e-8ce5-9645bca003c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:09.717298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3b627b8-b16b-470e-8ce5-9645bca003c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:09.722373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3b627b8-b16b-470e-8ce5-9645bca003c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:09.724161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3b627b8-b16b-470e-8ce5-9645bca003c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:09.725114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3b627b8-b16b-470e-8ce5-9645bca003c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:09.725821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3b627b8-b16b-470e-8ce5-9645bca003c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:09.726674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3b627b8-b16b-470e-8ce5-9645bca003c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:09.989641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e3b627b8-b16b-470e-8ce5-9645bca003c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418cfb97b2444502bedf855f9f147734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090743f0fdd0463fbd220eebe9c67651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:10.001386 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e3b627b8-b16b-470e-8ce5-9645bca003c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 200 len: 1210 microversion: 2.1 time: 0.315118 Oct 24 10:40:10.017805 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1806/3514] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:09 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 1210 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:10.023785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-720e428c-be75-483e-9573-04d3f672d43d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:10.024761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-720e428c-be75-483e-9573-04d3f672d43d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:10.032123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-720e428c-be75-483e-9573-04d3f672d43d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:10.032731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-720e428c-be75-483e-9573-04d3f672d43d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:10.033277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-720e428c-be75-483e-9573-04d3f672d43d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:10.034069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-720e428c-be75-483e-9573-04d3f672d43d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:10.034609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-720e428c-be75-483e-9573-04d3f672d43d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:10.035117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-720e428c-be75-483e-9573-04d3f672d43d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:10.201869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-720e428c-be75-483e-9573-04d3f672d43d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:10.218163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-720e428c-be75-483e-9573-04d3f672d43d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:10.220244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-720e428c-be75-483e-9573-04d3f672d43d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:10.238257 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-720e428c-be75-483e-9573-04d3f672d43d tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1544 microversion: 2.91 time: 0.218866 Oct 24 10:40:10.256866 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1807/3515] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:40:10 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1544 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:40:10.259533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d444f481-daa3-4269-8be3-aa705a79a63d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:10.262969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d444f481-daa3-4269-8be3-aa705a79a63d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:10.294081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d444f481-daa3-4269-8be3-aa705a79a63d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:10.296200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1025ef5c-435c-4456-bef3-1aead0e5bfd4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:10.296699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d444f481-daa3-4269-8be3-aa705a79a63d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:10.297202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d444f481-daa3-4269-8be3-aa705a79a63d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:10.297943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d444f481-daa3-4269-8be3-aa705a79a63d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:10.303361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d444f481-daa3-4269-8be3-aa705a79a63d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:10.304512 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1025ef5c-435c-4456-bef3-1aead0e5bfd4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1510 microversion: 2.1 time: 0.734189 Oct 24 10:40:10.304793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d444f481-daa3-4269-8be3-aa705a79a63d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:10.313488 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1709/3516] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:09 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1510 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:40:10.326373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-097d6053-6780-4604-966e-12cc335523d4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:10.328509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-097d6053-6780-4604-966e-12cc335523d4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:10.364769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-097d6053-6780-4604-966e-12cc335523d4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:10.365533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-097d6053-6780-4604-966e-12cc335523d4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:10.365868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-097d6053-6780-4604-966e-12cc335523d4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:10.366593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-097d6053-6780-4604-966e-12cc335523d4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:10.367052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-097d6053-6780-4604-966e-12cc335523d4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:10.367480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-097d6053-6780-4604-966e-12cc335523d4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:10.632584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-097d6053-6780-4604-966e-12cc335523d4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:10.658362 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-097d6053-6780-4604-966e-12cc335523d4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1221 microversion: 2.1 time: 0.343224 Oct 24 10:40:10.666017 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1710/3517] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:10 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1221 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:10.676384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a137d24d-aff9-49c1-b785-478f5342659a tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:10.679912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a137d24d-aff9-49c1-b785-478f5342659a tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:10.700416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:10.705238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a137d24d-aff9-49c1-b785-478f5342659a tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:10.713319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a137d24d-aff9-49c1-b785-478f5342659a tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:10.713787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a137d24d-aff9-49c1-b785-478f5342659a tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:10.715043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a137d24d-aff9-49c1-b785-478f5342659a tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:10.715521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a137d24d-aff9-49c1-b785-478f5342659a tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:10.715996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a137d24d-aff9-49c1-b785-478f5342659a tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:11.189654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d444f481-daa3-4269-8be3-aa705a79a63d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:11.199669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d444f481-daa3-4269-8be3-aa705a79a63d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:11.210361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d444f481-daa3-4269-8be3-aa705a79a63d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:11.212251 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d444f481-daa3-4269-8be3-aa705a79a63d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1874 microversion: 2.32 time: 0.964044 Oct 24 10:40:11.221460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a137d24d-aff9-49c1-b785-478f5342659a tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:11.227184 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1808/3518] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:40:10 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1874 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:40:11.231869 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a137d24d-aff9-49c1-b785-478f5342659a tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1323 microversion: 2.1 time: 0.564674 Oct 24 10:40:11.252883 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1711/3519] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:10 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1323 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:11.258589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-64e4e5d1-c7a2-4045-846e-e3b31f1421df tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:11.259412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-57532df4-ce40-4708-b249-8f749cb86370 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:11.260337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-57532df4-ce40-4708-b249-8f749cb86370 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:11.263650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-64e4e5d1-c7a2-4045-846e-e3b31f1421df tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:11.272280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64e4e5d1-c7a2-4045-846e-e3b31f1421df tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:11.273465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64e4e5d1-c7a2-4045-846e-e3b31f1421df tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:11.273759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-57532df4-ce40-4708-b249-8f749cb86370 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:11.274991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-57532df4-ce40-4708-b249-8f749cb86370 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:11.275225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64e4e5d1-c7a2-4045-846e-e3b31f1421df tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:11.275332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-57532df4-ce40-4708-b249-8f749cb86370 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:11.275783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64e4e5d1-c7a2-4045-846e-e3b31f1421df tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:11.276451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64e4e5d1-c7a2-4045-846e-e3b31f1421df tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:11.277631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-57532df4-ce40-4708-b249-8f749cb86370 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:11.277788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64e4e5d1-c7a2-4045-846e-e3b31f1421df tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:11.278742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-57532df4-ce40-4708-b249-8f749cb86370 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:11.279221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-57532df4-ce40-4708-b249-8f749cb86370 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:11.400772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-64e4e5d1-c7a2-4045-846e-e3b31f1421df tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418cfb97b2444502bedf855f9f147734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090743f0fdd0463fbd220eebe9c67651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:11.409053 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-64e4e5d1-c7a2-4045-846e-e3b31f1421df tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 200 len: 1266 microversion: 2.1 time: 0.154611 Oct 24 10:40:11.410331 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1712/3520] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:11 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:11.415355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e3da4edc-0b07-4737-8f6a-0efec9b40c70 req-3af43957-619b-4028-9eba-79c1c5d61b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4302c3-6ad2-41af-94ec-649390645fa1", "name": "network-vif-plugged", "status": "completed", "tag": "d195e830-67e1-435c-98bc-d0ae1282481d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:11.425395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e3da4edc-0b07-4737-8f6a-0efec9b40c70 req-3af43957-619b-4028-9eba-79c1c5d61b9b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:11.426232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e3da4edc-0b07-4737-8f6a-0efec9b40c70 req-3af43957-619b-4028-9eba-79c1c5d61b9b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:11.426889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e3da4edc-0b07-4737-8f6a-0efec9b40c70 req-3af43957-619b-4028-9eba-79c1c5d61b9b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:11.441650 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e3da4edc-0b07-4737-8f6a-0efec9b40c70 req-3af43957-619b-4028-9eba-79c1c5d61b9b service nova] Creating event network-vif-plugged:d195e830-67e1-435c-98bc-d0ae1282481d for instance 8a4302c3-6ad2-41af-94ec-649390645fa1 on n-h2-858383-15 Oct 24 10:40:11.441818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-57532df4-ce40-4708-b249-8f749cb86370 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:11.449010 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e3da4edc-0b07-4737-8f6a-0efec9b40c70 req-3af43957-619b-4028-9eba-79c1c5d61b9b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037172 Oct 24 10:40:11.450291 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1713/3521] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:11.457019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d9e615e4-842d-4301-8b67-bdf59c12b56f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:11.457794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d9e615e4-842d-4301-8b67-bdf59c12b56f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:11.459331 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-57532df4-ce40-4708-b249-8f749cb86370 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1273 microversion: 2.1 time: 0.225963 Oct 24 10:40:11.461015 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1809/3522] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:11 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1273 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:11.468543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9e615e4-842d-4301-8b67-bdf59c12b56f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:11.468927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-782fe616-39da-41a9-81b2-2056b5b28607 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:11.469075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9e615e4-842d-4301-8b67-bdf59c12b56f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:11.469731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9e615e4-842d-4301-8b67-bdf59c12b56f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:11.469958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-782fe616-39da-41a9-81b2-2056b5b28607 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:11.470777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9e615e4-842d-4301-8b67-bdf59c12b56f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:11.471398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9e615e4-842d-4301-8b67-bdf59c12b56f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:11.471992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9e615e4-842d-4301-8b67-bdf59c12b56f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:11.479562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-782fe616-39da-41a9-81b2-2056b5b28607 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:11.480251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-782fe616-39da-41a9-81b2-2056b5b28607 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:11.480975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-782fe616-39da-41a9-81b2-2056b5b28607 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:11.482005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-782fe616-39da-41a9-81b2-2056b5b28607 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:11.482684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-782fe616-39da-41a9-81b2-2056b5b28607 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:11.483751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-782fe616-39da-41a9-81b2-2056b5b28607 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:11.608975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d9e615e4-842d-4301-8b67-bdf59c12b56f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:11.622706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d9e615e4-842d-4301-8b67-bdf59c12b56f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:11.624507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d9e615e4-842d-4301-8b67-bdf59c12b56f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:11.643641 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d9e615e4-842d-4301-8b67-bdf59c12b56f tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1531 microversion: 2.91 time: 0.191864 Oct 24 10:40:11.675936 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1714/3523] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:40:11 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1531 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:40:11.695244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-348a0f2a-37ba-4234-a50b-82ecf2d770d1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:11.697151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-348a0f2a-37ba-4234-a50b-82ecf2d770d1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:11.709933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-782fe616-39da-41a9-81b2-2056b5b28607 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:11.712150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-348a0f2a-37ba-4234-a50b-82ecf2d770d1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:11.714987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-348a0f2a-37ba-4234-a50b-82ecf2d770d1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:11.716267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-348a0f2a-37ba-4234-a50b-82ecf2d770d1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:11.717370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-348a0f2a-37ba-4234-a50b-82ecf2d770d1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:11.718612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-348a0f2a-37ba-4234-a50b-82ecf2d770d1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:11.719051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-348a0f2a-37ba-4234-a50b-82ecf2d770d1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:11.722156 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-782fe616-39da-41a9-81b2-2056b5b28607 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1510 microversion: 2.1 time: 0.259188 Oct 24 10:40:11.723327 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1810/3524] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:11 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:11.730419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-94746d8d-3a70-4966-b673-12b3bfb241a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:11.731350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-94746d8d-3a70-4966-b673-12b3bfb241a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:11.754837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94746d8d-3a70-4966-b673-12b3bfb241a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:11.758445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94746d8d-3a70-4966-b673-12b3bfb241a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:11.759177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94746d8d-3a70-4966-b673-12b3bfb241a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:11.761458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94746d8d-3a70-4966-b673-12b3bfb241a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:11.762192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94746d8d-3a70-4966-b673-12b3bfb241a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:11.763913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94746d8d-3a70-4966-b673-12b3bfb241a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:11.806409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:11.982466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94746d8d-3a70-4966-b673-12b3bfb241a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:12.014736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-348a0f2a-37ba-4234-a50b-82ecf2d770d1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] Lazy-loading 'services' on Instance uuid 64cc15e2-c27b-4e1d-8673-338e434031db {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:40:12.024094 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-94746d8d-3a70-4966-b673-12b3bfb241a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1277 microversion: 2.1 time: 0.295010 Oct 24 10:40:12.026012 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1811/3525] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:11 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1277 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:12.074805 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-348a0f2a-37ba-4234-a50b-82ecf2d770d1 tempest-UnshelveToHostMultiNodesTest-94417790 tempest-UnshelveToHostMultiNodesTest-94417790-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1938 microversion: 2.91 time: 0.387304 Oct 24 10:40:12.076044 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1715/3526] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:40:11 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1938 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:40:12.131439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5e12f011-c097-4108-8956-180745e04159 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:12.132261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5e12f011-c097-4108-8956-180745e04159 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:12.142734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e12f011-c097-4108-8956-180745e04159 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:12.159595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e12f011-c097-4108-8956-180745e04159 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:12.161366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e12f011-c097-4108-8956-180745e04159 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:12.164826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e12f011-c097-4108-8956-180745e04159 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:12.165622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e12f011-c097-4108-8956-180745e04159 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:12.168542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e12f011-c097-4108-8956-180745e04159 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:12.261437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a5ba0b24-1296-482f-86f4-8f225b7e974e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:12.261954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a5ba0b24-1296-482f-86f4-8f225b7e974e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:12.273402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5ba0b24-1296-482f-86f4-8f225b7e974e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:12.273918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5ba0b24-1296-482f-86f4-8f225b7e974e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:12.274392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5ba0b24-1296-482f-86f4-8f225b7e974e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:12.275127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5ba0b24-1296-482f-86f4-8f225b7e974e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:12.275589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5ba0b24-1296-482f-86f4-8f225b7e974e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:12.276029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5ba0b24-1296-482f-86f4-8f225b7e974e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:12.284097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5e12f011-c097-4108-8956-180745e04159 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:40:12.514562 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5e12f011-c097-4108-8956-180745e04159 tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "DELETE /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 204 len: 0 microversion: 2.91 time: 0.388810 Oct 24 10:40:12.515462 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1812/3527] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:40:12 2022] DELETE /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:40:12.524718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5a377acb-062e-431e-a676-4d7b651520ea tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:12.535958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5a377acb-062e-431e-a676-4d7b651520ea tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:12.557474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a377acb-062e-431e-a676-4d7b651520ea tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:12.557988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a377acb-062e-431e-a676-4d7b651520ea tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:12.558434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a377acb-062e-431e-a676-4d7b651520ea tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:12.559951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a377acb-062e-431e-a676-4d7b651520ea tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:12.560643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a377acb-062e-431e-a676-4d7b651520ea tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:12.567793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a377acb-062e-431e-a676-4d7b651520ea tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:12.868226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a5ba0b24-1296-482f-86f4-8f225b7e974e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:12.893408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a5ba0b24-1296-482f-86f4-8f225b7e974e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:12.895043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a5ba0b24-1296-482f-86f4-8f225b7e974e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:12.896348 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a5ba0b24-1296-482f-86f4-8f225b7e974e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 2826 microversion: 2.32 time: 0.640480 Oct 24 10:40:12.904720 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1716/3528] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:40:12 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 2826 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:40:12.909953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f4a3a5c4-58ef-4d78-a9a0-72707820f1b9 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:12.910578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f4a3a5c4-58ef-4d78-a9a0-72707820f1b9 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:12.973096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4a3a5c4-58ef-4d78-a9a0-72707820f1b9 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:12.979270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4a3a5c4-58ef-4d78-a9a0-72707820f1b9 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:12.979270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4a3a5c4-58ef-4d78-a9a0-72707820f1b9 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:12.979270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4a3a5c4-58ef-4d78-a9a0-72707820f1b9 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:12.979270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4a3a5c4-58ef-4d78-a9a0-72707820f1b9 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:12.981678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4a3a5c4-58ef-4d78-a9a0-72707820f1b9 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:13.034086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5a377acb-062e-431e-a676-4d7b651520ea tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:13.048609 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5a377acb-062e-431e-a676-4d7b651520ea tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1323 microversion: 2.1 time: 0.526367 Oct 24 10:40:13.050135 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1813/3529] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:12 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1323 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:13.068336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-26b1be80-2088-4028-8254-ca74a10aef64 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:13.072189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-26b1be80-2088-4028-8254-ca74a10aef64 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:13.091050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26b1be80-2088-4028-8254-ca74a10aef64 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:13.091579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26b1be80-2088-4028-8254-ca74a10aef64 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:13.092035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26b1be80-2088-4028-8254-ca74a10aef64 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:13.096557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26b1be80-2088-4028-8254-ca74a10aef64 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:13.099558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26b1be80-2088-4028-8254-ca74a10aef64 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:13.101236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26b1be80-2088-4028-8254-ca74a10aef64 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:13.425747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f4a3a5c4-58ef-4d78-a9a0-72707820f1b9 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418cfb97b2444502bedf855f9f147734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090743f0fdd0463fbd220eebe9c67651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:13.449030 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f4a3a5c4-58ef-4d78-a9a0-72707820f1b9 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 200 len: 1272 microversion: 2.1 time: 0.542976 Oct 24 10:40:13.457324 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1717/3530] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:12 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 1272 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:13.465411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-da215fbe-cfbf-4460-aead-76eaf3f965cf tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:13.466286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-da215fbe-cfbf-4460-aead-76eaf3f965cf tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:13.478265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da215fbe-cfbf-4460-aead-76eaf3f965cf tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:13.480200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da215fbe-cfbf-4460-aead-76eaf3f965cf tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:13.491977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da215fbe-cfbf-4460-aead-76eaf3f965cf tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:13.493422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da215fbe-cfbf-4460-aead-76eaf3f965cf tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:13.493927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da215fbe-cfbf-4460-aead-76eaf3f965cf tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:13.494720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da215fbe-cfbf-4460-aead-76eaf3f965cf tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:13.653498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-da215fbe-cfbf-4460-aead-76eaf3f965cf tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:13.662181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-da215fbe-cfbf-4460-aead-76eaf3f965cf tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:13.669274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-da215fbe-cfbf-4460-aead-76eaf3f965cf tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:13.683122 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-da215fbe-cfbf-4460-aead-76eaf3f965cf tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.222471 Oct 24 10:40:13.696873 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1718/3531] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:40:13 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:40:13.699818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a185d8b5-34dc-4a04-a349-5928d8e55637 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:13.700441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a185d8b5-34dc-4a04-a349-5928d8e55637 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:13.717838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a185d8b5-34dc-4a04-a349-5928d8e55637 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:13.719101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a185d8b5-34dc-4a04-a349-5928d8e55637 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:13.720753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a185d8b5-34dc-4a04-a349-5928d8e55637 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:13.721755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a185d8b5-34dc-4a04-a349-5928d8e55637 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:13.722623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a185d8b5-34dc-4a04-a349-5928d8e55637 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:13.723571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a185d8b5-34dc-4a04-a349-5928d8e55637 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:13.756530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-26b1be80-2088-4028-8254-ca74a10aef64 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:13.766349 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-26b1be80-2088-4028-8254-ca74a10aef64 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1315 microversion: 2.1 time: 0.713156 Oct 24 10:40:13.781347 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1814/3532] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:13 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1315 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:13.793604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-651123e8-6a0f-4deb-acfb-fb8f4dc82e8f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:13.794116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-651123e8-6a0f-4deb-acfb-fb8f4dc82e8f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:13.803769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-651123e8-6a0f-4deb-acfb-fb8f4dc82e8f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:13.804336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-651123e8-6a0f-4deb-acfb-fb8f4dc82e8f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:13.804917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-651123e8-6a0f-4deb-acfb-fb8f4dc82e8f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:13.805642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-651123e8-6a0f-4deb-acfb-fb8f4dc82e8f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:13.806081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-651123e8-6a0f-4deb-acfb-fb8f4dc82e8f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:13.806502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-651123e8-6a0f-4deb-acfb-fb8f4dc82e8f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:13.999030 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-651123e8-6a0f-4deb-acfb-fb8f4dc82e8f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.216388 Oct 24 10:40:14.018085 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1815/3533] 10.222.0.50 () {60 vars in 1316 bytes} [Mon Oct 24 10:40:13 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946/os-interface => generated 1829 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:40:14.027599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3d2fd5c1-a6df-4d68-a802-919543e6d0f9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:14.028482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3d2fd5c1-a6df-4d68-a802-919543e6d0f9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:14.046152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d2fd5c1-a6df-4d68-a802-919543e6d0f9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:14.046657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d2fd5c1-a6df-4d68-a802-919543e6d0f9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:14.047101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d2fd5c1-a6df-4d68-a802-919543e6d0f9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:14.047816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d2fd5c1-a6df-4d68-a802-919543e6d0f9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:14.048275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d2fd5c1-a6df-4d68-a802-919543e6d0f9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:14.048710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d2fd5c1-a6df-4d68-a802-919543e6d0f9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:14.152522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a185d8b5-34dc-4a04-a349-5928d8e55637 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:14.167656 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a185d8b5-34dc-4a04-a349-5928d8e55637 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1510 microversion: 2.1 time: 0.480443 Oct 24 10:40:14.169537 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1719/3534] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:13 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1510 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:14.183297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3d2fd5c1-a6df-4d68-a802-919543e6d0f9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:14.192647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-44dfd7b7-ed5b-449d-9c7c-ebf20a90dffb tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:14.196025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-44dfd7b7-ed5b-449d-9c7c-ebf20a90dffb tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:14.201135 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3d2fd5c1-a6df-4d68-a802-919543e6d0f9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1283 microversion: 2.1 time: 0.179080 Oct 24 10:40:14.206152 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1816/3535] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:14 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1283 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:14.212975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44dfd7b7-ed5b-449d-9c7c-ebf20a90dffb tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:14.213751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44dfd7b7-ed5b-449d-9c7c-ebf20a90dffb tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:14.214758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44dfd7b7-ed5b-449d-9c7c-ebf20a90dffb tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:14.215959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44dfd7b7-ed5b-449d-9c7c-ebf20a90dffb tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:14.216849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44dfd7b7-ed5b-449d-9c7c-ebf20a90dffb tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:14.218262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44dfd7b7-ed5b-449d-9c7c-ebf20a90dffb tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:14.479940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-41507d04-d608-4bd7-b28e-569aaddaf6c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:14.480598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-41507d04-d608-4bd7-b28e-569aaddaf6c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:14.487497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41507d04-d608-4bd7-b28e-569aaddaf6c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:14.487987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41507d04-d608-4bd7-b28e-569aaddaf6c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:14.488427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41507d04-d608-4bd7-b28e-569aaddaf6c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:14.489164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41507d04-d608-4bd7-b28e-569aaddaf6c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:14.489617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41507d04-d608-4bd7-b28e-569aaddaf6c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:14.490046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41507d04-d608-4bd7-b28e-569aaddaf6c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:15.054772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-44dfd7b7-ed5b-449d-9c7c-ebf20a90dffb tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:15.065757 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-44dfd7b7-ed5b-449d-9c7c-ebf20a90dffb tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1517 microversion: 2.1 time: 0.894850 Oct 24 10:40:15.073917 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1720/3536] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:14 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1517 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:15.081123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3ac40a96-7a79-45e9-89cf-e96d4afe1606 req-17d3c587-b706-4553-b0b2-598e1b3cbad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5da901c-0851-4c31-9547-cd138b752ed6", "tag": "4f06be00-fe8b-4664-a038-85071a5cc14e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:15.103958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3ac40a96-7a79-45e9-89cf-e96d4afe1606 req-17d3c587-b706-4553-b0b2-598e1b3cbad7 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:15.104729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3ac40a96-7a79-45e9-89cf-e96d4afe1606 req-17d3c587-b706-4553-b0b2-598e1b3cbad7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:15.105499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3ac40a96-7a79-45e9-89cf-e96d4afe1606 req-17d3c587-b706-4553-b0b2-598e1b3cbad7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:15.120326 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3ac40a96-7a79-45e9-89cf-e96d4afe1606 req-17d3c587-b706-4553-b0b2-598e1b3cbad7 service nova] Creating event network-changed:4f06be00-fe8b-4664-a038-85071a5cc14e for instance b5da901c-0851-4c31-9547-cd138b752ed6 on n-h1-858383-15 Oct 24 10:40:15.125744 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3ac40a96-7a79-45e9-89cf-e96d4afe1606 req-17d3c587-b706-4553-b0b2-598e1b3cbad7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049773 Oct 24 10:40:15.127558 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1721/3537] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:15.135885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c80bef3b-b1b8-4940-bedf-d26a19dda39b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:15.136786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c80bef3b-b1b8-4940-bedf-d26a19dda39b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:15.143323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c80bef3b-b1b8-4940-bedf-d26a19dda39b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:15.144081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c80bef3b-b1b8-4940-bedf-d26a19dda39b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:15.144954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c80bef3b-b1b8-4940-bedf-d26a19dda39b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:15.145989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c80bef3b-b1b8-4940-bedf-d26a19dda39b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:15.146726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c80bef3b-b1b8-4940-bedf-d26a19dda39b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:15.147875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c80bef3b-b1b8-4940-bedf-d26a19dda39b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:15.295281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c80bef3b-b1b8-4940-bedf-d26a19dda39b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:15.300493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-41507d04-d608-4bd7-b28e-569aaddaf6c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418cfb97b2444502bedf855f9f147734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090743f0fdd0463fbd220eebe9c67651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:15.307513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c80bef3b-b1b8-4940-bedf-d26a19dda39b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:15.309822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c80bef3b-b1b8-4940-bedf-d26a19dda39b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebdd581042344cd908a42c7ba111fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d258f0ae58493da0efc5df77e54c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:15.312200 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-41507d04-d608-4bd7-b28e-569aaddaf6c1 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 200 len: 1314 microversion: 2.1 time: 0.836749 Oct 24 10:40:15.313488 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1817/3538] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:14 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 1314 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:40:15.316226 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c80bef3b-b1b8-4940-bedf-d26a19dda39b tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 200 len: 1537 microversion: 2.91 time: 0.187231 Oct 24 10:40:15.317237 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1722/3539] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:40:15 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 1537 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:40:15.323230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e6916df6-170c-49b8-96c1-8a8daa43910d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:15.324047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e6916df6-170c-49b8-96c1-8a8daa43910d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:15.330043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5ccf2db0-ccaa-41cb-9af7-d0e4faaff496 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:15.336933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5ccf2db0-ccaa-41cb-9af7-d0e4faaff496 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:15.340338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6916df6-170c-49b8-96c1-8a8daa43910d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:15.340853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6916df6-170c-49b8-96c1-8a8daa43910d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:15.341527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6916df6-170c-49b8-96c1-8a8daa43910d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:15.342250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6916df6-170c-49b8-96c1-8a8daa43910d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:15.342705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6916df6-170c-49b8-96c1-8a8daa43910d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:15.343136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6916df6-170c-49b8-96c1-8a8daa43910d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:15.353291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ccf2db0-ccaa-41cb-9af7-d0e4faaff496 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:15.353801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ccf2db0-ccaa-41cb-9af7-d0e4faaff496 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:15.354242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ccf2db0-ccaa-41cb-9af7-d0e4faaff496 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:15.354957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ccf2db0-ccaa-41cb-9af7-d0e4faaff496 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:15.355409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ccf2db0-ccaa-41cb-9af7-d0e4faaff496 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:15.355827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ccf2db0-ccaa-41cb-9af7-d0e4faaff496 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:15.385859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-5ccf2db0-ccaa-41cb-9af7-d0e4faaff496 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lazy-loading 'flavor' on Instance uuid 8a4302c3-6ad2-41af-94ec-649390645fa1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:40:15.495793 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5ccf2db0-ccaa-41cb-9af7-d0e4faaff496 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "POST /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1/action" status: 200 len: 32 microversion: 2.1 time: 0.176505 Oct 24 10:40:15.511891 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1723/3540] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:40:15 2022] POST /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:40:15.527557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6fff9487-0c92-4a62-a2af-04be97f1b8f1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:15.533885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6fff9487-0c92-4a62-a2af-04be97f1b8f1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:15.545306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fff9487-0c92-4a62-a2af-04be97f1b8f1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:15.546133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fff9487-0c92-4a62-a2af-04be97f1b8f1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:15.546926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fff9487-0c92-4a62-a2af-04be97f1b8f1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:15.548065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fff9487-0c92-4a62-a2af-04be97f1b8f1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:15.548961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fff9487-0c92-4a62-a2af-04be97f1b8f1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:15.550263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fff9487-0c92-4a62-a2af-04be97f1b8f1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:15.828699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e6916df6-170c-49b8-96c1-8a8daa43910d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:15.838389 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e6916df6-170c-49b8-96c1-8a8daa43910d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1315 microversion: 2.1 time: 0.522975 Oct 24 10:40:15.852858 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1818/3541] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:15 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:15.852858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-10c35af6-92c5-44a3-b617-d2248691bccc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:15.852858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-10c35af6-92c5-44a3-b617-d2248691bccc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:15.854417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10c35af6-92c5-44a3-b617-d2248691bccc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:15.855128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10c35af6-92c5-44a3-b617-d2248691bccc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:15.855754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10c35af6-92c5-44a3-b617-d2248691bccc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:15.856464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10c35af6-92c5-44a3-b617-d2248691bccc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:15.856947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10c35af6-92c5-44a3-b617-d2248691bccc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:15.857379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10c35af6-92c5-44a3-b617-d2248691bccc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:16.119530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6fff9487-0c92-4a62-a2af-04be97f1b8f1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:16.123261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:16.132595 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6fff9487-0c92-4a62-a2af-04be97f1b8f1 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1510 microversion: 2.1 time: 0.619063 Oct 24 10:40:16.148515 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1724/3542] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:15 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1510 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:16.156474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a2d01e40-ee5c-4e7f-b67a-79368e685701 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:16.157137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a2d01e40-ee5c-4e7f-b67a-79368e685701 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:16.165075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2d01e40-ee5c-4e7f-b67a-79368e685701 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:16.165577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2d01e40-ee5c-4e7f-b67a-79368e685701 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:16.166022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2d01e40-ee5c-4e7f-b67a-79368e685701 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:16.166742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2d01e40-ee5c-4e7f-b67a-79368e685701 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:16.167207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2d01e40-ee5c-4e7f-b67a-79368e685701 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:16.167637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2d01e40-ee5c-4e7f-b67a-79368e685701 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:16.376929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-10c35af6-92c5-44a3-b617-d2248691bccc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:16.384814 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-10c35af6-92c5-44a3-b617-d2248691bccc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1325 microversion: 2.1 time: 0.541158 Oct 24 10:40:16.394883 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1819/3543] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:15 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1325 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:16.401179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e3cb4596-24a8-4394-8a3b-ef75e036833a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:16.401942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e3cb4596-24a8-4394-8a3b-ef75e036833a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:16.408613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3cb4596-24a8-4394-8a3b-ef75e036833a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:16.409337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3cb4596-24a8-4394-8a3b-ef75e036833a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:16.409873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3cb4596-24a8-4394-8a3b-ef75e036833a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:16.411089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3cb4596-24a8-4394-8a3b-ef75e036833a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:16.411645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3cb4596-24a8-4394-8a3b-ef75e036833a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:16.413091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3cb4596-24a8-4394-8a3b-ef75e036833a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:16.623373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a2d01e40-ee5c-4e7f-b67a-79368e685701 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:16.634263 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a2d01e40-ee5c-4e7f-b67a-79368e685701 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.484140 Oct 24 10:40:16.634841 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1725/3544] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:16 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:16.653021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa69c83a-d669-4f77-8117-b59ba198de8a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:16.654120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa69c83a-d669-4f77-8117-b59ba198de8a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] [instance: 64cc15e2-c27b-4e1d-8673-338e434031db] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:16.661090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa69c83a-d669-4f77-8117-b59ba198de8a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:16.661579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa69c83a-d669-4f77-8117-b59ba198de8a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:16.663074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa69c83a-d669-4f77-8117-b59ba198de8a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:16.664041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa69c83a-d669-4f77-8117-b59ba198de8a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:16.664532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa69c83a-d669-4f77-8117-b59ba198de8a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:16.665120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa69c83a-d669-4f77-8117-b59ba198de8a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:16.683389 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-aa69c83a-d669-4f77-8117-b59ba198de8a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] HTTP exception thrown: Instance 64cc15e2-c27b-4e1d-8673-338e434031db could not be found. Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa69c83a-d669-4f77-8117-b59ba198de8a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Request method failure captured: Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db HTTP/1.1 Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmq9W4MnxJBOa-b4xbV72RISxQXU0eSaxJuyTSDIlBjZyImcd7zqD__gpOiAYRNXQH5F7Psma1Nilrcj_IUDh6ZABEZ2GYLSlS3fIVOxlIKh-Ggc8y7PWziDzHEwoujz3avVg-VrBnAfL-cukRf9_W2a9r7Z_pjt49uXzrt44SvbFQw Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.91 Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: a6d258f0ae58493da0efc5df77e54c3b Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1673304153 Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6d258f0ae58493da0efc5df77e54c3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6d258f0ae58493da0efc5df77e54c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a6d258f0ae58493da0efc5df77e54c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a6d258f0ae58493da0efc5df77e54c3b", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1673304153 Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: a6d258f0ae58493da0efc5df77e54c3b Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1673304153 Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-UnshelveToHostMultiNodesTest-1673304153-project Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 7ebdd581042344cd908a42c7ba111fb4 Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1673304153-project Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 64cc15e2-c27b-4e1d-8673-338e434031db could not be found. Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '64cc15e2-c27b-4e1d-8673-338e434031db'} Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64cc15e2-c27b-4e1d-8673-338e434031db could not be found. Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64cc15e2-c27b-4e1d-8673-338e434031db could not be found. Oct 24 10:40:16.685678 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:16.693484 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:16.693484 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:16.693484 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:16.693484 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:16.693484 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:16.693484 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:16.693484 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:16.693484 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64cc15e2-c27b-4e1d-8673-338e434031db could not be found. Oct 24 10:40:16.693484 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:16.693484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa69c83a-d669-4f77-8117-b59ba198de8a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] Returning 404 to user: Instance 64cc15e2-c27b-4e1d-8673-338e434031db could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:16.693484 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa69c83a-d669-4f77-8117-b59ba198de8a tempest-UnshelveToHostMultiNodesTest-1673304153 tempest-UnshelveToHostMultiNodesTest-1673304153-project] 10.222.0.50 "GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db" status: 404 len: 111 microversion: 2.91 time: 0.051036 Oct 24 10:40:16.693484 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1726/3545] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:40:16 2022] GET /compute/v2.1/servers/64cc15e2-c27b-4e1d-8673-338e434031db => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:40:16.851696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e3cb4596-24a8-4394-8a3b-ef75e036833a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418cfb97b2444502bedf855f9f147734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090743f0fdd0463fbd220eebe9c67651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:16.863292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7f44a1f0-0f65-45d5-8d34-c7a01bc3ebc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:16.863573 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e3cb4596-24a8-4394-8a3b-ef75e036833a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 200 len: 1314 microversion: 2.1 time: 0.467264 Oct 24 10:40:16.864467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7f44a1f0-0f65-45d5-8d34-c7a01bc3ebc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:16.871615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f44a1f0-0f65-45d5-8d34-c7a01bc3ebc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:16.872094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f44a1f0-0f65-45d5-8d34-c7a01bc3ebc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:16.872709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f44a1f0-0f65-45d5-8d34-c7a01bc3ebc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:16.873638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f44a1f0-0f65-45d5-8d34-c7a01bc3ebc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:16.874246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f44a1f0-0f65-45d5-8d34-c7a01bc3ebc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:16.874680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f44a1f0-0f65-45d5-8d34-c7a01bc3ebc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:16.880259 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1820/3546] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:16 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:17.157093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0a107662-7989-4e2c-b6b3-fdbb869db74a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:17.157940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0a107662-7989-4e2c-b6b3-fdbb869db74a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:17.165184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a107662-7989-4e2c-b6b3-fdbb869db74a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:17.165899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a107662-7989-4e2c-b6b3-fdbb869db74a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:17.166508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a107662-7989-4e2c-b6b3-fdbb869db74a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:17.167407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a107662-7989-4e2c-b6b3-fdbb869db74a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:17.168033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a107662-7989-4e2c-b6b3-fdbb869db74a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:17.168630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a107662-7989-4e2c-b6b3-fdbb869db74a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:17.327539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7f44a1f0-0f65-45d5-8d34-c7a01bc3ebc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:17.340900 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7f44a1f0-0f65-45d5-8d34-c7a01bc3ebc6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1315 microversion: 2.1 time: 0.481283 Oct 24 10:40:17.342386 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1727/3547] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:16 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:40:17.384654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:17.427580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:17.479451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0a107662-7989-4e2c-b6b3-fdbb869db74a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:17.488689 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0a107662-7989-4e2c-b6b3-fdbb869db74a tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1510 microversion: 2.1 time: 0.336270 Oct 24 10:40:17.504124 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1821/3548] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:17 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1510 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:40:17.520033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-2d0df35c-467c-49eb-9c0a-b71ec04f43b2 req-13ade6ea-320c-4800-a3fe-49e1cdb61636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15f47b34-c515-45c3-be54-4b534ce4f4c2", "tag": "b974087e-0f6b-420d-a529-b096270b3cee"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:17.542875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2d0df35c-467c-49eb-9c0a-b71ec04f43b2 req-13ade6ea-320c-4800-a3fe-49e1cdb61636 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:17.543358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2d0df35c-467c-49eb-9c0a-b71ec04f43b2 req-13ade6ea-320c-4800-a3fe-49e1cdb61636 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:17.544167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2d0df35c-467c-49eb-9c0a-b71ec04f43b2 req-13ade6ea-320c-4800-a3fe-49e1cdb61636 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:17.559509 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-2d0df35c-467c-49eb-9c0a-b71ec04f43b2 req-13ade6ea-320c-4800-a3fe-49e1cdb61636 service nova] Creating event network-changed:b974087e-0f6b-420d-a529-b096270b3cee for instance 15f47b34-c515-45c3-be54-4b534ce4f4c2 on n-h1-858383-15 Oct 24 10:40:17.565467 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-2d0df35c-467c-49eb-9c0a-b71ec04f43b2 req-13ade6ea-320c-4800-a3fe-49e1cdb61636 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071130 Oct 24 10:40:17.566757 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1822/3549] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:17.576283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-79d5f8f3-5a9d-4eb9-b1eb-9c81fc25cb47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:17.578250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-79d5f8f3-5a9d-4eb9-b1eb-9c81fc25cb47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:17.587091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79d5f8f3-5a9d-4eb9-b1eb-9c81fc25cb47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:17.587949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79d5f8f3-5a9d-4eb9-b1eb-9c81fc25cb47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:17.588590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79d5f8f3-5a9d-4eb9-b1eb-9c81fc25cb47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:17.593547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79d5f8f3-5a9d-4eb9-b1eb-9c81fc25cb47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:17.593751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79d5f8f3-5a9d-4eb9-b1eb-9c81fc25cb47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:17.594596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79d5f8f3-5a9d-4eb9-b1eb-9c81fc25cb47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:17.618908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-4ccb093c-a71e-43c9-990c-8aac27deb394 req-c2eaf1aa-3629-4edc-a456-e4630c7501d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "tag": "02b89d7c-b6a2-401d-89a3-9361e02645ab"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:17.644744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4ccb093c-a71e-43c9-990c-8aac27deb394 req-c2eaf1aa-3629-4edc-a456-e4630c7501d3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:17.646157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4ccb093c-a71e-43c9-990c-8aac27deb394 req-c2eaf1aa-3629-4edc-a456-e4630c7501d3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:17.647751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4ccb093c-a71e-43c9-990c-8aac27deb394 req-c2eaf1aa-3629-4edc-a456-e4630c7501d3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:17.682403 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-4ccb093c-a71e-43c9-990c-8aac27deb394 req-c2eaf1aa-3629-4edc-a456-e4630c7501d3 service nova] Creating event network-changed:02b89d7c-b6a2-401d-89a3-9361e02645ab for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:40:17.688795 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-4ccb093c-a71e-43c9-990c-8aac27deb394 req-c2eaf1aa-3629-4edc-a456-e4630c7501d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.344861 Oct 24 10:40:17.690264 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1728/3550] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:17.698185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a3ba2506-571b-48c8-bcb0-a47dd202e274 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:17.699182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a3ba2506-571b-48c8-bcb0-a47dd202e274 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:17.706784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3ba2506-571b-48c8-bcb0-a47dd202e274 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:17.707327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3ba2506-571b-48c8-bcb0-a47dd202e274 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:17.707956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3ba2506-571b-48c8-bcb0-a47dd202e274 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:17.708920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3ba2506-571b-48c8-bcb0-a47dd202e274 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:17.709680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3ba2506-571b-48c8-bcb0-a47dd202e274 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:17.710327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3ba2506-571b-48c8-bcb0-a47dd202e274 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:18.016507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-79d5f8f3-5a9d-4eb9-b1eb-9c81fc25cb47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:18.022628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a3ba2506-571b-48c8-bcb0-a47dd202e274 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:18.027866 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-79d5f8f3-5a9d-4eb9-b1eb-9c81fc25cb47 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1325 microversion: 2.1 time: 0.459708 Oct 24 10:40:18.040861 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1823/3551] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:17 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1325 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:18.040861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-374afe87-d6d0-4f7f-9575-cbfeebba6fcd tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:18.040861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-374afe87-d6d0-4f7f-9575-cbfeebba6fcd tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:18.041390 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a3ba2506-571b-48c8-bcb0-a47dd202e274 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.344743 Oct 24 10:40:18.041390 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1729/3552] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:17 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:18.041577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:18.060285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-374afe87-d6d0-4f7f-9575-cbfeebba6fcd tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:18.062034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-374afe87-d6d0-4f7f-9575-cbfeebba6fcd tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:18.064262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-374afe87-d6d0-4f7f-9575-cbfeebba6fcd tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:18.066465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-374afe87-d6d0-4f7f-9575-cbfeebba6fcd tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:18.067255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-374afe87-d6d0-4f7f-9575-cbfeebba6fcd tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:18.067712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-374afe87-d6d0-4f7f-9575-cbfeebba6fcd tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:18.309966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-374afe87-d6d0-4f7f-9575-cbfeebba6fcd tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418cfb97b2444502bedf855f9f147734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090743f0fdd0463fbd220eebe9c67651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:18.321932 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-374afe87-d6d0-4f7f-9575-cbfeebba6fcd tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 200 len: 1314 microversion: 2.1 time: 0.291175 Oct 24 10:40:18.323137 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1824/3553] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:18 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:18.365061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9cc4436f-f20e-4158-bb02-59cc505c75a2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:18.366499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9cc4436f-f20e-4158-bb02-59cc505c75a2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:18.373472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cc4436f-f20e-4158-bb02-59cc505c75a2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:18.374163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cc4436f-f20e-4158-bb02-59cc505c75a2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:18.374787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cc4436f-f20e-4158-bb02-59cc505c75a2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:18.376211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cc4436f-f20e-4158-bb02-59cc505c75a2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:18.376211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cc4436f-f20e-4158-bb02-59cc505c75a2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:18.376397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cc4436f-f20e-4158-bb02-59cc505c75a2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:18.524959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3d50f040-54ad-472a-b0ce-37b88b910a42 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:18.529634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3d50f040-54ad-472a-b0ce-37b88b910a42 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:18.540736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d50f040-54ad-472a-b0ce-37b88b910a42 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:18.541265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d50f040-54ad-472a-b0ce-37b88b910a42 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:18.541747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d50f040-54ad-472a-b0ce-37b88b910a42 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:18.542471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d50f040-54ad-472a-b0ce-37b88b910a42 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:18.543103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d50f040-54ad-472a-b0ce-37b88b910a42 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:18.543545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d50f040-54ad-472a-b0ce-37b88b910a42 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:18.726168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9cc4436f-f20e-4158-bb02-59cc505c75a2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:18.735119 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9cc4436f-f20e-4158-bb02-59cc505c75a2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1315 microversion: 2.1 time: 0.374038 Oct 24 10:40:18.749413 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1730/3554] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:18 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:18.812409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3d50f040-54ad-472a-b0ce-37b88b910a42 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:18.828475 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3d50f040-54ad-472a-b0ce-37b88b910a42 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1510 microversion: 2.1 time: 0.313022 Oct 24 10:40:18.829520 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1825/3555] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:18 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1510 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:19.066423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-157a8f0b-51bf-4110-a13f-f3742e3b23f3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:19.067845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bcd69023-60d8-4a41-8993-78bc25c9b506 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:19.068662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bcd69023-60d8-4a41-8993-78bc25c9b506 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:19.069096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-157a8f0b-51bf-4110-a13f-f3742e3b23f3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:19.082040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-157a8f0b-51bf-4110-a13f-f3742e3b23f3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:19.082856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bcd69023-60d8-4a41-8993-78bc25c9b506 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:19.083580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-157a8f0b-51bf-4110-a13f-f3742e3b23f3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:19.084686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bcd69023-60d8-4a41-8993-78bc25c9b506 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:19.085620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-157a8f0b-51bf-4110-a13f-f3742e3b23f3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:19.086290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bcd69023-60d8-4a41-8993-78bc25c9b506 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:19.087234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-157a8f0b-51bf-4110-a13f-f3742e3b23f3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:19.088174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bcd69023-60d8-4a41-8993-78bc25c9b506 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:19.088895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-157a8f0b-51bf-4110-a13f-f3742e3b23f3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:19.089575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bcd69023-60d8-4a41-8993-78bc25c9b506 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:19.090445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bcd69023-60d8-4a41-8993-78bc25c9b506 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:19.091022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-157a8f0b-51bf-4110-a13f-f3742e3b23f3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:19.091881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=12 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:19.875922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bcd69023-60d8-4a41-8993-78bc25c9b506 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:19.894234 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bcd69023-60d8-4a41-8993-78bc25c9b506 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.834539 Oct 24 10:40:19.899135 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1826/3556] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:19 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:19.910310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5951d7cf-8799-4f96-ad5e-5f434e21e706 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:19.911801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5951d7cf-8799-4f96-ad5e-5f434e21e706 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:19.920130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5951d7cf-8799-4f96-ad5e-5f434e21e706 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:19.921101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5951d7cf-8799-4f96-ad5e-5f434e21e706 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:19.921906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5951d7cf-8799-4f96-ad5e-5f434e21e706 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:19.923433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5951d7cf-8799-4f96-ad5e-5f434e21e706 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:19.924090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5951d7cf-8799-4f96-ad5e-5f434e21e706 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:19.925151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5951d7cf-8799-4f96-ad5e-5f434e21e706 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:19.939554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-157a8f0b-51bf-4110-a13f-f3742e3b23f3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:19.948479 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-157a8f0b-51bf-4110-a13f-f3742e3b23f3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1325 microversion: 2.1 time: 0.892378 Oct 24 10:40:19.949482 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1731/3557] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:19 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1325 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:19.956797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3cdfa676-03bb-4a57-86b3-1fadc6e37319 req-8d2daae7-0be5-4935-acce-4c4705c516a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1275c7b-79eb-4b3e-9d51-8311925edeb7", "tag": "f243fc6d-f6ad-467a-9a63-c692237aa8b3"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:19.968165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3cdfa676-03bb-4a57-86b3-1fadc6e37319 req-8d2daae7-0be5-4935-acce-4c4705c516a1 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:19.968954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3cdfa676-03bb-4a57-86b3-1fadc6e37319 req-8d2daae7-0be5-4935-acce-4c4705c516a1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:19.969558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3cdfa676-03bb-4a57-86b3-1fadc6e37319 req-8d2daae7-0be5-4935-acce-4c4705c516a1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:19.976439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:19.983476 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3cdfa676-03bb-4a57-86b3-1fadc6e37319 req-8d2daae7-0be5-4935-acce-4c4705c516a1 service nova] Creating event network-changed:f243fc6d-f6ad-467a-9a63-c692237aa8b3 for instance e1275c7b-79eb-4b3e-9d51-8311925edeb7 on n-h1-858383-15 Oct 24 10:40:19.991651 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3cdfa676-03bb-4a57-86b3-1fadc6e37319 req-8d2daae7-0be5-4935-acce-4c4705c516a1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039848 Oct 24 10:40:19.993020 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1732/3558] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:19.999406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5fdf68de-f583-4cbd-b6d8-36026bdc91a7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:20.000419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5fdf68de-f583-4cbd-b6d8-36026bdc91a7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:20.008580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fdf68de-f583-4cbd-b6d8-36026bdc91a7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:20.009363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fdf68de-f583-4cbd-b6d8-36026bdc91a7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:20.009970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fdf68de-f583-4cbd-b6d8-36026bdc91a7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:20.010888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fdf68de-f583-4cbd-b6d8-36026bdc91a7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:20.011538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fdf68de-f583-4cbd-b6d8-36026bdc91a7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:20.012137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fdf68de-f583-4cbd-b6d8-36026bdc91a7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:20.317445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5fdf68de-f583-4cbd-b6d8-36026bdc91a7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:20.338796 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5fdf68de-f583-4cbd-b6d8-36026bdc91a7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1315 microversion: 2.1 time: 0.344301 Oct 24 10:40:20.355825 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1733/3559] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:19 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:20.362394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-142c40e8-340e-4c5e-8e1e-1a14e5ea2da3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:20.363652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-142c40e8-340e-4c5e-8e1e-1a14e5ea2da3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:20.373675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-142c40e8-340e-4c5e-8e1e-1a14e5ea2da3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:20.374412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-142c40e8-340e-4c5e-8e1e-1a14e5ea2da3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:20.375010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-142c40e8-340e-4c5e-8e1e-1a14e5ea2da3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:20.375913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-142c40e8-340e-4c5e-8e1e-1a14e5ea2da3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:20.376663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-142c40e8-340e-4c5e-8e1e-1a14e5ea2da3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:20.377290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-142c40e8-340e-4c5e-8e1e-1a14e5ea2da3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:20.445912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5951d7cf-8799-4f96-ad5e-5f434e21e706 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418cfb97b2444502bedf855f9f147734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090743f0fdd0463fbd220eebe9c67651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:20.457574 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5951d7cf-8799-4f96-ad5e-5f434e21e706 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 200 len: 1314 microversion: 2.1 time: 0.556293 Oct 24 10:40:20.459553 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1827/3560] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:19 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:20.663259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-142c40e8-340e-4c5e-8e1e-1a14e5ea2da3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:20.673105 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-142c40e8-340e-4c5e-8e1e-1a14e5ea2da3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1487 microversion: 2.1 time: 0.315437 Oct 24 10:40:20.690537 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1734/3561] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:20 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1487 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:20.700910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ffc2bb3a-be83-41c2-806f-3f97fb291caf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:20.701687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ffc2bb3a-be83-41c2-806f-3f97fb291caf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:20.710616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffc2bb3a-be83-41c2-806f-3f97fb291caf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:20.711479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffc2bb3a-be83-41c2-806f-3f97fb291caf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:20.713045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffc2bb3a-be83-41c2-806f-3f97fb291caf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:20.714158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffc2bb3a-be83-41c2-806f-3f97fb291caf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:20.714790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffc2bb3a-be83-41c2-806f-3f97fb291caf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:20.715389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ffc2bb3a-be83-41c2-806f-3f97fb291caf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:20.753870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ffc2bb3a-be83-41c2-806f-3f97fb291caf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:40:20.863910 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ffc2bb3a-be83-41c2-806f-3f97fb291caf tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "DELETE /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 204 len: 0 microversion: 2.1 time: 0.168080 Oct 24 10:40:20.865904 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1828/3562] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:40:20 2022] DELETE /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:40:20.879145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ca8a5dbd-7d94-4e83-844f-d9b9a1990144 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:20.880271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ca8a5dbd-7d94-4e83-844f-d9b9a1990144 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:20.892388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca8a5dbd-7d94-4e83-844f-d9b9a1990144 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:20.892928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca8a5dbd-7d94-4e83-844f-d9b9a1990144 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:20.893381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca8a5dbd-7d94-4e83-844f-d9b9a1990144 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:20.894359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca8a5dbd-7d94-4e83-844f-d9b9a1990144 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:20.894839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca8a5dbd-7d94-4e83-844f-d9b9a1990144 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:20.895639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca8a5dbd-7d94-4e83-844f-d9b9a1990144 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:20.927469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4e95a139-8c80-4412-a6da-d41ad36e5062 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:20.933323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e95a139-8c80-4412-a6da-d41ad36e5062 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:20.934808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e95a139-8c80-4412-a6da-d41ad36e5062 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:20.935811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e95a139-8c80-4412-a6da-d41ad36e5062 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:20.936792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e95a139-8c80-4412-a6da-d41ad36e5062 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:20.938560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e95a139-8c80-4412-a6da-d41ad36e5062 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:20.939195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e95a139-8c80-4412-a6da-d41ad36e5062 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:20.971048 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4e95a139-8c80-4412-a6da-d41ad36e5062 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.206582 Oct 24 10:40:20.972643 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1735/3563] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:40:20 2022] GET /compute/v2.1/os-services => generated 949 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:20.981435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3e27e910-765e-4e89-840c-4f7724097644 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:20.982305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3e27e910-765e-4e89-840c-4f7724097644 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:20.995585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e27e910-765e-4e89-840c-4f7724097644 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:20.996475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e27e910-765e-4e89-840c-4f7724097644 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:20.997638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e27e910-765e-4e89-840c-4f7724097644 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:20.998677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e27e910-765e-4e89-840c-4f7724097644 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:20.999645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e27e910-765e-4e89-840c-4f7724097644 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:21.000262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e27e910-765e-4e89-840c-4f7724097644 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:21.124959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ca8a5dbd-7d94-4e83-844f-d9b9a1990144 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:21.136880 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ca8a5dbd-7d94-4e83-844f-d9b9a1990144 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1493 microversion: 2.1 time: 0.266162 Oct 24 10:40:21.138086 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1829/3564] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:20 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1493 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:21.142865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-83aa106e-0a1e-427e-b6de-1627395579ee tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:21.143473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-83aa106e-0a1e-427e-b6de-1627395579ee tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:21.150950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83aa106e-0a1e-427e-b6de-1627395579ee tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:21.151748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83aa106e-0a1e-427e-b6de-1627395579ee tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:21.153129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83aa106e-0a1e-427e-b6de-1627395579ee tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:21.153876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83aa106e-0a1e-427e-b6de-1627395579ee tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:21.154585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83aa106e-0a1e-427e-b6de-1627395579ee tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:21.155014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83aa106e-0a1e-427e-b6de-1627395579ee tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:21.247088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3e27e910-765e-4e89-840c-4f7724097644 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:21.259322 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3e27e910-765e-4e89-840c-4f7724097644 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.284989 Oct 24 10:40:21.260427 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1736/3565] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:20 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:21.269248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4d282317-f567-4cc4-8728-06f9e2e85ee0 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:21.274199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d282317-f567-4cc4-8728-06f9e2e85ee0 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:21.274887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d282317-f567-4cc4-8728-06f9e2e85ee0 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:21.275508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d282317-f567-4cc4-8728-06f9e2e85ee0 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:21.276411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d282317-f567-4cc4-8728-06f9e2e85ee0 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:21.277163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d282317-f567-4cc4-8728-06f9e2e85ee0 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:21.277595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d282317-f567-4cc4-8728-06f9e2e85ee0 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:21.306323 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4d282317-f567-4cc4-8728-06f9e2e85ee0 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.044188 Oct 24 10:40:21.307141 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1737/3566] 10.222.0.50 () {58 vars in 1170 bytes} [Mon Oct 24 10:40:21 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:21.320311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cb409220-6d50-421b-8d91-ef5fe3291e58 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:21.323916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb409220-6d50-421b-8d91-ef5fe3291e58 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:21.324401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb409220-6d50-421b-8d91-ef5fe3291e58 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:21.324875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb409220-6d50-421b-8d91-ef5fe3291e58 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:21.325592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb409220-6d50-421b-8d91-ef5fe3291e58 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:21.326054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb409220-6d50-421b-8d91-ef5fe3291e58 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:21.326467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb409220-6d50-421b-8d91-ef5fe3291e58 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:21.339138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-83aa106e-0a1e-427e-b6de-1627395579ee tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:21.348872 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-83aa106e-0a1e-427e-b6de-1627395579ee tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1325 microversion: 2.1 time: 0.209651 Oct 24 10:40:21.350352 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1830/3567] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:21 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1325 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:21.354322 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cb409220-6d50-421b-8d91-ef5fe3291e58 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.037626 Oct 24 10:40:21.354936 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1738/3568] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:40:21 2022] GET /compute/v2.1/os-services => generated 949 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:40:21.369536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-74f9b173-d16f-47b9-9fea-14360a19c765 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:21.370148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-74f9b173-d16f-47b9-9fea-14360a19c765 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:21.373506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-27440155-690f-432e-b1d6-919f5eb83abc tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:21.378947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27440155-690f-432e-b1d6-919f5eb83abc tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:21.379764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27440155-690f-432e-b1d6-919f5eb83abc tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:21.379893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74f9b173-d16f-47b9-9fea-14360a19c765 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:21.380215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27440155-690f-432e-b1d6-919f5eb83abc tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:21.380334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74f9b173-d16f-47b9-9fea-14360a19c765 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:21.380960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74f9b173-d16f-47b9-9fea-14360a19c765 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:21.381366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27440155-690f-432e-b1d6-919f5eb83abc tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:21.381661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74f9b173-d16f-47b9-9fea-14360a19c765 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:21.382115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74f9b173-d16f-47b9-9fea-14360a19c765 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:21.382227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27440155-690f-432e-b1d6-919f5eb83abc tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:21.382573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74f9b173-d16f-47b9-9fea-14360a19c765 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:21.382691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27440155-690f-432e-b1d6-919f5eb83abc tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:21.413907 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-27440155-690f-432e-b1d6-919f5eb83abc tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=n-d-858383-15&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.048835 Oct 24 10:40:21.414839 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1831/3569] 10.222.0.50 () {58 vars in 1196 bytes} [Mon Oct 24 10:40:21 2022] GET /compute/v2.1/os-services?host=n-d-858383-15&binary=xxx => generated 16 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:40:21.426607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6ecc9c2f-e422-464a-912c-9dfa1f71e3f1 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:21.431379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ecc9c2f-e422-464a-912c-9dfa1f71e3f1 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:21.431983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ecc9c2f-e422-464a-912c-9dfa1f71e3f1 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:21.432492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ecc9c2f-e422-464a-912c-9dfa1f71e3f1 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:21.433340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ecc9c2f-e422-464a-912c-9dfa1f71e3f1 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:21.433982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ecc9c2f-e422-464a-912c-9dfa1f71e3f1 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:21.434596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ecc9c2f-e422-464a-912c-9dfa1f71e3f1 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:21.452566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:21.464142 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6ecc9c2f-e422-464a-912c-9dfa1f71e3f1 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.041157 Oct 24 10:40:21.465200 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1832/3570] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:40:21 2022] GET /compute/v2.1/os-services => generated 949 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:21.480784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a81ad655-0f97-4d8c-9419-ca98dd852b71 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:21.485068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a81ad655-0f97-4d8c-9419-ca98dd852b71 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:21.485647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a81ad655-0f97-4d8c-9419-ca98dd852b71 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:21.486154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a81ad655-0f97-4d8c-9419-ca98dd852b71 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:21.486971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a81ad655-0f97-4d8c-9419-ca98dd852b71 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:21.487500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a81ad655-0f97-4d8c-9419-ca98dd852b71 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:21.487997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a81ad655-0f97-4d8c-9419-ca98dd852b71 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:21.518631 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a81ad655-0f97-4d8c-9419-ca98dd852b71 tempest-ServicesAdminNegativeTestJSON-564832753 tempest-ServicesAdminNegativeTestJSON-564832753-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.042112 Oct 24 10:40:21.519387 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1833/3571] 10.222.0.50 () {58 vars in 1198 bytes} [Mon Oct 24 10:40:21 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:40:21.531456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-714855a5-c438-439c-8cb7-1fb62731e444 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:21.532583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-714855a5-c438-439c-8cb7-1fb62731e444 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:21.539684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-714855a5-c438-439c-8cb7-1fb62731e444 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:21.540445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-714855a5-c438-439c-8cb7-1fb62731e444 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:21.541356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-714855a5-c438-439c-8cb7-1fb62731e444 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:21.542532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-714855a5-c438-439c-8cb7-1fb62731e444 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:21.543310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-714855a5-c438-439c-8cb7-1fb62731e444 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:21.544127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-714855a5-c438-439c-8cb7-1fb62731e444 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:21.549131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-74f9b173-d16f-47b9-9fea-14360a19c765 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:21.560395 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-74f9b173-d16f-47b9-9fea-14360a19c765 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1315 microversion: 2.1 time: 0.194408 Oct 24 10:40:21.561057 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1739/3572] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:21 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:21.677556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-44b76b76-f62a-40ca-9333-18db8fbd12b8 tempest-ServicesAdminNegativeTestJSON-1305537301 tempest-ServicesAdminNegativeTestJSON-1305537301-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:21.682214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-44b76b76-f62a-40ca-9333-18db8fbd12b8 tempest-ServicesAdminNegativeTestJSON-1305537301 tempest-ServicesAdminNegativeTestJSON-1305537301-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '513de461017241af92a8dadcb46e05b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7cc9a15460428a89feb69e99371ecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-44b76b76-f62a-40ca-9333-18db8fbd12b8 tempest-ServicesAdminNegativeTestJSON-1305537301 tempest-ServicesAdminNegativeTestJSON-1305537301-project] Request method failure captured: Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmuT9mTr3AqcM3T5f3ytoq8xuthpXJpW94SGWok3abmaU1qEwKdgBgKoAmmCaXsXHbd_HQt45MYhY1Fe1MyJgfLpuWtavkjXRDgmyXoSzq-qssYcFEwVPbjmLUTFNTX3K6pfHBpyMaHlUTbpM0Wwsb64maR9xlQFvjdMDES44sVsNHo Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: ee7cc9a15460428a89feb69e99371ecc Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1305537301 Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ee7cc9a15460428a89feb69e99371ecc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ee7cc9a15460428a89feb69e99371ecc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ee7cc9a15460428a89feb69e99371ecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ee7cc9a15460428a89feb69e99371ecc", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1305537301 Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: ee7cc9a15460428a89feb69e99371ecc Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1305537301 Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServicesAdminNegativeTestJSON-1305537301-project Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 513de461017241af92a8dadcb46e05b1 Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1305537301-project Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: action_args: {} Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 24 10:40:21.683988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:21.689227 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:21.689227 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:21.689227 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:21.689227 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:21.689227 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:21.689227 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:40:21.689227 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:40:21.689227 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 24 10:40:21.689227 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:21.689227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-44b76b76-f62a-40ca-9333-18db8fbd12b8 tempest-ServicesAdminNegativeTestJSON-1305537301 tempest-ServicesAdminNegativeTestJSON-1305537301-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:21.689227 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-44b76b76-f62a-40ca-9333-18db8fbd12b8 tempest-ServicesAdminNegativeTestJSON-1305537301 tempest-ServicesAdminNegativeTestJSON-1305537301-project] 10.222.0.50 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.123255 Oct 24 10:40:21.689227 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1740/3573] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:40:21 2022] GET /compute/v2.1/os-services => generated 112 bytes in 125 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:40:21.770981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-714855a5-c438-439c-8cb7-1fb62731e444 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418cfb97b2444502bedf855f9f147734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090743f0fdd0463fbd220eebe9c67651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:21.779595 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-714855a5-c438-439c-8cb7-1fb62731e444 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 200 len: 1314 microversion: 2.1 time: 0.258337 Oct 24 10:40:21.780544 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1834/3574] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:21 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:22.161706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2f00d6f3-17ea-4108-8f3d-753002321b03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:22.163245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2f00d6f3-17ea-4108-8f3d-753002321b03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:22.170925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f00d6f3-17ea-4108-8f3d-753002321b03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:22.171542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f00d6f3-17ea-4108-8f3d-753002321b03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:22.172060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f00d6f3-17ea-4108-8f3d-753002321b03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:22.173224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f00d6f3-17ea-4108-8f3d-753002321b03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:22.173902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f00d6f3-17ea-4108-8f3d-753002321b03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:22.174345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f00d6f3-17ea-4108-8f3d-753002321b03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:22.285744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54225b8e-ef9f-47f1-b657-9dcd4c1b27be tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:22.286411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-54225b8e-ef9f-47f1-b657-9dcd4c1b27be tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:22.299695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54225b8e-ef9f-47f1-b657-9dcd4c1b27be tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:22.303386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54225b8e-ef9f-47f1-b657-9dcd4c1b27be tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:22.304191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54225b8e-ef9f-47f1-b657-9dcd4c1b27be tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:22.305709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54225b8e-ef9f-47f1-b657-9dcd4c1b27be tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:22.306604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54225b8e-ef9f-47f1-b657-9dcd4c1b27be tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:22.307425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54225b8e-ef9f-47f1-b657-9dcd4c1b27be tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:22.383993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2f00d6f3-17ea-4108-8f3d-753002321b03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:22.402676 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2f00d6f3-17ea-4108-8f3d-753002321b03 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1493 microversion: 2.1 time: 0.245761 Oct 24 10:40:22.403498 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1741/3575] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:22 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1493 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:22.409009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-927846df-b25e-484a-bb73-c1c7b5e53d49 req-4509ab67-c6d3-4831-a532-9ec697980e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5da901c-0851-4c31-9547-cd138b752ed6", "name": "network-vif-plugged", "status": "completed", "tag": "4f06be00-fe8b-4664-a038-85071a5cc14e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:22.420768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-927846df-b25e-484a-bb73-c1c7b5e53d49 req-4509ab67-c6d3-4831-a532-9ec697980e00 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:22.421517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-927846df-b25e-484a-bb73-c1c7b5e53d49 req-4509ab67-c6d3-4831-a532-9ec697980e00 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:22.422234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-927846df-b25e-484a-bb73-c1c7b5e53d49 req-4509ab67-c6d3-4831-a532-9ec697980e00 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:22.437478 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-927846df-b25e-484a-bb73-c1c7b5e53d49 req-4509ab67-c6d3-4831-a532-9ec697980e00 service nova] Creating event network-vif-plugged:4f06be00-fe8b-4664-a038-85071a5cc14e for instance b5da901c-0851-4c31-9547-cd138b752ed6 on n-h1-858383-15 Oct 24 10:40:22.442888 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-927846df-b25e-484a-bb73-c1c7b5e53d49 req-4509ab67-c6d3-4831-a532-9ec697980e00 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037899 Oct 24 10:40:22.444941 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1742/3576] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:22.451779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b1adbf09-6a88-43be-bd69-a976317c1d93 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:22.452925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b1adbf09-6a88-43be-bd69-a976317c1d93 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:22.461598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1adbf09-6a88-43be-bd69-a976317c1d93 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:22.462606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1adbf09-6a88-43be-bd69-a976317c1d93 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:22.463330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1adbf09-6a88-43be-bd69-a976317c1d93 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:22.464412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1adbf09-6a88-43be-bd69-a976317c1d93 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:22.465403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1adbf09-6a88-43be-bd69-a976317c1d93 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:22.466042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1adbf09-6a88-43be-bd69-a976317c1d93 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:22.551081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-54225b8e-ef9f-47f1-b657-9dcd4c1b27be tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:22.560716 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-54225b8e-ef9f-47f1-b657-9dcd4c1b27be tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.279797 Oct 24 10:40:22.561761 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1835/3577] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:22 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:40:22.585844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6e1b0aae-f71a-401a-ae7e-b140657b965c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:22.587224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6e1b0aae-f71a-401a-ae7e-b140657b965c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:22.598760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e1b0aae-f71a-401a-ae7e-b140657b965c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:22.600255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e1b0aae-f71a-401a-ae7e-b140657b965c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:22.600909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e1b0aae-f71a-401a-ae7e-b140657b965c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:22.601819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e1b0aae-f71a-401a-ae7e-b140657b965c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:22.602493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e1b0aae-f71a-401a-ae7e-b140657b965c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:22.603139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e1b0aae-f71a-401a-ae7e-b140657b965c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:22.793984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b1adbf09-6a88-43be-bd69-a976317c1d93 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:22.805249 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b1adbf09-6a88-43be-bd69-a976317c1d93 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1325 microversion: 2.1 time: 0.358681 Oct 24 10:40:22.812922 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1743/3578] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:22 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1325 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:22.812922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9fdb48a8-a383-4161-a7f0-8ff73246ba4e tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:22.812922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9fdb48a8-a383-4161-a7f0-8ff73246ba4e tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:22.818303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fdb48a8-a383-4161-a7f0-8ff73246ba4e tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:22.819056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fdb48a8-a383-4161-a7f0-8ff73246ba4e tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:22.819538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fdb48a8-a383-4161-a7f0-8ff73246ba4e tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:22.820258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fdb48a8-a383-4161-a7f0-8ff73246ba4e tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:22.821725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fdb48a8-a383-4161-a7f0-8ff73246ba4e tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:22.821725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9fdb48a8-a383-4161-a7f0-8ff73246ba4e tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:22.874343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e1b0aae-f71a-401a-ae7e-b140657b965c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:22.886000 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6e1b0aae-f71a-401a-ae7e-b140657b965c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1315 microversion: 2.1 time: 0.305247 Oct 24 10:40:22.887460 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1836/3579] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:22 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:40:23.033283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9fdb48a8-a383-4161-a7f0-8ff73246ba4e tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418cfb97b2444502bedf855f9f147734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090743f0fdd0463fbd220eebe9c67651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:23.043429 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9fdb48a8-a383-4161-a7f0-8ff73246ba4e tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 200 len: 1314 microversion: 2.1 time: 0.236050 Oct 24 10:40:23.044020 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1744/3580] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:22 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:23.431256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8eeecb51-baea-4815-b814-7b3afa48a08c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:23.432636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8eeecb51-baea-4815-b814-7b3afa48a08c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:23.440647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8eeecb51-baea-4815-b814-7b3afa48a08c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:23.441194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8eeecb51-baea-4815-b814-7b3afa48a08c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:23.441703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8eeecb51-baea-4815-b814-7b3afa48a08c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:23.442318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8eeecb51-baea-4815-b814-7b3afa48a08c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:23.443404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8eeecb51-baea-4815-b814-7b3afa48a08c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:23.444007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8eeecb51-baea-4815-b814-7b3afa48a08c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:23.585737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-34f4eded-35e0-4985-be48-9ed00b492940 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:23.587153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-34f4eded-35e0-4985-be48-9ed00b492940 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:23.594531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34f4eded-35e0-4985-be48-9ed00b492940 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:23.595634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34f4eded-35e0-4985-be48-9ed00b492940 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:23.596268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34f4eded-35e0-4985-be48-9ed00b492940 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:23.598015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34f4eded-35e0-4985-be48-9ed00b492940 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:23.598849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34f4eded-35e0-4985-be48-9ed00b492940 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:23.600114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34f4eded-35e0-4985-be48-9ed00b492940 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:23.619917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8eeecb51-baea-4815-b814-7b3afa48a08c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:23.636761 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8eeecb51-baea-4815-b814-7b3afa48a08c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1493 microversion: 2.1 time: 0.210920 Oct 24 10:40:23.637872 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1837/3581] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:23 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1493 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:23.831478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-06d497e0-e314-4c9a-afa5-781f0856e085 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:23.832912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-06d497e0-e314-4c9a-afa5-781f0856e085 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:23.841207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06d497e0-e314-4c9a-afa5-781f0856e085 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:23.841999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06d497e0-e314-4c9a-afa5-781f0856e085 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:23.842647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06d497e0-e314-4c9a-afa5-781f0856e085 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:23.844337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06d497e0-e314-4c9a-afa5-781f0856e085 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:23.845033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06d497e0-e314-4c9a-afa5-781f0856e085 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:23.845663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06d497e0-e314-4c9a-afa5-781f0856e085 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:23.964393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-34f4eded-35e0-4985-be48-9ed00b492940 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:23.972873 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-34f4eded-35e0-4985-be48-9ed00b492940 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.392414 Oct 24 10:40:23.973458 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1745/3582] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:23 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:40:23.982877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fbe61431-1945-4659-9998-9df544f9ced9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:23.983681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fbe61431-1945-4659-9998-9df544f9ced9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:23.996197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbe61431-1945-4659-9998-9df544f9ced9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:23.997526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbe61431-1945-4659-9998-9df544f9ced9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:23.998443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbe61431-1945-4659-9998-9df544f9ced9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:23.999160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbe61431-1945-4659-9998-9df544f9ced9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:24.000061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbe61431-1945-4659-9998-9df544f9ced9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:24.000787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbe61431-1945-4659-9998-9df544f9ced9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:24.180565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-06d497e0-e314-4c9a-afa5-781f0856e085 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:24.192469 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-06d497e0-e314-4c9a-afa5-781f0856e085 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1325 microversion: 2.1 time: 0.364043 Oct 24 10:40:24.194778 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1838/3583] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:23 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1325 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:24.200514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-47cbb769-8e14-4c73-a491-828e6097023c tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:24.201413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-47cbb769-8e14-4c73-a491-828e6097023c tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:24.209328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47cbb769-8e14-4c73-a491-828e6097023c tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:24.209904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47cbb769-8e14-4c73-a491-828e6097023c tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:24.211326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47cbb769-8e14-4c73-a491-828e6097023c tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:24.212125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47cbb769-8e14-4c73-a491-828e6097023c tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:24.213461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47cbb769-8e14-4c73-a491-828e6097023c tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:24.215785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47cbb769-8e14-4c73-a491-828e6097023c tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:24.268365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fbe61431-1945-4659-9998-9df544f9ced9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:24.278933 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fbe61431-1945-4659-9998-9df544f9ced9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1315 microversion: 2.1 time: 0.302899 Oct 24 10:40:24.279763 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1746/3584] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:23 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:24.428550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-47cbb769-8e14-4c73-a491-828e6097023c tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418cfb97b2444502bedf855f9f147734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090743f0fdd0463fbd220eebe9c67651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:24.440678 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-47cbb769-8e14-4c73-a491-828e6097023c tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 200 len: 1314 microversion: 2.1 time: 0.243950 Oct 24 10:40:24.441961 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1839/3585] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:24 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:24.661728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-373eaf48-2645-4ede-a947-04abaea53be8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:24.662579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-373eaf48-2645-4ede-a947-04abaea53be8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:24.675062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-373eaf48-2645-4ede-a947-04abaea53be8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:24.675778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-373eaf48-2645-4ede-a947-04abaea53be8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:24.676220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-373eaf48-2645-4ede-a947-04abaea53be8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:24.677007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-373eaf48-2645-4ede-a947-04abaea53be8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:24.677460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-373eaf48-2645-4ede-a947-04abaea53be8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:24.679159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-373eaf48-2645-4ede-a947-04abaea53be8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:24.683753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:24.896232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-373eaf48-2645-4ede-a947-04abaea53be8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:24.909456 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-373eaf48-2645-4ede-a947-04abaea53be8 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1493 microversion: 2.1 time: 0.250263 Oct 24 10:40:24.910779 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1747/3586] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:24 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1493 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:24.998080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f14cb5cf-b863-41a1-93d8-5e39e0fa3b86 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:24.998770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f14cb5cf-b863-41a1-93d8-5e39e0fa3b86 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:25.008740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f14cb5cf-b863-41a1-93d8-5e39e0fa3b86 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:25.009298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f14cb5cf-b863-41a1-93d8-5e39e0fa3b86 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:25.009746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f14cb5cf-b863-41a1-93d8-5e39e0fa3b86 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:25.010466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f14cb5cf-b863-41a1-93d8-5e39e0fa3b86 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:25.011105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f14cb5cf-b863-41a1-93d8-5e39e0fa3b86 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:25.011548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f14cb5cf-b863-41a1-93d8-5e39e0fa3b86 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:25.202439 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8e63f559-c7bf-4d56-9930-487b5a952836 tempest-TenantUsagesNegativeTestJSON-1225174343 tempest-TenantUsagesNegativeTestJSON-1225174343-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-23T10%3A40%3A25.032791&end=2022-10-25T10%3A40%3A25.032791" status: 404 len: 112 microversion: - time: 0.163004 Oct 24 10:40:25.203250 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1748/3587] 10.222.0.50 () {58 vars in 1316 bytes} [Mon Oct 24 10:40:25 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-23T10%3A40%3A25.032791&end=2022-10-25T10%3A40%3A25.032791 => generated 112 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 24 10:40:25.214453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33c597e2-3ee5-4d16-b388-e33c684b4e65 tempest-TenantUsagesNegativeTestJSON-1225174343 tempest-TenantUsagesNegativeTestJSON-1225174343-project-admin] Calling method '.version_select at 0x7f04d4fb1160>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:25.219402 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-33c597e2-3ee5-4d16-b388-e33c684b4e65 tempest-TenantUsagesNegativeTestJSON-1225174343 tempest-TenantUsagesNegativeTestJSON-1225174343-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33c597e2-3ee5-4d16-b388-e33c684b4e65 tempest-TenantUsagesNegativeTestJSON-1225174343 tempest-TenantUsagesNegativeTestJSON-1225174343-project-admin] Request method failure captured: Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-simple-tenant-usage/8f177e5afed043babc9de1217b6b49cd?start=2022-10-25T10%3A40%3A25.032791&end=2022-10-23T10%3A40%3A25.032791 HTTP/1.1 Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmuYCzc-ogCiiMbPMI-FxfpGARTk_cO3GdlrBZO3JXxLE7LnFHa6n90CwlD0Ggo9NiN74KuT5MwCSacRlpw_yqxEmcTbwL-VKC4XZkZ0HtYhmXDcDjUD9-8mncuftGlKjpolZXMegcEPZjyb8JH48WhNzCasg3Z7imPSGnPQlK4zCRM Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 0d443111e12a414cb2a661b5260f719f Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1225174343 Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0d443111e12a414cb2a661b5260f719f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0d443111e12a414cb2a661b5260f719f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0d443111e12a414cb2a661b5260f719f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0d443111e12a414cb2a661b5260f719f", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1225174343 Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 0d443111e12a414cb2a661b5260f719f Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1225174343 Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TenantUsagesNegativeTestJSON-1225174343-project-admin Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 87dba7e30de3401dae521ff3676ab295 Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1225174343-project-admin Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid start time. The start time cannot occur after the end time. Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '8f177e5afed043babc9de1217b6b49cd'} Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 24 10:40:25.227140 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:25.238707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33c597e2-3ee5-4d16-b388-e33c684b4e65 tempest-TenantUsagesNegativeTestJSON-1225174343 tempest-TenantUsagesNegativeTestJSON-1225174343-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:25.238707 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-33c597e2-3ee5-4d16-b388-e33c684b4e65 tempest-TenantUsagesNegativeTestJSON-1225174343 tempest-TenantUsagesNegativeTestJSON-1225174343-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/8f177e5afed043babc9de1217b6b49cd?start=2022-10-25T10%3A40%3A25.032791&end=2022-10-23T10%3A40%3A25.032791" status: 400 len: 111 microversion: 2.1 time: 0.018483 Oct 24 10:40:25.238707 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1749/3588] 10.222.0.50 () {58 vars in 1412 bytes} [Mon Oct 24 10:40:25 2022] GET /compute/v2.1/os-simple-tenant-usage/8f177e5afed043babc9de1217b6b49cd?start=2022-10-25T10%3A40%3A25.032791&end=2022-10-23T10%3A40%3A25.032791 => generated 111 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 10:40:25.243729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7cc21fbc-504b-4fb6-91c0-37c4c3505866 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:25.244429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7cc21fbc-504b-4fb6-91c0-37c4c3505866 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:25.251871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cc21fbc-504b-4fb6-91c0-37c4c3505866 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:25.252236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f14cb5cf-b863-41a1-93d8-5e39e0fa3b86 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:25.252382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cc21fbc-504b-4fb6-91c0-37c4c3505866 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:25.252784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cc21fbc-504b-4fb6-91c0-37c4c3505866 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:25.253567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cc21fbc-504b-4fb6-91c0-37c4c3505866 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:25.254024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cc21fbc-504b-4fb6-91c0-37c4c3505866 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:25.254735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cc21fbc-504b-4fb6-91c0-37c4c3505866 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:25.266753 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f14cb5cf-b863-41a1-93d8-5e39e0fa3b86 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.272736 Oct 24 10:40:25.267428 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1840/3589] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:24 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:25.420230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7cc21fbc-504b-4fb6-91c0-37c4c3505866 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:25.426989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-77627e00-6995-414c-a834-9dd3a7030d7c tempest-TenantUsagesNegativeTestJSON-88962328 tempest-TenantUsagesNegativeTestJSON-88962328-project] Calling method '.version_select at 0x7f04d00e4940>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:25.434921 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7cc21fbc-504b-4fb6-91c0-37c4c3505866 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1325 microversion: 2.1 time: 0.204151 Oct 24 10:40:25.435900 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1750/3590] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:25 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1325 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:25.436408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-77627e00-6995-414c-a834-9dd3a7030d7c tempest-TenantUsagesNegativeTestJSON-88962328 tempest-TenantUsagesNegativeTestJSON-88962328-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '4e8cfc335ebd474288da457048fe0e0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f177e5afed043babc9de1217b6b49cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-77627e00-6995-414c-a834-9dd3a7030d7c tempest-TenantUsagesNegativeTestJSON-88962328 tempest-TenantUsagesNegativeTestJSON-88962328-project] Request method failure captured: Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-23T10%3A40%3A25.032791&end=2022-10-25T10%3A40%3A25.032791&detailed=1 HTTP/1.1 Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmuYJ3PbuaCBg5pGS5DeVSjYr-lgiUBHJScqksAeOMiRCdbmuY_CH-_U1LHOwztRUAsq61vrS72NVf1ClvO_u3IQeDBNB1978Q6BIop1r6TszNGogl13ii9WKQQD_TXOtNIrS14LuB3XmYEw4NwWa2nZKS3hTx4kz0zWO7rZ-kLTdJI Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 8f177e5afed043babc9de1217b6b49cd Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-88962328 Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8f177e5afed043babc9de1217b6b49cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8f177e5afed043babc9de1217b6b49cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8f177e5afed043babc9de1217b6b49cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8f177e5afed043babc9de1217b6b49cd", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-88962328 Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 8f177e5afed043babc9de1217b6b49cd Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-88962328 Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TenantUsagesNegativeTestJSON-88962328-project Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 4e8cfc335ebd474288da457048fe0e0e Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-88962328-project Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: action_args: {} Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 10:40:25.438814 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 24 10:40:25.444573 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 24 10:40:25.444573 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:25.444573 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:25.444573 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:25.444573 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:25.444573 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:25.444573 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:25.444573 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 24 10:40:25.444573 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 24 10:40:25.444573 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 24 10:40:25.444573 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:25.445580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-61888aea-9862-4976-84de-a36af16edc96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:25.445580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-61888aea-9862-4976-84de-a36af16edc96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:25.447224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-77627e00-6995-414c-a834-9dd3a7030d7c tempest-TenantUsagesNegativeTestJSON-88962328 tempest-TenantUsagesNegativeTestJSON-88962328-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:25.448346 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-77627e00-6995-414c-a834-9dd3a7030d7c tempest-TenantUsagesNegativeTestJSON-88962328 tempest-TenantUsagesNegativeTestJSON-88962328-project] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-23T10%3A40%3A25.032791&end=2022-10-25T10%3A40%3A25.032791&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.179777 Oct 24 10:40:25.449303 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1841/3591] 10.222.0.50 () {58 vars in 1335 bytes} [Mon Oct 24 10:40:25 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-23T10%3A40%3A25.032791&end=2022-10-25T10%3A40%3A25.032791&detailed=1 => generated 123 bytes in 181 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:40:25.455546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61888aea-9862-4976-84de-a36af16edc96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:25.460900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-b6e5b829-b4c0-45ea-977c-787347886439 req-7529ab3f-def6-466a-a14b-121e1db5f62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f9e553-a2d6-4c33-8f37-2cd23977137a", "name": "network-vif-deleted", "tag": "7f7f6e60-119a-48e8-b07a-627be75820a9"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:25.462364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61888aea-9862-4976-84de-a36af16edc96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:25.463009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61888aea-9862-4976-84de-a36af16edc96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:25.464419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61888aea-9862-4976-84de-a36af16edc96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:25.465231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61888aea-9862-4976-84de-a36af16edc96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:25.465899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61888aea-9862-4976-84de-a36af16edc96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:25.473601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b6e5b829-b4c0-45ea-977c-787347886439 req-7529ab3f-def6-466a-a14b-121e1db5f62d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:25.474093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b6e5b829-b4c0-45ea-977c-787347886439 req-7529ab3f-def6-466a-a14b-121e1db5f62d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:25.474569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b6e5b829-b4c0-45ea-977c-787347886439 req-7529ab3f-def6-466a-a14b-121e1db5f62d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:25.486689 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-b6e5b829-b4c0-45ea-977c-787347886439 req-7529ab3f-def6-466a-a14b-121e1db5f62d service nova] Creating event network-vif-deleted:7f7f6e60-119a-48e8-b07a-627be75820a9 for instance 81f9e553-a2d6-4c33-8f37-2cd23977137a on n-h1-858383-15 Oct 24 10:40:25.493347 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-b6e5b829-b4c0-45ea-977c-787347886439 req-7529ab3f-def6-466a-a14b-121e1db5f62d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042525 Oct 24 10:40:25.494017 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1842/3592] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:25.504743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a2532a72-2901-4e58-9402-6428ad3672b5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:25.504743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a2532a72-2901-4e58-9402-6428ad3672b5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:25.520911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2532a72-2901-4e58-9402-6428ad3672b5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:25.523193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2532a72-2901-4e58-9402-6428ad3672b5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:25.528541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2532a72-2901-4e58-9402-6428ad3672b5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:25.531131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2532a72-2901-4e58-9402-6428ad3672b5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:25.531795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2532a72-2901-4e58-9402-6428ad3672b5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:25.532646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2532a72-2901-4e58-9402-6428ad3672b5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:25.726251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-61888aea-9862-4976-84de-a36af16edc96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:25.735035 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-61888aea-9862-4976-84de-a36af16edc96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1315 microversion: 2.1 time: 0.296317 Oct 24 10:40:25.736095 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1751/3593] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:25 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:25.799388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a2532a72-2901-4e58-9402-6428ad3672b5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418cfb97b2444502bedf855f9f147734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090743f0fdd0463fbd220eebe9c67651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:25.813638 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a2532a72-2901-4e58-9402-6428ad3672b5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 200 len: 1314 microversion: 2.1 time: 0.314856 Oct 24 10:40:25.814574 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1843/3594] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:25 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:26.163189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d8cff954-aa6e-4f8e-9871-0d59bde040e3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:26.164056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d8cff954-aa6e-4f8e-9871-0d59bde040e3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:26.170394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8cff954-aa6e-4f8e-9871-0d59bde040e3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:26.171133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8cff954-aa6e-4f8e-9871-0d59bde040e3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:26.171714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8cff954-aa6e-4f8e-9871-0d59bde040e3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:26.172408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8cff954-aa6e-4f8e-9871-0d59bde040e3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:26.173102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8cff954-aa6e-4f8e-9871-0d59bde040e3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:26.173629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8cff954-aa6e-4f8e-9871-0d59bde040e3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:26.246269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d8cff954-aa6e-4f8e-9871-0d59bde040e3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:26.254769 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d8cff954-aa6e-4f8e-9871-0d59bde040e3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1451 microversion: 2.1 time: 0.324543 Oct 24 10:40:26.255362 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1752/3595] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:25 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1451 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:26.291959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1099073b-ce3b-4b18-a6a8-d19b3c1adc5e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:26.292503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1099073b-ce3b-4b18-a6a8-d19b3c1adc5e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:26.310584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1099073b-ce3b-4b18-a6a8-d19b3c1adc5e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:26.311089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1099073b-ce3b-4b18-a6a8-d19b3c1adc5e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:26.311538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1099073b-ce3b-4b18-a6a8-d19b3c1adc5e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:26.312266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1099073b-ce3b-4b18-a6a8-d19b3c1adc5e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:26.312730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1099073b-ce3b-4b18-a6a8-d19b3c1adc5e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:26.313191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1099073b-ce3b-4b18-a6a8-d19b3c1adc5e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:26.322745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-66496d28-3fcb-473b-af95-1ad726a519dd req-1be54456-1433-43cf-b121-8b19f67beb5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1275c7b-79eb-4b3e-9d51-8311925edeb7", "name": "network-vif-plugged", "status": "completed", "tag": "f243fc6d-f6ad-467a-9a63-c692237aa8b3"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:26.333553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-66496d28-3fcb-473b-af95-1ad726a519dd req-1be54456-1433-43cf-b121-8b19f67beb5b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:26.334164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-66496d28-3fcb-473b-af95-1ad726a519dd req-1be54456-1433-43cf-b121-8b19f67beb5b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:26.334612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-66496d28-3fcb-473b-af95-1ad726a519dd req-1be54456-1433-43cf-b121-8b19f67beb5b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:26.347277 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-66496d28-3fcb-473b-af95-1ad726a519dd req-1be54456-1433-43cf-b121-8b19f67beb5b service nova] Creating event network-vif-plugged:f243fc6d-f6ad-467a-9a63-c692237aa8b3 for instance e1275c7b-79eb-4b3e-9d51-8311925edeb7 on n-h1-858383-15 Oct 24 10:40:26.352983 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-66496d28-3fcb-473b-af95-1ad726a519dd req-1be54456-1433-43cf-b121-8b19f67beb5b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034127 Oct 24 10:40:26.353593 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1753/3596] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:40:26.464394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-11e3bb96-2728-46ec-93ec-83e38dd976fc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:26.465543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-11e3bb96-2728-46ec-93ec-83e38dd976fc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:26.472085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11e3bb96-2728-46ec-93ec-83e38dd976fc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:26.472574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11e3bb96-2728-46ec-93ec-83e38dd976fc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:26.473108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11e3bb96-2728-46ec-93ec-83e38dd976fc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:26.474012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11e3bb96-2728-46ec-93ec-83e38dd976fc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:26.475165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11e3bb96-2728-46ec-93ec-83e38dd976fc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:26.475774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11e3bb96-2728-46ec-93ec-83e38dd976fc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:26.564623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1099073b-ce3b-4b18-a6a8-d19b3c1adc5e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:26.577298 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1099073b-ce3b-4b18-a6a8-d19b3c1adc5e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.290468 Oct 24 10:40:26.578986 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1844/3597] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:26 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:26.668345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-11e3bb96-2728-46ec-93ec-83e38dd976fc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:26.679533 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-11e3bb96-2728-46ec-93ec-83e38dd976fc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1325 microversion: 2.1 time: 0.220186 Oct 24 10:40:26.681045 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1754/3598] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:26 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1325 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:40:26.759186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ba7ea998-b0ac-4c8a-a85c-5e94eb794a21 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:26.759802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ba7ea998-b0ac-4c8a-a85c-5e94eb794a21 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:26.765886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba7ea998-b0ac-4c8a-a85c-5e94eb794a21 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:26.766373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba7ea998-b0ac-4c8a-a85c-5e94eb794a21 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:26.766800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba7ea998-b0ac-4c8a-a85c-5e94eb794a21 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:26.767674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba7ea998-b0ac-4c8a-a85c-5e94eb794a21 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:26.768126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba7ea998-b0ac-4c8a-a85c-5e94eb794a21 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:26.768551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba7ea998-b0ac-4c8a-a85c-5e94eb794a21 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:26.837882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ffd27d27-8594-4a74-8fbf-d1074874419b tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:26.838649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ffd27d27-8594-4a74-8fbf-d1074874419b tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:26.845480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffd27d27-8594-4a74-8fbf-d1074874419b tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:26.846274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffd27d27-8594-4a74-8fbf-d1074874419b tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:26.846943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffd27d27-8594-4a74-8fbf-d1074874419b tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:26.847880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffd27d27-8594-4a74-8fbf-d1074874419b tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:26.848434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffd27d27-8594-4a74-8fbf-d1074874419b tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:26.849158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffd27d27-8594-4a74-8fbf-d1074874419b tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:27.042105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ba7ea998-b0ac-4c8a-a85c-5e94eb794a21 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:27.050971 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ba7ea998-b0ac-4c8a-a85c-5e94eb794a21 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1315 microversion: 2.1 time: 0.295525 Oct 24 10:40:27.052237 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1845/3599] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:26 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:27.098566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ffd27d27-8594-4a74-8fbf-d1074874419b tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418cfb97b2444502bedf855f9f147734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090743f0fdd0463fbd220eebe9c67651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:27.108115 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ffd27d27-8594-4a74-8fbf-d1074874419b tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 200 len: 1314 microversion: 2.1 time: 0.274935 Oct 24 10:40:27.109046 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1755/3600] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:26 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:27.280701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1ed0142d-619d-4259-9b85-1fa3ce7cf349 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:27.282359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1ed0142d-619d-4259-9b85-1fa3ce7cf349 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:27.291627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ed0142d-619d-4259-9b85-1fa3ce7cf349 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:27.292603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ed0142d-619d-4259-9b85-1fa3ce7cf349 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:27.293418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ed0142d-619d-4259-9b85-1fa3ce7cf349 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:27.294530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ed0142d-619d-4259-9b85-1fa3ce7cf349 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:27.295754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ed0142d-619d-4259-9b85-1fa3ce7cf349 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:27.296895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ed0142d-619d-4259-9b85-1fa3ce7cf349 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:27.304485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:27.417606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1ed0142d-619d-4259-9b85-1fa3ce7cf349 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:27.432297 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1ed0142d-619d-4259-9b85-1fa3ce7cf349 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1286 microversion: 2.1 time: 0.155434 Oct 24 10:40:27.436502 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1846/3601] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:27 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1286 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:27.604708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-20249697-d4d9-418e-a6e8-38e0c718e391 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:27.605418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-20249697-d4d9-418e-a6e8-38e0c718e391 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:27.614621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20249697-d4d9-418e-a6e8-38e0c718e391 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:27.616040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20249697-d4d9-418e-a6e8-38e0c718e391 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:27.616491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20249697-d4d9-418e-a6e8-38e0c718e391 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:27.617639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20249697-d4d9-418e-a6e8-38e0c718e391 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:27.618363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20249697-d4d9-418e-a6e8-38e0c718e391 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:27.618809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20249697-d4d9-418e-a6e8-38e0c718e391 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:27.713356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8491ab8e-b031-4eba-82b2-1e7b3d044b85 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:27.714109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8491ab8e-b031-4eba-82b2-1e7b3d044b85 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:27.725788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8491ab8e-b031-4eba-82b2-1e7b3d044b85 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:27.726654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8491ab8e-b031-4eba-82b2-1e7b3d044b85 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:27.727373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8491ab8e-b031-4eba-82b2-1e7b3d044b85 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:27.728323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8491ab8e-b031-4eba-82b2-1e7b3d044b85 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:27.728992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8491ab8e-b031-4eba-82b2-1e7b3d044b85 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:27.729630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8491ab8e-b031-4eba-82b2-1e7b3d044b85 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:27.829940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-20249697-d4d9-418e-a6e8-38e0c718e391 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:27.839672 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-20249697-d4d9-418e-a6e8-38e0c718e391 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.240822 Oct 24 10:40:27.840275 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1756/3602] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:27 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:28.010513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8491ab8e-b031-4eba-82b2-1e7b3d044b85 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:28.024896 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8491ab8e-b031-4eba-82b2-1e7b3d044b85 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1325 microversion: 2.1 time: 0.324914 Oct 24 10:40:28.029137 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1847/3603] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:27 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1325 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:28.077920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5a17226-6079-4825-8b68-18cb2c606b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:28.078719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d5a17226-6079-4825-8b68-18cb2c606b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:28.081001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:28.089084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5a17226-6079-4825-8b68-18cb2c606b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:28.089581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5a17226-6079-4825-8b68-18cb2c606b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:28.090031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5a17226-6079-4825-8b68-18cb2c606b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:28.090742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5a17226-6079-4825-8b68-18cb2c606b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:28.091202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5a17226-6079-4825-8b68-18cb2c606b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:28.091635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5a17226-6079-4825-8b68-18cb2c606b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:28.139050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4586af71-e20c-42b3-8003-e26ceabe8805 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:28.140049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4586af71-e20c-42b3-8003-e26ceabe8805 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:28.147588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4586af71-e20c-42b3-8003-e26ceabe8805 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:28.148237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4586af71-e20c-42b3-8003-e26ceabe8805 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:28.148675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4586af71-e20c-42b3-8003-e26ceabe8805 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:28.149544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4586af71-e20c-42b3-8003-e26ceabe8805 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:28.149995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4586af71-e20c-42b3-8003-e26ceabe8805 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:28.150630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4586af71-e20c-42b3-8003-e26ceabe8805 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:28.346104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d5a17226-6079-4825-8b68-18cb2c606b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:28.355731 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d5a17226-6079-4825-8b68-18cb2c606b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1503 microversion: 2.1 time: 0.283275 Oct 24 10:40:28.356334 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1757/3604] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:28 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1503 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:28.383039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4586af71-e20c-42b3-8003-e26ceabe8805 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418cfb97b2444502bedf855f9f147734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090743f0fdd0463fbd220eebe9c67651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:28.396952 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4586af71-e20c-42b3-8003-e26ceabe8805 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 200 len: 1314 microversion: 2.1 time: 0.261486 Oct 24 10:40:28.401424 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1848/3605] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:28 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:40:28.406301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3ba8bc1c-2636-4135-86a0-baabcc436b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:28.407118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3ba8bc1c-2636-4135-86a0-baabcc436b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:28.418120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ba8bc1c-2636-4135-86a0-baabcc436b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:28.418627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ba8bc1c-2636-4135-86a0-baabcc436b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:28.419071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ba8bc1c-2636-4135-86a0-baabcc436b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:28.421472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ba8bc1c-2636-4135-86a0-baabcc436b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:28.421472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ba8bc1c-2636-4135-86a0-baabcc436b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:28.421472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ba8bc1c-2636-4135-86a0-baabcc436b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:28.535955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e5eefc63-0e99-437d-9eae-e50c5e744e68 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Action: 'create', calling method: .version_select at 0x7f04d0f09280>, body: {"keypair": {"name": "tempest-keypair-1260480041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhJVK8q4lAEv+J0kPFrR9tgYk/kjjyztZm9ZljLfRUo6nhupeS5U+MdiJL6ln9ceV9k1qGh5Iy77MaMMYqjXCiXxsHho1QCa0uwacgL0F/IOnzk1006GUsBFQi0+fe15w=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:28.555664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-e5eefc63-0e99-437d-9eae-e50c5e744e68 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Getting quotas for project f665fed8d68743098111c04ac9f6ad7f. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:40:28.562670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-e5eefc63-0e99-437d-9eae-e50c5e744e68 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Getting quotas for user eec9cdff64bb4eed9feef84c1e8b9b3a and project f665fed8d68743098111c04ac9f6ad7f. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:40:28.590343 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e5eefc63-0e99-437d-9eae-e50c5e744e68 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.232556 Oct 24 10:40:28.597796 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1758/3606] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:40:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:28.597796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b1cdf5c-f4fe-4d7f-92e7-ccfc5ad792be tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:28.597796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8b1cdf5c-f4fe-4d7f-92e7-ccfc5ad792be tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:28.601367 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.network.security_group_api [None req-3ba8bc1c-2636-4135-86a0-baabcc436b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Removing security group 236d0acc-274f-47b4-88bd-3ad38b26ceef from port 4f06be00-fe8b-4664-a038-85071a5cc14e Oct 24 10:40:28.604806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b1cdf5c-f4fe-4d7f-92e7-ccfc5ad792be tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:28.605355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b1cdf5c-f4fe-4d7f-92e7-ccfc5ad792be tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:28.605994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b1cdf5c-f4fe-4d7f-92e7-ccfc5ad792be tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:28.606898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b1cdf5c-f4fe-4d7f-92e7-ccfc5ad792be tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:28.607432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b1cdf5c-f4fe-4d7f-92e7-ccfc5ad792be tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:28.607869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b1cdf5c-f4fe-4d7f-92e7-ccfc5ad792be tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:28.643933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b1cdf5c-f4fe-4d7f-92e7-ccfc5ad792be tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:28.644437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b1cdf5c-f4fe-4d7f-92e7-ccfc5ad792be tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:28.644863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b1cdf5c-f4fe-4d7f-92e7-ccfc5ad792be tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:28.645338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-8b1cdf5c-f4fe-4d7f-92e7-ccfc5ad792be tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lazy-loading 'fault' on Instance uuid 81f9e553-a2d6-4c33-8f37-2cd23977137a {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:40:28.721285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8b1cdf5c-f4fe-4d7f-92e7-ccfc5ad792be tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:28.731692 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b1cdf5c-f4fe-4d7f-92e7-ccfc5ad792be tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 200 len: 1304 microversion: 2.1 time: 0.139007 Oct 24 10:40:28.732607 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1759/3607] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:28 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 1304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:28.737676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fa4dcc4f-84b0-4239-8282-d36e5f7f5721 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Calling method '.version_select at 0x7f04d0bba5e0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:28.747743 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fa4dcc4f-84b0-4239-8282-d36e5f7f5721 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-1260480041" status: 200 len: 498 microversion: 2.1 time: 0.013577 Oct 24 10:40:28.754932 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1760/3608] 10.222.0.50 () {58 vars in 1218 bytes} [Mon Oct 24 10:40:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1260480041 => generated 498 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:28.765057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6aea37a7-91e8-47c2-9d96-186fd898242f tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Calling method '.version_select at 0x7f04d0c9d940>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:28.788811 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6aea37a7-91e8-47c2-9d96-186fd898242f tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1260480041" status: 202 len: 0 microversion: 2.1 time: 0.032136 Oct 24 10:40:28.790048 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1761/3609] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Oct 24 10:40:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1260480041 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:40:28.801360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-17669346-f698-404a-bfba-c0dddb2efd71 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Action: 'create', calling method: .version_select at 0x7f04d0b0b160>, body: {"keypair": {"name": "tempest-keypair-1724315713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnxsaaiFDKnVfIzzspDshYReX2Jc3S6i9+tS1TqBhjpR97qGyNccwWKWfQmRt+b/G3ow2/tV5ZZXPtITlgxAUwd4b3o7rhaaPyXYc8a7IshfWZeVPW1cfYkllDWh3WbhQ=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:28.822470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-17669346-f698-404a-bfba-c0dddb2efd71 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Getting quotas for project f665fed8d68743098111c04ac9f6ad7f. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:40:28.827882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-17669346-f698-404a-bfba-c0dddb2efd71 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Getting quotas for user eec9cdff64bb4eed9feef84c1e8b9b3a and project f665fed8d68743098111c04ac9f6ad7f. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:40:28.855667 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-17669346-f698-404a-bfba-c0dddb2efd71 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058064 Oct 24 10:40:28.856313 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1762/3610] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:40:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:40:28.868534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3c681235-62a8-4cc2-a771-e60101da58dd tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:28.869294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3c681235-62a8-4cc2-a771-e60101da58dd tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:28.875858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c681235-62a8-4cc2-a771-e60101da58dd tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:28.876330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c681235-62a8-4cc2-a771-e60101da58dd tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:28.876770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c681235-62a8-4cc2-a771-e60101da58dd tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:28.877552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c681235-62a8-4cc2-a771-e60101da58dd tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:28.878127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c681235-62a8-4cc2-a771-e60101da58dd tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:28.878571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c681235-62a8-4cc2-a771-e60101da58dd tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:29.060799 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3ba8bc1c-2636-4135-86a0-baabcc436b61 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6/action" status: 202 len: 0 microversion: 2.1 time: 0.658016 Oct 24 10:40:29.062456 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1849/3611] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:40:28 2022] POST /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6/action => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:40:29.067609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-de5e007b-3deb-4755-b13d-a085d842f776 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Calling method '.version_select at 0x7f04d057b310>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:29.096866 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-de5e007b-3deb-4755-b13d-a085d842f776 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724315713" status: 202 len: 0 microversion: 2.1 time: 0.030478 Oct 24 10:40:29.105322 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1850/3612] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Oct 24 10:40:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724315713 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:40:29.128337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a6639ded-2ba0-4906-8594-7aaeeb37d1bc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:29.131190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a6639ded-2ba0-4906-8594-7aaeeb37d1bc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:29.139288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c681235-62a8-4cc2-a771-e60101da58dd tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:29.152440 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3c681235-62a8-4cc2-a771-e60101da58dd tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.288553 Oct 24 10:40:29.153471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6639ded-2ba0-4906-8594-7aaeeb37d1bc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:29.154467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6639ded-2ba0-4906-8594-7aaeeb37d1bc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:29.156147 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1763/3613] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:28 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:29.158776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6639ded-2ba0-4906-8594-7aaeeb37d1bc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:29.161671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6639ded-2ba0-4906-8594-7aaeeb37d1bc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:29.163151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6639ded-2ba0-4906-8594-7aaeeb37d1bc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:29.164862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6639ded-2ba0-4906-8594-7aaeeb37d1bc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:29.165561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0b56f305-1851-4e8b-b061-c49d0389dfa1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:29.166311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0b56f305-1851-4e8b-b061-c49d0389dfa1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:29.189224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b56f305-1851-4e8b-b061-c49d0389dfa1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:29.190009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b56f305-1851-4e8b-b061-c49d0389dfa1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:29.190679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b56f305-1851-4e8b-b061-c49d0389dfa1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:29.191713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b56f305-1851-4e8b-b061-c49d0389dfa1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:29.192339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b56f305-1851-4e8b-b061-c49d0389dfa1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:29.193066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b56f305-1851-4e8b-b061-c49d0389dfa1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:29.337401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0b56f305-1851-4e8b-b061-c49d0389dfa1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:29.349269 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0b56f305-1851-4e8b-b061-c49d0389dfa1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1461 microversion: 2.1 time: 0.191545 Oct 24 10:40:29.351324 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1764/3614] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:29 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1461 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:29.357957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b7819142-107c-4c92-9afa-fce81e31c3ac req-0f95c82c-089e-46fb-b35e-fe57e0f43042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5da901c-0851-4c31-9547-cd138b752ed6", "tag": "4f06be00-fe8b-4664-a038-85071a5cc14e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:29.374819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b7819142-107c-4c92-9afa-fce81e31c3ac req-0f95c82c-089e-46fb-b35e-fe57e0f43042 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:29.376399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b7819142-107c-4c92-9afa-fce81e31c3ac req-0f95c82c-089e-46fb-b35e-fe57e0f43042 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:29.377554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b7819142-107c-4c92-9afa-fce81e31c3ac req-0f95c82c-089e-46fb-b35e-fe57e0f43042 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:29.384759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a6639ded-2ba0-4906-8594-7aaeeb37d1bc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:29.393844 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b7819142-107c-4c92-9afa-fce81e31c3ac req-0f95c82c-089e-46fb-b35e-fe57e0f43042 service nova] Creating event network-changed:4f06be00-fe8b-4664-a038-85071a5cc14e for instance b5da901c-0851-4c31-9547-cd138b752ed6 on n-h1-858383-15 Oct 24 10:40:29.398636 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a6639ded-2ba0-4906-8594-7aaeeb37d1bc tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1325 microversion: 2.1 time: 0.291953 Oct 24 10:40:29.399475 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1851/3615] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:29 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1325 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:29.404374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-13163995-4c48-493d-b392-2555bc9d3463 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Action: 'create', calling method: .version_select at 0x7f04d057ba60>, body: {"keypair": {"name": "tempest-keypair-1775669237", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:29.410026 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b7819142-107c-4c92-9afa-fce81e31c3ac req-0f95c82c-089e-46fb-b35e-fe57e0f43042 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055184 Oct 24 10:40:29.412922 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1765/3616] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:29.421586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ffce3c01-9177-4d53-acdb-28b566b64be6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:29.430151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ffce3c01-9177-4d53-acdb-28b566b64be6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:29.431252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-13163995-4c48-493d-b392-2555bc9d3463 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Getting quotas for project f665fed8d68743098111c04ac9f6ad7f. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:40:29.438065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-13163995-4c48-493d-b392-2555bc9d3463 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Getting quotas for user eec9cdff64bb4eed9feef84c1e8b9b3a and project f665fed8d68743098111c04ac9f6ad7f. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:40:29.442777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffce3c01-9177-4d53-acdb-28b566b64be6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:29.444262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffce3c01-9177-4d53-acdb-28b566b64be6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:29.447952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffce3c01-9177-4d53-acdb-28b566b64be6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:29.449358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffce3c01-9177-4d53-acdb-28b566b64be6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:29.453214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffce3c01-9177-4d53-acdb-28b566b64be6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:29.453808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffce3c01-9177-4d53-acdb-28b566b64be6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:29.480324 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-13163995-4c48-493d-b392-2555bc9d3463 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.076765 Oct 24 10:40:29.481319 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1852/3617] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:40:29 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:29.493254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2c54ba17-8033-459c-9e39-d05dc6e5d5af tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:29.494784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2c54ba17-8033-459c-9e39-d05dc6e5d5af tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:29.504184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c54ba17-8033-459c-9e39-d05dc6e5d5af tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:29.505443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c54ba17-8033-459c-9e39-d05dc6e5d5af tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:29.506550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c54ba17-8033-459c-9e39-d05dc6e5d5af tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:29.507963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c54ba17-8033-459c-9e39-d05dc6e5d5af tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:29.508908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c54ba17-8033-459c-9e39-d05dc6e5d5af tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:29.509525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c54ba17-8033-459c-9e39-d05dc6e5d5af tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:29.763729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ffce3c01-9177-4d53-acdb-28b566b64be6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:29.772730 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ffce3c01-9177-4d53-acdb-28b566b64be6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.355378 Oct 24 10:40:29.773655 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1766/3618] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:29 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:29.778774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb161025-6235-4bcf-b7e0-47191bafcd04 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Calling method '.version_select at 0x7f04d0bd4af0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:29.802679 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bb161025-6235-4bcf-b7e0-47191bafcd04 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1775669237" status: 202 len: 0 microversion: 2.1 time: 0.027425 Oct 24 10:40:29.803718 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1767/3619] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Oct 24 10:40:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1775669237 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:40:29.809176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8d4b0db4-8e06-4ad6-87fb-a428942c527f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:29.810107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8d4b0db4-8e06-4ad6-87fb-a428942c527f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:29.821314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2c54ba17-8033-459c-9e39-d05dc6e5d5af tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418cfb97b2444502bedf855f9f147734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090743f0fdd0463fbd220eebe9c67651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:29.829210 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2c54ba17-8033-459c-9e39-d05dc6e5d5af tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 200 len: 1503 microversion: 2.1 time: 0.346477 Oct 24 10:40:29.829779 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1853/3620] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:29 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 1503 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:29.830933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d4b0db4-8e06-4ad6-87fb-a428942c527f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:29.831609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d4b0db4-8e06-4ad6-87fb-a428942c527f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:29.832221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d4b0db4-8e06-4ad6-87fb-a428942c527f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:29.833040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d4b0db4-8e06-4ad6-87fb-a428942c527f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:29.833495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d4b0db4-8e06-4ad6-87fb-a428942c527f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:29.834504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d4b0db4-8e06-4ad6-87fb-a428942c527f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:29.842879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b47aadbf-cdfc-4f18-8968-76e697b97c9a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:29.843802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b47aadbf-cdfc-4f18-8968-76e697b97c9a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:29.848980 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-8d4b0db4-8e06-4ad6-87fb-a428942c527f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance 81f9e553-a2d6-4c33-8f37-2cd23977137a could not be found. Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8d4b0db4-8e06-4ad6-87fb-a428942c527f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a HTTP/1.1 Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 81f9e553-a2d6-4c33-8f37-2cd23977137a could not be found. Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '81f9e553-a2d6-4c33-8f37-2cd23977137a'} Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81f9e553-a2d6-4c33-8f37-2cd23977137a could not be found. Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81f9e553-a2d6-4c33-8f37-2cd23977137a could not be found. Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:29.852029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:29.858007 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:29.858007 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:29.858007 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:29.858007 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:29.858007 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:29.858007 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81f9e553-a2d6-4c33-8f37-2cd23977137a could not be found. Oct 24 10:40:29.858007 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:29.858007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8d4b0db4-8e06-4ad6-87fb-a428942c527f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance 81f9e553-a2d6-4c33-8f37-2cd23977137a could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:29.858007 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8d4b0db4-8e06-4ad6-87fb-a428942c527f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 404 len: 111 microversion: 2.1 time: 0.048611 Oct 24 10:40:29.858007 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1768/3621] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:29 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:40:29.858983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c682dede-62e5-4fd6-990b-0832255811be tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Action: 'create', calling method: .version_select at 0x7f04d13dc1f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1864960051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt97d9a3lZNMjPIk2eUEf1hIkT+RgNqTIq1R8YYt0YZ8WVMmhDlM29Qi+78anH89M4Df3PCe2OeYY0cQAegP/vlSKBvmQmeMHXWWHWjbRE957ky6JBT4nxNR+dXLYZ5+g=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:29.865006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b47aadbf-cdfc-4f18-8968-76e697b97c9a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:29.866300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b47aadbf-cdfc-4f18-8968-76e697b97c9a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:29.866930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b47aadbf-cdfc-4f18-8968-76e697b97c9a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:29.867820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b47aadbf-cdfc-4f18-8968-76e697b97c9a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:29.869502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b47aadbf-cdfc-4f18-8968-76e697b97c9a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:29.874772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b47aadbf-cdfc-4f18-8968-76e697b97c9a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:29.880070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c682dede-62e5-4fd6-990b-0832255811be tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Getting quotas for project f665fed8d68743098111c04ac9f6ad7f. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:40:29.886479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c682dede-62e5-4fd6-990b-0832255811be tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Getting quotas for user eec9cdff64bb4eed9feef84c1e8b9b3a and project f665fed8d68743098111c04ac9f6ad7f. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:40:29.917707 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c682dede-62e5-4fd6-990b-0832255811be tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.062154 Oct 24 10:40:29.918504 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1769/3622] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:40:29 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:29.924337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d13fcf00-c1dd-4de0-99b7-9323ba2d8ce3 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:29.924882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d13fcf00-c1dd-4de0-99b7-9323ba2d8ce3 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:29.931263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d13fcf00-c1dd-4de0-99b7-9323ba2d8ce3 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:29.932046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d13fcf00-c1dd-4de0-99b7-9323ba2d8ce3 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:29.932490 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d13fcf00-c1dd-4de0-99b7-9323ba2d8ce3 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:29.933283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d13fcf00-c1dd-4de0-99b7-9323ba2d8ce3 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:29.933737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d13fcf00-c1dd-4de0-99b7-9323ba2d8ce3 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:29.934164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d13fcf00-c1dd-4de0-99b7-9323ba2d8ce3 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:29.960755 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d13fcf00-c1dd-4de0-99b7-9323ba2d8ce3 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7/ips" status: 200 len: 109 microversion: 2.1 time: 0.041046 Oct 24 10:40:29.961913 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1770/3623] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Oct 24 10:40:29 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7/ips => generated 109 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:29.967356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0dbfb3ac-c746-46a0-bdbf-2f93dd7181f8 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Action: 'create', calling method: .version_select at 0x7f04d0b0bee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1704732318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbLCbGrDMtqTCVGL1tHCoj2ccv2+Yy7B1sMymz0r9S7b97jBc9HfgJEYU/ePP7EM+fDZ93/Z96paHwE8qLI0A8ouCvvDBWJOaOUCMDZtZ/bsjz5rKbdC+anRmldY/mEHQ=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:29.985978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0dbfb3ac-c746-46a0-bdbf-2f93dd7181f8 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Getting quotas for project f665fed8d68743098111c04ac9f6ad7f. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:40:29.993392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0dbfb3ac-c746-46a0-bdbf-2f93dd7181f8 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Getting quotas for user eec9cdff64bb4eed9feef84c1e8b9b3a and project f665fed8d68743098111c04ac9f6ad7f. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:40:30.028967 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0dbfb3ac-c746-46a0-bdbf-2f93dd7181f8 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.063334 Oct 24 10:40:30.030105 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1771/3624] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:40:29 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:30.037587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dc030f34-1cdc-41c3-9dbc-872838641ac6 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:30.039257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dc030f34-1cdc-41c3-9dbc-872838641ac6 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:30.048979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc030f34-1cdc-41c3-9dbc-872838641ac6 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:30.049637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc030f34-1cdc-41c3-9dbc-872838641ac6 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:30.050270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc030f34-1cdc-41c3-9dbc-872838641ac6 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:30.051409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc030f34-1cdc-41c3-9dbc-872838641ac6 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:30.052171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc030f34-1cdc-41c3-9dbc-872838641ac6 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:30.053696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc030f34-1cdc-41c3-9dbc-872838641ac6 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:30.085090 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dc030f34-1cdc-41c3-9dbc-872838641ac6 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7/ips" status: 200 len: 109 microversion: 2.1 time: 0.052295 Oct 24 10:40:30.085667 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1772/3625] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Oct 24 10:40:30 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7/ips => generated 109 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:30.090746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1369e4c2-e933-48a8-a6ac-6d3331c744bb tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Action: 'create', calling method: .version_select at 0x7f04d0c9c820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1880827632", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZoFWnK1gBMyekB5hKAtP9LTUCqxvS8cF07anP9bTNVVf8GhRnhjVyULGtZ+hqHdAaM+nunzJNmnRCTWKEj+mP5iBFvFV33j89ecdfRNh6CBaYiwHgEpuiMetoj7LyvBw=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:30.111041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-1369e4c2-e933-48a8-a6ac-6d3331c744bb tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Getting quotas for project f665fed8d68743098111c04ac9f6ad7f. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:40:30.122061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-1369e4c2-e933-48a8-a6ac-6d3331c744bb tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Getting quotas for user eec9cdff64bb4eed9feef84c1e8b9b3a and project f665fed8d68743098111c04ac9f6ad7f. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:40:30.155390 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1369e4c2-e933-48a8-a6ac-6d3331c744bb tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.068399 Oct 24 10:40:30.156987 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1773/3626] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:40:30 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:30.165147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-992f964f-c184-4ad2-9d18-f3b417b5f366 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-189726273", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "7e246fd4-526c-4b90-abc8-eb217581a916"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:30.188867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b47aadbf-cdfc-4f18-8968-76e697b97c9a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:30.210478 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b47aadbf-cdfc-4f18-8968-76e697b97c9a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.375476 Oct 24 10:40:30.211510 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1854/3627] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:29 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:30.233493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-542d5ef4-569c-49ba-a200-e91d6f9e260a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:30.234074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-542d5ef4-569c-49ba-a200-e91d6f9e260a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:30.238035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-992f964f-c184-4ad2-9d18-f3b417b5f366 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] validate_networks() for [('7e246fd4-526c-4b90-abc8-eb217581a916', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:40:30.250545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-542d5ef4-569c-49ba-a200-e91d6f9e260a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:30.251052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-542d5ef4-569c-49ba-a200-e91d6f9e260a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:30.251497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-542d5ef4-569c-49ba-a200-e91d6f9e260a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:30.252230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-542d5ef4-569c-49ba-a200-e91d6f9e260a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:30.252675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-542d5ef4-569c-49ba-a200-e91d6f9e260a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:30.253135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-542d5ef4-569c-49ba-a200-e91d6f9e260a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:30.282168 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-542d5ef4-569c-49ba-a200-e91d6f9e260a tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7/ips/tempest-ServerAddressesTestJSON-1665156006-network" status: 200 len: 94 microversion: 2.1 time: 0.068975 Oct 24 10:40:30.283077 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1855/3628] 10.222.0.50 () {58 vars in 1401 bytes} [Mon Oct 24 10:40:30 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7/ips/tempest-ServerAddressesTestJSON-1665156006-network => generated 94 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:40:30.288426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f0ef12e8-374c-4a5c-ad56-91f09e8d7fd2 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Calling method '.version_select at 0x7f04d04b30d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:30.293881 n-d-858383-15 devstack@n-api.service[120426]: WARNING oslo_db.sqlalchemy.utils [None req-f0ef12e8-374c-4a5c-ad56-91f09e8d7fd2 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 24 10:40:30.300887 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f0ef12e8-374c-4a5c-ad56-91f09e8d7fd2 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.016056 Oct 24 10:40:30.302329 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1856/3629] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:40:30 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:30.308505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a1dce696-1cbe-41ca-a28a-e89df5260fb4 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:30.309714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a1dce696-1cbe-41ca-a28a-e89df5260fb4 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:30.318793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1dce696-1cbe-41ca-a28a-e89df5260fb4 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:30.320148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1dce696-1cbe-41ca-a28a-e89df5260fb4 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:30.320817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1dce696-1cbe-41ca-a28a-e89df5260fb4 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:30.322212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1dce696-1cbe-41ca-a28a-e89df5260fb4 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:30.322937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1dce696-1cbe-41ca-a28a-e89df5260fb4 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:30.323612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1dce696-1cbe-41ca-a28a-e89df5260fb4 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:30.926079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a1dce696-1cbe-41ca-a28a-e89df5260fb4 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:30.941596 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a1dce696-1cbe-41ca-a28a-e89df5260fb4 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.637980 Oct 24 10:40:30.942458 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1857/3630] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:30 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:30.960782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9a962d49-831c-4744-ac89-5912fc241009 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:30.962466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9a962d49-831c-4744-ac89-5912fc241009 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:30.972956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a962d49-831c-4744-ac89-5912fc241009 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:30.973983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a962d49-831c-4744-ac89-5912fc241009 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:30.974471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a962d49-831c-4744-ac89-5912fc241009 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:30.975839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a962d49-831c-4744-ac89-5912fc241009 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:30.976335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a962d49-831c-4744-ac89-5912fc241009 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:30.976805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a962d49-831c-4744-ac89-5912fc241009 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:31.222521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9a962d49-831c-4744-ac89-5912fc241009 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:31.231918 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9a962d49-831c-4744-ac89-5912fc241009 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.287503 Oct 24 10:40:31.232917 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1858/3631] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:30 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:31.237910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5e550fce-21aa-4f0f-9a13-057c86244252 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:31.238638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5e550fce-21aa-4f0f-9a13-057c86244252 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:31.245730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e550fce-21aa-4f0f-9a13-057c86244252 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:31.246491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e550fce-21aa-4f0f-9a13-057c86244252 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:31.247171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e550fce-21aa-4f0f-9a13-057c86244252 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:31.248169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e550fce-21aa-4f0f-9a13-057c86244252 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:31.248852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e550fce-21aa-4f0f-9a13-057c86244252 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:31.249486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e550fce-21aa-4f0f-9a13-057c86244252 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:31.271799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-992f964f-c184-4ad2-9d18-f3b417b5f366 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:40:31.272324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-992f964f-c184-4ad2-9d18-f3b417b5f366 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:40:31.272694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-992f964f-c184-4ad2-9d18-f3b417b5f366 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:40:31.273153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-992f964f-c184-4ad2-9d18-f3b417b5f366 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:40:31.273575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-992f964f-c184-4ad2-9d18-f3b417b5f366 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:40:31.283631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5e550fce-21aa-4f0f-9a13-057c86244252 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:40:31.283965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-992f964f-c184-4ad2-9d18-f3b417b5f366 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:31.284492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-992f964f-c184-4ad2-9d18-f3b417b5f366 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:31.285024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-992f964f-c184-4ad2-9d18-f3b417b5f366 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:31.285780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-992f964f-c184-4ad2-9d18-f3b417b5f366 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:31.286420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-992f964f-c184-4ad2-9d18-f3b417b5f366 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:31.286903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-992f964f-c184-4ad2-9d18-f3b417b5f366 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:31.307461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-992f964f-c184-4ad2-9d18-f3b417b5f366 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Getting quotas for project eb78fe6939ec43d99fe6b1ba24a68287. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:40:31.312986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-992f964f-c184-4ad2-9d18-f3b417b5f366 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Getting quotas for user 2a7e183a1d4240f28566a318b7e70dee and project eb78fe6939ec43d99fe6b1ba24a68287. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:40:31.324202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:31.328135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-992f964f-c184-4ad2-9d18-f3b417b5f366 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:40:31.330632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-992f964f-c184-4ad2-9d18-f3b417b5f366 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:40:31.377877 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5e550fce-21aa-4f0f-9a13-057c86244252 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 204 len: 0 microversion: 2.1 time: 0.142892 Oct 24 10:40:31.378977 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1859/3632] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:40:31 2022] DELETE /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:40:31.386057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-945a3e53-49f2-4972-aa02-f3c64c81e6f9 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Calling method '.version_select at 0x7f04d06a2430>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:31.395756 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-992f964f-c184-4ad2-9d18-f3b417b5f366 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.237093 Oct 24 10:40:31.397728 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1774/3633] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:40:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:40:31.404907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d8c8ddfa-e9db-4163-9114-d48e3e1f49c4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:31.405707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d8c8ddfa-e9db-4163-9114-d48e3e1f49c4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:31.408524 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-945a3e53-49f2-4972-aa02-f3c64c81e6f9 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1880827632" status: 202 len: 0 microversion: 2.1 time: 0.027768 Oct 24 10:40:31.409800 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1860/3634] 10.222.0.50 () {58 vars in 1278 bytes} [Mon Oct 24 10:40:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1880827632 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:40:31.415983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8c8ddfa-e9db-4163-9114-d48e3e1f49c4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:31.416565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8c8ddfa-e9db-4163-9114-d48e3e1f49c4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:31.417044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8c8ddfa-e9db-4163-9114-d48e3e1f49c4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:31.417806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8c8ddfa-e9db-4163-9114-d48e3e1f49c4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:31.418606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8c8ddfa-e9db-4163-9114-d48e3e1f49c4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:31.418701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8c8ddfa-e9db-4163-9114-d48e3e1f49c4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:31.421484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a61b100a-e232-40c1-b5a5-c4686fa93e76 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:31.422577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a61b100a-e232-40c1-b5a5-c4686fa93e76 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:31.432634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a61b100a-e232-40c1-b5a5-c4686fa93e76 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:31.433560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a61b100a-e232-40c1-b5a5-c4686fa93e76 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:31.434089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a61b100a-e232-40c1-b5a5-c4686fa93e76 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:31.435351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a61b100a-e232-40c1-b5a5-c4686fa93e76 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:31.436321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a61b100a-e232-40c1-b5a5-c4686fa93e76 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:31.437060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a61b100a-e232-40c1-b5a5-c4686fa93e76 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:31.498243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:31.634479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d8c8ddfa-e9db-4163-9114-d48e3e1f49c4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:31.645360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a61b100a-e232-40c1-b5a5-c4686fa93e76 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:31.645675 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d8c8ddfa-e9db-4163-9114-d48e3e1f49c4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1325 microversion: 2.1 time: 0.246607 Oct 24 10:40:31.647368 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1775/3635] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:31 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1325 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:31.655076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6cfbd2dd-9683-46af-93a1-1a066bbae0e0 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:31.656167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6cfbd2dd-9683-46af-93a1-1a066bbae0e0 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:31.664562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cfbd2dd-9683-46af-93a1-1a066bbae0e0 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:31.665304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cfbd2dd-9683-46af-93a1-1a066bbae0e0 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:31.666396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cfbd2dd-9683-46af-93a1-1a066bbae0e0 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:31.667316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cfbd2dd-9683-46af-93a1-1a066bbae0e0 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:31.668960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cfbd2dd-9683-46af-93a1-1a066bbae0e0 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:31.669962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cfbd2dd-9683-46af-93a1-1a066bbae0e0 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:31.674727 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a61b100a-e232-40c1-b5a5-c4686fa93e76 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.263599 Oct 24 10:40:31.675702 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1861/3636] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:31 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:31.681127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-22591b8a-76f3-4048-9da5-0fe335e57f57 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:31.681745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-22591b8a-76f3-4048-9da5-0fe335e57f57 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:31.793724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-22591b8a-76f3-4048-9da5-0fe335e57f57 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:31.807034 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-22591b8a-76f3-4048-9da5-0fe335e57f57 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 200 len: 1214 microversion: 2.1 time: 0.129890 Oct 24 10:40:31.808863 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1862/3637] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:31 2022] GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:31.816825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e98f8b74-0fad-4c54-8bb9-4d9c33ec0429 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Calling method '.version_select at 0x7f04d008d550>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:31.840997 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e98f8b74-0fad-4c54-8bb9-4d9c33ec0429 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1704732318" status: 202 len: 0 microversion: 2.1 time: 0.030280 Oct 24 10:40:31.842043 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1863/3638] 10.222.0.50 () {58 vars in 1278 bytes} [Mon Oct 24 10:40:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1704732318 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:40:31.856295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7db94ff1-300d-456a-b4a7-2407d9f52d06 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] Calling method '.version_select at 0x7f04d06af3a0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:31.888865 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7db94ff1-300d-456a-b4a7-2407d9f52d06 tempest-KeyPairsV2TestJSON-298448787 tempest-KeyPairsV2TestJSON-298448787-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1864960051" status: 202 len: 0 microversion: 2.1 time: 0.042575 Oct 24 10:40:31.893494 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1864/3639] 10.222.0.50 () {58 vars in 1278 bytes} [Mon Oct 24 10:40:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1864960051 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:40:31.915862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e5ee0671-8203-4c4f-992d-de38bbcd26c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-542575316", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "4c723f9d-e03c-43f2-9281-1f2dfc935187"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:31.960967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6cfbd2dd-9683-46af-93a1-1a066bbae0e0 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418cfb97b2444502bedf855f9f147734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090743f0fdd0463fbd220eebe9c67651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:31.967034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:31.974130 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6cfbd2dd-9683-46af-93a1-1a066bbae0e0 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 200 len: 1509 microversion: 2.1 time: 0.324020 Oct 24 10:40:31.975620 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1776/3640] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:31 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 1509 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:31.980348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-77b9234c-d006-441f-907f-6cb3e6b3af47 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:31.981123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-77b9234c-d006-441f-907f-6cb3e6b3af47 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:31.991005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-e5ee0671-8203-4c4f-992d-de38bbcd26c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] validate_networks() for [('4c723f9d-e03c-43f2-9281-1f2dfc935187', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:40:32.001523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77b9234c-d006-441f-907f-6cb3e6b3af47 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:32.001971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77b9234c-d006-441f-907f-6cb3e6b3af47 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:32.002404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77b9234c-d006-441f-907f-6cb3e6b3af47 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:32.003298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77b9234c-d006-441f-907f-6cb3e6b3af47 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:32.003767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77b9234c-d006-441f-907f-6cb3e6b3af47 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:32.004205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77b9234c-d006-441f-907f-6cb3e6b3af47 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:32.310759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-77b9234c-d006-441f-907f-6cb3e6b3af47 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:32.340372 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-77b9234c-d006-441f-907f-6cb3e6b3af47 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.362838 Oct 24 10:40:32.341641 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1777/3641] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:31 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:32.508867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-9e05f52e-9147-42b8-a841-1efa4623a978 req-df883bf4-1cfa-4ce5-9fac-bb2545fcf55f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f47b34-c515-45c3-be54-4b534ce4f4c2", "name": "network-vif-plugged", "status": "completed", "tag": "b974087e-0f6b-420d-a529-b096270b3cee"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:32.529887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9e05f52e-9147-42b8-a841-1efa4623a978 req-df883bf4-1cfa-4ce5-9fac-bb2545fcf55f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:32.530961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9e05f52e-9147-42b8-a841-1efa4623a978 req-df883bf4-1cfa-4ce5-9fac-bb2545fcf55f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:32.533236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9e05f52e-9147-42b8-a841-1efa4623a978 req-df883bf4-1cfa-4ce5-9fac-bb2545fcf55f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:32.604971 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-9e05f52e-9147-42b8-a841-1efa4623a978 req-df883bf4-1cfa-4ce5-9fac-bb2545fcf55f service nova] Creating event network-vif-plugged:b974087e-0f6b-420d-a529-b096270b3cee for instance 15f47b34-c515-45c3-be54-4b534ce4f4c2 on n-h1-858383-15 Oct 24 10:40:32.633821 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-9e05f52e-9147-42b8-a841-1efa4623a978 req-df883bf4-1cfa-4ce5-9fac-bb2545fcf55f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130525 Oct 24 10:40:32.638146 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1778/3642] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:32.654191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e5ee0671-8203-4c4f-992d-de38bbcd26c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:40:32.655073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e5ee0671-8203-4c4f-992d-de38bbcd26c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:40:32.656381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e5ee0671-8203-4c4f-992d-de38bbcd26c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:40:32.659051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e5ee0671-8203-4c4f-992d-de38bbcd26c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:40:32.659707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e5ee0671-8203-4c4f-992d-de38bbcd26c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:40:32.670219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8fc22549-7560-4cba-a7e4-3c578e7fe8a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:32.670924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8fc22549-7560-4cba-a7e4-3c578e7fe8a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:32.672264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5ee0671-8203-4c4f-992d-de38bbcd26c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:32.672894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5ee0671-8203-4c4f-992d-de38bbcd26c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:32.673570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5ee0671-8203-4c4f-992d-de38bbcd26c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:32.674455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5ee0671-8203-4c4f-992d-de38bbcd26c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:32.675017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5ee0671-8203-4c4f-992d-de38bbcd26c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:32.675699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5ee0671-8203-4c4f-992d-de38bbcd26c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:32.679015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fc22549-7560-4cba-a7e4-3c578e7fe8a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:32.679831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fc22549-7560-4cba-a7e4-3c578e7fe8a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:32.680539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fc22549-7560-4cba-a7e4-3c578e7fe8a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:32.681700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fc22549-7560-4cba-a7e4-3c578e7fe8a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:32.682331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fc22549-7560-4cba-a7e4-3c578e7fe8a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:32.682928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fc22549-7560-4cba-a7e4-3c578e7fe8a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:32.714507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-e5ee0671-8203-4c4f-992d-de38bbcd26c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Getting quotas for project 4878c0e43a9d4db8ba5c6590b43624f0. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:40:32.723232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-e5ee0671-8203-4c4f-992d-de38bbcd26c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Getting quotas for user 45500f699a6f463b8755f0417b24151c and project 4878c0e43a9d4db8ba5c6590b43624f0. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:40:32.725691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:32.750873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e5ee0671-8203-4c4f-992d-de38bbcd26c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:40:32.753357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e5ee0671-8203-4c4f-992d-de38bbcd26c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:40:32.816887 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e5ee0671-8203-4c4f-992d-de38bbcd26c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925640 Oct 24 10:40:32.825789 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1865/3643] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:40:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:40:32.831932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8d7dac67-247f-4aaa-8e65-c06c163e9b91 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:32.832823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8d7dac67-247f-4aaa-8e65-c06c163e9b91 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:32.950955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d7dac67-247f-4aaa-8e65-c06c163e9b91 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:32.956058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8fc22549-7560-4cba-a7e4-3c578e7fe8a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:32.963371 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8d7dac67-247f-4aaa-8e65-c06c163e9b91 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1214 microversion: 2.1 time: 0.135935 Oct 24 10:40:32.964405 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1866/3644] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:32 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:32.967130 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8fc22549-7560-4cba-a7e4-3c578e7fe8a4 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1325 microversion: 2.1 time: 0.301574 Oct 24 10:40:32.969218 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1779/3645] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:32 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1325 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:32.978931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5b0c92fc-e275-4cac-9717-853431d0301c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:32.979574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5b0c92fc-e275-4cac-9717-853431d0301c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:32.995383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b0c92fc-e275-4cac-9717-853431d0301c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:32.995898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b0c92fc-e275-4cac-9717-853431d0301c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:32.996355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b0c92fc-e275-4cac-9717-853431d0301c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:32.997222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b0c92fc-e275-4cac-9717-853431d0301c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:32.997692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b0c92fc-e275-4cac-9717-853431d0301c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:32.999902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b0c92fc-e275-4cac-9717-853431d0301c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:33.000587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43bebf6d-c255-4524-a4da-e70ff1a7db58 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:33.002355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-43bebf6d-c255-4524-a4da-e70ff1a7db58 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:33.013521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43bebf6d-c255-4524-a4da-e70ff1a7db58 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:33.017575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43bebf6d-c255-4524-a4da-e70ff1a7db58 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:33.018387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43bebf6d-c255-4524-a4da-e70ff1a7db58 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:33.024765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43bebf6d-c255-4524-a4da-e70ff1a7db58 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:33.025338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43bebf6d-c255-4524-a4da-e70ff1a7db58 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:33.025770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43bebf6d-c255-4524-a4da-e70ff1a7db58 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:33.151691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5b0c92fc-e275-4cac-9717-853431d0301c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:33.163011 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5b0c92fc-e275-4cac-9717-853431d0301c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 200 len: 1266 microversion: 2.1 time: 0.197479 Oct 24 10:40:33.164004 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1867/3646] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:32 2022] GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:33.367301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-841531b4-774c-4fd2-ae89-1a0171c4a4c3 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:33.367941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-841531b4-774c-4fd2-ae89-1a0171c4a4c3 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:33.389624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-841531b4-774c-4fd2-ae89-1a0171c4a4c3 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:33.390134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-841531b4-774c-4fd2-ae89-1a0171c4a4c3 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:33.390588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-841531b4-774c-4fd2-ae89-1a0171c4a4c3 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:33.394663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-841531b4-774c-4fd2-ae89-1a0171c4a4c3 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:33.395191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-841531b4-774c-4fd2-ae89-1a0171c4a4c3 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:33.395638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-841531b4-774c-4fd2-ae89-1a0171c4a4c3 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:33.426023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-43bebf6d-c255-4524-a4da-e70ff1a7db58 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418cfb97b2444502bedf855f9f147734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090743f0fdd0463fbd220eebe9c67651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:33.448221 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-43bebf6d-c255-4524-a4da-e70ff1a7db58 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 200 len: 1509 microversion: 2.1 time: 0.451404 Oct 24 10:40:33.452933 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1780/3647] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:32 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 1509 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:40:33.731373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-841531b4-774c-4fd2-ae89-1a0171c4a4c3 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:33.744146 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-841531b4-774c-4fd2-ae89-1a0171c4a4c3 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.382307 Oct 24 10:40:33.752884 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1868/3648] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:33 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:40:33.997719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6ffcc443-d52a-43b4-87c8-9434c7402487 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:33.998738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6ffcc443-d52a-43b4-87c8-9434c7402487 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:33.999686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fef11647-fd7c-4599-acaa-dbcfdc2ba3eb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:34.000635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fef11647-fd7c-4599-acaa-dbcfdc2ba3eb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:34.017006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fef11647-fd7c-4599-acaa-dbcfdc2ba3eb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:34.020447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fef11647-fd7c-4599-acaa-dbcfdc2ba3eb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:34.024691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fef11647-fd7c-4599-acaa-dbcfdc2ba3eb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:34.025331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ffcc443-d52a-43b4-87c8-9434c7402487 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:34.026284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fef11647-fd7c-4599-acaa-dbcfdc2ba3eb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:34.027383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ffcc443-d52a-43b4-87c8-9434c7402487 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:34.028132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fef11647-fd7c-4599-acaa-dbcfdc2ba3eb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:34.029099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ffcc443-d52a-43b4-87c8-9434c7402487 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:34.031185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ffcc443-d52a-43b4-87c8-9434c7402487 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:34.031808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fef11647-fd7c-4599-acaa-dbcfdc2ba3eb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:34.033720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ffcc443-d52a-43b4-87c8-9434c7402487 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:34.040802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ffcc443-d52a-43b4-87c8-9434c7402487 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:34.177003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ffcc443-d52a-43b4-87c8-9434c7402487 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:34.199595 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6ffcc443-d52a-43b4-87c8-9434c7402487 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1218 microversion: 2.1 time: 0.214514 Oct 24 10:40:34.202041 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1781/3649] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:33 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1218 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:34.225867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-7f46d540-3ee6-4b00-8009-e07a6a3508ff req-97e8d3d7-c9c6-41a8-b334-a047ae32e6fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1275c7b-79eb-4b3e-9d51-8311925edeb7", "name": "network-vif-deleted", "tag": "f243fc6d-f6ad-467a-9a63-c692237aa8b3"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:34.236855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7f46d540-3ee6-4b00-8009-e07a6a3508ff req-97e8d3d7-c9c6-41a8-b334-a047ae32e6fc service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:34.237367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7f46d540-3ee6-4b00-8009-e07a6a3508ff req-97e8d3d7-c9c6-41a8-b334-a047ae32e6fc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:34.237810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7f46d540-3ee6-4b00-8009-e07a6a3508ff req-97e8d3d7-c9c6-41a8-b334-a047ae32e6fc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:34.258951 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-7f46d540-3ee6-4b00-8009-e07a6a3508ff req-97e8d3d7-c9c6-41a8-b334-a047ae32e6fc service nova] Creating event network-vif-deleted:f243fc6d-f6ad-467a-9a63-c692237aa8b3 for instance e1275c7b-79eb-4b3e-9d51-8311925edeb7 on n-h1-858383-15 Oct 24 10:40:34.269891 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-7f46d540-3ee6-4b00-8009-e07a6a3508ff req-97e8d3d7-c9c6-41a8-b334-a047ae32e6fc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054155 Oct 24 10:40:34.274071 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1782/3650] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:34.283999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a0e49a92-0943-4302-97a2-70884ff50a64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:34.288484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a0e49a92-0943-4302-97a2-70884ff50a64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:34.303567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0e49a92-0943-4302-97a2-70884ff50a64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:34.304387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0e49a92-0943-4302-97a2-70884ff50a64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:34.305305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0e49a92-0943-4302-97a2-70884ff50a64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:34.307295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0e49a92-0943-4302-97a2-70884ff50a64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:34.309134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0e49a92-0943-4302-97a2-70884ff50a64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:34.310975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a0e49a92-0943-4302-97a2-70884ff50a64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:34.475381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a0e49a92-0943-4302-97a2-70884ff50a64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:34.476365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fef11647-fd7c-4599-acaa-dbcfdc2ba3eb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:34.484334 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a0e49a92-0943-4302-97a2-70884ff50a64 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 200 len: 1272 microversion: 2.1 time: 0.208941 Oct 24 10:40:34.487733 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fef11647-fd7c-4599-acaa-dbcfdc2ba3eb tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1325 microversion: 2.1 time: 0.499224 Oct 24 10:40:34.488581 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1869/3651] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:33 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1325 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:34.498954 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1783/3652] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:34 2022] GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 1272 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:34.502666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-754b8306-a5c0-4837-9ed2-3254821828a5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:34.503502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-754b8306-a5c0-4837-9ed2-3254821828a5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:34.511863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-754b8306-a5c0-4837-9ed2-3254821828a5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:34.512492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-754b8306-a5c0-4837-9ed2-3254821828a5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:34.513588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-754b8306-a5c0-4837-9ed2-3254821828a5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:34.514435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-754b8306-a5c0-4837-9ed2-3254821828a5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:34.515226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-754b8306-a5c0-4837-9ed2-3254821828a5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:34.515868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-754b8306-a5c0-4837-9ed2-3254821828a5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:34.542003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:34.565638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-754b8306-a5c0-4837-9ed2-3254821828a5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:34.566281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-754b8306-a5c0-4837-9ed2-3254821828a5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:34.566974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-754b8306-a5c0-4837-9ed2-3254821828a5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:34.567749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-754b8306-a5c0-4837-9ed2-3254821828a5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lazy-loading 'fault' on Instance uuid e1275c7b-79eb-4b3e-9d51-8311925edeb7 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:40:34.623154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-754b8306-a5c0-4837-9ed2-3254821828a5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418cfb97b2444502bedf855f9f147734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090743f0fdd0463fbd220eebe9c67651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:34.633790 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-754b8306-a5c0-4837-9ed2-3254821828a5 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 200 len: 1304 microversion: 2.1 time: 0.142995 Oct 24 10:40:34.656066 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1870/3653] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:34 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:34.775013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-75f02f1c-305c-48b6-8f02-3b905b25e6b7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:34.776061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-75f02f1c-305c-48b6-8f02-3b905b25e6b7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:34.786083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75f02f1c-305c-48b6-8f02-3b905b25e6b7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:34.787526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75f02f1c-305c-48b6-8f02-3b905b25e6b7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:34.788469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75f02f1c-305c-48b6-8f02-3b905b25e6b7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:34.789759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75f02f1c-305c-48b6-8f02-3b905b25e6b7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:34.790410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75f02f1c-305c-48b6-8f02-3b905b25e6b7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:34.791031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75f02f1c-305c-48b6-8f02-3b905b25e6b7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:35.084807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-75f02f1c-305c-48b6-8f02-3b905b25e6b7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:35.092889 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-75f02f1c-305c-48b6-8f02-3b905b25e6b7 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.325130 Oct 24 10:40:35.111033 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1784/3654] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:34 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:35.167108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e8355067-890b-4767-8043-aacc34a580c6 tempest-AbsoluteLimitsTestJSON-1640462067 tempest-AbsoluteLimitsTestJSON-1640462067-project] Calling method '.version_select at 0x7f04d07f84c0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:35.181042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8355067-890b-4767-8043-aacc34a580c6 tempest-AbsoluteLimitsTestJSON-1640462067 tempest-AbsoluteLimitsTestJSON-1640462067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:35.181537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8355067-890b-4767-8043-aacc34a580c6 tempest-AbsoluteLimitsTestJSON-1640462067 tempest-AbsoluteLimitsTestJSON-1640462067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:35.182197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8355067-890b-4767-8043-aacc34a580c6 tempest-AbsoluteLimitsTestJSON-1640462067 tempest-AbsoluteLimitsTestJSON-1640462067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:35.182859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8355067-890b-4767-8043-aacc34a580c6 tempest-AbsoluteLimitsTestJSON-1640462067 tempest-AbsoluteLimitsTestJSON-1640462067-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:35.183618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8355067-890b-4767-8043-aacc34a580c6 tempest-AbsoluteLimitsTestJSON-1640462067 tempest-AbsoluteLimitsTestJSON-1640462067-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:35.184052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8355067-890b-4767-8043-aacc34a580c6 tempest-AbsoluteLimitsTestJSON-1640462067 tempest-AbsoluteLimitsTestJSON-1640462067-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:35.213884 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e8355067-890b-4767-8043-aacc34a580c6 tempest-AbsoluteLimitsTestJSON-1640462067 tempest-AbsoluteLimitsTestJSON-1640462067-project] 10.222.0.50 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.302948 Oct 24 10:40:35.214919 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1871/3655] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Oct 24 10:40:34 2022] GET /compute/v2.1/limits => generated 511 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:40:35.230023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d9f7963-78cd-438d-9c1a-ddbb5fa83f5c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:35.230958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0d9f7963-78cd-438d-9c1a-ddbb5fa83f5c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:35.238204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d9f7963-78cd-438d-9c1a-ddbb5fa83f5c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:35.239108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d9f7963-78cd-438d-9c1a-ddbb5fa83f5c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:35.239815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d9f7963-78cd-438d-9c1a-ddbb5fa83f5c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:35.241006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d9f7963-78cd-438d-9c1a-ddbb5fa83f5c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:35.241952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d9f7963-78cd-438d-9c1a-ddbb5fa83f5c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:35.242655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d9f7963-78cd-438d-9c1a-ddbb5fa83f5c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:35.410905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0d9f7963-78cd-438d-9c1a-ddbb5fa83f5c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:35.431928 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0d9f7963-78cd-438d-9c1a-ddbb5fa83f5c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1210 microversion: 2.1 time: 0.205491 Oct 24 10:40:35.433433 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1785/3656] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:35 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1210 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:35.511612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-286bd6ba-79d8-47e5-baee-0b7eec1ce4a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:35.512239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-286bd6ba-79d8-47e5-baee-0b7eec1ce4a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:35.518222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-13621233-1c1f-48f3-8f87-6b0f3334081e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:35.519727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-13621233-1c1f-48f3-8f87-6b0f3334081e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:35.530844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13621233-1c1f-48f3-8f87-6b0f3334081e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:35.531131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-286bd6ba-79d8-47e5-baee-0b7eec1ce4a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:35.531435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-286bd6ba-79d8-47e5-baee-0b7eec1ce4a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:35.532086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-286bd6ba-79d8-47e5-baee-0b7eec1ce4a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:35.532951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13621233-1c1f-48f3-8f87-6b0f3334081e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:35.533223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-286bd6ba-79d8-47e5-baee-0b7eec1ce4a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:35.533910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13621233-1c1f-48f3-8f87-6b0f3334081e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:35.535086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-286bd6ba-79d8-47e5-baee-0b7eec1ce4a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:35.535693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13621233-1c1f-48f3-8f87-6b0f3334081e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:35.536169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13621233-1c1f-48f3-8f87-6b0f3334081e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:35.536565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-286bd6ba-79d8-47e5-baee-0b7eec1ce4a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:35.538684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13621233-1c1f-48f3-8f87-6b0f3334081e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:35.900166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-286bd6ba-79d8-47e5-baee-0b7eec1ce4a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:35.914017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-13621233-1c1f-48f3-8f87-6b0f3334081e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:35.937880 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-286bd6ba-79d8-47e5-baee-0b7eec1ce4a3 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 200 len: 1314 microversion: 2.1 time: 0.431705 Oct 24 10:40:35.938485 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1872/3657] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:35 2022] GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:35.939776 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-13621233-1c1f-48f3-8f87-6b0f3334081e tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1520 microversion: 2.1 time: 0.425422 Oct 24 10:40:35.940353 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1786/3658] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:35 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1520 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:35.951369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a1cf5010-e678-4e06-a410-9dd9aef8c161 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:35.952029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a1cf5010-e678-4e06-a410-9dd9aef8c161 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] [instance: e1275c7b-79eb-4b3e-9d51-8311925edeb7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:35.958377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1cf5010-e678-4e06-a410-9dd9aef8c161 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:35.959644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1cf5010-e678-4e06-a410-9dd9aef8c161 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:35.960478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1cf5010-e678-4e06-a410-9dd9aef8c161 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:35.961410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1cf5010-e678-4e06-a410-9dd9aef8c161 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:35.962204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1cf5010-e678-4e06-a410-9dd9aef8c161 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:35.962787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1cf5010-e678-4e06-a410-9dd9aef8c161 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:35.975443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00a661d1-d698-4229-8bc4-ae0509dbdeb7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:35.976022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00a661d1-d698-4229-8bc4-ae0509dbdeb7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:35.982952 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-a1cf5010-e678-4e06-a410-9dd9aef8c161 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] HTTP exception thrown: Instance e1275c7b-79eb-4b3e-9d51-8311925edeb7 could not be found. Oct 24 10:40:35.984800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00a661d1-d698-4229-8bc4-ae0509dbdeb7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a1cf5010-e678-4e06-a410-9dd9aef8c161 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Request method failure captured: Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 HTTP/1.1 Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmuE1fIfmGTdFuPG8OE6AgfTbUr5d4E2Ooe4JWWxSZlbZrIvjiXuTKLQfMynPdFba0GtHBoetPyqKAWty00QxIUYfXyqRtiCO24dVQJykoTzHYQeLdEQnUIgPV5zMoIwE5WNq8GWu9z9etcqTANU1YAv_p0fnTU05VJ1gxkdXP-pIPs Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 090743f0fdd0463fbd220eebe9c67651 Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerAddressesTestJSON-1676201478 Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/090743f0fdd0463fbd220eebe9c67651"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/090743f0fdd0463fbd220eebe9c67651"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/090743f0fdd0463fbd220eebe9c67651"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_090743f0fdd0463fbd220eebe9c67651", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerAddressesTestJSON-1676201478 Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 090743f0fdd0463fbd220eebe9c67651 Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1676201478 Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerAddressesTestJSON-1676201478-project Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 418cfb97b2444502bedf855f9f147734 Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerAddressesTestJSON-1676201478-project Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance e1275c7b-79eb-4b3e-9d51-8311925edeb7 could not be found. Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'e1275c7b-79eb-4b3e-9d51-8311925edeb7'} Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1275c7b-79eb-4b3e-9d51-8311925edeb7 could not be found. Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1275c7b-79eb-4b3e-9d51-8311925edeb7 could not be found. Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:35.985225 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:35.991406 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:35.991406 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:35.991406 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:35.991406 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:35.991406 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:35.991406 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1275c7b-79eb-4b3e-9d51-8311925edeb7 could not be found. Oct 24 10:40:35.991406 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:35.992089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00a661d1-d698-4229-8bc4-ae0509dbdeb7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:35.992089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00a661d1-d698-4229-8bc4-ae0509dbdeb7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:35.992089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00a661d1-d698-4229-8bc4-ae0509dbdeb7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:35.992089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00a661d1-d698-4229-8bc4-ae0509dbdeb7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:35.992089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00a661d1-d698-4229-8bc4-ae0509dbdeb7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:35.994581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a1cf5010-e678-4e06-a410-9dd9aef8c161 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] Returning 404 to user: Instance e1275c7b-79eb-4b3e-9d51-8311925edeb7 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:35.995728 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a1cf5010-e678-4e06-a410-9dd9aef8c161 tempest-ServerAddressesTestJSON-1676201478 tempest-ServerAddressesTestJSON-1676201478-project] 10.222.0.50 "GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7" status: 404 len: 111 microversion: 2.1 time: 0.054228 Oct 24 10:40:35.996867 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1873/3659] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:35 2022] GET /compute/v2.1/servers/e1275c7b-79eb-4b3e-9d51-8311925edeb7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:40:36.030351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00a661d1-d698-4229-8bc4-ae0509dbdeb7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:40:36.120492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cbf76d14-88c0-4e5f-ad77-3f81dfcd58ff tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:36.121489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cbf76d14-88c0-4e5f-ad77-3f81dfcd58ff tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:36.139617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbf76d14-88c0-4e5f-ad77-3f81dfcd58ff tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:36.140280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbf76d14-88c0-4e5f-ad77-3f81dfcd58ff tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:36.140954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbf76d14-88c0-4e5f-ad77-3f81dfcd58ff tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:36.141872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbf76d14-88c0-4e5f-ad77-3f81dfcd58ff tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:36.142496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbf76d14-88c0-4e5f-ad77-3f81dfcd58ff tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:36.143093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbf76d14-88c0-4e5f-ad77-3f81dfcd58ff tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:36.168071 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-00a661d1-d698-4229-8bc4-ae0509dbdeb7 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "DELETE /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 204 len: 0 microversion: 2.1 time: 0.200713 Oct 24 10:40:36.170885 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1787/3660] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:40:35 2022] DELETE /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:40:36.189722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e599c7c4-3368-4bd3-b439-5dc507ce38a1 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:36.190452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e599c7c4-3368-4bd3-b439-5dc507ce38a1 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:36.207736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e599c7c4-3368-4bd3-b439-5dc507ce38a1 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:36.210083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e599c7c4-3368-4bd3-b439-5dc507ce38a1 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:36.211946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e599c7c4-3368-4bd3-b439-5dc507ce38a1 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:36.212897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e599c7c4-3368-4bd3-b439-5dc507ce38a1 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:36.215506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e599c7c4-3368-4bd3-b439-5dc507ce38a1 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:36.216287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e599c7c4-3368-4bd3-b439-5dc507ce38a1 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:36.625917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cbf76d14-88c0-4e5f-ad77-3f81dfcd58ff tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:36.636311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e599c7c4-3368-4bd3-b439-5dc507ce38a1 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:36.637478 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cbf76d14-88c0-4e5f-ad77-3f81dfcd58ff tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.521261 Oct 24 10:40:36.638701 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1874/3661] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:36 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:36.644570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7515b5f4-e616-41bb-8d45-d1d49f155f22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:36.645392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7515b5f4-e616-41bb-8d45-d1d49f155f22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:36.651936 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e599c7c4-3368-4bd3-b439-5dc507ce38a1 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1526 microversion: 2.1 time: 0.475825 Oct 24 10:40:36.652750 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1788/3662] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:36 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1526 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:36.662742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ae10fd63-72d5-4751-a171-b8e2aaaf884f req-776eb6df-9e1b-408a-b45b-1cf275ebf147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00f7c448-7d99-4ada-a8ba-01088ffecfd2", "tag": "1c02e5d1-ae08-492f-b37c-15a615eca04a"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:36.665919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7515b5f4-e616-41bb-8d45-d1d49f155f22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:36.671359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7515b5f4-e616-41bb-8d45-d1d49f155f22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:36.672334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7515b5f4-e616-41bb-8d45-d1d49f155f22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:36.673621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7515b5f4-e616-41bb-8d45-d1d49f155f22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:36.678991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7515b5f4-e616-41bb-8d45-d1d49f155f22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:36.679539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7515b5f4-e616-41bb-8d45-d1d49f155f22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:36.683295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ae10fd63-72d5-4751-a171-b8e2aaaf884f req-776eb6df-9e1b-408a-b45b-1cf275ebf147 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:36.684448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ae10fd63-72d5-4751-a171-b8e2aaaf884f req-776eb6df-9e1b-408a-b45b-1cf275ebf147 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:36.685107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ae10fd63-72d5-4751-a171-b8e2aaaf884f req-776eb6df-9e1b-408a-b45b-1cf275ebf147 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:36.717353 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ae10fd63-72d5-4751-a171-b8e2aaaf884f req-776eb6df-9e1b-408a-b45b-1cf275ebf147 service nova] Creating event network-changed:1c02e5d1-ae08-492f-b37c-15a615eca04a for instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 on n-h2-858383-15 Oct 24 10:40:36.728754 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ae10fd63-72d5-4751-a171-b8e2aaaf884f req-776eb6df-9e1b-408a-b45b-1cf275ebf147 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074579 Oct 24 10:40:36.730860 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1789/3663] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:36.780283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7515b5f4-e616-41bb-8d45-d1d49f155f22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:36.789103 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7515b5f4-e616-41bb-8d45-d1d49f155f22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1284 microversion: 2.1 time: 0.148782 Oct 24 10:40:36.790310 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1875/3664] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:36 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:36.970683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7d54152c-2b5c-4792-a89c-415767fbcd9f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:36.972539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7d54152c-2b5c-4792-a89c-415767fbcd9f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:36.981723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d54152c-2b5c-4792-a89c-415767fbcd9f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:36.982781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d54152c-2b5c-4792-a89c-415767fbcd9f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:36.985543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d54152c-2b5c-4792-a89c-415767fbcd9f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:36.986366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d54152c-2b5c-4792-a89c-415767fbcd9f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:36.986931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d54152c-2b5c-4792-a89c-415767fbcd9f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:36.987380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d54152c-2b5c-4792-a89c-415767fbcd9f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:37.256879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7d54152c-2b5c-4792-a89c-415767fbcd9f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:37.265114 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7d54152c-2b5c-4792-a89c-415767fbcd9f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 200 len: 1314 microversion: 2.1 time: 0.307339 Oct 24 10:40:37.266663 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1790/3665] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:36 2022] GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:37.666620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e39fa1e-69fe-41a5-84fb-cb51f9458663 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:37.667925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1e39fa1e-69fe-41a5-84fb-cb51f9458663 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:37.681421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e39fa1e-69fe-41a5-84fb-cb51f9458663 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:37.683748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e39fa1e-69fe-41a5-84fb-cb51f9458663 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:37.683920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-da4634ab-6ca2-47a8-b85a-eef498dc904a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:37.684720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-da4634ab-6ca2-47a8-b85a-eef498dc904a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:37.686681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e39fa1e-69fe-41a5-84fb-cb51f9458663 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:37.689777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e39fa1e-69fe-41a5-84fb-cb51f9458663 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:37.691681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e39fa1e-69fe-41a5-84fb-cb51f9458663 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:37.700332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e39fa1e-69fe-41a5-84fb-cb51f9458663 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:37.705705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da4634ab-6ca2-47a8-b85a-eef498dc904a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:37.707012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da4634ab-6ca2-47a8-b85a-eef498dc904a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:37.708133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da4634ab-6ca2-47a8-b85a-eef498dc904a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:37.712917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da4634ab-6ca2-47a8-b85a-eef498dc904a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:37.714446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da4634ab-6ca2-47a8-b85a-eef498dc904a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:37.718212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da4634ab-6ca2-47a8-b85a-eef498dc904a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:38.237890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1e39fa1e-69fe-41a5-84fb-cb51f9458663 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:38.246613 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1e39fa1e-69fe-41a5-84fb-cb51f9458663 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.585078 Oct 24 10:40:38.257283 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1876/3666] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:37 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:38.257283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4b84b131-66c8-4d0c-90d6-d2c65e948c22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:38.257283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4b84b131-66c8-4d0c-90d6-d2c65e948c22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:38.279408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b84b131-66c8-4d0c-90d6-d2c65e948c22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:38.279867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b84b131-66c8-4d0c-90d6-d2c65e948c22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:38.280303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b84b131-66c8-4d0c-90d6-d2c65e948c22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:38.281052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b84b131-66c8-4d0c-90d6-d2c65e948c22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:38.281538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b84b131-66c8-4d0c-90d6-d2c65e948c22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:38.281932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b84b131-66c8-4d0c-90d6-d2c65e948c22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:39.064956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-da4634ab-6ca2-47a8-b85a-eef498dc904a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:39.112174 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-da4634ab-6ca2-47a8-b85a-eef498dc904a tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1526 microversion: 2.1 time: 1.430619 Oct 24 10:40:39.113139 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1791/3667] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:37 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1526 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:40:39.141723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8f3512fd-66d7-4350-b747-cc2a5fc4a515 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:39.144230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8f3512fd-66d7-4350-b747-cc2a5fc4a515 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:39.155764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f3512fd-66d7-4350-b747-cc2a5fc4a515 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:39.159652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f3512fd-66d7-4350-b747-cc2a5fc4a515 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:39.160184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f3512fd-66d7-4350-b747-cc2a5fc4a515 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:39.166208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f3512fd-66d7-4350-b747-cc2a5fc4a515 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:39.166724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f3512fd-66d7-4350-b747-cc2a5fc4a515 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:39.167175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f3512fd-66d7-4350-b747-cc2a5fc4a515 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:39.323770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4b84b131-66c8-4d0c-90d6-d2c65e948c22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:39.338404 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4b84b131-66c8-4d0c-90d6-d2c65e948c22 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1314 microversion: 2.1 time: 1.085443 Oct 24 10:40:39.339028 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1877/3668] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:38 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1314 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:39.373613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-04b56669-8794-4c3d-a87b-6a1e923fcf03 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:39.374785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-04b56669-8794-4c3d-a87b-6a1e923fcf03 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:39.386699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04b56669-8794-4c3d-a87b-6a1e923fcf03 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:39.390736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04b56669-8794-4c3d-a87b-6a1e923fcf03 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:39.391210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04b56669-8794-4c3d-a87b-6a1e923fcf03 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:39.392032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04b56669-8794-4c3d-a87b-6a1e923fcf03 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:39.393030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04b56669-8794-4c3d-a87b-6a1e923fcf03 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:39.394756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04b56669-8794-4c3d-a87b-6a1e923fcf03 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:39.821166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8f3512fd-66d7-4350-b747-cc2a5fc4a515 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:39.830646 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8f3512fd-66d7-4350-b747-cc2a5fc4a515 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 200 len: 1314 microversion: 2.1 time: 0.696586 Oct 24 10:40:39.837224 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1792/3669] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:39 2022] GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:39.981939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-04b56669-8794-4c3d-a87b-6a1e923fcf03 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:39.996381 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-04b56669-8794-4c3d-a87b-6a1e923fcf03 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.638865 Oct 24 10:40:39.998451 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1878/3670] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:39 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:40.139062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be99daa3-a5cb-413d-ba77-02afdfb8a9d3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:40.141969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-be99daa3-a5cb-413d-ba77-02afdfb8a9d3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:40.158130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be99daa3-a5cb-413d-ba77-02afdfb8a9d3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:40.158744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be99daa3-a5cb-413d-ba77-02afdfb8a9d3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:40.159433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be99daa3-a5cb-413d-ba77-02afdfb8a9d3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:40.169567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be99daa3-a5cb-413d-ba77-02afdfb8a9d3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:40.172220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be99daa3-a5cb-413d-ba77-02afdfb8a9d3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:40.172709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be99daa3-a5cb-413d-ba77-02afdfb8a9d3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:40.376483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9477a160-7a08-47c0-b414-259439b33628 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:40.377703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9477a160-7a08-47c0-b414-259439b33628 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:40.401368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9477a160-7a08-47c0-b414-259439b33628 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:40.401900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9477a160-7a08-47c0-b414-259439b33628 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:40.402876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9477a160-7a08-47c0-b414-259439b33628 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:40.406028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9477a160-7a08-47c0-b414-259439b33628 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:40.408950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9477a160-7a08-47c0-b414-259439b33628 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:40.414493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-be99daa3-a5cb-413d-ba77-02afdfb8a9d3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f089833f359473ebfa681931e8ffc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5edfb6d8f84547399863eec5c89e6933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:40.420232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:40.425414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9477a160-7a08-47c0-b414-259439b33628 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:40.444256 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-be99daa3-a5cb-413d-ba77-02afdfb8a9d3 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 200 len: 1484 microversion: 2.1 time: 0.306585 Oct 24 10:40:40.447011 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1793/3671] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:40 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 1484 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:40.462568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-6f16ae7f-af77-4045-9b79-db12c7e8fb82 req-a9461b12-7896-49a9-a9d3-32daf126bf91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f47b34-c515-45c3-be54-4b534ce4f4c2", "name": "network-vif-deleted", "tag": "b974087e-0f6b-420d-a529-b096270b3cee"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:40.487454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6f16ae7f-af77-4045-9b79-db12c7e8fb82 req-a9461b12-7896-49a9-a9d3-32daf126bf91 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:40.489245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6f16ae7f-af77-4045-9b79-db12c7e8fb82 req-a9461b12-7896-49a9-a9d3-32daf126bf91 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:40.490915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6f16ae7f-af77-4045-9b79-db12c7e8fb82 req-a9461b12-7896-49a9-a9d3-32daf126bf91 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:40.522970 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-6f16ae7f-af77-4045-9b79-db12c7e8fb82 req-a9461b12-7896-49a9-a9d3-32daf126bf91 service nova] Creating event network-vif-deleted:b974087e-0f6b-420d-a529-b096270b3cee for instance 15f47b34-c515-45c3-be54-4b534ce4f4c2 on n-h1-858383-15 Oct 24 10:40:40.530112 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-6f16ae7f-af77-4045-9b79-db12c7e8fb82 req-a9461b12-7896-49a9-a9d3-32daf126bf91 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080686 Oct 24 10:40:40.531417 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1794/3672] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:40.752362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9477a160-7a08-47c0-b414-259439b33628 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:40.770316 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9477a160-7a08-47c0-b414-259439b33628 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1314 microversion: 2.1 time: 0.401132 Oct 24 10:40:40.772380 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1879/3673] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:40 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:40:40.860991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a3f746b3-ec67-403e-b64e-5f2d14937f5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:40.861811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a3f746b3-ec67-403e-b64e-5f2d14937f5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:40.888187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3f746b3-ec67-403e-b64e-5f2d14937f5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:40.889089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3f746b3-ec67-403e-b64e-5f2d14937f5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:40.890520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3f746b3-ec67-403e-b64e-5f2d14937f5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:40.891829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3f746b3-ec67-403e-b64e-5f2d14937f5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:40.892630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3f746b3-ec67-403e-b64e-5f2d14937f5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:40.893345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3f746b3-ec67-403e-b64e-5f2d14937f5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:41.034276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1a612cdc-d21b-4cfe-af2e-1929e6bc64b0 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:41.035208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1a612cdc-d21b-4cfe-af2e-1929e6bc64b0 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:41.043527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a612cdc-d21b-4cfe-af2e-1929e6bc64b0 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:41.044640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a612cdc-d21b-4cfe-af2e-1929e6bc64b0 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:41.046486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a612cdc-d21b-4cfe-af2e-1929e6bc64b0 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:41.048272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a612cdc-d21b-4cfe-af2e-1929e6bc64b0 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:41.049895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a612cdc-d21b-4cfe-af2e-1929e6bc64b0 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:41.050613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a612cdc-d21b-4cfe-af2e-1929e6bc64b0 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:41.098850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a3f746b3-ec67-403e-b64e-5f2d14937f5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:41.108925 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a3f746b3-ec67-403e-b64e-5f2d14937f5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 200 len: 1314 microversion: 2.1 time: 0.255430 Oct 24 10:40:41.109881 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1795/3674] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:40 2022] GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:41.262834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1a612cdc-d21b-4cfe-af2e-1929e6bc64b0 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:41.272508 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1a612cdc-d21b-4cfe-af2e-1929e6bc64b0 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.243313 Oct 24 10:40:41.274207 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1880/3675] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:41 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:40:41.482645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d8108fc2-be91-43e3-a99c-19c323f3cc78 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:41.486141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:41.487165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d8108fc2-be91-43e3-a99c-19c323f3cc78 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 15f47b34-c515-45c3-be54-4b534ce4f4c2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:41.491545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=26 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:41.505206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8108fc2-be91-43e3-a99c-19c323f3cc78 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:41.507452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8108fc2-be91-43e3-a99c-19c323f3cc78 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:41.508265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8108fc2-be91-43e3-a99c-19c323f3cc78 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:41.510446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8108fc2-be91-43e3-a99c-19c323f3cc78 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:41.511187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8108fc2-be91-43e3-a99c-19c323f3cc78 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:41.512659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8108fc2-be91-43e3-a99c-19c323f3cc78 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:41.538118 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-d8108fc2-be91-43e3-a99c-19c323f3cc78 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] HTTP exception thrown: Instance 15f47b34-c515-45c3-be54-4b534ce4f4c2 could not be found. Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d8108fc2-be91-43e3-a99c-19c323f3cc78 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Request method failure captured: Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 HTTP/1.1 Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmsZ6iCeMLTpciKzT-IOd-jSbp-Ock4X7vHFbSgox-iuMV2hxDyst1XnTlhe7a0yhnti-D3qlDTVLsDNpGHmdQxuIxzHTz6ZfOA3sAyV-nTFUvtxnUe0hLrgWnomxwn6YBZ-Qwy9VkVlCsoa7UEzkg7FPtyXY6LqjelB4oPUwFh9rLg Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5edfb6d8f84547399863eec5c89e6933", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 1f089833f359473ebfa681931e8ffc06 Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 15f47b34-c515-45c3-be54-4b534ce4f4c2 could not be found. Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '15f47b34-c515-45c3-be54-4b534ce4f4c2'} Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15f47b34-c515-45c3-be54-4b534ce4f4c2 could not be found. Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15f47b34-c515-45c3-be54-4b534ce4f4c2 could not be found. Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.540340 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:41.547144 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.547144 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:41.547144 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:41.547144 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:41.547144 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:41.547144 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:41.547144 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15f47b34-c515-45c3-be54-4b534ce4f4c2 could not be found. Oct 24 10:40:41.547144 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.548596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d8108fc2-be91-43e3-a99c-19c323f3cc78 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Returning 404 to user: Instance 15f47b34-c515-45c3-be54-4b534ce4f4c2 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:41.549830 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d8108fc2-be91-43e3-a99c-19c323f3cc78 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2" status: 404 len: 111 microversion: 2.1 time: 0.078414 Oct 24 10:40:41.554956 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1881/3676] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:41 2022] GET /compute/v2.1/servers/15f47b34-c515-45c3-be54-4b534ce4f4c2 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:40:41.562110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ca84bdfe-8a9d-4740-b4c3-f1d5ea64fb15 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '.version_select at 0x7f04d06a2700>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:41.590113 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-ca84bdfe-8a9d-4740-b4c3-f1d5ea64fb15 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] HTTP exception thrown: Image not found. Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ca84bdfe-8a9d-4740-b4c3-f1d5ea64fb15 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Request method failure captured: Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/images/7450176f-f233-4925-a56d-8b6b5aaea2b3 HTTP/1.1 Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmsZ6iCeMLTpciKzT-IOd-jSbp-Ock4X7vHFbSgox-iuMV2hxDyst1XnTlhe7a0yhnti-D3qlDTVLsDNpGHmdQxuIxzHTz6ZfOA3sAyV-nTFUvtxnUe0hLrgWnomxwn6YBZ-Qwy9VkVlCsoa7UEzkg7FPtyXY6LqjelB4oPUwFh9rLg Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5edfb6d8f84547399863eec5c89e6933", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 1f089833f359473ebfa681931e8ffc06 Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: exception: Image not found. Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '7450176f-f233-4925-a56d-8b6b5aaea2b3'} Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7450176f-f233-4925-a56d-8b6b5aaea2b3 to delete Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7450176f-f233-4925-a56d-8b6b5aaea2b3 could not be found. Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:41.592285 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ca84bdfe-8a9d-4740-b4c3-f1d5ea64fb15 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Returning 404 to user: Image not found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ca84bdfe-8a9d-4740-b4c3-f1d5ea64fb15 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "DELETE /compute/v2.1/images/7450176f-f233-4925-a56d-8b6b5aaea2b3" status: 404 len: 62 microversion: 2.1 time: 0.037552 Oct 24 10:40:41.601097 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1882/3677] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:41 2022] DELETE /compute/v2.1/images/7450176f-f233-4925-a56d-8b6b5aaea2b3 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:40:41.609656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8f53ce91-70e0-458b-b334-542ca3d9ff6f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:41.611624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8f53ce91-70e0-458b-b334-542ca3d9ff6f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:41.619573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f53ce91-70e0-458b-b334-542ca3d9ff6f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:41.620485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f53ce91-70e0-458b-b334-542ca3d9ff6f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:41.620997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f53ce91-70e0-458b-b334-542ca3d9ff6f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:41.622393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f53ce91-70e0-458b-b334-542ca3d9ff6f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:41.622874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f53ce91-70e0-458b-b334-542ca3d9ff6f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:41.623367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f53ce91-70e0-458b-b334-542ca3d9ff6f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:41.640930 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-8f53ce91-70e0-458b-b334-542ca3d9ff6f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] HTTP exception thrown: Instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d could not be found. Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8f53ce91-70e0-458b-b334-542ca3d9ff6f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Request method failure captured: Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d HTTP/1.1 Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmsZ6iCeMLTpciKzT-IOd-jSbp-Ock4X7vHFbSgox-iuMV2hxDyst1XnTlhe7a0yhnti-D3qlDTVLsDNpGHmdQxuIxzHTz6ZfOA3sAyV-nTFUvtxnUe0hLrgWnomxwn6YBZ-Qwy9VkVlCsoa7UEzkg7FPtyXY6LqjelB4oPUwFh9rLg Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5edfb6d8f84547399863eec5c89e6933", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 1f089833f359473ebfa681931e8ffc06 Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d could not be found. Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '27efcba4-7aac-4be7-890d-dc0baeff7a5d'} Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d could not be found. Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:40:41.642845 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:40:41.648240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d could not be found. Oct 24 10:40:41.648240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.648240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:41.648240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.648240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:41.648240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:41.648240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:41.648240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:41.648240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:41.648240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d could not be found. Oct 24 10:40:41.648240 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.650751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8f53ce91-70e0-458b-b334-542ca3d9ff6f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Returning 404 to user: Instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:41.651847 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8f53ce91-70e0-458b-b334-542ca3d9ff6f tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "DELETE /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 404 len: 111 microversion: 2.1 time: 0.052660 Oct 24 10:40:41.653072 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1883/3678] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:40:41 2022] DELETE /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:40:41.663276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-21bba952-e716-48c1-acfb-6f1062058645 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:41.663955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-21bba952-e716-48c1-acfb-6f1062058645 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: 27efcba4-7aac-4be7-890d-dc0baeff7a5d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:41.672122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21bba952-e716-48c1-acfb-6f1062058645 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:41.672431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21bba952-e716-48c1-acfb-6f1062058645 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:41.673484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21bba952-e716-48c1-acfb-6f1062058645 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:41.674448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21bba952-e716-48c1-acfb-6f1062058645 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:41.675160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21bba952-e716-48c1-acfb-6f1062058645 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:41.675852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21bba952-e716-48c1-acfb-6f1062058645 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:41.695816 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-21bba952-e716-48c1-acfb-6f1062058645 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] HTTP exception thrown: Instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d could not be found. Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-21bba952-e716-48c1-acfb-6f1062058645 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Request method failure captured: Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d HTTP/1.1 Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmsZ6iCeMLTpciKzT-IOd-jSbp-Ock4X7vHFbSgox-iuMV2hxDyst1XnTlhe7a0yhnti-D3qlDTVLsDNpGHmdQxuIxzHTz6ZfOA3sAyV-nTFUvtxnUe0hLrgWnomxwn6YBZ-Qwy9VkVlCsoa7UEzkg7FPtyXY6LqjelB4oPUwFh9rLg Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5edfb6d8f84547399863eec5c89e6933", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 1f089833f359473ebfa681931e8ffc06 Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d could not be found. Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '27efcba4-7aac-4be7-890d-dc0baeff7a5d'} Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d could not be found. Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d could not be found. Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.697575 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:41.703160 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.703160 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:41.703160 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:41.703160 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:41.703160 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:41.703160 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:41.703160 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d could not be found. Oct 24 10:40:41.703160 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:41.703160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-21bba952-e716-48c1-acfb-6f1062058645 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Returning 404 to user: Instance 27efcba4-7aac-4be7-890d-dc0baeff7a5d could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:41.703160 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-21bba952-e716-48c1-acfb-6f1062058645 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d" status: 404 len: 111 microversion: 2.1 time: 0.042316 Oct 24 10:40:41.703160 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1884/3679] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:41 2022] GET /compute/v2.1/servers/27efcba4-7aac-4be7-890d-dc0baeff7a5d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:40:41.709927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-045167f8-d7cf-4a1a-9847-5a553ae0cce9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '.version_select at 0x7f04d0109700>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:41.744392 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-045167f8-d7cf-4a1a-9847-5a553ae0cce9 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1308045681" status: 202 len: 0 microversion: 2.1 time: 0.039756 Oct 24 10:40:41.746838 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1885/3680] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Oct 24 10:40:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1308045681 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:40:41.784975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-5026ffb9-ecde-4a6f-ba3c-6df8a9542829 req-d5254635-51da-4ca7-9920-b503a1d92abe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6203fa6d-e5c6-45fa-9584-cfcd993b5cdf", "tag": "2a70293f-229f-41bd-aadc-1ca0206a17d9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:41.804362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e215d2b2-ab59-404c-8abc-f64e8661e181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:41.805821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e215d2b2-ab59-404c-8abc-f64e8661e181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:41.816406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5026ffb9-ecde-4a6f-ba3c-6df8a9542829 req-d5254635-51da-4ca7-9920-b503a1d92abe service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:41.817369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5026ffb9-ecde-4a6f-ba3c-6df8a9542829 req-d5254635-51da-4ca7-9920-b503a1d92abe service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:41.818705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5026ffb9-ecde-4a6f-ba3c-6df8a9542829 req-d5254635-51da-4ca7-9920-b503a1d92abe service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:41.820182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e215d2b2-ab59-404c-8abc-f64e8661e181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:41.822678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e215d2b2-ab59-404c-8abc-f64e8661e181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:41.823343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e215d2b2-ab59-404c-8abc-f64e8661e181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:41.825781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e215d2b2-ab59-404c-8abc-f64e8661e181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:41.827199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e215d2b2-ab59-404c-8abc-f64e8661e181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:41.828977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e215d2b2-ab59-404c-8abc-f64e8661e181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:41.857400 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-5026ffb9-ecde-4a6f-ba3c-6df8a9542829 req-d5254635-51da-4ca7-9920-b503a1d92abe service nova] Creating event network-changed:2a70293f-229f-41bd-aadc-1ca0206a17d9 for instance 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf on n-h1-858383-15 Oct 24 10:40:41.871278 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-5026ffb9-ecde-4a6f-ba3c-6df8a9542829 req-d5254635-51da-4ca7-9920-b503a1d92abe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.402440 Oct 24 10:40:41.876678 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1796/3681] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:42.134331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ec5d44d8-a71e-483a-a547-bf6a4d1cf9a5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:42.135384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ec5d44d8-a71e-483a-a547-bf6a4d1cf9a5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:42.147032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec5d44d8-a71e-483a-a547-bf6a4d1cf9a5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:42.148038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec5d44d8-a71e-483a-a547-bf6a4d1cf9a5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:42.148662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec5d44d8-a71e-483a-a547-bf6a4d1cf9a5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:42.149634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec5d44d8-a71e-483a-a547-bf6a4d1cf9a5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:42.151481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec5d44d8-a71e-483a-a547-bf6a4d1cf9a5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:42.153211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec5d44d8-a71e-483a-a547-bf6a4d1cf9a5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:42.197722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e215d2b2-ab59-404c-8abc-f64e8661e181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:42.206719 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e215d2b2-ab59-404c-8abc-f64e8661e181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1314 microversion: 2.1 time: 0.407315 Oct 24 10:40:42.221198 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1886/3682] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:41 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:42.302126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fd8fb6ab-dbf0-40ab-828b-e1ac30e4ebe8 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:42.302812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fd8fb6ab-dbf0-40ab-828b-e1ac30e4ebe8 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:42.318874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd8fb6ab-dbf0-40ab-828b-e1ac30e4ebe8 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:42.319420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd8fb6ab-dbf0-40ab-828b-e1ac30e4ebe8 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:42.319897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd8fb6ab-dbf0-40ab-828b-e1ac30e4ebe8 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:42.320583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd8fb6ab-dbf0-40ab-828b-e1ac30e4ebe8 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:42.321083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd8fb6ab-dbf0-40ab-828b-e1ac30e4ebe8 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:42.321519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd8fb6ab-dbf0-40ab-828b-e1ac30e4ebe8 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:42.626741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ec5d44d8-a71e-483a-a547-bf6a4d1cf9a5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:42.641825 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ec5d44d8-a71e-483a-a547-bf6a4d1cf9a5 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 200 len: 1314 microversion: 2.1 time: 0.512980 Oct 24 10:40:42.657859 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1797/3683] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:42 2022] GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:42.770567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fd8fb6ab-dbf0-40ab-828b-e1ac30e4ebe8 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:42.800886 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fd8fb6ab-dbf0-40ab-828b-e1ac30e4ebe8 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.502626 Oct 24 10:40:42.802675 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1887/3684] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:42 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:40:43.240619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-76444153-ff99-4db5-8f9b-e251754be407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:43.249139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-76444153-ff99-4db5-8f9b-e251754be407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:43.292280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-76444153-ff99-4db5-8f9b-e251754be407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:43.292952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-76444153-ff99-4db5-8f9b-e251754be407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:43.295195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-76444153-ff99-4db5-8f9b-e251754be407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:43.297048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-76444153-ff99-4db5-8f9b-e251754be407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:43.300257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-76444153-ff99-4db5-8f9b-e251754be407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:43.305408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-76444153-ff99-4db5-8f9b-e251754be407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:43.666906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-661bb4bc-8220-4ec3-8c94-f515fff759bc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:43.667845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-661bb4bc-8220-4ec3-8c94-f515fff759bc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:43.683834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-661bb4bc-8220-4ec3-8c94-f515fff759bc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:43.684348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-661bb4bc-8220-4ec3-8c94-f515fff759bc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:43.685115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-661bb4bc-8220-4ec3-8c94-f515fff759bc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:43.685848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-661bb4bc-8220-4ec3-8c94-f515fff759bc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:43.688222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-661bb4bc-8220-4ec3-8c94-f515fff759bc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:43.690656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-661bb4bc-8220-4ec3-8c94-f515fff759bc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:43.850970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-76444153-ff99-4db5-8f9b-e251754be407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:43.859445 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-76444153-ff99-4db5-8f9b-e251754be407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1314 microversion: 2.1 time: 0.625214 Oct 24 10:40:43.860035 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1798/3685] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:43 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:43.866496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ecb23831-f645-4bfe-bff8-95c53c320212 req-ff746950-d171-4f96-82fe-5efea1c19e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00f7c448-7d99-4ada-a8ba-01088ffecfd2", "name": "network-vif-plugged", "status": "completed", "tag": "1c02e5d1-ae08-492f-b37c-15a615eca04a"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:43.878900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ecb23831-f645-4bfe-bff8-95c53c320212 req-ff746950-d171-4f96-82fe-5efea1c19e91 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:43.879928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ecb23831-f645-4bfe-bff8-95c53c320212 req-ff746950-d171-4f96-82fe-5efea1c19e91 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:43.880773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ecb23831-f645-4bfe-bff8-95c53c320212 req-ff746950-d171-4f96-82fe-5efea1c19e91 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:43.894460 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ecb23831-f645-4bfe-bff8-95c53c320212 req-ff746950-d171-4f96-82fe-5efea1c19e91 service nova] Creating event network-vif-plugged:1c02e5d1-ae08-492f-b37c-15a615eca04a for instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 on n-h2-858383-15 Oct 24 10:40:43.901612 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ecb23831-f645-4bfe-bff8-95c53c320212 req-ff746950-d171-4f96-82fe-5efea1c19e91 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040033 Oct 24 10:40:43.906812 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1799/3686] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:43.913904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ee5f845a-1251-445c-8b88-8ce5a7091c83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '.version_select at 0x7f04d0c9dd30>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:43.944672 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-ee5f845a-1251-445c-8b88-8ce5a7091c83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] HTTP exception thrown: Image not found. Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ee5f845a-1251-445c-8b88-8ce5a7091c83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Request method failure captured: Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/images/59e62947-0481-44bd-8125-62850c366558 HTTP/1.1 Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmsZ6iCeMLTpciKzT-IOd-jSbp-Ock4X7vHFbSgox-iuMV2hxDyst1XnTlhe7a0yhnti-D3qlDTVLsDNpGHmdQxuIxzHTz6ZfOA3sAyV-nTFUvtxnUe0hLrgWnomxwn6YBZ-Qwy9VkVlCsoa7UEzkg7FPtyXY6LqjelB4oPUwFh9rLg Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5edfb6d8f84547399863eec5c89e6933", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 1f089833f359473ebfa681931e8ffc06 Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: exception: Image not found. Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '59e62947-0481-44bd-8125-62850c366558'} Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 59e62947-0481-44bd-8125-62850c366558 to delete Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 59e62947-0481-44bd-8125-62850c366558 could not be found. Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:43.947583 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 24 10:40:43.953118 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:43.957029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ee5f845a-1251-445c-8b88-8ce5a7091c83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Returning 404 to user: Image not found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:43.957616 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ee5f845a-1251-445c-8b88-8ce5a7091c83 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "DELETE /compute/v2.1/images/59e62947-0481-44bd-8125-62850c366558" status: 404 len: 62 microversion: 2.1 time: 0.048864 Oct 24 10:40:43.959615 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1800/3687] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:43 2022] DELETE /compute/v2.1/images/59e62947-0481-44bd-8125-62850c366558 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:40:43.965414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c9289ebc-d881-43e2-b6d2-141a4ee80615 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:43.966522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c9289ebc-d881-43e2-b6d2-141a4ee80615 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:43.977881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9289ebc-d881-43e2-b6d2-141a4ee80615 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:43.978585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9289ebc-d881-43e2-b6d2-141a4ee80615 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:43.979239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9289ebc-d881-43e2-b6d2-141a4ee80615 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:43.980136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9289ebc-d881-43e2-b6d2-141a4ee80615 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:43.980786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9289ebc-d881-43e2-b6d2-141a4ee80615 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:43.981741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9289ebc-d881-43e2-b6d2-141a4ee80615 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:44.182662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-661bb4bc-8220-4ec3-8c94-f515fff759bc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:44.190759 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-661bb4bc-8220-4ec3-8c94-f515fff759bc tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 200 len: 1314 microversion: 2.1 time: 0.527835 Oct 24 10:40:44.199140 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1888/3688] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:43 2022] GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:44.204687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d59f79af-431b-42f7-9d92-1e5a97d11c81 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:44.213650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d59f79af-431b-42f7-9d92-1e5a97d11c81 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:44.237409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d59f79af-431b-42f7-9d92-1e5a97d11c81 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:44.237999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d59f79af-431b-42f7-9d92-1e5a97d11c81 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:44.238462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d59f79af-431b-42f7-9d92-1e5a97d11c81 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:44.239293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d59f79af-431b-42f7-9d92-1e5a97d11c81 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:44.239860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d59f79af-431b-42f7-9d92-1e5a97d11c81 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:44.240316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d59f79af-431b-42f7-9d92-1e5a97d11c81 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:44.274197 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-d59f79af-431b-42f7-9d92-1e5a97d11c81 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] HTTP exception thrown: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 could not be found. Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d59f79af-431b-42f7-9d92-1e5a97d11c81 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Request method failure captured: Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 HTTP/1.1 Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmsZ6iCeMLTpciKzT-IOd-jSbp-Ock4X7vHFbSgox-iuMV2hxDyst1XnTlhe7a0yhnti-D3qlDTVLsDNpGHmdQxuIxzHTz6ZfOA3sAyV-nTFUvtxnUe0hLrgWnomxwn6YBZ-Qwy9VkVlCsoa7UEzkg7FPtyXY6LqjelB4oPUwFh9rLg Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5edfb6d8f84547399863eec5c89e6933", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 1f089833f359473ebfa681931e8ffc06 Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 could not be found. Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'a7aeb942-aab8-4051-b5ac-b4cab02dc9d0'} Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 could not be found. Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:40:44.278037 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:40:44.283678 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 could not be found. Oct 24 10:40:44.283678 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:44.283678 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:44.283678 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:44.283678 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:44.283678 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:44.283678 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:44.283678 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:44.283678 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:44.283678 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 could not be found. Oct 24 10:40:44.283678 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:44.289419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d59f79af-431b-42f7-9d92-1e5a97d11c81 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Returning 404 to user: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:44.290766 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d59f79af-431b-42f7-9d92-1e5a97d11c81 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 404 len: 111 microversion: 2.1 time: 0.090096 Oct 24 10:40:44.291849 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1889/3689] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:40:44 2022] DELETE /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:40:44.300374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e5adeab2-7fc6-4b45-8314-459979ed0719 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:44.301472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e5adeab2-7fc6-4b45-8314-459979ed0719 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] [instance: a7aeb942-aab8-4051-b5ac-b4cab02dc9d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:44.324426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5adeab2-7fc6-4b45-8314-459979ed0719 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:44.327054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5adeab2-7fc6-4b45-8314-459979ed0719 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:44.327726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5adeab2-7fc6-4b45-8314-459979ed0719 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:44.329752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5adeab2-7fc6-4b45-8314-459979ed0719 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:44.331716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5adeab2-7fc6-4b45-8314-459979ed0719 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:44.334634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5adeab2-7fc6-4b45-8314-459979ed0719 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:44.376241 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-e5adeab2-7fc6-4b45-8314-459979ed0719 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] HTTP exception thrown: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 could not be found. Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e5adeab2-7fc6-4b45-8314-459979ed0719 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Request method failure captured: Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 HTTP/1.1 Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmsZ6iCeMLTpciKzT-IOd-jSbp-Ock4X7vHFbSgox-iuMV2hxDyst1XnTlhe7a0yhnti-D3qlDTVLsDNpGHmdQxuIxzHTz6ZfOA3sAyV-nTFUvtxnUe0hLrgWnomxwn6YBZ-Qwy9VkVlCsoa7UEzkg7FPtyXY6LqjelB4oPUwFh9rLg Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5edfb6d8f84547399863eec5c89e6933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5edfb6d8f84547399863eec5c89e6933", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 5edfb6d8f84547399863eec5c89e6933 Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-584087554 Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 1f089833f359473ebfa681931e8ffc06 Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-584087554-project Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 could not be found. Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'a7aeb942-aab8-4051-b5ac-b4cab02dc9d0'} Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 could not be found. Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 could not be found. Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:44.383867 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:44.390466 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:44.390466 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:44.390466 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:44.390466 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:44.390466 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:44.390466 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:44.390466 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 could not be found. Oct 24 10:40:44.390466 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:44.390466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e5adeab2-7fc6-4b45-8314-459979ed0719 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] Returning 404 to user: Instance a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:44.390466 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e5adeab2-7fc6-4b45-8314-459979ed0719 tempest-ImagesOneServerNegativeTestJSON-584087554 tempest-ImagesOneServerNegativeTestJSON-584087554-project] 10.222.0.50 "GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0" status: 404 len: 111 microversion: 2.1 time: 0.089706 Oct 24 10:40:44.390466 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1890/3690] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:44 2022] GET /compute/v2.1/servers/a7aeb942-aab8-4051-b5ac-b4cab02dc9d0 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:40:44.637875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c9289ebc-d881-43e2-b6d2-141a4ee80615 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:44.652308 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c9289ebc-d881-43e2-b6d2-141a4ee80615 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.691375 Oct 24 10:40:44.653552 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1801/3691] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:43 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:44.886131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-443e12a7-2c63-47c8-999f-bab4679f878f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:44.887006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-443e12a7-2c63-47c8-999f-bab4679f878f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:44.902388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-443e12a7-2c63-47c8-999f-bab4679f878f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:44.903774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-443e12a7-2c63-47c8-999f-bab4679f878f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:44.904237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-443e12a7-2c63-47c8-999f-bab4679f878f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:44.907286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-443e12a7-2c63-47c8-999f-bab4679f878f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:44.907772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-443e12a7-2c63-47c8-999f-bab4679f878f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:44.908220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-443e12a7-2c63-47c8-999f-bab4679f878f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:45.179594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=16 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:45.192590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:45.233719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-87e449c1-8ca5-4b8e-8225-4999241b7c24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:45.237336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-87e449c1-8ca5-4b8e-8225-4999241b7c24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:45.245973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87e449c1-8ca5-4b8e-8225-4999241b7c24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:45.246834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87e449c1-8ca5-4b8e-8225-4999241b7c24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:45.247629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87e449c1-8ca5-4b8e-8225-4999241b7c24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:45.249986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87e449c1-8ca5-4b8e-8225-4999241b7c24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:45.250729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87e449c1-8ca5-4b8e-8225-4999241b7c24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:45.251342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87e449c1-8ca5-4b8e-8225-4999241b7c24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:45.928207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-443e12a7-2c63-47c8-999f-bab4679f878f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:45.944238 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-443e12a7-2c63-47c8-999f-bab4679f878f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1314 microversion: 2.1 time: 1.063722 Oct 24 10:40:45.960636 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1891/3692] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:44 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1314 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:45.965822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3084a9a2-fbfa-4c17-9bab-c45a7f0031d5 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:45.966889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3084a9a2-fbfa-4c17-9bab-c45a7f0031d5 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:45.986612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3084a9a2-fbfa-4c17-9bab-c45a7f0031d5 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:45.987124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3084a9a2-fbfa-4c17-9bab-c45a7f0031d5 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:45.987660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3084a9a2-fbfa-4c17-9bab-c45a7f0031d5 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:45.988352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3084a9a2-fbfa-4c17-9bab-c45a7f0031d5 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:45.988762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3084a9a2-fbfa-4c17-9bab-c45a7f0031d5 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:45.989333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3084a9a2-fbfa-4c17-9bab-c45a7f0031d5 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:46.112539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-87e449c1-8ca5-4b8e-8225-4999241b7c24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:46.125929 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-87e449c1-8ca5-4b8e-8225-4999241b7c24 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 200 len: 1314 microversion: 2.1 time: 0.898657 Oct 24 10:40:46.148300 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1802/3693] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:45 2022] GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 1314 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:40:46.441762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3084a9a2-fbfa-4c17-9bab-c45a7f0031d5 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:46.451006 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3084a9a2-fbfa-4c17-9bab-c45a7f0031d5 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1523 microversion: 2.1 time: 0.488981 Oct 24 10:40:46.451720 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1892/3694] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:45 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1523 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:46.987098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-af380648-d77b-46d9-a02d-11e911aac88e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:46.988309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-af380648-d77b-46d9-a02d-11e911aac88e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:47.005958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af380648-d77b-46d9-a02d-11e911aac88e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:47.006829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af380648-d77b-46d9-a02d-11e911aac88e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:47.007447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af380648-d77b-46d9-a02d-11e911aac88e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:47.009867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af380648-d77b-46d9-a02d-11e911aac88e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:47.011818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af380648-d77b-46d9-a02d-11e911aac88e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:47.012271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af380648-d77b-46d9-a02d-11e911aac88e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:47.157283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c4590f55-a7d3-43ec-90e1-8f57e52ceca9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:47.157905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c4590f55-a7d3-43ec-90e1-8f57e52ceca9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:47.178940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4590f55-a7d3-43ec-90e1-8f57e52ceca9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:47.187363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4590f55-a7d3-43ec-90e1-8f57e52ceca9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:47.188001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4590f55-a7d3-43ec-90e1-8f57e52ceca9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:47.188979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4590f55-a7d3-43ec-90e1-8f57e52ceca9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:47.189596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4590f55-a7d3-43ec-90e1-8f57e52ceca9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:47.190193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4590f55-a7d3-43ec-90e1-8f57e52ceca9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:47.250982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:47.779729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c4590f55-a7d3-43ec-90e1-8f57e52ceca9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:47.789396 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c4590f55-a7d3-43ec-90e1-8f57e52ceca9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 200 len: 1501 microversion: 2.1 time: 0.635846 Oct 24 10:40:47.791975 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1893/3695] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:47 2022] GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 1501 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:47.818011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-af380648-d77b-46d9-a02d-11e911aac88e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:47.851179 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-af380648-d77b-46d9-a02d-11e911aac88e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1314 microversion: 2.1 time: 0.860435 Oct 24 10:40:47.853135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a2cc46cf-6dc9-4707-b755-b1b5bc1e74d2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:47.856054 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1803/3696] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:46 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1314 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:47.858156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a2cc46cf-6dc9-4707-b755-b1b5bc1e74d2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:47.867999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a1107f37-ad70-4c52-b5ed-97db48e17d57 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:47.875893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a1107f37-ad70-4c52-b5ed-97db48e17d57 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:47.894133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2cc46cf-6dc9-4707-b755-b1b5bc1e74d2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:47.897702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2cc46cf-6dc9-4707-b755-b1b5bc1e74d2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:47.898189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2cc46cf-6dc9-4707-b755-b1b5bc1e74d2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:47.901412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2cc46cf-6dc9-4707-b755-b1b5bc1e74d2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:47.905988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2cc46cf-6dc9-4707-b755-b1b5bc1e74d2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:47.906565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2cc46cf-6dc9-4707-b755-b1b5bc1e74d2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:47.910134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1107f37-ad70-4c52-b5ed-97db48e17d57 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:47.910640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1107f37-ad70-4c52-b5ed-97db48e17d57 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:47.915359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1107f37-ad70-4c52-b5ed-97db48e17d57 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:47.916201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1107f37-ad70-4c52-b5ed-97db48e17d57 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:47.916692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1107f37-ad70-4c52-b5ed-97db48e17d57 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:47.917164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1107f37-ad70-4c52-b5ed-97db48e17d57 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:47.968006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-a1107f37-ad70-4c52-b5ed-97db48e17d57 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lazy-loading 'flavor' on Instance uuid 00f7c448-7d99-4ada-a8ba-01088ffecfd2 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:40:48.124887 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a1107f37-ad70-4c52-b5ed-97db48e17d57 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "POST /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2/action" status: 202 len: 0 microversion: 2.1 time: 0.266889 Oct 24 10:40:48.126665 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1804/3697] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:40:47 2022] POST /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:40:48.223815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a2cc46cf-6dc9-4707-b755-b1b5bc1e74d2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:48.235407 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a2cc46cf-6dc9-4707-b755-b1b5bc1e74d2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1503 microversion: 2.1 time: 0.425549 Oct 24 10:40:48.236256 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1894/3698] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:47 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1503 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:48.260934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e45fa270-0815-4861-9397-7cf4aba13c34 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:48.265599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e45fa270-0815-4861-9397-7cf4aba13c34 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:48.293810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e45fa270-0815-4861-9397-7cf4aba13c34 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:48.294486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e45fa270-0815-4861-9397-7cf4aba13c34 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:48.294947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e45fa270-0815-4861-9397-7cf4aba13c34 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:48.297753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e45fa270-0815-4861-9397-7cf4aba13c34 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:48.298250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e45fa270-0815-4861-9397-7cf4aba13c34 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:48.299508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e45fa270-0815-4861-9397-7cf4aba13c34 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:48.414856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-97ba6d31-ca28-49a3-a6d7-41c3478ca605 tempest-QuotasTestJSON-84201560 tempest-QuotasTestJSON-84201560-project] Calling method '.version_select at 0x7f04d4ed7310>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:48.525246 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-97ba6d31-ca28-49a3-a6d7-41c3478ca605 tempest-QuotasTestJSON-84201560 tempest-QuotasTestJSON-84201560-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/a6abd93e7ccf4683a8fad44da3dc67a1/defaults" status: 200 len: 371 microversion: 2.1 time: 0.397029 Oct 24 10:40:48.534103 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1805/3699] 10.222.0.50 () {58 vars in 1269 bytes} [Mon Oct 24 10:40:48 2022] GET /compute/v2.1/os-quota-sets/a6abd93e7ccf4683a8fad44da3dc67a1/defaults => generated 371 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:48.551517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf600b44-5cc4-410c-969e-0490d3e96dda tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Action: 'create', calling method: .version_select at 0x7f04d0c9d3a0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-873201084", "description": "tempest-description-220960811"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:48.737947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e45fa270-0815-4861-9397-7cf4aba13c34 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:48.763132 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e45fa270-0815-4861-9397-7cf4aba13c34 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 200 len: 1509 microversion: 2.1 time: 0.521958 Oct 24 10:40:48.764948 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1895/3700] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:48 2022] GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 1509 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:48.784475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b94f9a73-3e5f-41e6-8171-70484d6d6e2b tempest-QuotasTestJSON-84201560 tempest-QuotasTestJSON-84201560-project] Calling method '.version_select at 0x7f04d06fb670>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:48.928640 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b94f9a73-3e5f-41e6-8171-70484d6d6e2b tempest-QuotasTestJSON-84201560 tempest-QuotasTestJSON-84201560-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/a6abd93e7ccf4683a8fad44da3dc67a1" status: 200 len: 371 microversion: 2.1 time: 0.161466 Oct 24 10:40:48.929922 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1896/3701] 10.222.0.50 () {58 vars in 1242 bytes} [Mon Oct 24 10:40:48 2022] GET /compute/v2.1/os-quota-sets/a6abd93e7ccf4683a8fad44da3dc67a1 => generated 371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:48.935081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-74689145-3984-4cb4-bd76-bc5403d913c2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:48.935826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-74689145-3984-4cb4-bd76-bc5403d913c2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:48.947558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-74689145-3984-4cb4-bd76-bc5403d913c2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:48.948570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-74689145-3984-4cb4-bd76-bc5403d913c2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:48.949783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-74689145-3984-4cb4-bd76-bc5403d913c2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:48.951487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-74689145-3984-4cb4-bd76-bc5403d913c2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:48.951487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-74689145-3984-4cb4-bd76-bc5403d913c2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:48.951819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-74689145-3984-4cb4-bd76-bc5403d913c2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:49.322398 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bf600b44-5cc4-410c-969e-0490d3e96dda tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.787020 Oct 24 10:40:49.323095 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1806/3702] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:40:48 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:49.327923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a170f88e-75d4-496f-8878-325bb5bc4a85 tempest-QuotasTestJSON-84201560 tempest-QuotasTestJSON-84201560-project] Calling method '.version_select at 0x7f04d0a04040>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:49.476330 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a170f88e-75d4-496f-8878-325bb5bc4a85 tempest-QuotasTestJSON-84201560 tempest-QuotasTestJSON-84201560-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/a6abd93e7ccf4683a8fad44da3dc67a1/defaults" status: 200 len: 371 microversion: 2.1 time: 0.151321 Oct 24 10:40:49.489350 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1807/3703] 10.222.0.50 () {58 vars in 1269 bytes} [Mon Oct 24 10:40:49 2022] GET /compute/v2.1/os-quota-sets/a6abd93e7ccf4683a8fad44da3dc67a1/defaults => generated 371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:49.502209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b353bd90-64c5-41f0-b4ed-4c4e82af894e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-873201084"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:49.507481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b353bd90-64c5-41f0-b4ed-4c4e82af894e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:49.518489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b353bd90-64c5-41f0-b4ed-4c4e82af894e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:49.520056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b353bd90-64c5-41f0-b4ed-4c4e82af894e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:49.521437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b353bd90-64c5-41f0-b4ed-4c4e82af894e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:49.522636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b353bd90-64c5-41f0-b4ed-4c4e82af894e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:49.523327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b353bd90-64c5-41f0-b4ed-4c4e82af894e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:49.524015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b353bd90-64c5-41f0-b4ed-4c4e82af894e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:49.565418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-74689145-3984-4cb4-bd76-bc5403d913c2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:49.586073 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-74689145-3984-4cb4-bd76-bc5403d913c2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1314 microversion: 2.1 time: 0.646982 Oct 24 10:40:49.586767 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1897/3704] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:48 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:49.600567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-99e3ac7d-5a8b-4384-9b9f-1f6d304df4e4 tempest-QuotasTestJSON-84201560 tempest-QuotasTestJSON-84201560-project] Calling method '.version_select at 0x7f04d06fb310>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:49.733261 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-99e3ac7d-5a8b-4384-9b9f-1f6d304df4e4 tempest-QuotasTestJSON-84201560 tempest-QuotasTestJSON-84201560-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/a6abd93e7ccf4683a8fad44da3dc67a1" status: 200 len: 371 microversion: 2.1 time: 0.136350 Oct 24 10:40:49.734509 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1898/3705] 10.222.0.50 () {58 vars in 1242 bytes} [Mon Oct 24 10:40:49 2022] GET /compute/v2.1/os-quota-sets/a6abd93e7ccf4683a8fad44da3dc67a1 => generated 371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:49.754049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d49a9acf-91aa-4ba8-b20c-5390ea5b3fb7 tempest-QuotasTestJSON-84201560 tempest-QuotasTestJSON-84201560-project] Calling method '.version_select at 0x7f04d057b5e0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:49.858454 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.network.security_group_api [None req-b353bd90-64c5-41f0-b4ed-4c4e82af894e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Adding security group c61d213c-ae91-419f-b117-8b2f4b4e7741 to port d195e830-67e1-435c-98bc-d0ae1282481d Oct 24 10:40:49.930761 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d49a9acf-91aa-4ba8-b20c-5390ea5b3fb7 tempest-QuotasTestJSON-84201560 tempest-QuotasTestJSON-84201560-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/a6abd93e7ccf4683a8fad44da3dc67a1?user_id=216ce02a2d1c4b7eb4c05de61c0cd65a" status: 200 len: 371 microversion: 2.1 time: 0.185518 Oct 24 10:40:49.931377 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1899/3706] 10.222.0.50 () {58 vars in 1323 bytes} [Mon Oct 24 10:40:49 2022] GET /compute/v2.1/os-quota-sets/a6abd93e7ccf4683a8fad44da3dc67a1?user_id=216ce02a2d1c4b7eb4c05de61c0cd65a => generated 371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:49.935966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5198dc52-ff5a-4ffb-a60b-1bf1cd8c038d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:49.936585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5198dc52-ff5a-4ffb-a60b-1bf1cd8c038d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:49.967336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5198dc52-ff5a-4ffb-a60b-1bf1cd8c038d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:49.979036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5198dc52-ff5a-4ffb-a60b-1bf1cd8c038d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:49.979899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5198dc52-ff5a-4ffb-a60b-1bf1cd8c038d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:49.984408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5198dc52-ff5a-4ffb-a60b-1bf1cd8c038d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:49.985065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5198dc52-ff5a-4ffb-a60b-1bf1cd8c038d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:49.986832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5198dc52-ff5a-4ffb-a60b-1bf1cd8c038d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:50.656519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5198dc52-ff5a-4ffb-a60b-1bf1cd8c038d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:50.671755 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5198dc52-ff5a-4ffb-a60b-1bf1cd8c038d tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 200 len: 1492 microversion: 2.1 time: 0.739261 Oct 24 10:40:50.672356 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1900/3707] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:49 2022] GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 1492 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:50.984452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c372f5eb-c50e-47e2-a1c2-c05affacef7d tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Action: 'create', calling method: .version_select at 0x7f04d0563dc0>, body: {"keypair": {"name": "tempest-keypair-7872240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfaQiMH/8AnGZ4o8I1uoI06TBbVnQ/K7N4FEqGWH1u+Cae7sPq4uhto+9aMeczROqlzA9Uvkq4QZZnveic20yh70l9/6TTiwI3O2Bc9nfVlvrqbN7+UTSnGeJmVpbeX4A=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:51.012197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-c372f5eb-c50e-47e2-a1c2-c05affacef7d tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Getting quotas for project dbc29824130c410e8c2186dc5d4457c3. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:40:51.018723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-c372f5eb-c50e-47e2-a1c2-c05affacef7d tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Getting quotas for user 748e830a51c748ccaedc86a3566af1d3 and project dbc29824130c410e8c2186dc5d4457c3. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:40:51.024513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:51.064760 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c372f5eb-c50e-47e2-a1c2-c05affacef7d tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.389974 Oct 24 10:40:51.066315 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1901/3708] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:40:50 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:51.075611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-685c9ae5-932c-4caf-8cca-225966e3c121 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:51.077220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-685c9ae5-932c-4caf-8cca-225966e3c121 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:51.097041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-685c9ae5-932c-4caf-8cca-225966e3c121 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:51.098231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-685c9ae5-932c-4caf-8cca-225966e3c121 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:51.098898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-685c9ae5-932c-4caf-8cca-225966e3c121 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:51.099801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-685c9ae5-932c-4caf-8cca-225966e3c121 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:51.100578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-685c9ae5-932c-4caf-8cca-225966e3c121 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:51.101214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-685c9ae5-932c-4caf-8cca-225966e3c121 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:52.045340 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b353bd90-64c5-41f0-b4ed-4c4e82af894e tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "POST /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1/action" status: 202 len: 0 microversion: 2.1 time: 2.548158 Oct 24 10:40:52.046550 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1808/3709] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:40:49 2022] POST /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1/action => generated 0 bytes in 2550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:40:52.055827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-98356497-3c18-4e8d-8842-4a6b37c07172 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:52.056386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-98356497-3c18-4e8d-8842-4a6b37c07172 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:52.106465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98356497-3c18-4e8d-8842-4a6b37c07172 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:52.106980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98356497-3c18-4e8d-8842-4a6b37c07172 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:52.107441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98356497-3c18-4e8d-8842-4a6b37c07172 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:52.108179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98356497-3c18-4e8d-8842-4a6b37c07172 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:52.108644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98356497-3c18-4e8d-8842-4a6b37c07172 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:52.109109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98356497-3c18-4e8d-8842-4a6b37c07172 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:52.164052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-685c9ae5-932c-4caf-8cca-225966e3c121 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:52.178534 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-685c9ae5-932c-4caf-8cca-225966e3c121 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1314 microversion: 2.1 time: 1.110605 Oct 24 10:40:52.179416 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1902/3710] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:51 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1314 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:52.184515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b4a614c7-0ce8-4ff0-bb12-8e4584971a6f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-873201084"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:52.189585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-98356497-3c18-4e8d-8842-4a6b37c07172 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:40:52.194606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b4a614c7-0ce8-4ff0-bb12-8e4584971a6f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:52.216756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4a614c7-0ce8-4ff0-bb12-8e4584971a6f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:52.220170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4a614c7-0ce8-4ff0-bb12-8e4584971a6f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:52.225597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4a614c7-0ce8-4ff0-bb12-8e4584971a6f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:52.226667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4a614c7-0ce8-4ff0-bb12-8e4584971a6f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:52.228359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4a614c7-0ce8-4ff0-bb12-8e4584971a6f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:52.229115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4a614c7-0ce8-4ff0-bb12-8e4584971a6f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:52.472427 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-98356497-3c18-4e8d-8842-4a6b37c07172 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "DELETE /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 204 len: 0 microversion: 2.1 time: 0.419161 Oct 24 10:40:52.477262 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1809/3711] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:40:52 2022] DELETE /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:40:52.490972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-03bccddb-1004-4ee2-ab1c-c68a4db236a3 req-fe324e3f-0912-448d-a39d-8e2e45662f5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a4302c3-6ad2-41af-94ec-649390645fa1", "tag": "d195e830-67e1-435c-98bc-d0ae1282481d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:52.545641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-03bccddb-1004-4ee2-ab1c-c68a4db236a3 req-fe324e3f-0912-448d-a39d-8e2e45662f5a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:52.549209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-03bccddb-1004-4ee2-ab1c-c68a4db236a3 req-fe324e3f-0912-448d-a39d-8e2e45662f5a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:52.551683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-03bccddb-1004-4ee2-ab1c-c68a4db236a3 req-fe324e3f-0912-448d-a39d-8e2e45662f5a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:52.603813 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-03bccddb-1004-4ee2-ab1c-c68a4db236a3 req-fe324e3f-0912-448d-a39d-8e2e45662f5a service nova] Creating event network-changed:d195e830-67e1-435c-98bc-d0ae1282481d for instance 8a4302c3-6ad2-41af-94ec-649390645fa1 on n-h2-858383-15 Oct 24 10:40:52.619433 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-03bccddb-1004-4ee2-ab1c-c68a4db236a3 req-fe324e3f-0912-448d-a39d-8e2e45662f5a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137672 Oct 24 10:40:52.621837 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1810/3712] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:52.635424 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.network.security_group_api [None req-b4a614c7-0ce8-4ff0-bb12-8e4584971a6f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Removing security group c61d213c-ae91-419f-b117-8b2f4b4e7741 from port d195e830-67e1-435c-98bc-d0ae1282481d Oct 24 10:40:52.639844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-db47229e-40f9-4a90-8d9f-146ebdfbe398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:52.643842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-db47229e-40f9-4a90-8d9f-146ebdfbe398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:52.660215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db47229e-40f9-4a90-8d9f-146ebdfbe398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:52.661903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db47229e-40f9-4a90-8d9f-146ebdfbe398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:52.662378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db47229e-40f9-4a90-8d9f-146ebdfbe398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:52.665759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db47229e-40f9-4a90-8d9f-146ebdfbe398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:52.667940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db47229e-40f9-4a90-8d9f-146ebdfbe398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:52.669293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db47229e-40f9-4a90-8d9f-146ebdfbe398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:53.384724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-db47229e-40f9-4a90-8d9f-146ebdfbe398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:53.396957 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-db47229e-40f9-4a90-8d9f-146ebdfbe398 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 200 len: 1498 microversion: 2.1 time: 0.768823 Oct 24 10:40:53.401411 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1811/3713] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:52 2022] GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 1498 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:53.406956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2aa2b9aa-710d-4ed4-8d56-80be67a15fbc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:53.423501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2aa2b9aa-710d-4ed4-8d56-80be67a15fbc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:53.434122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aa2b9aa-710d-4ed4-8d56-80be67a15fbc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:53.435088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aa2b9aa-710d-4ed4-8d56-80be67a15fbc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:53.435753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aa2b9aa-710d-4ed4-8d56-80be67a15fbc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:53.436712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aa2b9aa-710d-4ed4-8d56-80be67a15fbc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:53.437476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aa2b9aa-710d-4ed4-8d56-80be67a15fbc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:53.438121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2aa2b9aa-710d-4ed4-8d56-80be67a15fbc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:53.893062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2aa2b9aa-710d-4ed4-8d56-80be67a15fbc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:53.906047 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2aa2b9aa-710d-4ed4-8d56-80be67a15fbc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1314 microversion: 2.1 time: 0.503007 Oct 24 10:40:53.914634 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1812/3714] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:53 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:54.046522 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b4a614c7-0ce8-4ff0-bb12-8e4584971a6f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "POST /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1/action" status: 202 len: 0 microversion: 2.1 time: 1.865781 Oct 24 10:40:54.047779 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1903/3715] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:40:52 2022] POST /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1/action => generated 0 bytes in 1867 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:40:54.064071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a34aa740-b651-4c6a-ba27-2d49ad52ea91 req-f568c37c-c556-43fc-9fc3-ff9f755a0a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6203fa6d-e5c6-45fa-9584-cfcd993b5cdf", "name": "network-vif-plugged", "status": "completed", "tag": "2a70293f-229f-41bd-aadc-1ca0206a17d9"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:54.100239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a34aa740-b651-4c6a-ba27-2d49ad52ea91 req-f568c37c-c556-43fc-9fc3-ff9f755a0a6e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:54.102841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a34aa740-b651-4c6a-ba27-2d49ad52ea91 req-f568c37c-c556-43fc-9fc3-ff9f755a0a6e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:54.103334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a34aa740-b651-4c6a-ba27-2d49ad52ea91 req-f568c37c-c556-43fc-9fc3-ff9f755a0a6e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:54.153766 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a34aa740-b651-4c6a-ba27-2d49ad52ea91 req-f568c37c-c556-43fc-9fc3-ff9f755a0a6e service nova] Creating event network-vif-plugged:2a70293f-229f-41bd-aadc-1ca0206a17d9 for instance 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf on n-h1-858383-15 Oct 24 10:40:54.165173 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a34aa740-b651-4c6a-ba27-2d49ad52ea91 req-f568c37c-c556-43fc-9fc3-ff9f755a0a6e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116091 Oct 24 10:40:54.167415 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1904/3716] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:54.182348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-49c622c3-a894-4697-bca3-500131879db2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Action: 'create', calling method: .version_select at 0x7f04d1450e50>, body: {"pool": null} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:54.263701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e3df9501-19e8-4481-ad12-5bee2c63cbd2 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] Action: 'create', calling method: .version_select at 0x7f04d0bb3c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2084084270", "metadata": {"Type": "work"}}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e3df9501-19e8-4481-ad12-5bee2c63cbd2 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] Request method failure captured: Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 122 Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmu1Ak2c1yEbGQdSI4mFXifNSEgMsLtiKZRPJiRK82AmNPxFIIItZzFkJsLB30mKv43GSxkcaVp0q-T7cr16eRlqgz4HkAoCMaxQZ9hk1be_lS6EhGpdNZ9JNSSYtRreKeCnwgVISHeSlupR6xOIjQrqOiCcr3GgcBjpFPSeBAqB36I Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4411d1ec9fb5464eb415c3bfd9fc949e Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesNegativeTest-847825062 Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4411d1ec9fb5464eb415c3bfd9fc949e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4411d1ec9fb5464eb415c3bfd9fc949e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4411d1ec9fb5464eb415c3bfd9fc949e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4411d1ec9fb5464eb415c3bfd9fc949e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-VolumesNegativeTest-847825062 Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4411d1ec9fb5464eb415c3bfd9fc949e Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesNegativeTest-847825062 Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-VolumesNegativeTest-847825062-project Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ccf253ac923a43ef95e7cdb5db2fb478 Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-VolumesNegativeTest-847825062-project Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2084084270", "metadata": {"Type": "work"}}} Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2084084270', 'metadata': {'Type': 'work'}}}} Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi '#$%' Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:40:54.268236 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:40:54.276234 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 24 10:40:54.276234 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.276234 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:54.276234 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.276234 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:54.276234 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:54.276234 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:54.276234 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:40:54.276234 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:40:54.276234 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 24 10:40:54.276234 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.276234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e3df9501-19e8-4481-ad12-5bee2c63cbd2 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:54.281936 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e3df9501-19e8-4481-ad12-5bee2c63cbd2 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.361961 Oct 24 10:40:54.282651 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1813/3717] 10.222.0.50 () {60 vars in 1156 bytes} [Mon Oct 24 10:40:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 367 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:40:54.298645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e4d0c9fb-377c-4674-860b-5613af625ce4 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] Action: 'create', calling method: .version_select at 0x7f04d0b0b820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-708993322", "metadata": {"Type": "work"}}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e4d0c9fb-377c-4674-860b-5613af625ce4 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] Request method failure captured: Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 119 Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmu1Ak2c1yEbGQdSI4mFXifNSEgMsLtiKZRPJiRK82AmNPxFIIItZzFkJsLB30mKv43GSxkcaVp0q-T7cr16eRlqgz4HkAoCMaxQZ9hk1be_lS6EhGpdNZ9JNSSYtRreKeCnwgVISHeSlupR6xOIjQrqOiCcr3GgcBjpFPSeBAqB36I Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4411d1ec9fb5464eb415c3bfd9fc949e Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesNegativeTest-847825062 Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4411d1ec9fb5464eb415c3bfd9fc949e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4411d1ec9fb5464eb415c3bfd9fc949e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4411d1ec9fb5464eb415c3bfd9fc949e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4411d1ec9fb5464eb415c3bfd9fc949e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-VolumesNegativeTest-847825062 Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4411d1ec9fb5464eb415c3bfd9fc949e Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesNegativeTest-847825062 Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-VolumesNegativeTest-847825062-project Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ccf253ac923a43ef95e7cdb5db2fb478 Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-VolumesNegativeTest-847825062-project Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-708993322", "metadata": {"Type": "work"}}} Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-708993322', 'metadata': {'Type': 'work'}}}} Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi '0' Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:40:54.318482 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:40:54.324131 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 24 10:40:54.324131 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.324131 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:54.324131 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.324131 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:54.324131 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:54.324131 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:54.324131 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:40:54.324131 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:40:54.324131 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 24 10:40:54.324131 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.324131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e4d0c9fb-377c-4674-860b-5613af625ce4 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:54.328205 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e4d0c9fb-377c-4674-860b-5613af625ce4 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.039682 Oct 24 10:40:54.329985 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1814/3718] 10.222.0.50 () {60 vars in 1156 bytes} [Mon Oct 24 10:40:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:40:54.348215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1ae8339e-84d8-4b0e-a593-f95999229cc7 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] Action: 'create', calling method: .version_select at 0x7f04d0a04c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-103369991", "metadata": {"Type": "work"}}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1ae8339e-84d8-4b0e-a593-f95999229cc7 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] Request method failure captured: Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 118 Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmu1Ak2c1yEbGQdSI4mFXifNSEgMsLtiKZRPJiRK82AmNPxFIIItZzFkJsLB30mKv43GSxkcaVp0q-T7cr16eRlqgz4HkAoCMaxQZ9hk1be_lS6EhGpdNZ9JNSSYtRreKeCnwgVISHeSlupR6xOIjQrqOiCcr3GgcBjpFPSeBAqB36I Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4411d1ec9fb5464eb415c3bfd9fc949e Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesNegativeTest-847825062 Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4411d1ec9fb5464eb415c3bfd9fc949e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4411d1ec9fb5464eb415c3bfd9fc949e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4411d1ec9fb5464eb415c3bfd9fc949e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4411d1ec9fb5464eb415c3bfd9fc949e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-VolumesNegativeTest-847825062 Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4411d1ec9fb5464eb415c3bfd9fc949e Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesNegativeTest-847825062 Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-VolumesNegativeTest-847825062-project Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ccf253ac923a43ef95e7cdb5db2fb478 Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-VolumesNegativeTest-847825062-project Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-103369991", "metadata": {"Type": "work"}}} Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-103369991', 'metadata': {'Type': 'work'}}}} Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi '' Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:40:54.352736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:40:54.358301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 24 10:40:54.358301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.358301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:54.358301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.358301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:54.358301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:54.358301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:54.358301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:40:54.358301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:40:54.358301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 24 10:40:54.358301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.377279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1ae8339e-84d8-4b0e-a593-f95999229cc7 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:54.381972 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1ae8339e-84d8-4b0e-a593-f95999229cc7 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.039374 Oct 24 10:40:54.389362 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1815/3719] 10.222.0.50 () {60 vars in 1156 bytes} [Mon Oct 24 10:40:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:40:54.407971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d2bc347c-d2e6-41e4-b01a-970a60fcedb5 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] Calling method '.version_select at 0x7f04d0ae53a0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:54.510928 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-d2bc347c-d2e6-41e4-b01a-970a60fcedb5 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] HTTP exception thrown: Volume tempest-invalid-412481559 could not be found. Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d2bc347c-d2e6-41e4-b01a-970a60fcedb5 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] Request method failure captured: Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-412481559 HTTP/1.1 Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmu1Ak2c1yEbGQdSI4mFXifNSEgMsLtiKZRPJiRK82AmNPxFIIItZzFkJsLB30mKv43GSxkcaVp0q-T7cr16eRlqgz4HkAoCMaxQZ9hk1be_lS6EhGpdNZ9JNSSYtRreKeCnwgVISHeSlupR6xOIjQrqOiCcr3GgcBjpFPSeBAqB36I Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4411d1ec9fb5464eb415c3bfd9fc949e Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesNegativeTest-847825062 Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4411d1ec9fb5464eb415c3bfd9fc949e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4411d1ec9fb5464eb415c3bfd9fc949e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4411d1ec9fb5464eb415c3bfd9fc949e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4411d1ec9fb5464eb415c3bfd9fc949e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-VolumesNegativeTest-847825062 Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4411d1ec9fb5464eb415c3bfd9fc949e Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesNegativeTest-847825062 Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-VolumesNegativeTest-847825062-project Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ccf253ac923a43ef95e7cdb5db2fb478 Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-VolumesNegativeTest-847825062-project Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: exception: Volume tempest-invalid-412481559 could not be found. Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'tempest-invalid-412481559'} Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-412481559 could not be found. (HTTP 404) (Request-ID: req-6e599a94-d1b0-4f12-9827-7041e605f754) Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 10:40:54.512754 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-412481559 could not be found. Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-412481559 could not be found. Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-412481559 could not be found. Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d2bc347c-d2e6-41e4-b01a-970a60fcedb5 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] Returning 404 to user: Volume tempest-invalid-412481559 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d2bc347c-d2e6-41e4-b01a-970a60fcedb5 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/tempest-invalid-412481559" status: 404 len: 98 microversion: 2.1 time: 0.119368 Oct 24 10:40:54.518578 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1816/3720] 10.222.0.50 () {58 vars in 1215 bytes} [Mon Oct 24 10:40:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-412481559 => generated 98 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:40:54.525390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a8ca7958-c80c-4c65-8600-88946e662109 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:54.531271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a8ca7958-c80c-4c65-8600-88946e662109 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:54.550384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8ca7958-c80c-4c65-8600-88946e662109 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:54.551118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8ca7958-c80c-4c65-8600-88946e662109 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:54.551779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8ca7958-c80c-4c65-8600-88946e662109 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:54.553770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8ca7958-c80c-4c65-8600-88946e662109 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:54.554661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8ca7958-c80c-4c65-8600-88946e662109 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:54.566469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8ca7958-c80c-4c65-8600-88946e662109 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:55.289221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a8ca7958-c80c-4c65-8600-88946e662109 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:55.311448 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a8ca7958-c80c-4c65-8600-88946e662109 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 200 len: 1498 microversion: 2.1 time: 0.794355 Oct 24 10:40:55.312459 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1817/3721] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:54 2022] GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 1498 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:55.318444 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef6a6122-7ae1-4246-9fd3-2415e3986ecc tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004155 Oct 24 10:40:55.319907 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1818/3722] 10.222.0.50 () {58 vars in 1140 bytes} [Mon Oct 24 10:40:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 24 10:40:55.325641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-0d1e1382-2c45-44aa-9b54-d351cd2a3ec5 req-76c1f5ee-dbd0-4941-8be9-779033e2d62c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a4302c3-6ad2-41af-94ec-649390645fa1", "tag": "d195e830-67e1-435c-98bc-d0ae1282481d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:55.354991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0d1e1382-2c45-44aa-9b54-d351cd2a3ec5 req-76c1f5ee-dbd0-4941-8be9-779033e2d62c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:55.355731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0d1e1382-2c45-44aa-9b54-d351cd2a3ec5 req-76c1f5ee-dbd0-4941-8be9-779033e2d62c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:55.358285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0d1e1382-2c45-44aa-9b54-d351cd2a3ec5 req-76c1f5ee-dbd0-4941-8be9-779033e2d62c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:55.375258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:55.400112 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-0d1e1382-2c45-44aa-9b54-d351cd2a3ec5 req-76c1f5ee-dbd0-4941-8be9-779033e2d62c service nova] Creating event network-changed:d195e830-67e1-435c-98bc-d0ae1282481d for instance 8a4302c3-6ad2-41af-94ec-649390645fa1 on n-h2-858383-15 Oct 24 10:40:55.443100 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-0d1e1382-2c45-44aa-9b54-d351cd2a3ec5 req-76c1f5ee-dbd0-4941-8be9-779033e2d62c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121517 Oct 24 10:40:55.444115 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1819/3723] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:55.452980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab1ad773-63b3-4f61-a372-7e86baa87f3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:55.454000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ab1ad773-63b3-4f61-a372-7e86baa87f3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:55.464221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab1ad773-63b3-4f61-a372-7e86baa87f3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:55.466775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab1ad773-63b3-4f61-a372-7e86baa87f3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:55.467163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab1ad773-63b3-4f61-a372-7e86baa87f3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:55.467901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab1ad773-63b3-4f61-a372-7e86baa87f3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:55.468367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab1ad773-63b3-4f61-a372-7e86baa87f3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:55.471412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab1ad773-63b3-4f61-a372-7e86baa87f3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:56.218449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ab1ad773-63b3-4f61-a372-7e86baa87f3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:56.251078 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ab1ad773-63b3-4f61-a372-7e86baa87f3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1314 microversion: 2.1 time: 0.798159 Oct 24 10:40:56.251764 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1820/3724] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:55 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1314 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:56.267992 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-73123661-7e43-4977-bdb2-07ec7ae9d292 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012991 Oct 24 10:40:56.268820 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1821/3725] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:40:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 24 10:40:56.300661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-858fadd3-79c5-4021-8997-9df18e071411 req-f51ab798-151e-4824-8be0-51cd05b0fa63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00f7c448-7d99-4ada-a8ba-01088ffecfd2", "name": "network-vif-deleted", "tag": "1c02e5d1-ae08-492f-b37c-15a615eca04a"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:56.332595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-858fadd3-79c5-4021-8997-9df18e071411 req-f51ab798-151e-4824-8be0-51cd05b0fa63 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:56.335916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-858fadd3-79c5-4021-8997-9df18e071411 req-f51ab798-151e-4824-8be0-51cd05b0fa63 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:56.336739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-858fadd3-79c5-4021-8997-9df18e071411 req-f51ab798-151e-4824-8be0-51cd05b0fa63 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:56.371671 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-858fadd3-79c5-4021-8997-9df18e071411 req-f51ab798-151e-4824-8be0-51cd05b0fa63 service nova] Creating event network-vif-deleted:1c02e5d1-ae08-492f-b37c-15a615eca04a for instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 on n-h2-858383-15 Oct 24 10:40:56.378041 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-858fadd3-79c5-4021-8997-9df18e071411 req-f51ab798-151e-4824-8be0-51cd05b0fa63 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091135 Oct 24 10:40:56.379213 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1822/3726] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:56.387394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9cd2bde9-94f3-4a74-81f8-f94ea9fb5778 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] Calling method '.version_select at 0x7f04d4f81ca0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:56.442200 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-9cd2bde9-94f3-4a74-81f8-f94ea9fb5778 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] HTTP exception thrown: Volume 07b00329-9e5f-453d-ac71-2e58eb1cd4ca could not be found. Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9cd2bde9-94f3-4a74-81f8-f94ea9fb5778 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] Request method failure captured: Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/os-volumes/07b00329-9e5f-453d-ac71-2e58eb1cd4ca HTTP/1.1 Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmu1Ak2c1yEbGQdSI4mFXifNSEgMsLtiKZRPJiRK82AmNPxFIIItZzFkJsLB30mKv43GSxkcaVp0q-T7cr16eRlqgz4HkAoCMaxQZ9hk1be_lS6EhGpdNZ9JNSSYtRreKeCnwgVISHeSlupR6xOIjQrqOiCcr3GgcBjpFPSeBAqB36I Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4411d1ec9fb5464eb415c3bfd9fc949e Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesNegativeTest-847825062 Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4411d1ec9fb5464eb415c3bfd9fc949e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4411d1ec9fb5464eb415c3bfd9fc949e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4411d1ec9fb5464eb415c3bfd9fc949e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4411d1ec9fb5464eb415c3bfd9fc949e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-VolumesNegativeTest-847825062 Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4411d1ec9fb5464eb415c3bfd9fc949e Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesNegativeTest-847825062 Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-VolumesNegativeTest-847825062-project Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ccf253ac923a43ef95e7cdb5db2fb478 Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-VolumesNegativeTest-847825062-project Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: exception: Volume 07b00329-9e5f-453d-ac71-2e58eb1cd4ca could not be found. Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '07b00329-9e5f-453d-ac71-2e58eb1cd4ca'} Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07b00329-9e5f-453d-ac71-2e58eb1cd4ca could not be found. (HTTP 404) (Request-ID: req-ce1cc93b-6f06-44c7-b097-b6a1f6fa27cb) Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 10:40:56.445612 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07b00329-9e5f-453d-ac71-2e58eb1cd4ca could not be found. Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07b00329-9e5f-453d-ac71-2e58eb1cd4ca could not be found. Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07b00329-9e5f-453d-ac71-2e58eb1cd4ca could not be found. Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9cd2bde9-94f3-4a74-81f8-f94ea9fb5778 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] Returning 404 to user: Volume 07b00329-9e5f-453d-ac71-2e58eb1cd4ca could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:56.451934 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9cd2bde9-94f3-4a74-81f8-f94ea9fb5778 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/07b00329-9e5f-453d-ac71-2e58eb1cd4ca" status: 404 len: 109 microversion: 2.1 time: 0.065762 Oct 24 10:40:56.459716 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1823/3727] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Oct 24 10:40:56 2022] DELETE /compute/v2.1/os-volumes/07b00329-9e5f-453d-ac71-2e58eb1cd4ca => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:40:56.464039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ac20bc9-99c3-4d0f-a722-3df139acf2e4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:56.464915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ac20bc9-99c3-4d0f-a722-3df139acf2e4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:56.482305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ac20bc9-99c3-4d0f-a722-3df139acf2e4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:56.484455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ac20bc9-99c3-4d0f-a722-3df139acf2e4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:56.486664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ac20bc9-99c3-4d0f-a722-3df139acf2e4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:56.491392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ac20bc9-99c3-4d0f-a722-3df139acf2e4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:56.491930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ac20bc9-99c3-4d0f-a722-3df139acf2e4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:56.492386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ac20bc9-99c3-4d0f-a722-3df139acf2e4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:56.598333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:40:56.615510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ac20bc9-99c3-4d0f-a722-3df139acf2e4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:56.616672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ac20bc9-99c3-4d0f-a722-3df139acf2e4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:56.617145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ac20bc9-99c3-4d0f-a722-3df139acf2e4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:56.619168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-2ac20bc9-99c3-4d0f-a722-3df139acf2e4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lazy-loading 'fault' on Instance uuid 00f7c448-7d99-4ada-a8ba-01088ffecfd2 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:40:56.770249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2ac20bc9-99c3-4d0f-a722-3df139acf2e4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7e183a1d4240f28566a318b7e70dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb78fe6939ec43d99fe6b1ba24a68287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:56.786250 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ac20bc9-99c3-4d0f-a722-3df139acf2e4 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 200 len: 1304 microversion: 2.1 time: 0.328802 Oct 24 10:40:56.807347 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1824/3728] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:56 2022] GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 1304 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:56.827284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4830b0fd-9cde-4ad7-966d-ba53237b2654 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] Calling method '.version_select at 0x7f04d4f81dc0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:56.915998 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-4830b0fd-9cde-4ad7-966d-ba53237b2654 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] HTTP exception thrown: Volume 22bd4d2c-5743-41eb-a207-66c9d03816ec could not be found. Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4830b0fd-9cde-4ad7-966d-ba53237b2654 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] Request method failure captured: Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-volumes/22bd4d2c-5743-41eb-a207-66c9d03816ec HTTP/1.1 Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmu1Ak2c1yEbGQdSI4mFXifNSEgMsLtiKZRPJiRK82AmNPxFIIItZzFkJsLB30mKv43GSxkcaVp0q-T7cr16eRlqgz4HkAoCMaxQZ9hk1be_lS6EhGpdNZ9JNSSYtRreKeCnwgVISHeSlupR6xOIjQrqOiCcr3GgcBjpFPSeBAqB36I Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4411d1ec9fb5464eb415c3bfd9fc949e Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesNegativeTest-847825062 Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4411d1ec9fb5464eb415c3bfd9fc949e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4411d1ec9fb5464eb415c3bfd9fc949e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4411d1ec9fb5464eb415c3bfd9fc949e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4411d1ec9fb5464eb415c3bfd9fc949e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-VolumesNegativeTest-847825062 Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4411d1ec9fb5464eb415c3bfd9fc949e Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesNegativeTest-847825062 Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-VolumesNegativeTest-847825062-project Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ccf253ac923a43ef95e7cdb5db2fb478 Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-VolumesNegativeTest-847825062-project Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: exception: Volume 22bd4d2c-5743-41eb-a207-66c9d03816ec could not be found. Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '22bd4d2c-5743-41eb-a207-66c9d03816ec'} Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 22bd4d2c-5743-41eb-a207-66c9d03816ec could not be found. (HTTP 404) (Request-ID: req-d05fac2d-bae0-4209-b436-0fbec2f192ba) Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 10:40:56.919519 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 22bd4d2c-5743-41eb-a207-66c9d03816ec could not be found. Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 22bd4d2c-5743-41eb-a207-66c9d03816ec could not be found. Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 22bd4d2c-5743-41eb-a207-66c9d03816ec could not be found. Oct 24 10:40:56.927650 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:56.939753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4830b0fd-9cde-4ad7-966d-ba53237b2654 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] Returning 404 to user: Volume 22bd4d2c-5743-41eb-a207-66c9d03816ec could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:56.939753 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4830b0fd-9cde-4ad7-966d-ba53237b2654 tempest-VolumesNegativeTest-847825062 tempest-VolumesNegativeTest-847825062-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/22bd4d2c-5743-41eb-a207-66c9d03816ec" status: 404 len: 109 microversion: 2.1 time: 0.120553 Oct 24 10:40:56.940608 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1825/3729] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 10:40:56 2022] GET /compute/v2.1/os-volumes/22bd4d2c-5743-41eb-a207-66c9d03816ec => generated 109 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:40:57.282491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-750864d6-8fc9-42cc-92f2-6e6ffb49fd65 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:57.283499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-750864d6-8fc9-42cc-92f2-6e6ffb49fd65 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:57.297727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-750864d6-8fc9-42cc-92f2-6e6ffb49fd65 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:57.303358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-750864d6-8fc9-42cc-92f2-6e6ffb49fd65 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:57.305364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-750864d6-8fc9-42cc-92f2-6e6ffb49fd65 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:57.306225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-750864d6-8fc9-42cc-92f2-6e6ffb49fd65 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:57.306812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-750864d6-8fc9-42cc-92f2-6e6ffb49fd65 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:57.309448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-750864d6-8fc9-42cc-92f2-6e6ffb49fd65 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:57.728477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-750864d6-8fc9-42cc-92f2-6e6ffb49fd65 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:57.748239 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-750864d6-8fc9-42cc-92f2-6e6ffb49fd65 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1501 microversion: 2.1 time: 0.473346 Oct 24 10:40:57.748857 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1826/3730] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:57 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1501 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:40:57.780140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-63605bb7-dd88-4afe-80e9-f4f49b88805a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:57.780686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-63605bb7-dd88-4afe-80e9-f4f49b88805a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:57.792760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63605bb7-dd88-4afe-80e9-f4f49b88805a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:57.795965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63605bb7-dd88-4afe-80e9-f4f49b88805a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:57.796856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63605bb7-dd88-4afe-80e9-f4f49b88805a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:57.798868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63605bb7-dd88-4afe-80e9-f4f49b88805a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:57.799578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63605bb7-dd88-4afe-80e9-f4f49b88805a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:57.800191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63605bb7-dd88-4afe-80e9-f4f49b88805a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:57.917053 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-63605bb7-dd88-4afe-80e9-f4f49b88805a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf/action" status: 202 len: 0 microversion: 2.1 time: 0.145952 Oct 24 10:40:57.918035 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1827/3731] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:40:57 2022] POST /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:40:57.949831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-857798a5-7ce0-4c56-a09c-5553b7094d5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:57.953637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-857798a5-7ce0-4c56-a09c-5553b7094d5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:57.981833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-857798a5-7ce0-4c56-a09c-5553b7094d5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:57.983688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-857798a5-7ce0-4c56-a09c-5553b7094d5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:57.984151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-857798a5-7ce0-4c56-a09c-5553b7094d5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:57.987239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-857798a5-7ce0-4c56-a09c-5553b7094d5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:57.991753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-857798a5-7ce0-4c56-a09c-5553b7094d5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:57.992348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-857798a5-7ce0-4c56-a09c-5553b7094d5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:58.027623 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-857798a5-7ce0-4c56-a09c-5553b7094d5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 could not be found. Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-857798a5-7ce0-4c56-a09c-5553b7094d5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 HTTP/1.1 Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 could not be found. Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '00f7c448-7d99-4ada-a8ba-01088ffecfd2'} Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 could not be found. Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 could not be found. Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:58.029748 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.035485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:58.035485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:58.035485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:58.035485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:58.035485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:58.035485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 could not be found. Oct 24 10:40:58.035485 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.035485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-857798a5-7ce0-4c56-a09c-5553b7094d5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:58.035485 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-857798a5-7ce0-4c56-a09c-5553b7094d5b tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 404 len: 111 microversion: 2.1 time: 0.111747 Oct 24 10:40:58.037643 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1828/3732] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:57 2022] GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:40:58.383461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-58c22e89-7b6d-405c-8b63-7943afb6b508 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Action: 'create', calling method: .version_select at 0x7f04d0d768b0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/W0T7DGCrLTpsNOMTlVThi3AaeWyvqVp4DMLuuEzc04Lh8YQrjsN8+kRxXSYaleWruRLaIGVcn8NLbKwQE4A937OCaV8eXKzkGErjc7/45s9sZhn0+pKPVfWnKUxnA9w=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-58c22e89-7b6d-405c-8b63-7943afb6b508 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Request method failure captured: Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 257 Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmu52BpLW4jGNWKsz6ipbuacI9EdgkFKugCh96LtbW17j1xOFOquKhBHHRV3iijwiQm9kxm36LJPaekywyGhkVCfAZCdXE598g4BHhfIq0RfnmGglIoE9ICVssYcJOBi7KPORyX-k7MXJ78xuJIyJBMovsbI5DCbAf6bvhoIM64koVI Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 81e6ed13d21044459ca5bd6263a30b21 Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_81e6ed13d21044459ca5bd6263a30b21", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 81e6ed13d21044459ca5bd6263a30b21 Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-KeyPairsNegativeTestJSON-355356037-project Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ddb4cd71a18847ed8b76540d212dabe5 Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-KeyPairsNegativeTestJSON-355356037-project Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/W0T7DGCrLTpsNOMTlVThi3AaeWyvqVp4DMLuuEzc04Lh8YQrjsN8+kRxXSYaleWruRLaIGVcn8NLbKwQE4A937OCaV8eXKzkGErjc7/45s9sZhn0+pKPVfWnKUxnA9w=="}} Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/W0T7DGCrLTpsNOMTlVThi3AaeWyvqVp4DMLuuEzc04Lh8YQrjsN8+kRxXSYaleWruRLaIGVcn8NLbKwQE4A937OCaV8eXKzkGErjc7/45s9sZhn0+pKPVfWnKUxnA9w=='}}} Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 24 10:40:58.391956 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-58c22e89-7b6d-405c-8b63-7943afb6b508 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-58c22e89-7b6d-405c-8b63-7943afb6b508 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.355093 Oct 24 10:40:58.402669 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1829/3733] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:40:58 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 363 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:40:58.435551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a87a5c07-42a6-4c50-a7aa-4bcdcca39c08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:58.437707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a87a5c07-42a6-4c50-a7aa-4bcdcca39c08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:58.456082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a87a5c07-42a6-4c50-a7aa-4bcdcca39c08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:58.456391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a87a5c07-42a6-4c50-a7aa-4bcdcca39c08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:58.456629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a87a5c07-42a6-4c50-a7aa-4bcdcca39c08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:58.463295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a87a5c07-42a6-4c50-a7aa-4bcdcca39c08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:58.466443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a87a5c07-42a6-4c50-a7aa-4bcdcca39c08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:58.468314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a87a5c07-42a6-4c50-a7aa-4bcdcca39c08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:58.635264 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-49c622c3-a894-4697-bca3-500131879db2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.461703 Oct 24 10:40:58.636437 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1905/3734] 10.222.0.50 () {60 vars in 1170 bytes} [Mon Oct 24 10:40:54 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:58.643266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-03ccc08b-5dd0-4b41-a9ef-1a20bc942441 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:58.643905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-03ccc08b-5dd0-4b41-a9ef-1a20bc942441 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:58.665592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03ccc08b-5dd0-4b41-a9ef-1a20bc942441 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:58.665592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03ccc08b-5dd0-4b41-a9ef-1a20bc942441 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:58.665592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03ccc08b-5dd0-4b41-a9ef-1a20bc942441 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:58.666203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03ccc08b-5dd0-4b41-a9ef-1a20bc942441 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:58.666667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03ccc08b-5dd0-4b41-a9ef-1a20bc942441 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:58.667094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03ccc08b-5dd0-4b41-a9ef-1a20bc942441 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:58.694478 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-03ccc08b-5dd0-4b41-a9ef-1a20bc942441 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 could not be found. Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-03ccc08b-5dd0-4b41-a9ef-1a20bc942441 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 HTTP/1.1 Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 could not be found. Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '00f7c448-7d99-4ada-a8ba-01088ffecfd2'} Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 could not be found. Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:40:58.696993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:40:58.702482 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 could not be found. Oct 24 10:40:58.702482 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.702482 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:58.702482 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.702482 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:58.702482 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:58.702482 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:58.702482 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:58.702482 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:58.702482 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 could not be found. Oct 24 10:40:58.702482 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.704304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-03ccc08b-5dd0-4b41-a9ef-1a20bc942441 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:58.705523 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-03ccc08b-5dd0-4b41-a9ef-1a20bc942441 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "DELETE /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 404 len: 111 microversion: 2.1 time: 0.068055 Oct 24 10:40:58.706732 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1906/3735] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:40:58 2022] DELETE /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:40:58.713859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-26139e7c-fece-4910-9fd8-351121ce3702 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Action: 'create', calling method: .version_select at 0x7f04d14505e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-727023849", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:58.768488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-26139e7c-fece-4910-9fd8-351121ce3702 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Getting quotas for project 81e6ed13d21044459ca5bd6263a30b21. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:40:58.782563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-26139e7c-fece-4910-9fd8-351121ce3702 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Getting quotas for user ddb4cd71a18847ed8b76540d212dabe5 and project 81e6ed13d21044459ca5bd6263a30b21. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:40:58.827897 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-26139e7c-fece-4910-9fd8-351121ce3702 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-26139e7c-fece-4910-9fd8-351121ce3702 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Request method failure captured: Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 2166 Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmu52BpLW4jGNWKsz6ipbuacI9EdgkFKugCh96LtbW17j1xOFOquKhBHHRV3iijwiQm9kxm36LJPaekywyGhkVCfAZCdXE598g4BHhfIq0RfnmGglIoE9ICVssYcJOBi7KPORyX-k7MXJ78xuJIyJBMovsbI5DCbAf6bvhoIM64koVI Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 81e6ed13d21044459ca5bd6263a30b21 Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_81e6ed13d21044459ca5bd6263a30b21", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 81e6ed13d21044459ca5bd6263a30b21 Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-KeyPairsNegativeTestJSON-355356037-project Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ddb4cd71a18847ed8b76540d212dabe5 Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-KeyPairsNegativeTestJSON-355356037-project Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-727023849", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:40:58.849508 n-d-858383-15 devstack@n-api.service[120426]: exception: Keypair data is invalid: failed to generate fingerprint Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-727023849', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:58.853380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-26139e7c-fece-4910-9fd8-351121ce3702 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-26139e7c-fece-4910-9fd8-351121ce3702 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.142002 Oct 24 10:40:58.856567 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1907/3736] 10.222.0.50 () {60 vars in 1160 bytes} [Mon Oct 24 10:40:58 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 10:40:58.865419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-23e5d3ef-449a-4d64-8729-1284943db410 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.162"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:58.881037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-23e5d3ef-449a-4d64-8729-1284943db410 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:58.899227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a87a5c07-42a6-4c50-a7aa-4bcdcca39c08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:40:58.901629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23e5d3ef-449a-4d64-8729-1284943db410 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:58.902823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23e5d3ef-449a-4d64-8729-1284943db410 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:58.903552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23e5d3ef-449a-4d64-8729-1284943db410 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:58.906257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23e5d3ef-449a-4d64-8729-1284943db410 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:58.910184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23e5d3ef-449a-4d64-8729-1284943db410 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:58.912897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23e5d3ef-449a-4d64-8729-1284943db410 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:58.916275 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a87a5c07-42a6-4c50-a7aa-4bcdcca39c08 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1486 microversion: 2.1 time: 0.513188 Oct 24 10:40:58.918719 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1830/3737] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:58 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1486 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:40:58.929361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d16efa56-68a0-4195-98fd-44b007748d7f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:58.931859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d16efa56-68a0-4195-98fd-44b007748d7f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 00f7c448-7d99-4ada-a8ba-01088ffecfd2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:58.949353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d16efa56-68a0-4195-98fd-44b007748d7f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:58.950237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d16efa56-68a0-4195-98fd-44b007748d7f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:58.953279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d16efa56-68a0-4195-98fd-44b007748d7f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:58.957120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d16efa56-68a0-4195-98fd-44b007748d7f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:58.957966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d16efa56-68a0-4195-98fd-44b007748d7f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:58.959604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d16efa56-68a0-4195-98fd-44b007748d7f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:58.990956 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-d16efa56-68a0-4195-98fd-44b007748d7f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 could not be found. Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d16efa56-68a0-4195-98fd-44b007748d7f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 HTTP/1.1 Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 could not be found. Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '00f7c448-7d99-4ada-a8ba-01088ffecfd2'} Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 could not be found. Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 could not be found. Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:58.993360 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:58.998933 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:58.998933 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:58.998933 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:58.998933 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:58.998933 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:58.998933 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 could not be found. Oct 24 10:40:58.998933 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:59.001292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d16efa56-68a0-4195-98fd-44b007748d7f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance 00f7c448-7d99-4ada-a8ba-01088ffecfd2 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:59.003210 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d16efa56-68a0-4195-98fd-44b007748d7f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2" status: 404 len: 111 microversion: 2.1 time: 0.081922 Oct 24 10:40:59.009125 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1831/3738] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:58 2022] GET /compute/v2.1/servers/00f7c448-7d99-4ada-a8ba-01088ffecfd2 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:40:59.017964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c4ae8e53-daac-4fa7-88d7-d41b873bbc2a tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Action: 'create', calling method: .version_select at 0x7f04d0bba550>, body: {"keypair": {"name": "tempest-keypair-509487231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5xKTLl+QFuwNSQSCT1FsRKxbJC6sPPdMnItJazKtuGsVeSWHbT6rJhAeR38vpcc7AgHwQjoaLPqTV6b4u0qCMD0nXOwnX0YQXeYOH4sKRWVNDY8SOvwyW6ng3X3HllKA=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:59.043969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c4ae8e53-daac-4fa7-88d7-d41b873bbc2a tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Getting quotas for project 81e6ed13d21044459ca5bd6263a30b21. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:40:59.050834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c4ae8e53-daac-4fa7-88d7-d41b873bbc2a tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Getting quotas for user ddb4cd71a18847ed8b76540d212dabe5 and project 81e6ed13d21044459ca5bd6263a30b21. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:40:59.055871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23e5d3ef-449a-4d64-8729-1284943db410 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "refresh_cache-8a4302c3-6ad2-41af-94ec-649390645fa1" {{(pid=120426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 10:40:59.056726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23e5d3ef-449a-4d64-8729-1284943db410 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquired lock "refresh_cache-8a4302c3-6ad2-41af-94ec-649390645fa1" {{(pid=120426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 10:40:59.122146 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c4ae8e53-daac-4fa7-88d7-d41b873bbc2a tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.110896 Oct 24 10:40:59.137591 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1832/3739] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:40:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:40:59.144545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-01a0993f-b548-497f-9edc-008db9f01910 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:59.148456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-01a0993f-b548-497f-9edc-008db9f01910 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:59.158698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01a0993f-b548-497f-9edc-008db9f01910 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:59.159504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01a0993f-b548-497f-9edc-008db9f01910 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:59.160122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01a0993f-b548-497f-9edc-008db9f01910 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:59.162527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01a0993f-b548-497f-9edc-008db9f01910 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:59.163295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01a0993f-b548-497f-9edc-008db9f01910 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:59.163919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01a0993f-b548-497f-9edc-008db9f01910 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:59.212997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-01a0993f-b548-497f-9edc-008db9f01910 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lazy-loading 'flavor' on Instance uuid 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:40:59.635756 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-01a0993f-b548-497f-9edc-008db9f01910 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf/action" status: 202 len: 0 microversion: 2.1 time: 0.496623 Oct 24 10:40:59.636632 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1833/3740] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:40:59 2022] POST /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:40:59.642953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf160d9b-af8c-44a5-89e8-a062a234b293 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:59.644683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf160d9b-af8c-44a5-89e8-a062a234b293 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:59.660243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf160d9b-af8c-44a5-89e8-a062a234b293 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:59.661153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf160d9b-af8c-44a5-89e8-a062a234b293 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:59.661957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf160d9b-af8c-44a5-89e8-a062a234b293 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:59.662913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf160d9b-af8c-44a5-89e8-a062a234b293 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:59.663718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf160d9b-af8c-44a5-89e8-a062a234b293 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:59.664826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf160d9b-af8c-44a5-89e8-a062a234b293 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:59.701937 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-cf160d9b-af8c-44a5-89e8-a062a234b293 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance 81f9e553-a2d6-4c33-8f37-2cd23977137a could not be found. Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf160d9b-af8c-44a5-89e8-a062a234b293 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a HTTP/1.1 Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 81f9e553-a2d6-4c33-8f37-2cd23977137a could not be found. Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '81f9e553-a2d6-4c33-8f37-2cd23977137a'} Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81f9e553-a2d6-4c33-8f37-2cd23977137a could not be found. Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:40:59.704375 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:40:59.712898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81f9e553-a2d6-4c33-8f37-2cd23977137a could not be found. Oct 24 10:40:59.712898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:59.712898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:59.712898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:59.712898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:59.712898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:59.712898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:59.712898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:59.712898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:59.712898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81f9e553-a2d6-4c33-8f37-2cd23977137a could not be found. Oct 24 10:40:59.712898 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:59.715378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf160d9b-af8c-44a5-89e8-a062a234b293 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance 81f9e553-a2d6-4c33-8f37-2cd23977137a could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:59.716386 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf160d9b-af8c-44a5-89e8-a062a234b293 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "DELETE /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 404 len: 111 microversion: 2.1 time: 0.078208 Oct 24 10:40:59.718617 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1834/3741] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:40:59 2022] DELETE /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:40:59.724973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2c21a7b1-1553-4ab2-ab70-b566d29e196e tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Action: 'create', calling method: .version_select at 0x7f04d0f09a60>, body: {"keypair": {"name": "tempest-keypair-509487231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0xiIEoX70YmjrR4bwkkRBV3XOU1KIHMPJU8kcNYkteFesA6HSPI4zoywX7dLcrp/uHS35B0+ILqnPC+m8i6Ssa1MRhrg1k+iV/Oaib/LYjw/uKBmxcwdWDBmWvWMiXiw=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:40:59.742143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-2c21a7b1-1553-4ab2-ab70-b566d29e196e tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Getting quotas for project 81e6ed13d21044459ca5bd6263a30b21. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:40:59.748603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-2c21a7b1-1553-4ab2-ab70-b566d29e196e tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Getting quotas for user ddb4cd71a18847ed8b76540d212dabe5 and project 81e6ed13d21044459ca5bd6263a30b21. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:40:59.785257 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-2c21a7b1-1553-4ab2-ab70-b566d29e196e tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] HTTP exception thrown: Key pair 'tempest-keypair-509487231' already exists. Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2c21a7b1-1553-4ab2-ab70-b566d29e196e tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Request method failure captured: Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 272 Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmu52BpLW4jGNWKsz6ipbuacI9EdgkFKugCh96LtbW17j1xOFOquKhBHHRV3iijwiQm9kxm36LJPaekywyGhkVCfAZCdXE598g4BHhfIq0RfnmGglIoE9ICVssYcJOBi7KPORyX-k7MXJ78xuJIyJBMovsbI5DCbAf6bvhoIM64koVI Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 81e6ed13d21044459ca5bd6263a30b21 Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_81e6ed13d21044459ca5bd6263a30b21", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 81e6ed13d21044459ca5bd6263a30b21 Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-KeyPairsNegativeTestJSON-355356037-project Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ddb4cd71a18847ed8b76540d212dabe5 Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-KeyPairsNegativeTestJSON-355356037-project Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: {"keypair": {"name": "tempest-keypair-509487231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0xiIEoX70YmjrR4bwkkRBV3XOU1KIHMPJU8kcNYkteFesA6HSPI4zoywX7dLcrp/uHS35B0+ILqnPC+m8i6Ssa1MRhrg1k+iV/Oaib/LYjw/uKBmxcwdWDBmWvWMiXiw=="}} Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: exception: Key pair 'tempest-keypair-509487231' already exists. Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-509487231', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0xiIEoX70YmjrR4bwkkRBV3XOU1KIHMPJU8kcNYkteFesA6HSPI4zoywX7dLcrp/uHS35B0+ILqnPC+m8i6Ssa1MRhrg1k+iV/Oaib/LYjw/uKBmxcwdWDBmWvWMiXiw=='}}} Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result.read() Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'ddb4cd71a18847ed8b76540d212dabe5-tempest-keypair-509487231' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 24 10:40:59.798443 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi session.flush() Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result.read() Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 24 10:40:59.803930 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'ddb4cd71a18847ed8b76540d212dabe5-tempest-keypair-509487231' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 24, 10, 40, 59, 774927), 'updated_at': None, 'name': 'tempest-keypair-509487231', 'user_id': 'ddb4cd71a18847ed8b76540d212dabe5', 'fingerprint': '0e:8f:e5:f0:10:22:37:1b:77:1a:5a:dd:0b:3d:ec:20', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0xiIEoX70YmjrR4bwkkRBV3XOU1KIHMPJU8kcNYkteFesA6HSPI4zoywX7dLcrp/uHS35B0+ILqnPC+m8i6Ssa1MRhrg1k+iV/Oaib/LYjw/uKBmxcwdWDBmWvWMiXiw==', 'type': 'ssh'}] Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6780, in import_key_pair Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi keypair.create() Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._create() Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-509487231' already exists. Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 24 10:40:59.809578 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-509487231' already exists. Oct 24 10:40:59.815024 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:59.815024 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:40:59.815024 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:59.815024 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:40:59.815024 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:40:59.815024 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:40:59.815024 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:40:59.815024 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:40:59.815024 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-509487231' already exists. Oct 24 10:40:59.815024 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:40:59.815024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2c21a7b1-1553-4ab2-ab70-b566d29e196e tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Returning 409 to user: Key pair 'tempest-keypair-509487231' already exists. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:40:59.815024 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2c21a7b1-1553-4ab2-ab70-b566d29e196e tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.090507 Oct 24 10:40:59.815024 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1835/3742] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:40:59 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:40:59.822003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5074ad39-2c8c-4829-aef5-c034ebffbbd7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:40:59.822003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5074ad39-2c8c-4829-aef5-c034ebffbbd7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:40:59.828967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5074ad39-2c8c-4829-aef5-c034ebffbbd7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:59.829460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5074ad39-2c8c-4829-aef5-c034ebffbbd7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:59.829898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5074ad39-2c8c-4829-aef5-c034ebffbbd7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:40:59.830606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5074ad39-2c8c-4829-aef5-c034ebffbbd7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:40:59.831064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5074ad39-2c8c-4829-aef5-c034ebffbbd7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:40:59.831498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5074ad39-2c8c-4829-aef5-c034ebffbbd7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:00.494455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5074ad39-2c8c-4829-aef5-c034ebffbbd7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:00.506904 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5074ad39-2c8c-4829-aef5-c034ebffbbd7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1492 microversion: 2.1 time: 0.689596 Oct 24 10:41:00.516987 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1836/3743] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:40:59 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1492 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:00.524714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0bfe05f-92e1-4cae-bc1e-c310c43e547f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:00.526149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f0bfe05f-92e1-4cae-bc1e-c310c43e547f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 81f9e553-a2d6-4c33-8f37-2cd23977137a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:00.535723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0bfe05f-92e1-4cae-bc1e-c310c43e547f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:00.537462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0bfe05f-92e1-4cae-bc1e-c310c43e547f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:00.538243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0bfe05f-92e1-4cae-bc1e-c310c43e547f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:00.539446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0bfe05f-92e1-4cae-bc1e-c310c43e547f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:00.540326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0bfe05f-92e1-4cae-bc1e-c310c43e547f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:00.541845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0bfe05f-92e1-4cae-bc1e-c310c43e547f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:00.562972 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-f0bfe05f-92e1-4cae-bc1e-c310c43e547f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance 81f9e553-a2d6-4c33-8f37-2cd23977137a could not be found. Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0bfe05f-92e1-4cae-bc1e-c310c43e547f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a HTTP/1.1 Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 81f9e553-a2d6-4c33-8f37-2cd23977137a could not be found. Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '81f9e553-a2d6-4c33-8f37-2cd23977137a'} Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81f9e553-a2d6-4c33-8f37-2cd23977137a could not be found. Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81f9e553-a2d6-4c33-8f37-2cd23977137a could not be found. Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.565043 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.569968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.569968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:00.569968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:00.569968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:00.569968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:00.569968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81f9e553-a2d6-4c33-8f37-2cd23977137a could not be found. Oct 24 10:41:00.569968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.571982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0bfe05f-92e1-4cae-bc1e-c310c43e547f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance 81f9e553-a2d6-4c33-8f37-2cd23977137a could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:00.573313 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f0bfe05f-92e1-4cae-bc1e-c310c43e547f tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a" status: 404 len: 111 microversion: 2.1 time: 0.054327 Oct 24 10:41:00.575939 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1837/3744] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:00 2022] GET /compute/v2.1/servers/81f9e553-a2d6-4c33-8f37-2cd23977137a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:41:00.582715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b8ecdb10-781c-418b-9e55-989a16410255 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Calling method '.version_select at 0x7f04d0254f70>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:00.613125 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b8ecdb10-781c-418b-9e55-989a16410255 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-509487231" status: 202 len: 0 microversion: 2.1 time: 0.035528 Oct 24 10:41:00.614997 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1838/3745] 10.222.0.50 () {58 vars in 1218 bytes} [Mon Oct 24 10:41:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-509487231 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:41:00.620265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cead651c-2203-459b-9dc7-937533bd4833 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:00.620773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cead651c-2203-459b-9dc7-937533bd4833 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:00.629794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cead651c-2203-459b-9dc7-937533bd4833 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:00.630577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cead651c-2203-459b-9dc7-937533bd4833 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:00.631631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cead651c-2203-459b-9dc7-937533bd4833 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:00.632704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cead651c-2203-459b-9dc7-937533bd4833 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:00.633727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cead651c-2203-459b-9dc7-937533bd4833 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:00.634371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cead651c-2203-459b-9dc7-937533bd4833 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:00.654096 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-cead651c-2203-459b-9dc7-937533bd4833 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance 18d4c883-f34d-4326-8505-2d66bd047dc8 could not be found. Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cead651c-2203-459b-9dc7-937533bd4833 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 HTTP/1.1 Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 18d4c883-f34d-4326-8505-2d66bd047dc8 could not be found. Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '18d4c883-f34d-4326-8505-2d66bd047dc8'} Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d4c883-f34d-4326-8505-2d66bd047dc8 could not be found. Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:41:00.656366 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:41:00.660777 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d4c883-f34d-4326-8505-2d66bd047dc8 could not be found. Oct 24 10:41:00.660777 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.660777 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.660777 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.660777 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.660777 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:00.660777 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:00.660777 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:00.660777 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:00.660777 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d4c883-f34d-4326-8505-2d66bd047dc8 could not be found. Oct 24 10:41:00.660777 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.664040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cead651c-2203-459b-9dc7-937533bd4833 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance 18d4c883-f34d-4326-8505-2d66bd047dc8 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:00.665420 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cead651c-2203-459b-9dc7-937533bd4833 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "DELETE /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 404 len: 111 microversion: 2.1 time: 0.048889 Oct 24 10:41:00.666560 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1839/3746] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:41:00 2022] DELETE /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:41:00.672101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0cdcab85-b51f-41f2-bb23-6601fa4f8558 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Action: 'create', calling method: .version_select at 0x7f04d0254ca0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlwz0SgPKFn2RvP38sUsEHqeIxtC+qUgl6TZFn9robJ0SKu214o9PwBf4Aen4rGlKvlWR0jeP2L3o/vNWoIv/wnIQt/LnG413Xcf7Mn7oHFkqvU9Nns+nP7RyQrmHbPeg=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0cdcab85-b51f-41f2-bb23-6601fa4f8558 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Request method failure captured: Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 247 Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmu52BpLW4jGNWKsz6ipbuacI9EdgkFKugCh96LtbW17j1xOFOquKhBHHRV3iijwiQm9kxm36LJPaekywyGhkVCfAZCdXE598g4BHhfIq0RfnmGglIoE9ICVssYcJOBi7KPORyX-k7MXJ78xuJIyJBMovsbI5DCbAf6bvhoIM64koVI Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 81e6ed13d21044459ca5bd6263a30b21 Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_81e6ed13d21044459ca5bd6263a30b21", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 81e6ed13d21044459ca5bd6263a30b21 Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-KeyPairsNegativeTestJSON-355356037-project Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ddb4cd71a18847ed8b76540d212dabe5 Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-KeyPairsNegativeTestJSON-355356037-project Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlwz0SgPKFn2RvP38sUsEHqeIxtC+qUgl6TZFn9robJ0SKu214o9PwBf4Aen4rGlKvlWR0jeP2L3o/vNWoIv/wnIQt/LnG413Xcf7Mn7oHFkqvU9Nns+nP7RyQrmHbPeg=="}} Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlwz0SgPKFn2RvP38sUsEHqeIxtC+qUgl6TZFn9robJ0SKu214o9PwBf4Aen4rGlKvlWR0jeP2L3o/vNWoIv/wnIQt/LnG413Xcf7Mn7oHFkqvU9Nns+nP7RyQrmHbPeg=='}}} Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi '' Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:41:00.676720 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:41:00.682381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:41:00.682381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:41:00.682381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:41:00.682381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:41:00.682381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 24 10:41:00.682381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.682381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.682381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.682381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.682381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:00.682381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:00.682381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:41:00.682381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:41:00.682381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 24 10:41:00.682381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.684346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0cdcab85-b51f-41f2-bb23-6601fa4f8558 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:00.684503 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0cdcab85-b51f-41f2-bb23-6601fa4f8558 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.016595 Oct 24 10:41:00.687566 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1840/3747] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:41:00 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:41:00.701429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-29b7944c-7c5a-4a27-bb52-a67491bde009 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:00.702305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-29b7944c-7c5a-4a27-bb52-a67491bde009 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 18d4c883-f34d-4326-8505-2d66bd047dc8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:00.713117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29b7944c-7c5a-4a27-bb52-a67491bde009 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:00.713977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29b7944c-7c5a-4a27-bb52-a67491bde009 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:00.714643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29b7944c-7c5a-4a27-bb52-a67491bde009 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:00.716695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29b7944c-7c5a-4a27-bb52-a67491bde009 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:00.717430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29b7944c-7c5a-4a27-bb52-a67491bde009 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:00.718106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29b7944c-7c5a-4a27-bb52-a67491bde009 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:00.740217 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-29b7944c-7c5a-4a27-bb52-a67491bde009 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance 18d4c883-f34d-4326-8505-2d66bd047dc8 could not be found. Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-29b7944c-7c5a-4a27-bb52-a67491bde009 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 HTTP/1.1 Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 18d4c883-f34d-4326-8505-2d66bd047dc8 could not be found. Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '18d4c883-f34d-4326-8505-2d66bd047dc8'} Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d4c883-f34d-4326-8505-2d66bd047dc8 could not be found. Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d4c883-f34d-4326-8505-2d66bd047dc8 could not be found. Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.743144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.748655 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.748655 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:00.748655 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:00.748655 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:00.748655 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:00.748655 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d4c883-f34d-4326-8505-2d66bd047dc8 could not be found. Oct 24 10:41:00.748655 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.751961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-29b7944c-7c5a-4a27-bb52-a67491bde009 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance 18d4c883-f34d-4326-8505-2d66bd047dc8 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:00.753530 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-29b7944c-7c5a-4a27-bb52-a67491bde009 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8" status: 404 len: 111 microversion: 2.1 time: 0.064958 Oct 24 10:41:00.754912 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1841/3748] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:00 2022] GET /compute/v2.1/servers/18d4c883-f34d-4326-8505-2d66bd047dc8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:41:00.761888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-89826915-6c45-46dc-9ad3-31749de6593e tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Action: 'create', calling method: .version_select at 0x7f04d0c9b0d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-681084545", "public_key": " "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:00.781194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-89826915-6c45-46dc-9ad3-31749de6593e tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Getting quotas for project 81e6ed13d21044459ca5bd6263a30b21. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:41:00.788278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-89826915-6c45-46dc-9ad3-31749de6593e tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Getting quotas for user ddb4cd71a18847ed8b76540d212dabe5 and project 81e6ed13d21044459ca5bd6263a30b21. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:41:00.811224 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-89826915-6c45-46dc-9ad3-31749de6593e tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-89826915-6c45-46dc-9ad3-31749de6593e tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Request method failure captured: Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 94 Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmu52BpLW4jGNWKsz6ipbuacI9EdgkFKugCh96LtbW17j1xOFOquKhBHHRV3iijwiQm9kxm36LJPaekywyGhkVCfAZCdXE598g4BHhfIq0RfnmGglIoE9ICVssYcJOBi7KPORyX-k7MXJ78xuJIyJBMovsbI5DCbAf6bvhoIM64koVI Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 81e6ed13d21044459ca5bd6263a30b21 Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_81e6ed13d21044459ca5bd6263a30b21", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 81e6ed13d21044459ca5bd6263a30b21 Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-KeyPairsNegativeTestJSON-355356037-project Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ddb4cd71a18847ed8b76540d212dabe5 Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-KeyPairsNegativeTestJSON-355356037-project Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-681084545", "public_key": " "}} Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: exception: Keypair data is invalid: failed to generate fingerprint Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-681084545', 'public_key': ' '}}} Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.814245 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-89826915-6c45-46dc-9ad3-31749de6593e tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-89826915-6c45-46dc-9ad3-31749de6593e tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.059392 Oct 24 10:41:00.820586 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1842/3749] 10.222.0.50 () {60 vars in 1158 bytes} [Mon Oct 24 10:41:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 10:41:00.829746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-36e4c20c-3c2a-4ce2-a638-4502ec9b6f45 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:00.831788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-36e4c20c-3c2a-4ce2-a638-4502ec9b6f45 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:00.838882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36e4c20c-3c2a-4ce2-a638-4502ec9b6f45 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:00.839328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36e4c20c-3c2a-4ce2-a638-4502ec9b6f45 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:00.839776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36e4c20c-3c2a-4ce2-a638-4502ec9b6f45 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:00.840497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36e4c20c-3c2a-4ce2-a638-4502ec9b6f45 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:00.841513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36e4c20c-3c2a-4ce2-a638-4502ec9b6f45 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:00.841969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36e4c20c-3c2a-4ce2-a638-4502ec9b6f45 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:00.857870 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-36e4c20c-3c2a-4ce2-a638-4502ec9b6f45 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance 431e0a67-61ff-4331-bebc-5f382784f7af could not be found. Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-36e4c20c-3c2a-4ce2-a638-4502ec9b6f45 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af HTTP/1.1 Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 431e0a67-61ff-4331-bebc-5f382784f7af could not be found. Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '431e0a67-61ff-4331-bebc-5f382784f7af'} Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 431e0a67-61ff-4331-bebc-5f382784f7af could not be found. Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:41:00.859983 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:41:00.868496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 431e0a67-61ff-4331-bebc-5f382784f7af could not be found. Oct 24 10:41:00.868496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.868496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.868496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.868496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.868496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:00.868496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:00.868496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:00.868496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:00.868496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 431e0a67-61ff-4331-bebc-5f382784f7af could not be found. Oct 24 10:41:00.868496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.868496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-36e4c20c-3c2a-4ce2-a638-4502ec9b6f45 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance 431e0a67-61ff-4331-bebc-5f382784f7af could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:00.868496 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-36e4c20c-3c2a-4ce2-a638-4502ec9b6f45 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "DELETE /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 404 len: 111 microversion: 2.1 time: 0.044305 Oct 24 10:41:00.868496 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1843/3750] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:41:00 2022] DELETE /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:41:00.868496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-055f84f0-35ac-48a2-9a04-b7b1e94f0393 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Action: 'create', calling method: .version_select at 0x7f04d0ca1160>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlhGYlHh7qOY/k2Uqk5+nBs3KmQE/zeNQt6zFkDoBTyfCd9P9EIz4dLAXtb+FHsxDf5mqW9VDMPodD2Eb742ae84x5QFLrJIIDD37FKUgDqkmD5lAN4zIGLlCJ1Z6JSrQ=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-055f84f0-35ac-48a2-9a04-b7b1e94f0393 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Request method failure captured: Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 507 Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmu52BpLW4jGNWKsz6ipbuacI9EdgkFKugCh96LtbW17j1xOFOquKhBHHRV3iijwiQm9kxm36LJPaekywyGhkVCfAZCdXE598g4BHhfIq0RfnmGglIoE9ICVssYcJOBi7KPORyX-k7MXJ78xuJIyJBMovsbI5DCbAf6bvhoIM64koVI Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 81e6ed13d21044459ca5bd6263a30b21 Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_81e6ed13d21044459ca5bd6263a30b21", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 81e6ed13d21044459ca5bd6263a30b21 Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-KeyPairsNegativeTestJSON-355356037-project Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ddb4cd71a18847ed8b76540d212dabe5 Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-KeyPairsNegativeTestJSON-355356037-project Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlhGYlHh7qOY/k2Uqk5+nBs3KmQE/zeNQt6zFkDoBTyfCd9P9EIz4dLAXtb+FHsxDf5mqW9VDMPodD2Eb742ae84x5QFLrJIIDD37FKUgDqkmD5lAN4zIGLlCJ1Z6JSrQ=="}} Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlhGYlHh7qOY/k2Uqk5+nBs3KmQE/zeNQt6zFkDoBTyfCd9P9EIz4dLAXtb+FHsxDf5mqW9VDMPodD2Eb742ae84x5QFLrJIIDD37FKUgDqkmD5lAN4zIGLlCJ1Z6JSrQ=='}}} Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 24 10:41:00.871952 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-055f84f0-35ac-48a2-9a04-b7b1e94f0393 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-055f84f0-35ac-48a2-9a04-b7b1e94f0393 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.010533 Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1844/3751] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:41:00 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:41:00.880992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-66b205ca-55b2-491c-a4fc-f53786ca8e5e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:00.884874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-66b205ca-55b2-491c-a4fc-f53786ca8e5e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 431e0a67-61ff-4331-bebc-5f382784f7af] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:00.888571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66b205ca-55b2-491c-a4fc-f53786ca8e5e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:00.889094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66b205ca-55b2-491c-a4fc-f53786ca8e5e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:00.889540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66b205ca-55b2-491c-a4fc-f53786ca8e5e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:00.890250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66b205ca-55b2-491c-a4fc-f53786ca8e5e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:00.890711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66b205ca-55b2-491c-a4fc-f53786ca8e5e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:00.891258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66b205ca-55b2-491c-a4fc-f53786ca8e5e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:00.913339 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-66b205ca-55b2-491c-a4fc-f53786ca8e5e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance 431e0a67-61ff-4331-bebc-5f382784f7af could not be found. Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-66b205ca-55b2-491c-a4fc-f53786ca8e5e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af HTTP/1.1 Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 431e0a67-61ff-4331-bebc-5f382784f7af could not be found. Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '431e0a67-61ff-4331-bebc-5f382784f7af'} Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 431e0a67-61ff-4331-bebc-5f382784f7af could not be found. Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 431e0a67-61ff-4331-bebc-5f382784f7af could not be found. Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.915162 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.919705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.919705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:00.919705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:00.919705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:00.919705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:00.919705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 431e0a67-61ff-4331-bebc-5f382784f7af could not be found. Oct 24 10:41:00.919705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.919705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-66b205ca-55b2-491c-a4fc-f53786ca8e5e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance 431e0a67-61ff-4331-bebc-5f382784f7af could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:00.919705 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-66b205ca-55b2-491c-a4fc-f53786ca8e5e tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af" status: 404 len: 111 microversion: 2.1 time: 0.041482 Oct 24 10:41:00.920674 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1845/3752] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:00 2022] GET /compute/v2.1/servers/431e0a67-61ff-4331-bebc-5f382784f7af => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:41:00.926689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2f484816-f1a0-49b7-94ad-c846556d9207 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Action: 'create', calling method: .version_select at 0x7f04d0254a60>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1867194947", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:00.961454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-2f484816-f1a0-49b7-94ad-c846556d9207 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Getting quotas for project 81e6ed13d21044459ca5bd6263a30b21. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:41:00.967256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-2f484816-f1a0-49b7-94ad-c846556d9207 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Getting quotas for user ddb4cd71a18847ed8b76540d212dabe5 and project 81e6ed13d21044459ca5bd6263a30b21. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:41:00.986100 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-2f484816-f1a0-49b7-94ad-c846556d9207 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2f484816-f1a0-49b7-94ad-c846556d9207 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Request method failure captured: Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 118 Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmu52BpLW4jGNWKsz6ipbuacI9EdgkFKugCh96LtbW17j1xOFOquKhBHHRV3iijwiQm9kxm36LJPaekywyGhkVCfAZCdXE598g4BHhfIq0RfnmGglIoE9ICVssYcJOBi7KPORyX-k7MXJ78xuJIyJBMovsbI5DCbAf6bvhoIM64koVI Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 81e6ed13d21044459ca5bd6263a30b21 Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_81e6ed13d21044459ca5bd6263a30b21", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 81e6ed13d21044459ca5bd6263a30b21 Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-KeyPairsNegativeTestJSON-355356037-project Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ddb4cd71a18847ed8b76540d212dabe5 Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-KeyPairsNegativeTestJSON-355356037-project Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1867194947", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: exception: Keypair data is invalid: failed to generate fingerprint Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1867194947', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 24 10:41:00.989939 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2f484816-f1a0-49b7-94ad-c846556d9207 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2f484816-f1a0-49b7-94ad-c846556d9207 tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.069701 Oct 24 10:41:00.994873 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1846/3753] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:41:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 10:41:01.000974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1dee8e24-64ca-4fb8-abc3-f790ca7fa6c9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:01.001584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1dee8e24-64ca-4fb8-abc3-f790ca7fa6c9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 0ffa8f50-8adf-4345-a522-82987d57b4d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:01.016212 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-1dee8e24-64ca-4fb8-abc3-f790ca7fa6c9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 could not be found. Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1dee8e24-64ca-4fb8-abc3-f790ca7fa6c9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/0ffa8f50-8adf-4345-a522-82987d57b4d1 HTTP/1.1 Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 could not be found. Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '0ffa8f50-8adf-4345-a522-82987d57b4d1'} Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 could not be found. Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 could not be found. Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:01.018807 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:01.024509 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:01.024509 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:01.024509 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:01.024509 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:01.024509 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:01.024509 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:01.024509 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 could not be found. Oct 24 10:41:01.024509 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:01.024509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1dee8e24-64ca-4fb8-abc3-f790ca7fa6c9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:01.025297 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1dee8e24-64ca-4fb8-abc3-f790ca7fa6c9 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0ffa8f50-8adf-4345-a522-82987d57b4d1" status: 404 len: 111 microversion: 2.1 time: 0.030006 Oct 24 10:41:01.025933 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1847/3754] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:41:00 2022] DELETE /compute/v2.1/servers/0ffa8f50-8adf-4345-a522-82987d57b4d1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:41:01.031677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68ce596e-8d35-4583-abe8-3c887c82a78c tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Calling method '.version_select at 0x7f04cbc02af0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:01.057577 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-68ce596e-8d35-4583-abe8-3c887c82a78c tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1248139557 not found for user ddb4cd71a18847ed8b76540d212dabe5 Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68ce596e-8d35-4583-abe8-3c887c82a78c tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Request method failure captured: Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1248139557 HTTP/1.1 Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmu52BpLW4jGNWKsz6ipbuacI9EdgkFKugCh96LtbW17j1xOFOquKhBHHRV3iijwiQm9kxm36LJPaekywyGhkVCfAZCdXE598g4BHhfIq0RfnmGglIoE9ICVssYcJOBi7KPORyX-k7MXJ78xuJIyJBMovsbI5DCbAf6bvhoIM64koVI Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 81e6ed13d21044459ca5bd6263a30b21 Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/81e6ed13d21044459ca5bd6263a30b21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_81e6ed13d21044459ca5bd6263a30b21", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 81e6ed13d21044459ca5bd6263a30b21 Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-355356037 Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-KeyPairsNegativeTestJSON-355356037-project Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ddb4cd71a18847ed8b76540d212dabe5 Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-KeyPairsNegativeTestJSON-355356037-project Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: exception: Keypair tempest-keypair-non-existent-1248139557 not found for user ddb4cd71a18847ed8b76540d212dabe5 Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'tempest-keypair-non-existent-1248139557'} Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise self.value Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6864, in delete_key_pair Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6885, in get_key_pair Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1248139557 not found for user ddb4cd71a18847ed8b76540d212dabe5 Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:01.069297 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1248139557 not found for user ddb4cd71a18847ed8b76540d212dabe5 Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1248139557 not found for user ddb4cd71a18847ed8b76540d212dabe5 Oct 24 10:41:01.073872 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:01.077563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68ce596e-8d35-4583-abe8-3c887c82a78c tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1248139557 not found for user ddb4cd71a18847ed8b76540d212dabe5 {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:01.078837 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-68ce596e-8d35-4583-abe8-3c887c82a78c tempest-KeyPairsNegativeTestJSON-355356037 tempest-KeyPairsNegativeTestJSON-355356037-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1248139557" status: 404 len: 145 microversion: 2.1 time: 0.052061 Oct 24 10:41:01.079647 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1848/3755] 10.222.0.50 () {58 vars in 1260 bytes} [Mon Oct 24 10:41:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1248139557 => generated 145 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:41:01.086269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-03209e3c-7f6c-4b1e-b1f5-4a41e39e1466 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:01.087120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-03209e3c-7f6c-4b1e-b1f5-4a41e39e1466 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 0ffa8f50-8adf-4345-a522-82987d57b4d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:01.094796 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-03209e3c-7f6c-4b1e-b1f5-4a41e39e1466 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 could not be found. Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-03209e3c-7f6c-4b1e-b1f5-4a41e39e1466 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/0ffa8f50-8adf-4345-a522-82987d57b4d1 HTTP/1.1 Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 could not be found. Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '0ffa8f50-8adf-4345-a522-82987d57b4d1'} Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 could not be found. Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 could not be found. Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:01.096593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:01.102475 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:01.102475 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:01.102475 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:01.102475 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 could not be found. Oct 24 10:41:01.102475 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:01.104697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-03209e3c-7f6c-4b1e-b1f5-4a41e39e1466 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance 0ffa8f50-8adf-4345-a522-82987d57b4d1 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:01.105821 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-03209e3c-7f6c-4b1e-b1f5-4a41e39e1466 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/0ffa8f50-8adf-4345-a522-82987d57b4d1" status: 404 len: 111 microversion: 2.1 time: 0.024242 Oct 24 10:41:01.106939 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1849/3756] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:01 2022] GET /compute/v2.1/servers/0ffa8f50-8adf-4345-a522-82987d57b4d1 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:41:01.404548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-23e5d3ef-449a-4d64-8729-1284943db410 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Building network info cache for instance {{(pid=120426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 10:41:01.426489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b06f23c7-aa1c-4063-8bc7-78dc113951e5 req-04d7b217-b610-478b-b0f0-6f7ebb2a30cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a4302c3-6ad2-41af-94ec-649390645fa1", "tag": "d195e830-67e1-435c-98bc-d0ae1282481d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:01.443873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b06f23c7-aa1c-4063-8bc7-78dc113951e5 req-04d7b217-b610-478b-b0f0-6f7ebb2a30cd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:01.444647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b06f23c7-aa1c-4063-8bc7-78dc113951e5 req-04d7b217-b610-478b-b0f0-6f7ebb2a30cd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:01.445320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b06f23c7-aa1c-4063-8bc7-78dc113951e5 req-04d7b217-b610-478b-b0f0-6f7ebb2a30cd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:01.468398 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b06f23c7-aa1c-4063-8bc7-78dc113951e5 req-04d7b217-b610-478b-b0f0-6f7ebb2a30cd service nova] Creating event network-changed:d195e830-67e1-435c-98bc-d0ae1282481d for instance 8a4302c3-6ad2-41af-94ec-649390645fa1 on n-h2-858383-15 Oct 24 10:41:01.478157 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b06f23c7-aa1c-4063-8bc7-78dc113951e5 req-04d7b217-b610-478b-b0f0-6f7ebb2a30cd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053705 Oct 24 10:41:01.480950 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1850/3757] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:41:01.530365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-70489bc6-7fd4-4532-a93a-853820b86d17 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:01.532125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-70489bc6-7fd4-4532-a93a-853820b86d17 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:01.565935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70489bc6-7fd4-4532-a93a-853820b86d17 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:01.572024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70489bc6-7fd4-4532-a93a-853820b86d17 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:01.575037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70489bc6-7fd4-4532-a93a-853820b86d17 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:01.582542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70489bc6-7fd4-4532-a93a-853820b86d17 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:01.583379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70489bc6-7fd4-4532-a93a-853820b86d17 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:01.588445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70489bc6-7fd4-4532-a93a-853820b86d17 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:02.652703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-70489bc6-7fd4-4532-a93a-853820b86d17 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:02.664480 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-70489bc6-7fd4-4532-a93a-853820b86d17 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1513 microversion: 2.1 time: 1.138522 Oct 24 10:41:02.680087 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1851/3758] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:01 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1513 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:03.203615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-23e5d3ef-449a-4d64-8729-1284943db410 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Updating instance_info_cache with network_info: [{"id": "d195e830-67e1-435c-98bc-d0ae1282481d", "address": "fa:16:3e:7c:2a:85", "network": {"id": "2f404f10-8852-4540-8970-2699670e99c9", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-769113359-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f906dc4e8ae44a1c8af9906fc14e28b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd195e830-67", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 10:41:03.217167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23e5d3ef-449a-4d64-8729-1284943db410 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Releasing lock "refresh_cache-8a4302c3-6ad2-41af-94ec-649390645fa1" {{(pid=120426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 10:41:03.224506 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-23e5d3ef-449a-4d64-8729-1284943db410 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "POST /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1/action" status: 202 len: 0 microversion: 2.1 time: 4.371580 Oct 24 10:41:03.225644 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1908/3759] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:40:58 2022] POST /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1/action => generated 0 bytes in 4374 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 24 10:41:03.234380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-56453b48-32aa-4531-aa87-21ca2573da26 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.162"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:03.619731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-56453b48-32aa-4531-aa87-21ca2573da26 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:03.629197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56453b48-32aa-4531-aa87-21ca2573da26 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:03.631911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56453b48-32aa-4531-aa87-21ca2573da26 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:03.632868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56453b48-32aa-4531-aa87-21ca2573da26 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:03.637528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56453b48-32aa-4531-aa87-21ca2573da26 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:03.638883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56453b48-32aa-4531-aa87-21ca2573da26 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:03.640260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56453b48-32aa-4531-aa87-21ca2573da26 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:03.694894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c2e7f7ff-95c3-4c18-b76b-997b2925ae55 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:03.696486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c2e7f7ff-95c3-4c18-b76b-997b2925ae55 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:03.718125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2e7f7ff-95c3-4c18-b76b-997b2925ae55 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:03.722609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2e7f7ff-95c3-4c18-b76b-997b2925ae55 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:03.723378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2e7f7ff-95c3-4c18-b76b-997b2925ae55 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:03.726963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2e7f7ff-95c3-4c18-b76b-997b2925ae55 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:03.730240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2e7f7ff-95c3-4c18-b76b-997b2925ae55 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:03.733419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2e7f7ff-95c3-4c18-b76b-997b2925ae55 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:04.271669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c2e7f7ff-95c3-4c18-b76b-997b2925ae55 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:04.291135 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c2e7f7ff-95c3-4c18-b76b-997b2925ae55 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1513 microversion: 2.1 time: 0.603375 Oct 24 10:41:04.292324 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1909/3760] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:03 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1513 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:41:04.550754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56453b48-32aa-4531-aa87-21ca2573da26 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "refresh_cache-8a4302c3-6ad2-41af-94ec-649390645fa1" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 10:41:04.553244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56453b48-32aa-4531-aa87-21ca2573da26 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquired lock "refresh_cache-8a4302c3-6ad2-41af-94ec-649390645fa1" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 10:41:05.339488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-14a77ad2-ae89-474d-aec2-c27a94b8a2c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:05.340121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-14a77ad2-ae89-474d-aec2-c27a94b8a2c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:05.369277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14a77ad2-ae89-474d-aec2-c27a94b8a2c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:05.369791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14a77ad2-ae89-474d-aec2-c27a94b8a2c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:05.378542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14a77ad2-ae89-474d-aec2-c27a94b8a2c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:05.382220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14a77ad2-ae89-474d-aec2-c27a94b8a2c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:05.383202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14a77ad2-ae89-474d-aec2-c27a94b8a2c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:05.386202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14a77ad2-ae89-474d-aec2-c27a94b8a2c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:05.821994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-14a77ad2-ae89-474d-aec2-c27a94b8a2c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:05.832608 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-14a77ad2-ae89-474d-aec2-c27a94b8a2c1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1513 microversion: 2.1 time: 0.515516 Oct 24 10:41:05.836687 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1910/3761] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:05 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1513 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:06.860627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-966f0c77-4a60-4fed-8960-988de59424d8 tempest-AbsoluteLimitsNegativeTestJSON-238264029 tempest-AbsoluteLimitsNegativeTestJSON-238264029-project] Calling method '.version_select at 0x7f04d085fca0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:06.915818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-966f0c77-4a60-4fed-8960-988de59424d8 tempest-AbsoluteLimitsNegativeTestJSON-238264029 tempest-AbsoluteLimitsNegativeTestJSON-238264029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:06.925684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-966f0c77-4a60-4fed-8960-988de59424d8 tempest-AbsoluteLimitsNegativeTestJSON-238264029 tempest-AbsoluteLimitsNegativeTestJSON-238264029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:06.927266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-966f0c77-4a60-4fed-8960-988de59424d8 tempest-AbsoluteLimitsNegativeTestJSON-238264029 tempest-AbsoluteLimitsNegativeTestJSON-238264029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:06.932033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-966f0c77-4a60-4fed-8960-988de59424d8 tempest-AbsoluteLimitsNegativeTestJSON-238264029 tempest-AbsoluteLimitsNegativeTestJSON-238264029-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:06.933250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-966f0c77-4a60-4fed-8960-988de59424d8 tempest-AbsoluteLimitsNegativeTestJSON-238264029 tempest-AbsoluteLimitsNegativeTestJSON-238264029-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:06.941323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-966f0c77-4a60-4fed-8960-988de59424d8 tempest-AbsoluteLimitsNegativeTestJSON-238264029 tempest-AbsoluteLimitsNegativeTestJSON-238264029-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:06.999385 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-966f0c77-4a60-4fed-8960-988de59424d8 tempest-AbsoluteLimitsNegativeTestJSON-238264029 tempest-AbsoluteLimitsNegativeTestJSON-238264029-project] 10.222.0.50 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.868587 Oct 24 10:41:07.002851 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1911/3762] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Oct 24 10:41:06 2022] GET /compute/v2.1/limits => generated 511 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:41:07.016766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1b6917fd-6cc6-4eb2-91ea-526d1c4d4455 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:07.018122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1b6917fd-6cc6-4eb2-91ea-526d1c4d4455 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:07.032860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b6917fd-6cc6-4eb2-91ea-526d1c4d4455 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:07.038104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b6917fd-6cc6-4eb2-91ea-526d1c4d4455 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:07.039779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b6917fd-6cc6-4eb2-91ea-526d1c4d4455 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:07.040936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b6917fd-6cc6-4eb2-91ea-526d1c4d4455 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:07.041632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b6917fd-6cc6-4eb2-91ea-526d1c4d4455 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:07.042657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b6917fd-6cc6-4eb2-91ea-526d1c4d4455 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:07.501493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-56453b48-32aa-4531-aa87-21ca2573da26 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Building network info cache for instance {{(pid=120425) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 24 10:41:08.196211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1b6917fd-6cc6-4eb2-91ea-526d1c4d4455 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:08.206233 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1b6917fd-6cc6-4eb2-91ea-526d1c4d4455 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1508 microversion: 2.1 time: 1.201929 Oct 24 10:41:08.212933 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1912/3763] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:07 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1508 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:08.218305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-38e50407-0750-4fda-87db-ba065d159909 req-accdefa5-084c-45fb-9dc8-cf71286185bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6203fa6d-e5c6-45fa-9584-cfcd993b5cdf", "name": "network-vif-plugged", "status": "completed", "tag": "2a70293f-229f-41bd-aadc-1ca0206a17d9"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:08.262967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-38e50407-0750-4fda-87db-ba065d159909 req-accdefa5-084c-45fb-9dc8-cf71286185bf service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:08.269565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-38e50407-0750-4fda-87db-ba065d159909 req-accdefa5-084c-45fb-9dc8-cf71286185bf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:08.271890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-38e50407-0750-4fda-87db-ba065d159909 req-accdefa5-084c-45fb-9dc8-cf71286185bf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:08.309859 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-38e50407-0750-4fda-87db-ba065d159909 req-accdefa5-084c-45fb-9dc8-cf71286185bf service nova] Creating event network-vif-plugged:2a70293f-229f-41bd-aadc-1ca0206a17d9 for instance 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf on n-h1-858383-15 Oct 24 10:41:08.323835 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-38e50407-0750-4fda-87db-ba065d159909 req-accdefa5-084c-45fb-9dc8-cf71286185bf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108714 Oct 24 10:41:08.327350 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1913/3764] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:41:08.338975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2e78d10d-719b-4d8b-bd5e-2ecf02bd99ad tempest-AbsoluteLimitsNegativeTestJSON-238264029 tempest-AbsoluteLimitsNegativeTestJSON-238264029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2032432496", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:09.249256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-56453b48-32aa-4531-aa87-21ca2573da26 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Updating instance_info_cache with network_info: [{"id": "d195e830-67e1-435c-98bc-d0ae1282481d", "address": "fa:16:3e:7c:2a:85", "network": {"id": "2f404f10-8852-4540-8970-2699670e99c9", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-769113359-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f906dc4e8ae44a1c8af9906fc14e28b1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd195e830-67", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120425) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 10:41:09.272656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56453b48-32aa-4531-aa87-21ca2573da26 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Releasing lock "refresh_cache-8a4302c3-6ad2-41af-94ec-649390645fa1" {{(pid=120425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 10:41:09.276375 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-56453b48-32aa-4531-aa87-21ca2573da26 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "POST /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1/action" status: 202 len: 0 microversion: 2.1 time: 6.046005 Oct 24 10:41:09.285403 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1852/3765] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:41:03 2022] POST /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1/action => generated 0 bytes in 6056 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 24 10:41:09.311034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-cfae1af9-1c06-4251-9d58-1b9dcd211393 req-11fcd2a8-4509-40c3-b265-8864919cb32b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a4302c3-6ad2-41af-94ec-649390645fa1", "tag": "d195e830-67e1-435c-98bc-d0ae1282481d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:09.357364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cfae1af9-1c06-4251-9d58-1b9dcd211393 req-11fcd2a8-4509-40c3-b265-8864919cb32b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:09.361998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cfae1af9-1c06-4251-9d58-1b9dcd211393 req-11fcd2a8-4509-40c3-b265-8864919cb32b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:09.368578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cfae1af9-1c06-4251-9d58-1b9dcd211393 req-11fcd2a8-4509-40c3-b265-8864919cb32b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:09.397513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:41:09.423350 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-cfae1af9-1c06-4251-9d58-1b9dcd211393 req-11fcd2a8-4509-40c3-b265-8864919cb32b service nova] Creating event network-changed:d195e830-67e1-435c-98bc-d0ae1282481d for instance 8a4302c3-6ad2-41af-94ec-649390645fa1 on n-h2-858383-15 Oct 24 10:41:09.448532 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-cfae1af9-1c06-4251-9d58-1b9dcd211393 req-11fcd2a8-4509-40c3-b265-8864919cb32b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158777 Oct 24 10:41:09.460890 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1853/3766] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:41:09.481506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-55fb1396-6deb-4a18-a947-a8482eb7f536 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:09.485673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-55fb1396-6deb-4a18-a947-a8482eb7f536 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:09.534523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-55fb1396-6deb-4a18-a947-a8482eb7f536 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:09.535084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-55fb1396-6deb-4a18-a947-a8482eb7f536 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:09.535592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-55fb1396-6deb-4a18-a947-a8482eb7f536 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:09.544636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-55fb1396-6deb-4a18-a947-a8482eb7f536 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:09.545159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-55fb1396-6deb-4a18-a947-a8482eb7f536 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:09.548393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-55fb1396-6deb-4a18-a947-a8482eb7f536 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:09.615218 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-55fb1396-6deb-4a18-a947-a8482eb7f536 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-55fb1396-6deb-4a18-a947-a8482eb7f536 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b HTTP/1.1 Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b'} Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:41:09.623097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:41:09.630112 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:41:09.630112 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:09.630112 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:09.630112 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:09.630112 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:09.630112 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:09.630112 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:09.630112 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:09.630112 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:09.630112 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:41:09.630112 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:09.630112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-55fb1396-6deb-4a18-a947-a8482eb7f536 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:09.630112 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-55fb1396-6deb-4a18-a947-a8482eb7f536 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "DELETE /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 404 len: 111 microversion: 2.1 time: 0.162556 Oct 24 10:41:09.632485 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1854/3767] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:41:09 2022] DELETE /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:41:09.664712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-49416cbb-5d41-40e5-affb-86b76e49b907 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:09.665764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-49416cbb-5d41-40e5-affb-86b76e49b907 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:09.697180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49416cbb-5d41-40e5-affb-86b76e49b907 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:09.698070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49416cbb-5d41-40e5-affb-86b76e49b907 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:09.698824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49416cbb-5d41-40e5-affb-86b76e49b907 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:09.700352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49416cbb-5d41-40e5-affb-86b76e49b907 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:09.700828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49416cbb-5d41-40e5-affb-86b76e49b907 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:09.703161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49416cbb-5d41-40e5-affb-86b76e49b907 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:10.158579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-49416cbb-5d41-40e5-affb-86b76e49b907 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:10.181430 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-49416cbb-5d41-40e5-affb-86b76e49b907 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1508 microversion: 2.1 time: 0.534528 Oct 24 10:41:10.183006 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1855/3768] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:09 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1508 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:10.199518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b7549507-0e90-44ca-a78c-94762aa8c4d9 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '.version_select at 0x7f04d02ca8b0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:10.975978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=16 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:41:11.827170 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b7549507-0e90-44ca-a78c-94762aa8c4d9 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/62c0e66b-92d4-4fb1-ac22-69e69325e03b" status: 202 len: 0 microversion: 2.1 time: 1.639726 Oct 24 10:41:11.831401 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1856/3769] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:41:10 2022] DELETE /compute/v2.1/os-floating-ips/62c0e66b-92d4-4fb1-ac22-69e69325e03b => generated 0 bytes in 1641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:41:11.835679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7b0989ce-10be-45ff-b71d-3b58fb556fce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:11.836311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7b0989ce-10be-45ff-b71d-3b58fb556fce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:11.849721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b0989ce-10be-45ff-b71d-3b58fb556fce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:11.850367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b0989ce-10be-45ff-b71d-3b58fb556fce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:11.851408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b0989ce-10be-45ff-b71d-3b58fb556fce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:11.854366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b0989ce-10be-45ff-b71d-3b58fb556fce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:11.855177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b0989ce-10be-45ff-b71d-3b58fb556fce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:11.856067 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b0989ce-10be-45ff-b71d-3b58fb556fce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:11.878732 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-7b0989ce-10be-45ff-b71d-3b58fb556fce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7b0989ce-10be-45ff-b71d-3b58fb556fce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b HTTP/1.1 Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b'} Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:11.881119 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:11.885965 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:11.885965 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:11.885965 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:11.885965 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:11.885965 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:11.885965 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. Oct 24 10:41:11.885965 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:11.888251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7b0989ce-10be-45ff-b71d-3b58fb556fce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:11.889388 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7b0989ce-10be-45ff-b71d-3b58fb556fce tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b" status: 404 len: 111 microversion: 2.1 time: 0.060360 Oct 24 10:41:11.890265 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1857/3770] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:11 2022] GET /compute/v2.1/servers/afbe96da-2d4d-4dc4-9f4f-558cb8e42f6b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:41:11.896934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9066ec89-e0dd-4381-aa44-62adbc2d1257 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:11.899206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9066ec89-e0dd-4381-aa44-62adbc2d1257 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:11.924289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9066ec89-e0dd-4381-aa44-62adbc2d1257 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:11.924795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9066ec89-e0dd-4381-aa44-62adbc2d1257 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:11.925270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9066ec89-e0dd-4381-aa44-62adbc2d1257 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:11.925989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9066ec89-e0dd-4381-aa44-62adbc2d1257 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:11.926457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9066ec89-e0dd-4381-aa44-62adbc2d1257 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:11.926931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9066ec89-e0dd-4381-aa44-62adbc2d1257 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:12.360742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9066ec89-e0dd-4381-aa44-62adbc2d1257 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:12.399456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9066ec89-e0dd-4381-aa44-62adbc2d1257 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:12.405416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9066ec89-e0dd-4381-aa44-62adbc2d1257 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:12.408696 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9066ec89-e0dd-4381-aa44-62adbc2d1257 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 2945 microversion: 2.32 time: 0.517262 Oct 24 10:41:12.411812 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1858/3771] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:41:11 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 2945 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:41:12.423786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e3ecba6d-82fb-4e7f-b261-bb21d5e1ebed tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:12.425724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e3ecba6d-82fb-4e7f-b261-bb21d5e1ebed tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:12.446089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3ecba6d-82fb-4e7f-b261-bb21d5e1ebed tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:12.449086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3ecba6d-82fb-4e7f-b261-bb21d5e1ebed tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:12.450704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3ecba6d-82fb-4e7f-b261-bb21d5e1ebed tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:12.453568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3ecba6d-82fb-4e7f-b261-bb21d5e1ebed tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:12.454862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3ecba6d-82fb-4e7f-b261-bb21d5e1ebed tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:12.457204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3ecba6d-82fb-4e7f-b261-bb21d5e1ebed tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:12.754581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e3ecba6d-82fb-4e7f-b261-bb21d5e1ebed tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:12.775120 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e3ecba6d-82fb-4e7f-b261-bb21d5e1ebed tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1508 microversion: 2.1 time: 0.360803 Oct 24 10:41:12.776970 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1859/3772] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:12 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1508 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:12.794323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ba9b6204-e828-4701-ab58-eb5fd32215eb tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '.version_select at 0x7f04d02ca9d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:13.226922 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ba9b6204-e828-4701-ab58-eb5fd32215eb tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/c61d213c-ae91-419f-b117-8b2f4b4e7741" status: 202 len: 0 microversion: 2.1 time: 0.446779 Oct 24 10:41:13.227898 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1860/3773] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:41:12 2022] DELETE /compute/v2.1/os-security-groups/c61d213c-ae91-419f-b117-8b2f4b4e7741 => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:41:13.234835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80995e85-78d0-49b8-b8b7-d4827c56b67c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:13.236644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-80995e85-78d0-49b8-b8b7-d4827c56b67c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:13.241244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:41:13.275730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80995e85-78d0-49b8-b8b7-d4827c56b67c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:13.277042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80995e85-78d0-49b8-b8b7-d4827c56b67c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:13.278487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80995e85-78d0-49b8-b8b7-d4827c56b67c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:13.285782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80995e85-78d0-49b8-b8b7-d4827c56b67c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:13.287336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80995e85-78d0-49b8-b8b7-d4827c56b67c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:13.288512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80995e85-78d0-49b8-b8b7-d4827c56b67c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:13.363316 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-80995e85-78d0-49b8-b8b7-d4827c56b67c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 could not be found. Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80995e85-78d0-49b8-b8b7-d4827c56b67c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 HTTP/1.1 Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 could not be found. Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '04f00dc8-0ba7-47ad-8ed1-28b0643335b1'} Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 could not be found. Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:41:13.369308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:41:13.374869 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 could not be found. Oct 24 10:41:13.374869 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:13.374869 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:13.374869 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:13.374869 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:13.374869 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:13.374869 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:13.374869 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:13.374869 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:13.374869 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 could not be found. Oct 24 10:41:13.374869 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:13.378590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80995e85-78d0-49b8-b8b7-d4827c56b67c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:13.379360 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-80995e85-78d0-49b8-b8b7-d4827c56b67c tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "DELETE /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 404 len: 111 microversion: 2.1 time: 0.149455 Oct 24 10:41:13.380450 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1861/3774] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:41:13 2022] DELETE /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:41:13.385719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-009394e2-41f9-4b4e-b568-d680dd17797d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:13.386447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-009394e2-41f9-4b4e-b568-d680dd17797d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:13.394716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-009394e2-41f9-4b4e-b568-d680dd17797d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:13.396801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-009394e2-41f9-4b4e-b568-d680dd17797d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:13.397814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-009394e2-41f9-4b4e-b568-d680dd17797d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:13.399388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-009394e2-41f9-4b4e-b568-d680dd17797d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:13.401726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-009394e2-41f9-4b4e-b568-d680dd17797d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:13.402377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-009394e2-41f9-4b4e-b568-d680dd17797d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:13.616374 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-009394e2-41f9-4b4e-b568-d680dd17797d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.234538 Oct 24 10:41:13.617036 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1862/3775] 10.222.0.50 () {60 vars in 1316 bytes} [Mon Oct 24 10:41:13 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946/os-interface => generated 1829 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:41:13.621705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb61a898-7132-420c-a174-f520303391a2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:13.622358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bb61a898-7132-420c-a174-f520303391a2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:13.630168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb61a898-7132-420c-a174-f520303391a2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:13.631270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb61a898-7132-420c-a174-f520303391a2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:13.632125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb61a898-7132-420c-a174-f520303391a2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:13.633136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb61a898-7132-420c-a174-f520303391a2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:13.633821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb61a898-7132-420c-a174-f520303391a2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:13.634435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb61a898-7132-420c-a174-f520303391a2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:13.674312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bb61a898-7132-420c-a174-f520303391a2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:41:13.830358 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bb61a898-7132-420c-a174-f520303391a2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 204 len: 0 microversion: 2.1 time: 0.211241 Oct 24 10:41:13.832071 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1863/3776] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:41:13 2022] DELETE /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:41:13.847276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e73d4c2-1095-406c-88bc-e0af22137455 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:13.847999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e73d4c2-1095-406c-88bc-e0af22137455 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] [instance: 04f00dc8-0ba7-47ad-8ed1-28b0643335b1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:13.861605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e73d4c2-1095-406c-88bc-e0af22137455 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:13.862125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e73d4c2-1095-406c-88bc-e0af22137455 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:13.862692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e73d4c2-1095-406c-88bc-e0af22137455 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:13.863545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e73d4c2-1095-406c-88bc-e0af22137455 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:13.864391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e73d4c2-1095-406c-88bc-e0af22137455 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:13.864810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e73d4c2-1095-406c-88bc-e0af22137455 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:13.885971 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-1e73d4c2-1095-406c-88bc-e0af22137455 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] HTTP exception thrown: Instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 could not be found. Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e73d4c2-1095-406c-88bc-e0af22137455 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Request method failure captured: Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 HTTP/1.1 Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmpriukdIgWNW0yfB7I79Cm3cxlF97P_xKNOVT3oHVMZvmnOIh357nAsPp4JmOy7fh-dbP6pUCHXWAQSNx-DHVlKF-7vi5f3_aPQtN78WaEAUCKm0LEWi74czCP9sRfoLpzlVJEps59MsgikHH4_SzPXfBhsAvv8NMJoexhOl3gft6g Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eb78fe6939ec43d99fe6b1ba24a68287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eb78fe6939ec43d99fe6b1ba24a68287", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: eb78fe6939ec43d99fe6b1ba24a68287 Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131568969 Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2a7e183a1d4240f28566a318b7e70dee Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-2131568969-project Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 could not be found. Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '04f00dc8-0ba7-47ad-8ed1-28b0643335b1'} Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 could not be found. Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 could not be found. Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:13.887717 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:13.892968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:13.892968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:13.892968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:13.892968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:13.892968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:13.892968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 could not be found. Oct 24 10:41:13.892968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:13.894886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e73d4c2-1095-406c-88bc-e0af22137455 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] Returning 404 to user: Instance 04f00dc8-0ba7-47ad-8ed1-28b0643335b1 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:13.896561 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1e73d4c2-1095-406c-88bc-e0af22137455 tempest-DeleteServersTestJSON-2131568969 tempest-DeleteServersTestJSON-2131568969-project] 10.222.0.50 "GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1" status: 404 len: 111 microversion: 2.1 time: 0.059001 Oct 24 10:41:13.898387 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1864/3777] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:13 2022] GET /compute/v2.1/servers/04f00dc8-0ba7-47ad-8ed1-28b0643335b1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:41:13.904331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-687f9aab-71b2-42cc-a8e3-d6b4d73aaa19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:13.905253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-687f9aab-71b2-42cc-a8e3-d6b4d73aaa19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:13.934085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-687f9aab-71b2-42cc-a8e3-d6b4d73aaa19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:13.938696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-687f9aab-71b2-42cc-a8e3-d6b4d73aaa19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:13.941795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-687f9aab-71b2-42cc-a8e3-d6b4d73aaa19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:13.943535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-687f9aab-71b2-42cc-a8e3-d6b4d73aaa19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:13.946883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-687f9aab-71b2-42cc-a8e3-d6b4d73aaa19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:13.947778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-687f9aab-71b2-42cc-a8e3-d6b4d73aaa19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:14.215000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-687f9aab-71b2-42cc-a8e3-d6b4d73aaa19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:14.234153 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-687f9aab-71b2-42cc-a8e3-d6b4d73aaa19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1508 microversion: 2.1 time: 0.334039 Oct 24 10:41:14.237380 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1865/3778] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:13 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1508 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:14.247023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-94081a96-9109-4883-8833-ed8c501f55b1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:14.248091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-94081a96-9109-4883-8833-ed8c501f55b1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:14.272577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94081a96-9109-4883-8833-ed8c501f55b1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:14.273543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94081a96-9109-4883-8833-ed8c501f55b1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:14.274745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94081a96-9109-4883-8833-ed8c501f55b1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:14.277157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94081a96-9109-4883-8833-ed8c501f55b1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:14.280235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94081a96-9109-4883-8833-ed8c501f55b1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:14.282026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-94081a96-9109-4883-8833-ed8c501f55b1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:14.788608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-94081a96-9109-4883-8833-ed8c501f55b1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:14.803900 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-94081a96-9109-4883-8833-ed8c501f55b1 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1509 microversion: 2.1 time: 0.559227 Oct 24 10:41:14.804481 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1866/3779] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:14 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1509 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:15.262025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fb0b8351-2ea6-48d5-8767-3ab8893da4fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:15.262960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fb0b8351-2ea6-48d5-8767-3ab8893da4fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:15.272549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb0b8351-2ea6-48d5-8767-3ab8893da4fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:15.274094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb0b8351-2ea6-48d5-8767-3ab8893da4fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:15.274502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb0b8351-2ea6-48d5-8767-3ab8893da4fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:15.278663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb0b8351-2ea6-48d5-8767-3ab8893da4fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:15.280513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb0b8351-2ea6-48d5-8767-3ab8893da4fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:15.282083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb0b8351-2ea6-48d5-8767-3ab8893da4fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:15.629347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fb0b8351-2ea6-48d5-8767-3ab8893da4fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:15.646347 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fb0b8351-2ea6-48d5-8767-3ab8893da4fd tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1508 microversion: 2.1 time: 0.387955 Oct 24 10:41:15.647724 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1867/3780] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:15 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1508 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:41:15.830597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-844301dc-20c9-4a17-a742-a08f71378bf2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:15.832692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-844301dc-20c9-4a17-a742-a08f71378bf2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:15.852620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-844301dc-20c9-4a17-a742-a08f71378bf2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:15.855918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-844301dc-20c9-4a17-a742-a08f71378bf2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:15.858516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-844301dc-20c9-4a17-a742-a08f71378bf2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:15.865956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-844301dc-20c9-4a17-a742-a08f71378bf2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:15.867847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-844301dc-20c9-4a17-a742-a08f71378bf2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:15.873063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-844301dc-20c9-4a17-a742-a08f71378bf2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:16.342014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-844301dc-20c9-4a17-a742-a08f71378bf2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:16.358537 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-844301dc-20c9-4a17-a742-a08f71378bf2 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1509 microversion: 2.1 time: 0.532795 Oct 24 10:41:16.366417 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1868/3781] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:15 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1509 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:16.673377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c206b153-e92b-4c50-a070-1ba7260f3a02 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:16.674008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c206b153-e92b-4c50-a070-1ba7260f3a02 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:16.686171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c206b153-e92b-4c50-a070-1ba7260f3a02 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:16.686664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c206b153-e92b-4c50-a070-1ba7260f3a02 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:16.687099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c206b153-e92b-4c50-a070-1ba7260f3a02 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:16.688067 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c206b153-e92b-4c50-a070-1ba7260f3a02 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:16.690986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c206b153-e92b-4c50-a070-1ba7260f3a02 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:16.691671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c206b153-e92b-4c50-a070-1ba7260f3a02 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:16.905182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=18 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:41:16.970716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:41:17.651078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c206b153-e92b-4c50-a070-1ba7260f3a02 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:17.661514 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c206b153-e92b-4c50-a070-1ba7260f3a02 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1508 microversion: 2.1 time: 0.993074 Oct 24 10:41:17.668965 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1869/3782] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:16 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1508 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:17.674542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8f73ccc0-0e1f-4f68-8056-484731eb629f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:17.679590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8f73ccc0-0e1f-4f68-8056-484731eb629f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:17.708862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f73ccc0-0e1f-4f68-8056-484731eb629f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:17.709958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f73ccc0-0e1f-4f68-8056-484731eb629f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:17.712453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f73ccc0-0e1f-4f68-8056-484731eb629f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:17.716148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f73ccc0-0e1f-4f68-8056-484731eb629f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:17.716867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f73ccc0-0e1f-4f68-8056-484731eb629f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:17.720479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f73ccc0-0e1f-4f68-8056-484731eb629f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:17.818784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f73ccc0-0e1f-4f68-8056-484731eb629f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:17.819285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f73ccc0-0e1f-4f68-8056-484731eb629f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:17.819761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f73ccc0-0e1f-4f68-8056-484731eb629f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:17.820280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-8f73ccc0-0e1f-4f68-8056-484731eb629f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lazy-loading 'fault' on Instance uuid 8a4302c3-6ad2-41af-94ec-649390645fa1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:41:17.970903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8f73ccc0-0e1f-4f68-8056-484731eb629f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c4584d7b5948358fef63edcf40667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906dc4e8ae44a1c8af9906fc14e28b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:17.990477 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8f73ccc0-0e1f-4f68-8056-484731eb629f tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 200 len: 1313 microversion: 2.1 time: 0.326163 Oct 24 10:41:18.015272 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1870/3783] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:17 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:18.032820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-53e22920-f5eb-423d-9fba-fd97902ae6f3 req-717a7e2c-1cfe-418e-bd27-f65a96306936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4302c3-6ad2-41af-94ec-649390645fa1", "name": "network-vif-deleted", "tag": "d195e830-67e1-435c-98bc-d0ae1282481d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:18.073597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-53e22920-f5eb-423d-9fba-fd97902ae6f3 req-717a7e2c-1cfe-418e-bd27-f65a96306936 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:18.075750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-53e22920-f5eb-423d-9fba-fd97902ae6f3 req-717a7e2c-1cfe-418e-bd27-f65a96306936 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:18.077485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-53e22920-f5eb-423d-9fba-fd97902ae6f3 req-717a7e2c-1cfe-418e-bd27-f65a96306936 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:18.097883 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-53e22920-f5eb-423d-9fba-fd97902ae6f3 req-717a7e2c-1cfe-418e-bd27-f65a96306936 service nova] Creating event network-vif-deleted:d195e830-67e1-435c-98bc-d0ae1282481d for instance 8a4302c3-6ad2-41af-94ec-649390645fa1 on n-h2-858383-15 Oct 24 10:41:18.111984 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-53e22920-f5eb-423d-9fba-fd97902ae6f3 req-717a7e2c-1cfe-418e-bd27-f65a96306936 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083885 Oct 24 10:41:18.113611 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1871/3784] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:41:18.310193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=71,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:41:18.376684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:41:18.689119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-609f73ae-925e-419c-ba6c-65a96eee473a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:18.690670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-609f73ae-925e-419c-ba6c-65a96eee473a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:18.710147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-609f73ae-925e-419c-ba6c-65a96eee473a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:18.714240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-609f73ae-925e-419c-ba6c-65a96eee473a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:18.714918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-609f73ae-925e-419c-ba6c-65a96eee473a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:18.715855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-609f73ae-925e-419c-ba6c-65a96eee473a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:18.716513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-609f73ae-925e-419c-ba6c-65a96eee473a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:18.719078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-609f73ae-925e-419c-ba6c-65a96eee473a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:19.199561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-609f73ae-925e-419c-ba6c-65a96eee473a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:19.219196 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-609f73ae-925e-419c-ba6c-65a96eee473a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1508 microversion: 2.1 time: 0.535813 Oct 24 10:41:19.227085 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1872/3785] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:18 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1508 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:41:19.241523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-92fc3982-e0ee-4237-b029-e8b4731a3573 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:19.242175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-92fc3982-e0ee-4237-b029-e8b4731a3573 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] [instance: 8a4302c3-6ad2-41af-94ec-649390645fa1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:19.259428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92fc3982-e0ee-4237-b029-e8b4731a3573 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:19.259923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92fc3982-e0ee-4237-b029-e8b4731a3573 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:19.260368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92fc3982-e0ee-4237-b029-e8b4731a3573 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:19.261117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92fc3982-e0ee-4237-b029-e8b4731a3573 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:19.261582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92fc3982-e0ee-4237-b029-e8b4731a3573 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:19.262014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92fc3982-e0ee-4237-b029-e8b4731a3573 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:19.280433 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-92fc3982-e0ee-4237-b029-e8b4731a3573 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] HTTP exception thrown: Instance 8a4302c3-6ad2-41af-94ec-649390645fa1 could not be found. Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-92fc3982-e0ee-4237-b029-e8b4731a3573 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Request method failure captured: Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 HTTP/1.1 Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmtyrevaWkxxtUDBt0REApodIlS-LSPThnK3YRW6Ud0W5eK6sLyMo73WE0zipzCZCAh_5upsNVehcjcuTwc6jFfzNd7QwRs7drx7HuK9YzR1MyQAdsmvTqtvVZIOlRrr0H7vkbGKMA3POxEJabFKA3dOYLExOb6Ux5GbaN3O0u5Bwcs Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: f906dc4e8ae44a1c8af9906fc14e28b1 Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1137499775 Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f906dc4e8ae44a1c8af9906fc14e28b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f906dc4e8ae44a1c8af9906fc14e28b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f906dc4e8ae44a1c8af9906fc14e28b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f906dc4e8ae44a1c8af9906fc14e28b1", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1137499775 Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: f906dc4e8ae44a1c8af9906fc14e28b1 Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1137499775 Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerRescueTestJSONUnderV235-1137499775-project Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 51c4584d7b5948358fef63edcf40667d Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1137499775-project Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 8a4302c3-6ad2-41af-94ec-649390645fa1 could not be found. Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '8a4302c3-6ad2-41af-94ec-649390645fa1'} Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a4302c3-6ad2-41af-94ec-649390645fa1 could not be found. Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a4302c3-6ad2-41af-94ec-649390645fa1 could not be found. Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:19.299697 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:19.311481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:19.311481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:19.311481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:19.311481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:19.311481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:19.311481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:19.311481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a4302c3-6ad2-41af-94ec-649390645fa1 could not be found. Oct 24 10:41:19.311481 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:19.311481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-92fc3982-e0ee-4237-b029-e8b4731a3573 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] Returning 404 to user: Instance 8a4302c3-6ad2-41af-94ec-649390645fa1 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:19.311481 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-92fc3982-e0ee-4237-b029-e8b4731a3573 tempest-ServerRescueTestJSONUnderV235-1137499775 tempest-ServerRescueTestJSONUnderV235-1137499775-project] 10.222.0.50 "GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1" status: 404 len: 111 microversion: 2.1 time: 0.064918 Oct 24 10:41:19.311481 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1873/3786] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:19 2022] GET /compute/v2.1/servers/8a4302c3-6ad2-41af-94ec-649390645fa1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:41:20.254536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-131e0d1c-ee04-4fe7-9284-6306cf884921 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:20.256192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-131e0d1c-ee04-4fe7-9284-6306cf884921 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:20.267527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-131e0d1c-ee04-4fe7-9284-6306cf884921 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:20.271619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-131e0d1c-ee04-4fe7-9284-6306cf884921 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:20.273328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-131e0d1c-ee04-4fe7-9284-6306cf884921 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:20.274260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-131e0d1c-ee04-4fe7-9284-6306cf884921 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:20.276390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-131e0d1c-ee04-4fe7-9284-6306cf884921 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:20.277133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-131e0d1c-ee04-4fe7-9284-6306cf884921 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:21.001832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-131e0d1c-ee04-4fe7-9284-6306cf884921 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:21.007150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:41:21.021194 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-131e0d1c-ee04-4fe7-9284-6306cf884921 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1508 microversion: 2.1 time: 0.772263 Oct 24 10:41:21.029261 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1874/3787] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:20 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1508 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:41:21.773870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-2e78d10d-719b-4d8b-bd5e-2ecf02bd99ad tempest-AbsoluteLimitsNegativeTestJSON-238264029 tempest-AbsoluteLimitsNegativeTestJSON-238264029-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:41:22.062355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5c3c72ba-f6dd-4ba4-9fda-2ed1d929a506 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:22.063601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c3c72ba-f6dd-4ba4-9fda-2ed1d929a506 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:22.093163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c3c72ba-f6dd-4ba4-9fda-2ed1d929a506 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:22.102842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c3c72ba-f6dd-4ba4-9fda-2ed1d929a506 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:22.104956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c3c72ba-f6dd-4ba4-9fda-2ed1d929a506 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:22.107285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c3c72ba-f6dd-4ba4-9fda-2ed1d929a506 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:22.110359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c3c72ba-f6dd-4ba4-9fda-2ed1d929a506 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:22.115068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c3c72ba-f6dd-4ba4-9fda-2ed1d929a506 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:22.893089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5c3c72ba-f6dd-4ba4-9fda-2ed1d929a506 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:22.903524 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5c3c72ba-f6dd-4ba4-9fda-2ed1d929a506 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1508 microversion: 2.1 time: 0.847712 Oct 24 10:41:22.909211 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1875/3788] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:22 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1508 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:41:23.253854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-2e78d10d-719b-4d8b-bd5e-2ecf02bd99ad tempest-AbsoluteLimitsNegativeTestJSON-238264029 tempest-AbsoluteLimitsNegativeTestJSON-238264029-project] Getting quotas for project 2e49cac51a1b495bb6f028cb818e6d4d. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:41:23.261093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-2e78d10d-719b-4d8b-bd5e-2ecf02bd99ad tempest-AbsoluteLimitsNegativeTestJSON-238264029 tempest-AbsoluteLimitsNegativeTestJSON-238264029-project] Getting quotas for user e2855300778349068d0297f14c750894 and project 2e49cac51a1b495bb6f028cb818e6d4d. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:41:23.307081 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-2e78d10d-719b-4d8b-bd5e-2ecf02bd99ad tempest-AbsoluteLimitsNegativeTestJSON-238264029 tempest-AbsoluteLimitsNegativeTestJSON-238264029-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2e78d10d-719b-4d8b-bd5e-2ecf02bd99ad tempest-AbsoluteLimitsNegativeTestJSON-238264029 tempest-AbsoluteLimitsNegativeTestJSON-238264029-project] Request method failure captured: Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 1752 Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmvBanrXlbIRgpfbrfuO6nUIBZ3GL3NUFhAVh7rAEePAm2sPLZ_G5AoPB7J1v3gZ-GejfYb_T3f7PZ1A5cRy0yZb8g-9w9zVedOABeSIvyZtP_1pNvpTjUShgiiSAVM-POPcz2avTWkrbBC-nknJjmBhiHqBUSlqUribVti6aRfdcRI Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 2e49cac51a1b495bb6f028cb818e6d4d Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-238264029 Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2e49cac51a1b495bb6f028cb818e6d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2e49cac51a1b495bb6f028cb818e6d4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2e49cac51a1b495bb6f028cb818e6d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2e49cac51a1b495bb6f028cb818e6d4d", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-238264029 Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 2e49cac51a1b495bb6f028cb818e6d4d Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-238264029 Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-238264029-project Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: e2855300778349068d0297f14c750894 Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-238264029-project Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2032432496", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:41:23.318890 n-d-858383-15 devstack@n-api.service[120426]: exception: Maximum number of metadata items exceeds 128 Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-2032432496', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:41:23.322221 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:41:23.327260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:41:23.327260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 10:41:23.327260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 24 10:41:23.327260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 24 10:41:23.327260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 24 10:41:23.327260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:23.327260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:23.327260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:23.327260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:23.327260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:23.327260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:23.327260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:23.327260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:23.327260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 24 10:41:23.327260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:23.327260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2e78d10d-719b-4d8b-bd5e-2ecf02bd99ad tempest-AbsoluteLimitsNegativeTestJSON-238264029 tempest-AbsoluteLimitsNegativeTestJSON-238264029-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:23.327260 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2e78d10d-719b-4d8b-bd5e-2ecf02bd99ad tempest-AbsoluteLimitsNegativeTestJSON-238264029 tempest-AbsoluteLimitsNegativeTestJSON-238264029-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 14.991825 Oct 24 10:41:23.334892 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1914/3789] 10.222.0.50 () {60 vars in 1148 bytes} [Mon Oct 24 10:41:08 2022] POST /compute/v2.1/servers => generated 87 bytes in 15007 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:41:23.947742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-45a41b5b-b0e7-420d-bc41-58ea25b017bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:23.949172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-45a41b5b-b0e7-420d-bc41-58ea25b017bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:23.968947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45a41b5b-b0e7-420d-bc41-58ea25b017bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:23.969876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45a41b5b-b0e7-420d-bc41-58ea25b017bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:23.972413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45a41b5b-b0e7-420d-bc41-58ea25b017bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:23.974090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45a41b5b-b0e7-420d-bc41-58ea25b017bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:23.977366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45a41b5b-b0e7-420d-bc41-58ea25b017bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:23.978139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45a41b5b-b0e7-420d-bc41-58ea25b017bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:24.860575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-45a41b5b-b0e7-420d-bc41-58ea25b017bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:24.870697 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-45a41b5b-b0e7-420d-bc41-58ea25b017bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1508 microversion: 2.1 time: 0.943512 Oct 24 10:41:24.873293 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1876/3790] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:23 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1508 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:25.904453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f9620afb-6150-4761-90f2-faef3abb5181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:25.906507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f9620afb-6150-4761-90f2-faef3abb5181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:25.918713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9620afb-6150-4761-90f2-faef3abb5181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:25.919671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9620afb-6150-4761-90f2-faef3abb5181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:25.920735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9620afb-6150-4761-90f2-faef3abb5181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:25.921850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9620afb-6150-4761-90f2-faef3abb5181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:25.922687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9620afb-6150-4761-90f2-faef3abb5181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:25.924466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9620afb-6150-4761-90f2-faef3abb5181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:26.479089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f9620afb-6150-4761-90f2-faef3abb5181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:26.490468 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f9620afb-6150-4761-90f2-faef3abb5181 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1508 microversion: 2.1 time: 0.596131 Oct 24 10:41:26.496938 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1915/3791] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:25 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1508 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:27.526914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b3548f16-2173-4117-acda-24c4a4a5cfd8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:27.527539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b3548f16-2173-4117-acda-24c4a4a5cfd8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:27.542962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3548f16-2173-4117-acda-24c4a4a5cfd8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:27.543467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3548f16-2173-4117-acda-24c4a4a5cfd8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:27.543912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3548f16-2173-4117-acda-24c4a4a5cfd8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:27.544640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3548f16-2173-4117-acda-24c4a4a5cfd8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:27.545135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3548f16-2173-4117-acda-24c4a4a5cfd8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:27.545568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3548f16-2173-4117-acda-24c4a4a5cfd8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:27.927705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b3548f16-2173-4117-acda-24c4a4a5cfd8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:27.940768 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b3548f16-2173-4117-acda-24c4a4a5cfd8 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1508 microversion: 2.1 time: 0.417589 Oct 24 10:41:27.947664 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1877/3792] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:27 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1508 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:28.971946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-49e41860-892c-4787-9ffd-43f5fb569580 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:28.972768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-49e41860-892c-4787-9ffd-43f5fb569580 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:28.991049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49e41860-892c-4787-9ffd-43f5fb569580 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:28.993434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49e41860-892c-4787-9ffd-43f5fb569580 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:28.994111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49e41860-892c-4787-9ffd-43f5fb569580 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:28.996037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49e41860-892c-4787-9ffd-43f5fb569580 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:28.998691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49e41860-892c-4787-9ffd-43f5fb569580 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:28.999405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49e41860-892c-4787-9ffd-43f5fb569580 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:29.414444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-49e41860-892c-4787-9ffd-43f5fb569580 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:29.425595 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-49e41860-892c-4787-9ffd-43f5fb569580 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1508 microversion: 2.1 time: 0.457851 Oct 24 10:41:29.428540 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1916/3793] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:28 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1508 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:30.452775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5753367b-4402-4272-bf3e-99594fc45ac3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:30.458096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5753367b-4402-4272-bf3e-99594fc45ac3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:30.470913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5753367b-4402-4272-bf3e-99594fc45ac3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:30.483250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5753367b-4402-4272-bf3e-99594fc45ac3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:30.483712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5753367b-4402-4272-bf3e-99594fc45ac3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:30.484478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5753367b-4402-4272-bf3e-99594fc45ac3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:30.484982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5753367b-4402-4272-bf3e-99594fc45ac3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:30.485419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5753367b-4402-4272-bf3e-99594fc45ac3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:31.212695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5753367b-4402-4272-bf3e-99594fc45ac3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:31.234204 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5753367b-4402-4272-bf3e-99594fc45ac3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1508 microversion: 2.1 time: 0.785108 Oct 24 10:41:31.235609 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1878/3794] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:30 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1508 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:32.265051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-285dad78-30c3-43f4-97c3-40235d691ea2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:32.266388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-285dad78-30c3-43f4-97c3-40235d691ea2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:32.305430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-285dad78-30c3-43f4-97c3-40235d691ea2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:32.307702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-285dad78-30c3-43f4-97c3-40235d691ea2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:32.310264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-285dad78-30c3-43f4-97c3-40235d691ea2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:32.314885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-285dad78-30c3-43f4-97c3-40235d691ea2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:32.318919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-285dad78-30c3-43f4-97c3-40235d691ea2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:32.324993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-285dad78-30c3-43f4-97c3-40235d691ea2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:33.028303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-285dad78-30c3-43f4-97c3-40235d691ea2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:33.035184 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-285dad78-30c3-43f4-97c3-40235d691ea2 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1508 microversion: 2.1 time: 0.774844 Oct 24 10:41:33.044095 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1917/3795] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:32 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1508 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:33.920584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ccb0df70-359e-4a5a-9f6e-8b06e1c26b80 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1225970945", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": "none"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:34.070903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d4f1c954-fea1-4091-8fde-0248f97316bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:34.071914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d4f1c954-fea1-4091-8fde-0248f97316bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:34.076413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ccb0df70-359e-4a5a-9f6e-8b06e1c26b80 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:41:34.076849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ccb0df70-359e-4a5a-9f6e-8b06e1c26b80 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:41:34.079313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ccb0df70-359e-4a5a-9f6e-8b06e1c26b80 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:41:34.080873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ccb0df70-359e-4a5a-9f6e-8b06e1c26b80 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:41:34.084995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ccb0df70-359e-4a5a-9f6e-8b06e1c26b80 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:41:34.091398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:41:34.100929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4f1c954-fea1-4091-8fde-0248f97316bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:34.109228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4f1c954-fea1-4091-8fde-0248f97316bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:34.110273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4f1c954-fea1-4091-8fde-0248f97316bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:34.114707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4f1c954-fea1-4091-8fde-0248f97316bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:34.119341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccb0df70-359e-4a5a-9f6e-8b06e1c26b80 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:34.121594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccb0df70-359e-4a5a-9f6e-8b06e1c26b80 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:34.124908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccb0df70-359e-4a5a-9f6e-8b06e1c26b80 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:34.126018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccb0df70-359e-4a5a-9f6e-8b06e1c26b80 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:34.128796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4f1c954-fea1-4091-8fde-0248f97316bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:34.133451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccb0df70-359e-4a5a-9f6e-8b06e1c26b80 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:34.133613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4f1c954-fea1-4091-8fde-0248f97316bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:34.133918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccb0df70-359e-4a5a-9f6e-8b06e1c26b80 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:34.210291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ccb0df70-359e-4a5a-9f6e-8b06e1c26b80 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Getting quotas for project 78644fba30f24012a4811ad5caef39a6. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:41:34.250203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ccb0df70-359e-4a5a-9f6e-8b06e1c26b80 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Getting quotas for user 5aaf8794c7024604991cfe102905e8bf and project 78644fba30f24012a4811ad5caef39a6. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:41:34.287533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ccb0df70-359e-4a5a-9f6e-8b06e1c26b80 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:41:34.292145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ccb0df70-359e-4a5a-9f6e-8b06e1c26b80 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:41:34.443948 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ccb0df70-359e-4a5a-9f6e-8b06e1c26b80 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.121728 Oct 24 10:41:34.460727 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1879/3796] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Oct 24 10:41:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 10:41:34.471437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-25844b8c-44f0-4eca-99a7-16fc71a49481 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:34.480410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-25844b8c-44f0-4eca-99a7-16fc71a49481 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:34.758910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-25844b8c-44f0-4eca-99a7-16fc71a49481 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:34.771069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-25844b8c-44f0-4eca-99a7-16fc71a49481 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:34.778011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-25844b8c-44f0-4eca-99a7-16fc71a49481 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:34.781722 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-25844b8c-44f0-4eca-99a7-16fc71a49481 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1278 microversion: 2.54 time: 0.312404 Oct 24 10:41:34.804570 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1880/3797] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:41:34 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1278 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:41:34.884415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d4f1c954-fea1-4091-8fde-0248f97316bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:34.902748 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d4f1c954-fea1-4091-8fde-0248f97316bc tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1508 microversion: 2.1 time: 0.835525 Oct 24 10:41:34.912003 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1918/3798] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:34 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1508 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:41:35.812123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a788c899-4e46-424d-bf90-2626b710a858 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:35.814317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a788c899-4e46-424d-bf90-2626b710a858 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:35.831211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a788c899-4e46-424d-bf90-2626b710a858 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:35.834797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a788c899-4e46-424d-bf90-2626b710a858 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:35.838675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a788c899-4e46-424d-bf90-2626b710a858 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:35.845138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a788c899-4e46-424d-bf90-2626b710a858 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:35.848545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a788c899-4e46-424d-bf90-2626b710a858 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:35.853663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a788c899-4e46-424d-bf90-2626b710a858 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:35.935821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d4a1a6a8-9301-4c5d-b820-9f7262fd9e98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:35.936538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d4a1a6a8-9301-4c5d-b820-9f7262fd9e98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:35.959671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4a1a6a8-9301-4c5d-b820-9f7262fd9e98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:35.961433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4a1a6a8-9301-4c5d-b820-9f7262fd9e98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:35.962000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4a1a6a8-9301-4c5d-b820-9f7262fd9e98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:35.967058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4a1a6a8-9301-4c5d-b820-9f7262fd9e98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:35.967636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4a1a6a8-9301-4c5d-b820-9f7262fd9e98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:35.968156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4a1a6a8-9301-4c5d-b820-9f7262fd9e98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:36.805306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a788c899-4e46-424d-bf90-2626b710a858 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:36.820136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a788c899-4e46-424d-bf90-2626b710a858 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:36.828008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a788c899-4e46-424d-bf90-2626b710a858 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:36.838306 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a788c899-4e46-424d-bf90-2626b710a858 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1282 microversion: 2.54 time: 1.030326 Oct 24 10:41:36.838914 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1881/3799] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:41:35 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1282 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:41:37.018621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d4a1a6a8-9301-4c5d-b820-9f7262fd9e98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:37.030260 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d4a1a6a8-9301-4c5d-b820-9f7262fd9e98 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1508 microversion: 2.1 time: 1.098272 Oct 24 10:41:37.035059 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1919/3800] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:35 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1508 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:37.873549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-56862334-829f-4051-ae04-45e0c1de1351 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:37.873549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-56862334-829f-4051-ae04-45e0c1de1351 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:37.887628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56862334-829f-4051-ae04-45e0c1de1351 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:37.888253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56862334-829f-4051-ae04-45e0c1de1351 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:37.891027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56862334-829f-4051-ae04-45e0c1de1351 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:37.894075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56862334-829f-4051-ae04-45e0c1de1351 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:37.894785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56862334-829f-4051-ae04-45e0c1de1351 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:37.896286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56862334-829f-4051-ae04-45e0c1de1351 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:38.062448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c02ad759-c0fd-495d-8e9f-ea221e00c80c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:38.063696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c02ad759-c0fd-495d-8e9f-ea221e00c80c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:38.088178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c02ad759-c0fd-495d-8e9f-ea221e00c80c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:38.089388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c02ad759-c0fd-495d-8e9f-ea221e00c80c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:38.091872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c02ad759-c0fd-495d-8e9f-ea221e00c80c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:38.094478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c02ad759-c0fd-495d-8e9f-ea221e00c80c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:38.099531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c02ad759-c0fd-495d-8e9f-ea221e00c80c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:38.103454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-56862334-829f-4051-ae04-45e0c1de1351 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:38.110025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c02ad759-c0fd-495d-8e9f-ea221e00c80c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:38.120938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-56862334-829f-4051-ae04-45e0c1de1351 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:38.123189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-56862334-829f-4051-ae04-45e0c1de1351 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:38.126720 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-56862334-829f-4051-ae04-45e0c1de1351 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1336 microversion: 2.54 time: 0.259185 Oct 24 10:41:38.128787 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1882/3801] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:41:37 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1336 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:41:38.670411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c02ad759-c0fd-495d-8e9f-ea221e00c80c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:38.684341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1607031067", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "31a75f7d-f284-43da-a15a-36f8c16e198c"}], "security_groups": [{"name": "tempest-securitygroup--1564398741"}], "key_name": "tempest-keypair-7872240", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "88cd7819-1b4c-41ed-8da7-3e2915db82af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:38.690799 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c02ad759-c0fd-495d-8e9f-ea221e00c80c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1505 microversion: 2.1 time: 0.626938 Oct 24 10:41:38.698706 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1920/3802] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:38 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1505 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:41:38.995158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] validate_networks() for [('31a75f7d-f284-43da-a15a-36f8c16e198c', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:41:39.161199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c8dfb0c0-225b-429b-a1f3-9c670870d355 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:39.162525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c8dfb0c0-225b-429b-a1f3-9c670870d355 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:39.170680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8dfb0c0-225b-429b-a1f3-9c670870d355 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:39.171637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8dfb0c0-225b-429b-a1f3-9c670870d355 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:39.172277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8dfb0c0-225b-429b-a1f3-9c670870d355 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:39.173816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8dfb0c0-225b-429b-a1f3-9c670870d355 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:39.174485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8dfb0c0-225b-429b-a1f3-9c670870d355 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:39.175597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8dfb0c0-225b-429b-a1f3-9c670870d355 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:39.385874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c8dfb0c0-225b-429b-a1f3-9c670870d355 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:39.397177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c8dfb0c0-225b-429b-a1f3-9c670870d355 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:39.398955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c8dfb0c0-225b-429b-a1f3-9c670870d355 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:39.400332 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c8dfb0c0-225b-429b-a1f3-9c670870d355 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1336 microversion: 2.54 time: 0.244612 Oct 24 10:41:39.413772 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1921/3803] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:41:39 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1336 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:41:39.447778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-ff97d33b-093e-429a-b7b9-fdbae72c63d5 req-ff1e5354-38d2-4488-80f3-3b7a2a850b7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6203fa6d-e5c6-45fa-9584-cfcd993b5cdf", "name": "network-vif-unplugged", "status": "completed", "tag": "2a70293f-229f-41bd-aadc-1ca0206a17d9"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:39.467648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ff97d33b-093e-429a-b7b9-fdbae72c63d5 req-ff1e5354-38d2-4488-80f3-3b7a2a850b7b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:39.470291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ff97d33b-093e-429a-b7b9-fdbae72c63d5 req-ff1e5354-38d2-4488-80f3-3b7a2a850b7b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:39.471809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ff97d33b-093e-429a-b7b9-fdbae72c63d5 req-ff1e5354-38d2-4488-80f3-3b7a2a850b7b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:39.515055 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ff97d33b-093e-429a-b7b9-fdbae72c63d5 req-ff1e5354-38d2-4488-80f3-3b7a2a850b7b service nova] Creating event network-vif-unplugged:2a70293f-229f-41bd-aadc-1ca0206a17d9 for instance 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf on n-h1-858383-15 Oct 24 10:41:39.534755 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-ff97d33b-093e-429a-b7b9-fdbae72c63d5 req-ff1e5354-38d2-4488-80f3-3b7a2a850b7b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085836 Oct 24 10:41:39.538359 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1922/3804] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:41:39.719997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5fb81f97-2c05-4061-89d7-61163ef66b14 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:39.720910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5fb81f97-2c05-4061-89d7-61163ef66b14 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:39.736385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fb81f97-2c05-4061-89d7-61163ef66b14 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:39.739525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fb81f97-2c05-4061-89d7-61163ef66b14 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:39.740337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fb81f97-2c05-4061-89d7-61163ef66b14 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:39.745063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fb81f97-2c05-4061-89d7-61163ef66b14 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:39.749946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fb81f97-2c05-4061-89d7-61163ef66b14 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:39.750711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fb81f97-2c05-4061-89d7-61163ef66b14 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:40.491374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5fb81f97-2c05-4061-89d7-61163ef66b14 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:40.534076 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5fb81f97-2c05-4061-89d7-61163ef66b14 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1505 microversion: 2.1 time: 0.793432 Oct 24 10:41:40.536578 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1923/3805] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:39 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1505 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:41:40.555619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-91d58033-32ed-4016-af5f-ef3da7d7ea7a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:40.556541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-91d58033-32ed-4016-af5f-ef3da7d7ea7a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:40.564096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91d58033-32ed-4016-af5f-ef3da7d7ea7a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:40.569618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91d58033-32ed-4016-af5f-ef3da7d7ea7a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:40.570188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91d58033-32ed-4016-af5f-ef3da7d7ea7a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:40.571034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91d58033-32ed-4016-af5f-ef3da7d7ea7a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:40.580583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91d58033-32ed-4016-af5f-ef3da7d7ea7a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:40.581227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91d58033-32ed-4016-af5f-ef3da7d7ea7a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:41.098568 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-91d58033-32ed-4016-af5f-ef3da7d7ea7a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:41.111211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-91d58033-32ed-4016-af5f-ef3da7d7ea7a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:41.120414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-91d58033-32ed-4016-af5f-ef3da7d7ea7a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:41.122057 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-91d58033-32ed-4016-af5f-ef3da7d7ea7a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1336 microversion: 2.54 time: 0.582091 Oct 24 10:41:41.123352 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1924/3806] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:41:40 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1336 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:41:41.134587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Getting quotas for project dbc29824130c410e8c2186dc5d4457c3. Resources: dict_keys(['metadata_items']) {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:41:41.153640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Getting quotas for user 748e830a51c748ccaedc86a3566af1d3 and project dbc29824130c410e8c2186dc5d4457c3. Resources: dict_keys(['metadata_items']) {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:41:41.192450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:41:41.193362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:41:41.195765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:41:41.199280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:41:41.200189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:41:41.221418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:41.225214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:41.225792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:41.226672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:41.227236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:41.227742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:41.280025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Getting quotas for project dbc29824130c410e8c2186dc5d4457c3. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:41:41.296465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Getting quotas for user 748e830a51c748ccaedc86a3566af1d3 and project dbc29824130c410e8c2186dc5d4457c3. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:41:41.463472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:41:41.465966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='88cd7819-1b4c-41ed-8da7-3e2915db82af',volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:41:41.568019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b81dd557-e4dd-4cb2-acf8-03f30d9b671d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:41.568648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b81dd557-e4dd-4cb2-acf8-03f30d9b671d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:41.592072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b81dd557-e4dd-4cb2-acf8-03f30d9b671d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:41.592785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b81dd557-e4dd-4cb2-acf8-03f30d9b671d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:41.593705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b81dd557-e4dd-4cb2-acf8-03f30d9b671d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:41.602259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b81dd557-e4dd-4cb2-acf8-03f30d9b671d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:41.603089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b81dd557-e4dd-4cb2-acf8-03f30d9b671d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:41.605382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b81dd557-e4dd-4cb2-acf8-03f30d9b671d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:41.775304 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2768ea78-d6ef-46b2-8a3a-754cab427153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.095422 Oct 24 10:41:41.777518 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1883/3807] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:41:38 2022] POST /compute/v2.1/servers => generated 407 bytes in 3098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 10:41:41.798074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5361195a-7fb4-4ed4-b9de-8372fc8b2e18 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:41.799260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5361195a-7fb4-4ed4-b9de-8372fc8b2e18 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:42.057943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5361195a-7fb4-4ed4-b9de-8372fc8b2e18 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:42.074370 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5361195a-7fb4-4ed4-b9de-8372fc8b2e18 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1119 microversion: 2.1 time: 0.285446 Oct 24 10:41:42.077256 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1884/3808] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:41 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1119 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:42.151519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-12e48fdc-f5c4-402a-a16d-0ed2824f9f65 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:42.152141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-12e48fdc-f5c4-402a-a16d-0ed2824f9f65 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:42.159636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12e48fdc-f5c4-402a-a16d-0ed2824f9f65 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:42.160136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12e48fdc-f5c4-402a-a16d-0ed2824f9f65 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:42.165185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12e48fdc-f5c4-402a-a16d-0ed2824f9f65 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:42.165996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12e48fdc-f5c4-402a-a16d-0ed2824f9f65 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:42.166475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12e48fdc-f5c4-402a-a16d-0ed2824f9f65 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:42.166912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12e48fdc-f5c4-402a-a16d-0ed2824f9f65 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:42.446237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b81dd557-e4dd-4cb2-acf8-03f30d9b671d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:42.473996 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b81dd557-e4dd-4cb2-acf8-03f30d9b671d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1505 microversion: 2.1 time: 0.912915 Oct 24 10:41:42.480573 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1925/3809] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:41 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1505 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:42.483210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-12e48fdc-f5c4-402a-a16d-0ed2824f9f65 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:42.502968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-12e48fdc-f5c4-402a-a16d-0ed2824f9f65 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:42.509953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-12e48fdc-f5c4-402a-a16d-0ed2824f9f65 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:42.513573 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-12e48fdc-f5c4-402a-a16d-0ed2824f9f65 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1336 microversion: 2.54 time: 0.365211 Oct 24 10:41:42.517475 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1885/3810] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:41:42 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1336 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:41:43.104536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e936992-af53-45c8-939f-a6dd8ec52708 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:43.107070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3e936992-af53-45c8-939f-a6dd8ec52708 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:43.139379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e936992-af53-45c8-939f-a6dd8ec52708 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:43.143948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e936992-af53-45c8-939f-a6dd8ec52708 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:43.147387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e936992-af53-45c8-939f-a6dd8ec52708 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:43.151255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e936992-af53-45c8-939f-a6dd8ec52708 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:43.152237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e936992-af53-45c8-939f-a6dd8ec52708 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:43.157318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e936992-af53-45c8-939f-a6dd8ec52708 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:43.462293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3e936992-af53-45c8-939f-a6dd8ec52708 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:43.471258 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3e936992-af53-45c8-939f-a6dd8ec52708 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1161 microversion: 2.1 time: 0.375308 Oct 24 10:41:43.476351 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1926/3811] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:43 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1161 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:43.511431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b5821a04-505a-4c54-9182-db6df0f10675 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:43.514763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b5821a04-505a-4c54-9182-db6df0f10675 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:43.531547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:41:43.539555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5821a04-505a-4c54-9182-db6df0f10675 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:43.539555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5821a04-505a-4c54-9182-db6df0f10675 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:43.539555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5821a04-505a-4c54-9182-db6df0f10675 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:43.539555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5821a04-505a-4c54-9182-db6df0f10675 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:43.539555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5821a04-505a-4c54-9182-db6df0f10675 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:43.539555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5821a04-505a-4c54-9182-db6df0f10675 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:43.566389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4507a487-06b7-418d-b401-8ac5b25f69b4 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:43.567262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4507a487-06b7-418d-b401-8ac5b25f69b4 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:43.574537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4507a487-06b7-418d-b401-8ac5b25f69b4 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:43.582728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4507a487-06b7-418d-b401-8ac5b25f69b4 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:43.583339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4507a487-06b7-418d-b401-8ac5b25f69b4 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:43.584756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4507a487-06b7-418d-b401-8ac5b25f69b4 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:43.586136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4507a487-06b7-418d-b401-8ac5b25f69b4 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:43.586760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4507a487-06b7-418d-b401-8ac5b25f69b4 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:43.818617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4507a487-06b7-418d-b401-8ac5b25f69b4 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:43.834427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4507a487-06b7-418d-b401-8ac5b25f69b4 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:43.835982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4507a487-06b7-418d-b401-8ac5b25f69b4 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:43.858133 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4507a487-06b7-418d-b401-8ac5b25f69b4 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1336 microversion: 2.54 time: 0.288120 Oct 24 10:41:43.859330 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1927/3812] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:41:43 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1336 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:41:44.060161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b5821a04-505a-4c54-9182-db6df0f10675 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:44.076023 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b5821a04-505a-4c54-9182-db6df0f10675 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 200 len: 1508 microversion: 2.1 time: 0.571445 Oct 24 10:41:44.077820 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1886/3813] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:43 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 1508 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:44.103457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-255950ad-d3e3-47e5-acdf-701c4e0ff73b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:44.104078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-255950ad-d3e3-47e5-acdf-701c4e0ff73b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:44.112187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-255950ad-d3e3-47e5-acdf-701c4e0ff73b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:44.113040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-255950ad-d3e3-47e5-acdf-701c4e0ff73b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:44.113579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-255950ad-d3e3-47e5-acdf-701c4e0ff73b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:44.114578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-255950ad-d3e3-47e5-acdf-701c4e0ff73b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:44.115091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-255950ad-d3e3-47e5-acdf-701c4e0ff73b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:44.115680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-255950ad-d3e3-47e5-acdf-701c4e0ff73b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:44.817401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-255950ad-d3e3-47e5-acdf-701c4e0ff73b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:44.827896 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-255950ad-d3e3-47e5-acdf-701c4e0ff73b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.730323 Oct 24 10:41:44.842514 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1928/3814] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:44 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:44.844584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f40a8347-0eb7-435b-853c-6a94eddc261f tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:44.846796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f40a8347-0eb7-435b-853c-6a94eddc261f tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:44.864246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f40a8347-0eb7-435b-853c-6a94eddc261f tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:44.873109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f40a8347-0eb7-435b-853c-6a94eddc261f tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:44.874844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f40a8347-0eb7-435b-853c-6a94eddc261f tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:44.875738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f40a8347-0eb7-435b-853c-6a94eddc261f tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:44.880991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f40a8347-0eb7-435b-853c-6a94eddc261f tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:44.882237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f40a8347-0eb7-435b-853c-6a94eddc261f tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:45.016011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-189425546", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "e34eb493-dec5-4784-b956-a2d6f68dce94"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:45.143509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] validate_networks() for [('e34eb493-dec5-4784-b956-a2d6f68dce94', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:41:45.211316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f40a8347-0eb7-435b-853c-6a94eddc261f tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:45.220361 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f40a8347-0eb7-435b-853c-6a94eddc261f tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1235 microversion: 2.1 time: 0.387335 Oct 24 10:41:45.241839 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1929/3815] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:44 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1235 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:45.247816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e20a250f-81dc-47b0-859d-f2dac11d0768 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:45.254484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e20a250f-81dc-47b0-859d-f2dac11d0768 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:45.273766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e20a250f-81dc-47b0-859d-f2dac11d0768 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:45.284325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e20a250f-81dc-47b0-859d-f2dac11d0768 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:45.285068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e20a250f-81dc-47b0-859d-f2dac11d0768 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:45.286595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e20a250f-81dc-47b0-859d-f2dac11d0768 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:45.287327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e20a250f-81dc-47b0-859d-f2dac11d0768 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:45.288064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e20a250f-81dc-47b0-859d-f2dac11d0768 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:46.145361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e20a250f-81dc-47b0-859d-f2dac11d0768 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:46.158256 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e20a250f-81dc-47b0-859d-f2dac11d0768 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.915195 Oct 24 10:41:46.158864 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1930/3816] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:45 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:46.169628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dc377ea8-7db2-4e72-9e50-825e6cb24471 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:46.170546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dc377ea8-7db2-4e72-9e50-825e6cb24471 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:46.195643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc377ea8-7db2-4e72-9e50-825e6cb24471 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:46.196259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc377ea8-7db2-4e72-9e50-825e6cb24471 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:46.197463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc377ea8-7db2-4e72-9e50-825e6cb24471 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:46.198435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc377ea8-7db2-4e72-9e50-825e6cb24471 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:46.199166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc377ea8-7db2-4e72-9e50-825e6cb24471 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:46.199830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc377ea8-7db2-4e72-9e50-825e6cb24471 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:46.412886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dc377ea8-7db2-4e72-9e50-825e6cb24471 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:46.437946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dc377ea8-7db2-4e72-9e50-825e6cb24471 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:46.440336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dc377ea8-7db2-4e72-9e50-825e6cb24471 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:46.442726 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dc377ea8-7db2-4e72-9e50-825e6cb24471 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1357 microversion: 2.54 time: 0.277040 Oct 24 10:41:46.444046 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1931/3817] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:41:46 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1357 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:41:46.450607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6f22aba9-fe03-4114-9720-6107b7b8fd3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:46.451496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6f22aba9-fe03-4114-9720-6107b7b8fd3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:46.460055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f22aba9-fe03-4114-9720-6107b7b8fd3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:46.460894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f22aba9-fe03-4114-9720-6107b7b8fd3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:46.479751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f22aba9-fe03-4114-9720-6107b7b8fd3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:46.481373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f22aba9-fe03-4114-9720-6107b7b8fd3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:46.482128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f22aba9-fe03-4114-9720-6107b7b8fd3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:46.482893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f22aba9-fe03-4114-9720-6107b7b8fd3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:46.489999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:41:46.852944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:41:46.853903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:41:46.854540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:41:46.855956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:41:46.856589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:41:46.873194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:46.878725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:46.881427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:46.882495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:46.885321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:46.889605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:46.955136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Getting quotas for project 743ff130bbae4b6e8022b30e821c4eb7. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:41:46.970840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Getting quotas for user c9aeff583c6141f487eb07e6e1ec3986 and project 743ff130bbae4b6e8022b30e821c4eb7. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:41:47.026538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Going to run 3 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:41:47.031132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:41:47.071115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6f22aba9-fe03-4114-9720-6107b7b8fd3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:47.091260 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6f22aba9-fe03-4114-9720-6107b7b8fd3e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.640912 Oct 24 10:41:47.111140 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1932/3818] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:46 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:47.125432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: dd604035-ef97-496b-a5fe-0204c8dc7e46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=8dffdbb2-6b3c-4b29-9016-40f1a54bda8d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:41:47.143596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c1683eb4-9788-439a-b899-97609c3a93a4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:47.147695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c1683eb4-9788-439a-b899-97609c3a93a4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:47.178686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1683eb4-9788-439a-b899-97609c3a93a4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:47.181090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1683eb4-9788-439a-b899-97609c3a93a4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:47.183972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1683eb4-9788-439a-b899-97609c3a93a4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:47.186372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1683eb4-9788-439a-b899-97609c3a93a4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:47.188467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1683eb4-9788-439a-b899-97609c3a93a4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:47.190363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1683eb4-9788-439a-b899-97609c3a93a4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:47.222346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=dd604035-ef97-496b-a5fe-0204c8dc7e46,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:41:47.361994 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c688197f-dff2-4ba5-97ff-ad0bb558eade tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.017303 Oct 24 10:41:47.362700 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1887/3819] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:41:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:41:47.376526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d73d6a59-9f06-462e-addf-1038c78b3ef0 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Action: 'create', calling method: .version_select at 0x7f04d02ca0d0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1151893838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9thBlcp/lWmSh4vQKq/ppNMeQ3q9dmtWGGonSoHoO+Uwri/jdzchHSfyUrR7aesjPsCdIh1OrR91643PMjgUgnjQdcgL2xrcv44etABISqxHDbzBpJym4DrvlXWGe6xg=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:47.427774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-d73d6a59-9f06-462e-addf-1038c78b3ef0 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Getting quotas for project 78644fba30f24012a4811ad5caef39a6. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:41:47.442157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-d73d6a59-9f06-462e-addf-1038c78b3ef0 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Getting quotas for user 5aaf8794c7024604991cfe102905e8bf and project 78644fba30f24012a4811ad5caef39a6. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:41:47.529236 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d73d6a59-9f06-462e-addf-1038c78b3ef0 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.154924 Oct 24 10:41:47.532664 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1888/3820] 10.222.0.50 () {62 vars in 1200 bytes} [Mon Oct 24 10:41:47 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 169 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 10:41:47.631733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c1683eb4-9788-439a-b899-97609c3a93a4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:47.644125 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c1683eb4-9788-439a-b899-97609c3a93a4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1303 microversion: 2.1 time: 0.529681 Oct 24 10:41:47.649828 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1933/3821] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:47 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1303 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:47.662843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cfe8624a-d6c7-4f47-a9b2-57482ac185f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:47.663983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cfe8624a-d6c7-4f47-a9b2-57482ac185f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:47.679491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfe8624a-d6c7-4f47-a9b2-57482ac185f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:47.682122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfe8624a-d6c7-4f47-a9b2-57482ac185f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:47.684113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfe8624a-d6c7-4f47-a9b2-57482ac185f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:47.687419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfe8624a-d6c7-4f47-a9b2-57482ac185f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:47.688179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfe8624a-d6c7-4f47-a9b2-57482ac185f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:47.689501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfe8624a-d6c7-4f47-a9b2-57482ac185f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:48.075027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5503d688-6387-4492-a5e1-e09d21e577e9 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Action: 'create', calling method: .version_select at 0x7f04d0a04790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1486036551", "description": "tempest-description-1918171819"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:48.106301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cfe8624a-d6c7-4f47-a9b2-57482ac185f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:48.120647 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cfe8624a-d6c7-4f47-a9b2-57482ac185f0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.469366 Oct 24 10:41:48.123655 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1934/3822] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:47 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:48.158123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-37df70da-5aa3-47e3-8666-a5898beed29a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:48.200026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-37df70da-5aa3-47e3-8666-a5898beed29a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:48.203525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-37df70da-5aa3-47e3-8666-a5898beed29a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Searching by: {'deleted': False, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:41:48.290454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37df70da-5aa3-47e3-8666-a5898beed29a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:48.293484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37df70da-5aa3-47e3-8666-a5898beed29a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:48.294987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37df70da-5aa3-47e3-8666-a5898beed29a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:48.299894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37df70da-5aa3-47e3-8666-a5898beed29a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:48.302699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37df70da-5aa3-47e3-8666-a5898beed29a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:48.304030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37df70da-5aa3-47e3-8666-a5898beed29a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:48.393879 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-37df70da-5aa3-47e3-8666-a5898beed29a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.266400 Oct 24 10:41:48.402865 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1935/3823] 10.222.0.50 () {58 vars in 1125 bytes} [Mon Oct 24 10:41:48 2022] GET /compute/v2.1/servers => generated 1015 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:48.427833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1151893838", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:48.432251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:48.441000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=51 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:41:48.443008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:48.444189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:48.444944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:48.448334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:48.449783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:48.451879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:48.685823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:41:48.686429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:41:48.690697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:41:48.692027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:41:48.694429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:41:48.722897 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5503d688-6387-4492-a5e1-e09d21e577e9 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.188751 Oct 24 10:41:48.733614 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1889/3824] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:41:47 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:41:48.741836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-28a9d16a-bcbc-441a-b7fd-99e2be94bd43 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:48.749937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28a9d16a-bcbc-441a-b7fd-99e2be94bd43 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:48.750646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28a9d16a-bcbc-441a-b7fd-99e2be94bd43 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:48.751265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28a9d16a-bcbc-441a-b7fd-99e2be94bd43 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:48.834251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-28a9d16a-bcbc-441a-b7fd-99e2be94bd43 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Going to try to stop instance {{(pid=120425) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 10:41:48.939439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:48.957692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:48.959401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:48.962306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:48.967535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:48.968379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:48.975549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:48.975840 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-28a9d16a-bcbc-441a-b7fd-99e2be94bd43 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 202 len: 0 microversion: 2.1 time: 0.222034 Oct 24 10:41:48.984921 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1890/3825] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:41:48 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:41:49.010915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-2b2ddb58-b92e-4d6f-b12a-949aeebf8f22 req-d996fe40-b384-42d5-be96-18df51fbf61c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cee981b9-6221-467f-bce3-e911488983ad", "tag": "7c636450-35fa-4e6c-861a-6b258e553318"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:49.068680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2b2ddb58-b92e-4d6f-b12a-949aeebf8f22 req-d996fe40-b384-42d5-be96-18df51fbf61c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:49.072152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2b2ddb58-b92e-4d6f-b12a-949aeebf8f22 req-d996fe40-b384-42d5-be96-18df51fbf61c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:49.072621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2b2ddb58-b92e-4d6f-b12a-949aeebf8f22 req-d996fe40-b384-42d5-be96-18df51fbf61c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:49.124388 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-2b2ddb58-b92e-4d6f-b12a-949aeebf8f22 req-d996fe40-b384-42d5-be96-18df51fbf61c service nova] Creating event network-changed:7c636450-35fa-4e6c-861a-6b258e553318 for instance cee981b9-6221-467f-bce3-e911488983ad on n-h2-858383-15 Oct 24 10:41:49.142605 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-2b2ddb58-b92e-4d6f-b12a-949aeebf8f22 req-d996fe40-b384-42d5-be96-18df51fbf61c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155720 Oct 24 10:41:49.143372 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f27b16ea-8b75-466c-8223-73cd802265d7 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "POST /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318/action" status: 202 len: 1140 microversion: 2.54 time: 0.703828 Oct 24 10:41:49.146350 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1936/3826] 10.222.0.50 () {62 vars in 1320 bytes} [Mon Oct 24 10:41:48 2022] POST /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318/action => generated 1140 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 24 10:41:49.149520 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1891/3827] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:41:49.156611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8457fdf3-7384-4103-893c-5887c5a8111f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:49.168313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b3faada0-1aee-4e76-9966-25a790443cb8 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:49.171645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8457fdf3-7384-4103-893c-5887c5a8111f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:49.172719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b3faada0-1aee-4e76-9966-25a790443cb8 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:49.200433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3faada0-1aee-4e76-9966-25a790443cb8 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:49.201225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3faada0-1aee-4e76-9966-25a790443cb8 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:49.203165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3faada0-1aee-4e76-9966-25a790443cb8 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:49.204704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3faada0-1aee-4e76-9966-25a790443cb8 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:49.205818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3faada0-1aee-4e76-9966-25a790443cb8 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:49.206704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3faada0-1aee-4e76-9966-25a790443cb8 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:49.472167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8457fdf3-7384-4103-893c-5887c5a8111f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:49.486405 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8457fdf3-7384-4103-893c-5887c5a8111f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1222 microversion: 2.1 time: 0.336119 Oct 24 10:41:49.492427 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1937/3828] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:49 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1222 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:49.518745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-45a60e57-2b8b-447b-b9f1-67bfa238d1b9 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Action: 'create', calling method: .version_select at 0x7f04d0a8f790>, body: {"security_group_rule": {"parent_group_id": "214c1b50-dcc2-45be-a20c-aa9f04fe8c0f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:49.879371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b3faada0-1aee-4e76-9966-25a790443cb8 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:49.894561 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b3faada0-1aee-4e76-9966-25a790443cb8 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1303 microversion: 2.1 time: 0.741068 Oct 24 10:41:49.920973 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1892/3829] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:49 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1303 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:49.936336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9741b862-0866-4fcd-8de4-ca2739cc6da1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:49.940208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9741b862-0866-4fcd-8de4-ca2739cc6da1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:49.968278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9741b862-0866-4fcd-8de4-ca2739cc6da1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:49.980380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9741b862-0866-4fcd-8de4-ca2739cc6da1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:49.981633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9741b862-0866-4fcd-8de4-ca2739cc6da1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:49.986240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9741b862-0866-4fcd-8de4-ca2739cc6da1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:49.989919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9741b862-0866-4fcd-8de4-ca2739cc6da1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:49.990649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9741b862-0866-4fcd-8de4-ca2739cc6da1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:50.707767 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-45a60e57-2b8b-447b-b9f1-67bfa238d1b9 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.212400 Oct 24 10:41:50.709421 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1938/3830] 10.222.0.50 () {60 vars in 1195 bytes} [Mon Oct 24 10:41:49 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:41:50.723530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ceb07884-1124-46e5-a047-0fd0eb66584f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:50.734518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ceb07884-1124-46e5-a047-0fd0eb66584f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:50.746972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9741b862-0866-4fcd-8de4-ca2739cc6da1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:50.750051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ceb07884-1124-46e5-a047-0fd0eb66584f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:50.753034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ceb07884-1124-46e5-a047-0fd0eb66584f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:50.759780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ceb07884-1124-46e5-a047-0fd0eb66584f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:50.761262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ceb07884-1124-46e5-a047-0fd0eb66584f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:50.762532 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9741b862-0866-4fcd-8de4-ca2739cc6da1 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1681 microversion: 2.1 time: 0.840000 Oct 24 10:41:50.763127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ceb07884-1124-46e5-a047-0fd0eb66584f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:50.764212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ceb07884-1124-46e5-a047-0fd0eb66584f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:50.779608 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1893/3831] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:49 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1681 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:50.807160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f374cf31-3c81-4b46-8adf-25362fbe06a6 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:50.814198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f374cf31-3c81-4b46-8adf-25362fbe06a6 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:50.833314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f374cf31-3c81-4b46-8adf-25362fbe06a6 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:50.835775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f374cf31-3c81-4b46-8adf-25362fbe06a6 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:50.836445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f374cf31-3c81-4b46-8adf-25362fbe06a6 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:50.837404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f374cf31-3c81-4b46-8adf-25362fbe06a6 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:50.856604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f374cf31-3c81-4b46-8adf-25362fbe06a6 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:50.857138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f374cf31-3c81-4b46-8adf-25362fbe06a6 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:51.011286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ceb07884-1124-46e5-a047-0fd0eb66584f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:51.028747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ceb07884-1124-46e5-a047-0fd0eb66584f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:51.048179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ceb07884-1124-46e5-a047-0fd0eb66584f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:51.056250 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ceb07884-1124-46e5-a047-0fd0eb66584f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1409 microversion: 2.54 time: 0.345442 Oct 24 10:41:51.057235 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1939/3832] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:41:50 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1409 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:41:51.080144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-56052592-91ca-484c-bc54-63bd1715fdd6 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Action: 'create', calling method: .version_select at 0x7f04d0f0d9d0>, body: {"security_group_rule": {"parent_group_id": "214c1b50-dcc2-45be-a20c-aa9f04fe8c0f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:51.101097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f374cf31-3c81-4b46-8adf-25362fbe06a6 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:51.118568 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f374cf31-3c81-4b46-8adf-25362fbe06a6 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1218 microversion: 2.1 time: 0.337386 Oct 24 10:41:51.142436 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1894/3833] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:50 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1218 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:51.157362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-86989c83-ddfd-4b41-a747-48a1563b3d9b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:51.163579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-86989c83-ddfd-4b41-a747-48a1563b3d9b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:51.206157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86989c83-ddfd-4b41-a747-48a1563b3d9b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:51.209444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86989c83-ddfd-4b41-a747-48a1563b3d9b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:51.210205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86989c83-ddfd-4b41-a747-48a1563b3d9b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:51.216681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86989c83-ddfd-4b41-a747-48a1563b3d9b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:51.217878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86989c83-ddfd-4b41-a747-48a1563b3d9b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:51.220895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86989c83-ddfd-4b41-a747-48a1563b3d9b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:51.288150 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-56052592-91ca-484c-bc54-63bd1715fdd6 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] HTTP exception thrown: This rule already exists in group 214c1b50-dcc2-45be-a20c-aa9f04fe8c0f Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-56052592-91ca-484c-bc54-63bd1715fdd6 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Request method failure captured: Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 138 Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmvq_ErMm0TYj1KvIBwglnPbLCISRgFXSJzN6zZrJjN2xlB9Vo1NepxbI9_wKrJkkvIRLsE4X0veb_v9DGGiHMjll9xwqxt1fzYTjO0Ns9iGDBYBfHkCDW9car5qnD1JlWFK2WOuDVGCeqjiur7ewFdk6MyOjskZKb_uv1_FFUSNiIA Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 8413ce3d6e5c41e7b8252e1bfa6e313c Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8413ce3d6e5c41e7b8252e1bfa6e313c", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 8413ce3d6e5c41e7b8252e1bfa6e313c Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 2665f9fda1af462d8d93758fac9318e7 Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: {"security_group_rule": {"parent_group_id": "214c1b50-dcc2-45be-a20c-aa9f04fe8c0f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: exception: This rule already exists in group 214c1b50-dcc2-45be-a20c-aa9f04fe8c0f Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'security_group_rule': {'parent_group_id': '214c1b50-dcc2-45be-a20c-aa9f04fe8c0f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 214c1b50-dcc2-45be-a20c-aa9f04fe8c0f Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 214c1b50-dcc2-45be-a20c-aa9f04fe8c0f Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:51.290354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:51.295067 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:51.295067 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:51.295067 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 214c1b50-dcc2-45be-a20c-aa9f04fe8c0f Oct 24 10:41:51.295067 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:51.299204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-56052592-91ca-484c-bc54-63bd1715fdd6 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Returning 400 to user: This rule already exists in group 214c1b50-dcc2-45be-a20c-aa9f04fe8c0f {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:51.300676 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-56052592-91ca-484c-bc54-63bd1715fdd6 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.242173 Oct 24 10:41:51.302264 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1940/3834] 10.222.0.50 () {60 vars in 1195 bytes} [Mon Oct 24 10:41:51 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 244 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:41:51.313684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-41774f26-ab86-40d8-b220-97d782012f32 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Calling method '.version_select at 0x7f04d0d2aee0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:52.252613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-86989c83-ddfd-4b41-a747-48a1563b3d9b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:52.257011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:41:52.264226 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-86989c83-ddfd-4b41-a747-48a1563b3d9b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1303 microversion: 2.1 time: 1.120350 Oct 24 10:41:52.271167 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1895/3835] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:51 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1303 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:52.291062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b141e6c1-d799-4db9-b486-e75d21a80013 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:52.291876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b141e6c1-d799-4db9-b486-e75d21a80013 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:52.298830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b141e6c1-d799-4db9-b486-e75d21a80013 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:52.302282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b141e6c1-d799-4db9-b486-e75d21a80013 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:52.302938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b141e6c1-d799-4db9-b486-e75d21a80013 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:52.305121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b141e6c1-d799-4db9-b486-e75d21a80013 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:52.305786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b141e6c1-d799-4db9-b486-e75d21a80013 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:52.316138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b141e6c1-d799-4db9-b486-e75d21a80013 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:53.053445 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-41774f26-ab86-40d8-b220-97d782012f32 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-group-rules/c6a89478-2d0d-4d7d-a9f4-b68ad5ed9249" status: 202 len: 0 microversion: 2.1 time: 1.746291 Oct 24 10:41:53.058334 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1941/3836] 10.222.0.50 () {58 vars in 1287 bytes} [Mon Oct 24 10:41:51 2022] DELETE /compute/v2.1/os-security-group-rules/c6a89478-2d0d-4d7d-a9f4-b68ad5ed9249 => generated 0 bytes in 1748 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:41:53.063129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-49303eed-0954-48e4-9224-110ebafb24b1 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:53.063440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-49303eed-0954-48e4-9224-110ebafb24b1 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:53.093132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49303eed-0954-48e4-9224-110ebafb24b1 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:53.097741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49303eed-0954-48e4-9224-110ebafb24b1 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:53.098953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49303eed-0954-48e4-9224-110ebafb24b1 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:53.100686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49303eed-0954-48e4-9224-110ebafb24b1 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:53.105186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49303eed-0954-48e4-9224-110ebafb24b1 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:53.106178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49303eed-0954-48e4-9224-110ebafb24b1 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:53.218103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b141e6c1-d799-4db9-b486-e75d21a80013 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:53.249148 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b141e6c1-d799-4db9-b486-e75d21a80013 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1681 microversion: 2.1 time: 0.963087 Oct 24 10:41:53.250447 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1896/3837] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:52 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1681 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:53.261485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-08fa3c39-75d9-42a9-9030-04940f51cb82 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:53.262975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-08fa3c39-75d9-42a9-9030-04940f51cb82 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:53.309329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08fa3c39-75d9-42a9-9030-04940f51cb82 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:53.324180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08fa3c39-75d9-42a9-9030-04940f51cb82 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:53.325428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08fa3c39-75d9-42a9-9030-04940f51cb82 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:53.326591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08fa3c39-75d9-42a9-9030-04940f51cb82 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:53.329396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08fa3c39-75d9-42a9-9030-04940f51cb82 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:53.330046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08fa3c39-75d9-42a9-9030-04940f51cb82 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:53.387499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-49303eed-0954-48e4-9224-110ebafb24b1 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:53.396387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-49303eed-0954-48e4-9224-110ebafb24b1 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:53.411044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-49303eed-0954-48e4-9224-110ebafb24b1 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:53.422045 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-49303eed-0954-48e4-9224-110ebafb24b1 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1409 microversion: 2.54 time: 0.366162 Oct 24 10:41:53.440870 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1942/3838] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:41:53 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1409 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:41:53.449236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3fcf8baf-fc61-4f35-89df-b4976d8f45d7 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Action: 'create', calling method: .version_select at 0x7f04d07f81f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-921356386", "description": "tempest-description-1991764475"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:53.524150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-08fa3c39-75d9-42a9-9030-04940f51cb82 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:53.532538 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-08fa3c39-75d9-42a9-9030-04940f51cb82 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1280 microversion: 2.1 time: 0.280768 Oct 24 10:41:53.545309 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1897/3839] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:53 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1280 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:53.550310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3b0f8f60-d890-4301-ac57-8cdd757c09c3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:53.551502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3b0f8f60-d890-4301-ac57-8cdd757c09c3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:53.567888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b0f8f60-d890-4301-ac57-8cdd757c09c3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:53.568389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b0f8f60-d890-4301-ac57-8cdd757c09c3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:53.568906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b0f8f60-d890-4301-ac57-8cdd757c09c3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:53.569600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b0f8f60-d890-4301-ac57-8cdd757c09c3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:53.570062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b0f8f60-d890-4301-ac57-8cdd757c09c3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:53.570494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b0f8f60-d890-4301-ac57-8cdd757c09c3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:54.052869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3b0f8f60-d890-4301-ac57-8cdd757c09c3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:54.064285 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3b0f8f60-d890-4301-ac57-8cdd757c09c3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1303 microversion: 2.1 time: 0.517748 Oct 24 10:41:54.065036 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1898/3840] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:53 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1303 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:54.277581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-25a226a0-c1c0-43e8-911b-274e8a9578d0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:54.278288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-25a226a0-c1c0-43e8-911b-274e8a9578d0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:54.292579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25a226a0-c1c0-43e8-911b-274e8a9578d0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:54.294244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25a226a0-c1c0-43e8-911b-274e8a9578d0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:54.294716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25a226a0-c1c0-43e8-911b-274e8a9578d0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:54.295725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25a226a0-c1c0-43e8-911b-274e8a9578d0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:54.299898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25a226a0-c1c0-43e8-911b-274e8a9578d0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:54.300154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25a226a0-c1c0-43e8-911b-274e8a9578d0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:54.341854 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3fcf8baf-fc61-4f35-89df-b4976d8f45d7 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.909342 Oct 24 10:41:54.343338 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1943/3841] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:41:53 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:41:54.360096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d13d0af-0205-4e8f-87f6-23d12616fa91 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Action: 'create', calling method: .version_select at 0x7f04d0df7b80>, body: {"security_group_rule": {"parent_group_id": "36501771-5fe6-4ae8-9b1a-4b7e33163548", "ip_protocol": "tcp", "from_port": 439419843, "to_port": 22}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:54.590092 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-2d13d0af-0205-4e8f-87f6-23d12616fa91 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] HTTP exception thrown: Invalid port range 439419843:22. Former value cannot be greater than the later Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d13d0af-0205-4e8f-87f6-23d12616fa91 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Request method failure captured: Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 145 Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmvq_ErMm0TYj1KvIBwglnPbLCISRgFXSJzN6zZrJjN2xlB9Vo1NepxbI9_wKrJkkvIRLsE4X0veb_v9DGGiHMjll9xwqxt1fzYTjO0Ns9iGDBYBfHkCDW9car5qnD1JlWFK2WOuDVGCeqjiur7ewFdk6MyOjskZKb_uv1_FFUSNiIA Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 8413ce3d6e5c41e7b8252e1bfa6e313c Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8413ce3d6e5c41e7b8252e1bfa6e313c", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 8413ce3d6e5c41e7b8252e1bfa6e313c Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 2665f9fda1af462d8d93758fac9318e7 Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: {"security_group_rule": {"parent_group_id": "36501771-5fe6-4ae8-9b1a-4b7e33163548", "ip_protocol": "tcp", "from_port": 439419843, "to_port": 22}} Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid port range 439419843:22. Former value cannot be greater than the later Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'security_group_rule': {'parent_group_id': '36501771-5fe6-4ae8-9b1a-4b7e33163548', 'ip_protocol': 'tcp', 'from_port': 439419843, 'to_port': 22}}} Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 439419843:22. Former value cannot be greater than the later Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 439419843:22. Former value cannot be greater than the later Oct 24 10:41:54.592457 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:54.602721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:54.602721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:54.602721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:54.602721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:54.602721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:54.602721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:54.602721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:54.602721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 439419843:22. Former value cannot be greater than the later Oct 24 10:41:54.602721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:54.602721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d13d0af-0205-4e8f-87f6-23d12616fa91 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Returning 400 to user: Invalid port range 439419843:22. Former value cannot be greater than the later {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:54.602721 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2d13d0af-0205-4e8f-87f6-23d12616fa91 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.240461 Oct 24 10:41:54.602721 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1944/3842] 10.222.0.50 () {60 vars in 1195 bytes} [Mon Oct 24 10:41:54 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 242 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 10:41:54.611430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-03939a2b-54dc-4674-9a30-3dcf9a540b47 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:54.612055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-03939a2b-54dc-4674-9a30-3dcf9a540b47 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:54.636604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-25a226a0-c1c0-43e8-911b-274e8a9578d0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:54.641731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03939a2b-54dc-4674-9a30-3dcf9a540b47 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:54.643699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03939a2b-54dc-4674-9a30-3dcf9a540b47 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:54.645211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03939a2b-54dc-4674-9a30-3dcf9a540b47 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:54.646956 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-25a226a0-c1c0-43e8-911b-274e8a9578d0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1681 microversion: 2.1 time: 0.373135 Oct 24 10:41:54.647550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03939a2b-54dc-4674-9a30-3dcf9a540b47 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:54.648043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03939a2b-54dc-4674-9a30-3dcf9a540b47 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:54.648486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03939a2b-54dc-4674-9a30-3dcf9a540b47 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:54.650670 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1899/3843] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:54 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1681 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:41:54.662506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fb6a4f6a-288a-4673-a3fb-77244246890e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:54.669136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fb6a4f6a-288a-4673-a3fb-77244246890e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:54.699519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb6a4f6a-288a-4673-a3fb-77244246890e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:54.702566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb6a4f6a-288a-4673-a3fb-77244246890e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:54.704673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb6a4f6a-288a-4673-a3fb-77244246890e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:54.706777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb6a4f6a-288a-4673-a3fb-77244246890e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:54.710962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb6a4f6a-288a-4673-a3fb-77244246890e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:54.711509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb6a4f6a-288a-4673-a3fb-77244246890e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:54.902734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-03939a2b-54dc-4674-9a30-3dcf9a540b47 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:54.953555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-03939a2b-54dc-4674-9a30-3dcf9a540b47 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:54.967458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-03939a2b-54dc-4674-9a30-3dcf9a540b47 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:54.969703 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-03939a2b-54dc-4674-9a30-3dcf9a540b47 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1409 microversion: 2.54 time: 0.371964 Oct 24 10:41:54.975137 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1945/3844] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:41:54 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1409 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:41:54.981731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fb6a4f6a-288a-4673-a3fb-77244246890e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:55.013055 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fb6a4f6a-288a-4673-a3fb-77244246890e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1280 microversion: 2.1 time: 0.358034 Oct 24 10:41:55.017296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5c91f88e-3174-4d79-b073-7bdfe624b5f6 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Action: 'create', calling method: .version_select at 0x7f04d085f1f0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1472735652", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:55.021730 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-5c91f88e-3174-4d79-b073-7bdfe624b5f6 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] HTTP exception thrown: Security group id should be uuid Oct 24 10:41:55.027317 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1900/3845] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:54 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1280 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5c91f88e-3174-4d79-b073-7bdfe624b5f6 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Request method failure captured: Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 131 Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmvq_ErMm0TYj1KvIBwglnPbLCISRgFXSJzN6zZrJjN2xlB9Vo1NepxbI9_wKrJkkvIRLsE4X0veb_v9DGGiHMjll9xwqxt1fzYTjO0Ns9iGDBYBfHkCDW9car5qnD1JlWFK2WOuDVGCeqjiur7ewFdk6MyOjskZKb_uv1_FFUSNiIA Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 8413ce3d6e5c41e7b8252e1bfa6e313c Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8413ce3d6e5c41e7b8252e1bfa6e313c", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 8413ce3d6e5c41e7b8252e1bfa6e313c Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 2665f9fda1af462d8d93758fac9318e7 Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1472735652", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: exception: Security group id should be uuid Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1472735652', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:55.033042 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:55.045915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 24 10:41:55.045915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:55.056185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5c91f88e-3174-4d79-b073-7bdfe624b5f6 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Returning 400 to user: Security group id should be uuid {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:55.060529 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5c91f88e-3174-4d79-b073-7bdfe624b5f6 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.082626 Oct 24 10:41:55.065400 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1946/3846] 10.222.0.50 () {60 vars in 1195 bytes} [Mon Oct 24 10:41:54 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 88 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 10:41:55.080422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cc1a125f-acf2-4a1b-b063-11610659c873 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Action: 'create', calling method: .version_select at 0x7f04cbbc4790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-440713222", "description": "tempest-description-372270756"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:55.109265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d2f9f667-3b7f-4195-9b72-5ba26d918a77 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:55.113387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d2f9f667-3b7f-4195-9b72-5ba26d918a77 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:55.154798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2f9f667-3b7f-4195-9b72-5ba26d918a77 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:55.165370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2f9f667-3b7f-4195-9b72-5ba26d918a77 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:55.166420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2f9f667-3b7f-4195-9b72-5ba26d918a77 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:55.167692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2f9f667-3b7f-4195-9b72-5ba26d918a77 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:55.168500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2f9f667-3b7f-4195-9b72-5ba26d918a77 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:55.169277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2f9f667-3b7f-4195-9b72-5ba26d918a77 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:56.192242 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cc1a125f-acf2-4a1b-b063-11610659c873 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.120643 Oct 24 10:41:56.194285 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1901/3847] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:41:55 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:41:56.199958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f74fd2d5-ed75-4b2b-ae0d-2dee61af1d07 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:56.200750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f74fd2d5-ed75-4b2b-ae0d-2dee61af1d07 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:56.215892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f74fd2d5-ed75-4b2b-ae0d-2dee61af1d07 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:56.216621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f74fd2d5-ed75-4b2b-ae0d-2dee61af1d07 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:56.217345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f74fd2d5-ed75-4b2b-ae0d-2dee61af1d07 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:56.218562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f74fd2d5-ed75-4b2b-ae0d-2dee61af1d07 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:56.221404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f74fd2d5-ed75-4b2b-ae0d-2dee61af1d07 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:56.222114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f74fd2d5-ed75-4b2b-ae0d-2dee61af1d07 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:56.417809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d2f9f667-3b7f-4195-9b72-5ba26d918a77 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:56.437261 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d2f9f667-3b7f-4195-9b72-5ba26d918a77 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1303 microversion: 2.1 time: 1.341896 Oct 24 10:41:56.438241 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1947/3848] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:55 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1303 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:56.447097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6bc9b451-b901-46e2-a71b-8c3d00529494 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:56.447920 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6bc9b451-b901-46e2-a71b-8c3d00529494 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:56.479088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6bc9b451-b901-46e2-a71b-8c3d00529494 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:56.479904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6bc9b451-b901-46e2-a71b-8c3d00529494 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:56.480622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6bc9b451-b901-46e2-a71b-8c3d00529494 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:56.481621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6bc9b451-b901-46e2-a71b-8c3d00529494 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:56.485600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6bc9b451-b901-46e2-a71b-8c3d00529494 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:56.486343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6bc9b451-b901-46e2-a71b-8c3d00529494 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:56.770559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6bc9b451-b901-46e2-a71b-8c3d00529494 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:56.791104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6bc9b451-b901-46e2-a71b-8c3d00529494 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:56.793821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6bc9b451-b901-46e2-a71b-8c3d00529494 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:56.795085 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6bc9b451-b901-46e2-a71b-8c3d00529494 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1409 microversion: 2.54 time: 0.355681 Oct 24 10:41:56.795669 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1948/3849] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:41:56 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1409 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:41:56.825246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b7d3399c-f0a3-4db0-90f9-22ef1ace579e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:56.826337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b7d3399c-f0a3-4db0-90f9-22ef1ace579e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:56.844188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7d3399c-f0a3-4db0-90f9-22ef1ace579e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:56.846206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7d3399c-f0a3-4db0-90f9-22ef1ace579e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:56.846847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7d3399c-f0a3-4db0-90f9-22ef1ace579e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:56.849385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7d3399c-f0a3-4db0-90f9-22ef1ace579e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:56.850233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7d3399c-f0a3-4db0-90f9-22ef1ace579e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:56.851273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7d3399c-f0a3-4db0-90f9-22ef1ace579e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:56.891010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f74fd2d5-ed75-4b2b-ae0d-2dee61af1d07 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:56.904323 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f74fd2d5-ed75-4b2b-ae0d-2dee61af1d07 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1681 microversion: 2.1 time: 0.707304 Oct 24 10:41:56.905215 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1902/3850] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:56 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1681 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:56.940395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf2b7192-36c9-4bc4-ad72-4e9e62074cb5 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Action: 'create', calling method: .version_select at 0x7f04d0d76940>, body: {"security_group_rule": {"parent_group_id": "f76048e2-4cd0-4449-b4ea-cc1514a146c1", "ip_protocol": "tempest-999-2133379707", "from_port": 22, "to_port": 22}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:56.954190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:41:57.183968 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-bf2b7192-36c9-4bc4-ad72-4e9e62074cb5 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] HTTP exception thrown: Invalid IP protocol tempest-999-2133379707. Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf2b7192-36c9-4bc4-ad72-4e9e62074cb5 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Request method failure captured: Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 157 Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmvq_ErMm0TYj1KvIBwglnPbLCISRgFXSJzN6zZrJjN2xlB9Vo1NepxbI9_wKrJkkvIRLsE4X0veb_v9DGGiHMjll9xwqxt1fzYTjO0Ns9iGDBYBfHkCDW9car5qnD1JlWFK2WOuDVGCeqjiur7ewFdk6MyOjskZKb_uv1_FFUSNiIA Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 8413ce3d6e5c41e7b8252e1bfa6e313c Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8413ce3d6e5c41e7b8252e1bfa6e313c", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 8413ce3d6e5c41e7b8252e1bfa6e313c Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2665f9fda1af462d8d93758fac9318e7 Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: {"security_group_rule": {"parent_group_id": "f76048e2-4cd0-4449-b4ea-cc1514a146c1", "ip_protocol": "tempest-999-2133379707", "from_port": 22, "to_port": 22}} Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid IP protocol tempest-999-2133379707. Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f76048e2-4cd0-4449-b4ea-cc1514a146c1', 'ip_protocol': 'tempest-999-2133379707', 'from_port': 22, 'to_port': 22}}} Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-2133379707. Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-2133379707. Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:57.185968 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:57.192213 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:57.192213 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:57.192213 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:57.192213 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:57.192213 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:57.192213 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:57.192213 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-2133379707. Oct 24 10:41:57.192213 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:57.192213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf2b7192-36c9-4bc4-ad72-4e9e62074cb5 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Returning 400 to user: Invalid IP protocol tempest-999-2133379707. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:57.193486 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bf2b7192-36c9-4bc4-ad72-4e9e62074cb5 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.262992 Oct 24 10:41:57.194704 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1903/3851] 10.222.0.50 () {60 vars in 1195 bytes} [Mon Oct 24 10:41:56 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 267 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 10:41:57.207577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b1d1f3c6-bd17-4443-b17b-7e579b560a6f tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Action: 'create', calling method: .version_select at 0x7f04d0254670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-267967330", "description": "tempest-description-150893745"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:57.330404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b7d3399c-f0a3-4db0-90f9-22ef1ace579e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:57.345412 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b7d3399c-f0a3-4db0-90f9-22ef1ace579e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1322 microversion: 2.1 time: 0.547338 Oct 24 10:41:57.346936 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1949/3852] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:56 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:57.456231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=30 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:41:57.474564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-34880b3e-a43e-4a01-9664-86890bebd533 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:57.477389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-34880b3e-a43e-4a01-9664-86890bebd533 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:57.511391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34880b3e-a43e-4a01-9664-86890bebd533 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:57.512323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34880b3e-a43e-4a01-9664-86890bebd533 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:57.513652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34880b3e-a43e-4a01-9664-86890bebd533 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:57.517415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34880b3e-a43e-4a01-9664-86890bebd533 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:57.518141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34880b3e-a43e-4a01-9664-86890bebd533 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:57.518804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34880b3e-a43e-4a01-9664-86890bebd533 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:57.965575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-34880b3e-a43e-4a01-9664-86890bebd533 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:57.975558 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-34880b3e-a43e-4a01-9664-86890bebd533 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1303 microversion: 2.1 time: 0.512941 Oct 24 10:41:57.990191 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1950/3853] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:57 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1303 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:57.997678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-7e24b400-a216-4228-a41f-fbadfe99348f req-6d41c153-9c19-4234-9417-2e172f7e9bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd604035-ef97-496b-a5fe-0204c8dc7e46", "tag": "b9e3bdde-6565-4e35-b42c-0f27f26f4e5d"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:58.008998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7e24b400-a216-4228-a41f-fbadfe99348f req-6d41c153-9c19-4234-9417-2e172f7e9bb3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:58.009772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7e24b400-a216-4228-a41f-fbadfe99348f req-6d41c153-9c19-4234-9417-2e172f7e9bb3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:58.010409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7e24b400-a216-4228-a41f-fbadfe99348f req-6d41c153-9c19-4234-9417-2e172f7e9bb3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:58.022813 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-7e24b400-a216-4228-a41f-fbadfe99348f req-6d41c153-9c19-4234-9417-2e172f7e9bb3 service nova] Creating event network-changed:b9e3bdde-6565-4e35-b42c-0f27f26f4e5d for instance dd604035-ef97-496b-a5fe-0204c8dc7e46 on n-h2-858383-15 Oct 24 10:41:58.028529 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-7e24b400-a216-4228-a41f-fbadfe99348f req-6d41c153-9c19-4234-9417-2e172f7e9bb3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036686 Oct 24 10:41:58.029588 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1951/3854] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:41:58.035148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0e95d86e-9d55-4c64-970e-efd187287171 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:58.036531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0e95d86e-9d55-4c64-970e-efd187287171 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:58.043354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e95d86e-9d55-4c64-970e-efd187287171 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:58.043796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e95d86e-9d55-4c64-970e-efd187287171 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:58.044476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e95d86e-9d55-4c64-970e-efd187287171 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:58.045229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e95d86e-9d55-4c64-970e-efd187287171 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:58.045847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e95d86e-9d55-4c64-970e-efd187287171 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:58.046284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e95d86e-9d55-4c64-970e-efd187287171 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:58.065023 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b1d1f3c6-bd17-4443-b17b-7e579b560a6f tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.864960 Oct 24 10:41:58.066689 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1904/3855] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:41:57 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:41:58.073104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8d085061-efb6-485a-81c7-27d2214ffa82 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:58.073977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8d085061-efb6-485a-81c7-27d2214ffa82 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:58.093252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d085061-efb6-485a-81c7-27d2214ffa82 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:58.094037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d085061-efb6-485a-81c7-27d2214ffa82 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:58.094983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d085061-efb6-485a-81c7-27d2214ffa82 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:58.096596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d085061-efb6-485a-81c7-27d2214ffa82 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:58.099062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d085061-efb6-485a-81c7-27d2214ffa82 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:58.100039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d085061-efb6-485a-81c7-27d2214ffa82 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:58.216333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0e95d86e-9d55-4c64-970e-efd187287171 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:58.230121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0e95d86e-9d55-4c64-970e-efd187287171 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:58.233368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0e95d86e-9d55-4c64-970e-efd187287171 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:58.234123 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0e95d86e-9d55-4c64-970e-efd187287171 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1409 microversion: 2.54 time: 0.203297 Oct 24 10:41:58.235342 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1952/3856] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:41:58 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1409 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:41:58.240711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7b36cf67-b304-4570-a8bd-94a41420815f tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Action: 'create', calling method: .version_select at 0x7f04d0b628b0>, body: {"security_group_rule": {"parent_group_id": "f9e94075-e5e2-42f7-8b2d-504972c96b57", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:58.348106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:41:58.391212 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-7b36cf67-b304-4570-a8bd-94a41420815f tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7b36cf67-b304-4570-a8bd-94a41420815f tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Request method failure captured: Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 138 Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmvq_ErMm0TYj1KvIBwglnPbLCISRgFXSJzN6zZrJjN2xlB9Vo1NepxbI9_wKrJkkvIRLsE4X0veb_v9DGGiHMjll9xwqxt1fzYTjO0Ns9iGDBYBfHkCDW9car5qnD1JlWFK2WOuDVGCeqjiur7ewFdk6MyOjskZKb_uv1_FFUSNiIA Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 8413ce3d6e5c41e7b8252e1bfa6e313c Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8413ce3d6e5c41e7b8252e1bfa6e313c", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 8413ce3d6e5c41e7b8252e1bfa6e313c Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 2665f9fda1af462d8d93758fac9318e7 Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: {"security_group_rule": {"parent_group_id": "f9e94075-e5e2-42f7-8b2d-504972c96b57", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f9e94075-e5e2-42f7-8b2d-504972c96b57', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 24 10:41:58.398116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:58.404181 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:58.404181 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:58.404181 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:58.404181 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:58.404181 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:58.404181 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:58.404181 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:58.404181 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 24 10:41:58.404181 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:41:58.406891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7b36cf67-b304-4570-a8bd-94a41420815f tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:58.410000 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7b36cf67-b304-4570-a8bd-94a41420815f tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.171978 Oct 24 10:41:58.411974 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1953/3857] 10.222.0.50 () {60 vars in 1195 bytes} [Mon Oct 24 10:41:58 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:41:58.419993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-234a8a57-bdc3-4e4b-a2c9-9a51b28a6d01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:58.421199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-234a8a57-bdc3-4e4b-a2c9-9a51b28a6d01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:58.449926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-234a8a57-bdc3-4e4b-a2c9-9a51b28a6d01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:58.450482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8d085061-efb6-485a-81c7-27d2214ffa82 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:58.452074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-234a8a57-bdc3-4e4b-a2c9-9a51b28a6d01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:58.453409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-234a8a57-bdc3-4e4b-a2c9-9a51b28a6d01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:58.454209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-234a8a57-bdc3-4e4b-a2c9-9a51b28a6d01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:58.454692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-234a8a57-bdc3-4e4b-a2c9-9a51b28a6d01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:58.455165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-234a8a57-bdc3-4e4b-a2c9-9a51b28a6d01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:58.486543 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8d085061-efb6-485a-81c7-27d2214ffa82 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1681 microversion: 2.1 time: 0.412194 Oct 24 10:41:58.489217 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1905/3858] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:58 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1681 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:58.525074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-67d25204-8dd3-4e83-a44a-98bdcec7b3ef tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Action: 'create', calling method: .version_select at 0x7f04cbbc4550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-76841733", "description": "tempest-description-1557096697"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:58.822991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-234a8a57-bdc3-4e4b-a2c9-9a51b28a6d01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:58.867868 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-234a8a57-bdc3-4e4b-a2c9-9a51b28a6d01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1322 microversion: 2.1 time: 0.449624 Oct 24 10:41:58.869001 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1954/3859] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:58 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:58.968603 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-67d25204-8dd3-4e83-a44a-98bdcec7b3ef tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.475968 Oct 24 10:41:58.973665 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1906/3860] 10.222.0.50 () {60 vars in 1180 bytes} [Mon Oct 24 10:41:58 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:41:58.975190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-59d2f5c1-4a9f-4bcb-98d7-6ec762c4399b req-9822ab51-a2eb-4dc4-b57a-49776bc86408 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d350ab27-db77-49c3-8270-682320f4bd1e", "tag": "e858bb76-d557-489c-9e4b-de662c087a76"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:58.994229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-265d6bdb-1bcb-4c10-8ba6-9edb18098151 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Action: 'create', calling method: .version_select at 0x7f04d0202310>, body: {"security_group_rule": {"parent_group_id": "f881006e-d2c5-4e1e-acb7-5e40e803bf2f", "ip_protocol": "tcp", "from_port": 22, "to_port": 1352997147}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:58.994627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-59d2f5c1-4a9f-4bcb-98d7-6ec762c4399b req-9822ab51-a2eb-4dc4-b57a-49776bc86408 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:58.997175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-59d2f5c1-4a9f-4bcb-98d7-6ec762c4399b req-9822ab51-a2eb-4dc4-b57a-49776bc86408 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:58.999065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-59d2f5c1-4a9f-4bcb-98d7-6ec762c4399b req-9822ab51-a2eb-4dc4-b57a-49776bc86408 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:59.081224 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-59d2f5c1-4a9f-4bcb-98d7-6ec762c4399b req-9822ab51-a2eb-4dc4-b57a-49776bc86408 service nova] Creating event network-changed:e858bb76-d557-489c-9e4b-de662c087a76 for instance d350ab27-db77-49c3-8270-682320f4bd1e on n-h1-858383-15 Oct 24 10:41:59.095407 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-265d6bdb-1bcb-4c10-8ba6-9edb18098151 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] HTTP exception thrown: Invalid port range 22:1352997147. Valid TCP ports should be between 1-65535 Oct 24 10:41:59.095632 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-59d2f5c1-4a9f-4bcb-98d7-6ec762c4399b req-9822ab51-a2eb-4dc4-b57a-49776bc86408 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128316 Oct 24 10:41:59.097308 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1955/3861] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-265d6bdb-1bcb-4c10-8ba6-9edb18098151 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Request method failure captured: Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 146 Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmvq_ErMm0TYj1KvIBwglnPbLCISRgFXSJzN6zZrJjN2xlB9Vo1NepxbI9_wKrJkkvIRLsE4X0veb_v9DGGiHMjll9xwqxt1fzYTjO0Ns9iGDBYBfHkCDW9car5qnD1JlWFK2WOuDVGCeqjiur7ewFdk6MyOjskZKb_uv1_FFUSNiIA Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 8413ce3d6e5c41e7b8252e1bfa6e313c Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8413ce3d6e5c41e7b8252e1bfa6e313c", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 8413ce3d6e5c41e7b8252e1bfa6e313c Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2665f9fda1af462d8d93758fac9318e7 Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: {"security_group_rule": {"parent_group_id": "f881006e-d2c5-4e1e-acb7-5e40e803bf2f", "ip_protocol": "tcp", "from_port": 22, "to_port": 1352997147}} Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid port range 22:1352997147. Valid TCP ports should be between 1-65535 Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f881006e-d2c5-4e1e-acb7-5e40e803bf2f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1352997147}}} Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1352997147. Valid TCP ports should be between 1-65535 Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1352997147. Valid TCP ports should be between 1-65535 Oct 24 10:41:59.098568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.104558 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:59.104558 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.104558 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:59.104558 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:59.104558 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:59.104558 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:59.104558 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:59.104558 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1352997147. Valid TCP ports should be between 1-65535 Oct 24 10:41:59.104558 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.104558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-265d6bdb-1bcb-4c10-8ba6-9edb18098151 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Returning 400 to user: Invalid port range 22:1352997147. Valid TCP ports should be between 1-65535 {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:59.104558 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-265d6bdb-1bcb-4c10-8ba6-9edb18098151 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.114539 Oct 24 10:41:59.104558 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1907/3862] 10.222.0.50 () {60 vars in 1195 bytes} [Mon Oct 24 10:41:58 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 10:41:59.116264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-978678c6-5dbf-4284-8460-581233f189ee tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:59.117394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-978678c6-5dbf-4284-8460-581233f189ee tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:59.125695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-978678c6-5dbf-4284-8460-581233f189ee tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:59.126298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-978678c6-5dbf-4284-8460-581233f189ee tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:59.127016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-978678c6-5dbf-4284-8460-581233f189ee tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:59.127992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-978678c6-5dbf-4284-8460-581233f189ee tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:59.130804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-978678c6-5dbf-4284-8460-581233f189ee tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:59.132097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-978678c6-5dbf-4284-8460-581233f189ee tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:59.137960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eb8a4c50-46f6-4296-8280-d1b8cd0e68c6 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Action: 'create', calling method: .version_select at 0x7f04cbc1b5e0>, body: {"security_group_rule": {"parent_group_id": "20af5044-7a58-4eeb-b32c-2102400441e3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:59.159219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:41:59.179363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG neutronclient.v2_0.client [None req-eb8a4c50-46f6-4296-8280-d1b8cd0e68c6 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 20af5044-7a58-4eeb-b32c-2102400441e3 does not exist", "detail": ""}} {{(pid=120425) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:41:59.183745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.security_group_api [None req-eb8a4c50-46f6-4296-8280-d1b8cd0e68c6 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Neutron security group 20af5044-7a58-4eeb-b32c-2102400441e3 not found {{(pid=120425) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 24 10:41:59.184660 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-eb8a4c50-46f6-4296-8280-d1b8cd0e68c6 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] HTTP exception thrown: Security group 20af5044-7a58-4eeb-b32c-2102400441e3 does not exist Oct 24 10:41:59.184660 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-59485682-ee9b-481b-acfa-52ac53290be4'] Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eb8a4c50-46f6-4296-8280-d1b8cd0e68c6 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Request method failure captured: Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 138 Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmvq_ErMm0TYj1KvIBwglnPbLCISRgFXSJzN6zZrJjN2xlB9Vo1NepxbI9_wKrJkkvIRLsE4X0veb_v9DGGiHMjll9xwqxt1fzYTjO0Ns9iGDBYBfHkCDW9car5qnD1JlWFK2WOuDVGCeqjiur7ewFdk6MyOjskZKb_uv1_FFUSNiIA Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 8413ce3d6e5c41e7b8252e1bfa6e313c Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8413ce3d6e5c41e7b8252e1bfa6e313c", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 8413ce3d6e5c41e7b8252e1bfa6e313c Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2665f9fda1af462d8d93758fac9318e7 Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: {"security_group_rule": {"parent_group_id": "20af5044-7a58-4eeb-b32c-2102400441e3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: exception: Security group 20af5044-7a58-4eeb-b32c-2102400441e3 does not exist Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-59485682-ee9b-481b-acfa-52ac53290be4'] Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'security_group_rule': {'parent_group_id': '20af5044-7a58-4eeb-b32c-2102400441e3', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:41:59.190809 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 20af5044-7a58-4eeb-b32c-2102400441e3 does not exist Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59485682-ee9b-481b-acfa-52ac53290be4'] Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 20af5044-7a58-4eeb-b32c-2102400441e3 does not exist Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59485682-ee9b-481b-acfa-52ac53290be4'] Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 20af5044-7a58-4eeb-b32c-2102400441e3 does not exist Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59485682-ee9b-481b-acfa-52ac53290be4'] Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 20af5044-7a58-4eeb-b32c-2102400441e3 does not exist Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59485682-ee9b-481b-acfa-52ac53290be4'] Oct 24 10:41:59.200381 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.206786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eb8a4c50-46f6-4296-8280-d1b8cd0e68c6 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Returning 404 to user: Security group 20af5044-7a58-4eeb-b32c-2102400441e3 does not exist Oct 24 10:41:59.206786 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-59485682-ee9b-481b-acfa-52ac53290be4'] {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:59.206786 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eb8a4c50-46f6-4296-8280-d1b8cd0e68c6 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.095229 Oct 24 10:41:59.207843 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1908/3863] 10.222.0.50 () {60 vars in 1195 bytes} [Mon Oct 24 10:41:59 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:41:59.217250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-65b9fbe8-450e-4484-b010-1f10e8008502 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Calling method '.version_select at 0x7f04cbbc4670>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:59.290171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG neutronclient.v2_0.client [None req-65b9fbe8-450e-4484-b010-1f10e8008502 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule c65fec78-6311-4323-9ed3-3a326dd6d4a9 does not exist", "detail": ""}} {{(pid=120425) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 24 10:41:59.290941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.security_group_api [None req-65b9fbe8-450e-4484-b010-1f10e8008502 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Neutron security group rule c65fec78-6311-4323-9ed3-3a326dd6d4a9 not found {{(pid=120425) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 24 10:41:59.291554 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-65b9fbe8-450e-4484-b010-1f10e8008502 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] HTTP exception thrown: Security group rule c65fec78-6311-4323-9ed3-3a326dd6d4a9 does not exist Oct 24 10:41:59.291554 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-9f8b749e-a1be-4b5f-a42d-efe8667f6fa3'] Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-65b9fbe8-450e-4484-b010-1f10e8008502 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Request method failure captured: Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/os-security-group-rules/c65fec78-6311-4323-9ed3-3a326dd6d4a9 HTTP/1.1 Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmvq_ErMm0TYj1KvIBwglnPbLCISRgFXSJzN6zZrJjN2xlB9Vo1NepxbI9_wKrJkkvIRLsE4X0veb_v9DGGiHMjll9xwqxt1fzYTjO0Ns9iGDBYBfHkCDW9car5qnD1JlWFK2WOuDVGCeqjiur7ewFdk6MyOjskZKb_uv1_FFUSNiIA Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 8413ce3d6e5c41e7b8252e1bfa6e313c Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8413ce3d6e5c41e7b8252e1bfa6e313c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8413ce3d6e5c41e7b8252e1bfa6e313c", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 8413ce3d6e5c41e7b8252e1bfa6e313c Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325 Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2665f9fda1af462d8d93758fac9318e7 Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: exception: Security group rule c65fec78-6311-4323-9ed3-3a326dd6d4a9 does not exist Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-9f8b749e-a1be-4b5f-a42d-efe8667f6fa3'] Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'c65fec78-6311-4323-9ed3-3a326dd6d4a9'} Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 24 10:41:59.294071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule c65fec78-6311-4323-9ed3-3a326dd6d4a9 does not exist Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f8b749e-a1be-4b5f-a42d-efe8667f6fa3'] Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule c65fec78-6311-4323-9ed3-3a326dd6d4a9 does not exist Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f8b749e-a1be-4b5f-a42d-efe8667f6fa3'] Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule c65fec78-6311-4323-9ed3-3a326dd6d4a9 does not exist Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f8b749e-a1be-4b5f-a42d-efe8667f6fa3'] Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule c65fec78-6311-4323-9ed3-3a326dd6d4a9 does not exist Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f8b749e-a1be-4b5f-a42d-efe8667f6fa3'] Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-65b9fbe8-450e-4484-b010-1f10e8008502 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Returning 404 to user: Security group rule c65fec78-6311-4323-9ed3-3a326dd6d4a9 does not exist Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: Neutron server returns request_ids: ['req-9f8b749e-a1be-4b5f-a42d-efe8667f6fa3'] {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:41:59.301964 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-65b9fbe8-450e-4484-b010-1f10e8008502 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-group-rules/c65fec78-6311-4323-9ed3-3a326dd6d4a9" status: 404 len: 199 microversion: 2.1 time: 0.086254 Oct 24 10:41:59.310306 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1909/3864] 10.222.0.50 () {58 vars in 1287 bytes} [Mon Oct 24 10:41:59 2022] DELETE /compute/v2.1/os-security-group-rules/c65fec78-6311-4323-9ed3-3a326dd6d4a9 => generated 199 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:41:59.313028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-646ae790-8775-47c1-a877-8b8a9a04a6fa tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:59.313769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-646ae790-8775-47c1-a877-8b8a9a04a6fa tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:59.320720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-646ae790-8775-47c1-a877-8b8a9a04a6fa tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:59.321460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-646ae790-8775-47c1-a877-8b8a9a04a6fa tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:59.321999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-646ae790-8775-47c1-a877-8b8a9a04a6fa tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:59.322810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-646ae790-8775-47c1-a877-8b8a9a04a6fa tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:59.323481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-646ae790-8775-47c1-a877-8b8a9a04a6fa tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:59.324005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-646ae790-8775-47c1-a877-8b8a9a04a6fa tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:59.382694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-978678c6-5dbf-4284-8460-581233f189ee tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:59.397612 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-978678c6-5dbf-4284-8460-581233f189ee tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1291 microversion: 2.1 time: 0.289559 Oct 24 10:41:59.399019 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1956/3865] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:59 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1291 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:59.404824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b6392877-fdd5-47d4-9e40-b28d211d609b tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Calling method '.version_select at 0x7f04d0bb7820>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:59.471726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-646ae790-8775-47c1-a877-8b8a9a04a6fa tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:59.484320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:41:59.484666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-646ae790-8775-47c1-a877-8b8a9a04a6fa tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:59.498351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-646ae790-8775-47c1-a877-8b8a9a04a6fa tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:59.502960 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-646ae790-8775-47c1-a877-8b8a9a04a6fa tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1409 microversion: 2.54 time: 0.193165 Oct 24 10:41:59.503658 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1910/3866] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:41:59 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1409 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:41:59.529572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b57f1236-d57e-49d4-a8fb-2f61719486e4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:59.530197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b57f1236-d57e-49d4-a8fb-2f61719486e4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:59.542965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b57f1236-d57e-49d4-a8fb-2f61719486e4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:59.543462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b57f1236-d57e-49d4-a8fb-2f61719486e4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:59.543905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b57f1236-d57e-49d4-a8fb-2f61719486e4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:59.544620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b57f1236-d57e-49d4-a8fb-2f61719486e4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:59.545120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b57f1236-d57e-49d4-a8fb-2f61719486e4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:59.545536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b57f1236-d57e-49d4-a8fb-2f61719486e4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:59.793596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b57f1236-d57e-49d4-a8fb-2f61719486e4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:41:59.808114 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b57f1236-d57e-49d4-a8fb-2f61719486e4 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1658 microversion: 2.1 time: 0.283465 Oct 24 10:41:59.825679 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1911/3867] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:59 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1658 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:41:59.837771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8266113c-a733-42c9-bb6e-6f76e4631259 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:41:59.851773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8266113c-a733-42c9-bb6e-6f76e4631259 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:59.852908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8266113c-a733-42c9-bb6e-6f76e4631259 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:59.853414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8266113c-a733-42c9-bb6e-6f76e4631259 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:59.857066 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b6392877-fdd5-47d4-9e40-b28d211d609b tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/f881006e-d2c5-4e1e-acb7-5e40e803bf2f" status: 202 len: 0 microversion: 2.1 time: 0.456710 Oct 24 10:41:59.857662 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1957/3868] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:41:59 2022] DELETE /compute/v2.1/os-security-groups/f881006e-d2c5-4e1e-acb7-5e40e803bf2f => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:41:59.866410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6df7fa53-3d2f-4a8e-9a67-39a61a32cd9a tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Calling method '.version_select at 0x7f04d0ca7d30>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:59.891132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8266113c-a733-42c9-bb6e-6f76e4631259 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Going to try to start instance {{(pid=120425) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 10:41:59.965833 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8266113c-a733-42c9-bb6e-6f76e4631259 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 202 len: 0 microversion: 2.1 time: 0.133174 Oct 24 10:41:59.967396 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1912/3869] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:41:59 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:41:59.976453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-96a1423d-4e2b-4745-8232-6d60ba350dc4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:41:59.977751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-96a1423d-4e2b-4745-8232-6d60ba350dc4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:41:59.985294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96a1423d-4e2b-4745-8232-6d60ba350dc4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:59.986053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96a1423d-4e2b-4745-8232-6d60ba350dc4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:59.987281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96a1423d-4e2b-4745-8232-6d60ba350dc4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:41:59.989150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96a1423d-4e2b-4745-8232-6d60ba350dc4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:41:59.989904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96a1423d-4e2b-4745-8232-6d60ba350dc4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:41:59.992008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96a1423d-4e2b-4745-8232-6d60ba350dc4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:00.168342 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6df7fa53-3d2f-4a8e-9a67-39a61a32cd9a tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/f9e94075-e5e2-42f7-8b2d-504972c96b57" status: 202 len: 0 microversion: 2.1 time: 0.306169 Oct 24 10:42:00.168975 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1958/3870] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:41:59 2022] DELETE /compute/v2.1/os-security-groups/f9e94075-e5e2-42f7-8b2d-504972c96b57 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:42:00.174001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a1243a90-acac-4db2-99a9-c63d8c450e2a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:00.174633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a1243a90-acac-4db2-99a9-c63d8c450e2a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:00.182879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1243a90-acac-4db2-99a9-c63d8c450e2a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:00.183730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1243a90-acac-4db2-99a9-c63d8c450e2a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:00.184355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1243a90-acac-4db2-99a9-c63d8c450e2a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:00.185278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1243a90-acac-4db2-99a9-c63d8c450e2a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:00.185901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1243a90-acac-4db2-99a9-c63d8c450e2a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:00.186494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1243a90-acac-4db2-99a9-c63d8c450e2a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:00.284433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-96a1423d-4e2b-4745-8232-6d60ba350dc4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:00.292785 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-96a1423d-4e2b-4745-8232-6d60ba350dc4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1322 microversion: 2.1 time: 0.323899 Oct 24 10:42:00.293403 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1913/3871] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:41:59 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:00.299643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d8ca91b9-3301-4b47-b26b-88bc8035fd1d req-28a59c97-cb4b-4f31-b922-55d7ab92c800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dffdbb2-6b3c-4b29-9016-40f1a54bda8d", "tag": "6ee57c06-f546-493d-8c76-cb3c3ea23bee"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:00.310390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d8ca91b9-3301-4b47-b26b-88bc8035fd1d req-28a59c97-cb4b-4f31-b922-55d7ab92c800 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:00.310966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d8ca91b9-3301-4b47-b26b-88bc8035fd1d req-28a59c97-cb4b-4f31-b922-55d7ab92c800 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:00.311457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d8ca91b9-3301-4b47-b26b-88bc8035fd1d req-28a59c97-cb4b-4f31-b922-55d7ab92c800 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:00.323597 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d8ca91b9-3301-4b47-b26b-88bc8035fd1d req-28a59c97-cb4b-4f31-b922-55d7ab92c800 service nova] Creating event network-changed:6ee57c06-f546-493d-8c76-cb3c3ea23bee for instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d on n-h1-858383-15 Oct 24 10:42:00.329086 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d8ca91b9-3301-4b47-b26b-88bc8035fd1d req-28a59c97-cb4b-4f31-b922-55d7ab92c800 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033589 Oct 24 10:42:00.329946 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1914/3872] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:00.336551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09329f21-9be4-4a00-ab07-14be34b6fd41 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Calling method '.version_select at 0x7f04d02555e0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:00.393964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a1243a90-acac-4db2-99a9-c63d8c450e2a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:00.403324 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a1243a90-acac-4db2-99a9-c63d8c450e2a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1667 microversion: 2.1 time: 0.233257 Oct 24 10:42:00.405034 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1959/3873] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:00 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1667 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:00.423261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1dce23ce-bba2-4b73-aee1-f577c94d51d3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:00.424138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1dce23ce-bba2-4b73-aee1-f577c94d51d3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:00.432014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dce23ce-bba2-4b73-aee1-f577c94d51d3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:00.432732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dce23ce-bba2-4b73-aee1-f577c94d51d3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:00.433361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dce23ce-bba2-4b73-aee1-f577c94d51d3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:00.434282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dce23ce-bba2-4b73-aee1-f577c94d51d3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:00.434936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dce23ce-bba2-4b73-aee1-f577c94d51d3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:00.435573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dce23ce-bba2-4b73-aee1-f577c94d51d3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:00.638778 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-09329f21-9be4-4a00-ab07-14be34b6fd41 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/f76048e2-4cd0-4449-b4ea-cc1514a146c1" status: 202 len: 0 microversion: 2.1 time: 0.307255 Oct 24 10:42:00.641560 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1915/3874] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:42:00 2022] DELETE /compute/v2.1/os-security-groups/f76048e2-4cd0-4449-b4ea-cc1514a146c1 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:42:00.646247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1dce23ce-bba2-4b73-aee1-f577c94d51d3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:00.648608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2c491433-b055-47c2-b103-08b0391d02d3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:00.651099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2c491433-b055-47c2-b103-08b0391d02d3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:00.662355 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1dce23ce-bba2-4b73-aee1-f577c94d51d3 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1291 microversion: 2.1 time: 0.240035 Oct 24 10:42:00.662989 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1960/3875] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:00 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1291 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:42:00.669012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c491433-b055-47c2-b103-08b0391d02d3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:00.669842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c491433-b055-47c2-b103-08b0391d02d3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:00.673183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5414765c-e88c-479c-a457-e443f81a51d7 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Calling method '.version_select at 0x7f04d05dfa60>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:00.682080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c491433-b055-47c2-b103-08b0391d02d3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:00.683539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c491433-b055-47c2-b103-08b0391d02d3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:00.685675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c491433-b055-47c2-b103-08b0391d02d3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:00.686664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c491433-b055-47c2-b103-08b0391d02d3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:00.817041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c491433-b055-47c2-b103-08b0391d02d3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:00.828003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c491433-b055-47c2-b103-08b0391d02d3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:00.835356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c491433-b055-47c2-b103-08b0391d02d3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:00.836627 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2c491433-b055-47c2-b103-08b0391d02d3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1409 microversion: 2.54 time: 0.193562 Oct 24 10:42:00.840456 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1916/3876] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:00 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1409 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:00.991398 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5414765c-e88c-479c-a457-e443f81a51d7 tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/36501771-5fe6-4ae8-9b1a-4b7e33163548" status: 202 len: 0 microversion: 2.1 time: 0.326952 Oct 24 10:42:00.999144 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1961/3877] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:42:00 2022] DELETE /compute/v2.1/os-security-groups/36501771-5fe6-4ae8-9b1a-4b7e33163548 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:42:01.000896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5cb4d6f5-19db-4e9e-87db-c86cc3e7850c tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] Calling method '.version_select at 0x7f04d02559d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:01.318296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1215986e-d15b-4dca-b79a-ac0341540b0b tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:01.318932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1215986e-d15b-4dca-b79a-ac0341540b0b tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:01.329130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1215986e-d15b-4dca-b79a-ac0341540b0b tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:01.329632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1215986e-d15b-4dca-b79a-ac0341540b0b tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:01.330074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1215986e-d15b-4dca-b79a-ac0341540b0b tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:01.330791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1215986e-d15b-4dca-b79a-ac0341540b0b tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:01.333446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1215986e-d15b-4dca-b79a-ac0341540b0b tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:01.337089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1215986e-d15b-4dca-b79a-ac0341540b0b tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:01.964713 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5cb4d6f5-19db-4e9e-87db-c86cc3e7850c tempest-SecurityGroupRulesNegativeTestJSON-1787626325 tempest-SecurityGroupRulesNegativeTestJSON-1787626325-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/214c1b50-dcc2-45be-a20c-aa9f04fe8c0f" status: 202 len: 0 microversion: 2.1 time: 0.967717 Oct 24 10:42:01.966469 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1917/3878] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:42:00 2022] DELETE /compute/v2.1/os-security-groups/214c1b50-dcc2-45be-a20c-aa9f04fe8c0f => generated 0 bytes in 971 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:42:01.973248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4e92de7a-9b59-4901-9c4d-1069bd39006a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:01.974485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4e92de7a-9b59-4901-9c4d-1069bd39006a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:02.000619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e92de7a-9b59-4901-9c4d-1069bd39006a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:02.003324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e92de7a-9b59-4901-9c4d-1069bd39006a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:02.004906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e92de7a-9b59-4901-9c4d-1069bd39006a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:02.006300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e92de7a-9b59-4901-9c4d-1069bd39006a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:02.008363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e92de7a-9b59-4901-9c4d-1069bd39006a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:02.010392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e92de7a-9b59-4901-9c4d-1069bd39006a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:02.117955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1215986e-d15b-4dca-b79a-ac0341540b0b tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:02.145779 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1215986e-d15b-4dca-b79a-ac0341540b0b tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1322 microversion: 2.1 time: 0.832685 Oct 24 10:42:02.148450 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1962/3879] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:01 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1322 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:42:02.168183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b2765e69-b8b6-4b65-9257-a185e5cc7caf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:02.169531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b2765e69-b8b6-4b65-9257-a185e5cc7caf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:02.179517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2765e69-b8b6-4b65-9257-a185e5cc7caf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:02.180328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2765e69-b8b6-4b65-9257-a185e5cc7caf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:02.181206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2765e69-b8b6-4b65-9257-a185e5cc7caf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:02.182685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2765e69-b8b6-4b65-9257-a185e5cc7caf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:02.185521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2765e69-b8b6-4b65-9257-a185e5cc7caf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:02.186279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2765e69-b8b6-4b65-9257-a185e5cc7caf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:02.822583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b2765e69-b8b6-4b65-9257-a185e5cc7caf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:02.838642 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b2765e69-b8b6-4b65-9257-a185e5cc7caf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1291 microversion: 2.1 time: 0.685562 Oct 24 10:42:02.839321 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1963/3880] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:02 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1291 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:02.851274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4e92de7a-9b59-4901-9c4d-1069bd39006a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:02.862094 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4e92de7a-9b59-4901-9c4d-1069bd39006a tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1667 microversion: 2.1 time: 0.894269 Oct 24 10:42:02.867236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-23f81e4f-3557-45ba-981b-5ef7e6d43413 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:02.868113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-23f81e4f-3557-45ba-981b-5ef7e6d43413 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:02.872959 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1918/3881] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:01 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1667 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:02.886323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23f81e4f-3557-45ba-981b-5ef7e6d43413 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:02.887078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23f81e4f-3557-45ba-981b-5ef7e6d43413 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:02.887945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23f81e4f-3557-45ba-981b-5ef7e6d43413 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:02.889747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23f81e4f-3557-45ba-981b-5ef7e6d43413 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:02.890375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23f81e4f-3557-45ba-981b-5ef7e6d43413 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:02.890974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23f81e4f-3557-45ba-981b-5ef7e6d43413 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:03.045210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-23f81e4f-3557-45ba-981b-5ef7e6d43413 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:03.054230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-23f81e4f-3557-45ba-981b-5ef7e6d43413 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:03.056113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-23f81e4f-3557-45ba-981b-5ef7e6d43413 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:03.057427 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-23f81e4f-3557-45ba-981b-5ef7e6d43413 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1409 microversion: 2.54 time: 0.216941 Oct 24 10:42:03.057971 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1964/3882] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:02 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1409 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:03.173375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9e3f9dd5-81e9-428b-ada0-e69d5ae1c1d9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:03.174128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9e3f9dd5-81e9-428b-ada0-e69d5ae1c1d9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:03.181598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e3f9dd5-81e9-428b-ada0-e69d5ae1c1d9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:03.182100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e3f9dd5-81e9-428b-ada0-e69d5ae1c1d9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:03.182549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e3f9dd5-81e9-428b-ada0-e69d5ae1c1d9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:03.183267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e3f9dd5-81e9-428b-ada0-e69d5ae1c1d9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:03.183731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e3f9dd5-81e9-428b-ada0-e69d5ae1c1d9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:03.184312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e3f9dd5-81e9-428b-ada0-e69d5ae1c1d9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:03.539042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9e3f9dd5-81e9-428b-ada0-e69d5ae1c1d9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:03.549078 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9e3f9dd5-81e9-428b-ada0-e69d5ae1c1d9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1322 microversion: 2.1 time: 0.381248 Oct 24 10:42:03.552458 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1919/3883] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:03 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1322 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:03.866518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7a7f2513-8c19-45f9-aa48-7bbdb85f4fdf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:03.867587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7a7f2513-8c19-45f9-aa48-7bbdb85f4fdf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:03.875076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a7f2513-8c19-45f9-aa48-7bbdb85f4fdf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:03.875928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a7f2513-8c19-45f9-aa48-7bbdb85f4fdf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:03.876377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a7f2513-8c19-45f9-aa48-7bbdb85f4fdf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:03.877111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a7f2513-8c19-45f9-aa48-7bbdb85f4fdf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:03.877734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a7f2513-8c19-45f9-aa48-7bbdb85f4fdf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:03.878160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a7f2513-8c19-45f9-aa48-7bbdb85f4fdf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:03.902782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-28ba9f68-02ba-40bf-8df9-78b55b63e0c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:03.903613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-28ba9f68-02ba-40bf-8df9-78b55b63e0c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:03.935173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28ba9f68-02ba-40bf-8df9-78b55b63e0c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:03.937182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28ba9f68-02ba-40bf-8df9-78b55b63e0c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:03.937645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28ba9f68-02ba-40bf-8df9-78b55b63e0c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:03.947537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28ba9f68-02ba-40bf-8df9-78b55b63e0c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:03.948327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28ba9f68-02ba-40bf-8df9-78b55b63e0c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:03.949041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28ba9f68-02ba-40bf-8df9-78b55b63e0c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:04.499653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7a7f2513-8c19-45f9-aa48-7bbdb85f4fdf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:04.512349 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7a7f2513-8c19-45f9-aa48-7bbdb85f4fdf tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1291 microversion: 2.1 time: 0.652093 Oct 24 10:42:04.515763 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1965/3884] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:03 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1291 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:04.521942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d0bb0e41-69c8-4d2f-bd73-63ed599eb48f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:04.522717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d0bb0e41-69c8-4d2f-bd73-63ed599eb48f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:04.527949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-28ba9f68-02ba-40bf-8df9-78b55b63e0c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:04.533351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0bb0e41-69c8-4d2f-bd73-63ed599eb48f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:04.533860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0bb0e41-69c8-4d2f-bd73-63ed599eb48f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:04.534255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0bb0e41-69c8-4d2f-bd73-63ed599eb48f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:04.539777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0bb0e41-69c8-4d2f-bd73-63ed599eb48f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:04.540506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0bb0e41-69c8-4d2f-bd73-63ed599eb48f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:04.541147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0bb0e41-69c8-4d2f-bd73-63ed599eb48f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:04.541422 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-28ba9f68-02ba-40bf-8df9-78b55b63e0c0 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.643478 Oct 24 10:42:04.544083 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1920/3885] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:03 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:42:04.573441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-837eda87-f675-4eef-a5d0-1ddb007a5019 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:04.574060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-837eda87-f675-4eef-a5d0-1ddb007a5019 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:04.584061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-837eda87-f675-4eef-a5d0-1ddb007a5019 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:04.586561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-837eda87-f675-4eef-a5d0-1ddb007a5019 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:04.587080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-837eda87-f675-4eef-a5d0-1ddb007a5019 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:04.587830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-837eda87-f675-4eef-a5d0-1ddb007a5019 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:04.588283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-837eda87-f675-4eef-a5d0-1ddb007a5019 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:04.588714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-837eda87-f675-4eef-a5d0-1ddb007a5019 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:04.604557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:42:04.711503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d0bb0e41-69c8-4d2f-bd73-63ed599eb48f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:04.727917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d0bb0e41-69c8-4d2f-bd73-63ed599eb48f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:04.737670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d0bb0e41-69c8-4d2f-bd73-63ed599eb48f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:04.739735 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d0bb0e41-69c8-4d2f-bd73-63ed599eb48f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1409 microversion: 2.54 time: 0.222708 Oct 24 10:42:04.740314 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1966/3886] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:04 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1409 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:04.772892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9293ee5a-7d31-40ac-9c20-44abaa782a33 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:04.773716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9293ee5a-7d31-40ac-9c20-44abaa782a33 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:04.783611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9293ee5a-7d31-40ac-9c20-44abaa782a33 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:04.784109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9293ee5a-7d31-40ac-9c20-44abaa782a33 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:04.790933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9293ee5a-7d31-40ac-9c20-44abaa782a33 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:04.791927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9293ee5a-7d31-40ac-9c20-44abaa782a33 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:04.793401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9293ee5a-7d31-40ac-9c20-44abaa782a33 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:04.793977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9293ee5a-7d31-40ac-9c20-44abaa782a33 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:04.992366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-837eda87-f675-4eef-a5d0-1ddb007a5019 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:05.005935 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-837eda87-f675-4eef-a5d0-1ddb007a5019 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.436090 Oct 24 10:42:05.006538 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1921/3887] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:04 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:42:05.037965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-626297a7-f93e-4689-bd0c-b40a8ddc008f req-ea8361a6-5540-4d31-a858-abb41b1b3eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dffdbb2-6b3c-4b29-9016-40f1a54bda8d", "name": "network-vif-plugged", "status": "completed", "tag": "6ee57c06-f546-493d-8c76-cb3c3ea23bee"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:05.067952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-626297a7-f93e-4689-bd0c-b40a8ddc008f req-ea8361a6-5540-4d31-a858-abb41b1b3eed service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:05.068884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-626297a7-f93e-4689-bd0c-b40a8ddc008f req-ea8361a6-5540-4d31-a858-abb41b1b3eed service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:05.069547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-626297a7-f93e-4689-bd0c-b40a8ddc008f req-ea8361a6-5540-4d31-a858-abb41b1b3eed service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:05.125542 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-626297a7-f93e-4689-bd0c-b40a8ddc008f req-ea8361a6-5540-4d31-a858-abb41b1b3eed service nova] Creating event network-vif-plugged:6ee57c06-f546-493d-8c76-cb3c3ea23bee for instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d on n-h1-858383-15 Oct 24 10:42:05.135824 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-626297a7-f93e-4689-bd0c-b40a8ddc008f req-ea8361a6-5540-4d31-a858-abb41b1b3eed service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104402 Oct 24 10:42:05.136980 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1922/3888] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:42:05.142451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ccc55a5-9826-4779-abc7-e4a178614967 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:05.143342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ccc55a5-9826-4779-abc7-e4a178614967 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:05.150516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ccc55a5-9826-4779-abc7-e4a178614967 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:05.151239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ccc55a5-9826-4779-abc7-e4a178614967 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:05.151819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ccc55a5-9826-4779-abc7-e4a178614967 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:05.152681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ccc55a5-9826-4779-abc7-e4a178614967 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:05.153305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ccc55a5-9826-4779-abc7-e4a178614967 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:05.153881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ccc55a5-9826-4779-abc7-e4a178614967 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:05.231673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9293ee5a-7d31-40ac-9c20-44abaa782a33 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:05.241473 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9293ee5a-7d31-40ac-9c20-44abaa782a33 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1322 microversion: 2.1 time: 0.481435 Oct 24 10:42:05.245644 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1967/3889] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:04 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1322 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:05.416635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2ccc55a5-9826-4779-abc7-e4a178614967 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:05.430822 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ccc55a5-9826-4779-abc7-e4a178614967 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.291774 Oct 24 10:42:05.433218 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1923/3890] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:05 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:05.454556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-df212847-d869-45fc-9aec-3ee8f307925f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:05.455182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-df212847-d869-45fc-9aec-3ee8f307925f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:05.471681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df212847-d869-45fc-9aec-3ee8f307925f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:05.472198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df212847-d869-45fc-9aec-3ee8f307925f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:05.485969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df212847-d869-45fc-9aec-3ee8f307925f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:05.486785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df212847-d869-45fc-9aec-3ee8f307925f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:05.487272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df212847-d869-45fc-9aec-3ee8f307925f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:05.487721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df212847-d869-45fc-9aec-3ee8f307925f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:05.540678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8d356b40-d676-41d6-83ac-330dd01d4914 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:05.541473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8d356b40-d676-41d6-83ac-330dd01d4914 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:05.554895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d356b40-d676-41d6-83ac-330dd01d4914 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:05.560764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d356b40-d676-41d6-83ac-330dd01d4914 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:05.561286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d356b40-d676-41d6-83ac-330dd01d4914 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:05.566927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d356b40-d676-41d6-83ac-330dd01d4914 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:05.568705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d356b40-d676-41d6-83ac-330dd01d4914 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:05.571757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d356b40-d676-41d6-83ac-330dd01d4914 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:06.641708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8d356b40-d676-41d6-83ac-330dd01d4914 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:06.674996 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8d356b40-d676-41d6-83ac-330dd01d4914 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1291 microversion: 2.1 time: 1.138170 Oct 24 10:42:06.677951 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1924/3891] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:05 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1291 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:42:06.706642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d88b7345-cd20-4d26-a398-6d8396869f1b tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:06.711673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d88b7345-cd20-4d26-a398-6d8396869f1b tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:06.735227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-df212847-d869-45fc-9aec-3ee8f307925f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:06.747687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d88b7345-cd20-4d26-a398-6d8396869f1b tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:06.751525 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-df212847-d869-45fc-9aec-3ee8f307925f tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 1.301641 Oct 24 10:42:06.752191 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1968/3892] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:05 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:06.756596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d88b7345-cd20-4d26-a398-6d8396869f1b tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:06.757392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d88b7345-cd20-4d26-a398-6d8396869f1b tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:06.758053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d88b7345-cd20-4d26-a398-6d8396869f1b tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:06.759676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d88b7345-cd20-4d26-a398-6d8396869f1b tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:06.760131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d88b7345-cd20-4d26-a398-6d8396869f1b tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:06.773594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-69fb1683-b4b5-485b-a689-c88464bb2755 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:06.777519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-69fb1683-b4b5-485b-a689-c88464bb2755 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:06.792006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69fb1683-b4b5-485b-a689-c88464bb2755 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:06.793512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69fb1683-b4b5-485b-a689-c88464bb2755 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:06.794406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69fb1683-b4b5-485b-a689-c88464bb2755 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:06.796815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69fb1683-b4b5-485b-a689-c88464bb2755 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:06.797563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69fb1683-b4b5-485b-a689-c88464bb2755 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:06.798269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69fb1683-b4b5-485b-a689-c88464bb2755 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:06.946292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d88b7345-cd20-4d26-a398-6d8396869f1b tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:06.968139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d88b7345-cd20-4d26-a398-6d8396869f1b tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:06.970530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d88b7345-cd20-4d26-a398-6d8396869f1b tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:06.972168 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d88b7345-cd20-4d26-a398-6d8396869f1b tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1409 microversion: 2.54 time: 0.288127 Oct 24 10:42:06.988313 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1925/3893] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:06 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1409 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:07.009625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8eb0c16d-7ff9-4fe8-a086-47148d521075 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:07.011082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8eb0c16d-7ff9-4fe8-a086-47148d521075 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:07.045881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8eb0c16d-7ff9-4fe8-a086-47148d521075 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:07.046399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8eb0c16d-7ff9-4fe8-a086-47148d521075 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:07.046849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8eb0c16d-7ff9-4fe8-a086-47148d521075 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:07.047575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8eb0c16d-7ff9-4fe8-a086-47148d521075 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:07.048035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8eb0c16d-7ff9-4fe8-a086-47148d521075 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:07.048469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8eb0c16d-7ff9-4fe8-a086-47148d521075 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:07.140759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-69fb1683-b4b5-485b-a689-c88464bb2755 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:07.155315 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-69fb1683-b4b5-485b-a689-c88464bb2755 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1322 microversion: 2.1 time: 0.402108 Oct 24 10:42:07.156275 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1969/3894] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:06 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:07.239607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a5a6405f-bd71-4e0e-b99a-470f1cde5931 req-ab62b30e-08c0-408b-b54f-b7965e5f9d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd604035-ef97-496b-a5fe-0204c8dc7e46", "name": "network-vif-plugged", "status": "completed", "tag": "b9e3bdde-6565-4e35-b42c-0f27f26f4e5d"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:07.293564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a5a6405f-bd71-4e0e-b99a-470f1cde5931 req-ab62b30e-08c0-408b-b54f-b7965e5f9d53 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:07.294107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a5a6405f-bd71-4e0e-b99a-470f1cde5931 req-ab62b30e-08c0-408b-b54f-b7965e5f9d53 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:07.294546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a5a6405f-bd71-4e0e-b99a-470f1cde5931 req-ab62b30e-08c0-408b-b54f-b7965e5f9d53 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:07.342673 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a5a6405f-bd71-4e0e-b99a-470f1cde5931 req-ab62b30e-08c0-408b-b54f-b7965e5f9d53 service nova] Creating event network-vif-plugged:b9e3bdde-6565-4e35-b42c-0f27f26f4e5d for instance dd604035-ef97-496b-a5fe-0204c8dc7e46 on n-h2-858383-15 Oct 24 10:42:07.350485 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a5a6405f-bd71-4e0e-b99a-470f1cde5931 req-ab62b30e-08c0-408b-b54f-b7965e5f9d53 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119146 Oct 24 10:42:07.352382 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1970/3895] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:42:07.433372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8eb0c16d-7ff9-4fe8-a086-47148d521075 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:07.445590 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8eb0c16d-7ff9-4fe8-a086-47148d521075 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.451097 Oct 24 10:42:07.446223 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1926/3896] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:06 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:07.478443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fbd09248-63b6-4178-b2bf-1f5720c2d69d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:07.478990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fbd09248-63b6-4178-b2bf-1f5720c2d69d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:07.492180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbd09248-63b6-4178-b2bf-1f5720c2d69d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:07.493326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbd09248-63b6-4178-b2bf-1f5720c2d69d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:07.493911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbd09248-63b6-4178-b2bf-1f5720c2d69d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:07.496226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbd09248-63b6-4178-b2bf-1f5720c2d69d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:07.496887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbd09248-63b6-4178-b2bf-1f5720c2d69d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:07.497461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbd09248-63b6-4178-b2bf-1f5720c2d69d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:07.532113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-fbd09248-63b6-4178-b2bf-1f5720c2d69d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lazy-loading 'flavor' on Instance uuid 513ca608-24c9-45f9-8fb9-e231d92c7262 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:42:07.623058 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fbd09248-63b6-4178-b2bf-1f5720c2d69d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 202 len: 0 microversion: 2.1 time: 0.152904 Oct 24 10:42:07.624263 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1971/3897] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:42:07 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:42:07.633715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c9fcec0f-514a-43c3-aeb6-79a965233c5b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:07.634663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c9fcec0f-514a-43c3-aeb6-79a965233c5b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:07.645764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9fcec0f-514a-43c3-aeb6-79a965233c5b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:07.647273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9fcec0f-514a-43c3-aeb6-79a965233c5b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:07.649004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9fcec0f-514a-43c3-aeb6-79a965233c5b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:07.650161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9fcec0f-514a-43c3-aeb6-79a965233c5b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:07.650922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9fcec0f-514a-43c3-aeb6-79a965233c5b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:07.652239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9fcec0f-514a-43c3-aeb6-79a965233c5b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:07.706676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a896ba64-5310-40f9-ab30-bb86e11e87d4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:07.707919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a896ba64-5310-40f9-ab30-bb86e11e87d4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:07.730046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a896ba64-5310-40f9-ab30-bb86e11e87d4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:07.731006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a896ba64-5310-40f9-ab30-bb86e11e87d4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:07.731616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a896ba64-5310-40f9-ab30-bb86e11e87d4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:07.734545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a896ba64-5310-40f9-ab30-bb86e11e87d4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:07.736581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a896ba64-5310-40f9-ab30-bb86e11e87d4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:07.741383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a896ba64-5310-40f9-ab30-bb86e11e87d4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:08.131702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c9fcec0f-514a-43c3-aeb6-79a965233c5b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:08.142074 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c9fcec0f-514a-43c3-aeb6-79a965233c5b tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1679 microversion: 2.1 time: 0.513643 Oct 24 10:42:08.148926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a896ba64-5310-40f9-ab30-bb86e11e87d4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:08.157455 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1927/3898] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:07 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1679 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:08.174038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-959005e2-fb23-4099-ac63-4973447325a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:08.175873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-959005e2-fb23-4099-ac63-4973447325a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:08.193390 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a896ba64-5310-40f9-ab30-bb86e11e87d4 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1291 microversion: 2.1 time: 0.487201 Oct 24 10:42:08.193517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-959005e2-fb23-4099-ac63-4973447325a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:08.194020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-959005e2-fb23-4099-ac63-4973447325a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:08.194474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-959005e2-fb23-4099-ac63-4973447325a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:08.195359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-959005e2-fb23-4099-ac63-4973447325a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:08.197556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-959005e2-fb23-4099-ac63-4973447325a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:08.198166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-959005e2-fb23-4099-ac63-4973447325a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:08.238934 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1972/3899] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:07 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1291 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:08.245449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6e6db1a8-7226-4cc3-b178-ecfface0f34a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:08.246080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6e6db1a8-7226-4cc3-b178-ecfface0f34a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:08.321272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e6db1a8-7226-4cc3-b178-ecfface0f34a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:08.325959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e6db1a8-7226-4cc3-b178-ecfface0f34a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:08.326433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e6db1a8-7226-4cc3-b178-ecfface0f34a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:08.330607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e6db1a8-7226-4cc3-b178-ecfface0f34a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:08.331086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e6db1a8-7226-4cc3-b178-ecfface0f34a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:08.331546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e6db1a8-7226-4cc3-b178-ecfface0f34a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:08.451347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-959005e2-fb23-4099-ac63-4973447325a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:08.463242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-959005e2-fb23-4099-ac63-4973447325a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:08.472941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-959005e2-fb23-4099-ac63-4973447325a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:08.475563 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-959005e2-fb23-4099-ac63-4973447325a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1409 microversion: 2.54 time: 0.310454 Oct 24 10:42:08.478879 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1928/3900] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:08 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1409 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:08.691497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e6db1a8-7226-4cc3-b178-ecfface0f34a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:08.707339 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6e6db1a8-7226-4cc3-b178-ecfface0f34a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1322 microversion: 2.1 time: 0.465593 Oct 24 10:42:08.728950 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1973/3901] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:08 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1322 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:09.171998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fc88f27f-4436-44c2-a1e7-8c0287a8f7d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:09.172580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fc88f27f-4436-44c2-a1e7-8c0287a8f7d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:09.181901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc88f27f-4436-44c2-a1e7-8c0287a8f7d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:09.182710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc88f27f-4436-44c2-a1e7-8c0287a8f7d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:09.183660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc88f27f-4436-44c2-a1e7-8c0287a8f7d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:09.184580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc88f27f-4436-44c2-a1e7-8c0287a8f7d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:09.185371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc88f27f-4436-44c2-a1e7-8c0287a8f7d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:09.185970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc88f27f-4436-44c2-a1e7-8c0287a8f7d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:09.226452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9173d3f0-2bfc-465c-992f-d0b64fa054a7 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:09.228256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9173d3f0-2bfc-465c-992f-d0b64fa054a7 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:09.240253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9173d3f0-2bfc-465c-992f-d0b64fa054a7 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:09.246341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9173d3f0-2bfc-465c-992f-d0b64fa054a7 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:09.247153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9173d3f0-2bfc-465c-992f-d0b64fa054a7 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:09.248084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9173d3f0-2bfc-465c-992f-d0b64fa054a7 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:09.251809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9173d3f0-2bfc-465c-992f-d0b64fa054a7 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:09.252605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9173d3f0-2bfc-465c-992f-d0b64fa054a7 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:09.470031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fc88f27f-4436-44c2-a1e7-8c0287a8f7d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:09.483776 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fc88f27f-4436-44c2-a1e7-8c0287a8f7d7 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1662 microversion: 2.1 time: 0.315918 Oct 24 10:42:09.488643 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1929/3902] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:09 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1662 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:09.518261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-40f3eaba-104b-49bb-8943-1be6f54102a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:09.519203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-40f3eaba-104b-49bb-8943-1be6f54102a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:09.523280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:42:09.528603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40f3eaba-104b-49bb-8943-1be6f54102a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:09.529347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40f3eaba-104b-49bb-8943-1be6f54102a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:09.530504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40f3eaba-104b-49bb-8943-1be6f54102a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:09.531305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40f3eaba-104b-49bb-8943-1be6f54102a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:09.531970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40f3eaba-104b-49bb-8943-1be6f54102a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:09.532470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40f3eaba-104b-49bb-8943-1be6f54102a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:09.561757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9173d3f0-2bfc-465c-992f-d0b64fa054a7 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:09.575117 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9173d3f0-2bfc-465c-992f-d0b64fa054a7 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1291 microversion: 2.1 time: 0.356566 Oct 24 10:42:09.577307 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1974/3903] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:09 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1291 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:09.605286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-678d915e-b78a-46b6-82e6-a91bcffd3c0d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:09.605967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-678d915e-b78a-46b6-82e6-a91bcffd3c0d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:09.612188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-678d915e-b78a-46b6-82e6-a91bcffd3c0d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:09.612679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-678d915e-b78a-46b6-82e6-a91bcffd3c0d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:09.613834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-678d915e-b78a-46b6-82e6-a91bcffd3c0d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:09.614695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-678d915e-b78a-46b6-82e6-a91bcffd3c0d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:09.615459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-678d915e-b78a-46b6-82e6-a91bcffd3c0d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:09.616636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-678d915e-b78a-46b6-82e6-a91bcffd3c0d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:09.622471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:42:09.637940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-40f3eaba-104b-49bb-8943-1be6f54102a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:09.653369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-40f3eaba-104b-49bb-8943-1be6f54102a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:09.658986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-40f3eaba-104b-49bb-8943-1be6f54102a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:09.662666 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-40f3eaba-104b-49bb-8943-1be6f54102a3 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1409 microversion: 2.54 time: 0.155626 Oct 24 10:42:09.665526 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1930/3904] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:09 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:42:09.727650 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-678d915e-b78a-46b6-82e6-a91bcffd3c0d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action" status: 202 len: 0 microversion: 2.1 time: 0.147695 Oct 24 10:42:09.729273 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1975/3905] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:42:09 2022] POST /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:42:09.741668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-36854d8e-72d1-4707-9f1b-10c1d694a245 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:09.743195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-36854d8e-72d1-4707-9f1b-10c1d694a245 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:09.761108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36854d8e-72d1-4707-9f1b-10c1d694a245 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:09.761861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36854d8e-72d1-4707-9f1b-10c1d694a245 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:09.763460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36854d8e-72d1-4707-9f1b-10c1d694a245 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:09.764699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36854d8e-72d1-4707-9f1b-10c1d694a245 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:09.765671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36854d8e-72d1-4707-9f1b-10c1d694a245 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:09.768228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36854d8e-72d1-4707-9f1b-10c1d694a245 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:09.784441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-95d0caa8-49cf-479f-9a24-f4f1baf08413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:09.787252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-95d0caa8-49cf-479f-9a24-f4f1baf08413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:09.806258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95d0caa8-49cf-479f-9a24-f4f1baf08413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:09.807079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95d0caa8-49cf-479f-9a24-f4f1baf08413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:09.807993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95d0caa8-49cf-479f-9a24-f4f1baf08413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:09.809710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95d0caa8-49cf-479f-9a24-f4f1baf08413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:09.810184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95d0caa8-49cf-479f-9a24-f4f1baf08413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:09.817478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95d0caa8-49cf-479f-9a24-f4f1baf08413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:10.029353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-36854d8e-72d1-4707-9f1b-10c1d694a245 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:10.040054 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-36854d8e-72d1-4707-9f1b-10c1d694a245 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1322 microversion: 2.1 time: 0.305552 Oct 24 10:42:10.043964 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1931/3906] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:09 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:10.151758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-95d0caa8-49cf-479f-9a24-f4f1baf08413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:10.168159 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-95d0caa8-49cf-479f-9a24-f4f1baf08413 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1668 microversion: 2.1 time: 0.409332 Oct 24 10:42:10.170849 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1976/3907] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:09 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1668 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:10.336529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-fc9e6dc1-dec3-4144-8cd6-8d7bc31bb061 req-bee288fa-299e-4aa1-8995-45a301f29f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee981b9-6221-467f-bce3-e911488983ad", "name": "network-vif-plugged", "status": "completed", "tag": "7c636450-35fa-4e6c-861a-6b258e553318"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:10.350470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fc9e6dc1-dec3-4144-8cd6-8d7bc31bb061 req-bee288fa-299e-4aa1-8995-45a301f29f0d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:10.351677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fc9e6dc1-dec3-4144-8cd6-8d7bc31bb061 req-bee288fa-299e-4aa1-8995-45a301f29f0d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:10.352292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fc9e6dc1-dec3-4144-8cd6-8d7bc31bb061 req-bee288fa-299e-4aa1-8995-45a301f29f0d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:10.372321 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-fc9e6dc1-dec3-4144-8cd6-8d7bc31bb061 req-bee288fa-299e-4aa1-8995-45a301f29f0d service nova] Creating event network-vif-plugged:7c636450-35fa-4e6c-861a-6b258e553318 for instance cee981b9-6221-467f-bce3-e911488983ad on n-h2-858383-15 Oct 24 10:42:10.379384 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-fc9e6dc1-dec3-4144-8cd6-8d7bc31bb061 req-bee288fa-299e-4aa1-8995-45a301f29f0d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047309 Oct 24 10:42:10.380562 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1932/3908] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:10.606075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-100afafa-806e-4d3b-999c-1aa1c963bc6a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:10.606702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-100afafa-806e-4d3b-999c-1aa1c963bc6a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:10.621624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-100afafa-806e-4d3b-999c-1aa1c963bc6a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:10.622494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-100afafa-806e-4d3b-999c-1aa1c963bc6a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:10.623896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-100afafa-806e-4d3b-999c-1aa1c963bc6a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:10.627937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-100afafa-806e-4d3b-999c-1aa1c963bc6a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:10.628706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-100afafa-806e-4d3b-999c-1aa1c963bc6a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:10.630452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-100afafa-806e-4d3b-999c-1aa1c963bc6a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:10.693630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-35b384c8-f838-4e4c-a3cb-6a4d3cad36c2 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:10.694581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-35b384c8-f838-4e4c-a3cb-6a4d3cad36c2 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:10.704697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35b384c8-f838-4e4c-a3cb-6a4d3cad36c2 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:10.709309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35b384c8-f838-4e4c-a3cb-6a4d3cad36c2 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:10.709950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35b384c8-f838-4e4c-a3cb-6a4d3cad36c2 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:10.710849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35b384c8-f838-4e4c-a3cb-6a4d3cad36c2 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:10.711618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35b384c8-f838-4e4c-a3cb-6a4d3cad36c2 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:10.712367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35b384c8-f838-4e4c-a3cb-6a4d3cad36c2 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:10.973324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-35b384c8-f838-4e4c-a3cb-6a4d3cad36c2 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:10.984252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-35b384c8-f838-4e4c-a3cb-6a4d3cad36c2 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:10.991200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-35b384c8-f838-4e4c-a3cb-6a4d3cad36c2 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:11.000320 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-35b384c8-f838-4e4c-a3cb-6a4d3cad36c2 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1409 microversion: 2.54 time: 0.311358 Oct 24 10:42:11.001109 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1933/3909] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:10 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1409 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:42:11.049664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-100afafa-806e-4d3b-999c-1aa1c963bc6a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:11.067555 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-100afafa-806e-4d3b-999c-1aa1c963bc6a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1291 microversion: 2.1 time: 0.466342 Oct 24 10:42:11.068872 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1977/3910] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:10 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1291 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:11.072488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-91fdb052-00aa-48a9-91bf-b6794382146f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:11.074693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-91fdb052-00aa-48a9-91bf-b6794382146f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:11.093471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91fdb052-00aa-48a9-91bf-b6794382146f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:11.099160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91fdb052-00aa-48a9-91bf-b6794382146f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:11.100094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91fdb052-00aa-48a9-91bf-b6794382146f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:11.101100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91fdb052-00aa-48a9-91bf-b6794382146f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:11.101708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91fdb052-00aa-48a9-91bf-b6794382146f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:11.102286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91fdb052-00aa-48a9-91bf-b6794382146f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:11.201366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b5acdcec-a619-4906-ad4f-59c246bf0297 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:11.202567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b5acdcec-a619-4906-ad4f-59c246bf0297 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:11.214801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5acdcec-a619-4906-ad4f-59c246bf0297 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:11.215408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5acdcec-a619-4906-ad4f-59c246bf0297 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:11.218285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5acdcec-a619-4906-ad4f-59c246bf0297 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:11.219805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5acdcec-a619-4906-ad4f-59c246bf0297 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:11.220445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5acdcec-a619-4906-ad4f-59c246bf0297 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:11.223593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5acdcec-a619-4906-ad4f-59c246bf0297 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:11.414325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-91fdb052-00aa-48a9-91bf-b6794382146f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:11.423721 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-91fdb052-00aa-48a9-91bf-b6794382146f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1322 microversion: 2.1 time: 0.357551 Oct 24 10:42:11.424781 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1934/3911] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:11 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:11.478657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b5acdcec-a619-4906-ad4f-59c246bf0297 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:11.487640 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b5acdcec-a619-4906-ad4f-59c246bf0297 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1668 microversion: 2.1 time: 0.292550 Oct 24 10:42:11.489606 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1978/3912] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:11 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1668 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:42:12.039818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-192e0022-7f2f-4312-ae12-3e631f3ab183 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:12.052115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-192e0022-7f2f-4312-ae12-3e631f3ab183 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:12.064024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-192e0022-7f2f-4312-ae12-3e631f3ab183 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:12.065602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-192e0022-7f2f-4312-ae12-3e631f3ab183 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:12.066902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-192e0022-7f2f-4312-ae12-3e631f3ab183 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:12.067888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-192e0022-7f2f-4312-ae12-3e631f3ab183 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:12.068666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-192e0022-7f2f-4312-ae12-3e631f3ab183 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:12.069263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-192e0022-7f2f-4312-ae12-3e631f3ab183 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:12.094564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-08f8e45a-756e-4216-b755-896bd76da365 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:12.096036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-08f8e45a-756e-4216-b755-896bd76da365 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:12.104101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08f8e45a-756e-4216-b755-896bd76da365 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:12.104613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08f8e45a-756e-4216-b755-896bd76da365 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:12.105284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08f8e45a-756e-4216-b755-896bd76da365 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:12.106304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08f8e45a-756e-4216-b755-896bd76da365 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:12.107048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08f8e45a-756e-4216-b755-896bd76da365 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:12.107881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08f8e45a-756e-4216-b755-896bd76da365 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:12.228514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-192e0022-7f2f-4312-ae12-3e631f3ab183 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:12.244185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-192e0022-7f2f-4312-ae12-3e631f3ab183 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:12.245670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-192e0022-7f2f-4312-ae12-3e631f3ab183 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:12.247059 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-192e0022-7f2f-4312-ae12-3e631f3ab183 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1409 microversion: 2.54 time: 0.220505 Oct 24 10:42:12.247640 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1935/3913] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:12 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1409 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:12.399008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-291daa4a-e847-447f-bb7d-398d62001dc7 req-325773e3-7e00-4726-b728-28b36c9d9182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d350ab27-db77-49c3-8270-682320f4bd1e", "name": "network-vif-plugged", "status": "completed", "tag": "e858bb76-d557-489c-9e4b-de662c087a76"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:12.410374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-291daa4a-e847-447f-bb7d-398d62001dc7 req-325773e3-7e00-4726-b728-28b36c9d9182 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:12.411050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-291daa4a-e847-447f-bb7d-398d62001dc7 req-325773e3-7e00-4726-b728-28b36c9d9182 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:12.411752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-291daa4a-e847-447f-bb7d-398d62001dc7 req-325773e3-7e00-4726-b728-28b36c9d9182 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:12.424271 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-291daa4a-e847-447f-bb7d-398d62001dc7 req-325773e3-7e00-4726-b728-28b36c9d9182 service nova] Creating event network-vif-plugged:e858bb76-d557-489c-9e4b-de662c087a76 for instance d350ab27-db77-49c3-8270-682320f4bd1e on n-h1-858383-15 Oct 24 10:42:12.431482 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-291daa4a-e847-447f-bb7d-398d62001dc7 req-325773e3-7e00-4726-b728-28b36c9d9182 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036018 Oct 24 10:42:12.432699 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1936/3914] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:42:12.448760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cd951d4a-72b3-48c1-9fe0-b9c4ee557951 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:12.449506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cd951d4a-72b3-48c1-9fe0-b9c4ee557951 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:12.455897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd951d4a-72b3-48c1-9fe0-b9c4ee557951 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:12.456389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd951d4a-72b3-48c1-9fe0-b9c4ee557951 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:12.457408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd951d4a-72b3-48c1-9fe0-b9c4ee557951 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:12.458117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd951d4a-72b3-48c1-9fe0-b9c4ee557951 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:12.458579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd951d4a-72b3-48c1-9fe0-b9c4ee557951 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:12.459018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd951d4a-72b3-48c1-9fe0-b9c4ee557951 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:12.494549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-08f8e45a-756e-4216-b755-896bd76da365 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:12.507970 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-08f8e45a-756e-4216-b755-896bd76da365 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1481 microversion: 2.1 time: 0.418845 Oct 24 10:42:12.509246 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1979/3915] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:12 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1481 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:42:12.514332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-93db8951-9e37-4daa-804f-6e77743fb8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:12.515348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-93db8951-9e37-4daa-804f-6e77743fb8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:12.522298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93db8951-9e37-4daa-804f-6e77743fb8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:12.522787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93db8951-9e37-4daa-804f-6e77743fb8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:12.523418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93db8951-9e37-4daa-804f-6e77743fb8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:12.524293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93db8951-9e37-4daa-804f-6e77743fb8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:12.524796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93db8951-9e37-4daa-804f-6e77743fb8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:12.525251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93db8951-9e37-4daa-804f-6e77743fb8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:12.886215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cd951d4a-72b3-48c1-9fe0-b9c4ee557951 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:12.905650 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cd951d4a-72b3-48c1-9fe0-b9c4ee557951 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1322 microversion: 2.1 time: 0.452006 Oct 24 10:42:12.907322 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1937/3916] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:12 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1322 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:12.913457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e11226bb-3d4d-4a8d-8c40-595b150e7071 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:12.914092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e11226bb-3d4d-4a8d-8c40-595b150e7071 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:12.921179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e11226bb-3d4d-4a8d-8c40-595b150e7071 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:12.931952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e11226bb-3d4d-4a8d-8c40-595b150e7071 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:12.932529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e11226bb-3d4d-4a8d-8c40-595b150e7071 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:12.933328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e11226bb-3d4d-4a8d-8c40-595b150e7071 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:12.933912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e11226bb-3d4d-4a8d-8c40-595b150e7071 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:12.934402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e11226bb-3d4d-4a8d-8c40-595b150e7071 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:12.957457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-93db8951-9e37-4daa-804f-6e77743fb8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:12.975137 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-93db8951-9e37-4daa-804f-6e77743fb8a6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1668 microversion: 2.1 time: 0.464533 Oct 24 10:42:12.979532 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1980/3917] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:12 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1668 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:13.176560 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e11226bb-3d4d-4a8d-8c40-595b150e7071 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.266370 Oct 24 10:42:13.178190 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1938/3918] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 10:42:12 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad/os-interface => generated 284 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:13.276783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ae098a49-4026-456c-8b05-ebb68b1e2f16 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:13.277743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ae098a49-4026-456c-8b05-ebb68b1e2f16 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:13.289430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae098a49-4026-456c-8b05-ebb68b1e2f16 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:13.289952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae098a49-4026-456c-8b05-ebb68b1e2f16 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:13.291467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae098a49-4026-456c-8b05-ebb68b1e2f16 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:13.294622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae098a49-4026-456c-8b05-ebb68b1e2f16 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:13.295403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae098a49-4026-456c-8b05-ebb68b1e2f16 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:13.298675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae098a49-4026-456c-8b05-ebb68b1e2f16 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:13.581117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ae098a49-4026-456c-8b05-ebb68b1e2f16 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:13.596482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ae098a49-4026-456c-8b05-ebb68b1e2f16 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:13.604762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ae098a49-4026-456c-8b05-ebb68b1e2f16 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:13.609105 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ae098a49-4026-456c-8b05-ebb68b1e2f16 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1415 microversion: 2.54 time: 0.337062 Oct 24 10:42:13.609973 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1981/3919] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:13 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1415 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:13.940331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-78957a39-9cef-4613-9aae-6fa32a2a15f5 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:13.942285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-78957a39-9cef-4613-9aae-6fa32a2a15f5 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:13.961158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78957a39-9cef-4613-9aae-6fa32a2a15f5 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:13.967710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78957a39-9cef-4613-9aae-6fa32a2a15f5 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:13.969227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78957a39-9cef-4613-9aae-6fa32a2a15f5 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:13.975434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78957a39-9cef-4613-9aae-6fa32a2a15f5 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:13.977135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78957a39-9cef-4613-9aae-6fa32a2a15f5 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:13.978548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78957a39-9cef-4613-9aae-6fa32a2a15f5 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:14.004154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-463b914c-887e-4b2b-bba2-e3c5bd2fe495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:14.004787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-463b914c-887e-4b2b-bba2-e3c5bd2fe495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:14.020419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-463b914c-887e-4b2b-bba2-e3c5bd2fe495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:14.029809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-463b914c-887e-4b2b-bba2-e3c5bd2fe495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:14.030543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-463b914c-887e-4b2b-bba2-e3c5bd2fe495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:14.033282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-463b914c-887e-4b2b-bba2-e3c5bd2fe495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:14.033913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-463b914c-887e-4b2b-bba2-e3c5bd2fe495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:14.037860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-463b914c-887e-4b2b-bba2-e3c5bd2fe495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:14.448349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-78957a39-9cef-4613-9aae-6fa32a2a15f5 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:14.462393 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-78957a39-9cef-4613-9aae-6fa32a2a15f5 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1322 microversion: 2.1 time: 0.533282 Oct 24 10:42:14.463514 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1939/3920] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:13 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1322 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:14.500457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-463b914c-887e-4b2b-bba2-e3c5bd2fe495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:14.513522 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-463b914c-887e-4b2b-bba2-e3c5bd2fe495 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 0.513717 Oct 24 10:42:14.516339 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1982/3921] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:13 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:42:14.641075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-42946fd7-96fb-4607-9ec7-6bbbc6fab2d0 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:14.642770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-42946fd7-96fb-4607-9ec7-6bbbc6fab2d0 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:14.660370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42946fd7-96fb-4607-9ec7-6bbbc6fab2d0 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:14.661814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42946fd7-96fb-4607-9ec7-6bbbc6fab2d0 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:14.667685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42946fd7-96fb-4607-9ec7-6bbbc6fab2d0 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:14.668651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42946fd7-96fb-4607-9ec7-6bbbc6fab2d0 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:14.670838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42946fd7-96fb-4607-9ec7-6bbbc6fab2d0 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:14.672421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42946fd7-96fb-4607-9ec7-6bbbc6fab2d0 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:14.890802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-42946fd7-96fb-4607-9ec7-6bbbc6fab2d0 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:14.904753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-42946fd7-96fb-4607-9ec7-6bbbc6fab2d0 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:14.912594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-42946fd7-96fb-4607-9ec7-6bbbc6fab2d0 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:14.915637 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-42946fd7-96fb-4607-9ec7-6bbbc6fab2d0 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1415 microversion: 2.54 time: 0.278204 Oct 24 10:42:14.917055 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1983/3922] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:14 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1415 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:42:15.107946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d8cc8548-c377-4320-83b6-9ec851f85629 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:15.108932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d8cc8548-c377-4320-83b6-9ec851f85629 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:15.123679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8cc8548-c377-4320-83b6-9ec851f85629 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:15.124465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8cc8548-c377-4320-83b6-9ec851f85629 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:15.125093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8cc8548-c377-4320-83b6-9ec851f85629 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:15.125981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8cc8548-c377-4320-83b6-9ec851f85629 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:15.126987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8cc8548-c377-4320-83b6-9ec851f85629 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:15.130190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8cc8548-c377-4320-83b6-9ec851f85629 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:15.146006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:42:15.496301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1418efac-b353-4de0-82e6-d1f25400deb9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:15.497309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1418efac-b353-4de0-82e6-d1f25400deb9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:15.511097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1418efac-b353-4de0-82e6-d1f25400deb9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:15.515131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1418efac-b353-4de0-82e6-d1f25400deb9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:15.516026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1418efac-b353-4de0-82e6-d1f25400deb9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:15.521137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1418efac-b353-4de0-82e6-d1f25400deb9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:15.521900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1418efac-b353-4de0-82e6-d1f25400deb9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:15.522680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1418efac-b353-4de0-82e6-d1f25400deb9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:16.038038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d8cc8548-c377-4320-83b6-9ec851f85629 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:16.063641 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d8cc8548-c377-4320-83b6-9ec851f85629 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1671 microversion: 2.1 time: 1.513880 Oct 24 10:42:16.078624 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1940/3923] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:14 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1671 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:16.102473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-92d5499e-8bf2-4570-8720-f9295bb65ba6 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:16.104352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-92d5499e-8bf2-4570-8720-f9295bb65ba6 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:16.123281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92d5499e-8bf2-4570-8720-f9295bb65ba6 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:16.128440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92d5499e-8bf2-4570-8720-f9295bb65ba6 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:16.129171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92d5499e-8bf2-4570-8720-f9295bb65ba6 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:16.132983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92d5499e-8bf2-4570-8720-f9295bb65ba6 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:16.133760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92d5499e-8bf2-4570-8720-f9295bb65ba6 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:16.134782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92d5499e-8bf2-4570-8720-f9295bb65ba6 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:16.213782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1418efac-b353-4de0-82e6-d1f25400deb9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:16.263026 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1418efac-b353-4de0-82e6-d1f25400deb9 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1322 microversion: 2.1 time: 0.778634 Oct 24 10:42:16.263645 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1984/3924] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:15 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1322 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:16.279941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f0bfb5e1-a186-400e-88a8-20b99a43488d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:16.283183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f0bfb5e1-a186-400e-88a8-20b99a43488d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:16.319033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0bfb5e1-a186-400e-88a8-20b99a43488d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:16.319837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0bfb5e1-a186-400e-88a8-20b99a43488d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:16.320463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0bfb5e1-a186-400e-88a8-20b99a43488d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:16.321397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0bfb5e1-a186-400e-88a8-20b99a43488d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:16.324273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0bfb5e1-a186-400e-88a8-20b99a43488d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:16.324983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0bfb5e1-a186-400e-88a8-20b99a43488d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:16.385397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-92d5499e-8bf2-4570-8720-f9295bb65ba6 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:16.399845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f0bfb5e1-a186-400e-88a8-20b99a43488d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:42:16.404334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-92d5499e-8bf2-4570-8720-f9295bb65ba6 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:16.407153 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.compute.api [None req-f0bfb5e1-a186-400e-88a8-20b99a43488d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Working on deleting snapshot 5e158af8-f03d-4d02-8d79-c776a3484343 from shelved instance... Oct 24 10:42:16.411047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-92d5499e-8bf2-4570-8720-f9295bb65ba6 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:16.414923 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-92d5499e-8bf2-4570-8720-f9295bb65ba6 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1415 microversion: 2.54 time: 0.334808 Oct 24 10:42:16.429388 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1941/3925] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:16 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1415 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:16.585706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-742c21b5-a763-4c7d-b2a6-a28d88d76687 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:16.586273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-742c21b5-a763-4c7d-b2a6-a28d88d76687 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:16.602354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-742c21b5-a763-4c7d-b2a6-a28d88d76687 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:16.602850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-742c21b5-a763-4c7d-b2a6-a28d88d76687 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:16.607851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-742c21b5-a763-4c7d-b2a6-a28d88d76687 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:16.609993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-742c21b5-a763-4c7d-b2a6-a28d88d76687 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:16.616189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-742c21b5-a763-4c7d-b2a6-a28d88d76687 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:16.619921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-742c21b5-a763-4c7d-b2a6-a28d88d76687 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:17.257883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-742c21b5-a763-4c7d-b2a6-a28d88d76687 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:17.269506 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-742c21b5-a763-4c7d-b2a6-a28d88d76687 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1481 microversion: 2.1 time: 0.690420 Oct 24 10:42:17.303050 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1942/3926] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:16 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1481 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:17.312665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a3adeb9b-e0c5-480a-acf4-6963b3c706f3 req-19f5b4b5-35b6-4b8e-8709-1f910e7c2667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cee981b9-6221-467f-bce3-e911488983ad", "tag": "7c636450-35fa-4e6c-861a-6b258e553318"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:17.383224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a3adeb9b-e0c5-480a-acf4-6963b3c706f3 req-19f5b4b5-35b6-4b8e-8709-1f910e7c2667 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:17.383861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a3adeb9b-e0c5-480a-acf4-6963b3c706f3 req-19f5b4b5-35b6-4b8e-8709-1f910e7c2667 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:17.384462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a3adeb9b-e0c5-480a-acf4-6963b3c706f3 req-19f5b4b5-35b6-4b8e-8709-1f910e7c2667 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:17.459523 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a3adeb9b-e0c5-480a-acf4-6963b3c706f3 req-19f5b4b5-35b6-4b8e-8709-1f910e7c2667 service nova] Creating event network-changed:7c636450-35fa-4e6c-861a-6b258e553318 for instance cee981b9-6221-467f-bce3-e911488983ad on n-h2-858383-15 Oct 24 10:42:17.473867 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a3adeb9b-e0c5-480a-acf4-6963b3c706f3 req-19f5b4b5-35b6-4b8e-8709-1f910e7c2667 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168857 Oct 24 10:42:17.474506 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1943/3927] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:17.510371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-83bf7588-a8dd-42c7-9b1e-30469ab2fd00 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:17.519455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-83bf7588-a8dd-42c7-9b1e-30469ab2fd00 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:17.543618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83bf7588-a8dd-42c7-9b1e-30469ab2fd00 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:17.544206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83bf7588-a8dd-42c7-9b1e-30469ab2fd00 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:17.546618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83bf7588-a8dd-42c7-9b1e-30469ab2fd00 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:17.548300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83bf7588-a8dd-42c7-9b1e-30469ab2fd00 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:17.553875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83bf7588-a8dd-42c7-9b1e-30469ab2fd00 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:17.555106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83bf7588-a8dd-42c7-9b1e-30469ab2fd00 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:18.213259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-83bf7588-a8dd-42c7-9b1e-30469ab2fd00 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:18.226518 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-83bf7588-a8dd-42c7-9b1e-30469ab2fd00 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1514 microversion: 2.1 time: 0.740002 Oct 24 10:42:18.227128 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1944/3928] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:17 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1514 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:18.254200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e0ed7df4-f602-4165-a477-236b188f0bec tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:18.262373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e0ed7df4-f602-4165-a477-236b188f0bec tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:18.298907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0ed7df4-f602-4165-a477-236b188f0bec tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:18.299459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0ed7df4-f602-4165-a477-236b188f0bec tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:18.299928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0ed7df4-f602-4165-a477-236b188f0bec tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:18.306808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0ed7df4-f602-4165-a477-236b188f0bec tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:18.308502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0ed7df4-f602-4165-a477-236b188f0bec tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:18.311463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0ed7df4-f602-4165-a477-236b188f0bec tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:18.446710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f0bfb5e1-a186-400e-88a8-20b99a43488d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Doing local delete in cell 75e76125-592d-4292-bea1-3b51451d7165(cell1) {{(pid=120426) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 24 10:42:18.449556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0bfb5e1-a186-400e-88a8-20b99a43488d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:18.452711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0bfb5e1-a186-400e-88a8-20b99a43488d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:18.453689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0bfb5e1-a186-400e-88a8-20b99a43488d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:18.455637 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.compute.api [None req-f0bfb5e1-a186-400e-88a8-20b99a43488d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 24 10:42:18.465534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-f0bfb5e1-a186-400e-88a8-20b99a43488d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] deallocate_for_instance() {{(pid=120426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 24 10:42:18.734865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e0ed7df4-f602-4165-a477-236b188f0bec tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:18.755083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e0ed7df4-f602-4165-a477-236b188f0bec tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:18.766744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e0ed7df4-f602-4165-a477-236b188f0bec tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:18.777042 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e0ed7df4-f602-4165-a477-236b188f0bec tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1400 microversion: 2.54 time: 0.539994 Oct 24 10:42:18.780777 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1945/3929] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:18 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1400 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:18.806608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b579ee63-323d-406c-a45f-6e5ccd122938 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:18.807942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b579ee63-323d-406c-a45f-6e5ccd122938 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: dd604035-ef97-496b-a5fe-0204c8dc7e46] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:18.854590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b579ee63-323d-406c-a45f-6e5ccd122938 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:18.859791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b579ee63-323d-406c-a45f-6e5ccd122938 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:18.860563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b579ee63-323d-406c-a45f-6e5ccd122938 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:18.861676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b579ee63-323d-406c-a45f-6e5ccd122938 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:18.862260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b579ee63-323d-406c-a45f-6e5ccd122938 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:18.863575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b579ee63-323d-406c-a45f-6e5ccd122938 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:19.835268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b579ee63-323d-406c-a45f-6e5ccd122938 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:19.850855 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b579ee63-323d-406c-a45f-6e5ccd122938 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/dd604035-ef97-496b-a5fe-0204c8dc7e46" status: 200 len: 1514 microversion: 2.1 time: 1.067943 Oct 24 10:42:19.851607 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1946/3930] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:18 2022] GET /compute/v2.1/servers/dd604035-ef97-496b-a5fe-0204c8dc7e46 => generated 1514 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:19.884933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-47304c5c-ff5f-4fe4-808b-46b19039300f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '.version_select at 0x7f04cbb89ee0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:19.942998 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-47304c5c-ff5f-4fe4-808b-46b19039300f tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1151893838" status: 204 len: 0 microversion: 2.54 time: 0.073073 Oct 24 10:42:19.946798 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1947/3931] 10.222.0.50 () {60 vars in 1319 bytes} [Mon Oct 24 10:42:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1151893838 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:42:19.949632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-803ddd57-e2be-4a7a-af0e-95ee1ac06f01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:19.952018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-803ddd57-e2be-4a7a-af0e-95ee1ac06f01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:19.968642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-803ddd57-e2be-4a7a-af0e-95ee1ac06f01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:19.969202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-803ddd57-e2be-4a7a-af0e-95ee1ac06f01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:19.969655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-803ddd57-e2be-4a7a-af0e-95ee1ac06f01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:19.976501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-803ddd57-e2be-4a7a-af0e-95ee1ac06f01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:19.980874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-803ddd57-e2be-4a7a-af0e-95ee1ac06f01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:19.981409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-803ddd57-e2be-4a7a-af0e-95ee1ac06f01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:20.440562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-803ddd57-e2be-4a7a-af0e-95ee1ac06f01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:20.455888 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-803ddd57-e2be-4a7a-af0e-95ee1ac06f01 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d" status: 200 len: 1514 microversion: 2.1 time: 0.510171 Oct 24 10:42:20.458829 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1948/3932] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:19 2022] GET /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d => generated 1514 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:20.478826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-681c8bc3-dcf6-44f1-973b-e78123cc48db tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:20.485179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-681c8bc3-dcf6-44f1-973b-e78123cc48db tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:20.502188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-681c8bc3-dcf6-44f1-973b-e78123cc48db tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:20.502696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-681c8bc3-dcf6-44f1-973b-e78123cc48db tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:20.505951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-681c8bc3-dcf6-44f1-973b-e78123cc48db tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:20.507374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-681c8bc3-dcf6-44f1-973b-e78123cc48db tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:20.507867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-681c8bc3-dcf6-44f1-973b-e78123cc48db tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:20.508313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-681c8bc3-dcf6-44f1-973b-e78123cc48db tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:20.569542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-681c8bc3-dcf6-44f1-973b-e78123cc48db tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:42:20.739895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-f0bfb5e1-a186-400e-88a8-20b99a43488d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Updating instance_info_cache with network_info: [] {{(pid=120426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 24 10:42:20.743514 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-681c8bc3-dcf6-44f1-973b-e78123cc48db tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "DELETE /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 204 len: 0 microversion: 2.54 time: 0.271153 Oct 24 10:42:20.746150 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1949/3933] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:42:20 2022] DELETE /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:42:20.764398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d07f2b58-8671-43df-a272-cbec471d914e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:20.768298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d07f2b58-8671-43df-a272-cbec471d914e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:20.785557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d07f2b58-8671-43df-a272-cbec471d914e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:20.788086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d07f2b58-8671-43df-a272-cbec471d914e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:20.788485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d07f2b58-8671-43df-a272-cbec471d914e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:20.790677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d07f2b58-8671-43df-a272-cbec471d914e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:20.792499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d07f2b58-8671-43df-a272-cbec471d914e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:20.794192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d07f2b58-8671-43df-a272-cbec471d914e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:20.868478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d07f2b58-8671-43df-a272-cbec471d914e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:42:21.010869 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d07f2b58-8671-43df-a272-cbec471d914e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d" status: 204 len: 0 microversion: 2.1 time: 0.262822 Oct 24 10:42:21.012148 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1950/3934] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:42:20 2022] DELETE /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:42:21.024357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-544efacc-00aa-4eff-8053-45b5ea42ac10 req-879caf99-2adb-4dfd-b8f3-4d4001f3c597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6203fa6d-e5c6-45fa-9584-cfcd993b5cdf", "name": "network-vif-deleted", "tag": "2a70293f-229f-41bd-aadc-1ca0206a17d9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:21.047235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-544efacc-00aa-4eff-8053-45b5ea42ac10 req-879caf99-2adb-4dfd-b8f3-4d4001f3c597 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:21.049673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-544efacc-00aa-4eff-8053-45b5ea42ac10 req-879caf99-2adb-4dfd-b8f3-4d4001f3c597 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:21.051390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-544efacc-00aa-4eff-8053-45b5ea42ac10 req-879caf99-2adb-4dfd-b8f3-4d4001f3c597 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:21.083051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.compute.server_external_events [req-544efacc-00aa-4eff-8053-45b5ea42ac10 req-879caf99-2adb-4dfd-b8f3-4d4001f3c597 service nova] Unable to find a host for instance 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf. Dropping event network-vif-deleted {{(pid=120425) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 24 10:42:21.098778 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-544efacc-00aa-4eff-8053-45b5ea42ac10 req-879caf99-2adb-4dfd-b8f3-4d4001f3c597 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.080419 Oct 24 10:42:21.099731 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1951/3935] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 87 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 24 10:42:21.117275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b2eebb7-e1bd-4877-990f-7329ab75915e tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:21.119895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6b2eebb7-e1bd-4877-990f-7329ab75915e tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:21.162109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b2eebb7-e1bd-4877-990f-7329ab75915e tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:21.162731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b2eebb7-e1bd-4877-990f-7329ab75915e tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:21.163141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b2eebb7-e1bd-4877-990f-7329ab75915e tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:21.163876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b2eebb7-e1bd-4877-990f-7329ab75915e tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:21.164331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b2eebb7-e1bd-4877-990f-7329ab75915e tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:21.166976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b2eebb7-e1bd-4877-990f-7329ab75915e tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:21.432398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=90 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:42:21.472866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6b2eebb7-e1bd-4877-990f-7329ab75915e tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:21.489512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6b2eebb7-e1bd-4877-990f-7329ab75915e tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:21.493860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6b2eebb7-e1bd-4877-990f-7329ab75915e tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:21.502187 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6b2eebb7-e1bd-4877-990f-7329ab75915e tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1406 microversion: 2.54 time: 0.398910 Oct 24 10:42:21.504589 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1952/3936] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:21 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1406 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:21.511248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e4d2098d-76bd-428a-a326-f41c2d87ab61 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:21.512524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e4d2098d-76bd-428a-a326-f41c2d87ab61 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:21.519299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4d2098d-76bd-428a-a326-f41c2d87ab61 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:21.520149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4d2098d-76bd-428a-a326-f41c2d87ab61 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:21.520887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4d2098d-76bd-428a-a326-f41c2d87ab61 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:21.522877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4d2098d-76bd-428a-a326-f41c2d87ab61 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:21.523569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4d2098d-76bd-428a-a326-f41c2d87ab61 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:21.524349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4d2098d-76bd-428a-a326-f41c2d87ab61 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:21.590761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=11,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:42:21.671938 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f0bfb5e1-a186-400e-88a8-20b99a43488d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 204 len: 0 microversion: 2.1 time: 5.405731 Oct 24 10:42:21.672539 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1985/3937] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:42:16 2022] DELETE /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 0 bytes in 5407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:42:21.685360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c1a2dd83-209b-40c2-892a-d0dde190db63 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:21.687233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c1a2dd83-209b-40c2-892a-d0dde190db63 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:21.697832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1a2dd83-209b-40c2-892a-d0dde190db63 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:21.708888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1a2dd83-209b-40c2-892a-d0dde190db63 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:21.709626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1a2dd83-209b-40c2-892a-d0dde190db63 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:21.710642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1a2dd83-209b-40c2-892a-d0dde190db63 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:21.711328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1a2dd83-209b-40c2-892a-d0dde190db63 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:21.711971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1a2dd83-209b-40c2-892a-d0dde190db63 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:21.730722 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-c1a2dd83-209b-40c2-892a-d0dde190db63 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] HTTP exception thrown: Instance 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf could not be found. Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c1a2dd83-209b-40c2-892a-d0dde190db63 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Request method failure captured: Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf HTTP/1.1 Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmmuJrxb1XlWB_avRxRliGRWB1RGcH6tFur30cSKqOzu2vxHhNtoBzNqu_iNWZYArPhjvCegW23YNaUUHwXw7ggKhvTGZpm4y2TCmcCle2W-rg0Uf0xse67nTky9VDrkBwyVUxKaUO1HKMfXPydd2Jmdynf6tgSS0X6qgnwmk8AaC6o Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4878c0e43a9d4db8ba5c6590b43624f0 Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerActionsTestJSON-1882077751 Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4878c0e43a9d4db8ba5c6590b43624f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4878c0e43a9d4db8ba5c6590b43624f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4878c0e43a9d4db8ba5c6590b43624f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4878c0e43a9d4db8ba5c6590b43624f0", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerActionsTestJSON-1882077751 Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4878c0e43a9d4db8ba5c6590b43624f0 Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerActionsTestJSON-1882077751 Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerActionsTestJSON-1882077751-project Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 45500f699a6f463b8755f0417b24151c Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerActionsTestJSON-1882077751-project Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf could not be found. Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '6203fa6d-e5c6-45fa-9584-cfcd993b5cdf'} Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf could not be found. Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf could not be found. Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:21.732768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:21.735906 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:21.735906 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:21.735906 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:21.735906 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:42:21.735906 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:42:21.735906 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf could not be found. Oct 24 10:42:21.735906 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:21.738561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c1a2dd83-209b-40c2-892a-d0dde190db63 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Returning 404 to user: Instance 6203fa6d-e5c6-45fa-9584-cfcd993b5cdf could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:42:21.739858 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c1a2dd83-209b-40c2-892a-d0dde190db63 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf" status: 404 len: 111 microversion: 2.1 time: 0.061538 Oct 24 10:42:21.747363 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1986/3938] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:21 2022] GET /compute/v2.1/servers/6203fa6d-e5c6-45fa-9584-cfcd993b5cdf => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:42:21.754673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e36ef3e9-c817-4651-b353-98b0c452a63c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:21.762975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e36ef3e9-c817-4651-b353-98b0c452a63c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:21.778342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e36ef3e9-c817-4651-b353-98b0c452a63c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:21.779860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e36ef3e9-c817-4651-b353-98b0c452a63c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:21.780507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e36ef3e9-c817-4651-b353-98b0c452a63c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:21.782233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e36ef3e9-c817-4651-b353-98b0c452a63c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:21.782862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e36ef3e9-c817-4651-b353-98b0c452a63c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:21.783679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e36ef3e9-c817-4651-b353-98b0c452a63c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:21.838213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e36ef3e9-c817-4651-b353-98b0c452a63c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:42:21.985972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e4d2098d-76bd-428a-a326-f41c2d87ab61 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:21.995940 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e4d2098d-76bd-428a-a326-f41c2d87ab61 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d" status: 200 len: 1520 microversion: 2.1 time: 0.489655 Oct 24 10:42:22.001450 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1953/3939] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:21 2022] GET /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d => generated 1520 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:22.025116 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e36ef3e9-c817-4651-b353-98b0c452a63c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 204 len: 0 microversion: 2.1 time: 0.274069 Oct 24 10:42:22.026350 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1987/3940] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:42:21 2022] DELETE /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:42:22.034281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a46dc94d-a0a5-405e-8113-f3d2209291a3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:22.035582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a46dc94d-a0a5-405e-8113-f3d2209291a3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:22.054891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a46dc94d-a0a5-405e-8113-f3d2209291a3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:22.055870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a46dc94d-a0a5-405e-8113-f3d2209291a3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:22.056482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a46dc94d-a0a5-405e-8113-f3d2209291a3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:22.057413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a46dc94d-a0a5-405e-8113-f3d2209291a3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:22.060665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a46dc94d-a0a5-405e-8113-f3d2209291a3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:22.061167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a46dc94d-a0a5-405e-8113-f3d2209291a3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:22.258408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a46dc94d-a0a5-405e-8113-f3d2209291a3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:22.267437 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a46dc94d-a0a5-405e-8113-f3d2209291a3 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1467 microversion: 2.1 time: 0.237191 Oct 24 10:42:22.285533 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1954/3941] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:22 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1467 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:22.533640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d741af56-c367-4c49-bfb0-5e14f3fe49ad tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:22.535311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d741af56-c367-4c49-bfb0-5e14f3fe49ad tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:22.562191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d741af56-c367-4c49-bfb0-5e14f3fe49ad tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:22.565871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d741af56-c367-4c49-bfb0-5e14f3fe49ad tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:22.581028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d741af56-c367-4c49-bfb0-5e14f3fe49ad tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:22.585950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d741af56-c367-4c49-bfb0-5e14f3fe49ad tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:22.586475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d741af56-c367-4c49-bfb0-5e14f3fe49ad tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:22.586929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d741af56-c367-4c49-bfb0-5e14f3fe49ad tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:22.865932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d741af56-c367-4c49-bfb0-5e14f3fe49ad tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:22.886806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d741af56-c367-4c49-bfb0-5e14f3fe49ad tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:22.891765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d741af56-c367-4c49-bfb0-5e14f3fe49ad tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:22.893132 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d741af56-c367-4c49-bfb0-5e14f3fe49ad tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1406 microversion: 2.54 time: 0.366103 Oct 24 10:42:22.896218 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1988/3942] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:22 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1406 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:23.026022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d91bb3c6-e367-4376-8960-47016996b584 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:23.027421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d91bb3c6-e367-4376-8960-47016996b584 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:23.035916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d91bb3c6-e367-4376-8960-47016996b584 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:23.037439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d91bb3c6-e367-4376-8960-47016996b584 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:23.041065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d91bb3c6-e367-4376-8960-47016996b584 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:23.042844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d91bb3c6-e367-4376-8960-47016996b584 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:23.043544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d91bb3c6-e367-4376-8960-47016996b584 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:23.044195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d91bb3c6-e367-4376-8960-47016996b584 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:23.294383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0e34a6bc-27f9-42b3-952e-df6f41c1d4a9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:23.295443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0e34a6bc-27f9-42b3-952e-df6f41c1d4a9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:23.309215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e34a6bc-27f9-42b3-952e-df6f41c1d4a9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:23.311740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e34a6bc-27f9-42b3-952e-df6f41c1d4a9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:23.312596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e34a6bc-27f9-42b3-952e-df6f41c1d4a9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:23.318102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e34a6bc-27f9-42b3-952e-df6f41c1d4a9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:23.320411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e34a6bc-27f9-42b3-952e-df6f41c1d4a9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:23.326873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e34a6bc-27f9-42b3-952e-df6f41c1d4a9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:23.605112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d91bb3c6-e367-4376-8960-47016996b584 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:23.607815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:42:23.623691 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d91bb3c6-e367-4376-8960-47016996b584 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d" status: 200 len: 1520 microversion: 2.1 time: 0.600014 Oct 24 10:42:23.633707 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1955/3943] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:23 2022] GET /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d => generated 1520 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:23.684677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0e34a6bc-27f9-42b3-952e-df6f41c1d4a9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:23.714666 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0e34a6bc-27f9-42b3-952e-df6f41c1d4a9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1467 microversion: 2.1 time: 0.425583 Oct 24 10:42:23.719696 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1989/3944] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:23 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1467 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:42:23.923617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0fcb3389-6be2-4532-a53c-d6bb96e74963 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:23.924479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0fcb3389-6be2-4532-a53c-d6bb96e74963 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:23.938674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fcb3389-6be2-4532-a53c-d6bb96e74963 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:23.939393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fcb3389-6be2-4532-a53c-d6bb96e74963 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:23.940073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fcb3389-6be2-4532-a53c-d6bb96e74963 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:23.963393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fcb3389-6be2-4532-a53c-d6bb96e74963 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:23.965742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fcb3389-6be2-4532-a53c-d6bb96e74963 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:23.966660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fcb3389-6be2-4532-a53c-d6bb96e74963 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:24.174664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0fcb3389-6be2-4532-a53c-d6bb96e74963 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:24.186655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0fcb3389-6be2-4532-a53c-d6bb96e74963 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:24.190592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0fcb3389-6be2-4532-a53c-d6bb96e74963 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:24.195281 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0fcb3389-6be2-4532-a53c-d6bb96e74963 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1406 microversion: 2.54 time: 0.275461 Oct 24 10:42:24.209602 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1956/3945] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:23 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1406 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:24.402636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-86839a22-a785-4050-bafd-f4b23241ad67 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Action: 'create', calling method: .version_select at 0x7f04d0970790>, body: {"keypair": {"name": "tempest-keypair-1388564245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUu1NGMKqzDTR7iVrUYZWlGDHtqtHEkVQiNlQjr7lAtDVKVBZBEB3lM9gPRS7w8PN2/5fZT+n+HsRZqNlM6G0X14KjeZeM+kgAkmK7/zhHnwHeU/O2Jrrh3+qQ8JF0/Mg=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:24.426688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-86839a22-a785-4050-bafd-f4b23241ad67 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Getting quotas for project acb35f419a9b4edd8f5d6b4fe52d0705. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:42:24.435309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-86839a22-a785-4050-bafd-f4b23241ad67 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Getting quotas for user bd761f0733fa47b0bb5fed8c80dafac0 and project acb35f419a9b4edd8f5d6b4fe52d0705. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:42:24.501851 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-86839a22-a785-4050-bafd-f4b23241ad67 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.569940 Oct 24 10:42:24.504776 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1990/3946] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:42:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:24.654183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68cf769d-9f1f-4525-8ebd-e74adf3bcaf3 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:24.654814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-68cf769d-9f1f-4525-8ebd-e74adf3bcaf3 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:24.668761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68cf769d-9f1f-4525-8ebd-e74adf3bcaf3 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:24.669445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68cf769d-9f1f-4525-8ebd-e74adf3bcaf3 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:24.670850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68cf769d-9f1f-4525-8ebd-e74adf3bcaf3 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:24.671952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68cf769d-9f1f-4525-8ebd-e74adf3bcaf3 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:24.672715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68cf769d-9f1f-4525-8ebd-e74adf3bcaf3 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:24.673657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68cf769d-9f1f-4525-8ebd-e74adf3bcaf3 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:24.758042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c471892a-582a-4b5c-b418-0347d254cb6c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:24.759152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c471892a-582a-4b5c-b418-0347d254cb6c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:24.776183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c471892a-582a-4b5c-b418-0347d254cb6c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:24.780828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c471892a-582a-4b5c-b418-0347d254cb6c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:24.781754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c471892a-582a-4b5c-b418-0347d254cb6c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:24.782785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c471892a-582a-4b5c-b418-0347d254cb6c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:24.783437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c471892a-582a-4b5c-b418-0347d254cb6c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:24.787010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c471892a-582a-4b5c-b418-0347d254cb6c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:25.263746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c471892a-582a-4b5c-b418-0347d254cb6c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:25.277098 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c471892a-582a-4b5c-b418-0347d254cb6c tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1467 microversion: 2.1 time: 0.531069 Oct 24 10:42:25.277873 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1991/3947] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:24 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1467 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:25.289287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-510b62a7-8220-47d8-8440-bb38c5c37d9a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:25.292365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-510b62a7-8220-47d8-8440-bb38c5c37d9a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:25.307860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-510b62a7-8220-47d8-8440-bb38c5c37d9a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:25.308746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-510b62a7-8220-47d8-8440-bb38c5c37d9a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:25.310171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-510b62a7-8220-47d8-8440-bb38c5c37d9a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:25.312095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-510b62a7-8220-47d8-8440-bb38c5c37d9a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:25.313768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-510b62a7-8220-47d8-8440-bb38c5c37d9a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:25.314767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-510b62a7-8220-47d8-8440-bb38c5c37d9a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:25.576071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-68cf769d-9f1f-4525-8ebd-e74adf3bcaf3 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:25.587537 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-68cf769d-9f1f-4525-8ebd-e74adf3bcaf3 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d" status: 200 len: 1520 microversion: 2.1 time: 0.938205 Oct 24 10:42:25.587930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-510b62a7-8220-47d8-8440-bb38c5c37d9a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:25.588402 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1957/3948] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:24 2022] GET /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d => generated 1520 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:25.598705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-510b62a7-8220-47d8-8440-bb38c5c37d9a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:25.603592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-510b62a7-8220-47d8-8440-bb38c5c37d9a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:25.608758 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-510b62a7-8220-47d8-8440-bb38c5c37d9a tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1406 microversion: 2.54 time: 0.323287 Oct 24 10:42:25.611002 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1992/3949] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:25 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:26.174536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ae99c444-9069-4913-8345-d92f3e17ea8f req-e14725f2-e8fa-4008-81d9-8c8bd2461cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dffdbb2-6b3c-4b29-9016-40f1a54bda8d", "name": "network-vif-deleted", "tag": "6ee57c06-f546-493d-8c76-cb3c3ea23bee"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:26.225255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ae99c444-9069-4913-8345-d92f3e17ea8f req-e14725f2-e8fa-4008-81d9-8c8bd2461cd1 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:26.225750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ae99c444-9069-4913-8345-d92f3e17ea8f req-e14725f2-e8fa-4008-81d9-8c8bd2461cd1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:26.226185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ae99c444-9069-4913-8345-d92f3e17ea8f req-e14725f2-e8fa-4008-81d9-8c8bd2461cd1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:26.287062 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ae99c444-9069-4913-8345-d92f3e17ea8f req-e14725f2-e8fa-4008-81d9-8c8bd2461cd1 service nova] Creating event network-vif-deleted:6ee57c06-f546-493d-8c76-cb3c3ea23bee for instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d on n-h1-858383-15 Oct 24 10:42:26.304319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eefb371f-e78a-4533-a3f6-64058e6b0ff9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:26.307652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-eefb371f-e78a-4533-a3f6-64058e6b0ff9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:26.311387 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ae99c444-9069-4913-8345-d92f3e17ea8f req-e14725f2-e8fa-4008-81d9-8c8bd2461cd1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139148 Oct 24 10:42:26.315625 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1958/3950] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:26.326432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eefb371f-e78a-4533-a3f6-64058e6b0ff9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:26.327547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eefb371f-e78a-4533-a3f6-64058e6b0ff9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:26.330893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eefb371f-e78a-4533-a3f6-64058e6b0ff9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:26.333355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eefb371f-e78a-4533-a3f6-64058e6b0ff9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:26.335321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eefb371f-e78a-4533-a3f6-64058e6b0ff9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:26.335986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eefb371f-e78a-4533-a3f6-64058e6b0ff9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:26.502057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-eefb371f-e78a-4533-a3f6-64058e6b0ff9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:26.515990 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-eefb371f-e78a-4533-a3f6-64058e6b0ff9 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1467 microversion: 2.1 time: 0.217656 Oct 24 10:42:26.516634 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1993/3951] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:26 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1467 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:42:26.621189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ceb16c17-57b5-459f-b309-0397e31dfa42 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:26.624873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ceb16c17-57b5-459f-b309-0397e31dfa42 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:26.640073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-961c3345-ca9d-4ad1-9f4c-28e4e31e3f08 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:26.640805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-961c3345-ca9d-4ad1-9f4c-28e4e31e3f08 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:26.652153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb16c17-57b5-459f-b309-0397e31dfa42 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:26.654377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb16c17-57b5-459f-b309-0397e31dfa42 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:26.656502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb16c17-57b5-459f-b309-0397e31dfa42 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:26.657104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-961c3345-ca9d-4ad1-9f4c-28e4e31e3f08 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:26.658090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb16c17-57b5-459f-b309-0397e31dfa42 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:26.658682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-961c3345-ca9d-4ad1-9f4c-28e4e31e3f08 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:26.661360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb16c17-57b5-459f-b309-0397e31dfa42 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:26.661932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-961c3345-ca9d-4ad1-9f4c-28e4e31e3f08 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:26.662789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-961c3345-ca9d-4ad1-9f4c-28e4e31e3f08 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:26.663690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb16c17-57b5-459f-b309-0397e31dfa42 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:26.668272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-961c3345-ca9d-4ad1-9f4c-28e4e31e3f08 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:26.669720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-961c3345-ca9d-4ad1-9f4c-28e4e31e3f08 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:26.772335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb16c17-57b5-459f-b309-0397e31dfa42 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:26.775644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb16c17-57b5-459f-b309-0397e31dfa42 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:26.776705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb16c17-57b5-459f-b309-0397e31dfa42 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:26.778594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-ceb16c17-57b5-459f-b309-0397e31dfa42 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lazy-loading 'fault' on Instance uuid 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:42:26.856899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-961c3345-ca9d-4ad1-9f4c-28e4e31e3f08 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:26.858844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-961c3345-ca9d-4ad1-9f4c-28e4e31e3f08 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:26.861438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-961c3345-ca9d-4ad1-9f4c-28e4e31e3f08 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:26.862034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-961c3345-ca9d-4ad1-9f4c-28e4e31e3f08 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lazy-loading 'fault' on Instance uuid 57cb67c6-d4e8-413e-82af-594d0194f318 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:42:26.877544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ceb16c17-57b5-459f-b309-0397e31dfa42 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:26.891007 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ceb16c17-57b5-459f-b309-0397e31dfa42 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d" status: 200 len: 1312 microversion: 2.1 time: 0.271615 Oct 24 10:42:26.907395 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1959/3952] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:26 2022] GET /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d => generated 1312 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:26.963625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-961c3345-ca9d-4ad1-9f4c-28e4e31e3f08 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:27.018190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-961c3345-ca9d-4ad1-9f4c-28e4e31e3f08 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:27.027788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-961c3345-ca9d-4ad1-9f4c-28e4e31e3f08 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5aaf8794c7024604991cfe102905e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78644fba30f24012a4811ad5caef39a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:27.033092 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-961c3345-ca9d-4ad1-9f4c-28e4e31e3f08 tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 200 len: 1411 microversion: 2.54 time: 0.394841 Oct 24 10:42:27.039350 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1994/3953] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:26 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 1411 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:27.149671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f3c36128-227c-4fb8-a8bf-d861be3a1649 req-6291cc40-f636-4e6a-ae1b-b57d6debf562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5da901c-0851-4c31-9547-cd138b752ed6", "name": "network-vif-deleted", "tag": "4f06be00-fe8b-4664-a038-85071a5cc14e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:27.175784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f3c36128-227c-4fb8-a8bf-d861be3a1649 req-6291cc40-f636-4e6a-ae1b-b57d6debf562 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:27.178758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f3c36128-227c-4fb8-a8bf-d861be3a1649 req-6291cc40-f636-4e6a-ae1b-b57d6debf562 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:27.180405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f3c36128-227c-4fb8-a8bf-d861be3a1649 req-6291cc40-f636-4e6a-ae1b-b57d6debf562 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:27.219948 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f3c36128-227c-4fb8-a8bf-d861be3a1649 req-6291cc40-f636-4e6a-ae1b-b57d6debf562 service nova] Creating event network-vif-deleted:4f06be00-fe8b-4664-a038-85071a5cc14e for instance b5da901c-0851-4c31-9547-cd138b752ed6 on n-h1-858383-15 Oct 24 10:42:27.232397 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f3c36128-227c-4fb8-a8bf-d861be3a1649 req-6291cc40-f636-4e6a-ae1b-b57d6debf562 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086793 Oct 24 10:42:27.236911 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1960/3954] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:27.541987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f14a8806-5cdd-4c9d-a95d-a2226e77c392 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:27.543762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f14a8806-5cdd-4c9d-a95d-a2226e77c392 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:27.568237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f14a8806-5cdd-4c9d-a95d-a2226e77c392 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:27.571014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f14a8806-5cdd-4c9d-a95d-a2226e77c392 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:27.574242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f14a8806-5cdd-4c9d-a95d-a2226e77c392 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:27.575383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f14a8806-5cdd-4c9d-a95d-a2226e77c392 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:27.576087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f14a8806-5cdd-4c9d-a95d-a2226e77c392 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:27.578794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f14a8806-5cdd-4c9d-a95d-a2226e77c392 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:27.675849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f14a8806-5cdd-4c9d-a95d-a2226e77c392 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:27.677099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f14a8806-5cdd-4c9d-a95d-a2226e77c392 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:27.682210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f14a8806-5cdd-4c9d-a95d-a2226e77c392 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:27.682935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-f14a8806-5cdd-4c9d-a95d-a2226e77c392 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lazy-loading 'fault' on Instance uuid b5da901c-0851-4c31-9547-cd138b752ed6 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:42:27.861960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f14a8806-5cdd-4c9d-a95d-a2226e77c392 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:27.872473 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f14a8806-5cdd-4c9d-a95d-a2226e77c392 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 200 len: 1305 microversion: 2.1 time: 0.334343 Oct 24 10:42:27.874714 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1995/3955] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:27 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 1305 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:42:27.916497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5051df8-fb3f-4450-83d7-617380f696fb tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:27.917194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d5051df8-fb3f-4450-83d7-617380f696fb tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:27.925436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5051df8-fb3f-4450-83d7-617380f696fb tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:27.937245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5051df8-fb3f-4450-83d7-617380f696fb tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:27.937948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5051df8-fb3f-4450-83d7-617380f696fb tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:27.939523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5051df8-fb3f-4450-83d7-617380f696fb tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:27.940214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5051df8-fb3f-4450-83d7-617380f696fb tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:27.941593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5051df8-fb3f-4450-83d7-617380f696fb tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:27.960035 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-d5051df8-fb3f-4450-83d7-617380f696fb tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] HTTP exception thrown: Instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d could not be found. Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5051df8-fb3f-4450-83d7-617380f696fb tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Request method failure captured: Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d HTTP/1.1 Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmvnykDaWU90T9uEDjktnTuEtAiCn9pTLtyRLfx5clShS51uyqjNB_hZnlnl8muxvmtqHjHMteZxeTWXgrqBzBZyPoGuLksbAPvyURZnGAVPfHXwLfZgz6kLMKDe-ic6nWVdeLrvto-K73QKjrS3Ub3HGy4Y8aiXj_Zo2LxGnNr1PAk Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 743ff130bbae4b6e8022b30e821c4eb7 Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_743ff130bbae4b6e8022b30e821c4eb7", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 743ff130bbae4b6e8022b30e821c4eb7 Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ListServersNegativeTestJSON-1287264984-project Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: c9aeff583c6141f487eb07e6e1ec3986 Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ListServersNegativeTestJSON-1287264984-project Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d could not be found. Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '8dffdbb2-6b3c-4b29-9016-40f1a54bda8d'} Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d could not be found. Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d could not be found. Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:27.962709 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:27.966895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:27.966895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:27.966895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:27.966895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:27.966895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:42:27.966895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:42:27.966895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d could not be found. Oct 24 10:42:27.966895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:27.966895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5051df8-fb3f-4450-83d7-617380f696fb tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Returning 404 to user: Instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:42:27.966895 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d5051df8-fb3f-4450-83d7-617380f696fb tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d" status: 404 len: 111 microversion: 2.1 time: 0.053263 Oct 24 10:42:27.974499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2131ad54-3e59-491c-99fe-e00e4d209fb8 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:27.979685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2131ad54-3e59-491c-99fe-e00e4d209fb8 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:27.980600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2131ad54-3e59-491c-99fe-e00e4d209fb8 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '743ff130bbae4b6e8022b30e821c4eb7'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:42:27.985500 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1961/3956] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:27 2022] GET /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:42:28.001581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2131ad54-3e59-491c-99fe-e00e4d209fb8 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:28.006244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2131ad54-3e59-491c-99fe-e00e4d209fb8 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:28.008046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2131ad54-3e59-491c-99fe-e00e4d209fb8 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:28.009124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2131ad54-3e59-491c-99fe-e00e4d209fb8 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:28.010322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2131ad54-3e59-491c-99fe-e00e4d209fb8 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:28.012301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2131ad54-3e59-491c-99fe-e00e4d209fb8 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:28.067247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00f847fe-277e-41e3-ad25-f7ce543595cc tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:28.068042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00f847fe-277e-41e3-ad25-f7ce543595cc tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] [instance: 57cb67c6-d4e8-413e-82af-594d0194f318] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:28.077011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00f847fe-277e-41e3-ad25-f7ce543595cc tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:28.099051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00f847fe-277e-41e3-ad25-f7ce543595cc tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:28.099051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00f847fe-277e-41e3-ad25-f7ce543595cc tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:28.099051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00f847fe-277e-41e3-ad25-f7ce543595cc tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:28.099623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00f847fe-277e-41e3-ad25-f7ce543595cc tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:28.100088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00f847fe-277e-41e3-ad25-f7ce543595cc tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:28.166228 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-00f847fe-277e-41e3-ad25-f7ce543595cc tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] HTTP exception thrown: Instance 57cb67c6-d4e8-413e-82af-594d0194f318 could not be found. Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00f847fe-277e-41e3-ad25-f7ce543595cc tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Request method failure captured: Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 HTTP/1.1 Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmvcWzh3oT1SoFrFaU1N_fxqB7CyEOxZ8isvLbT6aQRJ7itIp3t-ngaubyH7x1vMiH20XDhrZTO2-V9HdHufi3NUoYA6gHU5n-agDb7HZ2doWnlNz2Eg5tPOFoUDXc1-UqEvSZvMhqkPCAd42TDUHqq_JdacW-CMck62tbp-FHFlZFs Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.54 Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 78644fba30f24012a4811ad5caef39a6 Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerShowV254Test-581695661 Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/78644fba30f24012a4811ad5caef39a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/78644fba30f24012a4811ad5caef39a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/78644fba30f24012a4811ad5caef39a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_78644fba30f24012a4811ad5caef39a6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerShowV254Test-581695661 Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 78644fba30f24012a4811ad5caef39a6 Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerShowV254Test-581695661 Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerShowV254Test-581695661-project Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5aaf8794c7024604991cfe102905e8bf Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerShowV254Test-581695661-project Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 57cb67c6-d4e8-413e-82af-594d0194f318 could not be found. Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '57cb67c6-d4e8-413e-82af-594d0194f318'} Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57cb67c6-d4e8-413e-82af-594d0194f318 could not be found. Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57cb67c6-d4e8-413e-82af-594d0194f318 could not be found. Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:28.169989 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.173492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:28.173492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:28.173492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:28.173492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:42:28.173492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:42:28.173492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57cb67c6-d4e8-413e-82af-594d0194f318 could not be found. Oct 24 10:42:28.173492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.174249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00f847fe-277e-41e3-ad25-f7ce543595cc tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] Returning 404 to user: Instance 57cb67c6-d4e8-413e-82af-594d0194f318 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:42:28.182844 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-00f847fe-277e-41e3-ad25-f7ce543595cc tempest-ServerShowV254Test-581695661 tempest-ServerShowV254Test-581695661-project] 10.222.0.50 "GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318" status: 404 len: 111 microversion: 2.54 time: 0.113281 Oct 24 10:42:28.183811 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1962/3957] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:28 2022] GET /compute/v2.1/servers/57cb67c6-d4e8-413e-82af-594d0194f318 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 24 10:42:28.291643 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2131ad54-3e59-491c-99fe-e00e4d209fb8 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.319009 Oct 24 10:42:28.292569 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1996/3958] 10.222.0.50 () {58 vars in 1230 bytes} [Mon Oct 24 10:42:27 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 10:42:28.308284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-84914fc5-ba50-4811-9964-26c698a64f15 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-84914fc5-ba50-4811-9964-26c698a64f15 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Request method failure captured: Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmvnykDaWU90T9uEDjktnTuEtAiCn9pTLtyRLfx5clShS51uyqjNB_hZnlnl8muxvmtqHjHMteZxeTWXgrqBzBZyPoGuLksbAPvyURZnGAVPfHXwLfZgz6kLMKDe-ic6nWVdeLrvto-K73QKjrS3Ub3HGy4Y8aiXj_Zo2LxGnNr1PAk Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 743ff130bbae4b6e8022b30e821c4eb7 Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_743ff130bbae4b6e8022b30e821c4eb7", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 743ff130bbae4b6e8022b30e821c4eb7 Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ListServersNegativeTestJSON-1287264984-project Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: c9aeff583c6141f487eb07e6e1ec3986 Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ListServersNegativeTestJSON-1287264984-project Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: action_args: {} Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 24 10:42:28.313087 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:42:28.317208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:42:28.317208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:42:28.317208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:42:28.317208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 24 10:42:28.317208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.317208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:28.317208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.317208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:28.317208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:28.317208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:28.317208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:42:28.317208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:42:28.317208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 24 10:42:28.317208 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.320460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-84914fc5-ba50-4811-9964-26c698a64f15 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:42:28.321751 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-84914fc5-ba50-4811-9964-26c698a64f15 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.018190 Oct 24 10:42:28.325638 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1963/3959] 10.222.0.50 () {58 vars in 1182 bytes} [Mon Oct 24 10:42:28 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:42:28.339135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d1d11de7-a947-44ad-8d04-f8b2a931b4d4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:28.344548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d1d11de7-a947-44ad-8d04-f8b2a931b4d4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:28.345822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d1d11de7-a947-44ad-8d04-f8b2a931b4d4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Searching by: {'deleted': False, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:42:28.351929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1d11de7-a947-44ad-8d04-f8b2a931b4d4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:28.352502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1d11de7-a947-44ad-8d04-f8b2a931b4d4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:28.353052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1d11de7-a947-44ad-8d04-f8b2a931b4d4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:28.354052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1d11de7-a947-44ad-8d04-f8b2a931b4d4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:28.354583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1d11de7-a947-44ad-8d04-f8b2a931b4d4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:28.355998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1d11de7-a947-44ad-8d04-f8b2a931b4d4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:28.401556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-d1d11de7-a947-44ad-8d04-f8b2a931b4d4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:42:28.459007 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d1d11de7-a947-44ad-8d04-f8b2a931b4d4 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.126116 Oct 24 10:42:28.476186 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1997/3960] 10.222.0.50 () {58 vars in 1125 bytes} [Mon Oct 24 10:42:28 2022] GET /compute/v2.1/servers => generated 681 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:28.481030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a886e73b-d82c-4e74-9262-5d8afa3581f1 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:28.487997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a886e73b-d82c-4e74-9262-5d8afa3581f1 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:28.491775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.compute.servers [None req-a886e73b-d82c-4e74-9262-5d8afa3581f1 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Removing options 'limit' from query {{(pid=120425) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 24 10:42:28.494052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a886e73b-d82c-4e74-9262-5d8afa3581f1 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Searching by: {'deleted': False, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:42:28.506251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a886e73b-d82c-4e74-9262-5d8afa3581f1 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:28.506996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a886e73b-d82c-4e74-9262-5d8afa3581f1 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:28.507785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a886e73b-d82c-4e74-9262-5d8afa3581f1 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:28.509431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a886e73b-d82c-4e74-9262-5d8afa3581f1 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:28.510478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a886e73b-d82c-4e74-9262-5d8afa3581f1 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:28.512273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a886e73b-d82c-4e74-9262-5d8afa3581f1 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:28.564438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.multi_cell_list [None req-a886e73b-d82c-4e74-9262-5d8afa3581f1 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120425) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:42:28.677654 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a886e73b-d82c-4e74-9262-5d8afa3581f1 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.203233 Oct 24 10:42:28.679054 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1964/3961] 10.222.0.50 () {58 vars in 1144 bytes} [Mon Oct 24 10:42:28 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:28.698278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d52386c-5335-4e1b-8e6a-99bc7cc0cbab tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d52386c-5335-4e1b-8e6a-99bc7cc0cbab tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Request method failure captured: Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmvnykDaWU90T9uEDjktnTuEtAiCn9pTLtyRLfx5clShS51uyqjNB_hZnlnl8muxvmtqHjHMteZxeTWXgrqBzBZyPoGuLksbAPvyURZnGAVPfHXwLfZgz6kLMKDe-ic6nWVdeLrvto-K73QKjrS3Ub3HGy4Y8aiXj_Zo2LxGnNr1PAk Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 743ff130bbae4b6e8022b30e821c4eb7 Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_743ff130bbae4b6e8022b30e821c4eb7", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 743ff130bbae4b6e8022b30e821c4eb7 Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ListServersNegativeTestJSON-1287264984-project Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: c9aeff583c6141f487eb07e6e1ec3986 Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ListServersNegativeTestJSON-1287264984-project Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: action_args: {} Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi '-1' Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 24 10:42:28.703827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 24 10:42:28.708432 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:42:28.708432 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:42:28.708432 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:42:28.708432 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:42:28.708432 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 24 10:42:28.708432 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.708432 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:28.708432 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.708432 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:28.708432 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:28.708432 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:28.708432 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:42:28.708432 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:42:28.708432 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 24 10:42:28.708432 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.711426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d52386c-5335-4e1b-8e6a-99bc7cc0cbab tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:42:28.728092 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2d52386c-5335-4e1b-8e6a-99bc7cc0cbab tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.034293 Oct 24 10:42:28.729495 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1998/3962] 10.222.0.50 () {58 vars in 1142 bytes} [Mon Oct 24 10:42:28 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:42:28.741913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-18b42b29-8e55-4241-a45e-be0e33fab342 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-18b42b29-8e55-4241-a45e-be0e33fab342 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Request method failure captured: Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmvnykDaWU90T9uEDjktnTuEtAiCn9pTLtyRLfx5clShS51uyqjNB_hZnlnl8muxvmtqHjHMteZxeTWXgrqBzBZyPoGuLksbAPvyURZnGAVPfHXwLfZgz6kLMKDe-ic6nWVdeLrvto-K73QKjrS3Ub3HGy4Y8aiXj_Zo2LxGnNr1PAk Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 743ff130bbae4b6e8022b30e821c4eb7 Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_743ff130bbae4b6e8022b30e821c4eb7", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 743ff130bbae4b6e8022b30e821c4eb7 Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ListServersNegativeTestJSON-1287264984-project Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: c9aeff583c6141f487eb07e6e1ec3986 Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ListServersNegativeTestJSON-1287264984-project Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: action_args: {} Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'testing' Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 24 10:42:28.748309 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 24 10:42:28.751797 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:42:28.751797 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:42:28.751797 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:42:28.751797 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:42:28.751797 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 24 10:42:28.751797 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.751797 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:28.751797 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.751797 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:28.751797 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:28.751797 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:28.751797 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:42:28.751797 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:42:28.751797 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 24 10:42:28.751797 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.757034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-18b42b29-8e55-4241-a45e-be0e33fab342 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:42:28.758134 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-18b42b29-8e55-4241-a45e-be0e33fab342 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.020783 Oct 24 10:42:28.758898 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1965/3963] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:42:28 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:42:28.768540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8bdd9a47-8c57-4a87-9f38-63f3231d32d1 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:28.774801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8bdd9a47-8c57-4a87-9f38-63f3231d32d1 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:28.783885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8bdd9a47-8c57-4a87-9f38-63f3231d32d1 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:42:28.794996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.compute.servers [None req-8bdd9a47-8c57-4a87-9f38-63f3231d32d1 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Flavor 'non_existing_flavor' could not be found {{(pid=120426) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 24 10:42:28.796287 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8bdd9a47-8c57-4a87-9f38-63f3231d32d1 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.031843 Oct 24 10:42:28.810414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f250ab15-c72a-44ef-a6b5-57ecb683587a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:28.816417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f250ab15-c72a-44ef-a6b5-57ecb683587a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:28.821691 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 1999/3964] 10.222.0.50 () {58 vars in 1178 bytes} [Mon Oct 24 10:42:28 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:42:28.822851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f250ab15-c72a-44ef-a6b5-57ecb683587a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:42:28.841115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f250ab15-c72a-44ef-a6b5-57ecb683587a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:28.841999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f250ab15-c72a-44ef-a6b5-57ecb683587a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:28.842671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f250ab15-c72a-44ef-a6b5-57ecb683587a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:28.843603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f250ab15-c72a-44ef-a6b5-57ecb683587a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:28.844259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f250ab15-c72a-44ef-a6b5-57ecb683587a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:28.845133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f250ab15-c72a-44ef-a6b5-57ecb683587a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:28.900583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-33aa8e32-7d93-4e5c-b39c-017442e1d3fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:28.902063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-33aa8e32-7d93-4e5c-b39c-017442e1d3fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: b5da901c-0851-4c31-9547-cd138b752ed6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:28.912879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33aa8e32-7d93-4e5c-b39c-017442e1d3fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:28.915986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33aa8e32-7d93-4e5c-b39c-017442e1d3fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:28.919311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33aa8e32-7d93-4e5c-b39c-017442e1d3fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:28.921340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33aa8e32-7d93-4e5c-b39c-017442e1d3fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:28.922010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33aa8e32-7d93-4e5c-b39c-017442e1d3fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:28.925994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33aa8e32-7d93-4e5c-b39c-017442e1d3fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:28.980656 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-33aa8e32-7d93-4e5c-b39c-017442e1d3fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] HTTP exception thrown: Instance b5da901c-0851-4c31-9547-cd138b752ed6 could not be found. Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-33aa8e32-7d93-4e5c-b39c-017442e1d3fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Request method failure captured: Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 HTTP/1.1 Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmmuJrxb1XlWB_avRxRliGRWB1RGcH6tFur30cSKqOzu2vxHhNtoBzNqu_iNWZYArPhjvCegW23YNaUUHwXw7ggKhvTGZpm4y2TCmcCle2W-rg0Uf0xse67nTky9VDrkBwyVUxKaUO1HKMfXPydd2Jmdynf6tgSS0X6qgnwmk8AaC6o Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4878c0e43a9d4db8ba5c6590b43624f0 Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerActionsTestJSON-1882077751 Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4878c0e43a9d4db8ba5c6590b43624f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4878c0e43a9d4db8ba5c6590b43624f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4878c0e43a9d4db8ba5c6590b43624f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4878c0e43a9d4db8ba5c6590b43624f0", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerActionsTestJSON-1882077751 Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4878c0e43a9d4db8ba5c6590b43624f0 Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerActionsTestJSON-1882077751 Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerActionsTestJSON-1882077751-project Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 45500f699a6f463b8755f0417b24151c Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerActionsTestJSON-1882077751-project Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance b5da901c-0851-4c31-9547-cd138b752ed6 could not be found. Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'b5da901c-0851-4c31-9547-cd138b752ed6'} Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5da901c-0851-4c31-9547-cd138b752ed6 could not be found. Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5da901c-0851-4c31-9547-cd138b752ed6 could not be found. Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:28.988532 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.992804 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:28.992804 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:28.992804 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:28.992804 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:42:28.992804 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:42:28.992804 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5da901c-0851-4c31-9547-cd138b752ed6 could not be found. Oct 24 10:42:28.992804 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:28.995257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-33aa8e32-7d93-4e5c-b39c-017442e1d3fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Returning 404 to user: Instance b5da901c-0851-4c31-9547-cd138b752ed6 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:42:28.999122 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-33aa8e32-7d93-4e5c-b39c-017442e1d3fe tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6" status: 404 len: 111 microversion: 2.1 time: 0.102866 Oct 24 10:42:29.001841 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2000/3965] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:28 2022] GET /compute/v2.1/servers/b5da901c-0851-4c31-9547-cd138b752ed6 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:42:29.015445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e1b0aa33-b400-4c27-88af-93ce1f781e96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:29.015967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e1b0aa33-b400-4c27-88af-93ce1f781e96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:29.047487 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f250ab15-c72a-44ef-a6b5-57ecb683587a tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.241294 Oct 24 10:42:29.048895 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1966/3966] 10.222.0.50 () {58 vars in 1174 bytes} [Mon Oct 24 10:42:28 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:42:29.054626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1b0aa33-b400-4c27-88af-93ce1f781e96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:29.057524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1b0aa33-b400-4c27-88af-93ce1f781e96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:29.059840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1b0aa33-b400-4c27-88af-93ce1f781e96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:29.062015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1b0aa33-b400-4c27-88af-93ce1f781e96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:29.064685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1b0aa33-b400-4c27-88af-93ce1f781e96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:29.064814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a2a58961-ad41-4bfd-b904-5d8e909bab97 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:29.067187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1b0aa33-b400-4c27-88af-93ce1f781e96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:29.088651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a2a58961-ad41-4bfd-b904-5d8e909bab97 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:29.090483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a2a58961-ad41-4bfd-b904-5d8e909bab97 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:42:29.106711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2a58961-ad41-4bfd-b904-5d8e909bab97 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:29.107228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2a58961-ad41-4bfd-b904-5d8e909bab97 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:29.110716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2a58961-ad41-4bfd-b904-5d8e909bab97 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:29.114563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2a58961-ad41-4bfd-b904-5d8e909bab97 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:29.115093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2a58961-ad41-4bfd-b904-5d8e909bab97 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:29.119958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2a58961-ad41-4bfd-b904-5d8e909bab97 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:29.165823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e1b0aa33-b400-4c27-88af-93ce1f781e96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:42:29.388411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:UPDATE=8,nova_cell1:DELETE=2,nova_cell1:SELECT=88,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:42:29.411055 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a2a58961-ad41-4bfd-b904-5d8e909bab97 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.349540 Oct 24 10:42:29.413482 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1967/3967] 10.222.0.50 () {58 vars in 1184 bytes} [Mon Oct 24 10:42:29 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:42:29.428304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43103b71-158e-4fa1-ae3d-9ee400ae883d tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:29.462962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-43103b71-158e-4fa1-ae3d-9ee400ae883d tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:29.464240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-43103b71-158e-4fa1-ae3d-9ee400ae883d tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Searching by: {'deleted': False, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:42:29.466340 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e1b0aa33-b400-4c27-88af-93ce1f781e96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 204 len: 0 microversion: 2.1 time: 0.460882 Oct 24 10:42:29.468257 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2001/3968] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:42:29 2022] DELETE /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:42:29.484562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43103b71-158e-4fa1-ae3d-9ee400ae883d tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:29.485102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43103b71-158e-4fa1-ae3d-9ee400ae883d tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:29.485550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43103b71-158e-4fa1-ae3d-9ee400ae883d tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:29.486459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43103b71-158e-4fa1-ae3d-9ee400ae883d tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:29.486927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43103b71-158e-4fa1-ae3d-9ee400ae883d tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:29.487354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43103b71-158e-4fa1-ae3d-9ee400ae883d tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:29.509805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-db4a5f1f-c95a-4f33-bc61-6266a869f5bb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:29.512519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-db4a5f1f-c95a-4f33-bc61-6266a869f5bb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:29.528581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db4a5f1f-c95a-4f33-bc61-6266a869f5bb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:29.529107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db4a5f1f-c95a-4f33-bc61-6266a869f5bb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:29.529544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db4a5f1f-c95a-4f33-bc61-6266a869f5bb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:29.531409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db4a5f1f-c95a-4f33-bc61-6266a869f5bb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:29.532076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db4a5f1f-c95a-4f33-bc61-6266a869f5bb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:29.537557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db4a5f1f-c95a-4f33-bc61-6266a869f5bb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:29.556121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.multi_cell_list [None req-43103b71-158e-4fa1-ae3d-9ee400ae883d tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120425) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:42:29.644118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-43103b71-158e-4fa1-ae3d-9ee400ae883d tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:29.669352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43103b71-158e-4fa1-ae3d-9ee400ae883d tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:29.670771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43103b71-158e-4fa1-ae3d-9ee400ae883d tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:29.671394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43103b71-158e-4fa1-ae3d-9ee400ae883d tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:30.012715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-db4a5f1f-c95a-4f33-bc61-6266a869f5bb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:30.030158 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-db4a5f1f-c95a-4f33-bc61-6266a869f5bb tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1506 microversion: 2.1 time: 0.537797 Oct 24 10:42:30.044873 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2002/3969] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:29 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1506 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:30.044873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1281658809", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "90829005-77ef-4662-a885-13d754663688"}], "security_groups": [{"name": "tempest-securitygroup--951216451"}], "key_name": "tempest-keypair-1388564245", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:30.065000 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-43103b71-158e-4fa1-ae3d-9ee400ae883d tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 3021 microversion: 2.1 time: 0.642127 Oct 24 10:42:30.066958 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1968/3970] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:42:29 2022] GET /compute/v2.1/servers/detail => generated 3021 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:30.099715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7dfe88f5-fdb5-4cbe-a6d0-ee98886421af tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:30.109373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7dfe88f5-fdb5-4cbe-a6d0-ee98886421af tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:30.111672 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7dfe88f5-fdb5-4cbe-a6d0-ee98886421af tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.016189 Oct 24 10:42:30.114991 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1969/3971] 10.222.0.50 () {58 vars in 1178 bytes} [Mon Oct 24 10:42:30 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:42:30.131800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7aad4fcf-526d-4960-b0ce-85bf65552967 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:30.136984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7aad4fcf-526d-4960-b0ce-85bf65552967 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:30.137350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7aad4fcf-526d-4960-b0ce-85bf65552967 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Searching by: {'deleted': False, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:42:30.158437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7aad4fcf-526d-4960-b0ce-85bf65552967 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:30.158927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7aad4fcf-526d-4960-b0ce-85bf65552967 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:30.159393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7aad4fcf-526d-4960-b0ce-85bf65552967 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:30.163464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7aad4fcf-526d-4960-b0ce-85bf65552967 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:30.164255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7aad4fcf-526d-4960-b0ce-85bf65552967 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:30.164891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7aad4fcf-526d-4960-b0ce-85bf65552967 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:30.219065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.multi_cell_list [None req-7aad4fcf-526d-4960-b0ce-85bf65552967 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120425) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:42:30.254874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] validate_networks() for [('90829005-77ef-4662-a885-13d754663688', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:42:30.288495 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7aad4fcf-526d-4960-b0ce-85bf65552967 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.165724 Oct 24 10:42:30.294451 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1970/3972] 10.222.0.50 () {58 vars in 1125 bytes} [Mon Oct 24 10:42:30 2022] GET /compute/v2.1/servers => generated 681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:30.307031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5b76f087-335d-4dd3-bae3-e52a04414c3e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:30.307582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5b76f087-335d-4dd3-bae3-e52a04414c3e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:30.342150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b76f087-335d-4dd3-bae3-e52a04414c3e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:30.342758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b76f087-335d-4dd3-bae3-e52a04414c3e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:30.343166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b76f087-335d-4dd3-bae3-e52a04414c3e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:30.364441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b76f087-335d-4dd3-bae3-e52a04414c3e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:30.366630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b76f087-335d-4dd3-bae3-e52a04414c3e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:30.367097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b76f087-335d-4dd3-bae3-e52a04414c3e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:30.397633 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-5b76f087-335d-4dd3-bae3-e52a04414c3e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] HTTP exception thrown: Instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d could not be found. Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5b76f087-335d-4dd3-bae3-e52a04414c3e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Request method failure captured: Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d HTTP/1.1 Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmvnykDaWU90T9uEDjktnTuEtAiCn9pTLtyRLfx5clShS51uyqjNB_hZnlnl8muxvmtqHjHMteZxeTWXgrqBzBZyPoGuLksbAPvyURZnGAVPfHXwLfZgz6kLMKDe-ic6nWVdeLrvto-K73QKjrS3Ub3HGy4Y8aiXj_Zo2LxGnNr1PAk Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 743ff130bbae4b6e8022b30e821c4eb7 Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_743ff130bbae4b6e8022b30e821c4eb7", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 743ff130bbae4b6e8022b30e821c4eb7 Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ListServersNegativeTestJSON-1287264984-project Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: c9aeff583c6141f487eb07e6e1ec3986 Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ListServersNegativeTestJSON-1287264984-project Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d could not be found. Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '8dffdbb2-6b3c-4b29-9016-40f1a54bda8d'} Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d could not be found. Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:42:30.403251 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:42:30.406774 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d could not be found. Oct 24 10:42:30.406774 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:30.406774 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:30.406774 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:30.406774 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:30.406774 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:30.406774 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:30.406774 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:42:30.406774 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:42:30.406774 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d could not be found. Oct 24 10:42:30.406774 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:30.406774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5b76f087-335d-4dd3-bae3-e52a04414c3e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Returning 404 to user: Instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:42:30.406774 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5b76f087-335d-4dd3-bae3-e52a04414c3e tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d" status: 404 len: 111 microversion: 2.1 time: 0.107750 Oct 24 10:42:30.413603 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1971/3973] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:42:30 2022] DELETE /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:42:30.423261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-937f188e-0b10-4409-9edf-2e5e7f68cb59 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:30.426540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-937f188e-0b10-4409-9edf-2e5e7f68cb59 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: dd604035-ef97-496b-a5fe-0204c8dc7e46] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:30.443671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-937f188e-0b10-4409-9edf-2e5e7f68cb59 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:30.444412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-937f188e-0b10-4409-9edf-2e5e7f68cb59 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:30.445075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-937f188e-0b10-4409-9edf-2e5e7f68cb59 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:30.445976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-937f188e-0b10-4409-9edf-2e5e7f68cb59 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:30.446607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-937f188e-0b10-4409-9edf-2e5e7f68cb59 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:30.447620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-937f188e-0b10-4409-9edf-2e5e7f68cb59 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:30.517886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-937f188e-0b10-4409-9edf-2e5e7f68cb59 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: dd604035-ef97-496b-a5fe-0204c8dc7e46] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:42:30.709244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:42:30.716432 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-937f188e-0b10-4409-9edf-2e5e7f68cb59 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dd604035-ef97-496b-a5fe-0204c8dc7e46" status: 204 len: 0 microversion: 2.1 time: 0.300542 Oct 24 10:42:30.718351 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1972/3974] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:42:30 2022] DELETE /compute/v2.1/servers/dd604035-ef97-496b-a5fe-0204c8dc7e46 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:42:30.737060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-999caeef-1d55-405b-b64c-888a52863624 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:30.739095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-999caeef-1d55-405b-b64c-888a52863624 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:30.748557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-999caeef-1d55-405b-b64c-888a52863624 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:30.749389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-999caeef-1d55-405b-b64c-888a52863624 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:30.750053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-999caeef-1d55-405b-b64c-888a52863624 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:30.757357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-999caeef-1d55-405b-b64c-888a52863624 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:30.758091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-999caeef-1d55-405b-b64c-888a52863624 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:30.759270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-999caeef-1d55-405b-b64c-888a52863624 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:30.812972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-999caeef-1d55-405b-b64c-888a52863624 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:42:30.976256 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-999caeef-1d55-405b-b64c-888a52863624 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 204 len: 0 microversion: 2.1 time: 0.252810 Oct 24 10:42:30.977325 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1973/3975] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:42:30 2022] DELETE /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:42:30.993384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-62cbcda9-b2cd-4cb1-b689-5266f25a1760 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:30.994110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-62cbcda9-b2cd-4cb1-b689-5266f25a1760 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:31.013209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62cbcda9-b2cd-4cb1-b689-5266f25a1760 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:31.013713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62cbcda9-b2cd-4cb1-b689-5266f25a1760 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:31.016763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62cbcda9-b2cd-4cb1-b689-5266f25a1760 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:31.017511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62cbcda9-b2cd-4cb1-b689-5266f25a1760 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:31.017971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62cbcda9-b2cd-4cb1-b689-5266f25a1760 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:31.018453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62cbcda9-b2cd-4cb1-b689-5266f25a1760 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:31.066091 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-62cbcda9-b2cd-4cb1-b689-5266f25a1760 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] HTTP exception thrown: Instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d could not be found. Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-62cbcda9-b2cd-4cb1-b689-5266f25a1760 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Request method failure captured: Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d HTTP/1.1 Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmvnykDaWU90T9uEDjktnTuEtAiCn9pTLtyRLfx5clShS51uyqjNB_hZnlnl8muxvmtqHjHMteZxeTWXgrqBzBZyPoGuLksbAPvyURZnGAVPfHXwLfZgz6kLMKDe-ic6nWVdeLrvto-K73QKjrS3Ub3HGy4Y8aiXj_Zo2LxGnNr1PAk Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 743ff130bbae4b6e8022b30e821c4eb7 Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_743ff130bbae4b6e8022b30e821c4eb7", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 743ff130bbae4b6e8022b30e821c4eb7 Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ListServersNegativeTestJSON-1287264984-project Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: c9aeff583c6141f487eb07e6e1ec3986 Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ListServersNegativeTestJSON-1287264984-project Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d could not be found. Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '8dffdbb2-6b3c-4b29-9016-40f1a54bda8d'} Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d could not be found. Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d could not be found. Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:31.067988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:31.071147 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:31.071147 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:31.071147 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:31.071147 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:31.071147 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:42:31.071147 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:42:31.071147 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d could not be found. Oct 24 10:42:31.071147 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:42:31.078376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-62cbcda9-b2cd-4cb1-b689-5266f25a1760 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Returning 404 to user: Instance 8dffdbb2-6b3c-4b29-9016-40f1a54bda8d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:42:31.079352 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-62cbcda9-b2cd-4cb1-b689-5266f25a1760 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d" status: 404 len: 111 microversion: 2.1 time: 0.097510 Oct 24 10:42:31.079874 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1974/3976] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:30 2022] GET /compute/v2.1/servers/8dffdbb2-6b3c-4b29-9016-40f1a54bda8d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:42:31.098347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-593a7b6e-ed67-427b-bfa1-9d8cede3369d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:31.098965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-593a7b6e-ed67-427b-bfa1-9d8cede3369d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:31.133315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-593a7b6e-ed67-427b-bfa1-9d8cede3369d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:31.133815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-593a7b6e-ed67-427b-bfa1-9d8cede3369d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:31.134255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-593a7b6e-ed67-427b-bfa1-9d8cede3369d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:31.134958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-593a7b6e-ed67-427b-bfa1-9d8cede3369d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:31.135414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-593a7b6e-ed67-427b-bfa1-9d8cede3369d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:31.136051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-593a7b6e-ed67-427b-bfa1-9d8cede3369d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:31.394448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Getting quotas for project acb35f419a9b4edd8f5d6b4fe52d0705. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:42:31.414590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Getting quotas for user bd761f0733fa47b0bb5fed8c80dafac0 and project acb35f419a9b4edd8f5d6b4fe52d0705. Resources: dict_keys(['metadata_items']) {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:42:31.447683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:42:31.453797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:42:31.453797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:42:31.453797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:42:31.453797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:42:31.456915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-593a7b6e-ed67-427b-bfa1-9d8cede3369d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:31.459623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:42:31.470327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:31.470930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:31.471549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:31.473262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:31.473936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:31.474465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:31.477538 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-593a7b6e-ed67-427b-bfa1-9d8cede3369d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1506 microversion: 2.1 time: 0.386784 Oct 24 10:42:31.480652 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1975/3977] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:31 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:31.493843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-da9cfb9b-16e7-4654-af60-8e3d4c34dbf2 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:31.494670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-da9cfb9b-16e7-4654-af60-8e3d4c34dbf2 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: dd604035-ef97-496b-a5fe-0204c8dc7e46] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:31.508887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Getting quotas for project acb35f419a9b4edd8f5d6b4fe52d0705. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:42:31.511881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da9cfb9b-16e7-4654-af60-8e3d4c34dbf2 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:31.513782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da9cfb9b-16e7-4654-af60-8e3d4c34dbf2 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:31.514398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da9cfb9b-16e7-4654-af60-8e3d4c34dbf2 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:31.516054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Getting quotas for user bd761f0733fa47b0bb5fed8c80dafac0 and project acb35f419a9b4edd8f5d6b4fe52d0705. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:42:31.516732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da9cfb9b-16e7-4654-af60-8e3d4c34dbf2 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:31.518251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da9cfb9b-16e7-4654-af60-8e3d4c34dbf2 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:31.518849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da9cfb9b-16e7-4654-af60-8e3d4c34dbf2 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:31.532697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:42:31.536120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:42:31.640641 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-06db55e0-8454-40d1-98e6-726a469ac3ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.607414 Oct 24 10:42:31.641355 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2003/3978] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:42:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:42:31.658548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9a979c79-9450-45c9-8ad2-f0a7d0b518ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:31.659181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9a979c79-9450-45c9-8ad2-f0a7d0b518ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:31.840935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9a979c79-9450-45c9-8ad2-f0a7d0b518ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:31.860560 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9a979c79-9450-45c9-8ad2-f0a7d0b518ff tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1270 microversion: 2.1 time: 0.211587 Oct 24 10:42:31.861200 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2004/3979] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:31 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1270 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:42:31.865714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-da9cfb9b-16e7-4654-af60-8e3d4c34dbf2 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:31.877680 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-da9cfb9b-16e7-4654-af60-8e3d4c34dbf2 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/dd604035-ef97-496b-a5fe-0204c8dc7e46" status: 200 len: 1520 microversion: 2.1 time: 0.391456 Oct 24 10:42:31.880139 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1976/3980] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:31 2022] GET /compute/v2.1/servers/dd604035-ef97-496b-a5fe-0204c8dc7e46 => generated 1520 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:31.882104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-174f9447-0a3f-40b2-9a2b-4b537a849fe2 req-59693af5-4aa0-49d0-9768-70a54d01d120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1387bd9a-747c-4e8b-a30a-136d41dc39e6", "name": "network-vif-deleted", "tag": "51a23f09-0127-4838-82ec-0a7b4009705c"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:31.901767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-174f9447-0a3f-40b2-9a2b-4b537a849fe2 req-59693af5-4aa0-49d0-9768-70a54d01d120 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:31.902376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-174f9447-0a3f-40b2-9a2b-4b537a849fe2 req-59693af5-4aa0-49d0-9768-70a54d01d120 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:31.908631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-174f9447-0a3f-40b2-9a2b-4b537a849fe2 req-59693af5-4aa0-49d0-9768-70a54d01d120 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:31.940114 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-174f9447-0a3f-40b2-9a2b-4b537a849fe2 req-59693af5-4aa0-49d0-9768-70a54d01d120 service nova] Creating event network-vif-deleted:51a23f09-0127-4838-82ec-0a7b4009705c for instance 1387bd9a-747c-4e8b-a30a-136d41dc39e6 on n-h2-858383-15 Oct 24 10:42:31.948925 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-174f9447-0a3f-40b2-9a2b-4b537a849fe2 req-59693af5-4aa0-49d0-9768-70a54d01d120 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079187 Oct 24 10:42:31.949807 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2005/3981] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:32.507375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5499c3e-30cc-4906-9e96-6e649eecab96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:32.508073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d5499c3e-30cc-4906-9e96-6e649eecab96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:32.523508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5499c3e-30cc-4906-9e96-6e649eecab96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:32.527823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5499c3e-30cc-4906-9e96-6e649eecab96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:32.528390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5499c3e-30cc-4906-9e96-6e649eecab96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:32.529217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5499c3e-30cc-4906-9e96-6e649eecab96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:32.529744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5499c3e-30cc-4906-9e96-6e649eecab96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:32.549792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5499c3e-30cc-4906-9e96-6e649eecab96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:32.594374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5499c3e-30cc-4906-9e96-6e649eecab96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:32.594846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5499c3e-30cc-4906-9e96-6e649eecab96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:32.595289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5499c3e-30cc-4906-9e96-6e649eecab96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:32.595734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-d5499c3e-30cc-4906-9e96-6e649eecab96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lazy-loading 'fault' on Instance uuid 1387bd9a-747c-4e8b-a30a-136d41dc39e6 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:42:32.640858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d5499c3e-30cc-4906-9e96-6e649eecab96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:32.649622 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d5499c3e-30cc-4906-9e96-6e649eecab96 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1303 microversion: 2.1 time: 0.148506 Oct 24 10:42:32.651563 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1977/3982] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:32 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1303 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:32.885975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ae486729-38d6-479c-82a0-cd355e4632d8 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:32.887786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ae486729-38d6-479c-82a0-cd355e4632d8 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:32.906870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9b6ac90c-40cb-48eb-974f-e9177f77a492 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:32.907540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9b6ac90c-40cb-48eb-974f-e9177f77a492 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: dd604035-ef97-496b-a5fe-0204c8dc7e46] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:32.925540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae486729-38d6-479c-82a0-cd355e4632d8 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:32.926421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae486729-38d6-479c-82a0-cd355e4632d8 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:32.926984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae486729-38d6-479c-82a0-cd355e4632d8 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:32.927725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae486729-38d6-479c-82a0-cd355e4632d8 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:32.928184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae486729-38d6-479c-82a0-cd355e4632d8 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:32.928616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae486729-38d6-479c-82a0-cd355e4632d8 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:32.929699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b6ac90c-40cb-48eb-974f-e9177f77a492 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:32.930199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b6ac90c-40cb-48eb-974f-e9177f77a492 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:32.930622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b6ac90c-40cb-48eb-974f-e9177f77a492 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:32.934470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b6ac90c-40cb-48eb-974f-e9177f77a492 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:32.935251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b6ac90c-40cb-48eb-974f-e9177f77a492 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:32.936422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b6ac90c-40cb-48eb-974f-e9177f77a492 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:33.149790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ae486729-38d6-479c-82a0-cd355e4632d8 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:33.163938 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ae486729-38d6-479c-82a0-cd355e4632d8 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1322 microversion: 2.1 time: 0.282858 Oct 24 10:42:33.165583 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2006/3983] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:32 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:33.236889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9b6ac90c-40cb-48eb-974f-e9177f77a492 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:33.246276 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9b6ac90c-40cb-48eb-974f-e9177f77a492 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/dd604035-ef97-496b-a5fe-0204c8dc7e46" status: 200 len: 1520 microversion: 2.1 time: 0.345302 Oct 24 10:42:33.248702 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1978/3984] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:32 2022] GET /compute/v2.1/servers/dd604035-ef97-496b-a5fe-0204c8dc7e46 => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:33.678645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-21e32132-039b-4a1c-a67c-c11b94ad1407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:33.679357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-21e32132-039b-4a1c-a67c-c11b94ad1407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:33.695013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21e32132-039b-4a1c-a67c-c11b94ad1407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:33.695506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21e32132-039b-4a1c-a67c-c11b94ad1407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:33.695943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21e32132-039b-4a1c-a67c-c11b94ad1407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:33.696647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21e32132-039b-4a1c-a67c-c11b94ad1407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:33.697129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21e32132-039b-4a1c-a67c-c11b94ad1407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:33.697539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21e32132-039b-4a1c-a67c-c11b94ad1407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:33.776383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:42:33.778119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21e32132-039b-4a1c-a67c-c11b94ad1407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:33.778608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21e32132-039b-4a1c-a67c-c11b94ad1407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:33.779535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21e32132-039b-4a1c-a67c-c11b94ad1407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:33.781866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-21e32132-039b-4a1c-a67c-c11b94ad1407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lazy-loading 'fault' on Instance uuid 1387bd9a-747c-4e8b-a30a-136d41dc39e6 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:42:33.916065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-21e32132-039b-4a1c-a67c-c11b94ad1407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:33.927898 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-21e32132-039b-4a1c-a67c-c11b94ad1407 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 200 len: 1303 microversion: 2.1 time: 0.251720 Oct 24 10:42:33.941035 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2007/3985] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:33 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 1303 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:34.192282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43728e92-aa64-408e-826f-8f0816f3385b tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:34.192926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-43728e92-aa64-408e-826f-8f0816f3385b tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:34.204933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43728e92-aa64-408e-826f-8f0816f3385b tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:34.205438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43728e92-aa64-408e-826f-8f0816f3385b tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:34.216871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43728e92-aa64-408e-826f-8f0816f3385b tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:34.217668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43728e92-aa64-408e-826f-8f0816f3385b tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:34.218211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43728e92-aa64-408e-826f-8f0816f3385b tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:34.219413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43728e92-aa64-408e-826f-8f0816f3385b tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:34.271674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9c65a180-1ef3-4cc7-8f97-cbace0a48235 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:34.272591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9c65a180-1ef3-4cc7-8f97-cbace0a48235 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: dd604035-ef97-496b-a5fe-0204c8dc7e46] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:34.306588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c65a180-1ef3-4cc7-8f97-cbace0a48235 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:34.307028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c65a180-1ef3-4cc7-8f97-cbace0a48235 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:34.307501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c65a180-1ef3-4cc7-8f97-cbace0a48235 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:34.308207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c65a180-1ef3-4cc7-8f97-cbace0a48235 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:34.308646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c65a180-1ef3-4cc7-8f97-cbace0a48235 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:34.309110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c65a180-1ef3-4cc7-8f97-cbace0a48235 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:34.654661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-43728e92-aa64-408e-826f-8f0816f3385b tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:34.656347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9c65a180-1ef3-4cc7-8f97-cbace0a48235 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:34.680929 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-43728e92-aa64-408e-826f-8f0816f3385b tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1328 microversion: 2.1 time: 0.492969 Oct 24 10:42:34.681535 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1979/3986] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:34 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1328 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:34.690434 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9c65a180-1ef3-4cc7-8f97-cbace0a48235 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/dd604035-ef97-496b-a5fe-0204c8dc7e46" status: 200 len: 1478 microversion: 2.1 time: 0.422743 Oct 24 10:42:34.708338 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2008/3987] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:34 2022] GET /compute/v2.1/servers/dd604035-ef97-496b-a5fe-0204c8dc7e46 => generated 1478 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:34.721443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-72fddc3d-e141-4034-becd-6cbdf11ca71b req-1c6b0a35-e6cd-4391-b44b-15a6a0ca98a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd604035-ef97-496b-a5fe-0204c8dc7e46", "name": "network-vif-deleted", "tag": "b9e3bdde-6565-4e35-b42c-0f27f26f4e5d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:34.747494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-72fddc3d-e141-4034-becd-6cbdf11ca71b req-1c6b0a35-e6cd-4391-b44b-15a6a0ca98a6 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:34.749053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-72fddc3d-e141-4034-becd-6cbdf11ca71b req-1c6b0a35-e6cd-4391-b44b-15a6a0ca98a6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:34.749741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-72fddc3d-e141-4034-becd-6cbdf11ca71b req-1c6b0a35-e6cd-4391-b44b-15a6a0ca98a6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:34.767859 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-72fddc3d-e141-4034-becd-6cbdf11ca71b req-1c6b0a35-e6cd-4391-b44b-15a6a0ca98a6 service nova] Creating event network-vif-deleted:b9e3bdde-6565-4e35-b42c-0f27f26f4e5d for instance dd604035-ef97-496b-a5fe-0204c8dc7e46 on n-h2-858383-15 Oct 24 10:42:34.773593 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-72fddc3d-e141-4034-becd-6cbdf11ca71b req-1c6b0a35-e6cd-4391-b44b-15a6a0ca98a6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069441 Oct 24 10:42:34.774531 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1980/3988] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:34.967842 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eb9fc0cd-51f1-4f60-9b11-2b1ae149ba68 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:34.968509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-eb9fc0cd-51f1-4f60-9b11-2b1ae149ba68 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 1387bd9a-747c-4e8b-a30a-136d41dc39e6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:34.983688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb9fc0cd-51f1-4f60-9b11-2b1ae149ba68 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:34.987554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb9fc0cd-51f1-4f60-9b11-2b1ae149ba68 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:34.988970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb9fc0cd-51f1-4f60-9b11-2b1ae149ba68 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:34.991626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb9fc0cd-51f1-4f60-9b11-2b1ae149ba68 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:34.992368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb9fc0cd-51f1-4f60-9b11-2b1ae149ba68 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:34.994165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb9fc0cd-51f1-4f60-9b11-2b1ae149ba68 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:35.024047 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-eb9fc0cd-51f1-4f60-9b11-2b1ae149ba68 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] HTTP exception thrown: Instance 1387bd9a-747c-4e8b-a30a-136d41dc39e6 could not be found. Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eb9fc0cd-51f1-4f60-9b11-2b1ae149ba68 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Request method failure captured: Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 HTTP/1.1 Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmmuJrxb1XlWB_avRxRliGRWB1RGcH6tFur30cSKqOzu2vxHhNtoBzNqu_iNWZYArPhjvCegW23YNaUUHwXw7ggKhvTGZpm4y2TCmcCle2W-rg0Uf0xse67nTky9VDrkBwyVUxKaUO1HKMfXPydd2Jmdynf6tgSS0X6qgnwmk8AaC6o Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4878c0e43a9d4db8ba5c6590b43624f0 Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerActionsTestJSON-1882077751 Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4878c0e43a9d4db8ba5c6590b43624f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4878c0e43a9d4db8ba5c6590b43624f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4878c0e43a9d4db8ba5c6590b43624f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4878c0e43a9d4db8ba5c6590b43624f0", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerActionsTestJSON-1882077751 Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4878c0e43a9d4db8ba5c6590b43624f0 Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerActionsTestJSON-1882077751 Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerActionsTestJSON-1882077751-project Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 45500f699a6f463b8755f0417b24151c Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerActionsTestJSON-1882077751-project Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 1387bd9a-747c-4e8b-a30a-136d41dc39e6 could not be found. Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '1387bd9a-747c-4e8b-a30a-136d41dc39e6'} Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1387bd9a-747c-4e8b-a30a-136d41dc39e6 could not be found. Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1387bd9a-747c-4e8b-a30a-136d41dc39e6 could not be found. Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:35.026180 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:35.030189 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:35.030189 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:35.030189 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:35.030189 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:42:35.030189 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:42:35.030189 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1387bd9a-747c-4e8b-a30a-136d41dc39e6 could not be found. Oct 24 10:42:35.030189 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:35.032635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eb9fc0cd-51f1-4f60-9b11-2b1ae149ba68 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Returning 404 to user: Instance 1387bd9a-747c-4e8b-a30a-136d41dc39e6 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:42:35.033828 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-eb9fc0cd-51f1-4f60-9b11-2b1ae149ba68 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6" status: 404 len: 111 microversion: 2.1 time: 0.079083 Oct 24 10:42:35.035339 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2009/3989] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:34 2022] GET /compute/v2.1/servers/1387bd9a-747c-4e8b-a30a-136d41dc39e6 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:42:35.046130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ca3f4cef-96d3-4661-81a6-0535d23a53d6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:35.046910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ca3f4cef-96d3-4661-81a6-0535d23a53d6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:35.054924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca3f4cef-96d3-4661-81a6-0535d23a53d6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:35.055612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca3f4cef-96d3-4661-81a6-0535d23a53d6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:35.056206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca3f4cef-96d3-4661-81a6-0535d23a53d6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:35.057134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca3f4cef-96d3-4661-81a6-0535d23a53d6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:35.057737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca3f4cef-96d3-4661-81a6-0535d23a53d6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:35.058321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca3f4cef-96d3-4661-81a6-0535d23a53d6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:35.147920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ca3f4cef-96d3-4661-81a6-0535d23a53d6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:42:35.314225 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ca3f4cef-96d3-4661-81a6-0535d23a53d6 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 204 len: 0 microversion: 2.1 time: 0.273124 Oct 24 10:42:35.316049 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1981/3990] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:42:35 2022] DELETE /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:42:35.326703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f494ca64-7f7b-4d05-90f5-cdd314a48273 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:35.327701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f494ca64-7f7b-4d05-90f5-cdd314a48273 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:35.341517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f494ca64-7f7b-4d05-90f5-cdd314a48273 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:35.342856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f494ca64-7f7b-4d05-90f5-cdd314a48273 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:35.343449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f494ca64-7f7b-4d05-90f5-cdd314a48273 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:35.345332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f494ca64-7f7b-4d05-90f5-cdd314a48273 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:35.345964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f494ca64-7f7b-4d05-90f5-cdd314a48273 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:35.346661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f494ca64-7f7b-4d05-90f5-cdd314a48273 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:35.710299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-05567686-ec6f-43b3-9329-cc0b50853430 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:35.711171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-05567686-ec6f-43b3-9329-cc0b50853430 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:35.728941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05567686-ec6f-43b3-9329-cc0b50853430 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:35.730967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05567686-ec6f-43b3-9329-cc0b50853430 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:35.732255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05567686-ec6f-43b3-9329-cc0b50853430 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:35.733479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05567686-ec6f-43b3-9329-cc0b50853430 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:35.735885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05567686-ec6f-43b3-9329-cc0b50853430 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:35.741770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05567686-ec6f-43b3-9329-cc0b50853430 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:35.964992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f494ca64-7f7b-4d05-90f5-cdd314a48273 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:35.976819 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f494ca64-7f7b-4d05-90f5-cdd314a48273 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1494 microversion: 2.1 time: 0.655061 Oct 24 10:42:36.001172 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2010/3991] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:35 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1494 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:36.008431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-af41a196-6d14-4ca4-afed-b4dbd0c2c44f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:36.009345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-af41a196-6d14-4ca4-afed-b4dbd0c2c44f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: dd604035-ef97-496b-a5fe-0204c8dc7e46] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:36.017383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af41a196-6d14-4ca4-afed-b4dbd0c2c44f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:36.018967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af41a196-6d14-4ca4-afed-b4dbd0c2c44f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:36.019602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af41a196-6d14-4ca4-afed-b4dbd0c2c44f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:36.020592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af41a196-6d14-4ca4-afed-b4dbd0c2c44f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:36.021355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af41a196-6d14-4ca4-afed-b4dbd0c2c44f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:36.022002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af41a196-6d14-4ca4-afed-b4dbd0c2c44f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:36.055024 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-af41a196-6d14-4ca4-afed-b4dbd0c2c44f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] HTTP exception thrown: Instance dd604035-ef97-496b-a5fe-0204c8dc7e46 could not be found. Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-af41a196-6d14-4ca4-afed-b4dbd0c2c44f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Request method failure captured: Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/dd604035-ef97-496b-a5fe-0204c8dc7e46 HTTP/1.1 Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmvnykDaWU90T9uEDjktnTuEtAiCn9pTLtyRLfx5clShS51uyqjNB_hZnlnl8muxvmtqHjHMteZxeTWXgrqBzBZyPoGuLksbAPvyURZnGAVPfHXwLfZgz6kLMKDe-ic6nWVdeLrvto-K73QKjrS3Ub3HGy4Y8aiXj_Zo2LxGnNr1PAk Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 743ff130bbae4b6e8022b30e821c4eb7 Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_743ff130bbae4b6e8022b30e821c4eb7", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 743ff130bbae4b6e8022b30e821c4eb7 Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ListServersNegativeTestJSON-1287264984-project Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: c9aeff583c6141f487eb07e6e1ec3986 Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ListServersNegativeTestJSON-1287264984-project Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance dd604035-ef97-496b-a5fe-0204c8dc7e46 could not be found. Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'dd604035-ef97-496b-a5fe-0204c8dc7e46'} Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd604035-ef97-496b-a5fe-0204c8dc7e46 could not be found. Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd604035-ef97-496b-a5fe-0204c8dc7e46 could not be found. Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:36.056949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:36.061196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:36.061196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:36.061196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:36.061196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:36.061196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:42:36.061196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:42:36.061196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd604035-ef97-496b-a5fe-0204c8dc7e46 could not be found. Oct 24 10:42:36.061196 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:36.063072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-af41a196-6d14-4ca4-afed-b4dbd0c2c44f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Returning 404 to user: Instance dd604035-ef97-496b-a5fe-0204c8dc7e46 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:42:36.064109 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-af41a196-6d14-4ca4-afed-b4dbd0c2c44f tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/dd604035-ef97-496b-a5fe-0204c8dc7e46" status: 404 len: 111 microversion: 2.1 time: 0.061671 Oct 24 10:42:36.065979 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2011/3992] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:36 2022] GET /compute/v2.1/servers/dd604035-ef97-496b-a5fe-0204c8dc7e46 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:42:36.075352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-87d958ab-ceba-4bb8-8b8d-7da22e63951c tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:36.076310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-87d958ab-ceba-4bb8-8b8d-7da22e63951c tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:36.084025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87d958ab-ceba-4bb8-8b8d-7da22e63951c tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:36.084802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87d958ab-ceba-4bb8-8b8d-7da22e63951c tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:36.085443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87d958ab-ceba-4bb8-8b8d-7da22e63951c tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:36.086329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87d958ab-ceba-4bb8-8b8d-7da22e63951c tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:36.086946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87d958ab-ceba-4bb8-8b8d-7da22e63951c tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:36.087529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87d958ab-ceba-4bb8-8b8d-7da22e63951c tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:36.178608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87d958ab-ceba-4bb8-8b8d-7da22e63951c tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:36.186008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87d958ab-ceba-4bb8-8b8d-7da22e63951c tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:36.186858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87d958ab-ceba-4bb8-8b8d-7da22e63951c tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:36.187388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-87d958ab-ceba-4bb8-8b8d-7da22e63951c tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lazy-loading 'fault' on Instance uuid d350ab27-db77-49c3-8270-682320f4bd1e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:42:36.294934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-87d958ab-ceba-4bb8-8b8d-7da22e63951c tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9aeff583c6141f487eb07e6e1ec3986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743ff130bbae4b6e8022b30e821c4eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:36.309122 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-87d958ab-ceba-4bb8-8b8d-7da22e63951c tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 200 len: 1312 microversion: 2.1 time: 0.239946 Oct 24 10:42:36.310428 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2012/3993] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:36 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 1312 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:36.374569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-05567686-ec6f-43b3-9329-cc0b50853430 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:36.395253 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-05567686-ec6f-43b3-9329-cc0b50853430 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1395 microversion: 2.1 time: 0.691197 Oct 24 10:42:36.400130 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1982/3994] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:35 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1395 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:36.922819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-2b2c8545-e090-42c3-bfc5-bdcb915f0080 req-6c8eb3c9-75ed-454c-a361-afd96326517d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d350ab27-db77-49c3-8270-682320f4bd1e", "name": "network-vif-deleted", "tag": "e858bb76-d557-489c-9e4b-de662c087a76"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:36.960570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2b2c8545-e090-42c3-bfc5-bdcb915f0080 req-6c8eb3c9-75ed-454c-a361-afd96326517d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:36.967406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2b2c8545-e090-42c3-bfc5-bdcb915f0080 req-6c8eb3c9-75ed-454c-a361-afd96326517d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:36.967871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2b2c8545-e090-42c3-bfc5-bdcb915f0080 req-6c8eb3c9-75ed-454c-a361-afd96326517d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:36.997698 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-2b2c8545-e090-42c3-bfc5-bdcb915f0080 req-6c8eb3c9-75ed-454c-a361-afd96326517d service nova] Creating event network-vif-deleted:e858bb76-d557-489c-9e4b-de662c087a76 for instance d350ab27-db77-49c3-8270-682320f4bd1e on n-h1-858383-15 Oct 24 10:42:37.006138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-631bd7f8-2fbe-4753-9785-f0a839253257 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:37.007220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-631bd7f8-2fbe-4753-9785-f0a839253257 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:37.007990 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-2b2c8545-e090-42c3-bfc5-bdcb915f0080 req-6c8eb3c9-75ed-454c-a361-afd96326517d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090108 Oct 24 10:42:37.008876 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2013/3995] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:37.038986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-631bd7f8-2fbe-4753-9785-f0a839253257 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:37.039126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-631bd7f8-2fbe-4753-9785-f0a839253257 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:37.040057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-631bd7f8-2fbe-4753-9785-f0a839253257 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:37.042970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-631bd7f8-2fbe-4753-9785-f0a839253257 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:37.044958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-631bd7f8-2fbe-4753-9785-f0a839253257 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:37.045687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-631bd7f8-2fbe-4753-9785-f0a839253257 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:37.087783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-12caff35-30ea-4d9f-ac0d-3c3549544e3b req-21a6b29d-d92f-4f62-94af-9cef926127ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eac13fe-2828-4885-b82d-af682e20a40c", "name": "network-vif-unplugged", "status": "completed", "tag": "428c6441-9cf1-49b0-9ba0-9f7d5db1dc14"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:37.120653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-12caff35-30ea-4d9f-ac0d-3c3549544e3b req-21a6b29d-d92f-4f62-94af-9cef926127ff service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:37.121097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-12caff35-30ea-4d9f-ac0d-3c3549544e3b req-21a6b29d-d92f-4f62-94af-9cef926127ff service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:37.121539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-12caff35-30ea-4d9f-ac0d-3c3549544e3b req-21a6b29d-d92f-4f62-94af-9cef926127ff service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:37.157010 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-12caff35-30ea-4d9f-ac0d-3c3549544e3b req-21a6b29d-d92f-4f62-94af-9cef926127ff service nova] Creating event network-vif-unplugged:428c6441-9cf1-49b0-9ba0-9f7d5db1dc14 for instance 8eac13fe-2828-4885-b82d-af682e20a40c on n-h1-858383-15 Oct 24 10:42:37.169577 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-12caff35-30ea-4d9f-ac0d-3c3549544e3b req-21a6b29d-d92f-4f62-94af-9cef926127ff service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087820 Oct 24 10:42:37.172447 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2014/3996] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:42:37.340425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5d176551-60b4-407d-a2f6-a31c959fcb60 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:37.341616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5d176551-60b4-407d-a2f6-a31c959fcb60 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] [instance: d350ab27-db77-49c3-8270-682320f4bd1e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:37.378494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d176551-60b4-407d-a2f6-a31c959fcb60 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:37.381708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d176551-60b4-407d-a2f6-a31c959fcb60 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:37.382194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d176551-60b4-407d-a2f6-a31c959fcb60 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:37.382941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d176551-60b4-407d-a2f6-a31c959fcb60 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:37.383443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d176551-60b4-407d-a2f6-a31c959fcb60 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:37.384199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d176551-60b4-407d-a2f6-a31c959fcb60 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:37.410237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-631bd7f8-2fbe-4753-9785-f0a839253257 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:37.430440 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-5d176551-60b4-407d-a2f6-a31c959fcb60 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] HTTP exception thrown: Instance d350ab27-db77-49c3-8270-682320f4bd1e could not be found. Oct 24 10:42:37.432649 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-631bd7f8-2fbe-4753-9785-f0a839253257 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1494 microversion: 2.1 time: 0.431314 Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5d176551-60b4-407d-a2f6-a31c959fcb60 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Request method failure captured: Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e HTTP/1.1 Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmvnykDaWU90T9uEDjktnTuEtAiCn9pTLtyRLfx5clShS51uyqjNB_hZnlnl8muxvmtqHjHMteZxeTWXgrqBzBZyPoGuLksbAPvyURZnGAVPfHXwLfZgz6kLMKDe-ic6nWVdeLrvto-K73QKjrS3Ub3HGy4Y8aiXj_Zo2LxGnNr1PAk Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 743ff130bbae4b6e8022b30e821c4eb7 Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/743ff130bbae4b6e8022b30e821c4eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_743ff130bbae4b6e8022b30e821c4eb7", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 743ff130bbae4b6e8022b30e821c4eb7 Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1287264984 Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ListServersNegativeTestJSON-1287264984-project Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: c9aeff583c6141f487eb07e6e1ec3986 Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ListServersNegativeTestJSON-1287264984-project Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance d350ab27-db77-49c3-8270-682320f4bd1e could not be found. Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'd350ab27-db77-49c3-8270-682320f4bd1e'} Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d350ab27-db77-49c3-8270-682320f4bd1e could not be found. Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d350ab27-db77-49c3-8270-682320f4bd1e could not be found. Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:37.434566 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:37.438882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:37.438882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:37.438882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:37.438882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:37.438882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:42:37.438882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:42:37.438882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d350ab27-db77-49c3-8270-682320f4bd1e could not be found. Oct 24 10:42:37.438882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:37.440305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5d176551-60b4-407d-a2f6-a31c959fcb60 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] Returning 404 to user: Instance d350ab27-db77-49c3-8270-682320f4bd1e could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:42:37.442048 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5d176551-60b4-407d-a2f6-a31c959fcb60 tempest-ListServersNegativeTestJSON-1287264984 tempest-ListServersNegativeTestJSON-1287264984-project] 10.222.0.50 "GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e" status: 404 len: 111 microversion: 2.1 time: 0.109096 Oct 24 10:42:37.446156 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2015/3997] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:37 2022] GET /compute/v2.1/servers/d350ab27-db77-49c3-8270-682320f4bd1e => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:42:37.452404 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1983/3998] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:36 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1494 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:37.454537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8a7267c5-66c2-4529-bd73-63347a7e1061 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:37.458219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8a7267c5-66c2-4529-bd73-63347a7e1061 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:37.468013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a7267c5-66c2-4529-bd73-63347a7e1061 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:37.468759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a7267c5-66c2-4529-bd73-63347a7e1061 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:37.470546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a7267c5-66c2-4529-bd73-63347a7e1061 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:37.473654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a7267c5-66c2-4529-bd73-63347a7e1061 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:37.475553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a7267c5-66c2-4529-bd73-63347a7e1061 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:37.476169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a7267c5-66c2-4529-bd73-63347a7e1061 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:38.306169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8a7267c5-66c2-4529-bd73-63347a7e1061 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:38.319004 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8a7267c5-66c2-4529-bd73-63347a7e1061 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1395 microversion: 2.1 time: 0.871500 Oct 24 10:42:38.321889 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2016/3999] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:37 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1395 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:38.460738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8bc6b7ef-4520-4076-a2ab-54b5ee014c87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:38.462484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8bc6b7ef-4520-4076-a2ab-54b5ee014c87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:38.481466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bc6b7ef-4520-4076-a2ab-54b5ee014c87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:38.483131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bc6b7ef-4520-4076-a2ab-54b5ee014c87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:38.484950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bc6b7ef-4520-4076-a2ab-54b5ee014c87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:38.488595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bc6b7ef-4520-4076-a2ab-54b5ee014c87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:38.491710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bc6b7ef-4520-4076-a2ab-54b5ee014c87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:38.492484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bc6b7ef-4520-4076-a2ab-54b5ee014c87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:38.494198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-984b9a2f-af64-4e5e-a8fc-47a27bc887f5 req-7a283cee-2ef9-4370-8bdf-e611947052ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7e0c405-e34b-4b9c-97f6-ab1eb6b06526", "tag": "faea1350-7eaa-49e8-9806-291645b32b6e"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:38.509650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-984b9a2f-af64-4e5e-a8fc-47a27bc887f5 req-7a283cee-2ef9-4370-8bdf-e611947052ed service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:38.510570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-984b9a2f-af64-4e5e-a8fc-47a27bc887f5 req-7a283cee-2ef9-4370-8bdf-e611947052ed service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:38.511273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-984b9a2f-af64-4e5e-a8fc-47a27bc887f5 req-7a283cee-2ef9-4370-8bdf-e611947052ed service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:38.540351 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-984b9a2f-af64-4e5e-a8fc-47a27bc887f5 req-7a283cee-2ef9-4370-8bdf-e611947052ed service nova] Creating event network-changed:faea1350-7eaa-49e8-9806-291645b32b6e for instance e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 on n-h1-858383-15 Oct 24 10:42:38.558664 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-984b9a2f-af64-4e5e-a8fc-47a27bc887f5 req-7a283cee-2ef9-4370-8bdf-e611947052ed service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068385 Oct 24 10:42:38.566564 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2017/4000] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:38.582753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bc6b7ef-4520-4076-a2ab-54b5ee014c87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:38.583680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bc6b7ef-4520-4076-a2ab-54b5ee014c87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:38.585023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8bc6b7ef-4520-4076-a2ab-54b5ee014c87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:38.586277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-8bc6b7ef-4520-4076-a2ab-54b5ee014c87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lazy-loading 'fault' on Instance uuid 8eac13fe-2828-4885-b82d-af682e20a40c {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:42:38.716940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8bc6b7ef-4520-4076-a2ab-54b5ee014c87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:38.729087 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8bc6b7ef-4520-4076-a2ab-54b5ee014c87 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 200 len: 1304 microversion: 2.1 time: 0.272992 Oct 24 10:42:38.733218 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1984/4001] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:38 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 1304 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:39.122903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-29671adc-5bcb-4b1d-8dbe-9f2b98ead0b8 req-b0b990f8-2334-4e59-ac78-d7367b5984e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eac13fe-2828-4885-b82d-af682e20a40c", "name": "network-vif-deleted", "tag": "428c6441-9cf1-49b0-9ba0-9f7d5db1dc14"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:39.155898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-29671adc-5bcb-4b1d-8dbe-9f2b98ead0b8 req-b0b990f8-2334-4e59-ac78-d7367b5984e2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:39.161945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-29671adc-5bcb-4b1d-8dbe-9f2b98ead0b8 req-b0b990f8-2334-4e59-ac78-d7367b5984e2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:39.163485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-29671adc-5bcb-4b1d-8dbe-9f2b98ead0b8 req-b0b990f8-2334-4e59-ac78-d7367b5984e2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:39.206948 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-29671adc-5bcb-4b1d-8dbe-9f2b98ead0b8 req-b0b990f8-2334-4e59-ac78-d7367b5984e2 service nova] Creating event network-vif-deleted:428c6441-9cf1-49b0-9ba0-9f7d5db1dc14 for instance 8eac13fe-2828-4885-b82d-af682e20a40c on n-h1-858383-15 Oct 24 10:42:39.218520 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-29671adc-5bcb-4b1d-8dbe-9f2b98ead0b8 req-b0b990f8-2334-4e59-ac78-d7367b5984e2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098234 Oct 24 10:42:39.221473 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2018/4002] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:39.350925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f3cd05c2-24a6-4cb0-97ce-60af526a0b6c tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:39.352082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f3cd05c2-24a6-4cb0-97ce-60af526a0b6c tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:39.367515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3cd05c2-24a6-4cb0-97ce-60af526a0b6c tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:39.368279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3cd05c2-24a6-4cb0-97ce-60af526a0b6c tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:39.369251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3cd05c2-24a6-4cb0-97ce-60af526a0b6c tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:39.371225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3cd05c2-24a6-4cb0-97ce-60af526a0b6c tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:39.373155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3cd05c2-24a6-4cb0-97ce-60af526a0b6c tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:39.374729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3cd05c2-24a6-4cb0-97ce-60af526a0b6c tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:39.640214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:42:39.666785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f3cd05c2-24a6-4cb0-97ce-60af526a0b6c tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:39.677063 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f3cd05c2-24a6-4cb0-97ce-60af526a0b6c tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1395 microversion: 2.1 time: 0.332397 Oct 24 10:42:39.690039 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1985/4003] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:39 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1395 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:39.761329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2892b07e-62fd-42f2-8a83-f837f29fc653 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:39.762803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2892b07e-62fd-42f2-8a83-f837f29fc653 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 8eac13fe-2828-4885-b82d-af682e20a40c] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:39.773505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2892b07e-62fd-42f2-8a83-f837f29fc653 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:39.774254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2892b07e-62fd-42f2-8a83-f837f29fc653 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:39.775040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2892b07e-62fd-42f2-8a83-f837f29fc653 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:39.775976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2892b07e-62fd-42f2-8a83-f837f29fc653 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:39.776654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2892b07e-62fd-42f2-8a83-f837f29fc653 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:39.777307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2892b07e-62fd-42f2-8a83-f837f29fc653 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:39.795012 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-2892b07e-62fd-42f2-8a83-f837f29fc653 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] HTTP exception thrown: Instance 8eac13fe-2828-4885-b82d-af682e20a40c could not be found. Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2892b07e-62fd-42f2-8a83-f837f29fc653 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Request method failure captured: Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c HTTP/1.1 Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmmuJrxb1XlWB_avRxRliGRWB1RGcH6tFur30cSKqOzu2vxHhNtoBzNqu_iNWZYArPhjvCegW23YNaUUHwXw7ggKhvTGZpm4y2TCmcCle2W-rg0Uf0xse67nTky9VDrkBwyVUxKaUO1HKMfXPydd2Jmdynf6tgSS0X6qgnwmk8AaC6o Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4878c0e43a9d4db8ba5c6590b43624f0 Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerActionsTestJSON-1882077751 Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4878c0e43a9d4db8ba5c6590b43624f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4878c0e43a9d4db8ba5c6590b43624f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4878c0e43a9d4db8ba5c6590b43624f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4878c0e43a9d4db8ba5c6590b43624f0", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerActionsTestJSON-1882077751 Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4878c0e43a9d4db8ba5c6590b43624f0 Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerActionsTestJSON-1882077751 Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerActionsTestJSON-1882077751-project Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 45500f699a6f463b8755f0417b24151c Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerActionsTestJSON-1882077751-project Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 8eac13fe-2828-4885-b82d-af682e20a40c could not be found. Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '8eac13fe-2828-4885-b82d-af682e20a40c'} Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eac13fe-2828-4885-b82d-af682e20a40c could not be found. Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eac13fe-2828-4885-b82d-af682e20a40c could not be found. Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:39.797666 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:39.802754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:39.802754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:39.802754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:39.802754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:42:39.802754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:42:39.802754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eac13fe-2828-4885-b82d-af682e20a40c could not be found. Oct 24 10:42:39.802754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:39.805128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2892b07e-62fd-42f2-8a83-f837f29fc653 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Returning 404 to user: Instance 8eac13fe-2828-4885-b82d-af682e20a40c could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:42:39.806205 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2892b07e-62fd-42f2-8a83-f837f29fc653 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c" status: 404 len: 111 microversion: 2.1 time: 0.049871 Oct 24 10:42:39.807488 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2019/4004] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:39 2022] GET /compute/v2.1/servers/8eac13fe-2828-4885-b82d-af682e20a40c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:42:39.817768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d2d35e4b-b243-47ca-ae65-0257cc2d1182 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:39.818384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d2d35e4b-b243-47ca-ae65-0257cc2d1182 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:39.826508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2d35e4b-b243-47ca-ae65-0257cc2d1182 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:39.827269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2d35e4b-b243-47ca-ae65-0257cc2d1182 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:39.828049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2d35e4b-b243-47ca-ae65-0257cc2d1182 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:39.829139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2d35e4b-b243-47ca-ae65-0257cc2d1182 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:39.829735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2d35e4b-b243-47ca-ae65-0257cc2d1182 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:39.830316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2d35e4b-b243-47ca-ae65-0257cc2d1182 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:39.864475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d2d35e4b-b243-47ca-ae65-0257cc2d1182 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:42:39.969406 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d2d35e4b-b243-47ca-ae65-0257cc2d1182 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "DELETE /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 204 len: 0 microversion: 2.1 time: 0.157463 Oct 24 10:42:39.970559 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1986/4005] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:42:39 2022] DELETE /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:42:39.978718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e9708feb-6346-4bd2-b4a6-9e9aa58b553d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:39.979327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e9708feb-6346-4bd2-b4a6-9e9aa58b553d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:39.987018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9708feb-6346-4bd2-b4a6-9e9aa58b553d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:39.989994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9708feb-6346-4bd2-b4a6-9e9aa58b553d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:39.990690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9708feb-6346-4bd2-b4a6-9e9aa58b553d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:39.991809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9708feb-6346-4bd2-b4a6-9e9aa58b553d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:39.992972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9708feb-6346-4bd2-b4a6-9e9aa58b553d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:39.993666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9708feb-6346-4bd2-b4a6-9e9aa58b553d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:40.189765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e9708feb-6346-4bd2-b4a6-9e9aa58b553d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:40.199502 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e9708feb-6346-4bd2-b4a6-9e9aa58b553d tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1677 microversion: 2.1 time: 0.224663 Oct 24 10:42:40.200334 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2020/4006] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:39 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1677 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:40.699725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=10 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:42:40.712079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-677ecb24-bc55-42dd-90c5-16749bc48e73 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:40.719667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-677ecb24-bc55-42dd-90c5-16749bc48e73 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:40.741343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-677ecb24-bc55-42dd-90c5-16749bc48e73 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:40.744320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-677ecb24-bc55-42dd-90c5-16749bc48e73 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:40.746405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-677ecb24-bc55-42dd-90c5-16749bc48e73 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:40.751707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-677ecb24-bc55-42dd-90c5-16749bc48e73 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:40.754475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-677ecb24-bc55-42dd-90c5-16749bc48e73 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:40.775446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-677ecb24-bc55-42dd-90c5-16749bc48e73 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:41.203452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-677ecb24-bc55-42dd-90c5-16749bc48e73 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:41.223359 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-677ecb24-bc55-42dd-90c5-16749bc48e73 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1395 microversion: 2.1 time: 0.524541 Oct 24 10:42:41.223963 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1987/4007] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:40 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1395 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:41.225247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-08ed7c5c-80f3-4a60-a25c-71d798b74f5e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:41.225874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-08ed7c5c-80f3-4a60-a25c-71d798b74f5e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:41.249478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08ed7c5c-80f3-4a60-a25c-71d798b74f5e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:41.249996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08ed7c5c-80f3-4a60-a25c-71d798b74f5e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:41.254732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08ed7c5c-80f3-4a60-a25c-71d798b74f5e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:41.256095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08ed7c5c-80f3-4a60-a25c-71d798b74f5e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:41.262122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08ed7c5c-80f3-4a60-a25c-71d798b74f5e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:41.263448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08ed7c5c-80f3-4a60-a25c-71d798b74f5e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:41.483183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:42:41.857935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=16 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:42:41.915751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-08ed7c5c-80f3-4a60-a25c-71d798b74f5e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:41.927843 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-08ed7c5c-80f3-4a60-a25c-71d798b74f5e tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1677 microversion: 2.1 time: 0.708026 Oct 24 10:42:41.929029 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2021/4008] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:41 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1677 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:42:42.251484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-487cde02-e324-4e6b-ba8a-72616b625ff5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:42.252025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-487cde02-e324-4e6b-ba8a-72616b625ff5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:42.265697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-487cde02-e324-4e6b-ba8a-72616b625ff5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:42.267408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-487cde02-e324-4e6b-ba8a-72616b625ff5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:42.267859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-487cde02-e324-4e6b-ba8a-72616b625ff5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:42.271804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-487cde02-e324-4e6b-ba8a-72616b625ff5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:42.272370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-487cde02-e324-4e6b-ba8a-72616b625ff5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:42.272823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-487cde02-e324-4e6b-ba8a-72616b625ff5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:42.959307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ce1de8e3-d683-4e22-8669-a64949528180 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:42.959933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ce1de8e3-d683-4e22-8669-a64949528180 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:42.969474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce1de8e3-d683-4e22-8669-a64949528180 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:42.974619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce1de8e3-d683-4e22-8669-a64949528180 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:42.975066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce1de8e3-d683-4e22-8669-a64949528180 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:42.975865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce1de8e3-d683-4e22-8669-a64949528180 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:42.976329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce1de8e3-d683-4e22-8669-a64949528180 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:42.976759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce1de8e3-d683-4e22-8669-a64949528180 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:43.164881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-487cde02-e324-4e6b-ba8a-72616b625ff5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:43.196169 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-487cde02-e324-4e6b-ba8a-72616b625ff5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1395 microversion: 2.1 time: 0.948058 Oct 24 10:42:43.208875 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1988/4009] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:42 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1395 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:43.761801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ce1de8e3-d683-4e22-8669-a64949528180 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:43.772325 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ce1de8e3-d683-4e22-8669-a64949528180 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1677 microversion: 2.1 time: 0.818639 Oct 24 10:42:43.777201 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2022/4010] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:42 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1677 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:42:44.227863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d41d39a0-0ac1-4712-a25a-83be1edd0166 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:44.227863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d41d39a0-0ac1-4712-a25a-83be1edd0166 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:44.247465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d41d39a0-0ac1-4712-a25a-83be1edd0166 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:44.248423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d41d39a0-0ac1-4712-a25a-83be1edd0166 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:44.249273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d41d39a0-0ac1-4712-a25a-83be1edd0166 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:44.250546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d41d39a0-0ac1-4712-a25a-83be1edd0166 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:44.251776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d41d39a0-0ac1-4712-a25a-83be1edd0166 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:44.252414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d41d39a0-0ac1-4712-a25a-83be1edd0166 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:44.262831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:42:44.800973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-466d801e-11e3-4bd4-9d23-653ddb39ee19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:44.801683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-466d801e-11e3-4bd4-9d23-653ddb39ee19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:44.812177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-466d801e-11e3-4bd4-9d23-653ddb39ee19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:44.814387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-466d801e-11e3-4bd4-9d23-653ddb39ee19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:44.816736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-466d801e-11e3-4bd4-9d23-653ddb39ee19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:44.817709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-466d801e-11e3-4bd4-9d23-653ddb39ee19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:44.819325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-466d801e-11e3-4bd4-9d23-653ddb39ee19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:44.821649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-466d801e-11e3-4bd4-9d23-653ddb39ee19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:44.860611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d41d39a0-0ac1-4712-a25a-83be1edd0166 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:44.876197 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d41d39a0-0ac1-4712-a25a-83be1edd0166 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1395 microversion: 2.1 time: 0.656401 Oct 24 10:42:44.878851 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1989/4011] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:44 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1395 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:44.958995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-466d801e-11e3-4bd4-9d23-653ddb39ee19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:44.970860 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-466d801e-11e3-4bd4-9d23-653ddb39ee19 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1609 microversion: 2.1 time: 0.173926 Oct 24 10:42:45.001904 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2023/4012] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:44 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1609 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:42:45.144649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ed6cd28d-e3dc-4cb4-a1d3-d8e52c627e6a req-facf4d64-b3b4-439b-a925-6b9bc472f4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513ca608-24c9-45f9-8fb9-e231d92c7262", "name": "network-vif-deleted", "tag": "b2def801-647c-479d-9e34-cb0b4d60448e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:45.165878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ed6cd28d-e3dc-4cb4-a1d3-d8e52c627e6a req-facf4d64-b3b4-439b-a925-6b9bc472f4a0 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:45.192157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ed6cd28d-e3dc-4cb4-a1d3-d8e52c627e6a req-facf4d64-b3b4-439b-a925-6b9bc472f4a0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:45.193467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ed6cd28d-e3dc-4cb4-a1d3-d8e52c627e6a req-facf4d64-b3b4-439b-a925-6b9bc472f4a0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:45.243011 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ed6cd28d-e3dc-4cb4-a1d3-d8e52c627e6a req-facf4d64-b3b4-439b-a925-6b9bc472f4a0 service nova] Creating event network-vif-deleted:b2def801-647c-479d-9e34-cb0b4d60448e for instance 513ca608-24c9-45f9-8fb9-e231d92c7262 on n-h2-858383-15 Oct 24 10:42:45.288185 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ed6cd28d-e3dc-4cb4-a1d3-d8e52c627e6a req-facf4d64-b3b4-439b-a925-6b9bc472f4a0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148971 Oct 24 10:42:45.292934 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1990/4013] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:45.887356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-88df2681-52b9-42d9-9b1b-484ba0028250 req-1ca47f42-ef7c-425d-a53c-1cafe87eeeeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7e0c405-e34b-4b9c-97f6-ab1eb6b06526", "name": "network-vif-plugged", "status": "completed", "tag": "faea1350-7eaa-49e8-9806-291645b32b6e"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:45.906910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b5a48df0-f597-4c1e-a113-e53d464129af tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:45.907680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b5a48df0-f597-4c1e-a113-e53d464129af tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:45.913033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-88df2681-52b9-42d9-9b1b-484ba0028250 req-1ca47f42-ef7c-425d-a53c-1cafe87eeeeb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:45.913534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-88df2681-52b9-42d9-9b1b-484ba0028250 req-1ca47f42-ef7c-425d-a53c-1cafe87eeeeb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:45.916899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-88df2681-52b9-42d9-9b1b-484ba0028250 req-1ca47f42-ef7c-425d-a53c-1cafe87eeeeb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:45.918683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5a48df0-f597-4c1e-a113-e53d464129af tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:45.919212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5a48df0-f597-4c1e-a113-e53d464129af tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:45.919657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5a48df0-f597-4c1e-a113-e53d464129af tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:45.920423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5a48df0-f597-4c1e-a113-e53d464129af tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:45.921023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5a48df0-f597-4c1e-a113-e53d464129af tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:45.921411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5a48df0-f597-4c1e-a113-e53d464129af tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:45.974752 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-88df2681-52b9-42d9-9b1b-484ba0028250 req-1ca47f42-ef7c-425d-a53c-1cafe87eeeeb service nova] Creating event network-vif-plugged:faea1350-7eaa-49e8-9806-291645b32b6e for instance e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 on n-h1-858383-15 Oct 24 10:42:45.988715 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-88df2681-52b9-42d9-9b1b-484ba0028250 req-1ca47f42-ef7c-425d-a53c-1cafe87eeeeb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105277 Oct 24 10:42:45.990134 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2024/4014] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:46.048808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-afcfcfaa-63ca-4680-a8cf-03d48fb2e002 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:46.049626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-afcfcfaa-63ca-4680-a8cf-03d48fb2e002 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:46.090640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afcfcfaa-63ca-4680-a8cf-03d48fb2e002 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:46.091183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afcfcfaa-63ca-4680-a8cf-03d48fb2e002 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:46.091654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afcfcfaa-63ca-4680-a8cf-03d48fb2e002 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:46.092392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afcfcfaa-63ca-4680-a8cf-03d48fb2e002 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:46.101141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afcfcfaa-63ca-4680-a8cf-03d48fb2e002 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:46.101610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afcfcfaa-63ca-4680-a8cf-03d48fb2e002 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:46.230459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afcfcfaa-63ca-4680-a8cf-03d48fb2e002 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:46.231943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afcfcfaa-63ca-4680-a8cf-03d48fb2e002 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:46.232771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afcfcfaa-63ca-4680-a8cf-03d48fb2e002 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:46.234363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-afcfcfaa-63ca-4680-a8cf-03d48fb2e002 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lazy-loading 'fault' on Instance uuid 513ca608-24c9-45f9-8fb9-e231d92c7262 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:42:46.362871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-afcfcfaa-63ca-4680-a8cf-03d48fb2e002 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45500f699a6f463b8755f0417b24151c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4878c0e43a9d4db8ba5c6590b43624f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:46.369505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:42:46.372364 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-afcfcfaa-63ca-4680-a8cf-03d48fb2e002 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 200 len: 1328 microversion: 2.1 time: 0.336465 Oct 24 10:42:46.378579 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2025/4015] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:46 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 1328 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:46.453657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b5a48df0-f597-4c1e-a113-e53d464129af tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:46.468404 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b5a48df0-f597-4c1e-a113-e53d464129af tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1395 microversion: 2.1 time: 0.564818 Oct 24 10:42:46.476828 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1991/4016] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:45 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1395 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:42:47.403858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7fad950f-797e-4df5-8bc1-a1e851a1ec26 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:47.405424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7fad950f-797e-4df5-8bc1-a1e851a1ec26 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] [instance: 513ca608-24c9-45f9-8fb9-e231d92c7262] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:47.437859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fad950f-797e-4df5-8bc1-a1e851a1ec26 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:47.444341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fad950f-797e-4df5-8bc1-a1e851a1ec26 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:47.446955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fad950f-797e-4df5-8bc1-a1e851a1ec26 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:47.451018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fad950f-797e-4df5-8bc1-a1e851a1ec26 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:47.451720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fad950f-797e-4df5-8bc1-a1e851a1ec26 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:47.452190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fad950f-797e-4df5-8bc1-a1e851a1ec26 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:47.537082 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-7fad950f-797e-4df5-8bc1-a1e851a1ec26 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] HTTP exception thrown: Instance 513ca608-24c9-45f9-8fb9-e231d92c7262 could not be found. Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7fad950f-797e-4df5-8bc1-a1e851a1ec26 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Request method failure captured: Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 HTTP/1.1 Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmmuJrxb1XlWB_avRxRliGRWB1RGcH6tFur30cSKqOzu2vxHhNtoBzNqu_iNWZYArPhjvCegW23YNaUUHwXw7ggKhvTGZpm4y2TCmcCle2W-rg0Uf0xse67nTky9VDrkBwyVUxKaUO1HKMfXPydd2Jmdynf6tgSS0X6qgnwmk8AaC6o Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4878c0e43a9d4db8ba5c6590b43624f0 Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerActionsTestJSON-1882077751 Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4878c0e43a9d4db8ba5c6590b43624f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4878c0e43a9d4db8ba5c6590b43624f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4878c0e43a9d4db8ba5c6590b43624f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4878c0e43a9d4db8ba5c6590b43624f0", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerActionsTestJSON-1882077751 Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4878c0e43a9d4db8ba5c6590b43624f0 Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerActionsTestJSON-1882077751 Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerActionsTestJSON-1882077751-project Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 45500f699a6f463b8755f0417b24151c Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerActionsTestJSON-1882077751-project Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 513ca608-24c9-45f9-8fb9-e231d92c7262 could not be found. Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '513ca608-24c9-45f9-8fb9-e231d92c7262'} Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 513ca608-24c9-45f9-8fb9-e231d92c7262 could not be found. Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 513ca608-24c9-45f9-8fb9-e231d92c7262 could not be found. Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:42:47.538821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:47.542648 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:42:47.542648 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:42:47.542648 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:42:47.542648 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:42:47.542648 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:42:47.542648 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 513ca608-24c9-45f9-8fb9-e231d92c7262 could not be found. Oct 24 10:42:47.542648 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:42:47.543609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7fad950f-797e-4df5-8bc1-a1e851a1ec26 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Returning 404 to user: Instance 513ca608-24c9-45f9-8fb9-e231d92c7262 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:42:47.549122 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7fad950f-797e-4df5-8bc1-a1e851a1ec26 tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262" status: 404 len: 111 microversion: 2.1 time: 0.144711 Oct 24 10:42:47.553584 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2026/4017] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:47 2022] GET /compute/v2.1/servers/513ca608-24c9-45f9-8fb9-e231d92c7262 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:42:47.564552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-493e63f9-7aaa-45ae-9f33-1cc9e6408f1a tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:47.573792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-493e63f9-7aaa-45ae-9f33-1cc9e6408f1a tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:47.599322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-493e63f9-7aaa-45ae-9f33-1cc9e6408f1a tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:47.599841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-493e63f9-7aaa-45ae-9f33-1cc9e6408f1a tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:47.604713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-493e63f9-7aaa-45ae-9f33-1cc9e6408f1a tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:47.606231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-493e63f9-7aaa-45ae-9f33-1cc9e6408f1a tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:47.608034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-493e63f9-7aaa-45ae-9f33-1cc9e6408f1a tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:47.612617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-493e63f9-7aaa-45ae-9f33-1cc9e6408f1a tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:48.073053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-493e63f9-7aaa-45ae-9f33-1cc9e6408f1a tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:48.086433 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-493e63f9-7aaa-45ae-9f33-1cc9e6408f1a tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1395 microversion: 2.1 time: 0.531564 Oct 24 10:42:48.090029 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2027/4018] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:47 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1395 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:48.106274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e4efe7d8-f818-454f-80d7-fb6db4563aea tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] Calling method '.version_select at 0x7f04d06fbd30>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:48.161817 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e4efe7d8-f818-454f-80d7-fb6db4563aea tempest-ServerActionsTestJSON-1882077751 tempest-ServerActionsTestJSON-1882077751-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1372951817" status: 202 len: 0 microversion: 2.1 time: 0.068564 Oct 24 10:42:48.164148 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2028/4019] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Oct 24 10:42:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1372951817 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:42:48.333132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ed97ac2-5465-4afe-af49-ec6bf13e779d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Action: 'create', calling method: .version_select at 0x7f04cbb89d30>, body: {"keypair": {"name": "tempest-keypair-1486946419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQJIg5Ay0F0setADpVxIihKL85X85qGWpH8puLs7BKQaVfoPuaXIBcpxSQHMwvVa97MxHUlWzC9T+8+7SHamqM94hnu9LQxQjDPGNQcPQZmQ2fg+S+oL1SX7eIwWEO/Dg=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:48.400053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0ed97ac2-5465-4afe-af49-ec6bf13e779d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Getting quotas for project 886ae7eabe82421ca19e5cd59630e961. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:42:48.409241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0ed97ac2-5465-4afe-af49-ec6bf13e779d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Getting quotas for user bf908b0f4e444157a0f28e84de8f8555 and project 886ae7eabe82421ca19e5cd59630e961. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:42:48.484776 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0ed97ac2-5465-4afe-af49-ec6bf13e779d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.070520 Oct 24 10:42:48.485753 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1992/4020] 10.222.0.50 () {62 vars in 1200 bytes} [Mon Oct 24 10:42:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1073 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 24 10:42:49.115899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-01e19f44-5aac-4277-a1bf-afa8f399a878 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:49.117938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-01e19f44-5aac-4277-a1bf-afa8f399a878 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:49.149879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01e19f44-5aac-4277-a1bf-afa8f399a878 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:49.152575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01e19f44-5aac-4277-a1bf-afa8f399a878 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:49.155216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01e19f44-5aac-4277-a1bf-afa8f399a878 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:49.156200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01e19f44-5aac-4277-a1bf-afa8f399a878 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:49.158595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01e19f44-5aac-4277-a1bf-afa8f399a878 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:49.159484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01e19f44-5aac-4277-a1bf-afa8f399a878 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:49.664245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-01e19f44-5aac-4277-a1bf-afa8f399a878 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:49.673544 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-01e19f44-5aac-4277-a1bf-afa8f399a878 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1576 microversion: 2.1 time: 0.565477 Oct 24 10:42:49.676683 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2029/4021] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:49 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1576 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:49.705086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f13d890e-fd2d-4c38-b4f3-f1667d25afc4 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:49.707155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f13d890e-fd2d-4c38-b4f3-f1667d25afc4 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:49.720623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f13d890e-fd2d-4c38-b4f3-f1667d25afc4 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:49.723245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f13d890e-fd2d-4c38-b4f3-f1667d25afc4 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:49.723947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f13d890e-fd2d-4c38-b4f3-f1667d25afc4 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:49.725480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f13d890e-fd2d-4c38-b4f3-f1667d25afc4 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:49.726712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f13d890e-fd2d-4c38-b4f3-f1667d25afc4 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:49.732726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f13d890e-fd2d-4c38-b4f3-f1667d25afc4 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:49.901363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-827bfa5b-ed50-4190-acd3-e5c314eadef5 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1217113095", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": "none"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:50.027671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-827bfa5b-ed50-4190-acd3-e5c314eadef5 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:42:50.028029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-827bfa5b-ed50-4190-acd3-e5c314eadef5 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:42:50.028509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-827bfa5b-ed50-4190-acd3-e5c314eadef5 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:42:50.028949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-827bfa5b-ed50-4190-acd3-e5c314eadef5 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:42:50.029363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-827bfa5b-ed50-4190-acd3-e5c314eadef5 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:42:50.033824 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f13d890e-fd2d-4c38-b4f3-f1667d25afc4 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.334093 Oct 24 10:42:50.034468 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2030/4022] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 10:42:49 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526/os-interface => generated 284 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:50.067399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-827bfa5b-ed50-4190-acd3-e5c314eadef5 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:50.067901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-827bfa5b-ed50-4190-acd3-e5c314eadef5 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:50.068350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-827bfa5b-ed50-4190-acd3-e5c314eadef5 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:50.069190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-827bfa5b-ed50-4190-acd3-e5c314eadef5 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:50.074038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-827bfa5b-ed50-4190-acd3-e5c314eadef5 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:50.074771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-827bfa5b-ed50-4190-acd3-e5c314eadef5 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:50.141171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-827bfa5b-ed50-4190-acd3-e5c314eadef5 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Getting quotas for project 937d42ef3893417bb448af9f20dbc315. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:42:50.151855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-827bfa5b-ed50-4190-acd3-e5c314eadef5 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Getting quotas for user 5e845ff0d0d2476bbfa25c770cb63ee1 and project 937d42ef3893417bb448af9f20dbc315. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:42:50.197660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-827bfa5b-ed50-4190-acd3-e5c314eadef5 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:42:50.204132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-827bfa5b-ed50-4190-acd3-e5c314eadef5 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] [instance: 57495eaf-c97b-4afc-92e3-5e345bef58df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:42:50.275025 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-827bfa5b-ed50-4190-acd3-e5c314eadef5 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.647133 Oct 24 10:42:50.275815 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1993/4023] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Oct 24 10:42:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 10:42:50.288864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-260daf8d-9fe6-4a88-8713-60835e3b927c tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:50.289378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-260daf8d-9fe6-4a88-8713-60835e3b927c tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] [instance: 57495eaf-c97b-4afc-92e3-5e345bef58df] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:50.510178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-260daf8d-9fe6-4a88-8713-60835e3b927c tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:50.531250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-260daf8d-9fe6-4a88-8713-60835e3b927c tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:50.538129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-260daf8d-9fe6-4a88-8713-60835e3b927c tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:50.547365 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-260daf8d-9fe6-4a88-8713-60835e3b927c tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] 10.222.0.50 "GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df" status: 200 len: 1281 microversion: 2.47 time: 0.262005 Oct 24 10:42:50.551476 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2031/4024] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:50 2022] GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df => generated 1281 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:51.580400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c8637865-71d2-4500-9fe4-2cc31bf2978a tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:51.582021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c8637865-71d2-4500-9fe4-2cc31bf2978a tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] [instance: 57495eaf-c97b-4afc-92e3-5e345bef58df] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:51.617453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8637865-71d2-4500-9fe4-2cc31bf2978a tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:51.620723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8637865-71d2-4500-9fe4-2cc31bf2978a tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:51.621282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8637865-71d2-4500-9fe4-2cc31bf2978a tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:51.622042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8637865-71d2-4500-9fe4-2cc31bf2978a tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:51.622520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8637865-71d2-4500-9fe4-2cc31bf2978a tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:51.625303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8637865-71d2-4500-9fe4-2cc31bf2978a tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:52.250515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c8637865-71d2-4500-9fe4-2cc31bf2978a tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:52.269398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c8637865-71d2-4500-9fe4-2cc31bf2978a tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:52.272327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c8637865-71d2-4500-9fe4-2cc31bf2978a tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:52.279164 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c8637865-71d2-4500-9fe4-2cc31bf2978a tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] 10.222.0.50 "GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df" status: 200 len: 1277 microversion: 2.47 time: 0.704728 Oct 24 10:42:52.279800 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1994/4025] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:51 2022] GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df => generated 1277 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:53.314782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e3b4a756-7b2b-4509-bc9e-7c013372ae88 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:53.316931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e3b4a756-7b2b-4509-bc9e-7c013372ae88 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] [instance: 57495eaf-c97b-4afc-92e3-5e345bef58df] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:53.337094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3b4a756-7b2b-4509-bc9e-7c013372ae88 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:53.338012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3b4a756-7b2b-4509-bc9e-7c013372ae88 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:53.339723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3b4a756-7b2b-4509-bc9e-7c013372ae88 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:53.341634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3b4a756-7b2b-4509-bc9e-7c013372ae88 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:53.342661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3b4a756-7b2b-4509-bc9e-7c013372ae88 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:53.344228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3b4a756-7b2b-4509-bc9e-7c013372ae88 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:53.599390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e3b4a756-7b2b-4509-bc9e-7c013372ae88 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:53.619396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e3b4a756-7b2b-4509-bc9e-7c013372ae88 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:53.621656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e3b4a756-7b2b-4509-bc9e-7c013372ae88 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:53.625692 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e3b4a756-7b2b-4509-bc9e-7c013372ae88 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] 10.222.0.50 "GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df" status: 200 len: 1339 microversion: 2.47 time: 0.313930 Oct 24 10:42:53.627086 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2032/4026] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:53 2022] GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df => generated 1339 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:54.623558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-73f1c5e3-f235-4878-8950-88eb8186cabc tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:54.624240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-73f1c5e3-f235-4878-8950-88eb8186cabc tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:54.635785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73f1c5e3-f235-4878-8950-88eb8186cabc tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:54.636282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73f1c5e3-f235-4878-8950-88eb8186cabc tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:54.636726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73f1c5e3-f235-4878-8950-88eb8186cabc tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:54.643321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73f1c5e3-f235-4878-8950-88eb8186cabc tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:54.643822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73f1c5e3-f235-4878-8950-88eb8186cabc tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:54.644273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73f1c5e3-f235-4878-8950-88eb8186cabc tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:54.655235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-94ee8f0c-e32f-42b0-bcac-4f5ceb5321af tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:54.655853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-94ee8f0c-e32f-42b0-bcac-4f5ceb5321af tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] [instance: 57495eaf-c97b-4afc-92e3-5e345bef58df] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:54.670752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94ee8f0c-e32f-42b0-bcac-4f5ceb5321af tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:54.675427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94ee8f0c-e32f-42b0-bcac-4f5ceb5321af tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:54.681619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94ee8f0c-e32f-42b0-bcac-4f5ceb5321af tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:54.683166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94ee8f0c-e32f-42b0-bcac-4f5ceb5321af tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:54.685970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94ee8f0c-e32f-42b0-bcac-4f5ceb5321af tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:54.694984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94ee8f0c-e32f-42b0-bcac-4f5ceb5321af tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:54.894840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94ee8f0c-e32f-42b0-bcac-4f5ceb5321af tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:54.908418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94ee8f0c-e32f-42b0-bcac-4f5ceb5321af tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:54.916775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94ee8f0c-e32f-42b0-bcac-4f5ceb5321af tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:54.918466 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-94ee8f0c-e32f-42b0-bcac-4f5ceb5321af tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] 10.222.0.50 "GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df" status: 200 len: 1339 microversion: 2.47 time: 0.267906 Oct 24 10:42:54.919654 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2033/4027] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:54 2022] GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df => generated 1339 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:54.947422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-d4771191-5e49-4e63-8aaf-2bb72d999fd7 req-acc7e3f3-4f9b-422d-911b-f3b4d6274806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7e0c405-e34b-4b9c-97f6-ab1eb6b06526", "tag": "faea1350-7eaa-49e8-9806-291645b32b6e"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:54.980521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d4771191-5e49-4e63-8aaf-2bb72d999fd7 req-acc7e3f3-4f9b-422d-911b-f3b4d6274806 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:54.989274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d4771191-5e49-4e63-8aaf-2bb72d999fd7 req-acc7e3f3-4f9b-422d-911b-f3b4d6274806 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:54.989812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d4771191-5e49-4e63-8aaf-2bb72d999fd7 req-acc7e3f3-4f9b-422d-911b-f3b4d6274806 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:55.037525 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-d4771191-5e49-4e63-8aaf-2bb72d999fd7 req-acc7e3f3-4f9b-422d-911b-f3b4d6274806 service nova] Creating event network-changed:faea1350-7eaa-49e8-9806-291645b32b6e for instance e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 on n-h1-858383-15 Oct 24 10:42:55.043860 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-d4771191-5e49-4e63-8aaf-2bb72d999fd7 req-acc7e3f3-4f9b-422d-911b-f3b4d6274806 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122663 Oct 24 10:42:55.046718 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2034/4028] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:55.226964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-73f1c5e3-f235-4878-8950-88eb8186cabc tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:55.237469 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-73f1c5e3-f235-4878-8950-88eb8186cabc tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1576 microversion: 2.1 time: 0.618205 Oct 24 10:42:55.237971 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1995/4029] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:42:54 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1576 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:42:55.840543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-98d09859-dfc9-440a-8ef2-b89d66277617 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-553601052", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a22e9c7-8b7d-407a-b10d-a70b7c3811c7"}], "security_groups": [{"name": "tempest-securitygroup--1441585690"}], "key_name": "tempest-keypair-1486946419", "user_data": "}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:55.947844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e089113-76dd-4bac-8b4f-8f21c4f0b32e tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:55.948780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e089113-76dd-4bac-8b4f-8f21c4f0b32e tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] [instance: 57495eaf-c97b-4afc-92e3-5e345bef58df] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:55.957492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e089113-76dd-4bac-8b4f-8f21c4f0b32e tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:55.957987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e089113-76dd-4bac-8b4f-8f21c4f0b32e tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:55.958429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e089113-76dd-4bac-8b4f-8f21c4f0b32e tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:55.959150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e089113-76dd-4bac-8b4f-8f21c4f0b32e tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:55.966917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e089113-76dd-4bac-8b4f-8f21c4f0b32e tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:55.967506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e089113-76dd-4bac-8b4f-8f21c4f0b32e tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:56.328428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1e089113-76dd-4bac-8b4f-8f21c4f0b32e tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:56.341353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1e089113-76dd-4bac-8b4f-8f21c4f0b32e tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:56.343530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1e089113-76dd-4bac-8b4f-8f21c4f0b32e tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:56.345347 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1e089113-76dd-4bac-8b4f-8f21c4f0b32e tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] 10.222.0.50 "GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df" status: 200 len: 1339 microversion: 2.47 time: 0.402699 Oct 24 10:42:56.346480 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1996/4030] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:55 2022] GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df => generated 1339 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:42:56.524143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-98d09859-dfc9-440a-8ef2-b89d66277617 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] validate_networks() for [('7a22e9c7-8b7d-407a-b10d-a70b7c3811c7', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:42:57.374806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-35391b02-0a12-45b3-94b6-8c67df50109c tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:57.375718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-35391b02-0a12-45b3-94b6-8c67df50109c tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] [instance: 57495eaf-c97b-4afc-92e3-5e345bef58df] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:57.384346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35391b02-0a12-45b3-94b6-8c67df50109c tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:57.385004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35391b02-0a12-45b3-94b6-8c67df50109c tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:57.385628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35391b02-0a12-45b3-94b6-8c67df50109c tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:57.386459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35391b02-0a12-45b3-94b6-8c67df50109c tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:57.387062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35391b02-0a12-45b3-94b6-8c67df50109c tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:57.387626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35391b02-0a12-45b3-94b6-8c67df50109c tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:57.509412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-35391b02-0a12-45b3-94b6-8c67df50109c tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:57.523213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-35391b02-0a12-45b3-94b6-8c67df50109c tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:57.525967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-35391b02-0a12-45b3-94b6-8c67df50109c tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:57.527677 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-35391b02-0a12-45b3-94b6-8c67df50109c tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] 10.222.0.50 "GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df" status: 200 len: 1360 microversion: 2.47 time: 0.157914 Oct 24 10:42:57.529246 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1997/4031] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:57 2022] GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:42:57.561445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e4101037-5db9-47c2-8b55-a56d82382a20 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-294309281"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:42:57.563942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e4101037-5db9-47c2-8b55-a56d82382a20 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] [instance: 57495eaf-c97b-4afc-92e3-5e345bef58df] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:57.567088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:INSERT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:42:57.573753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4101037-5db9-47c2-8b55-a56d82382a20 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:57.574352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4101037-5db9-47c2-8b55-a56d82382a20 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:57.574947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4101037-5db9-47c2-8b55-a56d82382a20 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:57.576076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4101037-5db9-47c2-8b55-a56d82382a20 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:57.577152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4101037-5db9-47c2-8b55-a56d82382a20 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:57.577731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4101037-5db9-47c2-8b55-a56d82382a20 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:57.871006 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e4101037-5db9-47c2-8b55-a56d82382a20 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] 10.222.0.50 "POST /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df/action" status: 202 len: 52 microversion: 2.47 time: 0.314548 Oct 24 10:42:57.880425 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1998/4032] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Oct 24 10:42:57 2022] POST /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df/action => generated 52 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 24 10:42:57.887261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-197e1863-19aa-46c7-b120-ed9ff1fea057 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:57.888577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-197e1863-19aa-46c7-b120-ed9ff1fea057 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] [instance: 57495eaf-c97b-4afc-92e3-5e345bef58df] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:57.898983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-197e1863-19aa-46c7-b120-ed9ff1fea057 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:57.900530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-197e1863-19aa-46c7-b120-ed9ff1fea057 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:57.901198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-197e1863-19aa-46c7-b120-ed9ff1fea057 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:57.902325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-197e1863-19aa-46c7-b120-ed9ff1fea057 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:57.902947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-197e1863-19aa-46c7-b120-ed9ff1fea057 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:57.903586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-197e1863-19aa-46c7-b120-ed9ff1fea057 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:57.947006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-197e1863-19aa-46c7-b120-ed9ff1fea057 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] [instance: 57495eaf-c97b-4afc-92e3-5e345bef58df] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:42:58.054366 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-197e1863-19aa-46c7-b120-ed9ff1fea057 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] 10.222.0.50 "DELETE /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df" status: 204 len: 0 microversion: 2.47 time: 0.171105 Oct 24 10:42:58.058805 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 1999/4033] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:42:57 2022] DELETE /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:42:58.068734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d658f9f6-a44a-4cc5-961f-41f6b265a8b1 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:58.069618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d658f9f6-a44a-4cc5-961f-41f6b265a8b1 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] [instance: 57495eaf-c97b-4afc-92e3-5e345bef58df] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:58.075924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d658f9f6-a44a-4cc5-961f-41f6b265a8b1 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:58.076414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d658f9f6-a44a-4cc5-961f-41f6b265a8b1 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:58.076910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d658f9f6-a44a-4cc5-961f-41f6b265a8b1 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:58.077576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d658f9f6-a44a-4cc5-961f-41f6b265a8b1 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:58.078146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d658f9f6-a44a-4cc5-961f-41f6b265a8b1 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:58.078520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d658f9f6-a44a-4cc5-961f-41f6b265a8b1 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:58.231413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d658f9f6-a44a-4cc5-961f-41f6b265a8b1 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:58.246352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d658f9f6-a44a-4cc5-961f-41f6b265a8b1 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:58.246352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d658f9f6-a44a-4cc5-961f-41f6b265a8b1 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:58.247553 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d658f9f6-a44a-4cc5-961f-41f6b265a8b1 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] 10.222.0.50 "GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df" status: 200 len: 1366 microversion: 2.47 time: 0.184758 Oct 24 10:42:58.248246 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2000/4034] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:58 2022] GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:58.349286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-98d09859-dfc9-440a-8ef2-b89d66277617 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:42:58.349857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-98d09859-dfc9-440a-8ef2-b89d66277617 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:42:58.350168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-98d09859-dfc9-440a-8ef2-b89d66277617 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:42:58.350576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-98d09859-dfc9-440a-8ef2-b89d66277617 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:42:58.350984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-98d09859-dfc9-440a-8ef2-b89d66277617 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:42:58.363865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98d09859-dfc9-440a-8ef2-b89d66277617 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:58.364680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98d09859-dfc9-440a-8ef2-b89d66277617 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:58.365298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98d09859-dfc9-440a-8ef2-b89d66277617 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:58.366220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98d09859-dfc9-440a-8ef2-b89d66277617 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:58.366832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98d09859-dfc9-440a-8ef2-b89d66277617 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:58.367442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98d09859-dfc9-440a-8ef2-b89d66277617 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:58.391017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-98d09859-dfc9-440a-8ef2-b89d66277617 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Getting quotas for project 886ae7eabe82421ca19e5cd59630e961. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:42:58.398563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-98d09859-dfc9-440a-8ef2-b89d66277617 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Getting quotas for user bf908b0f4e444157a0f28e84de8f8555 and project 886ae7eabe82421ca19e5cd59630e961. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:42:58.421296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-98d09859-dfc9-440a-8ef2-b89d66277617 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:42:58.425273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-98d09859-dfc9-440a-8ef2-b89d66277617 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:42:58.514375 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-98d09859-dfc9-440a-8ef2-b89d66277617 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.683599 Oct 24 10:42:58.525150 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2035/4035] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Oct 24 10:42:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 2695 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 10:42:58.530331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-67e0ab86-4487-492e-95d3-beb49d99760d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:58.532399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-67e0ab86-4487-492e-95d3-beb49d99760d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:58.723470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-67e0ab86-4487-492e-95d3-beb49d99760d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:58.733750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-67e0ab86-4487-492e-95d3-beb49d99760d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:58.735881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-67e0ab86-4487-492e-95d3-beb49d99760d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:58.737817 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-67e0ab86-4487-492e-95d3-beb49d99760d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1281 microversion: 2.20 time: 0.210830 Oct 24 10:42:58.738989 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2001/4036] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:58 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1281 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:42:59.305162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b057ef8c-6e39-4004-aac1-51010e4086d3 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:59.318797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b057ef8c-6e39-4004-aac1-51010e4086d3 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] [instance: 57495eaf-c97b-4afc-92e3-5e345bef58df] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:59.343514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b057ef8c-6e39-4004-aac1-51010e4086d3 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:59.345050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b057ef8c-6e39-4004-aac1-51010e4086d3 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:59.345619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b057ef8c-6e39-4004-aac1-51010e4086d3 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:59.347535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b057ef8c-6e39-4004-aac1-51010e4086d3 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:59.348141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b057ef8c-6e39-4004-aac1-51010e4086d3 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:59.348708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b057ef8c-6e39-4004-aac1-51010e4086d3 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:59.474433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b057ef8c-6e39-4004-aac1-51010e4086d3 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:59.486575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b057ef8c-6e39-4004-aac1-51010e4086d3 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:59.489352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b057ef8c-6e39-4004-aac1-51010e4086d3 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:59.490884 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b057ef8c-6e39-4004-aac1-51010e4086d3 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] 10.222.0.50 "GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df" status: 200 len: 1366 microversion: 2.47 time: 0.213421 Oct 24 10:42:59.526078 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2036/4037] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:59 2022] GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:42:59.767644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-99b6785f-022c-4aa3-ae97-ea087724a73c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:59.769380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-99b6785f-022c-4aa3-ae97-ea087724a73c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:42:59.794387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99b6785f-022c-4aa3-ae97-ea087724a73c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:59.797724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99b6785f-022c-4aa3-ae97-ea087724a73c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:59.800393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99b6785f-022c-4aa3-ae97-ea087724a73c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:59.801786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99b6785f-022c-4aa3-ae97-ea087724a73c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:59.805485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99b6785f-022c-4aa3-ae97-ea087724a73c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:59.808106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-99b6785f-022c-4aa3-ae97-ea087724a73c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:59.879598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7cf1db54-535a-48f0-8640-85f921469338 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:42:59.885639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7cf1db54-535a-48f0-8640-85f921469338 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:59.886640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7cf1db54-535a-48f0-8640-85f921469338 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Searching by: {'deleted': False, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:42:59.894581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cf1db54-535a-48f0-8640-85f921469338 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:59.895074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cf1db54-535a-48f0-8640-85f921469338 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:59.895513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cf1db54-535a-48f0-8640-85f921469338 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:59.896437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cf1db54-535a-48f0-8640-85f921469338 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:42:59.896928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cf1db54-535a-48f0-8640-85f921469338 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:42:59.897359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cf1db54-535a-48f0-8640-85f921469338 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:42:59.934389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-7cf1db54-535a-48f0-8640-85f921469338 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:42:59.969299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-99b6785f-022c-4aa3-ae97-ea087724a73c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:59.975331 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7cf1db54-535a-48f0-8640-85f921469338 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.100419 Oct 24 10:42:59.976441 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2037/4038] 10.222.0.50 () {58 vars in 1125 bytes} [Mon Oct 24 10:42:59 2022] GET /compute/v2.1/servers => generated 344 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:42:59.984019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-99b6785f-022c-4aa3-ae97-ea087724a73c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:59.985554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-99b6785f-022c-4aa3-ae97-ea087724a73c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:42:59.990629 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-99b6785f-022c-4aa3-ae97-ea087724a73c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1333 microversion: 2.20 time: 0.223161 Oct 24 10:43:00.015654 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2002/4039] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:42:59 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1333 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:00.087801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5e05b590-1ce8-4c8e-b7cf-6ee14199d1b5 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:00.107409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5e05b590-1ce8-4c8e-b7cf-6ee14199d1b5 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:00.108548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5e05b590-1ce8-4c8e-b7cf-6ee14199d1b5 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Searching by: {'deleted': False, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:43:00.137093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e05b590-1ce8-4c8e-b7cf-6ee14199d1b5 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:00.137093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e05b590-1ce8-4c8e-b7cf-6ee14199d1b5 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:00.139809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e05b590-1ce8-4c8e-b7cf-6ee14199d1b5 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:00.140605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e05b590-1ce8-4c8e-b7cf-6ee14199d1b5 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:00.141129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e05b590-1ce8-4c8e-b7cf-6ee14199d1b5 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:00.141572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e05b590-1ce8-4c8e-b7cf-6ee14199d1b5 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:00.228471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-5e05b590-1ce8-4c8e-b7cf-6ee14199d1b5 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:43:00.302840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5e05b590-1ce8-4c8e-b7cf-6ee14199d1b5 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:00.311787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e05b590-1ce8-4c8e-b7cf-6ee14199d1b5 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:00.312646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e05b590-1ce8-4c8e-b7cf-6ee14199d1b5 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:00.313391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e05b590-1ce8-4c8e-b7cf-6ee14199d1b5 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:00.523041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ed940836-69ac-49a9-93dc-ab1ab6fa6cf8 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:00.523925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ed940836-69ac-49a9-93dc-ab1ab6fa6cf8 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] [instance: 57495eaf-c97b-4afc-92e3-5e345bef58df] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:00.531459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:00.535625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed940836-69ac-49a9-93dc-ab1ab6fa6cf8 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:00.536723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed940836-69ac-49a9-93dc-ab1ab6fa6cf8 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:00.538015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed940836-69ac-49a9-93dc-ab1ab6fa6cf8 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:00.538912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed940836-69ac-49a9-93dc-ab1ab6fa6cf8 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:00.539669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed940836-69ac-49a9-93dc-ab1ab6fa6cf8 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:00.540810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed940836-69ac-49a9-93dc-ab1ab6fa6cf8 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:00.725455 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5e05b590-1ce8-4c8e-b7cf-6ee14199d1b5 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 1602 microversion: 2.1 time: 0.642337 Oct 24 10:43:00.726882 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2038/4040] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:43:00 2022] GET /compute/v2.1/servers/detail => generated 1602 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:00.751215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3ae4ca34-b2e6-40e6-b573-7f04dd744656 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:00.762570 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3ae4ca34-b2e6-40e6-b573-7f04dd744656 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015206 Oct 24 10:43:00.763184 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2039/4041] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:43:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:43:00.768761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ed940836-69ac-49a9-93dc-ab1ab6fa6cf8 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:00.780522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ed940836-69ac-49a9-93dc-ab1ab6fa6cf8 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:00.787265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ed940836-69ac-49a9-93dc-ab1ab6fa6cf8 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:00.791501 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ed940836-69ac-49a9-93dc-ab1ab6fa6cf8 tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] 10.222.0.50 "GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df" status: 200 len: 1366 microversion: 2.47 time: 0.274235 Oct 24 10:43:00.795009 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2003/4042] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:00 2022] GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:01.024391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f71d2c67-3605-4f2f-adda-fdc9fe2f0cde tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:01.025599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f71d2c67-3605-4f2f-adda-fdc9fe2f0cde tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:01.042927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f71d2c67-3605-4f2f-adda-fdc9fe2f0cde tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:01.048027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f71d2c67-3605-4f2f-adda-fdc9fe2f0cde tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:01.052357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f71d2c67-3605-4f2f-adda-fdc9fe2f0cde tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:01.055715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f71d2c67-3605-4f2f-adda-fdc9fe2f0cde tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:01.056880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f71d2c67-3605-4f2f-adda-fdc9fe2f0cde tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:01.059800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f71d2c67-3605-4f2f-adda-fdc9fe2f0cde tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:01.084936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-756ce802-7a51-4f66-8003-c4fdfd266a87 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:01.085449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-756ce802-7a51-4f66-8003-c4fdfd266a87 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:01.093623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-756ce802-7a51-4f66-8003-c4fdfd266a87 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:01.096641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-756ce802-7a51-4f66-8003-c4fdfd266a87 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:01.097342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-756ce802-7a51-4f66-8003-c4fdfd266a87 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:01.100196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-756ce802-7a51-4f66-8003-c4fdfd266a87 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:01.101100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-756ce802-7a51-4f66-8003-c4fdfd266a87 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:01.102605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-756ce802-7a51-4f66-8003-c4fdfd266a87 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:01.157405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-756ce802-7a51-4f66-8003-c4fdfd266a87 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:43:01.276707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f71d2c67-3605-4f2f-adda-fdc9fe2f0cde tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:01.313494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:01.314964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f71d2c67-3605-4f2f-adda-fdc9fe2f0cde tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:01.323698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f71d2c67-3605-4f2f-adda-fdc9fe2f0cde tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:01.330431 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f71d2c67-3605-4f2f-adda-fdc9fe2f0cde tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1339 microversion: 2.20 time: 0.309889 Oct 24 10:43:01.367675 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2040/4043] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:01 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1339 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:01.396909 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-756ce802-7a51-4f66-8003-c4fdfd266a87 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "DELETE /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 204 len: 0 microversion: 2.1 time: 0.316318 Oct 24 10:43:01.397696 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2004/4044] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:43:01 2022] DELETE /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 10:43:01.406510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-93db5dc3-f670-4b5f-a80b-d06c80b1d37d tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:01.407360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-93db5dc3-f670-4b5f-a80b-d06c80b1d37d tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:01.415587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93db5dc3-f670-4b5f-a80b-d06c80b1d37d tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:01.416434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93db5dc3-f670-4b5f-a80b-d06c80b1d37d tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:01.417201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93db5dc3-f670-4b5f-a80b-d06c80b1d37d tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:01.418069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93db5dc3-f670-4b5f-a80b-d06c80b1d37d tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:01.419412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93db5dc3-f670-4b5f-a80b-d06c80b1d37d tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:01.420173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93db5dc3-f670-4b5f-a80b-d06c80b1d37d tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:01.824526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-45958fbb-894f-481e-b0a4-849be7630b8b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:01.825473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-45958fbb-894f-481e-b0a4-849be7630b8b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] [instance: 57495eaf-c97b-4afc-92e3-5e345bef58df] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:01.837965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45958fbb-894f-481e-b0a4-849be7630b8b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:01.840318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45958fbb-894f-481e-b0a4-849be7630b8b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:01.841176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45958fbb-894f-481e-b0a4-849be7630b8b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:01.842249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45958fbb-894f-481e-b0a4-849be7630b8b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:01.842887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45958fbb-894f-481e-b0a4-849be7630b8b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:01.843482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45958fbb-894f-481e-b0a4-849be7630b8b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:01.995552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-45958fbb-894f-481e-b0a4-849be7630b8b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:02.008439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-45958fbb-894f-481e-b0a4-849be7630b8b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:02.010665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-45958fbb-894f-481e-b0a4-849be7630b8b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:02.012640 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-45958fbb-894f-481e-b0a4-849be7630b8b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] 10.222.0.50 "GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df" status: 200 len: 1366 microversion: 2.47 time: 0.192779 Oct 24 10:43:02.013893 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2005/4045] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:01 2022] GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:43:02.102997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-93db5dc3-f670-4b5f-a80b-d06c80b1d37d tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:02.114018 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-93db5dc3-f670-4b5f-a80b-d06c80b1d37d tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1605 microversion: 2.1 time: 0.711539 Oct 24 10:43:02.115298 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2041/4046] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:01 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1605 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:02.361301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9f078acb-7592-46e2-85d7-041056743d55 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:02.363872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9f078acb-7592-46e2-85d7-041056743d55 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:02.374986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f078acb-7592-46e2-85d7-041056743d55 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:02.375753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f078acb-7592-46e2-85d7-041056743d55 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:02.376403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f078acb-7592-46e2-85d7-041056743d55 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:02.378718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f078acb-7592-46e2-85d7-041056743d55 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:02.379524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f078acb-7592-46e2-85d7-041056743d55 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:02.380345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f078acb-7592-46e2-85d7-041056743d55 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:02.668951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9f078acb-7592-46e2-85d7-041056743d55 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:02.679635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9f078acb-7592-46e2-85d7-041056743d55 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:02.686163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9f078acb-7592-46e2-85d7-041056743d55 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:02.693863 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9f078acb-7592-46e2-85d7-041056743d55 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1407 microversion: 2.20 time: 0.332062 Oct 24 10:43:02.694868 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2006/4047] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:02 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:03.042410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-578968c3-e21b-49c9-9581-9eee169bc48b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:03.043227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-578968c3-e21b-49c9-9581-9eee169bc48b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] [instance: 57495eaf-c97b-4afc-92e3-5e345bef58df] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:03.059197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-578968c3-e21b-49c9-9581-9eee169bc48b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:03.059815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-578968c3-e21b-49c9-9581-9eee169bc48b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:03.060347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-578968c3-e21b-49c9-9581-9eee169bc48b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:03.061193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-578968c3-e21b-49c9-9581-9eee169bc48b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:03.061735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-578968c3-e21b-49c9-9581-9eee169bc48b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:03.062582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-578968c3-e21b-49c9-9581-9eee169bc48b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:03.140773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-69be47de-cb28-4c46-adde-3fb1ac2165b2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:03.142265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-69be47de-cb28-4c46-adde-3fb1ac2165b2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:03.155535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69be47de-cb28-4c46-adde-3fb1ac2165b2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:03.156627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69be47de-cb28-4c46-adde-3fb1ac2165b2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:03.157259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69be47de-cb28-4c46-adde-3fb1ac2165b2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:03.158137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69be47de-cb28-4c46-adde-3fb1ac2165b2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:03.160926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69be47de-cb28-4c46-adde-3fb1ac2165b2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:03.161621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-69be47de-cb28-4c46-adde-3fb1ac2165b2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:03.333637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-578968c3-e21b-49c9-9581-9eee169bc48b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:03.350093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-578968c3-e21b-49c9-9581-9eee169bc48b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:03.354315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-578968c3-e21b-49c9-9581-9eee169bc48b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e845ff0d0d2476bbfa25c770cb63ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937d42ef3893417bb448af9f20dbc315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:03.357517 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-578968c3-e21b-49c9-9581-9eee169bc48b tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] 10.222.0.50 "GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df" status: 200 len: 1366 microversion: 2.47 time: 0.318879 Oct 24 10:43:03.361622 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2042/4048] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:03 2022] GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:03.530291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-69be47de-cb28-4c46-adde-3fb1ac2165b2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:03.539902 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-69be47de-cb28-4c46-adde-3fb1ac2165b2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1605 microversion: 2.1 time: 0.403337 Oct 24 10:43:03.541179 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2007/4049] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:03 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1605 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:03.725259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0062720f-462d-45c6-9807-710c21dee9a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:03.725923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0062720f-462d-45c6-9807-710c21dee9a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:03.746585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0062720f-462d-45c6-9807-710c21dee9a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:03.746816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0062720f-462d-45c6-9807-710c21dee9a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:03.747088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0062720f-462d-45c6-9807-710c21dee9a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:03.747815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0062720f-462d-45c6-9807-710c21dee9a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:03.748279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0062720f-462d-45c6-9807-710c21dee9a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:03.748712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0062720f-462d-45c6-9807-710c21dee9a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:04.276489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0062720f-462d-45c6-9807-710c21dee9a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:04.285618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0062720f-462d-45c6-9807-710c21dee9a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:04.292506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0062720f-462d-45c6-9807-710c21dee9a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:04.293804 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0062720f-462d-45c6-9807-710c21dee9a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1407 microversion: 2.20 time: 0.576675 Oct 24 10:43:04.294451 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2043/4050] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:03 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1407 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:04.388880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d70a0339-bc0a-4d91-93e5-97623d32490f tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:04.389669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d70a0339-bc0a-4d91-93e5-97623d32490f tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] [instance: 57495eaf-c97b-4afc-92e3-5e345bef58df] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:04.396938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d70a0339-bc0a-4d91-93e5-97623d32490f tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:04.404398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d70a0339-bc0a-4d91-93e5-97623d32490f tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:04.405021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d70a0339-bc0a-4d91-93e5-97623d32490f tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:04.405889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d70a0339-bc0a-4d91-93e5-97623d32490f tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:04.406590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d70a0339-bc0a-4d91-93e5-97623d32490f tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:04.407237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d70a0339-bc0a-4d91-93e5-97623d32490f tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:04.436141 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-d70a0339-bc0a-4d91-93e5-97623d32490f tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] HTTP exception thrown: Instance 57495eaf-c97b-4afc-92e3-5e345bef58df could not be found. Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d70a0339-bc0a-4d91-93e5-97623d32490f tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Request method failure captured: Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df HTTP/1.1 Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmwpttKMIiDpDQY9X2wQwvbyIid4l7M7-Ty9G0YsOh2rRl9J88w47VB3ScDwcprsoGmhxQR_GPxUqVve9yFcWQ2jt6jiJKp7EPbPnPsH7UrCvtTXS8aAmGzly7Yy3njee6HHOw21mtPOKxPgynqEMbspfuMnU3LmFdfVgC-7-18LAw0 Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.47 Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 937d42ef3893417bb448af9f20dbc315 Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersAaction247Test-23994340 Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/937d42ef3893417bb448af9f20dbc315"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/937d42ef3893417bb448af9f20dbc315"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/937d42ef3893417bb448af9f20dbc315"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_937d42ef3893417bb448af9f20dbc315", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersAaction247Test-23994340 Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 937d42ef3893417bb448af9f20dbc315 Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersAaction247Test-23994340 Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersAaction247Test-23994340-project Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5e845ff0d0d2476bbfa25c770cb63ee1 Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersAaction247Test-23994340-project Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 57495eaf-c97b-4afc-92e3-5e345bef58df could not be found. Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '57495eaf-c97b-4afc-92e3-5e345bef58df'} Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57495eaf-c97b-4afc-92e3-5e345bef58df could not be found. Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57495eaf-c97b-4afc-92e3-5e345bef58df could not be found. Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:43:04.438742 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:43:04.443014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:43:04.443014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:43:04.443014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:43:04.443014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:43:04.443014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:43:04.443014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57495eaf-c97b-4afc-92e3-5e345bef58df could not be found. Oct 24 10:43:04.443014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:43:04.445260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d70a0339-bc0a-4d91-93e5-97623d32490f tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] Returning 404 to user: Instance 57495eaf-c97b-4afc-92e3-5e345bef58df could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:43:04.446747 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d70a0339-bc0a-4d91-93e5-97623d32490f tempest-ServersAaction247Test-23994340 tempest-ServersAaction247Test-23994340-project] 10.222.0.50 "GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df" status: 404 len: 111 microversion: 2.47 time: 0.061791 Oct 24 10:43:04.452654 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2008/4051] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:04 2022] GET /compute/v2.1/servers/57495eaf-c97b-4afc-92e3-5e345bef58df => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:43:04.576599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-facb11bb-7161-4002-a521-51539c840c21 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:04.582081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-facb11bb-7161-4002-a521-51539c840c21 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:04.584637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:04.603022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-facb11bb-7161-4002-a521-51539c840c21 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:04.607525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-facb11bb-7161-4002-a521-51539c840c21 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:04.608649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-facb11bb-7161-4002-a521-51539c840c21 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:04.609596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-facb11bb-7161-4002-a521-51539c840c21 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:04.614942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-facb11bb-7161-4002-a521-51539c840c21 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:04.616331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-facb11bb-7161-4002-a521-51539c840c21 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:05.323760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7467c96c-3929-4f37-9169-6a885fa635bd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:05.324631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7467c96c-3929-4f37-9169-6a885fa635bd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:05.333626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7467c96c-3929-4f37-9169-6a885fa635bd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:05.337394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7467c96c-3929-4f37-9169-6a885fa635bd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:05.338075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7467c96c-3929-4f37-9169-6a885fa635bd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:05.338986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7467c96c-3929-4f37-9169-6a885fa635bd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:05.341743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7467c96c-3929-4f37-9169-6a885fa635bd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:05.342938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7467c96c-3929-4f37-9169-6a885fa635bd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:05.445415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-facb11bb-7161-4002-a521-51539c840c21 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:05.461737 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-facb11bb-7161-4002-a521-51539c840c21 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1605 microversion: 2.1 time: 0.897745 Oct 24 10:43:05.470829 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2044/4052] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:04 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1605 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:05.492618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-7b79bc37-7b41-4d56-9164-c3a49b29598c req-2d7a2b26-d318-4c23-a6e2-4d7852674de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6eb3578-42ca-4dc5-b31a-e5500aa94f2e", "tag": "36f88fb2-6faf-4282-bd23-d4f02a3206ca"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:05.516572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7b79bc37-7b41-4d56-9164-c3a49b29598c req-2d7a2b26-d318-4c23-a6e2-4d7852674de1 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:05.517213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7b79bc37-7b41-4d56-9164-c3a49b29598c req-2d7a2b26-d318-4c23-a6e2-4d7852674de1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:05.519135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7b79bc37-7b41-4d56-9164-c3a49b29598c req-2d7a2b26-d318-4c23-a6e2-4d7852674de1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:05.544515 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-7b79bc37-7b41-4d56-9164-c3a49b29598c req-2d7a2b26-d318-4c23-a6e2-4d7852674de1 service nova] Creating event network-changed:36f88fb2-6faf-4282-bd23-d4f02a3206ca for instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e on n-h2-858383-15 Oct 24 10:43:05.556882 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-7b79bc37-7b41-4d56-9164-c3a49b29598c req-2d7a2b26-d318-4c23-a6e2-4d7852674de1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082357 Oct 24 10:43:05.557614 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2045/4053] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:43:06.006554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7467c96c-3929-4f37-9169-6a885fa635bd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:06.022253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7467c96c-3929-4f37-9169-6a885fa635bd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:06.030758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7467c96c-3929-4f37-9169-6a885fa635bd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:06.032376 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7467c96c-3929-4f37-9169-6a885fa635bd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1407 microversion: 2.20 time: 0.712544 Oct 24 10:43:06.034840 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2009/4054] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:05 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1407 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:06.497361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-22ce2298-d7a1-4da5-a198-ff3a5adf9a37 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:06.514519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-22ce2298-d7a1-4da5-a198-ff3a5adf9a37 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:06.534783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22ce2298-d7a1-4da5-a198-ff3a5adf9a37 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:06.535346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22ce2298-d7a1-4da5-a198-ff3a5adf9a37 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:06.535976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22ce2298-d7a1-4da5-a198-ff3a5adf9a37 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:06.537052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22ce2298-d7a1-4da5-a198-ff3a5adf9a37 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:06.539598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22ce2298-d7a1-4da5-a198-ff3a5adf9a37 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:06.540590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22ce2298-d7a1-4da5-a198-ff3a5adf9a37 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:06.786663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-22ce2298-d7a1-4da5-a198-ff3a5adf9a37 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:06.802976 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-22ce2298-d7a1-4da5-a198-ff3a5adf9a37 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1537 microversion: 2.1 time: 0.305498 Oct 24 10:43:06.817745 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2046/4055] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:06 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1537 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:07.063042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b3a5da12-8427-4ef1-8da2-f78b59da429f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:07.063844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b3a5da12-8427-4ef1-8da2-f78b59da429f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:07.080024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3a5da12-8427-4ef1-8da2-f78b59da429f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:07.081319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3a5da12-8427-4ef1-8da2-f78b59da429f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:07.082738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3a5da12-8427-4ef1-8da2-f78b59da429f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:07.085334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3a5da12-8427-4ef1-8da2-f78b59da429f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:07.087660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3a5da12-8427-4ef1-8da2-f78b59da429f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:07.088349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3a5da12-8427-4ef1-8da2-f78b59da429f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:07.765652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-46816aed-bbd3-43ed-8e3d-4e178de797fc req-b13bee76-4b92-4931-852b-223842679780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee981b9-6221-467f-bce3-e911488983ad", "name": "network-vif-deleted", "tag": "7c636450-35fa-4e6c-861a-6b258e553318"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:07.823184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-46816aed-bbd3-43ed-8e3d-4e178de797fc req-b13bee76-4b92-4931-852b-223842679780 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:07.823840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-46816aed-bbd3-43ed-8e3d-4e178de797fc req-b13bee76-4b92-4931-852b-223842679780 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:07.825260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-46816aed-bbd3-43ed-8e3d-4e178de797fc req-b13bee76-4b92-4931-852b-223842679780 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:07.863751 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-46816aed-bbd3-43ed-8e3d-4e178de797fc req-b13bee76-4b92-4931-852b-223842679780 service nova] Creating event network-vif-deleted:7c636450-35fa-4e6c-861a-6b258e553318 for instance cee981b9-6221-467f-bce3-e911488983ad on n-h2-858383-15 Oct 24 10:43:07.867636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b3a5da12-8427-4ef1-8da2-f78b59da429f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:07.874560 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-46816aed-bbd3-43ed-8e3d-4e178de797fc req-b13bee76-4b92-4931-852b-223842679780 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118734 Oct 24 10:43:07.878941 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2047/4056] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:43:07.885816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b3a5da12-8427-4ef1-8da2-f78b59da429f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:07.890659 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b3a5da12-8427-4ef1-8da2-f78b59da429f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:07.894531 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b3a5da12-8427-4ef1-8da2-f78b59da429f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1407 microversion: 2.20 time: 0.836071 Oct 24 10:43:07.912923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-91c2e794-96be-4de5-8fa9-e85ac68e1e42 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:07.913284 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2010/4057] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:07 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1407 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:07.913396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-91c2e794-96be-4de5-8fa9-e85ac68e1e42 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:07.917563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91c2e794-96be-4de5-8fa9-e85ac68e1e42 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:07.921330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91c2e794-96be-4de5-8fa9-e85ac68e1e42 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:07.922365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91c2e794-96be-4de5-8fa9-e85ac68e1e42 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:07.923286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91c2e794-96be-4de5-8fa9-e85ac68e1e42 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:07.928747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91c2e794-96be-4de5-8fa9-e85ac68e1e42 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:07.946535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91c2e794-96be-4de5-8fa9-e85ac68e1e42 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:07.993120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:08.143544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-91c2e794-96be-4de5-8fa9-e85ac68e1e42 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:08.173701 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-91c2e794-96be-4de5-8fa9-e85ac68e1e42 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1250 microversion: 2.1 time: 0.291581 Oct 24 10:43:08.175625 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2048/4058] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:07 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1250 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:08.926706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ba0673fe-0ca4-42f5-b572-9b049dfe8b2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:08.927936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ba0673fe-0ca4-42f5-b572-9b049dfe8b2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:08.945824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:08.949488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba0673fe-0ca4-42f5-b572-9b049dfe8b2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:08.950011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba0673fe-0ca4-42f5-b572-9b049dfe8b2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:08.961925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba0673fe-0ca4-42f5-b572-9b049dfe8b2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:08.962226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba0673fe-0ca4-42f5-b572-9b049dfe8b2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:08.962719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba0673fe-0ca4-42f5-b572-9b049dfe8b2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:08.963163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba0673fe-0ca4-42f5-b572-9b049dfe8b2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:09.218483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-60e40852-3bfa-4b47-b7de-0db8bfe63bc9 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:09.219748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-60e40852-3bfa-4b47-b7de-0db8bfe63bc9 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:09.241876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-60e40852-3bfa-4b47-b7de-0db8bfe63bc9 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:09.242412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-60e40852-3bfa-4b47-b7de-0db8bfe63bc9 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:09.243565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-60e40852-3bfa-4b47-b7de-0db8bfe63bc9 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:09.245665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-60e40852-3bfa-4b47-b7de-0db8bfe63bc9 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:09.247017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-60e40852-3bfa-4b47-b7de-0db8bfe63bc9 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:09.248792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-60e40852-3bfa-4b47-b7de-0db8bfe63bc9 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:09.552825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-60e40852-3bfa-4b47-b7de-0db8bfe63bc9 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:09.562495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ba0673fe-0ca4-42f5-b572-9b049dfe8b2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:09.563333 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-60e40852-3bfa-4b47-b7de-0db8bfe63bc9 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1250 microversion: 2.1 time: 0.360961 Oct 24 10:43:09.563936 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2049/4059] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:09 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1250 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:09.587767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ba0673fe-0ca4-42f5-b572-9b049dfe8b2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:09.590073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ba0673fe-0ca4-42f5-b572-9b049dfe8b2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:09.591499 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ba0673fe-0ca4-42f5-b572-9b049dfe8b2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1407 microversion: 2.20 time: 0.668872 Oct 24 10:43:09.592953 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2011/4060] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:08 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1407 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:09.868807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2c13917a-30ea-4725-8818-c9b887bf93f2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1991789945", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "734fc132-fff0-4bf7-9775-3a17fdcd25dc"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:09.963384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-2c13917a-30ea-4725-8818-c9b887bf93f2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] validate_networks() for [('734fc132-fff0-4bf7-9775-3a17fdcd25dc', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:43:10.170076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:10.296290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=10 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:10.592414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-160617f1-6a65-450b-8b86-6ee1f547dc6b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:10.593671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-160617f1-6a65-450b-8b86-6ee1f547dc6b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:10.621413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-160617f1-6a65-450b-8b86-6ee1f547dc6b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:10.621413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-160617f1-6a65-450b-8b86-6ee1f547dc6b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:10.621831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-160617f1-6a65-450b-8b86-6ee1f547dc6b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:10.629348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-160617f1-6a65-450b-8b86-6ee1f547dc6b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:10.629892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-160617f1-6a65-450b-8b86-6ee1f547dc6b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:10.631391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-160617f1-6a65-450b-8b86-6ee1f547dc6b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:10.850102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-160617f1-6a65-450b-8b86-6ee1f547dc6b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:10.865301 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-160617f1-6a65-450b-8b86-6ee1f547dc6b tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1250 microversion: 2.1 time: 0.277358 Oct 24 10:43:10.866534 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2012/4061] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:10 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1250 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:43:10.875264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d03607ab-83e0-4b25-bddd-51cb0146d7d8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:10.879187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d03607ab-83e0-4b25-bddd-51cb0146d7d8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:10.905548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d03607ab-83e0-4b25-bddd-51cb0146d7d8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:10.906086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d03607ab-83e0-4b25-bddd-51cb0146d7d8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:10.906544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d03607ab-83e0-4b25-bddd-51cb0146d7d8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:10.907299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d03607ab-83e0-4b25-bddd-51cb0146d7d8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:10.907863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d03607ab-83e0-4b25-bddd-51cb0146d7d8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:10.908299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d03607ab-83e0-4b25-bddd-51cb0146d7d8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:11.485691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d03607ab-83e0-4b25-bddd-51cb0146d7d8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:11.500117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d03607ab-83e0-4b25-bddd-51cb0146d7d8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:11.502036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d03607ab-83e0-4b25-bddd-51cb0146d7d8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:11.503661 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d03607ab-83e0-4b25-bddd-51cb0146d7d8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1407 microversion: 2.20 time: 0.635776 Oct 24 10:43:11.504983 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2013/4062] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:10 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1407 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:11.567318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-2c13917a-30ea-4725-8818-c9b887bf93f2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:43:11.567749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-2c13917a-30ea-4725-8818-c9b887bf93f2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:43:11.568373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-2c13917a-30ea-4725-8818-c9b887bf93f2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:43:11.568789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-2c13917a-30ea-4725-8818-c9b887bf93f2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:43:11.569259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-2c13917a-30ea-4725-8818-c9b887bf93f2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:43:11.597791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c13917a-30ea-4725-8818-c9b887bf93f2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:11.598284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c13917a-30ea-4725-8818-c9b887bf93f2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:11.598736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c13917a-30ea-4725-8818-c9b887bf93f2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:11.599488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c13917a-30ea-4725-8818-c9b887bf93f2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:11.599949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c13917a-30ea-4725-8818-c9b887bf93f2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:11.600376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c13917a-30ea-4725-8818-c9b887bf93f2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:11.671521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-2c13917a-30ea-4725-8818-c9b887bf93f2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Getting quotas for project 9ab3028765ba447589bf595a603ea2e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:43:11.699563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-2c13917a-30ea-4725-8818-c9b887bf93f2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Getting quotas for user ed058a5e8ac14236ab2e8783e9170346 and project 9ab3028765ba447589bf595a603ea2e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:43:11.731208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2c13917a-30ea-4725-8818-c9b887bf93f2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:43:11.734213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2c13917a-30ea-4725-8818-c9b887bf93f2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:43:11.829585 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2c13917a-30ea-4725-8818-c9b887bf93f2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.264528 Oct 24 10:43:11.842651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3cb86a3e-b8c3-459c-ab8a-dc5e5c63221e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:11.843158 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2050/4063] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:43:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:43:11.844032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3cb86a3e-b8c3-459c-ab8a-dc5e5c63221e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:11.894765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-76a49050-00cb-466f-b14f-0d104e296207 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:11.895391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-76a49050-00cb-466f-b14f-0d104e296207 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:11.915597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a49050-00cb-466f-b14f-0d104e296207 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:11.916140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a49050-00cb-466f-b14f-0d104e296207 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:11.916594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a49050-00cb-466f-b14f-0d104e296207 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:11.917366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a49050-00cb-466f-b14f-0d104e296207 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:11.917828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a49050-00cb-466f-b14f-0d104e296207 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:11.918256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a49050-00cb-466f-b14f-0d104e296207 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:12.079026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3cb86a3e-b8c3-459c-ab8a-dc5e5c63221e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:12.090711 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3cb86a3e-b8c3-459c-ab8a-dc5e5c63221e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1193 microversion: 2.1 time: 0.251691 Oct 24 10:43:12.106921 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2014/4064] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:11 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1193 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:43:12.119033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-76a49050-00cb-466f-b14f-0d104e296207 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:12.135924 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-76a49050-00cb-466f-b14f-0d104e296207 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1250 microversion: 2.1 time: 0.248610 Oct 24 10:43:12.137518 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2051/4065] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:11 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1250 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:12.530613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-04c73b5e-8fe9-4a7b-a81e-d58302408f86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:12.531239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-04c73b5e-8fe9-4a7b-a81e-d58302408f86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:12.546320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04c73b5e-8fe9-4a7b-a81e-d58302408f86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:12.546813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04c73b5e-8fe9-4a7b-a81e-d58302408f86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:12.547209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04c73b5e-8fe9-4a7b-a81e-d58302408f86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:12.548026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04c73b5e-8fe9-4a7b-a81e-d58302408f86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:12.559386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04c73b5e-8fe9-4a7b-a81e-d58302408f86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:12.561347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04c73b5e-8fe9-4a7b-a81e-d58302408f86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:13.135671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-919ff06a-3e43-49a8-a2b5-45bf076ae80a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:13.137114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-919ff06a-3e43-49a8-a2b5-45bf076ae80a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:13.152147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-919ff06a-3e43-49a8-a2b5-45bf076ae80a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:13.153017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-919ff06a-3e43-49a8-a2b5-45bf076ae80a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:13.153672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-919ff06a-3e43-49a8-a2b5-45bf076ae80a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:13.163660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-919ff06a-3e43-49a8-a2b5-45bf076ae80a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:13.164461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-919ff06a-3e43-49a8-a2b5-45bf076ae80a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:13.165156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-919ff06a-3e43-49a8-a2b5-45bf076ae80a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:13.500743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-919ff06a-3e43-49a8-a2b5-45bf076ae80a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:13.510961 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-919ff06a-3e43-49a8-a2b5-45bf076ae80a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1189 microversion: 2.1 time: 0.392304 Oct 24 10:43:13.514968 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2052/4066] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:13 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1189 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:13.527318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-99914602-f000-4a94-b47c-f05511676da2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:13.530243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-99914602-f000-4a94-b47c-f05511676da2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:13.546249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99914602-f000-4a94-b47c-f05511676da2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:13.547434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99914602-f000-4a94-b47c-f05511676da2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:13.549966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99914602-f000-4a94-b47c-f05511676da2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:13.552018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99914602-f000-4a94-b47c-f05511676da2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:13.554762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99914602-f000-4a94-b47c-f05511676da2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:13.557548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99914602-f000-4a94-b47c-f05511676da2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:13.821455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-99914602-f000-4a94-b47c-f05511676da2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:13.830885 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-99914602-f000-4a94-b47c-f05511676da2 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1250 microversion: 2.1 time: 0.312755 Oct 24 10:43:13.831478 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2053/4067] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:13 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1250 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:13.930416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-04c73b5e-8fe9-4a7b-a81e-d58302408f86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:13.939420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-04c73b5e-8fe9-4a7b-a81e-d58302408f86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:13.941317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-04c73b5e-8fe9-4a7b-a81e-d58302408f86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:13.942440 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-04c73b5e-8fe9-4a7b-a81e-d58302408f86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1407 microversion: 2.20 time: 1.417040 Oct 24 10:43:13.954516 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2015/4068] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:12 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1407 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:14.542302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aa17431d-2def-4625-af69-392487a7bc90 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:14.543306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aa17431d-2def-4625-af69-392487a7bc90 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:14.581764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa17431d-2def-4625-af69-392487a7bc90 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:14.582323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa17431d-2def-4625-af69-392487a7bc90 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:14.582784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa17431d-2def-4625-af69-392487a7bc90 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:14.583539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa17431d-2def-4625-af69-392487a7bc90 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:14.583999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa17431d-2def-4625-af69-392487a7bc90 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:14.584431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa17431d-2def-4625-af69-392487a7bc90 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:14.783611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aa17431d-2def-4625-af69-392487a7bc90 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:14.793452 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aa17431d-2def-4625-af69-392487a7bc90 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1263 microversion: 2.1 time: 0.257706 Oct 24 10:43:14.794754 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2054/4069] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:14 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1263 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:14.857398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-271df52f-e19a-46ab-893e-695666bcb153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:14.858090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-271df52f-e19a-46ab-893e-695666bcb153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:14.872251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-271df52f-e19a-46ab-893e-695666bcb153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:14.873402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-271df52f-e19a-46ab-893e-695666bcb153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:14.876931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-271df52f-e19a-46ab-893e-695666bcb153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:14.877960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-271df52f-e19a-46ab-893e-695666bcb153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:14.878642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-271df52f-e19a-46ab-893e-695666bcb153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:14.879311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-271df52f-e19a-46ab-893e-695666bcb153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:14.976282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8e8df11a-b9cd-4d63-af2a-487bb58e0514 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:14.977029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8e8df11a-b9cd-4d63-af2a-487bb58e0514 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:14.995006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e8df11a-b9cd-4d63-af2a-487bb58e0514 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:14.997556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e8df11a-b9cd-4d63-af2a-487bb58e0514 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:14.998192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e8df11a-b9cd-4d63-af2a-487bb58e0514 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:15.000272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e8df11a-b9cd-4d63-af2a-487bb58e0514 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:15.002524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e8df11a-b9cd-4d63-af2a-487bb58e0514 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:15.004773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e8df11a-b9cd-4d63-af2a-487bb58e0514 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:15.073655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-271df52f-e19a-46ab-893e-695666bcb153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:15.090191 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-271df52f-e19a-46ab-893e-695666bcb153 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1250 microversion: 2.1 time: 0.237857 Oct 24 10:43:15.092802 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2016/4070] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:14 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1250 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:15.146747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-4edd52ac-f828-4ff4-a11f-3c82ad6a77f9 req-5707ce1d-1bf5-49c0-b458-04b32ee85de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6eb3578-42ca-4dc5-b31a-e5500aa94f2e", "name": "network-vif-plugged", "status": "completed", "tag": "36f88fb2-6faf-4282-bd23-d4f02a3206ca"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:15.167258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4edd52ac-f828-4ff4-a11f-3c82ad6a77f9 req-5707ce1d-1bf5-49c0-b458-04b32ee85de4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:15.168852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4edd52ac-f828-4ff4-a11f-3c82ad6a77f9 req-5707ce1d-1bf5-49c0-b458-04b32ee85de4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:15.170931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4edd52ac-f828-4ff4-a11f-3c82ad6a77f9 req-5707ce1d-1bf5-49c0-b458-04b32ee85de4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:15.198036 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-4edd52ac-f828-4ff4-a11f-3c82ad6a77f9 req-5707ce1d-1bf5-49c0-b458-04b32ee85de4 service nova] Creating event network-vif-plugged:36f88fb2-6faf-4282-bd23-d4f02a3206ca for instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e on n-h2-858383-15 Oct 24 10:43:15.210060 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-4edd52ac-f828-4ff4-a11f-3c82ad6a77f9 req-5707ce1d-1bf5-49c0-b458-04b32ee85de4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069987 Oct 24 10:43:15.216668 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2017/4071] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:43:15.820109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-827904bb-55f0-4fac-b2bb-5a865302854c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:15.821031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-827904bb-55f0-4fac-b2bb-5a865302854c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:15.838875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-827904bb-55f0-4fac-b2bb-5a865302854c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:15.839375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-827904bb-55f0-4fac-b2bb-5a865302854c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:15.839822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-827904bb-55f0-4fac-b2bb-5a865302854c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:15.840546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-827904bb-55f0-4fac-b2bb-5a865302854c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:15.841109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-827904bb-55f0-4fac-b2bb-5a865302854c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:15.841542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-827904bb-55f0-4fac-b2bb-5a865302854c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:15.846187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8e8df11a-b9cd-4d63-af2a-487bb58e0514 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:15.858523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8e8df11a-b9cd-4d63-af2a-487bb58e0514 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:15.864080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8e8df11a-b9cd-4d63-af2a-487bb58e0514 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:15.870345 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8e8df11a-b9cd-4d63-af2a-487bb58e0514 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1407 microversion: 2.20 time: 0.898812 Oct 24 10:43:15.871273 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2055/4072] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:14 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1407 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:43:16.002128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-827904bb-55f0-4fac-b2bb-5a865302854c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:16.024923 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-827904bb-55f0-4fac-b2bb-5a865302854c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1251 microversion: 2.1 time: 0.209899 Oct 24 10:43:16.040889 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2018/4073] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:15 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1251 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:43:16.137119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-425c0961-9892-4d90-9836-aa8a3032ca67 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:16.138283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-425c0961-9892-4d90-9836-aa8a3032ca67 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:16.150189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-425c0961-9892-4d90-9836-aa8a3032ca67 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:16.152771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-425c0961-9892-4d90-9836-aa8a3032ca67 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:16.154472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-425c0961-9892-4d90-9836-aa8a3032ca67 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:16.157700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-425c0961-9892-4d90-9836-aa8a3032ca67 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:16.160404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-425c0961-9892-4d90-9836-aa8a3032ca67 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:16.161082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-425c0961-9892-4d90-9836-aa8a3032ca67 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:16.339104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-425c0961-9892-4d90-9836-aa8a3032ca67 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:16.351050 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-425c0961-9892-4d90-9836-aa8a3032ca67 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1250 microversion: 2.1 time: 0.236338 Oct 24 10:43:16.356510 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2056/4074] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:16 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1250 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:16.899070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7d1fccc3-eb50-479f-8436-52499382f018 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:16.899849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7d1fccc3-eb50-479f-8436-52499382f018 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:16.914434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d1fccc3-eb50-479f-8436-52499382f018 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:16.916999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d1fccc3-eb50-479f-8436-52499382f018 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:16.917773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d1fccc3-eb50-479f-8436-52499382f018 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:16.919894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d1fccc3-eb50-479f-8436-52499382f018 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:16.921400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d1fccc3-eb50-479f-8436-52499382f018 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:16.922263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d1fccc3-eb50-479f-8436-52499382f018 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:17.051767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a3af5fd3-6087-426d-8215-83de3ea76a24 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:17.052390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a3af5fd3-6087-426d-8215-83de3ea76a24 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:17.065833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3af5fd3-6087-426d-8215-83de3ea76a24 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:17.068081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3af5fd3-6087-426d-8215-83de3ea76a24 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:17.080669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3af5fd3-6087-426d-8215-83de3ea76a24 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:17.084271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3af5fd3-6087-426d-8215-83de3ea76a24 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:17.089301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3af5fd3-6087-426d-8215-83de3ea76a24 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:17.091495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3af5fd3-6087-426d-8215-83de3ea76a24 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:17.315326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a3af5fd3-6087-426d-8215-83de3ea76a24 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:17.330478 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a3af5fd3-6087-426d-8215-83de3ea76a24 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1251 microversion: 2.1 time: 0.278308 Oct 24 10:43:17.331746 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2057/4075] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:17 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1251 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:43:17.374652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c0e8633a-fb1b-490f-ad7e-eb4b741e5eff tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:17.375550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c0e8633a-fb1b-490f-ad7e-eb4b741e5eff tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:17.394637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0e8633a-fb1b-490f-ad7e-eb4b741e5eff tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:17.395382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0e8633a-fb1b-490f-ad7e-eb4b741e5eff tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:17.395981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0e8633a-fb1b-490f-ad7e-eb4b741e5eff tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:17.396902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0e8633a-fb1b-490f-ad7e-eb4b741e5eff tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:17.397510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0e8633a-fb1b-490f-ad7e-eb4b741e5eff tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:17.398088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0e8633a-fb1b-490f-ad7e-eb4b741e5eff tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:17.467879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0e8633a-fb1b-490f-ad7e-eb4b741e5eff tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:17.470090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0e8633a-fb1b-490f-ad7e-eb4b741e5eff tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:17.470799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0e8633a-fb1b-490f-ad7e-eb4b741e5eff tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:17.473645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-c0e8633a-fb1b-490f-ad7e-eb4b741e5eff tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lazy-loading 'fault' on Instance uuid cee981b9-6221-467f-bce3-e911488983ad {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:43:18.228407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c0e8633a-fb1b-490f-ad7e-eb4b741e5eff tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748e830a51c748ccaedc86a3566af1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc29824130c410e8c2186dc5d4457c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:18.239288 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c0e8633a-fb1b-490f-ad7e-eb4b741e5eff tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 200 len: 1209 microversion: 2.1 time: 0.867366 Oct 24 10:43:18.241561 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2058/4076] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:17 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 1209 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:18.355988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c10b23ab-46ac-4616-bf9d-77d4e0f63db4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:18.357128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c10b23ab-46ac-4616-bf9d-77d4e0f63db4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:18.374514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c10b23ab-46ac-4616-bf9d-77d4e0f63db4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:18.376147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c10b23ab-46ac-4616-bf9d-77d4e0f63db4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:18.378452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c10b23ab-46ac-4616-bf9d-77d4e0f63db4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:18.380569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c10b23ab-46ac-4616-bf9d-77d4e0f63db4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:18.383365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c10b23ab-46ac-4616-bf9d-77d4e0f63db4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:18.384333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c10b23ab-46ac-4616-bf9d-77d4e0f63db4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:18.637815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7d1fccc3-eb50-479f-8436-52499382f018 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:18.653894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7d1fccc3-eb50-479f-8436-52499382f018 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:18.655401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7d1fccc3-eb50-479f-8436-52499382f018 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:18.661420 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7d1fccc3-eb50-479f-8436-52499382f018 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1407 microversion: 2.20 time: 1.762949 Oct 24 10:43:18.662088 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2019/4077] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:16 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1407 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:18.928311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c10b23ab-46ac-4616-bf9d-77d4e0f63db4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:18.948871 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c10b23ab-46ac-4616-bf9d-77d4e0f63db4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1293 microversion: 2.1 time: 0.596936 Oct 24 10:43:18.955124 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2059/4078] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:18 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1293 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:19.147461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80deb238-de27-4bfc-9384-532e59bec2b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:19.148504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-80deb238-de27-4bfc-9384-532e59bec2b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:19.155597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80deb238-de27-4bfc-9384-532e59bec2b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:19.159038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80deb238-de27-4bfc-9384-532e59bec2b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:19.159737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80deb238-de27-4bfc-9384-532e59bec2b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:19.160900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80deb238-de27-4bfc-9384-532e59bec2b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:19.163361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80deb238-de27-4bfc-9384-532e59bec2b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:19.165210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80deb238-de27-4bfc-9384-532e59bec2b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:19.228667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-80deb238-de27-4bfc-9384-532e59bec2b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:43:19.264972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-64bab3fa-b783-462c-8cf5-1aeefa121e2a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:19.265926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-64bab3fa-b783-462c-8cf5-1aeefa121e2a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] [instance: cee981b9-6221-467f-bce3-e911488983ad] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:19.278202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64bab3fa-b783-462c-8cf5-1aeefa121e2a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:19.278699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64bab3fa-b783-462c-8cf5-1aeefa121e2a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:19.279140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64bab3fa-b783-462c-8cf5-1aeefa121e2a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:19.279857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64bab3fa-b783-462c-8cf5-1aeefa121e2a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:19.280309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64bab3fa-b783-462c-8cf5-1aeefa121e2a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:19.280746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64bab3fa-b783-462c-8cf5-1aeefa121e2a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:19.325890 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-64bab3fa-b783-462c-8cf5-1aeefa121e2a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] HTTP exception thrown: Instance cee981b9-6221-467f-bce3-e911488983ad could not be found. Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-64bab3fa-b783-462c-8cf5-1aeefa121e2a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Request method failure captured: Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad HTTP/1.1 Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmuyO0UmtCj6WV_hGGTdC_W6OZAq8yaAMGmqAXI2aLswJFEaHM6oamyZo5pGhzsyqBUH5Vnfmw27AuYmxqO2iLH-AkaqAiVkVMrVI0bOg70U3Tc3-GQQAXAU4qmrU6osmm1M_GYdKSdciFKhbBw6fWXyLpLqLYC_yXxITtV71bLiTzE Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: dbc29824130c410e8c2186dc5d4457c3 Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersTestBootFromVolume-1640240538 Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dbc29824130c410e8c2186dc5d4457c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dbc29824130c410e8c2186dc5d4457c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dbc29824130c410e8c2186dc5d4457c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dbc29824130c410e8c2186dc5d4457c3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersTestBootFromVolume-1640240538 Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: dbc29824130c410e8c2186dc5d4457c3 Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1640240538 Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersTestBootFromVolume-1640240538-project Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 748e830a51c748ccaedc86a3566af1d3 Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersTestBootFromVolume-1640240538-project Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance cee981b9-6221-467f-bce3-e911488983ad could not be found. Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'cee981b9-6221-467f-bce3-e911488983ad'} Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee981b9-6221-467f-bce3-e911488983ad could not be found. Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee981b9-6221-467f-bce3-e911488983ad could not be found. Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:43:19.329949 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:43:19.335889 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:43:19.335889 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:43:19.335889 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:43:19.335889 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:43:19.335889 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:43:19.335889 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee981b9-6221-467f-bce3-e911488983ad could not be found. Oct 24 10:43:19.335889 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:43:19.341367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-64bab3fa-b783-462c-8cf5-1aeefa121e2a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Returning 404 to user: Instance cee981b9-6221-467f-bce3-e911488983ad could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:43:19.344037 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-64bab3fa-b783-462c-8cf5-1aeefa121e2a tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad" status: 404 len: 111 microversion: 2.1 time: 0.082565 Oct 24 10:43:19.345616 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2060/4079] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:19 2022] GET /compute/v2.1/servers/cee981b9-6221-467f-bce3-e911488983ad => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:43:19.355223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-128ba5fb-fff8-45fa-b82e-e1ee3551b946 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] Calling method '.version_select at 0x7f04d4e3c820>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:19.398850 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-128ba5fb-fff8-45fa-b82e-e1ee3551b946 tempest-ServersTestBootFromVolume-1640240538 tempest-ServersTestBootFromVolume-1640240538-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-7872240" status: 202 len: 0 microversion: 2.1 time: 0.048621 Oct 24 10:43:19.402967 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2061/4080] 10.222.0.50 () {58 vars in 1212 bytes} [Mon Oct 24 10:43:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-7872240 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:43:19.432015 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-80deb238-de27-4bfc-9384-532e59bec2b1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 204 len: 0 microversion: 2.32 time: 0.764717 Oct 24 10:43:19.448891 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2020/4081] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:43:18 2022] DELETE /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:43:19.461245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-36c214f2-4b9c-46e6-8363-c432abf32f29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:19.462101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-36c214f2-4b9c-46e6-8363-c432abf32f29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:19.469765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36c214f2-4b9c-46e6-8363-c432abf32f29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:19.470150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36c214f2-4b9c-46e6-8363-c432abf32f29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:19.470759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36c214f2-4b9c-46e6-8363-c432abf32f29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:19.472326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36c214f2-4b9c-46e6-8363-c432abf32f29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:19.473037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36c214f2-4b9c-46e6-8363-c432abf32f29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:19.478546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36c214f2-4b9c-46e6-8363-c432abf32f29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:19.693745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-04907b99-14f0-46f3-b062-a1caa1150ca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:19.695445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-04907b99-14f0-46f3-b062-a1caa1150ca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:19.708168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04907b99-14f0-46f3-b062-a1caa1150ca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:19.709817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04907b99-14f0-46f3-b062-a1caa1150ca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:19.711874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04907b99-14f0-46f3-b062-a1caa1150ca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:19.714327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04907b99-14f0-46f3-b062-a1caa1150ca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:19.717023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04907b99-14f0-46f3-b062-a1caa1150ca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:19.717862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04907b99-14f0-46f3-b062-a1caa1150ca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:20.028329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-36c214f2-4b9c-46e6-8363-c432abf32f29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:20.046367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-36c214f2-4b9c-46e6-8363-c432abf32f29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:20.054688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-36c214f2-4b9c-46e6-8363-c432abf32f29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:20.056356 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-36c214f2-4b9c-46e6-8363-c432abf32f29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 2951 microversion: 2.32 time: 0.601906 Oct 24 10:43:20.058926 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2062/4082] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:19 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 2951 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:20.081085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9bbb7f5b-5004-46db-a5f5-319745d88d4e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:20.082059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9bbb7f5b-5004-46db-a5f5-319745d88d4e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:20.092232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bbb7f5b-5004-46db-a5f5-319745d88d4e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:20.092892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bbb7f5b-5004-46db-a5f5-319745d88d4e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:20.097503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bbb7f5b-5004-46db-a5f5-319745d88d4e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:20.098331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bbb7f5b-5004-46db-a5f5-319745d88d4e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:20.098908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bbb7f5b-5004-46db-a5f5-319745d88d4e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:20.099440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bbb7f5b-5004-46db-a5f5-319745d88d4e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:20.396101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-04907b99-14f0-46f3-b062-a1caa1150ca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:20.399921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:20.410147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-04907b99-14f0-46f3-b062-a1caa1150ca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:20.417141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-04907b99-14f0-46f3-b062-a1caa1150ca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:20.418563 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-04907b99-14f0-46f3-b062-a1caa1150ca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1600 microversion: 2.20 time: 0.730953 Oct 24 10:43:20.421458 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2021/4083] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:19 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1600 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:43:20.452893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-95f0ec0b-dc5f-41fc-970a-3efcde58acf0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:20.453786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-95f0ec0b-dc5f-41fc-970a-3efcde58acf0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:20.467867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95f0ec0b-dc5f-41fc-970a-3efcde58acf0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:20.468376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95f0ec0b-dc5f-41fc-970a-3efcde58acf0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:20.468824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95f0ec0b-dc5f-41fc-970a-3efcde58acf0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:20.472182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95f0ec0b-dc5f-41fc-970a-3efcde58acf0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:20.473886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95f0ec0b-dc5f-41fc-970a-3efcde58acf0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:20.474866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95f0ec0b-dc5f-41fc-970a-3efcde58acf0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:20.950889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9bbb7f5b-5004-46db-a5f5-319745d88d4e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:20.961882 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9bbb7f5b-5004-46db-a5f5-319745d88d4e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1293 microversion: 2.1 time: 0.901635 Oct 24 10:43:20.964919 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2063/4084] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:20 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1293 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:20.987671 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-95f0ec0b-dc5f-41fc-970a-3efcde58acf0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.539028 Oct 24 10:43:20.989730 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2022/4085] 10.222.0.50 () {60 vars in 1316 bytes} [Mon Oct 24 10:43:20 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-interface => generated 285 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 10:43:21.100246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-209d630d-2774-4618-8d29-7024d0265f75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:21.100900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-209d630d-2774-4618-8d29-7024d0265f75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:21.119916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-209d630d-2774-4618-8d29-7024d0265f75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:21.121240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-209d630d-2774-4618-8d29-7024d0265f75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:21.124619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-209d630d-2774-4618-8d29-7024d0265f75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:21.126028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-209d630d-2774-4618-8d29-7024d0265f75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:21.127751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-209d630d-2774-4618-8d29-7024d0265f75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:21.129348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-209d630d-2774-4618-8d29-7024d0265f75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:21.637491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:21.725494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:21.993844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-497f24bb-84ec-420b-ba4a-998d8365ed3b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:21.994460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-497f24bb-84ec-420b-ba4a-998d8365ed3b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:22.010070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-497f24bb-84ec-420b-ba4a-998d8365ed3b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:22.015219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-497f24bb-84ec-420b-ba4a-998d8365ed3b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:22.019353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-497f24bb-84ec-420b-ba4a-998d8365ed3b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:22.020330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-497f24bb-84ec-420b-ba4a-998d8365ed3b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:22.023383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-497f24bb-84ec-420b-ba4a-998d8365ed3b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:22.024014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-497f24bb-84ec-420b-ba4a-998d8365ed3b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:22.095296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:23.786824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-209d630d-2774-4618-8d29-7024d0265f75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:23.800340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-209d630d-2774-4618-8d29-7024d0265f75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:23.802147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-209d630d-2774-4618-8d29-7024d0265f75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:23.803559 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-209d630d-2774-4618-8d29-7024d0265f75 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 2951 microversion: 2.32 time: 2.716813 Oct 24 10:43:23.804632 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2064/4086] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:21 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 2951 bytes in 2718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:23.804862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-497f24bb-84ec-420b-ba4a-998d8365ed3b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:23.813668 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-497f24bb-84ec-420b-ba4a-998d8365ed3b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1293 microversion: 2.1 time: 1.824949 Oct 24 10:43:23.829808 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2023/4087] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:21 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1293 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:24.028052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-3cf5d8bf-33f5-4e6d-a542-cde3b46699df req-c586ab06-e383-4447-a277-2a3839fe75ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68c41052-4f6b-4a60-97f6-11d5743cb09f", "tag": "a1d6ead8-7dd0-431f-bfb8-de3a8751c425"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:24.062130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3cf5d8bf-33f5-4e6d-a542-cde3b46699df req-c586ab06-e383-4447-a277-2a3839fe75ce service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:24.062888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3cf5d8bf-33f5-4e6d-a542-cde3b46699df req-c586ab06-e383-4447-a277-2a3839fe75ce service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:24.063475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3cf5d8bf-33f5-4e6d-a542-cde3b46699df req-c586ab06-e383-4447-a277-2a3839fe75ce service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:24.123760 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-3cf5d8bf-33f5-4e6d-a542-cde3b46699df req-c586ab06-e383-4447-a277-2a3839fe75ce service nova] Creating event network-changed:a1d6ead8-7dd0-431f-bfb8-de3a8751c425 for instance 68c41052-4f6b-4a60-97f6-11d5743cb09f on n-h1-858383-15 Oct 24 10:43:24.133613 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-3cf5d8bf-33f5-4e6d-a542-cde3b46699df req-c586ab06-e383-4447-a277-2a3839fe75ce service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116977 Oct 24 10:43:24.137198 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2065/4088] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:43:24.832720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3ea4e77d-7046-4345-a8d4-2d5e5dc4d7dc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:24.836016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3ea4e77d-7046-4345-a8d4-2d5e5dc4d7dc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:24.844429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8cfbc2a3-2fa8-4534-9359-5c9947a4a752 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:24.845576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8cfbc2a3-2fa8-4534-9359-5c9947a4a752 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:24.849553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ea4e77d-7046-4345-a8d4-2d5e5dc4d7dc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:24.850046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ea4e77d-7046-4345-a8d4-2d5e5dc4d7dc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:24.850485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ea4e77d-7046-4345-a8d4-2d5e5dc4d7dc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:24.851196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ea4e77d-7046-4345-a8d4-2d5e5dc4d7dc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:24.851646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ea4e77d-7046-4345-a8d4-2d5e5dc4d7dc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:24.857263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ea4e77d-7046-4345-a8d4-2d5e5dc4d7dc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:24.862892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cfbc2a3-2fa8-4534-9359-5c9947a4a752 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:24.863591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cfbc2a3-2fa8-4534-9359-5c9947a4a752 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:24.865945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cfbc2a3-2fa8-4534-9359-5c9947a4a752 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:24.866951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cfbc2a3-2fa8-4534-9359-5c9947a4a752 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:24.869474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cfbc2a3-2fa8-4534-9359-5c9947a4a752 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:24.869926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cfbc2a3-2fa8-4534-9359-5c9947a4a752 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:25.603496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3ea4e77d-7046-4345-a8d4-2d5e5dc4d7dc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:25.614064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3ea4e77d-7046-4345-a8d4-2d5e5dc4d7dc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:25.615768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3ea4e77d-7046-4345-a8d4-2d5e5dc4d7dc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:25.617272 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3ea4e77d-7046-4345-a8d4-2d5e5dc4d7dc tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 2951 microversion: 2.32 time: 0.789240 Oct 24 10:43:25.633796 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2024/4089] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:24 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 2951 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:25.668971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8cfbc2a3-2fa8-4534-9359-5c9947a4a752 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:25.680393 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8cfbc2a3-2fa8-4534-9359-5c9947a4a752 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1293 microversion: 2.1 time: 0.843811 Oct 24 10:43:25.693613 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2066/4090] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:24 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1293 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:43:26.173922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-4282e7ee-9e80-4061-abe3-1663ce5e584b req-384a865d-b7e1-451f-b287-cfae26da2704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6eb3578-42ca-4dc5-b31a-e5500aa94f2e", "tag": "36f88fb2-6faf-4282-bd23-d4f02a3206ca"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:26.195128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4282e7ee-9e80-4061-abe3-1663ce5e584b req-384a865d-b7e1-451f-b287-cfae26da2704 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:26.195594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4282e7ee-9e80-4061-abe3-1663ce5e584b req-384a865d-b7e1-451f-b287-cfae26da2704 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:26.196026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4282e7ee-9e80-4061-abe3-1663ce5e584b req-384a865d-b7e1-451f-b287-cfae26da2704 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:26.260572 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-4282e7ee-9e80-4061-abe3-1663ce5e584b req-384a865d-b7e1-451f-b287-cfae26da2704 service nova] Creating event network-changed:36f88fb2-6faf-4282-bd23-d4f02a3206ca for instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e on n-h2-858383-15 Oct 24 10:43:26.268188 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-4282e7ee-9e80-4061-abe3-1663ce5e584b req-384a865d-b7e1-451f-b287-cfae26da2704 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098112 Oct 24 10:43:26.275351 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2025/4091] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:43:26.479068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5bb6ca5d-b0cb-4a06-85a9-397d3f2bd5e2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-861823152", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:26.554913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-5bb6ca5d-b0cb-4a06-85a9-397d3f2bd5e2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] validate_networks() for [('de762a59-12f4-4557-8f95-655a4b5d7277', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:43:26.648064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-1a903c29-93ec-421f-b15c-89f0de188966 req-7d138fa9-8c16-4dab-b5e7-14ac6a83df80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "name": "network-vif-unplugged", "status": "completed", "tag": "5f14f77f-dfb8-4e0c-9fc7-42fa81786d65"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:26.666749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1a903c29-93ec-421f-b15c-89f0de188966 req-7d138fa9-8c16-4dab-b5e7-14ac6a83df80 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:26.671433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1a903c29-93ec-421f-b15c-89f0de188966 req-7d138fa9-8c16-4dab-b5e7-14ac6a83df80 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:26.672128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1a903c29-93ec-421f-b15c-89f0de188966 req-7d138fa9-8c16-4dab-b5e7-14ac6a83df80 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:26.696355 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-1a903c29-93ec-421f-b15c-89f0de188966 req-7d138fa9-8c16-4dab-b5e7-14ac6a83df80 service nova] Creating event network-vif-unplugged:5f14f77f-dfb8-4e0c-9fc7-42fa81786d65 for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:43:26.704293 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-1a903c29-93ec-421f-b15c-89f0de188966 req-7d138fa9-8c16-4dab-b5e7-14ac6a83df80 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060653 Oct 24 10:43:26.706531 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2026/4092] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:43:26.712090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2cb1e118-199e-4e68-aa96-bcf6cf27efef tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:26.713063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2cb1e118-199e-4e68-aa96-bcf6cf27efef tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:26.720160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cb1e118-199e-4e68-aa96-bcf6cf27efef tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:26.721718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cb1e118-199e-4e68-aa96-bcf6cf27efef tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:26.722388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cb1e118-199e-4e68-aa96-bcf6cf27efef tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:26.723320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cb1e118-199e-4e68-aa96-bcf6cf27efef tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:26.723997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cb1e118-199e-4e68-aa96-bcf6cf27efef tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:26.724667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cb1e118-199e-4e68-aa96-bcf6cf27efef tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:27.211815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2cb1e118-199e-4e68-aa96-bcf6cf27efef tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:27.225706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2cb1e118-199e-4e68-aa96-bcf6cf27efef tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:27.227966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2cb1e118-199e-4e68-aa96-bcf6cf27efef tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:27.229498 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2cb1e118-199e-4e68-aa96-bcf6cf27efef tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 2930 microversion: 2.32 time: 0.521659 Oct 24 10:43:27.230288 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2027/4093] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:26 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 2930 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:27.235402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3dda0ba2-883e-4463-acee-facdc8c120aa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:27.236193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3dda0ba2-883e-4463-acee-facdc8c120aa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:27.243783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dda0ba2-883e-4463-acee-facdc8c120aa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:27.244487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dda0ba2-883e-4463-acee-facdc8c120aa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:27.245813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dda0ba2-883e-4463-acee-facdc8c120aa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:27.247610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dda0ba2-883e-4463-acee-facdc8c120aa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:27.248229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dda0ba2-883e-4463-acee-facdc8c120aa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:27.248874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dda0ba2-883e-4463-acee-facdc8c120aa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:27.517795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3dda0ba2-883e-4463-acee-facdc8c120aa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:27.523658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5bb6ca5d-b0cb-4a06-85a9-397d3f2bd5e2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:43:27.524115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5bb6ca5d-b0cb-4a06-85a9-397d3f2bd5e2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:43:27.524549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5bb6ca5d-b0cb-4a06-85a9-397d3f2bd5e2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:43:27.524963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5bb6ca5d-b0cb-4a06-85a9-397d3f2bd5e2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:43:27.525378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5bb6ca5d-b0cb-4a06-85a9-397d3f2bd5e2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:43:27.545056 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3dda0ba2-883e-4463-acee-facdc8c120aa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1293 microversion: 2.1 time: 0.313228 Oct 24 10:43:27.545641 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2028/4094] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:27 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1293 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:27.550501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bb6ca5d-b0cb-4a06-85a9-397d3f2bd5e2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:27.550990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bb6ca5d-b0cb-4a06-85a9-397d3f2bd5e2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:27.551424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bb6ca5d-b0cb-4a06-85a9-397d3f2bd5e2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:27.552149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bb6ca5d-b0cb-4a06-85a9-397d3f2bd5e2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:27.552593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bb6ca5d-b0cb-4a06-85a9-397d3f2bd5e2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:27.553202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bb6ca5d-b0cb-4a06-85a9-397d3f2bd5e2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:27.597020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-5bb6ca5d-b0cb-4a06-85a9-397d3f2bd5e2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Getting quotas for project f4bbfd7373694648a1f5c4fb8cdace06. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:43:27.603949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-5bb6ca5d-b0cb-4a06-85a9-397d3f2bd5e2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Getting quotas for user 2fa246e48f904d058d451542c0763880 and project f4bbfd7373694648a1f5c4fb8cdace06. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:43:27.625692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5bb6ca5d-b0cb-4a06-85a9-397d3f2bd5e2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:43:27.628866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5bb6ca5d-b0cb-4a06-85a9-397d3f2bd5e2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:43:27.718156 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5bb6ca5d-b0cb-4a06-85a9-397d3f2bd5e2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.416205 Oct 24 10:43:27.721284 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2067/4095] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:43:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:43:27.731925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1d8f4ab2-d3de-40b9-8731-bf5f6bd6e35b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:27.732909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1d8f4ab2-d3de-40b9-8731-bf5f6bd6e35b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:27.748045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:27.887798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1d8f4ab2-d3de-40b9-8731-bf5f6bd6e35b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:27.895749 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1d8f4ab2-d3de-40b9-8731-bf5f6bd6e35b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1213 microversion: 2.1 time: 0.167938 Oct 24 10:43:27.915981 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2029/4096] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:27 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1213 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:28.279065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-063ff92f-0155-4ca0-a33c-eceb2c3f3bc5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:28.280665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-063ff92f-0155-4ca0-a33c-eceb2c3f3bc5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:28.314574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-063ff92f-0155-4ca0-a33c-eceb2c3f3bc5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:28.316094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-063ff92f-0155-4ca0-a33c-eceb2c3f3bc5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:28.316650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-063ff92f-0155-4ca0-a33c-eceb2c3f3bc5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:28.317651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-063ff92f-0155-4ca0-a33c-eceb2c3f3bc5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:28.318406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-063ff92f-0155-4ca0-a33c-eceb2c3f3bc5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:28.319117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-063ff92f-0155-4ca0-a33c-eceb2c3f3bc5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:28.356983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:28.573775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5574a2a4-082d-4e85-be93-9adb2cb7e3b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:28.575060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5574a2a4-082d-4e85-be93-9adb2cb7e3b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:28.590698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5574a2a4-082d-4e85-be93-9adb2cb7e3b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:28.591203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5574a2a4-082d-4e85-be93-9adb2cb7e3b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:28.591655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5574a2a4-082d-4e85-be93-9adb2cb7e3b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:28.592367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5574a2a4-082d-4e85-be93-9adb2cb7e3b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:28.592826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5574a2a4-082d-4e85-be93-9adb2cb7e3b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:28.593283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5574a2a4-082d-4e85-be93-9adb2cb7e3b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:29.434479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5574a2a4-082d-4e85-be93-9adb2cb7e3b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:29.446212 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5574a2a4-082d-4e85-be93-9adb2cb7e3b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1293 microversion: 2.1 time: 0.876322 Oct 24 10:43:29.446809 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2030/4097] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:28 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1293 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:43:29.454897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-9e856d2a-3d95-435e-9a98-6434d755edb7 req-a0858674-9160-48eb-bacf-f029f6152187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "name": "network-vif-unplugged", "status": "completed", "tag": "ea2571c6-ad05-4432-860b-c122aa8355bc"}, {"server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "name": "network-vif-unplugged", "status": "completed", "tag": "00f84ee5-49b5-45e0-85df-7a095215e973"}, {"server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "name": "network-vif-unplugged", "status": "completed", "tag": "02b89d7c-b6a2-401d-89a3-9361e02645ab"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:29.462560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-063ff92f-0155-4ca0-a33c-eceb2c3f3bc5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:29.482831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-063ff92f-0155-4ca0-a33c-eceb2c3f3bc5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:29.490386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-063ff92f-0155-4ca0-a33c-eceb2c3f3bc5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:29.491578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9e856d2a-3d95-435e-9a98-6434d755edb7 req-a0858674-9160-48eb-bacf-f029f6152187 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:29.493469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9e856d2a-3d95-435e-9a98-6434d755edb7 req-a0858674-9160-48eb-bacf-f029f6152187 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:29.494061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9e856d2a-3d95-435e-9a98-6434d755edb7 req-a0858674-9160-48eb-bacf-f029f6152187 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:29.494838 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-063ff92f-0155-4ca0-a33c-eceb2c3f3bc5 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 2930 microversion: 2.32 time: 1.235018 Oct 24 10:43:29.496297 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2068/4098] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:28 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 2930 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:29.512451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-22997bdd-e2ff-46b3-accd-5e4cd233c938 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:29.513117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-22997bdd-e2ff-46b3-accd-5e4cd233c938 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:29.531162 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-9e856d2a-3d95-435e-9a98-6434d755edb7 req-a0858674-9160-48eb-bacf-f029f6152187 service nova] Creating event network-vif-unplugged:ea2571c6-ad05-4432-860b-c122aa8355bc for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:43:29.531707 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-9e856d2a-3d95-435e-9a98-6434d755edb7 req-a0858674-9160-48eb-bacf-f029f6152187 service nova] Creating event network-vif-unplugged:00f84ee5-49b5-45e0-85df-7a095215e973 for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:43:29.532217 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-9e856d2a-3d95-435e-9a98-6434d755edb7 req-a0858674-9160-48eb-bacf-f029f6152187 service nova] Creating event network-vif-unplugged:02b89d7c-b6a2-401d-89a3-9361e02645ab for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:43:29.533910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22997bdd-e2ff-46b3-accd-5e4cd233c938 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:29.535296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22997bdd-e2ff-46b3-accd-5e4cd233c938 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:29.538636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22997bdd-e2ff-46b3-accd-5e4cd233c938 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:29.540410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22997bdd-e2ff-46b3-accd-5e4cd233c938 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:29.543574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22997bdd-e2ff-46b3-accd-5e4cd233c938 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:29.544121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22997bdd-e2ff-46b3-accd-5e4cd233c938 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:29.554864 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-9e856d2a-3d95-435e-9a98-6434d755edb7 req-a0858674-9160-48eb-bacf-f029f6152187 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.101809 Oct 24 10:43:29.558097 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2031/4099] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:43:29.660218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-22997bdd-e2ff-46b3-accd-5e4cd233c938 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:29.670995 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-22997bdd-e2ff-46b3-accd-5e4cd233c938 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1265 microversion: 2.1 time: 0.173591 Oct 24 10:43:29.686111 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2069/4100] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:29 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:30.470701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5d2b97f0-36d0-4caf-b4ef-3eec181ad4ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:30.472800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5d2b97f0-36d0-4caf-b4ef-3eec181ad4ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:30.481527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d2b97f0-36d0-4caf-b4ef-3eec181ad4ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:30.482267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d2b97f0-36d0-4caf-b4ef-3eec181ad4ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:30.482866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d2b97f0-36d0-4caf-b4ef-3eec181ad4ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:30.485688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d2b97f0-36d0-4caf-b4ef-3eec181ad4ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:30.486394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d2b97f0-36d0-4caf-b4ef-3eec181ad4ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:30.487929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d2b97f0-36d0-4caf-b4ef-3eec181ad4ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:30.531857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-93043057-3508-4d21-9c39-770158b165a6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:30.533364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-93043057-3508-4d21-9c39-770158b165a6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:30.552304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93043057-3508-4d21-9c39-770158b165a6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:30.556635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93043057-3508-4d21-9c39-770158b165a6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:30.557303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93043057-3508-4d21-9c39-770158b165a6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:30.560569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93043057-3508-4d21-9c39-770158b165a6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:30.561253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93043057-3508-4d21-9c39-770158b165a6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:30.566515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93043057-3508-4d21-9c39-770158b165a6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:31.010552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5d2b97f0-36d0-4caf-b4ef-3eec181ad4ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:31.021120 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5d2b97f0-36d0-4caf-b4ef-3eec181ad4ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1293 microversion: 2.1 time: 0.554449 Oct 24 10:43:31.021120 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2032/4101] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:30 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1293 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:31.037330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-93043057-3508-4d21-9c39-770158b165a6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:31.040570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6eec2f94-c5ef-40bb-9655-3cffa545129b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:31.042862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6eec2f94-c5ef-40bb-9655-3cffa545129b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:31.057680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-93043057-3508-4d21-9c39-770158b165a6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:31.058077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6eec2f94-c5ef-40bb-9655-3cffa545129b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:31.058575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6eec2f94-c5ef-40bb-9655-3cffa545129b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:31.059015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6eec2f94-c5ef-40bb-9655-3cffa545129b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:31.059725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6eec2f94-c5ef-40bb-9655-3cffa545129b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:31.060181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6eec2f94-c5ef-40bb-9655-3cffa545129b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:31.060607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6eec2f94-c5ef-40bb-9655-3cffa545129b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:31.062319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-93043057-3508-4d21-9c39-770158b165a6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:31.066379 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-93043057-3508-4d21-9c39-770158b165a6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 2909 microversion: 2.32 time: 0.539406 Oct 24 10:43:31.082969 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2070/4102] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:30 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 2909 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:43:31.255312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6eec2f94-c5ef-40bb-9655-3cffa545129b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:31.266787 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6eec2f94-c5ef-40bb-9655-3cffa545129b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1271 microversion: 2.1 time: 0.239789 Oct 24 10:43:31.269121 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2033/4103] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:31 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1271 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:31.634834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-85b84620-7fcd-4fe2-b59a-4783d2ce279d req-def7f905-2abb-41ee-8b94-c13ff114b1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "name": "network-vif-unplugged", "status": "completed", "tag": "718e738e-bf66-4482-a3d8-5ddfccb459f6"}, {"server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "name": "network-vif-unplugged", "status": "completed", "tag": "a9abbed7-ca02-4124-abca-3fe10fe22ee4"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:31.650692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-85b84620-7fcd-4fe2-b59a-4783d2ce279d req-def7f905-2abb-41ee-8b94-c13ff114b1c6 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:31.651171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-85b84620-7fcd-4fe2-b59a-4783d2ce279d req-def7f905-2abb-41ee-8b94-c13ff114b1c6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:31.651600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-85b84620-7fcd-4fe2-b59a-4783d2ce279d req-def7f905-2abb-41ee-8b94-c13ff114b1c6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:31.671141 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-85b84620-7fcd-4fe2-b59a-4783d2ce279d req-def7f905-2abb-41ee-8b94-c13ff114b1c6 service nova] Creating event network-vif-unplugged:718e738e-bf66-4482-a3d8-5ddfccb459f6 for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:43:31.671665 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-85b84620-7fcd-4fe2-b59a-4783d2ce279d req-def7f905-2abb-41ee-8b94-c13ff114b1c6 service nova] Creating event network-vif-unplugged:a9abbed7-ca02-4124-abca-3fe10fe22ee4 for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:43:31.684613 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-85b84620-7fcd-4fe2-b59a-4783d2ce279d req-def7f905-2abb-41ee-8b94-c13ff114b1c6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.058592 Oct 24 10:43:31.685251 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2071/4104] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:43:32.042631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2959fe18-1a86-4b89-90f8-f1d895c3e74e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:32.043956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2959fe18-1a86-4b89-90f8-f1d895c3e74e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:32.054532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2959fe18-1a86-4b89-90f8-f1d895c3e74e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:32.055461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2959fe18-1a86-4b89-90f8-f1d895c3e74e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:32.056110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2959fe18-1a86-4b89-90f8-f1d895c3e74e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:32.057066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2959fe18-1a86-4b89-90f8-f1d895c3e74e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:32.057736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2959fe18-1a86-4b89-90f8-f1d895c3e74e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:32.058380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2959fe18-1a86-4b89-90f8-f1d895c3e74e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:32.105476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3db12292-d041-4f32-8a64-21e2feca8ab7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:32.106190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3db12292-d041-4f32-8a64-21e2feca8ab7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:32.117048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3db12292-d041-4f32-8a64-21e2feca8ab7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:32.119766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3db12292-d041-4f32-8a64-21e2feca8ab7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:32.120398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3db12292-d041-4f32-8a64-21e2feca8ab7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:32.121443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3db12292-d041-4f32-8a64-21e2feca8ab7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:32.122790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3db12292-d041-4f32-8a64-21e2feca8ab7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:32.129922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3db12292-d041-4f32-8a64-21e2feca8ab7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:32.511752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2959fe18-1a86-4b89-90f8-f1d895c3e74e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:32.525115 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2959fe18-1a86-4b89-90f8-f1d895c3e74e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1293 microversion: 2.1 time: 0.486715 Oct 24 10:43:32.525793 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2034/4105] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:32 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1293 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:32.542786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c1ac600-405b-499b-9fb1-5a0a2a3bb3b7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:32.543668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1c1ac600-405b-499b-9fb1-5a0a2a3bb3b7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:32.550484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c1ac600-405b-499b-9fb1-5a0a2a3bb3b7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:32.550980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c1ac600-405b-499b-9fb1-5a0a2a3bb3b7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:32.551422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c1ac600-405b-499b-9fb1-5a0a2a3bb3b7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:32.552236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c1ac600-405b-499b-9fb1-5a0a2a3bb3b7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:32.552740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c1ac600-405b-499b-9fb1-5a0a2a3bb3b7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:32.553168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c1ac600-405b-499b-9fb1-5a0a2a3bb3b7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:32.583526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3db12292-d041-4f32-8a64-21e2feca8ab7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:32.594076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3db12292-d041-4f32-8a64-21e2feca8ab7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:32.595522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3db12292-d041-4f32-8a64-21e2feca8ab7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:32.597494 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3db12292-d041-4f32-8a64-21e2feca8ab7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 2909 microversion: 2.32 time: 0.497253 Oct 24 10:43:32.598814 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2072/4106] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:32 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 2909 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:32.646860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-3a91f37d-6723-4af5-80ac-366259eec283 req-21361903-a2a0-4395-8fe0-4d7ce07109c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "name": "network-vif-deleted", "tag": "718e738e-bf66-4482-a3d8-5ddfccb459f6"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:32.658820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3a91f37d-6723-4af5-80ac-366259eec283 req-21361903-a2a0-4395-8fe0-4d7ce07109c1 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:32.659542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3a91f37d-6723-4af5-80ac-366259eec283 req-21361903-a2a0-4395-8fe0-4d7ce07109c1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:32.660462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3a91f37d-6723-4af5-80ac-366259eec283 req-21361903-a2a0-4395-8fe0-4d7ce07109c1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:32.680524 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-3a91f37d-6723-4af5-80ac-366259eec283 req-21361903-a2a0-4395-8fe0-4d7ce07109c1 service nova] Creating event network-vif-deleted:718e738e-bf66-4482-a3d8-5ddfccb459f6 for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:43:32.698313 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-3a91f37d-6723-4af5-80ac-366259eec283 req-21361903-a2a0-4395-8fe0-4d7ce07109c1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054951 Oct 24 10:43:32.699472 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2073/4107] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:43:32.700019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1c1ac600-405b-499b-9fb1-5a0a2a3bb3b7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:32.710012 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1c1ac600-405b-499b-9fb1-5a0a2a3bb3b7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1271 microversion: 2.1 time: 0.182692 Oct 24 10:43:32.722356 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2035/4108] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:32 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:33.553273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-df89dba0-9590-43d1-938d-95a8a543d0e6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:33.555607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-df89dba0-9590-43d1-938d-95a8a543d0e6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:33.567478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df89dba0-9590-43d1-938d-95a8a543d0e6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:33.568097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df89dba0-9590-43d1-938d-95a8a543d0e6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:33.569689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df89dba0-9590-43d1-938d-95a8a543d0e6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:33.572122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df89dba0-9590-43d1-938d-95a8a543d0e6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:33.572763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df89dba0-9590-43d1-938d-95a8a543d0e6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:33.573617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df89dba0-9590-43d1-938d-95a8a543d0e6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:33.628630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-07bd6a29-b85d-45f4-96c1-eb3c0ba68b29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:33.629394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-07bd6a29-b85d-45f4-96c1-eb3c0ba68b29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:33.639377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07bd6a29-b85d-45f4-96c1-eb3c0ba68b29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:33.645223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07bd6a29-b85d-45f4-96c1-eb3c0ba68b29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:33.649854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07bd6a29-b85d-45f4-96c1-eb3c0ba68b29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:33.650810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07bd6a29-b85d-45f4-96c1-eb3c0ba68b29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:33.651307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07bd6a29-b85d-45f4-96c1-eb3c0ba68b29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:33.651744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07bd6a29-b85d-45f4-96c1-eb3c0ba68b29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:34.373445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-df89dba0-9590-43d1-938d-95a8a543d0e6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:34.395832 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-df89dba0-9590-43d1-938d-95a8a543d0e6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1293 microversion: 2.1 time: 0.850000 Oct 24 10:43:34.398202 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2074/4109] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:33 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1293 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:34.403303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-760573a6-18e1-4b54-a5f2-a290f34c66f8 req-6911f6cc-f9cb-4b74-bf86-0a47ba3bb277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68c41052-4f6b-4a60-97f6-11d5743cb09f", "name": "network-vif-plugged", "status": "completed", "tag": "a1d6ead8-7dd0-431f-bfb8-de3a8751c425"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:34.414720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-760573a6-18e1-4b54-a5f2-a290f34c66f8 req-6911f6cc-f9cb-4b74-bf86-0a47ba3bb277 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:34.415617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-760573a6-18e1-4b54-a5f2-a290f34c66f8 req-6911f6cc-f9cb-4b74-bf86-0a47ba3bb277 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:34.416211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-760573a6-18e1-4b54-a5f2-a290f34c66f8 req-6911f6cc-f9cb-4b74-bf86-0a47ba3bb277 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:34.429973 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-760573a6-18e1-4b54-a5f2-a290f34c66f8 req-6911f6cc-f9cb-4b74-bf86-0a47ba3bb277 service nova] Creating event network-vif-plugged:a1d6ead8-7dd0-431f-bfb8-de3a8751c425 for instance 68c41052-4f6b-4a60-97f6-11d5743cb09f on n-h1-858383-15 Oct 24 10:43:34.436405 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-760573a6-18e1-4b54-a5f2-a290f34c66f8 req-6911f6cc-f9cb-4b74-bf86-0a47ba3bb277 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036723 Oct 24 10:43:34.443597 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2075/4110] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:43:34.451842 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-526f038b-3c40-4a9e-af68-a098739f23a2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:34.452970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-526f038b-3c40-4a9e-af68-a098739f23a2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:34.459992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-526f038b-3c40-4a9e-af68-a098739f23a2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:34.460718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-526f038b-3c40-4a9e-af68-a098739f23a2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:34.461453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-526f038b-3c40-4a9e-af68-a098739f23a2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:34.462332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-526f038b-3c40-4a9e-af68-a098739f23a2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:34.463102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-526f038b-3c40-4a9e-af68-a098739f23a2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:34.463693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-526f038b-3c40-4a9e-af68-a098739f23a2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:34.629661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-07bd6a29-b85d-45f4-96c1-eb3c0ba68b29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:34.652905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-07bd6a29-b85d-45f4-96c1-eb3c0ba68b29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:34.668867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-07bd6a29-b85d-45f4-96c1-eb3c0ba68b29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:34.670418 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-07bd6a29-b85d-45f4-96c1-eb3c0ba68b29 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 2750 microversion: 2.32 time: 1.046709 Oct 24 10:43:34.671725 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2036/4111] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:33 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 2750 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:43:34.790443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-52b29bc4-947d-45c3-87cc-b1f7b23b8d46 req-de8ee8aa-8803-41fe-af83-14fe25cc5e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "name": "network-vif-deleted", "tag": "ea2571c6-ad05-4432-860b-c122aa8355bc"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:34.809040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-52b29bc4-947d-45c3-87cc-b1f7b23b8d46 req-de8ee8aa-8803-41fe-af83-14fe25cc5e81 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:34.809536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-52b29bc4-947d-45c3-87cc-b1f7b23b8d46 req-de8ee8aa-8803-41fe-af83-14fe25cc5e81 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:34.809993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-52b29bc4-947d-45c3-87cc-b1f7b23b8d46 req-de8ee8aa-8803-41fe-af83-14fe25cc5e81 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:34.835518 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-52b29bc4-947d-45c3-87cc-b1f7b23b8d46 req-de8ee8aa-8803-41fe-af83-14fe25cc5e81 service nova] Creating event network-vif-deleted:ea2571c6-ad05-4432-860b-c122aa8355bc for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:43:34.851785 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-52b29bc4-947d-45c3-87cc-b1f7b23b8d46 req-de8ee8aa-8803-41fe-af83-14fe25cc5e81 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060481 Oct 24 10:43:34.852858 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2037/4112] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:43:34.995994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-526f038b-3c40-4a9e-af68-a098739f23a2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:35.015342 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-526f038b-3c40-4a9e-af68-a098739f23a2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1313 microversion: 2.1 time: 0.561807 Oct 24 10:43:35.016279 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2076/4113] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:34 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1313 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:35.423209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eb792484-4d5e-4622-a807-325aa56e8e99 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:35.424517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eb792484-4d5e-4622-a807-325aa56e8e99 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:35.431825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb792484-4d5e-4622-a807-325aa56e8e99 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:35.435932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb792484-4d5e-4622-a807-325aa56e8e99 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:35.436408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb792484-4d5e-4622-a807-325aa56e8e99 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:35.437171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb792484-4d5e-4622-a807-325aa56e8e99 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:35.437638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb792484-4d5e-4622-a807-325aa56e8e99 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:35.438075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb792484-4d5e-4622-a807-325aa56e8e99 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:35.699063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4b5e0ea7-c926-4bff-90a4-f91a52694c81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:35.699750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4b5e0ea7-c926-4bff-90a4-f91a52694c81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:35.706525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:35.717580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b5e0ea7-c926-4bff-90a4-f91a52694c81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:35.718642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b5e0ea7-c926-4bff-90a4-f91a52694c81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:35.719764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b5e0ea7-c926-4bff-90a4-f91a52694c81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:35.723215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b5e0ea7-c926-4bff-90a4-f91a52694c81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:35.724306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b5e0ea7-c926-4bff-90a4-f91a52694c81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:35.725950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b5e0ea7-c926-4bff-90a4-f91a52694c81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:35.933653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eb792484-4d5e-4622-a807-325aa56e8e99 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:35.954738 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eb792484-4d5e-4622-a807-325aa56e8e99 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1293 microversion: 2.1 time: 0.528038 Oct 24 10:43:35.968860 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2038/4114] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:35 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1293 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:36.044637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ba374ba1-de81-4607-b49d-0d814a136100 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:36.045721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ba374ba1-de81-4607-b49d-0d814a136100 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:36.058807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba374ba1-de81-4607-b49d-0d814a136100 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:36.060176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba374ba1-de81-4607-b49d-0d814a136100 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:36.060790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba374ba1-de81-4607-b49d-0d814a136100 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:36.061975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba374ba1-de81-4607-b49d-0d814a136100 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:36.063137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba374ba1-de81-4607-b49d-0d814a136100 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:36.063891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba374ba1-de81-4607-b49d-0d814a136100 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:36.145493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4b5e0ea7-c926-4bff-90a4-f91a52694c81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:36.155117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4b5e0ea7-c926-4bff-90a4-f91a52694c81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:36.157000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4b5e0ea7-c926-4bff-90a4-f91a52694c81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:36.159348 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4b5e0ea7-c926-4bff-90a4-f91a52694c81 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 2590 microversion: 2.32 time: 0.463862 Oct 24 10:43:36.160531 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2077/4115] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:35 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 2590 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:36.499882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ba374ba1-de81-4607-b49d-0d814a136100 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:36.512778 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ba374ba1-de81-4607-b49d-0d814a136100 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1313 microversion: 2.1 time: 0.474027 Oct 24 10:43:36.513771 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2039/4116] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:36 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:36.989063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-20f0558e-5908-4bd0-8322-3251cc3c62eb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:36.989722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-20f0558e-5908-4bd0-8322-3251cc3c62eb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:37.018283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-0fd4a743-43c7-4bb2-a257-2ca4f990ce8b req-868ad172-c701-4e0d-ac13-61e67df7c105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "name": "network-vif-deleted", "tag": "5f14f77f-dfb8-4e0c-9fc7-42fa81786d65"}, {"name": "network-changed", "server_uuid": "8024a63d-01f0-45d1-81c2-99c962acee10", "tag": "1e175526-806a-4cdd-9347-5e7224e1da5e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:37.021958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20f0558e-5908-4bd0-8322-3251cc3c62eb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:37.023237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20f0558e-5908-4bd0-8322-3251cc3c62eb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:37.025742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20f0558e-5908-4bd0-8322-3251cc3c62eb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:37.029778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20f0558e-5908-4bd0-8322-3251cc3c62eb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:37.032373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20f0558e-5908-4bd0-8322-3251cc3c62eb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:37.034999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20f0558e-5908-4bd0-8322-3251cc3c62eb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:37.070855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0fd4a743-43c7-4bb2-a257-2ca4f990ce8b req-868ad172-c701-4e0d-ac13-61e67df7c105 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:37.071850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0fd4a743-43c7-4bb2-a257-2ca4f990ce8b req-868ad172-c701-4e0d-ac13-61e67df7c105 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:37.075641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0fd4a743-43c7-4bb2-a257-2ca4f990ce8b req-868ad172-c701-4e0d-ac13-61e67df7c105 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:37.114404 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-0fd4a743-43c7-4bb2-a257-2ca4f990ce8b req-868ad172-c701-4e0d-ac13-61e67df7c105 service nova] Creating event network-vif-deleted:5f14f77f-dfb8-4e0c-9fc7-42fa81786d65 for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:43:37.121389 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-0fd4a743-43c7-4bb2-a257-2ca4f990ce8b req-868ad172-c701-4e0d-ac13-61e67df7c105 service nova] Creating event network-changed:1e175526-806a-4cdd-9347-5e7224e1da5e for instance 8024a63d-01f0-45d1-81c2-99c962acee10 on n-h1-858383-15 Oct 24 10:43:37.139665 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-0fd4a743-43c7-4bb2-a257-2ca4f990ce8b req-868ad172-c701-4e0d-ac13-61e67df7c105 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.123771 Oct 24 10:43:37.140864 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2040/4117] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:43:37.190187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2e26e50b-de82-4ce6-a15c-fb4345803290 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:37.191000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2e26e50b-de82-4ce6-a15c-fb4345803290 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:37.203604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e26e50b-de82-4ce6-a15c-fb4345803290 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:37.204488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e26e50b-de82-4ce6-a15c-fb4345803290 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:37.205293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e26e50b-de82-4ce6-a15c-fb4345803290 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:37.206632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e26e50b-de82-4ce6-a15c-fb4345803290 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:37.207421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e26e50b-de82-4ce6-a15c-fb4345803290 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:37.208189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e26e50b-de82-4ce6-a15c-fb4345803290 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:37.587451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:37.606569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-20f0558e-5908-4bd0-8322-3251cc3c62eb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:37.620626 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-20f0558e-5908-4bd0-8322-3251cc3c62eb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1475 microversion: 2.1 time: 0.638099 Oct 24 10:43:37.622042 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2078/4118] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:36 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1475 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:37.637296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8ef3a950-ae81-414b-a447-9af005246331 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:37.638242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8ef3a950-ae81-414b-a447-9af005246331 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:37.644801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:37.646502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ef3a950-ae81-414b-a447-9af005246331 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:37.649374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ef3a950-ae81-414b-a447-9af005246331 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:37.650134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ef3a950-ae81-414b-a447-9af005246331 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:37.652043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ef3a950-ae81-414b-a447-9af005246331 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:37.653029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ef3a950-ae81-414b-a447-9af005246331 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:37.653029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ef3a950-ae81-414b-a447-9af005246331 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:37.787660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2e26e50b-de82-4ce6-a15c-fb4345803290 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:37.797804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2e26e50b-de82-4ce6-a15c-fb4345803290 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:37.800195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2e26e50b-de82-4ce6-a15c-fb4345803290 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:37.801495 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2e26e50b-de82-4ce6-a15c-fb4345803290 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 2430 microversion: 2.32 time: 0.616754 Oct 24 10:43:37.802078 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2041/4119] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:37 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 2430 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:37.808502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-45eaae31-812c-453d-9beb-dfddc9538b63 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1557197044", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:37.882895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-45eaae31-812c-453d-9beb-dfddc9538b63 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] validate_networks() for [('734fc132-fff0-4bf7-9775-3a17fdcd25dc', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:43:37.892041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:38.489967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8ef3a950-ae81-414b-a447-9af005246331 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:38.504347 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8ef3a950-ae81-414b-a447-9af005246331 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1313 microversion: 2.1 time: 0.877817 Oct 24 10:43:38.506172 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2079/4120] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:37 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1313 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:39.057180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c364ec80-8a2c-4b39-99b5-cd0c0e3d948c tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Action: 'create', calling method: .version_select at 0x7f04cb8ef790>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1959546707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8iPVQNf9DZnW6J9bgmX6Jr9svGBjJdzH3BtrV6Pls42CbLSJoeePN3fJqH9ySJDBhKF4Yo01DxS6FdAgVVv5fKor2DD7Se6v4pku1P+wVedlWwrWFFNtAOhzI6oqQYMw=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:39.099695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-c364ec80-8a2c-4b39-99b5-cd0c0e3d948c tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Getting quotas for project c43199c732c141d893e52e2bb1c751e2. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:43:39.108068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-c364ec80-8a2c-4b39-99b5-cd0c0e3d948c tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Getting quotas for user d4107e4d2df9455d9ec35a2bee1eacc8 and project c43199c732c141d893e52e2bb1c751e2. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:43:39.157147 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c364ec80-8a2c-4b39-99b5-cd0c0e3d948c tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.557951 Oct 24 10:43:39.167190 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2080/4121] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:43:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:43:39.181088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c1284b90-f2b0-4151-9846-8f1b5a10814e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:39.181716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c1284b90-f2b0-4151-9846-8f1b5a10814e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:39.190684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1284b90-f2b0-4151-9846-8f1b5a10814e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:39.190987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1284b90-f2b0-4151-9846-8f1b5a10814e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:39.191431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1284b90-f2b0-4151-9846-8f1b5a10814e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:39.192116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1284b90-f2b0-4151-9846-8f1b5a10814e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:39.192567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1284b90-f2b0-4151-9846-8f1b5a10814e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:39.193074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1284b90-f2b0-4151-9846-8f1b5a10814e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:39.389647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c1284b90-f2b0-4151-9846-8f1b5a10814e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:39.399508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c1284b90-f2b0-4151-9846-8f1b5a10814e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:39.400965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c1284b90-f2b0-4151-9846-8f1b5a10814e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:39.402209 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c1284b90-f2b0-4151-9846-8f1b5a10814e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 2317 microversion: 2.32 time: 0.233786 Oct 24 10:43:39.406976 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2081/4122] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:39 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 2317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:39.430658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-dd9b778a-a98e-4d6b-aa7e-692b5d676474 req-465aae0c-0427-43ae-943b-1355881b56f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "name": "network-vif-deleted", "tag": "a9abbed7-ca02-4124-abca-3fe10fe22ee4"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:39.463761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dd9b778a-a98e-4d6b-aa7e-692b5d676474 req-465aae0c-0427-43ae-943b-1355881b56f8 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:39.464578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-45eaae31-812c-453d-9beb-dfddc9538b63 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:43:39.465140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dd9b778a-a98e-4d6b-aa7e-692b5d676474 req-465aae0c-0427-43ae-943b-1355881b56f8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:39.465250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dd9b778a-a98e-4d6b-aa7e-692b5d676474 req-465aae0c-0427-43ae-943b-1355881b56f8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:39.465801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-45eaae31-812c-453d-9beb-dfddc9538b63 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:43:39.466970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-45eaae31-812c-453d-9beb-dfddc9538b63 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:43:39.472718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-45eaae31-812c-453d-9beb-dfddc9538b63 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:43:39.473507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-45eaae31-812c-453d-9beb-dfddc9538b63 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:43:39.518624 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-dd9b778a-a98e-4d6b-aa7e-692b5d676474 req-465aae0c-0427-43ae-943b-1355881b56f8 service nova] Creating event network-vif-deleted:a9abbed7-ca02-4124-abca-3fe10fe22ee4 for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:43:39.526284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45eaae31-812c-453d-9beb-dfddc9538b63 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:39.526284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45eaae31-812c-453d-9beb-dfddc9538b63 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:39.529315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45eaae31-812c-453d-9beb-dfddc9538b63 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:39.530266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45eaae31-812c-453d-9beb-dfddc9538b63 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:39.531400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45eaae31-812c-453d-9beb-dfddc9538b63 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:39.531859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45eaae31-812c-453d-9beb-dfddc9538b63 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:39.539984 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-dd9b778a-a98e-4d6b-aa7e-692b5d676474 req-465aae0c-0427-43ae-943b-1355881b56f8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127641 Oct 24 10:43:39.542329 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2082/4123] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:43:39.557904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-45eaae31-812c-453d-9beb-dfddc9538b63 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Getting quotas for project 9ab3028765ba447589bf595a603ea2e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:43:39.559217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-51bd375e-839b-4abf-8134-c8f679f16ad4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:39.563427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-51bd375e-839b-4abf-8134-c8f679f16ad4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:39.568110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-45eaae31-812c-453d-9beb-dfddc9538b63 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Getting quotas for user ed058a5e8ac14236ab2e8783e9170346 and project 9ab3028765ba447589bf595a603ea2e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:43:39.585821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51bd375e-839b-4abf-8134-c8f679f16ad4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:39.586514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51bd375e-839b-4abf-8134-c8f679f16ad4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:39.587075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51bd375e-839b-4abf-8134-c8f679f16ad4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:39.588003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51bd375e-839b-4abf-8134-c8f679f16ad4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:39.588605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51bd375e-839b-4abf-8134-c8f679f16ad4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:39.589203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51bd375e-839b-4abf-8134-c8f679f16ad4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:39.592745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-45eaae31-812c-453d-9beb-dfddc9538b63 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:43:39.596441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-45eaae31-812c-453d-9beb-dfddc9538b63 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:43:39.674348 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-45eaae31-812c-453d-9beb-dfddc9538b63 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.870797 Oct 24 10:43:39.675829 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2042/4124] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:43:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:43:39.693280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-21e8a3bb-8e29-464f-ac13-9ac9048d2e8b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:39.693971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-21e8a3bb-8e29-464f-ac13-9ac9048d2e8b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:39.735493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-21e8a3bb-8e29-464f-ac13-9ac9048d2e8b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:43:39.958477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-51bd375e-839b-4abf-8134-c8f679f16ad4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:39.966797 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-51bd375e-839b-4abf-8134-c8f679f16ad4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1313 microversion: 2.1 time: 0.421172 Oct 24 10:43:39.981006 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2083/4125] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:39 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:40.256150 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-21e8a3bb-8e29-464f-ac13-9ac9048d2e8b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7a4d9079-08a8-4c68-b6b4-5f0693fb03fe" status: 204 len: 0 microversion: 2.1 time: 0.565627 Oct 24 10:43:40.258458 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2043/4126] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:43:39 2022] DELETE /compute/v2.1/servers/7a4d9079-08a8-4c68-b6b4-5f0693fb03fe => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:43:40.277521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-66d56a32-8d9b-42a0-9dca-0870fedc513c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:40.278146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-66d56a32-8d9b-42a0-9dca-0870fedc513c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:40.324295 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-66d56a32-8d9b-42a0-9dca-0870fedc513c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe could not be found. Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-66d56a32-8d9b-42a0-9dca-0870fedc513c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/7a4d9079-08a8-4c68-b6b4-5f0693fb03fe HTTP/1.1 Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe could not be found. Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '7a4d9079-08a8-4c68-b6b4-5f0693fb03fe'} Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe could not be found. Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:43:40.338827 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe could not be found. Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe could not be found. Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-66d56a32-8d9b-42a0-9dca-0870fedc513c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-66d56a32-8d9b-42a0-9dca-0870fedc513c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/7a4d9079-08a8-4c68-b6b4-5f0693fb03fe" status: 404 len: 111 microversion: 2.1 time: 0.073925 Oct 24 10:43:40.343470 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2084/4127] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:40 2022] GET /compute/v2.1/servers/7a4d9079-08a8-4c68-b6b4-5f0693fb03fe => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:43:40.446226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa7d6b97-a3a4-4450-8e86-6e9390307315 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:40.450072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa7d6b97-a3a4-4450-8e86-6e9390307315 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:40.472549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa7d6b97-a3a4-4450-8e86-6e9390307315 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:40.476096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa7d6b97-a3a4-4450-8e86-6e9390307315 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:40.477389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa7d6b97-a3a4-4450-8e86-6e9390307315 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:40.478394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa7d6b97-a3a4-4450-8e86-6e9390307315 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:40.481706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa7d6b97-a3a4-4450-8e86-6e9390307315 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:40.482707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa7d6b97-a3a4-4450-8e86-6e9390307315 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:40.537706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b5568b68-5d09-4254-94a3-9be9c7bd6d4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1140579948", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "734fc132-fff0-4bf7-9775-3a17fdcd25dc"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:40.664557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa7d6b97-a3a4-4450-8e86-6e9390307315 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:40.666793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:40.690420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa7d6b97-a3a4-4450-8e86-6e9390307315 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:40.691993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa7d6b97-a3a4-4450-8e86-6e9390307315 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:40.693324 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa7d6b97-a3a4-4450-8e86-6e9390307315 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1604 microversion: 2.32 time: 0.265020 Oct 24 10:43:40.693880 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2044/4128] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:40 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1604 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:40.726901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-b5568b68-5d09-4254-94a3-9be9c7bd6d4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] validate_networks() for [('734fc132-fff0-4bf7-9775-3a17fdcd25dc', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:43:40.993388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-61da66a6-fb6b-4bd5-bb14-3ac5f4f6ed0d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:40.994018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-61da66a6-fb6b-4bd5-bb14-3ac5f4f6ed0d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:41.005208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61da66a6-fb6b-4bd5-bb14-3ac5f4f6ed0d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:41.008526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61da66a6-fb6b-4bd5-bb14-3ac5f4f6ed0d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:41.009072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61da66a6-fb6b-4bd5-bb14-3ac5f4f6ed0d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:41.009804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61da66a6-fb6b-4bd5-bb14-3ac5f4f6ed0d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:41.010262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61da66a6-fb6b-4bd5-bb14-3ac5f4f6ed0d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:41.010935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61da66a6-fb6b-4bd5-bb14-3ac5f4f6ed0d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:41.565922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-61da66a6-fb6b-4bd5-bb14-3ac5f4f6ed0d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:41.579706 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-61da66a6-fb6b-4bd5-bb14-3ac5f4f6ed0d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1313 microversion: 2.1 time: 0.590764 Oct 24 10:43:41.582808 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2045/4129] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:40 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1313 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:41.738019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d0cbe780-7b45-4900-b06f-4e99c2e16108 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:41.739153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d0cbe780-7b45-4900-b06f-4e99c2e16108 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:41.762665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0cbe780-7b45-4900-b06f-4e99c2e16108 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:41.764911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0cbe780-7b45-4900-b06f-4e99c2e16108 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:41.766411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0cbe780-7b45-4900-b06f-4e99c2e16108 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:41.773427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0cbe780-7b45-4900-b06f-4e99c2e16108 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:41.774137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0cbe780-7b45-4900-b06f-4e99c2e16108 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:41.781167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0cbe780-7b45-4900-b06f-4e99c2e16108 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:41.949124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d0cbe780-7b45-4900-b06f-4e99c2e16108 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:41.982720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d0cbe780-7b45-4900-b06f-4e99c2e16108 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:41.987434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d0cbe780-7b45-4900-b06f-4e99c2e16108 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:41.991135 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d0cbe780-7b45-4900-b06f-4e99c2e16108 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1604 microversion: 2.32 time: 0.263133 Oct 24 10:43:41.992711 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2046/4130] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:41 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:43:41.999441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-1e206a14-9af3-41ff-9f0c-9eeb13a5bc41 req-8605d00e-be99-4e20-8eb9-606f15a5b643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2595b35-cdfc-4152-b325-ea712ff8b946", "name": "network-vif-deleted", "tag": "02b89d7c-b6a2-401d-89a3-9361e02645ab"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:42.026562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1e206a14-9af3-41ff-9f0c-9eeb13a5bc41 req-8605d00e-be99-4e20-8eb9-606f15a5b643 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:42.028713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1e206a14-9af3-41ff-9f0c-9eeb13a5bc41 req-8605d00e-be99-4e20-8eb9-606f15a5b643 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:42.029530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1e206a14-9af3-41ff-9f0c-9eeb13a5bc41 req-8605d00e-be99-4e20-8eb9-606f15a5b643 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:42.070019 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-1e206a14-9af3-41ff-9f0c-9eeb13a5bc41 req-8605d00e-be99-4e20-8eb9-606f15a5b643 service nova] Creating event network-vif-deleted:02b89d7c-b6a2-401d-89a3-9361e02645ab for instance f2595b35-cdfc-4152-b325-ea712ff8b946 on n-h2-858383-15 Oct 24 10:43:42.083269 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-1e206a14-9af3-41ff-9f0c-9eeb13a5bc41 req-8605d00e-be99-4e20-8eb9-606f15a5b643 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088604 Oct 24 10:43:42.085216 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2047/4131] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:43:42.390474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b5568b68-5d09-4254-94a3-9be9c7bd6d4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:43:42.391036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b5568b68-5d09-4254-94a3-9be9c7bd6d4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:43:42.391521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b5568b68-5d09-4254-94a3-9be9c7bd6d4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:43:42.391933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b5568b68-5d09-4254-94a3-9be9c7bd6d4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:43:42.392601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b5568b68-5d09-4254-94a3-9be9c7bd6d4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:43:42.418177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5568b68-5d09-4254-94a3-9be9c7bd6d4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:42.418692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5568b68-5d09-4254-94a3-9be9c7bd6d4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:42.419563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5568b68-5d09-4254-94a3-9be9c7bd6d4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:42.420479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5568b68-5d09-4254-94a3-9be9c7bd6d4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:42.421992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5568b68-5d09-4254-94a3-9be9c7bd6d4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:42.422632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5568b68-5d09-4254-94a3-9be9c7bd6d4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:42.499595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-b5568b68-5d09-4254-94a3-9be9c7bd6d4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Getting quotas for project 9ab3028765ba447589bf595a603ea2e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:43:42.518517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-b5568b68-5d09-4254-94a3-9be9c7bd6d4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Getting quotas for user ed058a5e8ac14236ab2e8783e9170346 and project 9ab3028765ba447589bf595a603ea2e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:43:42.554798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b5568b68-5d09-4254-94a3-9be9c7bd6d4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:43:42.559210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b5568b68-5d09-4254-94a3-9be9c7bd6d4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:43:42.604567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3efe31d1-0337-4840-9087-1254109d6cb6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:42.605657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3efe31d1-0337-4840-9087-1254109d6cb6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:42.617671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3efe31d1-0337-4840-9087-1254109d6cb6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:42.622260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3efe31d1-0337-4840-9087-1254109d6cb6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:42.627965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3efe31d1-0337-4840-9087-1254109d6cb6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:42.629906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3efe31d1-0337-4840-9087-1254109d6cb6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:42.634174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3efe31d1-0337-4840-9087-1254109d6cb6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:42.635865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3efe31d1-0337-4840-9087-1254109d6cb6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:42.694092 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b5568b68-5d09-4254-94a3-9be9c7bd6d4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.164165 Oct 24 10:43:42.695396 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2085/4132] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:43:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:43:42.706909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c280175e-ea2d-46cd-b889-2c1740e28184 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:42.707982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c280175e-ea2d-46cd-b889-2c1740e28184 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:42.851442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c280175e-ea2d-46cd-b889-2c1740e28184 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:42.867295 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c280175e-ea2d-46cd-b889-2c1740e28184 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 200 len: 1221 microversion: 2.1 time: 0.164799 Oct 24 10:43:42.868747 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2086/4133] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:42 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 1221 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:43.025144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3cc51bf9-5066-46c0-83d2-2a9523f3ec99 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:43.027384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3cc51bf9-5066-46c0-83d2-2a9523f3ec99 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:43.041312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cc51bf9-5066-46c0-83d2-2a9523f3ec99 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:43.042647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cc51bf9-5066-46c0-83d2-2a9523f3ec99 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:43.043835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cc51bf9-5066-46c0-83d2-2a9523f3ec99 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:43.048061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cc51bf9-5066-46c0-83d2-2a9523f3ec99 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:43.048920 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cc51bf9-5066-46c0-83d2-2a9523f3ec99 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:43.049922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cc51bf9-5066-46c0-83d2-2a9523f3ec99 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:43.288395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3cc51bf9-5066-46c0-83d2-2a9523f3ec99 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:43.299426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3cc51bf9-5066-46c0-83d2-2a9523f3ec99 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:43.301078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3cc51bf9-5066-46c0-83d2-2a9523f3ec99 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:43.309539 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3cc51bf9-5066-46c0-83d2-2a9523f3ec99 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1604 microversion: 2.32 time: 0.282208 Oct 24 10:43:43.333246 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2087/4134] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:43 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1604 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:43:43.382275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3efe31d1-0337-4840-9087-1254109d6cb6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:43.390705 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3efe31d1-0337-4840-9087-1254109d6cb6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1313 microversion: 2.1 time: 0.790407 Oct 24 10:43:43.393511 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2048/4135] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:42 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1313 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:43:43.895517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ebb1398a-7bd2-46c5-b749-017f802adaa0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:43.896720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ebb1398a-7bd2-46c5-b749-017f802adaa0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:43.911313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebb1398a-7bd2-46c5-b749-017f802adaa0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:43.911808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebb1398a-7bd2-46c5-b749-017f802adaa0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:43.912238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebb1398a-7bd2-46c5-b749-017f802adaa0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:43.927768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebb1398a-7bd2-46c5-b749-017f802adaa0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:43.928954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebb1398a-7bd2-46c5-b749-017f802adaa0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:43.929417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebb1398a-7bd2-46c5-b749-017f802adaa0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:44.111472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ebb1398a-7bd2-46c5-b749-017f802adaa0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:44.140198 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ebb1398a-7bd2-46c5-b749-017f802adaa0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 200 len: 1225 microversion: 2.1 time: 0.244335 Oct 24 10:43:44.141590 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2088/4136] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:43 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 1225 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:44.263852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1712247905", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1959546707", "security_groups": [{"name": "tempest-secgroup-smoke-1939026757"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "17326586-8c66-4094-8c57-68a038139f65"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:44.349065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a2178bdf-f063-4c91-806e-fb22bdc41cad tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:44.349786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a2178bdf-f063-4c91-806e-fb22bdc41cad tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:44.357283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2178bdf-f063-4c91-806e-fb22bdc41cad tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:44.358656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2178bdf-f063-4c91-806e-fb22bdc41cad tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:44.359262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2178bdf-f063-4c91-806e-fb22bdc41cad tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:44.360157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2178bdf-f063-4c91-806e-fb22bdc41cad tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:44.360774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2178bdf-f063-4c91-806e-fb22bdc41cad tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:44.361427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2178bdf-f063-4c91-806e-fb22bdc41cad tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:44.507953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] validate_networks() for [('17326586-8c66-4094-8c57-68a038139f65', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:43:44.521234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a2178bdf-f063-4c91-806e-fb22bdc41cad tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:44.534219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a2178bdf-f063-4c91-806e-fb22bdc41cad tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:44.535956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a2178bdf-f063-4c91-806e-fb22bdc41cad tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:44.537200 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a2178bdf-f063-4c91-806e-fb22bdc41cad tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1604 microversion: 2.32 time: 0.193523 Oct 24 10:43:44.557113 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2089/4137] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:44 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1604 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:43:44.562771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-60595dc4-0f1a-4b17-b48e-b0c94d40aa14 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:44.563791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-60595dc4-0f1a-4b17-b48e-b0c94d40aa14 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:44.570897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-60595dc4-0f1a-4b17-b48e-b0c94d40aa14 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:44.571602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-60595dc4-0f1a-4b17-b48e-b0c94d40aa14 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:44.572618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-60595dc4-0f1a-4b17-b48e-b0c94d40aa14 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:44.573574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-60595dc4-0f1a-4b17-b48e-b0c94d40aa14 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:44.574465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-60595dc4-0f1a-4b17-b48e-b0c94d40aa14 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:44.575111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-60595dc4-0f1a-4b17-b48e-b0c94d40aa14 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:44.866157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-60595dc4-0f1a-4b17-b48e-b0c94d40aa14 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:44.874176 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-60595dc4-0f1a-4b17-b48e-b0c94d40aa14 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1313 microversion: 2.1 time: 0.315649 Oct 24 10:43:44.874757 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2090/4138] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:44 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:45.168189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-632b13fa-2f6c-4c89-9765-f98675411b1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:45.168856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-632b13fa-2f6c-4c89-9765-f98675411b1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:45.183810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-632b13fa-2f6c-4c89-9765-f98675411b1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:45.187734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-632b13fa-2f6c-4c89-9765-f98675411b1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:45.192133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-632b13fa-2f6c-4c89-9765-f98675411b1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:45.194380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-632b13fa-2f6c-4c89-9765-f98675411b1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:45.194874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-632b13fa-2f6c-4c89-9765-f98675411b1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:45.195323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-632b13fa-2f6c-4c89-9765-f98675411b1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:45.203604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:45.320199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-632b13fa-2f6c-4c89-9765-f98675411b1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:45.347027 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-632b13fa-2f6c-4c89-9765-f98675411b1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 200 len: 1279 microversion: 2.1 time: 0.182588 Oct 24 10:43:45.347699 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2091/4139] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:45 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 1279 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:45.565356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-329eeb6d-4eab-444e-91aa-bab07220d06f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:45.566251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-329eeb6d-4eab-444e-91aa-bab07220d06f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:45.591338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-329eeb6d-4eab-444e-91aa-bab07220d06f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:45.591852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-329eeb6d-4eab-444e-91aa-bab07220d06f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:45.592303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-329eeb6d-4eab-444e-91aa-bab07220d06f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:45.593064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-329eeb6d-4eab-444e-91aa-bab07220d06f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:45.593529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-329eeb6d-4eab-444e-91aa-bab07220d06f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:45.593967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-329eeb6d-4eab-444e-91aa-bab07220d06f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:46.274819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-329eeb6d-4eab-444e-91aa-bab07220d06f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:46.287101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-329eeb6d-4eab-444e-91aa-bab07220d06f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:46.299398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-329eeb6d-4eab-444e-91aa-bab07220d06f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:46.300649 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-329eeb6d-4eab-444e-91aa-bab07220d06f tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1604 microversion: 2.32 time: 0.740891 Oct 24 10:43:46.301593 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2092/4140] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:45 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1604 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:43:46.323594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5f1042f0-4c1c-48dd-8289-c6ebceb010bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:46.324212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5f1042f0-4c1c-48dd-8289-c6ebceb010bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:46.335318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f1042f0-4c1c-48dd-8289-c6ebceb010bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:46.335820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f1042f0-4c1c-48dd-8289-c6ebceb010bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:46.336776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f1042f0-4c1c-48dd-8289-c6ebceb010bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:46.337529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f1042f0-4c1c-48dd-8289-c6ebceb010bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:46.338941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f1042f0-4c1c-48dd-8289-c6ebceb010bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:46.341100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f1042f0-4c1c-48dd-8289-c6ebceb010bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:46.343278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Getting quotas for project c43199c732c141d893e52e2bb1c751e2. Resources: dict_keys(['metadata_items']) {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:43:46.360660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Getting quotas for user d4107e4d2df9455d9ec35a2bee1eacc8 and project c43199c732c141d893e52e2bb1c751e2. Resources: dict_keys(['metadata_items']) {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:43:46.409168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:43:46.412315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:43:46.413100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:43:46.413867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:43:46.414606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:43:46.438816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:46.440778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:46.441420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:46.442420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:46.443061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:46.443663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:46.473586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Getting quotas for project c43199c732c141d893e52e2bb1c751e2. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:43:46.481893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Getting quotas for user d4107e4d2df9455d9ec35a2bee1eacc8 and project c43199c732c141d893e52e2bb1c751e2. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:43:46.516429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:43:46.520043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:43:46.603300 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1be32500-4eb5-434b-81bc-89fae1df8388 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.343355 Oct 24 10:43:46.605644 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2049/4141] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:43:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 2347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:43:46.619222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-9d373d46-8548-4944-b266-c8342a90aa68 req-006642c2-f404-4d75-87ff-9a8ca4343b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8024a63d-01f0-45d1-81c2-99c962acee10", "name": "network-vif-plugged", "status": "completed", "tag": "1e175526-806a-4cdd-9347-5e7224e1da5e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:46.644793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9d373d46-8548-4944-b266-c8342a90aa68 req-006642c2-f404-4d75-87ff-9a8ca4343b1e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:46.647642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9d373d46-8548-4944-b266-c8342a90aa68 req-006642c2-f404-4d75-87ff-9a8ca4343b1e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:46.648147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9d373d46-8548-4944-b266-c8342a90aa68 req-006642c2-f404-4d75-87ff-9a8ca4343b1e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:46.675525 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-9d373d46-8548-4944-b266-c8342a90aa68 req-006642c2-f404-4d75-87ff-9a8ca4343b1e service nova] Creating event network-vif-plugged:1e175526-806a-4cdd-9347-5e7224e1da5e for instance 8024a63d-01f0-45d1-81c2-99c962acee10 on n-h1-858383-15 Oct 24 10:43:46.687781 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-9d373d46-8548-4944-b266-c8342a90aa68 req-006642c2-f404-4d75-87ff-9a8ca4343b1e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079130 Oct 24 10:43:46.691909 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2050/4142] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:43:46.707403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-72697634-17b8-4692-9bd6-5ddc36394436 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:46.710501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-72697634-17b8-4692-9bd6-5ddc36394436 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:46.725497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72697634-17b8-4692-9bd6-5ddc36394436 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:46.726019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72697634-17b8-4692-9bd6-5ddc36394436 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:46.726475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72697634-17b8-4692-9bd6-5ddc36394436 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:46.727209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72697634-17b8-4692-9bd6-5ddc36394436 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:46.730746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5f1042f0-4c1c-48dd-8289-c6ebceb010bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:46.733195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72697634-17b8-4692-9bd6-5ddc36394436 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:46.734519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72697634-17b8-4692-9bd6-5ddc36394436 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:46.745382 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5f1042f0-4c1c-48dd-8289-c6ebceb010bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1313 microversion: 2.1 time: 0.442544 Oct 24 10:43:46.766537 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2093/4143] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:46 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:46.784298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b2d0c20f-cbd1-433f-a966-61876dcb9894 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:46.786285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b2d0c20f-cbd1-433f-a966-61876dcb9894 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:46.934981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b2d0c20f-cbd1-433f-a966-61876dcb9894 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:46.943308 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b2d0c20f-cbd1-433f-a966-61876dcb9894 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1303 microversion: 2.1 time: 0.174645 Oct 24 10:43:46.948595 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2094/4144] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:46 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1303 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:47.211386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-72697634-17b8-4692-9bd6-5ddc36394436 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:47.246928 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-72697634-17b8-4692-9bd6-5ddc36394436 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 200 len: 1321 microversion: 2.1 time: 0.552051 Oct 24 10:43:47.263056 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2051/4145] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:46 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 1321 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:47.329758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6d13ec0e-4b7d-474b-92bb-fd0667791745 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:47.330615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6d13ec0e-4b7d-474b-92bb-fd0667791745 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:47.346219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d13ec0e-4b7d-474b-92bb-fd0667791745 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:47.347236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d13ec0e-4b7d-474b-92bb-fd0667791745 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:47.347713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d13ec0e-4b7d-474b-92bb-fd0667791745 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:47.354825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d13ec0e-4b7d-474b-92bb-fd0667791745 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:47.355615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d13ec0e-4b7d-474b-92bb-fd0667791745 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:47.356929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d13ec0e-4b7d-474b-92bb-fd0667791745 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:47.489368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6d13ec0e-4b7d-474b-92bb-fd0667791745 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:47.499041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6d13ec0e-4b7d-474b-92bb-fd0667791745 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:47.500608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6d13ec0e-4b7d-474b-92bb-fd0667791745 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:47.506105 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6d13ec0e-4b7d-474b-92bb-fd0667791745 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1604 microversion: 2.32 time: 0.180892 Oct 24 10:43:47.507191 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2095/4146] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:47 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1604 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:47.773229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1ffaa3e2-2fe2-4345-9581-60ef3d515e92 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:47.773860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1ffaa3e2-2fe2-4345-9581-60ef3d515e92 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:47.779773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:47.795750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ffaa3e2-2fe2-4345-9581-60ef3d515e92 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:47.796590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ffaa3e2-2fe2-4345-9581-60ef3d515e92 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:47.797276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ffaa3e2-2fe2-4345-9581-60ef3d515e92 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:47.798239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ffaa3e2-2fe2-4345-9581-60ef3d515e92 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:47.800220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ffaa3e2-2fe2-4345-9581-60ef3d515e92 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:47.801116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ffaa3e2-2fe2-4345-9581-60ef3d515e92 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:47.976537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7b9fc0ad-bf0f-4593-9e09-7bef19d23389 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:47.977437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7b9fc0ad-bf0f-4593-9e09-7bef19d23389 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:47.987485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b9fc0ad-bf0f-4593-9e09-7bef19d23389 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:47.989333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b9fc0ad-bf0f-4593-9e09-7bef19d23389 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:47.992356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b9fc0ad-bf0f-4593-9e09-7bef19d23389 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:47.994137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b9fc0ad-bf0f-4593-9e09-7bef19d23389 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:47.996924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b9fc0ad-bf0f-4593-9e09-7bef19d23389 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:47.997539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b9fc0ad-bf0f-4593-9e09-7bef19d23389 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:48.044542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1ffaa3e2-2fe2-4345-9581-60ef3d515e92 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:48.059618 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1ffaa3e2-2fe2-4345-9581-60ef3d515e92 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1313 microversion: 2.1 time: 0.294281 Oct 24 10:43:48.060429 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2052/4147] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:47 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:48.117884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7b9fc0ad-bf0f-4593-9e09-7bef19d23389 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:48.143594 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7b9fc0ad-bf0f-4593-9e09-7bef19d23389 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1307 microversion: 2.1 time: 0.169668 Oct 24 10:43:48.144746 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2096/4148] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:47 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1307 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:43:48.278696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c1f14ba4-0a06-490c-baf6-c44337afba19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:48.279706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c1f14ba4-0a06-490c-baf6-c44337afba19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:48.295654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1f14ba4-0a06-490c-baf6-c44337afba19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:48.296189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1f14ba4-0a06-490c-baf6-c44337afba19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:48.296649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1f14ba4-0a06-490c-baf6-c44337afba19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:48.301942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1f14ba4-0a06-490c-baf6-c44337afba19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:48.303420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1f14ba4-0a06-490c-baf6-c44337afba19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:48.305152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1f14ba4-0a06-490c-baf6-c44337afba19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:48.541328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e25e4824-a4fe-4883-b707-14d8b57913d8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:48.543280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e25e4824-a4fe-4883-b707-14d8b57913d8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:48.559258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e25e4824-a4fe-4883-b707-14d8b57913d8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:48.565118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e25e4824-a4fe-4883-b707-14d8b57913d8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:48.567406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e25e4824-a4fe-4883-b707-14d8b57913d8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:48.568357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e25e4824-a4fe-4883-b707-14d8b57913d8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:48.570275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e25e4824-a4fe-4883-b707-14d8b57913d8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:48.571393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e25e4824-a4fe-4883-b707-14d8b57913d8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:48.586251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c1f14ba4-0a06-490c-baf6-c44337afba19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:48.595954 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c1f14ba4-0a06-490c-baf6-c44337afba19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 200 len: 1321 microversion: 2.1 time: 0.321073 Oct 24 10:43:48.596554 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2053/4149] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:48 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:48.750652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e25e4824-a4fe-4883-b707-14d8b57913d8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:48.773877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e25e4824-a4fe-4883-b707-14d8b57913d8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:48.778508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e25e4824-a4fe-4883-b707-14d8b57913d8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:48.781656 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e25e4824-a4fe-4883-b707-14d8b57913d8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1604 microversion: 2.32 time: 0.248450 Oct 24 10:43:48.786226 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2097/4150] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:48 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1604 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:43:48.992912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-7acd9cbd-e2b0-4254-a4ec-58f3ebd4d04a req-db1b400a-4b58-4b84-afda-86d4590f2567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a8d0dbd-d76e-49fe-9120-796e315a72d1", "tag": "69c9cea8-b78f-4525-8b98-b05b0f455368"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:49.021813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7acd9cbd-e2b0-4254-a4ec-58f3ebd4d04a req-db1b400a-4b58-4b84-afda-86d4590f2567 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:49.022535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7acd9cbd-e2b0-4254-a4ec-58f3ebd4d04a req-db1b400a-4b58-4b84-afda-86d4590f2567 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:49.028105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7acd9cbd-e2b0-4254-a4ec-58f3ebd4d04a req-db1b400a-4b58-4b84-afda-86d4590f2567 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:49.056828 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-7acd9cbd-e2b0-4254-a4ec-58f3ebd4d04a req-db1b400a-4b58-4b84-afda-86d4590f2567 service nova] Creating event network-changed:69c9cea8-b78f-4525-8b98-b05b0f455368 for instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 on n-h2-858383-15 Oct 24 10:43:49.074683 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-7acd9cbd-e2b0-4254-a4ec-58f3ebd4d04a req-db1b400a-4b58-4b84-afda-86d4590f2567 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083196 Oct 24 10:43:49.077161 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2054/4151] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:43:49.092484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bf53b915-8739-4c46-8bb6-e03be728e015 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:49.097481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bf53b915-8739-4c46-8bb6-e03be728e015 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:49.113884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf53b915-8739-4c46-8bb6-e03be728e015 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:49.116291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf53b915-8739-4c46-8bb6-e03be728e015 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:49.118821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf53b915-8739-4c46-8bb6-e03be728e015 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:49.120496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf53b915-8739-4c46-8bb6-e03be728e015 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:49.121718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf53b915-8739-4c46-8bb6-e03be728e015 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:49.125736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf53b915-8739-4c46-8bb6-e03be728e015 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:49.169602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6a662d92-c779-4cd5-a6fb-333e2d7beabb tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:49.170990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6a662d92-c779-4cd5-a6fb-333e2d7beabb tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:49.193477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a662d92-c779-4cd5-a6fb-333e2d7beabb tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:49.198493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a662d92-c779-4cd5-a6fb-333e2d7beabb tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:49.198970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a662d92-c779-4cd5-a6fb-333e2d7beabb tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:49.204241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a662d92-c779-4cd5-a6fb-333e2d7beabb tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:49.204756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a662d92-c779-4cd5-a6fb-333e2d7beabb tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:49.205764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a662d92-c779-4cd5-a6fb-333e2d7beabb tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:49.422145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6a662d92-c779-4cd5-a6fb-333e2d7beabb tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:49.435501 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6a662d92-c779-4cd5-a6fb-333e2d7beabb tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1355 microversion: 2.1 time: 0.270808 Oct 24 10:43:49.439855 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2055/4152] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:49 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1355 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:49.569467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bf53b915-8739-4c46-8bb6-e03be728e015 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:49.594652 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bf53b915-8739-4c46-8bb6-e03be728e015 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1499 microversion: 2.1 time: 0.510202 Oct 24 10:43:49.595545 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2098/4153] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:49 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1499 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:49.630511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-49622e7b-c8a6-4382-b708-ca7e1a820c19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:49.632049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-49622e7b-c8a6-4382-b708-ca7e1a820c19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:49.633022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e69822ef-d72e-433b-a25c-dac206befde7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:49.639477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e69822ef-d72e-433b-a25c-dac206befde7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:49.654709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49622e7b-c8a6-4382-b708-ca7e1a820c19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:49.655928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49622e7b-c8a6-4382-b708-ca7e1a820c19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:49.656462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49622e7b-c8a6-4382-b708-ca7e1a820c19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:49.661302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49622e7b-c8a6-4382-b708-ca7e1a820c19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:49.662460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e69822ef-d72e-433b-a25c-dac206befde7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:49.662939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e69822ef-d72e-433b-a25c-dac206befde7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:49.663383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e69822ef-d72e-433b-a25c-dac206befde7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:49.664169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e69822ef-d72e-433b-a25c-dac206befde7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:49.664631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e69822ef-d72e-433b-a25c-dac206befde7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:49.665755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49622e7b-c8a6-4382-b708-ca7e1a820c19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:49.667260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49622e7b-c8a6-4382-b708-ca7e1a820c19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:49.676130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e69822ef-d72e-433b-a25c-dac206befde7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:49.728896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-e69822ef-d72e-433b-a25c-dac206befde7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lazy-loading 'flavor' on Instance uuid 8024a63d-01f0-45d1-81c2-99c962acee10 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:43:49.872496 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e69822ef-d72e-433b-a25c-dac206befde7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "POST /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10/action" status: 200 len: 32 microversion: 2.1 time: 0.253729 Oct 24 10:43:49.873978 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2099/4154] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:43:49 2022] POST /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10/action => generated 32 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:43:49.881158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-27b3dcbf-3593-46e9-b6b9-6c9616fad6d2 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:49.882627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-27b3dcbf-3593-46e9-b6b9-6c9616fad6d2 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:49.890379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27b3dcbf-3593-46e9-b6b9-6c9616fad6d2 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:49.891365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27b3dcbf-3593-46e9-b6b9-6c9616fad6d2 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:49.897339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27b3dcbf-3593-46e9-b6b9-6c9616fad6d2 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:49.898592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27b3dcbf-3593-46e9-b6b9-6c9616fad6d2 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:49.899346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27b3dcbf-3593-46e9-b6b9-6c9616fad6d2 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:49.900091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27b3dcbf-3593-46e9-b6b9-6c9616fad6d2 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:50.088433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-27b3dcbf-3593-46e9-b6b9-6c9616fad6d2 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:50.105594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-27b3dcbf-3593-46e9-b6b9-6c9616fad6d2 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:50.110273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-27b3dcbf-3593-46e9-b6b9-6c9616fad6d2 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:50.115690 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-27b3dcbf-3593-46e9-b6b9-6c9616fad6d2 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1604 microversion: 2.32 time: 0.239815 Oct 24 10:43:50.117600 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2100/4155] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:49 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:50.129403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b0ed8f01-b7b9-4070-99d8-72f5fa2deba5 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:50.131049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b0ed8f01-b7b9-4070-99d8-72f5fa2deba5 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:50.146280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b0ed8f01-b7b9-4070-99d8-72f5fa2deba5 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:50.146779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b0ed8f01-b7b9-4070-99d8-72f5fa2deba5 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:50.147222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b0ed8f01-b7b9-4070-99d8-72f5fa2deba5 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:50.155938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b0ed8f01-b7b9-4070-99d8-72f5fa2deba5 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:50.156446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b0ed8f01-b7b9-4070-99d8-72f5fa2deba5 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:50.156935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b0ed8f01-b7b9-4070-99d8-72f5fa2deba5 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:50.192707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-49622e7b-c8a6-4382-b708-ca7e1a820c19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:50.202869 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-49622e7b-c8a6-4382-b708-ca7e1a820c19 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 200 len: 1321 microversion: 2.1 time: 0.586504 Oct 24 10:43:50.203735 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2056/4156] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:49 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 1321 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:50.466993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ac732e6d-ab12-46e2-a711-42293ad1e7b5 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:50.467799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ac732e6d-ab12-46e2-a711-42293ad1e7b5 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:50.478460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac732e6d-ab12-46e2-a711-42293ad1e7b5 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:50.479273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac732e6d-ab12-46e2-a711-42293ad1e7b5 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:50.479902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac732e6d-ab12-46e2-a711-42293ad1e7b5 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:50.481898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac732e6d-ab12-46e2-a711-42293ad1e7b5 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:50.482371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac732e6d-ab12-46e2-a711-42293ad1e7b5 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:50.482808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac732e6d-ab12-46e2-a711-42293ad1e7b5 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:50.536705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b0ed8f01-b7b9-4070-99d8-72f5fa2deba5 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:50.551840 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b0ed8f01-b7b9-4070-99d8-72f5fa2deba5 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1505 microversion: 2.1 time: 0.432883 Oct 24 10:43:50.552588 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2101/4157] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:50 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1505 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:50.619900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ac732e6d-ab12-46e2-a711-42293ad1e7b5 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:50.638957 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ac732e6d-ab12-46e2-a711-42293ad1e7b5 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1361 microversion: 2.1 time: 0.175982 Oct 24 10:43:50.644358 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2057/4158] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:50 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:51.154447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e7a1ae7c-782c-4110-8f0c-5219cac0ddb3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:51.155166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e7a1ae7c-782c-4110-8f0c-5219cac0ddb3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:51.169078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7a1ae7c-782c-4110-8f0c-5219cac0ddb3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:51.172429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7a1ae7c-782c-4110-8f0c-5219cac0ddb3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:51.174818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7a1ae7c-782c-4110-8f0c-5219cac0ddb3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:51.175661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7a1ae7c-782c-4110-8f0c-5219cac0ddb3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:51.176353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7a1ae7c-782c-4110-8f0c-5219cac0ddb3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:51.177925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7a1ae7c-782c-4110-8f0c-5219cac0ddb3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:51.231367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e74d3040-bca7-4150-81d4-1674d4237c00 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:51.232783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e74d3040-bca7-4150-81d4-1674d4237c00 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:51.244908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e74d3040-bca7-4150-81d4-1674d4237c00 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:51.262396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e74d3040-bca7-4150-81d4-1674d4237c00 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:51.265848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e74d3040-bca7-4150-81d4-1674d4237c00 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:51.273867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e74d3040-bca7-4150-81d4-1674d4237c00 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:51.280483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e74d3040-bca7-4150-81d4-1674d4237c00 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:51.282479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e74d3040-bca7-4150-81d4-1674d4237c00 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:51.334187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e7a1ae7c-782c-4110-8f0c-5219cac0ddb3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:51.348138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e7a1ae7c-782c-4110-8f0c-5219cac0ddb3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:51.349855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e7a1ae7c-782c-4110-8f0c-5219cac0ddb3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:51.355012 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e7a1ae7c-782c-4110-8f0c-5219cac0ddb3 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1604 microversion: 2.32 time: 0.206483 Oct 24 10:43:51.359187 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2102/4159] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:51 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1604 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:51.507528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e74d3040-bca7-4150-81d4-1674d4237c00 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:51.517879 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e74d3040-bca7-4150-81d4-1674d4237c00 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 200 len: 1321 microversion: 2.1 time: 0.289667 Oct 24 10:43:51.519364 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2058/4160] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:51 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:51.577464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b065b98f-e468-424b-87cd-08230fd441e7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:51.578327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b065b98f-e468-424b-87cd-08230fd441e7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:51.586879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b065b98f-e468-424b-87cd-08230fd441e7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:51.587586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b065b98f-e468-424b-87cd-08230fd441e7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:51.588632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b065b98f-e468-424b-87cd-08230fd441e7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:51.589543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b065b98f-e468-424b-87cd-08230fd441e7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:51.590653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b065b98f-e468-424b-87cd-08230fd441e7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:51.591322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b065b98f-e468-424b-87cd-08230fd441e7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:51.667631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e84f9451-f708-4d94-9b35-071561fd6581 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:51.668257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e84f9451-f708-4d94-9b35-071561fd6581 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:51.678447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e84f9451-f708-4d94-9b35-071561fd6581 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:51.678951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e84f9451-f708-4d94-9b35-071561fd6581 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:51.679395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e84f9451-f708-4d94-9b35-071561fd6581 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:51.685733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e84f9451-f708-4d94-9b35-071561fd6581 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:51.686221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e84f9451-f708-4d94-9b35-071561fd6581 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:51.686661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e84f9451-f708-4d94-9b35-071561fd6581 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:51.771479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e84f9451-f708-4d94-9b35-071561fd6581 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:51.793523 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e84f9451-f708-4d94-9b35-071561fd6581 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1361 microversion: 2.1 time: 0.119175 Oct 24 10:43:51.794754 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2059/4161] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:51 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1361 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:43:51.848497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b065b98f-e468-424b-87cd-08230fd441e7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:51.857450 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b065b98f-e468-424b-87cd-08230fd441e7 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1505 microversion: 2.1 time: 0.283816 Oct 24 10:43:51.858242 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2103/4162] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:51 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:52.386445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-89a6468a-799e-4621-ae04-9e3d89b6a6db tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:52.387371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-89a6468a-799e-4621-ae04-9e3d89b6a6db tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:52.396824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89a6468a-799e-4621-ae04-9e3d89b6a6db tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:52.397630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89a6468a-799e-4621-ae04-9e3d89b6a6db tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:52.398237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89a6468a-799e-4621-ae04-9e3d89b6a6db tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:52.399058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89a6468a-799e-4621-ae04-9e3d89b6a6db tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:52.399611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89a6468a-799e-4621-ae04-9e3d89b6a6db tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:52.400383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89a6468a-799e-4621-ae04-9e3d89b6a6db tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:52.538111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-89a6468a-799e-4621-ae04-9e3d89b6a6db tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:52.542765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8ccb0acb-046e-4a60-af84-f6019481769f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:52.543389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8ccb0acb-046e-4a60-af84-f6019481769f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:52.551457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-89a6468a-799e-4621-ae04-9e3d89b6a6db tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:52.553019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:52.554410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-89a6468a-799e-4621-ae04-9e3d89b6a6db tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:52.554547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ccb0acb-046e-4a60-af84-f6019481769f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:52.555026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ccb0acb-046e-4a60-af84-f6019481769f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:52.555471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ccb0acb-046e-4a60-af84-f6019481769f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:52.556180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ccb0acb-046e-4a60-af84-f6019481769f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:52.556646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ccb0acb-046e-4a60-af84-f6019481769f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:52.556795 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-89a6468a-799e-4621-ae04-9e3d89b6a6db tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1604 microversion: 2.32 time: 0.175394 Oct 24 10:43:52.557089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ccb0acb-046e-4a60-af84-f6019481769f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:52.557825 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2060/4163] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:52 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1604 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:52.811712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8ccb0acb-046e-4a60-af84-f6019481769f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:52.819140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4806c895-c377-403c-ba6e-6fca7e98430b tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:52.819780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4806c895-c377-403c-ba6e-6fca7e98430b tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:52.830418 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8ccb0acb-046e-4a60-af84-f6019481769f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 200 len: 1321 microversion: 2.1 time: 0.290735 Oct 24 10:43:52.830764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4806c895-c377-403c-ba6e-6fca7e98430b tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:52.831532 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2104/4164] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:52 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:43:52.842436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4806c895-c377-403c-ba6e-6fca7e98430b tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:52.842899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4806c895-c377-403c-ba6e-6fca7e98430b tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:52.843651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4806c895-c377-403c-ba6e-6fca7e98430b tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:52.844113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4806c895-c377-403c-ba6e-6fca7e98430b tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:52.844541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4806c895-c377-403c-ba6e-6fca7e98430b tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:52.884971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9f985a48-1de4-4efa-8d51-48f2e313e6a3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:52.886102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9f985a48-1de4-4efa-8d51-48f2e313e6a3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:52.897169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f985a48-1de4-4efa-8d51-48f2e313e6a3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:52.898846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f985a48-1de4-4efa-8d51-48f2e313e6a3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:52.899516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f985a48-1de4-4efa-8d51-48f2e313e6a3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:52.903619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f985a48-1de4-4efa-8d51-48f2e313e6a3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:52.904109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f985a48-1de4-4efa-8d51-48f2e313e6a3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:52.906232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f985a48-1de4-4efa-8d51-48f2e313e6a3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:53.156592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9f985a48-1de4-4efa-8d51-48f2e313e6a3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:53.166414 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9f985a48-1de4-4efa-8d51-48f2e313e6a3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1505 microversion: 2.1 time: 0.286162 Oct 24 10:43:53.170360 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2105/4165] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:52 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1505 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:53.178177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4806c895-c377-403c-ba6e-6fca7e98430b tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:53.195031 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4806c895-c377-403c-ba6e-6fca7e98430b tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1429 microversion: 2.1 time: 0.380010 Oct 24 10:43:53.209608 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2061/4166] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:52 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1429 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:53.583624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d9a8e998-2230-4163-985c-15af4c74e6d6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:53.584241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d9a8e998-2230-4163-985c-15af4c74e6d6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:53.591609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9a8e998-2230-4163-985c-15af4c74e6d6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:53.592095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9a8e998-2230-4163-985c-15af4c74e6d6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:53.592563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9a8e998-2230-4163-985c-15af4c74e6d6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:53.593265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9a8e998-2230-4163-985c-15af4c74e6d6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:53.593898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9a8e998-2230-4163-985c-15af4c74e6d6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:53.594475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d9a8e998-2230-4163-985c-15af4c74e6d6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:53.680404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d9a8e998-2230-4163-985c-15af4c74e6d6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:53.686429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:53.697656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d9a8e998-2230-4163-985c-15af4c74e6d6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:53.702667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d9a8e998-2230-4163-985c-15af4c74e6d6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:53.705820 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d9a8e998-2230-4163-985c-15af4c74e6d6 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1604 microversion: 2.32 time: 0.126860 Oct 24 10:43:53.706610 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2106/4167] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:53 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1604 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:53.859319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-51b4a9c4-179f-409e-9c4d-241d623f45fb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:53.859941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-51b4a9c4-179f-409e-9c4d-241d623f45fb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:53.868182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51b4a9c4-179f-409e-9c4d-241d623f45fb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:53.869108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51b4a9c4-179f-409e-9c4d-241d623f45fb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:53.869757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51b4a9c4-179f-409e-9c4d-241d623f45fb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:53.870721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51b4a9c4-179f-409e-9c4d-241d623f45fb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:53.871389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51b4a9c4-179f-409e-9c4d-241d623f45fb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:53.872390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51b4a9c4-179f-409e-9c4d-241d623f45fb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:54.112776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-51b4a9c4-179f-409e-9c4d-241d623f45fb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:54.129206 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-51b4a9c4-179f-409e-9c4d-241d623f45fb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 200 len: 1321 microversion: 2.1 time: 0.270855 Oct 24 10:43:54.130488 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2062/4168] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:53 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:54.195284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3a90f2f2-3056-42a7-95b8-8ec350fd6d27 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:54.196086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3a90f2f2-3056-42a7-95b8-8ec350fd6d27 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:54.210786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a90f2f2-3056-42a7-95b8-8ec350fd6d27 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:54.219438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-15b77fdf-199d-4982-9518-8deca1c8aeef tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:54.220207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-15b77fdf-199d-4982-9518-8deca1c8aeef tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:54.227665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a90f2f2-3056-42a7-95b8-8ec350fd6d27 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:54.229318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a90f2f2-3056-42a7-95b8-8ec350fd6d27 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:54.231152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15b77fdf-199d-4982-9518-8deca1c8aeef tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:54.233421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a90f2f2-3056-42a7-95b8-8ec350fd6d27 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:54.234050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a90f2f2-3056-42a7-95b8-8ec350fd6d27 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:54.236096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15b77fdf-199d-4982-9518-8deca1c8aeef tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:54.237549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15b77fdf-199d-4982-9518-8deca1c8aeef tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:54.237811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a90f2f2-3056-42a7-95b8-8ec350fd6d27 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:54.238401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15b77fdf-199d-4982-9518-8deca1c8aeef tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:54.238864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15b77fdf-199d-4982-9518-8deca1c8aeef tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:54.239343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15b77fdf-199d-4982-9518-8deca1c8aeef tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:54.714071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3a90f2f2-3056-42a7-95b8-8ec350fd6d27 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:54.728567 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3a90f2f2-3056-42a7-95b8-8ec350fd6d27 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1505 microversion: 2.1 time: 0.539211 Oct 24 10:43:54.732584 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2107/4169] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:54 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:54.744635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-91467669-6d95-4d36-95a4-eef7ad30171c tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:54.745618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-91467669-6d95-4d36-95a4-eef7ad30171c tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:54.754804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91467669-6d95-4d36-95a4-eef7ad30171c tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:54.756381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91467669-6d95-4d36-95a4-eef7ad30171c tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:54.757524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91467669-6d95-4d36-95a4-eef7ad30171c tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:54.759330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91467669-6d95-4d36-95a4-eef7ad30171c tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:54.760125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91467669-6d95-4d36-95a4-eef7ad30171c tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:54.761171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91467669-6d95-4d36-95a4-eef7ad30171c tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:54.843643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-15b77fdf-199d-4982-9518-8deca1c8aeef tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:54.855321 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-15b77fdf-199d-4982-9518-8deca1c8aeef tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1429 microversion: 2.1 time: 0.640566 Oct 24 10:43:54.857722 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2063/4170] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:54 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1429 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:43:54.865771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ca042f12-46e5-4605-bd1c-675b9997127f req-7664c039-1d5b-47b6-874e-ff7d504a75f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "161edb66-41db-4070-8b7b-81c318cde03a", "tag": "0a0278ee-b58d-4340-bbf3-0cc59d2bb857"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:54.889064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ca042f12-46e5-4605-bd1c-675b9997127f req-7664c039-1d5b-47b6-874e-ff7d504a75f2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:54.889557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ca042f12-46e5-4605-bd1c-675b9997127f req-7664c039-1d5b-47b6-874e-ff7d504a75f2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:54.890066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ca042f12-46e5-4605-bd1c-675b9997127f req-7664c039-1d5b-47b6-874e-ff7d504a75f2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:54.906597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:54.931687 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ca042f12-46e5-4605-bd1c-675b9997127f req-7664c039-1d5b-47b6-874e-ff7d504a75f2 service nova] Creating event network-changed:0a0278ee-b58d-4340-bbf3-0cc59d2bb857 for instance 161edb66-41db-4070-8b7b-81c318cde03a on n-h1-858383-15 Oct 24 10:43:54.938610 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ca042f12-46e5-4605-bd1c-675b9997127f req-7664c039-1d5b-47b6-874e-ff7d504a75f2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079012 Oct 24 10:43:54.944346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-91467669-6d95-4d36-95a4-eef7ad30171c tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:54.959320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-91467669-6d95-4d36-95a4-eef7ad30171c tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:54.961400 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2064/4171] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:43:54.963252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-91467669-6d95-4d36-95a4-eef7ad30171c tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:54.964478 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-91467669-6d95-4d36-95a4-eef7ad30171c tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1604 microversion: 2.32 time: 0.229650 Oct 24 10:43:54.966392 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2108/4172] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:54 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1604 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:55.166228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ddec5d12-560a-48b0-ac6b-1af46d2e9a25 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:55.167323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ddec5d12-560a-48b0-ac6b-1af46d2e9a25 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:55.179143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddec5d12-560a-48b0-ac6b-1af46d2e9a25 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:55.179978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddec5d12-560a-48b0-ac6b-1af46d2e9a25 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:55.180628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddec5d12-560a-48b0-ac6b-1af46d2e9a25 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:55.181721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddec5d12-560a-48b0-ac6b-1af46d2e9a25 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:55.182727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddec5d12-560a-48b0-ac6b-1af46d2e9a25 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:55.183569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddec5d12-560a-48b0-ac6b-1af46d2e9a25 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:55.528824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ddec5d12-560a-48b0-ac6b-1af46d2e9a25 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:55.538086 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ddec5d12-560a-48b0-ac6b-1af46d2e9a25 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 200 len: 1321 microversion: 2.1 time: 0.382605 Oct 24 10:43:55.538676 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2065/4173] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:55 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 1321 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:55.757782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-92b643ce-64af-4c0a-a865-0f0fca51f039 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:55.758406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-92b643ce-64af-4c0a-a865-0f0fca51f039 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:55.769646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92b643ce-64af-4c0a-a865-0f0fca51f039 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:55.770869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92b643ce-64af-4c0a-a865-0f0fca51f039 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:55.773362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92b643ce-64af-4c0a-a865-0f0fca51f039 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:55.775775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92b643ce-64af-4c0a-a865-0f0fca51f039 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:55.776427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92b643ce-64af-4c0a-a865-0f0fca51f039 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:55.777893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92b643ce-64af-4c0a-a865-0f0fca51f039 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:55.882371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3cf3cc5f-05aa-4b53-8a65-c9066982978f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:55.883717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3cf3cc5f-05aa-4b53-8a65-c9066982978f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:55.897428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cf3cc5f-05aa-4b53-8a65-c9066982978f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:55.900932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cf3cc5f-05aa-4b53-8a65-c9066982978f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:55.901559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cf3cc5f-05aa-4b53-8a65-c9066982978f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:55.902420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cf3cc5f-05aa-4b53-8a65-c9066982978f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:55.903813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cf3cc5f-05aa-4b53-8a65-c9066982978f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:55.905859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cf3cc5f-05aa-4b53-8a65-c9066982978f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:55.994109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-92b643ce-64af-4c0a-a865-0f0fca51f039 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:56.008013 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-92b643ce-64af-4c0a-a865-0f0fca51f039 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1505 microversion: 2.1 time: 0.254244 Oct 24 10:43:56.021847 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2109/4174] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:55 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:56.032907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4a0b9c2e-35fb-4b5e-9f42-94a97fcc76bb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:56.034667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4a0b9c2e-35fb-4b5e-9f42-94a97fcc76bb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:56.042417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a0b9c2e-35fb-4b5e-9f42-94a97fcc76bb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:56.043260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a0b9c2e-35fb-4b5e-9f42-94a97fcc76bb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:56.044057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a0b9c2e-35fb-4b5e-9f42-94a97fcc76bb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:56.044976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a0b9c2e-35fb-4b5e-9f42-94a97fcc76bb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:56.045653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a0b9c2e-35fb-4b5e-9f42-94a97fcc76bb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:56.046272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a0b9c2e-35fb-4b5e-9f42-94a97fcc76bb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:56.175724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4a0b9c2e-35fb-4b5e-9f42-94a97fcc76bb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:56.197081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4a0b9c2e-35fb-4b5e-9f42-94a97fcc76bb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:56.199721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4a0b9c2e-35fb-4b5e-9f42-94a97fcc76bb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:56.206582 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4a0b9c2e-35fb-4b5e-9f42-94a97fcc76bb tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1604 microversion: 2.32 time: 0.181402 Oct 24 10:43:56.208318 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2110/4175] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:56 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1604 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:56.290678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3cf3cc5f-05aa-4b53-8a65-c9066982978f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:56.303931 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3cf3cc5f-05aa-4b53-8a65-c9066982978f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1429 microversion: 2.1 time: 0.427821 Oct 24 10:43:56.306704 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2066/4176] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:55 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1429 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:56.563134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ac83bc12-a1ef-4b7d-a7e4-118d2f1c59d6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:56.564432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ac83bc12-a1ef-4b7d-a7e4-118d2f1c59d6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:56.574351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:56.577901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac83bc12-a1ef-4b7d-a7e4-118d2f1c59d6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:56.578574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac83bc12-a1ef-4b7d-a7e4-118d2f1c59d6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:56.579110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac83bc12-a1ef-4b7d-a7e4-118d2f1c59d6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:56.583054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac83bc12-a1ef-4b7d-a7e4-118d2f1c59d6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:56.583791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac83bc12-a1ef-4b7d-a7e4-118d2f1c59d6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:56.584404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac83bc12-a1ef-4b7d-a7e4-118d2f1c59d6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:56.942504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=14 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:57.036395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6e4fe626-edaa-463f-9771-d43f007df9d6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:57.037051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6e4fe626-edaa-463f-9771-d43f007df9d6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:57.039044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:57.039724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=18 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:43:57.054680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e4fe626-edaa-463f-9771-d43f007df9d6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:57.055181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e4fe626-edaa-463f-9771-d43f007df9d6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:57.055626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e4fe626-edaa-463f-9771-d43f007df9d6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:57.056343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e4fe626-edaa-463f-9771-d43f007df9d6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:57.056805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e4fe626-edaa-463f-9771-d43f007df9d6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:57.057258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e4fe626-edaa-463f-9771-d43f007df9d6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:57.566551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ac83bc12-a1ef-4b7d-a7e4-118d2f1c59d6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:57.589599 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ac83bc12-a1ef-4b7d-a7e4-118d2f1c59d6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 200 len: 1321 microversion: 2.1 time: 1.030029 Oct 24 10:43:57.590440 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2111/4177] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:56 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 1321 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:57.602823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f418617f-cc1e-464f-b31a-8ed17e1080c8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:57.603813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f418617f-cc1e-464f-b31a-8ed17e1080c8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:57.628743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f418617f-cc1e-464f-b31a-8ed17e1080c8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:57.629811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f418617f-cc1e-464f-b31a-8ed17e1080c8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:57.631264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f418617f-cc1e-464f-b31a-8ed17e1080c8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:57.632623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f418617f-cc1e-464f-b31a-8ed17e1080c8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:57.636048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f418617f-cc1e-464f-b31a-8ed17e1080c8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:57.636676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f418617f-cc1e-464f-b31a-8ed17e1080c8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:57.843274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f418617f-cc1e-464f-b31a-8ed17e1080c8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:57.873170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f418617f-cc1e-464f-b31a-8ed17e1080c8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:57.881430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f418617f-cc1e-464f-b31a-8ed17e1080c8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:57.883125 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f418617f-cc1e-464f-b31a-8ed17e1080c8 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1604 microversion: 2.32 time: 0.288569 Oct 24 10:43:57.901432 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2112/4178] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:57 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1604 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:43:57.901432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4a50b4b4-be12-4715-a7b9-5e85bed38ac8 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:57.917461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4a50b4b4-be12-4715-a7b9-5e85bed38ac8 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:57.935413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a50b4b4-be12-4715-a7b9-5e85bed38ac8 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:57.936772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a50b4b4-be12-4715-a7b9-5e85bed38ac8 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:57.937325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a50b4b4-be12-4715-a7b9-5e85bed38ac8 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:57.937605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6e4fe626-edaa-463f-9771-d43f007df9d6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:57.938246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a50b4b4-be12-4715-a7b9-5e85bed38ac8 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:57.939899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a50b4b4-be12-4715-a7b9-5e85bed38ac8 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:57.940428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a50b4b4-be12-4715-a7b9-5e85bed38ac8 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:57.948006 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6e4fe626-edaa-463f-9771-d43f007df9d6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1505 microversion: 2.1 time: 0.916761 Oct 24 10:43:57.961179 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2067/4179] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:57 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1505 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:57.961179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-2459a736-9f7f-443c-8574-dfe26a9b9376 req-c75cd5eb-23e2-44eb-8c35-a79a24d489ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8d0dbd-d76e-49fe-9120-796e315a72d1", "name": "network-vif-plugged", "status": "completed", "tag": "69c9cea8-b78f-4525-8b98-b05b0f455368"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:43:57.997465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2459a736-9f7f-443c-8574-dfe26a9b9376 req-c75cd5eb-23e2-44eb-8c35-a79a24d489ed service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:57.999815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2459a736-9f7f-443c-8574-dfe26a9b9376 req-c75cd5eb-23e2-44eb-8c35-a79a24d489ed service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:58.000424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2459a736-9f7f-443c-8574-dfe26a9b9376 req-c75cd5eb-23e2-44eb-8c35-a79a24d489ed service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:58.017098 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-2459a736-9f7f-443c-8574-dfe26a9b9376 req-c75cd5eb-23e2-44eb-8c35-a79a24d489ed service nova] Creating event network-vif-plugged:69c9cea8-b78f-4525-8b98-b05b0f455368 for instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 on n-h2-858383-15 Oct 24 10:43:58.024214 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-2459a736-9f7f-443c-8574-dfe26a9b9376 req-c75cd5eb-23e2-44eb-8c35-a79a24d489ed service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073814 Oct 24 10:43:58.026167 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2068/4180] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:43:58.032013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5a2a63cb-68d2-419d-a7ec-050545b5f9e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:58.033177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5a2a63cb-68d2-419d-a7ec-050545b5f9e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:58.044925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a2a63cb-68d2-419d-a7ec-050545b5f9e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:58.045562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a2a63cb-68d2-419d-a7ec-050545b5f9e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:58.046067 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a2a63cb-68d2-419d-a7ec-050545b5f9e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:58.047204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a2a63cb-68d2-419d-a7ec-050545b5f9e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:58.047669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a2a63cb-68d2-419d-a7ec-050545b5f9e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:58.048150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a2a63cb-68d2-419d-a7ec-050545b5f9e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:58.102024 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5a2a63cb-68d2-419d-a7ec-050545b5f9e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/ips" status: 200 len: 153 microversion: 2.20 time: 0.070950 Oct 24 10:43:58.103934 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2069/4181] 10.222.0.50 () {60 vars in 1289 bytes} [Mon Oct 24 10:43:58 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/ips => generated 153 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:43:58.622340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3f34f438-e495-4966-bfd3-fb6dc6fe00b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:58.623359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3f34f438-e495-4966-bfd3-fb6dc6fe00b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:58.644600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f34f438-e495-4966-bfd3-fb6dc6fe00b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:58.647905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f34f438-e495-4966-bfd3-fb6dc6fe00b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:58.649849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f34f438-e495-4966-bfd3-fb6dc6fe00b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:58.651115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f34f438-e495-4966-bfd3-fb6dc6fe00b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:58.654143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f34f438-e495-4966-bfd3-fb6dc6fe00b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:58.655116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f34f438-e495-4966-bfd3-fb6dc6fe00b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:58.736039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4a50b4b4-be12-4715-a7b9-5e85bed38ac8 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:58.751371 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4a50b4b4-be12-4715-a7b9-5e85bed38ac8 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1429 microversion: 2.1 time: 0.855300 Oct 24 10:43:58.755389 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2113/4182] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:57 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1429 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:43:58.921463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c9656c21-299f-4c5e-b3e3-a50ddfa0035b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:58.930068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c9656c21-299f-4c5e-b3e3-a50ddfa0035b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:58.965446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9656c21-299f-4c5e-b3e3-a50ddfa0035b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:58.981843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9656c21-299f-4c5e-b3e3-a50ddfa0035b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:58.983875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9656c21-299f-4c5e-b3e3-a50ddfa0035b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:58.986200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9656c21-299f-4c5e-b3e3-a50ddfa0035b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:58.986892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9656c21-299f-4c5e-b3e3-a50ddfa0035b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:58.994230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9656c21-299f-4c5e-b3e3-a50ddfa0035b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:59.386182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c9656c21-299f-4c5e-b3e3-a50ddfa0035b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:59.414979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c9656c21-299f-4c5e-b3e3-a50ddfa0035b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:59.426210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c9656c21-299f-4c5e-b3e3-a50ddfa0035b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:59.427790 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c9656c21-299f-4c5e-b3e3-a50ddfa0035b tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1604 microversion: 2.32 time: 0.516714 Oct 24 10:43:59.434703 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2114/4183] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:43:58 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1604 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:43:59.448265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-061a1f59-17dd-4a70-befd-9ce5346ca569 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:59.449998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-061a1f59-17dd-4a70-befd-9ce5346ca569 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:59.477945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-061a1f59-17dd-4a70-befd-9ce5346ca569 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:59.484325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-061a1f59-17dd-4a70-befd-9ce5346ca569 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:59.485010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-061a1f59-17dd-4a70-befd-9ce5346ca569 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:59.493506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-061a1f59-17dd-4a70-befd-9ce5346ca569 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:59.494864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-061a1f59-17dd-4a70-befd-9ce5346ca569 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:59.496600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-061a1f59-17dd-4a70-befd-9ce5346ca569 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:59.577964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3f34f438-e495-4966-bfd3-fb6dc6fe00b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:43:59.613894 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3f34f438-e495-4966-bfd3-fb6dc6fe00b0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 200 len: 1321 microversion: 2.1 time: 0.993148 Oct 24 10:43:59.630763 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2070/4184] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:58 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 1321 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:43:59.795705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6c99f8f9-7d4f-48ca-9c76-64f53c696150 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:43:59.796876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6c99f8f9-7d4f-48ca-9c76-64f53c696150 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:43:59.814642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c99f8f9-7d4f-48ca-9c76-64f53c696150 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:59.817254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c99f8f9-7d4f-48ca-9c76-64f53c696150 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:59.821794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c99f8f9-7d4f-48ca-9c76-64f53c696150 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:59.825582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c99f8f9-7d4f-48ca-9c76-64f53c696150 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:43:59.828247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c99f8f9-7d4f-48ca-9c76-64f53c696150 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:43:59.832214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c99f8f9-7d4f-48ca-9c76-64f53c696150 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:43:59.987971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-061a1f59-17dd-4a70-befd-9ce5346ca569 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:00.004888 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-061a1f59-17dd-4a70-befd-9ce5346ca569 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1505 microversion: 2.1 time: 0.568308 Oct 24 10:44:00.006220 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2115/4185] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:59 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1505 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:00.443810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-19b93519-dfa4-4dcb-bffc-c63c2ae1f999 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725-project-admin] Calling method '.version_select at 0x7f04cb8cf040>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:00.446559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19b93519-dfa4-4dcb-bffc-c63c2ae1f999 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:00.447223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19b93519-dfa4-4dcb-bffc-c63c2ae1f999 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:00.447851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19b93519-dfa4-4dcb-bffc-c63c2ae1f999 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:00.501442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19b93519-dfa4-4dcb-bffc-c63c2ae1f999 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:00.507120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19b93519-dfa4-4dcb-bffc-c63c2ae1f999 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:00.508019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19b93519-dfa4-4dcb-bffc-c63c2ae1f999 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:00.519609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19b93519-dfa4-4dcb-bffc-c63c2ae1f999 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:00.520346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19b93519-dfa4-4dcb-bffc-c63c2ae1f999 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:00.521047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19b93519-dfa4-4dcb-bffc-c63c2ae1f999 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:00.527905 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-19b93519-dfa4-4dcb-bffc-c63c2ae1f999 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725 tempest-PortsAdminExtendedAttrsIpV6TestJSON-991731725-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.269815 Oct 24 10:44:00.529049 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2116/4186] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:44:00 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:44:00.534160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7ab7426e-e742-4cb6-92be-f63bd7017590 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:00.534957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7ab7426e-e742-4cb6-92be-f63bd7017590 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:00.541479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ab7426e-e742-4cb6-92be-f63bd7017590 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:00.542494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ab7426e-e742-4cb6-92be-f63bd7017590 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:00.543098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ab7426e-e742-4cb6-92be-f63bd7017590 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:00.544004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ab7426e-e742-4cb6-92be-f63bd7017590 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:00.544619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ab7426e-e742-4cb6-92be-f63bd7017590 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:00.545231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ab7426e-e742-4cb6-92be-f63bd7017590 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:00.658410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6c99f8f9-7d4f-48ca-9c76-64f53c696150 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:00.672992 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6c99f8f9-7d4f-48ca-9c76-64f53c696150 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1429 microversion: 2.1 time: 0.881689 Oct 24 10:44:00.674663 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2071/4187] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:43:59 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1429 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:00.678952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7ab7426e-e742-4cb6-92be-f63bd7017590 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:00.685430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-938536d2-6347-4b95-81d3-ea262dddbc62 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:00.689964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-938536d2-6347-4b95-81d3-ea262dddbc62 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:00.700712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7ab7426e-e742-4cb6-92be-f63bd7017590 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:00.705577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-938536d2-6347-4b95-81d3-ea262dddbc62 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:00.706606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-938536d2-6347-4b95-81d3-ea262dddbc62 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:00.707067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7ab7426e-e742-4cb6-92be-f63bd7017590 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:00.709694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-938536d2-6347-4b95-81d3-ea262dddbc62 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:00.710082 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7ab7426e-e742-4cb6-92be-f63bd7017590 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1604 microversion: 2.32 time: 0.179890 Oct 24 10:44:00.711233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-938536d2-6347-4b95-81d3-ea262dddbc62 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:00.711864 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2117/4188] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:00 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1604 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:00.714120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-938536d2-6347-4b95-81d3-ea262dddbc62 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:00.714991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-938536d2-6347-4b95-81d3-ea262dddbc62 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:01.020803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-938536d2-6347-4b95-81d3-ea262dddbc62 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:01.033985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fe6cfb47-786d-425b-b385-84244fb6959b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:01.034611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fe6cfb47-786d-425b-b385-84244fb6959b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:01.043561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe6cfb47-786d-425b-b385-84244fb6959b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:01.047265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe6cfb47-786d-425b-b385-84244fb6959b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:01.047990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe6cfb47-786d-425b-b385-84244fb6959b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:01.050632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe6cfb47-786d-425b-b385-84244fb6959b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:01.051534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe6cfb47-786d-425b-b385-84244fb6959b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:01.053656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe6cfb47-786d-425b-b385-84244fb6959b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:01.061556 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-938536d2-6347-4b95-81d3-ea262dddbc62 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 200 len: 1502 microversion: 2.1 time: 0.384696 Oct 24 10:44:01.063331 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2072/4189] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:00 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 1502 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:01.090264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e6a29278-a453-4ae7-b74e-72a3c68f575b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:01.091113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e6a29278-a453-4ae7-b74e-72a3c68f575b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:01.108810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6a29278-a453-4ae7-b74e-72a3c68f575b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:01.109372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6a29278-a453-4ae7-b74e-72a3c68f575b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:01.109822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6a29278-a453-4ae7-b74e-72a3c68f575b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:01.114499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6a29278-a453-4ae7-b74e-72a3c68f575b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:01.115194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6a29278-a453-4ae7-b74e-72a3c68f575b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:01.116068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6a29278-a453-4ae7-b74e-72a3c68f575b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:01.500955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e6a29278-a453-4ae7-b74e-72a3c68f575b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:01.514002 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e6a29278-a453-4ae7-b74e-72a3c68f575b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 200 len: 1502 microversion: 2.1 time: 0.429771 Oct 24 10:44:01.518289 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2073/4190] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:01 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 1502 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:44:01.547301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bcba61fc-3e33-4f9b-9a95-dda331c9ad92 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:01.547810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bcba61fc-3e33-4f9b-9a95-dda331c9ad92 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:01.563607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcba61fc-3e33-4f9b-9a95-dda331c9ad92 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:01.564148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcba61fc-3e33-4f9b-9a95-dda331c9ad92 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:01.564598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcba61fc-3e33-4f9b-9a95-dda331c9ad92 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:01.565358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcba61fc-3e33-4f9b-9a95-dda331c9ad92 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:01.565987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcba61fc-3e33-4f9b-9a95-dda331c9ad92 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:01.566433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcba61fc-3e33-4f9b-9a95-dda331c9ad92 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:01.612790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fe6cfb47-786d-425b-b385-84244fb6959b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:01.622751 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fe6cfb47-786d-425b-b385-84244fb6959b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1505 microversion: 2.1 time: 0.593033 Oct 24 10:44:01.623351 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2118/4191] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:01 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1505 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:44:01.638704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bcba61fc-3e33-4f9b-9a95-dda331c9ad92 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:44:01.698271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6dc2a471-ad83-4945-a146-ce394f7e7c94 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:01.698898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6dc2a471-ad83-4945-a146-ce394f7e7c94 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:01.705411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6dc2a471-ad83-4945-a146-ce394f7e7c94 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:01.706254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6dc2a471-ad83-4945-a146-ce394f7e7c94 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:01.706854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6dc2a471-ad83-4945-a146-ce394f7e7c94 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:01.707936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6dc2a471-ad83-4945-a146-ce394f7e7c94 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:01.708550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6dc2a471-ad83-4945-a146-ce394f7e7c94 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:01.709376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6dc2a471-ad83-4945-a146-ce394f7e7c94 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:01.796316 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bcba61fc-3e33-4f9b-9a95-dda331c9ad92 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 204 len: 0 microversion: 2.1 time: 0.252612 Oct 24 10:44:01.798118 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2074/4192] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:44:01 2022] DELETE /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:44:01.805358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bec8e0ed-8b3a-4fd6-8041-962cb75ae256 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:01.811932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bec8e0ed-8b3a-4fd6-8041-962cb75ae256 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:01.826282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bec8e0ed-8b3a-4fd6-8041-962cb75ae256 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:01.827028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bec8e0ed-8b3a-4fd6-8041-962cb75ae256 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:01.827657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bec8e0ed-8b3a-4fd6-8041-962cb75ae256 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:01.829324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bec8e0ed-8b3a-4fd6-8041-962cb75ae256 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:01.831533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bec8e0ed-8b3a-4fd6-8041-962cb75ae256 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:01.832202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bec8e0ed-8b3a-4fd6-8041-962cb75ae256 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:01.965040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bec8e0ed-8b3a-4fd6-8041-962cb75ae256 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:01.981151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bec8e0ed-8b3a-4fd6-8041-962cb75ae256 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:01.985070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bec8e0ed-8b3a-4fd6-8041-962cb75ae256 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:01.988030 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bec8e0ed-8b3a-4fd6-8041-962cb75ae256 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1604 microversion: 2.32 time: 0.187827 Oct 24 10:44:02.000860 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2075/4193] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:01 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1604 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:02.007630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a16e6b5d-f6df-4728-b62a-c9b103ea7d84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:02.007630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a16e6b5d-f6df-4728-b62a-c9b103ea7d84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:02.019550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a16e6b5d-f6df-4728-b62a-c9b103ea7d84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:02.020056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a16e6b5d-f6df-4728-b62a-c9b103ea7d84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:02.020534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a16e6b5d-f6df-4728-b62a-c9b103ea7d84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:02.024586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a16e6b5d-f6df-4728-b62a-c9b103ea7d84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:02.026217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a16e6b5d-f6df-4728-b62a-c9b103ea7d84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:02.026679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a16e6b5d-f6df-4728-b62a-c9b103ea7d84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:02.084166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6dc2a471-ad83-4945-a146-ce394f7e7c94 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:02.096423 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6dc2a471-ad83-4945-a146-ce394f7e7c94 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1429 microversion: 2.1 time: 0.403668 Oct 24 10:44:02.107976 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2119/4194] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:01 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1429 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:44:02.114264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0441b6ad-6b95-4349-a9ac-bdc9b433d58e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:02.115369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0441b6ad-6b95-4349-a9ac-bdc9b433d58e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:02.130444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0441b6ad-6b95-4349-a9ac-bdc9b433d58e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:02.132346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0441b6ad-6b95-4349-a9ac-bdc9b433d58e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:02.134124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0441b6ad-6b95-4349-a9ac-bdc9b433d58e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:02.137058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0441b6ad-6b95-4349-a9ac-bdc9b433d58e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:02.138357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0441b6ad-6b95-4349-a9ac-bdc9b433d58e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:02.140210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0441b6ad-6b95-4349-a9ac-bdc9b433d58e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:02.198301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-0441b6ad-6b95-4349-a9ac-bdc9b433d58e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lazy-loading 'flavor' on Instance uuid e6eb3578-42ca-4dc5-b31a-e5500aa94f2e {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:44:02.341914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a16e6b5d-f6df-4728-b62a-c9b103ea7d84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:02.354530 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a16e6b5d-f6df-4728-b62a-c9b103ea7d84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 200 len: 1508 microversion: 2.1 time: 0.362246 Oct 24 10:44:02.356455 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2076/4195] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:01 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 1508 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:02.553402 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0441b6ad-6b95-4349-a9ac-bdc9b433d58e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "POST /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/action" status: 202 len: 0 microversion: 2.20 time: 0.444043 Oct 24 10:44:02.563429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b67f21b8-f873-46ba-a0aa-f231566378e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:02.564286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b67f21b8-f873-46ba-a0aa-f231566378e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:02.570621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b67f21b8-f873-46ba-a0aa-f231566378e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:02.570833 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2120/4196] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Oct 24 10:44:02 2022] POST /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:44:02.571860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b67f21b8-f873-46ba-a0aa-f231566378e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:02.572454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b67f21b8-f873-46ba-a0aa-f231566378e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:02.573374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b67f21b8-f873-46ba-a0aa-f231566378e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:02.574148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b67f21b8-f873-46ba-a0aa-f231566378e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:02.574725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b67f21b8-f873-46ba-a0aa-f231566378e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:02.652133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-27071d89-3024-451d-9d8e-68a7fa3dc719 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:02.653335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-27071d89-3024-451d-9d8e-68a7fa3dc719 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:02.666545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27071d89-3024-451d-9d8e-68a7fa3dc719 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:02.667329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27071d89-3024-451d-9d8e-68a7fa3dc719 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:02.667923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27071d89-3024-451d-9d8e-68a7fa3dc719 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:02.668804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27071d89-3024-451d-9d8e-68a7fa3dc719 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:02.669432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27071d89-3024-451d-9d8e-68a7fa3dc719 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:02.670025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27071d89-3024-451d-9d8e-68a7fa3dc719 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:02.708055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:44:02.811696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b67f21b8-f873-46ba-a0aa-f231566378e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:02.823434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b67f21b8-f873-46ba-a0aa-f231566378e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:02.832294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b67f21b8-f873-46ba-a0aa-f231566378e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:02.833697 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b67f21b8-f873-46ba-a0aa-f231566378e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1725 microversion: 2.20 time: 0.274598 Oct 24 10:44:02.844861 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2077/4197] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:02 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1725 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:02.899529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-27071d89-3024-451d-9d8e-68a7fa3dc719 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:02.910977 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-27071d89-3024-451d-9d8e-68a7fa3dc719 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1505 microversion: 2.1 time: 0.264529 Oct 24 10:44:02.912050 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2121/4198] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:02 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1505 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:44:03.015605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c708a7d6-b6d1-4388-93fd-9a760162793d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:03.016232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c708a7d6-b6d1-4388-93fd-9a760162793d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:03.024264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c708a7d6-b6d1-4388-93fd-9a760162793d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:03.029196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c708a7d6-b6d1-4388-93fd-9a760162793d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:03.030878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c708a7d6-b6d1-4388-93fd-9a760162793d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:03.033613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c708a7d6-b6d1-4388-93fd-9a760162793d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:03.035097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c708a7d6-b6d1-4388-93fd-9a760162793d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:03.036234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c708a7d6-b6d1-4388-93fd-9a760162793d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:03.076915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c708a7d6-b6d1-4388-93fd-9a760162793d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:03.077492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c708a7d6-b6d1-4388-93fd-9a760162793d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:03.078051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c708a7d6-b6d1-4388-93fd-9a760162793d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:03.078721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-c708a7d6-b6d1-4388-93fd-9a760162793d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lazy-loading 'fault' on Instance uuid f2595b35-cdfc-4152-b325-ea712ff8b946 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:44:03.121397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-00dbcc35-02b5-4042-ac68-6669f1c518a9 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:03.122702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-00dbcc35-02b5-4042-ac68-6669f1c518a9 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:03.139686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00dbcc35-02b5-4042-ac68-6669f1c518a9 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:03.139853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00dbcc35-02b5-4042-ac68-6669f1c518a9 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:03.140247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00dbcc35-02b5-4042-ac68-6669f1c518a9 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:03.140988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00dbcc35-02b5-4042-ac68-6669f1c518a9 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:03.141442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00dbcc35-02b5-4042-ac68-6669f1c518a9 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:03.141863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00dbcc35-02b5-4042-ac68-6669f1c518a9 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:03.216045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c708a7d6-b6d1-4388-93fd-9a760162793d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:03.228224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c708a7d6-b6d1-4388-93fd-9a760162793d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:03.230044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c708a7d6-b6d1-4388-93fd-9a760162793d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6052fe343c86452f9183b383fcc85183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb64e6d84904f1083116b5aed79f7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:03.231477 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c708a7d6-b6d1-4388-93fd-9a760162793d tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 200 len: 1609 microversion: 2.32 time: 0.219893 Oct 24 10:44:03.232627 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2078/4199] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:03 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 1609 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:03.386681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3b68c9db-a85f-49a3-b4c9-c491e3270669 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:03.387772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3b68c9db-a85f-49a3-b4c9-c491e3270669 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:03.403741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b68c9db-a85f-49a3-b4c9-c491e3270669 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:03.408438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b68c9db-a85f-49a3-b4c9-c491e3270669 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:03.409576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b68c9db-a85f-49a3-b4c9-c491e3270669 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:03.411307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b68c9db-a85f-49a3-b4c9-c491e3270669 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:03.412813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b68c9db-a85f-49a3-b4c9-c491e3270669 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:03.415101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b68c9db-a85f-49a3-b4c9-c491e3270669 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:03.431737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-00dbcc35-02b5-4042-ac68-6669f1c518a9 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:03.446066 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-00dbcc35-02b5-4042-ac68-6669f1c518a9 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1429 microversion: 2.1 time: 0.330323 Oct 24 10:44:03.446798 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2122/4200] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:03 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1429 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:03.682803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3b68c9db-a85f-49a3-b4c9-c491e3270669 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:03.694700 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3b68c9db-a85f-49a3-b4c9-c491e3270669 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 200 len: 1508 microversion: 2.1 time: 0.313376 Oct 24 10:44:03.708231 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2079/4201] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:03 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 1508 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:03.863468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cc991c3d-d33a-4b0a-9819-f3c5b21d1a46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:03.864572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cc991c3d-d33a-4b0a-9819-f3c5b21d1a46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:03.886491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-fe1c804f-3c3d-4531-92bd-0657def94522 req-48725e08-b4d1-4ad3-bb49-a285e45f3272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161edb66-41db-4070-8b7b-81c318cde03a", "name": "network-vif-plugged", "status": "completed", "tag": "0a0278ee-b58d-4340-bbf3-0cc59d2bb857"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:03.898024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc991c3d-d33a-4b0a-9819-f3c5b21d1a46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:03.899519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc991c3d-d33a-4b0a-9819-f3c5b21d1a46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:03.901618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc991c3d-d33a-4b0a-9819-f3c5b21d1a46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:03.906103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc991c3d-d33a-4b0a-9819-f3c5b21d1a46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:03.907695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc991c3d-d33a-4b0a-9819-f3c5b21d1a46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:03.908509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc991c3d-d33a-4b0a-9819-f3c5b21d1a46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:03.921627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fe1c804f-3c3d-4531-92bd-0657def94522 req-48725e08-b4d1-4ad3-bb49-a285e45f3272 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:03.923532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fe1c804f-3c3d-4531-92bd-0657def94522 req-48725e08-b4d1-4ad3-bb49-a285e45f3272 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:03.925094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fe1c804f-3c3d-4531-92bd-0657def94522 req-48725e08-b4d1-4ad3-bb49-a285e45f3272 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:03.978863 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-fe1c804f-3c3d-4531-92bd-0657def94522 req-48725e08-b4d1-4ad3-bb49-a285e45f3272 service nova] Creating event network-vif-plugged:0a0278ee-b58d-4340-bbf3-0cc59d2bb857 for instance 161edb66-41db-4070-8b7b-81c318cde03a on n-h1-858383-15 Oct 24 10:44:03.996080 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-fe1c804f-3c3d-4531-92bd-0657def94522 req-48725e08-b4d1-4ad3-bb49-a285e45f3272 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116044 Oct 24 10:44:04.003225 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2080/4202] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:44:04.011006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-42a3cdab-ec34-4f2c-80ca-b306359ae012 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:04.013644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-42a3cdab-ec34-4f2c-80ca-b306359ae012 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:04.027568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42a3cdab-ec34-4f2c-80ca-b306359ae012 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:04.028483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42a3cdab-ec34-4f2c-80ca-b306359ae012 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:04.029168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42a3cdab-ec34-4f2c-80ca-b306359ae012 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:04.030108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42a3cdab-ec34-4f2c-80ca-b306359ae012 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:04.030884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42a3cdab-ec34-4f2c-80ca-b306359ae012 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:04.031520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42a3cdab-ec34-4f2c-80ca-b306359ae012 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:04.037148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:44:04.391490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cc991c3d-d33a-4b0a-9819-f3c5b21d1a46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:04.401399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cc991c3d-d33a-4b0a-9819-f3c5b21d1a46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:04.403740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cc991c3d-d33a-4b0a-9819-f3c5b21d1a46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:04.405180 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cc991c3d-d33a-4b0a-9819-f3c5b21d1a46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1725 microversion: 2.20 time: 0.548863 Oct 24 10:44:04.405867 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2123/4203] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:03 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1725 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:04.415267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7c6f3c08-3464-4a37-b38a-1aeb0b69b69e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:04.416210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7c6f3c08-3464-4a37-b38a-1aeb0b69b69e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:04.426710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c6f3c08-3464-4a37-b38a-1aeb0b69b69e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:04.428013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c6f3c08-3464-4a37-b38a-1aeb0b69b69e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:04.428779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c6f3c08-3464-4a37-b38a-1aeb0b69b69e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:04.429537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c6f3c08-3464-4a37-b38a-1aeb0b69b69e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:04.429988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c6f3c08-3464-4a37-b38a-1aeb0b69b69e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:04.430415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c6f3c08-3464-4a37-b38a-1aeb0b69b69e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:04.460523 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-7c6f3c08-3464-4a37-b38a-1aeb0b69b69e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] HTTP exception thrown: Instance f2595b35-cdfc-4152-b325-ea712ff8b946 could not be found. Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7c6f3c08-3464-4a37-b38a-1aeb0b69b69e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Request method failure captured: Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 HTTP/1.1 Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmrE9ZjH2-FOOxEaq1Um4zY_N0a0pkjUAXzjYezwM200NZnmc_lW9lS6Jd7NRhc0d1o-Xhdm1m4y0fV91cdA1W5vd6u6QqLBd6Vmh-337alFIolP6ijg4sPnzuvJqeB_TUsUQ9Y3AvFypU_2XxY8x-6tA9VHmmEcErr7deX0P9YhyBM Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-Openstack-Nova-Api-Version: 2.32 Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 2eb64e6d84904f1083116b5aed79f7f2 Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TaggedBootDevicesTest-1860443483 Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2eb64e6d84904f1083116b5aed79f7f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2eb64e6d84904f1083116b5aed79f7f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2eb64e6d84904f1083116b5aed79f7f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2eb64e6d84904f1083116b5aed79f7f2", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TaggedBootDevicesTest-1860443483 Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 2eb64e6d84904f1083116b5aed79f7f2 Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1860443483 Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TaggedBootDevicesTest-1860443483-project Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 6052fe343c86452f9183b383fcc85183 Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TaggedBootDevicesTest-1860443483-project Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance f2595b35-cdfc-4152-b325-ea712ff8b946 could not be found. Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'f2595b35-cdfc-4152-b325-ea712ff8b946'} Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2595b35-cdfc-4152-b325-ea712ff8b946 could not be found. Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2595b35-cdfc-4152-b325-ea712ff8b946 could not be found. Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:04.462623 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:44:04.468642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:04.468642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:44:04.468642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:44:04.468642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:44:04.468642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:44:04.468642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:44:04.468642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2595b35-cdfc-4152-b325-ea712ff8b946 could not be found. Oct 24 10:44:04.468642 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:04.469789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-42a3cdab-ec34-4f2c-80ca-b306359ae012 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:04.471451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7c6f3c08-3464-4a37-b38a-1aeb0b69b69e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Returning 404 to user: Instance f2595b35-cdfc-4152-b325-ea712ff8b946 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:44:04.472714 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7c6f3c08-3464-4a37-b38a-1aeb0b69b69e tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 404 len: 111 microversion: 2.32 time: 0.065774 Oct 24 10:44:04.475987 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2124/4204] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:04 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:44:04.482162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-00af0fe8-49c8-42cc-a138-09e780dc7324 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:04.482946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-00af0fe8-49c8-42cc-a138-09e780dc7324 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:04.483063 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-42a3cdab-ec34-4f2c-80ca-b306359ae012 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1505 microversion: 2.1 time: 0.477505 Oct 24 10:44:04.483797 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2081/4205] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:04 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1505 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:04.490585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00af0fe8-49c8-42cc-a138-09e780dc7324 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:04.491071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00af0fe8-49c8-42cc-a138-09e780dc7324 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:04.491503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00af0fe8-49c8-42cc-a138-09e780dc7324 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:04.492202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00af0fe8-49c8-42cc-a138-09e780dc7324 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:04.492646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00af0fe8-49c8-42cc-a138-09e780dc7324 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:04.493096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00af0fe8-49c8-42cc-a138-09e780dc7324 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:04.500936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c495a146-468f-4209-875b-ce30740d79b7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '.version_select at 0x7f04cbbe4670>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:04.559038 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c495a146-468f-4209-875b-ce30740d79b7 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363163816" status: 204 len: 0 microversion: 2.32 time: 0.065006 Oct 24 10:44:04.565680 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2082/4206] 10.222.0.50 () {60 vars in 1262 bytes} [Mon Oct 24 10:44:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363163816 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:44:04.726004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d1301b95-011b-4170-b18e-83834b4d1d96 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:04.727115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d1301b95-011b-4170-b18e-83834b4d1d96 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:04.741936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1301b95-011b-4170-b18e-83834b4d1d96 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:04.743728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1301b95-011b-4170-b18e-83834b4d1d96 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:04.744366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1301b95-011b-4170-b18e-83834b4d1d96 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:04.753110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1301b95-011b-4170-b18e-83834b4d1d96 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:04.755093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1301b95-011b-4170-b18e-83834b4d1d96 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:04.755719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1301b95-011b-4170-b18e-83834b4d1d96 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:05.000870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d1301b95-011b-4170-b18e-83834b4d1d96 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:05.019953 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d1301b95-011b-4170-b18e-83834b4d1d96 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 200 len: 1466 microversion: 2.1 time: 0.300720 Oct 24 10:44:05.020649 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2083/4207] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:04 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 1466 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:05.039937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-00af0fe8-49c8-42cc-a138-09e780dc7324 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:05.049338 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-00af0fe8-49c8-42cc-a138-09e780dc7324 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1429 microversion: 2.1 time: 0.571149 Oct 24 10:44:05.050234 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2125/4208] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:04 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1429 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:05.169688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d4d3d430-fab5-4d0a-8c97-40e0d7b332ad req-0f2d670d-1fe5-41ee-a343-05e956bb3aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8d0dbd-d76e-49fe-9120-796e315a72d1", "name": "network-vif-deleted", "tag": "69c9cea8-b78f-4525-8b98-b05b0f455368"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:05.187858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d4d3d430-fab5-4d0a-8c97-40e0d7b332ad req-0f2d670d-1fe5-41ee-a343-05e956bb3aad service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:05.188354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d4d3d430-fab5-4d0a-8c97-40e0d7b332ad req-0f2d670d-1fe5-41ee-a343-05e956bb3aad service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:05.188799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d4d3d430-fab5-4d0a-8c97-40e0d7b332ad req-0f2d670d-1fe5-41ee-a343-05e956bb3aad service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:05.218419 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d4d3d430-fab5-4d0a-8c97-40e0d7b332ad req-0f2d670d-1fe5-41ee-a343-05e956bb3aad service nova] Creating event network-vif-deleted:69c9cea8-b78f-4525-8b98-b05b0f455368 for instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 on n-h2-858383-15 Oct 24 10:44:05.231568 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d4d3d430-fab5-4d0a-8c97-40e0d7b332ad req-0f2d670d-1fe5-41ee-a343-05e956bb3aad service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065331 Oct 24 10:44:05.232200 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2084/4209] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:44:05.435059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8d21fe2c-a598-46a8-9628-69f10a289670 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:05.435673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8d21fe2c-a598-46a8-9628-69f10a289670 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:05.456789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d21fe2c-a598-46a8-9628-69f10a289670 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:05.457315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d21fe2c-a598-46a8-9628-69f10a289670 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:05.457761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d21fe2c-a598-46a8-9628-69f10a289670 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:05.467480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d21fe2c-a598-46a8-9628-69f10a289670 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:05.467987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d21fe2c-a598-46a8-9628-69f10a289670 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:05.468496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d21fe2c-a598-46a8-9628-69f10a289670 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:05.510481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e72026c8-310a-43ab-9480-0ce8edb73a9e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:05.511525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e72026c8-310a-43ab-9480-0ce8edb73a9e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:05.520824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e72026c8-310a-43ab-9480-0ce8edb73a9e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:05.529348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e72026c8-310a-43ab-9480-0ce8edb73a9e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:05.539908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e72026c8-310a-43ab-9480-0ce8edb73a9e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:05.540968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e72026c8-310a-43ab-9480-0ce8edb73a9e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:05.541649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e72026c8-310a-43ab-9480-0ce8edb73a9e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:05.542088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e72026c8-310a-43ab-9480-0ce8edb73a9e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:06.460070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d21fe2c-a598-46a8-9628-69f10a289670 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:06.473889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d21fe2c-a598-46a8-9628-69f10a289670 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:06.476716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d21fe2c-a598-46a8-9628-69f10a289670 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:06.481298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e72026c8-310a-43ab-9480-0ce8edb73a9e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:06.496822 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8d21fe2c-a598-46a8-9628-69f10a289670 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1725 microversion: 2.20 time: 1.065787 Oct 24 10:44:06.500537 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2126/4210] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:05 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1725 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:06.502467 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e72026c8-310a-43ab-9480-0ce8edb73a9e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1505 microversion: 2.1 time: 0.990013 Oct 24 10:44:06.519895 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2085/4211] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:05 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1505 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:06.534622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-604855f6-2310-47a8-bed3-b2f080bc7c9f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:06.535478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-604855f6-2310-47a8-bed3-b2f080bc7c9f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:06.536467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-565ef99a-1203-487c-ae90-f8f622984e8f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:06.537417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-565ef99a-1203-487c-ae90-f8f622984e8f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:06.553769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-565ef99a-1203-487c-ae90-f8f622984e8f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:06.561208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-565ef99a-1203-487c-ae90-f8f622984e8f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:06.561862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-565ef99a-1203-487c-ae90-f8f622984e8f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:06.562771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-565ef99a-1203-487c-ae90-f8f622984e8f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:06.563532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-565ef99a-1203-487c-ae90-f8f622984e8f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:06.563902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-604855f6-2310-47a8-bed3-b2f080bc7c9f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:06.565701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-604855f6-2310-47a8-bed3-b2f080bc7c9f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:06.565971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-565ef99a-1203-487c-ae90-f8f622984e8f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:06.566700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-604855f6-2310-47a8-bed3-b2f080bc7c9f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:06.567657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-604855f6-2310-47a8-bed3-b2f080bc7c9f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:06.568323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-604855f6-2310-47a8-bed3-b2f080bc7c9f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:06.569847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-604855f6-2310-47a8-bed3-b2f080bc7c9f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:06.599929 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-565ef99a-1203-487c-ae90-f8f622984e8f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 could not be found. Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-565ef99a-1203-487c-ae90-f8f622984e8f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 HTTP/1.1 Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 could not be found. Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '3a8d0dbd-d76e-49fe-9120-796e315a72d1'} Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 could not be found. Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 could not be found. Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:06.601723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:44:06.605800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:44:06.605800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:44:06.605800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:44:06.605800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:44:06.605800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 could not be found. Oct 24 10:44:06.605800 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:06.605800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-565ef99a-1203-487c-ae90-f8f622984e8f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:44:06.605800 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-565ef99a-1203-487c-ae90-f8f622984e8f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 404 len: 111 microversion: 2.1 time: 0.101434 Oct 24 10:44:06.605800 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2127/4212] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:06 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:44:06.622837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-46dfbc88-9837-4639-997e-0cfd40d7a79e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Action: 'create', calling method: .version_select at 0x7f04cb909160>, body: {"keypair": {"name": "tempest-key-773840704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8WN7wH5myu9vYUE3dO5aZSd0BCUf0Gmnfz9uPc9ov4FiyEas9NBBfLGezcyK8zuZ3XF/d81m5tDA8IUgwxXqTA05u8OCiCYpnpQ4hrV9+Y60i/Svh1ObXp6WDkZDtLdg=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:06.667304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-46dfbc88-9837-4639-997e-0cfd40d7a79e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Getting quotas for project 9ab3028765ba447589bf595a603ea2e3. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:44:06.682321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-46dfbc88-9837-4639-997e-0cfd40d7a79e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Getting quotas for user ed058a5e8ac14236ab2e8783e9170346 and project 9ab3028765ba447589bf595a603ea2e3. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:44:06.718880 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-46dfbc88-9837-4639-997e-0cfd40d7a79e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.105371 Oct 24 10:44:06.721047 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2128/4213] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:44:06 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:44:06.733615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-11b1b7bb-89fa-4d53-9449-6d22755c2ad5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '.version_select at 0x7f04cb8500d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:06.739417 n-d-858383-15 devstack@n-api.service[120426]: WARNING oslo_db.sqlalchemy.utils [None req-11b1b7bb-89fa-4d53-9449-6d22755c2ad5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 24 10:44:06.749385 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-11b1b7bb-89fa-4d53-9449-6d22755c2ad5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.019596 Oct 24 10:44:06.764208 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2129/4214] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:44:06 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:44:06.943167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-604855f6-2310-47a8-bed3-b2f080bc7c9f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:06.955745 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-604855f6-2310-47a8-bed3-b2f080bc7c9f tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1429 microversion: 2.1 time: 0.426796 Oct 24 10:44:06.960983 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2086/4215] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:06 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1429 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:06.977353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-85e8a1cb-45cf-4555-8c79-885ecc76c402 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1525933251", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "key_name": "tempest-key-773840704", "networks": [{"uuid": "734fc132-fff0-4bf7-9775-3a17fdcd25dc"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:07.059932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-85e8a1cb-45cf-4555-8c79-885ecc76c402 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] validate_networks() for [('734fc132-fff0-4bf7-9775-3a17fdcd25dc', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:44:07.526327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-db995cdc-5c66-4ea6-81d4-ad0f12ae8bbf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:07.526849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-db995cdc-5c66-4ea6-81d4-ad0f12ae8bbf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:07.539568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db995cdc-5c66-4ea6-81d4-ad0f12ae8bbf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:07.540066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db995cdc-5c66-4ea6-81d4-ad0f12ae8bbf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:07.540512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db995cdc-5c66-4ea6-81d4-ad0f12ae8bbf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:07.541256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db995cdc-5c66-4ea6-81d4-ad0f12ae8bbf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:07.541710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db995cdc-5c66-4ea6-81d4-ad0f12ae8bbf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:07.566913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db995cdc-5c66-4ea6-81d4-ad0f12ae8bbf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:07.945089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-db995cdc-5c66-4ea6-81d4-ad0f12ae8bbf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:07.965500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-db995cdc-5c66-4ea6-81d4-ad0f12ae8bbf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:07.968891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-db995cdc-5c66-4ea6-81d4-ad0f12ae8bbf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:07.972665 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-db995cdc-5c66-4ea6-81d4-ad0f12ae8bbf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1725 microversion: 2.20 time: 0.450572 Oct 24 10:44:07.986097 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2087/4216] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:07 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1725 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:44:08.000689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d1fb25ff-efc2-41c3-814d-fa4c22165cec tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:08.002227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d1fb25ff-efc2-41c3-814d-fa4c22165cec tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:08.009137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1fb25ff-efc2-41c3-814d-fa4c22165cec tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:08.009941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1fb25ff-efc2-41c3-814d-fa4c22165cec tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:08.010615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1fb25ff-efc2-41c3-814d-fa4c22165cec tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:08.012017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1fb25ff-efc2-41c3-814d-fa4c22165cec tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:08.012701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1fb25ff-efc2-41c3-814d-fa4c22165cec tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:08.013383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1fb25ff-efc2-41c3-814d-fa4c22165cec tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:08.073084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-85e8a1cb-45cf-4555-8c79-885ecc76c402 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:44:08.074117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-85e8a1cb-45cf-4555-8c79-885ecc76c402 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:44:08.074608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-85e8a1cb-45cf-4555-8c79-885ecc76c402 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:44:08.075296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-85e8a1cb-45cf-4555-8c79-885ecc76c402 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:44:08.075713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-85e8a1cb-45cf-4555-8c79-885ecc76c402 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:44:08.097118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85e8a1cb-45cf-4555-8c79-885ecc76c402 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:08.098724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85e8a1cb-45cf-4555-8c79-885ecc76c402 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:08.100087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85e8a1cb-45cf-4555-8c79-885ecc76c402 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:08.105884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85e8a1cb-45cf-4555-8c79-885ecc76c402 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:08.106734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85e8a1cb-45cf-4555-8c79-885ecc76c402 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:08.107413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-85e8a1cb-45cf-4555-8c79-885ecc76c402 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:08.164075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-85e8a1cb-45cf-4555-8c79-885ecc76c402 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Getting quotas for project 9ab3028765ba447589bf595a603ea2e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:44:08.175996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-85e8a1cb-45cf-4555-8c79-885ecc76c402 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Getting quotas for user ed058a5e8ac14236ab2e8783e9170346 and project 9ab3028765ba447589bf595a603ea2e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:44:08.197268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-85e8a1cb-45cf-4555-8c79-885ecc76c402 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:44:08.201858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-85e8a1cb-45cf-4555-8c79-885ecc76c402 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:44:08.345861 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-85e8a1cb-45cf-4555-8c79-885ecc76c402 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.368578 Oct 24 10:44:08.351190 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2130/4217] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:44:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:44:08.361689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-56d03c25-a4bb-472d-8b0e-c338383c8276 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:08.374295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-56d03c25-a4bb-472d-8b0e-c338383c8276 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:08.383457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-56d03c25-a4bb-472d-8b0e-c338383c8276 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Searching by: {'deleted': False, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:44:08.396161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56d03c25-a4bb-472d-8b0e-c338383c8276 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:08.397179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56d03c25-a4bb-472d-8b0e-c338383c8276 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:08.397906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56d03c25-a4bb-472d-8b0e-c338383c8276 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:08.399388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56d03c25-a4bb-472d-8b0e-c338383c8276 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:08.400000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56d03c25-a4bb-472d-8b0e-c338383c8276 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:08.400723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56d03c25-a4bb-472d-8b0e-c338383c8276 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:08.443820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d1fb25ff-efc2-41c3-814d-fa4c22165cec tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:08.451463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-56d03c25-a4bb-472d-8b0e-c338383c8276 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:44:08.456122 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d1fb25ff-efc2-41c3-814d-fa4c22165cec tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1505 microversion: 2.1 time: 0.467925 Oct 24 10:44:08.474870 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2088/4218] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:07 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:08.484695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-12dab6df-2c58-4674-8816-2521a39f1a70 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:08.485564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-12dab6df-2c58-4674-8816-2521a39f1a70 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:08.507452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12dab6df-2c58-4674-8816-2521a39f1a70 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:08.508807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12dab6df-2c58-4674-8816-2521a39f1a70 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:08.510106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12dab6df-2c58-4674-8816-2521a39f1a70 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:08.513927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12dab6df-2c58-4674-8816-2521a39f1a70 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:08.515815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12dab6df-2c58-4674-8816-2521a39f1a70 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:08.518018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12dab6df-2c58-4674-8816-2521a39f1a70 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:08.549988 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-56d03c25-a4bb-472d-8b0e-c338383c8276 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.195775 Oct 24 10:44:08.590155 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2131/4219] 10.222.0.50 () {58 vars in 1125 bytes} [Mon Oct 24 10:44:08 2022] GET /compute/v2.1/servers => generated 334 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:44:08.604698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c29d403d-d002-44ce-ad48-9380fea206a2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:08.606043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c29d403d-d002-44ce-ad48-9380fea206a2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:08.913050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c29d403d-d002-44ce-ad48-9380fea206a2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:08.922824 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c29d403d-d002-44ce-ad48-9380fea206a2 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 200 len: 1228 microversion: 2.1 time: 0.329551 Oct 24 10:44:08.950573 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2132/4220] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:08 2022] GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 1228 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:08.971736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-88e580d1-10a6-4c45-8369-99d471ac074f tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:08.984567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-88e580d1-10a6-4c45-8369-99d471ac074f tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:08.988733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-88e580d1-10a6-4c45-8369-99d471ac074f tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Searching by: {'deleted': False, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:44:09.005685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88e580d1-10a6-4c45-8369-99d471ac074f tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:09.008144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88e580d1-10a6-4c45-8369-99d471ac074f tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:09.008606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88e580d1-10a6-4c45-8369-99d471ac074f tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:09.009453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88e580d1-10a6-4c45-8369-99d471ac074f tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:09.009916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88e580d1-10a6-4c45-8369-99d471ac074f tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:09.010587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88e580d1-10a6-4c45-8369-99d471ac074f tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:09.084320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-12dab6df-2c58-4674-8816-2521a39f1a70 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:09.097077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-88e580d1-10a6-4c45-8369-99d471ac074f tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:44:09.103893 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-12dab6df-2c58-4674-8816-2521a39f1a70 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1609 microversion: 2.1 time: 0.627620 Oct 24 10:44:09.104567 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2089/4221] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:08 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1609 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:09.121002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8a1711ab-2bb2-454b-b99c-03fe8aa7eed8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:09.121002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8a1711ab-2bb2-454b-b99c-03fe8aa7eed8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:09.145341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a1711ab-2bb2-454b-b99c-03fe8aa7eed8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:09.148408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a1711ab-2bb2-454b-b99c-03fe8aa7eed8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:09.149720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a1711ab-2bb2-454b-b99c-03fe8aa7eed8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:09.151037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a1711ab-2bb2-454b-b99c-03fe8aa7eed8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:09.151524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a1711ab-2bb2-454b-b99c-03fe8aa7eed8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:09.152003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a1711ab-2bb2-454b-b99c-03fe8aa7eed8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:09.199039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-88e580d1-10a6-4c45-8369-99d471ac074f tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:09.212481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88e580d1-10a6-4c45-8369-99d471ac074f tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:09.213025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88e580d1-10a6-4c45-8369-99d471ac074f tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:09.216876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88e580d1-10a6-4c45-8369-99d471ac074f tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:09.686299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8a1711ab-2bb2-454b-b99c-03fe8aa7eed8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:09.697291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8a1711ab-2bb2-454b-b99c-03fe8aa7eed8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:09.698763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8a1711ab-2bb2-454b-b99c-03fe8aa7eed8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:09.706949 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8a1711ab-2bb2-454b-b99c-03fe8aa7eed8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1725 microversion: 2.20 time: 0.601211 Oct 24 10:44:09.707844 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2090/4222] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:09 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1725 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:09.731830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-88cd80d7-3093-472a-835b-13574d313664 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:09.736970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-88cd80d7-3093-472a-835b-13574d313664 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:09.748688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88cd80d7-3093-472a-835b-13574d313664 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:09.749229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88cd80d7-3093-472a-835b-13574d313664 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:09.749688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88cd80d7-3093-472a-835b-13574d313664 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:09.750438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88cd80d7-3093-472a-835b-13574d313664 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:09.752547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88cd80d7-3093-472a-835b-13574d313664 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:09.753311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88cd80d7-3093-472a-835b-13574d313664 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:10.032166 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-88e580d1-10a6-4c45-8369-99d471ac074f tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 1.078737 Oct 24 10:44:10.033296 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2133/4223] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:44:08 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:10.043694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-86dfbdc7-45b6-47e6-a7bf-c78d5fc14ae4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:10.045673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-86dfbdc7-45b6-47e6-a7bf-c78d5fc14ae4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:10.053692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-86dfbdc7-45b6-47e6-a7bf-c78d5fc14ae4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:10.055618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-86dfbdc7-45b6-47e6-a7bf-c78d5fc14ae4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:10.065147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-86dfbdc7-45b6-47e6-a7bf-c78d5fc14ae4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:10.066939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-86dfbdc7-45b6-47e6-a7bf-c78d5fc14ae4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:10.071755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-86dfbdc7-45b6-47e6-a7bf-c78d5fc14ae4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:10.072229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-86dfbdc7-45b6-47e6-a7bf-c78d5fc14ae4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:10.316097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-88cd80d7-3093-472a-835b-13574d313664 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:10.325592 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-88cd80d7-3093-472a-835b-13574d313664 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1609 microversion: 2.1 time: 0.615676 Oct 24 10:44:10.326185 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2091/4224] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:09 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1609 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:10.347614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-36c8b8da-5588-49e7-889d-84880a6c6b54 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:10.350005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-36c8b8da-5588-49e7-889d-84880a6c6b54 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:10.379912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36c8b8da-5588-49e7-889d-84880a6c6b54 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:10.380419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36c8b8da-5588-49e7-889d-84880a6c6b54 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:10.384161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36c8b8da-5588-49e7-889d-84880a6c6b54 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:10.388768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36c8b8da-5588-49e7-889d-84880a6c6b54 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:10.389569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36c8b8da-5588-49e7-889d-84880a6c6b54 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:10.391522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36c8b8da-5588-49e7-889d-84880a6c6b54 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:10.442652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-86dfbdc7-45b6-47e6-a7bf-c78d5fc14ae4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:10.455183 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-86dfbdc7-45b6-47e6-a7bf-c78d5fc14ae4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1505 microversion: 2.1 time: 0.415089 Oct 24 10:44:10.461130 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2134/4225] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:10 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:10.474559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5fd1c406-8ec7-4d94-b8c7-b2e90199dabc tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:10.491300 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5fd1c406-8ec7-4d94-b8c7-b2e90199dabc tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028195 Oct 24 10:44:10.493177 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2135/4226] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:44:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:44:10.499467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-665c804f-812a-4fd9-9cb5-c3b200cb76c4 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:10.500130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-665c804f-812a-4fd9-9cb5-c3b200cb76c4 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:10.509695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-665c804f-812a-4fd9-9cb5-c3b200cb76c4 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:10.510504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-665c804f-812a-4fd9-9cb5-c3b200cb76c4 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:10.513857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-665c804f-812a-4fd9-9cb5-c3b200cb76c4 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:10.514895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-665c804f-812a-4fd9-9cb5-c3b200cb76c4 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:10.515787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-665c804f-812a-4fd9-9cb5-c3b200cb76c4 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:10.516431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-665c804f-812a-4fd9-9cb5-c3b200cb76c4 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:10.690774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-36c8b8da-5588-49e7-889d-84880a6c6b54 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:10.704115 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-36c8b8da-5588-49e7-889d-84880a6c6b54 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 200 len: 1288 microversion: 2.1 time: 0.365042 Oct 24 10:44:10.707992 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2092/4227] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:10 2022] GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 1288 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:10.737324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-07a32268-0def-4995-91f9-cf447ab2396e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:10.738415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-07a32268-0def-4995-91f9-cf447ab2396e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:10.749769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07a32268-0def-4995-91f9-cf447ab2396e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:10.751771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07a32268-0def-4995-91f9-cf447ab2396e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:10.752494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07a32268-0def-4995-91f9-cf447ab2396e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:10.754520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07a32268-0def-4995-91f9-cf447ab2396e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:10.758705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07a32268-0def-4995-91f9-cf447ab2396e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:10.759164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07a32268-0def-4995-91f9-cf447ab2396e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:10.964763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-665c804f-812a-4fd9-9cb5-c3b200cb76c4 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:10.976210 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-665c804f-812a-4fd9-9cb5-c3b200cb76c4 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1609 microversion: 2.1 time: 0.481602 Oct 24 10:44:10.977600 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2136/4228] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:10 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1609 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:10.984751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1d3ca3cc-a25f-4be4-9d76-3e1302ecbbc5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:10.985678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1d3ca3cc-a25f-4be4-9d76-3e1302ecbbc5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:10.996300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d3ca3cc-a25f-4be4-9d76-3e1302ecbbc5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:10.998161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d3ca3cc-a25f-4be4-9d76-3e1302ecbbc5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:10.998844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d3ca3cc-a25f-4be4-9d76-3e1302ecbbc5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:10.999657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d3ca3cc-a25f-4be4-9d76-3e1302ecbbc5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:11.000341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d3ca3cc-a25f-4be4-9d76-3e1302ecbbc5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:11.001355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d3ca3cc-a25f-4be4-9d76-3e1302ecbbc5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:11.039626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1d3ca3cc-a25f-4be4-9d76-3e1302ecbbc5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:44:11.141390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-07a32268-0def-4995-91f9-cf447ab2396e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:11.155728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-07a32268-0def-4995-91f9-cf447ab2396e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:11.159323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-07a32268-0def-4995-91f9-cf447ab2396e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:11.176380 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-07a32268-0def-4995-91f9-cf447ab2396e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1725 microversion: 2.20 time: 0.443343 Oct 24 10:44:11.181940 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2093/4229] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:10 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1725 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:44:11.204615 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1d3ca3cc-a25f-4be4-9d76-3e1302ecbbc5 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 204 len: 0 microversion: 2.1 time: 0.224763 Oct 24 10:44:11.205642 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2137/4230] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:44:10 2022] DELETE /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:44:11.220724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c9fcbc90-6731-4491-b401-5eaa79b884fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:11.224845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c9fcbc90-6731-4491-b401-5eaa79b884fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:11.241079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9fcbc90-6731-4491-b401-5eaa79b884fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:11.242446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9fcbc90-6731-4491-b401-5eaa79b884fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:11.243441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9fcbc90-6731-4491-b401-5eaa79b884fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:11.244335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9fcbc90-6731-4491-b401-5eaa79b884fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:11.245833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9fcbc90-6731-4491-b401-5eaa79b884fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:11.246472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9fcbc90-6731-4491-b401-5eaa79b884fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:11.499380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6efbf156-e393-4d61-9a39-3f0dbbe0252e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:11.505830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6efbf156-e393-4d61-9a39-3f0dbbe0252e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:11.520896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6efbf156-e393-4d61-9a39-3f0dbbe0252e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:11.523538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6efbf156-e393-4d61-9a39-3f0dbbe0252e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:11.524388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6efbf156-e393-4d61-9a39-3f0dbbe0252e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:11.526833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6efbf156-e393-4d61-9a39-3f0dbbe0252e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:11.527332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6efbf156-e393-4d61-9a39-3f0dbbe0252e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:11.527773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6efbf156-e393-4d61-9a39-3f0dbbe0252e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:11.771378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c9fcbc90-6731-4491-b401-5eaa79b884fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:11.780767 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c9fcbc90-6731-4491-b401-5eaa79b884fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1701 microversion: 2.1 time: 0.570611 Oct 24 10:44:11.781828 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2094/4231] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:11 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1701 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:11.805178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cabbec7a-c751-464d-ad80-9a54518dd77a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:11.806280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cabbec7a-c751-464d-ad80-9a54518dd77a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:11.827040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cabbec7a-c751-464d-ad80-9a54518dd77a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:11.827539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cabbec7a-c751-464d-ad80-9a54518dd77a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:11.827990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cabbec7a-c751-464d-ad80-9a54518dd77a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:11.828703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cabbec7a-c751-464d-ad80-9a54518dd77a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:11.829186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cabbec7a-c751-464d-ad80-9a54518dd77a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:11.830168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cabbec7a-c751-464d-ad80-9a54518dd77a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:11.982636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cabbec7a-c751-464d-ad80-9a54518dd77a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:11.991560 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cabbec7a-c751-464d-ad80-9a54518dd77a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 200 len: 1286 microversion: 2.1 time: 0.192986 Oct 24 10:44:11.992177 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2095/4232] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:11 2022] GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 1286 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:12.209115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1029b445-8c6d-463a-bf33-d07883d60e4e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:12.209991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1029b445-8c6d-463a-bf33-d07883d60e4e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:12.218792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1029b445-8c6d-463a-bf33-d07883d60e4e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:12.221393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1029b445-8c6d-463a-bf33-d07883d60e4e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:12.221552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6efbf156-e393-4d61-9a39-3f0dbbe0252e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:12.224518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1029b445-8c6d-463a-bf33-d07883d60e4e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:12.226207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1029b445-8c6d-463a-bf33-d07883d60e4e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:12.228429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1029b445-8c6d-463a-bf33-d07883d60e4e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:12.230172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1029b445-8c6d-463a-bf33-d07883d60e4e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:12.230288 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6efbf156-e393-4d61-9a39-3f0dbbe0252e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1505 microversion: 2.1 time: 0.750801 Oct 24 10:44:12.250801 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2138/4233] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:11 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1505 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:12.718631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1029b445-8c6d-463a-bf33-d07883d60e4e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:12.732456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1029b445-8c6d-463a-bf33-d07883d60e4e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:12.740325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1029b445-8c6d-463a-bf33-d07883d60e4e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:12.743843 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1029b445-8c6d-463a-bf33-d07883d60e4e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1725 microversion: 2.20 time: 0.540006 Oct 24 10:44:12.748418 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2096/4234] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:12 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1725 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:12.805554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d8ccf56c-0bd9-452d-ad6b-2e610ed4b0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:12.806171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d8ccf56c-0bd9-452d-ad6b-2e610ed4b0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:12.828108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8ccf56c-0bd9-452d-ad6b-2e610ed4b0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:12.828789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8ccf56c-0bd9-452d-ad6b-2e610ed4b0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:12.829307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8ccf56c-0bd9-452d-ad6b-2e610ed4b0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:12.830090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8ccf56c-0bd9-452d-ad6b-2e610ed4b0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:12.830729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8ccf56c-0bd9-452d-ad6b-2e610ed4b0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:12.838601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8ccf56c-0bd9-452d-ad6b-2e610ed4b0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:13.022789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf35c5d8-67b8-4ca2-87e2-ea34ceb32fc5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:13.024363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf35c5d8-67b8-4ca2-87e2-ea34ceb32fc5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:13.031722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:44:13.034039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf35c5d8-67b8-4ca2-87e2-ea34ceb32fc5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:13.036647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf35c5d8-67b8-4ca2-87e2-ea34ceb32fc5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:13.037369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf35c5d8-67b8-4ca2-87e2-ea34ceb32fc5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:13.038494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf35c5d8-67b8-4ca2-87e2-ea34ceb32fc5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:13.039336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf35c5d8-67b8-4ca2-87e2-ea34ceb32fc5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:13.039988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf35c5d8-67b8-4ca2-87e2-ea34ceb32fc5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:14.232139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cf35c5d8-67b8-4ca2-87e2-ea34ceb32fc5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:14.250625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d8ccf56c-0bd9-452d-ad6b-2e610ed4b0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:14.259106 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf35c5d8-67b8-4ca2-87e2-ea34ceb32fc5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 200 len: 1328 microversion: 2.1 time: 1.233914 Oct 24 10:44:14.264890 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2097/4235] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:13 2022] GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 1328 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:14.269574 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d8ccf56c-0bd9-452d-ad6b-2e610ed4b0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1701 microversion: 2.1 time: 1.467793 Oct 24 10:44:14.270151 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2139/4236] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:12 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1701 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:14.280585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-30ba1085-b5f5-4d2d-b1e5-91fead6e4cd4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:14.281636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-30ba1085-b5f5-4d2d-b1e5-91fead6e4cd4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:14.282304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-41785f81-00e4-43d0-9957-c11c4ad8cf9e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:14.283443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-41785f81-00e4-43d0-9957-c11c4ad8cf9e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:14.291051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30ba1085-b5f5-4d2d-b1e5-91fead6e4cd4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:14.292970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30ba1085-b5f5-4d2d-b1e5-91fead6e4cd4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:14.294045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30ba1085-b5f5-4d2d-b1e5-91fead6e4cd4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:14.296786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30ba1085-b5f5-4d2d-b1e5-91fead6e4cd4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:14.297610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30ba1085-b5f5-4d2d-b1e5-91fead6e4cd4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:14.299547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30ba1085-b5f5-4d2d-b1e5-91fead6e4cd4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:14.303051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41785f81-00e4-43d0-9957-c11c4ad8cf9e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:14.303711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41785f81-00e4-43d0-9957-c11c4ad8cf9e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:14.304299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41785f81-00e4-43d0-9957-c11c4ad8cf9e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:14.305212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41785f81-00e4-43d0-9957-c11c4ad8cf9e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:14.305814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41785f81-00e4-43d0-9957-c11c4ad8cf9e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:14.306378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41785f81-00e4-43d0-9957-c11c4ad8cf9e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:15.037152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-41785f81-00e4-43d0-9957-c11c4ad8cf9e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:15.051842 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-41785f81-00e4-43d0-9957-c11c4ad8cf9e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:15.056325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-41785f81-00e4-43d0-9957-c11c4ad8cf9e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:15.059747 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-41785f81-00e4-43d0-9957-c11c4ad8cf9e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1746 microversion: 2.20 time: 0.783208 Oct 24 10:44:15.069221 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2140/4237] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:14 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1746 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:15.090042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-6535ccc3-777d-49ed-8de6-fe96d0954576 req-039feacd-b158-49ab-b689-9bd330d64030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf49c481-07dd-4401-b045-5f0945291b50", "tag": "db179df0-8dc0-43b3-9e26-a4d4eb25ed78"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:15.102169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-30ba1085-b5f5-4d2d-b1e5-91fead6e4cd4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:15.133926 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-30ba1085-b5f5-4d2d-b1e5-91fead6e4cd4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1505 microversion: 2.1 time: 0.867292 Oct 24 10:44:15.136999 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2098/4238] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:14 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1505 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:15.149322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6535ccc3-777d-49ed-8de6-fe96d0954576 req-039feacd-b158-49ab-b689-9bd330d64030 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:15.150264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6535ccc3-777d-49ed-8de6-fe96d0954576 req-039feacd-b158-49ab-b689-9bd330d64030 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:15.151871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6535ccc3-777d-49ed-8de6-fe96d0954576 req-039feacd-b158-49ab-b689-9bd330d64030 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:15.195116 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-6535ccc3-777d-49ed-8de6-fe96d0954576 req-039feacd-b158-49ab-b689-9bd330d64030 service nova] Creating event network-changed:db179df0-8dc0-43b3-9e26-a4d4eb25ed78 for instance bf49c481-07dd-4401-b045-5f0945291b50 on n-h2-858383-15 Oct 24 10:44:15.209695 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-6535ccc3-777d-49ed-8de6-fe96d0954576 req-039feacd-b158-49ab-b689-9bd330d64030 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135749 Oct 24 10:44:15.213962 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2141/4239] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:44:15.289807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7491a06a-5054-4aa7-81ac-38f77e90a75c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:15.290458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7491a06a-5054-4aa7-81ac-38f77e90a75c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:15.301250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3cc46ee-d4fb-4f5c-8300-aa645b631151 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:15.302044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f3cc46ee-d4fb-4f5c-8300-aa645b631151 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:15.302267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7491a06a-5054-4aa7-81ac-38f77e90a75c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:15.302933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7491a06a-5054-4aa7-81ac-38f77e90a75c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:15.303728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7491a06a-5054-4aa7-81ac-38f77e90a75c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:15.304602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7491a06a-5054-4aa7-81ac-38f77e90a75c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:15.307948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7491a06a-5054-4aa7-81ac-38f77e90a75c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:15.309076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7491a06a-5054-4aa7-81ac-38f77e90a75c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:15.317421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:44:15.324328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3cc46ee-d4fb-4f5c-8300-aa645b631151 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:15.325606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3cc46ee-d4fb-4f5c-8300-aa645b631151 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:15.328247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3cc46ee-d4fb-4f5c-8300-aa645b631151 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:15.329037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3cc46ee-d4fb-4f5c-8300-aa645b631151 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:15.330294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3cc46ee-d4fb-4f5c-8300-aa645b631151 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:15.331831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3cc46ee-d4fb-4f5c-8300-aa645b631151 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:15.344425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:44:15.349167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:44:16.162278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7491a06a-5054-4aa7-81ac-38f77e90a75c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:16.174703 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7491a06a-5054-4aa7-81ac-38f77e90a75c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 200 len: 1328 microversion: 2.1 time: 0.892010 Oct 24 10:44:16.176612 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2099/4240] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:15 2022] GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 1328 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:16.184710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c96bbcf6-ee26-41d2-a56f-afde5ede6941 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:16.185524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c96bbcf6-ee26-41d2-a56f-afde5ede6941 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:16.200160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c96bbcf6-ee26-41d2-a56f-afde5ede6941 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:16.200674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c96bbcf6-ee26-41d2-a56f-afde5ede6941 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:16.201157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c96bbcf6-ee26-41d2-a56f-afde5ede6941 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:16.201871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c96bbcf6-ee26-41d2-a56f-afde5ede6941 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:16.202336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c96bbcf6-ee26-41d2-a56f-afde5ede6941 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:16.202764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c96bbcf6-ee26-41d2-a56f-afde5ede6941 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:16.244188 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-c96bbcf6-ee26-41d2-a56f-afde5ede6941 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] HTTP exception thrown: Instance f2595b35-cdfc-4152-b325-ea712ff8b946 could not be found. Oct 24 10:44:16.244760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3cc46ee-d4fb-4f5c-8300-aa645b631151 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c96bbcf6-ee26-41d2-a56f-afde5ede6941 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Request method failure captured: Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 HTTP/1.1 Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmrE9ZjH2-FOOxEaq1Um4zY_N0a0pkjUAXzjYezwM200NZnmc_lW9lS6Jd7NRhc0d1o-Xhdm1m4y0fV91cdA1W5vd6u6QqLBd6Vmh-337alFIolP6ijg4sPnzuvJqeB_TUsUQ9Y3AvFypU_2XxY8x-6tA9VHmmEcErr7deX0P9YhyBM Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.32 Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 2eb64e6d84904f1083116b5aed79f7f2 Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TaggedBootDevicesTest-1860443483 Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2eb64e6d84904f1083116b5aed79f7f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2eb64e6d84904f1083116b5aed79f7f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2eb64e6d84904f1083116b5aed79f7f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2eb64e6d84904f1083116b5aed79f7f2", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TaggedBootDevicesTest-1860443483 Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 2eb64e6d84904f1083116b5aed79f7f2 Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1860443483 Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TaggedBootDevicesTest-1860443483-project Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6052fe343c86452f9183b383fcc85183 Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TaggedBootDevicesTest-1860443483-project Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance f2595b35-cdfc-4152-b325-ea712ff8b946 could not be found. Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'f2595b35-cdfc-4152-b325-ea712ff8b946'} Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2595b35-cdfc-4152-b325-ea712ff8b946 could not be found. Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:44:16.247645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:44:16.251386 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2595b35-cdfc-4152-b325-ea712ff8b946 could not be found. Oct 24 10:44:16.251386 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:44:16.251386 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:44:16.251386 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:44:16.251386 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:44:16.251386 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:44:16.251386 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:44:16.251386 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:44:16.251386 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:44:16.251386 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2595b35-cdfc-4152-b325-ea712ff8b946 could not be found. Oct 24 10:44:16.251386 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:44:16.255390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c96bbcf6-ee26-41d2-a56f-afde5ede6941 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Returning 404 to user: Instance f2595b35-cdfc-4152-b325-ea712ff8b946 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:44:16.256261 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c96bbcf6-ee26-41d2-a56f-afde5ede6941 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 404 len: 111 microversion: 2.32 time: 0.077170 Oct 24 10:44:16.256859 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2100/4241] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:44:16 2022] DELETE /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:44:16.259073 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f3cc46ee-d4fb-4f5c-8300-aa645b631151 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1701 microversion: 2.1 time: 0.963023 Oct 24 10:44:16.261712 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2142/4242] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:15 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1701 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:44:16.273515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ea501143-a748-4451-b47d-bd3029c05cef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:16.274953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ea501143-a748-4451-b47d-bd3029c05cef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:16.275910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-533e4966-bfd0-455a-a446-9038ce35c180 req-f8f900d7-d175-43b2-b6a4-fd66d0287a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7e0c405-e34b-4b9c-97f6-ab1eb6b06526", "name": "network-vif-unplugged", "status": "completed", "tag": "faea1350-7eaa-49e8-9806-291645b32b6e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:16.286093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-533e4966-bfd0-455a-a446-9038ce35c180 req-f8f900d7-d175-43b2-b6a4-fd66d0287a31 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:16.286868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-533e4966-bfd0-455a-a446-9038ce35c180 req-f8f900d7-d175-43b2-b6a4-fd66d0287a31 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:16.287508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-533e4966-bfd0-455a-a446-9038ce35c180 req-f8f900d7-d175-43b2-b6a4-fd66d0287a31 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:16.290469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea501143-a748-4451-b47d-bd3029c05cef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:16.290975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea501143-a748-4451-b47d-bd3029c05cef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:16.299345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea501143-a748-4451-b47d-bd3029c05cef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:16.299955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea501143-a748-4451-b47d-bd3029c05cef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:16.300423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea501143-a748-4451-b47d-bd3029c05cef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:16.300874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea501143-a748-4451-b47d-bd3029c05cef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:16.300996 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-533e4966-bfd0-455a-a446-9038ce35c180 req-f8f900d7-d175-43b2-b6a4-fd66d0287a31 service nova] Creating event network-vif-unplugged:faea1350-7eaa-49e8-9806-291645b32b6e for instance e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 on n-h1-858383-15 Oct 24 10:44:16.307738 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-533e4966-bfd0-455a-a446-9038ce35c180 req-f8f900d7-d175-43b2-b6a4-fd66d0287a31 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049433 Oct 24 10:44:16.308938 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2101/4243] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:44:16.315962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-26f3c5c0-140d-4f36-8652-40b9c4be9d05 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:16.316991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-26f3c5c0-140d-4f36-8652-40b9c4be9d05 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:16.324577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26f3c5c0-140d-4f36-8652-40b9c4be9d05 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:16.325363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26f3c5c0-140d-4f36-8652-40b9c4be9d05 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:16.326134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26f3c5c0-140d-4f36-8652-40b9c4be9d05 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:16.327069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26f3c5c0-140d-4f36-8652-40b9c4be9d05 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:16.327793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26f3c5c0-140d-4f36-8652-40b9c4be9d05 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:16.328631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26f3c5c0-140d-4f36-8652-40b9c4be9d05 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:16.749371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ea501143-a748-4451-b47d-bd3029c05cef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:16.769699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ea501143-a748-4451-b47d-bd3029c05cef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:16.772023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ea501143-a748-4451-b47d-bd3029c05cef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:16.773419 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ea501143-a748-4451-b47d-bd3029c05cef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1746 microversion: 2.20 time: 0.510445 Oct 24 10:44:16.774002 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2143/4244] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:16 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1746 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:16.777980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-26f3c5c0-140d-4f36-8652-40b9c4be9d05 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:16.784350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aa828ff0-0305-4e51-ab10-3ce38eee65a1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:16.785045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aa828ff0-0305-4e51-ab10-3ce38eee65a1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] [instance: f2595b35-cdfc-4152-b325-ea712ff8b946] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:16.791806 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-26f3c5c0-140d-4f36-8652-40b9c4be9d05 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1505 microversion: 2.1 time: 0.481172 Oct 24 10:44:16.793613 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2102/4245] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:16 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1505 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:16.796233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa828ff0-0305-4e51-ab10-3ce38eee65a1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:16.796798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa828ff0-0305-4e51-ab10-3ce38eee65a1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:16.797271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa828ff0-0305-4e51-ab10-3ce38eee65a1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:16.797992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa828ff0-0305-4e51-ab10-3ce38eee65a1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:16.806032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa828ff0-0305-4e51-ab10-3ce38eee65a1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:16.806669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa828ff0-0305-4e51-ab10-3ce38eee65a1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:16.839447 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-aa828ff0-0305-4e51-ab10-3ce38eee65a1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] HTTP exception thrown: Instance f2595b35-cdfc-4152-b325-ea712ff8b946 could not be found. Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aa828ff0-0305-4e51-ab10-3ce38eee65a1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Request method failure captured: Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 HTTP/1.1 Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmrE9ZjH2-FOOxEaq1Um4zY_N0a0pkjUAXzjYezwM200NZnmc_lW9lS6Jd7NRhc0d1o-Xhdm1m4y0fV91cdA1W5vd6u6QqLBd6Vmh-337alFIolP6ijg4sPnzuvJqeB_TUsUQ9Y3AvFypU_2XxY8x-6tA9VHmmEcErr7deX0P9YhyBM Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-Openstack-Nova-Api-Version: 2.32 Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 2eb64e6d84904f1083116b5aed79f7f2 Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TaggedBootDevicesTest-1860443483 Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2eb64e6d84904f1083116b5aed79f7f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2eb64e6d84904f1083116b5aed79f7f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2eb64e6d84904f1083116b5aed79f7f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2eb64e6d84904f1083116b5aed79f7f2", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TaggedBootDevicesTest-1860443483 Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 2eb64e6d84904f1083116b5aed79f7f2 Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1860443483 Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TaggedBootDevicesTest-1860443483-project Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 6052fe343c86452f9183b383fcc85183 Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TaggedBootDevicesTest-1860443483-project Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance f2595b35-cdfc-4152-b325-ea712ff8b946 could not be found. Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'f2595b35-cdfc-4152-b325-ea712ff8b946'} Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2595b35-cdfc-4152-b325-ea712ff8b946 could not be found. Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2595b35-cdfc-4152-b325-ea712ff8b946 could not be found. Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:16.841182 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:44:16.845953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:16.845953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:44:16.845953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:44:16.845953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:44:16.845953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:44:16.845953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:44:16.845953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2595b35-cdfc-4152-b325-ea712ff8b946 could not be found. Oct 24 10:44:16.845953 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:16.845953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aa828ff0-0305-4e51-ab10-3ce38eee65a1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] Returning 404 to user: Instance f2595b35-cdfc-4152-b325-ea712ff8b946 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:44:16.845953 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aa828ff0-0305-4e51-ab10-3ce38eee65a1 tempest-TaggedBootDevicesTest-1860443483 tempest-TaggedBootDevicesTest-1860443483-project] 10.222.0.50 "GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946" status: 404 len: 111 microversion: 2.32 time: 0.067531 Oct 24 10:44:16.849186 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2144/4246] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:16 2022] GET /compute/v2.1/servers/f2595b35-cdfc-4152-b325-ea712ff8b946 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:44:17.219781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8f24fe94-d466-43cb-b07f-e0330663415c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:17.221907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8f24fe94-d466-43cb-b07f-e0330663415c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:17.241405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f24fe94-d466-43cb-b07f-e0330663415c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:17.244093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f24fe94-d466-43cb-b07f-e0330663415c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:17.247272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f24fe94-d466-43cb-b07f-e0330663415c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:17.248453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f24fe94-d466-43cb-b07f-e0330663415c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:17.253600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f24fe94-d466-43cb-b07f-e0330663415c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:17.255271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f24fe94-d466-43cb-b07f-e0330663415c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:17.284668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-faef3e63-34e8-4418-aac0-6c2d5c0ff0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:17.285990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-faef3e63-34e8-4418-aac0-6c2d5c0ff0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:17.293707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-faef3e63-34e8-4418-aac0-6c2d5c0ff0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:17.296327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-faef3e63-34e8-4418-aac0-6c2d5c0ff0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:17.297027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-faef3e63-34e8-4418-aac0-6c2d5c0ff0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:17.298000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-faef3e63-34e8-4418-aac0-6c2d5c0ff0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:17.298695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-faef3e63-34e8-4418-aac0-6c2d5c0ff0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:17.299326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-faef3e63-34e8-4418-aac0-6c2d5c0ff0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:17.615667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-faef3e63-34e8-4418-aac0-6c2d5c0ff0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:17.630881 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-faef3e63-34e8-4418-aac0-6c2d5c0ff0d6 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1634 microversion: 2.1 time: 0.349064 Oct 24 10:44:17.633443 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2145/4247] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:17 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1634 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:17.804879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3dae4526-a42b-4abc-a5af-df3194d08732 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:17.805724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3dae4526-a42b-4abc-a5af-df3194d08732 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:17.818759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dae4526-a42b-4abc-a5af-df3194d08732 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:17.821714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dae4526-a42b-4abc-a5af-df3194d08732 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:17.824470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dae4526-a42b-4abc-a5af-df3194d08732 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:17.825559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dae4526-a42b-4abc-a5af-df3194d08732 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:17.827099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dae4526-a42b-4abc-a5af-df3194d08732 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:17.828481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dae4526-a42b-4abc-a5af-df3194d08732 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:18.782015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8f24fe94-d466-43cb-b07f-e0330663415c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:18.798728 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8f24fe94-d466-43cb-b07f-e0330663415c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 200 len: 1328 microversion: 2.1 time: 1.595271 Oct 24 10:44:18.799324 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2103/4248] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:17 2022] GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 1328 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:18.867952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-987fcbbb-f242-4a41-b7b2-95448dd0e81b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:18.870677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-987fcbbb-f242-4a41-b7b2-95448dd0e81b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:18.889251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-987fcbbb-f242-4a41-b7b2-95448dd0e81b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:18.889750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-987fcbbb-f242-4a41-b7b2-95448dd0e81b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:18.890537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-987fcbbb-f242-4a41-b7b2-95448dd0e81b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:18.891326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-987fcbbb-f242-4a41-b7b2-95448dd0e81b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:18.893319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-987fcbbb-f242-4a41-b7b2-95448dd0e81b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:18.893759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-987fcbbb-f242-4a41-b7b2-95448dd0e81b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:19.047779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:44:19.197098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=14 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:44:19.206443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3dae4526-a42b-4abc-a5af-df3194d08732 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:19.230514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3dae4526-a42b-4abc-a5af-df3194d08732 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:19.240160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3dae4526-a42b-4abc-a5af-df3194d08732 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:19.252722 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3dae4526-a42b-4abc-a5af-df3194d08732 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1741 microversion: 2.20 time: 1.452214 Oct 24 10:44:19.255449 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2146/4249] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:17 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1741 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:19.268611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-db968376-68cf-439b-b158-95a2b38e1a87 req-a98ee8be-56b9-47e8-a5bb-97a0d2989a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6eb3578-42ca-4dc5-b31a-e5500aa94f2e", "name": "network-vif-plugged", "status": "completed", "tag": "36f88fb2-6faf-4282-bd23-d4f02a3206ca"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:19.315958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-db968376-68cf-439b-b158-95a2b38e1a87 req-a98ee8be-56b9-47e8-a5bb-97a0d2989a48 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:19.329619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-db968376-68cf-439b-b158-95a2b38e1a87 req-a98ee8be-56b9-47e8-a5bb-97a0d2989a48 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:19.331885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-db968376-68cf-439b-b158-95a2b38e1a87 req-a98ee8be-56b9-47e8-a5bb-97a0d2989a48 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:19.375054 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-db968376-68cf-439b-b158-95a2b38e1a87 req-a98ee8be-56b9-47e8-a5bb-97a0d2989a48 service nova] Creating event network-vif-plugged:36f88fb2-6faf-4282-bd23-d4f02a3206ca for instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e on n-h2-858383-15 Oct 24 10:44:19.402251 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-db968376-68cf-439b-b158-95a2b38e1a87 req-a98ee8be-56b9-47e8-a5bb-97a0d2989a48 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142243 Oct 24 10:44:19.403170 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2147/4250] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:44:19.422858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-200efa12-657b-4de2-aa19-207996737a93 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:19.425687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-200efa12-657b-4de2-aa19-207996737a93 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:19.449545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-200efa12-657b-4de2-aa19-207996737a93 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:19.452360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-200efa12-657b-4de2-aa19-207996737a93 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:19.453057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-200efa12-657b-4de2-aa19-207996737a93 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:19.453987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-200efa12-657b-4de2-aa19-207996737a93 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:19.461607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-200efa12-657b-4de2-aa19-207996737a93 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:19.462504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-200efa12-657b-4de2-aa19-207996737a93 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:19.765456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-200efa12-657b-4de2-aa19-207996737a93 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:19.776345 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-200efa12-657b-4de2-aa19-207996737a93 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1355 microversion: 2.1 time: 0.365687 Oct 24 10:44:19.781547 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2148/4251] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:19 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1355 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:19.790044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-431d8f95-7cd1-45d1-bbbb-20e84cea1f70 req-7b483352-17c5-40f0-8794-770e520cc27a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7e0c405-e34b-4b9c-97f6-ab1eb6b06526", "name": "network-vif-deleted", "tag": "faea1350-7eaa-49e8-9806-291645b32b6e"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:19.821802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-431d8f95-7cd1-45d1-bbbb-20e84cea1f70 req-7b483352-17c5-40f0-8794-770e520cc27a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:19.822483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-431d8f95-7cd1-45d1-bbbb-20e84cea1f70 req-7b483352-17c5-40f0-8794-770e520cc27a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:19.827157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-431d8f95-7cd1-45d1-bbbb-20e84cea1f70 req-7b483352-17c5-40f0-8794-770e520cc27a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:19.858515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-987fcbbb-f242-4a41-b7b2-95448dd0e81b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:19.859012 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-431d8f95-7cd1-45d1-bbbb-20e84cea1f70 req-7b483352-17c5-40f0-8794-770e520cc27a service nova] Creating event network-vif-deleted:faea1350-7eaa-49e8-9806-291645b32b6e for instance e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 on n-h1-858383-15 Oct 24 10:44:19.870865 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-987fcbbb-f242-4a41-b7b2-95448dd0e81b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1505 microversion: 2.1 time: 1.058575 Oct 24 10:44:19.878974 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2104/4252] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:18 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1505 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:19.888013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9b53c2c2-6719-47d2-a32a-f307bc68c17a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:19.888718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9b53c2c2-6719-47d2-a32a-f307bc68c17a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:19.918731 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-431d8f95-7cd1-45d1-bbbb-20e84cea1f70 req-7b483352-17c5-40f0-8794-770e520cc27a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135696 Oct 24 10:44:19.925436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b53c2c2-6719-47d2-a32a-f307bc68c17a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:19.926348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b53c2c2-6719-47d2-a32a-f307bc68c17a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:19.927015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b53c2c2-6719-47d2-a32a-f307bc68c17a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:19.932118 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2149/4253] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:44:19.932484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b53c2c2-6719-47d2-a32a-f307bc68c17a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:19.933314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b53c2c2-6719-47d2-a32a-f307bc68c17a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:19.933930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b53c2c2-6719-47d2-a32a-f307bc68c17a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:20.281549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-10dc4bc5-6b19-48c3-9b60-bd05e851f5a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:20.282164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-10dc4bc5-6b19-48c3-9b60-bd05e851f5a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:20.324394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10dc4bc5-6b19-48c3-9b60-bd05e851f5a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:20.324991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10dc4bc5-6b19-48c3-9b60-bd05e851f5a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:20.334427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10dc4bc5-6b19-48c3-9b60-bd05e851f5a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:20.336971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10dc4bc5-6b19-48c3-9b60-bd05e851f5a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:20.340103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10dc4bc5-6b19-48c3-9b60-bd05e851f5a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:20.343749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10dc4bc5-6b19-48c3-9b60-bd05e851f5a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:20.455240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9b53c2c2-6719-47d2-a32a-f307bc68c17a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:20.469525 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9b53c2c2-6719-47d2-a32a-f307bc68c17a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 200 len: 1328 microversion: 2.1 time: 0.589321 Oct 24 10:44:20.470402 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2105/4254] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:19 2022] GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 1328 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:20.681216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-10dc4bc5-6b19-48c3-9b60-bd05e851f5a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:20.697976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-10dc4bc5-6b19-48c3-9b60-bd05e851f5a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:20.702989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-10dc4bc5-6b19-48c3-9b60-bd05e851f5a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:20.707323 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-10dc4bc5-6b19-48c3-9b60-bd05e851f5a5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1741 microversion: 2.20 time: 0.430712 Oct 24 10:44:20.709925 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2150/4255] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:20 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1741 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:20.804822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-028b56c1-bb14-454f-a044-c172fb5af9fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:20.805720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-028b56c1-bb14-454f-a044-c172fb5af9fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:20.813735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-028b56c1-bb14-454f-a044-c172fb5af9fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:20.814584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-028b56c1-bb14-454f-a044-c172fb5af9fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:20.815066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-028b56c1-bb14-454f-a044-c172fb5af9fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:20.815785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-028b56c1-bb14-454f-a044-c172fb5af9fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:20.816351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-028b56c1-bb14-454f-a044-c172fb5af9fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:20.816791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-028b56c1-bb14-454f-a044-c172fb5af9fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:20.902307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8e3dddcd-f70a-4258-9b6c-75fb88de072e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:20.902937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8e3dddcd-f70a-4258-9b6c-75fb88de072e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:20.915109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e3dddcd-f70a-4258-9b6c-75fb88de072e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:20.918661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e3dddcd-f70a-4258-9b6c-75fb88de072e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:20.920474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-028b56c1-bb14-454f-a044-c172fb5af9fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:20.922207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e3dddcd-f70a-4258-9b6c-75fb88de072e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:20.922937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e3dddcd-f70a-4258-9b6c-75fb88de072e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:20.923602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e3dddcd-f70a-4258-9b6c-75fb88de072e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:20.924373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e3dddcd-f70a-4258-9b6c-75fb88de072e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:20.930281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-028b56c1-bb14-454f-a044-c172fb5af9fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:20.930734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-028b56c1-bb14-454f-a044-c172fb5af9fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:20.931215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-028b56c1-bb14-454f-a044-c172fb5af9fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lazy-loading 'fault' on Instance uuid e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:44:21.104412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-028b56c1-bb14-454f-a044-c172fb5af9fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd761f0733fa47b0bb5fed8c80dafac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb35f419a9b4edd8f5d6b4fe52d0705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:21.142015 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-028b56c1-bb14-454f-a044-c172fb5af9fb tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 200 len: 1360 microversion: 2.1 time: 0.339489 Oct 24 10:44:21.146106 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2106/4256] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:20 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 1360 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:21.252696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8e3dddcd-f70a-4258-9b6c-75fb88de072e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:21.264019 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8e3dddcd-f70a-4258-9b6c-75fb88de072e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1505 microversion: 2.1 time: 0.366033 Oct 24 10:44:21.282076 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2151/4257] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:20 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1505 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:21.445152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-921f2117-7bf2-44ef-9ca2-2e7de09968d4 req-c768f2fd-cd77-46da-8e37-5d6d97c8b430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf49c481-07dd-4401-b045-5f0945291b50", "name": "network-vif-plugged", "status": "completed", "tag": "db179df0-8dc0-43b3-9e26-a4d4eb25ed78"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:21.493991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-13125571-f0b2-4590-99b7-7dd93340e2a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:21.494815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-921f2117-7bf2-44ef-9ca2-2e7de09968d4 req-c768f2fd-cd77-46da-8e37-5d6d97c8b430 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:21.495332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-921f2117-7bf2-44ef-9ca2-2e7de09968d4 req-c768f2fd-cd77-46da-8e37-5d6d97c8b430 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:21.495523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-13125571-f0b2-4590-99b7-7dd93340e2a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:21.495784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-921f2117-7bf2-44ef-9ca2-2e7de09968d4 req-c768f2fd-cd77-46da-8e37-5d6d97c8b430 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:21.556155 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-921f2117-7bf2-44ef-9ca2-2e7de09968d4 req-c768f2fd-cd77-46da-8e37-5d6d97c8b430 service nova] Creating event network-vif-plugged:db179df0-8dc0-43b3-9e26-a4d4eb25ed78 for instance bf49c481-07dd-4401-b045-5f0945291b50 on n-h2-858383-15 Oct 24 10:44:21.573754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13125571-f0b2-4590-99b7-7dd93340e2a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:21.574371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13125571-f0b2-4590-99b7-7dd93340e2a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:21.574829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13125571-f0b2-4590-99b7-7dd93340e2a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:21.588409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13125571-f0b2-4590-99b7-7dd93340e2a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:21.588992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13125571-f0b2-4590-99b7-7dd93340e2a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:21.591311 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-921f2117-7bf2-44ef-9ca2-2e7de09968d4 req-c768f2fd-cd77-46da-8e37-5d6d97c8b430 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147104 Oct 24 10:44:21.597956 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2107/4258] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:44:21.598167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13125571-f0b2-4590-99b7-7dd93340e2a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:21.745412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-289e34ea-189e-41ff-ba53-68844f4bf5ca tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:21.746435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-289e34ea-189e-41ff-ba53-68844f4bf5ca tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:21.767138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-289e34ea-189e-41ff-ba53-68844f4bf5ca tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:21.774023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-289e34ea-189e-41ff-ba53-68844f4bf5ca tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:21.777381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-289e34ea-189e-41ff-ba53-68844f4bf5ca tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:21.780913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-289e34ea-189e-41ff-ba53-68844f4bf5ca tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:21.785442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-289e34ea-189e-41ff-ba53-68844f4bf5ca tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:21.791210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-289e34ea-189e-41ff-ba53-68844f4bf5ca tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:22.163545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-13125571-f0b2-4590-99b7-7dd93340e2a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:22.182000 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-13125571-f0b2-4590-99b7-7dd93340e2a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 200 len: 1328 microversion: 2.1 time: 0.692254 Oct 24 10:44:22.187834 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2152/4259] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:21 2022] GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 1328 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:22.196714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-79b02036-507c-473a-8d73-1022741731b5 req-bcde8388-7a8d-4b20-8dc7-4671682aec3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "161edb66-41db-4070-8b7b-81c318cde03a", "tag": "0a0278ee-b58d-4340-bbf3-0cc59d2bb857"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:22.219432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-79b02036-507c-473a-8d73-1022741731b5 req-bcde8388-7a8d-4b20-8dc7-4671682aec3d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:22.219921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-79b02036-507c-473a-8d73-1022741731b5 req-bcde8388-7a8d-4b20-8dc7-4671682aec3d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:22.222860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-79b02036-507c-473a-8d73-1022741731b5 req-bcde8388-7a8d-4b20-8dc7-4671682aec3d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:22.247935 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-79b02036-507c-473a-8d73-1022741731b5 req-bcde8388-7a8d-4b20-8dc7-4671682aec3d service nova] Creating event network-changed:0a0278ee-b58d-4340-bbf3-0cc59d2bb857 for instance 161edb66-41db-4070-8b7b-81c318cde03a on n-h1-858383-15 Oct 24 10:44:22.262551 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-79b02036-507c-473a-8d73-1022741731b5 req-bcde8388-7a8d-4b20-8dc7-4671682aec3d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073383 Oct 24 10:44:22.263326 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2153/4260] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:44:22.269954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-77da0083-0d8e-4d00-823e-835b8e8b36e2 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:22.276606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-77da0083-0d8e-4d00-823e-835b8e8b36e2 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] [instance: e7e0c405-e34b-4b9c-97f6-ab1eb6b06526] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:22.288548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77da0083-0d8e-4d00-823e-835b8e8b36e2 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:22.292564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77da0083-0d8e-4d00-823e-835b8e8b36e2 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:22.293493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77da0083-0d8e-4d00-823e-835b8e8b36e2 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:22.294502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77da0083-0d8e-4d00-823e-835b8e8b36e2 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:22.296587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77da0083-0d8e-4d00-823e-835b8e8b36e2 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:22.299462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77da0083-0d8e-4d00-823e-835b8e8b36e2 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:22.341454 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-77da0083-0d8e-4d00-823e-835b8e8b36e2 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] HTTP exception thrown: Instance e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 could not be found. Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-77da0083-0d8e-4d00-823e-835b8e8b36e2 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Request method failure captured: Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 HTTP/1.1 Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmwPRI0DeWRqZ13K1BS1neoGvdtcil2lGgK7bGhfTFz5pcbai7wQnmfxKBU93KSOHqe5fCqP0dXvhtuJHGf37R01Hud_jrGtt2VtdIEE8MLYprljSOBVOTdkePArX_L2JSzyNfJz9wJzCt4xqhTpBfsWEGzWEqnFPmhDT6Mzqrhs8uk Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: acb35f419a9b4edd8f5d6b4fe52d0705 Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersTestJSON-1306955996 Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/acb35f419a9b4edd8f5d6b4fe52d0705"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/acb35f419a9b4edd8f5d6b4fe52d0705"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/acb35f419a9b4edd8f5d6b4fe52d0705"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_acb35f419a9b4edd8f5d6b4fe52d0705", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersTestJSON-1306955996 Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: acb35f419a9b4edd8f5d6b4fe52d0705 Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersTestJSON-1306955996 Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersTestJSON-1306955996-project Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: bd761f0733fa47b0bb5fed8c80dafac0 Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersTestJSON-1306955996-project Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 could not be found. Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'e7e0c405-e34b-4b9c-97f6-ab1eb6b06526'} Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 could not be found. Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 could not be found. Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:44:22.343562 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:22.348353 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:44:22.348353 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:44:22.348353 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:44:22.348353 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:44:22.348353 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:44:22.348353 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 could not be found. Oct 24 10:44:22.348353 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:22.354182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-77da0083-0d8e-4d00-823e-835b8e8b36e2 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Returning 404 to user: Instance e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:44:22.355282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-289e34ea-189e-41ff-ba53-68844f4bf5ca tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:22.356161 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-77da0083-0d8e-4d00-823e-835b8e8b36e2 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526" status: 404 len: 111 microversion: 2.1 time: 0.091176 Oct 24 10:44:22.356969 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2154/4261] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:22 2022] GET /compute/v2.1/servers/e7e0c405-e34b-4b9c-97f6-ab1eb6b06526 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:44:22.367964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c5f6d334-b138-464b-bf2f-70d497f21751 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:22.370780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c5f6d334-b138-464b-bf2f-70d497f21751 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:22.375326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-289e34ea-189e-41ff-ba53-68844f4bf5ca tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:22.377404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-289e34ea-189e-41ff-ba53-68844f4bf5ca tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:22.381776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5f6d334-b138-464b-bf2f-70d497f21751 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:22.382713 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-289e34ea-189e-41ff-ba53-68844f4bf5ca tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1741 microversion: 2.20 time: 0.644568 Oct 24 10:44:22.382986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5f6d334-b138-464b-bf2f-70d497f21751 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:22.383681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5f6d334-b138-464b-bf2f-70d497f21751 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:22.384672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5f6d334-b138-464b-bf2f-70d497f21751 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:22.385521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5f6d334-b138-464b-bf2f-70d497f21751 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:22.386353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5f6d334-b138-464b-bf2f-70d497f21751 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:22.402202 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2108/4262] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:21 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1741 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:22.418509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-20efd55f-074e-4ef2-ad07-808905d70190 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] Calling method '.version_select at 0x7f04cba170d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:22.481853 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-20efd55f-074e-4ef2-ad07-808905d70190 tempest-ServersTestJSON-1306955996 tempest-ServersTestJSON-1306955996-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1388564245" status: 202 len: 0 microversion: 2.1 time: 0.077061 Oct 24 10:44:22.482470 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2109/4263] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Oct 24 10:44:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1388564245 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:44:22.667606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c5f6d334-b138-464b-bf2f-70d497f21751 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:22.685208 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c5f6d334-b138-464b-bf2f-70d497f21751 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1485 microversion: 2.1 time: 0.324713 Oct 24 10:44:22.690005 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2155/4264] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:22 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1485 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:22.962135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d80930c7-3895-4e87-bdc3-30c0995f20de tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1093227760", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:23.206294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a1e3268b-31c3-4c66-803c-087130124ff9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:23.207078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a1e3268b-31c3-4c66-803c-087130124ff9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:23.216404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1e3268b-31c3-4c66-803c-087130124ff9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:23.217098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1e3268b-31c3-4c66-803c-087130124ff9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:23.217685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1e3268b-31c3-4c66-803c-087130124ff9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:23.218498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1e3268b-31c3-4c66-803c-087130124ff9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:23.219123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1e3268b-31c3-4c66-803c-087130124ff9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:23.219648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1e3268b-31c3-4c66-803c-087130124ff9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:24.750668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a1e3268b-31c3-4c66-803c-087130124ff9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:24.769693 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a1e3268b-31c3-4c66-803c-087130124ff9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 200 len: 1328 microversion: 2.1 time: 1.565667 Oct 24 10:44:24.781710 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2156/4265] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:23 2022] GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 1328 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:44:24.801246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e07eacac-54c6-4fc2-acfc-a5abab826b37 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:24.803251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e07eacac-54c6-4fc2-acfc-a5abab826b37 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:24.817115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e07eacac-54c6-4fc2-acfc-a5abab826b37 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:24.818658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e07eacac-54c6-4fc2-acfc-a5abab826b37 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:24.822174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e07eacac-54c6-4fc2-acfc-a5abab826b37 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:24.823930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e07eacac-54c6-4fc2-acfc-a5abab826b37 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:24.825487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e07eacac-54c6-4fc2-acfc-a5abab826b37 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:24.827620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e07eacac-54c6-4fc2-acfc-a5abab826b37 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:25.420028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e07eacac-54c6-4fc2-acfc-a5abab826b37 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:25.434033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e07eacac-54c6-4fc2-acfc-a5abab826b37 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:25.446044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e07eacac-54c6-4fc2-acfc-a5abab826b37 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:25.456208 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e07eacac-54c6-4fc2-acfc-a5abab826b37 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1741 microversion: 2.20 time: 0.672369 Oct 24 10:44:25.468891 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2157/4266] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:24 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1741 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:25.810888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8f3b230f-09de-4222-b266-122890d3474d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:25.811573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8f3b230f-09de-4222-b266-122890d3474d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:25.834969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f3b230f-09de-4222-b266-122890d3474d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:25.835813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f3b230f-09de-4222-b266-122890d3474d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:25.836464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f3b230f-09de-4222-b266-122890d3474d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:25.837456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f3b230f-09de-4222-b266-122890d3474d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:25.838134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f3b230f-09de-4222-b266-122890d3474d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:25.838759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f3b230f-09de-4222-b266-122890d3474d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:26.510068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8f3b230f-09de-4222-b266-122890d3474d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:26.525238 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8f3b230f-09de-4222-b266-122890d3474d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 200 len: 1510 microversion: 2.1 time: 0.718127 Oct 24 10:44:26.531301 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2158/4267] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:25 2022] GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 1510 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:44:26.569640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c7571da8-6991-4a45-9d27-060479f8ce52 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:26.571640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c7571da8-6991-4a45-9d27-060479f8ce52 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:26.595738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7571da8-6991-4a45-9d27-060479f8ce52 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:26.596670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7571da8-6991-4a45-9d27-060479f8ce52 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:26.597028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7571da8-6991-4a45-9d27-060479f8ce52 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:26.597773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7571da8-6991-4a45-9d27-060479f8ce52 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:26.598234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7571da8-6991-4a45-9d27-060479f8ce52 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:26.614850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7571da8-6991-4a45-9d27-060479f8ce52 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:27.094226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c7571da8-6991-4a45-9d27-060479f8ce52 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:27.114317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c7571da8-6991-4a45-9d27-060479f8ce52 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:27.116391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c7571da8-6991-4a45-9d27-060479f8ce52 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:27.124780 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c7571da8-6991-4a45-9d27-060479f8ce52 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1741 microversion: 2.20 time: 0.588171 Oct 24 10:44:27.126073 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2159/4268] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:26 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1741 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:27.131886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-722e166a-9d67-43c5-9bbc-701785f1b21d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:27.136715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-722e166a-9d67-43c5-9bbc-701785f1b21d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:27.155501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-722e166a-9d67-43c5-9bbc-701785f1b21d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:27.156368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-722e166a-9d67-43c5-9bbc-701785f1b21d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:27.157131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-722e166a-9d67-43c5-9bbc-701785f1b21d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:27.165388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-722e166a-9d67-43c5-9bbc-701785f1b21d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:27.166217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-722e166a-9d67-43c5-9bbc-701785f1b21d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:27.166964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-722e166a-9d67-43c5-9bbc-701785f1b21d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:27.367104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-d80930c7-3895-4e87-bdc3-30c0995f20de tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] validate_networks() for [('de762a59-12f4-4557-8f95-655a4b5d7277', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:44:27.604522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-722e166a-9d67-43c5-9bbc-701785f1b21d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:27.613214 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-722e166a-9d67-43c5-9bbc-701785f1b21d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 200 len: 1510 microversion: 2.1 time: 0.484916 Oct 24 10:44:27.621027 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2160/4269] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:27 2022] GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 1510 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:27.644890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b830b101-ccce-4e4a-ab57-16d02d4b2db3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:27.645951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b830b101-ccce-4e4a-ab57-16d02d4b2db3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:27.654590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b830b101-ccce-4e4a-ab57-16d02d4b2db3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:27.657329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b830b101-ccce-4e4a-ab57-16d02d4b2db3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:27.661184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b830b101-ccce-4e4a-ab57-16d02d4b2db3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:27.662007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b830b101-ccce-4e4a-ab57-16d02d4b2db3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:27.662549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b830b101-ccce-4e4a-ab57-16d02d4b2db3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:27.663050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b830b101-ccce-4e4a-ab57-16d02d4b2db3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:27.764268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b830b101-ccce-4e4a-ab57-16d02d4b2db3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:44:27.819576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:44:27.995498 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b830b101-ccce-4e4a-ab57-16d02d4b2db3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 204 len: 0 microversion: 2.1 time: 0.354740 Oct 24 10:44:27.996420 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2161/4270] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:44:27 2022] DELETE /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 10:44:28.006715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-07a45ad2-65bd-4d5c-a5bd-e3d7d6ad9f3e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:28.007812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-07a45ad2-65bd-4d5c-a5bd-e3d7d6ad9f3e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:28.024294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07a45ad2-65bd-4d5c-a5bd-e3d7d6ad9f3e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:28.025953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07a45ad2-65bd-4d5c-a5bd-e3d7d6ad9f3e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:28.026733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07a45ad2-65bd-4d5c-a5bd-e3d7d6ad9f3e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:28.027610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07a45ad2-65bd-4d5c-a5bd-e3d7d6ad9f3e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:28.028221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07a45ad2-65bd-4d5c-a5bd-e3d7d6ad9f3e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:28.028802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07a45ad2-65bd-4d5c-a5bd-e3d7d6ad9f3e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:28.454086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-07a45ad2-65bd-4d5c-a5bd-e3d7d6ad9f3e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:28.465052 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-07a45ad2-65bd-4d5c-a5bd-e3d7d6ad9f3e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 200 len: 1516 microversion: 2.1 time: 0.463882 Oct 24 10:44:28.472569 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2162/4271] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:27 2022] GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 1516 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:44:28.484745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c4f246a3-cde5-4ca2-927f-39c99867a144 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:28.486420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c4f246a3-cde5-4ca2-927f-39c99867a144 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:28.515040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4f246a3-cde5-4ca2-927f-39c99867a144 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:28.516037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4f246a3-cde5-4ca2-927f-39c99867a144 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:28.517230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4f246a3-cde5-4ca2-927f-39c99867a144 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:28.518370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4f246a3-cde5-4ca2-927f-39c99867a144 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:28.519042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4f246a3-cde5-4ca2-927f-39c99867a144 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:28.519678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4f246a3-cde5-4ca2-927f-39c99867a144 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:28.577987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d80930c7-3895-4e87-bdc3-30c0995f20de tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:44:28.578497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d80930c7-3895-4e87-bdc3-30c0995f20de tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:44:28.578994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d80930c7-3895-4e87-bdc3-30c0995f20de tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:44:28.580231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d80930c7-3895-4e87-bdc3-30c0995f20de tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:44:28.580677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d80930c7-3895-4e87-bdc3-30c0995f20de tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:44:28.606327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d80930c7-3895-4e87-bdc3-30c0995f20de tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:28.609450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d80930c7-3895-4e87-bdc3-30c0995f20de tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:28.612097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d80930c7-3895-4e87-bdc3-30c0995f20de tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:28.616034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d80930c7-3895-4e87-bdc3-30c0995f20de tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:28.619751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d80930c7-3895-4e87-bdc3-30c0995f20de tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:28.621471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d80930c7-3895-4e87-bdc3-30c0995f20de tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:28.724224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-d80930c7-3895-4e87-bdc3-30c0995f20de tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Getting quotas for project f4bbfd7373694648a1f5c4fb8cdace06. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:44:28.748228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-d80930c7-3895-4e87-bdc3-30c0995f20de tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Getting quotas for user 2fa246e48f904d058d451542c0763880 and project f4bbfd7373694648a1f5c4fb8cdace06. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:44:28.783645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d80930c7-3895-4e87-bdc3-30c0995f20de tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:44:28.786394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d80930c7-3895-4e87-bdc3-30c0995f20de tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:44:28.879882 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d80930c7-3895-4e87-bdc3-30c0995f20de tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.923215 Oct 24 10:44:28.889960 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2110/4272] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:44:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 5935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:44:28.902615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2fcdd7b3-aeff-4c67-b451-7e0b2c60d2d6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:28.904149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2fcdd7b3-aeff-4c67-b451-7e0b2c60d2d6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:29.004770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c4f246a3-cde5-4ca2-927f-39c99867a144 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:29.015013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c4f246a3-cde5-4ca2-927f-39c99867a144 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:29.034667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c4f246a3-cde5-4ca2-927f-39c99867a144 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:29.035902 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c4f246a3-cde5-4ca2-927f-39c99867a144 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1741 microversion: 2.20 time: 0.561908 Oct 24 10:44:29.042355 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2163/4273] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:28 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1741 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:29.151063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2fcdd7b3-aeff-4c67-b451-7e0b2c60d2d6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:29.164802 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2fcdd7b3-aeff-4c67-b451-7e0b2c60d2d6 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1214 microversion: 2.1 time: 0.273318 Oct 24 10:44:29.182357 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2111/4274] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:28 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1214 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:29.495741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9168bbf9-783a-4d32-b6af-743c09756aae tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:29.496366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9168bbf9-783a-4d32-b6af-743c09756aae tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:29.510160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9168bbf9-783a-4d32-b6af-743c09756aae tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:29.515557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9168bbf9-783a-4d32-b6af-743c09756aae tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:29.516078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9168bbf9-783a-4d32-b6af-743c09756aae tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:29.534252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9168bbf9-783a-4d32-b6af-743c09756aae tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:29.535025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9168bbf9-783a-4d32-b6af-743c09756aae tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:29.535558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9168bbf9-783a-4d32-b6af-743c09756aae tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:30.072600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6e3140a0-872a-4281-8436-07f25f90f925 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:30.073157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6e3140a0-872a-4281-8436-07f25f90f925 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:30.089735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e3140a0-872a-4281-8436-07f25f90f925 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:30.090238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e3140a0-872a-4281-8436-07f25f90f925 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:30.090682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e3140a0-872a-4281-8436-07f25f90f925 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:30.091408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e3140a0-872a-4281-8436-07f25f90f925 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:30.091867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e3140a0-872a-4281-8436-07f25f90f925 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:30.092300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e3140a0-872a-4281-8436-07f25f90f925 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:30.190530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9168bbf9-783a-4d32-b6af-743c09756aae tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:30.202428 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9168bbf9-783a-4d32-b6af-743c09756aae tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 200 len: 1516 microversion: 2.1 time: 0.710376 Oct 24 10:44:30.205385 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2164/4275] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:29 2022] GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 1516 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:44:30.226132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c70b23ea-4221-4460-a13c-4d308a74744f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:30.226781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c70b23ea-4221-4460-a13c-4d308a74744f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:30.489471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c70b23ea-4221-4460-a13c-4d308a74744f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:30.500670 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c70b23ea-4221-4460-a13c-4d308a74744f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1214 microversion: 2.1 time: 0.293534 Oct 24 10:44:30.522403 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2165/4276] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:30 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1214 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:30.754142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6e3140a0-872a-4281-8436-07f25f90f925 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:30.767767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6e3140a0-872a-4281-8436-07f25f90f925 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:30.769359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6e3140a0-872a-4281-8436-07f25f90f925 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:30.770557 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6e3140a0-872a-4281-8436-07f25f90f925 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1741 microversion: 2.20 time: 0.701966 Oct 24 10:44:30.777233 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2112/4277] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:30 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1741 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:31.235182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-55d331d9-6f0a-4745-b389-913ded3148b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:31.237175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-55d331d9-6f0a-4745-b389-913ded3148b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:31.272069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55d331d9-6f0a-4745-b389-913ded3148b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:31.276295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55d331d9-6f0a-4745-b389-913ded3148b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:31.280041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55d331d9-6f0a-4745-b389-913ded3148b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:31.282479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55d331d9-6f0a-4745-b389-913ded3148b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:31.288551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55d331d9-6f0a-4745-b389-913ded3148b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:31.294831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55d331d9-6f0a-4745-b389-913ded3148b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:31.533448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8ac223aa-b3ea-4328-a13f-39a473c78ea2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:31.534233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8ac223aa-b3ea-4328-a13f-39a473c78ea2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:31.557270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ac223aa-b3ea-4328-a13f-39a473c78ea2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:31.564402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ac223aa-b3ea-4328-a13f-39a473c78ea2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:31.566289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ac223aa-b3ea-4328-a13f-39a473c78ea2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:31.569256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ac223aa-b3ea-4328-a13f-39a473c78ea2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:31.581099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ac223aa-b3ea-4328-a13f-39a473c78ea2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:31.600059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ac223aa-b3ea-4328-a13f-39a473c78ea2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:32.870329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-55d331d9-6f0a-4745-b389-913ded3148b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:32.903346 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-55d331d9-6f0a-4745-b389-913ded3148b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 200 len: 1516 microversion: 2.1 time: 1.661442 Oct 24 10:44:32.907127 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2166/4278] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:31 2022] GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 1516 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:32.925299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eeb7f97a-557d-4985-81eb-433d22a55d95 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:32.925938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-eeb7f97a-557d-4985-81eb-433d22a55d95 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:32.932292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8ac223aa-b3ea-4328-a13f-39a473c78ea2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:32.946035 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8ac223aa-b3ea-4328-a13f-39a473c78ea2 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1266 microversion: 2.1 time: 1.419293 Oct 24 10:44:32.968974 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2113/4279] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:31 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1266 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:32.994911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eeb7f97a-557d-4985-81eb-433d22a55d95 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:32.995633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eeb7f97a-557d-4985-81eb-433d22a55d95 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:32.996046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eeb7f97a-557d-4985-81eb-433d22a55d95 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:32.996815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eeb7f97a-557d-4985-81eb-433d22a55d95 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:32.997368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eeb7f97a-557d-4985-81eb-433d22a55d95 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:33.001871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eeb7f97a-557d-4985-81eb-433d22a55d95 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:33.065923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3a7498e2-450c-4798-9b5e-5cee28fc9b99 req-ce210ae8-c086-4431-9653-7265b325df18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf49c481-07dd-4401-b045-5f0945291b50", "name": "network-vif-deleted", "tag": "db179df0-8dc0-43b3-9e26-a4d4eb25ed78"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:33.090473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3a7498e2-450c-4798-9b5e-5cee28fc9b99 req-ce210ae8-c086-4431-9653-7265b325df18 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:33.090964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3a7498e2-450c-4798-9b5e-5cee28fc9b99 req-ce210ae8-c086-4431-9653-7265b325df18 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:33.091415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3a7498e2-450c-4798-9b5e-5cee28fc9b99 req-ce210ae8-c086-4431-9653-7265b325df18 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:33.165451 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3a7498e2-450c-4798-9b5e-5cee28fc9b99 req-ce210ae8-c086-4431-9653-7265b325df18 service nova] Creating event network-vif-deleted:db179df0-8dc0-43b3-9e26-a4d4eb25ed78 for instance bf49c481-07dd-4401-b045-5f0945291b50 on n-h2-858383-15 Oct 24 10:44:33.194450 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3a7498e2-450c-4798-9b5e-5cee28fc9b99 req-ce210ae8-c086-4431-9653-7265b325df18 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132923 Oct 24 10:44:33.200006 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2114/4280] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:44:33.666951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-eeb7f97a-557d-4985-81eb-433d22a55d95 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:33.690057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-eeb7f97a-557d-4985-81eb-433d22a55d95 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:33.692284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-eeb7f97a-557d-4985-81eb-433d22a55d95 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:33.693738 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-eeb7f97a-557d-4985-81eb-433d22a55d95 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1741 microversion: 2.20 time: 0.783070 Oct 24 10:44:33.694504 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2167/4281] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:32 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1741 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:33.936498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-79a52cbf-97e1-493c-8927-7783fcf70567 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:33.938306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-79a52cbf-97e1-493c-8927-7783fcf70567 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:33.968280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79a52cbf-97e1-493c-8927-7783fcf70567 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:33.971423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79a52cbf-97e1-493c-8927-7783fcf70567 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:33.972121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79a52cbf-97e1-493c-8927-7783fcf70567 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:33.973881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-931a9bb0-4f23-4c3b-a6e5-b50d00cff1ad tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:33.975225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-931a9bb0-4f23-4c3b-a6e5-b50d00cff1ad tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:33.975555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79a52cbf-97e1-493c-8927-7783fcf70567 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:33.976346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79a52cbf-97e1-493c-8927-7783fcf70567 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:33.978241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79a52cbf-97e1-493c-8927-7783fcf70567 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:33.993623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-931a9bb0-4f23-4c3b-a6e5-b50d00cff1ad tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:33.994605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-931a9bb0-4f23-4c3b-a6e5-b50d00cff1ad tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:33.995416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-931a9bb0-4f23-4c3b-a6e5-b50d00cff1ad tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:33.996527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-931a9bb0-4f23-4c3b-a6e5-b50d00cff1ad tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:33.997311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-931a9bb0-4f23-4c3b-a6e5-b50d00cff1ad tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:33.997921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-931a9bb0-4f23-4c3b-a6e5-b50d00cff1ad tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:34.097881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79a52cbf-97e1-493c-8927-7783fcf70567 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:34.098381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79a52cbf-97e1-493c-8927-7783fcf70567 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:34.098837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79a52cbf-97e1-493c-8927-7783fcf70567 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:34.099364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-79a52cbf-97e1-493c-8927-7783fcf70567 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lazy-loading 'fault' on Instance uuid bf49c481-07dd-4401-b045-5f0945291b50 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:44:34.273659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-931a9bb0-4f23-4c3b-a6e5-b50d00cff1ad tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:34.288727 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-931a9bb0-4f23-4c3b-a6e5-b50d00cff1ad tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1272 microversion: 2.1 time: 0.317940 Oct 24 10:44:34.291147 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2168/4282] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:33 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1272 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:34.317883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-79a52cbf-97e1-493c-8927-7783fcf70567 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:34.325169 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-79a52cbf-97e1-493c-8927-7783fcf70567 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 200 len: 1318 microversion: 2.1 time: 0.394184 Oct 24 10:44:34.325766 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2115/4283] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:33 2022] GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:34.724498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-94c2de91-cd56-49ae-90a5-c2ab6c9334a7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:34.725148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-94c2de91-cd56-49ae-90a5-c2ab6c9334a7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:34.741217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94c2de91-cd56-49ae-90a5-c2ab6c9334a7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:34.745120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94c2de91-cd56-49ae-90a5-c2ab6c9334a7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:34.745661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94c2de91-cd56-49ae-90a5-c2ab6c9334a7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:34.746437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94c2de91-cd56-49ae-90a5-c2ab6c9334a7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:34.746920 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94c2de91-cd56-49ae-90a5-c2ab6c9334a7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:34.747361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94c2de91-cd56-49ae-90a5-c2ab6c9334a7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:35.064385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94c2de91-cd56-49ae-90a5-c2ab6c9334a7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:35.084133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94c2de91-cd56-49ae-90a5-c2ab6c9334a7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:35.087259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94c2de91-cd56-49ae-90a5-c2ab6c9334a7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:35.089484 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-94c2de91-cd56-49ae-90a5-c2ab6c9334a7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1741 microversion: 2.20 time: 0.369859 Oct 24 10:44:35.121693 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2169/4284] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:34 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1741 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:35.326203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-abdb7997-648c-4c66-aadf-09a0846b1d0f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:35.327610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-abdb7997-648c-4c66-aadf-09a0846b1d0f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:35.350694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-abdb7997-648c-4c66-aadf-09a0846b1d0f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:35.353229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d164d7fc-8de2-47e8-8f1e-38eebdab5c8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:35.353853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d164d7fc-8de2-47e8-8f1e-38eebdab5c8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:35.354289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-abdb7997-648c-4c66-aadf-09a0846b1d0f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:35.354972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-abdb7997-648c-4c66-aadf-09a0846b1d0f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:35.365082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d164d7fc-8de2-47e8-8f1e-38eebdab5c8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:35.365584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d164d7fc-8de2-47e8-8f1e-38eebdab5c8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:35.366501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-abdb7997-648c-4c66-aadf-09a0846b1d0f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:35.367331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-abdb7997-648c-4c66-aadf-09a0846b1d0f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:35.368016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-abdb7997-648c-4c66-aadf-09a0846b1d0f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:35.373518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d164d7fc-8de2-47e8-8f1e-38eebdab5c8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:35.374291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d164d7fc-8de2-47e8-8f1e-38eebdab5c8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:35.374775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d164d7fc-8de2-47e8-8f1e-38eebdab5c8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:35.375212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d164d7fc-8de2-47e8-8f1e-38eebdab5c8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:35.445763 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-d164d7fc-8de2-47e8-8f1e-38eebdab5c8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance bf49c481-07dd-4401-b045-5f0945291b50 could not be found. Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d164d7fc-8de2-47e8-8f1e-38eebdab5c8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 HTTP/1.1 Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance bf49c481-07dd-4401-b045-5f0945291b50 could not be found. Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'bf49c481-07dd-4401-b045-5f0945291b50'} Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf49c481-07dd-4401-b045-5f0945291b50 could not be found. Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf49c481-07dd-4401-b045-5f0945291b50 could not be found. Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:35.447464 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:44:35.451144 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:44:35.451144 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:44:35.451144 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:44:35.451144 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:44:35.451144 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf49c481-07dd-4401-b045-5f0945291b50 could not be found. Oct 24 10:44:35.451144 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:44:35.451144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d164d7fc-8de2-47e8-8f1e-38eebdab5c8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance bf49c481-07dd-4401-b045-5f0945291b50 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:44:35.451144 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d164d7fc-8de2-47e8-8f1e-38eebdab5c8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 404 len: 111 microversion: 2.1 time: 0.099802 Oct 24 10:44:35.458150 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2170/4285] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:35 2022] GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:44:35.470984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-42110baf-4a67-484a-88c7-6ba0e46eb35e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '.version_select at 0x7f04cb80cc10>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:35.512496 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-42110baf-4a67-484a-88c7-6ba0e46eb35e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-key-773840704" status: 202 len: 0 microversion: 2.1 time: 0.053181 Oct 24 10:44:35.513161 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2171/4286] 10.222.0.50 () {58 vars in 1206 bytes} [Mon Oct 24 10:44:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-773840704 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:44:35.683605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-abdb7997-648c-4c66-aadf-09a0846b1d0f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:35.696378 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-abdb7997-648c-4c66-aadf-09a0846b1d0f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1314 microversion: 2.1 time: 0.374717 Oct 24 10:44:35.697330 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2116/4287] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:35 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:35.881252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-498061c7-0714-4d3e-912c-c1e3fd6e70b6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1169029294", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "734fc132-fff0-4bf7-9775-3a17fdcd25dc"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:35.996128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-498061c7-0714-4d3e-912c-c1e3fd6e70b6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] validate_networks() for [('734fc132-fff0-4bf7-9775-3a17fdcd25dc', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:44:36.128053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fd8fb74e-0b38-4d0d-b769-ec305bd5d255 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:36.132562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fd8fb74e-0b38-4d0d-b769-ec305bd5d255 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:36.154169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd8fb74e-0b38-4d0d-b769-ec305bd5d255 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:36.157267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd8fb74e-0b38-4d0d-b769-ec305bd5d255 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:36.158054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd8fb74e-0b38-4d0d-b769-ec305bd5d255 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:36.164217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd8fb74e-0b38-4d0d-b769-ec305bd5d255 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:36.164925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd8fb74e-0b38-4d0d-b769-ec305bd5d255 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:36.165983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd8fb74e-0b38-4d0d-b769-ec305bd5d255 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:37.475705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fd8fb74e-0b38-4d0d-b769-ec305bd5d255 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:37.485291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fd8fb74e-0b38-4d0d-b769-ec305bd5d255 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:37.488563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fd8fb74e-0b38-4d0d-b769-ec305bd5d255 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:37.490626 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fd8fb74e-0b38-4d0d-b769-ec305bd5d255 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1741 microversion: 2.20 time: 1.366746 Oct 24 10:44:37.492039 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2117/4288] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:36 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1741 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:37.497935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-768b0f63-948a-4439-8bc6-868e10b278b9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:37.502163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-768b0f63-948a-4439-8bc6-868e10b278b9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:37.521772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-768b0f63-948a-4439-8bc6-868e10b278b9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:37.524410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-768b0f63-948a-4439-8bc6-868e10b278b9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:37.525153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-768b0f63-948a-4439-8bc6-868e10b278b9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:37.526196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-768b0f63-948a-4439-8bc6-868e10b278b9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:37.528566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-768b0f63-948a-4439-8bc6-868e10b278b9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:37.529323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-768b0f63-948a-4439-8bc6-868e10b278b9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:38.189874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-498061c7-0714-4d3e-912c-c1e3fd6e70b6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:44:38.198292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-498061c7-0714-4d3e-912c-c1e3fd6e70b6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:44:38.200789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-498061c7-0714-4d3e-912c-c1e3fd6e70b6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:44:38.203621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-498061c7-0714-4d3e-912c-c1e3fd6e70b6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:44:38.204368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-498061c7-0714-4d3e-912c-c1e3fd6e70b6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:44:38.231199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-768b0f63-948a-4439-8bc6-868e10b278b9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:38.238563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-498061c7-0714-4d3e-912c-c1e3fd6e70b6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:38.239049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-498061c7-0714-4d3e-912c-c1e3fd6e70b6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:38.239477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-498061c7-0714-4d3e-912c-c1e3fd6e70b6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:38.243439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-498061c7-0714-4d3e-912c-c1e3fd6e70b6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:38.246480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-498061c7-0714-4d3e-912c-c1e3fd6e70b6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:38.247102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-498061c7-0714-4d3e-912c-c1e3fd6e70b6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:38.260657 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-768b0f63-948a-4439-8bc6-868e10b278b9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1314 microversion: 2.1 time: 0.767148 Oct 24 10:44:38.269553 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2118/4289] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:37 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1314 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:38.301683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-498061c7-0714-4d3e-912c-c1e3fd6e70b6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Getting quotas for project 9ab3028765ba447589bf595a603ea2e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:44:38.311781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-498061c7-0714-4d3e-912c-c1e3fd6e70b6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Getting quotas for user ed058a5e8ac14236ab2e8783e9170346 and project 9ab3028765ba447589bf595a603ea2e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:44:38.338431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-498061c7-0714-4d3e-912c-c1e3fd6e70b6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:44:38.348708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-498061c7-0714-4d3e-912c-c1e3fd6e70b6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:44:38.440751 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-498061c7-0714-4d3e-912c-c1e3fd6e70b6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.563991 Oct 24 10:44:38.456739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-306c21e2-01d5-44fd-9b01-f67bf8e6aa6e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:38.456924 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2172/4290] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:44:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:44:38.457307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-306c21e2-01d5-44fd-9b01-f67bf8e6aa6e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:38.526112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b3669987-fdeb-4e49-9826-3e4d3a18f6d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:38.527016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b3669987-fdeb-4e49-9826-3e4d3a18f6d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:38.534690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3669987-fdeb-4e49-9826-3e4d3a18f6d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:38.542554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3669987-fdeb-4e49-9826-3e4d3a18f6d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:38.543443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3669987-fdeb-4e49-9826-3e4d3a18f6d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:38.544387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3669987-fdeb-4e49-9826-3e4d3a18f6d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:38.545059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3669987-fdeb-4e49-9826-3e4d3a18f6d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:38.545685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3669987-fdeb-4e49-9826-3e4d3a18f6d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:38.580234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-306c21e2-01d5-44fd-9b01-f67bf8e6aa6e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:38.592174 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-306c21e2-01d5-44fd-9b01-f67bf8e6aa6e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1209 microversion: 2.1 time: 0.141375 Oct 24 10:44:38.608707 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2119/4291] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:38 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1209 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:44:38.880880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b3669987-fdeb-4e49-9826-3e4d3a18f6d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:38.901230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b3669987-fdeb-4e49-9826-3e4d3a18f6d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:38.907860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b3669987-fdeb-4e49-9826-3e4d3a18f6d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:38.916744 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b3669987-fdeb-4e49-9826-3e4d3a18f6d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1741 microversion: 2.20 time: 0.394443 Oct 24 10:44:38.917398 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2173/4292] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:38 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1741 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:44:39.295302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e6f0e072-c7af-4873-ac9c-4c322e2f4b88 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:39.295938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e6f0e072-c7af-4873-ac9c-4c322e2f4b88 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:39.303423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:44:39.330520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6f0e072-c7af-4873-ac9c-4c322e2f4b88 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:39.332860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6f0e072-c7af-4873-ac9c-4c322e2f4b88 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:39.334766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6f0e072-c7af-4873-ac9c-4c322e2f4b88 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:39.336201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6f0e072-c7af-4873-ac9c-4c322e2f4b88 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:39.338252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6f0e072-c7af-4873-ac9c-4c322e2f4b88 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:39.340501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6f0e072-c7af-4873-ac9c-4c322e2f4b88 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:39.619810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eae90bda-62fb-403b-a140-976e326849c8 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:39.621232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-eae90bda-62fb-403b-a140-976e326849c8 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:39.652221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eae90bda-62fb-403b-a140-976e326849c8 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:39.658957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eae90bda-62fb-403b-a140-976e326849c8 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:39.673099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eae90bda-62fb-403b-a140-976e326849c8 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:39.674509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eae90bda-62fb-403b-a140-976e326849c8 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:39.675692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eae90bda-62fb-403b-a140-976e326849c8 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:39.677234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eae90bda-62fb-403b-a140-976e326849c8 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:39.899094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-eae90bda-62fb-403b-a140-976e326849c8 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:39.908231 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-eae90bda-62fb-403b-a140-976e326849c8 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1213 microversion: 2.1 time: 0.292138 Oct 24 10:44:39.912621 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2174/4293] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:39 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1213 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:39.951219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-716a5262-f091-4b1e-a11a-ee7345a2025e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:39.951992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-716a5262-f091-4b1e-a11a-ee7345a2025e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:39.968658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-716a5262-f091-4b1e-a11a-ee7345a2025e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:39.971065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-716a5262-f091-4b1e-a11a-ee7345a2025e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:39.974373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-716a5262-f091-4b1e-a11a-ee7345a2025e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:39.976075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-716a5262-f091-4b1e-a11a-ee7345a2025e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:39.977970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-716a5262-f091-4b1e-a11a-ee7345a2025e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:39.978579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-716a5262-f091-4b1e-a11a-ee7345a2025e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:39.982258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e6f0e072-c7af-4873-ac9c-4c322e2f4b88 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:40.004379 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e6f0e072-c7af-4873-ac9c-4c322e2f4b88 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1314 microversion: 2.1 time: 0.715615 Oct 24 10:44:40.005039 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2120/4294] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:39 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:40.025146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-29189ccc-8052-467c-a4b6-d960332582c9 req-8769b11c-c6f0-4e96-be9c-c5ac21988448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef69073c-f848-4be3-a21c-6d6627946be0", "tag": "82680612-5807-44cd-9c6f-ccec951a1345"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:40.120663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-29189ccc-8052-467c-a4b6-d960332582c9 req-8769b11c-c6f0-4e96-be9c-c5ac21988448 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:40.126760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-29189ccc-8052-467c-a4b6-d960332582c9 req-8769b11c-c6f0-4e96-be9c-c5ac21988448 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:40.133968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-29189ccc-8052-467c-a4b6-d960332582c9 req-8769b11c-c6f0-4e96-be9c-c5ac21988448 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:40.202263 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-29189ccc-8052-467c-a4b6-d960332582c9 req-8769b11c-c6f0-4e96-be9c-c5ac21988448 service nova] Creating event network-changed:82680612-5807-44cd-9c6f-ccec951a1345 for instance ef69073c-f848-4be3-a21c-6d6627946be0 on n-h2-858383-15 Oct 24 10:44:40.232561 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-29189ccc-8052-467c-a4b6-d960332582c9 req-8769b11c-c6f0-4e96-be9c-c5ac21988448 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220069 Oct 24 10:44:40.237384 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2121/4295] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:44:40.252353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-716a5262-f091-4b1e-a11a-ee7345a2025e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:40.267193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-716a5262-f091-4b1e-a11a-ee7345a2025e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:40.269061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-716a5262-f091-4b1e-a11a-ee7345a2025e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:40.270463 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-716a5262-f091-4b1e-a11a-ee7345a2025e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1741 microversion: 2.20 time: 0.329172 Oct 24 10:44:40.272260 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2175/4296] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:39 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1741 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:44:40.954345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ffbc4511-a8fe-4767-a1bb-20074a0776c7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:40.956317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ffbc4511-a8fe-4767-a1bb-20074a0776c7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:40.974694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffbc4511-a8fe-4767-a1bb-20074a0776c7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:40.980649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffbc4511-a8fe-4767-a1bb-20074a0776c7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:40.981384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffbc4511-a8fe-4767-a1bb-20074a0776c7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:40.984369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffbc4511-a8fe-4767-a1bb-20074a0776c7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:40.987030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffbc4511-a8fe-4767-a1bb-20074a0776c7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:40.987676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffbc4511-a8fe-4767-a1bb-20074a0776c7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:41.027512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bf80c27e-a21e-4243-9a3e-c44a997dc14a tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:41.028141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bf80c27e-a21e-4243-9a3e-c44a997dc14a tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:41.032372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:44:41.039993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf80c27e-a21e-4243-9a3e-c44a997dc14a tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:41.040492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf80c27e-a21e-4243-9a3e-c44a997dc14a tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:41.044729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf80c27e-a21e-4243-9a3e-c44a997dc14a tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:41.045717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf80c27e-a21e-4243-9a3e-c44a997dc14a tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:41.049617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf80c27e-a21e-4243-9a3e-c44a997dc14a tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:41.050250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf80c27e-a21e-4243-9a3e-c44a997dc14a tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:41.177748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ffbc4511-a8fe-4767-a1bb-20074a0776c7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:41.194803 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ffbc4511-a8fe-4767-a1bb-20074a0776c7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1269 microversion: 2.1 time: 0.259975 Oct 24 10:44:41.201742 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2122/4297] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:40 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1269 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:41.307660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8e935501-8123-4cb3-917a-00ea812eab40 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:41.309285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8e935501-8123-4cb3-917a-00ea812eab40 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:41.330373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e935501-8123-4cb3-917a-00ea812eab40 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:41.331121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e935501-8123-4cb3-917a-00ea812eab40 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:41.331598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e935501-8123-4cb3-917a-00ea812eab40 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:41.332321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e935501-8123-4cb3-917a-00ea812eab40 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:41.334964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e935501-8123-4cb3-917a-00ea812eab40 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:41.335430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e935501-8123-4cb3-917a-00ea812eab40 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:41.617233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8e935501-8123-4cb3-917a-00ea812eab40 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:41.628591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8e935501-8123-4cb3-917a-00ea812eab40 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:41.638491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8e935501-8123-4cb3-917a-00ea812eab40 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:41.645516 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8e935501-8123-4cb3-917a-00ea812eab40 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1741 microversion: 2.20 time: 0.341505 Oct 24 10:44:41.646359 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2123/4298] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:41 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1741 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:41.713422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bf80c27e-a21e-4243-9a3e-c44a997dc14a tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:41.724582 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bf80c27e-a21e-4243-9a3e-c44a997dc14a tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1314 microversion: 2.1 time: 0.700795 Oct 24 10:44:41.728265 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2176/4299] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:41 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:42.223380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dda1d7ca-a691-4513-a579-ac1592fb8148 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:42.224952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dda1d7ca-a691-4513-a579-ac1592fb8148 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:42.233473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dda1d7ca-a691-4513-a579-ac1592fb8148 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:42.234471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dda1d7ca-a691-4513-a579-ac1592fb8148 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:42.235119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dda1d7ca-a691-4513-a579-ac1592fb8148 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:42.236919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dda1d7ca-a691-4513-a579-ac1592fb8148 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:42.237639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dda1d7ca-a691-4513-a579-ac1592fb8148 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:42.238194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dda1d7ca-a691-4513-a579-ac1592fb8148 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:42.409450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dda1d7ca-a691-4513-a579-ac1592fb8148 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:42.430831 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dda1d7ca-a691-4513-a579-ac1592fb8148 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1267 microversion: 2.1 time: 0.212208 Oct 24 10:44:42.441922 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2124/4300] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:42 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:42.676253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-077c9e63-889a-496f-a793-805eeec382c8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:42.676903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-077c9e63-889a-496f-a793-805eeec382c8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:42.709602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-077c9e63-889a-496f-a793-805eeec382c8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:42.713386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-077c9e63-889a-496f-a793-805eeec382c8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:42.714055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-077c9e63-889a-496f-a793-805eeec382c8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:42.717582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-077c9e63-889a-496f-a793-805eeec382c8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:42.718848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-077c9e63-889a-496f-a793-805eeec382c8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:42.722444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-077c9e63-889a-496f-a793-805eeec382c8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:42.754170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a2f7275c-e0d3-43c4-8ce1-8aa69ed18c0b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:42.755040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a2f7275c-e0d3-43c4-8ce1-8aa69ed18c0b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:42.770387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2f7275c-e0d3-43c4-8ce1-8aa69ed18c0b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:42.771245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2f7275c-e0d3-43c4-8ce1-8aa69ed18c0b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:42.780087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2f7275c-e0d3-43c4-8ce1-8aa69ed18c0b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:42.781258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2f7275c-e0d3-43c4-8ce1-8aa69ed18c0b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:42.781996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2f7275c-e0d3-43c4-8ce1-8aa69ed18c0b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:42.783204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2f7275c-e0d3-43c4-8ce1-8aa69ed18c0b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:43.278279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-077c9e63-889a-496f-a793-805eeec382c8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:43.302700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-077c9e63-889a-496f-a793-805eeec382c8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:43.307726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-077c9e63-889a-496f-a793-805eeec382c8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:43.311638 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-077c9e63-889a-496f-a793-805eeec382c8 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1741 microversion: 2.20 time: 0.640574 Oct 24 10:44:43.314408 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2177/4301] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:42 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1741 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:44:43.347187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a2f7275c-e0d3-43c4-8ce1-8aa69ed18c0b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:43.362214 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a2f7275c-e0d3-43c4-8ce1-8aa69ed18c0b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1314 microversion: 2.1 time: 0.611620 Oct 24 10:44:43.368653 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2125/4302] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:42 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:44:43.459971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f7370683-d0b7-41e7-9608-33a1dd1dac1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:43.460882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f7370683-d0b7-41e7-9608-33a1dd1dac1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:43.472670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7370683-d0b7-41e7-9608-33a1dd1dac1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:43.477340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7370683-d0b7-41e7-9608-33a1dd1dac1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:43.479535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7370683-d0b7-41e7-9608-33a1dd1dac1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:43.480314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7370683-d0b7-41e7-9608-33a1dd1dac1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:43.481527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7370683-d0b7-41e7-9608-33a1dd1dac1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:43.482144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7370683-d0b7-41e7-9608-33a1dd1dac1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:43.749544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f7370683-d0b7-41e7-9608-33a1dd1dac1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:43.769426 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f7370683-d0b7-41e7-9608-33a1dd1dac1f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1267 microversion: 2.1 time: 0.308087 Oct 24 10:44:43.771026 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2178/4303] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:43 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1267 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:44.342197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d6ff3dfe-3bd7-4248-a8ce-521cf8170048 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:44.343159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d6ff3dfe-3bd7-4248-a8ce-521cf8170048 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:44.354362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:44:44.357566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6ff3dfe-3bd7-4248-a8ce-521cf8170048 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:44.358758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6ff3dfe-3bd7-4248-a8ce-521cf8170048 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:44.359370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6ff3dfe-3bd7-4248-a8ce-521cf8170048 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:44.361357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6ff3dfe-3bd7-4248-a8ce-521cf8170048 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:44.362208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6ff3dfe-3bd7-4248-a8ce-521cf8170048 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:44.362849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d6ff3dfe-3bd7-4248-a8ce-521cf8170048 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:44.391111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-47f350b9-5bab-49ef-be95-266ac6562fae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:44.391973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-47f350b9-5bab-49ef-be95-266ac6562fae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:44.401401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47f350b9-5bab-49ef-be95-266ac6562fae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:44.401897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47f350b9-5bab-49ef-be95-266ac6562fae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:44.405825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47f350b9-5bab-49ef-be95-266ac6562fae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:44.406615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47f350b9-5bab-49ef-be95-266ac6562fae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:44.413442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47f350b9-5bab-49ef-be95-266ac6562fae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:44.414814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47f350b9-5bab-49ef-be95-266ac6562fae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:46.013821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d6ff3dfe-3bd7-4248-a8ce-521cf8170048 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:46.024453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-47f350b9-5bab-49ef-be95-266ac6562fae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:46.036084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d6ff3dfe-3bd7-4248-a8ce-521cf8170048 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:46.040262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d6ff3dfe-3bd7-4248-a8ce-521cf8170048 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:46.044288 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d6ff3dfe-3bd7-4248-a8ce-521cf8170048 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1741 microversion: 2.20 time: 1.709053 Oct 24 10:44:46.044618 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-47f350b9-5bab-49ef-be95-266ac6562fae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1314 microversion: 2.1 time: 1.654688 Oct 24 10:44:46.046143 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2179/4304] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:44 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1314 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:46.064659 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2126/4305] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:44 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1741 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:46.069197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-05886a84-33e5-4424-b793-e015ffc68e16 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:46.073193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-05886a84-33e5-4424-b793-e015ffc68e16 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:46.103589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:44:46.110595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05886a84-33e5-4424-b793-e015ffc68e16 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:46.115862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05886a84-33e5-4424-b793-e015ffc68e16 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:46.116877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05886a84-33e5-4424-b793-e015ffc68e16 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:46.120811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05886a84-33e5-4424-b793-e015ffc68e16 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:46.122905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05886a84-33e5-4424-b793-e015ffc68e16 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:46.123880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05886a84-33e5-4424-b793-e015ffc68e16 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:46.256050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:44:46.841787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-05886a84-33e5-4424-b793-e015ffc68e16 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:46.916405 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-05886a84-33e5-4424-b793-e015ffc68e16 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1309 microversion: 2.1 time: 0.864910 Oct 24 10:44:46.917405 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2180/4306] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:46 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1309 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:47.072138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-afb42aab-a647-4532-9a96-ba862fd38b5f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:47.072783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-afb42aab-a647-4532-9a96-ba862fd38b5f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:47.081872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5d35572f-94fc-4146-b03f-f4f57a36b871 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:47.083546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5d35572f-94fc-4146-b03f-f4f57a36b871 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:47.091680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afb42aab-a647-4532-9a96-ba862fd38b5f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:47.093463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afb42aab-a647-4532-9a96-ba862fd38b5f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:47.096664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d35572f-94fc-4146-b03f-f4f57a36b871 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:47.097378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afb42aab-a647-4532-9a96-ba862fd38b5f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:47.098830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d35572f-94fc-4146-b03f-f4f57a36b871 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:47.099461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afb42aab-a647-4532-9a96-ba862fd38b5f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:47.100094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afb42aab-a647-4532-9a96-ba862fd38b5f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:47.100563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-afb42aab-a647-4532-9a96-ba862fd38b5f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:47.101571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d35572f-94fc-4146-b03f-f4f57a36b871 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:47.102914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d35572f-94fc-4146-b03f-f4f57a36b871 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:47.122581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d35572f-94fc-4146-b03f-f4f57a36b871 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:47.123285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d35572f-94fc-4146-b03f-f4f57a36b871 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:47.819507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5d35572f-94fc-4146-b03f-f4f57a36b871 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:47.839646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5d35572f-94fc-4146-b03f-f4f57a36b871 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:47.846642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5d35572f-94fc-4146-b03f-f4f57a36b871 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:47.848156 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5d35572f-94fc-4146-b03f-f4f57a36b871 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1741 microversion: 2.20 time: 0.772129 Oct 24 10:44:47.849709 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2181/4307] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:47 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1741 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:47.943501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8df0cd20-6d04-4e70-ad9b-7347c294afe7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:47.944136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8df0cd20-6d04-4e70-ad9b-7347c294afe7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:47.954631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8df0cd20-6d04-4e70-ad9b-7347c294afe7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:47.955167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8df0cd20-6d04-4e70-ad9b-7347c294afe7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:47.962837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8df0cd20-6d04-4e70-ad9b-7347c294afe7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:47.968597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8df0cd20-6d04-4e70-ad9b-7347c294afe7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:47.969132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8df0cd20-6d04-4e70-ad9b-7347c294afe7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:47.969820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8df0cd20-6d04-4e70-ad9b-7347c294afe7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:48.026455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-afb42aab-a647-4532-9a96-ba862fd38b5f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:48.041041 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-afb42aab-a647-4532-9a96-ba862fd38b5f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1314 microversion: 2.1 time: 0.972679 Oct 24 10:44:48.044950 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2127/4308] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:47 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1314 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:48.175162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b1bb176b-324c-49e9-b5a2-f31d171fe31a req-464bea72-e705-4dbb-885e-407697241175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef69073c-f848-4be3-a21c-6d6627946be0", "name": "network-vif-plugged", "status": "completed", "tag": "82680612-5807-44cd-9c6f-ccec951a1345"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:48.200960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b1bb176b-324c-49e9-b5a2-f31d171fe31a req-464bea72-e705-4dbb-885e-407697241175 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:48.202400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b1bb176b-324c-49e9-b5a2-f31d171fe31a req-464bea72-e705-4dbb-885e-407697241175 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:48.206714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b1bb176b-324c-49e9-b5a2-f31d171fe31a req-464bea72-e705-4dbb-885e-407697241175 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:48.240224 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b1bb176b-324c-49e9-b5a2-f31d171fe31a req-464bea72-e705-4dbb-885e-407697241175 service nova] Creating event network-vif-plugged:82680612-5807-44cd-9c6f-ccec951a1345 for instance ef69073c-f848-4be3-a21c-6d6627946be0 on n-h2-858383-15 Oct 24 10:44:48.246314 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b1bb176b-324c-49e9-b5a2-f31d171fe31a req-464bea72-e705-4dbb-885e-407697241175 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075745 Oct 24 10:44:48.247636 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2128/4309] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:44:48.267219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:44:48.324383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=8 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:44:48.733787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8df0cd20-6d04-4e70-ad9b-7347c294afe7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:48.744257 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8df0cd20-6d04-4e70-ad9b-7347c294afe7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1309 microversion: 2.1 time: 0.804486 Oct 24 10:44:48.746449 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2182/4310] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:47 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1309 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:44:48.862346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=10 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:44:48.878433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-07977b1c-1df3-4195-8868-30aa899ae7ac tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:48.879052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-07977b1c-1df3-4195-8868-30aa899ae7ac tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:48.879421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-8bae1f15-e998-4425-9e31-4fb93e040099 req-102d7122-6614-4c1d-ba33-575655a22c48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7d1046-0eb6-43eb-b688-650eb6f4f6fc", "tag": "3ba79e67-e8f1-47d0-bb0d-164e47b7818e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:48.890034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07977b1c-1df3-4195-8868-30aa899ae7ac tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:48.893606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07977b1c-1df3-4195-8868-30aa899ae7ac tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:48.894624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07977b1c-1df3-4195-8868-30aa899ae7ac tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:48.895619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07977b1c-1df3-4195-8868-30aa899ae7ac tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:48.897945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07977b1c-1df3-4195-8868-30aa899ae7ac tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:48.899134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07977b1c-1df3-4195-8868-30aa899ae7ac tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:48.909717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8bae1f15-e998-4425-9e31-4fb93e040099 req-102d7122-6614-4c1d-ba33-575655a22c48 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:48.910537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8bae1f15-e998-4425-9e31-4fb93e040099 req-102d7122-6614-4c1d-ba33-575655a22c48 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:48.911503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8bae1f15-e998-4425-9e31-4fb93e040099 req-102d7122-6614-4c1d-ba33-575655a22c48 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:48.988678 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-8bae1f15-e998-4425-9e31-4fb93e040099 req-102d7122-6614-4c1d-ba33-575655a22c48 service nova] Creating event network-changed:3ba79e67-e8f1-47d0-bb0d-164e47b7818e for instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc on n-h2-858383-15 Oct 24 10:44:49.002469 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-8bae1f15-e998-4425-9e31-4fb93e040099 req-102d7122-6614-4c1d-ba33-575655a22c48 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140819 Oct 24 10:44:49.004049 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2129/4311] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:44:49.078315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-42414767-46d7-44b5-89d6-02fa22aef495 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:49.079774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-42414767-46d7-44b5-89d6-02fa22aef495 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:49.099056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42414767-46d7-44b5-89d6-02fa22aef495 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:49.100600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42414767-46d7-44b5-89d6-02fa22aef495 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:49.102218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42414767-46d7-44b5-89d6-02fa22aef495 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:49.106060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42414767-46d7-44b5-89d6-02fa22aef495 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:49.106864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42414767-46d7-44b5-89d6-02fa22aef495 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:49.108427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42414767-46d7-44b5-89d6-02fa22aef495 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:49.436089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-07977b1c-1df3-4195-8868-30aa899ae7ac tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:49.446839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-07977b1c-1df3-4195-8868-30aa899ae7ac tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:49.448961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-07977b1c-1df3-4195-8868-30aa899ae7ac tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:49.450733 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-07977b1c-1df3-4195-8868-30aa899ae7ac tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1741 microversion: 2.20 time: 0.576983 Oct 24 10:44:49.468271 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2183/4312] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:48 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1741 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:44:49.781126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-381583da-2991-4ca5-9244-f2f5c419abc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:49.784327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-381583da-2991-4ca5-9244-f2f5c419abc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:49.815619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-381583da-2991-4ca5-9244-f2f5c419abc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:49.816431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-381583da-2991-4ca5-9244-f2f5c419abc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:49.817253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-381583da-2991-4ca5-9244-f2f5c419abc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:49.819464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-381583da-2991-4ca5-9244-f2f5c419abc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:49.822397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-381583da-2991-4ca5-9244-f2f5c419abc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:49.823063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-381583da-2991-4ca5-9244-f2f5c419abc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:49.828289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-42414767-46d7-44b5-89d6-02fa22aef495 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:49.836506 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-42414767-46d7-44b5-89d6-02fa22aef495 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1314 microversion: 2.1 time: 0.767888 Oct 24 10:44:49.845584 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2130/4313] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:49 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1314 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:50.348726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-381583da-2991-4ca5-9244-f2f5c419abc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:50.356898 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-381583da-2991-4ca5-9244-f2f5c419abc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1309 microversion: 2.1 time: 0.589618 Oct 24 10:44:50.357800 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2184/4314] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:49 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1309 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:50.483877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e8ec9fa7-a3c8-4289-893b-4760c8ae3e6f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:50.484749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e8ec9fa7-a3c8-4289-893b-4760c8ae3e6f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:50.493616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8ec9fa7-a3c8-4289-893b-4760c8ae3e6f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:50.494844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8ec9fa7-a3c8-4289-893b-4760c8ae3e6f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:50.495322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8ec9fa7-a3c8-4289-893b-4760c8ae3e6f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:50.496334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8ec9fa7-a3c8-4289-893b-4760c8ae3e6f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:50.496794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8ec9fa7-a3c8-4289-893b-4760c8ae3e6f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:50.497575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8ec9fa7-a3c8-4289-893b-4760c8ae3e6f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:50.865992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0e2d4f6e-d99b-4931-8a13-34ca1c75fae3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:50.867781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0e2d4f6e-d99b-4931-8a13-34ca1c75fae3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:50.894735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e2d4f6e-d99b-4931-8a13-34ca1c75fae3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:50.899016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e2d4f6e-d99b-4931-8a13-34ca1c75fae3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:50.899992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e2d4f6e-d99b-4931-8a13-34ca1c75fae3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:50.904823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e2d4f6e-d99b-4931-8a13-34ca1c75fae3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:50.909224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e2d4f6e-d99b-4931-8a13-34ca1c75fae3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:50.910025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e2d4f6e-d99b-4931-8a13-34ca1c75fae3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:51.338509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e8ec9fa7-a3c8-4289-893b-4760c8ae3e6f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:51.353748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e8ec9fa7-a3c8-4289-893b-4760c8ae3e6f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:51.355893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e8ec9fa7-a3c8-4289-893b-4760c8ae3e6f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:51.357825 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e8ec9fa7-a3c8-4289-893b-4760c8ae3e6f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1723 microversion: 2.20 time: 0.877764 Oct 24 10:44:51.359912 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2131/4315] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:50 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1723 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:51.383766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-244c8956-65c9-4175-8d4e-9204db17a08b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:51.384416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-244c8956-65c9-4175-8d4e-9204db17a08b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:51.400616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-244c8956-65c9-4175-8d4e-9204db17a08b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:51.402899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-244c8956-65c9-4175-8d4e-9204db17a08b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:51.403367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-244c8956-65c9-4175-8d4e-9204db17a08b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:51.404105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-244c8956-65c9-4175-8d4e-9204db17a08b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:51.404566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-244c8956-65c9-4175-8d4e-9204db17a08b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:51.405050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-244c8956-65c9-4175-8d4e-9204db17a08b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:51.483374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0e2d4f6e-d99b-4931-8a13-34ca1c75fae3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:51.505913 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0e2d4f6e-d99b-4931-8a13-34ca1c75fae3 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1500 microversion: 2.1 time: 0.649234 Oct 24 10:44:51.508259 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2185/4316] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:50 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1500 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:51.529601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2bc49455-003d-4989-868c-7819e3ff6a82 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:51.531970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2bc49455-003d-4989-868c-7819e3ff6a82 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:51.538763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bc49455-003d-4989-868c-7819e3ff6a82 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:51.539519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bc49455-003d-4989-868c-7819e3ff6a82 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:51.539978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bc49455-003d-4989-868c-7819e3ff6a82 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:51.540676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bc49455-003d-4989-868c-7819e3ff6a82 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:51.541318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bc49455-003d-4989-868c-7819e3ff6a82 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:51.541906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bc49455-003d-4989-868c-7819e3ff6a82 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:51.568047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-2bc49455-003d-4989-868c-7819e3ff6a82 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lazy-loading 'flavor' on Instance uuid ef69073c-f848-4be3-a21c-6d6627946be0 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:44:51.687464 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2bc49455-003d-4989-868c-7819e3ff6a82 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "POST /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0/action" status: 200 len: 32 microversion: 2.1 time: 0.160480 Oct 24 10:44:51.697346 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2186/4317] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:44:51 2022] POST /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 10:44:51.710038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0adbc9be-5e85-4d69-8348-65fcab6bb41b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:51.711841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0adbc9be-5e85-4d69-8348-65fcab6bb41b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:51.723449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0adbc9be-5e85-4d69-8348-65fcab6bb41b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:51.724592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0adbc9be-5e85-4d69-8348-65fcab6bb41b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:51.726969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0adbc9be-5e85-4d69-8348-65fcab6bb41b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:51.728985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0adbc9be-5e85-4d69-8348-65fcab6bb41b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:51.729774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0adbc9be-5e85-4d69-8348-65fcab6bb41b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:51.730462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0adbc9be-5e85-4d69-8348-65fcab6bb41b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:51.863401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-244c8956-65c9-4175-8d4e-9204db17a08b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:51.883693 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-244c8956-65c9-4175-8d4e-9204db17a08b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1309 microversion: 2.1 time: 0.499754 Oct 24 10:44:51.886358 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2132/4318] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:51 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1309 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:52.264802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0adbc9be-5e85-4d69-8348-65fcab6bb41b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:52.281496 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0adbc9be-5e85-4d69-8348-65fcab6bb41b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 0.581567 Oct 24 10:44:52.283339 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2187/4319] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:51 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:52.388083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1fc7ff86-58f0-4d9f-8e95-46844231ce32 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:52.389283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1fc7ff86-58f0-4d9f-8e95-46844231ce32 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:52.406835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fc7ff86-58f0-4d9f-8e95-46844231ce32 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:52.409263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fc7ff86-58f0-4d9f-8e95-46844231ce32 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:52.409727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fc7ff86-58f0-4d9f-8e95-46844231ce32 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:52.411567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fc7ff86-58f0-4d9f-8e95-46844231ce32 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:52.412172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fc7ff86-58f0-4d9f-8e95-46844231ce32 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:52.412818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fc7ff86-58f0-4d9f-8e95-46844231ce32 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:52.762303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1fc7ff86-58f0-4d9f-8e95-46844231ce32 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:52.777394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1fc7ff86-58f0-4d9f-8e95-46844231ce32 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:52.780808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1fc7ff86-58f0-4d9f-8e95-46844231ce32 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:52.783056 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1fc7ff86-58f0-4d9f-8e95-46844231ce32 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1723 microversion: 2.20 time: 0.398685 Oct 24 10:44:52.786875 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2133/4320] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:52 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1723 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:44:52.920152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a131d22d-9da6-41d0-9307-0a4bed94eb46 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:52.920859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a131d22d-9da6-41d0-9307-0a4bed94eb46 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:52.944942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a131d22d-9da6-41d0-9307-0a4bed94eb46 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:52.948793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a131d22d-9da6-41d0-9307-0a4bed94eb46 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:52.949494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a131d22d-9da6-41d0-9307-0a4bed94eb46 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:52.950430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a131d22d-9da6-41d0-9307-0a4bed94eb46 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:52.951946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a131d22d-9da6-41d0-9307-0a4bed94eb46 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:52.952544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a131d22d-9da6-41d0-9307-0a4bed94eb46 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:53.306167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-18568ffa-0a1c-4797-9f1c-1ccf34852f29 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:53.307050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-18568ffa-0a1c-4797-9f1c-1ccf34852f29 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:53.313999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18568ffa-0a1c-4797-9f1c-1ccf34852f29 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:53.314812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18568ffa-0a1c-4797-9f1c-1ccf34852f29 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:53.315442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18568ffa-0a1c-4797-9f1c-1ccf34852f29 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:53.316351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18568ffa-0a1c-4797-9f1c-1ccf34852f29 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:53.317020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18568ffa-0a1c-4797-9f1c-1ccf34852f29 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:53.317615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18568ffa-0a1c-4797-9f1c-1ccf34852f29 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:53.701908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a131d22d-9da6-41d0-9307-0a4bed94eb46 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:53.720244 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a131d22d-9da6-41d0-9307-0a4bed94eb46 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1309 microversion: 2.1 time: 0.813164 Oct 24 10:44:53.725885 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2188/4321] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:52 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1309 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:53.813579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6ade4fef-7eb8-407b-a84e-e4795dba8325 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:53.814441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6ade4fef-7eb8-407b-a84e-e4795dba8325 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:53.831566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ade4fef-7eb8-407b-a84e-e4795dba8325 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:53.832475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ade4fef-7eb8-407b-a84e-e4795dba8325 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:53.833228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ade4fef-7eb8-407b-a84e-e4795dba8325 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:53.834323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ade4fef-7eb8-407b-a84e-e4795dba8325 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:53.835593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ade4fef-7eb8-407b-a84e-e4795dba8325 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:53.836313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ade4fef-7eb8-407b-a84e-e4795dba8325 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:54.205582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-18568ffa-0a1c-4797-9f1c-1ccf34852f29 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:54.218773 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-18568ffa-0a1c-4797-9f1c-1ccf34852f29 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 0.916520 Oct 24 10:44:54.226982 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2134/4322] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:53 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:54.239668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b6c22403-0292-4f62-bf79-6bd14eadf35b req-c08284cf-3f03-4218-8463-8760235e7764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6eb3578-42ca-4dc5-b31a-e5500aa94f2e", "name": "network-vif-unplugged", "status": "completed", "tag": "36f88fb2-6faf-4282-bd23-d4f02a3206ca"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:54.257446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b6c22403-0292-4f62-bf79-6bd14eadf35b req-c08284cf-3f03-4218-8463-8760235e7764 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:54.259238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b6c22403-0292-4f62-bf79-6bd14eadf35b req-c08284cf-3f03-4218-8463-8760235e7764 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:54.260521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b6c22403-0292-4f62-bf79-6bd14eadf35b req-c08284cf-3f03-4218-8463-8760235e7764 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:54.319892 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b6c22403-0292-4f62-bf79-6bd14eadf35b req-c08284cf-3f03-4218-8463-8760235e7764 service nova] Creating event network-vif-unplugged:36f88fb2-6faf-4282-bd23-d4f02a3206ca for instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e on n-h2-858383-15 Oct 24 10:44:54.331517 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b6c22403-0292-4f62-bf79-6bd14eadf35b req-c08284cf-3f03-4218-8463-8760235e7764 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101747 Oct 24 10:44:54.333719 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2135/4323] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:44:54.367540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6ade4fef-7eb8-407b-a84e-e4795dba8325 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:54.380277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6ade4fef-7eb8-407b-a84e-e4795dba8325 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:54.385973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6ade4fef-7eb8-407b-a84e-e4795dba8325 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:54.389978 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6ade4fef-7eb8-407b-a84e-e4795dba8325 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1723 microversion: 2.20 time: 0.581484 Oct 24 10:44:54.408795 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2189/4324] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:53 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1723 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:44:54.748382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-819a4f8d-b7d9-4250-ac78-f491c6417890 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:54.749422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-819a4f8d-b7d9-4250-ac78-f491c6417890 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:54.763328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-819a4f8d-b7d9-4250-ac78-f491c6417890 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:54.765239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-819a4f8d-b7d9-4250-ac78-f491c6417890 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:54.765904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-819a4f8d-b7d9-4250-ac78-f491c6417890 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:54.769050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-819a4f8d-b7d9-4250-ac78-f491c6417890 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:54.770577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-819a4f8d-b7d9-4250-ac78-f491c6417890 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:54.774352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-819a4f8d-b7d9-4250-ac78-f491c6417890 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:55.265412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-819a4f8d-b7d9-4250-ac78-f491c6417890 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:55.274855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-97636490-c31f-4165-9ce0-fdfd2753e9bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:55.277353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-97636490-c31f-4165-9ce0-fdfd2753e9bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:55.289888 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-819a4f8d-b7d9-4250-ac78-f491c6417890 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1309 microversion: 2.1 time: 0.545023 Oct 24 10:44:55.291474 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2136/4325] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:54 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1309 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:55.297395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-97636490-c31f-4165-9ce0-fdfd2753e9bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:55.298263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-97636490-c31f-4165-9ce0-fdfd2753e9bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:55.302725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-97636490-c31f-4165-9ce0-fdfd2753e9bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:55.303991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-97636490-c31f-4165-9ce0-fdfd2753e9bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:55.304853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-97636490-c31f-4165-9ce0-fdfd2753e9bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:55.305607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-97636490-c31f-4165-9ce0-fdfd2753e9bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:55.425818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-87543041-f0bf-4752-ba4c-618fc28788bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:55.426661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-87543041-f0bf-4752-ba4c-618fc28788bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:55.453060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87543041-f0bf-4752-ba4c-618fc28788bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:55.454006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87543041-f0bf-4752-ba4c-618fc28788bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:55.462768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87543041-f0bf-4752-ba4c-618fc28788bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:55.468379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87543041-f0bf-4752-ba4c-618fc28788bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:55.469128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87543041-f0bf-4752-ba4c-618fc28788bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:55.470478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-87543041-f0bf-4752-ba4c-618fc28788bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:56.330927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-97636490-c31f-4165-9ce0-fdfd2753e9bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:56.373094 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-97636490-c31f-4165-9ce0-fdfd2753e9bc tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 1.118254 Oct 24 10:44:56.373955 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2190/4326] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:55 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:56.392735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2a6ad114-e028-4a16-bd84-7df431163676 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:56.403354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2a6ad114-e028-4a16-bd84-7df431163676 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:56.440654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a6ad114-e028-4a16-bd84-7df431163676 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:56.443002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a6ad114-e028-4a16-bd84-7df431163676 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:56.443568 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a6ad114-e028-4a16-bd84-7df431163676 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:56.444319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a6ad114-e028-4a16-bd84-7df431163676 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:56.446900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a6ad114-e028-4a16-bd84-7df431163676 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:56.447755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a6ad114-e028-4a16-bd84-7df431163676 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:56.535506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-87543041-f0bf-4752-ba4c-618fc28788bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:56.553107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-87543041-f0bf-4752-ba4c-618fc28788bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:56.557323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-87543041-f0bf-4752-ba4c-618fc28788bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:56.561491 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-87543041-f0bf-4752-ba4c-618fc28788bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1723 microversion: 2.20 time: 1.141901 Oct 24 10:44:56.562517 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2137/4327] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:55 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1723 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:44:56.901488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2a6ad114-e028-4a16-bd84-7df431163676 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:56.916483 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2a6ad114-e028-4a16-bd84-7df431163676 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1309 microversion: 2.1 time: 0.535010 Oct 24 10:44:56.917049 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2191/4328] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:56 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1309 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:57.266124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2a5a8cc4-0e80-4190-8da0-47e76a6a41f6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Action: 'create', calling method: .version_select at 0x7f04cb972dc0>, body: {"keypair": {"name": "tempest-keypair-1679326186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGa23fWb78te8FJgy0IsXCSRnYL2LVc2eHGGO4XqYZU9wqtILuFnOdc8axGp38wCs4F2FEWeBgfNRMQ0/lMfcPpP0FjnpdVDJJCpWV5aU+olhPJIOXpVBl7so3hOh7VDyA=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:57.294465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-2a5a8cc4-0e80-4190-8da0-47e76a6a41f6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Getting quotas for project 0233e99754464a45b8e92ebf909fa605. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:44:57.302508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-2a5a8cc4-0e80-4190-8da0-47e76a6a41f6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Getting quotas for user 95b808099e26413a9eaf4bba00069efb and project 0233e99754464a45b8e92ebf909fa605. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:44:57.351621 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2a5a8cc4-0e80-4190-8da0-47e76a6a41f6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.089133 Oct 24 10:44:57.352791 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2138/4329] 10.222.0.50 () {62 vars in 1200 bytes} [Mon Oct 24 10:44:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 24 10:44:57.399179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-21111655-dccd-4084-a722-f9efd8955092 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:57.400422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-21111655-dccd-4084-a722-f9efd8955092 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:57.415337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21111655-dccd-4084-a722-f9efd8955092 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:57.415829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21111655-dccd-4084-a722-f9efd8955092 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:57.416262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21111655-dccd-4084-a722-f9efd8955092 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:57.417002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21111655-dccd-4084-a722-f9efd8955092 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:57.417458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21111655-dccd-4084-a722-f9efd8955092 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:57.418819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21111655-dccd-4084-a722-f9efd8955092 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:57.590573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c03456df-9627-4838-afed-f1f30b627660 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:57.591923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c03456df-9627-4838-afed-f1f30b627660 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:57.599285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c03456df-9627-4838-afed-f1f30b627660 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:57.600005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c03456df-9627-4838-afed-f1f30b627660 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:57.600440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c03456df-9627-4838-afed-f1f30b627660 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:57.601372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c03456df-9627-4838-afed-f1f30b627660 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:57.601980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c03456df-9627-4838-afed-f1f30b627660 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:57.602560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c03456df-9627-4838-afed-f1f30b627660 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:58.297147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-21111655-dccd-4084-a722-f9efd8955092 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:58.322584 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-21111655-dccd-4084-a722-f9efd8955092 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 0.927032 Oct 24 10:44:58.339221 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2192/4330] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:57 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:58.465338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c03456df-9627-4838-afed-f1f30b627660 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:58.487337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c03456df-9627-4838-afed-f1f30b627660 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:58.493120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c03456df-9627-4838-afed-f1f30b627660 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:58.498590 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c03456df-9627-4838-afed-f1f30b627660 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1666 microversion: 2.20 time: 0.911145 Oct 24 10:44:58.500650 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2139/4331] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:44:57 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1666 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:44:58.512458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-20d84b91-89d3-444f-a249-e709fef9ff84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:44:58.518289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-20d84b91-89d3-444f-a249-e709fef9ff84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:58.538753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20d84b91-89d3-444f-a249-e709fef9ff84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:58.539342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20d84b91-89d3-444f-a249-e709fef9ff84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:58.539952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20d84b91-89d3-444f-a249-e709fef9ff84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:58.541223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20d84b91-89d3-444f-a249-e709fef9ff84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:58.541842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20d84b91-89d3-444f-a249-e709fef9ff84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:58.542723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20d84b91-89d3-444f-a249-e709fef9ff84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:58.698743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a927619f-dfd8-4eeb-a2d3-8ebf8702d6f3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-92755841", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "65d9e69a-668f-4023-bf4d-950cb97f5b96"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:58.802143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-a927619f-dfd8-4eeb-a2d3-8ebf8702d6f3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] validate_networks() for [('65d9e69a-668f-4023-bf4d-950cb97f5b96', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:44:59.347800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-20d84b91-89d3-444f-a249-e709fef9ff84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:44:59.363405 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-20d84b91-89d3-444f-a249-e709fef9ff84 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1309 microversion: 2.1 time: 0.858081 Oct 24 10:44:59.366345 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2140/4332] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:44:58 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1309 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:44:59.395647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-abd8137b-5afe-4cac-a599-e626cf6f36ab tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d36e4517-1c37-4bac-97eb-278fe5e64461"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:44:59.403335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-abd8137b-5afe-4cac-a599-e626cf6f36ab tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:44:59.421084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-abd8137b-5afe-4cac-a599-e626cf6f36ab tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:59.421971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-abd8137b-5afe-4cac-a599-e626cf6f36ab tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:59.422718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-abd8137b-5afe-4cac-a599-e626cf6f36ab tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:59.423779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-abd8137b-5afe-4cac-a599-e626cf6f36ab tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:44:59.427742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-abd8137b-5afe-4cac-a599-e626cf6f36ab tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:44:59.430811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-abd8137b-5afe-4cac-a599-e626cf6f36ab tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:44:59.635755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:00.082616 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-abd8137b-5afe-4cac-a599-e626cf6f36ab tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "POST /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.714762 Oct 24 10:45:00.083254 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2141/4333] 10.222.0.50 () {62 vars in 1364 bytes} [Mon Oct 24 10:44:59 2022] POST /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments => generated 188 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:45:00.362978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-7f710946-5445-49ba-aa5f-a92e35697019 req-402f4dff-3a1e-4e10-ad5d-64494e1cb0dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7d1046-0eb6-43eb-b688-650eb6f4f6fc", "name": "network-vif-plugged", "status": "completed", "tag": "3ba79e67-e8f1-47d0-bb0d-164e47b7818e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:00.392570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7f710946-5445-49ba-aa5f-a92e35697019 req-402f4dff-3a1e-4e10-ad5d-64494e1cb0dd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:00.393777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7f710946-5445-49ba-aa5f-a92e35697019 req-402f4dff-3a1e-4e10-ad5d-64494e1cb0dd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:00.397320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7f710946-5445-49ba-aa5f-a92e35697019 req-402f4dff-3a1e-4e10-ad5d-64494e1cb0dd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:00.429056 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-7f710946-5445-49ba-aa5f-a92e35697019 req-402f4dff-3a1e-4e10-ad5d-64494e1cb0dd service nova] Creating event network-vif-plugged:3ba79e67-e8f1-47d0-bb0d-164e47b7818e for instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc on n-h2-858383-15 Oct 24 10:45:00.435075 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-7f710946-5445-49ba-aa5f-a92e35697019 req-402f4dff-3a1e-4e10-ad5d-64494e1cb0dd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.350234 Oct 24 10:45:00.435634 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2142/4334] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:45:00.441564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5d166eb2-fc7a-41c6-8af7-2d4e290c257c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:00.442638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5d166eb2-fc7a-41c6-8af7-2d4e290c257c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:00.461997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d166eb2-fc7a-41c6-8af7-2d4e290c257c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:00.462666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d166eb2-fc7a-41c6-8af7-2d4e290c257c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:00.468509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d166eb2-fc7a-41c6-8af7-2d4e290c257c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:00.469612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d166eb2-fc7a-41c6-8af7-2d4e290c257c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:00.470355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d166eb2-fc7a-41c6-8af7-2d4e290c257c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:00.470966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d166eb2-fc7a-41c6-8af7-2d4e290c257c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:00.942211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a927619f-dfd8-4eeb-a2d3-8ebf8702d6f3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:45:00.943187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a927619f-dfd8-4eeb-a2d3-8ebf8702d6f3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:45:00.943833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a927619f-dfd8-4eeb-a2d3-8ebf8702d6f3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:45:00.944455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a927619f-dfd8-4eeb-a2d3-8ebf8702d6f3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:45:00.945314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a927619f-dfd8-4eeb-a2d3-8ebf8702d6f3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:45:00.962689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5d166eb2-fc7a-41c6-8af7-2d4e290c257c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:00.966579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a927619f-dfd8-4eeb-a2d3-8ebf8702d6f3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:00.968794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a927619f-dfd8-4eeb-a2d3-8ebf8702d6f3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:00.969346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a927619f-dfd8-4eeb-a2d3-8ebf8702d6f3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:00.970461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a927619f-dfd8-4eeb-a2d3-8ebf8702d6f3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:00.974107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a927619f-dfd8-4eeb-a2d3-8ebf8702d6f3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:00.974624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a927619f-dfd8-4eeb-a2d3-8ebf8702d6f3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:00.979198 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5d166eb2-fc7a-41c6-8af7-2d4e290c257c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 0.542334 Oct 24 10:45:00.992867 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2143/4335] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:00 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:00.992867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ce702d28-4cca-4cfb-bb8c-381c40a0ac1e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:00.992867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ce702d28-4cca-4cfb-bb8c-381c40a0ac1e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:01.010905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce702d28-4cca-4cfb-bb8c-381c40a0ac1e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:01.011415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce702d28-4cca-4cfb-bb8c-381c40a0ac1e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:01.011861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce702d28-4cca-4cfb-bb8c-381c40a0ac1e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:01.012582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce702d28-4cca-4cfb-bb8c-381c40a0ac1e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:01.013076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce702d28-4cca-4cfb-bb8c-381c40a0ac1e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:01.013512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce702d28-4cca-4cfb-bb8c-381c40a0ac1e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:01.028229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-a927619f-dfd8-4eeb-a2d3-8ebf8702d6f3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Getting quotas for project bc0e82e8116e4ace82fe3da9c52f793b. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:45:01.043444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-a927619f-dfd8-4eeb-a2d3-8ebf8702d6f3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Getting quotas for user 5902085e2f564affb70251d4e2fd1df0 and project bc0e82e8116e4ace82fe3da9c52f793b. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:45:01.076919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a927619f-dfd8-4eeb-a2d3-8ebf8702d6f3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:45:01.081520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a927619f-dfd8-4eeb-a2d3-8ebf8702d6f3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:45:01.240793 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a927619f-dfd8-4eeb-a2d3-8ebf8702d6f3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.892538 Oct 24 10:45:01.244336 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2193/4336] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Oct 24 10:44:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2904 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 10:45:01.249471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-42c44717-60c7-417f-8512-42ec9f4fbcda tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:01.255431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-42c44717-60c7-417f-8512-42ec9f4fbcda tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:01.266321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42c44717-60c7-417f-8512-42ec9f4fbcda tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:01.267230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42c44717-60c7-417f-8512-42ec9f4fbcda tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:01.267881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42c44717-60c7-417f-8512-42ec9f4fbcda tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:01.268761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42c44717-60c7-417f-8512-42ec9f4fbcda tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:01.269390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42c44717-60c7-417f-8512-42ec9f4fbcda tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:01.269972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42c44717-60c7-417f-8512-42ec9f4fbcda tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:01.342981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-42c44717-60c7-417f-8512-42ec9f4fbcda tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120426) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 24 10:45:01.466398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce702d28-4cca-4cfb-bb8c-381c40a0ac1e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:01.477501 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ce702d28-4cca-4cfb-bb8c-381c40a0ac1e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1309 microversion: 2.1 time: 0.496008 Oct 24 10:45:01.478316 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2144/4337] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:00 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1309 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:01.481028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:01.483830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-64411572-0d6b-4732-969e-5f31fecb1459 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:01.485083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-64411572-0d6b-4732-969e-5f31fecb1459 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:01.552954 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-42c44717-60c7-417f-8512-42ec9f4fbcda tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "POST /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/action" status: 202 len: 0 microversion: 2.20 time: 0.307200 Oct 24 10:45:01.564916 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2194/4338] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Oct 24 10:45:01 2022] POST /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:45:01.586599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ad586e70-3b9b-4552-8c97-ac7b9e96e2ae tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:01.588490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ad586e70-3b9b-4552-8c97-ac7b9e96e2ae tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:01.629165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad586e70-3b9b-4552-8c97-ac7b9e96e2ae tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:01.631863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad586e70-3b9b-4552-8c97-ac7b9e96e2ae tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:01.632588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad586e70-3b9b-4552-8c97-ac7b9e96e2ae tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:01.633776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad586e70-3b9b-4552-8c97-ac7b9e96e2ae tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:01.636272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad586e70-3b9b-4552-8c97-ac7b9e96e2ae tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:01.637085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad586e70-3b9b-4552-8c97-ac7b9e96e2ae tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:01.842163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-64411572-0d6b-4732-969e-5f31fecb1459 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:01.865638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-64411572-0d6b-4732-969e-5f31fecb1459 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:01.866970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-64411572-0d6b-4732-969e-5f31fecb1459 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:01.868304 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-64411572-0d6b-4732-969e-5f31fecb1459 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 200 len: 1257 microversion: 2.21 time: 0.388682 Oct 24 10:45:01.868758 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2145/4339] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:01 2022] GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 1257 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:02.004396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fac805b6-4574-4726-a818-0b0fbbbd82a8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:02.005039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fac805b6-4574-4726-a818-0b0fbbbd82a8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:02.017450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fac805b6-4574-4726-a818-0b0fbbbd82a8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:02.019418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fac805b6-4574-4726-a818-0b0fbbbd82a8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:02.033438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fac805b6-4574-4726-a818-0b0fbbbd82a8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:02.034298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fac805b6-4574-4726-a818-0b0fbbbd82a8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:02.050039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fac805b6-4574-4726-a818-0b0fbbbd82a8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:02.050896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fac805b6-4574-4726-a818-0b0fbbbd82a8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:02.077295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ad586e70-3b9b-4552-8c97-ac7b9e96e2ae tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:02.095502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ad586e70-3b9b-4552-8c97-ac7b9e96e2ae tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:02.097131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ad586e70-3b9b-4552-8c97-ac7b9e96e2ae tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:02.101950 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ad586e70-3b9b-4552-8c97-ac7b9e96e2ae tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1752 microversion: 2.20 time: 0.533407 Oct 24 10:45:02.108408 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2195/4340] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:01 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1752 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:02.507486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-87e2ff38-7aca-44a5-add3-94be01860c60 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:02.508386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-87e2ff38-7aca-44a5-add3-94be01860c60 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:02.524860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87e2ff38-7aca-44a5-add3-94be01860c60 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:02.541622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87e2ff38-7aca-44a5-add3-94be01860c60 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:02.542087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87e2ff38-7aca-44a5-add3-94be01860c60 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:02.542835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87e2ff38-7aca-44a5-add3-94be01860c60 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:02.543295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87e2ff38-7aca-44a5-add3-94be01860c60 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:02.543725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87e2ff38-7aca-44a5-add3-94be01860c60 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:02.584431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fac805b6-4574-4726-a818-0b0fbbbd82a8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:02.593528 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fac805b6-4574-4726-a818-0b0fbbbd82a8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 0.593719 Oct 24 10:45:02.600067 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2146/4341] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:01 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:45:02.896499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4ff66742-ce7c-43dc-90a0-c535c01c12a4 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:02.897912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4ff66742-ce7c-43dc-90a0-c535c01c12a4 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:02.916505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ff66742-ce7c-43dc-90a0-c535c01c12a4 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:02.921220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ff66742-ce7c-43dc-90a0-c535c01c12a4 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:02.921741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ff66742-ce7c-43dc-90a0-c535c01c12a4 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:02.922524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ff66742-ce7c-43dc-90a0-c535c01c12a4 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:02.923072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ff66742-ce7c-43dc-90a0-c535c01c12a4 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:02.923631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ff66742-ce7c-43dc-90a0-c535c01c12a4 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:03.081890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4ff66742-ce7c-43dc-90a0-c535c01c12a4 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:03.094247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4ff66742-ce7c-43dc-90a0-c535c01c12a4 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:03.105669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4ff66742-ce7c-43dc-90a0-c535c01c12a4 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:03.109583 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4ff66742-ce7c-43dc-90a0-c535c01c12a4 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 200 len: 1309 microversion: 2.21 time: 0.217373 Oct 24 10:45:03.137891 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2147/4342] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:02 2022] GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 1309 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:03.144109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1168152a-1fb8-41a8-8b73-a0160061fef6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:03.144654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1168152a-1fb8-41a8-8b73-a0160061fef6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:03.154008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1168152a-1fb8-41a8-8b73-a0160061fef6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:03.154474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1168152a-1fb8-41a8-8b73-a0160061fef6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:03.155047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1168152a-1fb8-41a8-8b73-a0160061fef6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:03.156386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1168152a-1fb8-41a8-8b73-a0160061fef6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:03.156874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1168152a-1fb8-41a8-8b73-a0160061fef6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:03.157358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1168152a-1fb8-41a8-8b73-a0160061fef6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:03.203272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-87e2ff38-7aca-44a5-add3-94be01860c60 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:03.218468 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-87e2ff38-7aca-44a5-add3-94be01860c60 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1309 microversion: 2.1 time: 0.716048 Oct 24 10:45:03.229096 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2196/4343] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:02 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1309 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:03.464674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1168152a-1fb8-41a8-8b73-a0160061fef6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:03.488364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1168152a-1fb8-41a8-8b73-a0160061fef6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:03.514691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1168152a-1fb8-41a8-8b73-a0160061fef6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:03.519326 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1168152a-1fb8-41a8-8b73-a0160061fef6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1752 microversion: 2.20 time: 0.379105 Oct 24 10:45:03.519326 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2148/4344] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:03 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1752 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:03.631534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cff6f2d6-5549-415d-ab06-3b0274dc5c80 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:03.632522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cff6f2d6-5549-415d-ab06-3b0274dc5c80 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:03.657792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cff6f2d6-5549-415d-ab06-3b0274dc5c80 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:03.658589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cff6f2d6-5549-415d-ab06-3b0274dc5c80 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:03.659189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cff6f2d6-5549-415d-ab06-3b0274dc5c80 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:03.662264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cff6f2d6-5549-415d-ab06-3b0274dc5c80 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:03.662893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cff6f2d6-5549-415d-ab06-3b0274dc5c80 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:03.666390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cff6f2d6-5549-415d-ab06-3b0274dc5c80 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:03.831103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4f684f28-ca14-4bbe-b178-bdb755ea43f1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1301940225", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "6ac38aec-9423-47e8-a792-52c97bac1384"}, {"port": "adbcc1ad-fe50-4a59-b11c-492a2b5fc035", "tag": "port-1"}, {"port": "87b48d2c-81df-4477-a1f6-2e67350bc815", "tag": "port-2"}, {"uuid": "881d0d53-a632-4716-b3c4-c3263d7e0f32", "tag": "net-1"}, {"uuid": "881d0d53-a632-4716-b3c4-c3263d7e0f32"}, {"uuid": "e4fb31b5-c318-4e8a-b224-6a58a6c9c7bf", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "e4fb31b5-c318-4e8a-b224-6a58a6c9c7bf", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "959e31f9-a260-4278-b47a-c5012c089b67", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "54d794f5-56ee-4f6a-8106-ed0a80c252ef", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "4e6c3139-456a-4eb9-a507-9c763d662413", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1893358663"}], "key_name": "tempest-keypair-1679326186", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:04.614004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-4f684f28-ca14-4bbe-b178-bdb755ea43f1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] validate_networks() for [('6ac38aec-9423-47e8-a792-52c97bac1384', None, None, None, None, None), (None, None, 'adbcc1ad-fe50-4a59-b11c-492a2b5fc035', None, None, None), (None, None, '87b48d2c-81df-4477-a1f6-2e67350bc815', None, None, None), ('881d0d53-a632-4716-b3c4-c3263d7e0f32', None, None, None, None, None), ('881d0d53-a632-4716-b3c4-c3263d7e0f32', None, None, None, None, None), ('e4fb31b5-c318-4e8a-b224-6a58a6c9c7bf', '10.2.2.100', None, None, None, None), ('e4fb31b5-c318-4e8a-b224-6a58a6c9c7bf', '10.2.2.200', None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:45:04.762780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cff6f2d6-5549-415d-ab06-3b0274dc5c80 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:04.771494 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cff6f2d6-5549-415d-ab06-3b0274dc5c80 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 1.150901 Oct 24 10:45:04.775352 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2197/4345] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:03 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:04.786639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-191dd499-c464-43cf-9cb7-9d277df5cef9 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:04.787711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-191dd499-c464-43cf-9cb7-9d277df5cef9 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:04.806292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-191dd499-c464-43cf-9cb7-9d277df5cef9 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:04.809599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-191dd499-c464-43cf-9cb7-9d277df5cef9 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:04.813525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-191dd499-c464-43cf-9cb7-9d277df5cef9 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:04.814691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-191dd499-c464-43cf-9cb7-9d277df5cef9 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:04.815388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-191dd499-c464-43cf-9cb7-9d277df5cef9 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:04.816054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-191dd499-c464-43cf-9cb7-9d277df5cef9 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:05.122841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-191dd499-c464-43cf-9cb7-9d277df5cef9 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:05.136780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-191dd499-c464-43cf-9cb7-9d277df5cef9 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:05.140416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-191dd499-c464-43cf-9cb7-9d277df5cef9 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:05.142007 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-191dd499-c464-43cf-9cb7-9d277df5cef9 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 200 len: 1315 microversion: 2.21 time: 0.365029 Oct 24 10:45:05.143699 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2198/4346] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:04 2022] GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:05.152684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3326aee-6773-4d5c-b9d7-ce273794088f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:05.155199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f3326aee-6773-4d5c-b9d7-ce273794088f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:05.171287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3326aee-6773-4d5c-b9d7-ce273794088f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:05.172178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3326aee-6773-4d5c-b9d7-ce273794088f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:05.174348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3326aee-6773-4d5c-b9d7-ce273794088f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:05.175328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3326aee-6773-4d5c-b9d7-ce273794088f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:05.176021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3326aee-6773-4d5c-b9d7-ce273794088f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:05.176685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3326aee-6773-4d5c-b9d7-ce273794088f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:05.759391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3326aee-6773-4d5c-b9d7-ce273794088f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:05.773469 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f3326aee-6773-4d5c-b9d7-ce273794088f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1490 microversion: 2.1 time: 0.624347 Oct 24 10:45:05.774428 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2199/4347] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:05 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1490 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:05.779262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e9520aae-15cc-4e43-9a28-7d618a622be0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:05.779806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e9520aae-15cc-4e43-9a28-7d618a622be0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:05.804579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9520aae-15cc-4e43-9a28-7d618a622be0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:05.805294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9520aae-15cc-4e43-9a28-7d618a622be0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:05.807240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9520aae-15cc-4e43-9a28-7d618a622be0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:05.808441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9520aae-15cc-4e43-9a28-7d618a622be0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:05.809086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9520aae-15cc-4e43-9a28-7d618a622be0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:05.809832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9520aae-15cc-4e43-9a28-7d618a622be0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:06.599912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e9520aae-15cc-4e43-9a28-7d618a622be0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:06.615819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e9520aae-15cc-4e43-9a28-7d618a622be0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:06.622571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e9520aae-15cc-4e43-9a28-7d618a622be0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:06.624375 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e9520aae-15cc-4e43-9a28-7d618a622be0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1754 microversion: 2.20 time: 0.848876 Oct 24 10:45:06.625062 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2200/4348] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:05 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1754 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:06.635701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e52b8d11-07d9-4b4a-a863-9cf1d40ea7bd tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:06.636330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e52b8d11-07d9-4b4a-a863-9cf1d40ea7bd tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:06.654188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e52b8d11-07d9-4b4a-a863-9cf1d40ea7bd tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:06.654692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e52b8d11-07d9-4b4a-a863-9cf1d40ea7bd tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:06.655166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e52b8d11-07d9-4b4a-a863-9cf1d40ea7bd tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:06.656195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e52b8d11-07d9-4b4a-a863-9cf1d40ea7bd tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:06.656959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e52b8d11-07d9-4b4a-a863-9cf1d40ea7bd tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:06.657723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e52b8d11-07d9-4b4a-a863-9cf1d40ea7bd tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:07.145716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e52b8d11-07d9-4b4a-a863-9cf1d40ea7bd tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:07.160176 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e52b8d11-07d9-4b4a-a863-9cf1d40ea7bd tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 0.530172 Oct 24 10:45:07.163321 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2201/4349] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:06 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:07.169377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4b85de96-7ed5-4b90-b680-f008a0135c9c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1169029294", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "734fc132-fff0-4bf7-9775-3a17fdcd25dc"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:07.281010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-4b85de96-7ed5-4b90-b680-f008a0135c9c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] validate_networks() for [('734fc132-fff0-4bf7-9775-3a17fdcd25dc', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:45:09.619726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-4b85de96-7ed5-4b90-b680-f008a0135c9c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:45:09.620280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-4b85de96-7ed5-4b90-b680-f008a0135c9c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:45:09.620515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-4b85de96-7ed5-4b90-b680-f008a0135c9c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:45:09.621211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-4b85de96-7ed5-4b90-b680-f008a0135c9c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:45:09.622083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-4b85de96-7ed5-4b90-b680-f008a0135c9c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:45:09.633254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b85de96-7ed5-4b90-b680-f008a0135c9c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:09.633928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b85de96-7ed5-4b90-b680-f008a0135c9c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:09.634519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b85de96-7ed5-4b90-b680-f008a0135c9c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:09.635423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b85de96-7ed5-4b90-b680-f008a0135c9c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:09.636034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b85de96-7ed5-4b90-b680-f008a0135c9c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:09.636615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b85de96-7ed5-4b90-b680-f008a0135c9c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:09.655880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-4b85de96-7ed5-4b90-b680-f008a0135c9c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Getting quotas for project 9ab3028765ba447589bf595a603ea2e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:45:09.662494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-4b85de96-7ed5-4b90-b680-f008a0135c9c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Getting quotas for user ed058a5e8ac14236ab2e8783e9170346 and project 9ab3028765ba447589bf595a603ea2e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:45:09.677682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4b85de96-7ed5-4b90-b680-f008a0135c9c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:45:09.680485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4b85de96-7ed5-4b90-b680-f008a0135c9c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:45:09.748556 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4b85de96-7ed5-4b90-b680-f008a0135c9c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.583789 Oct 24 10:45:09.749974 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2202/4350] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:45:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:45:09.756664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e7cb6436-2298-4ffb-a1b6-6512013e88a2 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:09.757686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e7cb6436-2298-4ffb-a1b6-6512013e88a2 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:09.764598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7cb6436-2298-4ffb-a1b6-6512013e88a2 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:09.765614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7cb6436-2298-4ffb-a1b6-6512013e88a2 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:09.766414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7cb6436-2298-4ffb-a1b6-6512013e88a2 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:09.767990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7cb6436-2298-4ffb-a1b6-6512013e88a2 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:09.768691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7cb6436-2298-4ffb-a1b6-6512013e88a2 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:09.769403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7cb6436-2298-4ffb-a1b6-6512013e88a2 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:10.216431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e7cb6436-2298-4ffb-a1b6-6512013e88a2 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:10.229582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e7cb6436-2298-4ffb-a1b6-6512013e88a2 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:10.231051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e7cb6436-2298-4ffb-a1b6-6512013e88a2 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:10.238780 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e7cb6436-2298-4ffb-a1b6-6512013e88a2 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 200 len: 1357 microversion: 2.21 time: 0.480282 Oct 24 10:45:10.253429 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2203/4351] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:09 2022] GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 1357 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:10.267564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-83b65494-af87-4386-968e-a9b3b7d0a1ee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:10.268275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-83b65494-af87-4386-968e-a9b3b7d0a1ee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:10.295867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83b65494-af87-4386-968e-a9b3b7d0a1ee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:10.296416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83b65494-af87-4386-968e-a9b3b7d0a1ee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:10.299914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83b65494-af87-4386-968e-a9b3b7d0a1ee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:10.300878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83b65494-af87-4386-968e-a9b3b7d0a1ee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:10.301345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83b65494-af87-4386-968e-a9b3b7d0a1ee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:10.301865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83b65494-af87-4386-968e-a9b3b7d0a1ee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:10.949317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-83b65494-af87-4386-968e-a9b3b7d0a1ee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:10.964806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-83b65494-af87-4386-968e-a9b3b7d0a1ee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:10.966295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-83b65494-af87-4386-968e-a9b3b7d0a1ee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:10.981905 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-83b65494-af87-4386-968e-a9b3b7d0a1ee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1754 microversion: 2.20 time: 0.727203 Oct 24 10:45:10.982831 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2204/4352] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:10 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1754 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:10.988672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c864673f-f81f-4e79-94f1-7bba3594daa9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:10.989652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c864673f-f81f-4e79-94f1-7bba3594daa9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:11.006306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c864673f-f81f-4e79-94f1-7bba3594daa9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:11.007049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c864673f-f81f-4e79-94f1-7bba3594daa9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:11.007819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c864673f-f81f-4e79-94f1-7bba3594daa9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:11.008993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c864673f-f81f-4e79-94f1-7bba3594daa9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:11.009626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c864673f-f81f-4e79-94f1-7bba3594daa9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:11.010209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c864673f-f81f-4e79-94f1-7bba3594daa9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:11.862325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:12.707782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c864673f-f81f-4e79-94f1-7bba3594daa9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:12.729701 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c864673f-f81f-4e79-94f1-7bba3594daa9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 1.745614 Oct 24 10:45:12.734058 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2205/4353] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:10 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:12.770389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a7107c88-b009-4fca-849e-673407ffe984 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:12.771381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a7107c88-b009-4fca-849e-673407ffe984 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:12.787135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7107c88-b009-4fca-849e-673407ffe984 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:12.787960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7107c88-b009-4fca-849e-673407ffe984 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:12.788627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7107c88-b009-4fca-849e-673407ffe984 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:12.790222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7107c88-b009-4fca-849e-673407ffe984 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:12.791740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7107c88-b009-4fca-849e-673407ffe984 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:12.793409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7107c88-b009-4fca-849e-673407ffe984 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:12.986316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a7107c88-b009-4fca-849e-673407ffe984 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:12.998030 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a7107c88-b009-4fca-849e-673407ffe984 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1267 microversion: 2.1 time: 0.231772 Oct 24 10:45:12.998618 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2206/4354] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:12 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:13.013243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8c539fb8-1894-4631-a229-c76d41002b93 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:13.014271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8c539fb8-1894-4631-a229-c76d41002b93 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:13.030545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c539fb8-1894-4631-a229-c76d41002b93 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:13.033442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c539fb8-1894-4631-a229-c76d41002b93 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:13.034112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c539fb8-1894-4631-a229-c76d41002b93 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:13.037218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c539fb8-1894-4631-a229-c76d41002b93 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:13.038773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c539fb8-1894-4631-a229-c76d41002b93 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:13.040090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c539fb8-1894-4631-a229-c76d41002b93 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:13.471503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=40,nova_cell1:UPDATE=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:13.484748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8c539fb8-1894-4631-a229-c76d41002b93 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:13.499071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8c539fb8-1894-4631-a229-c76d41002b93 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:13.500514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8c539fb8-1894-4631-a229-c76d41002b93 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:13.507503 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8c539fb8-1894-4631-a229-c76d41002b93 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 200 len: 1357 microversion: 2.21 time: 0.503351 Oct 24 10:45:13.510746 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2207/4355] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:13 2022] GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 1357 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:13.519285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8e8182db-7400-493f-a79b-b9ddd51914e0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:13.529488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8e8182db-7400-493f-a79b-b9ddd51914e0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:13.552031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e8182db-7400-493f-a79b-b9ddd51914e0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:13.552913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e8182db-7400-493f-a79b-b9ddd51914e0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:13.553569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e8182db-7400-493f-a79b-b9ddd51914e0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:13.558132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e8182db-7400-493f-a79b-b9ddd51914e0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:13.559785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e8182db-7400-493f-a79b-b9ddd51914e0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:13.560486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e8182db-7400-493f-a79b-b9ddd51914e0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:13.987025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8e8182db-7400-493f-a79b-b9ddd51914e0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:14.015482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8e8182db-7400-493f-a79b-b9ddd51914e0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:14.019877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8e8182db-7400-493f-a79b-b9ddd51914e0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:14.021795 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8e8182db-7400-493f-a79b-b9ddd51914e0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1810 microversion: 2.20 time: 0.509508 Oct 24 10:45:14.023096 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2208/4356] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:13 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1810 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:14.034151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-573d736c-c4f4-47b6-a9a3-cb6859917eea req-3d931cca-b734-46fa-8e3a-65396c10ebe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9685b83-752b-43b7-9f66-ea6ccc88917f", "tag": "8f930413-3b9b-4c52-9f03-c302ddd8931d"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:14.062343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-573d736c-c4f4-47b6-a9a3-cb6859917eea req-3d931cca-b734-46fa-8e3a-65396c10ebe0 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:14.070530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-573d736c-c4f4-47b6-a9a3-cb6859917eea req-3d931cca-b734-46fa-8e3a-65396c10ebe0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:14.071444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-573d736c-c4f4-47b6-a9a3-cb6859917eea req-3d931cca-b734-46fa-8e3a-65396c10ebe0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:14.092973 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-573d736c-c4f4-47b6-a9a3-cb6859917eea req-3d931cca-b734-46fa-8e3a-65396c10ebe0 service nova] Creating event network-changed:8f930413-3b9b-4c52-9f03-c302ddd8931d for instance d9685b83-752b-43b7-9f66-ea6ccc88917f on n-h1-858383-15 Oct 24 10:45:14.103638 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-573d736c-c4f4-47b6-a9a3-cb6859917eea req-3d931cca-b734-46fa-8e3a-65396c10ebe0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078030 Oct 24 10:45:14.105735 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2209/4357] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:45:14.121153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0e674bc9-1431-4a34-8ca7-d42131f3bf52 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:14.122897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0e674bc9-1431-4a34-8ca7-d42131f3bf52 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:14.130936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e674bc9-1431-4a34-8ca7-d42131f3bf52 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:14.131974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e674bc9-1431-4a34-8ca7-d42131f3bf52 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:14.136537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e674bc9-1431-4a34-8ca7-d42131f3bf52 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:14.136537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e674bc9-1431-4a34-8ca7-d42131f3bf52 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:14.136807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e674bc9-1431-4a34-8ca7-d42131f3bf52 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:14.137439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e674bc9-1431-4a34-8ca7-d42131f3bf52 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:14.404687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4f684f28-ca14-4bbe-b178-bdb755ea43f1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:45:14.406072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4f684f28-ca14-4bbe-b178-bdb755ea43f1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:45:14.407853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4f684f28-ca14-4bbe-b178-bdb755ea43f1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:45:14.408517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4f684f28-ca14-4bbe-b178-bdb755ea43f1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:45:14.409701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4f684f28-ca14-4bbe-b178-bdb755ea43f1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:45:14.433589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0e674bc9-1431-4a34-8ca7-d42131f3bf52 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:14.439887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f684f28-ca14-4bbe-b178-bdb755ea43f1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:14.440752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f684f28-ca14-4bbe-b178-bdb755ea43f1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:14.441697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f684f28-ca14-4bbe-b178-bdb755ea43f1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:14.443350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f684f28-ca14-4bbe-b178-bdb755ea43f1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:14.443505 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0e674bc9-1431-4a34-8ca7-d42131f3bf52 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 0.336372 Oct 24 10:45:14.444116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f684f28-ca14-4bbe-b178-bdb755ea43f1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:14.444877 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2210/4358] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:14 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:14.449854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a0e4b561-937b-42ec-afc6-c06c1472402e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:14.450776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a0e4b561-937b-42ec-afc6-c06c1472402e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:14.458500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f684f28-ca14-4bbe-b178-bdb755ea43f1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:14.459832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0e4b561-937b-42ec-afc6-c06c1472402e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:14.465915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0e4b561-937b-42ec-afc6-c06c1472402e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:14.466926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0e4b561-937b-42ec-afc6-c06c1472402e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:14.467910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0e4b561-937b-42ec-afc6-c06c1472402e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:14.468588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0e4b561-937b-42ec-afc6-c06c1472402e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:14.469261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0e4b561-937b-42ec-afc6-c06c1472402e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:14.476081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:14.483214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-4f684f28-ca14-4bbe-b178-bdb755ea43f1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Getting quotas for project 0233e99754464a45b8e92ebf909fa605. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:45:14.493934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-4f684f28-ca14-4bbe-b178-bdb755ea43f1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Getting quotas for user 95b808099e26413a9eaf4bba00069efb and project 0233e99754464a45b8e92ebf909fa605. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:45:14.551466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a0e4b561-937b-42ec-afc6-c06c1472402e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:14.561295 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a0e4b561-937b-42ec-afc6-c06c1472402e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1267 microversion: 2.1 time: 0.114334 Oct 24 10:45:14.562348 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2211/4359] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:14 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:14.568754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-291371fc-7993-4ea7-b136-1f52bef228eb tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:14.569755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-291371fc-7993-4ea7-b136-1f52bef228eb tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:14.576477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-291371fc-7993-4ea7-b136-1f52bef228eb tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:14.577347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-291371fc-7993-4ea7-b136-1f52bef228eb tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:14.578042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-291371fc-7993-4ea7-b136-1f52bef228eb tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:14.579663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-291371fc-7993-4ea7-b136-1f52bef228eb tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:14.580727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-291371fc-7993-4ea7-b136-1f52bef228eb tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:14.581536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-291371fc-7993-4ea7-b136-1f52bef228eb tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:14.750233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4f684f28-ca14-4bbe-b178-bdb755ea43f1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:45:14.753714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4f684f28-ca14-4bbe-b178-bdb755ea43f1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='959e31f9-a260-4278-b47a-c5012c089b67',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='54d794f5-56ee-4f6a-8106-ed0a80c252ef',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4e6c3139-456a-4eb9-a507-9c763d662413',volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:45:14.804650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-291371fc-7993-4ea7-b136-1f52bef228eb tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:14.809399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:14.816057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-291371fc-7993-4ea7-b136-1f52bef228eb tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:14.817556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-291371fc-7993-4ea7-b136-1f52bef228eb tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:14.819696 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-291371fc-7993-4ea7-b136-1f52bef228eb tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 200 len: 1357 microversion: 2.21 time: 0.254428 Oct 24 10:45:14.833440 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2212/4360] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:14 2022] GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 1357 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:15.051884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-262b6a6b-c380-40b0-a2cb-a0383cf53938 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:15.053103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-262b6a6b-c380-40b0-a2cb-a0383cf53938 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:15.068231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:15.083630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-262b6a6b-c380-40b0-a2cb-a0383cf53938 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:15.089761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-262b6a6b-c380-40b0-a2cb-a0383cf53938 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:15.090613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-262b6a6b-c380-40b0-a2cb-a0383cf53938 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:15.093927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-262b6a6b-c380-40b0-a2cb-a0383cf53938 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:15.099663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-262b6a6b-c380-40b0-a2cb-a0383cf53938 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:15.101194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-262b6a6b-c380-40b0-a2cb-a0383cf53938 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:15.398092 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4f684f28-ca14-4bbe-b178-bdb755ea43f1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 11.570995 Oct 24 10:45:15.399466 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2149/4361] 10.222.0.50 () {62 vars in 1189 bytes} [Mon Oct 24 10:45:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 11573 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 24 10:45:15.416268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c0724f64-a5a0-472e-9a8f-b22248eb8679 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:15.417166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c0724f64-a5a0-472e-9a8f-b22248eb8679 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:15.460795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-262b6a6b-c380-40b0-a2cb-a0383cf53938 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:15.477708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-262b6a6b-c380-40b0-a2cb-a0383cf53938 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:15.479171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-262b6a6b-c380-40b0-a2cb-a0383cf53938 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:15.480964 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-262b6a6b-c380-40b0-a2cb-a0383cf53938 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1810 microversion: 2.20 time: 0.434013 Oct 24 10:45:15.482136 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2213/4362] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:15 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1810 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:15.487535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-59098d8e-843e-418e-954d-e8191297dec4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:15.495694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-59098d8e-843e-418e-954d-e8191297dec4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:15.507364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-59098d8e-843e-418e-954d-e8191297dec4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:15.508423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-59098d8e-843e-418e-954d-e8191297dec4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:15.509117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-59098d8e-843e-418e-954d-e8191297dec4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:15.510039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-59098d8e-843e-418e-954d-e8191297dec4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:15.510836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-59098d8e-843e-418e-954d-e8191297dec4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:15.511467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-59098d8e-843e-418e-954d-e8191297dec4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:15.546340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0724f64-a5a0-472e-9a8f-b22248eb8679 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:15.568456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0724f64-a5a0-472e-9a8f-b22248eb8679 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:15.568456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0724f64-a5a0-472e-9a8f-b22248eb8679 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:15.584234 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c0724f64-a5a0-472e-9a8f-b22248eb8679 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1286 microversion: 2.42 time: 0.173125 Oct 24 10:45:15.585754 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2150/4363] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:15 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1286 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:15.596441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-644675a7-5d15-4d30-aac9-3b34002e835a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:15.598162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-644675a7-5d15-4d30-aac9-3b34002e835a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:15.609288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-644675a7-5d15-4d30-aac9-3b34002e835a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:15.609899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-644675a7-5d15-4d30-aac9-3b34002e835a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:15.610799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-644675a7-5d15-4d30-aac9-3b34002e835a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:15.611503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-644675a7-5d15-4d30-aac9-3b34002e835a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:15.611955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-644675a7-5d15-4d30-aac9-3b34002e835a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:15.612376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-644675a7-5d15-4d30-aac9-3b34002e835a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:15.746383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-644675a7-5d15-4d30-aac9-3b34002e835a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:15.784243 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-644675a7-5d15-4d30-aac9-3b34002e835a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1267 microversion: 2.1 time: 0.193485 Oct 24 10:45:15.786244 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2151/4364] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:15 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:15.850649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-26b84321-285a-4d1d-88a2-eb35bf3aa875 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:15.851271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-26b84321-285a-4d1d-88a2-eb35bf3aa875 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:15.865717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b84321-285a-4d1d-88a2-eb35bf3aa875 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:15.866392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b84321-285a-4d1d-88a2-eb35bf3aa875 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:15.866831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b84321-285a-4d1d-88a2-eb35bf3aa875 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:15.867547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b84321-285a-4d1d-88a2-eb35bf3aa875 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:15.868009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b84321-285a-4d1d-88a2-eb35bf3aa875 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:15.868433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26b84321-285a-4d1d-88a2-eb35bf3aa875 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:15.878542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-59098d8e-843e-418e-954d-e8191297dec4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:15.889986 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-59098d8e-843e-418e-954d-e8191297dec4 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 0.405866 Oct 24 10:45:15.891227 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2214/4365] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:15 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:16.062844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-066e483b-fc74-48d3-b619-e66fc4e6a784 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-687674196", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "0570c513-0036-46af-96c6-484910670fdc"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:16.109183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-26b84321-285a-4d1d-88a2-eb35bf3aa875 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:16.120771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-26b84321-285a-4d1d-88a2-eb35bf3aa875 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:16.123012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-26b84321-285a-4d1d-88a2-eb35bf3aa875 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:16.125067 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-26b84321-285a-4d1d-88a2-eb35bf3aa875 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 200 len: 1357 microversion: 2.21 time: 0.278759 Oct 24 10:45:16.146344 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2152/4366] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:15 2022] GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 1357 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:16.180396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-066e483b-fc74-48d3-b619-e66fc4e6a784 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] validate_networks() for [('0570c513-0036-46af-96c6-484910670fdc', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:45:16.511022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a9bdd995-f347-48ed-9de9-ad3f6f3adc76 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:16.512067 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a9bdd995-f347-48ed-9de9-ad3f6f3adc76 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:16.525096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9bdd995-f347-48ed-9de9-ad3f6f3adc76 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:16.525739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9bdd995-f347-48ed-9de9-ad3f6f3adc76 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:16.526370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9bdd995-f347-48ed-9de9-ad3f6f3adc76 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:16.527189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9bdd995-f347-48ed-9de9-ad3f6f3adc76 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:16.528582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9bdd995-f347-48ed-9de9-ad3f6f3adc76 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:16.529551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9bdd995-f347-48ed-9de9-ad3f6f3adc76 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:17.580977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a9bdd995-f347-48ed-9de9-ad3f6f3adc76 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:17.598320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a9bdd995-f347-48ed-9de9-ad3f6f3adc76 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:17.603703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a9bdd995-f347-48ed-9de9-ad3f6f3adc76 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:17.604968 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a9bdd995-f347-48ed-9de9-ad3f6f3adc76 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1810 microversion: 2.20 time: 1.098650 Oct 24 10:45:17.608080 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2153/4367] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:16 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1810 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:17.621940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4297a2a6-82cc-427a-87ea-783313752f83 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:17.622643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4297a2a6-82cc-427a-87ea-783313752f83 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:17.635657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4297a2a6-82cc-427a-87ea-783313752f83 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:17.636213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4297a2a6-82cc-427a-87ea-783313752f83 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:17.636665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4297a2a6-82cc-427a-87ea-783313752f83 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:17.641748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4297a2a6-82cc-427a-87ea-783313752f83 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:17.642445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4297a2a6-82cc-427a-87ea-783313752f83 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:17.642969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4297a2a6-82cc-427a-87ea-783313752f83 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:17.679498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-066e483b-fc74-48d3-b619-e66fc4e6a784 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:45:17.680053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-066e483b-fc74-48d3-b619-e66fc4e6a784 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:45:17.680817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-066e483b-fc74-48d3-b619-e66fc4e6a784 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:45:17.681371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-066e483b-fc74-48d3-b619-e66fc4e6a784 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:45:17.681887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-066e483b-fc74-48d3-b619-e66fc4e6a784 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:45:17.728434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-066e483b-fc74-48d3-b619-e66fc4e6a784 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:17.731584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-066e483b-fc74-48d3-b619-e66fc4e6a784 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:17.733926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-066e483b-fc74-48d3-b619-e66fc4e6a784 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:17.737888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-066e483b-fc74-48d3-b619-e66fc4e6a784 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:17.738998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-066e483b-fc74-48d3-b619-e66fc4e6a784 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:17.741280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-066e483b-fc74-48d3-b619-e66fc4e6a784 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:17.820744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4297a2a6-82cc-427a-87ea-783313752f83 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:17.827072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-066e483b-fc74-48d3-b619-e66fc4e6a784 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Getting quotas for project 656c472b32cc4421b312f671691a1bda. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:45:17.841652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4297a2a6-82cc-427a-87ea-783313752f83 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:17.847262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4297a2a6-82cc-427a-87ea-783313752f83 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:17.850286 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4297a2a6-82cc-427a-87ea-783313752f83 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1576 microversion: 2.42 time: 0.240371 Oct 24 10:45:17.852029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-066e483b-fc74-48d3-b619-e66fc4e6a784 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Getting quotas for user 758d3d450ce546ebad1836362108dea7 and project 656c472b32cc4421b312f671691a1bda. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:45:17.852483 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2154/4368] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:17 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1576 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:17.863334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-89c8c54b-4503-4602-a8c1-a06643e2b77f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:17.869557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-89c8c54b-4503-4602-a8c1-a06643e2b77f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:17.887651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89c8c54b-4503-4602-a8c1-a06643e2b77f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:17.888435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89c8c54b-4503-4602-a8c1-a06643e2b77f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:17.891061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89c8c54b-4503-4602-a8c1-a06643e2b77f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:17.892507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89c8c54b-4503-4602-a8c1-a06643e2b77f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:17.894315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89c8c54b-4503-4602-a8c1-a06643e2b77f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:17.895050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89c8c54b-4503-4602-a8c1-a06643e2b77f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:17.939863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-066e483b-fc74-48d3-b619-e66fc4e6a784 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:45:17.948717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-066e483b-fc74-48d3-b619-e66fc4e6a784 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:45:18.090087 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-066e483b-fc74-48d3-b619-e66fc4e6a784 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.196221 Oct 24 10:45:18.097019 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2215/4369] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:45:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:45:18.107617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-900a1baf-6096-419e-a3b0-bc2872eebae1 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:18.111198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-900a1baf-6096-419e-a3b0-bc2872eebae1 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:18.127943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-900a1baf-6096-419e-a3b0-bc2872eebae1 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:18.130849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-900a1baf-6096-419e-a3b0-bc2872eebae1 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:18.132321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-900a1baf-6096-419e-a3b0-bc2872eebae1 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:18.134696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-900a1baf-6096-419e-a3b0-bc2872eebae1 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:18.136081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-900a1baf-6096-419e-a3b0-bc2872eebae1 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:18.137503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-900a1baf-6096-419e-a3b0-bc2872eebae1 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:19.636003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-900a1baf-6096-419e-a3b0-bc2872eebae1 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:19.645996 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-900a1baf-6096-419e-a3b0-bc2872eebae1 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 1.547547 Oct 24 10:45:19.654546 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2216/4370] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:18 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:19.660246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2e6ea189-829a-4dd1-9f4d-00ab31655e60 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:19.665647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2e6ea189-829a-4dd1-9f4d-00ab31655e60 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:19.680555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e6ea189-829a-4dd1-9f4d-00ab31655e60 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:19.681477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e6ea189-829a-4dd1-9f4d-00ab31655e60 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:19.682150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e6ea189-829a-4dd1-9f4d-00ab31655e60 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:19.683270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e6ea189-829a-4dd1-9f4d-00ab31655e60 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:19.683966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e6ea189-829a-4dd1-9f4d-00ab31655e60 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:19.684642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e6ea189-829a-4dd1-9f4d-00ab31655e60 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:19.763759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-89c8c54b-4503-4602-a8c1-a06643e2b77f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:19.786718 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-89c8c54b-4503-4602-a8c1-a06643e2b77f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1309 microversion: 2.1 time: 1.930340 Oct 24 10:45:19.787486 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2155/4371] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:17 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1309 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:19.802302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c494a545-2059-4eb6-9007-f9b5bab176ca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:19.806691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c494a545-2059-4eb6-9007-f9b5bab176ca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:19.829791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c494a545-2059-4eb6-9007-f9b5bab176ca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:19.832905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c494a545-2059-4eb6-9007-f9b5bab176ca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:19.834347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c494a545-2059-4eb6-9007-f9b5bab176ca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:19.835964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c494a545-2059-4eb6-9007-f9b5bab176ca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:19.838667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c494a545-2059-4eb6-9007-f9b5bab176ca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:19.840513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c494a545-2059-4eb6-9007-f9b5bab176ca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:20.271167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c494a545-2059-4eb6-9007-f9b5bab176ca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:20.281513 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c494a545-2059-4eb6-9007-f9b5bab176ca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1213 microversion: 2.1 time: 0.487774 Oct 24 10:45:20.297120 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2156/4372] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:19 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1213 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:20.301874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-15f4a6cf-4bf7-44da-b706-00215de6d412 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:20.303432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-15f4a6cf-4bf7-44da-b706-00215de6d412 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:20.315838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15f4a6cf-4bf7-44da-b706-00215de6d412 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:20.316368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15f4a6cf-4bf7-44da-b706-00215de6d412 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:20.316795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15f4a6cf-4bf7-44da-b706-00215de6d412 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:20.318197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15f4a6cf-4bf7-44da-b706-00215de6d412 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:20.318663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15f4a6cf-4bf7-44da-b706-00215de6d412 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:20.319148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15f4a6cf-4bf7-44da-b706-00215de6d412 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:20.706082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2e6ea189-829a-4dd1-9f4d-00ab31655e60 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:20.723708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2e6ea189-829a-4dd1-9f4d-00ab31655e60 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:20.730928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2e6ea189-829a-4dd1-9f4d-00ab31655e60 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:20.735780 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2e6ea189-829a-4dd1-9f4d-00ab31655e60 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 200 len: 1357 microversion: 2.21 time: 1.079141 Oct 24 10:45:20.742016 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2217/4373] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:19 2022] GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 1357 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:20.746971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a9395a63-4993-45e3-875a-8aa714eefc81 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:20.747774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a9395a63-4993-45e3-875a-8aa714eefc81 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:20.787643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9395a63-4993-45e3-875a-8aa714eefc81 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:20.788618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9395a63-4993-45e3-875a-8aa714eefc81 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:20.789456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9395a63-4993-45e3-875a-8aa714eefc81 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:20.791850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9395a63-4993-45e3-875a-8aa714eefc81 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:20.793127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9395a63-4993-45e3-875a-8aa714eefc81 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:20.793733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9395a63-4993-45e3-875a-8aa714eefc81 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:21.087675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a9395a63-4993-45e3-875a-8aa714eefc81 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:21.099137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a9395a63-4993-45e3-875a-8aa714eefc81 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:21.100614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a9395a63-4993-45e3-875a-8aa714eefc81 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:21.105643 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a9395a63-4993-45e3-875a-8aa714eefc81 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1594 microversion: 2.42 time: 0.362396 Oct 24 10:45:21.127523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-15f4a6cf-4bf7-44da-b706-00215de6d412 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:21.137344 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2218/4374] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:20 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1594 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:21.155017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-15f4a6cf-4bf7-44da-b706-00215de6d412 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:21.156416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-e0aed3a5-5921-4e79-b290-7293031c623c req-561712b3-8038-43e7-8411-78b7d073d837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3cd53e-83ed-45b4-82ac-882fb65759f9", "tag": "bfb45541-45c3-4e57-959c-17ae32c17e06"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:21.163151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-15f4a6cf-4bf7-44da-b706-00215de6d412 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:21.166058 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-15f4a6cf-4bf7-44da-b706-00215de6d412 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1810 microversion: 2.20 time: 0.872704 Oct 24 10:45:21.172150 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2157/4375] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:20 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1810 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:21.204463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-50d06536-7e2f-464a-944e-0438d91ad33b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:21.205511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-50d06536-7e2f-464a-944e-0438d91ad33b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:21.217400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e0aed3a5-5921-4e79-b290-7293031c623c req-561712b3-8038-43e7-8411-78b7d073d837 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:21.217962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e0aed3a5-5921-4e79-b290-7293031c623c req-561712b3-8038-43e7-8411-78b7d073d837 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:21.218400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e0aed3a5-5921-4e79-b290-7293031c623c req-561712b3-8038-43e7-8411-78b7d073d837 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:21.246846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50d06536-7e2f-464a-944e-0438d91ad33b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:21.246940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50d06536-7e2f-464a-944e-0438d91ad33b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:21.247362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50d06536-7e2f-464a-944e-0438d91ad33b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:21.248097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50d06536-7e2f-464a-944e-0438d91ad33b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:21.248554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50d06536-7e2f-464a-944e-0438d91ad33b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:21.249062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50d06536-7e2f-464a-944e-0438d91ad33b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:21.287189 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-e0aed3a5-5921-4e79-b290-7293031c623c req-561712b3-8038-43e7-8411-78b7d073d837 service nova] Creating event network-changed:bfb45541-45c3-4e57-959c-17ae32c17e06 for instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 on n-h2-858383-15 Oct 24 10:45:21.305480 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-e0aed3a5-5921-4e79-b290-7293031c623c req-561712b3-8038-43e7-8411-78b7d073d837 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164916 Oct 24 10:45:21.309823 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2219/4376] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:45:21.333055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f2836021-7f01-4fe6-a39e-3187ba1fca81 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:21.334657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f2836021-7f01-4fe6-a39e-3187ba1fca81 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:21.363968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2836021-7f01-4fe6-a39e-3187ba1fca81 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:21.365101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2836021-7f01-4fe6-a39e-3187ba1fca81 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:21.370106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2836021-7f01-4fe6-a39e-3187ba1fca81 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:21.379357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2836021-7f01-4fe6-a39e-3187ba1fca81 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:21.382894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2836021-7f01-4fe6-a39e-3187ba1fca81 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:21.383591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2836021-7f01-4fe6-a39e-3187ba1fca81 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:22.203621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-50d06536-7e2f-464a-944e-0438d91ad33b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:22.212203 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-50d06536-7e2f-464a-944e-0438d91ad33b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 1.038311 Oct 24 10:45:22.213195 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2158/4377] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:21 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:22.236348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-7700cb7a-e3b6-4a90-b9d5-b10ee4abf1fd req-2c0b3ea1-a2ec-4e06-aaf7-13d5d0480043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9685b83-752b-43b7-9f66-ea6ccc88917f", "name": "network-vif-plugged", "status": "completed", "tag": "8f930413-3b9b-4c52-9f03-c302ddd8931d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:22.248607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7700cb7a-e3b6-4a90-b9d5-b10ee4abf1fd req-2c0b3ea1-a2ec-4e06-aaf7-13d5d0480043 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:22.249358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7700cb7a-e3b6-4a90-b9d5-b10ee4abf1fd req-2c0b3ea1-a2ec-4e06-aaf7-13d5d0480043 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:22.250020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7700cb7a-e3b6-4a90-b9d5-b10ee4abf1fd req-2c0b3ea1-a2ec-4e06-aaf7-13d5d0480043 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:22.261232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f2836021-7f01-4fe6-a39e-3187ba1fca81 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:22.265597 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-7700cb7a-e3b6-4a90-b9d5-b10ee4abf1fd req-2c0b3ea1-a2ec-4e06-aaf7-13d5d0480043 service nova] Creating event network-vif-plugged:8f930413-3b9b-4c52-9f03-c302ddd8931d for instance d9685b83-752b-43b7-9f66-ea6ccc88917f on n-h1-858383-15 Oct 24 10:45:22.272032 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-7700cb7a-e3b6-4a90-b9d5-b10ee4abf1fd req-2c0b3ea1-a2ec-4e06-aaf7-13d5d0480043 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044920 Oct 24 10:45:22.273744 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2159/4378] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:45:22.278380 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f2836021-7f01-4fe6-a39e-3187ba1fca81 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1309 microversion: 2.1 time: 0.967170 Oct 24 10:45:22.280698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ccec271b-3808-462f-9b82-cd2eb8031802 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:22.281510 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2220/4379] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:21 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1309 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:22.281972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ccec271b-3808-462f-9b82-cd2eb8031802 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:22.289202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccec271b-3808-462f-9b82-cd2eb8031802 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:22.290002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccec271b-3808-462f-9b82-cd2eb8031802 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:22.290686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccec271b-3808-462f-9b82-cd2eb8031802 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:22.291631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccec271b-3808-462f-9b82-cd2eb8031802 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:22.292310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccec271b-3808-462f-9b82-cd2eb8031802 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:22.292989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccec271b-3808-462f-9b82-cd2eb8031802 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:22.304506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-20000986-5a45-471f-a383-8b824bdc61e3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:22.305176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-20000986-5a45-471f-a383-8b824bdc61e3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:22.318690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20000986-5a45-471f-a383-8b824bdc61e3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:22.319188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20000986-5a45-471f-a383-8b824bdc61e3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:22.319640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20000986-5a45-471f-a383-8b824bdc61e3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:22.320357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20000986-5a45-471f-a383-8b824bdc61e3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:22.320816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20000986-5a45-471f-a383-8b824bdc61e3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:22.321271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20000986-5a45-471f-a383-8b824bdc61e3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:22.481811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ccec271b-3808-462f-9b82-cd2eb8031802 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:22.498538 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ccec271b-3808-462f-9b82-cd2eb8031802 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1275 microversion: 2.1 time: 0.223185 Oct 24 10:45:22.500600 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2160/4380] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:22 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1275 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:22.523972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-219c6551-6ab8-4727-ad25-53a4608e9b45 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:22.526016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-219c6551-6ab8-4727-ad25-53a4608e9b45 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:22.536699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-219c6551-6ab8-4727-ad25-53a4608e9b45 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:22.537618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-219c6551-6ab8-4727-ad25-53a4608e9b45 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:22.538612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-219c6551-6ab8-4727-ad25-53a4608e9b45 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:22.539693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-219c6551-6ab8-4727-ad25-53a4608e9b45 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:22.540373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-219c6551-6ab8-4727-ad25-53a4608e9b45 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:22.541059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-219c6551-6ab8-4727-ad25-53a4608e9b45 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:22.711471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-219c6551-6ab8-4727-ad25-53a4608e9b45 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:22.733614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-219c6551-6ab8-4727-ad25-53a4608e9b45 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:22.739840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-219c6551-6ab8-4727-ad25-53a4608e9b45 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:22.741451 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-219c6551-6ab8-4727-ad25-53a4608e9b45 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1594 microversion: 2.42 time: 0.231449 Oct 24 10:45:22.744609 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2161/4381] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:22 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1594 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:22.750011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a5254bb3-8f6d-479d-b179-785452d952b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:22.751391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a5254bb3-8f6d-479d-b179-785452d952b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:22.759373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5254bb3-8f6d-479d-b179-785452d952b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:22.760161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5254bb3-8f6d-479d-b179-785452d952b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:22.761700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5254bb3-8f6d-479d-b179-785452d952b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:22.764538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5254bb3-8f6d-479d-b179-785452d952b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:22.765279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5254bb3-8f6d-479d-b179-785452d952b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:22.766528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5254bb3-8f6d-479d-b179-785452d952b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:22.850778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-20000986-5a45-471f-a383-8b824bdc61e3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:22.864748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-20000986-5a45-471f-a383-8b824bdc61e3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:22.867084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-20000986-5a45-471f-a383-8b824bdc61e3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:22.868317 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-20000986-5a45-471f-a383-8b824bdc61e3 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 200 len: 1357 microversion: 2.21 time: 0.585809 Oct 24 10:45:22.896956 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2221/4382] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:22 2022] GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 1357 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:23.238632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a5254bb3-8f6d-479d-b179-785452d952b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:23.242035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8d597749-e6fc-4bbe-9c64-bb524b9be84f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:23.243010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8d597749-e6fc-4bbe-9c64-bb524b9be84f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:23.255468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d597749-e6fc-4bbe-9c64-bb524b9be84f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:23.257731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d597749-e6fc-4bbe-9c64-bb524b9be84f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:23.258594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a5254bb3-8f6d-479d-b179-785452d952b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:23.259290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d597749-e6fc-4bbe-9c64-bb524b9be84f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:23.260237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a5254bb3-8f6d-479d-b179-785452d952b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:23.261482 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a5254bb3-8f6d-479d-b179-785452d952b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1810 microversion: 2.20 time: 0.515261 Oct 24 10:45:23.262057 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2162/4383] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:22 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1810 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:23.263087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d597749-e6fc-4bbe-9c64-bb524b9be84f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:23.264353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d597749-e6fc-4bbe-9c64-bb524b9be84f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:23.273269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d597749-e6fc-4bbe-9c64-bb524b9be84f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:23.311680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef9d9ffc-48a2-4e04-a490-13827b0d142f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:23.312297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ef9d9ffc-48a2-4e04-a490-13827b0d142f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:23.339496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef9d9ffc-48a2-4e04-a490-13827b0d142f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:23.339997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef9d9ffc-48a2-4e04-a490-13827b0d142f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:23.340437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef9d9ffc-48a2-4e04-a490-13827b0d142f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:23.341206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef9d9ffc-48a2-4e04-a490-13827b0d142f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:23.341658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef9d9ffc-48a2-4e04-a490-13827b0d142f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:23.357811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef9d9ffc-48a2-4e04-a490-13827b0d142f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:24.172293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d597749-e6fc-4bbe-9c64-bb524b9be84f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:24.210092 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8d597749-e6fc-4bbe-9c64-bb524b9be84f tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 0.974106 Oct 24 10:45:24.229872 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2222/4384] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:23 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:24.252573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-369d065e-4b6d-45d8-b564-8f7b2eb4d6a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:24.253552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-369d065e-4b6d-45d8-b564-8f7b2eb4d6a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:24.267853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-369d065e-4b6d-45d8-b564-8f7b2eb4d6a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:24.269083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-369d065e-4b6d-45d8-b564-8f7b2eb4d6a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:24.269713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-369d065e-4b6d-45d8-b564-8f7b2eb4d6a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:24.270607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-369d065e-4b6d-45d8-b564-8f7b2eb4d6a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:24.275462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-369d065e-4b6d-45d8-b564-8f7b2eb4d6a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:24.276131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-369d065e-4b6d-45d8-b564-8f7b2eb4d6a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:24.388274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ef9d9ffc-48a2-4e04-a490-13827b0d142f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:24.402229 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef9d9ffc-48a2-4e04-a490-13827b0d142f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1309 microversion: 2.1 time: 1.094955 Oct 24 10:45:24.426536 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2163/4385] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:23 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1309 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:24.434075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eb6b897d-329d-4ecf-bcd3-6a83d84e247f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:24.434867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eb6b897d-329d-4ecf-bcd3-6a83d84e247f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:24.443472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb6b897d-329d-4ecf-bcd3-6a83d84e247f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:24.444088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb6b897d-329d-4ecf-bcd3-6a83d84e247f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:24.444645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb6b897d-329d-4ecf-bcd3-6a83d84e247f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:24.445568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb6b897d-329d-4ecf-bcd3-6a83d84e247f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:24.446768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb6b897d-329d-4ecf-bcd3-6a83d84e247f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:24.447401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb6b897d-329d-4ecf-bcd3-6a83d84e247f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:24.496564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:24.838331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eb6b897d-329d-4ecf-bcd3-6a83d84e247f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:24.850087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eb6b897d-329d-4ecf-bcd3-6a83d84e247f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:24.851572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eb6b897d-329d-4ecf-bcd3-6a83d84e247f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:24.852755 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eb6b897d-329d-4ecf-bcd3-6a83d84e247f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1594 microversion: 2.42 time: 0.425054 Oct 24 10:45:24.862009 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2164/4386] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:24 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1594 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:24.870452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-749b79fb-fcdb-46fb-8a00-db96ef4a7384 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:24.871062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-749b79fb-fcdb-46fb-8a00-db96ef4a7384 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:24.891575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-749b79fb-fcdb-46fb-8a00-db96ef4a7384 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:24.892099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-749b79fb-fcdb-46fb-8a00-db96ef4a7384 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:24.893018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-749b79fb-fcdb-46fb-8a00-db96ef4a7384 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:24.893737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-749b79fb-fcdb-46fb-8a00-db96ef4a7384 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:24.894188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-749b79fb-fcdb-46fb-8a00-db96ef4a7384 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:24.894811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-749b79fb-fcdb-46fb-8a00-db96ef4a7384 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:25.385824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-369d065e-4b6d-45d8-b564-8f7b2eb4d6a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:25.395293 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-369d065e-4b6d-45d8-b564-8f7b2eb4d6a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1317 microversion: 2.1 time: 1.147627 Oct 24 10:45:25.425408 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2223/4387] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:24 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1317 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:25.433851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-216271c2-8575-4b46-9156-5828d0d83ce6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:25.434775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-216271c2-8575-4b46-9156-5828d0d83ce6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:25.478618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-216271c2-8575-4b46-9156-5828d0d83ce6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:25.479124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-216271c2-8575-4b46-9156-5828d0d83ce6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:25.479575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-216271c2-8575-4b46-9156-5828d0d83ce6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:25.480303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-216271c2-8575-4b46-9156-5828d0d83ce6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:25.480764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-216271c2-8575-4b46-9156-5828d0d83ce6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:25.481232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-216271c2-8575-4b46-9156-5828d0d83ce6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:25.556555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:26.043371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-749b79fb-fcdb-46fb-8a00-db96ef4a7384 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:26.060296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-749b79fb-fcdb-46fb-8a00-db96ef4a7384 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:26.065181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-749b79fb-fcdb-46fb-8a00-db96ef4a7384 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:26.067902 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-749b79fb-fcdb-46fb-8a00-db96ef4a7384 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 200 len: 1550 microversion: 2.21 time: 1.204595 Oct 24 10:45:26.088592 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2165/4388] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:24 2022] GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 1550 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:26.088592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-64b3aec3-a7c0-45ae-855d-16da0aae5efe tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:26.088592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-64b3aec3-a7c0-45ae-855d-16da0aae5efe tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:26.103003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64b3aec3-a7c0-45ae-855d-16da0aae5efe tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:26.103766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64b3aec3-a7c0-45ae-855d-16da0aae5efe tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:26.105292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64b3aec3-a7c0-45ae-855d-16da0aae5efe tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:26.106333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64b3aec3-a7c0-45ae-855d-16da0aae5efe tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:26.106965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64b3aec3-a7c0-45ae-855d-16da0aae5efe tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:26.107934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64b3aec3-a7c0-45ae-855d-16da0aae5efe tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:26.476562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-216271c2-8575-4b46-9156-5828d0d83ce6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:26.494123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-216271c2-8575-4b46-9156-5828d0d83ce6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:26.496283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-216271c2-8575-4b46-9156-5828d0d83ce6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:26.497768 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-216271c2-8575-4b46-9156-5828d0d83ce6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1810 microversion: 2.20 time: 1.070393 Oct 24 10:45:26.498340 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2224/4389] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:25 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1810 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:26.511137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-05a54257-120b-4644-8def-31c008d5f243 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:26.517423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-05a54257-120b-4644-8def-31c008d5f243 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:26.534726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05a54257-120b-4644-8def-31c008d5f243 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:26.537285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05a54257-120b-4644-8def-31c008d5f243 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:26.537955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05a54257-120b-4644-8def-31c008d5f243 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:26.538928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05a54257-120b-4644-8def-31c008d5f243 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:26.541797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05a54257-120b-4644-8def-31c008d5f243 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:26.543398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05a54257-120b-4644-8def-31c008d5f243 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:26.747428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-64b3aec3-a7c0-45ae-855d-16da0aae5efe tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:26.760468 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-64b3aec3-a7c0-45ae-855d-16da0aae5efe tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 0.677150 Oct 24 10:45:26.765179 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2166/4390] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:26 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:26.792421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9d64d80a-b319-4c2d-bf6f-e97437f0a98e tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:26.794601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9d64d80a-b319-4c2d-bf6f-e97437f0a98e tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:26.804437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d64d80a-b319-4c2d-bf6f-e97437f0a98e tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:26.804959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d64d80a-b319-4c2d-bf6f-e97437f0a98e tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:26.805402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d64d80a-b319-4c2d-bf6f-e97437f0a98e tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:26.806111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d64d80a-b319-4c2d-bf6f-e97437f0a98e tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:26.806853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d64d80a-b319-4c2d-bf6f-e97437f0a98e tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:26.807287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d64d80a-b319-4c2d-bf6f-e97437f0a98e tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:26.887725 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9d64d80a-b319-4c2d-bf6f-e97437f0a98e tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.117831 Oct 24 10:45:26.906964 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2167/4391] 10.222.0.50 () {58 vars in 1293 bytes} [Mon Oct 24 10:45:26 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a/os-server-password => generated 116 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:45:26.916361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d1b77e4d-67e1-4029-9235-1e5460c5efac tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:26.917046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d1b77e4d-67e1-4029-9235-1e5460c5efac tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:26.935992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1b77e4d-67e1-4029-9235-1e5460c5efac tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:26.936528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1b77e4d-67e1-4029-9235-1e5460c5efac tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:26.937073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1b77e4d-67e1-4029-9235-1e5460c5efac tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:26.937761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1b77e4d-67e1-4029-9235-1e5460c5efac tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:26.939274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1b77e4d-67e1-4029-9235-1e5460c5efac tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:26.943277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1b77e4d-67e1-4029-9235-1e5460c5efac tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:26.977932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:27.140925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d1b77e4d-67e1-4029-9235-1e5460c5efac tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:27.153176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d1b77e4d-67e1-4029-9235-1e5460c5efac tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:27.154642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d1b77e4d-67e1-4029-9235-1e5460c5efac tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:27.155807 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d1b77e4d-67e1-4029-9235-1e5460c5efac tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1594 microversion: 2.42 time: 0.247762 Oct 24 10:45:27.165511 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2168/4392] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:26 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1594 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:27.174477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7dc3e28c-3890-4da1-8ae8-f8b957c67156 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:27.174990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7dc3e28c-3890-4da1-8ae8-f8b957c67156 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:27.192965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dc3e28c-3890-4da1-8ae8-f8b957c67156 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:27.193422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dc3e28c-3890-4da1-8ae8-f8b957c67156 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:27.193786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dc3e28c-3890-4da1-8ae8-f8b957c67156 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:27.194521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dc3e28c-3890-4da1-8ae8-f8b957c67156 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:27.194986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dc3e28c-3890-4da1-8ae8-f8b957c67156 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:27.195424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7dc3e28c-3890-4da1-8ae8-f8b957c67156 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:27.260919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7dc3e28c-3890-4da1-8ae8-f8b957c67156 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:45:27.331982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-05a54257-120b-4644-8def-31c008d5f243 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:27.345565 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-05a54257-120b-4644-8def-31c008d5f243 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1309 microversion: 2.1 time: 0.841059 Oct 24 10:45:27.347487 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2225/4393] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:26 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1309 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:27.361650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-586300f2-ebb1-4459-a42d-f4b3386860cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:27.362973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-586300f2-ebb1-4459-a42d-f4b3386860cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:27.378062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-586300f2-ebb1-4459-a42d-f4b3386860cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:27.386748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-586300f2-ebb1-4459-a42d-f4b3386860cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:27.387290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-586300f2-ebb1-4459-a42d-f4b3386860cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:27.394612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-586300f2-ebb1-4459-a42d-f4b3386860cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:27.396340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-586300f2-ebb1-4459-a42d-f4b3386860cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:27.398747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-586300f2-ebb1-4459-a42d-f4b3386860cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:27.439729 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7dc3e28c-3890-4da1-8ae8-f8b957c67156 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 204 len: 0 microversion: 2.21 time: 0.272669 Oct 24 10:45:27.440716 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2169/4394] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:45:27 2022] DELETE /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:45:27.452919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-524d3884-4685-4717-af83-38754e3c121e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:27.454224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-524d3884-4685-4717-af83-38754e3c121e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:27.462001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-524d3884-4685-4717-af83-38754e3c121e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:27.462577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-524d3884-4685-4717-af83-38754e3c121e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:27.463097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-524d3884-4685-4717-af83-38754e3c121e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:27.463984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-524d3884-4685-4717-af83-38754e3c121e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:27.464519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-524d3884-4685-4717-af83-38754e3c121e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:27.465184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-524d3884-4685-4717-af83-38754e3c121e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:27.784583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:27.908139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-586300f2-ebb1-4459-a42d-f4b3386860cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:27.914813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=18 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:27.928687 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-586300f2-ebb1-4459-a42d-f4b3386860cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1317 microversion: 2.1 time: 0.578462 Oct 24 10:45:27.930182 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2226/4395] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:27 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1317 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:27.942138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-492fafe7-b94a-46c4-b0cb-d283fff35599 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:27.945818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-492fafe7-b94a-46c4-b0cb-d283fff35599 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:27.963871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-492fafe7-b94a-46c4-b0cb-d283fff35599 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:27.964741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-492fafe7-b94a-46c4-b0cb-d283fff35599 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:27.965436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-492fafe7-b94a-46c4-b0cb-d283fff35599 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:27.967131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-492fafe7-b94a-46c4-b0cb-d283fff35599 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:27.968073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-492fafe7-b94a-46c4-b0cb-d283fff35599 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:27.968945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-492fafe7-b94a-46c4-b0cb-d283fff35599 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:28.082960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-524d3884-4685-4717-af83-38754e3c121e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:28.092771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-524d3884-4685-4717-af83-38754e3c121e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:28.094418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-524d3884-4685-4717-af83-38754e3c121e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:28.096145 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-524d3884-4685-4717-af83-38754e3c121e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 200 len: 1556 microversion: 2.21 time: 0.649306 Oct 24 10:45:28.102007 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2170/4396] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:27 2022] GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 1556 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:28.112328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-15211d32-e43a-4c84-961d-cf03163e0b5b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:28.112975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-15211d32-e43a-4c84-961d-cf03163e0b5b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:28.132042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15211d32-e43a-4c84-961d-cf03163e0b5b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:28.132554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15211d32-e43a-4c84-961d-cf03163e0b5b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:28.133038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15211d32-e43a-4c84-961d-cf03163e0b5b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:28.134020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15211d32-e43a-4c84-961d-cf03163e0b5b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:28.134483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15211d32-e43a-4c84-961d-cf03163e0b5b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:28.134910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-15211d32-e43a-4c84-961d-cf03163e0b5b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:28.353551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-492fafe7-b94a-46c4-b0cb-d283fff35599 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:28.363285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-492fafe7-b94a-46c4-b0cb-d283fff35599 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:28.364904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-492fafe7-b94a-46c4-b0cb-d283fff35599 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:28.366233 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-492fafe7-b94a-46c4-b0cb-d283fff35599 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1810 microversion: 2.20 time: 0.431691 Oct 24 10:45:28.366908 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2227/4397] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:27 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1810 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:28.371797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c468c03c-8827-4d0e-8d09-1da35c8c0455 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:28.372571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c468c03c-8827-4d0e-8d09-1da35c8c0455 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:28.379065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c468c03c-8827-4d0e-8d09-1da35c8c0455 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:28.380496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c468c03c-8827-4d0e-8d09-1da35c8c0455 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:28.381081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c468c03c-8827-4d0e-8d09-1da35c8c0455 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:28.381896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c468c03c-8827-4d0e-8d09-1da35c8c0455 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:28.382473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c468c03c-8827-4d0e-8d09-1da35c8c0455 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:28.382996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c468c03c-8827-4d0e-8d09-1da35c8c0455 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:28.487687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c468c03c-8827-4d0e-8d09-1da35c8c0455 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:28.497939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c468c03c-8827-4d0e-8d09-1da35c8c0455 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:28.499705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c468c03c-8827-4d0e-8d09-1da35c8c0455 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:28.502001 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c468c03c-8827-4d0e-8d09-1da35c8c0455 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1594 microversion: 2.42 time: 0.133853 Oct 24 10:45:28.503021 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2228/4398] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:28 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1594 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:28.536751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-15211d32-e43a-4c84-961d-cf03163e0b5b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:28.558972 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-15211d32-e43a-4c84-961d-cf03163e0b5b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 0.461101 Oct 24 10:45:28.572901 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2171/4399] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:28 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:28.572901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6fbd1e7a-b7a7-40bc-8cad-b13ed535cdcf tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:28.572901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6fbd1e7a-b7a7-40bc-8cad-b13ed535cdcf tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:28.575033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fbd1e7a-b7a7-40bc-8cad-b13ed535cdcf tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:28.575528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fbd1e7a-b7a7-40bc-8cad-b13ed535cdcf tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:28.575964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fbd1e7a-b7a7-40bc-8cad-b13ed535cdcf tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:28.576667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fbd1e7a-b7a7-40bc-8cad-b13ed535cdcf tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:28.577158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fbd1e7a-b7a7-40bc-8cad-b13ed535cdcf tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:28.577587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6fbd1e7a-b7a7-40bc-8cad-b13ed535cdcf tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:28.647018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-92b0bc58-3189-40d6-a1fe-660184311c5d req-72204d6d-6cdc-4bd6-8787-8efc7ad7cf44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba574b8-fd7b-4914-b2e1-0ef7c7beb55d", "tag": "f3cf98a5-3ab6-4a6a-9fe2-d2836e5f960d"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:28.657771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-92b0bc58-3189-40d6-a1fe-660184311c5d req-72204d6d-6cdc-4bd6-8787-8efc7ad7cf44 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:28.658426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-92b0bc58-3189-40d6-a1fe-660184311c5d req-72204d6d-6cdc-4bd6-8787-8efc7ad7cf44 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:28.658870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-92b0bc58-3189-40d6-a1fe-660184311c5d req-72204d6d-6cdc-4bd6-8787-8efc7ad7cf44 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:28.672354 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-92b0bc58-3189-40d6-a1fe-660184311c5d req-72204d6d-6cdc-4bd6-8787-8efc7ad7cf44 service nova] Creating event network-changed:f3cf98a5-3ab6-4a6a-9fe2-d2836e5f960d for instance dba574b8-fd7b-4914-b2e1-0ef7c7beb55d on n-h1-858383-15 Oct 24 10:45:28.679623 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-92b0bc58-3189-40d6-a1fe-660184311c5d req-72204d6d-6cdc-4bd6-8787-8efc7ad7cf44 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175550 Oct 24 10:45:28.680544 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2229/4400] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:45:28.857232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6fbd1e7a-b7a7-40bc-8cad-b13ed535cdcf tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:28.865916 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6fbd1e7a-b7a7-40bc-8cad-b13ed535cdcf tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1309 microversion: 2.1 time: 0.303473 Oct 24 10:45:28.866495 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2172/4401] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:28 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1309 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:28.955360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-62b22a01-1534-4514-82f1-129a2955be4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:28.956669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-62b22a01-1534-4514-82f1-129a2955be4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:28.963904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-62b22a01-1534-4514-82f1-129a2955be4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:28.964733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-62b22a01-1534-4514-82f1-129a2955be4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:28.965428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-62b22a01-1534-4514-82f1-129a2955be4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:28.966418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-62b22a01-1534-4514-82f1-129a2955be4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:28.967089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-62b22a01-1534-4514-82f1-129a2955be4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:28.967728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-62b22a01-1534-4514-82f1-129a2955be4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:29.130894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-70ba022f-9f59-4599-b5fc-1d623f0fed9f tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:29.132406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-70ba022f-9f59-4599-b5fc-1d623f0fed9f tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:29.145070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70ba022f-9f59-4599-b5fc-1d623f0fed9f tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:29.146982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70ba022f-9f59-4599-b5fc-1d623f0fed9f tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:29.148692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70ba022f-9f59-4599-b5fc-1d623f0fed9f tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:29.149732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70ba022f-9f59-4599-b5fc-1d623f0fed9f tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:29.153586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70ba022f-9f59-4599-b5fc-1d623f0fed9f tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:29.154484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70ba022f-9f59-4599-b5fc-1d623f0fed9f tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:29.409951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-62b22a01-1534-4514-82f1-129a2955be4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:29.420635 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-62b22a01-1534-4514-82f1-129a2955be4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1317 microversion: 2.1 time: 0.470925 Oct 24 10:45:29.422333 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2230/4402] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:28 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:29.428503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6eaf5183-8af3-4be8-a66f-388f6e03f78a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:29.429393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6eaf5183-8af3-4be8-a66f-388f6e03f78a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:29.437365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6eaf5183-8af3-4be8-a66f-388f6e03f78a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:29.438672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6eaf5183-8af3-4be8-a66f-388f6e03f78a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:29.439282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6eaf5183-8af3-4be8-a66f-388f6e03f78a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:29.440156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6eaf5183-8af3-4be8-a66f-388f6e03f78a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:29.440779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6eaf5183-8af3-4be8-a66f-388f6e03f78a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:29.441241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6eaf5183-8af3-4be8-a66f-388f6e03f78a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:29.461919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:29.592326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-70ba022f-9f59-4599-b5fc-1d623f0fed9f tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:29.602038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-70ba022f-9f59-4599-b5fc-1d623f0fed9f tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:29.603832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-70ba022f-9f59-4599-b5fc-1d623f0fed9f tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:29.605249 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-70ba022f-9f59-4599-b5fc-1d623f0fed9f tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 200 len: 1556 microversion: 2.21 time: 0.478919 Oct 24 10:45:29.606069 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2173/4403] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:29 2022] GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 1556 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:45:29.612087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-18ba3101-1844-4f1d-99d8-f05185deb07f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:29.612696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-18ba3101-1844-4f1d-99d8-f05185deb07f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:29.624606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18ba3101-1844-4f1d-99d8-f05185deb07f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:29.625114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18ba3101-1844-4f1d-99d8-f05185deb07f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:29.625753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18ba3101-1844-4f1d-99d8-f05185deb07f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:29.626715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18ba3101-1844-4f1d-99d8-f05185deb07f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:29.627346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18ba3101-1844-4f1d-99d8-f05185deb07f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:29.628174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18ba3101-1844-4f1d-99d8-f05185deb07f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:30.271084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6eaf5183-8af3-4be8-a66f-388f6e03f78a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:30.283927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6eaf5183-8af3-4be8-a66f-388f6e03f78a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:30.285672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6eaf5183-8af3-4be8-a66f-388f6e03f78a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:30.287086 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6eaf5183-8af3-4be8-a66f-388f6e03f78a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1810 microversion: 2.20 time: 0.863392 Oct 24 10:45:30.288139 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2231/4404] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:29 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1810 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:30.300308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-49e1705d-da24-4b55-b88a-423b6ee1c4ae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:30.303063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-49e1705d-da24-4b55-b88a-423b6ee1c4ae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:30.317979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49e1705d-da24-4b55-b88a-423b6ee1c4ae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:30.318794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49e1705d-da24-4b55-b88a-423b6ee1c4ae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:30.320693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49e1705d-da24-4b55-b88a-423b6ee1c4ae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:30.321989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49e1705d-da24-4b55-b88a-423b6ee1c4ae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:30.322614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49e1705d-da24-4b55-b88a-423b6ee1c4ae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:30.323669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49e1705d-da24-4b55-b88a-423b6ee1c4ae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:30.530740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-18ba3101-1844-4f1d-99d8-f05185deb07f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:30.542869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-18ba3101-1844-4f1d-99d8-f05185deb07f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:30.544467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-18ba3101-1844-4f1d-99d8-f05185deb07f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:30.545785 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-18ba3101-1844-4f1d-99d8-f05185deb07f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1662 microversion: 2.42 time: 0.938598 Oct 24 10:45:30.546350 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2174/4405] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:29 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1662 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:30.552250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-27736687-1a5c-4863-9ef0-a7473ca294ea tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:30.552879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-27736687-1a5c-4863-9ef0-a7473ca294ea tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:30.558936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27736687-1a5c-4863-9ef0-a7473ca294ea tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:30.559646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27736687-1a5c-4863-9ef0-a7473ca294ea tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:30.560422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27736687-1a5c-4863-9ef0-a7473ca294ea tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:30.561339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27736687-1a5c-4863-9ef0-a7473ca294ea tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:30.561982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27736687-1a5c-4863-9ef0-a7473ca294ea tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:30.569178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27736687-1a5c-4863-9ef0-a7473ca294ea tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:30.661321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-49e1705d-da24-4b55-b88a-423b6ee1c4ae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:30.669447 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-49e1705d-da24-4b55-b88a-423b6ee1c4ae tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 0.378117 Oct 24 10:45:30.677072 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2232/4406] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:30 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:30.677072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-108c4c07-1322-401e-bce9-8194ff6ad515 req-0ea0c1a4-a422-40b9-8fb0-9a61621fc468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9685b83-752b-43b7-9f66-ea6ccc88917f", "name": "network-vif-deleted", "tag": "8f930413-3b9b-4c52-9f03-c302ddd8931d"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:30.687443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-108c4c07-1322-401e-bce9-8194ff6ad515 req-0ea0c1a4-a422-40b9-8fb0-9a61621fc468 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:30.687961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-108c4c07-1322-401e-bce9-8194ff6ad515 req-0ea0c1a4-a422-40b9-8fb0-9a61621fc468 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:30.689298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-108c4c07-1322-401e-bce9-8194ff6ad515 req-0ea0c1a4-a422-40b9-8fb0-9a61621fc468 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:30.700659 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-108c4c07-1322-401e-bce9-8194ff6ad515 req-0ea0c1a4-a422-40b9-8fb0-9a61621fc468 service nova] Creating event network-vif-deleted:8f930413-3b9b-4c52-9f03-c302ddd8931d for instance d9685b83-752b-43b7-9f66-ea6ccc88917f on n-h1-858383-15 Oct 24 10:45:30.705755 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-108c4c07-1322-401e-bce9-8194ff6ad515 req-0ea0c1a4-a422-40b9-8fb0-9a61621fc468 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033978 Oct 24 10:45:30.706358 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2233/4407] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:45:30.711375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-15066891-4288-45fe-a0ad-666a10f6a64d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:30.712081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-15066891-4288-45fe-a0ad-666a10f6a64d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:30.718278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15066891-4288-45fe-a0ad-666a10f6a64d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:30.718772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15066891-4288-45fe-a0ad-666a10f6a64d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:30.719223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15066891-4288-45fe-a0ad-666a10f6a64d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:30.719930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15066891-4288-45fe-a0ad-666a10f6a64d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:30.720391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15066891-4288-45fe-a0ad-666a10f6a64d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:30.720821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15066891-4288-45fe-a0ad-666a10f6a64d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:30.843268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-27736687-1a5c-4863-9ef0-a7473ca294ea tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:30.851952 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-27736687-1a5c-4863-9ef0-a7473ca294ea tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1309 microversion: 2.1 time: 0.304547 Oct 24 10:45:30.852728 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2175/4408] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:30 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1309 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:30.857058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b300aa47-c48c-431e-91f0-751e1cb60b4e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:30.857664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b300aa47-c48c-431e-91f0-751e1cb60b4e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:30.864578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b300aa47-c48c-431e-91f0-751e1cb60b4e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:30.865098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b300aa47-c48c-431e-91f0-751e1cb60b4e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:30.866768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b300aa47-c48c-431e-91f0-751e1cb60b4e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:30.867554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b300aa47-c48c-431e-91f0-751e1cb60b4e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:30.868257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b300aa47-c48c-431e-91f0-751e1cb60b4e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:30.868759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b300aa47-c48c-431e-91f0-751e1cb60b4e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:30.902132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b300aa47-c48c-431e-91f0-751e1cb60b4e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:30.902629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b300aa47-c48c-431e-91f0-751e1cb60b4e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:30.903080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b300aa47-c48c-431e-91f0-751e1cb60b4e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:30.903535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-b300aa47-c48c-431e-91f0-751e1cb60b4e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lazy-loading 'fault' on Instance uuid d9685b83-752b-43b7-9f66-ea6ccc88917f {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:45:30.964980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-15066891-4288-45fe-a0ad-666a10f6a64d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:30.973333 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-15066891-4288-45fe-a0ad-666a10f6a64d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1317 microversion: 2.1 time: 0.265795 Oct 24 10:45:30.974126 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2234/4409] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:30 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:30.983950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b300aa47-c48c-431e-91f0-751e1cb60b4e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:30.992516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b300aa47-c48c-431e-91f0-751e1cb60b4e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:30.994164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b300aa47-c48c-431e-91f0-751e1cb60b4e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:30.995405 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b300aa47-c48c-431e-91f0-751e1cb60b4e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 200 len: 1347 microversion: 2.21 time: 0.141927 Oct 24 10:45:30.996039 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2176/4410] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:30 2022] GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 1347 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:31.315336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a30fb3c7-860a-4aea-afad-d109d9bed93c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:31.315950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a30fb3c7-860a-4aea-afad-d109d9bed93c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:31.321998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a30fb3c7-860a-4aea-afad-d109d9bed93c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:31.322516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a30fb3c7-860a-4aea-afad-d109d9bed93c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:31.322956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a30fb3c7-860a-4aea-afad-d109d9bed93c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:31.323662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a30fb3c7-860a-4aea-afad-d109d9bed93c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:31.324120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a30fb3c7-860a-4aea-afad-d109d9bed93c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:31.324547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a30fb3c7-860a-4aea-afad-d109d9bed93c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:31.459097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a30fb3c7-860a-4aea-afad-d109d9bed93c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:31.467767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a30fb3c7-860a-4aea-afad-d109d9bed93c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:31.469841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a30fb3c7-860a-4aea-afad-d109d9bed93c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:31.471236 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a30fb3c7-860a-4aea-afad-d109d9bed93c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1810 microversion: 2.20 time: 0.160882 Oct 24 10:45:31.474095 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2235/4411] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:31 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:31.573178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-50428cca-be28-49c4-af30-ae0507aba1a8 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:31.573908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-50428cca-be28-49c4-af30-ae0507aba1a8 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:31.580927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50428cca-be28-49c4-af30-ae0507aba1a8 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:31.581485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50428cca-be28-49c4-af30-ae0507aba1a8 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:31.582005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50428cca-be28-49c4-af30-ae0507aba1a8 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:31.582781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50428cca-be28-49c4-af30-ae0507aba1a8 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:31.583316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50428cca-be28-49c4-af30-ae0507aba1a8 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:31.583819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50428cca-be28-49c4-af30-ae0507aba1a8 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:31.695054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6932ea26-7c8a-432c-b41d-41c6d01a8409 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:31.696587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6932ea26-7c8a-432c-b41d-41c6d01a8409 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:31.705034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6932ea26-7c8a-432c-b41d-41c6d01a8409 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:31.705793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6932ea26-7c8a-432c-b41d-41c6d01a8409 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:31.706358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6932ea26-7c8a-432c-b41d-41c6d01a8409 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:31.707222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6932ea26-7c8a-432c-b41d-41c6d01a8409 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:31.707833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6932ea26-7c8a-432c-b41d-41c6d01a8409 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:31.709114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6932ea26-7c8a-432c-b41d-41c6d01a8409 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:31.740322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-50428cca-be28-49c4-af30-ae0507aba1a8 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:31.754320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-50428cca-be28-49c4-af30-ae0507aba1a8 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:31.759152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-50428cca-be28-49c4-af30-ae0507aba1a8 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:31.760421 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-50428cca-be28-49c4-af30-ae0507aba1a8 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1662 microversion: 2.42 time: 0.191286 Oct 24 10:45:31.762316 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2177/4412] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:31 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1662 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:31.876411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-779e7132-b42e-47fe-91e5-ceef7f822cbe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:31.877304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-779e7132-b42e-47fe-91e5-ceef7f822cbe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:31.883604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-779e7132-b42e-47fe-91e5-ceef7f822cbe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:31.884374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-779e7132-b42e-47fe-91e5-ceef7f822cbe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:31.885054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-779e7132-b42e-47fe-91e5-ceef7f822cbe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:31.886200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-779e7132-b42e-47fe-91e5-ceef7f822cbe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:31.886837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-779e7132-b42e-47fe-91e5-ceef7f822cbe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:31.887449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-779e7132-b42e-47fe-91e5-ceef7f822cbe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:31.902791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6932ea26-7c8a-432c-b41d-41c6d01a8409 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:31.913123 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6932ea26-7c8a-432c-b41d-41c6d01a8409 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 0.222154 Oct 24 10:45:31.929990 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2236/4413] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:31 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:31.996256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8b3aa7f3-8db0-419b-914e-bca2af7da125 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:31.996693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8b3aa7f3-8db0-419b-914e-bca2af7da125 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:32.011832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b3aa7f3-8db0-419b-914e-bca2af7da125 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:32.012422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b3aa7f3-8db0-419b-914e-bca2af7da125 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:32.012969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b3aa7f3-8db0-419b-914e-bca2af7da125 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:32.013745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b3aa7f3-8db0-419b-914e-bca2af7da125 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:32.014292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b3aa7f3-8db0-419b-914e-bca2af7da125 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:32.017577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b3aa7f3-8db0-419b-914e-bca2af7da125 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:32.069551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-779e7132-b42e-47fe-91e5-ceef7f822cbe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:32.080853 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-779e7132-b42e-47fe-91e5-ceef7f822cbe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1309 microversion: 2.1 time: 0.207790 Oct 24 10:45:32.082526 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2178/4414] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:31 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1309 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:32.088565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9eb87c81-d43e-4e86-a05b-f570d559e126 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:32.089697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9eb87c81-d43e-4e86-a05b-f570d559e126 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:32.098414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eb87c81-d43e-4e86-a05b-f570d559e126 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:32.099202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eb87c81-d43e-4e86-a05b-f570d559e126 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:32.099983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eb87c81-d43e-4e86-a05b-f570d559e126 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:32.101238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eb87c81-d43e-4e86-a05b-f570d559e126 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:32.101886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eb87c81-d43e-4e86-a05b-f570d559e126 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:32.102548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eb87c81-d43e-4e86-a05b-f570d559e126 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:32.142672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eb87c81-d43e-4e86-a05b-f570d559e126 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:32.143630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eb87c81-d43e-4e86-a05b-f570d559e126 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:32.144464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eb87c81-d43e-4e86-a05b-f570d559e126 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:32.145199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-9eb87c81-d43e-4e86-a05b-f570d559e126 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lazy-loading 'fault' on Instance uuid d9685b83-752b-43b7-9f66-ea6ccc88917f {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:45:32.212135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9eb87c81-d43e-4e86-a05b-f570d559e126 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:32.227906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9eb87c81-d43e-4e86-a05b-f570d559e126 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:32.230345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9eb87c81-d43e-4e86-a05b-f570d559e126 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:32.231969 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9eb87c81-d43e-4e86-a05b-f570d559e126 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 200 len: 1347 microversion: 2.21 time: 0.148128 Oct 24 10:45:32.232756 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2179/4415] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:32 2022] GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 1347 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:32.276063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8b3aa7f3-8db0-419b-914e-bca2af7da125 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:32.292270 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8b3aa7f3-8db0-419b-914e-bca2af7da125 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1317 microversion: 2.1 time: 0.300140 Oct 24 10:45:32.299039 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2237/4416] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:31 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:32.496533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-168493d4-e32c-4761-b102-13291d1d0915 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:32.497189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-168493d4-e32c-4761-b102-13291d1d0915 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:32.507115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-168493d4-e32c-4761-b102-13291d1d0915 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:32.507933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-168493d4-e32c-4761-b102-13291d1d0915 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:32.508661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-168493d4-e32c-4761-b102-13291d1d0915 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:32.509424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-168493d4-e32c-4761-b102-13291d1d0915 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:32.509894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-168493d4-e32c-4761-b102-13291d1d0915 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:32.510349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-168493d4-e32c-4761-b102-13291d1d0915 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:32.746625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-168493d4-e32c-4761-b102-13291d1d0915 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:32.759549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-168493d4-e32c-4761-b102-13291d1d0915 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:32.761117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-168493d4-e32c-4761-b102-13291d1d0915 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:32.762605 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-168493d4-e32c-4761-b102-13291d1d0915 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1810 microversion: 2.20 time: 0.269920 Oct 24 10:45:32.763382 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2180/4417] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:32 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1810 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:32.787919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b8a5dbce-f66e-4df2-a4d5-228b28a93963 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:32.789204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b8a5dbce-f66e-4df2-a4d5-228b28a93963 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:32.796410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8a5dbce-f66e-4df2-a4d5-228b28a93963 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:32.797206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8a5dbce-f66e-4df2-a4d5-228b28a93963 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:32.797845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8a5dbce-f66e-4df2-a4d5-228b28a93963 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:32.798837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8a5dbce-f66e-4df2-a4d5-228b28a93963 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:32.799453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8a5dbce-f66e-4df2-a4d5-228b28a93963 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:32.800036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8a5dbce-f66e-4df2-a4d5-228b28a93963 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:32.939574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3af4d062-8d9a-4d30-a0b3-03dfd800d7f0 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:32.940625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3af4d062-8d9a-4d30-a0b3-03dfd800d7f0 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:32.949150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3af4d062-8d9a-4d30-a0b3-03dfd800d7f0 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:32.949906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3af4d062-8d9a-4d30-a0b3-03dfd800d7f0 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:32.950595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3af4d062-8d9a-4d30-a0b3-03dfd800d7f0 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:32.952090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3af4d062-8d9a-4d30-a0b3-03dfd800d7f0 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:32.952986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3af4d062-8d9a-4d30-a0b3-03dfd800d7f0 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:32.954414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3af4d062-8d9a-4d30-a0b3-03dfd800d7f0 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:32.983207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b8a5dbce-f66e-4df2-a4d5-228b28a93963 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:33.004126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b8a5dbce-f66e-4df2-a4d5-228b28a93963 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:33.005662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b8a5dbce-f66e-4df2-a4d5-228b28a93963 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:33.012628 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b8a5dbce-f66e-4df2-a4d5-228b28a93963 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1662 microversion: 2.42 time: 0.222980 Oct 24 10:45:33.018562 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2238/4418] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:32 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1662 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:33.111042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f2219489-d8fd-4364-bb9c-5e9d2b9ed6d9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:33.111944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f2219489-d8fd-4364-bb9c-5e9d2b9ed6d9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:33.157647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2219489-d8fd-4364-bb9c-5e9d2b9ed6d9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:33.161876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2219489-d8fd-4364-bb9c-5e9d2b9ed6d9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:33.161876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2219489-d8fd-4364-bb9c-5e9d2b9ed6d9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:33.167887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2219489-d8fd-4364-bb9c-5e9d2b9ed6d9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:33.167887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2219489-d8fd-4364-bb9c-5e9d2b9ed6d9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:33.171992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2219489-d8fd-4364-bb9c-5e9d2b9ed6d9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:33.314351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3af4d062-8d9a-4d30-a0b3-03dfd800d7f0 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:33.320586 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3af4d062-8d9a-4d30-a0b3-03dfd800d7f0 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 0.384992 Oct 24 10:45:33.321232 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2181/4419] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:32 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:45:33.331468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5d5cd4aa-71c6-47f1-96d1-ab567e81be04 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:33.332226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5d5cd4aa-71c6-47f1-96d1-ab567e81be04 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:33.351771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d5cd4aa-71c6-47f1-96d1-ab567e81be04 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:33.352272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d5cd4aa-71c6-47f1-96d1-ab567e81be04 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:33.352717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d5cd4aa-71c6-47f1-96d1-ab567e81be04 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:33.365709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d5cd4aa-71c6-47f1-96d1-ab567e81be04 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:33.366383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d5cd4aa-71c6-47f1-96d1-ab567e81be04 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:33.366739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d5cd4aa-71c6-47f1-96d1-ab567e81be04 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:33.400753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:33.415390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d5cd4aa-71c6-47f1-96d1-ab567e81be04 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:33.416143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d5cd4aa-71c6-47f1-96d1-ab567e81be04 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:33.416737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d5cd4aa-71c6-47f1-96d1-ab567e81be04 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:33.417364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-5d5cd4aa-71c6-47f1-96d1-ab567e81be04 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lazy-loading 'fault' on Instance uuid d9685b83-752b-43b7-9f66-ea6ccc88917f {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:45:33.568401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5d5cd4aa-71c6-47f1-96d1-ab567e81be04 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:33.578687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5d5cd4aa-71c6-47f1-96d1-ab567e81be04 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:33.580952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5d5cd4aa-71c6-47f1-96d1-ab567e81be04 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5902085e2f564affb70251d4e2fd1df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0e82e8116e4ace82fe3da9c52f793b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:33.581884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f2219489-d8fd-4364-bb9c-5e9d2b9ed6d9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:33.584390 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5d5cd4aa-71c6-47f1-96d1-ab567e81be04 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 200 len: 1347 microversion: 2.21 time: 0.262211 Oct 24 10:45:33.585568 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2182/4420] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:33 2022] GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 1347 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:33.591042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-104dd5d3-edfe-4018-848f-0bfd2ea064f9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:33.591937 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f2219489-d8fd-4364-bb9c-5e9d2b9ed6d9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1309 microversion: 2.1 time: 0.485562 Oct 24 10:45:33.592517 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2239/4421] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:33 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1309 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:33.606976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-104dd5d3-edfe-4018-848f-0bfd2ea064f9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:33.645045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-104dd5d3-edfe-4018-848f-0bfd2ea064f9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:33.646821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-104dd5d3-edfe-4018-848f-0bfd2ea064f9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:33.647971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-104dd5d3-edfe-4018-848f-0bfd2ea064f9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:33.649301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-104dd5d3-edfe-4018-848f-0bfd2ea064f9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:33.650004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-104dd5d3-edfe-4018-848f-0bfd2ea064f9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:33.651864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-104dd5d3-edfe-4018-848f-0bfd2ea064f9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:33.790252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3cff3398-3573-4c5e-b47c-6261fa844edb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:33.791039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3cff3398-3573-4c5e-b47c-6261fa844edb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:33.802457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cff3398-3573-4c5e-b47c-6261fa844edb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:33.802938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cff3398-3573-4c5e-b47c-6261fa844edb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:33.803372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cff3398-3573-4c5e-b47c-6261fa844edb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:33.804088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cff3398-3573-4c5e-b47c-6261fa844edb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:33.808166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cff3398-3573-4c5e-b47c-6261fa844edb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:33.808686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cff3398-3573-4c5e-b47c-6261fa844edb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:34.086240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-104dd5d3-edfe-4018-848f-0bfd2ea064f9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:34.103285 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-104dd5d3-edfe-4018-848f-0bfd2ea064f9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1317 microversion: 2.1 time: 0.511909 Oct 24 10:45:34.104124 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2183/4422] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:33 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1317 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:34.121657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-54bb1247-f07b-4bc2-9838-21c145776a97 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:34.122285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-54bb1247-f07b-4bc2-9838-21c145776a97 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:34.144430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54bb1247-f07b-4bc2-9838-21c145776a97 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:34.152619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54bb1247-f07b-4bc2-9838-21c145776a97 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:34.153496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54bb1247-f07b-4bc2-9838-21c145776a97 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:34.154387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54bb1247-f07b-4bc2-9838-21c145776a97 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:34.154864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54bb1247-f07b-4bc2-9838-21c145776a97 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:34.155661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54bb1247-f07b-4bc2-9838-21c145776a97 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:34.363306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3cff3398-3573-4c5e-b47c-6261fa844edb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:34.382834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3cff3398-3573-4c5e-b47c-6261fa844edb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:34.384566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3cff3398-3573-4c5e-b47c-6261fa844edb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:34.385793 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3cff3398-3573-4c5e-b47c-6261fa844edb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1810 microversion: 2.20 time: 0.600416 Oct 24 10:45:34.386689 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2240/4423] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:33 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1810 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:34.392166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f64c4a42-ea17-475c-8390-f86b71b4f8af tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:34.404377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f64c4a42-ea17-475c-8390-f86b71b4f8af tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:34.418581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f64c4a42-ea17-475c-8390-f86b71b4f8af tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:34.419316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f64c4a42-ea17-475c-8390-f86b71b4f8af tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:34.419958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f64c4a42-ea17-475c-8390-f86b71b4f8af tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:34.420953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f64c4a42-ea17-475c-8390-f86b71b4f8af tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:34.421835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f64c4a42-ea17-475c-8390-f86b71b4f8af tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:34.422731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f64c4a42-ea17-475c-8390-f86b71b4f8af tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:35.319923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-54bb1247-f07b-4bc2-9838-21c145776a97 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:35.334461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-54bb1247-f07b-4bc2-9838-21c145776a97 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:35.335911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-54bb1247-f07b-4bc2-9838-21c145776a97 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:35.337110 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-54bb1247-f07b-4bc2-9838-21c145776a97 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1709 microversion: 2.42 time: 1.230665 Oct 24 10:45:35.341172 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2184/4424] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:34 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1709 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:35.351717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-2883993b-1735-477b-abbc-cc8f54073fc0 req-186b160d-69aa-44ad-9207-70989129711a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3cd53e-83ed-45b4-82ac-882fb65759f9", "name": "network-vif-plugged", "status": "completed", "tag": "bfb45541-45c3-4e57-959c-17ae32c17e06"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:35.370431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2883993b-1735-477b-abbc-cc8f54073fc0 req-186b160d-69aa-44ad-9207-70989129711a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:35.370909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2883993b-1735-477b-abbc-cc8f54073fc0 req-186b160d-69aa-44ad-9207-70989129711a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:35.371374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2883993b-1735-477b-abbc-cc8f54073fc0 req-186b160d-69aa-44ad-9207-70989129711a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:35.396653 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-2883993b-1735-477b-abbc-cc8f54073fc0 req-186b160d-69aa-44ad-9207-70989129711a service nova] Creating event network-vif-plugged:bfb45541-45c3-4e57-959c-17ae32c17e06 for instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 on n-h2-858383-15 Oct 24 10:45:35.402331 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-2883993b-1735-477b-abbc-cc8f54073fc0 req-186b160d-69aa-44ad-9207-70989129711a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059688 Oct 24 10:45:35.403637 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2185/4425] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:45:35.411736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b9966727-914a-4f2a-9145-07b8855bcf20 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:35.412447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b9966727-914a-4f2a-9145-07b8855bcf20 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:35.418727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9966727-914a-4f2a-9145-07b8855bcf20 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:35.419433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9966727-914a-4f2a-9145-07b8855bcf20 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:35.420038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9966727-914a-4f2a-9145-07b8855bcf20 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:35.420933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9966727-914a-4f2a-9145-07b8855bcf20 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:35.421543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9966727-914a-4f2a-9145-07b8855bcf20 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:35.422126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9966727-914a-4f2a-9145-07b8855bcf20 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:35.439573 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-b9966727-914a-4f2a-9145-07b8855bcf20 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] HTTP exception thrown: Instance d9685b83-752b-43b7-9f66-ea6ccc88917f could not be found. Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b9966727-914a-4f2a-9145-07b8855bcf20 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Request method failure captured: Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f HTTP/1.1 Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmypqE25kYnWeVlI5tdRYb8z-NOTm6EIT4Zk31drmH_6ThJAGqDiIuq9FdXWY6zEfCHAoE-dJU4SeJcg1ok5e9W3aSpB34CBtG0-_t170MSQQKmle5DDtd3RBRa87siEbfe2sapptl7yucML9xDENp9jogmCAzQsRn9Gea5MVtcGgbg Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.21 Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: bc0e82e8116e4ace82fe3da9c52f793b Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-InstanceActionsV221TestJSON-814704940 Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bc0e82e8116e4ace82fe3da9c52f793b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bc0e82e8116e4ace82fe3da9c52f793b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bc0e82e8116e4ace82fe3da9c52f793b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bc0e82e8116e4ace82fe3da9c52f793b", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-InstanceActionsV221TestJSON-814704940 Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: bc0e82e8116e4ace82fe3da9c52f793b Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-814704940 Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-InstanceActionsV221TestJSON-814704940-project Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5902085e2f564affb70251d4e2fd1df0 Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-InstanceActionsV221TestJSON-814704940-project Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance d9685b83-752b-43b7-9f66-ea6ccc88917f could not be found. Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'd9685b83-752b-43b7-9f66-ea6ccc88917f'} Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9685b83-752b-43b7-9f66-ea6ccc88917f could not be found. Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9685b83-752b-43b7-9f66-ea6ccc88917f could not be found. Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:45:35.442083 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:45:35.446829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:45:35.446829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:35.446829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:45:35.446829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:45:35.446829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:45:35.446829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:45:35.446829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9685b83-752b-43b7-9f66-ea6ccc88917f could not be found. Oct 24 10:45:35.446829 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:45:35.448492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b9966727-914a-4f2a-9145-07b8855bcf20 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Returning 404 to user: Instance d9685b83-752b-43b7-9f66-ea6ccc88917f could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:45:35.450039 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b9966727-914a-4f2a-9145-07b8855bcf20 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 404 len: 111 microversion: 2.21 time: 0.045162 Oct 24 10:45:35.450765 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2186/4426] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:35 2022] GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:45:35.456789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9e5fba1d-0531-46d1-aeb8-d56e2ee44c1c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:35.457663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9e5fba1d-0531-46d1-aeb8-d56e2ee44c1c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:35.466157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:35.467808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f64c4a42-ea17-475c-8390-f86b71b4f8af tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:35.469066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e5fba1d-0531-46d1-aeb8-d56e2ee44c1c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:35.470284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e5fba1d-0531-46d1-aeb8-d56e2ee44c1c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:35.471121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e5fba1d-0531-46d1-aeb8-d56e2ee44c1c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:35.472086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e5fba1d-0531-46d1-aeb8-d56e2ee44c1c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:35.472724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e5fba1d-0531-46d1-aeb8-d56e2ee44c1c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:35.473401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e5fba1d-0531-46d1-aeb8-d56e2ee44c1c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:35.518108 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f64c4a42-ea17-475c-8390-f86b71b4f8af tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1486 microversion: 2.1 time: 1.111783 Oct 24 10:45:35.524353 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2241/4427] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:34 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1486 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:35.551346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-59dfa2bf-4b2e-4a13-ba23-4fe783a7460e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:35.563453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-59dfa2bf-4b2e-4a13-ba23-4fe783a7460e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:35.586456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-59dfa2bf-4b2e-4a13-ba23-4fe783a7460e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:35.588277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-59dfa2bf-4b2e-4a13-ba23-4fe783a7460e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:35.591882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-59dfa2bf-4b2e-4a13-ba23-4fe783a7460e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:35.592919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-59dfa2bf-4b2e-4a13-ba23-4fe783a7460e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:35.593671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-59dfa2bf-4b2e-4a13-ba23-4fe783a7460e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:35.594524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-59dfa2bf-4b2e-4a13-ba23-4fe783a7460e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:35.917836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9e5fba1d-0531-46d1-aeb8-d56e2ee44c1c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:35.929606 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9e5fba1d-0531-46d1-aeb8-d56e2ee44c1c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1309 microversion: 2.1 time: 0.477423 Oct 24 10:45:35.941905 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2187/4428] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:35 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1309 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:35.952860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b65c4846-49b7-4e58-ae18-96bada7c739a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:35.954409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b65c4846-49b7-4e58-ae18-96bada7c739a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:35.961131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b65c4846-49b7-4e58-ae18-96bada7c739a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:35.962214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b65c4846-49b7-4e58-ae18-96bada7c739a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:35.962830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b65c4846-49b7-4e58-ae18-96bada7c739a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:35.963748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b65c4846-49b7-4e58-ae18-96bada7c739a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:35.964393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b65c4846-49b7-4e58-ae18-96bada7c739a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:35.965057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b65c4846-49b7-4e58-ae18-96bada7c739a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:35.972422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-59dfa2bf-4b2e-4a13-ba23-4fe783a7460e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:35.997220 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-59dfa2bf-4b2e-4a13-ba23-4fe783a7460e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1317 microversion: 2.1 time: 0.471428 Oct 24 10:45:36.005163 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2242/4429] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:35 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:36.023234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-20a9cd02-c67a-496b-a923-53e114998b61 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '.version_select at 0x7f04d4df3f70>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:36.033640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-20a9cd02-c67a-496b-a923-53e114998b61 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:36.043212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20a9cd02-c67a-496b-a923-53e114998b61 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:36.045383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20a9cd02-c67a-496b-a923-53e114998b61 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:36.046072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20a9cd02-c67a-496b-a923-53e114998b61 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:36.048716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20a9cd02-c67a-496b-a923-53e114998b61 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:36.049410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20a9cd02-c67a-496b-a923-53e114998b61 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:36.049977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20a9cd02-c67a-496b-a923-53e114998b61 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:36.217718 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-20a9cd02-c67a-496b-a923-53e114998b61 tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.211400 Oct 24 10:45:36.218324 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2243/4430] 10.222.0.50 () {60 vars in 1337 bytes} [Mon Oct 24 10:45:36 2022] GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f/os-instance-actions => generated 611 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:45:36.234374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f4267506-632b-4391-8de6-baea79926985 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:36.235504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f4267506-632b-4391-8de6-baea79926985 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:36.252740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4267506-632b-4391-8de6-baea79926985 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:36.255399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4267506-632b-4391-8de6-baea79926985 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:36.256135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4267506-632b-4391-8de6-baea79926985 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:36.258762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4267506-632b-4391-8de6-baea79926985 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:36.260735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4267506-632b-4391-8de6-baea79926985 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:36.261235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4267506-632b-4391-8de6-baea79926985 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:36.268115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b65c4846-49b7-4e58-ae18-96bada7c739a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:36.286586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b65c4846-49b7-4e58-ae18-96bada7c739a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:36.291056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b65c4846-49b7-4e58-ae18-96bada7c739a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:36.300787 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b65c4846-49b7-4e58-ae18-96bada7c739a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1810 microversion: 2.20 time: 0.357026 Oct 24 10:45:36.301873 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2188/4431] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:35 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1810 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:36.310356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31d4f1f7-bbec-45a1-8577-dbab84eb8fcd tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:36.311225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31d4f1f7-bbec-45a1-8577-dbab84eb8fcd tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:36.323110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31d4f1f7-bbec-45a1-8577-dbab84eb8fcd tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:36.324412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31d4f1f7-bbec-45a1-8577-dbab84eb8fcd tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:36.325137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31d4f1f7-bbec-45a1-8577-dbab84eb8fcd tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:36.326422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31d4f1f7-bbec-45a1-8577-dbab84eb8fcd tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:36.327121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31d4f1f7-bbec-45a1-8577-dbab84eb8fcd tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:36.327785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31d4f1f7-bbec-45a1-8577-dbab84eb8fcd tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:36.364227 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-31d4f1f7-bbec-45a1-8577-dbab84eb8fcd tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] HTTP exception thrown: Instance d9685b83-752b-43b7-9f66-ea6ccc88917f could not be found. Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31d4f1f7-bbec-45a1-8577-dbab84eb8fcd tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Request method failure captured: Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f HTTP/1.1 Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmypqE25kYnWeVlI5tdRYb8z-NOTm6EIT4Zk31drmH_6ThJAGqDiIuq9FdXWY6zEfCHAoE-dJU4SeJcg1ok5e9W3aSpB34CBtG0-_t170MSQQKmle5DDtd3RBRa87siEbfe2sapptl7yucML9xDENp9jogmCAzQsRn9Gea5MVtcGgbg Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.21 Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: bc0e82e8116e4ace82fe3da9c52f793b Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-InstanceActionsV221TestJSON-814704940 Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bc0e82e8116e4ace82fe3da9c52f793b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bc0e82e8116e4ace82fe3da9c52f793b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bc0e82e8116e4ace82fe3da9c52f793b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bc0e82e8116e4ace82fe3da9c52f793b", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-InstanceActionsV221TestJSON-814704940 Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: bc0e82e8116e4ace82fe3da9c52f793b Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-814704940 Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-InstanceActionsV221TestJSON-814704940-project Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 5902085e2f564affb70251d4e2fd1df0 Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-InstanceActionsV221TestJSON-814704940-project Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance d9685b83-752b-43b7-9f66-ea6ccc88917f could not be found. Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'd9685b83-752b-43b7-9f66-ea6ccc88917f'} Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9685b83-752b-43b7-9f66-ea6ccc88917f could not be found. Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:45:36.366398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:45:36.370301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9685b83-752b-43b7-9f66-ea6ccc88917f could not be found. Oct 24 10:45:36.370301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:45:36.370301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:45:36.370301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:45:36.370301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:36.370301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:45:36.370301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:45:36.370301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:45:36.370301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:45:36.370301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9685b83-752b-43b7-9f66-ea6ccc88917f could not be found. Oct 24 10:45:36.370301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:45:36.374795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31d4f1f7-bbec-45a1-8577-dbab84eb8fcd tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Returning 404 to user: Instance d9685b83-752b-43b7-9f66-ea6ccc88917f could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:45:36.377804 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31d4f1f7-bbec-45a1-8577-dbab84eb8fcd tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 404 len: 111 microversion: 2.21 time: 0.074638 Oct 24 10:45:36.381570 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2189/4432] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:45:36 2022] DELETE /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:45:36.403677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cdeeaa3d-ba3e-49dc-a4a6-f9c89497ade6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:36.415642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cdeeaa3d-ba3e-49dc-a4a6-f9c89497ade6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:36.428164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cdeeaa3d-ba3e-49dc-a4a6-f9c89497ade6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:36.429003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cdeeaa3d-ba3e-49dc-a4a6-f9c89497ade6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:36.429669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cdeeaa3d-ba3e-49dc-a4a6-f9c89497ade6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:36.430609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cdeeaa3d-ba3e-49dc-a4a6-f9c89497ade6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:36.431264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cdeeaa3d-ba3e-49dc-a4a6-f9c89497ade6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:36.431889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cdeeaa3d-ba3e-49dc-a4a6-f9c89497ade6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:36.447858 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f4267506-632b-4391-8de6-baea79926985 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "POST /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0/action" status: 202 len: 0 microversion: 2.1 time: 0.218427 Oct 24 10:45:36.449735 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2244/4433] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:45:36 2022] POST /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:45:36.458695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e9b90c7-ee5c-49b0-a22c-46be569dc48e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:36.460725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3e9b90c7-ee5c-49b0-a22c-46be569dc48e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] [instance: d9685b83-752b-43b7-9f66-ea6ccc88917f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:36.471892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e9b90c7-ee5c-49b0-a22c-46be569dc48e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:36.473132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e9b90c7-ee5c-49b0-a22c-46be569dc48e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:36.475899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e9b90c7-ee5c-49b0-a22c-46be569dc48e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:36.488720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e9b90c7-ee5c-49b0-a22c-46be569dc48e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:36.489274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e9b90c7-ee5c-49b0-a22c-46be569dc48e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:36.489731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e9b90c7-ee5c-49b0-a22c-46be569dc48e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:36.511185 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-3e9b90c7-ee5c-49b0-a22c-46be569dc48e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] HTTP exception thrown: Instance d9685b83-752b-43b7-9f66-ea6ccc88917f could not be found. Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e9b90c7-ee5c-49b0-a22c-46be569dc48e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Request method failure captured: Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f HTTP/1.1 Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmypqE25kYnWeVlI5tdRYb8z-NOTm6EIT4Zk31drmH_6ThJAGqDiIuq9FdXWY6zEfCHAoE-dJU4SeJcg1ok5e9W3aSpB34CBtG0-_t170MSQQKmle5DDtd3RBRa87siEbfe2sapptl7yucML9xDENp9jogmCAzQsRn9Gea5MVtcGgbg Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-Openstack-Nova-Api-Version: 2.21 Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: bc0e82e8116e4ace82fe3da9c52f793b Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-InstanceActionsV221TestJSON-814704940 Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bc0e82e8116e4ace82fe3da9c52f793b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bc0e82e8116e4ace82fe3da9c52f793b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bc0e82e8116e4ace82fe3da9c52f793b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bc0e82e8116e4ace82fe3da9c52f793b", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-InstanceActionsV221TestJSON-814704940 Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: bc0e82e8116e4ace82fe3da9c52f793b Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-814704940 Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-InstanceActionsV221TestJSON-814704940-project Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 5902085e2f564affb70251d4e2fd1df0 Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-InstanceActionsV221TestJSON-814704940-project Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance d9685b83-752b-43b7-9f66-ea6ccc88917f could not be found. Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'd9685b83-752b-43b7-9f66-ea6ccc88917f'} Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9685b83-752b-43b7-9f66-ea6ccc88917f could not be found. Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9685b83-752b-43b7-9f66-ea6ccc88917f could not be found. Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:36.513252 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:45:36.518359 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:36.518359 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:36.518359 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:45:36.518359 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:45:36.518359 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:45:36.518359 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:45:36.518359 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9685b83-752b-43b7-9f66-ea6ccc88917f could not be found. Oct 24 10:45:36.518359 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:36.520671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e9b90c7-ee5c-49b0-a22c-46be569dc48e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] Returning 404 to user: Instance d9685b83-752b-43b7-9f66-ea6ccc88917f could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:45:36.521779 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3e9b90c7-ee5c-49b0-a22c-46be569dc48e tempest-InstanceActionsV221TestJSON-814704940 tempest-InstanceActionsV221TestJSON-814704940-project] 10.222.0.50 "GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f" status: 404 len: 111 microversion: 2.21 time: 0.070695 Oct 24 10:45:36.522871 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2245/4434] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:36 2022] GET /compute/v2.1/servers/d9685b83-752b-43b7-9f66-ea6ccc88917f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:45:36.528024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-527c3151-e2a6-461d-a82a-862bdec8b1f8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:36.528874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-527c3151-e2a6-461d-a82a-862bdec8b1f8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:36.537036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-527c3151-e2a6-461d-a82a-862bdec8b1f8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:36.537801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-527c3151-e2a6-461d-a82a-862bdec8b1f8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:36.538470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-527c3151-e2a6-461d-a82a-862bdec8b1f8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:36.539383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-527c3151-e2a6-461d-a82a-862bdec8b1f8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:36.540296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-527c3151-e2a6-461d-a82a-862bdec8b1f8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:36.540947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-527c3151-e2a6-461d-a82a-862bdec8b1f8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:36.786086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cdeeaa3d-ba3e-49dc-a4a6-f9c89497ade6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:36.801774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cdeeaa3d-ba3e-49dc-a4a6-f9c89497ade6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:36.806182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cdeeaa3d-ba3e-49dc-a4a6-f9c89497ade6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:36.807632 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cdeeaa3d-ba3e-49dc-a4a6-f9c89497ade6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1803 microversion: 2.42 time: 0.424645 Oct 24 10:45:36.817335 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2190/4435] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:36 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1803 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:36.934285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-527c3151-e2a6-461d-a82a-862bdec8b1f8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:36.945812 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-527c3151-e2a6-461d-a82a-862bdec8b1f8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1494 microversion: 2.1 time: 0.421613 Oct 24 10:45:36.946589 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2246/4436] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:36 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1494 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:36.959322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-765bd212-3f77-4186-9b6d-d12588ad0bfc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:36.960047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-765bd212-3f77-4186-9b6d-d12588ad0bfc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:36.973784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-765bd212-3f77-4186-9b6d-d12588ad0bfc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:36.974403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-765bd212-3f77-4186-9b6d-d12588ad0bfc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:36.976221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-765bd212-3f77-4186-9b6d-d12588ad0bfc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:36.977083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-765bd212-3f77-4186-9b6d-d12588ad0bfc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:36.980422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-765bd212-3f77-4186-9b6d-d12588ad0bfc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:36.980981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-765bd212-3f77-4186-9b6d-d12588ad0bfc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:37.029017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b924d054-26ab-462c-b626-5caa570011cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:37.029737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b924d054-26ab-462c-b626-5caa570011cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:37.040507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b924d054-26ab-462c-b626-5caa570011cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:37.041064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b924d054-26ab-462c-b626-5caa570011cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:37.041656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b924d054-26ab-462c-b626-5caa570011cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:37.059029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b924d054-26ab-462c-b626-5caa570011cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:37.059646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b924d054-26ab-462c-b626-5caa570011cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:37.060113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b924d054-26ab-462c-b626-5caa570011cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:37.386704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-765bd212-3f77-4186-9b6d-d12588ad0bfc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:37.401191 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-765bd212-3f77-4186-9b6d-d12588ad0bfc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1309 microversion: 2.1 time: 0.448297 Oct 24 10:45:37.417116 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2191/4437] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:36 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1309 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:37.429019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b924d054-26ab-462c-b626-5caa570011cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:37.429801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d13936c4-480b-4d21-a23e-63848fe71be2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:37.430428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d13936c4-480b-4d21-a23e-63848fe71be2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:37.441386 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b924d054-26ab-462c-b626-5caa570011cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1317 microversion: 2.1 time: 0.416117 Oct 24 10:45:37.448096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d13936c4-480b-4d21-a23e-63848fe71be2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:37.453049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d13936c4-480b-4d21-a23e-63848fe71be2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:37.454206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d13936c4-480b-4d21-a23e-63848fe71be2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:37.454967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d13936c4-480b-4d21-a23e-63848fe71be2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:37.455425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d13936c4-480b-4d21-a23e-63848fe71be2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:37.456497 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2247/4438] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:37 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:45:37.461968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d13936c4-480b-4d21-a23e-63848fe71be2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:37.470444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-4989c3f0-da86-4864-a0d2-ae6bd9458743 req-1c723e26-8a41-4ffd-8758-3b3476e99426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6eb3578-42ca-4dc5-b31a-e5500aa94f2e", "name": "network-vif-plugged", "status": "completed", "tag": "36f88fb2-6faf-4282-bd23-d4f02a3206ca"}, {"server_uuid": "dba574b8-fd7b-4914-b2e1-0ef7c7beb55d", "name": "network-vif-plugged", "status": "completed", "tag": "f3cf98a5-3ab6-4a6a-9fe2-d2836e5f960d"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:37.486301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4989c3f0-da86-4864-a0d2-ae6bd9458743 req-1c723e26-8a41-4ffd-8758-3b3476e99426 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:37.486987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4989c3f0-da86-4864-a0d2-ae6bd9458743 req-1c723e26-8a41-4ffd-8758-3b3476e99426 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:37.487464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4989c3f0-da86-4864-a0d2-ae6bd9458743 req-1c723e26-8a41-4ffd-8758-3b3476e99426 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:37.504714 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-4989c3f0-da86-4864-a0d2-ae6bd9458743 req-1c723e26-8a41-4ffd-8758-3b3476e99426 service nova] Creating event network-vif-plugged:36f88fb2-6faf-4282-bd23-d4f02a3206ca for instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e on n-h2-858383-15 Oct 24 10:45:37.506637 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-4989c3f0-da86-4864-a0d2-ae6bd9458743 req-1c723e26-8a41-4ffd-8758-3b3476e99426 service nova] Creating event network-vif-plugged:f3cf98a5-3ab6-4a6a-9fe2-d2836e5f960d for instance dba574b8-fd7b-4914-b2e1-0ef7c7beb55d on n-h1-858383-15 Oct 24 10:45:37.523711 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-4989c3f0-da86-4864-a0d2-ae6bd9458743 req-1c723e26-8a41-4ffd-8758-3b3476e99426 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064367 Oct 24 10:45:37.531269 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2248/4439] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:45:37.788566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d13936c4-480b-4d21-a23e-63848fe71be2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:37.802523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d13936c4-480b-4d21-a23e-63848fe71be2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:37.805853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d13936c4-480b-4d21-a23e-63848fe71be2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:37.808270 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d13936c4-480b-4d21-a23e-63848fe71be2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1810 microversion: 2.20 time: 0.387780 Oct 24 10:45:37.809408 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2192/4440] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:37 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1810 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:37.846113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cd85f7ee-d927-46bc-8f35-87cbd7bb299d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:37.847698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cd85f7ee-d927-46bc-8f35-87cbd7bb299d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:37.857774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd85f7ee-d927-46bc-8f35-87cbd7bb299d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:37.858421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd85f7ee-d927-46bc-8f35-87cbd7bb299d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:37.858973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd85f7ee-d927-46bc-8f35-87cbd7bb299d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:37.859877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd85f7ee-d927-46bc-8f35-87cbd7bb299d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:37.860974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd85f7ee-d927-46bc-8f35-87cbd7bb299d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:37.862318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd85f7ee-d927-46bc-8f35-87cbd7bb299d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:37.868794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:37.972951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ff223814-73f0-4165-ad11-0740602684a9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:37.974377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ff223814-73f0-4165-ad11-0740602684a9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:37.984158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff223814-73f0-4165-ad11-0740602684a9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:37.985322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff223814-73f0-4165-ad11-0740602684a9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:37.988431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff223814-73f0-4165-ad11-0740602684a9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:37.989413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff223814-73f0-4165-ad11-0740602684a9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:37.989887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff223814-73f0-4165-ad11-0740602684a9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:37.991290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff223814-73f0-4165-ad11-0740602684a9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:38.277006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cd85f7ee-d927-46bc-8f35-87cbd7bb299d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:38.295090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cd85f7ee-d927-46bc-8f35-87cbd7bb299d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:38.296602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cd85f7ee-d927-46bc-8f35-87cbd7bb299d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:38.310902 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cd85f7ee-d927-46bc-8f35-87cbd7bb299d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1803 microversion: 2.42 time: 0.470321 Oct 24 10:45:38.321855 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2249/4441] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:37 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1803 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:38.363420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ff223814-73f0-4165-ad11-0740602684a9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:38.373206 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ff223814-73f0-4165-ad11-0740602684a9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1494 microversion: 2.1 time: 0.404312 Oct 24 10:45:38.373810 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2193/4442] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:37 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1494 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:38.429220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3aadfb0c-bede-4bf2-921d-266b077114b3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:38.430244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3aadfb0c-bede-4bf2-921d-266b077114b3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:38.438759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3aadfb0c-bede-4bf2-921d-266b077114b3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:38.439634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3aadfb0c-bede-4bf2-921d-266b077114b3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:38.440273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3aadfb0c-bede-4bf2-921d-266b077114b3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:38.441413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3aadfb0c-bede-4bf2-921d-266b077114b3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:38.442090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3aadfb0c-bede-4bf2-921d-266b077114b3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:38.442743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3aadfb0c-bede-4bf2-921d-266b077114b3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:38.476457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-acae70f9-2569-441f-b12c-e24b791bee74 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:38.477457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-acae70f9-2569-441f-b12c-e24b791bee74 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:38.485156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acae70f9-2569-441f-b12c-e24b791bee74 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:38.485649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acae70f9-2569-441f-b12c-e24b791bee74 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:38.486204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acae70f9-2569-441f-b12c-e24b791bee74 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:38.487098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acae70f9-2569-441f-b12c-e24b791bee74 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:38.487572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acae70f9-2569-441f-b12c-e24b791bee74 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:38.488072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acae70f9-2569-441f-b12c-e24b791bee74 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:38.863318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3aadfb0c-bede-4bf2-921d-266b077114b3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:38.874489 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3aadfb0c-bede-4bf2-921d-266b077114b3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1491 microversion: 2.1 time: 0.451332 Oct 24 10:45:38.877220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-acae70f9-2569-441f-b12c-e24b791bee74 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:38.880869 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2250/4443] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:38 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1491 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:38.886022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2263412a-157b-4706-94a5-886d97b1afcb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:38.886896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2263412a-157b-4706-94a5-886d97b1afcb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:38.893890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2263412a-157b-4706-94a5-886d97b1afcb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:38.895022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2263412a-157b-4706-94a5-886d97b1afcb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:38.895540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2263412a-157b-4706-94a5-886d97b1afcb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:38.896331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2263412a-157b-4706-94a5-886d97b1afcb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:38.897672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2263412a-157b-4706-94a5-886d97b1afcb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:38.898320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2263412a-157b-4706-94a5-886d97b1afcb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:38.921406 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-acae70f9-2569-441f-b12c-e24b791bee74 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1317 microversion: 2.1 time: 0.453453 Oct 24 10:45:38.936719 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2194/4444] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:38 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:38.947267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4ff53554-a72e-4a48-881c-045aefe2ed33 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:38.950226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4ff53554-a72e-4a48-881c-045aefe2ed33 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:38.965268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ff53554-a72e-4a48-881c-045aefe2ed33 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:38.966025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ff53554-a72e-4a48-881c-045aefe2ed33 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:38.966538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ff53554-a72e-4a48-881c-045aefe2ed33 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:38.967272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ff53554-a72e-4a48-881c-045aefe2ed33 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:38.967735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ff53554-a72e-4a48-881c-045aefe2ed33 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:38.968173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ff53554-a72e-4a48-881c-045aefe2ed33 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:39.217666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2263412a-157b-4706-94a5-886d97b1afcb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:39.243699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2263412a-157b-4706-94a5-886d97b1afcb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:39.245664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2263412a-157b-4706-94a5-886d97b1afcb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:39.247051 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2263412a-157b-4706-94a5-886d97b1afcb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1810 microversion: 2.20 time: 0.365762 Oct 24 10:45:39.248250 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2251/4445] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:38 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1810 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:39.267248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4ff53554-a72e-4a48-881c-045aefe2ed33 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:39.278347 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4ff53554-a72e-4a48-881c-045aefe2ed33 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1490 microversion: 2.1 time: 0.337750 Oct 24 10:45:39.279299 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2195/4446] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:38 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1490 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:39.305381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7471bff2-0176-46dc-ab0b-aa068e678d5a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:39.306266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7471bff2-0176-46dc-ab0b-aa068e678d5a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:39.331931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7471bff2-0176-46dc-ab0b-aa068e678d5a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:39.332697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7471bff2-0176-46dc-ab0b-aa068e678d5a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:39.334373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7471bff2-0176-46dc-ab0b-aa068e678d5a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:39.334373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7471bff2-0176-46dc-ab0b-aa068e678d5a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:39.339615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-57f1455e-d76e-488a-9fd5-63a37169dae7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:39.340326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-57f1455e-d76e-488a-9fd5-63a37169dae7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:39.342543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7471bff2-0176-46dc-ab0b-aa068e678d5a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:39.346972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7471bff2-0176-46dc-ab0b-aa068e678d5a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:39.355933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57f1455e-d76e-488a-9fd5-63a37169dae7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:39.361534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57f1455e-d76e-488a-9fd5-63a37169dae7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:39.362129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57f1455e-d76e-488a-9fd5-63a37169dae7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:39.363114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57f1455e-d76e-488a-9fd5-63a37169dae7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:39.365529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57f1455e-d76e-488a-9fd5-63a37169dae7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:39.366186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57f1455e-d76e-488a-9fd5-63a37169dae7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:39.752951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-57f1455e-d76e-488a-9fd5-63a37169dae7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:39.756963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7471bff2-0176-46dc-ab0b-aa068e678d5a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:39.773124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-57f1455e-d76e-488a-9fd5-63a37169dae7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:39.774559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-57f1455e-d76e-488a-9fd5-63a37169dae7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:39.775728 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-57f1455e-d76e-488a-9fd5-63a37169dae7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1850 microversion: 2.42 time: 0.440058 Oct 24 10:45:39.776507 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2196/4447] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:39 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1850 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:39.785512 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7471bff2-0176-46dc-ab0b-aa068e678d5a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1491 microversion: 2.1 time: 0.481713 Oct 24 10:45:39.789008 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2252/4448] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:39 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1491 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:39.799572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d191cc3e-aea9-4173-afd7-852cda83590c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:39.800448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d191cc3e-aea9-4173-afd7-852cda83590c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:39.811438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6485f8ee-9a3b-4a75-841b-9d4f024a7642 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:39.812167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6485f8ee-9a3b-4a75-841b-9d4f024a7642 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:39.813985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d191cc3e-aea9-4173-afd7-852cda83590c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:39.816044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d191cc3e-aea9-4173-afd7-852cda83590c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:39.816728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d191cc3e-aea9-4173-afd7-852cda83590c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:39.819481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6485f8ee-9a3b-4a75-841b-9d4f024a7642 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:39.820153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6485f8ee-9a3b-4a75-841b-9d4f024a7642 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:39.820779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6485f8ee-9a3b-4a75-841b-9d4f024a7642 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:39.821138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d191cc3e-aea9-4173-afd7-852cda83590c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:39.821850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6485f8ee-9a3b-4a75-841b-9d4f024a7642 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:39.822457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6485f8ee-9a3b-4a75-841b-9d4f024a7642 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:39.823061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6485f8ee-9a3b-4a75-841b-9d4f024a7642 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:39.823396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d191cc3e-aea9-4173-afd7-852cda83590c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:39.825668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d191cc3e-aea9-4173-afd7-852cda83590c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:39.854928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6485f8ee-9a3b-4a75-841b-9d4f024a7642 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:45:39.982605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:39.989587 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6485f8ee-9a3b-4a75-841b-9d4f024a7642 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 204 len: 0 microversion: 2.1 time: 0.181839 Oct 24 10:45:39.990864 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2253/4449] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:45:39 2022] DELETE /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:45:39.997223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-49cd7356-9c93-4c6a-9588-8e85e1deca29 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:39.998202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-49cd7356-9c93-4c6a-9588-8e85e1deca29 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:40.006306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49cd7356-9c93-4c6a-9588-8e85e1deca29 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:40.006799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49cd7356-9c93-4c6a-9588-8e85e1deca29 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:40.007430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49cd7356-9c93-4c6a-9588-8e85e1deca29 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:40.008354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49cd7356-9c93-4c6a-9588-8e85e1deca29 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:40.009257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49cd7356-9c93-4c6a-9588-8e85e1deca29 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:40.009874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49cd7356-9c93-4c6a-9588-8e85e1deca29 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:40.732879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d191cc3e-aea9-4173-afd7-852cda83590c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:40.742702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-49cd7356-9c93-4c6a-9588-8e85e1deca29 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:40.753502 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-49cd7356-9c93-4c6a-9588-8e85e1deca29 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1506 microversion: 2.1 time: 0.761102 Oct 24 10:45:40.758320 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2254/4450] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:39 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1506 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:40.770306 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d191cc3e-aea9-4173-afd7-852cda83590c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1494 microversion: 2.1 time: 0.990196 Oct 24 10:45:40.772866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0325b271-2439-405d-bd25-ea093aa90b2a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:40.774903 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2197/4451] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:39 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1494 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:40.775044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0325b271-2439-405d-bd25-ea093aa90b2a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:40.795236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-764801a2-11b9-49b3-8faa-daf174d30352 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:40.795601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0325b271-2439-405d-bd25-ea093aa90b2a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:40.796308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0325b271-2439-405d-bd25-ea093aa90b2a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:40.796664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-764801a2-11b9-49b3-8faa-daf174d30352 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:40.801459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0325b271-2439-405d-bd25-ea093aa90b2a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:40.802472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0325b271-2439-405d-bd25-ea093aa90b2a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:40.805571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0325b271-2439-405d-bd25-ea093aa90b2a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:40.806200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0325b271-2439-405d-bd25-ea093aa90b2a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:40.817802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-764801a2-11b9-49b3-8faa-daf174d30352 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:40.819218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-764801a2-11b9-49b3-8faa-daf174d30352 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:40.819824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-764801a2-11b9-49b3-8faa-daf174d30352 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:40.821529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-764801a2-11b9-49b3-8faa-daf174d30352 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:40.822152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-764801a2-11b9-49b3-8faa-daf174d30352 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:40.823006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-764801a2-11b9-49b3-8faa-daf174d30352 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:41.195140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0325b271-2439-405d-bd25-ea093aa90b2a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:41.200950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-764801a2-11b9-49b3-8faa-daf174d30352 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:41.214285 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0325b271-2439-405d-bd25-ea093aa90b2a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1497 microversion: 2.1 time: 0.452203 Oct 24 10:45:41.217120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-764801a2-11b9-49b3-8faa-daf174d30352 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:41.220375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-764801a2-11b9-49b3-8faa-daf174d30352 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:41.221897 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-764801a2-11b9-49b3-8faa-daf174d30352 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1810 microversion: 2.20 time: 0.445472 Oct 24 10:45:41.230933 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2255/4452] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:40 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1497 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:41.239660 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2198/4453] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:40 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1810 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:41.267152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10a850e9-83d1-400a-8a0a-1c7b17d6ec3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:41.268714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-10a850e9-83d1-400a-8a0a-1c7b17d6ec3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:41.279925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a850e9-83d1-400a-8a0a-1c7b17d6ec3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:41.280817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a850e9-83d1-400a-8a0a-1c7b17d6ec3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:41.282625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a850e9-83d1-400a-8a0a-1c7b17d6ec3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:41.283863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a850e9-83d1-400a-8a0a-1c7b17d6ec3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:41.284615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a850e9-83d1-400a-8a0a-1c7b17d6ec3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:41.285394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10a850e9-83d1-400a-8a0a-1c7b17d6ec3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:41.350847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-55cdec3f-7d94-412d-b550-e705f96c58c6 req-cf86d7e0-e8f0-4e9b-8e40-773de13f7f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "tag": "fb2020ef-e5e3-481a-baca-ee8ad6e8058a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:41.369650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-55cdec3f-7d94-412d-b550-e705f96c58c6 req-cf86d7e0-e8f0-4e9b-8e40-773de13f7f48 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:41.370241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-55cdec3f-7d94-412d-b550-e705f96c58c6 req-cf86d7e0-e8f0-4e9b-8e40-773de13f7f48 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:41.370798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-55cdec3f-7d94-412d-b550-e705f96c58c6 req-cf86d7e0-e8f0-4e9b-8e40-773de13f7f48 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:41.402633 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-55cdec3f-7d94-412d-b550-e705f96c58c6 req-cf86d7e0-e8f0-4e9b-8e40-773de13f7f48 service nova] Creating event network-changed:fb2020ef-e5e3-481a-baca-ee8ad6e8058a for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:45:41.410384 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-55cdec3f-7d94-412d-b550-e705f96c58c6 req-cf86d7e0-e8f0-4e9b-8e40-773de13f7f48 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175811 Oct 24 10:45:41.412916 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2256/4454] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:45:41.420208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-53c1f101-8171-475c-8e20-66e46dcb423c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:41.422095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-53c1f101-8171-475c-8e20-66e46dcb423c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:41.430829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53c1f101-8171-475c-8e20-66e46dcb423c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:41.431716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53c1f101-8171-475c-8e20-66e46dcb423c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:41.432364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53c1f101-8171-475c-8e20-66e46dcb423c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:41.433351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53c1f101-8171-475c-8e20-66e46dcb423c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:41.434040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53c1f101-8171-475c-8e20-66e46dcb423c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:41.434673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53c1f101-8171-475c-8e20-66e46dcb423c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:41.449300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-10a850e9-83d1-400a-8a0a-1c7b17d6ec3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:41.458193 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10a850e9-83d1-400a-8a0a-1c7b17d6ec3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1506 microversion: 2.1 time: 0.217019 Oct 24 10:45:41.459096 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2199/4455] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:41 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:41.483631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:41.488463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:41.499211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:41.500027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:41.501361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:41.502285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:41.503385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:41.504015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:41.588430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:41.600389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:45:41.600920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:45:41.601463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:45:41.601993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:45:41.602467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:45:41.648603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-53c1f101-8171-475c-8e20-66e46dcb423c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:41.659558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-53c1f101-8171-475c-8e20-66e46dcb423c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:41.661228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-53c1f101-8171-475c-8e20-66e46dcb423c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:41.662445 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-53c1f101-8171-475c-8e20-66e46dcb423c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1850 microversion: 2.42 time: 0.248104 Oct 24 10:45:41.663156 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2257/4456] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:41 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1850 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:41.686043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:41.693017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:41.693515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:41.693970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:41.694670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:41.695126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:41.695552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:41.724865 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9f333637-a964-4d4c-8e15-8e707a9f95b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "POST /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d/action" status: 202 len: 1108 microversion: 2.1 time: 0.247967 Oct 24 10:45:41.737547 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2200/4457] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:45:41 2022] POST /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d/action => generated 1108 bytes in 250 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 24 10:45:41.750673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9060b748-71e7-450c-951d-05624c6aaba5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:41.751498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9060b748-71e7-450c-951d-05624c6aaba5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:41.762315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9060b748-71e7-450c-951d-05624c6aaba5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:41.762823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9060b748-71e7-450c-951d-05624c6aaba5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:41.763276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9060b748-71e7-450c-951d-05624c6aaba5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:41.764005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9060b748-71e7-450c-951d-05624c6aaba5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:41.764468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9060b748-71e7-450c-951d-05624c6aaba5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:41.764927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9060b748-71e7-450c-951d-05624c6aaba5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:41.804797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-681d15a2-3aae-4f7f-a346-f370a14d9eb8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:41.805442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-681d15a2-3aae-4f7f-a346-f370a14d9eb8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:41.817966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-681d15a2-3aae-4f7f-a346-f370a14d9eb8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:41.818470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-681d15a2-3aae-4f7f-a346-f370a14d9eb8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:41.818912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-681d15a2-3aae-4f7f-a346-f370a14d9eb8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:41.819620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-681d15a2-3aae-4f7f-a346-f370a14d9eb8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:41.820079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-681d15a2-3aae-4f7f-a346-f370a14d9eb8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:41.820506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-681d15a2-3aae-4f7f-a346-f370a14d9eb8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:42.041760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9060b748-71e7-450c-951d-05624c6aaba5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:42.052796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-681d15a2-3aae-4f7f-a346-f370a14d9eb8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:42.054917 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9060b748-71e7-450c-951d-05624c6aaba5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.309624 Oct 24 10:45:42.055517 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2258/4458] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:41 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:42.062288 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-681d15a2-3aae-4f7f-a346-f370a14d9eb8 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1494 microversion: 2.1 time: 0.261687 Oct 24 10:45:42.065216 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2201/4459] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:41 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1494 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:42.238702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6e887e26-79cb-4fc4-8a1b-8f2446eae9b1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:42.239418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6e887e26-79cb-4fc4-8a1b-8f2446eae9b1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:42.245783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e887e26-79cb-4fc4-8a1b-8f2446eae9b1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:42.246344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e887e26-79cb-4fc4-8a1b-8f2446eae9b1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:42.246857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e887e26-79cb-4fc4-8a1b-8f2446eae9b1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:42.247643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e887e26-79cb-4fc4-8a1b-8f2446eae9b1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:42.248164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e887e26-79cb-4fc4-8a1b-8f2446eae9b1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:42.248665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e887e26-79cb-4fc4-8a1b-8f2446eae9b1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:42.259612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b3da523c-3649-4fb0-88f7-e393c80687c0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:42.260278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b3da523c-3649-4fb0-88f7-e393c80687c0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:42.276961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3da523c-3649-4fb0-88f7-e393c80687c0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:42.277474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3da523c-3649-4fb0-88f7-e393c80687c0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:42.279552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3da523c-3649-4fb0-88f7-e393c80687c0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:42.280313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3da523c-3649-4fb0-88f7-e393c80687c0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:42.294435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3da523c-3649-4fb0-88f7-e393c80687c0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:42.295089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3da523c-3649-4fb0-88f7-e393c80687c0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:42.465002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e887e26-79cb-4fc4-8a1b-8f2446eae9b1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:42.478551 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6e887e26-79cb-4fc4-8a1b-8f2446eae9b1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1497 microversion: 2.1 time: 0.244591 Oct 24 10:45:42.479171 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2259/4460] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:42 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1497 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:42.586220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b3da523c-3649-4fb0-88f7-e393c80687c0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:42.596702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b3da523c-3649-4fb0-88f7-e393c80687c0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:42.598489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b3da523c-3649-4fb0-88f7-e393c80687c0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:42.599797 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b3da523c-3649-4fb0-88f7-e393c80687c0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1810 microversion: 2.20 time: 0.350375 Oct 24 10:45:42.600449 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2202/4461] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:42 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1810 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:45:42.691673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7b48a79b-b546-4eff-85d8-f6cd6a2717a1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:42.692900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7b48a79b-b546-4eff-85d8-f6cd6a2717a1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:42.699653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b48a79b-b546-4eff-85d8-f6cd6a2717a1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:42.700133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b48a79b-b546-4eff-85d8-f6cd6a2717a1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:42.700567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b48a79b-b546-4eff-85d8-f6cd6a2717a1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:42.701319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b48a79b-b546-4eff-85d8-f6cd6a2717a1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:42.701775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b48a79b-b546-4eff-85d8-f6cd6a2717a1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:42.702553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b48a79b-b546-4eff-85d8-f6cd6a2717a1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:42.886914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7b48a79b-b546-4eff-85d8-f6cd6a2717a1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:42.897942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7b48a79b-b546-4eff-85d8-f6cd6a2717a1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:42.899536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7b48a79b-b546-4eff-85d8-f6cd6a2717a1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:42.900794 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7b48a79b-b546-4eff-85d8-f6cd6a2717a1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1850 microversion: 2.42 time: 0.213996 Oct 24 10:45:42.901471 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2260/4462] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:42 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1850 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:43.087507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cf902641-e512-488f-a559-cf74c4cb1103 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:43.088502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cf902641-e512-488f-a559-cf74c4cb1103 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:43.094363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-40d83474-a81b-479b-97ca-e35505ed2370 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:43.095030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-40d83474-a81b-479b-97ca-e35505ed2370 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:43.101563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf902641-e512-488f-a559-cf74c4cb1103 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:43.102806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf902641-e512-488f-a559-cf74c4cb1103 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:43.103337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf902641-e512-488f-a559-cf74c4cb1103 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:43.104210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf902641-e512-488f-a559-cf74c4cb1103 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:43.104746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf902641-e512-488f-a559-cf74c4cb1103 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:43.105300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf902641-e512-488f-a559-cf74c4cb1103 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:43.111444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40d83474-a81b-479b-97ca-e35505ed2370 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:43.111947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40d83474-a81b-479b-97ca-e35505ed2370 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:43.112388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40d83474-a81b-479b-97ca-e35505ed2370 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:43.113205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40d83474-a81b-479b-97ca-e35505ed2370 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:43.113666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40d83474-a81b-479b-97ca-e35505ed2370 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:43.114093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40d83474-a81b-479b-97ca-e35505ed2370 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:43.325595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cf902641-e512-488f-a559-cf74c4cb1103 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:43.335171 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cf902641-e512-488f-a559-cf74c4cb1103 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1500 microversion: 2.1 time: 0.252207 Oct 24 10:45:43.344109 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2261/4463] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:43 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1500 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:43.362598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-82dff5d3-7e53-4ae6-9310-f1ddfce54512 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:43.363200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-82dff5d3-7e53-4ae6-9310-f1ddfce54512 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:43.369576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82dff5d3-7e53-4ae6-9310-f1ddfce54512 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:43.370172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82dff5d3-7e53-4ae6-9310-f1ddfce54512 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:43.370706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82dff5d3-7e53-4ae6-9310-f1ddfce54512 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:43.371497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82dff5d3-7e53-4ae6-9310-f1ddfce54512 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:43.372095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82dff5d3-7e53-4ae6-9310-f1ddfce54512 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:43.372596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82dff5d3-7e53-4ae6-9310-f1ddfce54512 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:43.388106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-40d83474-a81b-479b-97ca-e35505ed2370 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:43.405880 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-40d83474-a81b-479b-97ca-e35505ed2370 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.328164 Oct 24 10:45:43.415068 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2203/4464] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:43 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:43.421154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-82dff5d3-7e53-4ae6-9310-f1ddfce54512 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:45:43.504036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c35e5bc4-0124-4d82-a221-ac81f71d1ffa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:43.504858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c35e5bc4-0124-4d82-a221-ac81f71d1ffa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:43.516225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c35e5bc4-0124-4d82-a221-ac81f71d1ffa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:43.520241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c35e5bc4-0124-4d82-a221-ac81f71d1ffa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:43.520729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c35e5bc4-0124-4d82-a221-ac81f71d1ffa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:43.521502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c35e5bc4-0124-4d82-a221-ac81f71d1ffa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:43.523155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c35e5bc4-0124-4d82-a221-ac81f71d1ffa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:43.524443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c35e5bc4-0124-4d82-a221-ac81f71d1ffa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:43.541181 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-82dff5d3-7e53-4ae6-9310-f1ddfce54512 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 204 len: 0 microversion: 2.1 time: 0.182805 Oct 24 10:45:43.544964 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2262/4465] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:45:43 2022] DELETE /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:45:43.551952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f8b9a49d-f6dc-41ea-8b18-9a80aa11d623 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:43.554694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f8b9a49d-f6dc-41ea-8b18-9a80aa11d623 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:43.561653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8b9a49d-f6dc-41ea-8b18-9a80aa11d623 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:43.562397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8b9a49d-f6dc-41ea-8b18-9a80aa11d623 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:43.563872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8b9a49d-f6dc-41ea-8b18-9a80aa11d623 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:43.564989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8b9a49d-f6dc-41ea-8b18-9a80aa11d623 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:43.565603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8b9a49d-f6dc-41ea-8b18-9a80aa11d623 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:43.567711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8b9a49d-f6dc-41ea-8b18-9a80aa11d623 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:43.599042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:43.749285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c35e5bc4-0124-4d82-a221-ac81f71d1ffa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:43.762464 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c35e5bc4-0124-4d82-a221-ac81f71d1ffa tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1497 microversion: 2.1 time: 0.262796 Oct 24 10:45:43.763669 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2204/4466] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:43 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1497 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:43.772245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ea78a0b7-bd0a-4e6d-b273-6c4bb52813bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:43.773542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ea78a0b7-bd0a-4e6d-b273-6c4bb52813bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:43.790806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea78a0b7-bd0a-4e6d-b273-6c4bb52813bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:43.791516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea78a0b7-bd0a-4e6d-b273-6c4bb52813bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:43.791822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f8b9a49d-f6dc-41ea-8b18-9a80aa11d623 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:43.792257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea78a0b7-bd0a-4e6d-b273-6c4bb52813bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:43.793463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea78a0b7-bd0a-4e6d-b273-6c4bb52813bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:43.794198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea78a0b7-bd0a-4e6d-b273-6c4bb52813bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:43.794815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea78a0b7-bd0a-4e6d-b273-6c4bb52813bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:43.800408 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f8b9a49d-f6dc-41ea-8b18-9a80aa11d623 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 0.254086 Oct 24 10:45:43.801315 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2263/4467] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:43 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:43.927648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c44da88f-babd-4b73-84b8-c9ea99f61005 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:43.928407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c44da88f-babd-4b73-84b8-c9ea99f61005 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:43.934743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c44da88f-babd-4b73-84b8-c9ea99f61005 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:43.935505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c44da88f-babd-4b73-84b8-c9ea99f61005 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:43.936137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c44da88f-babd-4b73-84b8-c9ea99f61005 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:43.937104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c44da88f-babd-4b73-84b8-c9ea99f61005 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:43.937782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c44da88f-babd-4b73-84b8-c9ea99f61005 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:43.938407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c44da88f-babd-4b73-84b8-c9ea99f61005 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:43.941617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ea78a0b7-bd0a-4e6d-b273-6c4bb52813bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:43.953171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ea78a0b7-bd0a-4e6d-b273-6c4bb52813bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:43.955313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ea78a0b7-bd0a-4e6d-b273-6c4bb52813bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:43.956565 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ea78a0b7-bd0a-4e6d-b273-6c4bb52813bf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1797 microversion: 2.20 time: 0.191687 Oct 24 10:45:43.957328 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2205/4468] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:43 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1797 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:44.274008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c44da88f-babd-4b73-84b8-c9ea99f61005 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:44.284658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c44da88f-babd-4b73-84b8-c9ea99f61005 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:44.294890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c44da88f-babd-4b73-84b8-c9ea99f61005 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:44.296257 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c44da88f-babd-4b73-84b8-c9ea99f61005 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1850 microversion: 2.42 time: 0.372576 Oct 24 10:45:44.296906 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2264/4469] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:43 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1850 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:44.433205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e3c5ea0a-f109-4828-bfbb-1b54d6cc318f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:44.435480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e3c5ea0a-f109-4828-bfbb-1b54d6cc318f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:44.445429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3c5ea0a-f109-4828-bfbb-1b54d6cc318f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:44.446304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3c5ea0a-f109-4828-bfbb-1b54d6cc318f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:44.446902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3c5ea0a-f109-4828-bfbb-1b54d6cc318f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:44.447765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3c5ea0a-f109-4828-bfbb-1b54d6cc318f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:44.448412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3c5ea0a-f109-4828-bfbb-1b54d6cc318f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:44.449023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3c5ea0a-f109-4828-bfbb-1b54d6cc318f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:44.651041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-cbea8d8c-ca33-465d-a06d-719fe16f45cd req-25c70f86-f3f4-4fba-856a-b2bcaa103e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3cd53e-83ed-45b4-82ac-882fb65759f9", "name": "network-vif-deleted", "tag": "bfb45541-45c3-4e57-959c-17ae32c17e06"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:44.682729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cbea8d8c-ca33-465d-a06d-719fe16f45cd req-25c70f86-f3f4-4fba-856a-b2bcaa103e43 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:44.684445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cbea8d8c-ca33-465d-a06d-719fe16f45cd req-25c70f86-f3f4-4fba-856a-b2bcaa103e43 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:44.684941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cbea8d8c-ca33-465d-a06d-719fe16f45cd req-25c70f86-f3f4-4fba-856a-b2bcaa103e43 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:44.717978 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-cbea8d8c-ca33-465d-a06d-719fe16f45cd req-25c70f86-f3f4-4fba-856a-b2bcaa103e43 service nova] Creating event network-vif-deleted:bfb45541-45c3-4e57-959c-17ae32c17e06 for instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 on n-h2-858383-15 Oct 24 10:45:44.736594 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-cbea8d8c-ca33-465d-a06d-719fe16f45cd req-25c70f86-f3f4-4fba-856a-b2bcaa103e43 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090136 Oct 24 10:45:44.737592 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2265/4470] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:45:44.789968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-717f1b8f-ed1f-4ae2-86fa-f2fef825e42f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:44.790683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-717f1b8f-ed1f-4ae2-86fa-f2fef825e42f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:44.801349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-717f1b8f-ed1f-4ae2-86fa-f2fef825e42f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:44.801844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-717f1b8f-ed1f-4ae2-86fa-f2fef825e42f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:44.802279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-717f1b8f-ed1f-4ae2-86fa-f2fef825e42f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:44.802992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-717f1b8f-ed1f-4ae2-86fa-f2fef825e42f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:44.803479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-717f1b8f-ed1f-4ae2-86fa-f2fef825e42f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:44.811438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-717f1b8f-ed1f-4ae2-86fa-f2fef825e42f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:44.829939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e3c5ea0a-f109-4828-bfbb-1b54d6cc318f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:44.839322 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e3c5ea0a-f109-4828-bfbb-1b54d6cc318f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.411411 Oct 24 10:45:44.845015 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2206/4471] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:44 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:44.850049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d8480d8a-f9ba-4704-b975-ee73d0ec9b5e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:44.851881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d8480d8a-f9ba-4704-b975-ee73d0ec9b5e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:44.863956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8480d8a-f9ba-4704-b975-ee73d0ec9b5e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:44.870535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8480d8a-f9ba-4704-b975-ee73d0ec9b5e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:44.871211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8480d8a-f9ba-4704-b975-ee73d0ec9b5e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:44.872188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8480d8a-f9ba-4704-b975-ee73d0ec9b5e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:44.872820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8480d8a-f9ba-4704-b975-ee73d0ec9b5e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:44.874121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8480d8a-f9ba-4704-b975-ee73d0ec9b5e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:44.967474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-717f1b8f-ed1f-4ae2-86fa-f2fef825e42f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:44.983308 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-717f1b8f-ed1f-4ae2-86fa-f2fef825e42f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1455 microversion: 2.1 time: 0.197821 Oct 24 10:45:44.992025 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2266/4472] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:44 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1455 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:45.199761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d8480d8a-f9ba-4704-b975-ee73d0ec9b5e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:45.212912 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d8480d8a-f9ba-4704-b975-ee73d0ec9b5e tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 0.366473 Oct 24 10:45:45.213535 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2207/4473] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:44 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:45.327105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d5a3706f-5d46-48b0-abd2-7336d1ddbc65 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:45.327817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d5a3706f-5d46-48b0-abd2-7336d1ddbc65 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:45.335461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5a3706f-5d46-48b0-abd2-7336d1ddbc65 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:45.336193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5a3706f-5d46-48b0-abd2-7336d1ddbc65 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:45.336969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5a3706f-5d46-48b0-abd2-7336d1ddbc65 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:45.337874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5a3706f-5d46-48b0-abd2-7336d1ddbc65 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:45.338581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5a3706f-5d46-48b0-abd2-7336d1ddbc65 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:45.339203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5a3706f-5d46-48b0-abd2-7336d1ddbc65 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:45.636697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d5a3706f-5d46-48b0-abd2-7336d1ddbc65 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:45.653496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d5a3706f-5d46-48b0-abd2-7336d1ddbc65 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:45.655616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d5a3706f-5d46-48b0-abd2-7336d1ddbc65 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:45.659666 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d5a3706f-5d46-48b0-abd2-7336d1ddbc65 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1871 microversion: 2.42 time: 0.338511 Oct 24 10:45:45.664182 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2267/4474] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:45 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1871 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:45.865852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e5d305a1-f7f2-4d74-8caa-b345e40b378c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:45.866483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e5d305a1-f7f2-4d74-8caa-b345e40b378c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:45.873495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5d305a1-f7f2-4d74-8caa-b345e40b378c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:45.874193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5d305a1-f7f2-4d74-8caa-b345e40b378c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:45.874790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5d305a1-f7f2-4d74-8caa-b345e40b378c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:45.876520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5d305a1-f7f2-4d74-8caa-b345e40b378c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:45.877230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5d305a1-f7f2-4d74-8caa-b345e40b378c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:45.877810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5d305a1-f7f2-4d74-8caa-b345e40b378c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:46.011674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f6fd7054-99d7-4d94-8f0d-59e1bb7449ff tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:46.012334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f6fd7054-99d7-4d94-8f0d-59e1bb7449ff tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:46.020989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6fd7054-99d7-4d94-8f0d-59e1bb7449ff tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:46.022723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6fd7054-99d7-4d94-8f0d-59e1bb7449ff tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:46.024051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6fd7054-99d7-4d94-8f0d-59e1bb7449ff tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:46.027088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6fd7054-99d7-4d94-8f0d-59e1bb7449ff tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:46.029215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6fd7054-99d7-4d94-8f0d-59e1bb7449ff tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:46.031131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6fd7054-99d7-4d94-8f0d-59e1bb7449ff tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:46.078017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e5d305a1-f7f2-4d74-8caa-b345e40b378c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:46.087602 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e5d305a1-f7f2-4d74-8caa-b345e40b378c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.225605 Oct 24 10:45:46.090948 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2208/4475] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:45 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:46.144311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f6fd7054-99d7-4d94-8f0d-59e1bb7449ff tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:46.153625 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f6fd7054-99d7-4d94-8f0d-59e1bb7449ff tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1455 microversion: 2.1 time: 0.146060 Oct 24 10:45:46.167475 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2268/4476] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:46 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:46.242830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-39baecf9-bce9-416f-87f4-93380e73c760 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:46.243465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-39baecf9-bce9-416f-87f4-93380e73c760 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:46.250202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39baecf9-bce9-416f-87f4-93380e73c760 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:46.252006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39baecf9-bce9-416f-87f4-93380e73c760 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:46.252463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39baecf9-bce9-416f-87f4-93380e73c760 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:46.253265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39baecf9-bce9-416f-87f4-93380e73c760 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:46.253966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39baecf9-bce9-416f-87f4-93380e73c760 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:46.254562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39baecf9-bce9-416f-87f4-93380e73c760 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:46.439916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-39baecf9-bce9-416f-87f4-93380e73c760 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:46.450166 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-39baecf9-bce9-416f-87f4-93380e73c760 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 0.212137 Oct 24 10:45:46.451238 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2209/4477] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:46 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:46.716930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-10d42bc5-a7a7-49db-8629-80b5f5ca27e1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:46.718433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-10d42bc5-a7a7-49db-8629-80b5f5ca27e1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:46.732117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10d42bc5-a7a7-49db-8629-80b5f5ca27e1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:46.736554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10d42bc5-a7a7-49db-8629-80b5f5ca27e1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:46.737349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10d42bc5-a7a7-49db-8629-80b5f5ca27e1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:46.738380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10d42bc5-a7a7-49db-8629-80b5f5ca27e1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:46.740264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10d42bc5-a7a7-49db-8629-80b5f5ca27e1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:46.741908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10d42bc5-a7a7-49db-8629-80b5f5ca27e1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:46.787672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f8b3a43d-9e07-4cbe-9825-d376172dba36 req-c1503190-4a89-489f-b1ad-9250e8ef0aee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "tag": "adbcc1ad-fe50-4a59-b11c-492a2b5fc035"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:46.816935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f8b3a43d-9e07-4cbe-9825-d376172dba36 req-c1503190-4a89-489f-b1ad-9250e8ef0aee service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:46.817429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f8b3a43d-9e07-4cbe-9825-d376172dba36 req-c1503190-4a89-489f-b1ad-9250e8ef0aee service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:46.818060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f8b3a43d-9e07-4cbe-9825-d376172dba36 req-c1503190-4a89-489f-b1ad-9250e8ef0aee service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:46.845810 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f8b3a43d-9e07-4cbe-9825-d376172dba36 req-c1503190-4a89-489f-b1ad-9250e8ef0aee service nova] Creating event network-changed:adbcc1ad-fe50-4a59-b11c-492a2b5fc035 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:45:46.856322 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f8b3a43d-9e07-4cbe-9825-d376172dba36 req-c1503190-4a89-489f-b1ad-9250e8ef0aee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074178 Oct 24 10:45:46.857788 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2210/4478] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:45:46.961926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-10d42bc5-a7a7-49db-8629-80b5f5ca27e1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:46.972389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-10d42bc5-a7a7-49db-8629-80b5f5ca27e1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:46.973871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-10d42bc5-a7a7-49db-8629-80b5f5ca27e1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:46.975061 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-10d42bc5-a7a7-49db-8629-80b5f5ca27e1 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1871 microversion: 2.42 time: 0.281838 Oct 24 10:45:46.975631 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2269/4479] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:46 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1871 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:47.116409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-61376e46-1def-46e8-9bd2-07856980c90c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:47.118588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-61376e46-1def-46e8-9bd2-07856980c90c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:47.130978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61376e46-1def-46e8-9bd2-07856980c90c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:47.132300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61376e46-1def-46e8-9bd2-07856980c90c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:47.133148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61376e46-1def-46e8-9bd2-07856980c90c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:47.135249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61376e46-1def-46e8-9bd2-07856980c90c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:47.135922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61376e46-1def-46e8-9bd2-07856980c90c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:47.137331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61376e46-1def-46e8-9bd2-07856980c90c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:47.179883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-566629ee-146f-4a9f-a47d-d119c9bcab7a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:47.180595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-566629ee-146f-4a9f-a47d-d119c9bcab7a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:47.194289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-566629ee-146f-4a9f-a47d-d119c9bcab7a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:47.195213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-566629ee-146f-4a9f-a47d-d119c9bcab7a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:47.195741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-566629ee-146f-4a9f-a47d-d119c9bcab7a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:47.196562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-566629ee-146f-4a9f-a47d-d119c9bcab7a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:47.197101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-566629ee-146f-4a9f-a47d-d119c9bcab7a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:47.197544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-566629ee-146f-4a9f-a47d-d119c9bcab7a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:47.273498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-566629ee-146f-4a9f-a47d-d119c9bcab7a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:47.273995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-566629ee-146f-4a9f-a47d-d119c9bcab7a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:47.274444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-566629ee-146f-4a9f-a47d-d119c9bcab7a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:47.275130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-566629ee-146f-4a9f-a47d-d119c9bcab7a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lazy-loading 'fault' on Instance uuid ab3cd53e-83ed-45b4-82ac-882fb65759f9 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:45:47.419236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-566629ee-146f-4a9f-a47d-d119c9bcab7a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:47.428251 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-566629ee-146f-4a9f-a47d-d119c9bcab7a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 200 len: 1299 microversion: 2.1 time: 0.252671 Oct 24 10:45:47.433470 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2270/4480] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:47 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 1299 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:45:47.474656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-83493c29-99ba-4b48-9613-1d212960db9c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:47.475690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-83493c29-99ba-4b48-9613-1d212960db9c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:47.482252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83493c29-99ba-4b48-9613-1d212960db9c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:47.482971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83493c29-99ba-4b48-9613-1d212960db9c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:47.483574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83493c29-99ba-4b48-9613-1d212960db9c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:47.484450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83493c29-99ba-4b48-9613-1d212960db9c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:47.485879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83493c29-99ba-4b48-9613-1d212960db9c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:47.486631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83493c29-99ba-4b48-9613-1d212960db9c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:47.708705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-61376e46-1def-46e8-9bd2-07856980c90c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:47.718470 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-61376e46-1def-46e8-9bd2-07856980c90c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.609950 Oct 24 10:45:47.724014 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2211/4481] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:47 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:47.799455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-83493c29-99ba-4b48-9613-1d212960db9c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:47.812294 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-83493c29-99ba-4b48-9613-1d212960db9c tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1506 microversion: 2.1 time: 0.341531 Oct 24 10:45:47.833861 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2271/4482] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:47 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:45:48.004025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8e2e1390-cf47-4e93-9f7c-932fea137c34 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:48.004701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8e2e1390-cf47-4e93-9f7c-932fea137c34 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:48.012402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e2e1390-cf47-4e93-9f7c-932fea137c34 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:48.013326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e2e1390-cf47-4e93-9f7c-932fea137c34 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:48.013947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e2e1390-cf47-4e93-9f7c-932fea137c34 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:48.014911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e2e1390-cf47-4e93-9f7c-932fea137c34 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:48.015377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e2e1390-cf47-4e93-9f7c-932fea137c34 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:48.016372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e2e1390-cf47-4e93-9f7c-932fea137c34 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:48.344964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8e2e1390-cf47-4e93-9f7c-932fea137c34 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:48.404496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8e2e1390-cf47-4e93-9f7c-932fea137c34 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:48.412724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8e2e1390-cf47-4e93-9f7c-932fea137c34 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:48.414459 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8e2e1390-cf47-4e93-9f7c-932fea137c34 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1871 microversion: 2.42 time: 0.414627 Oct 24 10:45:48.425198 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2212/4483] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:47 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1871 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:48.465591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a0c64794-0314-44fb-9e9a-231a4f6a1805 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:48.466659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a0c64794-0314-44fb-9e9a-231a4f6a1805 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:48.478710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0c64794-0314-44fb-9e9a-231a4f6a1805 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:48.479420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0c64794-0314-44fb-9e9a-231a4f6a1805 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:48.480063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0c64794-0314-44fb-9e9a-231a4f6a1805 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:48.481909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0c64794-0314-44fb-9e9a-231a4f6a1805 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:48.483165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0c64794-0314-44fb-9e9a-231a4f6a1805 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:48.485857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0c64794-0314-44fb-9e9a-231a4f6a1805 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:48.511409 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-a0c64794-0314-44fb-9e9a-231a4f6a1805 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 could not be found. Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a0c64794-0314-44fb-9e9a-231a4f6a1805 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 HTTP/1.1 Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 could not be found. Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'ab3cd53e-83ed-45b4-82ac-882fb65759f9'} Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 could not be found. Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 could not be found. Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:48.514741 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:48.521472 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:45:48.521472 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:45:48.521472 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:45:48.521472 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:45:48.521472 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 could not be found. Oct 24 10:45:48.521472 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:48.523778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a0c64794-0314-44fb-9e9a-231a4f6a1805 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:45:48.525263 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a0c64794-0314-44fb-9e9a-231a4f6a1805 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 404 len: 111 microversion: 2.1 time: 0.072027 Oct 24 10:45:48.530905 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2272/4484] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:48 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:45:48.534693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3f9bd5a3-ad47-458f-b426-19fdbc67b25d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:48.535194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3f9bd5a3-ad47-458f-b426-19fdbc67b25d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:48.550883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f9bd5a3-ad47-458f-b426-19fdbc67b25d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:48.551661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f9bd5a3-ad47-458f-b426-19fdbc67b25d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:48.552269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f9bd5a3-ad47-458f-b426-19fdbc67b25d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:48.553193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f9bd5a3-ad47-458f-b426-19fdbc67b25d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:48.553813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f9bd5a3-ad47-458f-b426-19fdbc67b25d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:48.554424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f9bd5a3-ad47-458f-b426-19fdbc67b25d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:48.600286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3f9bd5a3-ad47-458f-b426-19fdbc67b25d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:45:48.749367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d200e167-8b5a-46d6-bf5a-f5968f799161 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:48.750675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d200e167-8b5a-46d6-bf5a-f5968f799161 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:48.762325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d200e167-8b5a-46d6-bf5a-f5968f799161 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:48.763365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d200e167-8b5a-46d6-bf5a-f5968f799161 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:48.763365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d200e167-8b5a-46d6-bf5a-f5968f799161 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:48.769773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d200e167-8b5a-46d6-bf5a-f5968f799161 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:48.770499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d200e167-8b5a-46d6-bf5a-f5968f799161 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:48.771360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d200e167-8b5a-46d6-bf5a-f5968f799161 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:48.816862 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3f9bd5a3-ad47-458f-b426-19fdbc67b25d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 204 len: 0 microversion: 2.1 time: 0.286115 Oct 24 10:45:48.818723 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2213/4485] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:45:48 2022] DELETE /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 10:45:48.835325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fcf4fbc9-b703-4a95-bec2-6acc26fe00e9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:48.836174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fcf4fbc9-b703-4a95-bec2-6acc26fe00e9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:48.850625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcf4fbc9-b703-4a95-bec2-6acc26fe00e9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:48.852342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcf4fbc9-b703-4a95-bec2-6acc26fe00e9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:48.853090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcf4fbc9-b703-4a95-bec2-6acc26fe00e9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:48.856657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcf4fbc9-b703-4a95-bec2-6acc26fe00e9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:48.859466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcf4fbc9-b703-4a95-bec2-6acc26fe00e9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:48.860872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcf4fbc9-b703-4a95-bec2-6acc26fe00e9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:48.904553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:49.155431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d200e167-8b5a-46d6-bf5a-f5968f799161 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:49.167230 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d200e167-8b5a-46d6-bf5a-f5968f799161 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.421681 Oct 24 10:45:49.180914 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2273/4486] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:48 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:49.186232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ddaf84d1-2bb9-4a1e-ac7d-a200464ad878 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:49.187369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ddaf84d1-2bb9-4a1e-ac7d-a200464ad878 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:49.209644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaf84d1-2bb9-4a1e-ac7d-a200464ad878 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:49.210451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaf84d1-2bb9-4a1e-ac7d-a200464ad878 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:49.210901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaf84d1-2bb9-4a1e-ac7d-a200464ad878 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:49.211620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaf84d1-2bb9-4a1e-ac7d-a200464ad878 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:49.212252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaf84d1-2bb9-4a1e-ac7d-a200464ad878 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:49.212687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaf84d1-2bb9-4a1e-ac7d-a200464ad878 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:49.225567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fcf4fbc9-b703-4a95-bec2-6acc26fe00e9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:49.239434 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fcf4fbc9-b703-4a95-bec2-6acc26fe00e9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1496 microversion: 2.1 time: 0.414264 Oct 24 10:45:49.240049 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2214/4487] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:48 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1496 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:49.273566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-26430e5c-163b-4964-9e2b-ce8e82a8f0a6 req-4296549f-a905-42fb-a66f-90d59bfc79e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef69073c-f848-4be3-a21c-6d6627946be0", "name": "network-vif-deleted", "tag": "82680612-5807-44cd-9c6f-ccec951a1345"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:49.286194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-26430e5c-163b-4964-9e2b-ce8e82a8f0a6 req-4296549f-a905-42fb-a66f-90d59bfc79e3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:49.287017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-26430e5c-163b-4964-9e2b-ce8e82a8f0a6 req-4296549f-a905-42fb-a66f-90d59bfc79e3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:49.288084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-26430e5c-163b-4964-9e2b-ce8e82a8f0a6 req-4296549f-a905-42fb-a66f-90d59bfc79e3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:49.301199 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-26430e5c-163b-4964-9e2b-ce8e82a8f0a6 req-4296549f-a905-42fb-a66f-90d59bfc79e3 service nova] Creating event network-vif-deleted:82680612-5807-44cd-9c6f-ccec951a1345 for instance ef69073c-f848-4be3-a21c-6d6627946be0 on n-h2-858383-15 Oct 24 10:45:49.306809 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-26430e5c-163b-4964-9e2b-ce8e82a8f0a6 req-4296549f-a905-42fb-a66f-90d59bfc79e3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057899 Oct 24 10:45:49.308328 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2215/4488] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:45:49.316129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ddaf84d1-2bb9-4a1e-ac7d-a200464ad878 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:49.328969 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ddaf84d1-2bb9-4a1e-ac7d-a200464ad878 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1464 microversion: 2.1 time: 0.145969 Oct 24 10:45:49.335356 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2274/4489] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:49 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1464 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:49.451225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f3540070-f636-497f-b885-603f8846fee0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:49.455347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f3540070-f636-497f-b885-603f8846fee0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:49.465193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3540070-f636-497f-b885-603f8846fee0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:49.466770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3540070-f636-497f-b885-603f8846fee0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:49.468161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3540070-f636-497f-b885-603f8846fee0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:49.470301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3540070-f636-497f-b885-603f8846fee0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:49.472795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3540070-f636-497f-b885-603f8846fee0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:49.473552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3540070-f636-497f-b885-603f8846fee0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:49.783015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f3540070-f636-497f-b885-603f8846fee0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:49.799327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f3540070-f636-497f-b885-603f8846fee0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:49.801472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f3540070-f636-497f-b885-603f8846fee0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:49.803196 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f3540070-f636-497f-b885-603f8846fee0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1892 microversion: 2.42 time: 0.358232 Oct 24 10:45:49.805035 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2216/4490] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:49 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1892 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:50.194554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9df16402-4f67-4cdd-8934-cb5b6eee05ae tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:50.195767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9df16402-4f67-4cdd-8934-cb5b6eee05ae tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:50.203390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9df16402-4f67-4cdd-8934-cb5b6eee05ae tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:50.204242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9df16402-4f67-4cdd-8934-cb5b6eee05ae tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:50.205003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9df16402-4f67-4cdd-8934-cb5b6eee05ae tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:50.205871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9df16402-4f67-4cdd-8934-cb5b6eee05ae tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:50.206522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9df16402-4f67-4cdd-8934-cb5b6eee05ae tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:50.207101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9df16402-4f67-4cdd-8934-cb5b6eee05ae tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:50.266986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2cd22a0d-2739-4176-ac74-f6061f9e0f8a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:50.267646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2cd22a0d-2739-4176-ac74-f6061f9e0f8a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:50.275118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cd22a0d-2739-4176-ac74-f6061f9e0f8a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:50.275843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cd22a0d-2739-4176-ac74-f6061f9e0f8a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:50.276912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cd22a0d-2739-4176-ac74-f6061f9e0f8a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:50.277837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cd22a0d-2739-4176-ac74-f6061f9e0f8a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:50.278601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cd22a0d-2739-4176-ac74-f6061f9e0f8a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:50.279519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cd22a0d-2739-4176-ac74-f6061f9e0f8a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:50.938503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9df16402-4f67-4cdd-8934-cb5b6eee05ae tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:50.959683 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9df16402-4f67-4cdd-8934-cb5b6eee05ae tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.771669 Oct 24 10:45:50.960547 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2275/4491] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:50 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:50.976808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-497e4bd2-9120-4dd4-bd2d-dea55ed73259 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:50.977660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-497e4bd2-9120-4dd4-bd2d-dea55ed73259 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:50.986662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-497e4bd2-9120-4dd4-bd2d-dea55ed73259 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:50.987169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-497e4bd2-9120-4dd4-bd2d-dea55ed73259 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:50.987622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-497e4bd2-9120-4dd4-bd2d-dea55ed73259 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:50.988347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-497e4bd2-9120-4dd4-bd2d-dea55ed73259 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:50.988813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-497e4bd2-9120-4dd4-bd2d-dea55ed73259 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:50.997544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-497e4bd2-9120-4dd4-bd2d-dea55ed73259 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:51.058830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2cd22a0d-2739-4176-ac74-f6061f9e0f8a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:51.074471 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2cd22a0d-2739-4176-ac74-f6061f9e0f8a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1496 microversion: 2.1 time: 0.809329 Oct 24 10:45:51.076153 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2217/4492] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:50 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1496 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:51.081677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-607163d5-aa16-4473-bc69-e3fea5180c3b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:51.082716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-607163d5-aa16-4473-bc69-e3fea5180c3b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:51.092155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-607163d5-aa16-4473-bc69-e3fea5180c3b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:51.097133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-497e4bd2-9120-4dd4-bd2d-dea55ed73259 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:51.097655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-497e4bd2-9120-4dd4-bd2d-dea55ed73259 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:51.098085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-497e4bd2-9120-4dd4-bd2d-dea55ed73259 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:51.098543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-497e4bd2-9120-4dd4-bd2d-dea55ed73259 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lazy-loading 'fault' on Instance uuid ef69073c-f848-4be3-a21c-6d6627946be0 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:45:51.104972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-607163d5-aa16-4473-bc69-e3fea5180c3b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:51.107684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-607163d5-aa16-4473-bc69-e3fea5180c3b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:51.109257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-607163d5-aa16-4473-bc69-e3fea5180c3b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:51.111198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-607163d5-aa16-4473-bc69-e3fea5180c3b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:51.111836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-607163d5-aa16-4473-bc69-e3fea5180c3b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:51.336036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-497e4bd2-9120-4dd4-bd2d-dea55ed73259 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:51.348257 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-497e4bd2-9120-4dd4-bd2d-dea55ed73259 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 200 len: 1304 microversion: 2.1 time: 0.386834 Oct 24 10:45:51.356001 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2276/4493] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:50 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 1304 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:51.362242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-2979edb4-4e9c-4eea-ad23-209a16602553 req-97d3fc13-b7ec-4386-bf33-413cc4fe194f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "tag": "87b48d2c-81df-4477-a1f6-2e67350bc815"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:51.379633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2979edb4-4e9c-4eea-ad23-209a16602553 req-97d3fc13-b7ec-4386-bf33-413cc4fe194f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:51.380771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2979edb4-4e9c-4eea-ad23-209a16602553 req-97d3fc13-b7ec-4386-bf33-413cc4fe194f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:51.385334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2979edb4-4e9c-4eea-ad23-209a16602553 req-97d3fc13-b7ec-4386-bf33-413cc4fe194f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:51.419795 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-2979edb4-4e9c-4eea-ad23-209a16602553 req-97d3fc13-b7ec-4386-bf33-413cc4fe194f service nova] Creating event network-changed:87b48d2c-81df-4477-a1f6-2e67350bc815 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:45:51.438458 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-2979edb4-4e9c-4eea-ad23-209a16602553 req-97d3fc13-b7ec-4386-bf33-413cc4fe194f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078691 Oct 24 10:45:51.439821 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2277/4494] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:45:51.503423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-607163d5-aa16-4473-bc69-e3fea5180c3b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:51.536131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-607163d5-aa16-4473-bc69-e3fea5180c3b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:51.538429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-607163d5-aa16-4473-bc69-e3fea5180c3b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:51.540327 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-607163d5-aa16-4473-bc69-e3fea5180c3b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.462833 Oct 24 10:45:51.541105 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2218/4495] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:51 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:52.003210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9cb9b188-66cd-4215-8ee3-56c392d67f8e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:52.004248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9cb9b188-66cd-4215-8ee3-56c392d67f8e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:52.017439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cb9b188-66cd-4215-8ee3-56c392d67f8e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:52.019061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cb9b188-66cd-4215-8ee3-56c392d67f8e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:52.020420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cb9b188-66cd-4215-8ee3-56c392d67f8e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:52.021485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cb9b188-66cd-4215-8ee3-56c392d67f8e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:52.028356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cb9b188-66cd-4215-8ee3-56c392d67f8e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:52.029108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cb9b188-66cd-4215-8ee3-56c392d67f8e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:52.099155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f8e8ca5a-726e-499e-a3e3-989173add096 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:52.101402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f8e8ca5a-726e-499e-a3e3-989173add096 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:52.111255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8e8ca5a-726e-499e-a3e3-989173add096 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:52.112328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8e8ca5a-726e-499e-a3e3-989173add096 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:52.113049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8e8ca5a-726e-499e-a3e3-989173add096 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:52.114064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8e8ca5a-726e-499e-a3e3-989173add096 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:52.114894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8e8ca5a-726e-499e-a3e3-989173add096 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:52.115676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8e8ca5a-726e-499e-a3e3-989173add096 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:52.410613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9cb9b188-66cd-4215-8ee3-56c392d67f8e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:52.425582 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9cb9b188-66cd-4215-8ee3-56c392d67f8e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.432219 Oct 24 10:45:52.429074 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2278/4496] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:51 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:52.437387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0df3b1c0-869d-4243-90b6-2fa19c55017d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:52.439649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0df3b1c0-869d-4243-90b6-2fa19c55017d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: ef69073c-f848-4be3-a21c-6d6627946be0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:52.458224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0df3b1c0-869d-4243-90b6-2fa19c55017d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:52.462995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0df3b1c0-869d-4243-90b6-2fa19c55017d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:52.463564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0df3b1c0-869d-4243-90b6-2fa19c55017d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:52.464432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0df3b1c0-869d-4243-90b6-2fa19c55017d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:52.465032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0df3b1c0-869d-4243-90b6-2fa19c55017d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:52.465564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0df3b1c0-869d-4243-90b6-2fa19c55017d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:52.490431 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-0df3b1c0-869d-4243-90b6-2fa19c55017d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] HTTP exception thrown: Instance ef69073c-f848-4be3-a21c-6d6627946be0 could not be found. Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0df3b1c0-869d-4243-90b6-2fa19c55017d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Request method failure captured: Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 HTTP/1.1 Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmxOBe99phtxX9YbSmesfnmHtxzqQPeHinmeGsnZYttpTFCHetPHYHnIHmEMdvBv9ZoVH9o-M9Jt_E157pVWcBX8R_7FisKLTtY8L3jQAdkuwNPAivy8T9UD8cZDHc_JxTbqC-dT66OeiKvkAQ4iR-MYVR5kM6NJDS4GaMyMmxlhTYY Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: f4bbfd7373694648a1f5c4fb8cdace06 Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerRescueTestJSON-611162556 Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f4bbfd7373694648a1f5c4fb8cdace06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f4bbfd7373694648a1f5c4fb8cdace06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f4bbfd7373694648a1f5c4fb8cdace06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f4bbfd7373694648a1f5c4fb8cdace06", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerRescueTestJSON-611162556 Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: f4bbfd7373694648a1f5c4fb8cdace06 Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerRescueTestJSON-611162556 Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerRescueTestJSON-611162556-project Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 2fa246e48f904d058d451542c0763880 Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerRescueTestJSON-611162556-project Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance ef69073c-f848-4be3-a21c-6d6627946be0 could not be found. Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'ef69073c-f848-4be3-a21c-6d6627946be0'} Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef69073c-f848-4be3-a21c-6d6627946be0 could not be found. Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef69073c-f848-4be3-a21c-6d6627946be0 could not be found. Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:45:52.493215 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:52.499093 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:52.499093 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:45:52.499093 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:45:52.499093 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:45:52.499093 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:45:52.499093 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef69073c-f848-4be3-a21c-6d6627946be0 could not be found. Oct 24 10:45:52.499093 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:52.515076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0df3b1c0-869d-4243-90b6-2fa19c55017d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Returning 404 to user: Instance ef69073c-f848-4be3-a21c-6d6627946be0 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:45:52.517493 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0df3b1c0-869d-4243-90b6-2fa19c55017d tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0" status: 404 len: 111 microversion: 2.1 time: 0.085987 Oct 24 10:45:52.519639 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2279/4497] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:52 2022] GET /compute/v2.1/servers/ef69073c-f848-4be3-a21c-6d6627946be0 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:45:52.534109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d6478644-e1cd-40f0-8750-7fed27214eac tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:52.537070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d6478644-e1cd-40f0-8750-7fed27214eac tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:52.540679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f8e8ca5a-726e-499e-a3e3-989173add096 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:52.552808 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f8e8ca5a-726e-499e-a3e3-989173add096 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 200 len: 1496 microversion: 2.1 time: 0.457423 Oct 24 10:45:52.554907 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2219/4498] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:52 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 1496 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:52.572671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6478644-e1cd-40f0-8750-7fed27214eac tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:52.573648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6478644-e1cd-40f0-8750-7fed27214eac tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:52.574312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6478644-e1cd-40f0-8750-7fed27214eac tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:52.580728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6478644-e1cd-40f0-8750-7fed27214eac tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:52.581555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6478644-e1cd-40f0-8750-7fed27214eac tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:52.582963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf42dfde-72dd-4d06-9f48-54411a3372f6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:52.583998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6478644-e1cd-40f0-8750-7fed27214eac tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:52.585788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bf42dfde-72dd-4d06-9f48-54411a3372f6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:52.599561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf42dfde-72dd-4d06-9f48-54411a3372f6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:52.601980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf42dfde-72dd-4d06-9f48-54411a3372f6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:52.603387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf42dfde-72dd-4d06-9f48-54411a3372f6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:52.605637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf42dfde-72dd-4d06-9f48-54411a3372f6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:52.608766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf42dfde-72dd-4d06-9f48-54411a3372f6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:52.610297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf42dfde-72dd-4d06-9f48-54411a3372f6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:52.670876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d6478644-e1cd-40f0-8750-7fed27214eac tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:45:52.733542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:52.869804 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d6478644-e1cd-40f0-8750-7fed27214eac tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 204 len: 0 microversion: 2.1 time: 0.345535 Oct 24 10:45:52.870944 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2280/4499] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:45:52 2022] DELETE /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:45:52.881988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4ca6f8ce-9897-4bef-8f62-0666636fe37b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:52.884451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4ca6f8ce-9897-4bef-8f62-0666636fe37b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:52.900356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ca6f8ce-9897-4bef-8f62-0666636fe37b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:52.902527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ca6f8ce-9897-4bef-8f62-0666636fe37b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:52.904056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ca6f8ce-9897-4bef-8f62-0666636fe37b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:52.906021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ca6f8ce-9897-4bef-8f62-0666636fe37b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:52.907123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ca6f8ce-9897-4bef-8f62-0666636fe37b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:52.907608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ca6f8ce-9897-4bef-8f62-0666636fe37b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:53.212365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bf42dfde-72dd-4d06-9f48-54411a3372f6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:53.246054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bf42dfde-72dd-4d06-9f48-54411a3372f6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:53.248872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bf42dfde-72dd-4d06-9f48-54411a3372f6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:53.251447 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bf42dfde-72dd-4d06-9f48-54411a3372f6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.680045 Oct 24 10:45:53.252608 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2220/4500] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:52 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:53.457979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aef8da9d-b646-426e-a0e8-c0ff8a078cca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:53.458663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aef8da9d-b646-426e-a0e8-c0ff8a078cca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:53.484308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aef8da9d-b646-426e-a0e8-c0ff8a078cca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:53.485291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aef8da9d-b646-426e-a0e8-c0ff8a078cca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:53.485758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aef8da9d-b646-426e-a0e8-c0ff8a078cca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:53.486528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aef8da9d-b646-426e-a0e8-c0ff8a078cca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:53.486986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aef8da9d-b646-426e-a0e8-c0ff8a078cca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:53.487426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aef8da9d-b646-426e-a0e8-c0ff8a078cca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:53.628240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4ca6f8ce-9897-4bef-8f62-0666636fe37b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:53.640043 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4ca6f8ce-9897-4bef-8f62-0666636fe37b tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1491 microversion: 2.1 time: 0.764644 Oct 24 10:45:53.640551 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2281/4501] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:52 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1491 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:45:53.645994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-8838f9e2-f5b7-4469-9b3e-7ab8f73890b7 req-419a4f0a-7201-41af-8610-31074924339a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7d1046-0eb6-43eb-b688-650eb6f4f6fc", "name": "network-vif-deleted", "tag": "3ba79e67-e8f1-47d0-bb0d-164e47b7818e"}, {"name": "network-changed", "server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "tag": "f00b7439-3b57-4199-889a-94171e92eec2"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:53.675933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8838f9e2-f5b7-4469-9b3e-7ab8f73890b7 req-419a4f0a-7201-41af-8610-31074924339a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:53.676418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8838f9e2-f5b7-4469-9b3e-7ab8f73890b7 req-419a4f0a-7201-41af-8610-31074924339a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:53.676910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8838f9e2-f5b7-4469-9b3e-7ab8f73890b7 req-419a4f0a-7201-41af-8610-31074924339a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:53.692253 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-8838f9e2-f5b7-4469-9b3e-7ab8f73890b7 req-419a4f0a-7201-41af-8610-31074924339a service nova] Creating event network-vif-deleted:3ba79e67-e8f1-47d0-bb0d-164e47b7818e for instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc on n-h2-858383-15 Oct 24 10:45:53.693001 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-8838f9e2-f5b7-4469-9b3e-7ab8f73890b7 req-419a4f0a-7201-41af-8610-31074924339a service nova] Creating event network-changed:f00b7439-3b57-4199-889a-94171e92eec2 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:45:53.701663 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-8838f9e2-f5b7-4469-9b3e-7ab8f73890b7 req-419a4f0a-7201-41af-8610-31074924339a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058851 Oct 24 10:45:53.704448 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2282/4502] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:45:53.710823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1f28b600-ec2f-4168-813c-44a3b8afebed tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:53.711851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1f28b600-ec2f-4168-813c-44a3b8afebed tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:53.723434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f28b600-ec2f-4168-813c-44a3b8afebed tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:53.723931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f28b600-ec2f-4168-813c-44a3b8afebed tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:53.724381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f28b600-ec2f-4168-813c-44a3b8afebed tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:53.726013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f28b600-ec2f-4168-813c-44a3b8afebed tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:53.745517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f28b600-ec2f-4168-813c-44a3b8afebed tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:53.746390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f28b600-ec2f-4168-813c-44a3b8afebed tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:53.770420 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-1f28b600-ec2f-4168-813c-44a3b8afebed tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc could not be found. Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1f28b600-ec2f-4168-813c-44a3b8afebed tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc HTTP/1.1 Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc could not be found. Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'bb7d1046-0eb6-43eb-b688-650eb6f4f6fc'} Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc could not be found. Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc could not be found. Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:53.772170 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:53.776900 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:45:53.776900 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:45:53.776900 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:45:53.776900 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:45:53.776900 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc could not be found. Oct 24 10:45:53.776900 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:45:53.776900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1f28b600-ec2f-4168-813c-44a3b8afebed tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:45:53.776900 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1f28b600-ec2f-4168-813c-44a3b8afebed tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 404 len: 111 microversion: 2.1 time: 0.067792 Oct 24 10:45:53.776900 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2283/4503] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:53 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:45:53.942424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c295458a-a9d1-4850-aed3-41d6478f8e35 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1916950578", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "734fc132-fff0-4bf7-9775-3a17fdcd25dc"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:54.024328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-c295458a-a9d1-4850-aed3-41d6478f8e35 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] validate_networks() for [('734fc132-fff0-4bf7-9775-3a17fdcd25dc', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:45:54.046794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aef8da9d-b646-426e-a0e8-c0ff8a078cca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:54.057069 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aef8da9d-b646-426e-a0e8-c0ff8a078cca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.605259 Oct 24 10:45:54.072418 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2221/4504] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:53 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:54.283170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d7f9d069-b08a-4779-a966-d93b7fbd2cad tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:54.284849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d7f9d069-b08a-4779-a966-d93b7fbd2cad tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:54.291504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7f9d069-b08a-4779-a966-d93b7fbd2cad tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:54.292044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7f9d069-b08a-4779-a966-d93b7fbd2cad tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:54.292494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7f9d069-b08a-4779-a966-d93b7fbd2cad tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:54.293238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7f9d069-b08a-4779-a966-d93b7fbd2cad tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:54.293699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7f9d069-b08a-4779-a966-d93b7fbd2cad tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:54.294126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7f9d069-b08a-4779-a966-d93b7fbd2cad tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:54.882808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d7f9d069-b08a-4779-a966-d93b7fbd2cad tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:54.894437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d7f9d069-b08a-4779-a966-d93b7fbd2cad tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:54.896196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d7f9d069-b08a-4779-a966-d93b7fbd2cad tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:54.897491 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d7f9d069-b08a-4779-a966-d93b7fbd2cad tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.618826 Oct 24 10:45:54.898131 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2222/4505] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:54 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:54.902887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-53743367-fe9a-4177-95ef-8983d3e2e7c9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:54.903569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-53743367-fe9a-4177-95ef-8983d3e2e7c9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:54.910360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53743367-fe9a-4177-95ef-8983d3e2e7c9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:54.911037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53743367-fe9a-4177-95ef-8983d3e2e7c9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:54.911549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53743367-fe9a-4177-95ef-8983d3e2e7c9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:54.912469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53743367-fe9a-4177-95ef-8983d3e2e7c9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:54.913140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53743367-fe9a-4177-95ef-8983d3e2e7c9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:54.913633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-53743367-fe9a-4177-95ef-8983d3e2e7c9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:55.060640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-c295458a-a9d1-4850-aed3-41d6478f8e35 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:45:55.062092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-c295458a-a9d1-4850-aed3-41d6478f8e35 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:45:55.064359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-c295458a-a9d1-4850-aed3-41d6478f8e35 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:45:55.065111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-c295458a-a9d1-4850-aed3-41d6478f8e35 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:45:55.065779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-c295458a-a9d1-4850-aed3-41d6478f8e35 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:45:55.078363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c295458a-a9d1-4850-aed3-41d6478f8e35 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:55.081270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c295458a-a9d1-4850-aed3-41d6478f8e35 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:55.082642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c295458a-a9d1-4850-aed3-41d6478f8e35 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:55.084152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c295458a-a9d1-4850-aed3-41d6478f8e35 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:55.084950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c295458a-a9d1-4850-aed3-41d6478f8e35 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:55.085593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c295458a-a9d1-4850-aed3-41d6478f8e35 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:55.122509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-c295458a-a9d1-4850-aed3-41d6478f8e35 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Getting quotas for project 9ab3028765ba447589bf595a603ea2e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:45:55.147685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-c295458a-a9d1-4850-aed3-41d6478f8e35 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Getting quotas for user ed058a5e8ac14236ab2e8783e9170346 and project 9ab3028765ba447589bf595a603ea2e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:45:55.166364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c295458a-a9d1-4850-aed3-41d6478f8e35 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:45:55.169203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c295458a-a9d1-4850-aed3-41d6478f8e35 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:45:55.270458 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c295458a-a9d1-4850-aed3-41d6478f8e35 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.332986 Oct 24 10:45:55.281192 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2284/4506] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:45:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:45:55.296608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b12cffc0-cc80-4c54-89e4-245e9950de3c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:55.298640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b12cffc0-cc80-4c54-89e4-245e9950de3c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:55.308079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b12cffc0-cc80-4c54-89e4-245e9950de3c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:55.308704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b12cffc0-cc80-4c54-89e4-245e9950de3c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:55.309293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b12cffc0-cc80-4c54-89e4-245e9950de3c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:55.312136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b12cffc0-cc80-4c54-89e4-245e9950de3c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:55.313151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b12cffc0-cc80-4c54-89e4-245e9950de3c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:55.313931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b12cffc0-cc80-4c54-89e4-245e9950de3c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:56.023550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-53743367-fe9a-4177-95ef-8983d3e2e7c9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:56.031690 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-53743367-fe9a-4177-95ef-8983d3e2e7c9 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1491 microversion: 2.1 time: 1.132286 Oct 24 10:45:56.032497 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2223/4507] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:54 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1491 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:56.037708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b12cffc0-cc80-4c54-89e4-245e9950de3c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:56.049017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3ea616cf-4385-4f31-bd66-e43abb107ade tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:56.050737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3ea616cf-4385-4f31-bd66-e43abb107ade tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:56.058937 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b12cffc0-cc80-4c54-89e4-245e9950de3c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.775358 Oct 24 10:45:56.060154 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2285/4508] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:55 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:56.065653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-caa9326b-a99d-4c74-88e0-3ddcb2b34e78 req-365a4cd3-6a68-45c3-8211-9e70e6e1ad1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "tag": "cd46ad50-24e5-4e89-b061-174efa4e9061"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:56.073977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ea616cf-4385-4f31-bd66-e43abb107ade tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:56.077834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ea616cf-4385-4f31-bd66-e43abb107ade tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:56.079361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ea616cf-4385-4f31-bd66-e43abb107ade tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:56.080214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ea616cf-4385-4f31-bd66-e43abb107ade tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:56.080678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ea616cf-4385-4f31-bd66-e43abb107ade tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:56.085594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ea616cf-4385-4f31-bd66-e43abb107ade tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:56.095330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-caa9326b-a99d-4c74-88e0-3ddcb2b34e78 req-365a4cd3-6a68-45c3-8211-9e70e6e1ad1b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:56.102486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-caa9326b-a99d-4c74-88e0-3ddcb2b34e78 req-365a4cd3-6a68-45c3-8211-9e70e6e1ad1b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:56.103038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-caa9326b-a99d-4c74-88e0-3ddcb2b34e78 req-365a4cd3-6a68-45c3-8211-9e70e6e1ad1b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:56.132506 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-caa9326b-a99d-4c74-88e0-3ddcb2b34e78 req-365a4cd3-6a68-45c3-8211-9e70e6e1ad1b service nova] Creating event network-changed:cd46ad50-24e5-4e89-b061-174efa4e9061 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:45:56.141575 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-caa9326b-a99d-4c74-88e0-3ddcb2b34e78 req-365a4cd3-6a68-45c3-8211-9e70e6e1ad1b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078170 Oct 24 10:45:56.146570 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2286/4509] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:45:56.154110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3a2fea6a-8331-40e4-ad38-eac03e598594 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:56.155078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3a2fea6a-8331-40e4-ad38-eac03e598594 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:56.162709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a2fea6a-8331-40e4-ad38-eac03e598594 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:56.163509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a2fea6a-8331-40e4-ad38-eac03e598594 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:56.164137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a2fea6a-8331-40e4-ad38-eac03e598594 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:56.165058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a2fea6a-8331-40e4-ad38-eac03e598594 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:56.165782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a2fea6a-8331-40e4-ad38-eac03e598594 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:56.166436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a2fea6a-8331-40e4-ad38-eac03e598594 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:56.390214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3ea616cf-4385-4f31-bd66-e43abb107ade tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:56.401052 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3ea616cf-4385-4f31-bd66-e43abb107ade tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 200 len: 1205 microversion: 2.1 time: 0.367122 Oct 24 10:45:56.402154 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2224/4510] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:56 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 1205 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:56.828025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3a2fea6a-8331-40e4-ad38-eac03e598594 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:56.843140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3a2fea6a-8331-40e4-ad38-eac03e598594 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:56.845867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3a2fea6a-8331-40e4-ad38-eac03e598594 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:56.847375 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3a2fea6a-8331-40e4-ad38-eac03e598594 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.699436 Oct 24 10:45:56.848303 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2287/4511] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:56 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:57.058184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9cb9114-9185-44b6-8f5c-72ee3b4a1129 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:57.058792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f9cb9114-9185-44b6-8f5c-72ee3b4a1129 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:57.067339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9cb9114-9185-44b6-8f5c-72ee3b4a1129 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:57.068172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9cb9114-9185-44b6-8f5c-72ee3b4a1129 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:57.069123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9cb9114-9185-44b6-8f5c-72ee3b4a1129 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:57.070051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9cb9114-9185-44b6-8f5c-72ee3b4a1129 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:57.071560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9cb9114-9185-44b6-8f5c-72ee3b4a1129 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:57.072222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9cb9114-9185-44b6-8f5c-72ee3b4a1129 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:57.085467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-de2b96d5-cda1-46bb-8c9c-b22135283649 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:57.087572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-de2b96d5-cda1-46bb-8c9c-b22135283649 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:57.090873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:57.108814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de2b96d5-cda1-46bb-8c9c-b22135283649 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:57.113012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de2b96d5-cda1-46bb-8c9c-b22135283649 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:57.113712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de2b96d5-cda1-46bb-8c9c-b22135283649 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:57.127331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de2b96d5-cda1-46bb-8c9c-b22135283649 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:57.128361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de2b96d5-cda1-46bb-8c9c-b22135283649 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:57.128949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de2b96d5-cda1-46bb-8c9c-b22135283649 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:57.332049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f9cb9114-9185-44b6-8f5c-72ee3b4a1129 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fa246e48f904d058d451542c0763880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbfd7373694648a1f5c4fb8cdace06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:57.341335 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f9cb9114-9185-44b6-8f5c-72ee3b4a1129 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 200 len: 1449 microversion: 2.1 time: 0.287029 Oct 24 10:45:57.342003 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2225/4512] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:57 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 1449 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:57.360900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-22e8bb38-203f-4d86-ad6e-61f45401829c req-166b0079-b4a0-4b60-9240-44ff70f81e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8024a63d-01f0-45d1-81c2-99c962acee10", "name": "network-vif-deleted", "tag": "1e175526-806a-4cdd-9347-5e7224e1da5e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:57.387985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-22e8bb38-203f-4d86-ad6e-61f45401829c req-166b0079-b4a0-4b60-9240-44ff70f81e91 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:57.391046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-22e8bb38-203f-4d86-ad6e-61f45401829c req-166b0079-b4a0-4b60-9240-44ff70f81e91 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:57.393637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-22e8bb38-203f-4d86-ad6e-61f45401829c req-166b0079-b4a0-4b60-9240-44ff70f81e91 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:57.426532 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-22e8bb38-203f-4d86-ad6e-61f45401829c req-166b0079-b4a0-4b60-9240-44ff70f81e91 service nova] Creating event network-vif-deleted:1e175526-806a-4cdd-9347-5e7224e1da5e for instance 8024a63d-01f0-45d1-81c2-99c962acee10 on n-h1-858383-15 Oct 24 10:45:57.434652 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-22e8bb38-203f-4d86-ad6e-61f45401829c req-166b0079-b4a0-4b60-9240-44ff70f81e91 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080337 Oct 24 10:45:57.438039 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2226/4513] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:45:57.460540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fc26b6d6-5eff-4d30-b388-64ca7c59d2a7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:57.461099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fc26b6d6-5eff-4d30-b388-64ca7c59d2a7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:57.467697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc26b6d6-5eff-4d30-b388-64ca7c59d2a7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:57.468398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc26b6d6-5eff-4d30-b388-64ca7c59d2a7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:57.469665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc26b6d6-5eff-4d30-b388-64ca7c59d2a7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:57.470651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc26b6d6-5eff-4d30-b388-64ca7c59d2a7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:57.471287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc26b6d6-5eff-4d30-b388-64ca7c59d2a7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:57.471895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc26b6d6-5eff-4d30-b388-64ca7c59d2a7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:57.530005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-de2b96d5-cda1-46bb-8c9c-b22135283649 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:57.547723 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-de2b96d5-cda1-46bb-8c9c-b22135283649 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.465107 Oct 24 10:45:57.550301 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2288/4514] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:57 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:45:57.605969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fc26b6d6-5eff-4d30-b388-64ca7c59d2a7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:57.617593 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fc26b6d6-5eff-4d30-b388-64ca7c59d2a7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 200 len: 1267 microversion: 2.1 time: 0.172692 Oct 24 10:45:57.620984 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2227/4515] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:57 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:57.706267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-162461757", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "ec07ac35-7af1-4aa1-9715-c43024069832"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:57.776815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] validate_networks() for [('ec07ac35-7af1-4aa1-9715-c43024069832', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:45:57.907752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5a0c59a3-7c6d-4336-81ae-f91b0c4c6281 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:57.910486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5a0c59a3-7c6d-4336-81ae-f91b0c4c6281 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:57.927650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a0c59a3-7c6d-4336-81ae-f91b0c4c6281 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:57.929861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a0c59a3-7c6d-4336-81ae-f91b0c4c6281 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:57.930739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a0c59a3-7c6d-4336-81ae-f91b0c4c6281 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:57.932506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a0c59a3-7c6d-4336-81ae-f91b0c4c6281 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:57.933657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a0c59a3-7c6d-4336-81ae-f91b0c4c6281 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:57.935890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a0c59a3-7c6d-4336-81ae-f91b0c4c6281 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:58.318832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5a0c59a3-7c6d-4336-81ae-f91b0c4c6281 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:58.333566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5a0c59a3-7c6d-4336-81ae-f91b0c4c6281 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:58.335623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5a0c59a3-7c6d-4336-81ae-f91b0c4c6281 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:58.338691 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5a0c59a3-7c6d-4336-81ae-f91b0c4c6281 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.467542 Oct 24 10:45:58.340029 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2228/4516] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:57 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:45:58.345646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c480ddee-ac0f-4ffa-a7ab-7982b1a379d9 req-5d256308-118f-4ebc-9642-7ec797015baa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "tag": "6edc1d11-d1ae-4161-a5c2-9e721c334352"}, {"name": "network-changed", "server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "tag": "3e53a27e-13fd-4b03-87fb-f257a770ce85"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:45:58.359351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c480ddee-ac0f-4ffa-a7ab-7982b1a379d9 req-5d256308-118f-4ebc-9642-7ec797015baa service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:58.360826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c480ddee-ac0f-4ffa-a7ab-7982b1a379d9 req-5d256308-118f-4ebc-9642-7ec797015baa service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:58.361800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c480ddee-ac0f-4ffa-a7ab-7982b1a379d9 req-5d256308-118f-4ebc-9642-7ec797015baa service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:58.378898 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c480ddee-ac0f-4ffa-a7ab-7982b1a379d9 req-5d256308-118f-4ebc-9642-7ec797015baa service nova] Creating event network-changed:6edc1d11-d1ae-4161-a5c2-9e721c334352 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:45:58.379724 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c480ddee-ac0f-4ffa-a7ab-7982b1a379d9 req-5d256308-118f-4ebc-9642-7ec797015baa service nova] Creating event network-changed:3e53a27e-13fd-4b03-87fb-f257a770ce85 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:45:58.387261 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c480ddee-ac0f-4ffa-a7ab-7982b1a379d9 req-5d256308-118f-4ebc-9642-7ec797015baa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045336 Oct 24 10:45:58.388656 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2229/4517] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:45:58.401587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9b766407-9694-42c1-83b7-1236b0aea929 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:58.402553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9b766407-9694-42c1-83b7-1236b0aea929 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] [instance: 8024a63d-01f0-45d1-81c2-99c962acee10] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:58.412238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b766407-9694-42c1-83b7-1236b0aea929 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:58.414803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b766407-9694-42c1-83b7-1236b0aea929 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:58.416657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b766407-9694-42c1-83b7-1236b0aea929 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:58.419721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b766407-9694-42c1-83b7-1236b0aea929 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:58.420999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b766407-9694-42c1-83b7-1236b0aea929 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:58.423435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b766407-9694-42c1-83b7-1236b0aea929 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:58.462502 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-9b766407-9694-42c1-83b7-1236b0aea929 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] HTTP exception thrown: Instance 8024a63d-01f0-45d1-81c2-99c962acee10 could not be found. Oct 24 10:45:58.469198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9b766407-9694-42c1-83b7-1236b0aea929 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Request method failure captured: Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 HTTP/1.1 Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmxOBe99phtxX9YbSmesfnmHtxzqQPeHinmeGsnZYttpTFCHetPHYHnIHmEMdvBv9ZoVH9o-M9Jt_E157pVWcBX8R_7FisKLTtY8L3jQAdkuwNPAivy8T9UD8cZDHc_JxTbqC-dT66OeiKvkAQ4iR-MYVR5kM6NJDS4GaMyMmxlhTYY Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: f4bbfd7373694648a1f5c4fb8cdace06 Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerRescueTestJSON-611162556 Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f4bbfd7373694648a1f5c4fb8cdace06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f4bbfd7373694648a1f5c4fb8cdace06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f4bbfd7373694648a1f5c4fb8cdace06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f4bbfd7373694648a1f5c4fb8cdace06", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerRescueTestJSON-611162556 Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: f4bbfd7373694648a1f5c4fb8cdace06 Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerRescueTestJSON-611162556 Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerRescueTestJSON-611162556-project Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2fa246e48f904d058d451542c0763880 Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerRescueTestJSON-611162556-project Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 8024a63d-01f0-45d1-81c2-99c962acee10 could not be found. Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '8024a63d-01f0-45d1-81c2-99c962acee10'} Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8024a63d-01f0-45d1-81c2-99c962acee10 could not be found. Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8024a63d-01f0-45d1-81c2-99c962acee10 could not be found. Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:45:58.469706 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:45:58.473943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:45:58.473943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:45:58.473943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:45:58.473943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:45:58.473943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:45:58.473943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8024a63d-01f0-45d1-81c2-99c962acee10 could not be found. Oct 24 10:45:58.473943 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:45:58.473943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9b766407-9694-42c1-83b7-1236b0aea929 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] Returning 404 to user: Instance 8024a63d-01f0-45d1-81c2-99c962acee10 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:45:58.473943 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9b766407-9694-42c1-83b7-1236b0aea929 tempest-ServerRescueTestJSON-611162556 tempest-ServerRescueTestJSON-611162556-project] 10.222.0.50 "GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10" status: 404 len: 111 microversion: 2.1 time: 0.082276 Oct 24 10:45:58.475974 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2230/4518] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:58 2022] GET /compute/v2.1/servers/8024a63d-01f0-45d1-81c2-99c962acee10 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:45:58.477166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:45:58.478109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:45:58.478758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:45:58.479419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:45:58.495956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:58.498879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:58.499807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:58.503268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:58.504050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:58.504718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:58.533740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Getting quotas for project 51b48ea9adbe4711a3043add98c14ddb. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:45:58.544079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Getting quotas for user 9e32135e900a4b92b6fd23f458ba1d9d and project 51b48ea9adbe4711a3043add98c14ddb. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:45:58.562684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Going to run 2 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:45:58.565889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: 1cbddb45-3136-46ce-970e-0a056283a032] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:45:58.576251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ada5d4d1-42cc-4462-b3cf-3ea0c683be33 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:58.577982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ada5d4d1-42cc-4462-b3cf-3ea0c683be33 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:58.588775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ada5d4d1-42cc-4462-b3cf-3ea0c683be33 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:58.590786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ada5d4d1-42cc-4462-b3cf-3ea0c683be33 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:58.593668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ada5d4d1-42cc-4462-b3cf-3ea0c683be33 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:58.596243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ada5d4d1-42cc-4462-b3cf-3ea0c683be33 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:58.598732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ada5d4d1-42cc-4462-b3cf-3ea0c683be33 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:58.599546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ada5d4d1-42cc-4462-b3cf-3ea0c683be33 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:58.647776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=1cbddb45-3136-46ce-970e-0a056283a032,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:45:58.790476 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-efd575c6-a793-4cdf-a168-b1269e88969c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.238535 Oct 24 10:45:58.797856 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2289/4519] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:45:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:45:58.815072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-326a567e-85f3-41de-8850-c68752507a66 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:58.816470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-326a567e-85f3-41de-8850-c68752507a66 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:58.840061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-326a567e-85f3-41de-8850-c68752507a66 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:58.841110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-326a567e-85f3-41de-8850-c68752507a66 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:58.841832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-326a567e-85f3-41de-8850-c68752507a66 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:58.843603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-326a567e-85f3-41de-8850-c68752507a66 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:58.846183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-326a567e-85f3-41de-8850-c68752507a66 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:58.847456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-326a567e-85f3-41de-8850-c68752507a66 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:59.043022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-326a567e-85f3-41de-8850-c68752507a66 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:59.062055 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-326a567e-85f3-41de-8850-c68752507a66 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 200 len: 1267 microversion: 2.1 time: 0.261739 Oct 24 10:45:59.063004 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2290/4520] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:58 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:59.071343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c47520c5-fefc-4bc9-bd6a-a74253b1ac24 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:59.083972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c47520c5-fefc-4bc9-bd6a-a74253b1ac24 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:59.088649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c47520c5-fefc-4bc9-bd6a-a74253b1ac24 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Searching by: {'deleted': False, 'project_id': '51b48ea9adbe4711a3043add98c14ddb'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:45:59.132087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c47520c5-fefc-4bc9-bd6a-a74253b1ac24 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:59.132860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c47520c5-fefc-4bc9-bd6a-a74253b1ac24 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:59.133408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c47520c5-fefc-4bc9-bd6a-a74253b1ac24 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:59.134699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c47520c5-fefc-4bc9-bd6a-a74253b1ac24 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:59.135327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c47520c5-fefc-4bc9-bd6a-a74253b1ac24 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:59.136012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c47520c5-fefc-4bc9-bd6a-a74253b1ac24 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:59.209623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ada5d4d1-42cc-4462-b3cf-3ea0c683be33 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:59.222841 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ada5d4d1-42cc-4462-b3cf-3ea0c683be33 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.653198 Oct 24 10:45:59.224190 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2231/4521] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:58 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:59.242620 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c47520c5-fefc-4bc9-bd6a-a74253b1ac24 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.176570 Oct 24 10:45:59.243506 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2291/4522] 10.222.0.50 () {58 vars in 1125 bytes} [Mon Oct 24 10:45:59 2022] GET /compute/v2.1/servers => generated 675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:45:59.263563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c66c50d6-f053-400e-991f-d9b943f1ed61 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:59.264271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c66c50d6-f053-400e-991f-d9b943f1ed61 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:59.269706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:45:59.372344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c8ccfdf6-db90-4d13-9940-2bb800202f62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:45:59.374145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c8ccfdf6-db90-4d13-9940-2bb800202f62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:45:59.417729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8ccfdf6-db90-4d13-9940-2bb800202f62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:59.418237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8ccfdf6-db90-4d13-9940-2bb800202f62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:59.418682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8ccfdf6-db90-4d13-9940-2bb800202f62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:59.419537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8ccfdf6-db90-4d13-9940-2bb800202f62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:45:59.422094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8ccfdf6-db90-4d13-9940-2bb800202f62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:45:59.422538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8ccfdf6-db90-4d13-9940-2bb800202f62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:45:59.695023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c66c50d6-f053-400e-991f-d9b943f1ed61 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:59.705668 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c66c50d6-f053-400e-991f-d9b943f1ed61 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99" status: 200 len: 1219 microversion: 2.1 time: 0.451680 Oct 24 10:45:59.721901 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2232/4523] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:45:59 2022] GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99 => generated 1219 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:45:59.931169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c8ccfdf6-db90-4d13-9940-2bb800202f62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:59.943527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c8ccfdf6-db90-4d13-9940-2bb800202f62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:59.946133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c8ccfdf6-db90-4d13-9940-2bb800202f62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:45:59.947892 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c8ccfdf6-db90-4d13-9940-2bb800202f62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.584908 Oct 24 10:45:59.970310 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2292/4524] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:45:59 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:00.089742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4205d7ba-24e9-4d8d-bdfc-9637736ade22 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:00.090180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4205d7ba-24e9-4d8d-bdfc-9637736ade22 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:00.101984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4205d7ba-24e9-4d8d-bdfc-9637736ade22 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:00.102775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4205d7ba-24e9-4d8d-bdfc-9637736ade22 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:00.103406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4205d7ba-24e9-4d8d-bdfc-9637736ade22 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:00.104306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4205d7ba-24e9-4d8d-bdfc-9637736ade22 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:00.108147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4205d7ba-24e9-4d8d-bdfc-9637736ade22 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:00.108625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4205d7ba-24e9-4d8d-bdfc-9637736ade22 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:00.253883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dbe48a76-554b-4e4a-a9ed-730e2cd6660a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:00.258460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dbe48a76-554b-4e4a-a9ed-730e2cd6660a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:00.273000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbe48a76-554b-4e4a-a9ed-730e2cd6660a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:00.273671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbe48a76-554b-4e4a-a9ed-730e2cd6660a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:00.274418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbe48a76-554b-4e4a-a9ed-730e2cd6660a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:00.276011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbe48a76-554b-4e4a-a9ed-730e2cd6660a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:00.276782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbe48a76-554b-4e4a-a9ed-730e2cd6660a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:00.278523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbe48a76-554b-4e4a-a9ed-730e2cd6660a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:00.904173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4205d7ba-24e9-4d8d-bdfc-9637736ade22 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:00.921561 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4205d7ba-24e9-4d8d-bdfc-9637736ade22 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 200 len: 1309 microversion: 2.1 time: 0.835742 Oct 24 10:46:00.941592 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2233/4525] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:00 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 1309 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:00.947300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dbe48a76-554b-4e4a-a9ed-730e2cd6660a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:00.956293 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dbe48a76-554b-4e4a-a9ed-730e2cd6660a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.711623 Oct 24 10:46:00.956910 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2293/4526] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:00 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:00.957667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-89c41aba-5bc4-4b71-bf28-7178816737f7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:00.958299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-89c41aba-5bc4-4b71-bf28-7178816737f7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:00.970741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89c41aba-5bc4-4b71-bf28-7178816737f7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:00.972154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89c41aba-5bc4-4b71-bf28-7178816737f7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:00.974278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89c41aba-5bc4-4b71-bf28-7178816737f7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:00.975411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89c41aba-5bc4-4b71-bf28-7178816737f7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:00.978114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89c41aba-5bc4-4b71-bf28-7178816737f7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:00.983845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-749e069f-1dde-42bd-a120-46ee7595605d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:00.985480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-749e069f-1dde-42bd-a120-46ee7595605d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:00.988876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89c41aba-5bc4-4b71-bf28-7178816737f7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:00.995698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-749e069f-1dde-42bd-a120-46ee7595605d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:00.998027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-749e069f-1dde-42bd-a120-46ee7595605d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:00.999105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-749e069f-1dde-42bd-a120-46ee7595605d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:01.000043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-749e069f-1dde-42bd-a120-46ee7595605d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:01.011831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-749e069f-1dde-42bd-a120-46ee7595605d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:01.012286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-749e069f-1dde-42bd-a120-46ee7595605d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:01.174049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-89c41aba-5bc4-4b71-bf28-7178816737f7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:01.185893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:01.206684 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-89c41aba-5bc4-4b71-bf28-7178816737f7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99" status: 200 len: 1271 microversion: 2.1 time: 0.258225 Oct 24 10:46:01.213289 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2234/4527] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:00 2022] GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99 => generated 1271 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:01.519572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-749e069f-1dde-42bd-a120-46ee7595605d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:01.529610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-749e069f-1dde-42bd-a120-46ee7595605d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:01.539034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-749e069f-1dde-42bd-a120-46ee7595605d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:01.546581 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-749e069f-1dde-42bd-a120-46ee7595605d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.566813 Oct 24 10:46:01.548706 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2294/4528] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:00 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:46:01.949572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33ae3cf7-30b4-4df1-8605-4a67e409d271 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:01.950284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-33ae3cf7-30b4-4df1-8605-4a67e409d271 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:01.957564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33ae3cf7-30b4-4df1-8605-4a67e409d271 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:01.958057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33ae3cf7-30b4-4df1-8605-4a67e409d271 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:01.959397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33ae3cf7-30b4-4df1-8605-4a67e409d271 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:01.960540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33ae3cf7-30b4-4df1-8605-4a67e409d271 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:01.961304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33ae3cf7-30b4-4df1-8605-4a67e409d271 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:01.962149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33ae3cf7-30b4-4df1-8605-4a67e409d271 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:01.988404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7481444d-5487-41ab-8cf9-412c30e6ce59 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:01.988404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7481444d-5487-41ab-8cf9-412c30e6ce59 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:02.000495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7481444d-5487-41ab-8cf9-412c30e6ce59 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:02.000495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7481444d-5487-41ab-8cf9-412c30e6ce59 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:02.000495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7481444d-5487-41ab-8cf9-412c30e6ce59 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:02.001057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7481444d-5487-41ab-8cf9-412c30e6ce59 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:02.001494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7481444d-5487-41ab-8cf9-412c30e6ce59 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:02.001919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7481444d-5487-41ab-8cf9-412c30e6ce59 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:02.396053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-33ae3cf7-30b4-4df1-8605-4a67e409d271 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:02.404516 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-33ae3cf7-30b4-4df1-8605-4a67e409d271 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 200 len: 1309 microversion: 2.1 time: 0.458977 Oct 24 10:46:02.405454 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2235/4529] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:01 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 1309 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:02.411987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9c7c44b5-ebed-4c1f-8a4f-dbf410a15647 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:02.412702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9c7c44b5-ebed-4c1f-8a4f-dbf410a15647 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:02.424548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7481444d-5487-41ab-8cf9-412c30e6ce59 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:02.432814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c7c44b5-ebed-4c1f-8a4f-dbf410a15647 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:02.433625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c7c44b5-ebed-4c1f-8a4f-dbf410a15647 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:02.435717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c7c44b5-ebed-4c1f-8a4f-dbf410a15647 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:02.436812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c7c44b5-ebed-4c1f-8a4f-dbf410a15647 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:02.439144 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7481444d-5487-41ab-8cf9-412c30e6ce59 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.457467 Oct 24 10:46:02.439816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c7c44b5-ebed-4c1f-8a4f-dbf410a15647 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:02.440367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c7c44b5-ebed-4c1f-8a4f-dbf410a15647 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:02.442618 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2295/4530] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:01 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:02.551451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9c7c44b5-ebed-4c1f-8a4f-dbf410a15647 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:02.576558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cf08cd88-c515-4daa-8c8b-fc73cbece353 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:02.576558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cf08cd88-c515-4daa-8c8b-fc73cbece353 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:02.590494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf08cd88-c515-4daa-8c8b-fc73cbece353 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:02.590996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf08cd88-c515-4daa-8c8b-fc73cbece353 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:02.591440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf08cd88-c515-4daa-8c8b-fc73cbece353 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:02.592154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf08cd88-c515-4daa-8c8b-fc73cbece353 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:02.601820 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9c7c44b5-ebed-4c1f-8a4f-dbf410a15647 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99" status: 200 len: 1277 microversion: 2.1 time: 0.193996 Oct 24 10:46:02.602431 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2236/4531] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:02 2022] GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99 => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:02.603069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf08cd88-c515-4daa-8c8b-fc73cbece353 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:02.603730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf08cd88-c515-4daa-8c8b-fc73cbece353 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:02.921565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-8969e767-33cc-46b3-bbfd-5030e6ae4638 req-92fe5df8-6290-4a51-a021-bc8aa024535b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1335ca39-c87a-463e-9952-cdefaea18272", "tag": "5adb0f42-2d7b-4633-a6ec-68b8f247730e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:02.934884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8969e767-33cc-46b3-bbfd-5030e6ae4638 req-92fe5df8-6290-4a51-a021-bc8aa024535b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:02.935308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8969e767-33cc-46b3-bbfd-5030e6ae4638 req-92fe5df8-6290-4a51-a021-bc8aa024535b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:02.935756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8969e767-33cc-46b3-bbfd-5030e6ae4638 req-92fe5df8-6290-4a51-a021-bc8aa024535b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:02.960602 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-8969e767-33cc-46b3-bbfd-5030e6ae4638 req-92fe5df8-6290-4a51-a021-bc8aa024535b service nova] Creating event network-changed:5adb0f42-2d7b-4633-a6ec-68b8f247730e for instance 1335ca39-c87a-463e-9952-cdefaea18272 on n-h2-858383-15 Oct 24 10:46:02.966230 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-8969e767-33cc-46b3-bbfd-5030e6ae4638 req-92fe5df8-6290-4a51-a021-bc8aa024535b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053330 Oct 24 10:46:02.967536 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2237/4532] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:46:03.394190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cf08cd88-c515-4daa-8c8b-fc73cbece353 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:03.435849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0611f26a-ecea-4e95-8936-e6282002b0f6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:03.436953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0611f26a-ecea-4e95-8936-e6282002b0f6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:03.463399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cf08cd88-c515-4daa-8c8b-fc73cbece353 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:03.463776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0611f26a-ecea-4e95-8936-e6282002b0f6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:03.465668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0611f26a-ecea-4e95-8936-e6282002b0f6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:03.466477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0611f26a-ecea-4e95-8936-e6282002b0f6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:03.468088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0611f26a-ecea-4e95-8936-e6282002b0f6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:03.469785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cf08cd88-c515-4daa-8c8b-fc73cbece353 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:03.470499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0611f26a-ecea-4e95-8936-e6282002b0f6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:03.471973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0611f26a-ecea-4e95-8936-e6282002b0f6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:03.474093 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cf08cd88-c515-4daa-8c8b-fc73cbece353 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.902028 Oct 24 10:46:03.488873 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2296/4533] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:02 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:46:03.490102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-88b017f1-9ffb-4e5c-a4de-9e4475a4d6d0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:03.493512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-88b017f1-9ffb-4e5c-a4de-9e4475a4d6d0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:03.509822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88b017f1-9ffb-4e5c-a4de-9e4475a4d6d0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:03.510326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88b017f1-9ffb-4e5c-a4de-9e4475a4d6d0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:03.513707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88b017f1-9ffb-4e5c-a4de-9e4475a4d6d0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:03.514737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88b017f1-9ffb-4e5c-a4de-9e4475a4d6d0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:03.515211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88b017f1-9ffb-4e5c-a4de-9e4475a4d6d0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:03.515717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88b017f1-9ffb-4e5c-a4de-9e4475a4d6d0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:03.992755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0611f26a-ecea-4e95-8936-e6282002b0f6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:04.003239 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0611f26a-ecea-4e95-8936-e6282002b0f6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 200 len: 1309 microversion: 2.1 time: 0.574464 Oct 24 10:46:04.011312 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2238/4534] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:03 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 1309 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:04.011312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2dfa3244-7ae9-4d62-b71d-d32044ff73d7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:04.011772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2dfa3244-7ae9-4d62-b71d-d32044ff73d7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:04.012951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-88b017f1-9ffb-4e5c-a4de-9e4475a4d6d0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:04.023276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2dfa3244-7ae9-4d62-b71d-d32044ff73d7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:04.024205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2dfa3244-7ae9-4d62-b71d-d32044ff73d7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:04.024664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2dfa3244-7ae9-4d62-b71d-d32044ff73d7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:04.025479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2dfa3244-7ae9-4d62-b71d-d32044ff73d7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:04.025946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2dfa3244-7ae9-4d62-b71d-d32044ff73d7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:04.026384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2dfa3244-7ae9-4d62-b71d-d32044ff73d7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:04.036709 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-88b017f1-9ffb-4e5c-a4de-9e4475a4d6d0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.557387 Oct 24 10:46:04.059758 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2297/4535] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:03 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:04.158454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2dfa3244-7ae9-4d62-b71d-d32044ff73d7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:04.169166 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2dfa3244-7ae9-4d62-b71d-d32044ff73d7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99" status: 200 len: 1277 microversion: 2.1 time: 0.163558 Oct 24 10:46:04.169952 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2239/4536] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:04 2022] GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:04.509497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3cff846a-4e8d-44e6-8aa9-9a1874673385 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:04.512463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3cff846a-4e8d-44e6-8aa9-9a1874673385 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:04.525230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cff846a-4e8d-44e6-8aa9-9a1874673385 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:04.525947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cff846a-4e8d-44e6-8aa9-9a1874673385 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:04.527020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cff846a-4e8d-44e6-8aa9-9a1874673385 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:04.528267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cff846a-4e8d-44e6-8aa9-9a1874673385 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:04.528979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cff846a-4e8d-44e6-8aa9-9a1874673385 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:04.529598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cff846a-4e8d-44e6-8aa9-9a1874673385 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:05.028695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-756b4aa5-40c9-4a77-b9a6-8dfdfb307a71 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:05.031055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-756b4aa5-40c9-4a77-b9a6-8dfdfb307a71 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:05.049836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-756b4aa5-40c9-4a77-b9a6-8dfdfb307a71 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:05.050610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-756b4aa5-40c9-4a77-b9a6-8dfdfb307a71 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:05.051502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-756b4aa5-40c9-4a77-b9a6-8dfdfb307a71 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:05.052503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-756b4aa5-40c9-4a77-b9a6-8dfdfb307a71 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:05.053531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-756b4aa5-40c9-4a77-b9a6-8dfdfb307a71 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:05.054132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-756b4aa5-40c9-4a77-b9a6-8dfdfb307a71 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:05.461113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3cff846a-4e8d-44e6-8aa9-9a1874673385 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:05.471211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3cff846a-4e8d-44e6-8aa9-9a1874673385 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:05.473032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3cff846a-4e8d-44e6-8aa9-9a1874673385 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:05.474450 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3cff846a-4e8d-44e6-8aa9-9a1874673385 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.972118 Oct 24 10:46:05.495664 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2298/4537] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:04 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:05.501979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9582314d-27e2-497d-b622-07d350e63335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:05.502848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9582314d-27e2-497d-b622-07d350e63335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:05.509683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9582314d-27e2-497d-b622-07d350e63335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:05.510843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9582314d-27e2-497d-b622-07d350e63335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:05.511466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9582314d-27e2-497d-b622-07d350e63335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:05.512383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9582314d-27e2-497d-b622-07d350e63335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:05.513035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9582314d-27e2-497d-b622-07d350e63335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:05.513632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9582314d-27e2-497d-b622-07d350e63335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:05.732363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-756b4aa5-40c9-4a77-b9a6-8dfdfb307a71 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:05.747937 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-756b4aa5-40c9-4a77-b9a6-8dfdfb307a71 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 200 len: 1309 microversion: 2.1 time: 0.723289 Oct 24 10:46:05.749801 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2240/4538] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:05 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 1309 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:05.760689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ca469191-f780-4dc9-b92c-cea8684d4ce7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:05.762147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ca469191-f780-4dc9-b92c-cea8684d4ce7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:05.792976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca469191-f780-4dc9-b92c-cea8684d4ce7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:05.794384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca469191-f780-4dc9-b92c-cea8684d4ce7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:05.795870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca469191-f780-4dc9-b92c-cea8684d4ce7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:05.801598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca469191-f780-4dc9-b92c-cea8684d4ce7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:05.803069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca469191-f780-4dc9-b92c-cea8684d4ce7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:05.803880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca469191-f780-4dc9-b92c-cea8684d4ce7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:05.972777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9582314d-27e2-497d-b622-07d350e63335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:05.987847 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9582314d-27e2-497d-b622-07d350e63335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.490330 Oct 24 10:46:05.988770 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2299/4539] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:05 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:06.178503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ca469191-f780-4dc9-b92c-cea8684d4ce7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:06.187235 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ca469191-f780-4dc9-b92c-cea8684d4ce7 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99" status: 200 len: 1319 microversion: 2.1 time: 0.433443 Oct 24 10:46:06.204425 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2241/4540] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:05 2022] GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:06.280731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-67ccfc2f-1499-4038-9732-10705233337f req-7c8c1939-710d-43fd-b7eb-1c66043e6837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cbddb45-3136-46ce-970e-0a056283a032", "tag": "cfc27f4d-dd89-4e7b-87d2-0e251c19394a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:06.304129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-67ccfc2f-1499-4038-9732-10705233337f req-7c8c1939-710d-43fd-b7eb-1c66043e6837 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:06.307497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-67ccfc2f-1499-4038-9732-10705233337f req-7c8c1939-710d-43fd-b7eb-1c66043e6837 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:06.307998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-67ccfc2f-1499-4038-9732-10705233337f req-7c8c1939-710d-43fd-b7eb-1c66043e6837 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:06.335497 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-67ccfc2f-1499-4038-9732-10705233337f req-7c8c1939-710d-43fd-b7eb-1c66043e6837 service nova] Creating event network-changed:cfc27f4d-dd89-4e7b-87d2-0e251c19394a for instance 1cbddb45-3136-46ce-970e-0a056283a032 on n-h1-858383-15 Oct 24 10:46:06.343490 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-67ccfc2f-1499-4038-9732-10705233337f req-7c8c1939-710d-43fd-b7eb-1c66043e6837 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066849 Oct 24 10:46:06.350304 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2300/4541] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:06.504554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f2f74d82-c256-4ff7-9881-8abbc3bab166 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:06.508522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f2f74d82-c256-4ff7-9881-8abbc3bab166 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:06.522119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2f74d82-c256-4ff7-9881-8abbc3bab166 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:06.522616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2f74d82-c256-4ff7-9881-8abbc3bab166 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:06.523075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2f74d82-c256-4ff7-9881-8abbc3bab166 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:06.523774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2f74d82-c256-4ff7-9881-8abbc3bab166 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:06.524229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2f74d82-c256-4ff7-9881-8abbc3bab166 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:06.524652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2f74d82-c256-4ff7-9881-8abbc3bab166 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:06.779518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bde12390-82a7-4282-a2e1-69408d266d2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:06.782070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bde12390-82a7-4282-a2e1-69408d266d2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:06.793079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bde12390-82a7-4282-a2e1-69408d266d2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:06.793972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bde12390-82a7-4282-a2e1-69408d266d2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:06.794657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bde12390-82a7-4282-a2e1-69408d266d2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:06.795726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bde12390-82a7-4282-a2e1-69408d266d2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:06.796432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bde12390-82a7-4282-a2e1-69408d266d2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:06.797638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bde12390-82a7-4282-a2e1-69408d266d2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:06.823888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:06.965080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f2f74d82-c256-4ff7-9881-8abbc3bab166 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:06.983361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f2f74d82-c256-4ff7-9881-8abbc3bab166 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:06.985843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f2f74d82-c256-4ff7-9881-8abbc3bab166 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:06.987082 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f2f74d82-c256-4ff7-9881-8abbc3bab166 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.487508 Oct 24 10:46:06.987666 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2242/4542] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:06 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:07.011847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-58867d54-d01d-4a9c-893a-c42ed1c4a65f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:07.012706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-58867d54-d01d-4a9c-893a-c42ed1c4a65f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:07.019840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58867d54-d01d-4a9c-893a-c42ed1c4a65f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:07.020571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58867d54-d01d-4a9c-893a-c42ed1c4a65f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:07.021355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58867d54-d01d-4a9c-893a-c42ed1c4a65f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:07.022233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58867d54-d01d-4a9c-893a-c42ed1c4a65f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:07.022844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58867d54-d01d-4a9c-893a-c42ed1c4a65f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:07.023427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58867d54-d01d-4a9c-893a-c42ed1c4a65f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:07.169172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bde12390-82a7-4282-a2e1-69408d266d2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:07.178453 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bde12390-82a7-4282-a2e1-69408d266d2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 200 len: 1309 microversion: 2.1 time: 0.409824 Oct 24 10:46:07.179795 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2301/4543] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:06 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 1309 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:07.210826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8337dbdc-c1ac-4899-a6f3-a4d5d6ac036c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:07.211575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8337dbdc-c1ac-4899-a6f3-a4d5d6ac036c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:07.218648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8337dbdc-c1ac-4899-a6f3-a4d5d6ac036c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:07.219437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8337dbdc-c1ac-4899-a6f3-a4d5d6ac036c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:07.220051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8337dbdc-c1ac-4899-a6f3-a4d5d6ac036c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:07.221042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8337dbdc-c1ac-4899-a6f3-a4d5d6ac036c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:07.221509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8337dbdc-c1ac-4899-a6f3-a4d5d6ac036c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:07.221947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8337dbdc-c1ac-4899-a6f3-a4d5d6ac036c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:07.370810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-58867d54-d01d-4a9c-893a-c42ed1c4a65f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:07.380542 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-58867d54-d01d-4a9c-893a-c42ed1c4a65f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.373378 Oct 24 10:46:07.399371 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2243/4544] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:07 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:07.481525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8337dbdc-c1ac-4899-a6f3-a4d5d6ac036c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:07.498061 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8337dbdc-c1ac-4899-a6f3-a4d5d6ac036c tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99" status: 200 len: 1319 microversion: 2.1 time: 0.291137 Oct 24 10:46:07.513758 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2302/4545] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:07 2022] GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99 => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:08.017029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-671fa7e6-6a00-43a0-b5f2-c2ea446834b6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:08.018041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-671fa7e6-6a00-43a0-b5f2-c2ea446834b6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:08.036384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-671fa7e6-6a00-43a0-b5f2-c2ea446834b6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:08.036913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-671fa7e6-6a00-43a0-b5f2-c2ea446834b6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:08.037368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-671fa7e6-6a00-43a0-b5f2-c2ea446834b6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:08.039602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-671fa7e6-6a00-43a0-b5f2-c2ea446834b6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:08.040084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-671fa7e6-6a00-43a0-b5f2-c2ea446834b6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:08.040528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-671fa7e6-6a00-43a0-b5f2-c2ea446834b6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:08.207423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8f0d7e39-faa8-4c64-9415-39b8d259991d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:08.208048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8f0d7e39-faa8-4c64-9415-39b8d259991d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:08.225860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f0d7e39-faa8-4c64-9415-39b8d259991d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:08.226690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f0d7e39-faa8-4c64-9415-39b8d259991d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:08.227651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f0d7e39-faa8-4c64-9415-39b8d259991d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:08.228620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f0d7e39-faa8-4c64-9415-39b8d259991d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:08.229569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f0d7e39-faa8-4c64-9415-39b8d259991d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:08.230722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f0d7e39-faa8-4c64-9415-39b8d259991d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:08.550569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8f0d7e39-faa8-4c64-9415-39b8d259991d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:08.555465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-671fa7e6-6a00-43a0-b5f2-c2ea446834b6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:08.557317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=12 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:08.560582 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8f0d7e39-faa8-4c64-9415-39b8d259991d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 200 len: 1309 microversion: 2.1 time: 0.358509 Oct 24 10:46:08.561757 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2303/4546] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:08 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 1309 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:08.573159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-16ed217c-a51c-4699-a748-631696e32463 req-4c6a0cb2-8f48-4961-9b12-f45949e59ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1335ca39-c87a-463e-9952-cdefaea18272", "name": "network-vif-plugged", "status": "completed", "tag": "5adb0f42-2d7b-4633-a6ec-68b8f247730e"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:08.583442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-671fa7e6-6a00-43a0-b5f2-c2ea446834b6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:08.585165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-671fa7e6-6a00-43a0-b5f2-c2ea446834b6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:08.586437 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-671fa7e6-6a00-43a0-b5f2-c2ea446834b6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.574619 Oct 24 10:46:08.587596 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2244/4547] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:08 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:08.592434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-002441fd-91e2-4765-8a41-9cc78b5e35d5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:08.594542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-002441fd-91e2-4765-8a41-9cc78b5e35d5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:08.605291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-002441fd-91e2-4765-8a41-9cc78b5e35d5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:08.606029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-002441fd-91e2-4765-8a41-9cc78b5e35d5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:08.609328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-002441fd-91e2-4765-8a41-9cc78b5e35d5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:08.610315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-002441fd-91e2-4765-8a41-9cc78b5e35d5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:08.610792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-002441fd-91e2-4765-8a41-9cc78b5e35d5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:08.611282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-002441fd-91e2-4765-8a41-9cc78b5e35d5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:08.613070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-16ed217c-a51c-4699-a748-631696e32463 req-4c6a0cb2-8f48-4961-9b12-f45949e59ecf service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:08.615524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-16ed217c-a51c-4699-a748-631696e32463 req-4c6a0cb2-8f48-4961-9b12-f45949e59ecf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:08.616087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-16ed217c-a51c-4699-a748-631696e32463 req-4c6a0cb2-8f48-4961-9b12-f45949e59ecf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:08.632084 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-16ed217c-a51c-4699-a748-631696e32463 req-4c6a0cb2-8f48-4961-9b12-f45949e59ecf service nova] Creating event network-vif-plugged:5adb0f42-2d7b-4633-a6ec-68b8f247730e for instance 1335ca39-c87a-463e-9952-cdefaea18272 on n-h2-858383-15 Oct 24 10:46:08.638624 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-16ed217c-a51c-4699-a748-631696e32463 req-4c6a0cb2-8f48-4961-9b12-f45949e59ecf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074661 Oct 24 10:46:08.639699 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2304/4548] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:08.646326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-423d3a73-dbd3-4303-9785-655117bcc157 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:08.647142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-423d3a73-dbd3-4303-9785-655117bcc157 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:08.654279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-423d3a73-dbd3-4303-9785-655117bcc157 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:08.654953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-423d3a73-dbd3-4303-9785-655117bcc157 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:08.655544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-423d3a73-dbd3-4303-9785-655117bcc157 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:08.656286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-423d3a73-dbd3-4303-9785-655117bcc157 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:08.657334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-423d3a73-dbd3-4303-9785-655117bcc157 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:08.657763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-423d3a73-dbd3-4303-9785-655117bcc157 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:08.870754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-002441fd-91e2-4765-8a41-9cc78b5e35d5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:08.879836 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-002441fd-91e2-4765-8a41-9cc78b5e35d5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.290916 Oct 24 10:46:08.880427 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2245/4549] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:08 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:08.885467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e3cedcde-6f80-4d70-b5e8-d013fa17ce06 req-f5c1359f-429e-48bb-842f-edb20f7d0c74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e709ac15-ec83-4539-b417-27751f4ebf99", "tag": "8bf2b101-eca4-4c53-b9ea-be1aa58966f9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:08.896019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e3cedcde-6f80-4d70-b5e8-d013fa17ce06 req-f5c1359f-429e-48bb-842f-edb20f7d0c74 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:08.896778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e3cedcde-6f80-4d70-b5e8-d013fa17ce06 req-f5c1359f-429e-48bb-842f-edb20f7d0c74 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:08.897427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e3cedcde-6f80-4d70-b5e8-d013fa17ce06 req-f5c1359f-429e-48bb-842f-edb20f7d0c74 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:08.899491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-423d3a73-dbd3-4303-9785-655117bcc157 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:08.910225 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-423d3a73-dbd3-4303-9785-655117bcc157 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99" status: 200 len: 1319 microversion: 2.1 time: 0.269005 Oct 24 10:46:08.912559 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e3cedcde-6f80-4d70-b5e8-d013fa17ce06 req-f5c1359f-429e-48bb-842f-edb20f7d0c74 service nova] Creating event network-changed:8bf2b101-eca4-4c53-b9ea-be1aa58966f9 for instance e709ac15-ec83-4539-b417-27751f4ebf99 on n-h2-858383-15 Oct 24 10:46:08.918166 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e3cedcde-6f80-4d70-b5e8-d013fa17ce06 req-f5c1359f-429e-48bb-842f-edb20f7d0c74 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036316 Oct 24 10:46:08.918856 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2246/4550] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:08.920817 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2305/4551] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:08 2022] GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:09.587469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d3b40dff-1e35-4022-99a7-b375c918391a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:09.588893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d3b40dff-1e35-4022-99a7-b375c918391a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:09.597144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3b40dff-1e35-4022-99a7-b375c918391a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:09.597695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3b40dff-1e35-4022-99a7-b375c918391a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:09.598369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3b40dff-1e35-4022-99a7-b375c918391a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:09.599145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3b40dff-1e35-4022-99a7-b375c918391a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:09.599672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3b40dff-1e35-4022-99a7-b375c918391a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:09.600189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3b40dff-1e35-4022-99a7-b375c918391a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:09.619917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9ce057a6-7bcd-4568-8596-acc3e9535763 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:09.621439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9ce057a6-7bcd-4568-8596-acc3e9535763 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:09.627286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:09.648177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce057a6-7bcd-4568-8596-acc3e9535763 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:09.648781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce057a6-7bcd-4568-8596-acc3e9535763 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:09.651420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce057a6-7bcd-4568-8596-acc3e9535763 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:09.652187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce057a6-7bcd-4568-8596-acc3e9535763 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:09.653359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce057a6-7bcd-4568-8596-acc3e9535763 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:09.654104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ce057a6-7bcd-4568-8596-acc3e9535763 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:09.701501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:09.946845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d3b40dff-1e35-4022-99a7-b375c918391a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:09.966690 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d3b40dff-1e35-4022-99a7-b375c918391a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 200 len: 1309 microversion: 2.1 time: 0.383352 Oct 24 10:46:09.967337 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2247/4552] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:09 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 1309 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:09.981123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00e34ad8-16a1-4322-9310-c88c59e838fb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:09.981123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00e34ad8-16a1-4322-9310-c88c59e838fb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:09.981844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00e34ad8-16a1-4322-9310-c88c59e838fb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:09.982769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9ce057a6-7bcd-4568-8596-acc3e9535763 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:09.986549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00e34ad8-16a1-4322-9310-c88c59e838fb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:09.987046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00e34ad8-16a1-4322-9310-c88c59e838fb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:09.987965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00e34ad8-16a1-4322-9310-c88c59e838fb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:09.991433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00e34ad8-16a1-4322-9310-c88c59e838fb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:09.995700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00e34ad8-16a1-4322-9310-c88c59e838fb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:09.996091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9ce057a6-7bcd-4568-8596-acc3e9535763 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:09.997661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9ce057a6-7bcd-4568-8596-acc3e9535763 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:10.002038 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9ce057a6-7bcd-4568-8596-acc3e9535763 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.388841 Oct 24 10:46:10.003406 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2306/4553] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:09 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:46:10.008543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a3e6d457-7373-477c-8887-a2e134cf438b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:10.009557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a3e6d457-7373-477c-8887-a2e134cf438b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:10.017422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3e6d457-7373-477c-8887-a2e134cf438b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:10.018663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3e6d457-7373-477c-8887-a2e134cf438b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:10.019330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3e6d457-7373-477c-8887-a2e134cf438b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:10.020286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3e6d457-7373-477c-8887-a2e134cf438b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:10.021063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3e6d457-7373-477c-8887-a2e134cf438b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:10.021823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3e6d457-7373-477c-8887-a2e134cf438b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:10.283629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a3e6d457-7373-477c-8887-a2e134cf438b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:10.298500 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a3e6d457-7373-477c-8887-a2e134cf438b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99" status: 200 len: 1319 microversion: 2.1 time: 0.291874 Oct 24 10:46:10.300287 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2307/4554] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:10 2022] GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:10.303862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-00e34ad8-16a1-4322-9310-c88c59e838fb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:10.316730 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-00e34ad8-16a1-4322-9310-c88c59e838fb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1513 microversion: 2.1 time: 0.345838 Oct 24 10:46:10.317662 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2248/4555] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:09 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1513 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:10.996254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f49dc869-69dd-4ef8-83b6-c282f5968513 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:10.997041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f49dc869-69dd-4ef8-83b6-c282f5968513 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:11.007065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f49dc869-69dd-4ef8-83b6-c282f5968513 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:11.009782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f49dc869-69dd-4ef8-83b6-c282f5968513 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:11.018599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f49dc869-69dd-4ef8-83b6-c282f5968513 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:11.019972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f49dc869-69dd-4ef8-83b6-c282f5968513 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:11.020813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f49dc869-69dd-4ef8-83b6-c282f5968513 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:11.021466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f49dc869-69dd-4ef8-83b6-c282f5968513 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:11.032657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8fb7b497-7901-4fa0-a700-9fea5fef59f2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:11.033378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8fb7b497-7901-4fa0-a700-9fea5fef59f2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:11.060697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb7b497-7901-4fa0-a700-9fea5fef59f2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:11.064445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb7b497-7901-4fa0-a700-9fea5fef59f2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:11.065267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb7b497-7901-4fa0-a700-9fea5fef59f2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:11.068289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb7b497-7901-4fa0-a700-9fea5fef59f2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:11.068998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb7b497-7901-4fa0-a700-9fea5fef59f2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:11.074744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb7b497-7901-4fa0-a700-9fea5fef59f2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:11.464562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f49dc869-69dd-4ef8-83b6-c282f5968513 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:11.487517 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f49dc869-69dd-4ef8-83b6-c282f5968513 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 200 len: 1309 microversion: 2.1 time: 0.495502 Oct 24 10:46:11.488373 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2308/4556] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:10 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 1309 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:11.493512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fee48d4c-5077-4dca-8df5-9735016d7954 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:11.494315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fee48d4c-5077-4dca-8df5-9735016d7954 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:11.505389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fee48d4c-5077-4dca-8df5-9735016d7954 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:11.506388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fee48d4c-5077-4dca-8df5-9735016d7954 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:11.509001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fee48d4c-5077-4dca-8df5-9735016d7954 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:11.513865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fee48d4c-5077-4dca-8df5-9735016d7954 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:11.514368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fee48d4c-5077-4dca-8df5-9735016d7954 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:11.514828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fee48d4c-5077-4dca-8df5-9735016d7954 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:11.534147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8fb7b497-7901-4fa0-a700-9fea5fef59f2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:11.551186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8fb7b497-7901-4fa0-a700-9fea5fef59f2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:11.555791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8fb7b497-7901-4fa0-a700-9fea5fef59f2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:11.561645 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8fb7b497-7901-4fa0-a700-9fea5fef59f2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.531033 Oct 24 10:46:11.563221 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2249/4557] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:11 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:11.573973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-553b3237-c8c7-4268-be92-3d6acd2a6769 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:11.575704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-553b3237-c8c7-4268-be92-3d6acd2a6769 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:11.585957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-553b3237-c8c7-4268-be92-3d6acd2a6769 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:11.586658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-553b3237-c8c7-4268-be92-3d6acd2a6769 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:11.587259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-553b3237-c8c7-4268-be92-3d6acd2a6769 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:11.588361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-553b3237-c8c7-4268-be92-3d6acd2a6769 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:11.589169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-553b3237-c8c7-4268-be92-3d6acd2a6769 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:11.589904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-553b3237-c8c7-4268-be92-3d6acd2a6769 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:11.830788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fee48d4c-5077-4dca-8df5-9735016d7954 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:11.832946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-553b3237-c8c7-4268-be92-3d6acd2a6769 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:11.843310 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-553b3237-c8c7-4268-be92-3d6acd2a6769 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1519 microversion: 2.1 time: 0.278822 Oct 24 10:46:11.845048 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2250/4558] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:11 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1519 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:11.846304 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fee48d4c-5077-4dca-8df5-9735016d7954 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99" status: 200 len: 1319 microversion: 2.1 time: 0.356784 Oct 24 10:46:11.846929 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2309/4559] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:11 2022] GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99 => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:12.520349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cb8806ec-c4c2-46e3-b094-1e7de005e264 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:12.522997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cb8806ec-c4c2-46e3-b094-1e7de005e264 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:12.544473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb8806ec-c4c2-46e3-b094-1e7de005e264 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:12.544986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb8806ec-c4c2-46e3-b094-1e7de005e264 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:12.545602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb8806ec-c4c2-46e3-b094-1e7de005e264 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:12.546301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb8806ec-c4c2-46e3-b094-1e7de005e264 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:12.546763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb8806ec-c4c2-46e3-b094-1e7de005e264 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:12.547940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb8806ec-c4c2-46e3-b094-1e7de005e264 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:12.597417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-70a28f06-72f6-4987-98c9-617e77e20bd9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:12.598755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-70a28f06-72f6-4987-98c9-617e77e20bd9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:12.607288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70a28f06-72f6-4987-98c9-617e77e20bd9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:12.608112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70a28f06-72f6-4987-98c9-617e77e20bd9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:12.608721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70a28f06-72f6-4987-98c9-617e77e20bd9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:12.609721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70a28f06-72f6-4987-98c9-617e77e20bd9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:12.610519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70a28f06-72f6-4987-98c9-617e77e20bd9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:12.611219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70a28f06-72f6-4987-98c9-617e77e20bd9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:12.879739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cb8806ec-c4c2-46e3-b094-1e7de005e264 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:12.893622 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cb8806ec-c4c2-46e3-b094-1e7de005e264 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 200 len: 1491 microversion: 2.1 time: 0.379453 Oct 24 10:46:12.894596 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2251/4560] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:12 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 1491 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:12.901273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ac19d5de-59b6-40e8-8f66-30deded9ec48 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:12.902826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ac19d5de-59b6-40e8-8f66-30deded9ec48 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:12.913797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac19d5de-59b6-40e8-8f66-30deded9ec48 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:12.914638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac19d5de-59b6-40e8-8f66-30deded9ec48 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:12.915298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac19d5de-59b6-40e8-8f66-30deded9ec48 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:12.917293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac19d5de-59b6-40e8-8f66-30deded9ec48 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:12.918334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac19d5de-59b6-40e8-8f66-30deded9ec48 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:12.919580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac19d5de-59b6-40e8-8f66-30deded9ec48 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:12.927538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-70a28f06-72f6-4987-98c9-617e77e20bd9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:12.942952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-70a28f06-72f6-4987-98c9-617e77e20bd9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:12.944424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-70a28f06-72f6-4987-98c9-617e77e20bd9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:12.945662 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-70a28f06-72f6-4987-98c9-617e77e20bd9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.354641 Oct 24 10:46:12.946325 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2310/4561] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:12 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:12.953175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1f284c46-0691-43ea-851f-9d820d7ef098 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:12.954122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1f284c46-0691-43ea-851f-9d820d7ef098 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:12.962290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f284c46-0691-43ea-851f-9d820d7ef098 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:12.964217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f284c46-0691-43ea-851f-9d820d7ef098 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:12.964706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f284c46-0691-43ea-851f-9d820d7ef098 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:12.965473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f284c46-0691-43ea-851f-9d820d7ef098 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:12.965951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f284c46-0691-43ea-851f-9d820d7ef098 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:12.966389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f284c46-0691-43ea-851f-9d820d7ef098 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:13.501031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ac19d5de-59b6-40e8-8f66-30deded9ec48 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:13.504875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:13.512344 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ac19d5de-59b6-40e8-8f66-30deded9ec48 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99" status: 200 len: 1319 microversion: 2.1 time: 0.616454 Oct 24 10:46:13.514019 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2252/4562] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:12 2022] GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99 => generated 1319 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:13.520621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7d5100b6-7283-4e79-a303-97412d66df47 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:13.523331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7d5100b6-7283-4e79-a303-97412d66df47 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:13.530170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d5100b6-7283-4e79-a303-97412d66df47 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:13.536538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d5100b6-7283-4e79-a303-97412d66df47 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:13.537316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d5100b6-7283-4e79-a303-97412d66df47 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:13.539059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d5100b6-7283-4e79-a303-97412d66df47 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:13.539773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d5100b6-7283-4e79-a303-97412d66df47 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:13.540740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7d5100b6-7283-4e79-a303-97412d66df47 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:13.549435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1f284c46-0691-43ea-851f-9d820d7ef098 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:13.562479 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1f284c46-0691-43ea-851f-9d820d7ef098 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1519 microversion: 2.1 time: 0.613118 Oct 24 10:46:13.563874 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2311/4563] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:12 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1519 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:13.569389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-98653fcf-f756-433b-b3d2-0ff45699a2e5 req-3ddedbc8-04c5-49b7-b3ee-0352024617bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba574b8-fd7b-4914-b2e1-0ef7c7beb55d", "name": "network-vif-unplugged", "status": "completed", "tag": "f3cf98a5-3ab6-4a6a-9fe2-d2836e5f960d"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:13.582004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-98653fcf-f756-433b-b3d2-0ff45699a2e5 req-3ddedbc8-04c5-49b7-b3ee-0352024617bf service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:13.582765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-98653fcf-f756-433b-b3d2-0ff45699a2e5 req-3ddedbc8-04c5-49b7-b3ee-0352024617bf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:13.583307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-98653fcf-f756-433b-b3d2-0ff45699a2e5 req-3ddedbc8-04c5-49b7-b3ee-0352024617bf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:13.604121 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-98653fcf-f756-433b-b3d2-0ff45699a2e5 req-3ddedbc8-04c5-49b7-b3ee-0352024617bf service nova] Creating event network-vif-unplugged:f3cf98a5-3ab6-4a6a-9fe2-d2836e5f960d for instance dba574b8-fd7b-4914-b2e1-0ef7c7beb55d on n-h1-858383-15 Oct 24 10:46:13.612220 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-98653fcf-f756-433b-b3d2-0ff45699a2e5 req-3ddedbc8-04c5-49b7-b3ee-0352024617bf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046846 Oct 24 10:46:13.612858 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2312/4564] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:13.648793 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7d5100b6-7283-4e79-a303-97412d66df47 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "PUT /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 200 len: 1086 microversion: 2.1 time: 0.133266 Oct 24 10:46:13.649612 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2253/4565] 10.222.0.50 () {60 vars in 1256 bytes} [Mon Oct 24 10:46:13 2022] PUT /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 1086 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:13.670667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-08c9b1b8-2a11-44e5-ba11-b7c41241fd53 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:13.671393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-08c9b1b8-2a11-44e5-ba11-b7c41241fd53 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:13.678646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08c9b1b8-2a11-44e5-ba11-b7c41241fd53 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:13.679133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08c9b1b8-2a11-44e5-ba11-b7c41241fd53 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:13.679571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08c9b1b8-2a11-44e5-ba11-b7c41241fd53 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:13.680411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08c9b1b8-2a11-44e5-ba11-b7c41241fd53 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:13.680893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08c9b1b8-2a11-44e5-ba11-b7c41241fd53 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:13.681326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08c9b1b8-2a11-44e5-ba11-b7c41241fd53 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:13.973143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dd6ace23-39c9-42a4-86d8-5d193b4ddf8a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:13.973886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dd6ace23-39c9-42a4-86d8-5d193b4ddf8a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:13.985795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd6ace23-39c9-42a4-86d8-5d193b4ddf8a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:13.986293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd6ace23-39c9-42a4-86d8-5d193b4ddf8a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:13.986735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd6ace23-39c9-42a4-86d8-5d193b4ddf8a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:13.989365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd6ace23-39c9-42a4-86d8-5d193b4ddf8a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:13.989836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd6ace23-39c9-42a4-86d8-5d193b4ddf8a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:13.990274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd6ace23-39c9-42a4-86d8-5d193b4ddf8a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:14.006998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-08c9b1b8-2a11-44e5-ba11-b7c41241fd53 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:14.016511 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-08c9b1b8-2a11-44e5-ba11-b7c41241fd53 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 200 len: 1512 microversion: 2.1 time: 0.350171 Oct 24 10:46:14.017275 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2313/4566] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:13 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 1512 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:14.039614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1f3c2784-cd92-4f83-9894-d9e2d3a8bd9e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:14.040546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1f3c2784-cd92-4f83-9894-d9e2d3a8bd9e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:14.049936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f3c2784-cd92-4f83-9894-d9e2d3a8bd9e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:14.057542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f3c2784-cd92-4f83-9894-d9e2d3a8bd9e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:14.058267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f3c2784-cd92-4f83-9894-d9e2d3a8bd9e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:14.059431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f3c2784-cd92-4f83-9894-d9e2d3a8bd9e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:14.060081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f3c2784-cd92-4f83-9894-d9e2d3a8bd9e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:14.060697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f3c2784-cd92-4f83-9894-d9e2d3a8bd9e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:14.602048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1f3c2784-cd92-4f83-9894-d9e2d3a8bd9e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:14.611558 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1f3c2784-cd92-4f83-9894-d9e2d3a8bd9e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 200 len: 1512 microversion: 2.1 time: 0.575833 Oct 24 10:46:14.637149 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2314/4567] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:14 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 1512 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:14.653701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c82322f5-c01c-419f-abbf-f07fdf3e1c69 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:14.655341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c82322f5-c01c-419f-abbf-f07fdf3e1c69 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:14.669926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c82322f5-c01c-419f-abbf-f07fdf3e1c69 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:14.670778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c82322f5-c01c-419f-abbf-f07fdf3e1c69 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:14.671654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c82322f5-c01c-419f-abbf-f07fdf3e1c69 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:14.674032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dd6ace23-39c9-42a4-86d8-5d193b4ddf8a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:14.674707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c82322f5-c01c-419f-abbf-f07fdf3e1c69 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:14.675600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c82322f5-c01c-419f-abbf-f07fdf3e1c69 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:14.676221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c82322f5-c01c-419f-abbf-f07fdf3e1c69 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:14.699363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dd6ace23-39c9-42a4-86d8-5d193b4ddf8a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:14.701258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dd6ace23-39c9-42a4-86d8-5d193b4ddf8a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:14.702509 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dd6ace23-39c9-42a4-86d8-5d193b4ddf8a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.734787 Oct 24 10:46:14.703625 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2254/4568] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:13 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:46:14.739035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e227afec-dc92-4e98-b2f1-180a61e1e563 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:14.740062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e227afec-dc92-4e98-b2f1-180a61e1e563 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:14.756259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e227afec-dc92-4e98-b2f1-180a61e1e563 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:14.756767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e227afec-dc92-4e98-b2f1-180a61e1e563 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:14.757241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e227afec-dc92-4e98-b2f1-180a61e1e563 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:14.760430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e227afec-dc92-4e98-b2f1-180a61e1e563 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:14.763098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e227afec-dc92-4e98-b2f1-180a61e1e563 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:14.763809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e227afec-dc92-4e98-b2f1-180a61e1e563 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:15.180894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c82322f5-c01c-419f-abbf-f07fdf3e1c69 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:15.189013 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c82322f5-c01c-419f-abbf-f07fdf3e1c69 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99" status: 200 len: 1319 microversion: 2.1 time: 0.548076 Oct 24 10:46:15.199547 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2315/4569] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:14 2022] GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99 => generated 1319 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:15.205393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-52d047ed-6972-4f83-b725-abafe13863ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:15.206095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-52d047ed-6972-4f83-b725-abafe13863ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:15.221728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-52d047ed-6972-4f83-b725-abafe13863ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:15.222808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-52d047ed-6972-4f83-b725-abafe13863ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:15.223488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-52d047ed-6972-4f83-b725-abafe13863ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:15.226096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-52d047ed-6972-4f83-b725-abafe13863ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:15.227249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-52d047ed-6972-4f83-b725-abafe13863ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:15.229484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-52d047ed-6972-4f83-b725-abafe13863ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:15.278090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-52d047ed-6972-4f83-b725-abafe13863ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:46:15.344421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e227afec-dc92-4e98-b2f1-180a61e1e563 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:15.357760 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e227afec-dc92-4e98-b2f1-180a61e1e563 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1519 microversion: 2.1 time: 0.626581 Oct 24 10:46:15.358428 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2255/4570] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:14 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1519 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:15.471175 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-52d047ed-6972-4f83-b725-abafe13863ab tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 204 len: 0 microversion: 2.1 time: 0.269943 Oct 24 10:46:15.472656 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2316/4571] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:46:15 2022] DELETE /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:46:15.480866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-86788684-7996-4e0b-91fa-f638742d0d0e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:15.481571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-86788684-7996-4e0b-91fa-f638742d0d0e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:15.488914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86788684-7996-4e0b-91fa-f638742d0d0e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:15.489692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86788684-7996-4e0b-91fa-f638742d0d0e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:15.490382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86788684-7996-4e0b-91fa-f638742d0d0e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:15.491529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86788684-7996-4e0b-91fa-f638742d0d0e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:15.492215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86788684-7996-4e0b-91fa-f638742d0d0e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:15.492900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86788684-7996-4e0b-91fa-f638742d0d0e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:15.629166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-ebd63675-cf2e-47dc-833b-ce5877bb7c40 req-30fd7e13-9876-4392-8146-d85eaf00e12f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cbddb45-3136-46ce-970e-0a056283a032", "name": "network-vif-plugged", "status": "completed", "tag": "cfc27f4d-dd89-4e7b-87d2-0e251c19394a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:15.647338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ebd63675-cf2e-47dc-833b-ce5877bb7c40 req-30fd7e13-9876-4392-8146-d85eaf00e12f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:15.648401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ebd63675-cf2e-47dc-833b-ce5877bb7c40 req-30fd7e13-9876-4392-8146-d85eaf00e12f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:15.649107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ebd63675-cf2e-47dc-833b-ce5877bb7c40 req-30fd7e13-9876-4392-8146-d85eaf00e12f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:15.676416 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ebd63675-cf2e-47dc-833b-ce5877bb7c40 req-30fd7e13-9876-4392-8146-d85eaf00e12f service nova] Creating event network-vif-plugged:cfc27f4d-dd89-4e7b-87d2-0e251c19394a for instance 1cbddb45-3136-46ce-970e-0a056283a032 on n-h1-858383-15 Oct 24 10:46:15.692119 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-ebd63675-cf2e-47dc-833b-ce5877bb7c40 req-30fd7e13-9876-4392-8146-d85eaf00e12f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067420 Oct 24 10:46:15.693320 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2317/4572] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:15.730634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-86788684-7996-4e0b-91fa-f638742d0d0e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:15.736419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a1466f99-20ba-4746-9664-36d06bf450eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:15.737347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a1466f99-20ba-4746-9664-36d06bf450eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:15.742218 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-86788684-7996-4e0b-91fa-f638742d0d0e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 200 len: 1518 microversion: 2.1 time: 0.265163 Oct 24 10:46:15.756869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1466f99-20ba-4746-9664-36d06bf450eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:15.756869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1466f99-20ba-4746-9664-36d06bf450eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:15.756869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1466f99-20ba-4746-9664-36d06bf450eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:15.756869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1466f99-20ba-4746-9664-36d06bf450eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:15.756869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1466f99-20ba-4746-9664-36d06bf450eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:15.756869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1466f99-20ba-4746-9664-36d06bf450eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:15.765130 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2256/4573] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:15 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 1518 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:15.789238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:16.093527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a1466f99-20ba-4746-9664-36d06bf450eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:16.104623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a1466f99-20ba-4746-9664-36d06bf450eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:16.106720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a1466f99-20ba-4746-9664-36d06bf450eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:16.108211 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a1466f99-20ba-4746-9664-36d06bf450eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.378811 Oct 24 10:46:16.109981 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2318/4574] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:15 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:46:16.223001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1d8b0f65-1979-4463-84d2-91c84a3af88d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:16.223989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1d8b0f65-1979-4463-84d2-91c84a3af88d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:16.232570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d8b0f65-1979-4463-84d2-91c84a3af88d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:16.233902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d8b0f65-1979-4463-84d2-91c84a3af88d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:16.235199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d8b0f65-1979-4463-84d2-91c84a3af88d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:16.236356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d8b0f65-1979-4463-84d2-91c84a3af88d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:16.237194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d8b0f65-1979-4463-84d2-91c84a3af88d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:16.238053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d8b0f65-1979-4463-84d2-91c84a3af88d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:16.382617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-53e862cd-ffbe-48be-b37b-68d2c9113d0c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:16.383228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-53e862cd-ffbe-48be-b37b-68d2c9113d0c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:16.402866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53e862cd-ffbe-48be-b37b-68d2c9113d0c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:16.403362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53e862cd-ffbe-48be-b37b-68d2c9113d0c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:16.403805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53e862cd-ffbe-48be-b37b-68d2c9113d0c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:16.404523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53e862cd-ffbe-48be-b37b-68d2c9113d0c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:16.405654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53e862cd-ffbe-48be-b37b-68d2c9113d0c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:16.407028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53e862cd-ffbe-48be-b37b-68d2c9113d0c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:16.456559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1d8b0f65-1979-4463-84d2-91c84a3af88d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:16.465595 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1d8b0f65-1979-4463-84d2-91c84a3af88d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99" status: 200 len: 1319 microversion: 2.1 time: 0.249423 Oct 24 10:46:16.477017 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2257/4575] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:16 2022] GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:16.621399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-53e862cd-ffbe-48be-b37b-68d2c9113d0c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:16.631457 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-53e862cd-ffbe-48be-b37b-68d2c9113d0c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1519 microversion: 2.1 time: 0.252659 Oct 24 10:46:16.633409 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2319/4576] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:16 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1519 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:16.772665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c0dcd965-49dc-4047-81bb-404b6929ccf1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:16.773290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c0dcd965-49dc-4047-81bb-404b6929ccf1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:16.790867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0dcd965-49dc-4047-81bb-404b6929ccf1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:16.791365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0dcd965-49dc-4047-81bb-404b6929ccf1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:16.791803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0dcd965-49dc-4047-81bb-404b6929ccf1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:16.792524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0dcd965-49dc-4047-81bb-404b6929ccf1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:16.793021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0dcd965-49dc-4047-81bb-404b6929ccf1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:16.793453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0dcd965-49dc-4047-81bb-404b6929ccf1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:17.060580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0dcd965-49dc-4047-81bb-404b6929ccf1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:17.071197 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c0dcd965-49dc-4047-81bb-404b6929ccf1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 200 len: 1518 microversion: 2.1 time: 0.302154 Oct 24 10:46:17.072406 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2258/4577] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:16 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 1518 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:17.136292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9be3aa53-8d0e-420d-ace7-d4aaa0c95082 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:17.136292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9be3aa53-8d0e-420d-ace7-d4aaa0c95082 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:17.151535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9be3aa53-8d0e-420d-ace7-d4aaa0c95082 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:17.152104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9be3aa53-8d0e-420d-ace7-d4aaa0c95082 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:17.153101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9be3aa53-8d0e-420d-ace7-d4aaa0c95082 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:17.153920 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9be3aa53-8d0e-420d-ace7-d4aaa0c95082 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:17.154449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9be3aa53-8d0e-420d-ace7-d4aaa0c95082 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:17.155292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9be3aa53-8d0e-420d-ace7-d4aaa0c95082 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:17.455587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1b0e651d-ed2a-4047-9858-c16b0f28bce7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:17.456298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1b0e651d-ed2a-4047-9858-c16b0f28bce7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:17.473029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b0e651d-ed2a-4047-9858-c16b0f28bce7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:17.478371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b0e651d-ed2a-4047-9858-c16b0f28bce7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:17.478847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b0e651d-ed2a-4047-9858-c16b0f28bce7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:17.479599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b0e651d-ed2a-4047-9858-c16b0f28bce7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:17.480130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b0e651d-ed2a-4047-9858-c16b0f28bce7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:17.497570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b0e651d-ed2a-4047-9858-c16b0f28bce7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:17.557678 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1b0e651d-ed2a-4047-9858-c16b0f28bce7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments/d36e4517-1c37-4bac-97eb-278fe5e64461" status: 200 len: 194 microversion: 2.20 time: 0.108300 Oct 24 10:46:17.558927 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2259/4578] 10.222.0.50 () {60 vars in 1454 bytes} [Mon Oct 24 10:46:17 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments/d36e4517-1c37-4bac-97eb-278fe5e64461 => generated 194 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 10:46:17.566259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5d7d4847-5552-4bc4-b2f8-69ac96a9ee29 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:17.567770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5d7d4847-5552-4bc4-b2f8-69ac96a9ee29 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:17.587460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d7d4847-5552-4bc4-b2f8-69ac96a9ee29 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:17.588367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d7d4847-5552-4bc4-b2f8-69ac96a9ee29 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:17.589116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d7d4847-5552-4bc4-b2f8-69ac96a9ee29 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:17.590418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d7d4847-5552-4bc4-b2f8-69ac96a9ee29 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:17.591117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d7d4847-5552-4bc4-b2f8-69ac96a9ee29 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:17.592530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d7d4847-5552-4bc4-b2f8-69ac96a9ee29 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:17.608120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9be3aa53-8d0e-420d-ace7-d4aaa0c95082 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:17.623044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9be3aa53-8d0e-420d-ace7-d4aaa0c95082 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:17.626042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9be3aa53-8d0e-420d-ace7-d4aaa0c95082 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:17.628384 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9be3aa53-8d0e-420d-ace7-d4aaa0c95082 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.496571 Oct 24 10:46:17.631332 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2320/4579] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:17 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:17.658741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dbe706f1-e557-404a-8a54-d3ea9005b548 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:17.661744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dbe706f1-e557-404a-8a54-d3ea9005b548 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:17.683695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbe706f1-e557-404a-8a54-d3ea9005b548 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:17.684336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbe706f1-e557-404a-8a54-d3ea9005b548 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:17.685315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbe706f1-e557-404a-8a54-d3ea9005b548 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:17.688597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbe706f1-e557-404a-8a54-d3ea9005b548 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:17.689357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbe706f1-e557-404a-8a54-d3ea9005b548 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:17.691683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbe706f1-e557-404a-8a54-d3ea9005b548 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:17.961712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5d7d4847-5552-4bc4-b2f8-69ac96a9ee29 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:17.978641 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5d7d4847-5552-4bc4-b2f8-69ac96a9ee29 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99" status: 200 len: 1319 microversion: 2.1 time: 0.418359 Oct 24 10:46:17.979935 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2260/4580] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:17 2022] GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99 => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:17.987065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e6efdc8a-9053-4196-96b0-acad7e9f636a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:17.987822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e6efdc8a-9053-4196-96b0-acad7e9f636a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:17.998800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6efdc8a-9053-4196-96b0-acad7e9f636a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:18.000240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6efdc8a-9053-4196-96b0-acad7e9f636a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:18.001523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6efdc8a-9053-4196-96b0-acad7e9f636a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:18.003252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6efdc8a-9053-4196-96b0-acad7e9f636a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:18.004179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6efdc8a-9053-4196-96b0-acad7e9f636a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:18.005423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6efdc8a-9053-4196-96b0-acad7e9f636a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:18.006949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dbe706f1-e557-404a-8a54-d3ea9005b548 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:18.018295 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dbe706f1-e557-404a-8a54-d3ea9005b548 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1519 microversion: 2.1 time: 0.367935 Oct 24 10:46:18.021678 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2321/4581] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:17 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1519 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:18.191189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-e6efdc8a-9053-4196-96b0-acad7e9f636a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lazy-loading 'services' on Instance uuid e6eb3578-42ca-4dc5-b31a-e5500aa94f2e {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:46:18.308630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d7866d18-f28e-49f4-bce4-74887eb13482 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1963511966", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "ea14b7bf-289a-4b27-a2a5-5e88a171ea45"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:18.357866 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e6efdc8a-9053-4196-96b0-acad7e9f636a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments/d36e4517-1c37-4bac-97eb-278fe5e64461" status: 202 len: 0 microversion: 2.20 time: 0.352818 Oct 24 10:46:18.358576 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2261/4582] 10.222.0.50 () {60 vars in 1457 bytes} [Mon Oct 24 10:46:17 2022] DELETE /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments/d36e4517-1c37-4bac-97eb-278fe5e64461 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:46:18.385843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ca0ca39f-8ec8-427b-b6f8-73298e70f827 req-5e9cfffc-4bb3-443c-a2e1-6094944f6be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e709ac15-ec83-4539-b417-27751f4ebf99", "name": "network-vif-plugged", "status": "completed", "tag": "8bf2b101-eca4-4c53-b9ea-be1aa58966f9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:18.409147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-d7866d18-f28e-49f4-bce4-74887eb13482 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] validate_networks() for [('ea14b7bf-289a-4b27-a2a5-5e88a171ea45', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:46:18.423338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ca0ca39f-8ec8-427b-b6f8-73298e70f827 req-5e9cfffc-4bb3-443c-a2e1-6094944f6be3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:18.425372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ca0ca39f-8ec8-427b-b6f8-73298e70f827 req-5e9cfffc-4bb3-443c-a2e1-6094944f6be3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:18.428296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ca0ca39f-8ec8-427b-b6f8-73298e70f827 req-5e9cfffc-4bb3-443c-a2e1-6094944f6be3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:18.462253 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ca0ca39f-8ec8-427b-b6f8-73298e70f827 req-5e9cfffc-4bb3-443c-a2e1-6094944f6be3 service nova] Creating event network-vif-plugged:8bf2b101-eca4-4c53-b9ea-be1aa58966f9 for instance e709ac15-ec83-4539-b417-27751f4ebf99 on n-h2-858383-15 Oct 24 10:46:18.468299 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ca0ca39f-8ec8-427b-b6f8-73298e70f827 req-5e9cfffc-4bb3-443c-a2e1-6094944f6be3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108181 Oct 24 10:46:18.470952 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2262/4583] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:18.485224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b587b2ef-e0b8-46ff-b23d-06ed58084b08 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:18.487395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b587b2ef-e0b8-46ff-b23d-06ed58084b08 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:18.505414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b587b2ef-e0b8-46ff-b23d-06ed58084b08 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:18.505926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b587b2ef-e0b8-46ff-b23d-06ed58084b08 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:18.508285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b587b2ef-e0b8-46ff-b23d-06ed58084b08 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:18.509022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b587b2ef-e0b8-46ff-b23d-06ed58084b08 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:18.511795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b587b2ef-e0b8-46ff-b23d-06ed58084b08 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:18.512287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b587b2ef-e0b8-46ff-b23d-06ed58084b08 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:18.570262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b587b2ef-e0b8-46ff-b23d-06ed58084b08 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:18.571321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b587b2ef-e0b8-46ff-b23d-06ed58084b08 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:18.571925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b587b2ef-e0b8-46ff-b23d-06ed58084b08 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:18.573098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-b587b2ef-e0b8-46ff-b23d-06ed58084b08 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lazy-loading 'fault' on Instance uuid 1335ca39-c87a-463e-9952-cdefaea18272 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:46:18.699898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b587b2ef-e0b8-46ff-b23d-06ed58084b08 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:18.710694 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b587b2ef-e0b8-46ff-b23d-06ed58084b08 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 200 len: 1320 microversion: 2.1 time: 0.238667 Oct 24 10:46:18.711331 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2263/4584] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:18 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 1320 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:18.728584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3c7bc247-5856-42fc-8c84-ac5d767c8aec req-9d93e3c5-39c3-4733-8dc3-83cac7b13bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1335ca39-c87a-463e-9952-cdefaea18272", "name": "network-vif-deleted", "tag": "5adb0f42-2d7b-4633-a6ec-68b8f247730e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:18.741888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3c7bc247-5856-42fc-8c84-ac5d767c8aec req-9d93e3c5-39c3-4733-8dc3-83cac7b13bb3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:18.742679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3c7bc247-5856-42fc-8c84-ac5d767c8aec req-9d93e3c5-39c3-4733-8dc3-83cac7b13bb3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:18.743724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3c7bc247-5856-42fc-8c84-ac5d767c8aec req-9d93e3c5-39c3-4733-8dc3-83cac7b13bb3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:18.760704 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3c7bc247-5856-42fc-8c84-ac5d767c8aec req-9d93e3c5-39c3-4733-8dc3-83cac7b13bb3 service nova] Creating event network-vif-deleted:5adb0f42-2d7b-4633-a6ec-68b8f247730e for instance 1335ca39-c87a-463e-9952-cdefaea18272 on n-h2-858383-15 Oct 24 10:46:18.767345 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3c7bc247-5856-42fc-8c84-ac5d767c8aec req-9d93e3c5-39c3-4733-8dc3-83cac7b13bb3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043587 Oct 24 10:46:18.768172 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2264/4585] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:18.776442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e0229dca-e7d6-4e7f-9445-f92ee88788e6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:18.778782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e0229dca-e7d6-4e7f-9445-f92ee88788e6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:18.787105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0229dca-e7d6-4e7f-9445-f92ee88788e6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:18.787608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0229dca-e7d6-4e7f-9445-f92ee88788e6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:18.788057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0229dca-e7d6-4e7f-9445-f92ee88788e6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:18.788785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0229dca-e7d6-4e7f-9445-f92ee88788e6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:18.789352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0229dca-e7d6-4e7f-9445-f92ee88788e6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:18.790196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0229dca-e7d6-4e7f-9445-f92ee88788e6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:18.825197 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e0229dca-e7d6-4e7f-9445-f92ee88788e6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052779 Oct 24 10:46:18.825785 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2265/4586] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:46:18 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:46:18.835450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-af7dfb0f-201e-4497-ae8e-00337362e0dc tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:18.836076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-af7dfb0f-201e-4497-ae8e-00337362e0dc tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:18.842172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af7dfb0f-201e-4497-ae8e-00337362e0dc tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:18.842793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af7dfb0f-201e-4497-ae8e-00337362e0dc tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:18.843397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af7dfb0f-201e-4497-ae8e-00337362e0dc tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:18.844683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af7dfb0f-201e-4497-ae8e-00337362e0dc tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:18.845177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af7dfb0f-201e-4497-ae8e-00337362e0dc tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:18.845617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af7dfb0f-201e-4497-ae8e-00337362e0dc tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:19.197105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-af7dfb0f-201e-4497-ae8e-00337362e0dc tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:19.214476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-af7dfb0f-201e-4497-ae8e-00337362e0dc tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:19.217309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-af7dfb0f-201e-4497-ae8e-00337362e0dc tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:19.221367 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-af7dfb0f-201e-4497-ae8e-00337362e0dc tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.389641 Oct 24 10:46:19.223848 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2266/4587] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:18 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:19.244673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d7866d18-f28e-49f4-bce4-74887eb13482 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:46:19.245394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d7866d18-f28e-49f4-bce4-74887eb13482 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:46:19.245919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d7866d18-f28e-49f4-bce4-74887eb13482 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:46:19.246450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d7866d18-f28e-49f4-bce4-74887eb13482 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:46:19.246892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d7866d18-f28e-49f4-bce4-74887eb13482 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:46:19.255391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cefee735-b122-4c00-bcbf-9fd8cdd0c0c5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:19.257259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cefee735-b122-4c00-bcbf-9fd8cdd0c0c5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:19.271193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cefee735-b122-4c00-bcbf-9fd8cdd0c0c5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:19.271608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cefee735-b122-4c00-bcbf-9fd8cdd0c0c5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:19.272076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cefee735-b122-4c00-bcbf-9fd8cdd0c0c5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:19.272930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cefee735-b122-4c00-bcbf-9fd8cdd0c0c5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:19.273396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cefee735-b122-4c00-bcbf-9fd8cdd0c0c5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:19.274021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cefee735-b122-4c00-bcbf-9fd8cdd0c0c5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:19.275057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7866d18-f28e-49f4-bce4-74887eb13482 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:19.276327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7866d18-f28e-49f4-bce4-74887eb13482 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:19.277043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7866d18-f28e-49f4-bce4-74887eb13482 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:19.277986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7866d18-f28e-49f4-bce4-74887eb13482 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:19.278444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7866d18-f28e-49f4-bce4-74887eb13482 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:19.305843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7866d18-f28e-49f4-bce4-74887eb13482 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:19.353816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d7866d18-f28e-49f4-bce4-74887eb13482 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Getting quotas for project 62e0b76a9bec4493b85d125ebafe1987. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:46:19.361559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d7866d18-f28e-49f4-bce4-74887eb13482 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Getting quotas for user e51a666b23af4082babf718206d6a01e and project 62e0b76a9bec4493b85d125ebafe1987. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:46:19.367287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:19.387725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d7866d18-f28e-49f4-bce4-74887eb13482 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:46:19.393665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d7866d18-f28e-49f4-bce4-74887eb13482 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:46:19.526491 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d7866d18-f28e-49f4-bce4-74887eb13482 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.502812 Oct 24 10:46:19.527648 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2322/4588] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Oct 24 10:46:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1505 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 10:46:19.534760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cefee735-b122-4c00-bcbf-9fd8cdd0c0c5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:19.543862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ee89b973-1349-4071-af39-3261ef2f4a66 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:19.545608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ee89b973-1349-4071-af39-3261ef2f4a66 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:19.560689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee89b973-1349-4071-af39-3261ef2f4a66 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:19.563427 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cefee735-b122-4c00-bcbf-9fd8cdd0c0c5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99" status: 200 len: 1319 microversion: 2.1 time: 0.336599 Oct 24 10:46:19.565119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee89b973-1349-4071-af39-3261ef2f4a66 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:19.565727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee89b973-1349-4071-af39-3261ef2f4a66 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:19.566781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee89b973-1349-4071-af39-3261ef2f4a66 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:19.568756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee89b973-1349-4071-af39-3261ef2f4a66 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:19.569544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee89b973-1349-4071-af39-3261ef2f4a66 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:19.570302 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2267/4589] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:19 2022] GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:19.593257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09db71cc-80b2-4418-b1d8-dde1122be110 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:19.596873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09db71cc-80b2-4418-b1d8-dde1122be110 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:19.708089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-09db71cc-80b2-4418-b1d8-dde1122be110 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:19.731957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-09db71cc-80b2-4418-b1d8-dde1122be110 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:19.738438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-09db71cc-80b2-4418-b1d8-dde1122be110 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:19.743853 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-09db71cc-80b2-4418-b1d8-dde1122be110 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1262 microversion: 2.26 time: 0.168791 Oct 24 10:46:19.744792 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2268/4590] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:19 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1262 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:19.759076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0da4d0d1-84a5-491b-aea9-58d6d5d4d750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:19.759076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0da4d0d1-84a5-491b-aea9-58d6d5d4d750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:19.767949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0da4d0d1-84a5-491b-aea9-58d6d5d4d750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:19.768473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0da4d0d1-84a5-491b-aea9-58d6d5d4d750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:19.768938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0da4d0d1-84a5-491b-aea9-58d6d5d4d750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:19.769661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0da4d0d1-84a5-491b-aea9-58d6d5d4d750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:19.770215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0da4d0d1-84a5-491b-aea9-58d6d5d4d750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:19.770732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0da4d0d1-84a5-491b-aea9-58d6d5d4d750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:19.811030 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-0da4d0d1-84a5-491b-aea9-58d6d5d4d750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance 1335ca39-c87a-463e-9952-cdefaea18272 could not be found. Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0da4d0d1-84a5-491b-aea9-58d6d5d4d750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 HTTP/1.1 Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 1335ca39-c87a-463e-9952-cdefaea18272 could not be found. Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '1335ca39-c87a-463e-9952-cdefaea18272'} Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1335ca39-c87a-463e-9952-cdefaea18272 could not be found. Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1335ca39-c87a-463e-9952-cdefaea18272 could not be found. Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:46:19.813425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:46:19.819196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:46:19.819196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:46:19.819196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:46:19.819196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:46:19.819196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1335ca39-c87a-463e-9952-cdefaea18272 could not be found. Oct 24 10:46:19.819196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:46:19.819196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0da4d0d1-84a5-491b-aea9-58d6d5d4d750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance 1335ca39-c87a-463e-9952-cdefaea18272 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:46:19.829352 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0da4d0d1-84a5-491b-aea9-58d6d5d4d750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 404 len: 111 microversion: 2.1 time: 0.071604 Oct 24 10:46:19.830680 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2269/4591] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:19 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:46:19.850775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-37714279-17fd-4a3a-a0d8-53112c9f08ef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:19.854515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-37714279-17fd-4a3a-a0d8-53112c9f08ef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:19.864184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37714279-17fd-4a3a-a0d8-53112c9f08ef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:19.864902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37714279-17fd-4a3a-a0d8-53112c9f08ef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:19.866426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37714279-17fd-4a3a-a0d8-53112c9f08ef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:19.867257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37714279-17fd-4a3a-a0d8-53112c9f08ef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:19.867844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37714279-17fd-4a3a-a0d8-53112c9f08ef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:19.868449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37714279-17fd-4a3a-a0d8-53112c9f08ef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:19.929617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:19.950176 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-37714279-17fd-4a3a-a0d8-53112c9f08ef tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.106700 Oct 24 10:46:19.957961 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2270/4592] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:46:19 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:46:19.976448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ee89b973-1349-4071-af39-3261ef2f4a66 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:19.992309 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ee89b973-1349-4071-af39-3261ef2f4a66 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1519 microversion: 2.1 time: 0.455710 Oct 24 10:46:19.999504 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2323/4593] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:19 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1519 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:20.060323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f06a27e5-9aa3-4668-ae12-5a0b03d7cc39 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1300001458", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "734fc132-fff0-4bf7-9775-3a17fdcd25dc"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:20.152559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-f06a27e5-9aa3-4668-ae12-5a0b03d7cc39 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] validate_networks() for [('734fc132-fff0-4bf7-9775-3a17fdcd25dc', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:46:20.254771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-05656fa6-9800-461e-a1a7-a616de691e2e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:20.256400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-05656fa6-9800-461e-a1a7-a616de691e2e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:20.264703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05656fa6-9800-461e-a1a7-a616de691e2e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:20.266522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05656fa6-9800-461e-a1a7-a616de691e2e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:20.267007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05656fa6-9800-461e-a1a7-a616de691e2e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:20.268356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05656fa6-9800-461e-a1a7-a616de691e2e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:20.268819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05656fa6-9800-461e-a1a7-a616de691e2e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:20.269277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05656fa6-9800-461e-a1a7-a616de691e2e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:20.727184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-05656fa6-9800-461e-a1a7-a616de691e2e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:20.741682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-05656fa6-9800-461e-a1a7-a616de691e2e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:20.743181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-05656fa6-9800-461e-a1a7-a616de691e2e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:20.749397 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-05656fa6-9800-461e-a1a7-a616de691e2e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.500212 Oct 24 10:46:20.750763 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2324/4594] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:20 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:46:20.758041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-72730084-bf18-48f9-9942-f465b5bc6ad0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:20.759000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-72730084-bf18-48f9-9942-f465b5bc6ad0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:20.773881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72730084-bf18-48f9-9942-f465b5bc6ad0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:20.774470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72730084-bf18-48f9-9942-f465b5bc6ad0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:20.775037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72730084-bf18-48f9-9942-f465b5bc6ad0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:20.775766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72730084-bf18-48f9-9942-f465b5bc6ad0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:20.776229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72730084-bf18-48f9-9942-f465b5bc6ad0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:20.776659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72730084-bf18-48f9-9942-f465b5bc6ad0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:21.528425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-f06a27e5-9aa3-4668-ae12-5a0b03d7cc39 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:46:21.529675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-f06a27e5-9aa3-4668-ae12-5a0b03d7cc39 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:46:21.530240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-72730084-bf18-48f9-9942-f465b5bc6ad0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:21.530696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-f06a27e5-9aa3-4668-ae12-5a0b03d7cc39 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:46:21.532104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-f06a27e5-9aa3-4668-ae12-5a0b03d7cc39 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:46:21.532531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-f06a27e5-9aa3-4668-ae12-5a0b03d7cc39 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:46:21.541889 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-72730084-bf18-48f9-9942-f465b5bc6ad0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99" status: 200 len: 1319 microversion: 2.1 time: 0.789083 Oct 24 10:46:21.551460 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2325/4595] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:20 2022] GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99 => generated 1319 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:21.560358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-5c036eca-da24-4e6a-80f5-6ef782c8020e req-43d552ed-04dc-4ec6-b25f-983c1176e3e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba574b8-fd7b-4914-b2e1-0ef7c7beb55d", "name": "network-vif-plugged", "status": "completed", "tag": "f3cf98a5-3ab6-4a6a-9fe2-d2836e5f960d"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:21.563020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f06a27e5-9aa3-4668-ae12-5a0b03d7cc39 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:21.563755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f06a27e5-9aa3-4668-ae12-5a0b03d7cc39 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:21.565395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f06a27e5-9aa3-4668-ae12-5a0b03d7cc39 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:21.566547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f06a27e5-9aa3-4668-ae12-5a0b03d7cc39 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:21.567838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f06a27e5-9aa3-4668-ae12-5a0b03d7cc39 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:21.568636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f06a27e5-9aa3-4668-ae12-5a0b03d7cc39 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:21.586122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5c036eca-da24-4e6a-80f5-6ef782c8020e req-43d552ed-04dc-4ec6-b25f-983c1176e3e7 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:21.586627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5c036eca-da24-4e6a-80f5-6ef782c8020e req-43d552ed-04dc-4ec6-b25f-983c1176e3e7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:21.587064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5c036eca-da24-4e6a-80f5-6ef782c8020e req-43d552ed-04dc-4ec6-b25f-983c1176e3e7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:21.610462 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-5c036eca-da24-4e6a-80f5-6ef782c8020e req-43d552ed-04dc-4ec6-b25f-983c1176e3e7 service nova] Creating event network-vif-plugged:f3cf98a5-3ab6-4a6a-9fe2-d2836e5f960d for instance dba574b8-fd7b-4914-b2e1-0ef7c7beb55d on n-h1-858383-15 Oct 24 10:46:21.614396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-f06a27e5-9aa3-4668-ae12-5a0b03d7cc39 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Getting quotas for project 9ab3028765ba447589bf595a603ea2e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:46:21.627422 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-5c036eca-da24-4e6a-80f5-6ef782c8020e req-43d552ed-04dc-4ec6-b25f-983c1176e3e7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073211 Oct 24 10:46:21.627642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-f06a27e5-9aa3-4668-ae12-5a0b03d7cc39 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Getting quotas for user ed058a5e8ac14236ab2e8783e9170346 and project 9ab3028765ba447589bf595a603ea2e3. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:46:21.628744 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2326/4596] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:21.639059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54a13197-0956-4d44-b498-4d6fa8a4982c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:21.648158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-54a13197-0956-4d44-b498-4d6fa8a4982c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:21.649167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f06a27e5-9aa3-4668-ae12-5a0b03d7cc39 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:46:21.658628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54a13197-0956-4d44-b498-4d6fa8a4982c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:21.659384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54a13197-0956-4d44-b498-4d6fa8a4982c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:21.659829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54a13197-0956-4d44-b498-4d6fa8a4982c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:21.660552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54a13197-0956-4d44-b498-4d6fa8a4982c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:21.661292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f06a27e5-9aa3-4668-ae12-5a0b03d7cc39 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:46:21.667800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54a13197-0956-4d44-b498-4d6fa8a4982c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:21.668365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54a13197-0956-4d44-b498-4d6fa8a4982c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:21.768294 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f06a27e5-9aa3-4668-ae12-5a0b03d7cc39 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.709120 Oct 24 10:46:21.779284 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2271/4597] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:46:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:46:21.787021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-489133c2-cd90-405e-9e2c-a240df5f9272 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:21.790363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-489133c2-cd90-405e-9e2c-a240df5f9272 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:21.800669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:21.802471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-489133c2-cd90-405e-9e2c-a240df5f9272 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:21.803194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-489133c2-cd90-405e-9e2c-a240df5f9272 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:21.803989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-489133c2-cd90-405e-9e2c-a240df5f9272 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:21.805106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-489133c2-cd90-405e-9e2c-a240df5f9272 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:21.805802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-489133c2-cd90-405e-9e2c-a240df5f9272 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:21.806507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-489133c2-cd90-405e-9e2c-a240df5f9272 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:21.846214 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-489133c2-cd90-405e-9e2c-a240df5f9272 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065298 Oct 24 10:46:21.847628 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2272/4598] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:46:21 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:46:21.854665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f96172d5-de3a-44b0-abd4-b08203b9bc98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:21.855591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f96172d5-de3a-44b0-abd4-b08203b9bc98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:21.865751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f96172d5-de3a-44b0-abd4-b08203b9bc98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:21.867835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f96172d5-de3a-44b0-abd4-b08203b9bc98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:21.868628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f96172d5-de3a-44b0-abd4-b08203b9bc98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:21.869814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f96172d5-de3a-44b0-abd4-b08203b9bc98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:21.871305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f96172d5-de3a-44b0-abd4-b08203b9bc98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:21.872378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f96172d5-de3a-44b0-abd4-b08203b9bc98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:21.922725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-54a13197-0956-4d44-b498-4d6fa8a4982c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:21.939076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-54a13197-0956-4d44-b498-4d6fa8a4982c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:21.944708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-54a13197-0956-4d44-b498-4d6fa8a4982c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:21.952726 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-54a13197-0956-4d44-b498-4d6fa8a4982c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1332 microversion: 2.26 time: 0.320910 Oct 24 10:46:21.954644 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2327/4599] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:21 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1332 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:21.965849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-35f8b132-c00d-4bf1-bf70-a6150c42ce26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:21.969750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-35f8b132-c00d-4bf1-bf70-a6150c42ce26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:21.985593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35f8b132-c00d-4bf1-bf70-a6150c42ce26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:21.986171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35f8b132-c00d-4bf1-bf70-a6150c42ce26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:21.987729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35f8b132-c00d-4bf1-bf70-a6150c42ce26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:21.988488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35f8b132-c00d-4bf1-bf70-a6150c42ce26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:21.989124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35f8b132-c00d-4bf1-bf70-a6150c42ce26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:21.994847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35f8b132-c00d-4bf1-bf70-a6150c42ce26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:22.526335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-35f8b132-c00d-4bf1-bf70-a6150c42ce26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:22.539878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-35f8b132-c00d-4bf1-bf70-a6150c42ce26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:22.549664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-35f8b132-c00d-4bf1-bf70-a6150c42ce26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:22.551081 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-35f8b132-c00d-4bf1-bf70-a6150c42ce26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.593290 Oct 24 10:46:22.551749 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2328/4600] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:21 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:22.569552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bdeba78a-7d56-4e8c-a556-00e3e7cb30b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:22.571110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bdeba78a-7d56-4e8c-a556-00e3e7cb30b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:22.587285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f96172d5-de3a-44b0-abd4-b08203b9bc98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:22.588048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bdeba78a-7d56-4e8c-a556-00e3e7cb30b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:22.588751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bdeba78a-7d56-4e8c-a556-00e3e7cb30b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:22.589549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bdeba78a-7d56-4e8c-a556-00e3e7cb30b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:22.590787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bdeba78a-7d56-4e8c-a556-00e3e7cb30b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:22.591533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bdeba78a-7d56-4e8c-a556-00e3e7cb30b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:22.593000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bdeba78a-7d56-4e8c-a556-00e3e7cb30b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:22.600850 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f96172d5-de3a-44b0-abd4-b08203b9bc98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1519 microversion: 2.1 time: 0.751688 Oct 24 10:46:22.620591 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2273/4601] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:21 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1519 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:22.627819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8eae6086-a21f-4c44-bce8-95cfd7242570 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:22.628687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8eae6086-a21f-4c44-bce8-95cfd7242570 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:22.638113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8eae6086-a21f-4c44-bce8-95cfd7242570 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:22.638976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8eae6086-a21f-4c44-bce8-95cfd7242570 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:22.639771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8eae6086-a21f-4c44-bce8-95cfd7242570 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:22.641180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8eae6086-a21f-4c44-bce8-95cfd7242570 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:22.642014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8eae6086-a21f-4c44-bce8-95cfd7242570 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:22.643036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8eae6086-a21f-4c44-bce8-95cfd7242570 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:22.717243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bdeba78a-7d56-4e8c-a556-00e3e7cb30b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:22.732687 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bdeba78a-7d56-4e8c-a556-00e3e7cb30b9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1213 microversion: 2.1 time: 0.179432 Oct 24 10:46:22.733350 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2329/4602] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:22 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1213 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:22.859838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ec14fa4b-3e89-47b3-a20a-226774add031 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:22.862727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ec14fa4b-3e89-47b3-a20a-226774add031 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:22.870406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec14fa4b-3e89-47b3-a20a-226774add031 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:22.871305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec14fa4b-3e89-47b3-a20a-226774add031 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:22.871971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec14fa4b-3e89-47b3-a20a-226774add031 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:22.873062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec14fa4b-3e89-47b3-a20a-226774add031 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:22.873764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec14fa4b-3e89-47b3-a20a-226774add031 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:22.874264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec14fa4b-3e89-47b3-a20a-226774add031 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:22.970839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8eae6086-a21f-4c44-bce8-95cfd7242570 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:22.982670 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8eae6086-a21f-4c44-bce8-95cfd7242570 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99" status: 200 len: 1507 microversion: 2.1 time: 0.360728 Oct 24 10:46:22.983279 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2274/4603] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:22 2022] GET /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99 => generated 1507 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:22.990850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-adc625e3-5d2f-4608-8509-7e6803fa25bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:22.991480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-adc625e3-5d2f-4608-8509-7e6803fa25bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:23.000941 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ec14fa4b-3e89-47b3-a20a-226774add031 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.145198 Oct 24 10:46:23.009909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adc625e3-5d2f-4608-8509-7e6803fa25bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:23.010477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adc625e3-5d2f-4608-8509-7e6803fa25bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:23.012579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adc625e3-5d2f-4608-8509-7e6803fa25bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:23.013048 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2330/4604] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:46:22 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:46:23.014623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adc625e3-5d2f-4608-8509-7e6803fa25bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:23.015117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adc625e3-5d2f-4608-8509-7e6803fa25bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:23.017048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adc625e3-5d2f-4608-8509-7e6803fa25bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:23.025646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ef750bd9-86d3-47bb-8c63-ab3215e5bd4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:23.026580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ef750bd9-86d3-47bb-8c63-ab3215e5bd4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: 1cbddb45-3136-46ce-970e-0a056283a032] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:23.041694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef750bd9-86d3-47bb-8c63-ab3215e5bd4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:23.053175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef750bd9-86d3-47bb-8c63-ab3215e5bd4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:23.056259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef750bd9-86d3-47bb-8c63-ab3215e5bd4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:23.057365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef750bd9-86d3-47bb-8c63-ab3215e5bd4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:23.064312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef750bd9-86d3-47bb-8c63-ab3215e5bd4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:23.065848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef750bd9-86d3-47bb-8c63-ab3215e5bd4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:23.133318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-adc625e3-5d2f-4608-8509-7e6803fa25bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:23.146195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-adc625e3-5d2f-4608-8509-7e6803fa25bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:23.147689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-adc625e3-5d2f-4608-8509-7e6803fa25bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:23.148827 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-adc625e3-5d2f-4608-8509-7e6803fa25bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1320 microversion: 2.26 time: 0.164611 Oct 24 10:46:23.158868 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2275/4605] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:22 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1320 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:23.472349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ef750bd9-86d3-47bb-8c63-ab3215e5bd4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:23.486834 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ef750bd9-86d3-47bb-8c63-ab3215e5bd4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/1cbddb45-3136-46ce-970e-0a056283a032" status: 200 len: 1506 microversion: 2.1 time: 0.469817 Oct 24 10:46:23.488417 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2331/4606] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:23 2022] GET /compute/v2.1/servers/1cbddb45-3136-46ce-970e-0a056283a032 => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:23.523748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1145d2dc-7109-428c-9d50-75b1adf6e94d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:23.526531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1145d2dc-7109-428c-9d50-75b1adf6e94d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: 1cbddb45-3136-46ce-970e-0a056283a032] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:23.537255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1145d2dc-7109-428c-9d50-75b1adf6e94d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:23.538089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1145d2dc-7109-428c-9d50-75b1adf6e94d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:23.538768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1145d2dc-7109-428c-9d50-75b1adf6e94d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:23.539917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1145d2dc-7109-428c-9d50-75b1adf6e94d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:23.540730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1145d2dc-7109-428c-9d50-75b1adf6e94d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:23.541375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1145d2dc-7109-428c-9d50-75b1adf6e94d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:23.572727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1145d2dc-7109-428c-9d50-75b1adf6e94d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: 1cbddb45-3136-46ce-970e-0a056283a032] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:46:23.582596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3eb161b8-34b9-48bd-ac12-ecbf97bd60eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:23.583251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3eb161b8-34b9-48bd-ac12-ecbf97bd60eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:23.590776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3eb161b8-34b9-48bd-ac12-ecbf97bd60eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:23.591460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3eb161b8-34b9-48bd-ac12-ecbf97bd60eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:23.591841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3eb161b8-34b9-48bd-ac12-ecbf97bd60eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:23.604547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3eb161b8-34b9-48bd-ac12-ecbf97bd60eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:23.605382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3eb161b8-34b9-48bd-ac12-ecbf97bd60eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:23.605849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3eb161b8-34b9-48bd-ac12-ecbf97bd60eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:23.675942 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1145d2dc-7109-428c-9d50-75b1adf6e94d tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1cbddb45-3136-46ce-970e-0a056283a032" status: 204 len: 0 microversion: 2.1 time: 0.163822 Oct 24 10:46:23.677574 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2276/4607] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:46:23 2022] DELETE /compute/v2.1/servers/1cbddb45-3136-46ce-970e-0a056283a032 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:46:23.700297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c1bba6b5-d11a-4f57-8e84-0efef8d53420 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:23.701576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c1bba6b5-d11a-4f57-8e84-0efef8d53420 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:23.711961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1bba6b5-d11a-4f57-8e84-0efef8d53420 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:23.712711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1bba6b5-d11a-4f57-8e84-0efef8d53420 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:23.713356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1bba6b5-d11a-4f57-8e84-0efef8d53420 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:23.714432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1bba6b5-d11a-4f57-8e84-0efef8d53420 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:23.715053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1bba6b5-d11a-4f57-8e84-0efef8d53420 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:23.715647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1bba6b5-d11a-4f57-8e84-0efef8d53420 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:24.069200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c1bba6b5-d11a-4f57-8e84-0efef8d53420 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:24.077881 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c1bba6b5-d11a-4f57-8e84-0efef8d53420 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1519 microversion: 2.1 time: 0.398696 Oct 24 10:46:24.082363 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2277/4608] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:23 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1519 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:24.087425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-278e390a-334c-4a2e-b70b-8b90bc7af4aa tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:24.089261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-278e390a-334c-4a2e-b70b-8b90bc7af4aa tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:24.098663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3eb161b8-34b9-48bd-ac12-ecbf97bd60eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:24.111040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3eb161b8-34b9-48bd-ac12-ecbf97bd60eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:24.112736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3eb161b8-34b9-48bd-ac12-ecbf97bd60eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:24.113006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-278e390a-334c-4a2e-b70b-8b90bc7af4aa tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:24.113683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-278e390a-334c-4a2e-b70b-8b90bc7af4aa tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:24.113969 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3eb161b8-34b9-48bd-ac12-ecbf97bd60eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.536729 Oct 24 10:46:24.114337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-278e390a-334c-4a2e-b70b-8b90bc7af4aa tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:24.115140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-278e390a-334c-4a2e-b70b-8b90bc7af4aa tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:24.115753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-278e390a-334c-4a2e-b70b-8b90bc7af4aa tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:24.116276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-278e390a-334c-4a2e-b70b-8b90bc7af4aa tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:24.128308 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2332/4609] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:23 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:46:24.140395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-03899c8e-61cd-4917-8eca-ac88e0535a5b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:24.141407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-03899c8e-61cd-4917-8eca-ac88e0535a5b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:24.149459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03899c8e-61cd-4917-8eca-ac88e0535a5b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:24.149801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03899c8e-61cd-4917-8eca-ac88e0535a5b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:24.150517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03899c8e-61cd-4917-8eca-ac88e0535a5b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:24.151320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03899c8e-61cd-4917-8eca-ac88e0535a5b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:24.152036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03899c8e-61cd-4917-8eca-ac88e0535a5b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:24.152209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-278e390a-334c-4a2e-b70b-8b90bc7af4aa tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e709ac15-ec83-4539-b417-27751f4ebf99] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:46:24.152790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03899c8e-61cd-4917-8eca-ac88e0535a5b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:24.232031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-03899c8e-61cd-4917-8eca-ac88e0535a5b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:24.241795 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-03899c8e-61cd-4917-8eca-ac88e0535a5b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1267 microversion: 2.1 time: 0.112285 Oct 24 10:46:24.243339 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2333/4610] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:24 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1267 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:24.244087 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-278e390a-334c-4a2e-b70b-8b90bc7af4aa tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99" status: 204 len: 0 microversion: 2.1 time: 0.159378 Oct 24 10:46:24.245153 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2278/4611] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:46:24 2022] DELETE /compute/v2.1/servers/e709ac15-ec83-4539-b417-27751f4ebf99 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:46:24.249173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-815cea4e-47a7-441e-a7c8-3495fb84b644 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:24.251864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-815cea4e-47a7-441e-a7c8-3495fb84b644 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:24.258158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-761a6d78-b5f0-4b1c-95f5-2a9aab14bad9 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:24.259015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-761a6d78-b5f0-4b1c-95f5-2a9aab14bad9 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:24.266832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-761a6d78-b5f0-4b1c-95f5-2a9aab14bad9 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:24.267527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-761a6d78-b5f0-4b1c-95f5-2a9aab14bad9 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:24.268027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-761a6d78-b5f0-4b1c-95f5-2a9aab14bad9 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:24.269258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-761a6d78-b5f0-4b1c-95f5-2a9aab14bad9 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:24.269636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-761a6d78-b5f0-4b1c-95f5-2a9aab14bad9 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:24.270109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-761a6d78-b5f0-4b1c-95f5-2a9aab14bad9 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:24.278462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-815cea4e-47a7-441e-a7c8-3495fb84b644 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:24.281746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-815cea4e-47a7-441e-a7c8-3495fb84b644 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:24.282691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-815cea4e-47a7-441e-a7c8-3495fb84b644 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:24.283973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-815cea4e-47a7-441e-a7c8-3495fb84b644 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:24.295554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-815cea4e-47a7-441e-a7c8-3495fb84b644 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:24.297667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-815cea4e-47a7-441e-a7c8-3495fb84b644 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:24.371524 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-815cea4e-47a7-441e-a7c8-3495fb84b644 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.126514 Oct 24 10:46:24.372519 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2334/4612] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:46:24 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:46:24.409072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-510688735", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "ec07ac35-7af1-4aa1-9715-c43024069832"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:24.472648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-761a6d78-b5f0-4b1c-95f5-2a9aab14bad9 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:24.481453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] validate_networks() for [('ec07ac35-7af1-4aa1-9715-c43024069832', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:46:24.483483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-761a6d78-b5f0-4b1c-95f5-2a9aab14bad9 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:24.485298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-761a6d78-b5f0-4b1c-95f5-2a9aab14bad9 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:24.494208 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-761a6d78-b5f0-4b1c-95f5-2a9aab14bad9 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1362 microversion: 2.26 time: 0.240401 Oct 24 10:46:24.504877 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2279/4613] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:24 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:25.108099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-63890da0-bdd6-4394-bdec-880243f9dd98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:25.110390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-63890da0-bdd6-4394-bdec-880243f9dd98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:25.138789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63890da0-bdd6-4394-bdec-880243f9dd98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:25.139293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63890da0-bdd6-4394-bdec-880243f9dd98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:25.142654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63890da0-bdd6-4394-bdec-880243f9dd98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:25.145468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63890da0-bdd6-4394-bdec-880243f9dd98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:25.158033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63890da0-bdd6-4394-bdec-880243f9dd98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:25.159429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63890da0-bdd6-4394-bdec-880243f9dd98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:25.355594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:46:25.356621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:46:25.357460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:46:25.358712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:46:25.361789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:46:25.394213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:25.395573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:25.396317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:25.397922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:25.399105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:25.400199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:25.466031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Getting quotas for project 51b48ea9adbe4711a3043add98c14ddb. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:46:25.494870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Getting quotas for user 9e32135e900a4b92b6fd23f458ba1d9d and project 51b48ea9adbe4711a3043add98c14ddb. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:46:25.527986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Going to run 2 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:46:25.535787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e35dae0d-896b-405b-a5a9-a9c951b30101] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:46:25.552696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-63890da0-bdd6-4394-bdec-880243f9dd98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:25.563327 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-63890da0-bdd6-4394-bdec-880243f9dd98 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1504 microversion: 2.1 time: 0.460050 Oct 24 10:46:25.577834 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2280/4614] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:25 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1504 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:25.590959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a43a99fe-5e04-4743-8156-a2c7bacb5c26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:25.591905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a43a99fe-5e04-4743-8156-a2c7bacb5c26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:25.600746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a43a99fe-5e04-4743-8156-a2c7bacb5c26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:25.601767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a43a99fe-5e04-4743-8156-a2c7bacb5c26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:25.603930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a43a99fe-5e04-4743-8156-a2c7bacb5c26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:25.605031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a43a99fe-5e04-4743-8156-a2c7bacb5c26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:25.605747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a43a99fe-5e04-4743-8156-a2c7bacb5c26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:25.606475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a43a99fe-5e04-4743-8156-a2c7bacb5c26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:25.613689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=e35dae0d-896b-405b-a5a9-a9c951b30101,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:46:25.737071 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f87a1088-547e-4bfd-b664-448b8c9afd3b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.332273 Oct 24 10:46:25.738063 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2335/4615] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:46:24 2022] POST /compute/v2.1/servers => generated 32 bytes in 1334 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 24 10:46:25.752417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-29850fc7-5883-4e40-bca1-f527d74eb42b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:25.753300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-29850fc7-5883-4e40-bca1-f527d74eb42b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:25.767749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29850fc7-5883-4e40-bca1-f527d74eb42b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:25.774038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29850fc7-5883-4e40-bca1-f527d74eb42b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:25.774725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29850fc7-5883-4e40-bca1-f527d74eb42b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:25.775772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29850fc7-5883-4e40-bca1-f527d74eb42b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:25.776578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29850fc7-5883-4e40-bca1-f527d74eb42b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:25.777259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29850fc7-5883-4e40-bca1-f527d74eb42b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:25.975181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a43a99fe-5e04-4743-8156-a2c7bacb5c26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:25.993641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a43a99fe-5e04-4743-8156-a2c7bacb5c26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:25.995098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a43a99fe-5e04-4743-8156-a2c7bacb5c26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:25.996300 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a43a99fe-5e04-4743-8156-a2c7bacb5c26 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.410233 Oct 24 10:46:26.011963 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2281/4616] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:25 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:26.011963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-347bb34c-8fa5-476d-8535-f82a6b8633f6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:26.011963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-347bb34c-8fa5-476d-8535-f82a6b8633f6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:26.025298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-347bb34c-8fa5-476d-8535-f82a6b8633f6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:26.025833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-347bb34c-8fa5-476d-8535-f82a6b8633f6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:26.026308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-347bb34c-8fa5-476d-8535-f82a6b8633f6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:26.027264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-347bb34c-8fa5-476d-8535-f82a6b8633f6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:26.027459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-347bb34c-8fa5-476d-8535-f82a6b8633f6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:26.027878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-347bb34c-8fa5-476d-8535-f82a6b8633f6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:26.103551 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-347bb34c-8fa5-476d-8535-f82a6b8633f6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.104250 Oct 24 10:46:26.105158 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2282/4617] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:46:25 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:46:26.114173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-62ebf852-b494-446f-9f4d-24c50889ab29 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:26.114801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-62ebf852-b494-446f-9f4d-24c50889ab29 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:26.130291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62ebf852-b494-446f-9f4d-24c50889ab29 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:26.132091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62ebf852-b494-446f-9f4d-24c50889ab29 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:26.132712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62ebf852-b494-446f-9f4d-24c50889ab29 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:26.138489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62ebf852-b494-446f-9f4d-24c50889ab29 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:26.139196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62ebf852-b494-446f-9f4d-24c50889ab29 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:26.139827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62ebf852-b494-446f-9f4d-24c50889ab29 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:26.382345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-29850fc7-5883-4e40-bca1-f527d74eb42b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:26.396484 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-29850fc7-5883-4e40-bca1-f527d74eb42b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1309 microversion: 2.1 time: 0.650112 Oct 24 10:46:26.409087 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2336/4618] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:25 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1309 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:26.409087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-37ecc19c-2827-4296-8a4e-c08438ac3cd1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:26.409087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-37ecc19c-2827-4296-8a4e-c08438ac3cd1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:26.419919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37ecc19c-2827-4296-8a4e-c08438ac3cd1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:26.420433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37ecc19c-2827-4296-8a4e-c08438ac3cd1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:26.426047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37ecc19c-2827-4296-8a4e-c08438ac3cd1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:26.427367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37ecc19c-2827-4296-8a4e-c08438ac3cd1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:26.429171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37ecc19c-2827-4296-8a4e-c08438ac3cd1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:26.429881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37ecc19c-2827-4296-8a4e-c08438ac3cd1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:26.464697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:26.699209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-62ebf852-b494-446f-9f4d-24c50889ab29 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:26.714983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-62ebf852-b494-446f-9f4d-24c50889ab29 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:26.716462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-62ebf852-b494-446f-9f4d-24c50889ab29 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:26.718257 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-62ebf852-b494-446f-9f4d-24c50889ab29 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1362 microversion: 2.26 time: 0.611556 Oct 24 10:46:26.718257 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2283/4619] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:26 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1362 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:26.730321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9c03421-a9e3-405b-8b06-98b5884d2cc5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:26.746152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f9c03421-a9e3-405b-8b06-98b5884d2cc5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:26.746836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f9c03421-a9e3-405b-8b06-98b5884d2cc5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Searching by: {'deleted': False, 'project_id': '51b48ea9adbe4711a3043add98c14ddb'} {{(pid=120425) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:46:26.783402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9c03421-a9e3-405b-8b06-98b5884d2cc5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:26.784491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9c03421-a9e3-405b-8b06-98b5884d2cc5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:26.785755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9c03421-a9e3-405b-8b06-98b5884d2cc5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:26.786407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9c03421-a9e3-405b-8b06-98b5884d2cc5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:26.787441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9c03421-a9e3-405b-8b06-98b5884d2cc5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:26.788454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9c03421-a9e3-405b-8b06-98b5884d2cc5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:26.832600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.multi_cell_list [None req-f9c03421-a9e3-405b-8b06-98b5884d2cc5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Listed batch of 4 results from cell out of 998 limit. Returned 4 total so far. {{(pid=120425) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:46:26.873967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:26.877603 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f9c03421-a9e3-405b-8b06-98b5884d2cc5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.157583 Oct 24 10:46:26.878421 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2284/4620] 10.222.0.50 () {58 vars in 1125 bytes} [Mon Oct 24 10:46:26 2022] GET /compute/v2.1/servers => generated 1333 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:26.912339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-72607571-23ed-4d0a-877b-8c2c12fd5448 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:26.914288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-72607571-23ed-4d0a-877b-8c2c12fd5448 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:27.238338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-72607571-23ed-4d0a-877b-8c2c12fd5448 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:27.257186 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-72607571-23ed-4d0a-877b-8c2c12fd5448 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee" status: 200 len: 1217 microversion: 2.1 time: 0.364264 Oct 24 10:46:27.268913 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2285/4621] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:26 2022] GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee => generated 1217 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:27.279121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7adc7e15-1de5-4254-9088-8cf964bd9bb3 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:27.282392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7adc7e15-1de5-4254-9088-8cf964bd9bb3 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:27.327298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7adc7e15-1de5-4254-9088-8cf964bd9bb3 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:27.328358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7adc7e15-1de5-4254-9088-8cf964bd9bb3 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:27.328828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7adc7e15-1de5-4254-9088-8cf964bd9bb3 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:27.330696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7adc7e15-1de5-4254-9088-8cf964bd9bb3 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:27.335550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7adc7e15-1de5-4254-9088-8cf964bd9bb3 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:27.336336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7adc7e15-1de5-4254-9088-8cf964bd9bb3 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:27.438656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-37ecc19c-2827-4296-8a4e-c08438ac3cd1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:27.454769 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-37ecc19c-2827-4296-8a4e-c08438ac3cd1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 200 len: 1504 microversion: 2.1 time: 1.054888 Oct 24 10:46:27.457728 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2337/4622] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:26 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 1504 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:27.473036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b36913eb-4b4b-45c8-bd0e-fef0413bf0fc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:27.482438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b36913eb-4b4b-45c8-bd0e-fef0413bf0fc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:27.509194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b36913eb-4b4b-45c8-bd0e-fef0413bf0fc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:27.510217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b36913eb-4b4b-45c8-bd0e-fef0413bf0fc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:27.511116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b36913eb-4b4b-45c8-bd0e-fef0413bf0fc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:27.512124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b36913eb-4b4b-45c8-bd0e-fef0413bf0fc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:27.514263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b36913eb-4b4b-45c8-bd0e-fef0413bf0fc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:27.520721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b36913eb-4b4b-45c8-bd0e-fef0413bf0fc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:27.611873 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b36913eb-4b4b-45c8-bd0e-fef0413bf0fc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.152305 Oct 24 10:46:27.613556 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2338/4623] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:46:27 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e/os-volume_attachments => generated 25 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:27.621166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-85c79b96-f973-4455-9e09-33b3bb50f82c req-96b31969-11bf-49e5-8469-078c43572898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cbddb45-3136-46ce-970e-0a056283a032", "name": "network-vif-deleted", "tag": "cfc27f4d-dd89-4e7b-87d2-0e251c19394a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:27.650246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-85c79b96-f973-4455-9e09-33b3bb50f82c req-96b31969-11bf-49e5-8469-078c43572898 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:27.651090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-85c79b96-f973-4455-9e09-33b3bb50f82c req-96b31969-11bf-49e5-8469-078c43572898 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:27.651751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-85c79b96-f973-4455-9e09-33b3bb50f82c req-96b31969-11bf-49e5-8469-078c43572898 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:27.685652 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-85c79b96-f973-4455-9e09-33b3bb50f82c req-96b31969-11bf-49e5-8469-078c43572898 service nova] Creating event network-vif-deleted:cfc27f4d-dd89-4e7b-87d2-0e251c19394a for instance 1cbddb45-3136-46ce-970e-0a056283a032 on n-h1-858383-15 Oct 24 10:46:27.704253 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-85c79b96-f973-4455-9e09-33b3bb50f82c req-96b31969-11bf-49e5-8469-078c43572898 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087019 Oct 24 10:46:27.705481 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2339/4624] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:27.719420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c9aa79e7-a5e9-4fa1-ac22-6ecd4bcffb3a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:27.759820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c9aa79e7-a5e9-4fa1-ac22-6ecd4bcffb3a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:27.769546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9aa79e7-a5e9-4fa1-ac22-6ecd4bcffb3a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:27.770331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9aa79e7-a5e9-4fa1-ac22-6ecd4bcffb3a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:27.771015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9aa79e7-a5e9-4fa1-ac22-6ecd4bcffb3a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:27.771963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9aa79e7-a5e9-4fa1-ac22-6ecd4bcffb3a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:27.772645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9aa79e7-a5e9-4fa1-ac22-6ecd4bcffb3a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:27.773371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9aa79e7-a5e9-4fa1-ac22-6ecd4bcffb3a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:27.838283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7adc7e15-1de5-4254-9088-8cf964bd9bb3 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:27.855507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7adc7e15-1de5-4254-9088-8cf964bd9bb3 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:27.860871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7adc7e15-1de5-4254-9088-8cf964bd9bb3 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:27.864634 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7adc7e15-1de5-4254-9088-8cf964bd9bb3 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.603128 Oct 24 10:46:27.866002 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2286/4625] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:27 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:27.873277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dccb9734-8545-45d3-97d8-f026b389dcbd tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:27.877366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dccb9734-8545-45d3-97d8-f026b389dcbd tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:27.890078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dccb9734-8545-45d3-97d8-f026b389dcbd tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:27.891514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dccb9734-8545-45d3-97d8-f026b389dcbd tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:27.892582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dccb9734-8545-45d3-97d8-f026b389dcbd tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:27.896378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dccb9734-8545-45d3-97d8-f026b389dcbd tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:27.897198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dccb9734-8545-45d3-97d8-f026b389dcbd tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:27.897891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dccb9734-8545-45d3-97d8-f026b389dcbd tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:27.959888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dccb9734-8545-45d3-97d8-f026b389dcbd tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:46:28.174475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c9aa79e7-a5e9-4fa1-ac22-6ecd4bcffb3a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:28.183509 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c9aa79e7-a5e9-4fa1-ac22-6ecd4bcffb3a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1309 microversion: 2.1 time: 0.476529 Oct 24 10:46:28.183958 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dccb9734-8545-45d3-97d8-f026b389dcbd tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 204 len: 0 microversion: 2.1 time: 0.316347 Oct 24 10:46:28.188184 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2287/4626] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:46:27 2022] DELETE /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:46:28.197626 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2340/4627] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:27 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1309 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:28.208474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-88dbb51d-257c-4214-a054-bf41d85b782d tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:28.209395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-88dbb51d-257c-4214-a054-bf41d85b782d tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:28.210836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-02ea9124-f047-4b5a-8628-1612ea6829ff tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:28.211568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-02ea9124-f047-4b5a-8628-1612ea6829ff tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:28.216581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88dbb51d-257c-4214-a054-bf41d85b782d tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:28.217813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88dbb51d-257c-4214-a054-bf41d85b782d tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:28.218409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88dbb51d-257c-4214-a054-bf41d85b782d tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:28.220246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88dbb51d-257c-4214-a054-bf41d85b782d tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:28.220799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02ea9124-f047-4b5a-8628-1612ea6829ff tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:28.221079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88dbb51d-257c-4214-a054-bf41d85b782d tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:28.221548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02ea9124-f047-4b5a-8628-1612ea6829ff tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:28.221913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-88dbb51d-257c-4214-a054-bf41d85b782d tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:28.222472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02ea9124-f047-4b5a-8628-1612ea6829ff tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:28.223436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02ea9124-f047-4b5a-8628-1612ea6829ff tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:28.224005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02ea9124-f047-4b5a-8628-1612ea6829ff tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:28.224734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02ea9124-f047-4b5a-8628-1612ea6829ff tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:28.258908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-02ea9124-f047-4b5a-8628-1612ea6829ff tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:46:28.425898 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-02ea9124-f047-4b5a-8628-1612ea6829ff tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 204 len: 0 microversion: 2.20 time: 0.239176 Oct 24 10:46:28.427187 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2288/4628] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:46:28 2022] DELETE /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:46:28.436807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e5862e64-17c4-45c8-8dea-80c29d3bead1 req-fdd1bb06-c1de-4df9-9c20-d1e6751e6621 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc1822e-4a9a-4bf2-8e57-f8875039c620", "tag": "c9986ef8-b1c4-471d-a593-ab2b20c4286a"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:28.448152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e5862e64-17c4-45c8-8dea-80c29d3bead1 req-fdd1bb06-c1de-4df9-9c20-d1e6751e6621 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:28.448892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e5862e64-17c4-45c8-8dea-80c29d3bead1 req-fdd1bb06-c1de-4df9-9c20-d1e6751e6621 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:28.449728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e5862e64-17c4-45c8-8dea-80c29d3bead1 req-fdd1bb06-c1de-4df9-9c20-d1e6751e6621 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:28.489571 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e5862e64-17c4-45c8-8dea-80c29d3bead1 req-fdd1bb06-c1de-4df9-9c20-d1e6751e6621 service nova] Creating event network-changed:c9986ef8-b1c4-471d-a593-ab2b20c4286a for instance 0bc1822e-4a9a-4bf2-8e57-f8875039c620 on n-h1-858383-15 Oct 24 10:46:28.498007 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e5862e64-17c4-45c8-8dea-80c29d3bead1 req-fdd1bb06-c1de-4df9-9c20-d1e6751e6621 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067741 Oct 24 10:46:28.499356 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2289/4629] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:28.507430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-974bbd07-1eab-41cf-8ebc-d9ba12026a7a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:28.508742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-974bbd07-1eab-41cf-8ebc-d9ba12026a7a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:28.529816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-974bbd07-1eab-41cf-8ebc-d9ba12026a7a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:28.530642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-974bbd07-1eab-41cf-8ebc-d9ba12026a7a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:28.532428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-974bbd07-1eab-41cf-8ebc-d9ba12026a7a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:28.533696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-974bbd07-1eab-41cf-8ebc-d9ba12026a7a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:28.534679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-974bbd07-1eab-41cf-8ebc-d9ba12026a7a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:28.535599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-974bbd07-1eab-41cf-8ebc-d9ba12026a7a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:28.560054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-88dbb51d-257c-4214-a054-bf41d85b782d tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:28.569815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-88dbb51d-257c-4214-a054-bf41d85b782d tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:28.571275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-88dbb51d-257c-4214-a054-bf41d85b782d tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:28.572404 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-88dbb51d-257c-4214-a054-bf41d85b782d tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1362 microversion: 2.26 time: 0.373734 Oct 24 10:46:28.588752 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2341/4630] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:28 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1362 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:28.601161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6066c1ec-1e5c-42af-9545-4b17e35a11f3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-413226079", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "0570c513-0036-46af-96c6-484910670fdc"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:28.630380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-974bbd07-1eab-41cf-8ebc-d9ba12026a7a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:28.643973 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-974bbd07-1eab-41cf-8ebc-d9ba12026a7a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee" status: 200 len: 1269 microversion: 2.1 time: 0.141416 Oct 24 10:46:28.645613 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2290/4631] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:28 2022] GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee => generated 1269 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:28.665731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ca5f5d99-19e9-4d7d-a737-f42c52377be3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:28.666721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ca5f5d99-19e9-4d7d-a737-f42c52377be3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:28.675920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca5f5d99-19e9-4d7d-a737-f42c52377be3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:28.676674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca5f5d99-19e9-4d7d-a737-f42c52377be3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:28.677277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca5f5d99-19e9-4d7d-a737-f42c52377be3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:28.678874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca5f5d99-19e9-4d7d-a737-f42c52377be3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:28.679658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca5f5d99-19e9-4d7d-a737-f42c52377be3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:28.680297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ca5f5d99-19e9-4d7d-a737-f42c52377be3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:28.680457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-6066c1ec-1e5c-42af-9545-4b17e35a11f3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] validate_networks() for [('0570c513-0036-46af-96c6-484910670fdc', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:46:28.943977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ca5f5d99-19e9-4d7d-a737-f42c52377be3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:28.958913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ca5f5d99-19e9-4d7d-a737-f42c52377be3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:28.960870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ca5f5d99-19e9-4d7d-a737-f42c52377be3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:28.963375 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ca5f5d99-19e9-4d7d-a737-f42c52377be3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1725 microversion: 2.20 time: 0.303334 Oct 24 10:46:28.964541 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2291/4632] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:28 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1725 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:28.970831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b735446-9742-490f-9c25-fddb85ca5bf7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:28.971954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6b735446-9742-490f-9c25-fddb85ca5bf7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:28.986886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b735446-9742-490f-9c25-fddb85ca5bf7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:28.990871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b735446-9742-490f-9c25-fddb85ca5bf7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:28.991406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b735446-9742-490f-9c25-fddb85ca5bf7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:28.992175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b735446-9742-490f-9c25-fddb85ca5bf7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:28.992648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b735446-9742-490f-9c25-fddb85ca5bf7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:28.998212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b735446-9742-490f-9c25-fddb85ca5bf7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:29.329892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6b735446-9742-490f-9c25-fddb85ca5bf7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:29.351823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6b735446-9742-490f-9c25-fddb85ca5bf7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:29.354766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6b735446-9742-490f-9c25-fddb85ca5bf7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:29.357373 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6b735446-9742-490f-9c25-fddb85ca5bf7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.390377 Oct 24 10:46:29.358484 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2292/4633] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:28 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:29.364817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fef24ff1-d260-4d9d-be27-bbc7b450a73f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:29.365730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fef24ff1-d260-4d9d-be27-bbc7b450a73f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:29.382152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fef24ff1-d260-4d9d-be27-bbc7b450a73f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:29.382653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fef24ff1-d260-4d9d-be27-bbc7b450a73f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:29.383107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fef24ff1-d260-4d9d-be27-bbc7b450a73f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:29.383995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fef24ff1-d260-4d9d-be27-bbc7b450a73f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:29.384737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fef24ff1-d260-4d9d-be27-bbc7b450a73f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:29.385200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fef24ff1-d260-4d9d-be27-bbc7b450a73f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:29.394462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6066c1ec-1e5c-42af-9545-4b17e35a11f3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:46:29.395089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6066c1ec-1e5c-42af-9545-4b17e35a11f3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:46:29.395758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6066c1ec-1e5c-42af-9545-4b17e35a11f3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:46:29.396365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6066c1ec-1e5c-42af-9545-4b17e35a11f3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:46:29.396953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6066c1ec-1e5c-42af-9545-4b17e35a11f3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:46:29.408378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6066c1ec-1e5c-42af-9545-4b17e35a11f3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:29.409126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6066c1ec-1e5c-42af-9545-4b17e35a11f3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:29.409891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6066c1ec-1e5c-42af-9545-4b17e35a11f3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:29.410776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6066c1ec-1e5c-42af-9545-4b17e35a11f3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:29.411385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6066c1ec-1e5c-42af-9545-4b17e35a11f3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:29.412105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6066c1ec-1e5c-42af-9545-4b17e35a11f3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:29.437188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-6066c1ec-1e5c-42af-9545-4b17e35a11f3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Getting quotas for project 656c472b32cc4421b312f671691a1bda. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:46:29.444432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-6066c1ec-1e5c-42af-9545-4b17e35a11f3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Getting quotas for user 758d3d450ce546ebad1836362108dea7 and project 656c472b32cc4421b312f671691a1bda. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:46:29.461117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6066c1ec-1e5c-42af-9545-4b17e35a11f3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:46:29.463845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6066c1ec-1e5c-42af-9545-4b17e35a11f3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:46:29.538560 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6066c1ec-1e5c-42af-9545-4b17e35a11f3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.947696 Oct 24 10:46:29.539953 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2342/4634] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:46:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:46:29.553765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-711a4cc0-d09b-4b18-b3b7-c0d716e876cf tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:29.554532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-711a4cc0-d09b-4b18-b3b7-c0d716e876cf tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:29.723487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-711a4cc0-d09b-4b18-b3b7-c0d716e876cf tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:29.783303 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-711a4cc0-d09b-4b18-b3b7-c0d716e876cf tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1217 microversion: 2.1 time: 0.202535 Oct 24 10:46:29.790386 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2343/4635] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:29 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1217 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:29.808310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e8e45596-937a-494f-b4be-39bb430380d4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:29.809233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e8e45596-937a-494f-b4be-39bb430380d4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:29.835943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8e45596-937a-494f-b4be-39bb430380d4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:29.836639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8e45596-937a-494f-b4be-39bb430380d4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:29.836900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8e45596-937a-494f-b4be-39bb430380d4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:29.837633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8e45596-937a-494f-b4be-39bb430380d4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:29.838093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8e45596-937a-494f-b4be-39bb430380d4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:29.838663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8e45596-937a-494f-b4be-39bb430380d4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:29.990599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fef24ff1-d260-4d9d-be27-bbc7b450a73f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:29.999654 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fef24ff1-d260-4d9d-be27-bbc7b450a73f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1309 microversion: 2.1 time: 0.639874 Oct 24 10:46:30.007110 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2293/4636] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:29 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1309 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:30.028568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-13b5b6fc-3291-4e3c-8513-64e148f09681 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:30.029224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-13b5b6fc-3291-4e3c-8513-64e148f09681 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:30.036120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13b5b6fc-3291-4e3c-8513-64e148f09681 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:30.036467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13b5b6fc-3291-4e3c-8513-64e148f09681 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:30.049336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13b5b6fc-3291-4e3c-8513-64e148f09681 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:30.050312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13b5b6fc-3291-4e3c-8513-64e148f09681 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:30.050808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13b5b6fc-3291-4e3c-8513-64e148f09681 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:30.053523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-13b5b6fc-3291-4e3c-8513-64e148f09681 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:30.354109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-13b5b6fc-3291-4e3c-8513-64e148f09681 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:30.366677 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-13b5b6fc-3291-4e3c-8513-64e148f09681 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee" status: 200 len: 1277 microversion: 2.1 time: 0.355966 Oct 24 10:46:30.369150 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2294/4637] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:30 2022] GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee => generated 1277 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:30.381929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ffb51dfd-1038-4fa2-b340-00e5c504aa14 req-b4738000-e21c-46da-8163-1edf4b315b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e709ac15-ec83-4539-b417-27751f4ebf99", "name": "network-vif-deleted", "tag": "8bf2b101-eca4-4c53-b9ea-be1aa58966f9"}, {"name": "network-changed", "server_uuid": "b55e1f7d-f0be-4eca-9123-b2df6f212b41", "tag": "17ce799e-44e1-45e0-a869-e6a177d299e7"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:30.407609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ffb51dfd-1038-4fa2-b340-00e5c504aa14 req-b4738000-e21c-46da-8163-1edf4b315b4c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:30.408354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ffb51dfd-1038-4fa2-b340-00e5c504aa14 req-b4738000-e21c-46da-8163-1edf4b315b4c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:30.409074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ffb51dfd-1038-4fa2-b340-00e5c504aa14 req-b4738000-e21c-46da-8163-1edf4b315b4c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:30.437391 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ffb51dfd-1038-4fa2-b340-00e5c504aa14 req-b4738000-e21c-46da-8163-1edf4b315b4c service nova] Creating event network-vif-deleted:8bf2b101-eca4-4c53-b9ea-be1aa58966f9 for instance e709ac15-ec83-4539-b417-27751f4ebf99 on n-h2-858383-15 Oct 24 10:46:30.438172 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ffb51dfd-1038-4fa2-b340-00e5c504aa14 req-b4738000-e21c-46da-8163-1edf4b315b4c service nova] Creating event network-changed:17ce799e-44e1-45e0-a869-e6a177d299e7 for instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 on n-h2-858383-15 Oct 24 10:46:30.450690 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ffb51dfd-1038-4fa2-b340-00e5c504aa14 req-b4738000-e21c-46da-8163-1edf4b315b4c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.080048 Oct 24 10:46:30.451311 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2295/4638] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:30.466731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-90e30c88-d0e6-4e58-a870-e1daa5a0d98b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:30.471173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-90e30c88-d0e6-4e58-a870-e1daa5a0d98b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:30.486474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90e30c88-d0e6-4e58-a870-e1daa5a0d98b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:30.488489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90e30c88-d0e6-4e58-a870-e1daa5a0d98b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:30.492588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90e30c88-d0e6-4e58-a870-e1daa5a0d98b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:30.493383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90e30c88-d0e6-4e58-a870-e1daa5a0d98b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:30.493863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90e30c88-d0e6-4e58-a870-e1daa5a0d98b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:30.494387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90e30c88-d0e6-4e58-a870-e1daa5a0d98b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:30.528007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e8e45596-937a-494f-b4be-39bb430380d4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:30.542170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e8e45596-937a-494f-b4be-39bb430380d4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:30.543671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e8e45596-937a-494f-b4be-39bb430380d4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:30.544856 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e8e45596-937a-494f-b4be-39bb430380d4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1362 microversion: 2.26 time: 0.753227 Oct 24 10:46:30.550333 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2344/4639] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:29 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1362 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:30.565880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-22ef718a-b9ad-4ff2-81b7-75052fb67a6a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:30.571553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-22ef718a-b9ad-4ff2-81b7-75052fb67a6a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:30.595840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22ef718a-b9ad-4ff2-81b7-75052fb67a6a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:30.596358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22ef718a-b9ad-4ff2-81b7-75052fb67a6a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:30.596800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22ef718a-b9ad-4ff2-81b7-75052fb67a6a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:30.597575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22ef718a-b9ad-4ff2-81b7-75052fb67a6a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:30.598015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22ef718a-b9ad-4ff2-81b7-75052fb67a6a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:30.598440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22ef718a-b9ad-4ff2-81b7-75052fb67a6a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:30.911121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-90e30c88-d0e6-4e58-a870-e1daa5a0d98b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:30.919860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-90e30c88-d0e6-4e58-a870-e1daa5a0d98b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:30.922045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-90e30c88-d0e6-4e58-a870-e1daa5a0d98b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:30.923865 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-90e30c88-d0e6-4e58-a870-e1daa5a0d98b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1725 microversion: 2.20 time: 0.461549 Oct 24 10:46:30.924666 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2296/4640] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:30 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1725 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:30.930236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c59ad2bb-8e51-4e8c-ab37-00e6b0a9178d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:30.931212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c59ad2bb-8e51-4e8c-ab37-00e6b0a9178d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:30.940563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c59ad2bb-8e51-4e8c-ab37-00e6b0a9178d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:30.941432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c59ad2bb-8e51-4e8c-ab37-00e6b0a9178d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:30.942134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c59ad2bb-8e51-4e8c-ab37-00e6b0a9178d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:30.943103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c59ad2bb-8e51-4e8c-ab37-00e6b0a9178d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:30.943941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c59ad2bb-8e51-4e8c-ab37-00e6b0a9178d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:30.944575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c59ad2bb-8e51-4e8c-ab37-00e6b0a9178d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:30.991645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-22ef718a-b9ad-4ff2-81b7-75052fb67a6a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:31.007795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-22ef718a-b9ad-4ff2-81b7-75052fb67a6a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:31.013658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-22ef718a-b9ad-4ff2-81b7-75052fb67a6a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:31.015106 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-22ef718a-b9ad-4ff2-81b7-75052fb67a6a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.453131 Oct 24 10:46:31.015938 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2345/4641] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:30 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:31.036167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f8f5c909-a826-4db9-bbf6-8d4c84dec2da tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:31.037180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f8f5c909-a826-4db9-bbf6-8d4c84dec2da tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:31.046457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8f5c909-a826-4db9-bbf6-8d4c84dec2da tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:31.049477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8f5c909-a826-4db9-bbf6-8d4c84dec2da tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:31.050169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8f5c909-a826-4db9-bbf6-8d4c84dec2da tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:31.054126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8f5c909-a826-4db9-bbf6-8d4c84dec2da tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:31.054815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8f5c909-a826-4db9-bbf6-8d4c84dec2da tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:31.055467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8f5c909-a826-4db9-bbf6-8d4c84dec2da tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:31.066540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c59ad2bb-8e51-4e8c-ab37-00e6b0a9178d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:31.076781 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c59ad2bb-8e51-4e8c-ab37-00e6b0a9178d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1213 microversion: 2.1 time: 0.150806 Oct 24 10:46:31.090590 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2297/4642] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:30 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1213 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:31.255316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f8f5c909-a826-4db9-bbf6-8d4c84dec2da tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:31.264989 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f8f5c909-a826-4db9-bbf6-8d4c84dec2da tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1309 microversion: 2.1 time: 0.233471 Oct 24 10:46:31.267048 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2346/4643] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:31 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1309 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:31.394716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf2fc342-498d-4c72-99d9-e974b3160946 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:31.395343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf2fc342-498d-4c72-99d9-e974b3160946 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:31.402451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf2fc342-498d-4c72-99d9-e974b3160946 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:31.403185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf2fc342-498d-4c72-99d9-e974b3160946 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:31.403624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf2fc342-498d-4c72-99d9-e974b3160946 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:31.404332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf2fc342-498d-4c72-99d9-e974b3160946 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:31.404782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf2fc342-498d-4c72-99d9-e974b3160946 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:31.405242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf2fc342-498d-4c72-99d9-e974b3160946 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:31.485392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cf2fc342-498d-4c72-99d9-e974b3160946 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:31.495804 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf2fc342-498d-4c72-99d9-e974b3160946 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee" status: 200 len: 1275 microversion: 2.1 time: 0.105598 Oct 24 10:46:31.501277 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2298/4644] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:31 2022] GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee => generated 1275 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:31.583755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-558e3ed3-7d35-4282-aa8b-c51b116fca06 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:31.584603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-558e3ed3-7d35-4282-aa8b-c51b116fca06 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:31.593086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-558e3ed3-7d35-4282-aa8b-c51b116fca06 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:31.594498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-558e3ed3-7d35-4282-aa8b-c51b116fca06 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:31.595220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-558e3ed3-7d35-4282-aa8b-c51b116fca06 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:31.596369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-558e3ed3-7d35-4282-aa8b-c51b116fca06 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:31.596970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-558e3ed3-7d35-4282-aa8b-c51b116fca06 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:31.597465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-558e3ed3-7d35-4282-aa8b-c51b116fca06 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:31.769303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-558e3ed3-7d35-4282-aa8b-c51b116fca06 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:31.782068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-558e3ed3-7d35-4282-aa8b-c51b116fca06 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:31.783662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-558e3ed3-7d35-4282-aa8b-c51b116fca06 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:31.784922 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-558e3ed3-7d35-4282-aa8b-c51b116fca06 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1362 microversion: 2.26 time: 0.206777 Oct 24 10:46:31.786140 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2347/4645] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:31 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:31.956909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e863f7d6-e157-420d-9567-d409e4dafe68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:31.966917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e863f7d6-e157-420d-9567-d409e4dafe68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:32.008302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e863f7d6-e157-420d-9567-d409e4dafe68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:32.010450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e863f7d6-e157-420d-9567-d409e4dafe68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:32.012298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e863f7d6-e157-420d-9567-d409e4dafe68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:32.017517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e863f7d6-e157-420d-9567-d409e4dafe68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:32.018317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e863f7d6-e157-420d-9567-d409e4dafe68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:32.018987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e863f7d6-e157-420d-9567-d409e4dafe68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:32.057996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c329ea45-aa0d-480e-a41b-56644d76df6c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:32.060677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c329ea45-aa0d-480e-a41b-56644d76df6c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:32.077777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c329ea45-aa0d-480e-a41b-56644d76df6c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:32.084495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c329ea45-aa0d-480e-a41b-56644d76df6c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:32.085009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c329ea45-aa0d-480e-a41b-56644d76df6c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:32.085837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c329ea45-aa0d-480e-a41b-56644d76df6c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:32.086522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c329ea45-aa0d-480e-a41b-56644d76df6c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:32.087198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c329ea45-aa0d-480e-a41b-56644d76df6c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:32.296259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e863f7d6-e157-420d-9567-d409e4dafe68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:32.311496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e863f7d6-e157-420d-9567-d409e4dafe68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:32.314531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e863f7d6-e157-420d-9567-d409e4dafe68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:32.315872 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e863f7d6-e157-420d-9567-d409e4dafe68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1725 microversion: 2.20 time: 0.365445 Oct 24 10:46:32.316547 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2299/4646] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:31 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1725 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:32.322853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ba3fc79b-1981-4626-8887-f76f5feaa459 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:32.323923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ba3fc79b-1981-4626-8887-f76f5feaa459 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:32.332737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba3fc79b-1981-4626-8887-f76f5feaa459 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:32.333636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba3fc79b-1981-4626-8887-f76f5feaa459 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:32.334331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba3fc79b-1981-4626-8887-f76f5feaa459 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:32.335277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba3fc79b-1981-4626-8887-f76f5feaa459 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:32.335991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba3fc79b-1981-4626-8887-f76f5feaa459 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:32.336673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba3fc79b-1981-4626-8887-f76f5feaa459 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:32.347759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c329ea45-aa0d-480e-a41b-56644d76df6c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:32.355091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:32.374378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c329ea45-aa0d-480e-a41b-56644d76df6c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:32.377000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c329ea45-aa0d-480e-a41b-56644d76df6c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:32.386099 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c329ea45-aa0d-480e-a41b-56644d76df6c tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.341797 Oct 24 10:46:32.387816 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2348/4647] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:32 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:46:32.395983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7697b0ab-c6d2-496e-b777-e18cb003afb6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:32.396910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7697b0ab-c6d2-496e-b777-e18cb003afb6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:32.404963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7697b0ab-c6d2-496e-b777-e18cb003afb6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:32.405892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7697b0ab-c6d2-496e-b777-e18cb003afb6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:32.407501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7697b0ab-c6d2-496e-b777-e18cb003afb6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:32.408608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7697b0ab-c6d2-496e-b777-e18cb003afb6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:32.409356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7697b0ab-c6d2-496e-b777-e18cb003afb6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:32.410063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7697b0ab-c6d2-496e-b777-e18cb003afb6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:32.441055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ba3fc79b-1981-4626-8887-f76f5feaa459 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:32.477601 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ba3fc79b-1981-4626-8887-f76f5feaa459 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1213 microversion: 2.1 time: 0.137818 Oct 24 10:46:32.477601 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2300/4648] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:32 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1213 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:32.524260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7fc5d893-3a6f-413c-9339-e981c9386b53 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:32.524913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7fc5d893-3a6f-413c-9339-e981c9386b53 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:32.534231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fc5d893-3a6f-413c-9339-e981c9386b53 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:32.534977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fc5d893-3a6f-413c-9339-e981c9386b53 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:32.535603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fc5d893-3a6f-413c-9339-e981c9386b53 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:32.536504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fc5d893-3a6f-413c-9339-e981c9386b53 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:32.537147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fc5d893-3a6f-413c-9339-e981c9386b53 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:32.537742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fc5d893-3a6f-413c-9339-e981c9386b53 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:32.627291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7fc5d893-3a6f-413c-9339-e981c9386b53 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:32.636383 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7fc5d893-3a6f-413c-9339-e981c9386b53 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee" status: 200 len: 1275 microversion: 2.1 time: 0.116656 Oct 24 10:46:32.637444 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2301/4649] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:32 2022] GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee => generated 1275 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:32.638032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7697b0ab-c6d2-496e-b777-e18cb003afb6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:32.652782 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7697b0ab-c6d2-496e-b777-e18cb003afb6 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1309 microversion: 2.1 time: 0.263671 Oct 24 10:46:32.653417 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2349/4650] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:32 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1309 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:32.663184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-eb5e627e-b8c2-4978-98bc-a24efbc00f86 req-f60e1ad5-cf59-48c2-8eef-ab140b00b2dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba574b8-fd7b-4914-b2e1-0ef7c7beb55d", "name": "network-vif-deleted", "tag": "f3cf98a5-3ab6-4a6a-9fe2-d2836e5f960d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:32.684252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eb5e627e-b8c2-4978-98bc-a24efbc00f86 req-f60e1ad5-cf59-48c2-8eef-ab140b00b2dd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:32.685398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eb5e627e-b8c2-4978-98bc-a24efbc00f86 req-f60e1ad5-cf59-48c2-8eef-ab140b00b2dd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:32.686326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eb5e627e-b8c2-4978-98bc-a24efbc00f86 req-f60e1ad5-cf59-48c2-8eef-ab140b00b2dd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:32.703715 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-eb5e627e-b8c2-4978-98bc-a24efbc00f86 req-f60e1ad5-cf59-48c2-8eef-ab140b00b2dd service nova] Creating event network-vif-deleted:f3cf98a5-3ab6-4a6a-9fe2-d2836e5f960d for instance dba574b8-fd7b-4914-b2e1-0ef7c7beb55d on n-h1-858383-15 Oct 24 10:46:32.710437 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-eb5e627e-b8c2-4978-98bc-a24efbc00f86 req-f60e1ad5-cf59-48c2-8eef-ab140b00b2dd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060184 Oct 24 10:46:32.711052 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2302/4651] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:46:32.820314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-92d445de-e1db-4482-99d8-8d23f3401e2f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:32.822301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-92d445de-e1db-4482-99d8-8d23f3401e2f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:32.844288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92d445de-e1db-4482-99d8-8d23f3401e2f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:32.846765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92d445de-e1db-4482-99d8-8d23f3401e2f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:32.847746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92d445de-e1db-4482-99d8-8d23f3401e2f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:32.853764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92d445de-e1db-4482-99d8-8d23f3401e2f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:32.854276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92d445de-e1db-4482-99d8-8d23f3401e2f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:32.854729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92d445de-e1db-4482-99d8-8d23f3401e2f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:33.347770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-229cc932-41aa-459f-9c75-cc3dc02aee8f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:33.348776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-229cc932-41aa-459f-9c75-cc3dc02aee8f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:33.365680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229cc932-41aa-459f-9c75-cc3dc02aee8f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:33.369803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229cc932-41aa-459f-9c75-cc3dc02aee8f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:33.412233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229cc932-41aa-459f-9c75-cc3dc02aee8f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:33.413093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229cc932-41aa-459f-9c75-cc3dc02aee8f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:33.413588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229cc932-41aa-459f-9c75-cc3dc02aee8f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:33.414042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229cc932-41aa-459f-9c75-cc3dc02aee8f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:33.832104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-229cc932-41aa-459f-9c75-cc3dc02aee8f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:33.850045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-229cc932-41aa-459f-9c75-cc3dc02aee8f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:33.855575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-229cc932-41aa-459f-9c75-cc3dc02aee8f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:33.861273 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-229cc932-41aa-459f-9c75-cc3dc02aee8f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1657 microversion: 2.20 time: 0.516612 Oct 24 10:46:33.862478 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2303/4652] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:33 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1657 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:33.880766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e40ca55-4569-4b94-8604-9fd673424aed tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:33.900961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5e40ca55-4569-4b94-8604-9fd673424aed tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:33.936608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-92d445de-e1db-4482-99d8-8d23f3401e2f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:33.945416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e40ca55-4569-4b94-8604-9fd673424aed tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:33.948235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e40ca55-4569-4b94-8604-9fd673424aed tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:33.950381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e40ca55-4569-4b94-8604-9fd673424aed tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:33.950923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-92d445de-e1db-4482-99d8-8d23f3401e2f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:33.953751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-92d445de-e1db-4482-99d8-8d23f3401e2f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:33.954326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e40ca55-4569-4b94-8604-9fd673424aed tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:33.956091 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-92d445de-e1db-4482-99d8-8d23f3401e2f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1362 microversion: 2.26 time: 1.142889 Oct 24 10:46:33.956225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e40ca55-4569-4b94-8604-9fd673424aed tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:33.957216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e40ca55-4569-4b94-8604-9fd673424aed tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:33.976127 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2350/4653] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:32 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1362 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:33.986021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4e4c2f45-2787-44e4-b99a-bdae6b5c2a70 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:33.987046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4e4c2f45-2787-44e4-b99a-bdae6b5c2a70 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:33.994944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e4c2f45-2787-44e4-b99a-bdae6b5c2a70 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:33.996013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e4c2f45-2787-44e4-b99a-bdae6b5c2a70 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:33.996864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e4c2f45-2787-44e4-b99a-bdae6b5c2a70 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:33.997976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e4c2f45-2787-44e4-b99a-bdae6b5c2a70 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:33.998883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e4c2f45-2787-44e4-b99a-bdae6b5c2a70 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:33.999499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e4c2f45-2787-44e4-b99a-bdae6b5c2a70 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:34.325005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4e4c2f45-2787-44e4-b99a-bdae6b5c2a70 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:34.340302 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4e4c2f45-2787-44e4-b99a-bdae6b5c2a70 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1269 microversion: 2.1 time: 0.362413 Oct 24 10:46:34.341242 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2351/4654] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:33 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1269 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:34.351634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2f703759-682c-4fba-9cce-581635c90dab tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:34.352366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2f703759-682c-4fba-9cce-581635c90dab tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:34.363481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:34.373733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f703759-682c-4fba-9cce-581635c90dab tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:34.375629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f703759-682c-4fba-9cce-581635c90dab tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:34.376272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f703759-682c-4fba-9cce-581635c90dab tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:34.379363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f703759-682c-4fba-9cce-581635c90dab tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:34.381120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f703759-682c-4fba-9cce-581635c90dab tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:34.381645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f703759-682c-4fba-9cce-581635c90dab tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:34.575179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5e40ca55-4569-4b94-8604-9fd673424aed tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:34.590347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5e40ca55-4569-4b94-8604-9fd673424aed tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:34.597166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5e40ca55-4569-4b94-8604-9fd673424aed tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:34.600507 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5e40ca55-4569-4b94-8604-9fd673424aed tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.735789 Oct 24 10:46:34.605939 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2304/4655] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:33 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:34.618762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-efac35c5-e012-4591-a39d-fec33096f0e7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:34.620774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-efac35c5-e012-4591-a39d-fec33096f0e7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:34.621854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2f703759-682c-4fba-9cce-581635c90dab tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:34.631466 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2f703759-682c-4fba-9cce-581635c90dab tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee" status: 200 len: 1275 microversion: 2.1 time: 0.289135 Oct 24 10:46:34.638219 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2352/4656] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:34 2022] GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee => generated 1275 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:34.638760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efac35c5-e012-4591-a39d-fec33096f0e7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:34.641231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efac35c5-e012-4591-a39d-fec33096f0e7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:34.641890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efac35c5-e012-4591-a39d-fec33096f0e7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:34.642848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efac35c5-e012-4591-a39d-fec33096f0e7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:34.644788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efac35c5-e012-4591-a39d-fec33096f0e7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:34.647147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efac35c5-e012-4591-a39d-fec33096f0e7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:34.649006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-c3fde48d-cb8d-476e-b396-35507d7bed14 req-0ec13abb-258d-4a1a-b2a7-d9fb680f0e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-plugged", "status": "completed", "tag": "adbcc1ad-fe50-4a59-b11c-492a2b5fc035"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:34.674361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c3fde48d-cb8d-476e-b396-35507d7bed14 req-0ec13abb-258d-4a1a-b2a7-d9fb680f0e2a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:34.678072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c3fde48d-cb8d-476e-b396-35507d7bed14 req-0ec13abb-258d-4a1a-b2a7-d9fb680f0e2a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:34.678708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c3fde48d-cb8d-476e-b396-35507d7bed14 req-0ec13abb-258d-4a1a-b2a7-d9fb680f0e2a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:34.728469 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-c3fde48d-cb8d-476e-b396-35507d7bed14 req-0ec13abb-258d-4a1a-b2a7-d9fb680f0e2a service nova] Creating event network-vif-plugged:adbcc1ad-fe50-4a59-b11c-492a2b5fc035 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:46:34.747933 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-c3fde48d-cb8d-476e-b396-35507d7bed14 req-0ec13abb-258d-4a1a-b2a7-d9fb680f0e2a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106017 Oct 24 10:46:34.753846 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2353/4657] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:34.890302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6882a1a0-8ed7-4209-bd93-0c9d72a7edb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:34.891908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6882a1a0-8ed7-4209-bd93-0c9d72a7edb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:34.907136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6882a1a0-8ed7-4209-bd93-0c9d72a7edb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:34.907641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6882a1a0-8ed7-4209-bd93-0c9d72a7edb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:34.908353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6882a1a0-8ed7-4209-bd93-0c9d72a7edb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:34.909346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6882a1a0-8ed7-4209-bd93-0c9d72a7edb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:34.910033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6882a1a0-8ed7-4209-bd93-0c9d72a7edb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:34.910705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6882a1a0-8ed7-4209-bd93-0c9d72a7edb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:35.099861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6882a1a0-8ed7-4209-bd93-0c9d72a7edb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:35.133419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6882a1a0-8ed7-4209-bd93-0c9d72a7edb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:35.136038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6882a1a0-8ed7-4209-bd93-0c9d72a7edb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:35.137842 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6882a1a0-8ed7-4209-bd93-0c9d72a7edb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 200 len: 1657 microversion: 2.20 time: 0.251665 Oct 24 10:46:35.138760 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2354/4658] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:34 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 1657 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:46:35.149296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-393d5402-db86-4e35-b491-d3f9fd9b2a46 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:35.150230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-393d5402-db86-4e35-b491-d3f9fd9b2a46 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:35.172743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-393d5402-db86-4e35-b491-d3f9fd9b2a46 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:35.174294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-393d5402-db86-4e35-b491-d3f9fd9b2a46 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:35.175433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-393d5402-db86-4e35-b491-d3f9fd9b2a46 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:35.177778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-393d5402-db86-4e35-b491-d3f9fd9b2a46 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:35.188873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-393d5402-db86-4e35-b491-d3f9fd9b2a46 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:35.189709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-393d5402-db86-4e35-b491-d3f9fd9b2a46 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:35.321240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-efac35c5-e012-4591-a39d-fec33096f0e7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:35.330486 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-efac35c5-e012-4591-a39d-fec33096f0e7 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1309 microversion: 2.1 time: 0.722415 Oct 24 10:46:35.334653 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2305/4659] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:34 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1309 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:35.341326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3f3ba3d9-5631-46cb-9623-e5befaf65bbc req-57f581e0-8415-41a6-997a-385068096049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6eb3578-42ca-4dc5-b31a-e5500aa94f2e", "name": "network-vif-deleted", "tag": "36f88fb2-6faf-4282-bd23-d4f02a3206ca"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:35.370173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3f3ba3d9-5631-46cb-9623-e5befaf65bbc req-57f581e0-8415-41a6-997a-385068096049 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:35.371904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3f3ba3d9-5631-46cb-9623-e5befaf65bbc req-57f581e0-8415-41a6-997a-385068096049 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:35.372614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3f3ba3d9-5631-46cb-9623-e5befaf65bbc req-57f581e0-8415-41a6-997a-385068096049 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:35.399447 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3f3ba3d9-5631-46cb-9623-e5befaf65bbc req-57f581e0-8415-41a6-997a-385068096049 service nova] Creating event network-vif-deleted:36f88fb2-6faf-4282-bd23-d4f02a3206ca for instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e on n-h2-858383-15 Oct 24 10:46:35.414824 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3f3ba3d9-5631-46cb-9623-e5befaf65bbc req-57f581e0-8415-41a6-997a-385068096049 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076908 Oct 24 10:46:35.415872 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2306/4660] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:35.421347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-922bf5a0-0ef1-4bd1-bccb-f5440f7c36a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:35.422274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-922bf5a0-0ef1-4bd1-bccb-f5440f7c36a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:35.430439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-922bf5a0-0ef1-4bd1-bccb-f5440f7c36a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:35.430971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-922bf5a0-0ef1-4bd1-bccb-f5440f7c36a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:35.431421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-922bf5a0-0ef1-4bd1-bccb-f5440f7c36a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:35.432288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-922bf5a0-0ef1-4bd1-bccb-f5440f7c36a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:35.432753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-922bf5a0-0ef1-4bd1-bccb-f5440f7c36a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:35.433216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-922bf5a0-0ef1-4bd1-bccb-f5440f7c36a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:35.688114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-922bf5a0-0ef1-4bd1-bccb-f5440f7c36a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:35.710368 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-922bf5a0-0ef1-4bd1-bccb-f5440f7c36a5 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1275 microversion: 2.1 time: 0.290473 Oct 24 10:46:35.711118 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2307/4661] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:35 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1275 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:35.719542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f256f1c0-b605-4b3f-8817-e5f2eb9f60b0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:35.726371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f256f1c0-b605-4b3f-8817-e5f2eb9f60b0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:35.739198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f256f1c0-b605-4b3f-8817-e5f2eb9f60b0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:35.742000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f256f1c0-b605-4b3f-8817-e5f2eb9f60b0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:35.743661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f256f1c0-b605-4b3f-8817-e5f2eb9f60b0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:35.747975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f256f1c0-b605-4b3f-8817-e5f2eb9f60b0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:35.748666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f256f1c0-b605-4b3f-8817-e5f2eb9f60b0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:35.750594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f256f1c0-b605-4b3f-8817-e5f2eb9f60b0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:35.892608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-393d5402-db86-4e35-b491-d3f9fd9b2a46 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:35.917170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-393d5402-db86-4e35-b491-d3f9fd9b2a46 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:35.918767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-393d5402-db86-4e35-b491-d3f9fd9b2a46 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:35.920167 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-393d5402-db86-4e35-b491-d3f9fd9b2a46 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1362 microversion: 2.26 time: 0.780242 Oct 24 10:46:35.921979 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2355/4662] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:35 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1362 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:35.929401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-00ca39d9-bda8-49a7-996f-c3f4c86ac18a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:35.930224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-00ca39d9-bda8-49a7-996f-c3f4c86ac18a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:35.940361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00ca39d9-bda8-49a7-996f-c3f4c86ac18a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:35.941838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00ca39d9-bda8-49a7-996f-c3f4c86ac18a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:35.942637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00ca39d9-bda8-49a7-996f-c3f4c86ac18a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:35.943582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00ca39d9-bda8-49a7-996f-c3f4c86ac18a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:35.944424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00ca39d9-bda8-49a7-996f-c3f4c86ac18a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:35.945210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00ca39d9-bda8-49a7-996f-c3f4c86ac18a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:36.438683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-00ca39d9-bda8-49a7-996f-c3f4c86ac18a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:36.445523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:36.447800 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-00ca39d9-bda8-49a7-996f-c3f4c86ac18a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee" status: 200 len: 1317 microversion: 2.1 time: 0.524317 Oct 24 10:46:36.460450 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2356/4663] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:35 2022] GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:36.491734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ab667932-9397-4ccf-a0a0-d6a592a4b197 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:36.492463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ab667932-9397-4ccf-a0a0-d6a592a4b197 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:36.509030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab667932-9397-4ccf-a0a0-d6a592a4b197 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:36.512119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab667932-9397-4ccf-a0a0-d6a592a4b197 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:36.513355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab667932-9397-4ccf-a0a0-d6a592a4b197 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:36.514133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab667932-9397-4ccf-a0a0-d6a592a4b197 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:36.514838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab667932-9397-4ccf-a0a0-d6a592a4b197 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:36.516137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab667932-9397-4ccf-a0a0-d6a592a4b197 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:36.551254 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-ab667932-9397-4ccf-a0a0-d6a592a4b197 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] HTTP exception thrown: Instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e could not be found. Oct 24 10:46:36.554650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f256f1c0-b605-4b3f-8817-e5f2eb9f60b0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ab667932-9397-4ccf-a0a0-d6a592a4b197 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Request method failure captured: Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e HTTP/1.1 Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmwnIuIZc1Tl9vEr8TvLLys7k1HMZ9MNU5wcS8xr7Pjq3sY7xhdSzLmmStgcIifhS0zJ_xMtACHjHF4b6lSPIPEL5ZG3LD-qwNDqXAVcJD_3Tc8O3D8Upy8sI31CZQDVOh4vYSKX3MAZXUS3FFIRt6kwnnjzCE26xhLIH0I-kIWSvKY Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 886ae7eabe82421ca19e5cd59630e961 Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-860198550 Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/886ae7eabe82421ca19e5cd59630e961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/886ae7eabe82421ca19e5cd59630e961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/886ae7eabe82421ca19e5cd59630e961"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_886ae7eabe82421ca19e5cd59630e961", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AttachVolumeShelveTestJSON-860198550 Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 886ae7eabe82421ca19e5cd59630e961 Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-860198550 Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AttachVolumeShelveTestJSON-860198550-project Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: bf908b0f4e444157a0f28e84de8f8555 Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AttachVolumeShelveTestJSON-860198550-project Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e could not be found. Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'e6eb3578-42ca-4dc5-b31a-e5500aa94f2e'} Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e could not be found. Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e could not be found. Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:46:36.555726 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:46:36.561730 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:46:36.561730 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:46:36.561730 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:46:36.561730 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:46:36.561730 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:46:36.561730 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:46:36.561730 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e could not be found. Oct 24 10:46:36.561730 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:46:36.561730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ab667932-9397-4ccf-a0a0-d6a592a4b197 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Returning 404 to user: Instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:46:36.561730 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ab667932-9397-4ccf-a0a0-d6a592a4b197 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 404 len: 111 microversion: 2.20 time: 0.093978 Oct 24 10:46:36.561730 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2357/4664] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:36 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:46:36.567085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8953d7c3-09d0-42db-a695-78567c9d8848 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:36.573615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f256f1c0-b605-4b3f-8817-e5f2eb9f60b0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:36.574393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8953d7c3-09d0-42db-a695-78567c9d8848 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:36.583322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f256f1c0-b605-4b3f-8817-e5f2eb9f60b0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:36.587188 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f256f1c0-b605-4b3f-8817-e5f2eb9f60b0 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.872656 Oct 24 10:46:36.605141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8953d7c3-09d0-42db-a695-78567c9d8848 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:36.605141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8953d7c3-09d0-42db-a695-78567c9d8848 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:36.605141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8953d7c3-09d0-42db-a695-78567c9d8848 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:36.605141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8953d7c3-09d0-42db-a695-78567c9d8848 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:36.605141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8953d7c3-09d0-42db-a695-78567c9d8848 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:36.605141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8953d7c3-09d0-42db-a695-78567c9d8848 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:36.605787 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2308/4665] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:35 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:36.622557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8425e4dc-75b2-4296-8bfa-54fa713a8a07 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '.version_select at 0x7f04d5038550>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:36.645579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:36.678188 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8425e4dc-75b2-4296-8bfa-54fa713a8a07 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1486946419" status: 204 len: 0 microversion: 2.20 time: 0.072701 Oct 24 10:46:36.682641 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2309/4666] 10.222.0.50 () {60 vars in 1262 bytes} [Mon Oct 24 10:46:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1486946419 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:46:36.740748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-42afde8e-a778-495b-87df-abd54dddc11b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:36.741633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-42afde8e-a778-495b-87df-abd54dddc11b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:36.754836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42afde8e-a778-495b-87df-abd54dddc11b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:36.755680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42afde8e-a778-495b-87df-abd54dddc11b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:36.757665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42afde8e-a778-495b-87df-abd54dddc11b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:36.760522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42afde8e-a778-495b-87df-abd54dddc11b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:36.762952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42afde8e-a778-495b-87df-abd54dddc11b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:36.763569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42afde8e-a778-495b-87df-abd54dddc11b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:36.818245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:37.181146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8953d7c3-09d0-42db-a695-78567c9d8848 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:37.189969 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8953d7c3-09d0-42db-a695-78567c9d8848 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1309 microversion: 2.1 time: 0.629251 Oct 24 10:46:37.201454 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2358/4667] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:36 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1309 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:37.207381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c3c3f40f-c6eb-4aba-a539-0fc5ed3fb1a7 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:37.208408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c3c3f40f-c6eb-4aba-a539-0fc5ed3fb1a7 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:37.223628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3c3f40f-c6eb-4aba-a539-0fc5ed3fb1a7 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:37.224320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3c3f40f-c6eb-4aba-a539-0fc5ed3fb1a7 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:37.224964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3c3f40f-c6eb-4aba-a539-0fc5ed3fb1a7 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:37.225911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3c3f40f-c6eb-4aba-a539-0fc5ed3fb1a7 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:37.230477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3c3f40f-c6eb-4aba-a539-0fc5ed3fb1a7 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:37.231104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3c3f40f-c6eb-4aba-a539-0fc5ed3fb1a7 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:37.252040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=10 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:37.363512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-42afde8e-a778-495b-87df-abd54dddc11b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:37.378795 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-42afde8e-a778-495b-87df-abd54dddc11b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1317 microversion: 2.1 time: 0.642176 Oct 24 10:46:37.380778 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2310/4668] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:36 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1317 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:37.479357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-429a8af3-907a-4ec9-b21d-e0a3cae25af5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:37.480254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-429a8af3-907a-4ec9-b21d-e0a3cae25af5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:37.492719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-429a8af3-907a-4ec9-b21d-e0a3cae25af5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:37.493485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-429a8af3-907a-4ec9-b21d-e0a3cae25af5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:37.494126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-429a8af3-907a-4ec9-b21d-e0a3cae25af5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:37.495074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-429a8af3-907a-4ec9-b21d-e0a3cae25af5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:37.495850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-429a8af3-907a-4ec9-b21d-e0a3cae25af5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:37.496689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-429a8af3-907a-4ec9-b21d-e0a3cae25af5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:37.576545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c3c3f40f-c6eb-4aba-a539-0fc5ed3fb1a7 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:37.586591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c3c3f40f-c6eb-4aba-a539-0fc5ed3fb1a7 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:37.588359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c3c3f40f-c6eb-4aba-a539-0fc5ed3fb1a7 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:37.590161 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c3c3f40f-c6eb-4aba-a539-0fc5ed3fb1a7 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1362 microversion: 2.26 time: 0.387610 Oct 24 10:46:37.608735 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2359/4669] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:37 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1362 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:37.619287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-587bec01-5c68-4bac-af2c-f3e4fb7dc384 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:37.620351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-587bec01-5c68-4bac-af2c-f3e4fb7dc384 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:37.630172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-587bec01-5c68-4bac-af2c-f3e4fb7dc384 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:37.630908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-587bec01-5c68-4bac-af2c-f3e4fb7dc384 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:37.632273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-587bec01-5c68-4bac-af2c-f3e4fb7dc384 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:37.633406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-587bec01-5c68-4bac-af2c-f3e4fb7dc384 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:37.634105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-587bec01-5c68-4bac-af2c-f3e4fb7dc384 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:37.635044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-587bec01-5c68-4bac-af2c-f3e4fb7dc384 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:37.918899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-429a8af3-907a-4ec9-b21d-e0a3cae25af5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:37.936931 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-429a8af3-907a-4ec9-b21d-e0a3cae25af5 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee" status: 200 len: 1317 microversion: 2.1 time: 0.463886 Oct 24 10:46:37.938282 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2311/4670] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:37 2022] GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:37.979778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e2e333b9-08e8-41b3-9c84-93724b8a9842 req-ed28c29a-7e59-470c-a413-104b71d25f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc1822e-4a9a-4bf2-8e57-f8875039c620", "name": "network-vif-plugged", "status": "completed", "tag": "c9986ef8-b1c4-471d-a593-ab2b20c4286a"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:37.987113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-587bec01-5c68-4bac-af2c-f3e4fb7dc384 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:37.995314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e2e333b9-08e8-41b3-9c84-93724b8a9842 req-ed28c29a-7e59-470c-a413-104b71d25f5e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:38.004632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e2e333b9-08e8-41b3-9c84-93724b8a9842 req-ed28c29a-7e59-470c-a413-104b71d25f5e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:38.006388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e2e333b9-08e8-41b3-9c84-93724b8a9842 req-ed28c29a-7e59-470c-a413-104b71d25f5e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:38.010500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-587bec01-5c68-4bac-af2c-f3e4fb7dc384 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:38.017604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-587bec01-5c68-4bac-af2c-f3e4fb7dc384 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:38.022875 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-587bec01-5c68-4bac-af2c-f3e4fb7dc384 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.407136 Oct 24 10:46:38.024963 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2360/4671] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:37 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:38.044786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-6f69a4f2-628b-45e3-a049-27508162e96d req-26eb028b-0e36-4cec-aecb-57c23a1da3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e35dae0d-896b-405b-a5a9-a9c951b30101", "tag": "9c42b90d-d03c-4366-9ad1-55ce408b2567"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:38.062423 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e2e333b9-08e8-41b3-9c84-93724b8a9842 req-ed28c29a-7e59-470c-a413-104b71d25f5e service nova] Creating event network-vif-plugged:c9986ef8-b1c4-471d-a593-ab2b20c4286a for instance 0bc1822e-4a9a-4bf2-8e57-f8875039c620 on n-h1-858383-15 Oct 24 10:46:38.075002 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e2e333b9-08e8-41b3-9c84-93724b8a9842 req-ed28c29a-7e59-470c-a413-104b71d25f5e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098882 Oct 24 10:46:38.082877 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2312/4672] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:38.095797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6f69a4f2-628b-45e3-a049-27508162e96d req-26eb028b-0e36-4cec-aecb-57c23a1da3d9 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:38.100714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6f69a4f2-628b-45e3-a049-27508162e96d req-26eb028b-0e36-4cec-aecb-57c23a1da3d9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:38.103050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6f69a4f2-628b-45e3-a049-27508162e96d req-26eb028b-0e36-4cec-aecb-57c23a1da3d9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:38.159872 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-6f69a4f2-628b-45e3-a049-27508162e96d req-26eb028b-0e36-4cec-aecb-57c23a1da3d9 service nova] Creating event network-changed:9c42b90d-d03c-4366-9ad1-55ce408b2567 for instance e35dae0d-896b-405b-a5a9-a9c951b30101 on n-h1-858383-15 Oct 24 10:46:38.175293 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-6f69a4f2-628b-45e3-a049-27508162e96d req-26eb028b-0e36-4cec-aecb-57c23a1da3d9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136604 Oct 24 10:46:38.176214 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2361/4673] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:46:38.229378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5ac7e406-f7b3-45cb-89e1-89c2314eeb1b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:38.230304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5ac7e406-f7b3-45cb-89e1-89c2314eeb1b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:38.242299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ac7e406-f7b3-45cb-89e1-89c2314eeb1b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:38.248248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ac7e406-f7b3-45cb-89e1-89c2314eeb1b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:38.248616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ac7e406-f7b3-45cb-89e1-89c2314eeb1b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:38.254754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ac7e406-f7b3-45cb-89e1-89c2314eeb1b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:38.255402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ac7e406-f7b3-45cb-89e1-89c2314eeb1b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:38.256017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ac7e406-f7b3-45cb-89e1-89c2314eeb1b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:38.408549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-50dab9c7-f28a-40c8-ad4f-26826aaa1300 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:38.409302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-50dab9c7-f28a-40c8-ad4f-26826aaa1300 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:38.419393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50dab9c7-f28a-40c8-ad4f-26826aaa1300 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:38.419871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50dab9c7-f28a-40c8-ad4f-26826aaa1300 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:38.426207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50dab9c7-f28a-40c8-ad4f-26826aaa1300 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:38.427212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50dab9c7-f28a-40c8-ad4f-26826aaa1300 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:38.427851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50dab9c7-f28a-40c8-ad4f-26826aaa1300 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:38.428446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50dab9c7-f28a-40c8-ad4f-26826aaa1300 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:38.630808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5ac7e406-f7b3-45cb-89e1-89c2314eeb1b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:38.643006 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5ac7e406-f7b3-45cb-89e1-89c2314eeb1b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1309 microversion: 2.1 time: 0.418306 Oct 24 10:46:38.648527 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2313/4674] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:38 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1309 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:38.663650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2c958345-dcdc-4b0c-aafb-e39827036100 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:38.664885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2c958345-dcdc-4b0c-aafb-e39827036100 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:38.680629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c958345-dcdc-4b0c-aafb-e39827036100 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:38.687009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c958345-dcdc-4b0c-aafb-e39827036100 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:38.687864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c958345-dcdc-4b0c-aafb-e39827036100 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:38.688902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c958345-dcdc-4b0c-aafb-e39827036100 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:38.689520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c958345-dcdc-4b0c-aafb-e39827036100 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:38.690153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c958345-dcdc-4b0c-aafb-e39827036100 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:39.101512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-50dab9c7-f28a-40c8-ad4f-26826aaa1300 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:39.123258 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-50dab9c7-f28a-40c8-ad4f-26826aaa1300 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1317 microversion: 2.1 time: 0.720197 Oct 24 10:46:39.124210 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2362/4675] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:38 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1317 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:39.147608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8c7611b3-5be2-4105-8cf1-ecfcaa098a67 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:39.148497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8c7611b3-5be2-4105-8cf1-ecfcaa098a67 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:39.164922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c7611b3-5be2-4105-8cf1-ecfcaa098a67 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:39.166454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c7611b3-5be2-4105-8cf1-ecfcaa098a67 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:39.167098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c7611b3-5be2-4105-8cf1-ecfcaa098a67 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:39.167978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c7611b3-5be2-4105-8cf1-ecfcaa098a67 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:39.168581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c7611b3-5be2-4105-8cf1-ecfcaa098a67 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:39.169195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c7611b3-5be2-4105-8cf1-ecfcaa098a67 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:39.254410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c958345-dcdc-4b0c-aafb-e39827036100 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:39.266734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c958345-dcdc-4b0c-aafb-e39827036100 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:39.268811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2c958345-dcdc-4b0c-aafb-e39827036100 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:39.278400 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2c958345-dcdc-4b0c-aafb-e39827036100 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1362 microversion: 2.26 time: 0.628420 Oct 24 10:46:39.279013 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2314/4676] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:38 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1362 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:39.284564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2200b460-4c64-4721-8f58-fe932a283a22 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Action: 'create', calling method: .version_select at 0x7f04cb9a61f0>, body: {"keypair": {"name": "tempest-keypair-827608814", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+chc/iF7a2A6ROwiliIcZs3JpsgACc56JnLsPOdaOS9UYfdFUwe8PqcpFWQQIxuvS3ECO3IiDHBvOgdu97yrtBCR/TTnfY4+8m2sdJGf3aAzHL48p34IxXebA7VzJGtA=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:39.320454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-2200b460-4c64-4721-8f58-fe932a283a22 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Getting quotas for project 886ae7eabe82421ca19e5cd59630e961. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:46:39.336641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-2200b460-4c64-4721-8f58-fe932a283a22 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Getting quotas for user bf908b0f4e444157a0f28e84de8f8555 and project 886ae7eabe82421ca19e5cd59630e961. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:46:39.391431 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2200b460-4c64-4721-8f58-fe932a283a22 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.110765 Oct 24 10:46:39.392123 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2315/4677] 10.222.0.50 () {62 vars in 1200 bytes} [Mon Oct 24 10:46:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 10:46:39.397437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ca246b9-66ee-4790-bd5d-c362161ef021 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:39.398064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0ca246b9-66ee-4790-bd5d-c362161ef021 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:39.411522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ca246b9-66ee-4790-bd5d-c362161ef021 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:39.412030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ca246b9-66ee-4790-bd5d-c362161ef021 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:39.412477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ca246b9-66ee-4790-bd5d-c362161ef021 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:39.419328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:39.421424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ca246b9-66ee-4790-bd5d-c362161ef021 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:39.422541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ca246b9-66ee-4790-bd5d-c362161ef021 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:39.423002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ca246b9-66ee-4790-bd5d-c362161ef021 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:39.515012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8c7611b3-5be2-4105-8cf1-ecfcaa098a67 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:39.529294 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8c7611b3-5be2-4105-8cf1-ecfcaa098a67 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee" status: 200 len: 1317 microversion: 2.1 time: 0.389696 Oct 24 10:46:39.529922 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2363/4678] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:39 2022] GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:39.670637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e67ad16e-3039-42a8-a7dc-aa3024cdf40f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:39.671531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e67ad16e-3039-42a8-a7dc-aa3024cdf40f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:39.685274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e67ad16e-3039-42a8-a7dc-aa3024cdf40f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:39.685835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e67ad16e-3039-42a8-a7dc-aa3024cdf40f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:39.686294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e67ad16e-3039-42a8-a7dc-aa3024cdf40f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:39.687038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e67ad16e-3039-42a8-a7dc-aa3024cdf40f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:39.687759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e67ad16e-3039-42a8-a7dc-aa3024cdf40f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:39.688208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e67ad16e-3039-42a8-a7dc-aa3024cdf40f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:39.743342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=20 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:40.005885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0ca246b9-66ee-4790-bd5d-c362161ef021 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:40.026138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0ca246b9-66ee-4790-bd5d-c362161ef021 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:40.032303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0ca246b9-66ee-4790-bd5d-c362161ef021 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:40.039419 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0ca246b9-66ee-4790-bd5d-c362161ef021 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.643665 Oct 24 10:46:40.040969 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2316/4679] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:39 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:40.048493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-956f8ad4-690e-4d0f-9678-9c960c9af80b req-e39c9132-cf5c-4764-a140-ed78b9bfe9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0272c314-d0fe-44d3-8f8c-b475beff2cd1", "tag": "ddf33fbf-e51d-445c-be66-c7f9b44e3d6c"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:40.066305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-956f8ad4-690e-4d0f-9678-9c960c9af80b req-e39c9132-cf5c-4764-a140-ed78b9bfe9e0 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:40.067994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-956f8ad4-690e-4d0f-9678-9c960c9af80b req-e39c9132-cf5c-4764-a140-ed78b9bfe9e0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:40.068759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-956f8ad4-690e-4d0f-9678-9c960c9af80b req-e39c9132-cf5c-4764-a140-ed78b9bfe9e0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:40.083263 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-956f8ad4-690e-4d0f-9678-9c960c9af80b req-e39c9132-cf5c-4764-a140-ed78b9bfe9e0 service nova] Creating event network-changed:ddf33fbf-e51d-445c-be66-c7f9b44e3d6c for instance 0272c314-d0fe-44d3-8f8c-b475beff2cd1 on n-h1-858383-15 Oct 24 10:46:40.090952 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-956f8ad4-690e-4d0f-9678-9c960c9af80b req-e39c9132-cf5c-4764-a140-ed78b9bfe9e0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047673 Oct 24 10:46:40.092275 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2317/4680] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:40.117816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-eeec4f42-abdf-4039-9782-3e616ae41477 req-c1c55cef-61a3-47c6-8888-329927c64bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-plugged", "status": "completed", "tag": "f00b7439-3b57-4199-889a-94171e92eec2"}, {"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-plugged", "status": "completed", "tag": "fb2020ef-e5e3-481a-baca-ee8ad6e8058a"}, {"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-plugged", "status": "completed", "tag": "cd46ad50-24e5-4e89-b061-174efa4e9061"}, {"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-plugged", "status": "completed", "tag": "3e53a27e-13fd-4b03-87fb-f257a770ce85"}, {"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-plugged", "status": "completed", "tag": "6edc1d11-d1ae-4161-a5c2-9e721c334352"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:40.135357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eeec4f42-abdf-4039-9782-3e616ae41477 req-c1c55cef-61a3-47c6-8888-329927c64bf0 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:40.135892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eeec4f42-abdf-4039-9782-3e616ae41477 req-c1c55cef-61a3-47c6-8888-329927c64bf0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:40.136376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eeec4f42-abdf-4039-9782-3e616ae41477 req-c1c55cef-61a3-47c6-8888-329927c64bf0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:40.150111 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-eeec4f42-abdf-4039-9782-3e616ae41477 req-c1c55cef-61a3-47c6-8888-329927c64bf0 service nova] Creating event network-vif-plugged:f00b7439-3b57-4199-889a-94171e92eec2 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:46:40.150627 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-eeec4f42-abdf-4039-9782-3e616ae41477 req-c1c55cef-61a3-47c6-8888-329927c64bf0 service nova] Creating event network-vif-plugged:fb2020ef-e5e3-481a-baca-ee8ad6e8058a for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:46:40.151129 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-eeec4f42-abdf-4039-9782-3e616ae41477 req-c1c55cef-61a3-47c6-8888-329927c64bf0 service nova] Creating event network-vif-plugged:cd46ad50-24e5-4e89-b061-174efa4e9061 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:46:40.151859 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-eeec4f42-abdf-4039-9782-3e616ae41477 req-c1c55cef-61a3-47c6-8888-329927c64bf0 service nova] Creating event network-vif-plugged:3e53a27e-13fd-4b03-87fb-f257a770ce85 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:46:40.152563 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-eeec4f42-abdf-4039-9782-3e616ae41477 req-c1c55cef-61a3-47c6-8888-329927c64bf0 service nova] Creating event network-vif-plugged:6edc1d11-d1ae-4161-a5c2-9e721c334352 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:46:40.162246 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-eeec4f42-abdf-4039-9782-3e616ae41477 req-c1c55cef-61a3-47c6-8888-329927c64bf0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.058364 Oct 24 10:46:40.163419 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2318/4681] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:46:40.171292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-49a91728-f653-47ba-8922-ef03a71909bb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:40.173074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-49a91728-f653-47ba-8922-ef03a71909bb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:40.181366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49a91728-f653-47ba-8922-ef03a71909bb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:40.181856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49a91728-f653-47ba-8922-ef03a71909bb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:40.182346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49a91728-f653-47ba-8922-ef03a71909bb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:40.183098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49a91728-f653-47ba-8922-ef03a71909bb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:40.183554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49a91728-f653-47ba-8922-ef03a71909bb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:40.183981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49a91728-f653-47ba-8922-ef03a71909bb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:40.217624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e67ad16e-3039-42a8-a7dc-aa3024cdf40f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:40.229341 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e67ad16e-3039-42a8-a7dc-aa3024cdf40f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1309 microversion: 2.1 time: 0.563052 Oct 24 10:46:40.254362 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2364/4682] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:39 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1309 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:40.266144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-e293ae4c-371d-4544-8256-186da5e41a00 req-86da5955-5817-4900-90b7-f611b0f2c078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa3f4aec-0b6f-4bae-953e-69477c43cfee", "tag": "4f5b21ae-b234-4677-a503-6ca2318d5913"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:40.288663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e293ae4c-371d-4544-8256-186da5e41a00 req-86da5955-5817-4900-90b7-f611b0f2c078 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:40.290038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e293ae4c-371d-4544-8256-186da5e41a00 req-86da5955-5817-4900-90b7-f611b0f2c078 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:40.292119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e293ae4c-371d-4544-8256-186da5e41a00 req-86da5955-5817-4900-90b7-f611b0f2c078 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:40.320209 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-e293ae4c-371d-4544-8256-186da5e41a00 req-86da5955-5817-4900-90b7-f611b0f2c078 service nova] Creating event network-changed:4f5b21ae-b234-4677-a503-6ca2318d5913 for instance fa3f4aec-0b6f-4bae-953e-69477c43cfee on n-h2-858383-15 Oct 24 10:46:40.329153 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-e293ae4c-371d-4544-8256-186da5e41a00 req-86da5955-5817-4900-90b7-f611b0f2c078 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072171 Oct 24 10:46:40.331379 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2365/4683] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:40.341805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54f7ad55-c729-4cd8-8fe7-d4b71896a744 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:40.348185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-54f7ad55-c729-4cd8-8fe7-d4b71896a744 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:40.358015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54f7ad55-c729-4cd8-8fe7-d4b71896a744 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:40.358808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54f7ad55-c729-4cd8-8fe7-d4b71896a744 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:40.360016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54f7ad55-c729-4cd8-8fe7-d4b71896a744 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:40.361674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54f7ad55-c729-4cd8-8fe7-d4b71896a744 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:40.362746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54f7ad55-c729-4cd8-8fe7-d4b71896a744 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:40.363984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54f7ad55-c729-4cd8-8fe7-d4b71896a744 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:40.413038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-49a91728-f653-47ba-8922-ef03a71909bb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:40.422932 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-49a91728-f653-47ba-8922-ef03a71909bb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1317 microversion: 2.1 time: 0.257776 Oct 24 10:46:40.438752 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2319/4684] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:40 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:40.558301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b032254-20de-4fd7-ab2b-5388beb84b00 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:40.559667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8b032254-20de-4fd7-ab2b-5388beb84b00 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:40.569475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b032254-20de-4fd7-ab2b-5388beb84b00 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:40.570603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b032254-20de-4fd7-ab2b-5388beb84b00 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:40.572029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b032254-20de-4fd7-ab2b-5388beb84b00 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:40.573122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b032254-20de-4fd7-ab2b-5388beb84b00 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:40.573768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b032254-20de-4fd7-ab2b-5388beb84b00 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:40.574428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b032254-20de-4fd7-ab2b-5388beb84b00 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:40.587020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-54f7ad55-c729-4cd8-8fe7-d4b71896a744 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:40.604435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-54f7ad55-c729-4cd8-8fe7-d4b71896a744 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:40.610891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-54f7ad55-c729-4cd8-8fe7-d4b71896a744 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:40.612461 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-54f7ad55-c729-4cd8-8fe7-d4b71896a744 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1362 microversion: 2.26 time: 0.278737 Oct 24 10:46:40.613709 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2366/4685] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:40 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1362 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:40.748779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8b032254-20de-4fd7-ab2b-5388beb84b00 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:40.758258 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b032254-20de-4fd7-ab2b-5388beb84b00 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee" status: 200 len: 1317 microversion: 2.1 time: 0.204641 Oct 24 10:46:40.759018 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2320/4686] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:40 2022] GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:41.071096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ed7f923f-cd07-4086-9852-c25957441f56 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:41.071813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ed7f923f-cd07-4086-9852-c25957441f56 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:41.079082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed7f923f-cd07-4086-9852-c25957441f56 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:41.079568 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed7f923f-cd07-4086-9852-c25957441f56 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:41.080000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed7f923f-cd07-4086-9852-c25957441f56 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:41.080697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed7f923f-cd07-4086-9852-c25957441f56 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:41.081176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed7f923f-cd07-4086-9852-c25957441f56 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:41.081600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed7f923f-cd07-4086-9852-c25957441f56 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:41.264266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b45dff90-73fc-47f0-a8d4-ddeb0c3dcbd1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:41.265328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b45dff90-73fc-47f0-a8d4-ddeb0c3dcbd1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:41.274571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b45dff90-73fc-47f0-a8d4-ddeb0c3dcbd1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:41.275227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b45dff90-73fc-47f0-a8d4-ddeb0c3dcbd1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:41.275870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b45dff90-73fc-47f0-a8d4-ddeb0c3dcbd1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:41.276792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b45dff90-73fc-47f0-a8d4-ddeb0c3dcbd1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:41.278139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b45dff90-73fc-47f0-a8d4-ddeb0c3dcbd1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:41.278805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b45dff90-73fc-47f0-a8d4-ddeb0c3dcbd1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:41.281809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ed7f923f-cd07-4086-9852-c25957441f56 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:41.294163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ed7f923f-cd07-4086-9852-c25957441f56 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:41.297358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ed7f923f-cd07-4086-9852-c25957441f56 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:41.298845 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ed7f923f-cd07-4086-9852-c25957441f56 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.231795 Oct 24 10:46:41.299843 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2367/4687] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:41 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:46:41.430996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b45dff90-73fc-47f0-a8d4-ddeb0c3dcbd1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:41.440849 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b45dff90-73fc-47f0-a8d4-ddeb0c3dcbd1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1309 microversion: 2.1 time: 0.182118 Oct 24 10:46:41.441972 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2321/4688] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:41 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1309 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:41.447858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8fc14db9-df4c-4273-865b-7b2d73d30c3e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:41.450913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8fc14db9-df4c-4273-865b-7b2d73d30c3e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:41.459783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fc14db9-df4c-4273-865b-7b2d73d30c3e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:41.460567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fc14db9-df4c-4273-865b-7b2d73d30c3e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:41.472500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fc14db9-df4c-4273-865b-7b2d73d30c3e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:41.474071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fc14db9-df4c-4273-865b-7b2d73d30c3e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:41.474564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fc14db9-df4c-4273-865b-7b2d73d30c3e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:41.475947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fc14db9-df4c-4273-865b-7b2d73d30c3e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:41.630121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8fc14db9-df4c-4273-865b-7b2d73d30c3e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:41.644537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33bb3cf7-6c74-4e2e-83b7-6af3400a1790 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:41.645390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-33bb3cf7-6c74-4e2e-83b7-6af3400a1790 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:41.648519 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8fc14db9-df4c-4273-865b-7b2d73d30c3e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1317 microversion: 2.1 time: 0.206551 Oct 24 10:46:41.652732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33bb3cf7-6c74-4e2e-83b7-6af3400a1790 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:41.652924 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2368/4689] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:41 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:41.654282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33bb3cf7-6c74-4e2e-83b7-6af3400a1790 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:41.654739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33bb3cf7-6c74-4e2e-83b7-6af3400a1790 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:41.655466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33bb3cf7-6c74-4e2e-83b7-6af3400a1790 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:41.655999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33bb3cf7-6c74-4e2e-83b7-6af3400a1790 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:41.656437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33bb3cf7-6c74-4e2e-83b7-6af3400a1790 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:41.661096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:41.783110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4cf44d74-f0db-47a4-89d7-b9c8176a69be tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:41.784114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4cf44d74-f0db-47a4-89d7-b9c8176a69be tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:41.792227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4cf44d74-f0db-47a4-89d7-b9c8176a69be tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:41.792979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4cf44d74-f0db-47a4-89d7-b9c8176a69be tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:41.793646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4cf44d74-f0db-47a4-89d7-b9c8176a69be tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:41.794594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4cf44d74-f0db-47a4-89d7-b9c8176a69be tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:41.795307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4cf44d74-f0db-47a4-89d7-b9c8176a69be tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:41.795955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4cf44d74-f0db-47a4-89d7-b9c8176a69be tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:41.816144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-33bb3cf7-6c74-4e2e-83b7-6af3400a1790 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:41.826593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-33bb3cf7-6c74-4e2e-83b7-6af3400a1790 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:41.828960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-33bb3cf7-6c74-4e2e-83b7-6af3400a1790 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:41.830910 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-33bb3cf7-6c74-4e2e-83b7-6af3400a1790 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1362 microversion: 2.26 time: 0.191674 Oct 24 10:46:41.832004 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2322/4690] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:41 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:46:41.964088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4cf44d74-f0db-47a4-89d7-b9c8176a69be tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:41.974552 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4cf44d74-f0db-47a4-89d7-b9c8176a69be tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee" status: 200 len: 1317 microversion: 2.1 time: 0.195516 Oct 24 10:46:41.986886 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2369/4691] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:41 2022] GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:42.061766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a3d803e4-5cc8-41fe-beb3-53c73dc21f2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-220532136", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a22e9c7-8b7d-407a-b10d-a70b7c3811c7"}], "security_groups": [{"name": "tempest-securitygroup--480005896"}], "key_name": "tempest-keypair-827608814", "user_data": "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:42.173824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-a3d803e4-5cc8-41fe-beb3-53c73dc21f2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] validate_networks() for [('7a22e9c7-8b7d-407a-b10d-a70b7c3811c7', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:46:42.180479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-b6728008-5afe-4d4f-b103-1af647a4fc00 req-e4c6b0da-4234-4ec7-80ac-7c458a484270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-plugged", "status": "completed", "tag": "87b48d2c-81df-4477-a1f6-2e67350bc815"}, {"server_uuid": "b55e1f7d-f0be-4eca-9123-b2df6f212b41", "name": "network-vif-plugged", "status": "completed", "tag": "17ce799e-44e1-45e0-a869-e6a177d299e7"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:42.192932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b6728008-5afe-4d4f-b103-1af647a4fc00 req-e4c6b0da-4234-4ec7-80ac-7c458a484270 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:42.193644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b6728008-5afe-4d4f-b103-1af647a4fc00 req-e4c6b0da-4234-4ec7-80ac-7c458a484270 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:42.194088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b6728008-5afe-4d4f-b103-1af647a4fc00 req-e4c6b0da-4234-4ec7-80ac-7c458a484270 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:42.208519 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-b6728008-5afe-4d4f-b103-1af647a4fc00 req-e4c6b0da-4234-4ec7-80ac-7c458a484270 service nova] Creating event network-vif-plugged:87b48d2c-81df-4477-a1f6-2e67350bc815 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:46:42.209139 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-b6728008-5afe-4d4f-b103-1af647a4fc00 req-e4c6b0da-4234-4ec7-80ac-7c458a484270 service nova] Creating event network-vif-plugged:17ce799e-44e1-45e0-a869-e6a177d299e7 for instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 on n-h2-858383-15 Oct 24 10:46:42.222133 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-b6728008-5afe-4d4f-b103-1af647a4fc00 req-e4c6b0da-4234-4ec7-80ac-7c458a484270 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039814 Oct 24 10:46:42.222133 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2370/4692] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:46:42.327249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-40902f61-e696-4a71-9326-cae7e8f25e07 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:42.328084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-40902f61-e696-4a71-9326-cae7e8f25e07 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:42.337494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40902f61-e696-4a71-9326-cae7e8f25e07 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:42.340163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40902f61-e696-4a71-9326-cae7e8f25e07 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:42.340811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40902f61-e696-4a71-9326-cae7e8f25e07 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:42.341575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40902f61-e696-4a71-9326-cae7e8f25e07 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:42.342323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40902f61-e696-4a71-9326-cae7e8f25e07 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:42.343124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40902f61-e696-4a71-9326-cae7e8f25e07 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:42.884996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-40902f61-e696-4a71-9326-cae7e8f25e07 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:42.899471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-40902f61-e696-4a71-9326-cae7e8f25e07 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:42.904278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-40902f61-e696-4a71-9326-cae7e8f25e07 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:42.907440 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-40902f61-e696-4a71-9326-cae7e8f25e07 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.584709 Oct 24 10:46:42.909742 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2371/4693] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:42 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:42.918054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b3eb0940-ea80-4be4-986e-725a6df0ba27 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:42.919017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b3eb0940-ea80-4be4-986e-725a6df0ba27 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:42.930744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a3d803e4-5cc8-41fe-beb3-53c73dc21f2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:46:42.931300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a3d803e4-5cc8-41fe-beb3-53c73dc21f2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:46:42.932075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a3d803e4-5cc8-41fe-beb3-53c73dc21f2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:46:42.932775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a3d803e4-5cc8-41fe-beb3-53c73dc21f2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:46:42.933342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a3d803e4-5cc8-41fe-beb3-53c73dc21f2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:46:42.938284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3eb0940-ea80-4be4-986e-725a6df0ba27 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:42.939074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3eb0940-ea80-4be4-986e-725a6df0ba27 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:42.940042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3eb0940-ea80-4be4-986e-725a6df0ba27 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:42.941102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3eb0940-ea80-4be4-986e-725a6df0ba27 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:42.941823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3eb0940-ea80-4be4-986e-725a6df0ba27 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:42.942452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3eb0940-ea80-4be4-986e-725a6df0ba27 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:42.949820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3d803e4-5cc8-41fe-beb3-53c73dc21f2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:42.953351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3d803e4-5cc8-41fe-beb3-53c73dc21f2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:42.955262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3d803e4-5cc8-41fe-beb3-53c73dc21f2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:42.958058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3d803e4-5cc8-41fe-beb3-53c73dc21f2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:42.960662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3d803e4-5cc8-41fe-beb3-53c73dc21f2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:42.961406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3d803e4-5cc8-41fe-beb3-53c73dc21f2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:43.003418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-a3d803e4-5cc8-41fe-beb3-53c73dc21f2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Getting quotas for project 886ae7eabe82421ca19e5cd59630e961. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:46:43.023432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-a3d803e4-5cc8-41fe-beb3-53c73dc21f2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Getting quotas for user bf908b0f4e444157a0f28e84de8f8555 and project 886ae7eabe82421ca19e5cd59630e961. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:46:43.043052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a3d803e4-5cc8-41fe-beb3-53c73dc21f2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:46:43.047618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a3d803e4-5cc8-41fe-beb3-53c73dc21f2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:46:43.133249 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a3d803e4-5cc8-41fe-beb3-53c73dc21f2b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.075854 Oct 24 10:46:43.134100 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2323/4694] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Oct 24 10:46:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 10:46:43.145797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-075f88b7-362c-449f-8001-acc4abf9b4d3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:43.146686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-075f88b7-362c-449f-8001-acc4abf9b4d3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:43.158082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-075f88b7-362c-449f-8001-acc4abf9b4d3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:43.158839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-075f88b7-362c-449f-8001-acc4abf9b4d3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:43.159535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-075f88b7-362c-449f-8001-acc4abf9b4d3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:43.160530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-075f88b7-362c-449f-8001-acc4abf9b4d3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:43.161698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-075f88b7-362c-449f-8001-acc4abf9b4d3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:43.162445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-075f88b7-362c-449f-8001-acc4abf9b4d3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:43.737374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b3eb0940-ea80-4be4-986e-725a6df0ba27 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:43.751044 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b3eb0940-ea80-4be4-986e-725a6df0ba27 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1309 microversion: 2.1 time: 0.839719 Oct 24 10:46:43.765835 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2372/4695] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:42 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1309 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:43.769263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-075f88b7-362c-449f-8001-acc4abf9b4d3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:43.774227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aede7ac9-7d09-4002-9dcc-2abf0bfafe68 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:43.774931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aede7ac9-7d09-4002-9dcc-2abf0bfafe68 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:43.779087 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-075f88b7-362c-449f-8001-acc4abf9b4d3 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1317 microversion: 2.1 time: 0.636881 Oct 24 10:46:43.780133 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2324/4696] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:43 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1317 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:43.783273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aede7ac9-7d09-4002-9dcc-2abf0bfafe68 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:43.783768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aede7ac9-7d09-4002-9dcc-2abf0bfafe68 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:43.784208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aede7ac9-7d09-4002-9dcc-2abf0bfafe68 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:43.785152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aede7ac9-7d09-4002-9dcc-2abf0bfafe68 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:43.786219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aede7ac9-7d09-4002-9dcc-2abf0bfafe68 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:43.786908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aede7ac9-7d09-4002-9dcc-2abf0bfafe68 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:43.787635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e57a269c-3e25-49a2-8664-a6c289fc9063 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:43.788501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e57a269c-3e25-49a2-8664-a6c289fc9063 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:43.796729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e57a269c-3e25-49a2-8664-a6c289fc9063 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:43.797838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e57a269c-3e25-49a2-8664-a6c289fc9063 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:43.798389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e57a269c-3e25-49a2-8664-a6c289fc9063 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:43.799177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e57a269c-3e25-49a2-8664-a6c289fc9063 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:43.799925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e57a269c-3e25-49a2-8664-a6c289fc9063 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:43.800523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e57a269c-3e25-49a2-8664-a6c289fc9063 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.039410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aede7ac9-7d09-4002-9dcc-2abf0bfafe68 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:44.048860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aede7ac9-7d09-4002-9dcc-2abf0bfafe68 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:44.050318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aede7ac9-7d09-4002-9dcc-2abf0bfafe68 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:44.053781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e57a269c-3e25-49a2-8664-a6c289fc9063 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:44.058274 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aede7ac9-7d09-4002-9dcc-2abf0bfafe68 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1546 microversion: 2.26 time: 0.290466 Oct 24 10:46:44.058709 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2373/4697] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:43 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1546 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:44.062279 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e57a269c-3e25-49a2-8664-a6c289fc9063 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee" status: 200 len: 1317 microversion: 2.1 time: 0.279719 Oct 24 10:46:44.074833 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2325/4698] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:43 2022] GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:44.075010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cae3e012-de89-4eb9-b184-a8382527d2b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:44.075010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cae3e012-de89-4eb9-b184-a8382527d2b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:44.075230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-02201485-4070-4137-8bab-33eacdab7249 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:44.075230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-02201485-4070-4137-8bab-33eacdab7249 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:44.075402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae3e012-de89-4eb9-b184-a8382527d2b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.075402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae3e012-de89-4eb9-b184-a8382527d2b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.075402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae3e012-de89-4eb9-b184-a8382527d2b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.075402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae3e012-de89-4eb9-b184-a8382527d2b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.075402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae3e012-de89-4eb9-b184-a8382527d2b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.075402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae3e012-de89-4eb9-b184-a8382527d2b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.075899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02201485-4070-4137-8bab-33eacdab7249 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.076030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02201485-4070-4137-8bab-33eacdab7249 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.076564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02201485-4070-4137-8bab-33eacdab7249 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.077759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02201485-4070-4137-8bab-33eacdab7249 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.078910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02201485-4070-4137-8bab-33eacdab7249 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.079422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02201485-4070-4137-8bab-33eacdab7249 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.169717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cae3e012-de89-4eb9-b184-a8382527d2b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:44.178898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cae3e012-de89-4eb9-b184-a8382527d2b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:44.180424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cae3e012-de89-4eb9-b184-a8382527d2b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:44.181587 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cae3e012-de89-4eb9-b184-a8382527d2b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1284 microversion: 2.20 time: 0.121767 Oct 24 10:46:44.182478 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2374/4699] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:44 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:44.188014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '.version_select at 0x7f04d06a2af0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:44.202344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.203132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.204462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.205670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:44.213016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.213505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.213947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.215010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.215099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.215506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.247098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.247719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.248245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.262907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.263472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.263991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.267638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:44.291715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lazy-loading 'flavor' on Instance uuid 0bc1822e-4a9a-4bf2-8e57-f8875039c620 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:46:44.302997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-02201485-4070-4137-8bab-33eacdab7249 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:44.309309 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7adaeceb-9a4d-43e7-ab94-bb7daaea4907 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "PUT /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags/tempest-tag-1277060616" status: 201 len: 0 microversion: 2.26 time: 0.125742 Oct 24 10:46:44.309975 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2375/4700] 10.222.0.50 () {62 vars in 1380 bytes} [Mon Oct 24 10:46:44 2022] PUT /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags/tempest-tag-1277060616 => generated 0 bytes in 127 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 24 10:46:44.320568 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f4769d71-f853-4f74-b62d-4e7f9533edd3 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '.version_select at 0x7f04d0d50820>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:44.329667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4769d71-f853-4f74-b62d-4e7f9533edd3 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.330401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4769d71-f853-4f74-b62d-4e7f9533edd3 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.330852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4769d71-f853-4f74-b62d-4e7f9533edd3 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.337391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-02201485-4070-4137-8bab-33eacdab7249 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:44.341834 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f4769d71-f853-4f74-b62d-4e7f9533edd3 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags/tempest-tag-1277060616" status: 204 len: 0 microversion: 2.26 time: 0.025455 Oct 24 10:46:44.342755 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2376/4701] 10.222.0.50 () {60 vars in 1361 bytes} [Mon Oct 24 10:46:44 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags/tempest-tag-1277060616 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:46:44.343727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-02201485-4070-4137-8bab-33eacdab7249 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:44.345308 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-02201485-4070-4137-8bab-33eacdab7249 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1880 microversion: 2.42 time: 0.281437 Oct 24 10:46:44.358617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ae095c9b-2535-46f3-b34b-f6a35ef36663 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '.version_select at 0x7f04d06a2790>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:44.366926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae095c9b-2535-46f3-b34b-f6a35ef36663 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.367430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae095c9b-2535-46f3-b34b-f6a35ef36663 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.367836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae095c9b-2535-46f3-b34b-f6a35ef36663 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.368332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ae095c9b-2535-46f3-b34b-f6a35ef36663 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:44.370021 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2326/4702] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:44 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1880 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:44.373849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae095c9b-2535-46f3-b34b-f6a35ef36663 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.374336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae095c9b-2535-46f3-b34b-f6a35ef36663 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.375771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae095c9b-2535-46f3-b34b-f6a35ef36663 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.376312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae095c9b-2535-46f3-b34b-f6a35ef36663 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.376464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae095c9b-2535-46f3-b34b-f6a35ef36663 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.376899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae095c9b-2535-46f3-b34b-f6a35ef36663 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.402901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae095c9b-2535-46f3-b34b-f6a35ef36663 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.403395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae095c9b-2535-46f3-b34b-f6a35ef36663 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.403839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae095c9b-2535-46f3-b34b-f6a35ef36663 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.423757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-ae095c9b-2535-46f3-b34b-f6a35ef36663 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lazy-loading 'flavor' on Instance uuid 0bc1822e-4a9a-4bf2-8e57-f8875039c620 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:46:44.441178 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ae095c9b-2535-46f3-b34b-f6a35ef36663 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags" status: 204 len: 0 microversion: 2.26 time: 0.093981 Oct 24 10:46:44.441842 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2377/4703] 10.222.0.50 () {60 vars in 1295 bytes} [Mon Oct 24 10:46:44 2022] DELETE /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:46:44.451011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e1fff17c-65d4-41f1-9455-8c6655384ac4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '.version_select at 0x7f04cbbf0790>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:44.460181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1fff17c-65d4-41f1-9455-8c6655384ac4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.460762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1fff17c-65d4-41f1-9455-8c6655384ac4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.461311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1fff17c-65d4-41f1-9455-8c6655384ac4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.476409 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e1fff17c-65d4-41f1-9455-8c6655384ac4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags" status: 200 len: 12 microversion: 2.26 time: 0.029316 Oct 24 10:46:44.477483 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2327/4704] 10.222.0.50 () {60 vars in 1292 bytes} [Mon Oct 24 10:46:44 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags => generated 12 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:44.488547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '.version_select at 0x7f04d06af160>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:44.498771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.499443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.500460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.501145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:44.507940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.508617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.509489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.510434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.510992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.511501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.541540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.542132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.542648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.553644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.554236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.554759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.555292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-765a27fe-9325-4e63-98ff-992462fc5a3c req-45b4a2e3-a117-4339-a0e7-167ac884917c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3f4aec-0b6f-4bae-953e-69477c43cfee", "name": "network-vif-plugged", "status": "completed", "tag": "4f5b21ae-b234-4677-a503-6ca2318d5913"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:44.565558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-765a27fe-9325-4e63-98ff-992462fc5a3c req-45b4a2e3-a117-4339-a0e7-167ac884917c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.566044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-765a27fe-9325-4e63-98ff-992462fc5a3c req-45b4a2e3-a117-4339-a0e7-167ac884917c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.566487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-765a27fe-9325-4e63-98ff-992462fc5a3c req-45b4a2e3-a117-4339-a0e7-167ac884917c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.580759 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-765a27fe-9325-4e63-98ff-992462fc5a3c req-45b4a2e3-a117-4339-a0e7-167ac884917c service nova] Creating event network-vif-plugged:4f5b21ae-b234-4677-a503-6ca2318d5913 for instance fa3f4aec-0b6f-4bae-953e-69477c43cfee on n-h2-858383-15 Oct 24 10:46:44.585648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lazy-loading 'flavor' on Instance uuid 0bc1822e-4a9a-4bf2-8e57-f8875039c620 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:46:44.588312 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-765a27fe-9325-4e63-98ff-992462fc5a3c req-45b4a2e3-a117-4339-a0e7-167ac884917c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036619 Oct 24 10:46:44.589155 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2328/4705] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:46:44.604004 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f2f8e48f-9a53-434e-9c1f-6dcb9454ef3b tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "PUT /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags/tempest-tag-829166263" status: 201 len: 0 microversion: 2.26 time: 0.120203 Oct 24 10:46:44.604742 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2378/4706] 10.222.0.50 () {62 vars in 1377 bytes} [Mon Oct 24 10:46:44 2022] PUT /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags/tempest-tag-829166263 => generated 0 bytes in 122 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 24 10:46:44.615499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31c6723d-94a5-4773-a360-9e9763a519af tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '.version_select at 0x7f04d0bb3670>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:44.623677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31c6723d-94a5-4773-a360-9e9763a519af tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.624176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31c6723d-94a5-4773-a360-9e9763a519af tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.624869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31c6723d-94a5-4773-a360-9e9763a519af tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.634625 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31c6723d-94a5-4773-a360-9e9763a519af tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags" status: 200 len: 35 microversion: 2.26 time: 0.023490 Oct 24 10:46:44.635933 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2329/4707] 10.222.0.50 () {60 vars in 1292 bytes} [Mon Oct 24 10:46:44 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags => generated 35 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:44.646444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7e968a31-5e84-414f-a97a-3371d6896490 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '.version_select at 0x7f04d06a23a0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:44.654411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e968a31-5e84-414f-a97a-3371d6896490 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.654897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e968a31-5e84-414f-a97a-3371d6896490 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.655675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e968a31-5e84-414f-a97a-3371d6896490 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.656720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7e968a31-5e84-414f-a97a-3371d6896490 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:44.662724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e968a31-5e84-414f-a97a-3371d6896490 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.663222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e968a31-5e84-414f-a97a-3371d6896490 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.663661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e968a31-5e84-414f-a97a-3371d6896490 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.664573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e968a31-5e84-414f-a97a-3371d6896490 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.665222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e968a31-5e84-414f-a97a-3371d6896490 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.665933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e968a31-5e84-414f-a97a-3371d6896490 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.690726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e968a31-5e84-414f-a97a-3371d6896490 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.691526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e968a31-5e84-414f-a97a-3371d6896490 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.691983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e968a31-5e84-414f-a97a-3371d6896490 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.716890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-7e968a31-5e84-414f-a97a-3371d6896490 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lazy-loading 'flavor' on Instance uuid 0bc1822e-4a9a-4bf2-8e57-f8875039c620 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:46:44.742421 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7e968a31-5e84-414f-a97a-3371d6896490 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags/tempest-tag-829166263" status: 204 len: 0 microversion: 2.26 time: 0.100063 Oct 24 10:46:44.743158 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2379/4708] 10.222.0.50 () {60 vars in 1361 bytes} [Mon Oct 24 10:46:44 2022] DELETE /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags/tempest-tag-829166263 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:46:44.751786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3c0b2a8e-70e0-481d-81db-32d4a666043a tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '.version_select at 0x7f04d0c9c310>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:44.760956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c0b2a8e-70e0-481d-81db-32d4a666043a tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.761450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c0b2a8e-70e0-481d-81db-32d4a666043a tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.761897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c0b2a8e-70e0-481d-81db-32d4a666043a tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.772696 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3c0b2a8e-70e0-481d-81db-32d4a666043a tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags" status: 200 len: 12 microversion: 2.26 time: 0.025224 Oct 24 10:46:44.773480 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2330/4709] 10.222.0.50 () {60 vars in 1292 bytes} [Mon Oct 24 10:46:44 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags => generated 12 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:44.779263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fd5a6650-99df-4602-8dc9-bd88ca60dfd4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:44.779979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fd5a6650-99df-4602-8dc9-bd88ca60dfd4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:44.785035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2de9d4d8-ec29-46b9-b363-63d89c2e942f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '.version_select at 0x7f04d0f939d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:44.787281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd5a6650-99df-4602-8dc9-bd88ca60dfd4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.787851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd5a6650-99df-4602-8dc9-bd88ca60dfd4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.789073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd5a6650-99df-4602-8dc9-bd88ca60dfd4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.789771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd5a6650-99df-4602-8dc9-bd88ca60dfd4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.790624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd5a6650-99df-4602-8dc9-bd88ca60dfd4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.791049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd5a6650-99df-4602-8dc9-bd88ca60dfd4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.792862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2de9d4d8-ec29-46b9-b363-63d89c2e942f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.793354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2de9d4d8-ec29-46b9-b363-63d89c2e942f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.793795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2de9d4d8-ec29-46b9-b363-63d89c2e942f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.794405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2de9d4d8-ec29-46b9-b363-63d89c2e942f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:44.800648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2de9d4d8-ec29-46b9-b363-63d89c2e942f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.801253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2de9d4d8-ec29-46b9-b363-63d89c2e942f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.801700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2de9d4d8-ec29-46b9-b363-63d89c2e942f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.802393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2de9d4d8-ec29-46b9-b363-63d89c2e942f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.802860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2de9d4d8-ec29-46b9-b363-63d89c2e942f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.803290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2de9d4d8-ec29-46b9-b363-63d89c2e942f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.826584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2de9d4d8-ec29-46b9-b363-63d89c2e942f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.827082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2de9d4d8-ec29-46b9-b363-63d89c2e942f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.827526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2de9d4d8-ec29-46b9-b363-63d89c2e942f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.839333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-2de9d4d8-ec29-46b9-b363-63d89c2e942f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lazy-loading 'flavor' on Instance uuid 0bc1822e-4a9a-4bf2-8e57-f8875039c620 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:46:44.863615 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2de9d4d8-ec29-46b9-b363-63d89c2e942f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags" status: 204 len: 0 microversion: 2.26 time: 0.083202 Oct 24 10:46:44.868416 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2331/4710] 10.222.0.50 () {60 vars in 1295 bytes} [Mon Oct 24 10:46:44 2022] DELETE /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 24 10:46:44.869325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a29f4c77-9c86-4f13-a388-e05bfd80564a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:44.870161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a29f4c77-9c86-4f13-a388-e05bfd80564a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:44.877602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a29f4c77-9c86-4f13-a388-e05bfd80564a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.878177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a29f4c77-9c86-4f13-a388-e05bfd80564a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.878701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a29f4c77-9c86-4f13-a388-e05bfd80564a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.879862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a29f4c77-9c86-4f13-a388-e05bfd80564a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:44.880183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a29f4c77-9c86-4f13-a388-e05bfd80564a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:44.880693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a29f4c77-9c86-4f13-a388-e05bfd80564a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:44.974885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fd5a6650-99df-4602-8dc9-bd88ca60dfd4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:45.011262 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fd5a6650-99df-4602-8dc9-bd88ca60dfd4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1490 microversion: 2.1 time: 0.240263 Oct 24 10:46:45.014388 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2380/4711] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:44 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1490 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:45.022021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '.version_select at 0x7f04d06a2430>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:45.051954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.052451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.054874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.056216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:45.076628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.077167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.077618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.078632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.079107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.079538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.099074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a29f4c77-9c86-4f13-a388-e05bfd80564a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:45.108964 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a29f4c77-9c86-4f13-a388-e05bfd80564a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1317 microversion: 2.1 time: 0.243447 Oct 24 10:46:45.110631 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2332/4712] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:44 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:45.126299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-22e31dcc-9ae5-4929-868a-b479d352367f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1135488373"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:45.132652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.136188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.136400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-22e31dcc-9ae5-4929-868a-b479d352367f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:45.138572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.143550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22e31dcc-9ae5-4929-868a-b479d352367f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.144163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22e31dcc-9ae5-4929-868a-b479d352367f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.144677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22e31dcc-9ae5-4929-868a-b479d352367f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.145609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22e31dcc-9ae5-4929-868a-b479d352367f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.146406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22e31dcc-9ae5-4929-868a-b479d352367f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.147032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22e31dcc-9ae5-4929-868a-b479d352367f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.168033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.169299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.169903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.198042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lazy-loading 'flavor' on Instance uuid 0bc1822e-4a9a-4bf2-8e57-f8875039c620 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:46:45.214774 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f4b7b8a3-416e-4677-a8bf-117ee1bc7c6c tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "PUT /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags/tempest-tag-873750903" status: 201 len: 0 microversion: 2.26 time: 0.199160 Oct 24 10:46:45.222046 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2381/4713] 10.222.0.50 () {62 vars in 1377 bytes} [Mon Oct 24 10:46:45 2022] PUT /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags/tempest-tag-873750903 => generated 0 bytes in 200 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 24 10:46:45.225604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3bbcea56-4134-44a2-bf0b-0e9c48dd211a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:45.226223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3bbcea56-4134-44a2-bf0b-0e9c48dd211a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:45.232205 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-22e31dcc-9ae5-4929-868a-b479d352367f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "PUT /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1075 microversion: 2.1 time: 0.120050 Oct 24 10:46:45.232454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3bbcea56-4134-44a2-bf0b-0e9c48dd211a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.232958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3bbcea56-4134-44a2-bf0b-0e9c48dd211a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.233395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3bbcea56-4134-44a2-bf0b-0e9c48dd211a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.234714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3bbcea56-4134-44a2-bf0b-0e9c48dd211a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.235255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3bbcea56-4134-44a2-bf0b-0e9c48dd211a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.235684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3bbcea56-4134-44a2-bf0b-0e9c48dd211a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.237202 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2333/4714] 10.222.0.50 () {60 vars in 1256 bytes} [Mon Oct 24 10:46:45 2022] PUT /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1075 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:45.242641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d1ee9006-5d4b-41ee-b450-83bdce7c4a06 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:45.243614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d1ee9006-5d4b-41ee-b450-83bdce7c4a06 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:45.252198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1ee9006-5d4b-41ee-b450-83bdce7c4a06 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.253009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1ee9006-5d4b-41ee-b450-83bdce7c4a06 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.253648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1ee9006-5d4b-41ee-b450-83bdce7c4a06 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.254575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1ee9006-5d4b-41ee-b450-83bdce7c4a06 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.255221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1ee9006-5d4b-41ee-b450-83bdce7c4a06 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.255808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1ee9006-5d4b-41ee-b450-83bdce7c4a06 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.359923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d1ee9006-5d4b-41ee-b450-83bdce7c4a06 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:45.368944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d1ee9006-5d4b-41ee-b450-83bdce7c4a06 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:45.370928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d1ee9006-5d4b-41ee-b450-83bdce7c4a06 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:45.372435 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d1ee9006-5d4b-41ee-b450-83bdce7c4a06 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1332 microversion: 2.20 time: 0.134055 Oct 24 10:46:45.373551 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2334/4715] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:45 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1332 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:45.378783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '.version_select at 0x7f04d5038ca0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:45.389537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.390504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.401561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.402427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:45.414271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.414764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.415201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.415918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.416367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.416788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.441686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3bbcea56-4134-44a2-bf0b-0e9c48dd211a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:45.445552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.446146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.446686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.450121 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3bbcea56-4134-44a2-bf0b-0e9c48dd211a tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee" status: 200 len: 1317 microversion: 2.1 time: 0.233697 Oct 24 10:46:45.450702 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2382/4716] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:45 2022] GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:45.456881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0aa43d76-fa09-4d73-83ac-614ce90ae2a3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:45.457703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0aa43d76-fa09-4d73-83ac-614ce90ae2a3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:45.463774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0aa43d76-fa09-4d73-83ac-614ce90ae2a3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.464473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0aa43d76-fa09-4d73-83ac-614ce90ae2a3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.465130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0aa43d76-fa09-4d73-83ac-614ce90ae2a3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.465998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0aa43d76-fa09-4d73-83ac-614ce90ae2a3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.466618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0aa43d76-fa09-4d73-83ac-614ce90ae2a3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.467220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0aa43d76-fa09-4d73-83ac-614ce90ae2a3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.467928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.469415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.470023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.497192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lazy-loading 'flavor' on Instance uuid 0bc1822e-4a9a-4bf2-8e57-f8875039c620 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:46:45.513920 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-98e02bee-d554-4c7b-90f3-e5221b771ad4 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "PUT /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags/tempest-tag-888908370" status: 201 len: 0 microversion: 2.26 time: 0.139127 Oct 24 10:46:45.514955 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2335/4717] 10.222.0.50 () {62 vars in 1377 bytes} [Mon Oct 24 10:46:45 2022] PUT /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags/tempest-tag-888908370 => generated 0 bytes in 141 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 24 10:46:45.520279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6f86a2af-c028-4056-a891-519ba11337ea tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:45.521001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6f86a2af-c028-4056-a891-519ba11337ea tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:45.527215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f86a2af-c028-4056-a891-519ba11337ea tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.527700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f86a2af-c028-4056-a891-519ba11337ea tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.528136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f86a2af-c028-4056-a891-519ba11337ea tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.528874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f86a2af-c028-4056-a891-519ba11337ea tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.529316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f86a2af-c028-4056-a891-519ba11337ea tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.529741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f86a2af-c028-4056-a891-519ba11337ea tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.707968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0aa43d76-fa09-4d73-83ac-614ce90ae2a3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:45.716404 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0aa43d76-fa09-4d73-83ac-614ce90ae2a3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1501 microversion: 2.1 time: 0.264528 Oct 24 10:46:45.717018 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2383/4718] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:45 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1501 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:45.722995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5dd68608-aa3d-45c2-8c28-39edc073fc15 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '.version_select at 0x7f04cba9bca0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:45.731694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5dd68608-aa3d-45c2-8c28-39edc073fc15 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.732390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5dd68608-aa3d-45c2-8c28-39edc073fc15 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.733045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5dd68608-aa3d-45c2-8c28-39edc073fc15 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.733684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5dd68608-aa3d-45c2-8c28-39edc073fc15 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:45.740005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5dd68608-aa3d-45c2-8c28-39edc073fc15 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.740696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5dd68608-aa3d-45c2-8c28-39edc073fc15 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.741442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5dd68608-aa3d-45c2-8c28-39edc073fc15 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.742299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5dd68608-aa3d-45c2-8c28-39edc073fc15 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.744515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5dd68608-aa3d-45c2-8c28-39edc073fc15 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.745808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5dd68608-aa3d-45c2-8c28-39edc073fc15 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.767184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6f86a2af-c028-4056-a891-519ba11337ea tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:45.775016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5dd68608-aa3d-45c2-8c28-39edc073fc15 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.775587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5dd68608-aa3d-45c2-8c28-39edc073fc15 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.776095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5dd68608-aa3d-45c2-8c28-39edc073fc15 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.780159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6f86a2af-c028-4056-a891-519ba11337ea tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:45.786919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6f86a2af-c028-4056-a891-519ba11337ea tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:45.788364 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6f86a2af-c028-4056-a891-519ba11337ea tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 2839 microversion: 2.42 time: 0.271856 Oct 24 10:46:45.797263 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2336/4719] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:45 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 2839 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:45.797508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-5dd68608-aa3d-45c2-8c28-39edc073fc15 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lazy-loading 'flavor' on Instance uuid 0bc1822e-4a9a-4bf2-8e57-f8875039c620 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:46:45.800470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-159c61aa-cdbf-4dfe-a447-e8fa037a6fe1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:45.801403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-159c61aa-cdbf-4dfe-a447-e8fa037a6fe1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:45.809268 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5dd68608-aa3d-45c2-8c28-39edc073fc15 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags" status: 204 len: 0 microversion: 2.26 time: 0.090980 Oct 24 10:46:45.810396 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2384/4720] 10.222.0.50 () {60 vars in 1295 bytes} [Mon Oct 24 10:46:45 2022] DELETE /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:46:45.817489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-159c61aa-cdbf-4dfe-a447-e8fa037a6fe1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.818219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-159c61aa-cdbf-4dfe-a447-e8fa037a6fe1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.818826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-159c61aa-cdbf-4dfe-a447-e8fa037a6fe1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.819734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-159c61aa-cdbf-4dfe-a447-e8fa037a6fe1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.820354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-159c61aa-cdbf-4dfe-a447-e8fa037a6fe1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.820975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-159c61aa-cdbf-4dfe-a447-e8fa037a6fe1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.826939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-edbf16a2-5389-4fcc-ab73-0fc8bbdb8632 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '.version_select at 0x7f04d04fcb80>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:45.838973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-edbf16a2-5389-4fcc-ab73-0fc8bbdb8632 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.841046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-edbf16a2-5389-4fcc-ab73-0fc8bbdb8632 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.841046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-edbf16a2-5389-4fcc-ab73-0fc8bbdb8632 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.862380 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-edbf16a2-5389-4fcc-ab73-0fc8bbdb8632 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags" status: 200 len: 12 microversion: 2.26 time: 0.044293 Oct 24 10:46:45.863441 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2385/4721] 10.222.0.50 () {60 vars in 1292 bytes} [Mon Oct 24 10:46:45 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags => generated 12 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:45.868770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-686521ef-20f6-4f92-a469-b937ee32c53a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:45.869494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-686521ef-20f6-4f92-a469-b937ee32c53a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:45.876957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-686521ef-20f6-4f92-a469-b937ee32c53a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.877680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-686521ef-20f6-4f92-a469-b937ee32c53a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.878285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-686521ef-20f6-4f92-a469-b937ee32c53a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.879181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-686521ef-20f6-4f92-a469-b937ee32c53a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:45.879815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-686521ef-20f6-4f92-a469-b937ee32c53a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:45.880451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-686521ef-20f6-4f92-a469-b937ee32c53a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:45.904625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:46.096544 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-686521ef-20f6-4f92-a469-b937ee32c53a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.231228 Oct 24 10:46:46.097706 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2386/4722] 10.222.0.50 () {60 vars in 1316 bytes} [Mon Oct 24 10:46:45 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711/os-interface => generated 1832 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:46.122453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4f47b7e3-b763-42df-a8ce-7c9b70c05e24 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '.version_select at 0x7f04d07fa700>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:46.123190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-159c61aa-cdbf-4dfe-a447-e8fa037a6fe1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:46.132993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f47b7e3-b763-42df-a8ce-7c9b70c05e24 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:46.133605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f47b7e3-b763-42df-a8ce-7c9b70c05e24 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:46.134152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f47b7e3-b763-42df-a8ce-7c9b70c05e24 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:46.137870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4f47b7e3-b763-42df-a8ce-7c9b70c05e24 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:46.141974 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-159c61aa-cdbf-4dfe-a447-e8fa037a6fe1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1501 microversion: 2.1 time: 0.351856 Oct 24 10:46:46.144886 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2337/4723] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:45 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1501 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:46.146457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f47b7e3-b763-42df-a8ce-7c9b70c05e24 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:46.147058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f47b7e3-b763-42df-a8ce-7c9b70c05e24 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:46.147604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f47b7e3-b763-42df-a8ce-7c9b70c05e24 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:46.148418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f47b7e3-b763-42df-a8ce-7c9b70c05e24 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:46.149027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f47b7e3-b763-42df-a8ce-7c9b70c05e24 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:46.149567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f47b7e3-b763-42df-a8ce-7c9b70c05e24 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:46.170520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8aa00e1a-0b49-4648-81f0-5682da1b800d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:46.175928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8aa00e1a-0b49-4648-81f0-5682da1b800d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:46.195789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8aa00e1a-0b49-4648-81f0-5682da1b800d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:46.197561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8aa00e1a-0b49-4648-81f0-5682da1b800d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:46.201910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8aa00e1a-0b49-4648-81f0-5682da1b800d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:46.203684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8aa00e1a-0b49-4648-81f0-5682da1b800d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:46.205133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8aa00e1a-0b49-4648-81f0-5682da1b800d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:46.210449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8aa00e1a-0b49-4648-81f0-5682da1b800d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:46.224693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f47b7e3-b763-42df-a8ce-7c9b70c05e24 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:46.229589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f47b7e3-b763-42df-a8ce-7c9b70c05e24 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:46.230243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f47b7e3-b763-42df-a8ce-7c9b70c05e24 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:46.272925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-4f47b7e3-b763-42df-a8ce-7c9b70c05e24 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lazy-loading 'flavor' on Instance uuid 0bc1822e-4a9a-4bf2-8e57-f8875039c620 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:46:46.323895 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4f47b7e3-b763-42df-a8ce-7c9b70c05e24 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags" status: 204 len: 0 microversion: 2.26 time: 0.208815 Oct 24 10:46:46.325175 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2387/4724] 10.222.0.50 () {60 vars in 1295 bytes} [Mon Oct 24 10:46:46 2022] DELETE /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:46:46.331479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4db162a4-d73b-41af-ab37-df68d91be912 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:46.344140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4db162a4-d73b-41af-ab37-df68d91be912 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:46.345660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4db162a4-d73b-41af-ab37-df68d91be912 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:46.346614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4db162a4-d73b-41af-ab37-df68d91be912 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:46.387053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4db162a4-d73b-41af-ab37-df68d91be912 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Going to try to stop instance {{(pid=120426) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 10:46:46.469884 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4db162a4-d73b-41af-ab37-df68d91be912 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "POST /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41/action" status: 202 len: 0 microversion: 2.1 time: 0.142189 Oct 24 10:46:46.470272 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2388/4725] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:46:46 2022] POST /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:46:46.480456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '.version_select at 0x7f04d0d50b80>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:46.494257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:46.494760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:46.495204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:46.495804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:46.504686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:46.504686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:46.505319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:46.506014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:46.507007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:46.507574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:46.538617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8aa00e1a-0b49-4648-81f0-5682da1b800d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:46.547522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:46.557588 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8aa00e1a-0b49-4648-81f0-5682da1b800d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1317 microversion: 2.1 time: 0.409552 Oct 24 10:46:46.558613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:46.559105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:46.559543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:46.559940 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2338/4726] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:46 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:46.575956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7cd75468-1e1c-4238-a800-b6a0fb5f195c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:46.577121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7cd75468-1e1c-4238-a800-b6a0fb5f195c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:46.579103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:46.580436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:46.581279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:46.588686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cd75468-1e1c-4238-a800-b6a0fb5f195c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:46.590037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cd75468-1e1c-4238-a800-b6a0fb5f195c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:46.590690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cd75468-1e1c-4238-a800-b6a0fb5f195c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:46.591587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cd75468-1e1c-4238-a800-b6a0fb5f195c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:46.592216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cd75468-1e1c-4238-a800-b6a0fb5f195c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:46.594467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cd75468-1e1c-4238-a800-b6a0fb5f195c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:46.627535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lazy-loading 'flavor' on Instance uuid 0bc1822e-4a9a-4bf2-8e57-f8875039c620 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:46:46.660416 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e24e2c41-9d44-42eb-9e6f-75d1d140f092 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "PUT /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags/tempest-tag-45223750" status: 201 len: 0 microversion: 2.26 time: 0.185592 Oct 24 10:46:46.663149 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2389/4727] 10.222.0.50 () {62 vars in 1374 bytes} [Mon Oct 24 10:46:46 2022] PUT /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags/tempest-tag-45223750 => generated 0 bytes in 189 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Oct 24 10:46:46.675275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-44918032-80a7-41e3-a4e7-8f4a9a165de1 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:46.678843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-44918032-80a7-41e3-a4e7-8f4a9a165de1 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:46.690731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44918032-80a7-41e3-a4e7-8f4a9a165de1 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:46.691524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44918032-80a7-41e3-a4e7-8f4a9a165de1 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:46.692469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44918032-80a7-41e3-a4e7-8f4a9a165de1 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:46.693454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44918032-80a7-41e3-a4e7-8f4a9a165de1 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:46.694142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44918032-80a7-41e3-a4e7-8f4a9a165de1 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:46.696376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44918032-80a7-41e3-a4e7-8f4a9a165de1 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:46.740654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7cd75468-1e1c-4238-a800-b6a0fb5f195c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:46.755180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7cd75468-1e1c-4238-a800-b6a0fb5f195c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:46.758226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7cd75468-1e1c-4238-a800-b6a0fb5f195c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:46.759620 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7cd75468-1e1c-4238-a800-b6a0fb5f195c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1350 microversion: 2.20 time: 0.198538 Oct 24 10:46:46.760999 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2339/4728] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:46 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1350 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:46.766797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-010e3d9b-54be-4562-a394-249a6a246910 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:46.767831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-010e3d9b-54be-4562-a394-249a6a246910 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:46.777012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-010e3d9b-54be-4562-a394-249a6a246910 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:46.777808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-010e3d9b-54be-4562-a394-249a6a246910 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:46.779617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-010e3d9b-54be-4562-a394-249a6a246910 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:46.781420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-010e3d9b-54be-4562-a394-249a6a246910 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:46.782299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-010e3d9b-54be-4562-a394-249a6a246910 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:46.783420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-010e3d9b-54be-4562-a394-249a6a246910 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.019810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-44918032-80a7-41e3-a4e7-8f4a9a165de1 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:47.034413 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-44918032-80a7-41e3-a4e7-8f4a9a165de1 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee" status: 200 len: 1505 microversion: 2.1 time: 0.369203 Oct 24 10:46:47.038251 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2390/4729] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:46 2022] GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:47.048278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-521915ae-c839-4784-bcbf-bd53e65f421f req-5e1a7c32-d7f0-4c34-82d0-96a5bd7a948d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e35dae0d-896b-405b-a5a9-a9c951b30101", "name": "network-vif-plugged", "status": "completed", "tag": "9c42b90d-d03c-4366-9ad1-55ce408b2567"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:47.048642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-010e3d9b-54be-4562-a394-249a6a246910 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:47.058409 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-010e3d9b-54be-4562-a394-249a6a246910 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.296041 Oct 24 10:46:47.059271 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2340/4730] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:46 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:47.065118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '.version_select at 0x7f04d0208ca0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:47.070644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-521915ae-c839-4784-bcbf-bd53e65f421f req-5e1a7c32-d7f0-4c34-82d0-96a5bd7a948d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.070936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-521915ae-c839-4784-bcbf-bd53e65f421f req-5e1a7c32-d7f0-4c34-82d0-96a5bd7a948d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.071440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-521915ae-c839-4784-bcbf-bd53e65f421f req-5e1a7c32-d7f0-4c34-82d0-96a5bd7a948d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.077471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.078615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.079622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.080235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:47.087595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.088322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.089121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.090004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.090591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.091146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.091697 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-521915ae-c839-4784-bcbf-bd53e65f421f req-5e1a7c32-d7f0-4c34-82d0-96a5bd7a948d service nova] Creating event network-vif-plugged:9c42b90d-d03c-4366-9ad1-55ce408b2567 for instance e35dae0d-896b-405b-a5a9-a9c951b30101 on n-h1-858383-15 Oct 24 10:46:47.097549 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-521915ae-c839-4784-bcbf-bd53e65f421f req-5e1a7c32-d7f0-4c34-82d0-96a5bd7a948d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056810 Oct 24 10:46:47.098592 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2391/4731] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:47.104516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a666429e-f436-4448-9791-fdf92e796e71 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:47.105403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a666429e-f436-4448-9791-fdf92e796e71 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e35dae0d-896b-405b-a5a9-a9c951b30101] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:47.114964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a666429e-f436-4448-9791-fdf92e796e71 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.115471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a666429e-f436-4448-9791-fdf92e796e71 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.124934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.125638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.126166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.131866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a666429e-f436-4448-9791-fdf92e796e71 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.132916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a666429e-f436-4448-9791-fdf92e796e71 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.133415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a666429e-f436-4448-9791-fdf92e796e71 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.135513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a666429e-f436-4448-9791-fdf92e796e71 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.136960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.138248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.138920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.174675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lazy-loading 'flavor' on Instance uuid 0bc1822e-4a9a-4bf2-8e57-f8875039c620 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:46:47.198755 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8460f392-4c18-4800-bd50-f724df470fc5 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "PUT /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags/tempest-tag-517155278" status: 201 len: 0 microversion: 2.26 time: 0.137876 Oct 24 10:46:47.199688 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2341/4732] 10.222.0.50 () {62 vars in 1377 bytes} [Mon Oct 24 10:46:47 2022] PUT /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags/tempest-tag-517155278 => generated 0 bytes in 140 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 24 10:46:47.214861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ba9048f7-2225-463f-a9b2-093fa623f0ee tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Action: 'update_all', calling method: .version_select at 0x7f04d0bba940>, body: {"tags": ["tempest-tag-1019505527", "tempest-tag-1752924106"]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:47.224479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:47.231942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba9048f7-2225-463f-a9b2-093fa623f0ee tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.232437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba9048f7-2225-463f-a9b2-093fa623f0ee tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.233043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba9048f7-2225-463f-a9b2-093fa623f0ee tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.233922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ba9048f7-2225-463f-a9b2-093fa623f0ee tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:47.241826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba9048f7-2225-463f-a9b2-093fa623f0ee tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.243509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba9048f7-2225-463f-a9b2-093fa623f0ee tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.244950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba9048f7-2225-463f-a9b2-093fa623f0ee tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.245813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba9048f7-2225-463f-a9b2-093fa623f0ee tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.246318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba9048f7-2225-463f-a9b2-093fa623f0ee tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.246760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba9048f7-2225-463f-a9b2-093fa623f0ee tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.284858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba9048f7-2225-463f-a9b2-093fa623f0ee tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.285357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba9048f7-2225-463f-a9b2-093fa623f0ee tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.285862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba9048f7-2225-463f-a9b2-093fa623f0ee tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.319961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-ba9048f7-2225-463f-a9b2-093fa623f0ee tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lazy-loading 'flavor' on Instance uuid 0bc1822e-4a9a-4bf2-8e57-f8875039c620 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:46:47.344274 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ba9048f7-2225-463f-a9b2-093fa623f0ee tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "PUT /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags" status: 200 len: 62 microversion: 2.26 time: 0.137491 Oct 24 10:46:47.345213 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2342/4733] 10.222.0.50 () {62 vars in 1312 bytes} [Mon Oct 24 10:46:47 2022] PUT /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags => generated 62 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:47.355820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a12d3848-bd77-468b-ada9-53b8d91cd9d2 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '.version_select at 0x7f04d0bd4af0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:47.366135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a12d3848-bd77-468b-ada9-53b8d91cd9d2 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.366685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a12d3848-bd77-468b-ada9-53b8d91cd9d2 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.367131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a12d3848-bd77-468b-ada9-53b8d91cd9d2 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.381539 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a12d3848-bd77-468b-ada9-53b8d91cd9d2 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags" status: 200 len: 62 microversion: 2.26 time: 0.029910 Oct 24 10:46:47.389531 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2343/4734] 10.222.0.50 () {60 vars in 1292 bytes} [Mon Oct 24 10:46:47 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags => generated 62 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:47.397115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-92172526-e6c0-4158-b142-35e765b2f2f8 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '.version_select at 0x7f04d02548b0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:47.412305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92172526-e6c0-4158-b142-35e765b2f2f8 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.413040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92172526-e6c0-4158-b142-35e765b2f2f8 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.413631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92172526-e6c0-4158-b142-35e765b2f2f8 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.414124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-92172526-e6c0-4158-b142-35e765b2f2f8 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:47.417298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a666429e-f436-4448-9791-fdf92e796e71 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:47.420938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92172526-e6c0-4158-b142-35e765b2f2f8 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.421437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92172526-e6c0-4158-b142-35e765b2f2f8 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.422005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92172526-e6c0-4158-b142-35e765b2f2f8 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.422704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92172526-e6c0-4158-b142-35e765b2f2f8 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.423160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92172526-e6c0-4158-b142-35e765b2f2f8 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.423597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92172526-e6c0-4158-b142-35e765b2f2f8 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.430618 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a666429e-f436-4448-9791-fdf92e796e71 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101" status: 200 len: 1317 microversion: 2.1 time: 0.327957 Oct 24 10:46:47.431186 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2392/4735] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:47 2022] GET /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:47.451895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92172526-e6c0-4158-b142-35e765b2f2f8 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.452320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92172526-e6c0-4158-b142-35e765b2f2f8 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.453572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92172526-e6c0-4158-b142-35e765b2f2f8 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.472702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-92172526-e6c0-4158-b142-35e765b2f2f8 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lazy-loading 'flavor' on Instance uuid 0bc1822e-4a9a-4bf2-8e57-f8875039c620 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:46:47.490220 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-92172526-e6c0-4158-b142-35e765b2f2f8 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags" status: 204 len: 0 microversion: 2.26 time: 0.099492 Oct 24 10:46:47.492440 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2344/4736] 10.222.0.50 () {60 vars in 1295 bytes} [Mon Oct 24 10:46:47 2022] DELETE /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620/tags => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:46:47.509729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a2da3245-2b70-485c-b00d-dadd93b96070 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:47.510869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a2da3245-2b70-485c-b00d-dadd93b96070 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:47.519560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2da3245-2b70-485c-b00d-dadd93b96070 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.520264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2da3245-2b70-485c-b00d-dadd93b96070 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.521032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2da3245-2b70-485c-b00d-dadd93b96070 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.522165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2da3245-2b70-485c-b00d-dadd93b96070 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.522966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2da3245-2b70-485c-b00d-dadd93b96070 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.523549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2da3245-2b70-485c-b00d-dadd93b96070 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.557230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a2da3245-2b70-485c-b00d-dadd93b96070 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:46:47.586513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cb75cf9b-aa1a-4491-974c-4a5290911a04 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:47.587699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cb75cf9b-aa1a-4491-974c-4a5290911a04 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:47.596792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb75cf9b-aa1a-4491-974c-4a5290911a04 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.600268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb75cf9b-aa1a-4491-974c-4a5290911a04 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.601330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb75cf9b-aa1a-4491-974c-4a5290911a04 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.602476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb75cf9b-aa1a-4491-974c-4a5290911a04 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.603153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb75cf9b-aa1a-4491-974c-4a5290911a04 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.603790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb75cf9b-aa1a-4491-974c-4a5290911a04 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.648491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:47.667845 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a2da3245-2b70-485c-b00d-dadd93b96070 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 204 len: 0 microversion: 2.26 time: 0.161632 Oct 24 10:46:47.670703 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2393/4737] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:46:47 2022] DELETE /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:46:47.676878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1a09713b-2fb6-4080-8988-07b689fe9d38 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:47.677631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1a09713b-2fb6-4080-8988-07b689fe9d38 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:47.683764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a09713b-2fb6-4080-8988-07b689fe9d38 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.684261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a09713b-2fb6-4080-8988-07b689fe9d38 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.684700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a09713b-2fb6-4080-8988-07b689fe9d38 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.685436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a09713b-2fb6-4080-8988-07b689fe9d38 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.685889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a09713b-2fb6-4080-8988-07b689fe9d38 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.686314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a09713b-2fb6-4080-8988-07b689fe9d38 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.862318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cb75cf9b-aa1a-4491-974c-4a5290911a04 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:47.877895 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cb75cf9b-aa1a-4491-974c-4a5290911a04 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1317 microversion: 2.1 time: 0.295897 Oct 24 10:46:47.878621 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2345/4738] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:47 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:47.912046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-32589484-f289-49c8-9a80-088480cb60e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:47.913060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-32589484-f289-49c8-9a80-088480cb60e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:47.915058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1a09713b-2fb6-4080-8988-07b689fe9d38 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:47.929563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1a09713b-2fb6-4080-8988-07b689fe9d38 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:47.932193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1a09713b-2fb6-4080-8988-07b689fe9d38 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:47.933649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32589484-f289-49c8-9a80-088480cb60e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.934272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32589484-f289-49c8-9a80-088480cb60e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.934922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32589484-f289-49c8-9a80-088480cb60e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:47.935671 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1a09713b-2fb6-4080-8988-07b689fe9d38 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1552 microversion: 2.26 time: 0.263490 Oct 24 10:46:47.935814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32589484-f289-49c8-9a80-088480cb60e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:47.936873 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2394/4739] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:47 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1552 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:47.937339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32589484-f289-49c8-9a80-088480cb60e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:47.938014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32589484-f289-49c8-9a80-088480cb60e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:48.034800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-32589484-f289-49c8-9a80-088480cb60e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:48.046174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-32589484-f289-49c8-9a80-088480cb60e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:48.049718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-32589484-f289-49c8-9a80-088480cb60e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:48.052381 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-32589484-f289-49c8-9a80-088480cb60e3 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1338 microversion: 2.20 time: 0.152591 Oct 24 10:46:48.053600 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2346/4740] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:47 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1338 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:48.086070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8f7af159-c2b5-4d83-a038-02e9ac6fcc86 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:48.087492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8f7af159-c2b5-4d83-a038-02e9ac6fcc86 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:48.096320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f7af159-c2b5-4d83-a038-02e9ac6fcc86 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:48.097483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f7af159-c2b5-4d83-a038-02e9ac6fcc86 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:48.097483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f7af159-c2b5-4d83-a038-02e9ac6fcc86 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:48.098000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f7af159-c2b5-4d83-a038-02e9ac6fcc86 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:48.098465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f7af159-c2b5-4d83-a038-02e9ac6fcc86 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:48.098899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f7af159-c2b5-4d83-a038-02e9ac6fcc86 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:48.261589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8f7af159-c2b5-4d83-a038-02e9ac6fcc86 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:48.270136 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8f7af159-c2b5-4d83-a038-02e9ac6fcc86 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.190112 Oct 24 10:46:48.272887 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2395/4741] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:48 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:48.457187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-03108120-fc0a-485a-8317-f81b2e0de1bd tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:48.458413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-03108120-fc0a-485a-8317-f81b2e0de1bd tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e35dae0d-896b-405b-a5a9-a9c951b30101] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:48.464591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03108120-fc0a-485a-8317-f81b2e0de1bd tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:48.465110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03108120-fc0a-485a-8317-f81b2e0de1bd tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:48.465552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03108120-fc0a-485a-8317-f81b2e0de1bd tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:48.466252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03108120-fc0a-485a-8317-f81b2e0de1bd tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:48.466701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03108120-fc0a-485a-8317-f81b2e0de1bd tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:48.467345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03108120-fc0a-485a-8317-f81b2e0de1bd tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:48.650618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-03108120-fc0a-485a-8317-f81b2e0de1bd tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:48.663313 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-03108120-fc0a-485a-8317-f81b2e0de1bd tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101" status: 200 len: 1317 microversion: 2.1 time: 0.208709 Oct 24 10:46:48.664867 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2347/4742] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:48 2022] GET /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:48.800825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-cf6d84ad-cac2-41c6-874f-2a621ef1b2e4 req-9553d403-325b-49da-8fa0-cae67db554db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "tag": "fb2020ef-e5e3-481a-baca-ee8ad6e8058a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:48.829157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cf6d84ad-cac2-41c6-874f-2a621ef1b2e4 req-9553d403-325b-49da-8fa0-cae67db554db service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:48.836746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cf6d84ad-cac2-41c6-874f-2a621ef1b2e4 req-9553d403-325b-49da-8fa0-cae67db554db service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:48.837479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cf6d84ad-cac2-41c6-874f-2a621ef1b2e4 req-9553d403-325b-49da-8fa0-cae67db554db service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:48.897006 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-cf6d84ad-cac2-41c6-874f-2a621ef1b2e4 req-9553d403-325b-49da-8fa0-cae67db554db service nova] Creating event network-changed:fb2020ef-e5e3-481a-baca-ee8ad6e8058a for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:46:48.911412 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-cf6d84ad-cac2-41c6-874f-2a621ef1b2e4 req-9553d403-325b-49da-8fa0-cae67db554db service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114380 Oct 24 10:46:48.911699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e41bd1ac-865d-4596-8229-98756f0fe76d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:48.912229 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2396/4743] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:48.921901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e41bd1ac-865d-4596-8229-98756f0fe76d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:48.942285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e41bd1ac-865d-4596-8229-98756f0fe76d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:48.943031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e41bd1ac-865d-4596-8229-98756f0fe76d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:48.944519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e41bd1ac-865d-4596-8229-98756f0fe76d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:48.945542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e41bd1ac-865d-4596-8229-98756f0fe76d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:48.953052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e41bd1ac-865d-4596-8229-98756f0fe76d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:48.954251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e41bd1ac-865d-4596-8229-98756f0fe76d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:48.978356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dd11fa23-bed1-42e0-9c93-c44d96cd5439 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:48.979429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dd11fa23-bed1-42e0-9c93-c44d96cd5439 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:48.996937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd11fa23-bed1-42e0-9c93-c44d96cd5439 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:48.997436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd11fa23-bed1-42e0-9c93-c44d96cd5439 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:48.997876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd11fa23-bed1-42e0-9c93-c44d96cd5439 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:48.998592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd11fa23-bed1-42e0-9c93-c44d96cd5439 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:48.999048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd11fa23-bed1-42e0-9c93-c44d96cd5439 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:48.999477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd11fa23-bed1-42e0-9c93-c44d96cd5439 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:49.251544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e41bd1ac-865d-4596-8229-98756f0fe76d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:49.271414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dd11fa23-bed1-42e0-9c93-c44d96cd5439 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:49.273131 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e41bd1ac-865d-4596-8229-98756f0fe76d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1317 microversion: 2.1 time: 0.374190 Oct 24 10:46:49.278519 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2348/4744] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:48 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:49.290266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6c665c55-3029-4306-86ee-142bd45f1b91 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:49.293379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6c665c55-3029-4306-86ee-142bd45f1b91 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:49.298813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dd11fa23-bed1-42e0-9c93-c44d96cd5439 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:49.300557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dd11fa23-bed1-42e0-9c93-c44d96cd5439 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:49.302035 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dd11fa23-bed1-42e0-9c93-c44d96cd5439 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1552 microversion: 2.26 time: 0.341347 Oct 24 10:46:49.309141 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2397/4745] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:48 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1552 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:49.323884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c665c55-3029-4306-86ee-142bd45f1b91 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:49.324317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c665c55-3029-4306-86ee-142bd45f1b91 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:49.324770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c665c55-3029-4306-86ee-142bd45f1b91 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:49.327408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c665c55-3029-4306-86ee-142bd45f1b91 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:49.327933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c665c55-3029-4306-86ee-142bd45f1b91 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:49.328388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c665c55-3029-4306-86ee-142bd45f1b91 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:49.335959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-00023489-4eb5-4834-b648-bdb59db46951 req-d46ba192-0e6a-4a4e-a89e-3122614b7f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0272c314-d0fe-44d3-8f8c-b475beff2cd1", "name": "network-vif-plugged", "status": "completed", "tag": "ddf33fbf-e51d-445c-be66-c7f9b44e3d6c"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:49.354243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-00023489-4eb5-4834-b648-bdb59db46951 req-d46ba192-0e6a-4a4e-a89e-3122614b7f01 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:49.354908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-00023489-4eb5-4834-b648-bdb59db46951 req-d46ba192-0e6a-4a4e-a89e-3122614b7f01 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:49.355140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-00023489-4eb5-4834-b648-bdb59db46951 req-d46ba192-0e6a-4a4e-a89e-3122614b7f01 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:49.377062 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-00023489-4eb5-4834-b648-bdb59db46951 req-d46ba192-0e6a-4a4e-a89e-3122614b7f01 service nova] Creating event network-vif-plugged:ddf33fbf-e51d-445c-be66-c7f9b44e3d6c for instance 0272c314-d0fe-44d3-8f8c-b475beff2cd1 on n-h1-858383-15 Oct 24 10:46:49.382527 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-00023489-4eb5-4834-b648-bdb59db46951 req-d46ba192-0e6a-4a4e-a89e-3122614b7f01 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071765 Oct 24 10:46:49.383673 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2398/4746] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:49.394201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-19eed6ca-cc6b-428c-931f-0b0ea7f9f31b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:49.395112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-19eed6ca-cc6b-428c-931f-0b0ea7f9f31b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:49.401617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19eed6ca-cc6b-428c-931f-0b0ea7f9f31b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:49.402145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19eed6ca-cc6b-428c-931f-0b0ea7f9f31b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:49.402590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19eed6ca-cc6b-428c-931f-0b0ea7f9f31b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:49.403401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19eed6ca-cc6b-428c-931f-0b0ea7f9f31b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:49.403735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19eed6ca-cc6b-428c-931f-0b0ea7f9f31b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:49.404339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19eed6ca-cc6b-428c-931f-0b0ea7f9f31b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:49.581376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6c665c55-3029-4306-86ee-142bd45f1b91 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:49.593266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6c665c55-3029-4306-86ee-142bd45f1b91 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:49.595485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6c665c55-3029-4306-86ee-142bd45f1b91 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:49.596625 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6c665c55-3029-4306-86ee-142bd45f1b91 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1405 microversion: 2.20 time: 0.316913 Oct 24 10:46:49.597449 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2349/4747] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:49 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1405 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:49.646270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-19eed6ca-cc6b-428c-931f-0b0ea7f9f31b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:49.655223 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-19eed6ca-cc6b-428c-931f-0b0ea7f9f31b tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.270175 Oct 24 10:46:49.656993 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2399/4748] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:49 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:49.689943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-75207e3f-8eef-4774-a2c0-52e7c10dc7ca tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:49.690929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-75207e3f-8eef-4774-a2c0-52e7c10dc7ca tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e35dae0d-896b-405b-a5a9-a9c951b30101] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:49.698834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75207e3f-8eef-4774-a2c0-52e7c10dc7ca tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:49.700106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75207e3f-8eef-4774-a2c0-52e7c10dc7ca tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:49.700710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75207e3f-8eef-4774-a2c0-52e7c10dc7ca tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:49.701628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75207e3f-8eef-4774-a2c0-52e7c10dc7ca tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:49.702359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75207e3f-8eef-4774-a2c0-52e7c10dc7ca tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:49.703014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75207e3f-8eef-4774-a2c0-52e7c10dc7ca tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:49.976449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-75207e3f-8eef-4774-a2c0-52e7c10dc7ca tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:49.986989 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-75207e3f-8eef-4774-a2c0-52e7c10dc7ca tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101" status: 200 len: 1317 microversion: 2.1 time: 0.303333 Oct 24 10:46:49.990949 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2350/4749] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:49 2022] GET /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101 => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:50.304195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d396e506-66ef-48a8-ab56-008051d6de8c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:50.305479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d396e506-66ef-48a8-ab56-008051d6de8c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:50.314984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d396e506-66ef-48a8-ab56-008051d6de8c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:50.315717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d396e506-66ef-48a8-ab56-008051d6de8c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:50.316438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d396e506-66ef-48a8-ab56-008051d6de8c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:50.317358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d396e506-66ef-48a8-ab56-008051d6de8c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:50.317976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d396e506-66ef-48a8-ab56-008051d6de8c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:50.318564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d396e506-66ef-48a8-ab56-008051d6de8c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:50.336730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-613b2b97-90d7-4542-8ff6-75ce5fcae55f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:50.337676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-613b2b97-90d7-4542-8ff6-75ce5fcae55f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:50.351901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-613b2b97-90d7-4542-8ff6-75ce5fcae55f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:50.352780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-613b2b97-90d7-4542-8ff6-75ce5fcae55f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:50.353432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-613b2b97-90d7-4542-8ff6-75ce5fcae55f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:50.354344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-613b2b97-90d7-4542-8ff6-75ce5fcae55f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:50.355016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-613b2b97-90d7-4542-8ff6-75ce5fcae55f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:50.355757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-613b2b97-90d7-4542-8ff6-75ce5fcae55f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:50.391652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=1,nova_cell1:UPDATE=2,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:50.606668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d396e506-66ef-48a8-ab56-008051d6de8c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:50.619949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-613b2b97-90d7-4542-8ff6-75ce5fcae55f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:50.623895 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d396e506-66ef-48a8-ab56-008051d6de8c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1317 microversion: 2.1 time: 0.315579 Oct 24 10:46:50.628895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-613b2b97-90d7-4542-8ff6-75ce5fcae55f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:50.630425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-613b2b97-90d7-4542-8ff6-75ce5fcae55f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:50.632000 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-613b2b97-90d7-4542-8ff6-75ce5fcae55f tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1552 microversion: 2.26 time: 0.299910 Oct 24 10:46:50.632708 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2351/4750] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:50 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1552 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:50.638855 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2400/4751] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:50 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:50.653599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2d2f37c3-606b-4901-8914-17f1613e7b86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:50.654528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2d2f37c3-606b-4901-8914-17f1613e7b86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:50.662103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d2f37c3-606b-4901-8914-17f1613e7b86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:50.662601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d2f37c3-606b-4901-8914-17f1613e7b86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:50.663043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d2f37c3-606b-4901-8914-17f1613e7b86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:50.663828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d2f37c3-606b-4901-8914-17f1613e7b86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:50.664480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d2f37c3-606b-4901-8914-17f1613e7b86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:50.664968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d2f37c3-606b-4901-8914-17f1613e7b86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:50.681709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-321578a0-ddda-4b61-9030-f0a50206d2ac tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:50.682680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-321578a0-ddda-4b61-9030-f0a50206d2ac tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:50.690458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:50.690692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-321578a0-ddda-4b61-9030-f0a50206d2ac tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:50.691263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-321578a0-ddda-4b61-9030-f0a50206d2ac tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:50.691965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-321578a0-ddda-4b61-9030-f0a50206d2ac tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:50.693155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-321578a0-ddda-4b61-9030-f0a50206d2ac tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:50.693769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-321578a0-ddda-4b61-9030-f0a50206d2ac tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:50.694417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-321578a0-ddda-4b61-9030-f0a50206d2ac tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:50.897837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2d2f37c3-606b-4901-8914-17f1613e7b86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:50.913064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2d2f37c3-606b-4901-8914-17f1613e7b86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:50.914840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2d2f37c3-606b-4901-8914-17f1613e7b86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:50.918710 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2d2f37c3-606b-4901-8914-17f1613e7b86 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1405 microversion: 2.20 time: 0.284864 Oct 24 10:46:50.921169 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2352/4752] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:50 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1405 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:50.941703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-321578a0-ddda-4b61-9030-f0a50206d2ac tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:50.950041 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-321578a0-ddda-4b61-9030-f0a50206d2ac tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.272977 Oct 24 10:46:50.950622 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2401/4753] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:50 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:50.996662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d114b4b9-fb4e-460c-82ac-975e6f7c2bb3 req-de213b10-b7b9-40a4-8d97-47aa3aa5573d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e357ce41-0ae9-4efa-973b-bc8920e4a0fa", "tag": "ddf713d1-ef02-4308-b6ce-8ec89af0574f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:51.008162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d114b4b9-fb4e-460c-82ac-975e6f7c2bb3 req-de213b10-b7b9-40a4-8d97-47aa3aa5573d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:51.017155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b71f30cf-2a98-4629-8d27-15f97a863542 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:51.017891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b71f30cf-2a98-4629-8d27-15f97a863542 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e35dae0d-896b-405b-a5a9-a9c951b30101] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:51.019136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d114b4b9-fb4e-460c-82ac-975e6f7c2bb3 req-de213b10-b7b9-40a4-8d97-47aa3aa5573d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:51.019807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d114b4b9-fb4e-460c-82ac-975e6f7c2bb3 req-de213b10-b7b9-40a4-8d97-47aa3aa5573d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:51.032712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b71f30cf-2a98-4629-8d27-15f97a863542 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:51.036101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b71f30cf-2a98-4629-8d27-15f97a863542 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:51.036827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b71f30cf-2a98-4629-8d27-15f97a863542 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:51.037818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b71f30cf-2a98-4629-8d27-15f97a863542 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:51.041302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b71f30cf-2a98-4629-8d27-15f97a863542 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:51.041845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b71f30cf-2a98-4629-8d27-15f97a863542 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:51.052134 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d114b4b9-fb4e-460c-82ac-975e6f7c2bb3 req-de213b10-b7b9-40a4-8d97-47aa3aa5573d service nova] Creating event network-changed:ddf713d1-ef02-4308-b6ce-8ec89af0574f for instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa on n-h2-858383-15 Oct 24 10:46:51.064730 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d114b4b9-fb4e-460c-82ac-975e6f7c2bb3 req-de213b10-b7b9-40a4-8d97-47aa3aa5573d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071594 Oct 24 10:46:51.066364 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2353/4754] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:46:51.212824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b71f30cf-2a98-4629-8d27-15f97a863542 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:51.222220 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b71f30cf-2a98-4629-8d27-15f97a863542 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101" status: 200 len: 1505 microversion: 2.1 time: 0.210828 Oct 24 10:46:51.223040 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2402/4755] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:51 2022] GET /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101 => generated 1505 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:51.249546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b95ee829-226c-4cf0-a8e7-8d8a2429dea0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:51.251058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b95ee829-226c-4cf0-a8e7-8d8a2429dea0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e35dae0d-896b-405b-a5a9-a9c951b30101] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:51.259038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b95ee829-226c-4cf0-a8e7-8d8a2429dea0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:51.259650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b95ee829-226c-4cf0-a8e7-8d8a2429dea0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:51.260871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b95ee829-226c-4cf0-a8e7-8d8a2429dea0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:51.261368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b95ee829-226c-4cf0-a8e7-8d8a2429dea0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:51.262377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b95ee829-226c-4cf0-a8e7-8d8a2429dea0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:51.262910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b95ee829-226c-4cf0-a8e7-8d8a2429dea0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:51.295761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b95ee829-226c-4cf0-a8e7-8d8a2429dea0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e35dae0d-896b-405b-a5a9-a9c951b30101] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:46:51.424620 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b95ee829-226c-4cf0-a8e7-8d8a2429dea0 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101" status: 204 len: 0 microversion: 2.1 time: 0.179600 Oct 24 10:46:51.425552 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2354/4756] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:46:51 2022] DELETE /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:46:51.433888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e7bd2386-d83a-4aed-a9f9-6b2307f89694 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:51.434415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e7bd2386-d83a-4aed-a9f9-6b2307f89694 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:51.442698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7bd2386-d83a-4aed-a9f9-6b2307f89694 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:51.443416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7bd2386-d83a-4aed-a9f9-6b2307f89694 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:51.443866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7bd2386-d83a-4aed-a9f9-6b2307f89694 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:51.444581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7bd2386-d83a-4aed-a9f9-6b2307f89694 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:51.445060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7bd2386-d83a-4aed-a9f9-6b2307f89694 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:51.446339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7bd2386-d83a-4aed-a9f9-6b2307f89694 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:51.480462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e7bd2386-d83a-4aed-a9f9-6b2307f89694 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:46:51.610146 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e7bd2386-d83a-4aed-a9f9-6b2307f89694 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee" status: 204 len: 0 microversion: 2.1 time: 0.178373 Oct 24 10:46:51.615255 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2403/4757] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:46:51 2022] DELETE /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:46:51.624632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-904bcb3f-2750-49f7-aff3-4ff8bc8c3f4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:51.625963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-904bcb3f-2750-49f7-aff3-4ff8bc8c3f4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e35dae0d-896b-405b-a5a9-a9c951b30101] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:51.639747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-904bcb3f-2750-49f7-aff3-4ff8bc8c3f4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:51.640869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-904bcb3f-2750-49f7-aff3-4ff8bc8c3f4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:51.641510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-904bcb3f-2750-49f7-aff3-4ff8bc8c3f4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:51.643672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-904bcb3f-2750-49f7-aff3-4ff8bc8c3f4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:51.644361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-904bcb3f-2750-49f7-aff3-4ff8bc8c3f4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:51.646208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-904bcb3f-2750-49f7-aff3-4ff8bc8c3f4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:51.660684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2f8e6766-26b1-4f73-bca3-d0666569dc4a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:51.661363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2f8e6766-26b1-4f73-bca3-d0666569dc4a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:51.673941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f8e6766-26b1-4f73-bca3-d0666569dc4a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:51.676638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f8e6766-26b1-4f73-bca3-d0666569dc4a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:51.677321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f8e6766-26b1-4f73-bca3-d0666569dc4a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:51.680034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f8e6766-26b1-4f73-bca3-d0666569dc4a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:51.680737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f8e6766-26b1-4f73-bca3-d0666569dc4a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:51.682423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f8e6766-26b1-4f73-bca3-d0666569dc4a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:51.873393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-904bcb3f-2750-49f7-aff3-4ff8bc8c3f4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:51.885513 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-904bcb3f-2750-49f7-aff3-4ff8bc8c3f4b tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101" status: 200 len: 1511 microversion: 2.1 time: 0.268539 Oct 24 10:46:51.886242 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2355/4758] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:51 2022] GET /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101 => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:51.886366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2f8e6766-26b1-4f73-bca3-d0666569dc4a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:51.891969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1007fa1f-f7c3-480c-af98-0359591d24f2 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:51.892993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1007fa1f-f7c3-480c-af98-0359591d24f2 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:51.897651 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2f8e6766-26b1-4f73-bca3-d0666569dc4a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1506 microversion: 2.1 time: 0.244556 Oct 24 10:46:51.898460 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2404/4759] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:51 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:51.899375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1007fa1f-f7c3-480c-af98-0359591d24f2 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:51.899949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1007fa1f-f7c3-480c-af98-0359591d24f2 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:51.900656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1007fa1f-f7c3-480c-af98-0359591d24f2 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:51.901446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1007fa1f-f7c3-480c-af98-0359591d24f2 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:51.901982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1007fa1f-f7c3-480c-af98-0359591d24f2 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:51.902493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1007fa1f-f7c3-480c-af98-0359591d24f2 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:51.920647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4f54d0f9-ad99-49c6-99cf-b76537fa6b3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:51.921340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4f54d0f9-ad99-49c6-99cf-b76537fa6b3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:51.928638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f54d0f9-ad99-49c6-99cf-b76537fa6b3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:51.929245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f54d0f9-ad99-49c6-99cf-b76537fa6b3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:51.929912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f54d0f9-ad99-49c6-99cf-b76537fa6b3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:51.930692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f54d0f9-ad99-49c6-99cf-b76537fa6b3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:51.931383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f54d0f9-ad99-49c6-99cf-b76537fa6b3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:51.931891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f54d0f9-ad99-49c6-99cf-b76537fa6b3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:51.978770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1007fa1f-f7c3-480c-af98-0359591d24f2 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:52.006108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1007fa1f-f7c3-480c-af98-0359591d24f2 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:52.009035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1007fa1f-f7c3-480c-af98-0359591d24f2 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:52.012780 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1007fa1f-f7c3-480c-af98-0359591d24f2 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1510 microversion: 2.26 time: 0.125169 Oct 24 10:46:52.015044 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2356/4760] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:51 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1510 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:52.020214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2bfde1b1-f959-46f9-95ab-7f581f3a5805 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:52.021257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2bfde1b1-f959-46f9-95ab-7f581f3a5805 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:52.034450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bfde1b1-f959-46f9-95ab-7f581f3a5805 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:52.037682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bfde1b1-f959-46f9-95ab-7f581f3a5805 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:52.038140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bfde1b1-f959-46f9-95ab-7f581f3a5805 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:52.038893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bfde1b1-f959-46f9-95ab-7f581f3a5805 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:52.039361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bfde1b1-f959-46f9-95ab-7f581f3a5805 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:52.039789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bfde1b1-f959-46f9-95ab-7f581f3a5805 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:52.165494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4f54d0f9-ad99-49c6-99cf-b76537fa6b3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:52.175268 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4f54d0f9-ad99-49c6-99cf-b76537fa6b3d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1506 microversion: 2.1 time: 0.258554 Oct 24 10:46:52.181612 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2405/4761] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:51 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:52.181612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3a9d5f3e-a0eb-4361-9f14-2c7607e86339 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:52.181612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3a9d5f3e-a0eb-4361-9f14-2c7607e86339 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:52.187500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a9d5f3e-a0eb-4361-9f14-2c7607e86339 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:52.187981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a9d5f3e-a0eb-4361-9f14-2c7607e86339 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:52.188414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a9d5f3e-a0eb-4361-9f14-2c7607e86339 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:52.189132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a9d5f3e-a0eb-4361-9f14-2c7607e86339 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:52.189583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a9d5f3e-a0eb-4361-9f14-2c7607e86339 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:52.190004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a9d5f3e-a0eb-4361-9f14-2c7607e86339 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:52.219569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2bfde1b1-f959-46f9-95ab-7f581f3a5805 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:52.228604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2bfde1b1-f959-46f9-95ab-7f581f3a5805 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:52.230186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2bfde1b1-f959-46f9-95ab-7f581f3a5805 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:52.231407 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2bfde1b1-f959-46f9-95ab-7f581f3a5805 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1405 microversion: 2.20 time: 0.215036 Oct 24 10:46:52.232249 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2357/4762] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:52 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:52.237325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c1767689-3435-4b09-8c74-806e08b5328a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:52.240008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c1767689-3435-4b09-8c74-806e08b5328a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:52.246397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1767689-3435-4b09-8c74-806e08b5328a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:52.246997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1767689-3435-4b09-8c74-806e08b5328a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:52.247650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1767689-3435-4b09-8c74-806e08b5328a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:52.248445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1767689-3435-4b09-8c74-806e08b5328a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:52.249018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1767689-3435-4b09-8c74-806e08b5328a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:52.249457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1767689-3435-4b09-8c74-806e08b5328a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:52.318754 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c1767689-3435-4b09-8c74-806e08b5328a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "PUT /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1078 microversion: 2.1 time: 0.085468 Oct 24 10:46:52.332860 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2358/4763] 10.222.0.50 () {60 vars in 1256 bytes} [Mon Oct 24 10:46:52 2022] PUT /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1078 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:52.336135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3a9d5f3e-a0eb-4361-9f14-2c7607e86339 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:52.340777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-95b6a6c5-edd7-4b80-b05c-37e5097af2c1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:52.341429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-95b6a6c5-edd7-4b80-b05c-37e5097af2c1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:52.345689 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3a9d5f3e-a0eb-4361-9f14-2c7607e86339 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.168589 Oct 24 10:46:52.346462 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2406/4764] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:52 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:52.348218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95b6a6c5-edd7-4b80-b05c-37e5097af2c1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:52.348713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95b6a6c5-edd7-4b80-b05c-37e5097af2c1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:52.349187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95b6a6c5-edd7-4b80-b05c-37e5097af2c1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:52.349899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95b6a6c5-edd7-4b80-b05c-37e5097af2c1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:52.350362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95b6a6c5-edd7-4b80-b05c-37e5097af2c1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:52.350795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95b6a6c5-edd7-4b80-b05c-37e5097af2c1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:52.487176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-95b6a6c5-edd7-4b80-b05c-37e5097af2c1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:52.495072 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-95b6a6c5-edd7-4b80-b05c-37e5097af2c1 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1504 microversion: 2.1 time: 0.158914 Oct 24 10:46:52.495627 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2359/4765] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:52 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:52.518188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-adb83175-c252-479d-a6db-92a553f8f32c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:52.518906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-adb83175-c252-479d-a6db-92a553f8f32c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:52.525926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adb83175-c252-479d-a6db-92a553f8f32c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:52.526484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adb83175-c252-479d-a6db-92a553f8f32c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:52.527130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adb83175-c252-479d-a6db-92a553f8f32c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:52.527832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adb83175-c252-479d-a6db-92a553f8f32c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:52.528287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adb83175-c252-479d-a6db-92a553f8f32c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:52.528710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adb83175-c252-479d-a6db-92a553f8f32c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:52.669629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-adb83175-c252-479d-a6db-92a553f8f32c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:52.679969 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-adb83175-c252-479d-a6db-92a553f8f32c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1504 microversion: 2.1 time: 0.166405 Oct 24 10:46:52.681146 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2407/4766] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:52 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:52.704173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:52.708027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:52.719662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:52.721637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:52.722197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:52.722985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:52.723652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:52.724145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:52.817176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:46:52.817628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:46:52.818110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:46:52.818516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:46:52.818908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:46:52.911198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-30804081-9b7c-4fcb-b8ad-259b4043ad7e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:52.911921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-30804081-9b7c-4fcb-b8ad-259b4043ad7e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e35dae0d-896b-405b-a5a9-a9c951b30101] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:52.920698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30804081-9b7c-4fcb-b8ad-259b4043ad7e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:52.922306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:52.923040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30804081-9b7c-4fcb-b8ad-259b4043ad7e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:52.923699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30804081-9b7c-4fcb-b8ad-259b4043ad7e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:52.925882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30804081-9b7c-4fcb-b8ad-259b4043ad7e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:52.926354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30804081-9b7c-4fcb-b8ad-259b4043ad7e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:52.926787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30804081-9b7c-4fcb-b8ad-259b4043ad7e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:52.936577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:52.937168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:52.937791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:52.938483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:52.938931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:52.939373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:52.977341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:52.994309 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-804cbf4a-b141-497f-967b-8f840b57111f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "POST /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1/action" status: 202 len: 1110 microversion: 2.1 time: 0.294392 Oct 24 10:46:53.010484 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2360/4767] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:46:52 2022] POST /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1/action => generated 1110 bytes in 311 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 24 10:46:53.026565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-66a70aad-703b-4674-ac96-4b1abbf86281 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:53.027350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-66a70aad-703b-4674-ac96-4b1abbf86281 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:53.038727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=10 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:53.041864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66a70aad-703b-4674-ac96-4b1abbf86281 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:53.043314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66a70aad-703b-4674-ac96-4b1abbf86281 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:53.044146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66a70aad-703b-4674-ac96-4b1abbf86281 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:53.045115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66a70aad-703b-4674-ac96-4b1abbf86281 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:53.045829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66a70aad-703b-4674-ac96-4b1abbf86281 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:53.046518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66a70aad-703b-4674-ac96-4b1abbf86281 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:53.215835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-30804081-9b7c-4fcb-b8ad-259b4043ad7e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:53.236319 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-30804081-9b7c-4fcb-b8ad-259b4043ad7e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101" status: 200 len: 1511 microversion: 2.1 time: 0.328755 Oct 24 10:46:53.245382 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2408/4768] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:52 2022] GET /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101 => generated 1511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:46:53.245382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c394f296-9e39-45f1-822e-1070ff5ff9d0 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:53.245382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c394f296-9e39-45f1-822e-1070ff5ff9d0 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:53.257961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c394f296-9e39-45f1-822e-1070ff5ff9d0 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:53.259217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c394f296-9e39-45f1-822e-1070ff5ff9d0 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:53.261599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c394f296-9e39-45f1-822e-1070ff5ff9d0 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:53.262553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c394f296-9e39-45f1-822e-1070ff5ff9d0 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:53.263505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c394f296-9e39-45f1-822e-1070ff5ff9d0 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:53.263939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c394f296-9e39-45f1-822e-1070ff5ff9d0 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:53.310109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c394f296-9e39-45f1-822e-1070ff5ff9d0 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:53.310607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c394f296-9e39-45f1-822e-1070ff5ff9d0 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:53.311049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c394f296-9e39-45f1-822e-1070ff5ff9d0 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:53.311630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-c394f296-9e39-45f1-822e-1070ff5ff9d0 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lazy-loading 'fault' on Instance uuid 0bc1822e-4a9a-4bf2-8e57-f8875039c620 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:46:53.345314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-66a70aad-703b-4674-ac96-4b1abbf86281 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:53.354076 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-66a70aad-703b-4674-ac96-4b1abbf86281 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.341966 Oct 24 10:46:53.365649 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2361/4769] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:53 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:53.370703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-2326710a-42af-4150-a59a-db384914c036 req-fda3d14b-faf8-4162-8fca-c873b2df8e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc1822e-4a9a-4bf2-8e57-f8875039c620", "name": "network-vif-deleted", "tag": "c9986ef8-b1c4-471d-a593-ab2b20c4286a"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:53.381702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2326710a-42af-4150-a59a-db384914c036 req-fda3d14b-faf8-4162-8fca-c873b2df8e3e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:53.382189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2326710a-42af-4150-a59a-db384914c036 req-fda3d14b-faf8-4162-8fca-c873b2df8e3e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:53.382543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c394f296-9e39-45f1-822e-1070ff5ff9d0 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:53.382705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2326710a-42af-4150-a59a-db384914c036 req-fda3d14b-faf8-4162-8fca-c873b2df8e3e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:53.396569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c394f296-9e39-45f1-822e-1070ff5ff9d0 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:53.400598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c394f296-9e39-45f1-822e-1070ff5ff9d0 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e51a666b23af4082babf718206d6a01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e0b76a9bec4493b85d125ebafe1987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:53.404295 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c394f296-9e39-45f1-822e-1070ff5ff9d0 tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 200 len: 1352 microversion: 2.26 time: 0.166042 Oct 24 10:46:53.412903 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-2326710a-42af-4150-a59a-db384914c036 req-fda3d14b-faf8-4162-8fca-c873b2df8e3e service nova] Creating event network-vif-deleted:c9986ef8-b1c4-471d-a593-ab2b20c4286a for instance 0bc1822e-4a9a-4bf2-8e57-f8875039c620 on n-h1-858383-15 Oct 24 10:46:53.413120 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2409/4770] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:53 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 1352 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:53.427826 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-2326710a-42af-4150-a59a-db384914c036 req-fda3d14b-faf8-4162-8fca-c873b2df8e3e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054456 Oct 24 10:46:53.427826 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2362/4771] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:53.440531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5d51b972-afa6-471a-9935-41688ab18ff0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:53.441358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5d51b972-afa6-471a-9935-41688ab18ff0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:53.443928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-86cd4251-40c5-474a-b97a-c907185f062f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:53.444872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-86cd4251-40c5-474a-b97a-c907185f062f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:53.456292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d51b972-afa6-471a-9935-41688ab18ff0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:53.456292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d51b972-afa6-471a-9935-41688ab18ff0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:53.456292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d51b972-afa6-471a-9935-41688ab18ff0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:53.456292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d51b972-afa6-471a-9935-41688ab18ff0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:53.461572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d51b972-afa6-471a-9935-41688ab18ff0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:53.463417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5d51b972-afa6-471a-9935-41688ab18ff0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:53.464825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86cd4251-40c5-474a-b97a-c907185f062f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:53.465322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86cd4251-40c5-474a-b97a-c907185f062f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:53.465744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86cd4251-40c5-474a-b97a-c907185f062f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:53.466479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86cd4251-40c5-474a-b97a-c907185f062f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:53.466876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86cd4251-40c5-474a-b97a-c907185f062f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:53.467953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86cd4251-40c5-474a-b97a-c907185f062f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:53.675980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5d51b972-afa6-471a-9935-41688ab18ff0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:53.689608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5d51b972-afa6-471a-9935-41688ab18ff0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:53.691355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5d51b972-afa6-471a-9935-41688ab18ff0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:53.692779 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5d51b972-afa6-471a-9935-41688ab18ff0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1405 microversion: 2.20 time: 0.258328 Oct 24 10:46:53.693912 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2410/4772] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:53 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1405 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:53.723943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-86cd4251-40c5-474a-b97a-c907185f062f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:53.735233 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-86cd4251-40c5-474a-b97a-c907185f062f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.300352 Oct 24 10:46:53.751813 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2363/4773] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:53 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:54.272031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9ae9398e-afa6-471e-a3b2-ad9ac6038e3e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:54.273033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9ae9398e-afa6-471e-a3b2-ad9ac6038e3e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e35dae0d-896b-405b-a5a9-a9c951b30101] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:54.293227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ae9398e-afa6-471e-a3b2-ad9ac6038e3e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:54.297866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ae9398e-afa6-471e-a3b2-ad9ac6038e3e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:54.298425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ae9398e-afa6-471e-a3b2-ad9ac6038e3e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:54.299197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ae9398e-afa6-471e-a3b2-ad9ac6038e3e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:54.299879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ae9398e-afa6-471e-a3b2-ad9ac6038e3e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:54.300324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ae9398e-afa6-471e-a3b2-ad9ac6038e3e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:54.381649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10855e3d-e687-4c4b-94c0-448a888b1921 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:54.382381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-10855e3d-e687-4c4b-94c0-448a888b1921 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:54.400334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10855e3d-e687-4c4b-94c0-448a888b1921 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:54.404151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10855e3d-e687-4c4b-94c0-448a888b1921 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:54.404921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10855e3d-e687-4c4b-94c0-448a888b1921 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:54.407255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10855e3d-e687-4c4b-94c0-448a888b1921 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:54.410111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10855e3d-e687-4c4b-94c0-448a888b1921 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:54.410830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ae9398e-afa6-471e-a3b2-ad9ac6038e3e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:54.411411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ae9398e-afa6-471e-a3b2-ad9ac6038e3e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:54.411916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ae9398e-afa6-471e-a3b2-ad9ac6038e3e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:54.412303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10855e3d-e687-4c4b-94c0-448a888b1921 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:54.412442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-9ae9398e-afa6-471e-a3b2-ad9ac6038e3e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lazy-loading 'fault' on Instance uuid e35dae0d-896b-405b-a5a9-a9c951b30101 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:46:54.487238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9ae9398e-afa6-471e-a3b2-ad9ac6038e3e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:54.498174 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9ae9398e-afa6-471e-a3b2-ad9ac6038e3e tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101" status: 200 len: 1307 microversion: 2.1 time: 0.231045 Oct 24 10:46:54.513680 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2411/4774] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:54 2022] GET /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101 => generated 1307 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:54.521632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-619cae3e-c5fb-498f-8595-fd071654f7bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:54.522499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-619cae3e-c5fb-498f-8595-fd071654f7bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] [instance: 0bc1822e-4a9a-4bf2-8e57-f8875039c620] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:54.536062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-619cae3e-c5fb-498f-8595-fd071654f7bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:54.536888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-619cae3e-c5fb-498f-8595-fd071654f7bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:54.542259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-619cae3e-c5fb-498f-8595-fd071654f7bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:54.543518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-619cae3e-c5fb-498f-8595-fd071654f7bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:54.545370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-619cae3e-c5fb-498f-8595-fd071654f7bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:54.546201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-619cae3e-c5fb-498f-8595-fd071654f7bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:54.580604 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-619cae3e-c5fb-498f-8595-fd071654f7bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] HTTP exception thrown: Instance 0bc1822e-4a9a-4bf2-8e57-f8875039c620 could not be found. Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-619cae3e-c5fb-498f-8595-fd071654f7bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Request method failure captured: Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 HTTP/1.1 Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmz57gQOgin9NYWKjuHKxyrUV0ZJlF37gStJxBNneHm0B-fdAycRvRW5AJ7EAZAsljZdqcgUKka_K-O6cU8QY_8nk5xCyonteqe8r_AZcZkc-cQVbLdK6f10VOIYhcjVukJmqwN5Chh6_CWzbMEA9HAN4HYTeYu4fN8clzKL2dI8ffo Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-Openstack-Nova-Api-Version: 2.26 Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 62e0b76a9bec4493b85d125ebafe1987 Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerTagsTestJSON-554043993 Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/62e0b76a9bec4493b85d125ebafe1987"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/62e0b76a9bec4493b85d125ebafe1987"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/62e0b76a9bec4493b85d125ebafe1987"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_62e0b76a9bec4493b85d125ebafe1987", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerTagsTestJSON-554043993 Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 62e0b76a9bec4493b85d125ebafe1987 Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerTagsTestJSON-554043993 Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerTagsTestJSON-554043993-project Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: e51a666b23af4082babf718206d6a01e Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerTagsTestJSON-554043993-project Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 0bc1822e-4a9a-4bf2-8e57-f8875039c620 could not be found. Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '0bc1822e-4a9a-4bf2-8e57-f8875039c620'} Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bc1822e-4a9a-4bf2-8e57-f8875039c620 could not be found. Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bc1822e-4a9a-4bf2-8e57-f8875039c620 could not be found. Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:46:54.585652 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:46:54.589761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:46:54.589761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:46:54.589761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:46:54.589761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:46:54.589761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:46:54.589761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bc1822e-4a9a-4bf2-8e57-f8875039c620 could not be found. Oct 24 10:46:54.589761 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:46:54.591249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-619cae3e-c5fb-498f-8595-fd071654f7bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] Returning 404 to user: Instance 0bc1822e-4a9a-4bf2-8e57-f8875039c620 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:46:54.592123 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-619cae3e-c5fb-498f-8595-fd071654f7bd tempest-ServerTagsTestJSON-554043993 tempest-ServerTagsTestJSON-554043993-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620" status: 404 len: 111 microversion: 2.26 time: 0.076553 Oct 24 10:46:54.598280 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2412/4775] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:54 2022] GET /compute/v2.1/servers/0bc1822e-4a9a-4bf2-8e57-f8875039c620 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:46:54.723503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3d6a069c-32f3-4242-9c94-671c9ae9ea2c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:54.725441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3d6a069c-32f3-4242-9c94-671c9ae9ea2c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:54.739808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d6a069c-32f3-4242-9c94-671c9ae9ea2c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:54.740567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d6a069c-32f3-4242-9c94-671c9ae9ea2c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:54.742228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d6a069c-32f3-4242-9c94-671c9ae9ea2c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:54.745459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d6a069c-32f3-4242-9c94-671c9ae9ea2c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:54.746308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d6a069c-32f3-4242-9c94-671c9ae9ea2c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:54.747020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d6a069c-32f3-4242-9c94-671c9ae9ea2c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:54.938557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-10855e3d-e687-4c4b-94c0-448a888b1921 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:54.947848 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10855e3d-e687-4c4b-94c0-448a888b1921 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.570175 Oct 24 10:46:54.955473 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2364/4776] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:54 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:54.960600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-575cab6d-be3a-49cf-8f3e-fb4b4108c1a9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:54.967086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-575cab6d-be3a-49cf-8f3e-fb4b4108c1a9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:54.985844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-575cab6d-be3a-49cf-8f3e-fb4b4108c1a9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:54.988521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-575cab6d-be3a-49cf-8f3e-fb4b4108c1a9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:54.989201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-575cab6d-be3a-49cf-8f3e-fb4b4108c1a9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:54.990992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-575cab6d-be3a-49cf-8f3e-fb4b4108c1a9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:54.998238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-575cab6d-be3a-49cf-8f3e-fb4b4108c1a9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:54.998993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-575cab6d-be3a-49cf-8f3e-fb4b4108c1a9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:55.266290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3d6a069c-32f3-4242-9c94-671c9ae9ea2c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:55.290396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3d6a069c-32f3-4242-9c94-671c9ae9ea2c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:55.297069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3d6a069c-32f3-4242-9c94-671c9ae9ea2c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:55.302283 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3d6a069c-32f3-4242-9c94-671c9ae9ea2c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1405 microversion: 2.20 time: 0.583459 Oct 24 10:46:55.303155 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2413/4777] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:54 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1405 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:55.394367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-575cab6d-be3a-49cf-8f3e-fb4b4108c1a9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:55.408023 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-575cab6d-be3a-49cf-8f3e-fb4b4108c1a9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.447820 Oct 24 10:46:55.409056 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2365/4778] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:54 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:55.502942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-f658485e-7581-4a7f-9672-920564f8d595 req-210d53cf-4e01-4127-bb87-b74e0d2d5573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e35dae0d-896b-405b-a5a9-a9c951b30101", "name": "network-vif-deleted", "tag": "9c42b90d-d03c-4366-9ad1-55ce408b2567"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:55.526436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b915305f-c9b7-4aa7-9ebb-40e718d530df tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:55.527364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b915305f-c9b7-4aa7-9ebb-40e718d530df tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: e35dae0d-896b-405b-a5a9-a9c951b30101] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:55.545390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b915305f-c9b7-4aa7-9ebb-40e718d530df tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:55.546095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b915305f-c9b7-4aa7-9ebb-40e718d530df tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:55.549694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b915305f-c9b7-4aa7-9ebb-40e718d530df tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:55.549851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f658485e-7581-4a7f-9672-920564f8d595 req-210d53cf-4e01-4127-bb87-b74e0d2d5573 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:55.551833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b915305f-c9b7-4aa7-9ebb-40e718d530df tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:55.552246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f658485e-7581-4a7f-9672-920564f8d595 req-210d53cf-4e01-4127-bb87-b74e0d2d5573 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:55.552871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f658485e-7581-4a7f-9672-920564f8d595 req-210d53cf-4e01-4127-bb87-b74e0d2d5573 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:55.553512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b915305f-c9b7-4aa7-9ebb-40e718d530df tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:55.559009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b915305f-c9b7-4aa7-9ebb-40e718d530df tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:55.574155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:55.582909 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f658485e-7581-4a7f-9672-920564f8d595 req-210d53cf-4e01-4127-bb87-b74e0d2d5573 service nova] Creating event network-vif-deleted:9c42b90d-d03c-4366-9ad1-55ce408b2567 for instance e35dae0d-896b-405b-a5a9-a9c951b30101 on n-h1-858383-15 Oct 24 10:46:55.590072 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-b915305f-c9b7-4aa7-9ebb-40e718d530df tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] HTTP exception thrown: Instance e35dae0d-896b-405b-a5a9-a9c951b30101 could not be found. Oct 24 10:46:55.596799 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-f658485e-7581-4a7f-9672-920564f8d595 req-210d53cf-4e01-4127-bb87-b74e0d2d5573 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104260 Oct 24 10:46:55.597853 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2414/4779] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b915305f-c9b7-4aa7-9ebb-40e718d530df tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Request method failure captured: Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101 HTTP/1.1 Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmzlGchWcqg-B7BpD4aWaBPkw56EOnow0msGtoXJgh8HijHi4yLVHh0pwiNiGNXJRUAHFakGdOIK7LM1hnpxWD1T-QoJJegyrQ_rCs23ILqW74R_-hz3NG5-yo71GpJO09JC23bJf1xjfZ0q7H_d28qkdT2FoBu-J6amEupFj1vLulg Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 51b48ea9adbe4711a3043add98c14ddb Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-MultipleCreateTestJSON-1288788662 Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/51b48ea9adbe4711a3043add98c14ddb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/51b48ea9adbe4711a3043add98c14ddb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/51b48ea9adbe4711a3043add98c14ddb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_51b48ea9adbe4711a3043add98c14ddb", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-MultipleCreateTestJSON-1288788662 Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 51b48ea9adbe4711a3043add98c14ddb Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1288788662 Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-MultipleCreateTestJSON-1288788662-project Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 9e32135e900a4b92b6fd23f458ba1d9d Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-MultipleCreateTestJSON-1288788662-project Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance e35dae0d-896b-405b-a5a9-a9c951b30101 could not be found. Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'e35dae0d-896b-405b-a5a9-a9c951b30101'} Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e35dae0d-896b-405b-a5a9-a9c951b30101 could not be found. Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e35dae0d-896b-405b-a5a9-a9c951b30101 could not be found. Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:46:55.598398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:46:55.602557 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:46:55.602557 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:46:55.602557 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:46:55.602557 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:46:55.602557 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:46:55.602557 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e35dae0d-896b-405b-a5a9-a9c951b30101 could not be found. Oct 24 10:46:55.602557 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:46:55.604015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b915305f-c9b7-4aa7-9ebb-40e718d530df tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Returning 404 to user: Instance e35dae0d-896b-405b-a5a9-a9c951b30101 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:46:55.605073 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b915305f-c9b7-4aa7-9ebb-40e718d530df tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101" status: 404 len: 111 microversion: 2.1 time: 0.082758 Oct 24 10:46:55.605791 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2366/4780] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:55 2022] GET /compute/v2.1/servers/e35dae0d-896b-405b-a5a9-a9c951b30101 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:46:55.639999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dc8b1bf4-820e-44f9-8904-424267dca5cb tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:55.646189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dc8b1bf4-820e-44f9-8904-424267dca5cb tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:55.654011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc8b1bf4-820e-44f9-8904-424267dca5cb tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:55.654972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc8b1bf4-820e-44f9-8904-424267dca5cb tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:55.657029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc8b1bf4-820e-44f9-8904-424267dca5cb tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:55.658068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc8b1bf4-820e-44f9-8904-424267dca5cb tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:55.658696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc8b1bf4-820e-44f9-8904-424267dca5cb tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:55.659276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc8b1bf4-820e-44f9-8904-424267dca5cb tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:55.891499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dc8b1bf4-820e-44f9-8904-424267dca5cb tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e32135e900a4b92b6fd23f458ba1d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b48ea9adbe4711a3043add98c14ddb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:55.902083 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dc8b1bf4-820e-44f9-8904-424267dca5cb tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee" status: 200 len: 1469 microversion: 2.1 time: 0.289922 Oct 24 10:46:55.905420 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2415/4781] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:55 2022] GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee => generated 1469 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:55.985531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-20eaf12e-e927-4e56-b077-313737682f4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:55.986869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-20eaf12e-e927-4e56-b077-313737682f4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:56.003313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20eaf12e-e927-4e56-b077-313737682f4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:56.005580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20eaf12e-e927-4e56-b077-313737682f4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:56.006817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20eaf12e-e927-4e56-b077-313737682f4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:56.008599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20eaf12e-e927-4e56-b077-313737682f4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:56.010466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20eaf12e-e927-4e56-b077-313737682f4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:56.011122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20eaf12e-e927-4e56-b077-313737682f4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:56.330933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9b86d92f-a1d7-4aff-9bac-e16b1b7f2a97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:56.332020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9b86d92f-a1d7-4aff-9bac-e16b1b7f2a97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:56.338715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b86d92f-a1d7-4aff-9bac-e16b1b7f2a97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:56.339475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b86d92f-a1d7-4aff-9bac-e16b1b7f2a97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:56.340176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b86d92f-a1d7-4aff-9bac-e16b1b7f2a97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:56.341280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b86d92f-a1d7-4aff-9bac-e16b1b7f2a97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:56.341744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b86d92f-a1d7-4aff-9bac-e16b1b7f2a97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:56.342450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b86d92f-a1d7-4aff-9bac-e16b1b7f2a97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:56.350842 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:46:56.591725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-20eaf12e-e927-4e56-b077-313737682f4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:56.606665 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-20eaf12e-e927-4e56-b077-313737682f4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.627561 Oct 24 10:46:56.610252 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2367/4782] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:55 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:56.625173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c9c8141c-a26b-48f8-925a-b1d209e3c653 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:56.625804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c9c8141c-a26b-48f8-925a-b1d209e3c653 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:56.644201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9c8141c-a26b-48f8-925a-b1d209e3c653 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:56.645152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9c8141c-a26b-48f8-925a-b1d209e3c653 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:56.645839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9c8141c-a26b-48f8-925a-b1d209e3c653 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:56.646953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9c8141c-a26b-48f8-925a-b1d209e3c653 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:56.647921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9c8141c-a26b-48f8-925a-b1d209e3c653 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:56.648579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9c8141c-a26b-48f8-925a-b1d209e3c653 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:56.678577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9b86d92f-a1d7-4aff-9bac-e16b1b7f2a97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:56.715534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9b86d92f-a1d7-4aff-9bac-e16b1b7f2a97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:56.717621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9b86d92f-a1d7-4aff-9bac-e16b1b7f2a97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:56.720009 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9b86d92f-a1d7-4aff-9bac-e16b1b7f2a97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1405 microversion: 2.20 time: 0.394005 Oct 24 10:46:56.732857 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2416/4783] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:56 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:56.878191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c9c8141c-a26b-48f8-925a-b1d209e3c653 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:56.888309 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c9c8141c-a26b-48f8-925a-b1d209e3c653 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.277013 Oct 24 10:46:56.901315 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2368/4784] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:56 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:56.931151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4f4ff6c7-520b-4be6-94ab-893b2c036269 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:56.932604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4f4ff6c7-520b-4be6-94ab-893b2c036269 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] [instance: fa3f4aec-0b6f-4bae-953e-69477c43cfee] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:56.942440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f4ff6c7-520b-4be6-94ab-893b2c036269 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:56.943389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f4ff6c7-520b-4be6-94ab-893b2c036269 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:56.944116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f4ff6c7-520b-4be6-94ab-893b2c036269 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:56.945200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f4ff6c7-520b-4be6-94ab-893b2c036269 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:56.945929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f4ff6c7-520b-4be6-94ab-893b2c036269 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:56.947383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f4ff6c7-520b-4be6-94ab-893b2c036269 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:56.968148 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-4f4ff6c7-520b-4be6-94ab-893b2c036269 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] HTTP exception thrown: Instance fa3f4aec-0b6f-4bae-953e-69477c43cfee could not be found. Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4f4ff6c7-520b-4be6-94ab-893b2c036269 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Request method failure captured: Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee HTTP/1.1 Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmzlGchWcqg-B7BpD4aWaBPkw56EOnow0msGtoXJgh8HijHi4yLVHh0pwiNiGNXJRUAHFakGdOIK7LM1hnpxWD1T-QoJJegyrQ_rCs23ILqW74R_-hz3NG5-yo71GpJO09JC23bJf1xjfZ0q7H_d28qkdT2FoBu-J6amEupFj1vLulg Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 51b48ea9adbe4711a3043add98c14ddb Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-MultipleCreateTestJSON-1288788662 Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/51b48ea9adbe4711a3043add98c14ddb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/51b48ea9adbe4711a3043add98c14ddb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/51b48ea9adbe4711a3043add98c14ddb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_51b48ea9adbe4711a3043add98c14ddb", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-MultipleCreateTestJSON-1288788662 Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 51b48ea9adbe4711a3043add98c14ddb Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1288788662 Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-MultipleCreateTestJSON-1288788662-project Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 9e32135e900a4b92b6fd23f458ba1d9d Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-MultipleCreateTestJSON-1288788662-project Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance fa3f4aec-0b6f-4bae-953e-69477c43cfee could not be found. Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'fa3f4aec-0b6f-4bae-953e-69477c43cfee'} Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa3f4aec-0b6f-4bae-953e-69477c43cfee could not be found. Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa3f4aec-0b6f-4bae-953e-69477c43cfee could not be found. Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:46:56.970842 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:46:56.974662 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:46:56.974662 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:46:56.974662 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:46:56.974662 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:46:56.974662 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:46:56.974662 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa3f4aec-0b6f-4bae-953e-69477c43cfee could not be found. Oct 24 10:46:56.974662 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:46:56.976622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4f4ff6c7-520b-4be6-94ab-893b2c036269 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] Returning 404 to user: Instance fa3f4aec-0b6f-4bae-953e-69477c43cfee could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:46:56.977990 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4f4ff6c7-520b-4be6-94ab-893b2c036269 tempest-MultipleCreateTestJSON-1288788662 tempest-MultipleCreateTestJSON-1288788662-project] 10.222.0.50 "GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee" status: 404 len: 111 microversion: 2.1 time: 0.052251 Oct 24 10:46:56.982854 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2417/4785] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:56 2022] GET /compute/v2.1/servers/fa3f4aec-0b6f-4bae-953e-69477c43cfee => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:46:57.123844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-39643b58-2d5e-4911-8fca-568ccf95d0c7 req-2227bf30-6573-4266-b249-1a745b864844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e357ce41-0ae9-4efa-973b-bc8920e4a0fa", "name": "network-vif-plugged", "status": "completed", "tag": "ddf713d1-ef02-4308-b6ce-8ec89af0574f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:57.143347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-39643b58-2d5e-4911-8fca-568ccf95d0c7 req-2227bf30-6573-4266-b249-1a745b864844 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:57.144144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-39643b58-2d5e-4911-8fca-568ccf95d0c7 req-2227bf30-6573-4266-b249-1a745b864844 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:57.144870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-39643b58-2d5e-4911-8fca-568ccf95d0c7 req-2227bf30-6573-4266-b249-1a745b864844 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:57.166747 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-39643b58-2d5e-4911-8fca-568ccf95d0c7 req-2227bf30-6573-4266-b249-1a745b864844 service nova] Creating event network-vif-plugged:ddf713d1-ef02-4308-b6ce-8ec89af0574f for instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa on n-h2-858383-15 Oct 24 10:46:57.176361 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-39643b58-2d5e-4911-8fca-568ccf95d0c7 req-2227bf30-6573-4266-b249-1a745b864844 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055856 Oct 24 10:46:57.177697 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2369/4786] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:57.667231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c46c940d-fae6-43f6-9b0b-6e1572a4cc78 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:57.671147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c46c940d-fae6-43f6-9b0b-6e1572a4cc78 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:57.699527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c46c940d-fae6-43f6-9b0b-6e1572a4cc78 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:57.700693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c46c940d-fae6-43f6-9b0b-6e1572a4cc78 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:57.701381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c46c940d-fae6-43f6-9b0b-6e1572a4cc78 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:57.703362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c46c940d-fae6-43f6-9b0b-6e1572a4cc78 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:57.704274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c46c940d-fae6-43f6-9b0b-6e1572a4cc78 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:57.704966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e315b225-398c-4be6-a2a5-773dfaedadf3 req-054a9066-d659-4321-8c5b-3210f6eb4523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3f4aec-0b6f-4bae-953e-69477c43cfee", "name": "network-vif-deleted", "tag": "4f5b21ae-b234-4677-a503-6ca2318d5913"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:46:57.705790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c46c940d-fae6-43f6-9b0b-6e1572a4cc78 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:57.731516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e315b225-398c-4be6-a2a5-773dfaedadf3 req-054a9066-d659-4321-8c5b-3210f6eb4523 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:57.733036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e315b225-398c-4be6-a2a5-773dfaedadf3 req-054a9066-d659-4321-8c5b-3210f6eb4523 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:57.734843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e315b225-398c-4be6-a2a5-773dfaedadf3 req-054a9066-d659-4321-8c5b-3210f6eb4523 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:57.766293 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e315b225-398c-4be6-a2a5-773dfaedadf3 req-054a9066-d659-4321-8c5b-3210f6eb4523 service nova] Creating event network-vif-deleted:4f5b21ae-b234-4677-a503-6ca2318d5913 for instance fa3f4aec-0b6f-4bae-953e-69477c43cfee on n-h2-858383-15 Oct 24 10:46:57.773766 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e315b225-398c-4be6-a2a5-773dfaedadf3 req-054a9066-d659-4321-8c5b-3210f6eb4523 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073750 Oct 24 10:46:57.779691 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2370/4787] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:46:57.790476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-200e4ce7-cf04-4071-a091-4740ece99063 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:57.791746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-200e4ce7-cf04-4071-a091-4740ece99063 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:57.800030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-200e4ce7-cf04-4071-a091-4740ece99063 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:57.800787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-200e4ce7-cf04-4071-a091-4740ece99063 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:57.801432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-200e4ce7-cf04-4071-a091-4740ece99063 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:57.802631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-200e4ce7-cf04-4071-a091-4740ece99063 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:57.802775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-200e4ce7-cf04-4071-a091-4740ece99063 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:57.803239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-200e4ce7-cf04-4071-a091-4740ece99063 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:58.230538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c46c940d-fae6-43f6-9b0b-6e1572a4cc78 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:58.239985 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c46c940d-fae6-43f6-9b0b-6e1572a4cc78 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.600698 Oct 24 10:46:58.241061 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2418/4788] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:57 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:58.245940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-02110e6e-f88e-4813-a252-af5c668413d4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:58.246775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-02110e6e-f88e-4813-a252-af5c668413d4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:58.260509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02110e6e-f88e-4813-a252-af5c668413d4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:58.261293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02110e6e-f88e-4813-a252-af5c668413d4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:58.263625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02110e6e-f88e-4813-a252-af5c668413d4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:58.264608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02110e6e-f88e-4813-a252-af5c668413d4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:58.266475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02110e6e-f88e-4813-a252-af5c668413d4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:58.267076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02110e6e-f88e-4813-a252-af5c668413d4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:58.290010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-200e4ce7-cf04-4071-a091-4740ece99063 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:58.304791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-200e4ce7-cf04-4071-a091-4740ece99063 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:58.306515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-200e4ce7-cf04-4071-a091-4740ece99063 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:58.307764 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-200e4ce7-cf04-4071-a091-4740ece99063 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1405 microversion: 2.20 time: 0.526245 Oct 24 10:46:58.308340 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2371/4789] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:57 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1405 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:46:58.673370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-02110e6e-f88e-4813-a252-af5c668413d4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:58.701980 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-02110e6e-f88e-4813-a252-af5c668413d4 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.459623 Oct 24 10:46:58.702579 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2419/4790] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:58 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:59.273182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-48aa1560-0826-4dff-8536-4d8e0b030bc6 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:59.274597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-48aa1560-0826-4dff-8536-4d8e0b030bc6 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:59.284652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48aa1560-0826-4dff-8536-4d8e0b030bc6 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:59.285438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48aa1560-0826-4dff-8536-4d8e0b030bc6 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:59.286043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48aa1560-0826-4dff-8536-4d8e0b030bc6 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:59.286969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48aa1560-0826-4dff-8536-4d8e0b030bc6 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:59.287668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48aa1560-0826-4dff-8536-4d8e0b030bc6 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:59.288263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48aa1560-0826-4dff-8536-4d8e0b030bc6 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:59.337174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c3b5a3a6-5094-4409-9a97-8223c2e0b389 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:59.338484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c3b5a3a6-5094-4409-9a97-8223c2e0b389 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:59.370191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3b5a3a6-5094-4409-9a97-8223c2e0b389 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:59.372106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3b5a3a6-5094-4409-9a97-8223c2e0b389 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:59.372672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3b5a3a6-5094-4409-9a97-8223c2e0b389 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:59.373563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3b5a3a6-5094-4409-9a97-8223c2e0b389 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:59.376451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3b5a3a6-5094-4409-9a97-8223c2e0b389 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:59.378303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3b5a3a6-5094-4409-9a97-8223c2e0b389 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:59.886323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c3b5a3a6-5094-4409-9a97-8223c2e0b389 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:59.905605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c3b5a3a6-5094-4409-9a97-8223c2e0b389 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:59.911105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c3b5a3a6-5094-4409-9a97-8223c2e0b389 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:59.912604 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c3b5a3a6-5094-4409-9a97-8223c2e0b389 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1597 microversion: 2.20 time: 0.583017 Oct 24 10:46:59.913748 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2420/4791] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:46:59 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1597 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:46:59.918716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-48aa1560-0826-4dff-8536-4d8e0b030bc6 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:46:59.919936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d2cc4993-9d4e-4a55-bf37-c4df62c6d3fe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:59.920993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d2cc4993-9d4e-4a55-bf37-c4df62c6d3fe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:46:59.930214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2cc4993-9d4e-4a55-bf37-c4df62c6d3fe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:59.933473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2cc4993-9d4e-4a55-bf37-c4df62c6d3fe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:59.935187 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-48aa1560-0826-4dff-8536-4d8e0b030bc6 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.671575 Oct 24 10:46:59.935483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2cc4993-9d4e-4a55-bf37-c4df62c6d3fe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:59.935805 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2372/4792] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:59 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:46:59.936588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2cc4993-9d4e-4a55-bf37-c4df62c6d3fe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:46:59.938790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2cc4993-9d4e-4a55-bf37-c4df62c6d3fe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:46:59.943538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2cc4993-9d4e-4a55-bf37-c4df62c6d3fe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:46:59.972760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e64bf6f-7dd6-40d4-af50-e388248e0e68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:46:59.980825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5e64bf6f-7dd6-40d4-af50-e388248e0e68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:00.003793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e64bf6f-7dd6-40d4-af50-e388248e0e68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:00.004298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e64bf6f-7dd6-40d4-af50-e388248e0e68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:00.004742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e64bf6f-7dd6-40d4-af50-e388248e0e68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:00.005549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e64bf6f-7dd6-40d4-af50-e388248e0e68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:00.005956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e64bf6f-7dd6-40d4-af50-e388248e0e68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:00.006384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e64bf6f-7dd6-40d4-af50-e388248e0e68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:00.226751 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5e64bf6f-7dd6-40d4-af50-e388248e0e68 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.260521 Oct 24 10:47:00.228208 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2373/4793] 10.222.0.50 () {60 vars in 1316 bytes} [Mon Oct 24 10:46:59 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa/os-interface => generated 284 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:47:00.879020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d2cc4993-9d4e-4a55-bf37-c4df62c6d3fe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:00.891973 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d2cc4993-9d4e-4a55-bf37-c4df62c6d3fe tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.976981 Oct 24 10:47:00.893792 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2421/4794] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:46:59 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:00.974205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-17768c6f-f758-4ad2-92d9-761fdb614eca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:00.976772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-17768c6f-f758-4ad2-92d9-761fdb614eca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:00.987341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17768c6f-f758-4ad2-92d9-761fdb614eca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:00.988104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17768c6f-f758-4ad2-92d9-761fdb614eca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:00.988737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17768c6f-f758-4ad2-92d9-761fdb614eca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:00.990869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17768c6f-f758-4ad2-92d9-761fdb614eca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:00.992300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17768c6f-f758-4ad2-92d9-761fdb614eca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:00.994171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17768c6f-f758-4ad2-92d9-761fdb614eca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:01.716598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-17768c6f-f758-4ad2-92d9-761fdb614eca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:01.730847 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-17768c6f-f758-4ad2-92d9-761fdb614eca tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.768925 Oct 24 10:47:01.731473 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2374/4795] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:00 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:01.922953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-34b8d53b-17b4-4b14-bd2b-f23ced46d9ef tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:01.926074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-34b8d53b-17b4-4b14-bd2b-f23ced46d9ef tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:01.940214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34b8d53b-17b4-4b14-bd2b-f23ced46d9ef tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:01.941935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34b8d53b-17b4-4b14-bd2b-f23ced46d9ef tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:01.943297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34b8d53b-17b4-4b14-bd2b-f23ced46d9ef tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:01.947141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34b8d53b-17b4-4b14-bd2b-f23ced46d9ef tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:01.947810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34b8d53b-17b4-4b14-bd2b-f23ced46d9ef tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:01.948246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34b8d53b-17b4-4b14-bd2b-f23ced46d9ef tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:02.300636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-34b8d53b-17b4-4b14-bd2b-f23ced46d9ef tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:02.310426 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-34b8d53b-17b4-4b14-bd2b-f23ced46d9ef tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.395701 Oct 24 10:47:02.331232 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2422/4796] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:01 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:02.630457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-13c3eb13-0e9b-4668-90a3-c0a99d13af99 req-b08d5d12-6676-46fc-8e44-3bd940d5b514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e357ce41-0ae9-4efa-973b-bc8920e4a0fa", "tag": "ddf713d1-ef02-4308-b6ce-8ec89af0574f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:02.666102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-13c3eb13-0e9b-4668-90a3-c0a99d13af99 req-b08d5d12-6676-46fc-8e44-3bd940d5b514 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:02.667555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-13c3eb13-0e9b-4668-90a3-c0a99d13af99 req-b08d5d12-6676-46fc-8e44-3bd940d5b514 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:02.668164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-13c3eb13-0e9b-4668-90a3-c0a99d13af99 req-b08d5d12-6676-46fc-8e44-3bd940d5b514 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:02.687683 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-13c3eb13-0e9b-4668-90a3-c0a99d13af99 req-b08d5d12-6676-46fc-8e44-3bd940d5b514 service nova] Creating event network-changed:ddf713d1-ef02-4308-b6ce-8ec89af0574f for instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa on n-h2-858383-15 Oct 24 10:47:02.698811 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-13c3eb13-0e9b-4668-90a3-c0a99d13af99 req-b08d5d12-6676-46fc-8e44-3bd940d5b514 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071234 Oct 24 10:47:02.703471 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2375/4797] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:47:02.757729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-898a4bf0-88a4-423b-80a9-2a24fb199d4c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:02.758397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-898a4bf0-88a4-423b-80a9-2a24fb199d4c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:02.772353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-898a4bf0-88a4-423b-80a9-2a24fb199d4c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:02.774509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-898a4bf0-88a4-423b-80a9-2a24fb199d4c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:02.775014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-898a4bf0-88a4-423b-80a9-2a24fb199d4c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:02.778241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-898a4bf0-88a4-423b-80a9-2a24fb199d4c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:02.778739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-898a4bf0-88a4-423b-80a9-2a24fb199d4c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:02.779189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-898a4bf0-88a4-423b-80a9-2a24fb199d4c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:03.111799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-898a4bf0-88a4-423b-80a9-2a24fb199d4c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:03.123893 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-898a4bf0-88a4-423b-80a9-2a24fb199d4c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.370988 Oct 24 10:47:03.128236 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2423/4798] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:02 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:03.341517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-84d323b2-f171-4b33-989f-1cd685f3ea2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:03.342256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-84d323b2-f171-4b33-989f-1cd685f3ea2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:03.357946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84d323b2-f171-4b33-989f-1cd685f3ea2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:03.358910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84d323b2-f171-4b33-989f-1cd685f3ea2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:03.359661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84d323b2-f171-4b33-989f-1cd685f3ea2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:03.361539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84d323b2-f171-4b33-989f-1cd685f3ea2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:03.373993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84d323b2-f171-4b33-989f-1cd685f3ea2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:03.375201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84d323b2-f171-4b33-989f-1cd685f3ea2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:03.658435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-84d323b2-f171-4b33-989f-1cd685f3ea2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:03.673727 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-84d323b2-f171-4b33-989f-1cd685f3ea2d tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.337639 Oct 24 10:47:03.674605 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2376/4799] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:03 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:03.991512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-51d6c6f2-4bd3-46d3-b944-abfbcc0a7bfc tempest-ExtensionsTest-501888767 tempest-ExtensionsTest-501888767-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:03.993231 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-51d6c6f2-4bd3-46d3-b944-abfbcc0a7bfc tempest-ExtensionsTest-501888767 tempest-ExtensionsTest-501888767-project] 10.222.0.50 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.169733 Oct 24 10:47:03.994270 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2424/4800] 10.222.0.50 () {58 vars in 1170 bytes} [Mon Oct 24 10:47:03 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:47:04.006892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2e5b95b0-3495-41bf-aa32-01ccf2f2b06c tempest-ExtensionsTest-501888767 tempest-ExtensionsTest-501888767-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:04.009436 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2e5b95b0-3495-41bf-aa32-01ccf2f2b06c tempest-ExtensionsTest-501888767 tempest-ExtensionsTest-501888767-project] 10.222.0.50 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.010392 Oct 24 10:47:04.010879 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2377/4801] 10.222.0.50 () {58 vars in 1134 bytes} [Mon Oct 24 10:47:03 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:47:04.162252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7abab057-8a6e-4d67-b14e-bf1fe0b2bd6b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:04.162252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7abab057-8a6e-4d67-b14e-bf1fe0b2bd6b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:04.173145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7abab057-8a6e-4d67-b14e-bf1fe0b2bd6b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:04.177449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7abab057-8a6e-4d67-b14e-bf1fe0b2bd6b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:04.179713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7abab057-8a6e-4d67-b14e-bf1fe0b2bd6b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:04.181371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7abab057-8a6e-4d67-b14e-bf1fe0b2bd6b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:04.182886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7abab057-8a6e-4d67-b14e-bf1fe0b2bd6b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:04.183622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7abab057-8a6e-4d67-b14e-bf1fe0b2bd6b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:04.536479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7abab057-8a6e-4d67-b14e-bf1fe0b2bd6b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:04.551264 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7abab057-8a6e-4d67-b14e-bf1fe0b2bd6b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.400485 Oct 24 10:47:04.552478 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2425/4802] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:04 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:04.707535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e5b7e9c8-f03b-4c4b-914b-5140a34423dc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:04.709417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e5b7e9c8-f03b-4c4b-914b-5140a34423dc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:04.732601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5b7e9c8-f03b-4c4b-914b-5140a34423dc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:04.735145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5b7e9c8-f03b-4c4b-914b-5140a34423dc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:04.735983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5b7e9c8-f03b-4c4b-914b-5140a34423dc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:04.740061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5b7e9c8-f03b-4c4b-914b-5140a34423dc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:04.743840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5b7e9c8-f03b-4c4b-914b-5140a34423dc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:04.748077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5b7e9c8-f03b-4c4b-914b-5140a34423dc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:05.131168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e5b7e9c8-f03b-4c4b-914b-5140a34423dc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:05.161630 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e5b7e9c8-f03b-4c4b-914b-5140a34423dc tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.455547 Oct 24 10:47:05.178328 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2378/4803] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:04 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:05.578493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-11f93e56-a12a-4fd7-82d7-86eeda1929c0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:05.579831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-11f93e56-a12a-4fd7-82d7-86eeda1929c0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:05.590162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11f93e56-a12a-4fd7-82d7-86eeda1929c0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:05.590834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11f93e56-a12a-4fd7-82d7-86eeda1929c0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:05.591461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11f93e56-a12a-4fd7-82d7-86eeda1929c0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:05.592324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11f93e56-a12a-4fd7-82d7-86eeda1929c0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:05.595028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11f93e56-a12a-4fd7-82d7-86eeda1929c0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:05.595981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11f93e56-a12a-4fd7-82d7-86eeda1929c0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:05.849708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-11f93e56-a12a-4fd7-82d7-86eeda1929c0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:05.861222 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-11f93e56-a12a-4fd7-82d7-86eeda1929c0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.288105 Oct 24 10:47:05.862445 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2426/4804] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:05 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:06.194075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-84669c63-0b4c-4aca-994b-ce9f2541c4db tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:06.195910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-84669c63-0b4c-4aca-994b-ce9f2541c4db tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:06.210248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84669c63-0b4c-4aca-994b-ce9f2541c4db tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:06.210744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84669c63-0b4c-4aca-994b-ce9f2541c4db tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:06.213109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84669c63-0b4c-4aca-994b-ce9f2541c4db tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:06.215360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84669c63-0b4c-4aca-994b-ce9f2541c4db tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:06.215840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84669c63-0b4c-4aca-994b-ce9f2541c4db tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:06.216279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84669c63-0b4c-4aca-994b-ce9f2541c4db tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:06.501301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-84669c63-0b4c-4aca-994b-ce9f2541c4db tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:06.510740 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-84669c63-0b4c-4aca-994b-ce9f2541c4db tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.321611 Oct 24 10:47:06.511761 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2379/4805] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:06 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:06.887647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0c6c48a-85ea-4798-bf4f-0c8bd5ec63f0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:06.888407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f0c6c48a-85ea-4798-bf4f-0c8bd5ec63f0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:06.896290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0c6c48a-85ea-4798-bf4f-0c8bd5ec63f0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:06.897612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0c6c48a-85ea-4798-bf4f-0c8bd5ec63f0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:06.898721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0c6c48a-85ea-4798-bf4f-0c8bd5ec63f0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:06.900019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0c6c48a-85ea-4798-bf4f-0c8bd5ec63f0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:06.900479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0c6c48a-85ea-4798-bf4f-0c8bd5ec63f0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:06.900936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0c6c48a-85ea-4798-bf4f-0c8bd5ec63f0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:06.967456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c3a65d6d-04f2-4647-a60c-9e30ee820700 tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] Action: 'create', calling method: .version_select at 0x7f04d0970160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-784823372", "metadata": {"Type": "work"}}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:07.079916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f0c6c48a-85ea-4798-bf4f-0c8bd5ec63f0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:07.089191 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f0c6c48a-85ea-4798-bf4f-0c8bd5ec63f0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.205696 Oct 24 10:47:07.090324 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2380/4806] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:06 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:07.356079 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c3a65d6d-04f2-4647-a60c-9e30ee820700 tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.561399 Oct 24 10:47:07.357318 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2427/4807] 10.222.0.50 () {60 vars in 1156 bytes} [Mon Oct 24 10:47:06 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 563 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 24 10:47:07.371925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33ccd9fe-faa3-4a98-b8e4-b43ce1ec3415 tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] Calling method '.version_select at 0x7f04d0bd4790>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:07.439579 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-33ccd9fe-faa3-4a98-b8e4-b43ce1ec3415 tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/12549003-8f17-480e-bd56-03a903f0f757" status: 200 len: 352 microversion: 2.1 time: 0.072329 Oct 24 10:47:07.440287 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2381/4808] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 10:47:07 2022] GET /compute/v2.1/os-volumes/12549003-8f17-480e-bd56-03a903f0f757 => generated 352 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:47:07.535901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-27d77397-6d9a-42c6-8fd9-7ebb3fdb9847 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:07.536763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-27d77397-6d9a-42c6-8fd9-7ebb3fdb9847 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:07.544794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27d77397-6d9a-42c6-8fd9-7ebb3fdb9847 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:07.545707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27d77397-6d9a-42c6-8fd9-7ebb3fdb9847 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:07.546342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27d77397-6d9a-42c6-8fd9-7ebb3fdb9847 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:07.547430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27d77397-6d9a-42c6-8fd9-7ebb3fdb9847 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:07.548041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27d77397-6d9a-42c6-8fd9-7ebb3fdb9847 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:07.548702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27d77397-6d9a-42c6-8fd9-7ebb3fdb9847 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:07.708380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-27d77397-6d9a-42c6-8fd9-7ebb3fdb9847 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:07.719127 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-27d77397-6d9a-42c6-8fd9-7ebb3fdb9847 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.186737 Oct 24 10:47:07.719978 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2428/4809] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:07 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:08.114743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e02e0d0-3f2f-4e6b-8837-07add7a2560f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:08.115268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e02e0d0-3f2f-4e6b-8837-07add7a2560f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:08.129758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e02e0d0-3f2f-4e6b-8837-07add7a2560f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:08.130527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e02e0d0-3f2f-4e6b-8837-07add7a2560f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:08.131797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e02e0d0-3f2f-4e6b-8837-07add7a2560f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:08.132569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e02e0d0-3f2f-4e6b-8837-07add7a2560f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:08.133088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e02e0d0-3f2f-4e6b-8837-07add7a2560f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:08.133505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e02e0d0-3f2f-4e6b-8837-07add7a2560f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:08.411240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1e02e0d0-3f2f-4e6b-8837-07add7a2560f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:08.424513 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1e02e0d0-3f2f-4e6b-8837-07add7a2560f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.313565 Oct 24 10:47:08.425637 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2382/4810] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:08 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:08.454340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c11996a0-0613-4328-9f0f-3a17b4236376 tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] Calling method '.version_select at 0x7f04d05e4820>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:08.539758 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c11996a0-0613-4328-9f0f-3a17b4236376 tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/12549003-8f17-480e-bd56-03a903f0f757" status: 200 len: 353 microversion: 2.1 time: 0.089376 Oct 24 10:47:08.548586 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2429/4811] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 10:47:08 2022] GET /compute/v2.1/os-volumes/12549003-8f17-480e-bd56-03a903f0f757 => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:47:08.554997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6672428d-9629-4d98-8a93-66027b70e139 tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] Calling method '.version_select at 0x7f04d4fe0e50>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:08.666642 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6672428d-9629-4d98-8a93-66027b70e139 tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/12549003-8f17-480e-bd56-03a903f0f757" status: 200 len: 353 microversion: 2.1 time: 0.116599 Oct 24 10:47:08.667425 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2383/4812] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 10:47:08 2022] GET /compute/v2.1/os-volumes/12549003-8f17-480e-bd56-03a903f0f757 => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:47:08.685501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0b885edf-e937-462e-8c67-074c19f996cb tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] Calling method '.version_select at 0x7f04d008d430>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:08.743792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fc455179-d962-466b-a529-bbcccde2f049 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:08.744826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fc455179-d962-466b-a529-bbcccde2f049 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:08.754633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc455179-d962-466b-a529-bbcccde2f049 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:08.756978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc455179-d962-466b-a529-bbcccde2f049 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:08.758199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc455179-d962-466b-a529-bbcccde2f049 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:08.759740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc455179-d962-466b-a529-bbcccde2f049 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:08.760917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc455179-d962-466b-a529-bbcccde2f049 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:08.761790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc455179-d962-466b-a529-bbcccde2f049 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:08.811377 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0b885edf-e937-462e-8c67-074c19f996cb tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/12549003-8f17-480e-bd56-03a903f0f757" status: 202 len: 0 microversion: 2.1 time: 0.130213 Oct 24 10:47:08.812788 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2430/4813] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Oct 24 10:47:08 2022] DELETE /compute/v2.1/os-volumes/12549003-8f17-480e-bd56-03a903f0f757 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:47:08.823254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-961de08b-8855-49d3-9141-53da206822e0 tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] Calling method '.version_select at 0x7f04d04b3550>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:08.924247 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-961de08b-8855-49d3-9141-53da206822e0 tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/12549003-8f17-480e-bd56-03a903f0f757" status: 200 len: 352 microversion: 2.1 time: 0.105857 Oct 24 10:47:08.925251 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2431/4814] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 10:47:08 2022] GET /compute/v2.1/os-volumes/12549003-8f17-480e-bd56-03a903f0f757 => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:47:08.984886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fc455179-d962-466b-a529-bbcccde2f049 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:08.995924 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fc455179-d962-466b-a529-bbcccde2f049 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.256621 Oct 24 10:47:08.998843 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2384/4815] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:08 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:09.455747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-81eb01e5-5882-4186-987e-36f866270c64 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:09.459817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-81eb01e5-5882-4186-987e-36f866270c64 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:09.474770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81eb01e5-5882-4186-987e-36f866270c64 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:09.475834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81eb01e5-5882-4186-987e-36f866270c64 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:09.476517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81eb01e5-5882-4186-987e-36f866270c64 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:09.478078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81eb01e5-5882-4186-987e-36f866270c64 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:09.480295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81eb01e5-5882-4186-987e-36f866270c64 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:09.481029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81eb01e5-5882-4186-987e-36f866270c64 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:09.722889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-81eb01e5-5882-4186-987e-36f866270c64 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:09.735644 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-81eb01e5-5882-4186-987e-36f866270c64 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.287892 Oct 24 10:47:09.739208 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2432/4816] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:09 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:09.950477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-99e1e82d-6124-4b1d-9b53-a592d91ef2d6 tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] Calling method '.version_select at 0x7f04d0ca1160>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:10.020408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1faae0a1-f11a-43b2-b75a-14ee675d019e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:10.021063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1faae0a1-f11a-43b2-b75a-14ee675d019e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:10.035256 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-99e1e82d-6124-4b1d-9b53-a592d91ef2d6 tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/12549003-8f17-480e-bd56-03a903f0f757" status: 200 len: 352 microversion: 2.1 time: 0.090536 Oct 24 10:47:10.038702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1faae0a1-f11a-43b2-b75a-14ee675d019e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:10.039194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1faae0a1-f11a-43b2-b75a-14ee675d019e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:10.039627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1faae0a1-f11a-43b2-b75a-14ee675d019e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:10.040381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1faae0a1-f11a-43b2-b75a-14ee675d019e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:10.040792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1faae0a1-f11a-43b2-b75a-14ee675d019e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:10.041244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1faae0a1-f11a-43b2-b75a-14ee675d019e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:10.042990 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2385/4817] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 10:47:09 2022] GET /compute/v2.1/os-volumes/12549003-8f17-480e-bd56-03a903f0f757 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:47:10.352095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1faae0a1-f11a-43b2-b75a-14ee675d019e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:10.372448 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1faae0a1-f11a-43b2-b75a-14ee675d019e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.355854 Oct 24 10:47:10.374556 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2433/4818] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:10 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:10.761199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ecc726eb-fd0f-4a52-bf52-7ff4c73846a0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:10.762805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ecc726eb-fd0f-4a52-bf52-7ff4c73846a0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:10.771406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecc726eb-fd0f-4a52-bf52-7ff4c73846a0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:10.772713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecc726eb-fd0f-4a52-bf52-7ff4c73846a0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:10.773422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecc726eb-fd0f-4a52-bf52-7ff4c73846a0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:10.774404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecc726eb-fd0f-4a52-bf52-7ff4c73846a0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:10.775107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecc726eb-fd0f-4a52-bf52-7ff4c73846a0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:10.775785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecc726eb-fd0f-4a52-bf52-7ff4c73846a0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:10.951070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ecc726eb-fd0f-4a52-bf52-7ff4c73846a0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:10.962377 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ecc726eb-fd0f-4a52-bf52-7ff4c73846a0 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.206206 Oct 24 10:47:10.977578 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2386/4819] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:10 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:11.052193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cca0fd62-1323-4d8c-b8c0-35bde319ad01 tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] Calling method '.version_select at 0x7f04d0563940>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:11.155329 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cca0fd62-1323-4d8c-b8c0-35bde319ad01 tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/12549003-8f17-480e-bd56-03a903f0f757" status: 200 len: 352 microversion: 2.1 time: 0.109059 Oct 24 10:47:11.156202 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2434/4820] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 10:47:11 2022] GET /compute/v2.1/os-volumes/12549003-8f17-480e-bd56-03a903f0f757 => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:47:11.401826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1015f577-1b22-4e32-af33-638412e57443 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:11.402630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1015f577-1b22-4e32-af33-638412e57443 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:11.417196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1015f577-1b22-4e32-af33-638412e57443 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:11.419099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1015f577-1b22-4e32-af33-638412e57443 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:11.420358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1015f577-1b22-4e32-af33-638412e57443 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:11.421800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1015f577-1b22-4e32-af33-638412e57443 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:11.422705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1015f577-1b22-4e32-af33-638412e57443 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:11.424376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1015f577-1b22-4e32-af33-638412e57443 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:11.649508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1015f577-1b22-4e32-af33-638412e57443 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:11.666637 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1015f577-1b22-4e32-af33-638412e57443 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.269957 Oct 24 10:47:11.670097 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2387/4821] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:11 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:11.988979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-72bbcdea-f2fe-4bf4-a606-8fd12bb7ffeb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:11.990008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-72bbcdea-f2fe-4bf4-a606-8fd12bb7ffeb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:12.008281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72bbcdea-f2fe-4bf4-a606-8fd12bb7ffeb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:12.009891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72bbcdea-f2fe-4bf4-a606-8fd12bb7ffeb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:12.012126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72bbcdea-f2fe-4bf4-a606-8fd12bb7ffeb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:12.014539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72bbcdea-f2fe-4bf4-a606-8fd12bb7ffeb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:12.015746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72bbcdea-f2fe-4bf4-a606-8fd12bb7ffeb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:12.018361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-72bbcdea-f2fe-4bf4-a606-8fd12bb7ffeb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:12.171320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dcc4c48d-4ce4-41cc-b084-0b90f0af41ab tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] Calling method '.version_select at 0x7f04d13dc670>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:12.230132 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-dcc4c48d-4ce4-41cc-b084-0b90f0af41ab tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] HTTP exception thrown: Volume 12549003-8f17-480e-bd56-03a903f0f757 could not be found. Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dcc4c48d-4ce4-41cc-b084-0b90f0af41ab tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] Request method failure captured: Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/os-volumes/12549003-8f17-480e-bd56-03a903f0f757 HTTP/1.1 Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm0qSPutpAOL8E5gc2aPf5MpA_IDSfXO25WDoq7WxGBV8Two1KrzA8-OFNKBO29Ng7sref5tRQtx20-2f30VKbh8w_RfEM4wC8RWbamO818pTBDxonDO0FtKSTd0cI5FH_SUH5bLykyClhPk85at8lpr4PYaDr6VTWWHape8BVin7cc Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 5cc4da72ef344b93a433d260404f01ff Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesGetTestJSON-1094063259 Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5cc4da72ef344b93a433d260404f01ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5cc4da72ef344b93a433d260404f01ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5cc4da72ef344b93a433d260404f01ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5cc4da72ef344b93a433d260404f01ff", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-VolumesGetTestJSON-1094063259 Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 5cc4da72ef344b93a433d260404f01ff Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesGetTestJSON-1094063259 Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-VolumesGetTestJSON-1094063259-project Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 820baec7c2c84214973453ec887d8a1a Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-VolumesGetTestJSON-1094063259-project Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: exception: Volume 12549003-8f17-480e-bd56-03a903f0f757 could not be found. Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '12549003-8f17-480e-bd56-03a903f0f757'} Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 12549003-8f17-480e-bd56-03a903f0f757 could not be found. (HTTP 404) (Request-ID: req-70eb5fc1-1395-44d8-8fee-35bbd2270dc6) Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 10:47:12.233182 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 12549003-8f17-480e-bd56-03a903f0f757 could not be found. Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 12549003-8f17-480e-bd56-03a903f0f757 could not be found. Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 12549003-8f17-480e-bd56-03a903f0f757 could not be found. Oct 24 10:47:12.238434 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:12.245333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dcc4c48d-4ce4-41cc-b084-0b90f0af41ab tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] Returning 404 to user: Volume 12549003-8f17-480e-bd56-03a903f0f757 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:12.245333 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dcc4c48d-4ce4-41cc-b084-0b90f0af41ab tempest-VolumesGetTestJSON-1094063259 tempest-VolumesGetTestJSON-1094063259-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/12549003-8f17-480e-bd56-03a903f0f757" status: 404 len: 109 microversion: 2.1 time: 0.077425 Oct 24 10:47:12.245333 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2388/4822] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 10:47:12 2022] GET /compute/v2.1/os-volumes/12549003-8f17-480e-bd56-03a903f0f757 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:47:12.440050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-72bbcdea-f2fe-4bf4-a606-8fd12bb7ffeb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:12.452370 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-72bbcdea-f2fe-4bf4-a606-8fd12bb7ffeb tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.467518 Oct 24 10:47:12.469102 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2435/4823] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:11 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:12.694381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c260505d-54e5-49e7-981f-4b4756520cd3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:12.695276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c260505d-54e5-49e7-981f-4b4756520cd3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:12.715735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c260505d-54e5-49e7-981f-4b4756520cd3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:12.716503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c260505d-54e5-49e7-981f-4b4756520cd3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:12.719435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c260505d-54e5-49e7-981f-4b4756520cd3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:12.720666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c260505d-54e5-49e7-981f-4b4756520cd3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:12.722143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c260505d-54e5-49e7-981f-4b4756520cd3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:12.724057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c260505d-54e5-49e7-981f-4b4756520cd3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:13.037827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c260505d-54e5-49e7-981f-4b4756520cd3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:13.060680 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c260505d-54e5-49e7-981f-4b4756520cd3 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.369155 Oct 24 10:47:13.076375 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2389/4824] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:12 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:13.487085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dac1da5b-9cf6-48c8-be6f-fdb2df19d1b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:13.488025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dac1da5b-9cf6-48c8-be6f-fdb2df19d1b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:13.503913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dac1da5b-9cf6-48c8-be6f-fdb2df19d1b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:13.507473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dac1da5b-9cf6-48c8-be6f-fdb2df19d1b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:13.507943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dac1da5b-9cf6-48c8-be6f-fdb2df19d1b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:13.510857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dac1da5b-9cf6-48c8-be6f-fdb2df19d1b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:13.513195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dac1da5b-9cf6-48c8-be6f-fdb2df19d1b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:13.514501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dac1da5b-9cf6-48c8-be6f-fdb2df19d1b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:13.910009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dac1da5b-9cf6-48c8-be6f-fdb2df19d1b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:13.921479 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dac1da5b-9cf6-48c8-be6f-fdb2df19d1b2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.441951 Oct 24 10:47:13.922292 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2436/4825] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:13 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:14.101939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fcd5b74f-c42d-4b11-9523-68da09f477d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:14.103272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fcd5b74f-c42d-4b11-9523-68da09f477d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:14.106457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:47:14.119710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcd5b74f-c42d-4b11-9523-68da09f477d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:14.121774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcd5b74f-c42d-4b11-9523-68da09f477d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:14.123961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcd5b74f-c42d-4b11-9523-68da09f477d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:14.126519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcd5b74f-c42d-4b11-9523-68da09f477d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:14.127684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcd5b74f-c42d-4b11-9523-68da09f477d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:14.128906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcd5b74f-c42d-4b11-9523-68da09f477d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:14.387318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fcd5b74f-c42d-4b11-9523-68da09f477d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:14.394270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:47:14.399335 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fcd5b74f-c42d-4b11-9523-68da09f477d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.301418 Oct 24 10:47:14.400461 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2390/4826] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:14 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:14.947489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-48815668-baeb-40cc-865d-1adf4dd5f7fe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:14.948313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-48815668-baeb-40cc-865d-1adf4dd5f7fe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:14.966028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48815668-baeb-40cc-865d-1adf4dd5f7fe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:14.966732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48815668-baeb-40cc-865d-1adf4dd5f7fe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:14.967550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48815668-baeb-40cc-865d-1adf4dd5f7fe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:14.969343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48815668-baeb-40cc-865d-1adf4dd5f7fe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:14.970124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48815668-baeb-40cc-865d-1adf4dd5f7fe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:14.970786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48815668-baeb-40cc-865d-1adf4dd5f7fe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:15.624236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-48815668-baeb-40cc-865d-1adf4dd5f7fe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:15.638551 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-48815668-baeb-40cc-865d-1adf4dd5f7fe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.694681 Oct 24 10:47:15.639947 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2437/4827] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:14 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:15.648085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0c8922b0-fa96-4146-9a7d-6da4102549d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:15.649421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0c8922b0-fa96-4146-9a7d-6da4102549d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:15.655861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c8922b0-fa96-4146-9a7d-6da4102549d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:15.656355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c8922b0-fa96-4146-9a7d-6da4102549d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:15.659226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c8922b0-fa96-4146-9a7d-6da4102549d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:15.661080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c8922b0-fa96-4146-9a7d-6da4102549d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:15.661723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c8922b0-fa96-4146-9a7d-6da4102549d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:15.662318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c8922b0-fa96-4146-9a7d-6da4102549d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:15.813694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ba58b2d3-82bb-4836-aa19-cd96ec052cb7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-779561065", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "8afc1e78-088d-4229-a590-e55c6c5952e5"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:15.835829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0c8922b0-fa96-4146-9a7d-6da4102549d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:15.845878 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0c8922b0-fa96-4146-9a7d-6da4102549d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.203379 Oct 24 10:47:15.847272 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2438/4828] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:15 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:15.915033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-ba58b2d3-82bb-4836-aa19-cd96ec052cb7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] validate_networks() for [('8afc1e78-088d-4229-a590-e55c6c5952e5', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:47:16.427776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ba58b2d3-82bb-4836-aa19-cd96ec052cb7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:47:16.428274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ba58b2d3-82bb-4836-aa19-cd96ec052cb7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:47:16.428820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ba58b2d3-82bb-4836-aa19-cd96ec052cb7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:47:16.429323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ba58b2d3-82bb-4836-aa19-cd96ec052cb7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:47:16.429852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ba58b2d3-82bb-4836-aa19-cd96ec052cb7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:47:16.441226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba58b2d3-82bb-4836-aa19-cd96ec052cb7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:16.441444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba58b2d3-82bb-4836-aa19-cd96ec052cb7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:16.442003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba58b2d3-82bb-4836-aa19-cd96ec052cb7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:16.443082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba58b2d3-82bb-4836-aa19-cd96ec052cb7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:16.443206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba58b2d3-82bb-4836-aa19-cd96ec052cb7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:16.443617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ba58b2d3-82bb-4836-aa19-cd96ec052cb7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:16.467717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ba58b2d3-82bb-4836-aa19-cd96ec052cb7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Getting quotas for project 26a140969afb4058ae5bb7cb62d58f14. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:47:16.474103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ba58b2d3-82bb-4836-aa19-cd96ec052cb7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Getting quotas for user 446c9d2505a348a5a5b3369d38985451 and project 26a140969afb4058ae5bb7cb62d58f14. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:47:16.488462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ba58b2d3-82bb-4836-aa19-cd96ec052cb7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:47:16.490857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ba58b2d3-82bb-4836-aa19-cd96ec052cb7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:47:16.547691 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ba58b2d3-82bb-4836-aa19-cd96ec052cb7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.236332 Oct 24 10:47:16.548527 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2391/4829] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:47:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:47:16.560951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f383b7d7-4c9e-4a88-bdd9-c4b3fafae6ed tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:16.563143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f383b7d7-4c9e-4a88-bdd9-c4b3fafae6ed tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:16.643581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f383b7d7-4c9e-4a88-bdd9-c4b3fafae6ed tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446c9d2505a348a5a5b3369d38985451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a140969afb4058ae5bb7cb62d58f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:16.656909 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f383b7d7-4c9e-4a88-bdd9-c4b3fafae6ed tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 200 len: 1224 microversion: 2.1 time: 0.099443 Oct 24 10:47:16.665039 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2439/4830] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:16 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:16.676879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf270563-da92-4a77-ad23-cb41b75bb0df tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:16.677620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bf270563-da92-4a77-ad23-cb41b75bb0df tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:16.690195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf270563-da92-4a77-ad23-cb41b75bb0df tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:16.690801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf270563-da92-4a77-ad23-cb41b75bb0df tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:16.692533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf270563-da92-4a77-ad23-cb41b75bb0df tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:16.694011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf270563-da92-4a77-ad23-cb41b75bb0df tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:16.694918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf270563-da92-4a77-ad23-cb41b75bb0df tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:16.695559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf270563-da92-4a77-ad23-cb41b75bb0df tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:16.873331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-84342201-e022-4f19-9810-3abf8aded574 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:16.874108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-84342201-e022-4f19-9810-3abf8aded574 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:16.892025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84342201-e022-4f19-9810-3abf8aded574 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:16.894166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84342201-e022-4f19-9810-3abf8aded574 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:16.894733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84342201-e022-4f19-9810-3abf8aded574 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:16.896086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84342201-e022-4f19-9810-3abf8aded574 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:16.897328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84342201-e022-4f19-9810-3abf8aded574 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:16.898294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84342201-e022-4f19-9810-3abf8aded574 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:16.937247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:47:17.008113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bf270563-da92-4a77-ad23-cb41b75bb0df tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:17.021762 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bf270563-da92-4a77-ad23-cb41b75bb0df tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.349416 Oct 24 10:47:17.027559 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2392/4831] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:16 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:17.259868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-84342201-e022-4f19-9810-3abf8aded574 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:17.271756 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-84342201-e022-4f19-9810-3abf8aded574 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1511 microversion: 2.1 time: 0.402858 Oct 24 10:47:17.277576 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2440/4832] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:16 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1511 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:17.685528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c0f3db82-5a4e-4e2c-bf60-c8e27368548d tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:17.686156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c0f3db82-5a4e-4e2c-bf60-c8e27368548d tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:17.699403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0f3db82-5a4e-4e2c-bf60-c8e27368548d tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:17.708929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0f3db82-5a4e-4e2c-bf60-c8e27368548d tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:17.714394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0f3db82-5a4e-4e2c-bf60-c8e27368548d tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:17.715235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0f3db82-5a4e-4e2c-bf60-c8e27368548d tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:17.715718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0f3db82-5a4e-4e2c-bf60-c8e27368548d tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:17.716157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0f3db82-5a4e-4e2c-bf60-c8e27368548d tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:17.865443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0f3db82-5a4e-4e2c-bf60-c8e27368548d tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446c9d2505a348a5a5b3369d38985451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a140969afb4058ae5bb7cb62d58f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:17.879933 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c0f3db82-5a4e-4e2c-bf60-c8e27368548d tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 200 len: 1220 microversion: 2.1 time: 0.201667 Oct 24 10:47:17.891077 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2393/4833] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:17 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 1220 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:18.055774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d72c9138-f8a3-4dc8-a185-5de36714533a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:18.056418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d72c9138-f8a3-4dc8-a185-5de36714533a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:18.075192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:47:18.085322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d72c9138-f8a3-4dc8-a185-5de36714533a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:18.086233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d72c9138-f8a3-4dc8-a185-5de36714533a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:18.089467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d72c9138-f8a3-4dc8-a185-5de36714533a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:18.090228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d72c9138-f8a3-4dc8-a185-5de36714533a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:18.090794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d72c9138-f8a3-4dc8-a185-5de36714533a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:18.091161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d72c9138-f8a3-4dc8-a185-5de36714533a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:18.300306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-219665ec-148c-42b5-8597-58ce66c96a8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:18.300885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-219665ec-148c-42b5-8597-58ce66c96a8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:18.317505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-219665ec-148c-42b5-8597-58ce66c96a8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:18.320759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-219665ec-148c-42b5-8597-58ce66c96a8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:18.322237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-219665ec-148c-42b5-8597-58ce66c96a8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:18.323825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-219665ec-148c-42b5-8597-58ce66c96a8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:18.324323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-219665ec-148c-42b5-8597-58ce66c96a8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:18.324771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-219665ec-148c-42b5-8597-58ce66c96a8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:18.325686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d72c9138-f8a3-4dc8-a185-5de36714533a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:18.335154 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d72c9138-f8a3-4dc8-a185-5de36714533a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.285694 Oct 24 10:47:18.338502 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2441/4834] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:18 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:18.566489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-219665ec-148c-42b5-8597-58ce66c96a8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:18.576506 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-219665ec-148c-42b5-8597-58ce66c96a8c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1488 microversion: 2.1 time: 0.283371 Oct 24 10:47:18.580431 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2394/4835] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:18 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1488 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:18.614630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f9837692-b560-4285-ba0c-f90077ccc97a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1957322712"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:18.620094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f9837692-b560-4285-ba0c-f90077ccc97a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:18.643041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9837692-b560-4285-ba0c-f90077ccc97a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:18.643591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9837692-b560-4285-ba0c-f90077ccc97a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:18.643978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9837692-b560-4285-ba0c-f90077ccc97a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:18.644710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9837692-b560-4285-ba0c-f90077ccc97a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:18.655054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9837692-b560-4285-ba0c-f90077ccc97a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:18.656191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9837692-b560-4285-ba0c-f90077ccc97a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:18.801931 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f9837692-b560-4285-ba0c-f90077ccc97a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "PUT /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1061 microversion: 2.1 time: 0.200041 Oct 24 10:47:18.804373 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2442/4836] 10.222.0.50 () {60 vars in 1256 bytes} [Mon Oct 24 10:47:18 2022] PUT /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1061 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:18.829988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-57299abd-9234-48cf-a131-c9ef41a6a01a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:18.830898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-57299abd-9234-48cf-a131-c9ef41a6a01a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:18.839407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57299abd-9234-48cf-a131-c9ef41a6a01a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:18.840773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57299abd-9234-48cf-a131-c9ef41a6a01a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:18.842170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57299abd-9234-48cf-a131-c9ef41a6a01a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:18.845054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57299abd-9234-48cf-a131-c9ef41a6a01a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:18.846366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57299abd-9234-48cf-a131-c9ef41a6a01a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:18.847178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57299abd-9234-48cf-a131-c9ef41a6a01a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:18.907072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7203535c-80c2-4e68-ab03-498cb087bb64 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:18.908463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7203535c-80c2-4e68-ab03-498cb087bb64 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:18.921498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7203535c-80c2-4e68-ab03-498cb087bb64 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:18.922532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7203535c-80c2-4e68-ab03-498cb087bb64 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:18.923324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7203535c-80c2-4e68-ab03-498cb087bb64 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:18.924726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7203535c-80c2-4e68-ab03-498cb087bb64 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:18.926793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7203535c-80c2-4e68-ab03-498cb087bb64 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:18.927473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7203535c-80c2-4e68-ab03-498cb087bb64 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:19.065197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7203535c-80c2-4e68-ab03-498cb087bb64 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446c9d2505a348a5a5b3369d38985451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a140969afb4058ae5bb7cb62d58f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:19.072588 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7203535c-80c2-4e68-ab03-498cb087bb64 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 200 len: 1282 microversion: 2.1 time: 0.171504 Oct 24 10:47:19.077979 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2443/4837] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:18 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 1282 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:19.161422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-57299abd-9234-48cf-a131-c9ef41a6a01a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:19.171566 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-57299abd-9234-48cf-a131-c9ef41a6a01a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1488 microversion: 2.1 time: 0.350960 Oct 24 10:47:19.189983 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2395/4838] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:18 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1488 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:19.202054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1b6ecb97-c77c-489c-b63b-85c3fbe02b64 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:19.203302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1b6ecb97-c77c-489c-b63b-85c3fbe02b64 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:19.229586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b6ecb97-c77c-489c-b63b-85c3fbe02b64 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:19.238613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b6ecb97-c77c-489c-b63b-85c3fbe02b64 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:19.240885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b6ecb97-c77c-489c-b63b-85c3fbe02b64 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:19.241796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b6ecb97-c77c-489c-b63b-85c3fbe02b64 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:19.242146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b6ecb97-c77c-489c-b63b-85c3fbe02b64 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:19.242645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b6ecb97-c77c-489c-b63b-85c3fbe02b64 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:19.364111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b5fd1560-0ace-4a67-b1c6-c1ed4f831de2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:19.364746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b5fd1560-0ace-4a67-b1c6-c1ed4f831de2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:19.374650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5fd1560-0ace-4a67-b1c6-c1ed4f831de2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:19.375151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5fd1560-0ace-4a67-b1c6-c1ed4f831de2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:19.375627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5fd1560-0ace-4a67-b1c6-c1ed4f831de2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:19.376513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5fd1560-0ace-4a67-b1c6-c1ed4f831de2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:19.377012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5fd1560-0ace-4a67-b1c6-c1ed4f831de2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:19.377447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b5fd1560-0ace-4a67-b1c6-c1ed4f831de2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:19.674059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1b6ecb97-c77c-489c-b63b-85c3fbe02b64 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:19.700008 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1b6ecb97-c77c-489c-b63b-85c3fbe02b64 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1488 microversion: 2.1 time: 0.501822 Oct 24 10:47:19.700642 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2444/4839] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:19 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1488 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:19.725395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7ea5bdd0-ea57-42c3-9c31-eec1f4c95ccd tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:19.726230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7ea5bdd0-ea57-42c3-9c31-eec1f4c95ccd tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:19.733220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ea5bdd0-ea57-42c3-9c31-eec1f4c95ccd tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:19.734609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ea5bdd0-ea57-42c3-9c31-eec1f4c95ccd tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:19.735233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ea5bdd0-ea57-42c3-9c31-eec1f4c95ccd tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:19.736524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ea5bdd0-ea57-42c3-9c31-eec1f4c95ccd tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:19.737244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ea5bdd0-ea57-42c3-9c31-eec1f4c95ccd tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:19.737901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ea5bdd0-ea57-42c3-9c31-eec1f4c95ccd tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:19.797514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7ea5bdd0-ea57-42c3-9c31-eec1f4c95ccd tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:47:19.818364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b5fd1560-0ace-4a67-b1c6-c1ed4f831de2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:19.832242 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b5fd1560-0ace-4a67-b1c6-c1ed4f831de2 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1515 microversion: 2.1 time: 0.470419 Oct 24 10:47:19.833397 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2396/4840] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:19 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1515 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:19.993016 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7ea5bdd0-ea57-42c3-9c31-eec1f4c95ccd tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 204 len: 0 microversion: 2.1 time: 0.270050 Oct 24 10:47:19.994178 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2445/4841] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:47:19 2022] DELETE /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:47:20.004672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3836e487-fc7a-413b-9fa3-be376c61d00f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:20.005574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3836e487-fc7a-413b-9fa3-be376c61d00f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:20.013934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3836e487-fc7a-413b-9fa3-be376c61d00f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:20.014462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3836e487-fc7a-413b-9fa3-be376c61d00f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:20.014856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3836e487-fc7a-413b-9fa3-be376c61d00f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:20.015764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3836e487-fc7a-413b-9fa3-be376c61d00f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:20.016418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3836e487-fc7a-413b-9fa3-be376c61d00f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:20.016868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3836e487-fc7a-413b-9fa3-be376c61d00f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:20.105514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ea0e93df-48a7-405d-a012-a08a2b305343 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:20.107816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ea0e93df-48a7-405d-a012-a08a2b305343 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:20.114753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea0e93df-48a7-405d-a012-a08a2b305343 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:20.115538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea0e93df-48a7-405d-a012-a08a2b305343 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:20.116141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea0e93df-48a7-405d-a012-a08a2b305343 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:20.117144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea0e93df-48a7-405d-a012-a08a2b305343 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:20.117827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea0e93df-48a7-405d-a012-a08a2b305343 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:20.118424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea0e93df-48a7-405d-a012-a08a2b305343 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:20.318057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3836e487-fc7a-413b-9fa3-be376c61d00f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:20.328813 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3836e487-fc7a-413b-9fa3-be376c61d00f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1494 microversion: 2.1 time: 0.329630 Oct 24 10:47:20.330476 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2397/4842] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:19 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1494 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:20.422425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ea0e93df-48a7-405d-a012-a08a2b305343 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446c9d2505a348a5a5b3369d38985451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a140969afb4058ae5bb7cb62d58f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:20.431233 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ea0e93df-48a7-405d-a012-a08a2b305343 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 200 len: 1324 microversion: 2.1 time: 0.331226 Oct 24 10:47:20.431850 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2446/4843] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:20 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 1324 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:20.832317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-db4fd96f-e1ee-4d90-ad3b-e69da0c84608 req-0a5086f3-8a52-4bfb-bb3c-b486d9cb0839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36bf2b2f-b787-456b-bfdb-a72e729004c3", "tag": "a1fa292f-fa97-46f8-85e4-231329118adc"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:20.858403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2e4528f6-abd9-43e3-9798-29c949b31833 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:20.859637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2e4528f6-abd9-43e3-9798-29c949b31833 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:20.865767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-db4fd96f-e1ee-4d90-ad3b-e69da0c84608 req-0a5086f3-8a52-4bfb-bb3c-b486d9cb0839 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:20.866878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-db4fd96f-e1ee-4d90-ad3b-e69da0c84608 req-0a5086f3-8a52-4bfb-bb3c-b486d9cb0839 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:20.867332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-db4fd96f-e1ee-4d90-ad3b-e69da0c84608 req-0a5086f3-8a52-4bfb-bb3c-b486d9cb0839 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:20.872506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e4528f6-abd9-43e3-9798-29c949b31833 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:20.874220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e4528f6-abd9-43e3-9798-29c949b31833 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:20.874220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e4528f6-abd9-43e3-9798-29c949b31833 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:20.874220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e4528f6-abd9-43e3-9798-29c949b31833 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:20.874895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e4528f6-abd9-43e3-9798-29c949b31833 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:20.875526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e4528f6-abd9-43e3-9798-29c949b31833 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:20.894753 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-db4fd96f-e1ee-4d90-ad3b-e69da0c84608 req-0a5086f3-8a52-4bfb-bb3c-b486d9cb0839 service nova] Creating event network-changed:a1fa292f-fa97-46f8-85e4-231329118adc for instance 36bf2b2f-b787-456b-bfdb-a72e729004c3 on n-h2-858383-15 Oct 24 10:47:20.911451 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-db4fd96f-e1ee-4d90-ad3b-e69da0c84608 req-0a5086f3-8a52-4bfb-bb3c-b486d9cb0839 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084835 Oct 24 10:47:20.912224 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2398/4844] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:47:21.104777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2e4528f6-abd9-43e3-9798-29c949b31833 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:21.114313 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2e4528f6-abd9-43e3-9798-29c949b31833 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1521 microversion: 2.1 time: 0.260782 Oct 24 10:47:21.131029 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2447/4845] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:20 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:21.359052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0c660184-0fa7-48f4-80b3-7083d1129a37 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:21.359948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0c660184-0fa7-48f4-80b3-7083d1129a37 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:21.376294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c660184-0fa7-48f4-80b3-7083d1129a37 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:21.377123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c660184-0fa7-48f4-80b3-7083d1129a37 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:21.377753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c660184-0fa7-48f4-80b3-7083d1129a37 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:21.378739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c660184-0fa7-48f4-80b3-7083d1129a37 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:21.380608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c660184-0fa7-48f4-80b3-7083d1129a37 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:21.381273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c660184-0fa7-48f4-80b3-7083d1129a37 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:21.455877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-66928ab5-bfda-427a-81bf-f3ffb44ffc3c tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:21.456499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-66928ab5-bfda-427a-81bf-f3ffb44ffc3c tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:21.468353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66928ab5-bfda-427a-81bf-f3ffb44ffc3c tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:21.469297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66928ab5-bfda-427a-81bf-f3ffb44ffc3c tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:21.469633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66928ab5-bfda-427a-81bf-f3ffb44ffc3c tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:21.474254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66928ab5-bfda-427a-81bf-f3ffb44ffc3c tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:21.474905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66928ab5-bfda-427a-81bf-f3ffb44ffc3c tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:21.475897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66928ab5-bfda-427a-81bf-f3ffb44ffc3c tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:21.830648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-66928ab5-bfda-427a-81bf-f3ffb44ffc3c tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446c9d2505a348a5a5b3369d38985451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a140969afb4058ae5bb7cb62d58f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:21.842912 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-66928ab5-bfda-427a-81bf-f3ffb44ffc3c tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 200 len: 1324 microversion: 2.1 time: 0.388721 Oct 24 10:47:21.845560 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2448/4846] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:21 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 1324 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:21.877909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0c660184-0fa7-48f4-80b3-7083d1129a37 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:21.893786 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0c660184-0fa7-48f4-80b3-7083d1129a37 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1494 microversion: 2.1 time: 0.540570 Oct 24 10:47:21.906369 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2399/4847] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:21 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1494 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:22.158840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d2ed5383-96b0-4b20-87c1-d04acbea9132 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:22.160276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d2ed5383-96b0-4b20-87c1-d04acbea9132 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:22.167769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2ed5383-96b0-4b20-87c1-d04acbea9132 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:22.168513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2ed5383-96b0-4b20-87c1-d04acbea9132 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:22.169229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2ed5383-96b0-4b20-87c1-d04acbea9132 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:22.170434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2ed5383-96b0-4b20-87c1-d04acbea9132 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:22.171115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2ed5383-96b0-4b20-87c1-d04acbea9132 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:22.171778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2ed5383-96b0-4b20-87c1-d04acbea9132 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:22.368618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d2ed5383-96b0-4b20-87c1-d04acbea9132 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:22.381501 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d2ed5383-96b0-4b20-87c1-d04acbea9132 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1521 microversion: 2.1 time: 0.228214 Oct 24 10:47:22.393610 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2449/4848] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:22 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:22.868037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31840cb6-8cde-481b-86da-ac114c88ace4 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:22.868666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31840cb6-8cde-481b-86da-ac114c88ace4 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:22.876905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31840cb6-8cde-481b-86da-ac114c88ace4 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:22.877409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31840cb6-8cde-481b-86da-ac114c88ace4 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:22.877840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31840cb6-8cde-481b-86da-ac114c88ace4 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:22.878556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31840cb6-8cde-481b-86da-ac114c88ace4 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:22.879101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31840cb6-8cde-481b-86da-ac114c88ace4 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:22.879434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31840cb6-8cde-481b-86da-ac114c88ace4 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:22.922528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0645effe-b9ee-490b-b489-35255fcaf483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:22.923168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0645effe-b9ee-490b-b489-35255fcaf483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:22.930726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0645effe-b9ee-490b-b489-35255fcaf483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:22.931106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0645effe-b9ee-490b-b489-35255fcaf483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:22.931554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0645effe-b9ee-490b-b489-35255fcaf483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:22.932422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0645effe-b9ee-490b-b489-35255fcaf483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:22.933093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0645effe-b9ee-490b-b489-35255fcaf483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:22.933694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0645effe-b9ee-490b-b489-35255fcaf483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:23.066844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0645effe-b9ee-490b-b489-35255fcaf483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:23.088104 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0645effe-b9ee-490b-b489-35255fcaf483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1452 microversion: 2.1 time: 0.169915 Oct 24 10:47:23.089328 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2450/4849] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:22 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:23.178123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-71df51ba-7c49-40f0-8ea2-04d5406d7ff8 req-97a1d547-e453-4084-82a4-e8bb153dad1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b55e1f7d-f0be-4eca-9123-b2df6f212b41", "name": "network-vif-deleted", "tag": "17ce799e-44e1-45e0-a869-e6a177d299e7"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:23.182538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-31840cb6-8cde-481b-86da-ac114c88ace4 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446c9d2505a348a5a5b3369d38985451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a140969afb4058ae5bb7cb62d58f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:23.227705 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31840cb6-8cde-481b-86da-ac114c88ace4 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 200 len: 1324 microversion: 2.1 time: 0.345513 Oct 24 10:47:23.228647 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2400/4850] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:22 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 1324 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:23.247552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-71df51ba-7c49-40f0-8ea2-04d5406d7ff8 req-97a1d547-e453-4084-82a4-e8bb153dad1d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:23.249048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-71df51ba-7c49-40f0-8ea2-04d5406d7ff8 req-97a1d547-e453-4084-82a4-e8bb153dad1d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:23.251173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-71df51ba-7c49-40f0-8ea2-04d5406d7ff8 req-97a1d547-e453-4084-82a4-e8bb153dad1d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:23.263425 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-71df51ba-7c49-40f0-8ea2-04d5406d7ff8 req-97a1d547-e453-4084-82a4-e8bb153dad1d service nova] Creating event network-vif-deleted:17ce799e-44e1-45e0-a869-e6a177d299e7 for instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 on n-h2-858383-15 Oct 24 10:47:23.270423 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-71df51ba-7c49-40f0-8ea2-04d5406d7ff8 req-97a1d547-e453-4084-82a4-e8bb153dad1d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101737 Oct 24 10:47:23.281793 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2451/4851] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:47:23.407464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e63fa47-36dc-42d3-8987-011ff7a25d37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:23.408460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0e63fa47-36dc-42d3-8987-011ff7a25d37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:23.431772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e63fa47-36dc-42d3-8987-011ff7a25d37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:23.436652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e63fa47-36dc-42d3-8987-011ff7a25d37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:23.437791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e63fa47-36dc-42d3-8987-011ff7a25d37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:23.440086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e63fa47-36dc-42d3-8987-011ff7a25d37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:23.441362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e63fa47-36dc-42d3-8987-011ff7a25d37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:23.443019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e63fa47-36dc-42d3-8987-011ff7a25d37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:23.644209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0e63fa47-36dc-42d3-8987-011ff7a25d37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:23.653375 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e63fa47-36dc-42d3-8987-011ff7a25d37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1521 microversion: 2.1 time: 0.250081 Oct 24 10:47:23.653375 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2401/4852] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:23 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:24.130574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6c03bc8c-26e6-40c0-9d6c-0ee8d72cbc76 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:24.131305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6c03bc8c-26e6-40c0-9d6c-0ee8d72cbc76 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:24.161809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c03bc8c-26e6-40c0-9d6c-0ee8d72cbc76 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:24.162328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c03bc8c-26e6-40c0-9d6c-0ee8d72cbc76 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:24.162774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c03bc8c-26e6-40c0-9d6c-0ee8d72cbc76 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:24.165829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c03bc8c-26e6-40c0-9d6c-0ee8d72cbc76 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:24.166687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c03bc8c-26e6-40c0-9d6c-0ee8d72cbc76 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:24.166793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c03bc8c-26e6-40c0-9d6c-0ee8d72cbc76 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:24.227712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-33e9fe4f-dc59-4f6e-8951-314ce681be18 req-962060ce-8cc1-4e17-ac83-4b547180c7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0272c314-d0fe-44d3-8f8c-b475beff2cd1", "name": "network-vif-unplugged", "status": "completed", "tag": "ddf33fbf-e51d-445c-be66-c7f9b44e3d6c"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:24.250098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-33e9fe4f-dc59-4f6e-8951-314ce681be18 req-962060ce-8cc1-4e17-ac83-4b547180c7a2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:24.250322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c03bc8c-26e6-40c0-9d6c-0ee8d72cbc76 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:24.251986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c03bc8c-26e6-40c0-9d6c-0ee8d72cbc76 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:24.252627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c03bc8c-26e6-40c0-9d6c-0ee8d72cbc76 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:24.253704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-6c03bc8c-26e6-40c0-9d6c-0ee8d72cbc76 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lazy-loading 'fault' on Instance uuid b55e1f7d-f0be-4eca-9123-b2df6f212b41 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:47:24.262973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-33e9fe4f-dc59-4f6e-8951-314ce681be18 req-962060ce-8cc1-4e17-ac83-4b547180c7a2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:24.263438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-33e9fe4f-dc59-4f6e-8951-314ce681be18 req-962060ce-8cc1-4e17-ac83-4b547180c7a2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:24.284999 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-33e9fe4f-dc59-4f6e-8951-314ce681be18 req-962060ce-8cc1-4e17-ac83-4b547180c7a2 service nova] Creating event network-vif-unplugged:ddf33fbf-e51d-445c-be66-c7f9b44e3d6c for instance 0272c314-d0fe-44d3-8f8c-b475beff2cd1 on n-h1-858383-15 Oct 24 10:47:24.313696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6c03bc8c-26e6-40c0-9d6c-0ee8d72cbc76 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:24.315905 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-33e9fe4f-dc59-4f6e-8951-314ce681be18 req-962060ce-8cc1-4e17-ac83-4b547180c7a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091104 Oct 24 10:47:24.318462 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2402/4853] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:47:24.325428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-03fa2bc4-b888-45f8-ada1-f607240a8b13 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:24.326063 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6c03bc8c-26e6-40c0-9d6c-0ee8d72cbc76 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 200 len: 1310 microversion: 2.1 time: 0.216748 Oct 24 10:47:24.326189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-03fa2bc4-b888-45f8-ada1-f607240a8b13 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:24.327532 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2452/4854] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:24 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 1310 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:24.342997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03fa2bc4-b888-45f8-ada1-f607240a8b13 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:24.345637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03fa2bc4-b888-45f8-ada1-f607240a8b13 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:24.346348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03fa2bc4-b888-45f8-ada1-f607240a8b13 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:24.347350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03fa2bc4-b888-45f8-ada1-f607240a8b13 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:24.348084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03fa2bc4-b888-45f8-ada1-f607240a8b13 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:24.348670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03fa2bc4-b888-45f8-ada1-f607240a8b13 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:24.586057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-03fa2bc4-b888-45f8-ada1-f607240a8b13 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446c9d2505a348a5a5b3369d38985451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a140969afb4058ae5bb7cb62d58f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:24.595783 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-03fa2bc4-b888-45f8-ada1-f607240a8b13 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 200 len: 1324 microversion: 2.1 time: 0.275322 Oct 24 10:47:24.596381 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2403/4855] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:24 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 1324 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:24.678914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-41020b10-5c4c-4ba4-a71d-85f38c1e226a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:24.679797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-41020b10-5c4c-4ba4-a71d-85f38c1e226a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:24.687418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41020b10-5c4c-4ba4-a71d-85f38c1e226a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:24.687994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41020b10-5c4c-4ba4-a71d-85f38c1e226a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:24.688813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41020b10-5c4c-4ba4-a71d-85f38c1e226a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:24.689835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41020b10-5c4c-4ba4-a71d-85f38c1e226a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:24.690714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41020b10-5c4c-4ba4-a71d-85f38c1e226a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:24.691217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41020b10-5c4c-4ba4-a71d-85f38c1e226a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:24.937484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-41020b10-5c4c-4ba4-a71d-85f38c1e226a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:24.951490 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-41020b10-5c4c-4ba4-a71d-85f38c1e226a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1521 microversion: 2.1 time: 0.277295 Oct 24 10:47:24.952070 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2453/4856] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:24 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:25.352952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6592b018-7dcb-4c70-8119-280a0b80450a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:25.353525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6592b018-7dcb-4c70-8119-280a0b80450a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:25.368927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6592b018-7dcb-4c70-8119-280a0b80450a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.368927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6592b018-7dcb-4c70-8119-280a0b80450a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.368927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6592b018-7dcb-4c70-8119-280a0b80450a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.375539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6592b018-7dcb-4c70-8119-280a0b80450a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.377127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6592b018-7dcb-4c70-8119-280a0b80450a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.377575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6592b018-7dcb-4c70-8119-280a0b80450a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.420498 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-6592b018-7dcb-4c70-8119-280a0b80450a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 could not be found. Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6592b018-7dcb-4c70-8119-280a0b80450a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 HTTP/1.1 Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 could not be found. Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'b55e1f7d-f0be-4eca-9123-b2df6f212b41'} Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 could not be found. Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 could not be found. Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.422467 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.429153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.429153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.429153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:25.429153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:25.429153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 could not be found. Oct 24 10:47:25.429153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.429153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6592b018-7dcb-4c70-8119-280a0b80450a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:25.429153 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6592b018-7dcb-4c70-8119-280a0b80450a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 404 len: 111 microversion: 2.1 time: 0.076164 Oct 24 10:47:25.432363 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2404/4857] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:25 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:25.448089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9b90ec68-0739-4686-876e-41030a06787f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:25.449851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9b90ec68-0739-4686-876e-41030a06787f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:25.460771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b90ec68-0739-4686-876e-41030a06787f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.461980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b90ec68-0739-4686-876e-41030a06787f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.463209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b90ec68-0739-4686-876e-41030a06787f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.464684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b90ec68-0739-4686-876e-41030a06787f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.466082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b90ec68-0739-4686-876e-41030a06787f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.467360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b90ec68-0739-4686-876e-41030a06787f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.489944 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-9b90ec68-0739-4686-876e-41030a06787f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 could not be found. Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9b90ec68-0739-4686-876e-41030a06787f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 HTTP/1.1 Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 could not be found. Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'b55e1f7d-f0be-4eca-9123-b2df6f212b41'} Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 could not be found. Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:25.492131 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 could not be found. Oct 24 10:47:25.498040 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.498040 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.498040 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.498040 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.498040 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.498040 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.498040 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:25.498040 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:25.498040 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 could not be found. Oct 24 10:47:25.498040 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.501729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9b90ec68-0739-4686-876e-41030a06787f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:25.503051 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9b90ec68-0739-4686-876e-41030a06787f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 404 len: 111 microversion: 2.1 time: 0.059613 Oct 24 10:47:25.504203 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2454/4858] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:47:25 2022] DELETE /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:25.512395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ae4504b-f3a4-4a77-b570-f4f53a2f2adb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:25.513197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0ae4504b-f3a4-4a77-b570-f4f53a2f2adb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: b55e1f7d-f0be-4eca-9123-b2df6f212b41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:25.519787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ae4504b-f3a4-4a77-b570-f4f53a2f2adb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.520291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ae4504b-f3a4-4a77-b570-f4f53a2f2adb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.520734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ae4504b-f3a4-4a77-b570-f4f53a2f2adb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.521838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ae4504b-f3a4-4a77-b570-f4f53a2f2adb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.523883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ae4504b-f3a4-4a77-b570-f4f53a2f2adb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.524384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ae4504b-f3a4-4a77-b570-f4f53a2f2adb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.556882 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-0ae4504b-f3a4-4a77-b570-f4f53a2f2adb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 could not be found. Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ae4504b-f3a4-4a77-b570-f4f53a2f2adb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 HTTP/1.1 Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 could not be found. Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'b55e1f7d-f0be-4eca-9123-b2df6f212b41'} Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 could not be found. Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 could not be found. Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.559177 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.565901 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.565901 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.565901 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:25.565901 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:25.565901 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 could not be found. Oct 24 10:47:25.565901 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.565901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ae4504b-f3a4-4a77-b570-f4f53a2f2adb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance b55e1f7d-f0be-4eca-9123-b2df6f212b41 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:25.565901 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0ae4504b-f3a4-4a77-b570-f4f53a2f2adb tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41" status: 404 len: 111 microversion: 2.1 time: 0.052578 Oct 24 10:47:25.565901 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2405/4859] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:25 2022] GET /compute/v2.1/servers/b55e1f7d-f0be-4eca-9123-b2df6f212b41 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:47:25.571138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-53ef961a-b959-4d9d-8fa7-25f1cea5d606 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:25.572058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-53ef961a-b959-4d9d-8fa7-25f1cea5d606 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:25.579867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53ef961a-b959-4d9d-8fa7-25f1cea5d606 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.580478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53ef961a-b959-4d9d-8fa7-25f1cea5d606 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.581032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53ef961a-b959-4d9d-8fa7-25f1cea5d606 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.581812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53ef961a-b959-4d9d-8fa7-25f1cea5d606 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.582596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53ef961a-b959-4d9d-8fa7-25f1cea5d606 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.583239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53ef961a-b959-4d9d-8fa7-25f1cea5d606 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.604148 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-53ef961a-b959-4d9d-8fa7-25f1cea5d606 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance 1335ca39-c87a-463e-9952-cdefaea18272 could not be found. Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-53ef961a-b959-4d9d-8fa7-25f1cea5d606 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 HTTP/1.1 Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 1335ca39-c87a-463e-9952-cdefaea18272 could not be found. Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '1335ca39-c87a-463e-9952-cdefaea18272'} Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1335ca39-c87a-463e-9952-cdefaea18272 could not be found. Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:25.607108 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1335ca39-c87a-463e-9952-cdefaea18272 could not be found. Oct 24 10:47:25.614390 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.614390 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.614390 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.614390 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.614390 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.614390 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.614390 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:25.614390 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:25.614390 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1335ca39-c87a-463e-9952-cdefaea18272 could not be found. Oct 24 10:47:25.614390 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.614390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-53ef961a-b959-4d9d-8fa7-25f1cea5d606 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance 1335ca39-c87a-463e-9952-cdefaea18272 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:25.614390 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-53ef961a-b959-4d9d-8fa7-25f1cea5d606 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 404 len: 111 microversion: 2.1 time: 0.045042 Oct 24 10:47:25.617123 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2455/4860] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:47:25 2022] DELETE /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:25.623339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-16a15dde-1e7d-438d-accb-56fccced94e1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:25.624989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-16a15dde-1e7d-438d-accb-56fccced94e1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 1335ca39-c87a-463e-9952-cdefaea18272] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:25.632733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16a15dde-1e7d-438d-accb-56fccced94e1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.633345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b80eeb2f-42dd-40f2-b205-4e2a92d5564b tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:25.633738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16a15dde-1e7d-438d-accb-56fccced94e1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.634371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16a15dde-1e7d-438d-accb-56fccced94e1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.635246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16a15dde-1e7d-438d-accb-56fccced94e1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.636134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16a15dde-1e7d-438d-accb-56fccced94e1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.636724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16a15dde-1e7d-438d-accb-56fccced94e1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.644585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b80eeb2f-42dd-40f2-b205-4e2a92d5564b tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:25.656359 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-16a15dde-1e7d-438d-accb-56fccced94e1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance 1335ca39-c87a-463e-9952-cdefaea18272 could not be found. Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-16a15dde-1e7d-438d-accb-56fccced94e1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 HTTP/1.1 Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 1335ca39-c87a-463e-9952-cdefaea18272 could not be found. Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '1335ca39-c87a-463e-9952-cdefaea18272'} Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1335ca39-c87a-463e-9952-cdefaea18272 could not be found. Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1335ca39-c87a-463e-9952-cdefaea18272 could not be found. Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.659262 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.663755 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.663755 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.663755 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:25.663755 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:25.663755 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1335ca39-c87a-463e-9952-cdefaea18272 could not be found. Oct 24 10:47:25.663755 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.664934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-16a15dde-1e7d-438d-accb-56fccced94e1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance 1335ca39-c87a-463e-9952-cdefaea18272 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:25.666198 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-16a15dde-1e7d-438d-accb-56fccced94e1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272" status: 404 len: 111 microversion: 2.1 time: 0.046891 Oct 24 10:47:25.666847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b80eeb2f-42dd-40f2-b205-4e2a92d5564b tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.670517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b80eeb2f-42dd-40f2-b205-4e2a92d5564b tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.672127 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2406/4861] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:25 2022] GET /compute/v2.1/servers/1335ca39-c87a-463e-9952-cdefaea18272 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:25.672733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b80eeb2f-42dd-40f2-b205-4e2a92d5564b tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.678787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b80eeb2f-42dd-40f2-b205-4e2a92d5564b tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.679294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b80eeb2f-42dd-40f2-b205-4e2a92d5564b tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.680926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f83286a8-b4cf-4ebe-8586-6548cef34fc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:25.682237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f83286a8-b4cf-4ebe-8586-6548cef34fc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:25.683243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b80eeb2f-42dd-40f2-b205-4e2a92d5564b tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.690533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f83286a8-b4cf-4ebe-8586-6548cef34fc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.691328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f83286a8-b4cf-4ebe-8586-6548cef34fc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.692245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f83286a8-b4cf-4ebe-8586-6548cef34fc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.693215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f83286a8-b4cf-4ebe-8586-6548cef34fc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.693834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f83286a8-b4cf-4ebe-8586-6548cef34fc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.694424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f83286a8-b4cf-4ebe-8586-6548cef34fc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.719465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:47:25.724942 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-f83286a8-b4cf-4ebe-8586-6548cef34fc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 could not be found. Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f83286a8-b4cf-4ebe-8586-6548cef34fc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 HTTP/1.1 Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 could not be found. Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'ab3cd53e-83ed-45b4-82ac-882fb65759f9'} Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 could not be found. Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:25.728503 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 could not be found. Oct 24 10:47:25.733397 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.733397 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.733397 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.733397 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.733397 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.733397 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.733397 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:25.733397 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:25.733397 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 could not be found. Oct 24 10:47:25.733397 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.736487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f83286a8-b4cf-4ebe-8586-6548cef34fc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:25.738086 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f83286a8-b4cf-4ebe-8586-6548cef34fc0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 404 len: 111 microversion: 2.1 time: 0.063868 Oct 24 10:47:25.738890 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2407/4862] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:47:25 2022] DELETE /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:25.748046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-feadfe31-f1f8-41bb-a159-f2ec87fb035f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:25.749583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-feadfe31-f1f8-41bb-a159-f2ec87fb035f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: ab3cd53e-83ed-45b4-82ac-882fb65759f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:25.772073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-feadfe31-f1f8-41bb-a159-f2ec87fb035f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.772587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-feadfe31-f1f8-41bb-a159-f2ec87fb035f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.773059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-feadfe31-f1f8-41bb-a159-f2ec87fb035f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.774141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-feadfe31-f1f8-41bb-a159-f2ec87fb035f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.774675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-feadfe31-f1f8-41bb-a159-f2ec87fb035f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.775139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-feadfe31-f1f8-41bb-a159-f2ec87fb035f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.819307 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-feadfe31-f1f8-41bb-a159-f2ec87fb035f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 could not be found. Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-feadfe31-f1f8-41bb-a159-f2ec87fb035f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 HTTP/1.1 Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 could not be found. Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'ab3cd53e-83ed-45b4-82ac-882fb65759f9'} Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 could not be found. Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 could not be found. Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.826822 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.836904 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.836904 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.836904 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:25.836904 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:25.836904 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 could not be found. Oct 24 10:47:25.836904 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.836904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-feadfe31-f1f8-41bb-a159-f2ec87fb035f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance ab3cd53e-83ed-45b4-82ac-882fb65759f9 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:25.836904 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-feadfe31-f1f8-41bb-a159-f2ec87fb035f tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9" status: 404 len: 111 microversion: 2.1 time: 0.085752 Oct 24 10:47:25.836904 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2408/4863] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:25 2022] GET /compute/v2.1/servers/ab3cd53e-83ed-45b4-82ac-882fb65759f9 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:25.848427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b85de64-193e-473b-a8ec-82526b71c750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:25.848984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6b85de64-193e-473b-a8ec-82526b71c750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:25.856940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b85de64-193e-473b-a8ec-82526b71c750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.858356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b85de64-193e-473b-a8ec-82526b71c750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.859516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b85de64-193e-473b-a8ec-82526b71c750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.860676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b85de64-193e-473b-a8ec-82526b71c750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.861236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b85de64-193e-473b-a8ec-82526b71c750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.861713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b85de64-193e-473b-a8ec-82526b71c750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.879801 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-6b85de64-193e-473b-a8ec-82526b71c750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc could not be found. Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b85de64-193e-473b-a8ec-82526b71c750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc HTTP/1.1 Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc could not be found. Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'bb7d1046-0eb6-43eb-b688-650eb6f4f6fc'} Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc could not be found. Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:25.881593 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc could not be found. Oct 24 10:47:25.888405 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.888405 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.888405 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.888405 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.888405 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.888405 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.888405 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:25.888405 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:25.888405 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc could not be found. Oct 24 10:47:25.888405 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.888405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b85de64-193e-473b-a8ec-82526b71c750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:25.890084 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6b85de64-193e-473b-a8ec-82526b71c750 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 404 len: 111 microversion: 2.1 time: 0.051231 Oct 24 10:47:25.890826 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2409/4864] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:47:25 2022] DELETE /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:25.901788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-198d2f1a-0cc3-4029-a70a-5b38918331af tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:25.902399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-198d2f1a-0cc3-4029-a70a-5b38918331af tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bb7d1046-0eb6-43eb-b688-650eb6f4f6fc] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:25.913602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-198d2f1a-0cc3-4029-a70a-5b38918331af tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.914191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-198d2f1a-0cc3-4029-a70a-5b38918331af tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.914532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-198d2f1a-0cc3-4029-a70a-5b38918331af tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.915242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-198d2f1a-0cc3-4029-a70a-5b38918331af tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.915686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-198d2f1a-0cc3-4029-a70a-5b38918331af tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.916157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-198d2f1a-0cc3-4029-a70a-5b38918331af tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.925429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b80eeb2f-42dd-40f2-b205-4e2a92d5564b tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446c9d2505a348a5a5b3369d38985451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a140969afb4058ae5bb7cb62d58f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:25.931956 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-198d2f1a-0cc3-4029-a70a-5b38918331af tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc could not be found. Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-198d2f1a-0cc3-4029-a70a-5b38918331af tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc HTTP/1.1 Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc could not be found. Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'bb7d1046-0eb6-43eb-b688-650eb6f4f6fc'} Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc could not be found. Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc could not be found. Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.933373 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.939741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.939741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.939741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:25.939741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:25.939741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc could not be found. Oct 24 10:47:25.939741 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.939741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-198d2f1a-0cc3-4029-a70a-5b38918331af tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance bb7d1046-0eb6-43eb-b688-650eb6f4f6fc could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:25.939741 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-198d2f1a-0cc3-4029-a70a-5b38918331af tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc" status: 404 len: 111 microversion: 2.1 time: 0.038576 Oct 24 10:47:25.939741 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2410/4865] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:25 2022] GET /compute/v2.1/servers/bb7d1046-0eb6-43eb-b688-650eb6f4f6fc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:25.940995 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b80eeb2f-42dd-40f2-b205-4e2a92d5564b tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 200 len: 1324 microversion: 2.1 time: 0.319072 Oct 24 10:47:25.950447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7283687c-bb6c-438b-9486-e3b2828319e5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:25.951385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7283687c-bb6c-438b-9486-e3b2828319e5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:25.963736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7283687c-bb6c-438b-9486-e3b2828319e5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.964374 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2456/4866] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:25 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 1324 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:25.964697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7283687c-bb6c-438b-9486-e3b2828319e5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.965343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7283687c-bb6c-438b-9486-e3b2828319e5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.966409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7283687c-bb6c-438b-9486-e3b2828319e5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.967024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7283687c-bb6c-438b-9486-e3b2828319e5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.967611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7283687c-bb6c-438b-9486-e3b2828319e5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.985549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6aafddcf-702e-4428-9308-ec77746c194d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:25.986158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6aafddcf-702e-4428-9308-ec77746c194d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:25.986743 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-7283687c-bb6c-438b-9486-e3b2828319e5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance bf49c481-07dd-4401-b045-5f0945291b50 could not be found. Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7283687c-bb6c-438b-9486-e3b2828319e5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 HTTP/1.1 Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance bf49c481-07dd-4401-b045-5f0945291b50 could not be found. Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'bf49c481-07dd-4401-b045-5f0945291b50'} Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf49c481-07dd-4401-b045-5f0945291b50 could not be found. Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:25.988496 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf49c481-07dd-4401-b045-5f0945291b50 could not be found. Oct 24 10:47:25.993152 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.993152 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:25.993152 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.993152 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:25.993152 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:25.993152 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:25.993152 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:25.993152 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:25.993152 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf49c481-07dd-4401-b045-5f0945291b50 could not be found. Oct 24 10:47:25.993152 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:25.994367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6aafddcf-702e-4428-9308-ec77746c194d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.995013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6aafddcf-702e-4428-9308-ec77746c194d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.995471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6aafddcf-702e-4428-9308-ec77746c194d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:25.995926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7283687c-bb6c-438b-9486-e3b2828319e5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance bf49c481-07dd-4401-b045-5f0945291b50 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:25.997196 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7283687c-bb6c-438b-9486-e3b2828319e5 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 404 len: 111 microversion: 2.1 time: 0.052257 Oct 24 10:47:25.997755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6aafddcf-702e-4428-9308-ec77746c194d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:25.998215 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2411/4867] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:47:25 2022] DELETE /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:25.998637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6aafddcf-702e-4428-9308-ec77746c194d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:25.999676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6aafddcf-702e-4428-9308-ec77746c194d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:26.008012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7769430c-b669-43c1-ac6a-ed9d175d4f69 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:26.008922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7769430c-b669-43c1-ac6a-ed9d175d4f69 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: bf49c481-07dd-4401-b045-5f0945291b50] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:26.018188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7769430c-b669-43c1-ac6a-ed9d175d4f69 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:26.019151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7769430c-b669-43c1-ac6a-ed9d175d4f69 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:26.019900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7769430c-b669-43c1-ac6a-ed9d175d4f69 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:26.020818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7769430c-b669-43c1-ac6a-ed9d175d4f69 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:26.021514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7769430c-b669-43c1-ac6a-ed9d175d4f69 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:26.021984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7769430c-b669-43c1-ac6a-ed9d175d4f69 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:26.050558 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-7769430c-b669-43c1-ac6a-ed9d175d4f69 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance bf49c481-07dd-4401-b045-5f0945291b50 could not be found. Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7769430c-b669-43c1-ac6a-ed9d175d4f69 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 HTTP/1.1 Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance bf49c481-07dd-4401-b045-5f0945291b50 could not be found. Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'bf49c481-07dd-4401-b045-5f0945291b50'} Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf49c481-07dd-4401-b045-5f0945291b50 could not be found. Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf49c481-07dd-4401-b045-5f0945291b50 could not be found. Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.052413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:26.057045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:26.057045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:26.057045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:26.057045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:26.057045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf49c481-07dd-4401-b045-5f0945291b50 could not be found. Oct 24 10:47:26.057045 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.059808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7769430c-b669-43c1-ac6a-ed9d175d4f69 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance bf49c481-07dd-4401-b045-5f0945291b50 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:26.061264 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7769430c-b669-43c1-ac6a-ed9d175d4f69 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50" status: 404 len: 111 microversion: 2.1 time: 0.058090 Oct 24 10:47:26.061822 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2412/4868] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:26 2022] GET /compute/v2.1/servers/bf49c481-07dd-4401-b045-5f0945291b50 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:26.071455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6c430424-cb91-4b8e-87a1-ac4147faeca0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:26.072232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6c430424-cb91-4b8e-87a1-ac4147faeca0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:26.080113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c430424-cb91-4b8e-87a1-ac4147faeca0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:26.081053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c430424-cb91-4b8e-87a1-ac4147faeca0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:26.082010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c430424-cb91-4b8e-87a1-ac4147faeca0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:26.082932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c430424-cb91-4b8e-87a1-ac4147faeca0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:26.083581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c430424-cb91-4b8e-87a1-ac4147faeca0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:26.084198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c430424-cb91-4b8e-87a1-ac4147faeca0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:26.102047 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-6c430424-cb91-4b8e-87a1-ac4147faeca0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 could not be found. Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6c430424-cb91-4b8e-87a1-ac4147faeca0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 HTTP/1.1 Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 could not be found. Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '3a8d0dbd-d76e-49fe-9120-796e315a72d1'} Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 could not be found. Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:26.103931 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 could not be found. Oct 24 10:47:26.110500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.110500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:26.110500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.110500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:26.110500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:26.110500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:26.110500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:26.110500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:26.110500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 could not be found. Oct 24 10:47:26.110500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.110500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6c430424-cb91-4b8e-87a1-ac4147faeca0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:26.110500 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6c430424-cb91-4b8e-87a1-ac4147faeca0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 404 len: 111 microversion: 2.1 time: 0.043227 Oct 24 10:47:26.112158 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2413/4869] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:47:26 2022] DELETE /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:26.121371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-56e50df5-1e32-482b-a90d-913eca505ece tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:26.122149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-56e50df5-1e32-482b-a90d-913eca505ece tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 3a8d0dbd-d76e-49fe-9120-796e315a72d1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:26.134887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56e50df5-1e32-482b-a90d-913eca505ece tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:26.135530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56e50df5-1e32-482b-a90d-913eca505ece tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:26.136287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56e50df5-1e32-482b-a90d-913eca505ece tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:26.137104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56e50df5-1e32-482b-a90d-913eca505ece tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:26.137622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56e50df5-1e32-482b-a90d-913eca505ece tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:26.138207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56e50df5-1e32-482b-a90d-913eca505ece tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:26.155301 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-56e50df5-1e32-482b-a90d-913eca505ece tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 could not be found. Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-56e50df5-1e32-482b-a90d-913eca505ece tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 HTTP/1.1 Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 could not be found. Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '3a8d0dbd-d76e-49fe-9120-796e315a72d1'} Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 could not be found. Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 could not be found. Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.157301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:26.161550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:26.161550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:26.161550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:26.161550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:26.161550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 could not be found. Oct 24 10:47:26.161550 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.162959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-56e50df5-1e32-482b-a90d-913eca505ece tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance 3a8d0dbd-d76e-49fe-9120-796e315a72d1 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:26.164032 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-56e50df5-1e32-482b-a90d-913eca505ece tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1" status: 404 len: 111 microversion: 2.1 time: 0.047571 Oct 24 10:47:26.164648 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2414/4870] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:26 2022] GET /compute/v2.1/servers/3a8d0dbd-d76e-49fe-9120-796e315a72d1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:26.174992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3505ffab-fee5-4771-9a9c-28155501911a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:26.175702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3505ffab-fee5-4771-9a9c-28155501911a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:26.181687 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-3505ffab-fee5-4771-9a9c-28155501911a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe could not be found. Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3505ffab-fee5-4771-9a9c-28155501911a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/7a4d9079-08a8-4c68-b6b4-5f0693fb03fe HTTP/1.1 Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe could not be found. Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '7a4d9079-08a8-4c68-b6b4-5f0693fb03fe'} Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe could not be found. Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe could not be found. Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:26.183231 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.191155 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:26.191155 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:26.191155 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:26.191155 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:26.191155 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:26.191155 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe could not be found. Oct 24 10:47:26.191155 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.191155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3505ffab-fee5-4771-9a9c-28155501911a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:26.191155 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3505ffab-fee5-4771-9a9c-28155501911a tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7a4d9079-08a8-4c68-b6b4-5f0693fb03fe" status: 404 len: 111 microversion: 2.1 time: 0.015657 Oct 24 10:47:26.191155 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2415/4871] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:47:26 2022] DELETE /compute/v2.1/servers/7a4d9079-08a8-4c68-b6b4-5f0693fb03fe => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:26.195564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-69400ed1-337b-4df0-8cd3-93b94c2c40f9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:26.195564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-69400ed1-337b-4df0-8cd3-93b94c2c40f9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:26.202214 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-69400ed1-337b-4df0-8cd3-93b94c2c40f9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe could not be found. Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-69400ed1-337b-4df0-8cd3-93b94c2c40f9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/7a4d9079-08a8-4c68-b6b4-5f0693fb03fe HTTP/1.1 Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe could not be found. Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '7a4d9079-08a8-4c68-b6b4-5f0693fb03fe'} Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe could not be found. Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe could not be found. Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:26.204188 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:26.212733 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:26.212733 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:26.212733 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe could not be found. Oct 24 10:47:26.212733 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:26.212733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-69400ed1-337b-4df0-8cd3-93b94c2c40f9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance 7a4d9079-08a8-4c68-b6b4-5f0693fb03fe could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:26.212733 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-69400ed1-337b-4df0-8cd3-93b94c2c40f9 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/7a4d9079-08a8-4c68-b6b4-5f0693fb03fe" status: 404 len: 111 microversion: 2.1 time: 0.015187 Oct 24 10:47:26.212733 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2416/4872] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:26 2022] GET /compute/v2.1/servers/7a4d9079-08a8-4c68-b6b4-5f0693fb03fe => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:47:26.214498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb8bad26-78c5-4510-88bc-face9d6b94d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:26.214869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bb8bad26-78c5-4510-88bc-face9d6b94d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:26.217340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6aafddcf-702e-4428-9308-ec77746c194d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:26.221531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb8bad26-78c5-4510-88bc-face9d6b94d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:26.222448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb8bad26-78c5-4510-88bc-face9d6b94d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:26.222892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb8bad26-78c5-4510-88bc-face9d6b94d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:26.223611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb8bad26-78c5-4510-88bc-face9d6b94d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:26.224052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb8bad26-78c5-4510-88bc-face9d6b94d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:26.224515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb8bad26-78c5-4510-88bc-face9d6b94d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:26.230378 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6aafddcf-702e-4428-9308-ec77746c194d tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1521 microversion: 2.1 time: 0.254844 Oct 24 10:47:26.230993 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2457/4873] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:25 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:26.275437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bb8bad26-78c5-4510-88bc-face9d6b94d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:47:26.324199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:47:26.394417 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bb8bad26-78c5-4510-88bc-face9d6b94d1 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "DELETE /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 204 len: 0 microversion: 2.1 time: 0.183506 Oct 24 10:47:26.400781 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2417/4874] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:47:26 2022] DELETE /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:47:26.409572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7c160d81-2bce-4993-a06b-996d47691d6e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:26.410497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7c160d81-2bce-4993-a06b-996d47691d6e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:26.419108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c160d81-2bce-4993-a06b-996d47691d6e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:26.419740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c160d81-2bce-4993-a06b-996d47691d6e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:26.420196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c160d81-2bce-4993-a06b-996d47691d6e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:26.422377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c160d81-2bce-4993-a06b-996d47691d6e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:26.423902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c160d81-2bce-4993-a06b-996d47691d6e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:26.424431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c160d81-2bce-4993-a06b-996d47691d6e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:26.614371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7c160d81-2bce-4993-a06b-996d47691d6e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:26.623080 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7c160d81-2bce-4993-a06b-996d47691d6e tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1481 microversion: 2.1 time: 0.222435 Oct 24 10:47:26.623673 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2458/4875] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:26 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1481 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:26.706744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-4eb26130-4b93-498e-a7f4-a3ef393c1546 req-9b25ecc6-98e7-4dbf-be7a-0d1c90b3de04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0272c314-d0fe-44d3-8f8c-b475beff2cd1", "name": "network-vif-plugged", "status": "completed", "tag": "ddf33fbf-e51d-445c-be66-c7f9b44e3d6c"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:26.717410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:47:26.719089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:47:26.722340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4eb26130-4b93-498e-a7f4-a3ef393c1546 req-9b25ecc6-98e7-4dbf-be7a-0d1c90b3de04 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:26.722826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4eb26130-4b93-498e-a7f4-a3ef393c1546 req-9b25ecc6-98e7-4dbf-be7a-0d1c90b3de04 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:26.723324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4eb26130-4b93-498e-a7f4-a3ef393c1546 req-9b25ecc6-98e7-4dbf-be7a-0d1c90b3de04 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:26.737700 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-4eb26130-4b93-498e-a7f4-a3ef393c1546 req-9b25ecc6-98e7-4dbf-be7a-0d1c90b3de04 service nova] Creating event network-vif-plugged:ddf33fbf-e51d-445c-be66-c7f9b44e3d6c for instance 0272c314-d0fe-44d3-8f8c-b475beff2cd1 on n-h1-858383-15 Oct 24 10:47:26.743391 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-4eb26130-4b93-498e-a7f4-a3ef393c1546 req-9b25ecc6-98e7-4dbf-be7a-0d1c90b3de04 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042020 Oct 24 10:47:26.744341 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2418/4876] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:47:26.966985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f7f9502e-87c1-4b47-a679-c17c8633f239 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:26.967617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f7f9502e-87c1-4b47-a679-c17c8633f239 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:26.970406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:47:26.977550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7f9502e-87c1-4b47-a679-c17c8633f239 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:26.978460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7f9502e-87c1-4b47-a679-c17c8633f239 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:26.979225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7f9502e-87c1-4b47-a679-c17c8633f239 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:26.980694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7f9502e-87c1-4b47-a679-c17c8633f239 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:26.981867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7f9502e-87c1-4b47-a679-c17c8633f239 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:26.982536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7f9502e-87c1-4b47-a679-c17c8633f239 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:27.186527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f7f9502e-87c1-4b47-a679-c17c8633f239 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446c9d2505a348a5a5b3369d38985451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a140969afb4058ae5bb7cb62d58f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:27.198317 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f7f9502e-87c1-4b47-a679-c17c8633f239 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 200 len: 1324 microversion: 2.1 time: 0.235657 Oct 24 10:47:27.199500 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2459/4877] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:26 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 1324 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:27.260290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bc6296db-c32d-4f10-988d-40d9c407c56b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:27.261292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bc6296db-c32d-4f10-988d-40d9c407c56b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:27.270431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc6296db-c32d-4f10-988d-40d9c407c56b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:27.270923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc6296db-c32d-4f10-988d-40d9c407c56b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:27.271360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc6296db-c32d-4f10-988d-40d9c407c56b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:27.272078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc6296db-c32d-4f10-988d-40d9c407c56b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:27.272673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc6296db-c32d-4f10-988d-40d9c407c56b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:27.273206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc6296db-c32d-4f10-988d-40d9c407c56b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:27.456116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bc6296db-c32d-4f10-988d-40d9c407c56b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:27.465814 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bc6296db-c32d-4f10-988d-40d9c407c56b tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1521 microversion: 2.1 time: 0.211873 Oct 24 10:47:27.479065 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2419/4878] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:27 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:27.649210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8fe473f2-f892-413f-ab20-0984910e8e05 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:27.650471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8fe473f2-f892-413f-ab20-0984910e8e05 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:27.659542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fe473f2-f892-413f-ab20-0984910e8e05 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:27.660382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fe473f2-f892-413f-ab20-0984910e8e05 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:27.661153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fe473f2-f892-413f-ab20-0984910e8e05 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:27.662072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fe473f2-f892-413f-ab20-0984910e8e05 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:27.662755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fe473f2-f892-413f-ab20-0984910e8e05 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:27.663496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fe473f2-f892-413f-ab20-0984910e8e05 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:27.938893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8fe473f2-f892-413f-ab20-0984910e8e05 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:27.950803 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8fe473f2-f892-413f-ab20-0984910e8e05 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1481 microversion: 2.1 time: 0.305931 Oct 24 10:47:27.953575 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2460/4879] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:27 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1481 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:28.225925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-74514f3e-fa58-4d87-bcf8-7d3042c10502 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:28.227361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-74514f3e-fa58-4d87-bcf8-7d3042c10502 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:28.238611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74514f3e-fa58-4d87-bcf8-7d3042c10502 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:28.239960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74514f3e-fa58-4d87-bcf8-7d3042c10502 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:28.240662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74514f3e-fa58-4d87-bcf8-7d3042c10502 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:28.243169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74514f3e-fa58-4d87-bcf8-7d3042c10502 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:28.245236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74514f3e-fa58-4d87-bcf8-7d3042c10502 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:28.246401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74514f3e-fa58-4d87-bcf8-7d3042c10502 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:28.480211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-74514f3e-fa58-4d87-bcf8-7d3042c10502 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446c9d2505a348a5a5b3369d38985451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a140969afb4058ae5bb7cb62d58f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:28.491112 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-74514f3e-fa58-4d87-bcf8-7d3042c10502 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 200 len: 1324 microversion: 2.1 time: 0.271988 Oct 24 10:47:28.491900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0f1218cf-8fdb-4fcc-b46f-de2200b19a9a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:28.493030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0f1218cf-8fdb-4fcc-b46f-de2200b19a9a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:28.493508 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2420/4880] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:28 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 1324 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:28.503513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f1218cf-8fdb-4fcc-b46f-de2200b19a9a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:28.504250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f1218cf-8fdb-4fcc-b46f-de2200b19a9a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:28.505256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f1218cf-8fdb-4fcc-b46f-de2200b19a9a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:28.506358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f1218cf-8fdb-4fcc-b46f-de2200b19a9a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:28.506983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f1218cf-8fdb-4fcc-b46f-de2200b19a9a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:28.507590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f1218cf-8fdb-4fcc-b46f-de2200b19a9a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:28.699716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0f1218cf-8fdb-4fcc-b46f-de2200b19a9a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:28.710289 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0f1218cf-8fdb-4fcc-b46f-de2200b19a9a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1521 microversion: 2.1 time: 0.222690 Oct 24 10:47:28.717493 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2461/4881] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:28 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:28.983589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-52d748d8-7092-4ca5-aaf5-b4bfd9bf1483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:28.984732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-52d748d8-7092-4ca5-aaf5-b4bfd9bf1483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:28.994599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52d748d8-7092-4ca5-aaf5-b4bfd9bf1483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:28.996660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52d748d8-7092-4ca5-aaf5-b4bfd9bf1483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:28.997392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52d748d8-7092-4ca5-aaf5-b4bfd9bf1483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:29.000228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52d748d8-7092-4ca5-aaf5-b4bfd9bf1483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:29.000821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52d748d8-7092-4ca5-aaf5-b4bfd9bf1483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:29.002713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-52d748d8-7092-4ca5-aaf5-b4bfd9bf1483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:29.274464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-52d748d8-7092-4ca5-aaf5-b4bfd9bf1483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:29.284786 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-52d748d8-7092-4ca5-aaf5-b4bfd9bf1483 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1481 microversion: 2.1 time: 0.311995 Oct 24 10:47:29.301455 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2421/4882] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:28 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1481 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:29.418705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-b242f16f-61a3-447c-8c64-3a637b8072de req-26a07563-c74c-4502-a2a2-8fef26451871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36bf2b2f-b787-456b-bfdb-a72e729004c3", "name": "network-vif-plugged", "status": "completed", "tag": "a1fa292f-fa97-46f8-85e4-231329118adc"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:29.441889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b242f16f-61a3-447c-8c64-3a637b8072de req-26a07563-c74c-4502-a2a2-8fef26451871 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:29.444929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b242f16f-61a3-447c-8c64-3a637b8072de req-26a07563-c74c-4502-a2a2-8fef26451871 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:29.445601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b242f16f-61a3-447c-8c64-3a637b8072de req-26a07563-c74c-4502-a2a2-8fef26451871 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:29.465992 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-b242f16f-61a3-447c-8c64-3a637b8072de req-26a07563-c74c-4502-a2a2-8fef26451871 service nova] Creating event network-vif-plugged:a1fa292f-fa97-46f8-85e4-231329118adc for instance 36bf2b2f-b787-456b-bfdb-a72e729004c3 on n-h2-858383-15 Oct 24 10:47:29.473851 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-b242f16f-61a3-447c-8c64-3a637b8072de req-26a07563-c74c-4502-a2a2-8fef26451871 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059080 Oct 24 10:47:29.476649 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2462/4883] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:47:29.521598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f178b925-998d-4a17-8710-6a4b08c61af2 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:29.524173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f178b925-998d-4a17-8710-6a4b08c61af2 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:29.544585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f178b925-998d-4a17-8710-6a4b08c61af2 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:29.547309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f178b925-998d-4a17-8710-6a4b08c61af2 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:29.548330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f178b925-998d-4a17-8710-6a4b08c61af2 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:29.549918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f178b925-998d-4a17-8710-6a4b08c61af2 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:29.553517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f178b925-998d-4a17-8710-6a4b08c61af2 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:29.554311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f178b925-998d-4a17-8710-6a4b08c61af2 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:29.740459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f547e389-082f-4ff6-ab60-23a5ac42da34 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:29.741845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f547e389-082f-4ff6-ab60-23a5ac42da34 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:29.752628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f547e389-082f-4ff6-ab60-23a5ac42da34 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:29.753427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f547e389-082f-4ff6-ab60-23a5ac42da34 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:29.754037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f547e389-082f-4ff6-ab60-23a5ac42da34 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:29.755128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f547e389-082f-4ff6-ab60-23a5ac42da34 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:29.755777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f547e389-082f-4ff6-ab60-23a5ac42da34 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:29.756504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f547e389-082f-4ff6-ab60-23a5ac42da34 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:29.763969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f178b925-998d-4a17-8710-6a4b08c61af2 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446c9d2505a348a5a5b3369d38985451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a140969afb4058ae5bb7cb62d58f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:29.774920 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f178b925-998d-4a17-8710-6a4b08c61af2 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 200 len: 1324 microversion: 2.1 time: 0.257947 Oct 24 10:47:29.776231 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2422/4884] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:29 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 1324 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:29.951814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f547e389-082f-4ff6-ab60-23a5ac42da34 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:29.962234 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f547e389-082f-4ff6-ab60-23a5ac42da34 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1506 microversion: 2.1 time: 0.228369 Oct 24 10:47:29.964620 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2463/4885] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:29 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:29.991420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-51b5ff5a-b52a-4104-92ae-dee12631547a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:29.992489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-51b5ff5a-b52a-4104-92ae-dee12631547a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:30.000055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51b5ff5a-b52a-4104-92ae-dee12631547a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:30.001133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51b5ff5a-b52a-4104-92ae-dee12631547a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:30.001874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51b5ff5a-b52a-4104-92ae-dee12631547a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:30.002850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51b5ff5a-b52a-4104-92ae-dee12631547a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:30.003532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51b5ff5a-b52a-4104-92ae-dee12631547a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:30.004254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51b5ff5a-b52a-4104-92ae-dee12631547a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:30.231177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-21f9b9fb-df68-4104-a367-1cb50811b941 req-7a534b11-ac42-480f-b8a1-22f5130253bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68c41052-4f6b-4a60-97f6-11d5743cb09f", "name": "network-vif-deleted", "tag": "a1d6ead8-7dd0-431f-bfb8-de3a8751c425"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:30.243372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-21f9b9fb-df68-4104-a367-1cb50811b941 req-7a534b11-ac42-480f-b8a1-22f5130253bb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:30.250098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-21f9b9fb-df68-4104-a367-1cb50811b941 req-7a534b11-ac42-480f-b8a1-22f5130253bb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:30.250098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-21f9b9fb-df68-4104-a367-1cb50811b941 req-7a534b11-ac42-480f-b8a1-22f5130253bb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:30.258135 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-21f9b9fb-df68-4104-a367-1cb50811b941 req-7a534b11-ac42-480f-b8a1-22f5130253bb service nova] Creating event network-vif-deleted:a1d6ead8-7dd0-431f-bfb8-de3a8751c425 for instance 68c41052-4f6b-4a60-97f6-11d5743cb09f on n-h1-858383-15 Oct 24 10:47:30.263759 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-21f9b9fb-df68-4104-a367-1cb50811b941 req-7a534b11-ac42-480f-b8a1-22f5130253bb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037340 Oct 24 10:47:30.270520 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2464/4886] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:47:30.312804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d608e1a2-7eaf-4fac-a496-fd16cc908216 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:30.313180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-51b5ff5a-b52a-4104-92ae-dee12631547a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:30.314191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d608e1a2-7eaf-4fac-a496-fd16cc908216 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:30.327338 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-51b5ff5a-b52a-4104-92ae-dee12631547a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 200 len: 1506 microversion: 2.1 time: 0.339398 Oct 24 10:47:30.329009 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2423/4887] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:29 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:30.343412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d608e1a2-7eaf-4fac-a496-fd16cc908216 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:30.345119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d608e1a2-7eaf-4fac-a496-fd16cc908216 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:30.345925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d608e1a2-7eaf-4fac-a496-fd16cc908216 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:30.347022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d608e1a2-7eaf-4fac-a496-fd16cc908216 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:30.347867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d608e1a2-7eaf-4fac-a496-fd16cc908216 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:30.348748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d608e1a2-7eaf-4fac-a496-fd16cc908216 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:30.358795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cbb763fe-a5f8-43e0-93e7-4860c84c5b30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:30.359770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cbb763fe-a5f8-43e0-93e7-4860c84c5b30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:30.368098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbb763fe-a5f8-43e0-93e7-4860c84c5b30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:30.369651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbb763fe-a5f8-43e0-93e7-4860c84c5b30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:30.370481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbb763fe-a5f8-43e0-93e7-4860c84c5b30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:30.371381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbb763fe-a5f8-43e0-93e7-4860c84c5b30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:30.372097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbb763fe-a5f8-43e0-93e7-4860c84c5b30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:30.372778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbb763fe-a5f8-43e0-93e7-4860c84c5b30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:30.409812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cbb763fe-a5f8-43e0-93e7-4860c84c5b30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:47:30.461776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d608e1a2-7eaf-4fac-a496-fd16cc908216 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:30.488968 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d608e1a2-7eaf-4fac-a496-fd16cc908216 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1278 microversion: 2.1 time: 0.181122 Oct 24 10:47:30.493000 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2465/4888] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:30 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:30.561496 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cbb763fe-a5f8-43e0-93e7-4860c84c5b30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 204 len: 0 microversion: 2.1 time: 0.207957 Oct 24 10:47:30.563353 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2424/4889] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:47:30 2022] DELETE /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 10:47:30.706559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5aad9400-df6f-4d71-8e99-28e5e4d46518 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1068166962", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "0570c513-0036-46af-96c6-484910670fdc"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Oct 24 10:47:30.793531 n-d-858383-15 devstack@n-api.service[120426]: ERROR sqlalchemy.pool.impl.QueuePool Oct 24 10:47:30.797510 n-d-858383-15 devstack@n-api.service[120426]: Exception ignored in: . at 0x7f04d0174d30> Oct 24 10:47:30.797510 n-d-858383-15 devstack@n-api.service[120426]: Traceback (most recent call last): Oct 24 10:47:30.797510 n-d-858383-15 devstack@n-api.service[120426]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 24 10:47:30.797510 n-d-858383-15 devstack@n-api.service[120426]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 24 10:47:30.797510 n-d-858383-15 devstack@n-api.service[120426]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 24 10:47:30.797510 n-d-858383-15 devstack@n-api.service[120426]: connection_record.checkin() Oct 24 10:47:30.797510 n-d-858383-15 devstack@n-api.service[120426]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 24 10:47:30.797510 n-d-858383-15 devstack@n-api.service[120426]: pool.dispatch.checkin(connection, self) Oct 24 10:47:30.797510 n-d-858383-15 devstack@n-api.service[120426]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 24 10:47:30.799661 n-d-858383-15 devstack@n-api.service[120426]: fn(*args, **kw) Oct 24 10:47:30.799661 n-d-858383-15 devstack@n-api.service[120426]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Oct 24 10:47:30.803488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-16e44ec0-07a7-4ae7-a479-bf49b6b01076 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:30.804346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-16e44ec0-07a7-4ae7-a479-bf49b6b01076 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:30.806064 n-d-858383-15 devstack@n-api.service[120426]: time.sleep(0) Oct 24 10:47:30.806064 n-d-858383-15 devstack@n-api.service[120426]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 24 10:47:30.806324 n-d-858383-15 devstack@n-api.service[120426]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 24 10:47:30.806324 n-d-858383-15 devstack@n-api.service[120426]: AssertionError: do not call blocking functions from the mainloop Oct 24 10:47:30.810714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16e44ec0-07a7-4ae7-a479-bf49b6b01076 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:30.814095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16e44ec0-07a7-4ae7-a479-bf49b6b01076 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:30.814552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16e44ec0-07a7-4ae7-a479-bf49b6b01076 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:30.815285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16e44ec0-07a7-4ae7-a479-bf49b6b01076 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:30.815820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16e44ec0-07a7-4ae7-a479-bf49b6b01076 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:30.816260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-16e44ec0-07a7-4ae7-a479-bf49b6b01076 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:30.826493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-5aad9400-df6f-4d71-8e99-28e5e4d46518 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] validate_networks() for [('0570c513-0036-46af-96c6-484910670fdc', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:47:31.040814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-16e44ec0-07a7-4ae7-a479-bf49b6b01076 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446c9d2505a348a5a5b3369d38985451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a140969afb4058ae5bb7cb62d58f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:31.049166 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-16e44ec0-07a7-4ae7-a479-bf49b6b01076 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 200 len: 1324 microversion: 2.1 time: 0.250238 Oct 24 10:47:31.050236 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2425/4890] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:30 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 1324 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:31.518068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c59d8e0c-d5f8-441b-89de-737a4cd5c0a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:31.518676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c59d8e0c-d5f8-441b-89de-737a4cd5c0a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:31.527401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c59d8e0c-d5f8-441b-89de-737a4cd5c0a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:31.528241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c59d8e0c-d5f8-441b-89de-737a4cd5c0a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:31.528687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c59d8e0c-d5f8-441b-89de-737a4cd5c0a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:31.529419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c59d8e0c-d5f8-441b-89de-737a4cd5c0a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:31.529875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c59d8e0c-d5f8-441b-89de-737a4cd5c0a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:31.530364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c59d8e0c-d5f8-441b-89de-737a4cd5c0a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:31.576250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:47:31.583662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c59d8e0c-d5f8-441b-89de-737a4cd5c0a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:31.584567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c59d8e0c-d5f8-441b-89de-737a4cd5c0a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:31.585481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c59d8e0c-d5f8-441b-89de-737a4cd5c0a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:31.586216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-c59d8e0c-d5f8-441b-89de-737a4cd5c0a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lazy-loading 'fault' on Instance uuid 68c41052-4f6b-4a60-97f6-11d5743cb09f {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:47:31.608240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5aad9400-df6f-4d71-8e99-28e5e4d46518 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:47:31.610127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5aad9400-df6f-4d71-8e99-28e5e4d46518 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:47:31.610824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5aad9400-df6f-4d71-8e99-28e5e4d46518 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:47:31.611572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5aad9400-df6f-4d71-8e99-28e5e4d46518 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:47:31.612205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5aad9400-df6f-4d71-8e99-28e5e4d46518 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:47:31.626971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5aad9400-df6f-4d71-8e99-28e5e4d46518 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:31.628026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5aad9400-df6f-4d71-8e99-28e5e4d46518 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:31.628888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5aad9400-df6f-4d71-8e99-28e5e4d46518 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:31.630807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5aad9400-df6f-4d71-8e99-28e5e4d46518 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:31.631699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5aad9400-df6f-4d71-8e99-28e5e4d46518 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:31.632401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5aad9400-df6f-4d71-8e99-28e5e4d46518 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:31.657873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-5aad9400-df6f-4d71-8e99-28e5e4d46518 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Getting quotas for project 656c472b32cc4421b312f671691a1bda. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:47:31.658303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c59d8e0c-d5f8-441b-89de-737a4cd5c0a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed058a5e8ac14236ab2e8783e9170346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3028765ba447589bf595a603ea2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:31.667884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-5aad9400-df6f-4d71-8e99-28e5e4d46518 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Getting quotas for user 758d3d450ce546ebad1836362108dea7 and project 656c472b32cc4421b312f671691a1bda. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:47:31.669140 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c59d8e0c-d5f8-441b-89de-737a4cd5c0a0 tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 200 len: 1283 microversion: 2.1 time: 0.155395 Oct 24 10:47:31.670046 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2426/4891] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:31 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 1283 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:31.685200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5aad9400-df6f-4d71-8e99-28e5e4d46518 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:47:31.688755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5aad9400-df6f-4d71-8e99-28e5e4d46518 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:47:31.751577 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5aad9400-df6f-4d71-8e99-28e5e4d46518 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.050682 Oct 24 10:47:31.752637 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2466/4892] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:47:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 10:47:31.763969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-174802ae-a3e2-4deb-beff-b9a9405e6ec8 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:31.765630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-174802ae-a3e2-4deb-beff-b9a9405e6ec8 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:31.830500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-174802ae-a3e2-4deb-beff-b9a9405e6ec8 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:31.843702 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-174802ae-a3e2-4deb-beff-b9a9405e6ec8 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1218 microversion: 2.1 time: 0.083242 Oct 24 10:47:31.844574 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2427/4893] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:31 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:32.074156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7f727caa-480f-466a-873b-2e5caaf04439 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:32.075408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7f727caa-480f-466a-873b-2e5caaf04439 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:32.088683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f727caa-480f-466a-873b-2e5caaf04439 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:32.090049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f727caa-480f-466a-873b-2e5caaf04439 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:32.090508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f727caa-480f-466a-873b-2e5caaf04439 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:32.092442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f727caa-480f-466a-873b-2e5caaf04439 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:32.095332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f727caa-480f-466a-873b-2e5caaf04439 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:32.096471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f727caa-480f-466a-873b-2e5caaf04439 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:32.323488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7f727caa-480f-466a-873b-2e5caaf04439 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446c9d2505a348a5a5b3369d38985451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a140969afb4058ae5bb7cb62d58f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:32.336327 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7f727caa-480f-466a-873b-2e5caaf04439 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 200 len: 1521 microversion: 2.1 time: 0.267202 Oct 24 10:47:32.349869 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2467/4894] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:32 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:32.365808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-62232e41-0df7-45c5-b27c-1d5ed9b7ced3 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:32.366620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-62232e41-0df7-45c5-b27c-1d5ed9b7ced3 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:32.375275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62232e41-0df7-45c5-b27c-1d5ed9b7ced3 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:32.375957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62232e41-0df7-45c5-b27c-1d5ed9b7ced3 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:32.376656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62232e41-0df7-45c5-b27c-1d5ed9b7ced3 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:32.377741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62232e41-0df7-45c5-b27c-1d5ed9b7ced3 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:32.379077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62232e41-0df7-45c5-b27c-1d5ed9b7ced3 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:32.379959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62232e41-0df7-45c5-b27c-1d5ed9b7ced3 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:32.431811 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-62232e41-0df7-45c5-b27c-1d5ed9b7ced3 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] HTTP exception thrown: Instance is not a member of specified network Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-62232e41-0df7-45c5-b27c-1d5ed9b7ced3 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Request method failure captured: Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3/ips/invalid HTTP/1.1 Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm0yp9cQaznLFhNYbK3h86jS1a0weM8iTkqzYiiuuZVVCMs0EFD4eRebfYIg_TDD-LQx4pnRxNPM_c5Xb_hlJuRr8PNfIF3fujeW3xKfjJURe6QDPYMbzJC9HJNDUCoaaoOgyAh5sAt4ORhInnlONOSkcUboleMsVUo5EcGe39Al0Ec Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 26a140969afb4058ae5bb7cb62d58f14 Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-607365940 Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/26a140969afb4058ae5bb7cb62d58f14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/26a140969afb4058ae5bb7cb62d58f14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/26a140969afb4058ae5bb7cb62d58f14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_26a140969afb4058ae5bb7cb62d58f14", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-607365940 Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 26a140969afb4058ae5bb7cb62d58f14 Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-607365940 Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerAddressesNegativeTestJSON-607365940-project Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 446c9d2505a348a5a5b3369d38985451 Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-607365940-project Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance is not a member of specified network Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'server_id': '36bf2b2f-b787-456b-bfdb-a72e729004c3', 'id': 'invalid'} Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 24 10:47:32.446364 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:32.450029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-62232e41-0df7-45c5-b27c-1d5ed9b7ced3 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:32.450573 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-62232e41-0df7-45c5-b27c-1d5ed9b7ced3 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.089050 Oct 24 10:47:32.452590 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2428/4895] 10.222.0.50 () {58 vars in 1272 bytes} [Mon Oct 24 10:47:32 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3/ips/invalid => generated 91 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 24 10:47:32.462290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e28daecc-5dde-487a-844f-15552ae5b416 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:32.462796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e28daecc-5dde-487a-844f-15552ae5b416 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Failed to fetch instance by id 999 {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 24 10:47:32.463283 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-e28daecc-5dde-487a-844f-15552ae5b416 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] HTTP exception thrown: Instance 999 could not be found. Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e28daecc-5dde-487a-844f-15552ae5b416 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Request method failure captured: Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm0yp9cQaznLFhNYbK3h86jS1a0weM8iTkqzYiiuuZVVCMs0EFD4eRebfYIg_TDD-LQx4pnRxNPM_c5Xb_hlJuRr8PNfIF3fujeW3xKfjJURe6QDPYMbzJC9HJNDUCoaaoOgyAh5sAt4ORhInnlONOSkcUboleMsVUo5EcGe39Al0Ec Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 26a140969afb4058ae5bb7cb62d58f14 Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-607365940 Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/26a140969afb4058ae5bb7cb62d58f14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/26a140969afb4058ae5bb7cb62d58f14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/26a140969afb4058ae5bb7cb62d58f14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_26a140969afb4058ae5bb7cb62d58f14", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-607365940 Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 26a140969afb4058ae5bb7cb62d58f14 Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-607365940 Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerAddressesNegativeTestJSON-607365940-project Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 446c9d2505a348a5a5b3369d38985451 Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-607365940-project Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 999 could not be found. Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'server_id': '999'} Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 24 10:47:32.465130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:32.469714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e28daecc-5dde-487a-844f-15552ae5b416 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:32.469714 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e28daecc-5dde-487a-844f-15552ae5b416 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.008827 Oct 24 10:47:32.470113 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2468/4896] 10.222.0.50 () {58 vars in 1149 bytes} [Mon Oct 24 10:47:32 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:47:32.481010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-baa9f8be-edc6-48a5-9495-13d27053a2b7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:32.481517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-baa9f8be-edc6-48a5-9495-13d27053a2b7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:32.488806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-baa9f8be-edc6-48a5-9495-13d27053a2b7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:32.489351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-baa9f8be-edc6-48a5-9495-13d27053a2b7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:32.490018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-baa9f8be-edc6-48a5-9495-13d27053a2b7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:32.491230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-baa9f8be-edc6-48a5-9495-13d27053a2b7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:32.492469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-baa9f8be-edc6-48a5-9495-13d27053a2b7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:32.493166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-baa9f8be-edc6-48a5-9495-13d27053a2b7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:32.538390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-baa9f8be-edc6-48a5-9495-13d27053a2b7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:47:32.694990 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-baa9f8be-edc6-48a5-9495-13d27053a2b7 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "DELETE /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 204 len: 0 microversion: 2.1 time: 0.206378 Oct 24 10:47:32.695684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0029dc92-39c3-4164-b9be-256c2d3ecd4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:32.696889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0029dc92-39c3-4164-b9be-256c2d3ecd4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] [instance: 68c41052-4f6b-4a60-97f6-11d5743cb09f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:32.698885 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2429/4897] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:47:32 2022] DELETE /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:47:32.714490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0029dc92-39c3-4164-b9be-256c2d3ecd4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:32.715613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0029dc92-39c3-4164-b9be-256c2d3ecd4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:32.717321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0029dc92-39c3-4164-b9be-256c2d3ecd4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:32.719231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a50ce368-025c-442c-a878-96def4be3800 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:32.719987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0029dc92-39c3-4164-b9be-256c2d3ecd4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:32.720977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0029dc92-39c3-4164-b9be-256c2d3ecd4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:32.722362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0029dc92-39c3-4164-b9be-256c2d3ecd4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:32.722959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a50ce368-025c-442c-a878-96def4be3800 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:32.733388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a50ce368-025c-442c-a878-96def4be3800 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:32.734538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a50ce368-025c-442c-a878-96def4be3800 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:32.735290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a50ce368-025c-442c-a878-96def4be3800 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:32.736387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a50ce368-025c-442c-a878-96def4be3800 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:32.737166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a50ce368-025c-442c-a878-96def4be3800 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:32.737814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a50ce368-025c-442c-a878-96def4be3800 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:32.764368 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-0029dc92-39c3-4164-b9be-256c2d3ecd4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] HTTP exception thrown: Instance 68c41052-4f6b-4a60-97f6-11d5743cb09f could not be found. Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0029dc92-39c3-4164-b9be-256c2d3ecd4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Request method failure captured: Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f HTTP/1.1 Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmw9l7_B4dXmuHU9Gb-K9AcNFa89ojqUgA5b0CyptYzvLocNIE8tXIG7P0RqbJKotfG9m8hHPDmpUjY1zcemypezLpzaZsUU_uw64Cau1NS5oTTu6oashO8QtWPXGFwaCBcNre3tXrdTVA82MqFhJ1n8NWC1ALmfEhCjkY7DqygJ630 Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ab3028765ba447589bf595a603ea2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ab3028765ba447589bf595a603ea2e3", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersTestJSON-594196235 Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9ab3028765ba447589bf595a603ea2e3 Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersTestJSON-594196235 Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersTestJSON-594196235-project Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ed058a5e8ac14236ab2e8783e9170346 Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersTestJSON-594196235-project Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 68c41052-4f6b-4a60-97f6-11d5743cb09f could not be found. Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '68c41052-4f6b-4a60-97f6-11d5743cb09f'} Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68c41052-4f6b-4a60-97f6-11d5743cb09f could not be found. Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68c41052-4f6b-4a60-97f6-11d5743cb09f could not be found. Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:32.770774 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:32.775723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:32.775723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:32.775723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:32.775723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:32.775723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68c41052-4f6b-4a60-97f6-11d5743cb09f could not be found. Oct 24 10:47:32.775723 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:32.781379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0029dc92-39c3-4164-b9be-256c2d3ecd4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] Returning 404 to user: Instance 68c41052-4f6b-4a60-97f6-11d5743cb09f could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:32.782560 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0029dc92-39c3-4164-b9be-256c2d3ecd4c tempest-ServersTestJSON-594196235 tempest-ServersTestJSON-594196235-project] 10.222.0.50 "GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f" status: 404 len: 111 microversion: 2.1 time: 0.093332 Oct 24 10:47:32.787539 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2469/4898] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:32 2022] GET /compute/v2.1/servers/68c41052-4f6b-4a60-97f6-11d5743cb09f => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:32.876434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-501d76db-ad3e-4c35-a437-6ece834a3c30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:32.877488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-501d76db-ad3e-4c35-a437-6ece834a3c30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:32.895170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-501d76db-ad3e-4c35-a437-6ece834a3c30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:32.900264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-501d76db-ad3e-4c35-a437-6ece834a3c30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:32.901576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-501d76db-ad3e-4c35-a437-6ece834a3c30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:32.904290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-501d76db-ad3e-4c35-a437-6ece834a3c30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:32.906780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-501d76db-ad3e-4c35-a437-6ece834a3c30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:32.909075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-501d76db-ad3e-4c35-a437-6ece834a3c30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:32.998567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a50ce368-025c-442c-a878-96def4be3800 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446c9d2505a348a5a5b3369d38985451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a140969afb4058ae5bb7cb62d58f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:33.008883 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a50ce368-025c-442c-a878-96def4be3800 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 200 len: 1527 microversion: 2.1 time: 0.303909 Oct 24 10:47:33.010150 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2430/4899] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:32 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 1527 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:33.034381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-501d76db-ad3e-4c35-a437-6ece834a3c30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:33.044451 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-501d76db-ad3e-4c35-a437-6ece834a3c30 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1270 microversion: 2.1 time: 0.180487 Oct 24 10:47:33.046173 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2470/4900] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:32 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1270 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:33.535297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3de79f3b-8900-42df-8ac6-30d3e36d965a req-0a011782-0c0b-414b-97df-4bf219c5f55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0272c314-d0fe-44d3-8f8c-b475beff2cd1", "name": "network-vif-deleted", "tag": "ddf33fbf-e51d-445c-be66-c7f9b44e3d6c"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:33.563020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3de79f3b-8900-42df-8ac6-30d3e36d965a req-0a011782-0c0b-414b-97df-4bf219c5f55d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:33.563790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3de79f3b-8900-42df-8ac6-30d3e36d965a req-0a011782-0c0b-414b-97df-4bf219c5f55d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:33.564393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3de79f3b-8900-42df-8ac6-30d3e36d965a req-0a011782-0c0b-414b-97df-4bf219c5f55d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:33.580689 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3de79f3b-8900-42df-8ac6-30d3e36d965a req-0a011782-0c0b-414b-97df-4bf219c5f55d service nova] Creating event network-vif-deleted:ddf33fbf-e51d-445c-be66-c7f9b44e3d6c for instance 0272c314-d0fe-44d3-8f8c-b475beff2cd1 on n-h1-858383-15 Oct 24 10:47:33.597693 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3de79f3b-8900-42df-8ac6-30d3e36d965a req-0a011782-0c0b-414b-97df-4bf219c5f55d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068507 Oct 24 10:47:33.599192 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2431/4901] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:47:34.038404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e0759da8-1bc4-477c-a2ac-71cadc380c3e tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:34.039081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e0759da8-1bc4-477c-a2ac-71cadc380c3e tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:34.053378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0759da8-1bc4-477c-a2ac-71cadc380c3e tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:34.057313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0759da8-1bc4-477c-a2ac-71cadc380c3e tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:34.057767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0759da8-1bc4-477c-a2ac-71cadc380c3e tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:34.063953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0759da8-1bc4-477c-a2ac-71cadc380c3e tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:34.063953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0759da8-1bc4-477c-a2ac-71cadc380c3e tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:34.068882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-945ca01d-9e07-4899-bebe-10b090c247f7 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:34.069590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-945ca01d-9e07-4899-bebe-10b090c247f7 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:34.078630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0759da8-1bc4-477c-a2ac-71cadc380c3e tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:34.084520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-945ca01d-9e07-4899-bebe-10b090c247f7 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:34.085047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-945ca01d-9e07-4899-bebe-10b090c247f7 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:34.086813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-945ca01d-9e07-4899-bebe-10b090c247f7 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:34.090622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-945ca01d-9e07-4899-bebe-10b090c247f7 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:34.095565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-945ca01d-9e07-4899-bebe-10b090c247f7 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:34.096447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-945ca01d-9e07-4899-bebe-10b090c247f7 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:34.422928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e0759da8-1bc4-477c-a2ac-71cadc380c3e tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446c9d2505a348a5a5b3369d38985451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a140969afb4058ae5bb7cb62d58f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:34.431193 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e0759da8-1bc4-477c-a2ac-71cadc380c3e tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 200 len: 1527 microversion: 2.1 time: 0.398315 Oct 24 10:47:34.435466 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2471/4902] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:34 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 1527 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:34.445347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-945ca01d-9e07-4899-bebe-10b090c247f7 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:34.450168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:47:34.458769 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-945ca01d-9e07-4899-bebe-10b090c247f7 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1276 microversion: 2.1 time: 0.394029 Oct 24 10:47:34.459959 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2432/4903] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:34 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1276 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:35.459439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c1aef77f-60db-4101-af82-455d2d73ee4a tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:35.460081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c1aef77f-60db-4101-af82-455d2d73ee4a tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:35.485527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-61a2bc73-06c3-4519-a0d9-d427d420a69c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:35.486159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-61a2bc73-06c3-4519-a0d9-d427d420a69c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:35.496150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1aef77f-60db-4101-af82-455d2d73ee4a tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:35.496655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1aef77f-60db-4101-af82-455d2d73ee4a tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:35.497130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1aef77f-60db-4101-af82-455d2d73ee4a tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:35.497862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1aef77f-60db-4101-af82-455d2d73ee4a tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:35.498321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1aef77f-60db-4101-af82-455d2d73ee4a tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:35.513953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61a2bc73-06c3-4519-a0d9-d427d420a69c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:35.517596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1aef77f-60db-4101-af82-455d2d73ee4a tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:35.520224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61a2bc73-06c3-4519-a0d9-d427d420a69c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:35.520711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61a2bc73-06c3-4519-a0d9-d427d420a69c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:35.529858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61a2bc73-06c3-4519-a0d9-d427d420a69c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:35.530368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61a2bc73-06c3-4519-a0d9-d427d420a69c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:35.531419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61a2bc73-06c3-4519-a0d9-d427d420a69c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:35.853471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c1aef77f-60db-4101-af82-455d2d73ee4a tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446c9d2505a348a5a5b3369d38985451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a140969afb4058ae5bb7cb62d58f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:35.868221 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c1aef77f-60db-4101-af82-455d2d73ee4a tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 200 len: 1485 microversion: 2.1 time: 0.413069 Oct 24 10:47:35.869206 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2472/4904] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:35 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 1485 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:35.873720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-20e68a72-5113-4afb-b627-2fa441eaabf7 req-b3304dae-29b9-4706-9433-bc50e90751a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36bf2b2f-b787-456b-bfdb-a72e729004c3", "name": "network-vif-deleted", "tag": "a1fa292f-fa97-46f8-85e4-231329118adc"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:35.884409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-20e68a72-5113-4afb-b627-2fa441eaabf7 req-b3304dae-29b9-4706-9433-bc50e90751a0 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:35.885091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-20e68a72-5113-4afb-b627-2fa441eaabf7 req-b3304dae-29b9-4706-9433-bc50e90751a0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:35.885576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-20e68a72-5113-4afb-b627-2fa441eaabf7 req-b3304dae-29b9-4706-9433-bc50e90751a0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:35.900550 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-20e68a72-5113-4afb-b627-2fa441eaabf7 req-b3304dae-29b9-4706-9433-bc50e90751a0 service nova] Creating event network-vif-deleted:a1fa292f-fa97-46f8-85e4-231329118adc for instance 36bf2b2f-b787-456b-bfdb-a72e729004c3 on n-h2-858383-15 Oct 24 10:47:35.909127 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-20e68a72-5113-4afb-b627-2fa441eaabf7 req-b3304dae-29b9-4706-9433-bc50e90751a0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038079 Oct 24 10:47:35.911281 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2473/4905] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:47:36.093837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-61a2bc73-06c3-4519-a0d9-d427d420a69c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:36.105419 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-61a2bc73-06c3-4519-a0d9-d427d420a69c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1318 microversion: 2.1 time: 0.625678 Oct 24 10:47:36.109831 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2433/4906] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:35 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1318 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:36.352975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-db24f77d-3d14-4528-b356-cd3db7699d7e req-dd400b11-4631-4349-93ca-91595f3daabb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2992560c-f47d-44e1-a976-3f26b8f21b21", "tag": "08321389-96af-4a52-b12f-c9346d58ac1f"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:36.379925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-db24f77d-3d14-4528-b356-cd3db7699d7e req-dd400b11-4631-4349-93ca-91595f3daabb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:36.380325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-db24f77d-3d14-4528-b356-cd3db7699d7e req-dd400b11-4631-4349-93ca-91595f3daabb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:36.384815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-db24f77d-3d14-4528-b356-cd3db7699d7e req-dd400b11-4631-4349-93ca-91595f3daabb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:36.418068 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-db24f77d-3d14-4528-b356-cd3db7699d7e req-dd400b11-4631-4349-93ca-91595f3daabb service nova] Creating event network-changed:08321389-96af-4a52-b12f-c9346d58ac1f for instance 2992560c-f47d-44e1-a976-3f26b8f21b21 on n-h1-858383-15 Oct 24 10:47:36.428158 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-db24f77d-3d14-4528-b356-cd3db7699d7e req-dd400b11-4631-4349-93ca-91595f3daabb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089002 Oct 24 10:47:36.432744 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2474/4907] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:47:36.896147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5322f0ae-c046-4f91-81cf-157042e6f409 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:36.896777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5322f0ae-c046-4f91-81cf-157042e6f409 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:36.910665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5322f0ae-c046-4f91-81cf-157042e6f409 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:36.911357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5322f0ae-c046-4f91-81cf-157042e6f409 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:36.911802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5322f0ae-c046-4f91-81cf-157042e6f409 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:36.912522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5322f0ae-c046-4f91-81cf-157042e6f409 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:36.916185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5322f0ae-c046-4f91-81cf-157042e6f409 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:36.916663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5322f0ae-c046-4f91-81cf-157042e6f409 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:36.997109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5322f0ae-c046-4f91-81cf-157042e6f409 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:36.997899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5322f0ae-c046-4f91-81cf-157042e6f409 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:36.998786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5322f0ae-c046-4f91-81cf-157042e6f409 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:37.000280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-5322f0ae-c046-4f91-81cf-157042e6f409 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lazy-loading 'fault' on Instance uuid 36bf2b2f-b787-456b-bfdb-a72e729004c3 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:47:37.142981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-446bc20a-6a5d-4f51-ab5f-088df4d01261 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:37.143635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-446bc20a-6a5d-4f51-ab5f-088df4d01261 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:37.185775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-446bc20a-6a5d-4f51-ab5f-088df4d01261 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:37.191794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-446bc20a-6a5d-4f51-ab5f-088df4d01261 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:37.192915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-446bc20a-6a5d-4f51-ab5f-088df4d01261 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:37.198193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-446bc20a-6a5d-4f51-ab5f-088df4d01261 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:37.201107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-446bc20a-6a5d-4f51-ab5f-088df4d01261 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:37.201874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-446bc20a-6a5d-4f51-ab5f-088df4d01261 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:37.527188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5322f0ae-c046-4f91-81cf-157042e6f409 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446c9d2505a348a5a5b3369d38985451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a140969afb4058ae5bb7cb62d58f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:37.537358 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5322f0ae-c046-4f91-81cf-157042e6f409 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 200 len: 1314 microversion: 2.1 time: 0.644961 Oct 24 10:47:37.568894 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2434/4908] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:36 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 1314 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:37.739709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-446bc20a-6a5d-4f51-ab5f-088df4d01261 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:37.756337 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-446bc20a-6a5d-4f51-ab5f-088df4d01261 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1318 microversion: 2.1 time: 0.622369 Oct 24 10:47:37.756956 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2475/4909] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:37 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1318 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:38.570366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e4460667-7d91-4ddf-b058-360fd645c529 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:38.571295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e4460667-7d91-4ddf-b058-360fd645c529 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] [instance: 36bf2b2f-b787-456b-bfdb-a72e729004c3] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:38.584572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4460667-7d91-4ddf-b058-360fd645c529 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:38.585101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4460667-7d91-4ddf-b058-360fd645c529 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:38.585543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4460667-7d91-4ddf-b058-360fd645c529 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:38.586262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4460667-7d91-4ddf-b058-360fd645c529 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:38.586719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4460667-7d91-4ddf-b058-360fd645c529 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:38.587149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4460667-7d91-4ddf-b058-360fd645c529 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:38.611650 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-e4460667-7d91-4ddf-b058-360fd645c529 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] HTTP exception thrown: Instance 36bf2b2f-b787-456b-bfdb-a72e729004c3 could not be found. Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e4460667-7d91-4ddf-b058-360fd645c529 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Request method failure captured: Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 HTTP/1.1 Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm0yp9cQaznLFhNYbK3h86jS1a0weM8iTkqzYiiuuZVVCMs0EFD4eRebfYIg_TDD-LQx4pnRxNPM_c5Xb_hlJuRr8PNfIF3fujeW3xKfjJURe6QDPYMbzJC9HJNDUCoaaoOgyAh5sAt4ORhInnlONOSkcUboleMsVUo5EcGe39Al0Ec Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 26a140969afb4058ae5bb7cb62d58f14 Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-607365940 Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/26a140969afb4058ae5bb7cb62d58f14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/26a140969afb4058ae5bb7cb62d58f14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/26a140969afb4058ae5bb7cb62d58f14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_26a140969afb4058ae5bb7cb62d58f14", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-607365940 Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 26a140969afb4058ae5bb7cb62d58f14 Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-607365940 Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerAddressesNegativeTestJSON-607365940-project Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 446c9d2505a348a5a5b3369d38985451 Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-607365940-project Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 36bf2b2f-b787-456b-bfdb-a72e729004c3 could not be found. Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '36bf2b2f-b787-456b-bfdb-a72e729004c3'} Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36bf2b2f-b787-456b-bfdb-a72e729004c3 could not be found. Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36bf2b2f-b787-456b-bfdb-a72e729004c3 could not be found. Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:38.613384 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:38.618325 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:38.618325 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:38.618325 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:38.618325 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:38.618325 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:38.618325 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:38.618325 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36bf2b2f-b787-456b-bfdb-a72e729004c3 could not be found. Oct 24 10:47:38.618325 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:38.620075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e4460667-7d91-4ddf-b058-360fd645c529 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] Returning 404 to user: Instance 36bf2b2f-b787-456b-bfdb-a72e729004c3 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:38.621898 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e4460667-7d91-4ddf-b058-360fd645c529 tempest-ServerAddressesNegativeTestJSON-607365940 tempest-ServerAddressesNegativeTestJSON-607365940-project] 10.222.0.50 "GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3" status: 404 len: 111 microversion: 2.1 time: 0.057351 Oct 24 10:47:38.627298 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2435/4910] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:38 2022] GET /compute/v2.1/servers/36bf2b2f-b787-456b-bfdb-a72e729004c3 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:38.786982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cf58c4b0-bd7d-40cf-b39d-69e84560dcda tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:38.787934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cf58c4b0-bd7d-40cf-b39d-69e84560dcda tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:38.804924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf58c4b0-bd7d-40cf-b39d-69e84560dcda tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:38.805639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf58c4b0-bd7d-40cf-b39d-69e84560dcda tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:38.806391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf58c4b0-bd7d-40cf-b39d-69e84560dcda tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:38.807467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf58c4b0-bd7d-40cf-b39d-69e84560dcda tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:38.808443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf58c4b0-bd7d-40cf-b39d-69e84560dcda tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:38.809007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf58c4b0-bd7d-40cf-b39d-69e84560dcda tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:39.138392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cf58c4b0-bd7d-40cf-b39d-69e84560dcda tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:39.157543 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cf58c4b0-bd7d-40cf-b39d-69e84560dcda tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1318 microversion: 2.1 time: 0.379607 Oct 24 10:47:39.177787 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2476/4911] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:38 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:39.283435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-380d06fb-984f-41ac-8874-814cc0eb4db6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:39.283944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-380d06fb-984f-41ac-8874-814cc0eb4db6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:39.294311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-380d06fb-984f-41ac-8874-814cc0eb4db6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:39.301821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-380d06fb-984f-41ac-8874-814cc0eb4db6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:39.302828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-380d06fb-984f-41ac-8874-814cc0eb4db6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:39.303848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-380d06fb-984f-41ac-8874-814cc0eb4db6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:39.304557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-380d06fb-984f-41ac-8874-814cc0eb4db6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:39.305306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-380d06fb-984f-41ac-8874-814cc0eb4db6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:39.381664 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-380d06fb-984f-41ac-8874-814cc0eb4db6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa/ips" status: 200 len: 152 microversion: 2.20 time: 0.102950 Oct 24 10:47:39.389908 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2436/4912] 10.222.0.50 () {60 vars in 1289 bytes} [Mon Oct 24 10:47:39 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa/ips => generated 152 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:47:40.183421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3c6cc48-16cd-4a01-ba04-4c1aa8e17774 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:40.184233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f3c6cc48-16cd-4a01-ba04-4c1aa8e17774 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:40.196077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3c6cc48-16cd-4a01-ba04-4c1aa8e17774 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:40.197383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3c6cc48-16cd-4a01-ba04-4c1aa8e17774 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:40.198007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3c6cc48-16cd-4a01-ba04-4c1aa8e17774 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:40.199088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3c6cc48-16cd-4a01-ba04-4c1aa8e17774 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:40.199785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3c6cc48-16cd-4a01-ba04-4c1aa8e17774 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:40.200541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3c6cc48-16cd-4a01-ba04-4c1aa8e17774 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:40.632122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3c6cc48-16cd-4a01-ba04-4c1aa8e17774 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:40.653248 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f3c6cc48-16cd-4a01-ba04-4c1aa8e17774 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1318 microversion: 2.1 time: 0.474353 Oct 24 10:47:40.654514 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2477/4913] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:40 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:41.323815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7baffa83-910f-4a7c-bf79-8b11995db96b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:41.326075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7baffa83-910f-4a7c-bf79-8b11995db96b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:41.343848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7baffa83-910f-4a7c-bf79-8b11995db96b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:41.344736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7baffa83-910f-4a7c-bf79-8b11995db96b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:41.349212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7baffa83-910f-4a7c-bf79-8b11995db96b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:41.350369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7baffa83-910f-4a7c-bf79-8b11995db96b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:41.351339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7baffa83-910f-4a7c-bf79-8b11995db96b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:41.352174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7baffa83-910f-4a7c-bf79-8b11995db96b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:41.686476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f6c92df8-6ef4-4a61-9bd2-de590d653625 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:41.687926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f6c92df8-6ef4-4a61-9bd2-de590d653625 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:41.691101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:47:41.696004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:47:41.720601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6c92df8-6ef4-4a61-9bd2-de590d653625 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:41.731691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6c92df8-6ef4-4a61-9bd2-de590d653625 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:41.732455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6c92df8-6ef4-4a61-9bd2-de590d653625 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:41.734128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6c92df8-6ef4-4a61-9bd2-de590d653625 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:41.734781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6c92df8-6ef4-4a61-9bd2-de590d653625 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:41.735381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6c92df8-6ef4-4a61-9bd2-de590d653625 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:41.749262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:47:41.834918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:47:42.081584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7baffa83-910f-4a7c-bf79-8b11995db96b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:42.097322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7baffa83-910f-4a7c-bf79-8b11995db96b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:42.100632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7baffa83-910f-4a7c-bf79-8b11995db96b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:42.103665 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7baffa83-910f-4a7c-bf79-8b11995db96b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 2958 microversion: 2.42 time: 0.784683 Oct 24 10:47:42.122752 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2437/4914] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:47:41 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 2958 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:47:42.160748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3ab98fa6-a01e-40d3-8d19-5e8e69e80c6f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:42.161808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3ab98fa6-a01e-40d3-8d19-5e8e69e80c6f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:42.184503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ab98fa6-a01e-40d3-8d19-5e8e69e80c6f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:42.185467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ab98fa6-a01e-40d3-8d19-5e8e69e80c6f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:42.187920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ab98fa6-a01e-40d3-8d19-5e8e69e80c6f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:42.190641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ab98fa6-a01e-40d3-8d19-5e8e69e80c6f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:42.196533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ab98fa6-a01e-40d3-8d19-5e8e69e80c6f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:42.198871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ab98fa6-a01e-40d3-8d19-5e8e69e80c6f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:42.229002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f6c92df8-6ef4-4a61-9bd2-de590d653625 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:42.258758 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f6c92df8-6ef4-4a61-9bd2-de590d653625 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1318 microversion: 2.1 time: 0.576860 Oct 24 10:47:42.261843 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2478/4915] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:41 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1318 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:42.448647 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3ab98fa6-a01e-40d3-8d19-5e8e69e80c6f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.297304 Oct 24 10:47:42.462225 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2438/4916] 10.222.0.50 () {60 vars in 1316 bytes} [Mon Oct 24 10:47:42 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711/os-interface => generated 1832 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:47:42.678481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0ff33c74-9a2d-40d7-98b6-831f657fda5c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:42.679221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0ff33c74-9a2d-40d7-98b6-831f657fda5c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:42.692993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ff33c74-9a2d-40d7-98b6-831f657fda5c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:42.694202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ff33c74-9a2d-40d7-98b6-831f657fda5c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:42.695037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ff33c74-9a2d-40d7-98b6-831f657fda5c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:42.695916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ff33c74-9a2d-40d7-98b6-831f657fda5c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:42.696419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ff33c74-9a2d-40d7-98b6-831f657fda5c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:42.696796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ff33c74-9a2d-40d7-98b6-831f657fda5c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:42.759889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-0ff33c74-9a2d-40d7-98b6-831f657fda5c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lazy-loading 'flavor' on Instance uuid e357ce41-0ae9-4efa-973b-bc8920e4a0fa {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:47:43.203490 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0ff33c74-9a2d-40d7-98b6-831f657fda5c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "POST /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa/action" status: 202 len: 0 microversion: 2.20 time: 0.528705 Oct 24 10:47:43.204786 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2479/4917] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Oct 24 10:47:42 2022] POST /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:47:43.213773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bab56393-d438-47de-9112-2ff78c67e162 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:43.214740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bab56393-d438-47de-9112-2ff78c67e162 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:43.225443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bab56393-d438-47de-9112-2ff78c67e162 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:43.227246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bab56393-d438-47de-9112-2ff78c67e162 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:43.230492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bab56393-d438-47de-9112-2ff78c67e162 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:43.231453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bab56393-d438-47de-9112-2ff78c67e162 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:43.232981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bab56393-d438-47de-9112-2ff78c67e162 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:43.234924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bab56393-d438-47de-9112-2ff78c67e162 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:43.292772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-44d93a79-78c0-48a9-a63f-155839002484 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:43.293670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-44d93a79-78c0-48a9-a63f-155839002484 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:43.307342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44d93a79-78c0-48a9-a63f-155839002484 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:43.308297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44d93a79-78c0-48a9-a63f-155839002484 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:43.309167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44d93a79-78c0-48a9-a63f-155839002484 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:43.310609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44d93a79-78c0-48a9-a63f-155839002484 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:43.313521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44d93a79-78c0-48a9-a63f-155839002484 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:43.314259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44d93a79-78c0-48a9-a63f-155839002484 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:43.707964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bab56393-d438-47de-9112-2ff78c67e162 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:43.724137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bab56393-d438-47de-9112-2ff78c67e162 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:43.728132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bab56393-d438-47de-9112-2ff78c67e162 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:43.732154 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bab56393-d438-47de-9112-2ff78c67e162 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1722 microversion: 2.20 time: 0.523332 Oct 24 10:47:43.737271 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2439/4918] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:47:43 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1722 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:47:43.812028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3af97a61-c998-4bf8-8db3-2098f86492ab req-d38c3dba-4f78-4359-94c5-50267fb2f540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2992560c-f47d-44e1-a976-3f26b8f21b21", "name": "network-vif-plugged", "status": "completed", "tag": "08321389-96af-4a52-b12f-c9346d58ac1f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:43.855399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3af97a61-c998-4bf8-8db3-2098f86492ab req-d38c3dba-4f78-4359-94c5-50267fb2f540 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:43.856122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3af97a61-c998-4bf8-8db3-2098f86492ab req-d38c3dba-4f78-4359-94c5-50267fb2f540 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:43.862257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3af97a61-c998-4bf8-8db3-2098f86492ab req-d38c3dba-4f78-4359-94c5-50267fb2f540 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:43.896640 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3af97a61-c998-4bf8-8db3-2098f86492ab req-d38c3dba-4f78-4359-94c5-50267fb2f540 service nova] Creating event network-vif-plugged:08321389-96af-4a52-b12f-c9346d58ac1f for instance 2992560c-f47d-44e1-a976-3f26b8f21b21 on n-h1-858383-15 Oct 24 10:47:43.912739 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3af97a61-c998-4bf8-8db3-2098f86492ab req-d38c3dba-4f78-4359-94c5-50267fb2f540 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107721 Oct 24 10:47:43.914024 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2440/4919] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:47:43.938262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-44d93a79-78c0-48a9-a63f-155839002484 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:43.946997 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-44d93a79-78c0-48a9-a63f-155839002484 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1318 microversion: 2.1 time: 0.658838 Oct 24 10:47:43.948927 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2480/4920] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:43 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:44.772997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3d3a6ff1-257d-4392-8e62-b9743afd24d1 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:44.774637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3d3a6ff1-257d-4392-8e62-b9743afd24d1 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:44.788946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d3a6ff1-257d-4392-8e62-b9743afd24d1 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:44.794952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d3a6ff1-257d-4392-8e62-b9743afd24d1 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:44.795692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d3a6ff1-257d-4392-8e62-b9743afd24d1 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:44.796908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d3a6ff1-257d-4392-8e62-b9743afd24d1 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:44.797596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d3a6ff1-257d-4392-8e62-b9743afd24d1 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:44.798269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d3a6ff1-257d-4392-8e62-b9743afd24d1 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:44.977139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c1e516db-c226-4d2a-b74a-b89a7e58bef8 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:44.979992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c1e516db-c226-4d2a-b74a-b89a7e58bef8 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:44.989608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:47:45.004564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1e516db-c226-4d2a-b74a-b89a7e58bef8 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:45.007385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1e516db-c226-4d2a-b74a-b89a7e58bef8 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:45.008324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1e516db-c226-4d2a-b74a-b89a7e58bef8 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:45.009486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1e516db-c226-4d2a-b74a-b89a7e58bef8 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:45.028394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1e516db-c226-4d2a-b74a-b89a7e58bef8 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:45.029010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1e516db-c226-4d2a-b74a-b89a7e58bef8 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:45.324233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3d3a6ff1-257d-4392-8e62-b9743afd24d1 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:45.335949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3d3a6ff1-257d-4392-8e62-b9743afd24d1 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:45.340696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3d3a6ff1-257d-4392-8e62-b9743afd24d1 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:45.342232 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3d3a6ff1-257d-4392-8e62-b9743afd24d1 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1722 microversion: 2.20 time: 0.577661 Oct 24 10:47:45.371054 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2441/4921] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:47:44 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1722 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:47:45.409214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c1e516db-c226-4d2a-b74a-b89a7e58bef8 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:45.418045 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c1e516db-c226-4d2a-b74a-b89a7e58bef8 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1318 microversion: 2.1 time: 0.446556 Oct 24 10:47:45.419218 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2481/4922] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:44 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1318 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:46.370841 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-646ca838-a1a4-49e3-8f6c-6cc70d15599e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:46.371454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-646ca838-a1a4-49e3-8f6c-6cc70d15599e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:46.387288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-646ca838-a1a4-49e3-8f6c-6cc70d15599e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:46.388091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-646ca838-a1a4-49e3-8f6c-6cc70d15599e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:46.389003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-646ca838-a1a4-49e3-8f6c-6cc70d15599e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:46.393469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-646ca838-a1a4-49e3-8f6c-6cc70d15599e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:46.394520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-646ca838-a1a4-49e3-8f6c-6cc70d15599e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:46.394942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-646ca838-a1a4-49e3-8f6c-6cc70d15599e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:46.448466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e42c0eff-d205-453c-9f7b-cab9fde148ad tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:46.449160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e42c0eff-d205-453c-9f7b-cab9fde148ad tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:46.462588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e42c0eff-d205-453c-9f7b-cab9fde148ad tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:46.464668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e42c0eff-d205-453c-9f7b-cab9fde148ad tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:46.471996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e42c0eff-d205-453c-9f7b-cab9fde148ad tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:46.473226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e42c0eff-d205-453c-9f7b-cab9fde148ad tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:46.473919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e42c0eff-d205-453c-9f7b-cab9fde148ad tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:46.474582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e42c0eff-d205-453c-9f7b-cab9fde148ad tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:46.901719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e42c0eff-d205-453c-9f7b-cab9fde148ad tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:46.910600 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e42c0eff-d205-453c-9f7b-cab9fde148ad tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1507 microversion: 2.1 time: 0.466900 Oct 24 10:47:46.911188 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2482/4923] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:46 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1507 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:46.938327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-646ca838-a1a4-49e3-8f6c-6cc70d15599e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:46.939264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-99cffd2c-13d3-45a4-9dff-e1c023785335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:46.939889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-99cffd2c-13d3-45a4-9dff-e1c023785335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:46.950162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99cffd2c-13d3-45a4-9dff-e1c023785335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:46.950657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99cffd2c-13d3-45a4-9dff-e1c023785335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:46.951099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99cffd2c-13d3-45a4-9dff-e1c023785335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:46.951801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99cffd2c-13d3-45a4-9dff-e1c023785335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:46.952810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99cffd2c-13d3-45a4-9dff-e1c023785335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:46.959217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-646ca838-a1a4-49e3-8f6c-6cc70d15599e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:46.961372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-646ca838-a1a4-49e3-8f6c-6cc70d15599e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:46.961544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99cffd2c-13d3-45a4-9dff-e1c023785335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:46.963557 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-646ca838-a1a4-49e3-8f6c-6cc70d15599e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1722 microversion: 2.20 time: 0.597021 Oct 24 10:47:46.993403 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2442/4924] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:47:46 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1722 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:47:47.263695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-99cffd2c-13d3-45a4-9dff-e1c023785335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:47.283604 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-99cffd2c-13d3-45a4-9dff-e1c023785335 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1507 microversion: 2.1 time: 0.348715 Oct 24 10:47:47.284607 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2483/4925] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:46 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1507 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:47.311729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33a68ad2-187c-4246-8646-dd7c26b5955f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:47.314356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-33a68ad2-187c-4246-8646-dd7c26b5955f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:47.321400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33a68ad2-187c-4246-8646-dd7c26b5955f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:47.321699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33a68ad2-187c-4246-8646-dd7c26b5955f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:47.322313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33a68ad2-187c-4246-8646-dd7c26b5955f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:47.323198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33a68ad2-187c-4246-8646-dd7c26b5955f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:47.323807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33a68ad2-187c-4246-8646-dd7c26b5955f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:47.324397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33a68ad2-187c-4246-8646-dd7c26b5955f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:47.418219 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-33a68ad2-187c-4246-8646-dd7c26b5955f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "PUT /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1079 microversion: 2.1 time: 0.111154 Oct 24 10:47:47.432953 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2443/4926] 10.222.0.50 () {60 vars in 1256 bytes} [Mon Oct 24 10:47:47 2022] PUT /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1079 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:47.441494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d66de810-6b98-4939-85e6-272988f0f915 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:47.442111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d66de810-6b98-4939-85e6-272988f0f915 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:47.449262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d66de810-6b98-4939-85e6-272988f0f915 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:47.449884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d66de810-6b98-4939-85e6-272988f0f915 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:47.450154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d66de810-6b98-4939-85e6-272988f0f915 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:47.451202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d66de810-6b98-4939-85e6-272988f0f915 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:47.452362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d66de810-6b98-4939-85e6-272988f0f915 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:47.453570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d66de810-6b98-4939-85e6-272988f0f915 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:47.684125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d66de810-6b98-4939-85e6-272988f0f915 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:47.704984 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d66de810-6b98-4939-85e6-272988f0f915 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1505 microversion: 2.1 time: 0.265711 Oct 24 10:47:47.729807 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2484/4927] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:47 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1505 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:47.736866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0b44edf2-a1d1-4e27-b1a4-87b4e568fc37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:47.737638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0b44edf2-a1d1-4e27-b1a4-87b4e568fc37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:47.759638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b44edf2-a1d1-4e27-b1a4-87b4e568fc37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:47.761883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b44edf2-a1d1-4e27-b1a4-87b4e568fc37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:47.762345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b44edf2-a1d1-4e27-b1a4-87b4e568fc37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:47.766276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b44edf2-a1d1-4e27-b1a4-87b4e568fc37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:47.766793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b44edf2-a1d1-4e27-b1a4-87b4e568fc37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:47.768467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b44edf2-a1d1-4e27-b1a4-87b4e568fc37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:48.081769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0b44edf2-a1d1-4e27-b1a4-87b4e568fc37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:48.102060 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0b44edf2-a1d1-4e27-b1a4-87b4e568fc37 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1505 microversion: 2.1 time: 0.371058 Oct 24 10:47:48.103304 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2444/4928] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:47 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1505 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:48.126505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e6a66084-d7d1-4c15-90a5-7cf579e6ccbe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:48.129789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e6a66084-d7d1-4c15-90a5-7cf579e6ccbe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:48.140570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6a66084-d7d1-4c15-90a5-7cf579e6ccbe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:48.141550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6a66084-d7d1-4c15-90a5-7cf579e6ccbe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:48.142238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6a66084-d7d1-4c15-90a5-7cf579e6ccbe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:48.143160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6a66084-d7d1-4c15-90a5-7cf579e6ccbe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:48.143828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6a66084-d7d1-4c15-90a5-7cf579e6ccbe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:48.144535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6a66084-d7d1-4c15-90a5-7cf579e6ccbe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:48.280025 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e6a66084-d7d1-4c15-90a5-7cf579e6ccbe tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "PUT /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1081 microversion: 2.1 time: 0.157963 Oct 24 10:47:48.283224 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2445/4929] 10.222.0.50 () {60 vars in 1256 bytes} [Mon Oct 24 10:47:48 2022] PUT /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1081 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:48.304081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-21183d9e-27d0-405e-ac2a-0ed32d42114f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:48.306223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-21183d9e-27d0-405e-ac2a-0ed32d42114f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:48.320972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21183d9e-27d0-405e-ac2a-0ed32d42114f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:48.339236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21183d9e-27d0-405e-ac2a-0ed32d42114f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:48.344181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21183d9e-27d0-405e-ac2a-0ed32d42114f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:48.347325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21183d9e-27d0-405e-ac2a-0ed32d42114f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:48.347920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21183d9e-27d0-405e-ac2a-0ed32d42114f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:48.348385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21183d9e-27d0-405e-ac2a-0ed32d42114f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:48.396255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a8a9b7cf-0594-42aa-8471-90c1502797d7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:48.398149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a8a9b7cf-0594-42aa-8471-90c1502797d7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:48.424548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8a9b7cf-0594-42aa-8471-90c1502797d7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:48.428240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8a9b7cf-0594-42aa-8471-90c1502797d7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:48.434630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8a9b7cf-0594-42aa-8471-90c1502797d7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:48.438747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8a9b7cf-0594-42aa-8471-90c1502797d7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:48.439774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8a9b7cf-0594-42aa-8471-90c1502797d7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:48.440445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8a9b7cf-0594-42aa-8471-90c1502797d7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:48.805716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-21183d9e-27d0-405e-ac2a-0ed32d42114f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:48.828725 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-21183d9e-27d0-405e-ac2a-0ed32d42114f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1507 microversion: 2.1 time: 0.527723 Oct 24 10:47:48.830730 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2446/4930] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:48 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1507 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:48.856457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31762c0f-6fac-4133-a7a7-fd1d6d45af51 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:48.857278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31762c0f-6fac-4133-a7a7-fd1d6d45af51 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:48.879496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31762c0f-6fac-4133-a7a7-fd1d6d45af51 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:48.881912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31762c0f-6fac-4133-a7a7-fd1d6d45af51 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:48.886067 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31762c0f-6fac-4133-a7a7-fd1d6d45af51 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:48.888073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31762c0f-6fac-4133-a7a7-fd1d6d45af51 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:48.888937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31762c0f-6fac-4133-a7a7-fd1d6d45af51 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:48.892205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31762c0f-6fac-4133-a7a7-fd1d6d45af51 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:48.916314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a8a9b7cf-0594-42aa-8471-90c1502797d7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:48.928880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a8a9b7cf-0594-42aa-8471-90c1502797d7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:48.932711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a8a9b7cf-0594-42aa-8471-90c1502797d7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:48.935071 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a8a9b7cf-0594-42aa-8471-90c1502797d7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1722 microversion: 2.20 time: 0.939334 Oct 24 10:47:48.940653 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2485/4931] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:47:47 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1722 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:47:49.965489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ad94a5b6-734d-4126-9482-ae11fe3002b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:49.966050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ad94a5b6-734d-4126-9482-ae11fe3002b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:49.989337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad94a5b6-734d-4126-9482-ae11fe3002b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:49.991180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad94a5b6-734d-4126-9482-ae11fe3002b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:49.991653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad94a5b6-734d-4126-9482-ae11fe3002b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:49.993809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad94a5b6-734d-4126-9482-ae11fe3002b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:49.995272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad94a5b6-734d-4126-9482-ae11fe3002b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:49.996358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad94a5b6-734d-4126-9482-ae11fe3002b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:50.435237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-31762c0f-6fac-4133-a7a7-fd1d6d45af51 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:50.446654 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31762c0f-6fac-4133-a7a7-fd1d6d45af51 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1507 microversion: 2.1 time: 1.594875 Oct 24 10:47:50.469063 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2447/4932] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:48 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1507 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:47:50.481401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d898242b-72c3-48e7-a4e5-0bee65dcc46c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:50.482066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d898242b-72c3-48e7-a4e5-0bee65dcc46c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:50.495351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d898242b-72c3-48e7-a4e5-0bee65dcc46c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:50.495864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d898242b-72c3-48e7-a4e5-0bee65dcc46c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:50.496309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d898242b-72c3-48e7-a4e5-0bee65dcc46c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:50.497195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d898242b-72c3-48e7-a4e5-0bee65dcc46c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:50.497650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d898242b-72c3-48e7-a4e5-0bee65dcc46c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:50.498079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d898242b-72c3-48e7-a4e5-0bee65dcc46c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:50.560082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d898242b-72c3-48e7-a4e5-0bee65dcc46c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:47:50.665533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:47:50.757339 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d898242b-72c3-48e7-a4e5-0bee65dcc46c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 204 len: 0 microversion: 2.1 time: 0.286456 Oct 24 10:47:50.763740 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2448/4933] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:47:50 2022] DELETE /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:47:50.774112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a6dad016-600d-4b69-b3d2-fd3f0f537d4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:50.777072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a6dad016-600d-4b69-b3d2-fd3f0f537d4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:50.795973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6dad016-600d-4b69-b3d2-fd3f0f537d4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:50.797528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6dad016-600d-4b69-b3d2-fd3f0f537d4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:50.798484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6dad016-600d-4b69-b3d2-fd3f0f537d4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:50.801126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6dad016-600d-4b69-b3d2-fd3f0f537d4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:50.801906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6dad016-600d-4b69-b3d2-fd3f0f537d4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:50.802626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6dad016-600d-4b69-b3d2-fd3f0f537d4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:50.806489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ad94a5b6-734d-4126-9482-ae11fe3002b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:50.816602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ad94a5b6-734d-4126-9482-ae11fe3002b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:50.820745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ad94a5b6-734d-4126-9482-ae11fe3002b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:50.822561 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ad94a5b6-734d-4126-9482-ae11fe3002b0 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1722 microversion: 2.20 time: 0.863517 Oct 24 10:47:50.824948 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2486/4934] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:47:49 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1722 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:47:50.848273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a6dad016-600d-4b69-b3d2-fd3f0f537d4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:47:50.939683 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.compute.api [None req-a6dad016-600d-4b69-b3d2-fd3f0f537d4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Instance is already in deleting state, ignoring this request Oct 24 10:47:50.941850 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a6dad016-600d-4b69-b3d2-fd3f0f537d4e tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 204 len: 0 microversion: 2.1 time: 0.175637 Oct 24 10:47:50.943232 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2449/4935] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:47:50 2022] DELETE /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:47:50.951111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f30814a8-6c0a-4892-b167-9863eacf35cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:50.951742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f30814a8-6c0a-4892-b167-9863eacf35cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:50.964217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f30814a8-6c0a-4892-b167-9863eacf35cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:50.964361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f30814a8-6c0a-4892-b167-9863eacf35cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:50.964765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f30814a8-6c0a-4892-b167-9863eacf35cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:50.965550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f30814a8-6c0a-4892-b167-9863eacf35cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:50.966127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f30814a8-6c0a-4892-b167-9863eacf35cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:50.966399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f30814a8-6c0a-4892-b167-9863eacf35cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:51.434076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f30814a8-6c0a-4892-b167-9863eacf35cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:51.446524 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f30814a8-6c0a-4892-b167-9863eacf35cc tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1513 microversion: 2.1 time: 0.499167 Oct 24 10:47:51.447129 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2487/4936] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:50 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1513 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:51.857409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf98b8ab-a4c6-4c9e-9dc5-19daa2cbde1f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:51.863234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf98b8ab-a4c6-4c9e-9dc5-19daa2cbde1f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:51.880865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf98b8ab-a4c6-4c9e-9dc5-19daa2cbde1f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:51.884079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf98b8ab-a4c6-4c9e-9dc5-19daa2cbde1f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:51.894826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf98b8ab-a4c6-4c9e-9dc5-19daa2cbde1f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:51.895616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf98b8ab-a4c6-4c9e-9dc5-19daa2cbde1f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:51.896099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf98b8ab-a4c6-4c9e-9dc5-19daa2cbde1f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:51.896523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf98b8ab-a4c6-4c9e-9dc5-19daa2cbde1f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:52.314798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cf98b8ab-a4c6-4c9e-9dc5-19daa2cbde1f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:52.328393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cf98b8ab-a4c6-4c9e-9dc5-19daa2cbde1f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:52.329887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cf98b8ab-a4c6-4c9e-9dc5-19daa2cbde1f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:52.331314 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf98b8ab-a4c6-4c9e-9dc5-19daa2cbde1f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1722 microversion: 2.20 time: 0.478064 Oct 24 10:47:52.332784 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2450/4937] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:47:51 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1722 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:47:52.475168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5730018c-d324-41ca-9b83-9f3ca70013d9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:52.475787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5730018c-d324-41ca-9b83-9f3ca70013d9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:52.488411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5730018c-d324-41ca-9b83-9f3ca70013d9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:52.488949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5730018c-d324-41ca-9b83-9f3ca70013d9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:52.489399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5730018c-d324-41ca-9b83-9f3ca70013d9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:52.490121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5730018c-d324-41ca-9b83-9f3ca70013d9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:52.490582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5730018c-d324-41ca-9b83-9f3ca70013d9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:52.491020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5730018c-d324-41ca-9b83-9f3ca70013d9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:52.976921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5730018c-d324-41ca-9b83-9f3ca70013d9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:52.985946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eddff5cd-2f68-49de-b992-cf44e50f6678 tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] Calling method '.version_select at 0x7f04d0ca8ee0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:52.990361 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5730018c-d324-41ca-9b83-9f3ca70013d9 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1513 microversion: 2.1 time: 0.518646 Oct 24 10:47:52.992865 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2488/4938] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:52 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1513 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:53.077124 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eddff5cd-2f68-49de-b992-cf44e50f6678 tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/58954757-e9a4-47e6-a9d3-2f51708f4e30" status: 200 len: 350 microversion: 2.1 time: 0.095768 Oct 24 10:47:53.078094 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2451/4939] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 10:47:52 2022] GET /compute/v2.1/os-volumes/58954757-e9a4-47e6-a9d3-2f51708f4e30 => generated 350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:47:53.361504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f68a78f8-a87e-49cd-8b09-9e6c65cb4f79 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:53.362166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f68a78f8-a87e-49cd-8b09-9e6c65cb4f79 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:53.370590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f68a78f8-a87e-49cd-8b09-9e6c65cb4f79 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:53.371176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f68a78f8-a87e-49cd-8b09-9e6c65cb4f79 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:53.371889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f68a78f8-a87e-49cd-8b09-9e6c65cb4f79 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:53.373148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f68a78f8-a87e-49cd-8b09-9e6c65cb4f79 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:53.381412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f68a78f8-a87e-49cd-8b09-9e6c65cb4f79 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:53.382912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f68a78f8-a87e-49cd-8b09-9e6c65cb4f79 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:53.682136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a189139e-994e-457b-92f2-ee032b437f7d req-705c974a-ab13-4e92-98b3-36c67f4a136e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2992560c-f47d-44e1-a976-3f26b8f21b21", "name": "network-vif-deleted", "tag": "08321389-96af-4a52-b12f-c9346d58ac1f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:47:53.717114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a189139e-994e-457b-92f2-ee032b437f7d req-705c974a-ab13-4e92-98b3-36c67f4a136e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:53.717689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a189139e-994e-457b-92f2-ee032b437f7d req-705c974a-ab13-4e92-98b3-36c67f4a136e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:53.718989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a189139e-994e-457b-92f2-ee032b437f7d req-705c974a-ab13-4e92-98b3-36c67f4a136e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:53.794699 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a189139e-994e-457b-92f2-ee032b437f7d req-705c974a-ab13-4e92-98b3-36c67f4a136e service nova] Creating event network-vif-deleted:08321389-96af-4a52-b12f-c9346d58ac1f for instance 2992560c-f47d-44e1-a976-3f26b8f21b21 on n-h1-858383-15 Oct 24 10:47:53.818102 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a189139e-994e-457b-92f2-ee032b437f7d req-705c974a-ab13-4e92-98b3-36c67f4a136e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139716 Oct 24 10:47:53.828882 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2452/4940] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:47:53.958193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f68a78f8-a87e-49cd-8b09-9e6c65cb4f79 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:53.971813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f68a78f8-a87e-49cd-8b09-9e6c65cb4f79 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:53.977698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f68a78f8-a87e-49cd-8b09-9e6c65cb4f79 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:53.986624 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f68a78f8-a87e-49cd-8b09-9e6c65cb4f79 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1722 microversion: 2.20 time: 0.631426 Oct 24 10:47:53.987228 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2489/4941] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:47:53 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1722 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:47:54.023882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f6f3add3-6de4-4bbe-9695-4a4dae35ad44 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:54.025572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f6f3add3-6de4-4bbe-9695-4a4dae35ad44 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:54.058444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f3add3-6de4-4bbe-9695-4a4dae35ad44 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:54.060603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f3add3-6de4-4bbe-9695-4a4dae35ad44 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:54.062606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f3add3-6de4-4bbe-9695-4a4dae35ad44 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:54.064182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f3add3-6de4-4bbe-9695-4a4dae35ad44 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:54.064934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f3add3-6de4-4bbe-9695-4a4dae35ad44 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:54.065615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f3add3-6de4-4bbe-9695-4a4dae35ad44 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:54.148557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f3add3-6de4-4bbe-9695-4a4dae35ad44 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:54.149217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f3add3-6de4-4bbe-9695-4a4dae35ad44 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:54.149985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f3add3-6de4-4bbe-9695-4a4dae35ad44 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:54.150548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-f6f3add3-6de4-4bbe-9695-4a4dae35ad44 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lazy-loading 'fault' on Instance uuid 2992560c-f47d-44e1-a976-3f26b8f21b21 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:47:54.279682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f6f3add3-6de4-4bbe-9695-4a4dae35ad44 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '758d3d450ce546ebad1836362108dea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656c472b32cc4421b312f671691a1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:54.290757 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f6f3add3-6de4-4bbe-9695-4a4dae35ad44 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 200 len: 1308 microversion: 2.1 time: 0.276029 Oct 24 10:47:54.295128 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2453/4942] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:54 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 1308 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:54.748472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f68a78f8-a87e-49cd-8b09-9e6c65cb4f79 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:54.748472 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f68a78f8-a87e-49cd-8b09-9e6c65cb4f79 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001286 Oct 24 10:47:54.748472 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2490/4943] 10.222.0.50 () {56 vars in 886 bytes} [Mon Oct 24 10:47:54 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 24 10:47:55.016518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-83360998-071c-467d-94ab-11d64bed2ec7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:55.017434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-83360998-071c-467d-94ab-11d64bed2ec7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:55.030239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83360998-071c-467d-94ab-11d64bed2ec7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:55.031102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83360998-071c-467d-94ab-11d64bed2ec7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:55.031581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83360998-071c-467d-94ab-11d64bed2ec7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:55.032320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83360998-071c-467d-94ab-11d64bed2ec7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:55.032782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83360998-071c-467d-94ab-11d64bed2ec7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:55.033245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83360998-071c-467d-94ab-11d64bed2ec7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:55.332758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-641933f6-21d6-4d27-99f4-689c2c98875f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:55.334800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-641933f6-21d6-4d27-99f4-689c2c98875f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 2992560c-f47d-44e1-a976-3f26b8f21b21] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:55.357152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-83360998-071c-467d-94ab-11d64bed2ec7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:55.369823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-641933f6-21d6-4d27-99f4-689c2c98875f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:55.370333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-641933f6-21d6-4d27-99f4-689c2c98875f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:55.370778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-641933f6-21d6-4d27-99f4-689c2c98875f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:55.372061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-641933f6-21d6-4d27-99f4-689c2c98875f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:55.372530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-641933f6-21d6-4d27-99f4-689c2c98875f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:55.372998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-641933f6-21d6-4d27-99f4-689c2c98875f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:55.373735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-83360998-071c-467d-94ab-11d64bed2ec7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:55.375682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-83360998-071c-467d-94ab-11d64bed2ec7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:55.381733 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-83360998-071c-467d-94ab-11d64bed2ec7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1722 microversion: 2.20 time: 0.366177 Oct 24 10:47:55.382584 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2454/4944] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:47:55 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1722 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:47:55.394210 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-641933f6-21d6-4d27-99f4-689c2c98875f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] HTTP exception thrown: Instance 2992560c-f47d-44e1-a976-3f26b8f21b21 could not be found. Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-641933f6-21d6-4d27-99f4-689c2c98875f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Request method failure captured: Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 HTTP/1.1 Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmy7zwH9GPVoGLDUEIRHUa-nl8VsJwR0j8Cbd6-kI-4vd8wiWPBkwyYMttNHk7yczmUaWjtzKKuToJi3w-x2sOmbGVBwIIkDPZkv8uwImJbPPETeaAErHMptW7LnYCqjTnNrcuwzGhDgxIWJFDrzdn6Q0wQ5Q5Av59N1w9KzyUluBUs Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 656c472b32cc4421b312f671691a1bda Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1670725579 Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/656c472b32cc4421b312f671691a1bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/656c472b32cc4421b312f671691a1bda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/656c472b32cc4421b312f671691a1bda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_656c472b32cc4421b312f671691a1bda", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerDiskConfigTestJSON-1670725579 Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 656c472b32cc4421b312f671691a1bda Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1670725579 Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerDiskConfigTestJSON-1670725579-project Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 758d3d450ce546ebad1836362108dea7 Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerDiskConfigTestJSON-1670725579-project Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 2992560c-f47d-44e1-a976-3f26b8f21b21 could not be found. Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '2992560c-f47d-44e1-a976-3f26b8f21b21'} Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2992560c-f47d-44e1-a976-3f26b8f21b21 could not be found. Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2992560c-f47d-44e1-a976-3f26b8f21b21 could not be found. Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:55.396370 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.400993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:55.400993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:55.400993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:55.400993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:55.400993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:55.400993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2992560c-f47d-44e1-a976-3f26b8f21b21 could not be found. Oct 24 10:47:55.400993 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.402377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-641933f6-21d6-4d27-99f4-689c2c98875f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Returning 404 to user: Instance 2992560c-f47d-44e1-a976-3f26b8f21b21 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:55.403405 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-641933f6-21d6-4d27-99f4-689c2c98875f tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21" status: 404 len: 111 microversion: 2.1 time: 0.082777 Oct 24 10:47:55.413696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf81f690-bbad-4824-8e96-436c78c4317c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:55.414463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bf81f690-bbad-4824-8e96-436c78c4317c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:55.417920 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2491/4945] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:55 2022] GET /compute/v2.1/servers/2992560c-f47d-44e1-a976-3f26b8f21b21 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:55.423392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf81f690-bbad-4824-8e96-436c78c4317c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:55.424794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf81f690-bbad-4824-8e96-436c78c4317c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:55.426034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf81f690-bbad-4824-8e96-436c78c4317c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:55.427012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf81f690-bbad-4824-8e96-436c78c4317c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:55.427669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf81f690-bbad-4824-8e96-436c78c4317c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:55.428665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf81f690-bbad-4824-8e96-436c78c4317c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:55.447315 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-bf81f690-bbad-4824-8e96-436c78c4317c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] HTTP exception thrown: Instance 0272c314-d0fe-44d3-8f8c-b475beff2cd1 could not be found. Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf81f690-bbad-4824-8e96-436c78c4317c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Request method failure captured: Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 HTTP/1.1 Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmy7zwH9GPVoGLDUEIRHUa-nl8VsJwR0j8Cbd6-kI-4vd8wiWPBkwyYMttNHk7yczmUaWjtzKKuToJi3w-x2sOmbGVBwIIkDPZkv8uwImJbPPETeaAErHMptW7LnYCqjTnNrcuwzGhDgxIWJFDrzdn6Q0wQ5Q5Av59N1w9KzyUluBUs Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 656c472b32cc4421b312f671691a1bda Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1670725579 Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/656c472b32cc4421b312f671691a1bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/656c472b32cc4421b312f671691a1bda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/656c472b32cc4421b312f671691a1bda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_656c472b32cc4421b312f671691a1bda", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerDiskConfigTestJSON-1670725579 Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 656c472b32cc4421b312f671691a1bda Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1670725579 Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerDiskConfigTestJSON-1670725579-project Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 758d3d450ce546ebad1836362108dea7 Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerDiskConfigTestJSON-1670725579-project Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 0272c314-d0fe-44d3-8f8c-b475beff2cd1 could not be found. Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '0272c314-d0fe-44d3-8f8c-b475beff2cd1'} Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0272c314-d0fe-44d3-8f8c-b475beff2cd1 could not be found. Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:55.450554 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:55.456308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0272c314-d0fe-44d3-8f8c-b475beff2cd1 could not be found. Oct 24 10:47:55.456308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.456308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:55.456308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.456308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:55.456308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:55.456308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:55.456308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:55.456308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:55.456308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0272c314-d0fe-44d3-8f8c-b475beff2cd1 could not be found. Oct 24 10:47:55.456308 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.458330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf81f690-bbad-4824-8e96-436c78c4317c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Returning 404 to user: Instance 0272c314-d0fe-44d3-8f8c-b475beff2cd1 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:55.459503 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bf81f690-bbad-4824-8e96-436c78c4317c tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 404 len: 111 microversion: 2.1 time: 0.050128 Oct 24 10:47:55.472176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-29edd0b3-961c-484d-8db6-d459185b0c99 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:55.473240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-29edd0b3-961c-484d-8db6-d459185b0c99 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: 0272c314-d0fe-44d3-8f8c-b475beff2cd1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:55.476976 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2455/4946] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:47:55 2022] DELETE /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:47:55.482050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29edd0b3-961c-484d-8db6-d459185b0c99 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:55.482747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29edd0b3-961c-484d-8db6-d459185b0c99 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:55.483408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29edd0b3-961c-484d-8db6-d459185b0c99 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:55.485197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29edd0b3-961c-484d-8db6-d459185b0c99 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:55.485827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29edd0b3-961c-484d-8db6-d459185b0c99 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:55.486470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29edd0b3-961c-484d-8db6-d459185b0c99 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:55.515669 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-29edd0b3-961c-484d-8db6-d459185b0c99 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] HTTP exception thrown: Instance 0272c314-d0fe-44d3-8f8c-b475beff2cd1 could not be found. Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-29edd0b3-961c-484d-8db6-d459185b0c99 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Request method failure captured: Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 HTTP/1.1 Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmy7zwH9GPVoGLDUEIRHUa-nl8VsJwR0j8Cbd6-kI-4vd8wiWPBkwyYMttNHk7yczmUaWjtzKKuToJi3w-x2sOmbGVBwIIkDPZkv8uwImJbPPETeaAErHMptW7LnYCqjTnNrcuwzGhDgxIWJFDrzdn6Q0wQ5Q5Av59N1w9KzyUluBUs Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 656c472b32cc4421b312f671691a1bda Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1670725579 Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/656c472b32cc4421b312f671691a1bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/656c472b32cc4421b312f671691a1bda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/656c472b32cc4421b312f671691a1bda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_656c472b32cc4421b312f671691a1bda", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerDiskConfigTestJSON-1670725579 Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 656c472b32cc4421b312f671691a1bda Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1670725579 Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerDiskConfigTestJSON-1670725579-project Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 758d3d450ce546ebad1836362108dea7 Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerDiskConfigTestJSON-1670725579-project Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 0272c314-d0fe-44d3-8f8c-b475beff2cd1 could not be found. Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '0272c314-d0fe-44d3-8f8c-b475beff2cd1'} Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0272c314-d0fe-44d3-8f8c-b475beff2cd1 could not be found. Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0272c314-d0fe-44d3-8f8c-b475beff2cd1 could not be found. Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:55.520858 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.525728 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:55.525728 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:55.525728 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:55.525728 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:55.525728 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:55.525728 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0272c314-d0fe-44d3-8f8c-b475beff2cd1 could not be found. Oct 24 10:47:55.525728 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.527007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-29edd0b3-961c-484d-8db6-d459185b0c99 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Returning 404 to user: Instance 0272c314-d0fe-44d3-8f8c-b475beff2cd1 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:55.528102 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-29edd0b3-961c-484d-8db6-d459185b0c99 tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1" status: 404 len: 111 microversion: 2.1 time: 0.062423 Oct 24 10:47:55.534091 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2492/4947] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:55 2022] GET /compute/v2.1/servers/0272c314-d0fe-44d3-8f8c-b475beff2cd1 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:55.539979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-659af995-95fc-469d-ad31-7cefe18366ee tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:55.540727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-659af995-95fc-469d-ad31-7cefe18366ee tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:55.548956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-659af995-95fc-469d-ad31-7cefe18366ee tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:55.551766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-659af995-95fc-469d-ad31-7cefe18366ee tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:55.552387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-659af995-95fc-469d-ad31-7cefe18366ee tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:55.554235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-659af995-95fc-469d-ad31-7cefe18366ee tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:55.555292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-659af995-95fc-469d-ad31-7cefe18366ee tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:55.556390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-659af995-95fc-469d-ad31-7cefe18366ee tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:55.596713 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-659af995-95fc-469d-ad31-7cefe18366ee tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] HTTP exception thrown: Instance dba574b8-fd7b-4914-b2e1-0ef7c7beb55d could not be found. Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-659af995-95fc-469d-ad31-7cefe18366ee tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Request method failure captured: Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d HTTP/1.1 Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmy7zwH9GPVoGLDUEIRHUa-nl8VsJwR0j8Cbd6-kI-4vd8wiWPBkwyYMttNHk7yczmUaWjtzKKuToJi3w-x2sOmbGVBwIIkDPZkv8uwImJbPPETeaAErHMptW7LnYCqjTnNrcuwzGhDgxIWJFDrzdn6Q0wQ5Q5Av59N1w9KzyUluBUs Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 656c472b32cc4421b312f671691a1bda Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1670725579 Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/656c472b32cc4421b312f671691a1bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/656c472b32cc4421b312f671691a1bda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/656c472b32cc4421b312f671691a1bda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_656c472b32cc4421b312f671691a1bda", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerDiskConfigTestJSON-1670725579 Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 656c472b32cc4421b312f671691a1bda Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1670725579 Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerDiskConfigTestJSON-1670725579-project Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 758d3d450ce546ebad1836362108dea7 Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerDiskConfigTestJSON-1670725579-project Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance dba574b8-fd7b-4914-b2e1-0ef7c7beb55d could not be found. Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'dba574b8-fd7b-4914-b2e1-0ef7c7beb55d'} Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dba574b8-fd7b-4914-b2e1-0ef7c7beb55d could not be found. Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:55.602020 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:55.606844 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dba574b8-fd7b-4914-b2e1-0ef7c7beb55d could not be found. Oct 24 10:47:55.606844 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.606844 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:55.606844 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.606844 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:55.606844 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:55.606844 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:55.606844 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:55.606844 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:55.606844 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dba574b8-fd7b-4914-b2e1-0ef7c7beb55d could not be found. Oct 24 10:47:55.606844 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.606844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-659af995-95fc-469d-ad31-7cefe18366ee tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Returning 404 to user: Instance dba574b8-fd7b-4914-b2e1-0ef7c7beb55d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:55.606844 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-659af995-95fc-469d-ad31-7cefe18366ee tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 404 len: 111 microversion: 2.1 time: 0.069355 Oct 24 10:47:55.606844 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2456/4948] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:47:55 2022] DELETE /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:55.623290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a1d3a2a7-8063-4b8a-9e9b-cb51b47b7d1a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:55.626275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a1d3a2a7-8063-4b8a-9e9b-cb51b47b7d1a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] [instance: dba574b8-fd7b-4914-b2e1-0ef7c7beb55d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:55.641119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1d3a2a7-8063-4b8a-9e9b-cb51b47b7d1a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:55.642625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1d3a2a7-8063-4b8a-9e9b-cb51b47b7d1a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:55.643312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1d3a2a7-8063-4b8a-9e9b-cb51b47b7d1a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:55.645322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1d3a2a7-8063-4b8a-9e9b-cb51b47b7d1a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:55.645927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1d3a2a7-8063-4b8a-9e9b-cb51b47b7d1a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:55.646644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1d3a2a7-8063-4b8a-9e9b-cb51b47b7d1a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:55.664710 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-a1d3a2a7-8063-4b8a-9e9b-cb51b47b7d1a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] HTTP exception thrown: Instance dba574b8-fd7b-4914-b2e1-0ef7c7beb55d could not be found. Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a1d3a2a7-8063-4b8a-9e9b-cb51b47b7d1a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Request method failure captured: Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d HTTP/1.1 Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmy7zwH9GPVoGLDUEIRHUa-nl8VsJwR0j8Cbd6-kI-4vd8wiWPBkwyYMttNHk7yczmUaWjtzKKuToJi3w-x2sOmbGVBwIIkDPZkv8uwImJbPPETeaAErHMptW7LnYCqjTnNrcuwzGhDgxIWJFDrzdn6Q0wQ5Q5Av59N1w9KzyUluBUs Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 656c472b32cc4421b312f671691a1bda Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1670725579 Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/656c472b32cc4421b312f671691a1bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/656c472b32cc4421b312f671691a1bda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/656c472b32cc4421b312f671691a1bda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_656c472b32cc4421b312f671691a1bda", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerDiskConfigTestJSON-1670725579 Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 656c472b32cc4421b312f671691a1bda Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1670725579 Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerDiskConfigTestJSON-1670725579-project Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 758d3d450ce546ebad1836362108dea7 Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerDiskConfigTestJSON-1670725579-project Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance dba574b8-fd7b-4914-b2e1-0ef7c7beb55d could not be found. Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'dba574b8-fd7b-4914-b2e1-0ef7c7beb55d'} Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dba574b8-fd7b-4914-b2e1-0ef7c7beb55d could not be found. Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dba574b8-fd7b-4914-b2e1-0ef7c7beb55d could not be found. Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:47:55.666513 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.671837 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:47:55.671837 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:47:55.671837 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:47:55.671837 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:47:55.671837 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:47:55.671837 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dba574b8-fd7b-4914-b2e1-0ef7c7beb55d could not be found. Oct 24 10:47:55.671837 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:47:55.673959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a1d3a2a7-8063-4b8a-9e9b-cb51b47b7d1a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] Returning 404 to user: Instance dba574b8-fd7b-4914-b2e1-0ef7c7beb55d could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:47:55.673959 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a1d3a2a7-8063-4b8a-9e9b-cb51b47b7d1a tempest-ServerDiskConfigTestJSON-1670725579 tempest-ServerDiskConfigTestJSON-1670725579-project] 10.222.0.50 "GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d" status: 404 len: 111 microversion: 2.1 time: 0.063720 Oct 24 10:47:55.674616 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2493/4949] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:47:55 2022] GET /compute/v2.1/servers/dba574b8-fd7b-4914-b2e1-0ef7c7beb55d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:47:55.817713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-493666ce-a5f9-42f2-8b2f-c8509af23fdc tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] Calling method '.version_select at 0x7f04d4fe0940>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:55.892914 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-493666ce-a5f9-42f2-8b2f-c8509af23fdc tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/4b2b8b19-1665-47a9-9ed7-1304cdccaf52" status: 200 len: 350 microversion: 2.1 time: 0.079326 Oct 24 10:47:55.894612 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2457/4950] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 10:47:55 2022] GET /compute/v2.1/os-volumes/4b2b8b19-1665-47a9-9ed7-1304cdccaf52 => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:47:56.412688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-95ac58e5-8dd5-4755-8ed5-ba724e86cc1b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:56.413428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-95ac58e5-8dd5-4755-8ed5-ba724e86cc1b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:56.433469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95ac58e5-8dd5-4755-8ed5-ba724e86cc1b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:56.434016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95ac58e5-8dd5-4755-8ed5-ba724e86cc1b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:56.434649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95ac58e5-8dd5-4755-8ed5-ba724e86cc1b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:56.435428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95ac58e5-8dd5-4755-8ed5-ba724e86cc1b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:56.436146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95ac58e5-8dd5-4755-8ed5-ba724e86cc1b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:56.437054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95ac58e5-8dd5-4755-8ed5-ba724e86cc1b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:57.768074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-95ac58e5-8dd5-4755-8ed5-ba724e86cc1b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:57.804729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-95ac58e5-8dd5-4755-8ed5-ba724e86cc1b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:57.810767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-95ac58e5-8dd5-4755-8ed5-ba724e86cc1b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:57.815018 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-95ac58e5-8dd5-4755-8ed5-ba724e86cc1b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1722 microversion: 2.20 time: 1.405209 Oct 24 10:47:57.816472 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2494/4951] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:47:56 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1722 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:47:58.571680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d6db5229-5d31-4122-9442-782f1a14a782 tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] Calling method '.version_select at 0x7f04d02d0940>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:58.684658 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d6db5229-5d31-4122-9442-782f1a14a782 tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/08f6bbaa-8ee5-469e-8874-d39df27e81e0" status: 200 len: 350 microversion: 2.1 time: 0.123447 Oct 24 10:47:58.704655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c3a15235-6a69-452c-b984-036ff07db9bd tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] Calling method '.version_select at 0x7f04d00b6820>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:58.709005 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2458/4952] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 10:47:58 2022] GET /compute/v2.1/os-volumes/08f6bbaa-8ee5-469e-8874-d39df27e81e0 => generated 350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:47:58.851176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c69d8203-7f29-4d36-81a7-12f4fbdd678b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:58.851812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c69d8203-7f29-4d36-81a7-12f4fbdd678b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:47:58.879829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c69d8203-7f29-4d36-81a7-12f4fbdd678b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:58.880337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c69d8203-7f29-4d36-81a7-12f4fbdd678b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:58.883315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c69d8203-7f29-4d36-81a7-12f4fbdd678b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:58.884890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c69d8203-7f29-4d36-81a7-12f4fbdd678b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:47:58.896635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c69d8203-7f29-4d36-81a7-12f4fbdd678b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:47:58.897133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c69d8203-7f29-4d36-81a7-12f4fbdd678b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:47:58.910863 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c3a15235-6a69-452c-b984-036ff07db9bd tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.214199 Oct 24 10:47:58.913176 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2495/4953] 10.222.0.50 () {58 vars in 1134 bytes} [Mon Oct 24 10:47:58 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:58.929013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-098dfa74-129f-4836-9b5f-4f5033888d13 tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] Calling method '.version_select at 0x7f04cb8e4040>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:59.161583 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-098dfa74-129f-4836-9b5f-4f5033888d13 tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.237110 Oct 24 10:47:59.163083 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2496/4954] 10.222.0.50 () {58 vars in 1149 bytes} [Mon Oct 24 10:47:58 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:47:59.181791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-279edf49-0695-4b17-b5b7-bf794f66a06d tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] Calling method '.version_select at 0x7f04cb8e4c10>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:59.420864 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-279edf49-0695-4b17-b5b7-bf794f66a06d tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.245759 Oct 24 10:47:59.422901 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2497/4955] 10.222.0.50 () {58 vars in 1134 bytes} [Mon Oct 24 10:47:59 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:47:59.454356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e0a22107-7c25-4143-afc7-2abed05e4e1e tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] Calling method '.version_select at 0x7f04d06afee0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:59.553140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c69d8203-7f29-4d36-81a7-12f4fbdd678b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:59.571386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c69d8203-7f29-4d36-81a7-12f4fbdd678b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:59.573196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c69d8203-7f29-4d36-81a7-12f4fbdd678b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:47:59.586463 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c69d8203-7f29-4d36-81a7-12f4fbdd678b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1743 microversion: 2.20 time: 0.746263 Oct 24 10:47:59.587396 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2459/4956] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:47:58 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1743 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:47:59.671594 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e0a22107-7c25-4143-afc7-2abed05e4e1e tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.231112 Oct 24 10:47:59.672902 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2498/4957] 10.222.0.50 () {58 vars in 1167 bytes} [Mon Oct 24 10:47:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:47:59.701415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-36e0a235-bf7c-4b93-8b0e-6e7ba84e1d03 tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] Calling method '.version_select at 0x7f04d02555e0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:47:59.849774 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-36e0a235-bf7c-4b93-8b0e-6e7ba84e1d03 tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.155006 Oct 24 10:47:59.850358 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2460/4958] 10.222.0.50 () {58 vars in 1170 bytes} [Mon Oct 24 10:47:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:47:59.874718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-794134ee-4d60-48c0-9c05-0f31a0caeb53 tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] Calling method '.version_select at 0x7f04d078d310>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:00.163182 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-794134ee-4d60-48c0-9c05-0f31a0caeb53 tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.291461 Oct 24 10:48:00.164504 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2499/4959] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Oct 24 10:47:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:00.190477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ddda88d3-8846-4c63-9974-192c23cf470c tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] Calling method '.version_select at 0x7f04d0216c10>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:00.388690 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ddda88d3-8846-4c63-9974-192c23cf470c tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.204218 Oct 24 10:48:00.408742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3788d62d-655b-405b-ab69-a7a880a4e1ef tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] Calling method '.version_select at 0x7f04d021ef70>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:00.409356 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2461/4960] 10.222.0.50 () {58 vars in 1188 bytes} [Mon Oct 24 10:48:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:48:00.544485 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3788d62d-655b-405b-ab69-a7a880a4e1ef tempest-VolumesTestJSON-1001632856 tempest-VolumesTestJSON-1001632856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.140377 Oct 24 10:48:00.545208 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2500/4961] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Oct 24 10:48:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:00.624306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-943b74a1-0841-469d-8ca0-b33c73ceb229 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:00.625685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-943b74a1-0841-469d-8ca0-b33c73ceb229 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:00.641087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-943b74a1-0841-469d-8ca0-b33c73ceb229 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:00.641870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-943b74a1-0841-469d-8ca0-b33c73ceb229 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:00.645807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-943b74a1-0841-469d-8ca0-b33c73ceb229 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:00.646876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-943b74a1-0841-469d-8ca0-b33c73ceb229 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:00.647349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-943b74a1-0841-469d-8ca0-b33c73ceb229 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:00.651584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-943b74a1-0841-469d-8ca0-b33c73ceb229 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:01.753177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-943b74a1-0841-469d-8ca0-b33c73ceb229 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:01.772855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-943b74a1-0841-469d-8ca0-b33c73ceb229 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:01.795010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-943b74a1-0841-469d-8ca0-b33c73ceb229 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:01.804911 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-943b74a1-0841-469d-8ca0-b33c73ceb229 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1743 microversion: 2.20 time: 1.187725 Oct 24 10:48:01.805941 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2462/4962] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:00 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1743 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:02.834517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-313b08b8-e2d0-4ec0-80c4-7f42997377cf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:02.836320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-313b08b8-e2d0-4ec0-80c4-7f42997377cf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:02.855597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-313b08b8-e2d0-4ec0-80c4-7f42997377cf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:02.856368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-313b08b8-e2d0-4ec0-80c4-7f42997377cf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:02.857033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-313b08b8-e2d0-4ec0-80c4-7f42997377cf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:02.858838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-313b08b8-e2d0-4ec0-80c4-7f42997377cf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:02.859488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-313b08b8-e2d0-4ec0-80c4-7f42997377cf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:02.860581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-313b08b8-e2d0-4ec0-80c4-7f42997377cf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:03.458065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-313b08b8-e2d0-4ec0-80c4-7f42997377cf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:03.468947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:48:03.478721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-313b08b8-e2d0-4ec0-80c4-7f42997377cf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:03.509587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-313b08b8-e2d0-4ec0-80c4-7f42997377cf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:03.514056 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-313b08b8-e2d0-4ec0-80c4-7f42997377cf tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1738 microversion: 2.20 time: 0.685170 Oct 24 10:48:03.515394 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2501/4963] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:02 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1738 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:04.542983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09fc360e-d0d7-4f91-a684-abbc50f08cbb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:04.543917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09fc360e-d0d7-4f91-a684-abbc50f08cbb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:04.562574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:48:04.571810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09fc360e-d0d7-4f91-a684-abbc50f08cbb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:04.575273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09fc360e-d0d7-4f91-a684-abbc50f08cbb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:04.575746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09fc360e-d0d7-4f91-a684-abbc50f08cbb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:04.580878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09fc360e-d0d7-4f91-a684-abbc50f08cbb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:04.581401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09fc360e-d0d7-4f91-a684-abbc50f08cbb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:04.581959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09fc360e-d0d7-4f91-a684-abbc50f08cbb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:05.678873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-09fc360e-d0d7-4f91-a684-abbc50f08cbb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:05.689409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-09fc360e-d0d7-4f91-a684-abbc50f08cbb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:05.723610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-09fc360e-d0d7-4f91-a684-abbc50f08cbb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:05.725072 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-09fc360e-d0d7-4f91-a684-abbc50f08cbb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1738 microversion: 2.20 time: 1.186101 Oct 24 10:48:05.725677 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2463/4964] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:04 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1738 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:06.757611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-197c13e7-5ccb-4aa4-9c49-8cdc7df07c93 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:06.758313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-197c13e7-5ccb-4aa4-9c49-8cdc7df07c93 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:06.787340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-197c13e7-5ccb-4aa4-9c49-8cdc7df07c93 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:06.789927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-197c13e7-5ccb-4aa4-9c49-8cdc7df07c93 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:06.792400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-197c13e7-5ccb-4aa4-9c49-8cdc7df07c93 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:06.797924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-197c13e7-5ccb-4aa4-9c49-8cdc7df07c93 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:06.801480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-197c13e7-5ccb-4aa4-9c49-8cdc7df07c93 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:06.802863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-197c13e7-5ccb-4aa4-9c49-8cdc7df07c93 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:07.628127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-307f6e1d-9506-496c-91f7-912d378fefcb req-f58a97e8-5e46-460f-8372-52e43032bbcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e357ce41-0ae9-4efa-973b-bc8920e4a0fa", "name": "network-vif-plugged", "status": "completed", "tag": "ddf713d1-ef02-4308-b6ce-8ec89af0574f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:48:07.660107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-307f6e1d-9506-496c-91f7-912d378fefcb req-f58a97e8-5e46-460f-8372-52e43032bbcf service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:07.667295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-307f6e1d-9506-496c-91f7-912d378fefcb req-f58a97e8-5e46-460f-8372-52e43032bbcf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:07.668428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-307f6e1d-9506-496c-91f7-912d378fefcb req-f58a97e8-5e46-460f-8372-52e43032bbcf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:07.709219 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-307f6e1d-9506-496c-91f7-912d378fefcb req-f58a97e8-5e46-460f-8372-52e43032bbcf service nova] Creating event network-vif-plugged:ddf713d1-ef02-4308-b6ce-8ec89af0574f for instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa on n-h2-858383-15 Oct 24 10:48:07.722980 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-307f6e1d-9506-496c-91f7-912d378fefcb req-f58a97e8-5e46-460f-8372-52e43032bbcf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099441 Oct 24 10:48:07.725520 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2464/4965] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 24 10:48:08.104619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-197c13e7-5ccb-4aa4-9c49-8cdc7df07c93 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:08.119604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-197c13e7-5ccb-4aa4-9c49-8cdc7df07c93 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:08.123932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-197c13e7-5ccb-4aa4-9c49-8cdc7df07c93 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:08.132821 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-197c13e7-5ccb-4aa4-9c49-8cdc7df07c93 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1738 microversion: 2.20 time: 1.380882 Oct 24 10:48:08.138431 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2502/4966] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:06 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1738 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:09.173198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-917d2e30-583e-4e5e-a579-c32cd4b9b302 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:09.174989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-917d2e30-583e-4e5e-a579-c32cd4b9b302 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:09.196952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-917d2e30-583e-4e5e-a579-c32cd4b9b302 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:09.198005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-917d2e30-583e-4e5e-a579-c32cd4b9b302 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:09.199615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-917d2e30-583e-4e5e-a579-c32cd4b9b302 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:09.200600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-917d2e30-583e-4e5e-a579-c32cd4b9b302 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:09.201336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-917d2e30-583e-4e5e-a579-c32cd4b9b302 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:09.203685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-917d2e30-583e-4e5e-a579-c32cd4b9b302 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:09.846701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-917d2e30-583e-4e5e-a579-c32cd4b9b302 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:09.861026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-917d2e30-583e-4e5e-a579-c32cd4b9b302 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:09.867806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-917d2e30-583e-4e5e-a579-c32cd4b9b302 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:09.896351 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-917d2e30-583e-4e5e-a579-c32cd4b9b302 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1738 microversion: 2.20 time: 0.725960 Oct 24 10:48:09.899254 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2465/4967] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:09 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1738 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:10.931885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b2224326-2379-4dcc-a316-c03bb295307c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:10.932516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b2224326-2379-4dcc-a316-c03bb295307c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:10.947575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2224326-2379-4dcc-a316-c03bb295307c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:10.948093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2224326-2379-4dcc-a316-c03bb295307c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:10.948536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2224326-2379-4dcc-a316-c03bb295307c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:10.949310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2224326-2379-4dcc-a316-c03bb295307c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:10.949783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2224326-2379-4dcc-a316-c03bb295307c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:10.950224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2224326-2379-4dcc-a316-c03bb295307c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:11.749484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b2224326-2379-4dcc-a316-c03bb295307c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:11.759199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b2224326-2379-4dcc-a316-c03bb295307c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:11.782913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b2224326-2379-4dcc-a316-c03bb295307c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:11.784754 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b2224326-2379-4dcc-a316-c03bb295307c tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1738 microversion: 2.20 time: 0.856893 Oct 24 10:48:11.785997 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2503/4968] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:10 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1738 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:12.813446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-229f88ee-07c7-4b07-95ef-8c408cb41069 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:12.814368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-229f88ee-07c7-4b07-95ef-8c408cb41069 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:12.826468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229f88ee-07c7-4b07-95ef-8c408cb41069 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:12.826978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229f88ee-07c7-4b07-95ef-8c408cb41069 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:12.827558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229f88ee-07c7-4b07-95ef-8c408cb41069 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:12.830607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229f88ee-07c7-4b07-95ef-8c408cb41069 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:12.831090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229f88ee-07c7-4b07-95ef-8c408cb41069 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:12.831531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229f88ee-07c7-4b07-95ef-8c408cb41069 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:13.438918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-229f88ee-07c7-4b07-95ef-8c408cb41069 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:13.455308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-229f88ee-07c7-4b07-95ef-8c408cb41069 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:13.457111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-229f88ee-07c7-4b07-95ef-8c408cb41069 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:13.459545 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-229f88ee-07c7-4b07-95ef-8c408cb41069 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1738 microversion: 2.20 time: 0.652322 Oct 24 10:48:13.460799 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2466/4969] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:12 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1738 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:14.488545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-45a102bb-993e-4833-acf3-6ee348e46338 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:14.489343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-45a102bb-993e-4833-acf3-6ee348e46338 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:14.512285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-45a102bb-993e-4833-acf3-6ee348e46338 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:14.519517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-45a102bb-993e-4833-acf3-6ee348e46338 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:14.520517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-45a102bb-993e-4833-acf3-6ee348e46338 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:14.521395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-45a102bb-993e-4833-acf3-6ee348e46338 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:14.521942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-45a102bb-993e-4833-acf3-6ee348e46338 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:14.522497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-45a102bb-993e-4833-acf3-6ee348e46338 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:15.090779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-45a102bb-993e-4833-acf3-6ee348e46338 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:15.115870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-45a102bb-993e-4833-acf3-6ee348e46338 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:15.135216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-45a102bb-993e-4833-acf3-6ee348e46338 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:15.142492 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-45a102bb-993e-4833-acf3-6ee348e46338 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1738 microversion: 2.20 time: 0.658663 Oct 24 10:48:15.151396 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2504/4970] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:14 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1738 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:16.181687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ebce98c5-62af-423d-adca-17b08c7d26ba tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:16.183236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ebce98c5-62af-423d-adca-17b08c7d26ba tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:16.197068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebce98c5-62af-423d-adca-17b08c7d26ba tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:16.198365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebce98c5-62af-423d-adca-17b08c7d26ba tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:16.199173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebce98c5-62af-423d-adca-17b08c7d26ba tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:16.201785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebce98c5-62af-423d-adca-17b08c7d26ba tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:16.205421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebce98c5-62af-423d-adca-17b08c7d26ba tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:16.206169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebce98c5-62af-423d-adca-17b08c7d26ba tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:18.341837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ebce98c5-62af-423d-adca-17b08c7d26ba tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:18.362672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ebce98c5-62af-423d-adca-17b08c7d26ba tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:18.369175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ebce98c5-62af-423d-adca-17b08c7d26ba tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:18.383497 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ebce98c5-62af-423d-adca-17b08c7d26ba tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1738 microversion: 2.20 time: 2.205397 Oct 24 10:48:18.404926 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2467/4971] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:16 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1738 bytes in 2214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:19.419813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e55e64a-7fa4-4262-a633-cb7c45c29457 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:19.420478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1e55e64a-7fa4-4262-a633-cb7c45c29457 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:19.449358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=34 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:48:19.450909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e55e64a-7fa4-4262-a633-cb7c45c29457 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:19.456915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e55e64a-7fa4-4262-a633-cb7c45c29457 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:19.457615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e55e64a-7fa4-4262-a633-cb7c45c29457 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:19.462755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e55e64a-7fa4-4262-a633-cb7c45c29457 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:19.463246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e55e64a-7fa4-4262-a633-cb7c45c29457 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:19.463685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e55e64a-7fa4-4262-a633-cb7c45c29457 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:20.544890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1e55e64a-7fa4-4262-a633-cb7c45c29457 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:20.564444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1e55e64a-7fa4-4262-a633-cb7c45c29457 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:20.568672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1e55e64a-7fa4-4262-a633-cb7c45c29457 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:20.573132 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1e55e64a-7fa4-4262-a633-cb7c45c29457 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1738 microversion: 2.20 time: 1.157482 Oct 24 10:48:20.594909 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2505/4972] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:19 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1738 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:21.603309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-59da1c41-9391-4081-967e-9f2bb66fed44 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:21.603945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-59da1c41-9391-4081-967e-9f2bb66fed44 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:21.630045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59da1c41-9391-4081-967e-9f2bb66fed44 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:21.636264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59da1c41-9391-4081-967e-9f2bb66fed44 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:21.643184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59da1c41-9391-4081-967e-9f2bb66fed44 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:21.651811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59da1c41-9391-4081-967e-9f2bb66fed44 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:21.652425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59da1c41-9391-4081-967e-9f2bb66fed44 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:21.652909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59da1c41-9391-4081-967e-9f2bb66fed44 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:21.729190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:48:22.532191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-59da1c41-9391-4081-967e-9f2bb66fed44 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:22.544267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-59da1c41-9391-4081-967e-9f2bb66fed44 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:22.547051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-59da1c41-9391-4081-967e-9f2bb66fed44 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:22.551942 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-59da1c41-9391-4081-967e-9f2bb66fed44 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1738 microversion: 2.20 time: 0.949485 Oct 24 10:48:22.552965 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2468/4973] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:21 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1738 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:23.587592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9eaaa684-cb38-4c0a-a30b-e9b423ac97be tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:23.588797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9eaaa684-cb38-4c0a-a30b-e9b423ac97be tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:23.611925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9eaaa684-cb38-4c0a-a30b-e9b423ac97be tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:23.613545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9eaaa684-cb38-4c0a-a30b-e9b423ac97be tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:23.614504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9eaaa684-cb38-4c0a-a30b-e9b423ac97be tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:23.617316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9eaaa684-cb38-4c0a-a30b-e9b423ac97be tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:23.619058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9eaaa684-cb38-4c0a-a30b-e9b423ac97be tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:23.621180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9eaaa684-cb38-4c0a-a30b-e9b423ac97be tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:25.298384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9eaaa684-cb38-4c0a-a30b-e9b423ac97be tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:25.313335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9eaaa684-cb38-4c0a-a30b-e9b423ac97be tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:25.354031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9eaaa684-cb38-4c0a-a30b-e9b423ac97be tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:25.357650 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9eaaa684-cb38-4c0a-a30b-e9b423ac97be tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1738 microversion: 2.20 time: 1.777465 Oct 24 10:48:25.359671 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2506/4974] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:23 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1738 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:26.383214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4df91f64-9a58-4f0a-a529-1b3ab71d46b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:26.383830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4df91f64-9a58-4f0a-a529-1b3ab71d46b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:26.416265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4df91f64-9a58-4f0a-a529-1b3ab71d46b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:26.418254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4df91f64-9a58-4f0a-a529-1b3ab71d46b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:26.423217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4df91f64-9a58-4f0a-a529-1b3ab71d46b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:26.424552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4df91f64-9a58-4f0a-a529-1b3ab71d46b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:26.425792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4df91f64-9a58-4f0a-a529-1b3ab71d46b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:26.427827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4df91f64-9a58-4f0a-a529-1b3ab71d46b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:27.081188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4df91f64-9a58-4f0a-a529-1b3ab71d46b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:27.094298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4df91f64-9a58-4f0a-a529-1b3ab71d46b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:27.103387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4df91f64-9a58-4f0a-a529-1b3ab71d46b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:27.109429 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4df91f64-9a58-4f0a-a529-1b3ab71d46b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1738 microversion: 2.20 time: 0.730195 Oct 24 10:48:27.110025 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2469/4975] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:26 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1738 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:28.149830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-496333ac-a894-4093-bdff-f060091c8906 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:28.150517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-496333ac-a894-4093-bdff-f060091c8906 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:28.167296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-496333ac-a894-4093-bdff-f060091c8906 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:28.167801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-496333ac-a894-4093-bdff-f060091c8906 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:28.168226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-496333ac-a894-4093-bdff-f060091c8906 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:28.168970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-496333ac-a894-4093-bdff-f060091c8906 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:28.169426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-496333ac-a894-4093-bdff-f060091c8906 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:28.181591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-496333ac-a894-4093-bdff-f060091c8906 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:28.709539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-496333ac-a894-4093-bdff-f060091c8906 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:28.719480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-496333ac-a894-4093-bdff-f060091c8906 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:28.737318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-496333ac-a894-4093-bdff-f060091c8906 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:28.740055 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-496333ac-a894-4093-bdff-f060091c8906 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1738 microversion: 2.20 time: 0.600021 Oct 24 10:48:28.741011 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2507/4976] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:28 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1738 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:29.772959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5fb4c1a1-e80d-481c-94f6-c950bf5c728f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:29.773586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5fb4c1a1-e80d-481c-94f6-c950bf5c728f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:29.791332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fb4c1a1-e80d-481c-94f6-c950bf5c728f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:29.792237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fb4c1a1-e80d-481c-94f6-c950bf5c728f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:29.793715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fb4c1a1-e80d-481c-94f6-c950bf5c728f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:29.795345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fb4c1a1-e80d-481c-94f6-c950bf5c728f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:29.800771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fb4c1a1-e80d-481c-94f6-c950bf5c728f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:29.801989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fb4c1a1-e80d-481c-94f6-c950bf5c728f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:30.888641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5fb4c1a1-e80d-481c-94f6-c950bf5c728f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:30.946527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5fb4c1a1-e80d-481c-94f6-c950bf5c728f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:30.949850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5fb4c1a1-e80d-481c-94f6-c950bf5c728f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:30.951122 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5fb4c1a1-e80d-481c-94f6-c950bf5c728f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1738 microversion: 2.20 time: 1.184227 Oct 24 10:48:30.956440 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2470/4977] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:29 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1738 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:31.196581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5e434353-c873-4029-8489-0fa13330d162 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Action: 'create', calling method: .version_select at 0x7f04cb8e4670>, body: {"keypair": {"name": "tempest-keypair-1805143861", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyWhDRF30AIeHSDvGLvEWMVoZFTgAHOiptyg7749emIgMqI+Kk8a4+iukZtlY5k+6f3kcHAQiAS1F5BSbeJKSGUF2+2LVI5dCccjNS9VKpi4v4TYrcFSs21nFzbmD3D6g=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:48:31.268679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-5e434353-c873-4029-8489-0fa13330d162 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Getting quotas for project 520c2b4219cd4573bc817e65756a05ac. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:48:31.278286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-5e434353-c873-4029-8489-0fa13330d162 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Getting quotas for user f38592218a3b4c39a977f49dd653e556 and project 520c2b4219cd4573bc817e65756a05ac. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:48:31.344288 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5e434353-c873-4029-8489-0fa13330d162 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.936717 Oct 24 10:48:31.351275 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2508/4978] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:48:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:48:31.981661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d071213c-046b-493c-90af-8df0093f9d41 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:31.982544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d071213c-046b-493c-90af-8df0093f9d41 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:31.994340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d071213c-046b-493c-90af-8df0093f9d41 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:31.997619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d071213c-046b-493c-90af-8df0093f9d41 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:31.998283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d071213c-046b-493c-90af-8df0093f9d41 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:32.001055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d071213c-046b-493c-90af-8df0093f9d41 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:32.001740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d071213c-046b-493c-90af-8df0093f9d41 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:32.004921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d071213c-046b-493c-90af-8df0093f9d41 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:32.259315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5ef2acbc-8fca-4914-a766-fe5e9f256fee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1733950282", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:48:32.414170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-5ef2acbc-8fca-4914-a766-fe5e9f256fee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] validate_networks() for [('7fb4c5a5-316a-47ef-9893-2ec34f5cffe8', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:48:32.878231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d071213c-046b-493c-90af-8df0093f9d41 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:32.895507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d071213c-046b-493c-90af-8df0093f9d41 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:32.902892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d071213c-046b-493c-90af-8df0093f9d41 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:32.904487 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d071213c-046b-493c-90af-8df0093f9d41 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1738 microversion: 2.20 time: 0.929963 Oct 24 10:48:32.905426 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2509/4979] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:31 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1738 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:33.934055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-28041fee-4902-462c-a4b7-ce0e88dffca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:33.934736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-28041fee-4902-462c-a4b7-ce0e88dffca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:33.943634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28041fee-4902-462c-a4b7-ce0e88dffca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:33.963173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28041fee-4902-462c-a4b7-ce0e88dffca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:33.963825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28041fee-4902-462c-a4b7-ce0e88dffca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:33.974453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28041fee-4902-462c-a4b7-ce0e88dffca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:33.977645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28041fee-4902-462c-a4b7-ce0e88dffca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:33.981510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28041fee-4902-462c-a4b7-ce0e88dffca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:34.417230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5ef2acbc-8fca-4914-a766-fe5e9f256fee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:48:34.417852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5ef2acbc-8fca-4914-a766-fe5e9f256fee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:48:34.418113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5ef2acbc-8fca-4914-a766-fe5e9f256fee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:48:34.418525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5ef2acbc-8fca-4914-a766-fe5e9f256fee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:48:34.418937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5ef2acbc-8fca-4914-a766-fe5e9f256fee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:48:34.446347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ef2acbc-8fca-4914-a766-fe5e9f256fee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:34.446853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ef2acbc-8fca-4914-a766-fe5e9f256fee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:34.447306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ef2acbc-8fca-4914-a766-fe5e9f256fee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:34.448055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ef2acbc-8fca-4914-a766-fe5e9f256fee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:34.453725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ef2acbc-8fca-4914-a766-fe5e9f256fee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:34.454453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ef2acbc-8fca-4914-a766-fe5e9f256fee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:34.605973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-5ef2acbc-8fca-4914-a766-fe5e9f256fee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Getting quotas for project 0ae874e076c34c44adb00f85aebd000e. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:48:34.637141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-5ef2acbc-8fca-4914-a766-fe5e9f256fee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Getting quotas for user 6da7534777ef4425aefa81bc7e49b69f and project 0ae874e076c34c44adb00f85aebd000e. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:48:34.709291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=26 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:48:34.709291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5ef2acbc-8fca-4914-a766-fe5e9f256fee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:48:34.718071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5ef2acbc-8fca-4914-a766-fe5e9f256fee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:48:34.992202 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5ef2acbc-8fca-4914-a766-fe5e9f256fee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.154235 Oct 24 10:48:34.993251 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2471/4980] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:48:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 3161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:48:35.019256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5884a942-8646-49d8-afd1-c3b10bf2b459 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:35.020308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5884a942-8646-49d8-afd1-c3b10bf2b459 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:35.314975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-28041fee-4902-462c-a4b7-ce0e88dffca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:35.356936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-28041fee-4902-462c-a4b7-ce0e88dffca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:35.362907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-28041fee-4902-462c-a4b7-ce0e88dffca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:35.364179 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-28041fee-4902-462c-a4b7-ce0e88dffca2 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1738 microversion: 2.20 time: 1.434111 Oct 24 10:48:35.373628 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2510/4981] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:33 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1738 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:35.574506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5884a942-8646-49d8-afd1-c3b10bf2b459 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:35.592425 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5884a942-8646-49d8-afd1-c3b10bf2b459 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1222 microversion: 2.1 time: 0.590289 Oct 24 10:48:35.597846 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2472/4982] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:35 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1222 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:35.910690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5f90845c-ad9b-4fd0-81d1-e341c71680c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-844831129", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:48:36.066238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-5f90845c-ad9b-4fd0-81d1-e341c71680c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] validate_networks() for [('7fb4c5a5-316a-47ef-9893-2ec34f5cffe8', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:48:36.394360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-978dc850-84de-4b1a-8319-ff58fdcf1e57 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:36.399824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-978dc850-84de-4b1a-8319-ff58fdcf1e57 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:36.425434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-978dc850-84de-4b1a-8319-ff58fdcf1e57 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:36.425863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-978dc850-84de-4b1a-8319-ff58fdcf1e57 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:36.426318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-978dc850-84de-4b1a-8319-ff58fdcf1e57 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:36.427043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-978dc850-84de-4b1a-8319-ff58fdcf1e57 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:36.435480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-978dc850-84de-4b1a-8319-ff58fdcf1e57 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:36.443609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-978dc850-84de-4b1a-8319-ff58fdcf1e57 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:38.275098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5f90845c-ad9b-4fd0-81d1-e341c71680c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:48:38.278146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5f90845c-ad9b-4fd0-81d1-e341c71680c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:48:38.278663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5f90845c-ad9b-4fd0-81d1-e341c71680c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:48:38.280786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5f90845c-ad9b-4fd0-81d1-e341c71680c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:48:38.283442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5f90845c-ad9b-4fd0-81d1-e341c71680c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:48:38.307917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f90845c-ad9b-4fd0-81d1-e341c71680c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:38.310578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f90845c-ad9b-4fd0-81d1-e341c71680c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:38.311127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f90845c-ad9b-4fd0-81d1-e341c71680c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:38.315754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f90845c-ad9b-4fd0-81d1-e341c71680c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:38.316296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f90845c-ad9b-4fd0-81d1-e341c71680c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:38.316754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-978dc850-84de-4b1a-8319-ff58fdcf1e57 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:38.317245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f90845c-ad9b-4fd0-81d1-e341c71680c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:38.329295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-978dc850-84de-4b1a-8319-ff58fdcf1e57 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:38.330753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-978dc850-84de-4b1a-8319-ff58fdcf1e57 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:38.332283 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-978dc850-84de-4b1a-8319-ff58fdcf1e57 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1738 microversion: 2.20 time: 1.942564 Oct 24 10:48:38.333083 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2473/4983] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:36 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1738 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:48:38.339439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c0695c8d-509f-4071-9f3d-c91dc00b96a5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-436565923", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a4acae2-4510-4628-9fd5-81f6365ddf36"}], "security_groups": [{"name": "tempest-securitygroup--1963874138"}], "key_name": "tempest-keypair-1805143861", "user_data": "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:48:38.347044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=50 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:48:38.386882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-5f90845c-ad9b-4fd0-81d1-e341c71680c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Getting quotas for project 0ae874e076c34c44adb00f85aebd000e. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:48:38.406897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-5f90845c-ad9b-4fd0-81d1-e341c71680c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Getting quotas for user 6da7534777ef4425aefa81bc7e49b69f and project 0ae874e076c34c44adb00f85aebd000e. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:48:38.445412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5f90845c-ad9b-4fd0-81d1-e341c71680c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:48:38.458054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5f90845c-ad9b-4fd0-81d1-e341c71680c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:48:38.600364 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5f90845c-ad9b-4fd0-81d1-e341c71680c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.697755 Oct 24 10:48:38.608923 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2511/4984] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:48:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 2702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:48:38.616816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-258f75ae-b885-4c3e-9dbf-2cf0666e43a9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:38.618824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-258f75ae-b885-4c3e-9dbf-2cf0666e43a9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:38.688220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-c0695c8d-509f-4071-9f3d-c91dc00b96a5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] validate_networks() for [('9a4acae2-4510-4628-9fd5-81f6365ddf36', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:48:38.824949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-258f75ae-b885-4c3e-9dbf-2cf0666e43a9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:38.851729 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-258f75ae-b885-4c3e-9dbf-2cf0666e43a9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1221 microversion: 2.1 time: 0.228501 Oct 24 10:48:38.852419 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2512/4985] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:38 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1221 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:39.365349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1094eefe-676e-46be-a32c-440dcab008cb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:39.366681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1094eefe-676e-46be-a32c-440dcab008cb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:39.379144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1094eefe-676e-46be-a32c-440dcab008cb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:39.385697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1094eefe-676e-46be-a32c-440dcab008cb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:39.386838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1094eefe-676e-46be-a32c-440dcab008cb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:39.388059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1094eefe-676e-46be-a32c-440dcab008cb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:39.390312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1094eefe-676e-46be-a32c-440dcab008cb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:39.392708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1094eefe-676e-46be-a32c-440dcab008cb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:40.127128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1094eefe-676e-46be-a32c-440dcab008cb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:40.136871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1094eefe-676e-46be-a32c-440dcab008cb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:40.141884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1094eefe-676e-46be-a32c-440dcab008cb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:40.143083 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1094eefe-676e-46be-a32c-440dcab008cb tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1720 microversion: 2.20 time: 0.783042 Oct 24 10:48:40.143657 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2513/4986] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:39 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1720 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:40.158162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0bfdc841-d51d-42ff-83f0-99c3d3910326 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:40.158777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0bfdc841-d51d-42ff-83f0-99c3d3910326 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:40.190806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bfdc841-d51d-42ff-83f0-99c3d3910326 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:40.191549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bfdc841-d51d-42ff-83f0-99c3d3910326 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:40.192449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bfdc841-d51d-42ff-83f0-99c3d3910326 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:40.193411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bfdc841-d51d-42ff-83f0-99c3d3910326 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:40.195043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bfdc841-d51d-42ff-83f0-99c3d3910326 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:40.196316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0bfdc841-d51d-42ff-83f0-99c3d3910326 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:40.376286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0bfdc841-d51d-42ff-83f0-99c3d3910326 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:40.387082 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0bfdc841-d51d-42ff-83f0-99c3d3910326 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1225 microversion: 2.1 time: 0.242293 Oct 24 10:48:40.388768 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2514/4987] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:40 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1225 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:41.047633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-c0695c8d-509f-4071-9f3d-c91dc00b96a5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:48:41.048753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-c0695c8d-509f-4071-9f3d-c91dc00b96a5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:48:41.049836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-c0695c8d-509f-4071-9f3d-c91dc00b96a5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:48:41.050652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-c0695c8d-509f-4071-9f3d-c91dc00b96a5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:48:41.051600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-c0695c8d-509f-4071-9f3d-c91dc00b96a5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:48:41.066262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0695c8d-509f-4071-9f3d-c91dc00b96a5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:41.067826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0695c8d-509f-4071-9f3d-c91dc00b96a5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:41.068513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0695c8d-509f-4071-9f3d-c91dc00b96a5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:41.069852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0695c8d-509f-4071-9f3d-c91dc00b96a5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:41.070963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0695c8d-509f-4071-9f3d-c91dc00b96a5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:41.071798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0695c8d-509f-4071-9f3d-c91dc00b96a5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:41.109963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c0695c8d-509f-4071-9f3d-c91dc00b96a5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Getting quotas for project 520c2b4219cd4573bc817e65756a05ac. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:48:41.132526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c0695c8d-509f-4071-9f3d-c91dc00b96a5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Getting quotas for user f38592218a3b4c39a977f49dd653e556 and project 520c2b4219cd4573bc817e65756a05ac. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:48:41.150845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c0695c8d-509f-4071-9f3d-c91dc00b96a5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:48:41.166418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c0695c8d-509f-4071-9f3d-c91dc00b96a5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:48:41.173582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-91f6476e-4cdb-4313-941b-aebd3905a458 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:41.175406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-91f6476e-4cdb-4313-941b-aebd3905a458 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:41.186742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91f6476e-4cdb-4313-941b-aebd3905a458 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:41.192747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91f6476e-4cdb-4313-941b-aebd3905a458 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:41.193455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91f6476e-4cdb-4313-941b-aebd3905a458 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:41.194575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91f6476e-4cdb-4313-941b-aebd3905a458 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:41.195199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91f6476e-4cdb-4313-941b-aebd3905a458 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:41.196370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91f6476e-4cdb-4313-941b-aebd3905a458 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:41.336347 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c0695c8d-509f-4071-9f3d-c91dc00b96a5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.000554 Oct 24 10:48:41.339069 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2474/4988] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:48:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 3005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:48:41.356287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f6b3739c-616a-4d60-8a67-d58a59a50119 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:41.357139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f6b3739c-616a-4d60-8a67-d58a59a50119 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:41.580671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f6b3739c-616a-4d60-8a67-d58a59a50119 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:41.592217 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f6b3739c-616a-4d60-8a67-d58a59a50119 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1237 microversion: 2.1 time: 0.244243 Oct 24 10:48:41.593356 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2475/4989] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:41 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1237 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:41.604141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-acc6a27a-1536-4d8d-b458-d504e9414df1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:41.608823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-acc6a27a-1536-4d8d-b458-d504e9414df1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:41.627400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acc6a27a-1536-4d8d-b458-d504e9414df1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:41.631014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acc6a27a-1536-4d8d-b458-d504e9414df1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:41.631534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acc6a27a-1536-4d8d-b458-d504e9414df1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:41.632290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acc6a27a-1536-4d8d-b458-d504e9414df1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:41.632763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acc6a27a-1536-4d8d-b458-d504e9414df1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:41.633236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acc6a27a-1536-4d8d-b458-d504e9414df1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:41.853011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-91f6476e-4cdb-4313-941b-aebd3905a458 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:41.863481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-91f6476e-4cdb-4313-941b-aebd3905a458 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:41.896993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-91f6476e-4cdb-4313-941b-aebd3905a458 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:41.901767 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-91f6476e-4cdb-4313-941b-aebd3905a458 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1723 microversion: 2.20 time: 0.729357 Oct 24 10:48:41.925905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-acc6a27a-1536-4d8d-b458-d504e9414df1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:41.930516 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2515/4990] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:41 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1723 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:48:41.957072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-af450134-bf98-4dad-be2a-9dcd3b455ca9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94093153-d07b-4dfc-a160-3c0f9391c007"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:48:41.957454 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-acc6a27a-1536-4d8d-b458-d504e9414df1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1279 microversion: 2.1 time: 0.338692 Oct 24 10:48:41.958869 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2476/4991] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:41 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1279 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:41.976621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-af450134-bf98-4dad-be2a-9dcd3b455ca9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:41.999498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af450134-bf98-4dad-be2a-9dcd3b455ca9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:42.000317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af450134-bf98-4dad-be2a-9dcd3b455ca9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:42.001036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af450134-bf98-4dad-be2a-9dcd3b455ca9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:42.001924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af450134-bf98-4dad-be2a-9dcd3b455ca9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:42.002552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af450134-bf98-4dad-be2a-9dcd3b455ca9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:42.003148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af450134-bf98-4dad-be2a-9dcd3b455ca9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:42.417556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-9a4903e4-cd9d-4b7f-8043-535b94f31de0 req-2ac256a2-4e54-4fdb-af00-f7a790f09b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e357ce41-0ae9-4efa-973b-bc8920e4a0fa", "name": "network-vif-unplugged", "status": "completed", "tag": "ddf713d1-ef02-4308-b6ce-8ec89af0574f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:48:42.444331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9a4903e4-cd9d-4b7f-8043-535b94f31de0 req-2ac256a2-4e54-4fdb-af00-f7a790f09b47 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:42.447258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9a4903e4-cd9d-4b7f-8043-535b94f31de0 req-2ac256a2-4e54-4fdb-af00-f7a790f09b47 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:42.447986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9a4903e4-cd9d-4b7f-8043-535b94f31de0 req-2ac256a2-4e54-4fdb-af00-f7a790f09b47 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:42.486674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.compute.server_external_events [req-9a4903e4-cd9d-4b7f-8043-535b94f31de0 req-2ac256a2-4e54-4fdb-af00-f7a790f09b47 service nova] Unable to find a host for instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa. Dropping event network-vif-unplugged {{(pid=120425) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 24 10:48:42.488075 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-9a4903e4-cd9d-4b7f-8043-535b94f31de0 req-2ac256a2-4e54-4fdb-af00-f7a790f09b47 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.075735 Oct 24 10:48:42.491164 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2477/4992] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 79 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 24 10:48:42.621478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7739cf0c-8bc8-49a6-9d14-33216cd62b16 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:42.622232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7739cf0c-8bc8-49a6-9d14-33216cd62b16 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:42.637009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7739cf0c-8bc8-49a6-9d14-33216cd62b16 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:42.639042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7739cf0c-8bc8-49a6-9d14-33216cd62b16 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:42.639952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7739cf0c-8bc8-49a6-9d14-33216cd62b16 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:42.641838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7739cf0c-8bc8-49a6-9d14-33216cd62b16 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:42.643523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7739cf0c-8bc8-49a6-9d14-33216cd62b16 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:42.643998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7739cf0c-8bc8-49a6-9d14-33216cd62b16 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:42.783948 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-af450134-bf98-4dad-be2a-9dcd3b455ca9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "POST /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.852022 Oct 24 10:48:42.785774 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2516/4993] 10.222.0.50 () {62 vars in 1364 bytes} [Mon Oct 24 10:48:41 2022] POST /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa/os-volume_attachments => generated 188 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:48:42.916594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7739cf0c-8bc8-49a6-9d14-33216cd62b16 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:42.928243 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7739cf0c-8bc8-49a6-9d14-33216cd62b16 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1241 microversion: 2.1 time: 0.314023 Oct 24 10:48:42.947278 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2478/4994] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:42 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1241 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:48:42.987259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4d0848aa-8b2b-4a23-bc8f-6404aace1768 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:42.987890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4d0848aa-8b2b-4a23-bc8f-6404aace1768 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:43.002907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d0848aa-8b2b-4a23-bc8f-6404aace1768 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:43.003508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d0848aa-8b2b-4a23-bc8f-6404aace1768 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:43.003967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d0848aa-8b2b-4a23-bc8f-6404aace1768 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:43.004702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d0848aa-8b2b-4a23-bc8f-6404aace1768 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:43.005194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d0848aa-8b2b-4a23-bc8f-6404aace1768 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:43.005629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d0848aa-8b2b-4a23-bc8f-6404aace1768 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:43.113962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-500f7df1-2bae-4f2e-ae12-74cf91ad70d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:43.115153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-500f7df1-2bae-4f2e-ae12-74cf91ad70d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:43.138072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-500f7df1-2bae-4f2e-ae12-74cf91ad70d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:43.145994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-500f7df1-2bae-4f2e-ae12-74cf91ad70d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:43.149800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-500f7df1-2bae-4f2e-ae12-74cf91ad70d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:43.151102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-500f7df1-2bae-4f2e-ae12-74cf91ad70d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:43.154103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-500f7df1-2bae-4f2e-ae12-74cf91ad70d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:43.154832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-500f7df1-2bae-4f2e-ae12-74cf91ad70d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:43.549278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4d0848aa-8b2b-4a23-bc8f-6404aace1768 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:43.557563 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4d0848aa-8b2b-4a23-bc8f-6404aace1768 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1279 microversion: 2.1 time: 0.575404 Oct 24 10:48:43.564630 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2517/4995] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:42 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1279 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:43.804107 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-500f7df1-2bae-4f2e-ae12-74cf91ad70d9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa/os-volume_attachments/94093153-d07b-4dfc-a160-3c0f9391c007" status: 202 len: 0 microversion: 2.20 time: 0.697592 Oct 24 10:48:43.805426 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2479/4996] 10.222.0.50 () {60 vars in 1457 bytes} [Mon Oct 24 10:48:43 2022] DELETE /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa/os-volume_attachments/94093153-d07b-4dfc-a160-3c0f9391c007 => generated 0 bytes in 700 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 24 10:48:43.911295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-d8c8980a-085a-4c61-ad36-29cb17249b86 req-3bc3ff9b-1e1b-40d7-8074-88d410e3abc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "305c8bd9-3fdb-48da-920e-13613f65ec41", "tag": "8aac5c1c-7648-4de2-9e1b-44b559f12f0c"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:48:43.947687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d8c8980a-085a-4c61-ad36-29cb17249b86 req-3bc3ff9b-1e1b-40d7-8074-88d410e3abc5 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:43.948184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d8c8980a-085a-4c61-ad36-29cb17249b86 req-3bc3ff9b-1e1b-40d7-8074-88d410e3abc5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:43.948623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d8c8980a-085a-4c61-ad36-29cb17249b86 req-3bc3ff9b-1e1b-40d7-8074-88d410e3abc5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:43.959020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-daec628e-77f8-46a9-b969-75767dcdeeb4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:43.959876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-daec628e-77f8-46a9-b969-75767dcdeeb4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:43.983989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-daec628e-77f8-46a9-b969-75767dcdeeb4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:43.985269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-daec628e-77f8-46a9-b969-75767dcdeeb4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:43.987044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-daec628e-77f8-46a9-b969-75767dcdeeb4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:43.989599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-daec628e-77f8-46a9-b969-75767dcdeeb4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:43.991508 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-d8c8980a-085a-4c61-ad36-29cb17249b86 req-3bc3ff9b-1e1b-40d7-8074-88d410e3abc5 service nova] Creating event network-changed:8aac5c1c-7648-4de2-9e1b-44b559f12f0c for instance 305c8bd9-3fdb-48da-920e-13613f65ec41 on n-h1-858383-15 Oct 24 10:48:43.993211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-daec628e-77f8-46a9-b969-75767dcdeeb4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:43.996380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-daec628e-77f8-46a9-b969-75767dcdeeb4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:44.006406 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-d8c8980a-085a-4c61-ad36-29cb17249b86 req-3bc3ff9b-1e1b-40d7-8074-88d410e3abc5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101215 Oct 24 10:48:44.016547 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2518/4997] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:48:44.037074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f28024b9-b6a5-4699-af1a-38506715686f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:48:44.038041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f28024b9-b6a5-4699-af1a-38506715686f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:44.087864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f28024b9-b6a5-4699-af1a-38506715686f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:44.096725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f28024b9-b6a5-4699-af1a-38506715686f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:44.097580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f28024b9-b6a5-4699-af1a-38506715686f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:44.102096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f28024b9-b6a5-4699-af1a-38506715686f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:44.102601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f28024b9-b6a5-4699-af1a-38506715686f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:44.103051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f28024b9-b6a5-4699-af1a-38506715686f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:44.226563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f28024b9-b6a5-4699-af1a-38506715686f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120426) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 24 10:48:44.395758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-daec628e-77f8-46a9-b969-75767dcdeeb4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:44.417005 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-daec628e-77f8-46a9-b969-75767dcdeeb4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1297 microversion: 2.1 time: 0.462996 Oct 24 10:48:44.422114 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2480/4998] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:43 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1297 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:44.568215 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f28024b9-b6a5-4699-af1a-38506715686f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "POST /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa/action" status: 202 len: 0 microversion: 2.20 time: 0.548933 Oct 24 10:48:44.574387 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2519/4999] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Oct 24 10:48:44 2022] POST /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:48:44.588323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-985044eb-60f1-4eb5-88eb-432a9b03ed2a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:44.590373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-985044eb-60f1-4eb5-88eb-432a9b03ed2a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:44.618102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-41ced26f-dabf-4ef1-ad49-3248a1b57716 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:44.618854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-41ced26f-dabf-4ef1-ad49-3248a1b57716 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:44.629588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-985044eb-60f1-4eb5-88eb-432a9b03ed2a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:44.631956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-985044eb-60f1-4eb5-88eb-432a9b03ed2a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:44.632876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-985044eb-60f1-4eb5-88eb-432a9b03ed2a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:44.633852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-985044eb-60f1-4eb5-88eb-432a9b03ed2a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:44.634678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-985044eb-60f1-4eb5-88eb-432a9b03ed2a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:44.635278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-985044eb-60f1-4eb5-88eb-432a9b03ed2a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:44.659829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41ced26f-dabf-4ef1-ad49-3248a1b57716 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:44.660337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41ced26f-dabf-4ef1-ad49-3248a1b57716 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:44.664146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41ced26f-dabf-4ef1-ad49-3248a1b57716 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:44.665333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41ced26f-dabf-4ef1-ad49-3248a1b57716 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:44.667705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41ced26f-dabf-4ef1-ad49-3248a1b57716 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:44.669255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41ced26f-dabf-4ef1-ad49-3248a1b57716 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:45.555358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-985044eb-60f1-4eb5-88eb-432a9b03ed2a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:45.574613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-985044eb-60f1-4eb5-88eb-432a9b03ed2a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:45.576973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-985044eb-60f1-4eb5-88eb-432a9b03ed2a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:45.587564 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-985044eb-60f1-4eb5-88eb-432a9b03ed2a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1671 microversion: 2.20 time: 1.005624 Oct 24 10:48:45.591321 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2481/5000] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:44 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1671 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:45.610486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-19d42615-b045-4fcc-9cd0-64dd743271e3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:45.611040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-19d42615-b045-4fcc-9cd0-64dd743271e3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:45.641400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19d42615-b045-4fcc-9cd0-64dd743271e3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:45.641975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19d42615-b045-4fcc-9cd0-64dd743271e3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:45.642433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19d42615-b045-4fcc-9cd0-64dd743271e3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:45.643182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19d42615-b045-4fcc-9cd0-64dd743271e3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:45.646358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19d42615-b045-4fcc-9cd0-64dd743271e3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:45.648792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19d42615-b045-4fcc-9cd0-64dd743271e3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:45.726433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-41ced26f-dabf-4ef1-ad49-3248a1b57716 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:45.739232 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-41ced26f-dabf-4ef1-ad49-3248a1b57716 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1321 microversion: 2.1 time: 1.142787 Oct 24 10:48:45.741051 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2520/5001] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:44 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1321 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:45.896014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-19d42615-b045-4fcc-9cd0-64dd743271e3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:45.937782 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-19d42615-b045-4fcc-9cd0-64dd743271e3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1295 microversion: 2.1 time: 0.315384 Oct 24 10:48:45.960986 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2482/5002] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:45 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1295 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:46.626909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-38ca3366-6ffc-4656-84ac-0f0fdabcc4b9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:46.627545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-38ca3366-6ffc-4656-84ac-0f0fdabcc4b9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:46.683075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38ca3366-6ffc-4656-84ac-0f0fdabcc4b9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:46.693093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38ca3366-6ffc-4656-84ac-0f0fdabcc4b9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:46.693424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38ca3366-6ffc-4656-84ac-0f0fdabcc4b9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:46.699901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38ca3366-6ffc-4656-84ac-0f0fdabcc4b9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:46.700632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38ca3366-6ffc-4656-84ac-0f0fdabcc4b9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:46.702021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38ca3366-6ffc-4656-84ac-0f0fdabcc4b9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:46.777195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-761d028b-4b3b-490e-9dd3-ae745faacf36 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:46.781514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-761d028b-4b3b-490e-9dd3-ae745faacf36 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:46.803893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-761d028b-4b3b-490e-9dd3-ae745faacf36 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:46.805053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-761d028b-4b3b-490e-9dd3-ae745faacf36 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:46.806249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-761d028b-4b3b-490e-9dd3-ae745faacf36 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:46.809598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-761d028b-4b3b-490e-9dd3-ae745faacf36 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:46.811459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-761d028b-4b3b-490e-9dd3-ae745faacf36 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:46.847043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-761d028b-4b3b-490e-9dd3-ae745faacf36 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:47.280793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-761d028b-4b3b-490e-9dd3-ae745faacf36 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:47.294920 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-38ca3366-6ffc-4656-84ac-0f0fdabcc4b9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:47.307787 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-761d028b-4b3b-490e-9dd3-ae745faacf36 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1321 microversion: 2.1 time: 0.542486 Oct 24 10:48:47.310141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-38ca3366-6ffc-4656-84ac-0f0fdabcc4b9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:47.327780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-38ca3366-6ffc-4656-84ac-0f0fdabcc4b9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:47.331134 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2483/5003] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:46 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1321 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:47.335583 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-38ca3366-6ffc-4656-84ac-0f0fdabcc4b9 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1673 microversion: 2.20 time: 0.717097 Oct 24 10:48:47.341348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c4c6baa0-6ac8-49ce-a9b2-a3b9185ae191 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:47.357776 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2521/5004] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:46 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1673 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:47.358780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c4c6baa0-6ac8-49ce-a9b2-a3b9185ae191 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:47.369161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4c6baa0-6ac8-49ce-a9b2-a3b9185ae191 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:47.369941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4c6baa0-6ac8-49ce-a9b2-a3b9185ae191 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:47.370592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4c6baa0-6ac8-49ce-a9b2-a3b9185ae191 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:47.371739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4c6baa0-6ac8-49ce-a9b2-a3b9185ae191 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:47.372375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4c6baa0-6ac8-49ce-a9b2-a3b9185ae191 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:47.373013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4c6baa0-6ac8-49ce-a9b2-a3b9185ae191 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:47.518105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c4c6baa0-6ac8-49ce-a9b2-a3b9185ae191 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:47.587791 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c4c6baa0-6ac8-49ce-a9b2-a3b9185ae191 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1295 microversion: 2.1 time: 0.254131 Oct 24 10:48:47.610660 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2484/5005] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:47 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1295 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:48.344521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4b49c252-55c1-4f69-a39c-63813ea9e919 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:48.346784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4b49c252-55c1-4f69-a39c-63813ea9e919 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:48.353361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:48:48.373325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-012ba6c2-d2f0-4f7e-9f16-eba91260fd49 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:48.374631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-012ba6c2-d2f0-4f7e-9f16-eba91260fd49 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:48.375878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b49c252-55c1-4f69-a39c-63813ea9e919 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:48.382577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b49c252-55c1-4f69-a39c-63813ea9e919 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:48.383376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b49c252-55c1-4f69-a39c-63813ea9e919 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:48.385542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b49c252-55c1-4f69-a39c-63813ea9e919 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:48.386029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b49c252-55c1-4f69-a39c-63813ea9e919 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:48.386487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b49c252-55c1-4f69-a39c-63813ea9e919 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:48.390366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-012ba6c2-d2f0-4f7e-9f16-eba91260fd49 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:48.391104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-012ba6c2-d2f0-4f7e-9f16-eba91260fd49 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:48.396238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-012ba6c2-d2f0-4f7e-9f16-eba91260fd49 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:48.397637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-012ba6c2-d2f0-4f7e-9f16-eba91260fd49 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:48.398347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-012ba6c2-d2f0-4f7e-9f16-eba91260fd49 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:48.399021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-012ba6c2-d2f0-4f7e-9f16-eba91260fd49 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:48.832431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=12 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:48:49.344591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-012ba6c2-d2f0-4f7e-9f16-eba91260fd49 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:49.357367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-012ba6c2-d2f0-4f7e-9f16-eba91260fd49 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:49.360413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-012ba6c2-d2f0-4f7e-9f16-eba91260fd49 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:49.375355 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-012ba6c2-d2f0-4f7e-9f16-eba91260fd49 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1729 microversion: 2.20 time: 1.005024 Oct 24 10:48:49.377073 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2485/5006] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:48 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1729 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:49.384612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3a5b6f44-0e51-4ff3-a9df-0daaa08ee84c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:49.385493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3a5b6f44-0e51-4ff3-a9df-0daaa08ee84c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:49.395504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a5b6f44-0e51-4ff3-a9df-0daaa08ee84c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:49.396312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a5b6f44-0e51-4ff3-a9df-0daaa08ee84c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:49.397034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a5b6f44-0e51-4ff3-a9df-0daaa08ee84c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:49.397908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a5b6f44-0e51-4ff3-a9df-0daaa08ee84c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:49.398568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a5b6f44-0e51-4ff3-a9df-0daaa08ee84c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:49.399695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a5b6f44-0e51-4ff3-a9df-0daaa08ee84c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:49.431772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:48:49.432550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4b49c252-55c1-4f69-a39c-63813ea9e919 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:49.441284 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4b49c252-55c1-4f69-a39c-63813ea9e919 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1321 microversion: 2.1 time: 1.104538 Oct 24 10:48:49.477063 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2522/5007] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:48 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1321 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:49.483031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-696c6b47-eb06-4d09-b379-bd4560bdaf4a req-7d345cd0-eb07-4b2e-b457-332d56b7ca4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e1338eb-7f3d-4680-a0ee-931115da05f9", "tag": "ddf72b1d-9770-4cec-9349-b0bc3aee4a1c"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:48:49.494201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-696c6b47-eb06-4d09-b379-bd4560bdaf4a req-7d345cd0-eb07-4b2e-b457-332d56b7ca4d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:49.495079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-696c6b47-eb06-4d09-b379-bd4560bdaf4a req-7d345cd0-eb07-4b2e-b457-332d56b7ca4d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:49.495745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-696c6b47-eb06-4d09-b379-bd4560bdaf4a req-7d345cd0-eb07-4b2e-b457-332d56b7ca4d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:49.508868 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-696c6b47-eb06-4d09-b379-bd4560bdaf4a req-7d345cd0-eb07-4b2e-b457-332d56b7ca4d service nova] Creating event network-changed:ddf72b1d-9770-4cec-9349-b0bc3aee4a1c for instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 on n-h2-858383-15 Oct 24 10:48:49.515435 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-696c6b47-eb06-4d09-b379-bd4560bdaf4a req-7d345cd0-eb07-4b2e-b457-332d56b7ca4d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036615 Oct 24 10:48:49.516976 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2523/5008] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:48:50.350364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3a5b6f44-0e51-4ff3-a9df-0daaa08ee84c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:50.382023 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3a5b6f44-0e51-4ff3-a9df-0daaa08ee84c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1363 microversion: 2.1 time: 1.001439 Oct 24 10:48:50.392934 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2486/5009] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:49 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1363 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:50.413530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-46ea6d49-fe13-4149-bc58-371c778b7b29 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:50.414389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-46ea6d49-fe13-4149-bc58-371c778b7b29 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:50.425685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:48:50.427466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46ea6d49-fe13-4149-bc58-371c778b7b29 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:50.433724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46ea6d49-fe13-4149-bc58-371c778b7b29 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:50.434371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46ea6d49-fe13-4149-bc58-371c778b7b29 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:50.435088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46ea6d49-fe13-4149-bc58-371c778b7b29 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:50.435632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46ea6d49-fe13-4149-bc58-371c778b7b29 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:50.435962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46ea6d49-fe13-4149-bc58-371c778b7b29 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:50.515349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-314b92ce-7608-4df2-befb-d9bb7d8328fd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:50.516119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-314b92ce-7608-4df2-befb-d9bb7d8328fd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:50.535909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-314b92ce-7608-4df2-befb-d9bb7d8328fd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:50.538711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-314b92ce-7608-4df2-befb-d9bb7d8328fd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:50.545299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-314b92ce-7608-4df2-befb-d9bb7d8328fd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:50.547042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-314b92ce-7608-4df2-befb-d9bb7d8328fd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:50.547718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-314b92ce-7608-4df2-befb-d9bb7d8328fd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:50.548398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-314b92ce-7608-4df2-befb-d9bb7d8328fd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:50.996239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-46ea6d49-fe13-4149-bc58-371c778b7b29 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:51.013674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-46ea6d49-fe13-4149-bc58-371c778b7b29 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:51.026801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-46ea6d49-fe13-4149-bc58-371c778b7b29 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:51.028513 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-46ea6d49-fe13-4149-bc58-371c778b7b29 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1729 microversion: 2.20 time: 0.621724 Oct 24 10:48:51.031897 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2524/5010] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:50 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1729 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:51.091243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:48:51.183789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-314b92ce-7608-4df2-befb-d9bb7d8328fd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:51.215830 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-314b92ce-7608-4df2-befb-d9bb7d8328fd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1321 microversion: 2.1 time: 0.725479 Oct 24 10:48:51.216437 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2487/5011] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:50 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1321 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:51.410188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-459452f2-b34d-4b4d-b9ea-22a1ff3556a4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:51.411140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-459452f2-b34d-4b4d-b9ea-22a1ff3556a4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:51.442780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-459452f2-b34d-4b4d-b9ea-22a1ff3556a4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:51.444198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-459452f2-b34d-4b4d-b9ea-22a1ff3556a4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:51.444198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-459452f2-b34d-4b4d-b9ea-22a1ff3556a4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:51.450969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-459452f2-b34d-4b4d-b9ea-22a1ff3556a4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:51.451744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-459452f2-b34d-4b4d-b9ea-22a1ff3556a4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:51.454099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-459452f2-b34d-4b4d-b9ea-22a1ff3556a4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:51.754169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-eb8f869c-e339-4531-b967-50457c66f608 req-094d3e6f-f011-4661-a5f0-9de6baa77bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "305c8bd9-3fdb-48da-920e-13613f65ec41", "name": "network-vif-plugged", "status": "completed", "tag": "8aac5c1c-7648-4de2-9e1b-44b559f12f0c"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:48:51.761284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=16 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:48:51.769909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eb8f869c-e339-4531-b967-50457c66f608 req-094d3e6f-f011-4661-a5f0-9de6baa77bec service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:51.770415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eb8f869c-e339-4531-b967-50457c66f608 req-094d3e6f-f011-4661-a5f0-9de6baa77bec service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:51.770850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eb8f869c-e339-4531-b967-50457c66f608 req-094d3e6f-f011-4661-a5f0-9de6baa77bec service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:51.795182 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-eb8f869c-e339-4531-b967-50457c66f608 req-094d3e6f-f011-4661-a5f0-9de6baa77bec service nova] Creating event network-vif-plugged:8aac5c1c-7648-4de2-9e1b-44b559f12f0c for instance 305c8bd9-3fdb-48da-920e-13613f65ec41 on n-h1-858383-15 Oct 24 10:48:51.811785 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-eb8f869c-e339-4531-b967-50457c66f608 req-094d3e6f-f011-4661-a5f0-9de6baa77bec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062361 Oct 24 10:48:51.821460 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2488/5012] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 24 10:48:51.874782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-459452f2-b34d-4b4d-b9ea-22a1ff3556a4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:51.888961 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-459452f2-b34d-4b4d-b9ea-22a1ff3556a4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1363 microversion: 2.1 time: 0.479946 Oct 24 10:48:51.908809 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2525/5013] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:51 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1363 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:52.060171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d7f512b7-252a-4cd8-b7d8-2d2eab3c4b97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:52.062168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d7f512b7-252a-4cd8-b7d8-2d2eab3c4b97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:52.069432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7f512b7-252a-4cd8-b7d8-2d2eab3c4b97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:52.070953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7f512b7-252a-4cd8-b7d8-2d2eab3c4b97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:52.071977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7f512b7-252a-4cd8-b7d8-2d2eab3c4b97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:52.072955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7f512b7-252a-4cd8-b7d8-2d2eab3c4b97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:52.073641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7f512b7-252a-4cd8-b7d8-2d2eab3c4b97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:52.074315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7f512b7-252a-4cd8-b7d8-2d2eab3c4b97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:52.243683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-50c7155a-e0b9-4b31-ac7c-9c960c6b704c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:52.244293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-50c7155a-e0b9-4b31-ac7c-9c960c6b704c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:52.257049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50c7155a-e0b9-4b31-ac7c-9c960c6b704c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:52.257551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50c7155a-e0b9-4b31-ac7c-9c960c6b704c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:52.258184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50c7155a-e0b9-4b31-ac7c-9c960c6b704c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:52.259190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50c7155a-e0b9-4b31-ac7c-9c960c6b704c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:52.259977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50c7155a-e0b9-4b31-ac7c-9c960c6b704c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:52.260567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50c7155a-e0b9-4b31-ac7c-9c960c6b704c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:52.339143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d7f512b7-252a-4cd8-b7d8-2d2eab3c4b97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:52.354836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d7f512b7-252a-4cd8-b7d8-2d2eab3c4b97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:52.356912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d7f512b7-252a-4cd8-b7d8-2d2eab3c4b97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:52.358667 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d7f512b7-252a-4cd8-b7d8-2d2eab3c4b97 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1729 microversion: 2.20 time: 0.303700 Oct 24 10:48:52.360358 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2489/5014] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:52 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1729 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:52.441184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-22e74e06-d5a7-4064-825f-2249af352772 req-9aa04abc-fdb6-48a7-b4a0-45f0f66f116a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8856046c-d409-4791-898d-19e0401f6dc0", "tag": "7ecdfb45-88b0-476d-baa1-30646c4c023d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:48:52.459522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-22e74e06-d5a7-4064-825f-2249af352772 req-9aa04abc-fdb6-48a7-b4a0-45f0f66f116a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:52.465976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-22e74e06-d5a7-4064-825f-2249af352772 req-9aa04abc-fdb6-48a7-b4a0-45f0f66f116a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:52.466670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-22e74e06-d5a7-4064-825f-2249af352772 req-9aa04abc-fdb6-48a7-b4a0-45f0f66f116a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:52.489604 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-22e74e06-d5a7-4064-825f-2249af352772 req-9aa04abc-fdb6-48a7-b4a0-45f0f66f116a service nova] Creating event network-changed:7ecdfb45-88b0-476d-baa1-30646c4c023d for instance 8856046c-d409-4791-898d-19e0401f6dc0 on n-h1-858383-15 Oct 24 10:48:52.492407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-50c7155a-e0b9-4b31-ac7c-9c960c6b704c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:52.503323 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-22e74e06-d5a7-4064-825f-2249af352772 req-9aa04abc-fdb6-48a7-b4a0-45f0f66f116a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066788 Oct 24 10:48:52.506196 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2490/5015] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:48:52.512344 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-50c7155a-e0b9-4b31-ac7c-9c960c6b704c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1321 microversion: 2.1 time: 0.272421 Oct 24 10:48:52.513371 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2526/5016] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:52 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:52.917380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8cb2879b-576c-4028-906e-3607befa4ebd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:52.918078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8cb2879b-576c-4028-906e-3607befa4ebd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:52.930353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb2879b-576c-4028-906e-3607befa4ebd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:52.934496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb2879b-576c-4028-906e-3607befa4ebd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:52.937050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb2879b-576c-4028-906e-3607befa4ebd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:52.937790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb2879b-576c-4028-906e-3607befa4ebd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:52.938256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb2879b-576c-4028-906e-3607befa4ebd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:52.938691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cb2879b-576c-4028-906e-3607befa4ebd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:53.214655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8cb2879b-576c-4028-906e-3607befa4ebd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:53.231412 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8cb2879b-576c-4028-906e-3607befa4ebd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1363 microversion: 2.1 time: 0.318871 Oct 24 10:48:53.235845 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2491/5017] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:52 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:53.387565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-56cd44b2-9062-4556-adae-c8e4caf3825f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:53.389049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-56cd44b2-9062-4556-adae-c8e4caf3825f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:53.410527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56cd44b2-9062-4556-adae-c8e4caf3825f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:53.417070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56cd44b2-9062-4556-adae-c8e4caf3825f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:53.428286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56cd44b2-9062-4556-adae-c8e4caf3825f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:53.429696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56cd44b2-9062-4556-adae-c8e4caf3825f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:53.430375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56cd44b2-9062-4556-adae-c8e4caf3825f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:53.430986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56cd44b2-9062-4556-adae-c8e4caf3825f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:53.436663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:48:53.551757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-11f35bbb-e08a-40e2-9e01-319ff68ce6a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:53.553464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-11f35bbb-e08a-40e2-9e01-319ff68ce6a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:53.570237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11f35bbb-e08a-40e2-9e01-319ff68ce6a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:53.571181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11f35bbb-e08a-40e2-9e01-319ff68ce6a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:53.571757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11f35bbb-e08a-40e2-9e01-319ff68ce6a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:53.572820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11f35bbb-e08a-40e2-9e01-319ff68ce6a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:53.573401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11f35bbb-e08a-40e2-9e01-319ff68ce6a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:53.573756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11f35bbb-e08a-40e2-9e01-319ff68ce6a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:54.125522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-11f35bbb-e08a-40e2-9e01-319ff68ce6a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:54.128129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-56cd44b2-9062-4556-adae-c8e4caf3825f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:54.140201 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-11f35bbb-e08a-40e2-9e01-319ff68ce6a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1321 microversion: 2.1 time: 0.596703 Oct 24 10:48:54.141893 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2492/5018] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:53 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1321 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:54.149079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-56cd44b2-9062-4556-adae-c8e4caf3825f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:54.159833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-56cd44b2-9062-4556-adae-c8e4caf3825f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:54.161331 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-56cd44b2-9062-4556-adae-c8e4caf3825f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1729 microversion: 2.20 time: 0.779060 Oct 24 10:48:54.169128 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2527/5019] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:53 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1729 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:54.259773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e789422f-3f94-4a42-afff-08eee6047acd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:54.260959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e789422f-3f94-4a42-afff-08eee6047acd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:54.275301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e789422f-3f94-4a42-afff-08eee6047acd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:54.277290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e789422f-3f94-4a42-afff-08eee6047acd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:54.278360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e789422f-3f94-4a42-afff-08eee6047acd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:54.282547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e789422f-3f94-4a42-afff-08eee6047acd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:54.283768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e789422f-3f94-4a42-afff-08eee6047acd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:54.284870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e789422f-3f94-4a42-afff-08eee6047acd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:54.743594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e789422f-3f94-4a42-afff-08eee6047acd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:54.757827 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e789422f-3f94-4a42-afff-08eee6047acd tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1363 microversion: 2.1 time: 0.501641 Oct 24 10:48:54.758450 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2493/5020] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:54 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1363 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:55.165538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a1a7168b-3b6a-44cb-93a3-ca64620b15ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:55.166158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a1a7168b-3b6a-44cb-93a3-ca64620b15ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:55.196506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1a7168b-3b6a-44cb-93a3-ca64620b15ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:55.199566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c0c1ae60-7fe8-4420-8e38-0654edf20f46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:55.200621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1a7168b-3b6a-44cb-93a3-ca64620b15ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:55.200768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c0c1ae60-7fe8-4420-8e38-0654edf20f46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:55.206088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1a7168b-3b6a-44cb-93a3-ca64620b15ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:55.206088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1a7168b-3b6a-44cb-93a3-ca64620b15ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:55.206088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1a7168b-3b6a-44cb-93a3-ca64620b15ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:55.206088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1a7168b-3b6a-44cb-93a3-ca64620b15ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:55.209204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0c1ae60-7fe8-4420-8e38-0654edf20f46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:55.210457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0c1ae60-7fe8-4420-8e38-0654edf20f46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:55.211223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0c1ae60-7fe8-4420-8e38-0654edf20f46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:55.212415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0c1ae60-7fe8-4420-8e38-0654edf20f46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:55.213589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0c1ae60-7fe8-4420-8e38-0654edf20f46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:55.214386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0c1ae60-7fe8-4420-8e38-0654edf20f46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:56.049082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0c1ae60-7fe8-4420-8e38-0654edf20f46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:56.069604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0c1ae60-7fe8-4420-8e38-0654edf20f46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:56.073608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0c1ae60-7fe8-4420-8e38-0654edf20f46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:56.076336 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c0c1ae60-7fe8-4420-8e38-0654edf20f46 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1729 microversion: 2.20 time: 0.882143 Oct 24 10:48:56.081446 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2494/5021] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:55 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1729 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:56.092078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8869d02f-e147-4703-9c26-ddffc75cf8ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:56.093798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8869d02f-e147-4703-9c26-ddffc75cf8ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:56.113127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8869d02f-e147-4703-9c26-ddffc75cf8ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:56.113893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8869d02f-e147-4703-9c26-ddffc75cf8ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:56.115272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8869d02f-e147-4703-9c26-ddffc75cf8ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:56.117684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8869d02f-e147-4703-9c26-ddffc75cf8ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:56.118428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8869d02f-e147-4703-9c26-ddffc75cf8ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:56.121458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8869d02f-e147-4703-9c26-ddffc75cf8ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:56.332532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a1a7168b-3b6a-44cb-93a3-ca64620b15ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:56.346396 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a1a7168b-3b6a-44cb-93a3-ca64620b15ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1321 microversion: 2.1 time: 1.185352 Oct 24 10:48:56.346980 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2528/5022] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:55 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1321 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:56.591701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8869d02f-e147-4703-9c26-ddffc75cf8ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:56.612505 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8869d02f-e147-4703-9c26-ddffc75cf8ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1363 microversion: 2.1 time: 0.529647 Oct 24 10:48:56.613763 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2495/5023] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:56 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1363 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:57.117330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1f67cfd5-cb3b-4f54-895f-8feea053217e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:57.119464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1f67cfd5-cb3b-4f54-895f-8feea053217e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:57.140757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f67cfd5-cb3b-4f54-895f-8feea053217e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:57.148124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f67cfd5-cb3b-4f54-895f-8feea053217e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:57.148930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f67cfd5-cb3b-4f54-895f-8feea053217e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:57.163173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f67cfd5-cb3b-4f54-895f-8feea053217e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:57.163948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f67cfd5-cb3b-4f54-895f-8feea053217e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:57.164710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f67cfd5-cb3b-4f54-895f-8feea053217e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:57.375689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-567b8c0b-c87e-4aed-bd87-4a44120c2a1a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:57.378182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-567b8c0b-c87e-4aed-bd87-4a44120c2a1a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:57.398995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-567b8c0b-c87e-4aed-bd87-4a44120c2a1a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:57.408461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-567b8c0b-c87e-4aed-bd87-4a44120c2a1a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:57.411435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-567b8c0b-c87e-4aed-bd87-4a44120c2a1a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:57.418040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-567b8c0b-c87e-4aed-bd87-4a44120c2a1a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:57.422522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-567b8c0b-c87e-4aed-bd87-4a44120c2a1a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:57.423069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-567b8c0b-c87e-4aed-bd87-4a44120c2a1a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:57.588343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1f67cfd5-cb3b-4f54-895f-8feea053217e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:57.600677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1f67cfd5-cb3b-4f54-895f-8feea053217e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:57.602163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1f67cfd5-cb3b-4f54-895f-8feea053217e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:57.613123 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1f67cfd5-cb3b-4f54-895f-8feea053217e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1729 microversion: 2.20 time: 0.505399 Oct 24 10:48:57.616879 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2529/5024] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:57 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1729 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:57.647554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-af23a1af-c941-4724-881c-4b909b769c4d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:57.648684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-af23a1af-c941-4724-881c-4b909b769c4d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:57.657253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af23a1af-c941-4724-881c-4b909b769c4d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:57.658103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af23a1af-c941-4724-881c-4b909b769c4d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:57.658854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af23a1af-c941-4724-881c-4b909b769c4d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:57.668951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af23a1af-c941-4724-881c-4b909b769c4d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:57.670418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af23a1af-c941-4724-881c-4b909b769c4d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:57.671647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af23a1af-c941-4724-881c-4b909b769c4d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:57.781972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-567b8c0b-c87e-4aed-bd87-4a44120c2a1a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:57.801844 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-567b8c0b-c87e-4aed-bd87-4a44120c2a1a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1321 microversion: 2.1 time: 0.432079 Oct 24 10:48:57.802452 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2496/5025] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:57 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:57.996517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-af23a1af-c941-4724-881c-4b909b769c4d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:58.015755 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-af23a1af-c941-4724-881c-4b909b769c4d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1363 microversion: 2.1 time: 0.373251 Oct 24 10:48:58.016355 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2530/5026] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:57 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1363 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:48:58.038380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-1373413f-40e4-490d-ba61-4bbf35d078f7 req-ba060dfb-ed7b-4bf7-a75f-47baae5cb9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e1338eb-7f3d-4680-a0ee-931115da05f9", "name": "network-vif-plugged", "status": "completed", "tag": "ddf72b1d-9770-4cec-9349-b0bc3aee4a1c"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:48:58.049839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1373413f-40e4-490d-ba61-4bbf35d078f7 req-ba060dfb-ed7b-4bf7-a75f-47baae5cb9e4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:58.050650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1373413f-40e4-490d-ba61-4bbf35d078f7 req-ba060dfb-ed7b-4bf7-a75f-47baae5cb9e4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:58.051291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1373413f-40e4-490d-ba61-4bbf35d078f7 req-ba060dfb-ed7b-4bf7-a75f-47baae5cb9e4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:58.080244 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-1373413f-40e4-490d-ba61-4bbf35d078f7 req-ba060dfb-ed7b-4bf7-a75f-47baae5cb9e4 service nova] Creating event network-vif-plugged:ddf72b1d-9770-4cec-9349-b0bc3aee4a1c for instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 on n-h2-858383-15 Oct 24 10:48:58.136310 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-1373413f-40e4-490d-ba61-4bbf35d078f7 req-ba060dfb-ed7b-4bf7-a75f-47baae5cb9e4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083926 Oct 24 10:48:58.137239 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2497/5027] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:48:58.648994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-24c28ce3-204d-4d03-a6d7-b5d43a2827dc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:58.650489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-24c28ce3-204d-4d03-a6d7-b5d43a2827dc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:58.670040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24c28ce3-204d-4d03-a6d7-b5d43a2827dc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:58.672396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24c28ce3-204d-4d03-a6d7-b5d43a2827dc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:58.673116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24c28ce3-204d-4d03-a6d7-b5d43a2827dc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:58.674104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24c28ce3-204d-4d03-a6d7-b5d43a2827dc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:58.676972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24c28ce3-204d-4d03-a6d7-b5d43a2827dc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:58.677883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24c28ce3-204d-4d03-a6d7-b5d43a2827dc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:58.831062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e17bb109-4ea7-41cd-aee4-5e0b4381dc75 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:58.832671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e17bb109-4ea7-41cd-aee4-5e0b4381dc75 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:58.860336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e17bb109-4ea7-41cd-aee4-5e0b4381dc75 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:58.863993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e17bb109-4ea7-41cd-aee4-5e0b4381dc75 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:58.864776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e17bb109-4ea7-41cd-aee4-5e0b4381dc75 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:58.869855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e17bb109-4ea7-41cd-aee4-5e0b4381dc75 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:58.871135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e17bb109-4ea7-41cd-aee4-5e0b4381dc75 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:58.878406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e17bb109-4ea7-41cd-aee4-5e0b4381dc75 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:59.017498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-24c28ce3-204d-4d03-a6d7-b5d43a2827dc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:59.034561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-24c28ce3-204d-4d03-a6d7-b5d43a2827dc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:59.038995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-24c28ce3-204d-4d03-a6d7-b5d43a2827dc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:59.042456 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-24c28ce3-204d-4d03-a6d7-b5d43a2827dc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1729 microversion: 2.20 time: 0.397712 Oct 24 10:48:59.045319 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2531/5028] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:48:58 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1729 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:48:59.057443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4e4f5175-b68b-4191-963c-331a2bc49491 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:48:59.058350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4e4f5175-b68b-4191-963c-331a2bc49491 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:48:59.076645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e4f5175-b68b-4191-963c-331a2bc49491 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:59.081007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e4f5175-b68b-4191-963c-331a2bc49491 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:59.086449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e4f5175-b68b-4191-963c-331a2bc49491 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:59.087481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e4f5175-b68b-4191-963c-331a2bc49491 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:48:59.088363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e4f5175-b68b-4191-963c-331a2bc49491 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:48:59.088810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e4f5175-b68b-4191-963c-331a2bc49491 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:48:59.334527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e17bb109-4ea7-41cd-aee4-5e0b4381dc75 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:59.374590 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e17bb109-4ea7-41cd-aee4-5e0b4381dc75 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1321 microversion: 2.1 time: 0.548234 Oct 24 10:48:59.380887 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2498/5029] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:58 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1321 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:48:59.540272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4e4f5175-b68b-4191-963c-331a2bc49491 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:48:59.551543 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4e4f5175-b68b-4191-963c-331a2bc49491 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1363 microversion: 2.1 time: 0.504474 Oct 24 10:48:59.570456 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2532/5030] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:48:59 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1363 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:00.071910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e330b01c-fcc7-4d20-b878-5eb2e65bc81f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:00.072718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e330b01c-fcc7-4d20-b878-5eb2e65bc81f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:00.086430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e330b01c-fcc7-4d20-b878-5eb2e65bc81f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:00.087129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e330b01c-fcc7-4d20-b878-5eb2e65bc81f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:00.087693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e330b01c-fcc7-4d20-b878-5eb2e65bc81f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:00.088585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e330b01c-fcc7-4d20-b878-5eb2e65bc81f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:00.089213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e330b01c-fcc7-4d20-b878-5eb2e65bc81f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:00.095473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e330b01c-fcc7-4d20-b878-5eb2e65bc81f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:00.433966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1260ed10-74f2-4bc3-a949-e7949215234e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:00.437489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1260ed10-74f2-4bc3-a949-e7949215234e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:00.469421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1260ed10-74f2-4bc3-a949-e7949215234e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:00.470351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1260ed10-74f2-4bc3-a949-e7949215234e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:00.471080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1260ed10-74f2-4bc3-a949-e7949215234e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:00.473643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1260ed10-74f2-4bc3-a949-e7949215234e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:00.476490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1260ed10-74f2-4bc3-a949-e7949215234e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:00.478013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1260ed10-74f2-4bc3-a949-e7949215234e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:00.516744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e330b01c-fcc7-4d20-b878-5eb2e65bc81f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:00.527987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e330b01c-fcc7-4d20-b878-5eb2e65bc81f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:00.531027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e330b01c-fcc7-4d20-b878-5eb2e65bc81f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:00.538866 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e330b01c-fcc7-4d20-b878-5eb2e65bc81f tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1729 microversion: 2.20 time: 0.465060 Oct 24 10:49:00.544497 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2499/5031] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:00 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1729 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:00.586588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-814e017d-87fb-466e-bf2d-cf39e036b164 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:00.587215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-814e017d-87fb-466e-bf2d-cf39e036b164 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:00.612770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-814e017d-87fb-466e-bf2d-cf39e036b164 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:00.616487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-814e017d-87fb-466e-bf2d-cf39e036b164 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:00.617482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-814e017d-87fb-466e-bf2d-cf39e036b164 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:00.618489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-814e017d-87fb-466e-bf2d-cf39e036b164 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:00.619960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-814e017d-87fb-466e-bf2d-cf39e036b164 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:00.620864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-814e017d-87fb-466e-bf2d-cf39e036b164 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:00.989843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1260ed10-74f2-4bc3-a949-e7949215234e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:01.013815 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1260ed10-74f2-4bc3-a949-e7949215234e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1321 microversion: 2.1 time: 0.587622 Oct 24 10:49:01.017391 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2533/5032] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:00 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1321 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:01.150337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-814e017d-87fb-466e-bf2d-cf39e036b164 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:01.159116 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-814e017d-87fb-466e-bf2d-cf39e036b164 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1363 microversion: 2.1 time: 0.578040 Oct 24 10:49:01.159734 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2500/5033] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:00 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1363 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:49:01.569195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0a8aa09d-cd02-4a07-a9df-ad970427c720 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:01.569195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0a8aa09d-cd02-4a07-a9df-ad970427c720 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:01.586392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a8aa09d-cd02-4a07-a9df-ad970427c720 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:01.586821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a8aa09d-cd02-4a07-a9df-ad970427c720 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:01.587276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a8aa09d-cd02-4a07-a9df-ad970427c720 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:01.588004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a8aa09d-cd02-4a07-a9df-ad970427c720 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:01.588465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a8aa09d-cd02-4a07-a9df-ad970427c720 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:01.588929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a8aa09d-cd02-4a07-a9df-ad970427c720 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:01.931219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0a8aa09d-cd02-4a07-a9df-ad970427c720 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:01.956169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0a8aa09d-cd02-4a07-a9df-ad970427c720 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:01.957663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0a8aa09d-cd02-4a07-a9df-ad970427c720 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:01.958876 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0a8aa09d-cd02-4a07-a9df-ad970427c720 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1729 microversion: 2.20 time: 0.397697 Oct 24 10:49:01.959461 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2534/5034] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:01 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1729 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:02.050549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e5e17756-c811-4635-a71c-77a4927b78b6 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:02.051187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e5e17756-c811-4635-a71c-77a4927b78b6 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:02.065945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5e17756-c811-4635-a71c-77a4927b78b6 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:02.067071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5e17756-c811-4635-a71c-77a4927b78b6 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:02.067841 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5e17756-c811-4635-a71c-77a4927b78b6 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:02.069686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5e17756-c811-4635-a71c-77a4927b78b6 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:02.079808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5e17756-c811-4635-a71c-77a4927b78b6 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:02.081426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5e17756-c811-4635-a71c-77a4927b78b6 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:02.194240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f1973d7c-a9af-4ffa-b1f5-cccc5a2b85e9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:02.195397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f1973d7c-a9af-4ffa-b1f5-cccc5a2b85e9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:02.213360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1973d7c-a9af-4ffa-b1f5-cccc5a2b85e9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:02.216800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1973d7c-a9af-4ffa-b1f5-cccc5a2b85e9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:02.220273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1973d7c-a9af-4ffa-b1f5-cccc5a2b85e9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:02.225185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1973d7c-a9af-4ffa-b1f5-cccc5a2b85e9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:02.227317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1973d7c-a9af-4ffa-b1f5-cccc5a2b85e9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:02.230217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1973d7c-a9af-4ffa-b1f5-cccc5a2b85e9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:02.616758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e5e17756-c811-4635-a71c-77a4927b78b6 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:02.629683 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e5e17756-c811-4635-a71c-77a4927b78b6 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1515 microversion: 2.1 time: 0.587804 Oct 24 10:49:02.645569 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2501/5035] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:02 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1515 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:02.654574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3f505ef8-0cef-4fe7-b957-caf32a6895ad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:49:02.658725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3f505ef8-0cef-4fe7-b957-caf32a6895ad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:02.670075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f505ef8-0cef-4fe7-b957-caf32a6895ad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:02.671300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f505ef8-0cef-4fe7-b957-caf32a6895ad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:02.672570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f505ef8-0cef-4fe7-b957-caf32a6895ad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:02.675119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f505ef8-0cef-4fe7-b957-caf32a6895ad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:02.675963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f505ef8-0cef-4fe7-b957-caf32a6895ad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:02.676646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f505ef8-0cef-4fe7-b957-caf32a6895ad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:02.765855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-3f505ef8-0cef-4fe7-b957-caf32a6895ad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lazy-loading 'flavor' on Instance uuid 5e1338eb-7f3d-4680-a0ee-931115da05f9 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:49:02.782787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f1973d7c-a9af-4ffa-b1f5-cccc5a2b85e9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:02.800041 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f1973d7c-a9af-4ffa-b1f5-cccc5a2b85e9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1363 microversion: 2.1 time: 0.614861 Oct 24 10:49:02.805633 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2535/5036] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:02 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1363 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:02.992394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-22cfe695-af4f-4f60-a628-8252797d3129 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:02.993112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-22cfe695-af4f-4f60-a628-8252797d3129 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:03.009798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22cfe695-af4f-4f60-a628-8252797d3129 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:03.010328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22cfe695-af4f-4f60-a628-8252797d3129 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:03.019573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:49:03.023062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22cfe695-af4f-4f60-a628-8252797d3129 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:03.031887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22cfe695-af4f-4f60-a628-8252797d3129 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:03.035071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22cfe695-af4f-4f60-a628-8252797d3129 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:03.036953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22cfe695-af4f-4f60-a628-8252797d3129 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:03.044104 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3f505ef8-0cef-4fe7-b957-caf32a6895ad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "POST /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9/action" status: 200 len: 32 microversion: 2.1 time: 0.393678 Oct 24 10:49:03.045062 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2502/5037] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:49:02 2022] POST /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9/action => generated 32 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:49:03.064520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f4ad39bd-2b07-49c6-b794-1930d2a239a9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:03.065368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f4ad39bd-2b07-49c6-b794-1930d2a239a9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:03.081626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4ad39bd-2b07-49c6-b794-1930d2a239a9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:03.082929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4ad39bd-2b07-49c6-b794-1930d2a239a9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:03.082929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4ad39bd-2b07-49c6-b794-1930d2a239a9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:03.084445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4ad39bd-2b07-49c6-b794-1930d2a239a9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:03.085212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4ad39bd-2b07-49c6-b794-1930d2a239a9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:03.085698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4ad39bd-2b07-49c6-b794-1930d2a239a9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:03.583110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-22cfe695-af4f-4f60-a628-8252797d3129 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:03.608599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-22cfe695-af4f-4f60-a628-8252797d3129 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:03.635978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-22cfe695-af4f-4f60-a628-8252797d3129 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:03.638648 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-22cfe695-af4f-4f60-a628-8252797d3129 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1729 microversion: 2.20 time: 0.649689 Oct 24 10:49:03.640347 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2536/5038] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:02 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1729 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:49:03.830728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f0557372-092f-4dd6-b14b-e29e099698da tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:03.832126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f0557372-092f-4dd6-b14b-e29e099698da tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:03.839733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f4ad39bd-2b07-49c6-b794-1930d2a239a9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:03.850935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0557372-092f-4dd6-b14b-e29e099698da tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:03.852043 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f4ad39bd-2b07-49c6-b794-1930d2a239a9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.797302 Oct 24 10:49:03.854980 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2503/5039] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:03 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:03.873278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0557372-092f-4dd6-b14b-e29e099698da tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:03.874191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0557372-092f-4dd6-b14b-e29e099698da tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:03.876641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0557372-092f-4dd6-b14b-e29e099698da tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:03.879882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0557372-092f-4dd6-b14b-e29e099698da tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:03.883424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0557372-092f-4dd6-b14b-e29e099698da tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:04.278058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-57c48460-ce59-4d4c-ac9d-7ef57586fc47 req-73e44a95-17ea-4d89-813c-32a7ea3ff48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8856046c-d409-4791-898d-19e0401f6dc0", "name": "network-vif-plugged", "status": "completed", "tag": "7ecdfb45-88b0-476d-baa1-30646c4c023d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:49:04.293656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-57c48460-ce59-4d4c-ac9d-7ef57586fc47 req-73e44a95-17ea-4d89-813c-32a7ea3ff48e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:04.293656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-57c48460-ce59-4d4c-ac9d-7ef57586fc47 req-73e44a95-17ea-4d89-813c-32a7ea3ff48e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:04.304324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-57c48460-ce59-4d4c-ac9d-7ef57586fc47 req-73e44a95-17ea-4d89-813c-32a7ea3ff48e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:04.306289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f0557372-092f-4dd6-b14b-e29e099698da tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:04.339967 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-57c48460-ce59-4d4c-ac9d-7ef57586fc47 req-73e44a95-17ea-4d89-813c-32a7ea3ff48e service nova] Creating event network-vif-plugged:7ecdfb45-88b0-476d-baa1-30646c4c023d for instance 8856046c-d409-4791-898d-19e0401f6dc0 on n-h1-858383-15 Oct 24 10:49:04.343745 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f0557372-092f-4dd6-b14b-e29e099698da tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1363 microversion: 2.1 time: 0.517847 Oct 24 10:49:04.360923 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-57c48460-ce59-4d4c-ac9d-7ef57586fc47 req-73e44a95-17ea-4d89-813c-32a7ea3ff48e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092278 Oct 24 10:49:04.360923 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2504/5040] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:49:04.365511 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2537/5041] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:03 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1363 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:49:04.667941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c05ba003-5e69-4bda-9877-5c8ad4bb5432 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:04.668870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c05ba003-5e69-4bda-9877-5c8ad4bb5432 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:04.687501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c05ba003-5e69-4bda-9877-5c8ad4bb5432 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:04.690435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c05ba003-5e69-4bda-9877-5c8ad4bb5432 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:04.691195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c05ba003-5e69-4bda-9877-5c8ad4bb5432 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:04.699180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c05ba003-5e69-4bda-9877-5c8ad4bb5432 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:04.699180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c05ba003-5e69-4bda-9877-5c8ad4bb5432 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:04.699180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c05ba003-5e69-4bda-9877-5c8ad4bb5432 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:04.877129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3d1fbb8-033e-4f14-a668-a502c4365377 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:04.877758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f3d1fbb8-033e-4f14-a668-a502c4365377 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:04.896299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3d1fbb8-033e-4f14-a668-a502c4365377 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:04.896913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3d1fbb8-033e-4f14-a668-a502c4365377 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:04.897375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3d1fbb8-033e-4f14-a668-a502c4365377 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:04.898127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3d1fbb8-033e-4f14-a668-a502c4365377 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:04.903214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3d1fbb8-033e-4f14-a668-a502c4365377 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:04.906380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3d1fbb8-033e-4f14-a668-a502c4365377 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:05.132080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c05ba003-5e69-4bda-9877-5c8ad4bb5432 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:05.158585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c05ba003-5e69-4bda-9877-5c8ad4bb5432 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:05.169109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c05ba003-5e69-4bda-9877-5c8ad4bb5432 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:05.170634 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c05ba003-5e69-4bda-9877-5c8ad4bb5432 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1729 microversion: 2.20 time: 0.508323 Oct 24 10:49:05.178859 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2505/5042] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:04 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1729 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:05.386629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a3aa5cbc-6a83-4fc1-99d0-93e38393cff3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:05.388803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a3aa5cbc-6a83-4fc1-99d0-93e38393cff3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:05.405239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:49:05.432741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3aa5cbc-6a83-4fc1-99d0-93e38393cff3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:05.441496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3aa5cbc-6a83-4fc1-99d0-93e38393cff3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:05.444569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3aa5cbc-6a83-4fc1-99d0-93e38393cff3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:05.448164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3aa5cbc-6a83-4fc1-99d0-93e38393cff3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:05.453979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3aa5cbc-6a83-4fc1-99d0-93e38393cff3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:05.455013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3aa5cbc-6a83-4fc1-99d0-93e38393cff3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:05.548073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3d1fbb8-033e-4f14-a668-a502c4365377 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:05.576568 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f3d1fbb8-033e-4f14-a668-a502c4365377 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.704629 Oct 24 10:49:05.578712 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2538/5043] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:04 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:05.874894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a3aa5cbc-6a83-4fc1-99d0-93e38393cff3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:05.890743 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a3aa5cbc-6a83-4fc1-99d0-93e38393cff3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1363 microversion: 2.1 time: 0.515126 Oct 24 10:49:05.908722 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2506/5044] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:05 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1363 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:06.195794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-952a496a-6138-40de-972c-41095619af80 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:06.197532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-952a496a-6138-40de-972c-41095619af80 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:06.207372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-952a496a-6138-40de-972c-41095619af80 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:06.208348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-952a496a-6138-40de-972c-41095619af80 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:06.209037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-952a496a-6138-40de-972c-41095619af80 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:06.210238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-952a496a-6138-40de-972c-41095619af80 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:06.211460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-952a496a-6138-40de-972c-41095619af80 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:06.212410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-952a496a-6138-40de-972c-41095619af80 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:06.543253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-952a496a-6138-40de-972c-41095619af80 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:06.555545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-952a496a-6138-40de-972c-41095619af80 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:06.557394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-952a496a-6138-40de-972c-41095619af80 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:06.564663 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-952a496a-6138-40de-972c-41095619af80 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1729 microversion: 2.20 time: 0.372918 Oct 24 10:49:06.568488 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2539/5045] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:06 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1729 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:06.603801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4d63cb9c-51ba-43fc-8768-1d29c1011f64 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:06.604654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4d63cb9c-51ba-43fc-8768-1d29c1011f64 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:06.614596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d63cb9c-51ba-43fc-8768-1d29c1011f64 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:06.623679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d63cb9c-51ba-43fc-8768-1d29c1011f64 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:06.625219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d63cb9c-51ba-43fc-8768-1d29c1011f64 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:06.626258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d63cb9c-51ba-43fc-8768-1d29c1011f64 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:06.626955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d63cb9c-51ba-43fc-8768-1d29c1011f64 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:06.628128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d63cb9c-51ba-43fc-8768-1d29c1011f64 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:06.926103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5ed48e52-8c12-4dcd-9027-50ccfdc1e620 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:06.926763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5ed48e52-8c12-4dcd-9027-50ccfdc1e620 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:06.935871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ed48e52-8c12-4dcd-9027-50ccfdc1e620 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:06.937260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ed48e52-8c12-4dcd-9027-50ccfdc1e620 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:06.938117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ed48e52-8c12-4dcd-9027-50ccfdc1e620 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:06.939333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ed48e52-8c12-4dcd-9027-50ccfdc1e620 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:06.939980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ed48e52-8c12-4dcd-9027-50ccfdc1e620 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:06.940692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ed48e52-8c12-4dcd-9027-50ccfdc1e620 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:06.949289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4d63cb9c-51ba-43fc-8768-1d29c1011f64 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:06.964711 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4d63cb9c-51ba-43fc-8768-1d29c1011f64 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.365213 Oct 24 10:49:06.981742 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2507/5046] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:06 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:07.218556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5ed48e52-8c12-4dcd-9027-50ccfdc1e620 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:07.234158 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5ed48e52-8c12-4dcd-9027-50ccfdc1e620 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1549 microversion: 2.1 time: 0.314827 Oct 24 10:49:07.234973 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2540/5047] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:06 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1549 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:07.259157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7520cccb-b2ee-40e8-9a88-ad8255092891 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:07.259670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7520cccb-b2ee-40e8-9a88-ad8255092891 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:07.267125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7520cccb-b2ee-40e8-9a88-ad8255092891 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:07.267630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7520cccb-b2ee-40e8-9a88-ad8255092891 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:07.268079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7520cccb-b2ee-40e8-9a88-ad8255092891 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:07.268799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7520cccb-b2ee-40e8-9a88-ad8255092891 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:07.269291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7520cccb-b2ee-40e8-9a88-ad8255092891 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:07.269727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7520cccb-b2ee-40e8-9a88-ad8255092891 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:07.400313 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7520cccb-b2ee-40e8-9a88-ad8255092891 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.146223 Oct 24 10:49:07.406453 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2508/5048] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 10:49:07 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:49:07.595860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3d499c3-f068-4539-a97c-39e51ebf1b6e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:07.596492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f3d499c3-f068-4539-a97c-39e51ebf1b6e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:07.603041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3d499c3-f068-4539-a97c-39e51ebf1b6e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:07.603795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3d499c3-f068-4539-a97c-39e51ebf1b6e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:07.604447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3d499c3-f068-4539-a97c-39e51ebf1b6e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:07.605381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3d499c3-f068-4539-a97c-39e51ebf1b6e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:07.606012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3d499c3-f068-4539-a97c-39e51ebf1b6e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:07.606615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3d499c3-f068-4539-a97c-39e51ebf1b6e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:08.000446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fc5e2728-52d2-4e9b-a63b-472731bed9fe tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:08.002595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fc5e2728-52d2-4e9b-a63b-472731bed9fe tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:08.013406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc5e2728-52d2-4e9b-a63b-472731bed9fe tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:08.015167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc5e2728-52d2-4e9b-a63b-472731bed9fe tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:08.016327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc5e2728-52d2-4e9b-a63b-472731bed9fe tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:08.017386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc5e2728-52d2-4e9b-a63b-472731bed9fe tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:08.018255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc5e2728-52d2-4e9b-a63b-472731bed9fe tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:08.019279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc5e2728-52d2-4e9b-a63b-472731bed9fe tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:08.436714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3d499c3-f068-4539-a97c-39e51ebf1b6e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:08.458094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3d499c3-f068-4539-a97c-39e51ebf1b6e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:08.459555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3d499c3-f068-4539-a97c-39e51ebf1b6e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:08.460744 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f3d499c3-f068-4539-a97c-39e51ebf1b6e tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1729 microversion: 2.20 time: 0.869486 Oct 24 10:49:08.461702 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2541/5049] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:07 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1729 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:08.551323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fc5e2728-52d2-4e9b-a63b-472731bed9fe tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:08.561739 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fc5e2728-52d2-4e9b-a63b-472731bed9fe tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.572049 Oct 24 10:49:08.565061 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2509/5050] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:07 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:08.964889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-973e2903-9eb6-4513-9204-60fba6718c17 req-8c472627-da2c-4bd7-b0f0-ede40ffef816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8856046c-d409-4791-898d-19e0401f6dc0", "tag": "7ecdfb45-88b0-476d-baa1-30646c4c023d"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:49:08.986404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-973e2903-9eb6-4513-9204-60fba6718c17 req-8c472627-da2c-4bd7-b0f0-ede40ffef816 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:08.988286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-973e2903-9eb6-4513-9204-60fba6718c17 req-8c472627-da2c-4bd7-b0f0-ede40ffef816 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:08.989036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-973e2903-9eb6-4513-9204-60fba6718c17 req-8c472627-da2c-4bd7-b0f0-ede40ffef816 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:09.007968 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-973e2903-9eb6-4513-9204-60fba6718c17 req-8c472627-da2c-4bd7-b0f0-ede40ffef816 service nova] Creating event network-changed:7ecdfb45-88b0-476d-baa1-30646c4c023d for instance 8856046c-d409-4791-898d-19e0401f6dc0 on n-h1-858383-15 Oct 24 10:49:09.019485 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-973e2903-9eb6-4513-9204-60fba6718c17 req-8c472627-da2c-4bd7-b0f0-ede40ffef816 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060033 Oct 24 10:49:09.020714 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2542/5051] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:49:09.492206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-67f0bf19-d4f2-411d-bbda-3eacc049f5fd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:09.494080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-67f0bf19-d4f2-411d-bbda-3eacc049f5fd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:09.508019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67f0bf19-d4f2-411d-bbda-3eacc049f5fd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:09.509795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67f0bf19-d4f2-411d-bbda-3eacc049f5fd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:09.511573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67f0bf19-d4f2-411d-bbda-3eacc049f5fd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:09.514203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67f0bf19-d4f2-411d-bbda-3eacc049f5fd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:09.519658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67f0bf19-d4f2-411d-bbda-3eacc049f5fd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:09.521622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67f0bf19-d4f2-411d-bbda-3eacc049f5fd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:09.586582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5f9c8b26-802c-4183-8f96-f19d736d3cb8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:09.587302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5f9c8b26-802c-4183-8f96-f19d736d3cb8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:09.598235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f9c8b26-802c-4183-8f96-f19d736d3cb8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:09.600199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f9c8b26-802c-4183-8f96-f19d736d3cb8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:09.601262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f9c8b26-802c-4183-8f96-f19d736d3cb8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:09.602244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f9c8b26-802c-4183-8f96-f19d736d3cb8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:09.602949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f9c8b26-802c-4183-8f96-f19d736d3cb8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:09.603779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f9c8b26-802c-4183-8f96-f19d736d3cb8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:10.076262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-67f0bf19-d4f2-411d-bbda-3eacc049f5fd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:10.096209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-67f0bf19-d4f2-411d-bbda-3eacc049f5fd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:10.099837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-67f0bf19-d4f2-411d-bbda-3eacc049f5fd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:10.111074 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-67f0bf19-d4f2-411d-bbda-3eacc049f5fd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1729 microversion: 2.20 time: 0.625465 Oct 24 10:49:10.112509 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2510/5052] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:09 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1729 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:10.604558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5f9c8b26-802c-4183-8f96-f19d736d3cb8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:10.614287 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5f9c8b26-802c-4183-8f96-f19d736d3cb8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 1.031354 Oct 24 10:49:10.614287 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2543/5053] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:09 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:49:11.140973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3b362fc9-06f9-443d-85e5-34ca8b0b81e5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:11.141741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3b362fc9-06f9-443d-85e5-34ca8b0b81e5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:11.167267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b362fc9-06f9-443d-85e5-34ca8b0b81e5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:11.169744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b362fc9-06f9-443d-85e5-34ca8b0b81e5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:11.170326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b362fc9-06f9-443d-85e5-34ca8b0b81e5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:11.172412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b362fc9-06f9-443d-85e5-34ca8b0b81e5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:11.173061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b362fc9-06f9-443d-85e5-34ca8b0b81e5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:11.174316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3b362fc9-06f9-443d-85e5-34ca8b0b81e5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:11.419369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3b362fc9-06f9-443d-85e5-34ca8b0b81e5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:11.430770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3b362fc9-06f9-443d-85e5-34ca8b0b81e5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:11.432709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3b362fc9-06f9-443d-85e5-34ca8b0b81e5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:11.434662 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3b362fc9-06f9-443d-85e5-34ca8b0b81e5 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1729 microversion: 2.20 time: 0.298765 Oct 24 10:49:11.435813 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2511/5054] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:11 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1729 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:49:11.642146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bab89321-1325-46d2-b587-04569bd90211 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:11.647853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bab89321-1325-46d2-b587-04569bd90211 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:11.656478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bab89321-1325-46d2-b587-04569bd90211 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:11.657512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bab89321-1325-46d2-b587-04569bd90211 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:11.658051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bab89321-1325-46d2-b587-04569bd90211 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:11.658854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bab89321-1325-46d2-b587-04569bd90211 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:11.659506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bab89321-1325-46d2-b587-04569bd90211 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:11.660005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bab89321-1325-46d2-b587-04569bd90211 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:11.692570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:49:11.882906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bab89321-1325-46d2-b587-04569bd90211 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:11.901864 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bab89321-1325-46d2-b587-04569bd90211 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.267518 Oct 24 10:49:11.902700 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2544/5055] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:11 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:12.468489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6313a6ae-5f0e-495a-ab98-1d1588ddb81b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:12.469971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6313a6ae-5f0e-495a-ab98-1d1588ddb81b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:12.479384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6313a6ae-5f0e-495a-ab98-1d1588ddb81b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:12.480244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6313a6ae-5f0e-495a-ab98-1d1588ddb81b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:12.481525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6313a6ae-5f0e-495a-ab98-1d1588ddb81b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:12.482721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6313a6ae-5f0e-495a-ab98-1d1588ddb81b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:12.483952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6313a6ae-5f0e-495a-ab98-1d1588ddb81b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:12.485353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6313a6ae-5f0e-495a-ab98-1d1588ddb81b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:12.647782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-851c0aa7-8b97-4c2f-ba21-6c1fe0ce3de6 req-21b8414c-bb92-451d-91d1-1b9bd005935e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e357ce41-0ae9-4efa-973b-bc8920e4a0fa", "name": "network-vif-plugged", "status": "completed", "tag": "ddf713d1-ef02-4308-b6ce-8ec89af0574f"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:49:12.669243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6313a6ae-5f0e-495a-ab98-1d1588ddb81b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:12.672967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-851c0aa7-8b97-4c2f-ba21-6c1fe0ce3de6 req-21b8414c-bb92-451d-91d1-1b9bd005935e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:12.673921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-851c0aa7-8b97-4c2f-ba21-6c1fe0ce3de6 req-21b8414c-bb92-451d-91d1-1b9bd005935e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:12.674550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-851c0aa7-8b97-4c2f-ba21-6c1fe0ce3de6 req-21b8414c-bb92-451d-91d1-1b9bd005935e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:12.678373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6313a6ae-5f0e-495a-ab98-1d1588ddb81b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:12.679812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6313a6ae-5f0e-495a-ab98-1d1588ddb81b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:12.688481 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6313a6ae-5f0e-495a-ab98-1d1588ddb81b tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1729 microversion: 2.20 time: 0.225727 Oct 24 10:49:12.690097 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2512/5056] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:12 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:12.699412 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-851c0aa7-8b97-4c2f-ba21-6c1fe0ce3de6 req-21b8414c-bb92-451d-91d1-1b9bd005935e service nova] Creating event network-vif-plugged:ddf713d1-ef02-4308-b6ce-8ec89af0574f for instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa on n-h2-858383-15 Oct 24 10:49:12.713731 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-851c0aa7-8b97-4c2f-ba21-6c1fe0ce3de6 req-21b8414c-bb92-451d-91d1-1b9bd005935e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070472 Oct 24 10:49:12.719901 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2545/5057] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:49:12.926435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8fb92f98-4da7-4ed5-8c7d-037fd208bfad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:12.927315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8fb92f98-4da7-4ed5-8c7d-037fd208bfad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:12.934521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb92f98-4da7-4ed5-8c7d-037fd208bfad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:12.935912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb92f98-4da7-4ed5-8c7d-037fd208bfad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:12.935912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb92f98-4da7-4ed5-8c7d-037fd208bfad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:12.936766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb92f98-4da7-4ed5-8c7d-037fd208bfad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:12.944124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb92f98-4da7-4ed5-8c7d-037fd208bfad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:12.946659 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fb92f98-4da7-4ed5-8c7d-037fd208bfad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:13.489738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8fb92f98-4da7-4ed5-8c7d-037fd208bfad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:13.499451 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8fb92f98-4da7-4ed5-8c7d-037fd208bfad tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.576344 Oct 24 10:49:13.501911 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2513/5058] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:12 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:13.723415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-82332a05-0ed5-49ff-97ce-0080aec69fee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:13.724164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-82332a05-0ed5-49ff-97ce-0080aec69fee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:13.738966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82332a05-0ed5-49ff-97ce-0080aec69fee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:13.739565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82332a05-0ed5-49ff-97ce-0080aec69fee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:13.739912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82332a05-0ed5-49ff-97ce-0080aec69fee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:13.740641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82332a05-0ed5-49ff-97ce-0080aec69fee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:13.743024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82332a05-0ed5-49ff-97ce-0080aec69fee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:13.743489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82332a05-0ed5-49ff-97ce-0080aec69fee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:14.100437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-82332a05-0ed5-49ff-97ce-0080aec69fee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:14.148786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-82332a05-0ed5-49ff-97ce-0080aec69fee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:14.150317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-82332a05-0ed5-49ff-97ce-0080aec69fee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:14.151532 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-82332a05-0ed5-49ff-97ce-0080aec69fee tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1729 microversion: 2.20 time: 0.435999 Oct 24 10:49:14.152390 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2546/5059] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:13 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1729 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:14.525558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3cad1dba-ebe0-4ba0-8bc4-4f9f6d351297 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:14.526173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3cad1dba-ebe0-4ba0-8bc4-4f9f6d351297 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:14.538779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cad1dba-ebe0-4ba0-8bc4-4f9f6d351297 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:14.539336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cad1dba-ebe0-4ba0-8bc4-4f9f6d351297 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:14.547102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cad1dba-ebe0-4ba0-8bc4-4f9f6d351297 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:14.548164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cad1dba-ebe0-4ba0-8bc4-4f9f6d351297 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:14.548819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cad1dba-ebe0-4ba0-8bc4-4f9f6d351297 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:14.549450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cad1dba-ebe0-4ba0-8bc4-4f9f6d351297 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:14.937626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3cad1dba-ebe0-4ba0-8bc4-4f9f6d351297 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:14.953355 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3cad1dba-ebe0-4ba0-8bc4-4f9f6d351297 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.431478 Oct 24 10:49:14.957615 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2514/5060] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:14 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:15.182064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b56ac5c7-87fe-4e23-b996-685bb3b3cbb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:15.183357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b56ac5c7-87fe-4e23-b996-685bb3b3cbb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:15.203148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b56ac5c7-87fe-4e23-b996-685bb3b3cbb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:15.203638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b56ac5c7-87fe-4e23-b996-685bb3b3cbb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:15.204077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b56ac5c7-87fe-4e23-b996-685bb3b3cbb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:15.212283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b56ac5c7-87fe-4e23-b996-685bb3b3cbb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:15.213071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b56ac5c7-87fe-4e23-b996-685bb3b3cbb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:15.213689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b56ac5c7-87fe-4e23-b996-685bb3b3cbb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:15.509242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b56ac5c7-87fe-4e23-b996-685bb3b3cbb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:15.521644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b56ac5c7-87fe-4e23-b996-685bb3b3cbb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:15.527505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b56ac5c7-87fe-4e23-b996-685bb3b3cbb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:15.528732 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b56ac5c7-87fe-4e23-b996-685bb3b3cbb4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1729 microversion: 2.20 time: 0.350890 Oct 24 10:49:15.529715 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2547/5061] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:15 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1729 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:15.979779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-222ace91-07e5-4134-bcc2-8749a1cce2df tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:15.980542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-222ace91-07e5-4134-bcc2-8749a1cce2df tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:15.988458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-222ace91-07e5-4134-bcc2-8749a1cce2df tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:15.988993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-222ace91-07e5-4134-bcc2-8749a1cce2df tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:15.989464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-222ace91-07e5-4134-bcc2-8749a1cce2df tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:15.990165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-222ace91-07e5-4134-bcc2-8749a1cce2df tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:15.990748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-222ace91-07e5-4134-bcc2-8749a1cce2df tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:15.991407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-222ace91-07e5-4134-bcc2-8749a1cce2df tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:16.166644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-222ace91-07e5-4134-bcc2-8749a1cce2df tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:16.175516 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-222ace91-07e5-4134-bcc2-8749a1cce2df tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.199705 Oct 24 10:49:16.178738 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2515/5062] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:15 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:16.562701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-77a0bed7-3043-4270-8e21-5c73c85bfe0a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:16.563725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-77a0bed7-3043-4270-8e21-5c73c85bfe0a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:16.571175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77a0bed7-3043-4270-8e21-5c73c85bfe0a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:16.571668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77a0bed7-3043-4270-8e21-5c73c85bfe0a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:16.572113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77a0bed7-3043-4270-8e21-5c73c85bfe0a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:16.573069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77a0bed7-3043-4270-8e21-5c73c85bfe0a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:16.573531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77a0bed7-3043-4270-8e21-5c73c85bfe0a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:16.573967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77a0bed7-3043-4270-8e21-5c73c85bfe0a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:16.741630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-77a0bed7-3043-4270-8e21-5c73c85bfe0a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:16.753175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-77a0bed7-3043-4270-8e21-5c73c85bfe0a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:16.755042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-77a0bed7-3043-4270-8e21-5c73c85bfe0a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:16.756271 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-77a0bed7-3043-4270-8e21-5c73c85bfe0a tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1716 microversion: 2.20 time: 0.199035 Oct 24 10:49:16.765411 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2548/5063] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:16 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1716 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:17.198929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0c6dc833-fbe1-4ac4-bcf2-02c579005b8e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:17.199697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0c6dc833-fbe1-4ac4-bcf2-02c579005b8e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:17.210348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c6dc833-fbe1-4ac4-bcf2-02c579005b8e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:17.210845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c6dc833-fbe1-4ac4-bcf2-02c579005b8e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:17.211288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c6dc833-fbe1-4ac4-bcf2-02c579005b8e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:17.211994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c6dc833-fbe1-4ac4-bcf2-02c579005b8e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:17.212787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c6dc833-fbe1-4ac4-bcf2-02c579005b8e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:17.213259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c6dc833-fbe1-4ac4-bcf2-02c579005b8e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:17.360807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0c6dc833-fbe1-4ac4-bcf2-02c579005b8e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:17.369827 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0c6dc833-fbe1-4ac4-bcf2-02c579005b8e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.174586 Oct 24 10:49:17.370532 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2516/5064] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:17 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:18.396868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0c02bd88-e8dd-421d-8db4-2d3e0057272e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:18.397612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0c02bd88-e8dd-421d-8db4-2d3e0057272e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:18.407018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c02bd88-e8dd-421d-8db4-2d3e0057272e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:18.407949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c02bd88-e8dd-421d-8db4-2d3e0057272e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:18.408760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c02bd88-e8dd-421d-8db4-2d3e0057272e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:18.409894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c02bd88-e8dd-421d-8db4-2d3e0057272e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:18.410587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c02bd88-e8dd-421d-8db4-2d3e0057272e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:18.411374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c02bd88-e8dd-421d-8db4-2d3e0057272e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:18.571490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0c02bd88-e8dd-421d-8db4-2d3e0057272e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:18.583105 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0c02bd88-e8dd-421d-8db4-2d3e0057272e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.190233 Oct 24 10:49:18.583725 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2549/5065] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:18 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:19.607071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9bbb8d85-0a33-4917-a437-d0c48b36111a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:19.609259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9bbb8d85-0a33-4917-a437-d0c48b36111a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:19.616878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bbb8d85-0a33-4917-a437-d0c48b36111a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:19.617379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bbb8d85-0a33-4917-a437-d0c48b36111a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:19.618066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bbb8d85-0a33-4917-a437-d0c48b36111a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:19.618804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bbb8d85-0a33-4917-a437-d0c48b36111a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:19.619252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bbb8d85-0a33-4917-a437-d0c48b36111a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:19.619717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9bbb8d85-0a33-4917-a437-d0c48b36111a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:19.765518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9bbb8d85-0a33-4917-a437-d0c48b36111a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:19.774973 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9bbb8d85-0a33-4917-a437-d0c48b36111a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.171557 Oct 24 10:49:19.775720 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2517/5066] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:19 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:49:20.800525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ee89f6ff-c74c-4e22-8f97-79b5a9a31b01 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:20.801342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ee89f6ff-c74c-4e22-8f97-79b5a9a31b01 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:20.806838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=52 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:49:20.814025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee89f6ff-c74c-4e22-8f97-79b5a9a31b01 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:20.816775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee89f6ff-c74c-4e22-8f97-79b5a9a31b01 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:20.818233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee89f6ff-c74c-4e22-8f97-79b5a9a31b01 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:20.819307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee89f6ff-c74c-4e22-8f97-79b5a9a31b01 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:20.820335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee89f6ff-c74c-4e22-8f97-79b5a9a31b01 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:20.821068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee89f6ff-c74c-4e22-8f97-79b5a9a31b01 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:20.973127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ee89f6ff-c74c-4e22-8f97-79b5a9a31b01 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:20.984805 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ee89f6ff-c74c-4e22-8f97-79b5a9a31b01 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.188596 Oct 24 10:49:20.985562 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2550/5067] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:20 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:22.012394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b439d74f-3882-430b-930c-f0875b3a275a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:22.013770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b439d74f-3882-430b-930c-f0875b3a275a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:22.022229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b439d74f-3882-430b-930c-f0875b3a275a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:22.022721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b439d74f-3882-430b-930c-f0875b3a275a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:22.023159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b439d74f-3882-430b-930c-f0875b3a275a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:22.024004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b439d74f-3882-430b-930c-f0875b3a275a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:22.024316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b439d74f-3882-430b-930c-f0875b3a275a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:22.024740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b439d74f-3882-430b-930c-f0875b3a275a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:22.177290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b439d74f-3882-430b-930c-f0875b3a275a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:22.188162 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b439d74f-3882-430b-930c-f0875b3a275a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.184351 Oct 24 10:49:22.189154 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2518/5068] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:22 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:23.211877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9c305319-57bc-416c-9f3d-ce8f2220ce21 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:23.212724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9c305319-57bc-416c-9f3d-ce8f2220ce21 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:23.220000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c305319-57bc-416c-9f3d-ce8f2220ce21 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:23.220498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c305319-57bc-416c-9f3d-ce8f2220ce21 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:23.220976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c305319-57bc-416c-9f3d-ce8f2220ce21 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:23.221696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c305319-57bc-416c-9f3d-ce8f2220ce21 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:23.222294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c305319-57bc-416c-9f3d-ce8f2220ce21 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:23.222738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c305319-57bc-416c-9f3d-ce8f2220ce21 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:23.383484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9c305319-57bc-416c-9f3d-ce8f2220ce21 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:23.391862 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9c305319-57bc-416c-9f3d-ce8f2220ce21 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.183860 Oct 24 10:49:23.392436 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2551/5069] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:23 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:24.416312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-490a6fe4-92d5-4e85-99cb-763c48702a33 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:24.417120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-490a6fe4-92d5-4e85-99cb-763c48702a33 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:24.424655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-490a6fe4-92d5-4e85-99cb-763c48702a33 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:24.425191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-490a6fe4-92d5-4e85-99cb-763c48702a33 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:24.425626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-490a6fe4-92d5-4e85-99cb-763c48702a33 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:24.426326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-490a6fe4-92d5-4e85-99cb-763c48702a33 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:24.426905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-490a6fe4-92d5-4e85-99cb-763c48702a33 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:24.427335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-490a6fe4-92d5-4e85-99cb-763c48702a33 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:24.577748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-490a6fe4-92d5-4e85-99cb-763c48702a33 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:24.589674 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-490a6fe4-92d5-4e85-99cb-763c48702a33 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.177825 Oct 24 10:49:24.590407 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2519/5070] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:24 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:25.621428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3bcbbc5a-3031-44e0-84ab-bbba499e040d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:25.622106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3bcbbc5a-3031-44e0-84ab-bbba499e040d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:25.629487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3bcbbc5a-3031-44e0-84ab-bbba499e040d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:25.630068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3bcbbc5a-3031-44e0-84ab-bbba499e040d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:25.630572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3bcbbc5a-3031-44e0-84ab-bbba499e040d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:25.631477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3bcbbc5a-3031-44e0-84ab-bbba499e040d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:25.631934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3bcbbc5a-3031-44e0-84ab-bbba499e040d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:25.632365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3bcbbc5a-3031-44e0-84ab-bbba499e040d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:25.770575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3bcbbc5a-3031-44e0-84ab-bbba499e040d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:25.778397 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3bcbbc5a-3031-44e0-84ab-bbba499e040d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.161147 Oct 24 10:49:25.778963 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2552/5071] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:25 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:26.802750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5645121d-f812-4a66-94df-6233a325dd62 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:26.803355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5645121d-f812-4a66-94df-6233a325dd62 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:26.810791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5645121d-f812-4a66-94df-6233a325dd62 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:26.811939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5645121d-f812-4a66-94df-6233a325dd62 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:26.812420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5645121d-f812-4a66-94df-6233a325dd62 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:26.813375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5645121d-f812-4a66-94df-6233a325dd62 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:26.814001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5645121d-f812-4a66-94df-6233a325dd62 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:26.814440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5645121d-f812-4a66-94df-6233a325dd62 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:26.836679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:49:26.977900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5645121d-f812-4a66-94df-6233a325dd62 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:26.986629 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5645121d-f812-4a66-94df-6233a325dd62 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.187700 Oct 24 10:49:26.997686 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2520/5072] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:26 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:49:28.023700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f79e1215-ee57-4c2b-863f-898750eaccf9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:28.025149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f79e1215-ee57-4c2b-863f-898750eaccf9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:28.038399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f79e1215-ee57-4c2b-863f-898750eaccf9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:28.039549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f79e1215-ee57-4c2b-863f-898750eaccf9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:28.040775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f79e1215-ee57-4c2b-863f-898750eaccf9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:28.041841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f79e1215-ee57-4c2b-863f-898750eaccf9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:28.042611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f79e1215-ee57-4c2b-863f-898750eaccf9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:28.043337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f79e1215-ee57-4c2b-863f-898750eaccf9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:28.214801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f79e1215-ee57-4c2b-863f-898750eaccf9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:28.224292 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f79e1215-ee57-4c2b-863f-898750eaccf9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.205314 Oct 24 10:49:28.225017 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2553/5073] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:28 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:29.248144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d4bf4ed6-8708-4063-85d6-e802945fd392 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:29.249221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d4bf4ed6-8708-4063-85d6-e802945fd392 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:29.256726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4bf4ed6-8708-4063-85d6-e802945fd392 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:29.257592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4bf4ed6-8708-4063-85d6-e802945fd392 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:29.257877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4bf4ed6-8708-4063-85d6-e802945fd392 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:29.258603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4bf4ed6-8708-4063-85d6-e802945fd392 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:29.259074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4bf4ed6-8708-4063-85d6-e802945fd392 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:29.259496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4bf4ed6-8708-4063-85d6-e802945fd392 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:29.428785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d4bf4ed6-8708-4063-85d6-e802945fd392 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:29.429878 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d4bf4ed6-8708-4063-85d6-e802945fd392 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.185538 Oct 24 10:49:29.430847 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2521/5074] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:29 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:49:30.454893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-21c0189a-ed08-408d-93b3-882bd95fa428 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:30.456046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-21c0189a-ed08-408d-93b3-882bd95fa428 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:30.463581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21c0189a-ed08-408d-93b3-882bd95fa428 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:30.464445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21c0189a-ed08-408d-93b3-882bd95fa428 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:30.465007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21c0189a-ed08-408d-93b3-882bd95fa428 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:30.465749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21c0189a-ed08-408d-93b3-882bd95fa428 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:30.466214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21c0189a-ed08-408d-93b3-882bd95fa428 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:30.466647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21c0189a-ed08-408d-93b3-882bd95fa428 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:30.614050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-21c0189a-ed08-408d-93b3-882bd95fa428 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:30.624617 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-21c0189a-ed08-408d-93b3-882bd95fa428 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.174109 Oct 24 10:49:30.625668 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2554/5075] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:30 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:30.760573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e217c94e-acb7-4584-a095-7bfbbbf34172 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:30.761263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e217c94e-acb7-4584-a095-7bfbbbf34172 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:30.768782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e217c94e-acb7-4584-a095-7bfbbbf34172 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:30.769307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e217c94e-acb7-4584-a095-7bfbbbf34172 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:30.769968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e217c94e-acb7-4584-a095-7bfbbbf34172 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:30.770683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e217c94e-acb7-4584-a095-7bfbbbf34172 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:30.771151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e217c94e-acb7-4584-a095-7bfbbbf34172 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:30.771585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e217c94e-acb7-4584-a095-7bfbbbf34172 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:30.801154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e217c94e-acb7-4584-a095-7bfbbbf34172 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:49:30.904984 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e217c94e-acb7-4584-a095-7bfbbbf34172 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "DELETE /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 204 len: 0 microversion: 2.1 time: 0.342696 Oct 24 10:49:30.906440 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2522/5076] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:49:30 2022] DELETE /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 10:49:30.914496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-84496d8e-3254-4f32-9d4a-e50e84ff98a1 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:30.915126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-84496d8e-3254-4f32-9d4a-e50e84ff98a1 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:30.921773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84496d8e-3254-4f32-9d4a-e50e84ff98a1 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:30.922265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84496d8e-3254-4f32-9d4a-e50e84ff98a1 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:30.922903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84496d8e-3254-4f32-9d4a-e50e84ff98a1 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:30.923609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84496d8e-3254-4f32-9d4a-e50e84ff98a1 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:30.924253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84496d8e-3254-4f32-9d4a-e50e84ff98a1 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:30.924688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84496d8e-3254-4f32-9d4a-e50e84ff98a1 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:31.099990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-84496d8e-3254-4f32-9d4a-e50e84ff98a1 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:31.110020 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-84496d8e-3254-4f32-9d4a-e50e84ff98a1 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1733 microversion: 2.1 time: 0.199301 Oct 24 10:49:31.110731 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2555/5077] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:30 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1733 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:31.650194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-372fa143-cf3e-4a62-b6e0-f71c1d1a8358 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:31.650826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-372fa143-cf3e-4a62-b6e0-f71c1d1a8358 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:31.658779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-372fa143-cf3e-4a62-b6e0-f71c1d1a8358 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:31.659359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-372fa143-cf3e-4a62-b6e0-f71c1d1a8358 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:31.659897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-372fa143-cf3e-4a62-b6e0-f71c1d1a8358 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:31.660802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-372fa143-cf3e-4a62-b6e0-f71c1d1a8358 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:31.661569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-372fa143-cf3e-4a62-b6e0-f71c1d1a8358 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:31.662063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-372fa143-cf3e-4a62-b6e0-f71c1d1a8358 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:31.872690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-372fa143-cf3e-4a62-b6e0-f71c1d1a8358 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:31.881311 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-372fa143-cf3e-4a62-b6e0-f71c1d1a8358 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.236092 Oct 24 10:49:31.882218 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2523/5078] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:31 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:32.138397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-27518d88-adc5-4c23-a84b-4db48319fd65 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:32.140445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-27518d88-adc5-4c23-a84b-4db48319fd65 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:32.149210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27518d88-adc5-4c23-a84b-4db48319fd65 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:32.150079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27518d88-adc5-4c23-a84b-4db48319fd65 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:32.150750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27518d88-adc5-4c23-a84b-4db48319fd65 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:32.151846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27518d88-adc5-4c23-a84b-4db48319fd65 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:32.153336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27518d88-adc5-4c23-a84b-4db48319fd65 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:32.154012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-27518d88-adc5-4c23-a84b-4db48319fd65 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:32.317320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-27518d88-adc5-4c23-a84b-4db48319fd65 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:32.326563 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-27518d88-adc5-4c23-a84b-4db48319fd65 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1733 microversion: 2.1 time: 0.194839 Oct 24 10:49:32.327771 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2556/5079] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:32 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1733 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:32.947409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4a7585c0-6155-446f-80e0-3fb48eb6b909 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:32.950990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-548e2596-4bed-4f1d-b6f8-f7e46c01977b req-993c5427-aa50-4e02-a0d3-abb8a8449322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161edb66-41db-4070-8b7b-81c318cde03a", "name": "network-vif-deleted", "tag": "0a0278ee-b58d-4340-bbf3-0cc59d2bb857"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:49:32.953669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4a7585c0-6155-446f-80e0-3fb48eb6b909 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:32.979290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a7585c0-6155-446f-80e0-3fb48eb6b909 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:32.983657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a7585c0-6155-446f-80e0-3fb48eb6b909 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:32.991484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a7585c0-6155-446f-80e0-3fb48eb6b909 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:32.998177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a7585c0-6155-446f-80e0-3fb48eb6b909 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:33.001816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a7585c0-6155-446f-80e0-3fb48eb6b909 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:33.002374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-548e2596-4bed-4f1d-b6f8-f7e46c01977b req-993c5427-aa50-4e02-a0d3-abb8a8449322 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:33.003448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a7585c0-6155-446f-80e0-3fb48eb6b909 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:33.009420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-548e2596-4bed-4f1d-b6f8-f7e46c01977b req-993c5427-aa50-4e02-a0d3-abb8a8449322 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:33.021923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-548e2596-4bed-4f1d-b6f8-f7e46c01977b req-993c5427-aa50-4e02-a0d3-abb8a8449322 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:33.070289 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-548e2596-4bed-4f1d-b6f8-f7e46c01977b req-993c5427-aa50-4e02-a0d3-abb8a8449322 service nova] Creating event network-vif-deleted:0a0278ee-b58d-4340-bbf3-0cc59d2bb857 for instance 161edb66-41db-4070-8b7b-81c318cde03a on n-h1-858383-15 Oct 24 10:49:33.098775 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-548e2596-4bed-4f1d-b6f8-f7e46c01977b req-993c5427-aa50-4e02-a0d3-abb8a8449322 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184651 Oct 24 10:49:33.100085 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2557/5080] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:49:33.341046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4a7585c0-6155-446f-80e0-3fb48eb6b909 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:33.353373 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4a7585c0-6155-446f-80e0-3fb48eb6b909 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1521 microversion: 2.1 time: 0.448644 Oct 24 10:49:33.354123 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2524/5081] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:32 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1521 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:33.370144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f9e86094-e4cb-4cb3-bdf8-d8a08c848a12 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:33.370144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f9e86094-e4cb-4cb3-bdf8-d8a08c848a12 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:33.379708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9e86094-e4cb-4cb3-bdf8-d8a08c848a12 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:33.380415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9e86094-e4cb-4cb3-bdf8-d8a08c848a12 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:33.381092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9e86094-e4cb-4cb3-bdf8-d8a08c848a12 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:33.382715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9e86094-e4cb-4cb3-bdf8-d8a08c848a12 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:33.383420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9e86094-e4cb-4cb3-bdf8-d8a08c848a12 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:33.384486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9e86094-e4cb-4cb3-bdf8-d8a08c848a12 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:33.435366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9e86094-e4cb-4cb3-bdf8-d8a08c848a12 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:33.436602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9e86094-e4cb-4cb3-bdf8-d8a08c848a12 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:33.437398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9e86094-e4cb-4cb3-bdf8-d8a08c848a12 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:33.438013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-f9e86094-e4cb-4cb3-bdf8-d8a08c848a12 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lazy-loading 'fault' on Instance uuid 161edb66-41db-4070-8b7b-81c318cde03a {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:49:33.491488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f9e86094-e4cb-4cb3-bdf8-d8a08c848a12 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4107e4d2df9455d9ec35a2bee1eacc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43199c732c141d893e52e2bb1c751e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:33.499523 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f9e86094-e4cb-4cb3-bdf8-d8a08c848a12 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 200 len: 1389 microversion: 2.1 time: 0.152091 Oct 24 10:49:33.500406 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2558/5082] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:33 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:34.378820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cafbea8f-45bc-4a8d-a11a-5c5523887d6d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:34.379999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cafbea8f-45bc-4a8d-a11a-5c5523887d6d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:34.395494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cafbea8f-45bc-4a8d-a11a-5c5523887d6d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:34.396012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cafbea8f-45bc-4a8d-a11a-5c5523887d6d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:34.396460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cafbea8f-45bc-4a8d-a11a-5c5523887d6d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:34.398288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cafbea8f-45bc-4a8d-a11a-5c5523887d6d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:34.398718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cafbea8f-45bc-4a8d-a11a-5c5523887d6d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:34.399158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cafbea8f-45bc-4a8d-a11a-5c5523887d6d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:34.524489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6c93d000-4ced-47a7-935b-bc87475ab0a3 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:34.525846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6c93d000-4ced-47a7-935b-bc87475ab0a3 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:34.534315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c93d000-4ced-47a7-935b-bc87475ab0a3 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:34.535055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c93d000-4ced-47a7-935b-bc87475ab0a3 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:34.535501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c93d000-4ced-47a7-935b-bc87475ab0a3 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:34.536438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c93d000-4ced-47a7-935b-bc87475ab0a3 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:34.537110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c93d000-4ced-47a7-935b-bc87475ab0a3 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:34.537714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c93d000-4ced-47a7-935b-bc87475ab0a3 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:34.558427 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-6c93d000-4ced-47a7-935b-bc87475ab0a3 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] HTTP exception thrown: Instance 161edb66-41db-4070-8b7b-81c318cde03a could not be found. Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6c93d000-4ced-47a7-935b-bc87475ab0a3 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Request method failure captured: Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a HTTP/1.1 Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmxGEf8mF42THT3h9fVPjViIC0vxXev9PDg9QG-1yIrdQc4XuWxkeckaiL1UG9W7evBgJwyTY2CMWgNyjCetvBLyQA0df24aJxSn1VeaDSE7OuAPqW65H3YqPVpe_ZHcqqNHqoCfgTDVJOA9iP5HY1LaTgt2RYe4CG8s3GjW0HDUrzM Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: c43199c732c141d893e52e2bb1c751e2 Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestServerBasicOps-1579171212 Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c43199c732c141d893e52e2bb1c751e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c43199c732c141d893e52e2bb1c751e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c43199c732c141d893e52e2bb1c751e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c43199c732c141d893e52e2bb1c751e2", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestServerBasicOps-1579171212 Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: c43199c732c141d893e52e2bb1c751e2 Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestServerBasicOps-1579171212 Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestServerBasicOps-1579171212-project Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: d4107e4d2df9455d9ec35a2bee1eacc8 Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestServerBasicOps-1579171212-project Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 161edb66-41db-4070-8b7b-81c318cde03a could not be found. Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '161edb66-41db-4070-8b7b-81c318cde03a'} Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 161edb66-41db-4070-8b7b-81c318cde03a could not be found. Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 161edb66-41db-4070-8b7b-81c318cde03a could not be found. Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:49:34.561079 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:34.566919 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:34.566919 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:49:34.566919 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:49:34.566919 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:49:34.566919 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:49:34.566919 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 161edb66-41db-4070-8b7b-81c318cde03a could not be found. Oct 24 10:49:34.566919 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:34.569146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6c93d000-4ced-47a7-935b-bc87475ab0a3 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Returning 404 to user: Instance 161edb66-41db-4070-8b7b-81c318cde03a could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:49:34.570224 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6c93d000-4ced-47a7-935b-bc87475ab0a3 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 404 len: 111 microversion: 2.1 time: 0.050539 Oct 24 10:49:34.571356 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2559/5083] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:34 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:49:34.588957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cafbea8f-45bc-4a8d-a11a-5c5523887d6d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:34.598766 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cafbea8f-45bc-4a8d-a11a-5c5523887d6d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1501 microversion: 2.1 time: 0.225587 Oct 24 10:49:34.599570 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2525/5084] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:34 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1501 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:34.623981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b063427e-4a56-4a58-8e0e-487135619391 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:34.624951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b063427e-4a56-4a58-8e0e-487135619391 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:34.631344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b063427e-4a56-4a58-8e0e-487135619391 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:34.632114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b063427e-4a56-4a58-8e0e-487135619391 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:34.632905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b063427e-4a56-4a58-8e0e-487135619391 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:34.633854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b063427e-4a56-4a58-8e0e-487135619391 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:34.634523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b063427e-4a56-4a58-8e0e-487135619391 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:34.635162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b063427e-4a56-4a58-8e0e-487135619391 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:34.824583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b063427e-4a56-4a58-8e0e-487135619391 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:34.844873 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b063427e-4a56-4a58-8e0e-487135619391 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1515 microversion: 2.1 time: 0.224631 Oct 24 10:49:34.845751 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2560/5085] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:34 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1515 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:34.869218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2cbe7107-e9df-4e7e-9a97-a5942eac471b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:49:34.871793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2cbe7107-e9df-4e7e-9a97-a5942eac471b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: a40fa62e-2049-4967-ac0a-cfc0a507a15d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:34.878551 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-2cbe7107-e9df-4e7e-9a97-a5942eac471b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] HTTP exception thrown: Instance a40fa62e-2049-4967-ac0a-cfc0a507a15d could not be found. Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2cbe7107-e9df-4e7e-9a97-a5942eac471b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Request method failure captured: Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/a40fa62e-2049-4967-ac0a-cfc0a507a15d/action HTTP/1.1 Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 14 Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm1_YpcUoTx6EtuRJqEim52THa9nHc93ggv-rCTsxHF8KCdRzu0B50Tb2gQcOKEkZzR8bjwxbVU1lCLt9l9Nlkw5MZDlojxwV2MAHZbN_UcYOzact8aaTN_ICS6JQcw4OPHcT53rEwR6K2uYrfqZ498tDq4tCZjBExjOK6wvBxhiRXQ Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 0ae874e076c34c44adb00f85aebd000e Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ae874e076c34c44adb00f85aebd000e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 0ae874e076c34c44adb00f85aebd000e Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerRescueNegativeTestJSON-615921797-project Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6da7534777ef4425aefa81bc7e49b69f Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-615921797-project Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: {"rescue": {}} Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance a40fa62e-2049-4967-ac0a-cfc0a507a15d could not be found. Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'a40fa62e-2049-4967-ac0a-cfc0a507a15d', 'body': {'rescue': {}}} Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a40fa62e-2049-4967-ac0a-cfc0a507a15d could not be found. Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a40fa62e-2049-4967-ac0a-cfc0a507a15d could not be found. Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:49:34.891529 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:34.897272 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:49:34.897272 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:49:34.897272 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:49:34.897272 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:49:34.897272 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a40fa62e-2049-4967-ac0a-cfc0a507a15d could not be found. Oct 24 10:49:34.897272 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:49:34.898904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2cbe7107-e9df-4e7e-9a97-a5942eac471b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Returning 404 to user: Instance a40fa62e-2049-4967-ac0a-cfc0a507a15d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:49:34.899913 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2cbe7107-e9df-4e7e-9a97-a5942eac471b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "POST /compute/v2.1/servers/a40fa62e-2049-4967-ac0a-cfc0a507a15d/action" status: 404 len: 111 microversion: 2.1 time: 0.035189 Oct 24 10:49:34.906641 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2526/5086] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:49:34 2022] POST /compute/v2.1/servers/a40fa62e-2049-4967-ac0a-cfc0a507a15d/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:49:34.911599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-76a71122-9eca-4550-83d3-b6b731198a65 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:49:34.912150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-76a71122-9eca-4550-83d3-b6b731198a65 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:34.928929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a71122-9eca-4550-83d3-b6b731198a65 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:34.932690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a71122-9eca-4550-83d3-b6b731198a65 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:34.933403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a71122-9eca-4550-83d3-b6b731198a65 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:34.934358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a71122-9eca-4550-83d3-b6b731198a65 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:34.935017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a71122-9eca-4550-83d3-b6b731198a65 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:34.935642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a71122-9eca-4550-83d3-b6b731198a65 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:35.005281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:49:35.018491 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-76a71122-9eca-4550-83d3-b6b731198a65 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "POST /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41/action" status: 202 len: 0 microversion: 2.1 time: 0.110650 Oct 24 10:49:35.020246 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2561/5087] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:49:34 2022] POST /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:49:35.028785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5bcf00f0-047b-4b42-95fc-567aad44f92b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:35.030536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5bcf00f0-047b-4b42-95fc-567aad44f92b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:35.038975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bcf00f0-047b-4b42-95fc-567aad44f92b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:35.039867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bcf00f0-047b-4b42-95fc-567aad44f92b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:35.040633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bcf00f0-047b-4b42-95fc-567aad44f92b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:35.041784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bcf00f0-047b-4b42-95fc-567aad44f92b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:35.042589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bcf00f0-047b-4b42-95fc-567aad44f92b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:35.043539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bcf00f0-047b-4b42-95fc-567aad44f92b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:35.255928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-67304299-27fb-489b-8bbb-e39b8224d864 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:35.256874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-67304299-27fb-489b-8bbb-e39b8224d864 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:35.274447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-67304299-27fb-489b-8bbb-e39b8224d864 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:35.275025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-67304299-27fb-489b-8bbb-e39b8224d864 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:35.275615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-67304299-27fb-489b-8bbb-e39b8224d864 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:35.276466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-67304299-27fb-489b-8bbb-e39b8224d864 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:35.276945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-67304299-27fb-489b-8bbb-e39b8224d864 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:35.277381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-67304299-27fb-489b-8bbb-e39b8224d864 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:35.295160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5bcf00f0-047b-4b42-95fc-567aad44f92b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:35.298358 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-67304299-27fb-489b-8bbb-e39b8224d864 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] HTTP exception thrown: Instance 161edb66-41db-4070-8b7b-81c318cde03a could not be found. Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-67304299-27fb-489b-8bbb-e39b8224d864 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Request method failure captured: Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a HTTP/1.1 Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmxGEf8mF42THT3h9fVPjViIC0vxXev9PDg9QG-1yIrdQc4XuWxkeckaiL1UG9W7evBgJwyTY2CMWgNyjCetvBLyQA0df24aJxSn1VeaDSE7OuAPqW65H3YqPVpe_ZHcqqNHqoCfgTDVJOA9iP5HY1LaTgt2RYe4CG8s3GjW0HDUrzM Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: c43199c732c141d893e52e2bb1c751e2 Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestServerBasicOps-1579171212 Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c43199c732c141d893e52e2bb1c751e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c43199c732c141d893e52e2bb1c751e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c43199c732c141d893e52e2bb1c751e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c43199c732c141d893e52e2bb1c751e2", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestServerBasicOps-1579171212 Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: c43199c732c141d893e52e2bb1c751e2 Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestServerBasicOps-1579171212 Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestServerBasicOps-1579171212-project Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: d4107e4d2df9455d9ec35a2bee1eacc8 Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestServerBasicOps-1579171212-project Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 161edb66-41db-4070-8b7b-81c318cde03a could not be found. Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '161edb66-41db-4070-8b7b-81c318cde03a'} Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 161edb66-41db-4070-8b7b-81c318cde03a could not be found. Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:49:35.300271 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:49:35.305831 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 161edb66-41db-4070-8b7b-81c318cde03a could not be found. Oct 24 10:49:35.305831 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:35.305831 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:49:35.305831 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:35.305831 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:35.305831 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:49:35.305831 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:49:35.305831 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:49:35.305831 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:49:35.305831 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 161edb66-41db-4070-8b7b-81c318cde03a could not be found. Oct 24 10:49:35.305831 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:35.305831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-67304299-27fb-489b-8bbb-e39b8224d864 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Returning 404 to user: Instance 161edb66-41db-4070-8b7b-81c318cde03a could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:49:35.305831 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-67304299-27fb-489b-8bbb-e39b8224d864 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "DELETE /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 404 len: 111 microversion: 2.1 time: 0.051422 Oct 24 10:49:35.305831 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2562/5088] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:49:35 2022] DELETE /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:49:35.314895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-81520fb3-7b47-46ba-a5ec-840334dde373 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:35.315737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-81520fb3-7b47-46ba-a5ec-840334dde373 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] [instance: 161edb66-41db-4070-8b7b-81c318cde03a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:35.315894 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5bcf00f0-047b-4b42-95fc-567aad44f92b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1520 microversion: 2.1 time: 0.290803 Oct 24 10:49:35.317046 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2527/5089] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:35 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:49:35.322322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81520fb3-7b47-46ba-a5ec-840334dde373 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:35.322752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81520fb3-7b47-46ba-a5ec-840334dde373 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:35.323188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81520fb3-7b47-46ba-a5ec-840334dde373 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:35.323883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81520fb3-7b47-46ba-a5ec-840334dde373 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:35.324338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81520fb3-7b47-46ba-a5ec-840334dde373 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:35.324768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81520fb3-7b47-46ba-a5ec-840334dde373 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:35.355889 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-81520fb3-7b47-46ba-a5ec-840334dde373 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] HTTP exception thrown: Instance 161edb66-41db-4070-8b7b-81c318cde03a could not be found. Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-81520fb3-7b47-46ba-a5ec-840334dde373 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Request method failure captured: Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a HTTP/1.1 Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmxGEf8mF42THT3h9fVPjViIC0vxXev9PDg9QG-1yIrdQc4XuWxkeckaiL1UG9W7evBgJwyTY2CMWgNyjCetvBLyQA0df24aJxSn1VeaDSE7OuAPqW65H3YqPVpe_ZHcqqNHqoCfgTDVJOA9iP5HY1LaTgt2RYe4CG8s3GjW0HDUrzM Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: c43199c732c141d893e52e2bb1c751e2 Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestServerBasicOps-1579171212 Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c43199c732c141d893e52e2bb1c751e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c43199c732c141d893e52e2bb1c751e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c43199c732c141d893e52e2bb1c751e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c43199c732c141d893e52e2bb1c751e2", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestServerBasicOps-1579171212 Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: c43199c732c141d893e52e2bb1c751e2 Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestServerBasicOps-1579171212 Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestServerBasicOps-1579171212-project Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: d4107e4d2df9455d9ec35a2bee1eacc8 Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestServerBasicOps-1579171212-project Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 161edb66-41db-4070-8b7b-81c318cde03a could not be found. Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '161edb66-41db-4070-8b7b-81c318cde03a'} Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 161edb66-41db-4070-8b7b-81c318cde03a could not be found. Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 161edb66-41db-4070-8b7b-81c318cde03a could not be found. Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:49:35.357604 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:35.363801 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:35.363801 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:49:35.363801 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:49:35.363801 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:49:35.363801 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:49:35.363801 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 161edb66-41db-4070-8b7b-81c318cde03a could not be found. Oct 24 10:49:35.363801 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:35.363801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-81520fb3-7b47-46ba-a5ec-840334dde373 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Returning 404 to user: Instance 161edb66-41db-4070-8b7b-81c318cde03a could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:49:35.363801 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-81520fb3-7b47-46ba-a5ec-840334dde373 tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a" status: 404 len: 111 microversion: 2.1 time: 0.050318 Oct 24 10:49:35.363801 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2563/5090] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:35 2022] GET /compute/v2.1/servers/161edb66-41db-4070-8b7b-81c318cde03a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:49:35.551814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4bfff7e6-2c99-422f-b6d1-de4b4c5d64ff tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] Calling method '.version_select at 0x7f04cb943790>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:35.592117 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4bfff7e6-2c99-422f-b6d1-de4b4c5d64ff tempest-TestServerBasicOps-1579171212 tempest-TestServerBasicOps-1579171212-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1959546707" status: 202 len: 0 microversion: 2.1 time: 0.046641 Oct 24 10:49:35.593326 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2528/5091] 10.222.0.50 () {58 vars in 1254 bytes} [Mon Oct 24 10:49:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1959546707 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:49:36.339614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bc7d3bbc-79df-403c-aa86-753eb6d16836 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:36.340344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bc7d3bbc-79df-403c-aa86-753eb6d16836 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:36.348872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc7d3bbc-79df-403c-aa86-753eb6d16836 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:36.349719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc7d3bbc-79df-403c-aa86-753eb6d16836 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:36.350322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc7d3bbc-79df-403c-aa86-753eb6d16836 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:36.351225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc7d3bbc-79df-403c-aa86-753eb6d16836 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:36.351861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc7d3bbc-79df-403c-aa86-753eb6d16836 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:36.352772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc7d3bbc-79df-403c-aa86-753eb6d16836 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:36.516311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bc7d3bbc-79df-403c-aa86-753eb6d16836 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:36.527618 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bc7d3bbc-79df-403c-aa86-753eb6d16836 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1500 microversion: 2.1 time: 0.191346 Oct 24 10:49:36.528805 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2564/5092] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:36 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1500 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:36.554614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-84ae059c-e8f5-48c0-b884-efdfa39f796a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:49:36.558253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-84ae059c-e8f5-48c0-b884-efdfa39f796a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:36.562269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:49:36.568470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84ae059c-e8f5-48c0-b884-efdfa39f796a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:36.569284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84ae059c-e8f5-48c0-b884-efdfa39f796a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:36.569915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84ae059c-e8f5-48c0-b884-efdfa39f796a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:36.570873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84ae059c-e8f5-48c0-b884-efdfa39f796a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:36.571509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84ae059c-e8f5-48c0-b884-efdfa39f796a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:36.572117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84ae059c-e8f5-48c0-b884-efdfa39f796a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:36.604020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-84ae059c-e8f5-48c0-b884-efdfa39f796a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lazy-loading 'flavor' on Instance uuid 305c8bd9-3fdb-48da-920e-13613f65ec41 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:49:36.622243 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-84ae059c-e8f5-48c0-b884-efdfa39f796a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] HTTP exception thrown: Cannot 'rescue' instance 305c8bd9-3fdb-48da-920e-13613f65ec41 while it is in vm_state paused Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-84ae059c-e8f5-48c0-b884-efdfa39f796a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Request method failure captured: Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41/action HTTP/1.1 Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 14 Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm1_YpcUoTx6EtuRJqEim52THa9nHc93ggv-rCTsxHF8KCdRzu0B50Tb2gQcOKEkZzR8bjwxbVU1lCLt9l9Nlkw5MZDlojxwV2MAHZbN_UcYOzact8aaTN_ICS6JQcw4OPHcT53rEwR6K2uYrfqZ498tDq4tCZjBExjOK6wvBxhiRXQ Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 0ae874e076c34c44adb00f85aebd000e Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ae874e076c34c44adb00f85aebd000e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 0ae874e076c34c44adb00f85aebd000e Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerRescueNegativeTestJSON-615921797-project Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6da7534777ef4425aefa81bc7e49b69f Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-615921797-project Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: {"rescue": {}} Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: exception: Cannot 'rescue' instance 305c8bd9-3fdb-48da-920e-13613f65ec41 while it is in vm_state paused Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '305c8bd9-3fdb-48da-920e-13613f65ec41', 'body': {'rescue': {}}} Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 305c8bd9-3fdb-48da-920e-13613f65ec41 in vm_state paused. Cannot rescue while the instance is in this state. Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 305c8bd9-3fdb-48da-920e-13613f65ec41 while it is in vm_state paused Oct 24 10:49:36.624779 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:49:36.629511 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:49:36.629511 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:49:36.629511 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:36.629511 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:49:36.629511 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:49:36.629511 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:49:36.629511 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:49:36.629511 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 305c8bd9-3fdb-48da-920e-13613f65ec41 while it is in vm_state paused Oct 24 10:49:36.629511 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:49:36.629511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-84ae059c-e8f5-48c0-b884-efdfa39f796a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Returning 409 to user: Cannot 'rescue' instance 305c8bd9-3fdb-48da-920e-13613f65ec41 while it is in vm_state paused {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:49:36.629511 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-84ae059c-e8f5-48c0-b884-efdfa39f796a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "POST /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41/action" status: 409 len: 144 microversion: 2.1 time: 0.076634 Oct 24 10:49:36.637813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cd9191ac-ea5c-4882-97e0-082fb53e251b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:49:36.637813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cd9191ac-ea5c-4882-97e0-082fb53e251b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:36.641339 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2529/5093] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:49:36 2022] POST /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41/action => generated 144 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:49:36.644594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd9191ac-ea5c-4882-97e0-082fb53e251b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:36.645118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd9191ac-ea5c-4882-97e0-082fb53e251b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:36.645558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd9191ac-ea5c-4882-97e0-082fb53e251b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:36.646455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd9191ac-ea5c-4882-97e0-082fb53e251b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:36.646945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd9191ac-ea5c-4882-97e0-082fb53e251b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:36.647382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd9191ac-ea5c-4882-97e0-082fb53e251b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:36.767437 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cd9191ac-ea5c-4882-97e0-082fb53e251b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "POST /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41/action" status: 202 len: 0 microversion: 2.1 time: 0.135097 Oct 24 10:49:36.768090 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2565/5094] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:49:36 2022] POST /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:49:36.781810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-45ba3ba6-e0a3-403f-9b46-aa21e4bd1dda tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:36.785506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-45ba3ba6-e0a3-403f-9b46-aa21e4bd1dda tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:36.801233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45ba3ba6-e0a3-403f-9b46-aa21e4bd1dda tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:36.802609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45ba3ba6-e0a3-403f-9b46-aa21e4bd1dda tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:36.804163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45ba3ba6-e0a3-403f-9b46-aa21e4bd1dda tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:36.806415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45ba3ba6-e0a3-403f-9b46-aa21e4bd1dda tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:36.808222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45ba3ba6-e0a3-403f-9b46-aa21e4bd1dda tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:36.809330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45ba3ba6-e0a3-403f-9b46-aa21e4bd1dda tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:37.019987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-45ba3ba6-e0a3-403f-9b46-aa21e4bd1dda tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:37.030805 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-45ba3ba6-e0a3-403f-9b46-aa21e4bd1dda tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1507 microversion: 2.1 time: 0.255690 Oct 24 10:49:37.031772 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2530/5095] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:36 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:38.063567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cca20ad4-ce66-4375-ae63-6969a501804f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:38.065152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cca20ad4-ce66-4375-ae63-6969a501804f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:38.076459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cca20ad4-ce66-4375-ae63-6969a501804f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:38.077348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cca20ad4-ce66-4375-ae63-6969a501804f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:38.078043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cca20ad4-ce66-4375-ae63-6969a501804f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:38.079793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cca20ad4-ce66-4375-ae63-6969a501804f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:38.086239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cca20ad4-ce66-4375-ae63-6969a501804f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:38.087067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cca20ad4-ce66-4375-ae63-6969a501804f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:38.608142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cca20ad4-ce66-4375-ae63-6969a501804f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:38.619344 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cca20ad4-ce66-4375-ae63-6969a501804f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1515 microversion: 2.1 time: 0.565999 Oct 24 10:49:38.619931 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2566/5096] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:38 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1515 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:41.427610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-add8ba70-1bd8-485a-92b7-0f6b748c10ae tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:49:41.431704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-add8ba70-1bd8-485a-92b7-0f6b748c10ae tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:41.460228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-add8ba70-1bd8-485a-92b7-0f6b748c10ae tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:41.465112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-add8ba70-1bd8-485a-92b7-0f6b748c10ae tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:41.466806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-add8ba70-1bd8-485a-92b7-0f6b748c10ae tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:41.473148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-add8ba70-1bd8-485a-92b7-0f6b748c10ae tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:41.476525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-add8ba70-1bd8-485a-92b7-0f6b748c10ae tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:41.478194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-add8ba70-1bd8-485a-92b7-0f6b748c10ae tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:41.543585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-add8ba70-1bd8-485a-92b7-0f6b748c10ae tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lazy-loading 'flavor' on Instance uuid 305c8bd9-3fdb-48da-920e-13613f65ec41 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:49:41.722786 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-add8ba70-1bd8-485a-92b7-0f6b748c10ae tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "POST /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41/action" status: 200 len: 32 microversion: 2.1 time: 0.300449 Oct 24 10:49:41.723837 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2531/5097] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:49:41 2022] POST /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41/action => generated 32 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:49:41.734160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aca32faa-8f4f-4ad6-a8ae-6b4ec3857f74 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:41.735557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aca32faa-8f4f-4ad6-a8ae-6b4ec3857f74 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:41.743087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aca32faa-8f4f-4ad6-a8ae-6b4ec3857f74 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:41.745429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aca32faa-8f4f-4ad6-a8ae-6b4ec3857f74 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:41.746762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aca32faa-8f4f-4ad6-a8ae-6b4ec3857f74 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:41.747582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aca32faa-8f4f-4ad6-a8ae-6b4ec3857f74 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:41.748054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aca32faa-8f4f-4ad6-a8ae-6b4ec3857f74 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:41.750690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aca32faa-8f4f-4ad6-a8ae-6b4ec3857f74 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:42.032288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aca32faa-8f4f-4ad6-a8ae-6b4ec3857f74 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:42.045788 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aca32faa-8f4f-4ad6-a8ae-6b4ec3857f74 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1521 microversion: 2.1 time: 0.315889 Oct 24 10:49:42.050341 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2567/5098] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:41 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:43.075186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6aeb4fa3-777c-4f1d-b29d-180c178f06c1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:43.075883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6aeb4fa3-777c-4f1d-b29d-180c178f06c1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:43.088656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aeb4fa3-777c-4f1d-b29d-180c178f06c1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:43.101285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aeb4fa3-777c-4f1d-b29d-180c178f06c1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:43.102066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aeb4fa3-777c-4f1d-b29d-180c178f06c1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:43.102821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aeb4fa3-777c-4f1d-b29d-180c178f06c1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:43.103476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aeb4fa3-777c-4f1d-b29d-180c178f06c1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:43.104073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aeb4fa3-777c-4f1d-b29d-180c178f06c1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:43.533105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6aeb4fa3-777c-4f1d-b29d-180c178f06c1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:43.678761 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6aeb4fa3-777c-4f1d-b29d-180c178f06c1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1521 microversion: 2.1 time: 0.604099 Oct 24 10:49:43.687895 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2532/5099] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:43 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1521 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:44.167299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6c7d2910-e5ab-4ded-a7ca-e28b9fb86e51 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'create', calling method: .version_select at 0x7f04cb78f3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1260423236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtTQLZLS7AIRrowOtA3eiuYIUqymTaQv0CuNBTUhijyxrMxYzWMZbEeZ4lRs5q2DqZGzlo8DB7muGzhb0k3qQBnXNEptxOyVnF26b/o/P1Flb3wzFvHLZuJUVKEW3W/ZA=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:49:44.219123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-6c7d2910-e5ab-4ded-a7ca-e28b9fb86e51 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Getting quotas for project 45405624633e404ab2d6ff26482a150e. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:49:44.231444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-6c7d2910-e5ab-4ded-a7ca-e28b9fb86e51 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Getting quotas for user cdae8836f9784dff90fea5201fd15d1d and project 45405624633e404ab2d6ff26482a150e. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:49:44.297303 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6c7d2910-e5ab-4ded-a7ca-e28b9fb86e51 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.444268 Oct 24 10:49:44.298251 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2568/5100] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:49:43 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:49:44.707601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7228c5bd-97fc-49c0-8d98-a6cc9dd68efd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:44.708898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7228c5bd-97fc-49c0-8d98-a6cc9dd68efd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:44.731906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7228c5bd-97fc-49c0-8d98-a6cc9dd68efd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:44.732457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7228c5bd-97fc-49c0-8d98-a6cc9dd68efd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:44.734293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7228c5bd-97fc-49c0-8d98-a6cc9dd68efd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:44.740671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7228c5bd-97fc-49c0-8d98-a6cc9dd68efd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:44.741660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7228c5bd-97fc-49c0-8d98-a6cc9dd68efd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:44.744160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7228c5bd-97fc-49c0-8d98-a6cc9dd68efd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:45.121954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7228c5bd-97fc-49c0-8d98-a6cc9dd68efd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:45.131728 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7228c5bd-97fc-49c0-8d98-a6cc9dd68efd tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1521 microversion: 2.1 time: 0.432741 Oct 24 10:49:45.136150 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2533/5101] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:44 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1521 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:46.183674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-655ee4fe-c10d-4285-8a1d-1ff6fbdeb593 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:46.193334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-655ee4fe-c10d-4285-8a1d-1ff6fbdeb593 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:46.213841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-655ee4fe-c10d-4285-8a1d-1ff6fbdeb593 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:46.215002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-655ee4fe-c10d-4285-8a1d-1ff6fbdeb593 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:46.215766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-655ee4fe-c10d-4285-8a1d-1ff6fbdeb593 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:46.217014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-655ee4fe-c10d-4285-8a1d-1ff6fbdeb593 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:46.219476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-655ee4fe-c10d-4285-8a1d-1ff6fbdeb593 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:46.221225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-655ee4fe-c10d-4285-8a1d-1ff6fbdeb593 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:46.565259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-655ee4fe-c10d-4285-8a1d-1ff6fbdeb593 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:46.577722 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-655ee4fe-c10d-4285-8a1d-1ff6fbdeb593 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1521 microversion: 2.1 time: 0.414633 Oct 24 10:49:46.578493 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2569/5102] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:46 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:47.160592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-60e2d2ed-f082-4683-b020-3a830241a42f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:47.161246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-60e2d2ed-f082-4683-b020-3a830241a42f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:47.177782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60e2d2ed-f082-4683-b020-3a830241a42f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:47.178438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60e2d2ed-f082-4683-b020-3a830241a42f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:47.179462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60e2d2ed-f082-4683-b020-3a830241a42f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:47.181400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60e2d2ed-f082-4683-b020-3a830241a42f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:47.184183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60e2d2ed-f082-4683-b020-3a830241a42f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:47.185864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60e2d2ed-f082-4683-b020-3a830241a42f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:47.250838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-60e2d2ed-f082-4683-b020-3a830241a42f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:49:47.301305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:49:47.396486 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-60e2d2ed-f082-4683-b020-3a830241a42f tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 204 len: 0 microversion: 2.42 time: 0.823807 Oct 24 10:49:47.399051 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2534/5103] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:49:46 2022] DELETE /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:49:47.407684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5093e2ac-1876-40c1-b8f9-ee0a8026ea2a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:47.409047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5093e2ac-1876-40c1-b8f9-ee0a8026ea2a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:47.438478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5093e2ac-1876-40c1-b8f9-ee0a8026ea2a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:47.439710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5093e2ac-1876-40c1-b8f9-ee0a8026ea2a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:47.440870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5093e2ac-1876-40c1-b8f9-ee0a8026ea2a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:47.442773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5093e2ac-1876-40c1-b8f9-ee0a8026ea2a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:47.446491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5093e2ac-1876-40c1-b8f9-ee0a8026ea2a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:47.448143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5093e2ac-1876-40c1-b8f9-ee0a8026ea2a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:47.617016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8ac7cf0a-3139-4317-8d00-a424c2045bcb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:47.619850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8ac7cf0a-3139-4317-8d00-a424c2045bcb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:47.631680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ac7cf0a-3139-4317-8d00-a424c2045bcb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:47.632563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ac7cf0a-3139-4317-8d00-a424c2045bcb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:47.633251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ac7cf0a-3139-4317-8d00-a424c2045bcb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:47.634144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ac7cf0a-3139-4317-8d00-a424c2045bcb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:47.644070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ac7cf0a-3139-4317-8d00-a424c2045bcb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:47.648868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8ac7cf0a-3139-4317-8d00-a424c2045bcb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:47.984628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5093e2ac-1876-40c1-b8f9-ee0a8026ea2a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:48.000102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5093e2ac-1876-40c1-b8f9-ee0a8026ea2a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:48.004470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5093e2ac-1876-40c1-b8f9-ee0a8026ea2a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:48.007973 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5093e2ac-1876-40c1-b8f9-ee0a8026ea2a tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 2964 microversion: 2.42 time: 0.604499 Oct 24 10:49:48.010159 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2570/5104] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:47 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 2964 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:49:48.112035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8ac7cf0a-3139-4317-8d00-a424c2045bcb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:48.130226 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8ac7cf0a-3139-4317-8d00-a424c2045bcb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1521 microversion: 2.1 time: 0.527398 Oct 24 10:49:48.135642 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2535/5105] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:47 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:49.038863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-69e8258e-6993-4fed-9fdd-4b2f3ef100e9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:49.039568 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-69e8258e-6993-4fed-9fdd-4b2f3ef100e9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:49.048371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69e8258e-6993-4fed-9fdd-4b2f3ef100e9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:49.049237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69e8258e-6993-4fed-9fdd-4b2f3ef100e9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:49.050135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69e8258e-6993-4fed-9fdd-4b2f3ef100e9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:49.051070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69e8258e-6993-4fed-9fdd-4b2f3ef100e9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:49.051764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69e8258e-6993-4fed-9fdd-4b2f3ef100e9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:49.052410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69e8258e-6993-4fed-9fdd-4b2f3ef100e9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:49.158251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b55d483f-6aff-45d4-8417-0cb238f43f4d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:49.158976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b55d483f-6aff-45d4-8417-0cb238f43f4d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:49.166857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b55d483f-6aff-45d4-8417-0cb238f43f4d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:49.167353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b55d483f-6aff-45d4-8417-0cb238f43f4d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:49.167793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b55d483f-6aff-45d4-8417-0cb238f43f4d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:49.171050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b55d483f-6aff-45d4-8417-0cb238f43f4d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:49.174483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b55d483f-6aff-45d4-8417-0cb238f43f4d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:49.175597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b55d483f-6aff-45d4-8417-0cb238f43f4d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:49.603630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b55d483f-6aff-45d4-8417-0cb238f43f4d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:49.630388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-69e8258e-6993-4fed-9fdd-4b2f3ef100e9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:49.632145 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b55d483f-6aff-45d4-8417-0cb238f43f4d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1521 microversion: 2.1 time: 0.478920 Oct 24 10:49:49.633310 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2536/5106] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:49 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1521 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:49.653980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-69e8258e-6993-4fed-9fdd-4b2f3ef100e9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:49.653980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-69e8258e-6993-4fed-9fdd-4b2f3ef100e9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:49.653980 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-69e8258e-6993-4fed-9fdd-4b2f3ef100e9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 2964 microversion: 2.42 time: 0.613409 Oct 24 10:49:49.656297 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2571/5107] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:49 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 2964 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:50.543102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9d18020-7750-4a6a-ae86-dfa92b21ed9d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:50.546772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f9d18020-7750-4a6a-ae86-dfa92b21ed9d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:50.556806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9d18020-7750-4a6a-ae86-dfa92b21ed9d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:50.557499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9d18020-7750-4a6a-ae86-dfa92b21ed9d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:50.558395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9d18020-7750-4a6a-ae86-dfa92b21ed9d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:50.559342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9d18020-7750-4a6a-ae86-dfa92b21ed9d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:50.559966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9d18020-7750-4a6a-ae86-dfa92b21ed9d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:50.561223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9d18020-7750-4a6a-ae86-dfa92b21ed9d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:50.596329 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f9d18020-7750-4a6a-ae86-dfa92b21ed9d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057935 Oct 24 10:49:50.596935 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2537/5108] 10.222.0.50 () {60 vars in 1343 bytes} [Mon Oct 24 10:49:50 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:50.668113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-87f3d439-c1ab-4be8-a614-bf95da168010 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:50.668113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-87f3d439-c1ab-4be8-a614-bf95da168010 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:50.674373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1cd233ea-3c68-449a-9bd7-ccf29f877e83 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:50.674996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1cd233ea-3c68-449a-9bd7-ccf29f877e83 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:50.678367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87f3d439-c1ab-4be8-a614-bf95da168010 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:50.679172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87f3d439-c1ab-4be8-a614-bf95da168010 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:50.679799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87f3d439-c1ab-4be8-a614-bf95da168010 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:50.682254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87f3d439-c1ab-4be8-a614-bf95da168010 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:50.683785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1cd233ea-3c68-449a-9bd7-ccf29f877e83 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:50.684382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1cd233ea-3c68-449a-9bd7-ccf29f877e83 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:50.684694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87f3d439-c1ab-4be8-a614-bf95da168010 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:50.685055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1cd233ea-3c68-449a-9bd7-ccf29f877e83 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:50.685882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1cd233ea-3c68-449a-9bd7-ccf29f877e83 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:50.686484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87f3d439-c1ab-4be8-a614-bf95da168010 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:50.687067 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1cd233ea-3c68-449a-9bd7-ccf29f877e83 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:50.687599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1cd233ea-3c68-449a-9bd7-ccf29f877e83 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:50.745548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1cd233ea-3c68-449a-9bd7-ccf29f877e83 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:49:50.953297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-87f3d439-c1ab-4be8-a614-bf95da168010 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:50.959315 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1cd233ea-3c68-449a-9bd7-ccf29f877e83 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 204 len: 0 microversion: 2.20 time: 0.288289 Oct 24 10:49:50.961624 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2538/5109] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:49:50 2022] DELETE /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 24 10:49:50.968729 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-87f3d439-c1ab-4be8-a614-bf95da168010 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1521 microversion: 2.1 time: 0.310521 Oct 24 10:49:50.972475 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2572/5110] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:50 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:50.975881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-921ee9b8-1049-4be0-b043-d01e0f6f711d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:50.979274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-921ee9b8-1049-4be0-b043-d01e0f6f711d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:50.988908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-875d8396-1f57-4154-bd00-0092a9f60a1d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:50.991075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-875d8396-1f57-4154-bd00-0092a9f60a1d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:50.997458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-921ee9b8-1049-4be0-b043-d01e0f6f711d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:50.997954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-921ee9b8-1049-4be0-b043-d01e0f6f711d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:50.998419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-921ee9b8-1049-4be0-b043-d01e0f6f711d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:51.002235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:49:51.003743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-921ee9b8-1049-4be0-b043-d01e0f6f711d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:51.004252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-921ee9b8-1049-4be0-b043-d01e0f6f711d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:51.004953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-921ee9b8-1049-4be0-b043-d01e0f6f711d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:51.009712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-875d8396-1f57-4154-bd00-0092a9f60a1d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:51.012749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-875d8396-1f57-4154-bd00-0092a9f60a1d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:51.013254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-875d8396-1f57-4154-bd00-0092a9f60a1d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:51.013998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-875d8396-1f57-4154-bd00-0092a9f60a1d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:51.015016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-875d8396-1f57-4154-bd00-0092a9f60a1d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:51.015449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-875d8396-1f57-4154-bd00-0092a9f60a1d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:51.325978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-875d8396-1f57-4154-bd00-0092a9f60a1d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:51.347198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-875d8396-1f57-4154-bd00-0092a9f60a1d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:51.353308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-875d8396-1f57-4154-bd00-0092a9f60a1d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:51.360562 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-875d8396-1f57-4154-bd00-0092a9f60a1d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1722 microversion: 2.20 time: 0.385254 Oct 24 10:49:51.361301 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2573/5111] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:50 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1722 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:51.579364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-921ee9b8-1049-4be0-b043-d01e0f6f711d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:51.602956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-921ee9b8-1049-4be0-b043-d01e0f6f711d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:51.610723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-921ee9b8-1049-4be0-b043-d01e0f6f711d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:51.613114 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-921ee9b8-1049-4be0-b043-d01e0f6f711d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 2964 microversion: 2.42 time: 0.649550 Oct 24 10:49:51.614206 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2539/5112] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:50 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 2964 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:51.998264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-71720dbd-a5e1-470c-8d24-ada5dacab276 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:51.999618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-71720dbd-a5e1-470c-8d24-ada5dacab276 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:52.015147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71720dbd-a5e1-470c-8d24-ada5dacab276 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:52.015943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71720dbd-a5e1-470c-8d24-ada5dacab276 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:52.016636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71720dbd-a5e1-470c-8d24-ada5dacab276 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:52.021235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71720dbd-a5e1-470c-8d24-ada5dacab276 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:52.022093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71720dbd-a5e1-470c-8d24-ada5dacab276 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:52.022877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71720dbd-a5e1-470c-8d24-ada5dacab276 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:52.319419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-71720dbd-a5e1-470c-8d24-ada5dacab276 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:52.331654 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-71720dbd-a5e1-470c-8d24-ada5dacab276 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1521 microversion: 2.1 time: 0.335657 Oct 24 10:49:52.333743 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2574/5113] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:51 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:52.391484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ce6d52e4-6726-4bfd-9515-bd5b0889efa6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:52.394699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ce6d52e4-6726-4bfd-9515-bd5b0889efa6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:52.401700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce6d52e4-6726-4bfd-9515-bd5b0889efa6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:52.402441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce6d52e4-6726-4bfd-9515-bd5b0889efa6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:52.403496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce6d52e4-6726-4bfd-9515-bd5b0889efa6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:52.405040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce6d52e4-6726-4bfd-9515-bd5b0889efa6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:52.405873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce6d52e4-6726-4bfd-9515-bd5b0889efa6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:52.406511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce6d52e4-6726-4bfd-9515-bd5b0889efa6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:52.645863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-84cec561-a1f1-40be-908b-019177ca6cd5 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:52.646487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-84cec561-a1f1-40be-908b-019177ca6cd5 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:52.656531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84cec561-a1f1-40be-908b-019177ca6cd5 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:52.665915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84cec561-a1f1-40be-908b-019177ca6cd5 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:52.671280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84cec561-a1f1-40be-908b-019177ca6cd5 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:52.672166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84cec561-a1f1-40be-908b-019177ca6cd5 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:52.672634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84cec561-a1f1-40be-908b-019177ca6cd5 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:52.679242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84cec561-a1f1-40be-908b-019177ca6cd5 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:52.691118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce6d52e4-6726-4bfd-9515-bd5b0889efa6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:52.718434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce6d52e4-6726-4bfd-9515-bd5b0889efa6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:52.726675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce6d52e4-6726-4bfd-9515-bd5b0889efa6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:52.731123 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ce6d52e4-6726-4bfd-9515-bd5b0889efa6 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1722 microversion: 2.20 time: 0.346143 Oct 24 10:49:52.732714 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2540/5114] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:52 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1722 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:53.032570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-84cec561-a1f1-40be-908b-019177ca6cd5 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:53.063776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-84cec561-a1f1-40be-908b-019177ca6cd5 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:53.068900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-84cec561-a1f1-40be-908b-019177ca6cd5 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:53.070479 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-84cec561-a1f1-40be-908b-019177ca6cd5 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 2964 microversion: 2.42 time: 0.428607 Oct 24 10:49:53.085094 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2575/5115] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:52 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 2964 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:49:53.363082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a3f8d416-0df8-44c7-9f43-10b4282a4c00 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:53.364140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a3f8d416-0df8-44c7-9f43-10b4282a4c00 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:53.376673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3f8d416-0df8-44c7-9f43-10b4282a4c00 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:53.378364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3f8d416-0df8-44c7-9f43-10b4282a4c00 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:53.378823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3f8d416-0df8-44c7-9f43-10b4282a4c00 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:53.379654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3f8d416-0df8-44c7-9f43-10b4282a4c00 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:53.380007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3f8d416-0df8-44c7-9f43-10b4282a4c00 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:53.380507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3f8d416-0df8-44c7-9f43-10b4282a4c00 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:53.602640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a3f8d416-0df8-44c7-9f43-10b4282a4c00 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:53.612552 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a3f8d416-0df8-44c7-9f43-10b4282a4c00 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1521 microversion: 2.1 time: 0.260011 Oct 24 10:49:53.613194 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2541/5116] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:53 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:53.763275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2b1cd15f-7dc2-4e2b-aad5-18b5dac840b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:53.764767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2b1cd15f-7dc2-4e2b-aad5-18b5dac840b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:53.775987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1cd15f-7dc2-4e2b-aad5-18b5dac840b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:53.776482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1cd15f-7dc2-4e2b-aad5-18b5dac840b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:53.779224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1cd15f-7dc2-4e2b-aad5-18b5dac840b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:53.780203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1cd15f-7dc2-4e2b-aad5-18b5dac840b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:53.780765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1cd15f-7dc2-4e2b-aad5-18b5dac840b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:53.784144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1cd15f-7dc2-4e2b-aad5-18b5dac840b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:54.003545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2b1cd15f-7dc2-4e2b-aad5-18b5dac840b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:54.020553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2b1cd15f-7dc2-4e2b-aad5-18b5dac840b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:54.025515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2b1cd15f-7dc2-4e2b-aad5-18b5dac840b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:54.028342 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2b1cd15f-7dc2-4e2b-aad5-18b5dac840b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1722 microversion: 2.20 time: 0.270293 Oct 24 10:49:54.034370 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2576/5117] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:53 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:54.103174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1ff75591-ccc9-4088-9d97-ca077a313979 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:54.103889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1ff75591-ccc9-4088-9d97-ca077a313979 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:54.112030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ff75591-ccc9-4088-9d97-ca077a313979 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:54.112531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ff75591-ccc9-4088-9d97-ca077a313979 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:54.113043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ff75591-ccc9-4088-9d97-ca077a313979 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:54.113746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ff75591-ccc9-4088-9d97-ca077a313979 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:54.114274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ff75591-ccc9-4088-9d97-ca077a313979 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:54.114682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ff75591-ccc9-4088-9d97-ca077a313979 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:54.550294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1ff75591-ccc9-4088-9d97-ca077a313979 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:54.567046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1ff75591-ccc9-4088-9d97-ca077a313979 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:54.574158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1ff75591-ccc9-4088-9d97-ca077a313979 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:54.578410 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1ff75591-ccc9-4088-9d97-ca077a313979 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 2964 microversion: 2.42 time: 0.479911 Oct 24 10:49:54.579010 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2542/5118] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:54 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 2964 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:54.614260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-b84f6d3e-f95a-4ee3-a87b-e726ac023f77 req-bd8d51eb-b8f6-4207-9f57-463561106c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-unplugged", "status": "completed", "tag": "f00b7439-3b57-4199-889a-94171e92eec2"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:49:54.622275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:49:54.651263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-adeede52-37e4-47c2-aade-0aee3b83e241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:54.651897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-adeede52-37e4-47c2-aade-0aee3b83e241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:54.660662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b84f6d3e-f95a-4ee3-a87b-e726ac023f77 req-bd8d51eb-b8f6-4207-9f57-463561106c14 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:54.661176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b84f6d3e-f95a-4ee3-a87b-e726ac023f77 req-bd8d51eb-b8f6-4207-9f57-463561106c14 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:54.661608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b84f6d3e-f95a-4ee3-a87b-e726ac023f77 req-bd8d51eb-b8f6-4207-9f57-463561106c14 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:54.663902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adeede52-37e4-47c2-aade-0aee3b83e241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:54.664600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adeede52-37e4-47c2-aade-0aee3b83e241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:54.666790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adeede52-37e4-47c2-aade-0aee3b83e241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:54.668571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adeede52-37e4-47c2-aade-0aee3b83e241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:54.672391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adeede52-37e4-47c2-aade-0aee3b83e241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:54.673155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adeede52-37e4-47c2-aade-0aee3b83e241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:54.700681 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-b84f6d3e-f95a-4ee3-a87b-e726ac023f77 req-bd8d51eb-b8f6-4207-9f57-463561106c14 service nova] Creating event network-vif-unplugged:f00b7439-3b57-4199-889a-94171e92eec2 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:49:54.719155 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-b84f6d3e-f95a-4ee3-a87b-e726ac023f77 req-bd8d51eb-b8f6-4207-9f57-463561106c14 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108772 Oct 24 10:49:54.724085 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2577/5119] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:49:54.977783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-adeede52-37e4-47c2-aade-0aee3b83e241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:54.994075 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-adeede52-37e4-47c2-aade-0aee3b83e241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1521 microversion: 2.1 time: 0.359731 Oct 24 10:49:54.994969 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2543/5120] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:54 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:55.060298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d624480d-2d49-4217-b674-662e4c4462b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:55.061757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d624480d-2d49-4217-b674-662e4c4462b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:55.070914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d624480d-2d49-4217-b674-662e4c4462b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:55.071911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d624480d-2d49-4217-b674-662e4c4462b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:55.072544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d624480d-2d49-4217-b674-662e4c4462b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:55.073459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d624480d-2d49-4217-b674-662e4c4462b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:55.074196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d624480d-2d49-4217-b674-662e4c4462b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:55.074794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d624480d-2d49-4217-b674-662e4c4462b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:55.559341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d624480d-2d49-4217-b674-662e4c4462b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:55.573970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d624480d-2d49-4217-b674-662e4c4462b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:55.575426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d624480d-2d49-4217-b674-662e4c4462b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:55.589134 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d624480d-2d49-4217-b674-662e4c4462b7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1722 microversion: 2.20 time: 0.521657 Oct 24 10:49:55.590045 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2578/5121] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:55 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1722 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:55.612793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1a56f442-badd-4b69-9700-2012ac6a40e6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:55.613472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1a56f442-badd-4b69-9700-2012ac6a40e6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:55.626380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a56f442-badd-4b69-9700-2012ac6a40e6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:55.627799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a56f442-badd-4b69-9700-2012ac6a40e6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:55.629032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a56f442-badd-4b69-9700-2012ac6a40e6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:55.631958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a56f442-badd-4b69-9700-2012ac6a40e6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:55.632479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a56f442-badd-4b69-9700-2012ac6a40e6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:55.634611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a56f442-badd-4b69-9700-2012ac6a40e6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:56.018611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1a56f442-badd-4b69-9700-2012ac6a40e6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:56.026409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6b90daa0-634a-4492-906c-d786a59c10c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:56.027941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6b90daa0-634a-4492-906c-d786a59c10c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:56.046429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b90daa0-634a-4492-906c-d786a59c10c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:56.048728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b90daa0-634a-4492-906c-d786a59c10c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:56.049319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b90daa0-634a-4492-906c-d786a59c10c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:56.049766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1a56f442-badd-4b69-9700-2012ac6a40e6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:56.052264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b90daa0-634a-4492-906c-d786a59c10c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:56.052763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b90daa0-634a-4492-906c-d786a59c10c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:56.054617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b90daa0-634a-4492-906c-d786a59c10c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:56.055138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1a56f442-badd-4b69-9700-2012ac6a40e6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:56.058707 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1a56f442-badd-4b69-9700-2012ac6a40e6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 2964 microversion: 2.42 time: 0.450213 Oct 24 10:49:56.077409 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2544/5122] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:55 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 2964 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:56.386554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6b90daa0-634a-4492-906c-d786a59c10c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:56.401184 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6b90daa0-634a-4492-906c-d786a59c10c2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1521 microversion: 2.1 time: 0.383072 Oct 24 10:49:56.404364 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2579/5123] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:56 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:49:56.624052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0654cb3-2496-4678-b892-81e8f04267d4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:56.624760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f0654cb3-2496-4678-b892-81e8f04267d4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:56.637878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0654cb3-2496-4678-b892-81e8f04267d4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:56.638376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0654cb3-2496-4678-b892-81e8f04267d4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:56.641500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0654cb3-2496-4678-b892-81e8f04267d4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:56.642278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0654cb3-2496-4678-b892-81e8f04267d4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:56.642796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0654cb3-2496-4678-b892-81e8f04267d4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:56.643416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0654cb3-2496-4678-b892-81e8f04267d4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:56.812674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-5ab5e5d9-9b8f-4ca0-bbb1-437233bf3612 req-70607bba-1413-4383-b648-b07ce0ac30cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-unplugged", "status": "completed", "tag": "adbcc1ad-fe50-4a59-b11c-492a2b5fc035"}, {"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-unplugged", "status": "completed", "tag": "fb2020ef-e5e3-481a-baca-ee8ad6e8058a"}, {"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-unplugged", "status": "completed", "tag": "cd46ad50-24e5-4e89-b061-174efa4e9061"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:49:56.835011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5ab5e5d9-9b8f-4ca0-bbb1-437233bf3612 req-70607bba-1413-4383-b648-b07ce0ac30cd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:56.836188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5ab5e5d9-9b8f-4ca0-bbb1-437233bf3612 req-70607bba-1413-4383-b648-b07ce0ac30cd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:56.836891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5ab5e5d9-9b8f-4ca0-bbb1-437233bf3612 req-70607bba-1413-4383-b648-b07ce0ac30cd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:56.839276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f0654cb3-2496-4678-b892-81e8f04267d4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:56.854092 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-5ab5e5d9-9b8f-4ca0-bbb1-437233bf3612 req-70607bba-1413-4383-b648-b07ce0ac30cd service nova] Creating event network-vif-unplugged:adbcc1ad-fe50-4a59-b11c-492a2b5fc035 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:49:56.854888 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-5ab5e5d9-9b8f-4ca0-bbb1-437233bf3612 req-70607bba-1413-4383-b648-b07ce0ac30cd service nova] Creating event network-vif-unplugged:fb2020ef-e5e3-481a-baca-ee8ad6e8058a for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:49:56.855639 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-5ab5e5d9-9b8f-4ca0-bbb1-437233bf3612 req-70607bba-1413-4383-b648-b07ce0ac30cd service nova] Creating event network-vif-unplugged:cd46ad50-24e5-4e89-b061-174efa4e9061 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:49:56.856825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f0654cb3-2496-4678-b892-81e8f04267d4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:56.862062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f0654cb3-2496-4678-b892-81e8f04267d4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:56.863644 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f0654cb3-2496-4678-b892-81e8f04267d4 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1655 microversion: 2.20 time: 0.245875 Oct 24 10:49:56.863986 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-5ab5e5d9-9b8f-4ca0-bbb1-437233bf3612 req-70607bba-1413-4383-b648-b07ce0ac30cd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.055915 Oct 24 10:49:56.865988 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2580/5124] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:49:56.867654 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2545/5125] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:56 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1655 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:57.098565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a048f9ad-1294-42ba-8262-13adf8d9a5cf tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:57.099902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a048f9ad-1294-42ba-8262-13adf8d9a5cf tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:57.111593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a048f9ad-1294-42ba-8262-13adf8d9a5cf tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:57.113694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a048f9ad-1294-42ba-8262-13adf8d9a5cf tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:57.114395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a048f9ad-1294-42ba-8262-13adf8d9a5cf tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:57.115807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a048f9ad-1294-42ba-8262-13adf8d9a5cf tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:57.136235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a048f9ad-1294-42ba-8262-13adf8d9a5cf tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:57.136717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a048f9ad-1294-42ba-8262-13adf8d9a5cf tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:57.153337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:49:57.424890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1a17ca29-b27c-425d-9757-8db9647eb429 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:57.425594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1a17ca29-b27c-425d-9757-8db9647eb429 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:57.436464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a17ca29-b27c-425d-9757-8db9647eb429 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:57.445433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a17ca29-b27c-425d-9757-8db9647eb429 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:57.446004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a17ca29-b27c-425d-9757-8db9647eb429 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:57.446844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a17ca29-b27c-425d-9757-8db9647eb429 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:57.449419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a17ca29-b27c-425d-9757-8db9647eb429 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:57.450075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a17ca29-b27c-425d-9757-8db9647eb429 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:57.527772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a048f9ad-1294-42ba-8262-13adf8d9a5cf tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:57.545946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a048f9ad-1294-42ba-8262-13adf8d9a5cf tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:57.550679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a048f9ad-1294-42ba-8262-13adf8d9a5cf tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:57.558243 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a048f9ad-1294-42ba-8262-13adf8d9a5cf tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 2943 microversion: 2.42 time: 0.466005 Oct 24 10:49:57.572618 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2581/5126] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:57 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 2943 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:57.759055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1a17ca29-b27c-425d-9757-8db9647eb429 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:57.782044 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1a17ca29-b27c-425d-9757-8db9647eb429 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1501 microversion: 2.1 time: 0.358944 Oct 24 10:49:57.784602 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2546/5127] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:57 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1501 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:57.810636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f2c2c6af-10d8-4632-af55-f6ed8ba49c78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b9d2269-f62c-4cb8-a28b-e118b3a03847"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:49:57.814586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f2c2c6af-10d8-4632-af55-f6ed8ba49c78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:57.822229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2c2c6af-10d8-4632-af55-f6ed8ba49c78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:57.822927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2c2c6af-10d8-4632-af55-f6ed8ba49c78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:57.823647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2c2c6af-10d8-4632-af55-f6ed8ba49c78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:57.824703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2c2c6af-10d8-4632-af55-f6ed8ba49c78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:57.825420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2c2c6af-10d8-4632-af55-f6ed8ba49c78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:57.826059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2c2c6af-10d8-4632-af55-f6ed8ba49c78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:57.875587 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-f2c2c6af-10d8-4632-af55-f6ed8ba49c78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] HTTP exception thrown: Cannot 'attach_volume' instance 305c8bd9-3fdb-48da-920e-13613f65ec41 while it is in vm_state rescued Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f2c2c6af-10d8-4632-af55-f6ed8ba49c78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Request method failure captured: Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41/os-volume_attachments HTTP/1.1 Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 74 Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm1_YpcUoTx6EtuRJqEim52THa9nHc93ggv-rCTsxHF8KCdRzu0B50Tb2gQcOKEkZzR8bjwxbVU1lCLt9l9Nlkw5MZDlojxwV2MAHZbN_UcYOzact8aaTN_ICS6JQcw4OPHcT53rEwR6K2uYrfqZ498tDq4tCZjBExjOK6wvBxhiRXQ Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 0ae874e076c34c44adb00f85aebd000e Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ae874e076c34c44adb00f85aebd000e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 0ae874e076c34c44adb00f85aebd000e Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerRescueNegativeTestJSON-615921797-project Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 6da7534777ef4425aefa81bc7e49b69f Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerRescueNegativeTestJSON-615921797-project Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: {"volumeAttachment": {"volumeId": "0b9d2269-f62c-4cb8-a28b-e118b3a03847"}} Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: exception: Cannot 'attach_volume' instance 305c8bd9-3fdb-48da-920e-13613f65ec41 while it is in vm_state rescued Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'server_id': '305c8bd9-3fdb-48da-920e-13613f65ec41', 'body': {'volumeAttachment': {'volumeId': '0b9d2269-f62c-4cb8-a28b-e118b3a03847'}}} Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 305c8bd9-3fdb-48da-920e-13613f65ec41 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 24 10:49:57.877637 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 10:49:57.883812 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 10:49:57.883812 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 10:49:57.883812 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 305c8bd9-3fdb-48da-920e-13613f65ec41 while it is in vm_state rescued Oct 24 10:49:57.883812 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:57.883812 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:49:57.883812 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:57.883812 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:57.883812 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:49:57.883812 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:49:57.883812 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:49:57.883812 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:49:57.883812 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 305c8bd9-3fdb-48da-920e-13613f65ec41 while it is in vm_state rescued Oct 24 10:49:57.883812 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:49:57.883812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f2c2c6af-10d8-4632-af55-f6ed8ba49c78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Returning 409 to user: Cannot 'attach_volume' instance 305c8bd9-3fdb-48da-920e-13613f65ec41 while it is in vm_state rescued {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:49:57.883812 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f2c2c6af-10d8-4632-af55-f6ed8ba49c78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "POST /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.073888 Oct 24 10:49:57.883812 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2582/5128] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 10:49:57 2022] POST /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41/os-volume_attachments => generated 152 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:49:57.892189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fb90a3d3-65bc-427c-9c0b-127fca418b30 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:49:57.892714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a69c01a6-ded9-41f4-b283-5b8bbe7f4dfd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:57.893194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a69c01a6-ded9-41f4-b283-5b8bbe7f4dfd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:57.893367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fb90a3d3-65bc-427c-9c0b-127fca418b30 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:57.900160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a69c01a6-ded9-41f4-b283-5b8bbe7f4dfd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:57.901221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a69c01a6-ded9-41f4-b283-5b8bbe7f4dfd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:57.901932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a69c01a6-ded9-41f4-b283-5b8bbe7f4dfd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:57.902954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a69c01a6-ded9-41f4-b283-5b8bbe7f4dfd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:57.903626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a69c01a6-ded9-41f4-b283-5b8bbe7f4dfd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:57.904263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a69c01a6-ded9-41f4-b283-5b8bbe7f4dfd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:57.908232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb90a3d3-65bc-427c-9c0b-127fca418b30 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:57.908889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb90a3d3-65bc-427c-9c0b-127fca418b30 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:57.909386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb90a3d3-65bc-427c-9c0b-127fca418b30 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:57.910178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb90a3d3-65bc-427c-9c0b-127fca418b30 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:57.910703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb90a3d3-65bc-427c-9c0b-127fca418b30 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:57.911440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb90a3d3-65bc-427c-9c0b-127fca418b30 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:58.014959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a69c01a6-ded9-41f4-b283-5b8bbe7f4dfd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:58.029044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:49:58.031444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a69c01a6-ded9-41f4-b283-5b8bbe7f4dfd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:58.032965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a69c01a6-ded9-41f4-b283-5b8bbe7f4dfd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf908b0f4e444157a0f28e84de8f8555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ae7eabe82421ca19e5cd59630e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:58.034175 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a69c01a6-ded9-41f4-b283-5b8bbe7f4dfd tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 200 len: 1655 microversion: 2.20 time: 0.146311 Oct 24 10:49:58.037123 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2583/5129] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:57 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 1655 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:49:58.043662 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fb90a3d3-65bc-427c-9c0b-127fca418b30 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "POST /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41/action" status: 202 len: 0 microversion: 2.1 time: 0.157463 Oct 24 10:49:58.046022 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2547/5130] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:49:57 2022] POST /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:49:58.063122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-108b4052-1f4d-4bac-a712-600698b72a2d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:58.063726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-108b4052-1f4d-4bac-a712-600698b72a2d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:58.076078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-108b4052-1f4d-4bac-a712-600698b72a2d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:58.077699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-108b4052-1f4d-4bac-a712-600698b72a2d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:58.081134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-108b4052-1f4d-4bac-a712-600698b72a2d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:58.082324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-108b4052-1f4d-4bac-a712-600698b72a2d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:58.084051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-108b4052-1f4d-4bac-a712-600698b72a2d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:58.085348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-108b4052-1f4d-4bac-a712-600698b72a2d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:58.267086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-72fbb309-3913-4e93-aa89-219fe982374d req-f7ea80d2-c543-42a7-b200-bc7ef45e5b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e357ce41-0ae9-4efa-973b-bc8920e4a0fa", "name": "network-vif-deleted", "tag": "ddf713d1-ef02-4308-b6ce-8ec89af0574f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:49:58.287209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-72fbb309-3913-4e93-aa89-219fe982374d req-f7ea80d2-c543-42a7-b200-bc7ef45e5b6b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:58.290013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-72fbb309-3913-4e93-aa89-219fe982374d req-f7ea80d2-c543-42a7-b200-bc7ef45e5b6b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:58.291501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-72fbb309-3913-4e93-aa89-219fe982374d req-f7ea80d2-c543-42a7-b200-bc7ef45e5b6b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:58.321426 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-72fbb309-3913-4e93-aa89-219fe982374d req-f7ea80d2-c543-42a7-b200-bc7ef45e5b6b service nova] Creating event network-vif-deleted:ddf713d1-ef02-4308-b6ce-8ec89af0574f for instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa on n-h2-858383-15 Oct 24 10:49:58.341268 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-72fbb309-3913-4e93-aa89-219fe982374d req-f7ea80d2-c543-42a7-b200-bc7ef45e5b6b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074830 Oct 24 10:49:58.344429 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2548/5131] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:49:58.352436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ffc57be5-2294-4169-96e9-81f0ac595a6d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1937377464", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "c144123e-b6b6-47c3-b8bb-82674567b5a7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1260423236", "security_groups": [{"name": "tempest-secgroup-smoke-1352772628"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:49:58.370318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-108b4052-1f4d-4bac-a712-600698b72a2d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:58.381875 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-108b4052-1f4d-4bac-a712-600698b72a2d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1509 microversion: 2.1 time: 0.331773 Oct 24 10:49:58.398107 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2584/5132] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:58 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1509 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:49:58.531926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-ffc57be5-2294-4169-96e9-81f0ac595a6d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] validate_networks() for [('c144123e-b6b6-47c3-b8bb-82674567b5a7', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:49:58.593262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c2983cae-cfd5-4cc5-9d8c-5624fd85f12e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:58.594551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c2983cae-cfd5-4cc5-9d8c-5624fd85f12e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:58.621486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2983cae-cfd5-4cc5-9d8c-5624fd85f12e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:58.622451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2983cae-cfd5-4cc5-9d8c-5624fd85f12e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:58.626067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2983cae-cfd5-4cc5-9d8c-5624fd85f12e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:58.628410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2983cae-cfd5-4cc5-9d8c-5624fd85f12e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:58.629161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2983cae-cfd5-4cc5-9d8c-5624fd85f12e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:58.632190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2983cae-cfd5-4cc5-9d8c-5624fd85f12e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:59.333938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c2983cae-cfd5-4cc5-9d8c-5624fd85f12e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:59.348709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c2983cae-cfd5-4cc5-9d8c-5624fd85f12e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:59.350224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c2983cae-cfd5-4cc5-9d8c-5624fd85f12e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:49:59.351538 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c2983cae-cfd5-4cc5-9d8c-5624fd85f12e tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 2943 microversion: 2.42 time: 0.763676 Oct 24 10:49:59.369322 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2585/5133] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:58 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 2943 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:49:59.549744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ffc57be5-2294-4169-96e9-81f0ac595a6d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:49:59.550282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ffc57be5-2294-4169-96e9-81f0ac595a6d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:49:59.550763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ffc57be5-2294-4169-96e9-81f0ac595a6d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:49:59.551285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ffc57be5-2294-4169-96e9-81f0ac595a6d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:49:59.551899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ffc57be5-2294-4169-96e9-81f0ac595a6d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:49:59.631887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffc57be5-2294-4169-96e9-81f0ac595a6d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:59.638489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffc57be5-2294-4169-96e9-81f0ac595a6d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:59.639115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffc57be5-2294-4169-96e9-81f0ac595a6d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:59.646246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffc57be5-2294-4169-96e9-81f0ac595a6d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:59.646649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffc57be5-2294-4169-96e9-81f0ac595a6d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:59.647108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ffc57be5-2294-4169-96e9-81f0ac595a6d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:59.726746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ffc57be5-2294-4169-96e9-81f0ac595a6d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Getting quotas for project 45405624633e404ab2d6ff26482a150e. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:49:59.736451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ffc57be5-2294-4169-96e9-81f0ac595a6d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Getting quotas for user cdae8836f9784dff90fea5201fd15d1d and project 45405624633e404ab2d6ff26482a150e. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:49:59.754564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ffc57be5-2294-4169-96e9-81f0ac595a6d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:49:59.757892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ffc57be5-2294-4169-96e9-81f0ac595a6d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:49:59.849516 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ffc57be5-2294-4169-96e9-81f0ac595a6d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.503480 Oct 24 10:49:59.850851 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2549/5134] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:49:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:49:59.859999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf3f70d2-1e57-49d3-8a85-08110b506ebc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:59.861679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bf3f70d2-1e57-49d3-8a85-08110b506ebc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:59.869969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf3f70d2-1e57-49d3-8a85-08110b506ebc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:59.870518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf3f70d2-1e57-49d3-8a85-08110b506ebc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:59.871439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf3f70d2-1e57-49d3-8a85-08110b506ebc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:59.872231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf3f70d2-1e57-49d3-8a85-08110b506ebc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:59.873137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf3f70d2-1e57-49d3-8a85-08110b506ebc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:59.874455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf3f70d2-1e57-49d3-8a85-08110b506ebc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:59.912454 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-bf3f70d2-1e57-49d3-8a85-08110b506ebc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] HTTP exception thrown: Instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa could not be found. Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf3f70d2-1e57-49d3-8a85-08110b506ebc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Request method failure captured: Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa HTTP/1.1 Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmwnIuIZc1Tl9vEr8TvLLys7k1HMZ9MNU5wcS8xr7Pjq3sY7xhdSzLmmStgcIifhS0zJ_xMtACHjHF4b6lSPIPEL5ZG3LD-qwNDqXAVcJD_3Tc8O3D8Upy8sI31CZQDVOh4vYSKX3MAZXUS3FFIRt6kwnnjzCE26xhLIH0I-kIWSvKY Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 886ae7eabe82421ca19e5cd59630e961 Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-860198550 Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/886ae7eabe82421ca19e5cd59630e961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/886ae7eabe82421ca19e5cd59630e961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/886ae7eabe82421ca19e5cd59630e961"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_886ae7eabe82421ca19e5cd59630e961", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeShelveTestJSON-860198550 Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 886ae7eabe82421ca19e5cd59630e961 Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-860198550 Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AttachVolumeShelveTestJSON-860198550-project Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: bf908b0f4e444157a0f28e84de8f8555 Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeShelveTestJSON-860198550-project Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa could not be found. Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'e357ce41-0ae9-4efa-973b-bc8920e4a0fa'} Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa could not be found. Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa could not be found. Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:49:59.915167 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:49:59.922365 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:49:59.922365 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:49:59.922365 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:49:59.922365 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:49:59.922365 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:49:59.922365 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:49:59.922365 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa could not be found. Oct 24 10:49:59.922365 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:49:59.922365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf3f70d2-1e57-49d3-8a85-08110b506ebc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Returning 404 to user: Instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:49:59.922365 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bf3f70d2-1e57-49d3-8a85-08110b506ebc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 404 len: 111 microversion: 2.20 time: 0.067524 Oct 24 10:49:59.923205 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2550/5135] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:49:59 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:49:59.960221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2b33708e-1c9e-4772-9e0b-2080d66e68d0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:49:59.963406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2b33708e-1c9e-4772-9e0b-2080d66e68d0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:49:59.980630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b33708e-1c9e-4772-9e0b-2080d66e68d0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:59.984367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b33708e-1c9e-4772-9e0b-2080d66e68d0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:59.987137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b33708e-1c9e-4772-9e0b-2080d66e68d0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:49:59.988389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b33708e-1c9e-4772-9e0b-2080d66e68d0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:49:59.992503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b33708e-1c9e-4772-9e0b-2080d66e68d0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:49:59.993267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b33708e-1c9e-4772-9e0b-2080d66e68d0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:00.039887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-f3ed69da-6046-4ef4-adb5-fd2e5f49c196 req-8a210c70-7d86-4049-b091-631fcfac40fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-unplugged", "status": "completed", "tag": "3e53a27e-13fd-4b03-87fb-f257a770ce85"}, {"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-unplugged", "status": "completed", "tag": "6edc1d11-d1ae-4161-a5c2-9e721c334352"}, {"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-unplugged", "status": "completed", "tag": "87b48d2c-81df-4477-a1f6-2e67350bc815"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:50:00.055257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f3ed69da-6046-4ef4-adb5-fd2e5f49c196 req-8a210c70-7d86-4049-b091-631fcfac40fc service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:00.056064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f3ed69da-6046-4ef4-adb5-fd2e5f49c196 req-8a210c70-7d86-4049-b091-631fcfac40fc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:00.056703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f3ed69da-6046-4ef4-adb5-fd2e5f49c196 req-8a210c70-7d86-4049-b091-631fcfac40fc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:00.077176 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f3ed69da-6046-4ef4-adb5-fd2e5f49c196 req-8a210c70-7d86-4049-b091-631fcfac40fc service nova] Creating event network-vif-unplugged:3e53a27e-13fd-4b03-87fb-f257a770ce85 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:50:00.079240 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f3ed69da-6046-4ef4-adb5-fd2e5f49c196 req-8a210c70-7d86-4049-b091-631fcfac40fc service nova] Creating event network-vif-unplugged:6edc1d11-d1ae-4161-a5c2-9e721c334352 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:50:00.080393 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f3ed69da-6046-4ef4-adb5-fd2e5f49c196 req-8a210c70-7d86-4049-b091-631fcfac40fc service nova] Creating event network-vif-unplugged:87b48d2c-81df-4477-a1f6-2e67350bc815 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:50:00.090391 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-f3ed69da-6046-4ef4-adb5-fd2e5f49c196 req-8a210c70-7d86-4049-b091-631fcfac40fc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.717986 Oct 24 10:50:00.093054 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2586/5136] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:50:00.107765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ee16d407-b04b-415f-a5c2-4afad0d0498f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:00.112981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ee16d407-b04b-415f-a5c2-4afad0d0498f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:00.318961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ee16d407-b04b-415f-a5c2-4afad0d0498f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:00.332472 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ee16d407-b04b-415f-a5c2-4afad0d0498f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1267 microversion: 2.1 time: 0.237915 Oct 24 10:50:00.336983 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2587/5137] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:00 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:00.349286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b77c98a4-ac16-4cb1-a1dc-bb32950af9bc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '.version_select at 0x7f04cb78f0d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:00.405062 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b77c98a4-ac16-4cb1-a1dc-bb32950af9bc tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-827608814" status: 204 len: 0 microversion: 2.20 time: 0.066531 Oct 24 10:50:00.406317 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2588/5138] 10.222.0.50 () {60 vars in 1259 bytes} [Mon Oct 24 10:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-827608814 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:50:00.434406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d0488104-aa72-4d3b-93ad-d2e2842f5031 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:00.435086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d0488104-aa72-4d3b-93ad-d2e2842f5031 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:00.473043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0488104-aa72-4d3b-93ad-d2e2842f5031 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:00.473575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0488104-aa72-4d3b-93ad-d2e2842f5031 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:00.476554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0488104-aa72-4d3b-93ad-d2e2842f5031 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:00.477364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0488104-aa72-4d3b-93ad-d2e2842f5031 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:00.482456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0488104-aa72-4d3b-93ad-d2e2842f5031 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:00.483472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0488104-aa72-4d3b-93ad-d2e2842f5031 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:00.568780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2b33708e-1c9e-4772-9e0b-2080d66e68d0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:00.610911 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2b33708e-1c9e-4772-9e0b-2080d66e68d0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1509 microversion: 2.1 time: 0.664405 Oct 24 10:50:00.613145 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2551/5139] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:49:59 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1509 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:01.368767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2fa148ca-2607-441f-913f-1c8486aeb7fc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:01.369619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2fa148ca-2607-441f-913f-1c8486aeb7fc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:02.072959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d0488104-aa72-4d3b-93ad-d2e2842f5031 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:02.088338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d0488104-aa72-4d3b-93ad-d2e2842f5031 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:02.100368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d0488104-aa72-4d3b-93ad-d2e2842f5031 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:02.104264 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d0488104-aa72-4d3b-93ad-d2e2842f5031 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 2922 microversion: 2.42 time: 1.694661 Oct 24 10:50:02.147147 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2589/5140] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:00 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 2922 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:02.160534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-292ea732-1aaf-45a1-bbd4-7fc39bcf70f8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:02.161207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-292ea732-1aaf-45a1-bbd4-7fc39bcf70f8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:02.191722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-292ea732-1aaf-45a1-bbd4-7fc39bcf70f8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:02.192160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-292ea732-1aaf-45a1-bbd4-7fc39bcf70f8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:02.192614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-292ea732-1aaf-45a1-bbd4-7fc39bcf70f8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:02.193380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-292ea732-1aaf-45a1-bbd4-7fc39bcf70f8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:02.193849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-292ea732-1aaf-45a1-bbd4-7fc39bcf70f8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:02.201298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2fa148ca-2607-441f-913f-1c8486aeb7fc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:02.209756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-292ea732-1aaf-45a1-bbd4-7fc39bcf70f8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:02.212506 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2fa148ca-2607-441f-913f-1c8486aeb7fc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1267 microversion: 2.1 time: 0.847105 Oct 24 10:50:02.214647 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2552/5141] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:01 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1267 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:02.230428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c58de679-727d-442e-b177-d21fef2a1abb req-0d49b6f0-7b1d-48c2-bd24-46c539dcac68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-deleted", "tag": "f00b7439-3b57-4199-889a-94171e92eec2"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:50:02.272179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c58de679-727d-442e-b177-d21fef2a1abb req-0d49b6f0-7b1d-48c2-bd24-46c539dcac68 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:02.272677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c58de679-727d-442e-b177-d21fef2a1abb req-0d49b6f0-7b1d-48c2-bd24-46c539dcac68 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:02.273152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c58de679-727d-442e-b177-d21fef2a1abb req-0d49b6f0-7b1d-48c2-bd24-46c539dcac68 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:02.294522 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c58de679-727d-442e-b177-d21fef2a1abb req-0d49b6f0-7b1d-48c2-bd24-46c539dcac68 service nova] Creating event network-vif-deleted:f00b7439-3b57-4199-889a-94171e92eec2 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:50:02.307019 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c58de679-727d-442e-b177-d21fef2a1abb req-0d49b6f0-7b1d-48c2-bd24-46c539dcac68 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090755 Oct 24 10:50:02.317704 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2553/5142] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:50:02.606826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-292ea732-1aaf-45a1-bbd4-7fc39bcf70f8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:02.616209 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-292ea732-1aaf-45a1-bbd4-7fc39bcf70f8 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1509 microversion: 2.1 time: 0.467646 Oct 24 10:50:02.621556 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2590/5143] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:02 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1509 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:03.180566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-686bfd8f-25f6-4b8e-8cec-5428540b473b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:03.182867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-686bfd8f-25f6-4b8e-8cec-5428540b473b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:03.200540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-686bfd8f-25f6-4b8e-8cec-5428540b473b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:03.201114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-686bfd8f-25f6-4b8e-8cec-5428540b473b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:03.202305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-686bfd8f-25f6-4b8e-8cec-5428540b473b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:03.206011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-686bfd8f-25f6-4b8e-8cec-5428540b473b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:03.215724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-686bfd8f-25f6-4b8e-8cec-5428540b473b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:03.216206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-686bfd8f-25f6-4b8e-8cec-5428540b473b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:03.242514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0d7b7348-834a-4d0c-89c3-788e8e6c7d88 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:03.243143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0d7b7348-834a-4d0c-89c3-788e8e6c7d88 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:03.263519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d7b7348-834a-4d0c-89c3-788e8e6c7d88 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:03.276436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d7b7348-834a-4d0c-89c3-788e8e6c7d88 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:03.277112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d7b7348-834a-4d0c-89c3-788e8e6c7d88 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:03.279532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d7b7348-834a-4d0c-89c3-788e8e6c7d88 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:03.287093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d7b7348-834a-4d0c-89c3-788e8e6c7d88 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:03.287561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d7b7348-834a-4d0c-89c3-788e8e6c7d88 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:03.697303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0d7b7348-834a-4d0c-89c3-788e8e6c7d88 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:03.711300 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0d7b7348-834a-4d0c-89c3-788e8e6c7d88 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1263 microversion: 2.1 time: 0.472847 Oct 24 10:50:03.727888 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2591/5144] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:03 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1263 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:03.727888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-68a8f3c3-db24-43c4-9563-f7c01d1e36af tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:03.727888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-68a8f3c3-db24-43c4-9563-f7c01d1e36af tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:03.739831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68a8f3c3-db24-43c4-9563-f7c01d1e36af tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:03.740342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68a8f3c3-db24-43c4-9563-f7c01d1e36af tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:03.740786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68a8f3c3-db24-43c4-9563-f7c01d1e36af tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:03.743910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68a8f3c3-db24-43c4-9563-f7c01d1e36af tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:03.745241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68a8f3c3-db24-43c4-9563-f7c01d1e36af tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:03.745694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68a8f3c3-db24-43c4-9563-f7c01d1e36af tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:04.009894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-686bfd8f-25f6-4b8e-8cec-5428540b473b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:04.025620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-686bfd8f-25f6-4b8e-8cec-5428540b473b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:04.027309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-686bfd8f-25f6-4b8e-8cec-5428540b473b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:04.032451 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-686bfd8f-25f6-4b8e-8cec-5428540b473b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 2714 microversion: 2.42 time: 0.886717 Oct 24 10:50:04.033587 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2554/5145] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:03 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 2714 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:04.035155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-68a8f3c3-db24-43c4-9563-f7c01d1e36af tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:04.044052 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-68a8f3c3-db24-43c4-9563-f7c01d1e36af tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1515 microversion: 2.1 time: 0.327951 Oct 24 10:50:04.063543 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2592/5146] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:03 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1515 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:04.466118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-50545ba9-a479-4ee1-b2b8-4c4444d1a77d req-432d76bb-cfa4-4dbd-9b8a-f29faf80c9bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-deleted", "tag": "fb2020ef-e5e3-481a-baca-ee8ad6e8058a"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:50:04.500510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-50545ba9-a479-4ee1-b2b8-4c4444d1a77d req-432d76bb-cfa4-4dbd-9b8a-f29faf80c9bd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:04.502037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-50545ba9-a479-4ee1-b2b8-4c4444d1a77d req-432d76bb-cfa4-4dbd-9b8a-f29faf80c9bd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:04.503662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-50545ba9-a479-4ee1-b2b8-4c4444d1a77d req-432d76bb-cfa4-4dbd-9b8a-f29faf80c9bd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:04.568338 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-50545ba9-a479-4ee1-b2b8-4c4444d1a77d req-432d76bb-cfa4-4dbd-9b8a-f29faf80c9bd service nova] Creating event network-vif-deleted:fb2020ef-e5e3-481a-baca-ee8ad6e8058a for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:50:04.598811 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-50545ba9-a479-4ee1-b2b8-4c4444d1a77d req-432d76bb-cfa4-4dbd-9b8a-f29faf80c9bd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136792 Oct 24 10:50:04.600308 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2555/5147] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:50:04.747363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e86cfcd4-9ab6-4b85-b135-d43cb62efd9f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:04.748199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e86cfcd4-9ab6-4b85-b135-d43cb62efd9f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:04.769490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e86cfcd4-9ab6-4b85-b135-d43cb62efd9f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:04.770285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e86cfcd4-9ab6-4b85-b135-d43cb62efd9f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:04.771875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e86cfcd4-9ab6-4b85-b135-d43cb62efd9f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:04.772827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e86cfcd4-9ab6-4b85-b135-d43cb62efd9f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:04.775124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e86cfcd4-9ab6-4b85-b135-d43cb62efd9f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:04.777703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e86cfcd4-9ab6-4b85-b135-d43cb62efd9f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:04.939071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e86cfcd4-9ab6-4b85-b135-d43cb62efd9f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:04.954889 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e86cfcd4-9ab6-4b85-b135-d43cb62efd9f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1325 microversion: 2.1 time: 0.214670 Oct 24 10:50:04.956967 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2593/5148] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:04 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1325 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:05.068350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be8536d8-c6ee-4cc0-91e0-a3a837ec742d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:05.069598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-be8536d8-c6ee-4cc0-91e0-a3a837ec742d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:05.082068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be8536d8-c6ee-4cc0-91e0-a3a837ec742d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:05.085936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be8536d8-c6ee-4cc0-91e0-a3a837ec742d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:05.090202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be8536d8-c6ee-4cc0-91e0-a3a837ec742d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:05.091298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be8536d8-c6ee-4cc0-91e0-a3a837ec742d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:05.091987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be8536d8-c6ee-4cc0-91e0-a3a837ec742d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:05.093889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be8536d8-c6ee-4cc0-91e0-a3a837ec742d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:05.489886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-be8536d8-c6ee-4cc0-91e0-a3a837ec742d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:05.505352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-be8536d8-c6ee-4cc0-91e0-a3a837ec742d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:05.507150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-be8536d8-c6ee-4cc0-91e0-a3a837ec742d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:05.509575 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-be8536d8-c6ee-4cc0-91e0-a3a837ec742d tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 2375 microversion: 2.42 time: 0.445861 Oct 24 10:50:05.510754 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2556/5149] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:05 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 2375 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:05.981082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6d4d3c5b-5bca-4f2f-945d-5a45e0630e8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:05.981995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6d4d3c5b-5bca-4f2f-945d-5a45e0630e8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:06.000223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d4d3c5b-5bca-4f2f-945d-5a45e0630e8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:06.001631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d4d3c5b-5bca-4f2f-945d-5a45e0630e8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:06.003864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d4d3c5b-5bca-4f2f-945d-5a45e0630e8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:06.005979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d4d3c5b-5bca-4f2f-945d-5a45e0630e8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:06.007912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d4d3c5b-5bca-4f2f-945d-5a45e0630e8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:06.008925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d4d3c5b-5bca-4f2f-945d-5a45e0630e8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:06.192854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6d4d3c5b-5bca-4f2f-945d-5a45e0630e8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:06.205958 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6d4d3c5b-5bca-4f2f-945d-5a45e0630e8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1325 microversion: 2.1 time: 0.229668 Oct 24 10:50:06.206880 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2594/5150] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:05 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1325 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:06.546245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c9d91a77-dab7-42c2-a7f7-e817fea41697 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:06.547069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c9d91a77-dab7-42c2-a7f7-e817fea41697 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:06.563118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9d91a77-dab7-42c2-a7f7-e817fea41697 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:06.563995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9d91a77-dab7-42c2-a7f7-e817fea41697 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:06.564892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9d91a77-dab7-42c2-a7f7-e817fea41697 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:06.573264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9d91a77-dab7-42c2-a7f7-e817fea41697 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:06.574139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9d91a77-dab7-42c2-a7f7-e817fea41697 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:06.575416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9d91a77-dab7-42c2-a7f7-e817fea41697 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:06.704973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-d4d72e61-62ee-483f-aebb-4e932874f53d req-bd3667ff-b831-4a38-bd00-1b139f87cb80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-deleted", "tag": "3e53a27e-13fd-4b03-87fb-f257a770ce85"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:50:06.738015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d4d72e61-62ee-483f-aebb-4e932874f53d req-bd3667ff-b831-4a38-bd00-1b139f87cb80 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:06.739847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d4d72e61-62ee-483f-aebb-4e932874f53d req-bd3667ff-b831-4a38-bd00-1b139f87cb80 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:06.745155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d4d72e61-62ee-483f-aebb-4e932874f53d req-bd3667ff-b831-4a38-bd00-1b139f87cb80 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:06.781371 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-d4d72e61-62ee-483f-aebb-4e932874f53d req-bd3667ff-b831-4a38-bd00-1b139f87cb80 service nova] Creating event network-vif-deleted:3e53a27e-13fd-4b03-87fb-f257a770ce85 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:50:06.796337 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-d4d72e61-62ee-483f-aebb-4e932874f53d req-bd3667ff-b831-4a38-bd00-1b139f87cb80 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114331 Oct 24 10:50:06.797988 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2595/5151] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:50:07.021763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c9d91a77-dab7-42c2-a7f7-e817fea41697 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:07.035439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c9d91a77-dab7-42c2-a7f7-e817fea41697 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:07.036910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c9d91a77-dab7-42c2-a7f7-e817fea41697 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:07.038739 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c9d91a77-dab7-42c2-a7f7-e817fea41697 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 2328 microversion: 2.42 time: 0.499203 Oct 24 10:50:07.054291 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2557/5152] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:06 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 2328 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:07.238341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-25855082-262e-4d9a-b8e5-2bf62769f572 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:07.241181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-25855082-262e-4d9a-b8e5-2bf62769f572 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:07.254072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25855082-262e-4d9a-b8e5-2bf62769f572 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:07.258744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25855082-262e-4d9a-b8e5-2bf62769f572 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:07.259419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25855082-262e-4d9a-b8e5-2bf62769f572 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:07.259917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25855082-262e-4d9a-b8e5-2bf62769f572 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:07.260372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25855082-262e-4d9a-b8e5-2bf62769f572 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:07.261243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25855082-262e-4d9a-b8e5-2bf62769f572 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:07.570189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-25855082-262e-4d9a-b8e5-2bf62769f572 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:07.580627 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-25855082-262e-4d9a-b8e5-2bf62769f572 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1393 microversion: 2.1 time: 0.352778 Oct 24 10:50:07.586298 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2596/5153] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:07 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1393 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:07.930175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c8997e08-e363-4784-8812-f2aa29ba529d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Action: 'create', calling method: .version_select at 0x7f04cb943dc0>, body: {"keypair": {"name": "tempest-keypair-1770527232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMamRunO6lCvj/V4BzhiYdYWSvIddA6zJSP0Q6eIj5zkpaefz++XQzo3yA9fyOR/wLU9258R08TmgWwjqqDNzKiPHYt8v78tK+Fh1MT/HJq0ZPAf/q69tk6Shk/92nFLA=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:50:07.945731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:50:07.973216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c8997e08-e363-4784-8812-f2aa29ba529d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Getting quotas for project 0ae874e076c34c44adb00f85aebd000e. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:50:07.987593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a3dfa4e4-8a63-46fa-8af5-070802afd313 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:07.988340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a3dfa4e4-8a63-46fa-8af5-070802afd313 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:08.001178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3dfa4e4-8a63-46fa-8af5-070802afd313 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:08.001686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3dfa4e4-8a63-46fa-8af5-070802afd313 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:08.002137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3dfa4e4-8a63-46fa-8af5-070802afd313 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:08.002869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3dfa4e4-8a63-46fa-8af5-070802afd313 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:08.003338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3dfa4e4-8a63-46fa-8af5-070802afd313 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:08.003772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3dfa4e4-8a63-46fa-8af5-070802afd313 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:08.019278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c8997e08-e363-4784-8812-f2aa29ba529d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Getting quotas for user 6da7534777ef4425aefa81bc7e49b69f and project 0ae874e076c34c44adb00f85aebd000e. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:50:08.032535 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-a3dfa4e4-8a63-46fa-8af5-070802afd313 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] HTTP exception thrown: Instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa could not be found. Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a3dfa4e4-8a63-46fa-8af5-070802afd313 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Request method failure captured: Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa HTTP/1.1 Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmwnIuIZc1Tl9vEr8TvLLys7k1HMZ9MNU5wcS8xr7Pjq3sY7xhdSzLmmStgcIifhS0zJ_xMtACHjHF4b6lSPIPEL5ZG3LD-qwNDqXAVcJD_3Tc8O3D8Upy8sI31CZQDVOh4vYSKX3MAZXUS3FFIRt6kwnnjzCE26xhLIH0I-kIWSvKY Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 886ae7eabe82421ca19e5cd59630e961 Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-860198550 Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/886ae7eabe82421ca19e5cd59630e961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/886ae7eabe82421ca19e5cd59630e961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/886ae7eabe82421ca19e5cd59630e961"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_886ae7eabe82421ca19e5cd59630e961", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AttachVolumeShelveTestJSON-860198550 Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 886ae7eabe82421ca19e5cd59630e961 Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-860198550 Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AttachVolumeShelveTestJSON-860198550-project Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: bf908b0f4e444157a0f28e84de8f8555 Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AttachVolumeShelveTestJSON-860198550-project Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa could not be found. Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'e357ce41-0ae9-4efa-973b-bc8920e4a0fa'} Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa could not be found. Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:50:08.037618 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:50:08.044485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa could not be found. Oct 24 10:50:08.044485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:50:08.044485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:50:08.044485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:50:08.044485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:08.044485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:50:08.044485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:50:08.044485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:50:08.044485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:50:08.044485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa could not be found. Oct 24 10:50:08.044485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:50:08.046336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a3dfa4e4-8a63-46fa-8af5-070802afd313 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Returning 404 to user: Instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:50:08.050100 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a3dfa4e4-8a63-46fa-8af5-070802afd313 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 404 len: 111 microversion: 2.20 time: 0.067444 Oct 24 10:50:08.051499 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2597/5154] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:50:07 2022] DELETE /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:50:08.063053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-47ee7fc7-3f3a-4cde-8f9a-d6effe65b029 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:08.066316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-47ee7fc7-3f3a-4cde-8f9a-d6effe65b029 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e357ce41-0ae9-4efa-973b-bc8920e4a0fa] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:08.071334 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c8997e08-e363-4784-8812-f2aa29ba529d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.151728 Oct 24 10:50:08.079813 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2558/5155] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:50:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:50:08.086213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ccfab602-5fd5-40b9-92ac-6fadfaf39cec tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:08.087059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ccfab602-5fd5-40b9-92ac-6fadfaf39cec tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:08.094849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47ee7fc7-3f3a-4cde-8f9a-d6effe65b029 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:08.095016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccfab602-5fd5-40b9-92ac-6fadfaf39cec tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:08.095342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccfab602-5fd5-40b9-92ac-6fadfaf39cec tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:08.095516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47ee7fc7-3f3a-4cde-8f9a-d6effe65b029 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:08.095861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47ee7fc7-3f3a-4cde-8f9a-d6effe65b029 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:08.096338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccfab602-5fd5-40b9-92ac-6fadfaf39cec tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:08.096592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47ee7fc7-3f3a-4cde-8f9a-d6effe65b029 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:08.097472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccfab602-5fd5-40b9-92ac-6fadfaf39cec tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:08.098178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccfab602-5fd5-40b9-92ac-6fadfaf39cec tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:08.098784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccfab602-5fd5-40b9-92ac-6fadfaf39cec tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:08.104190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47ee7fc7-3f3a-4cde-8f9a-d6effe65b029 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:08.105430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47ee7fc7-3f3a-4cde-8f9a-d6effe65b029 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:08.157343 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-47ee7fc7-3f3a-4cde-8f9a-d6effe65b029 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] HTTP exception thrown: Instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa could not be found. Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-47ee7fc7-3f3a-4cde-8f9a-d6effe65b029 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Request method failure captured: Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa HTTP/1.1 Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmwnIuIZc1Tl9vEr8TvLLys7k1HMZ9MNU5wcS8xr7Pjq3sY7xhdSzLmmStgcIifhS0zJ_xMtACHjHF4b6lSPIPEL5ZG3LD-qwNDqXAVcJD_3Tc8O3D8Upy8sI31CZQDVOh4vYSKX3MAZXUS3FFIRt6kwnnjzCE26xhLIH0I-kIWSvKY Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 886ae7eabe82421ca19e5cd59630e961 Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-860198550 Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/886ae7eabe82421ca19e5cd59630e961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/886ae7eabe82421ca19e5cd59630e961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/886ae7eabe82421ca19e5cd59630e961"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_886ae7eabe82421ca19e5cd59630e961", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AttachVolumeShelveTestJSON-860198550 Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 886ae7eabe82421ca19e5cd59630e961 Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-860198550 Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AttachVolumeShelveTestJSON-860198550-project Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: bf908b0f4e444157a0f28e84de8f8555 Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AttachVolumeShelveTestJSON-860198550-project Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa could not be found. Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'e357ce41-0ae9-4efa-973b-bc8920e4a0fa'} Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa could not be found. Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa could not be found. Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:50:08.162071 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:50:08.172122 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:50:08.172122 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:08.172122 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:50:08.172122 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:50:08.172122 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:50:08.172122 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:50:08.172122 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa could not be found. Oct 24 10:50:08.172122 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:50:08.172122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-47ee7fc7-3f3a-4cde-8f9a-d6effe65b029 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Returning 404 to user: Instance e357ce41-0ae9-4efa-973b-bc8920e4a0fa could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:50:08.172122 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-47ee7fc7-3f3a-4cde-8f9a-d6effe65b029 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa" status: 404 len: 111 microversion: 2.20 time: 0.109461 Oct 24 10:50:08.172122 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2598/5156] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:08 2022] GET /compute/v2.1/servers/e357ce41-0ae9-4efa-973b-bc8920e4a0fa => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:50:08.246735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ccfab602-5fd5-40b9-92ac-6fadfaf39cec tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:08.278315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ccfab602-5fd5-40b9-92ac-6fadfaf39cec tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:08.282145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ccfab602-5fd5-40b9-92ac-6fadfaf39cec tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:08.292350 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ccfab602-5fd5-40b9-92ac-6fadfaf39cec tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 2146 microversion: 2.42 time: 0.205870 Oct 24 10:50:08.293097 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2559/5157] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:08 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 2146 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:08.612513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c2f628a2-3b2f-49bd-bc79-b6b2038c4450 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:08.614054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c2f628a2-3b2f-49bd-bc79-b6b2038c4450 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:08.629049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2f628a2-3b2f-49bd-bc79-b6b2038c4450 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:08.635916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2f628a2-3b2f-49bd-bc79-b6b2038c4450 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:08.636448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2f628a2-3b2f-49bd-bc79-b6b2038c4450 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:08.641042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2f628a2-3b2f-49bd-bc79-b6b2038c4450 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:08.641589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2f628a2-3b2f-49bd-bc79-b6b2038c4450 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:08.642036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2f628a2-3b2f-49bd-bc79-b6b2038c4450 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:08.963840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c25592e3-8da6-4a44-a467-e905f32b342a req-4bc04e79-5b65-4597-b910-ec34f83d6d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-deleted", "tag": "cd46ad50-24e5-4e89-b061-174efa4e9061"}, {"server_uuid": "3c84caf0-0586-4590-b18c-684ef8e2a711", "name": "network-vif-deleted", "tag": "6edc1d11-d1ae-4161-a5c2-9e721c334352"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:50:09.011277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c25592e3-8da6-4a44-a467-e905f32b342a req-4bc04e79-5b65-4597-b910-ec34f83d6d75 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:09.012062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c25592e3-8da6-4a44-a467-e905f32b342a req-4bc04e79-5b65-4597-b910-ec34f83d6d75 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:09.013853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c25592e3-8da6-4a44-a467-e905f32b342a req-4bc04e79-5b65-4597-b910-ec34f83d6d75 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:09.062236 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c25592e3-8da6-4a44-a467-e905f32b342a req-4bc04e79-5b65-4597-b910-ec34f83d6d75 service nova] Creating event network-vif-deleted:cd46ad50-24e5-4e89-b061-174efa4e9061 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:50:09.063131 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c25592e3-8da6-4a44-a467-e905f32b342a req-4bc04e79-5b65-4597-b910-ec34f83d6d75 service nova] Creating event network-vif-deleted:6edc1d11-d1ae-4161-a5c2-9e721c334352 for instance 3c84caf0-0586-4590-b18c-684ef8e2a711 on n-h2-858383-15 Oct 24 10:50:09.070249 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c25592e3-8da6-4a44-a467-e905f32b342a req-4bc04e79-5b65-4597-b910-ec34f83d6d75 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.113546 Oct 24 10:50:09.071112 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2560/5158] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:50:09.289454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c2f628a2-3b2f-49bd-bc79-b6b2038c4450 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:09.307972 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c2f628a2-3b2f-49bd-bc79-b6b2038c4450 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1393 microversion: 2.1 time: 0.696861 Oct 24 10:50:09.309234 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2599/5159] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:08 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1393 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:09.326829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3f9c4628-93d3-4402-b2c7-9498a6e200a2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:09.327554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3f9c4628-93d3-4402-b2c7-9498a6e200a2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:09.363321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f9c4628-93d3-4402-b2c7-9498a6e200a2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:09.364574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f9c4628-93d3-4402-b2c7-9498a6e200a2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:09.367923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f9c4628-93d3-4402-b2c7-9498a6e200a2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:09.370619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f9c4628-93d3-4402-b2c7-9498a6e200a2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:09.371947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f9c4628-93d3-4402-b2c7-9498a6e200a2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:09.374544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f9c4628-93d3-4402-b2c7-9498a6e200a2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:09.594873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3f9c4628-93d3-4402-b2c7-9498a6e200a2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:09.617121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3f9c4628-93d3-4402-b2c7-9498a6e200a2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:09.619765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3f9c4628-93d3-4402-b2c7-9498a6e200a2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:09.626791 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3f9c4628-93d3-4402-b2c7-9498a6e200a2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1605 microversion: 2.42 time: 0.304918 Oct 24 10:50:09.629936 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2561/5160] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:09 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1605 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:10.332714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-80b55e15-95dd-4477-843e-f69c59d03bea tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:10.333994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-80b55e15-95dd-4477-843e-f69c59d03bea tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:10.337035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:50:10.351900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80b55e15-95dd-4477-843e-f69c59d03bea tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:10.352725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80b55e15-95dd-4477-843e-f69c59d03bea tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:10.353512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80b55e15-95dd-4477-843e-f69c59d03bea tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:10.354443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80b55e15-95dd-4477-843e-f69c59d03bea tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:10.355082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80b55e15-95dd-4477-843e-f69c59d03bea tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:10.355696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80b55e15-95dd-4477-843e-f69c59d03bea tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:10.656115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c46ccfa-6118-42f9-aa62-f998463e1085 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:10.656972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1c46ccfa-6118-42f9-aa62-f998463e1085 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:10.659381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:50:10.668450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-80b55e15-95dd-4477-843e-f69c59d03bea tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:10.678012 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-80b55e15-95dd-4477-843e-f69c59d03bea tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1393 microversion: 2.1 time: 0.349324 Oct 24 10:50:10.681306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c46ccfa-6118-42f9-aa62-f998463e1085 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:10.681799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c46ccfa-6118-42f9-aa62-f998463e1085 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:10.682256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c46ccfa-6118-42f9-aa62-f998463e1085 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:10.683236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c46ccfa-6118-42f9-aa62-f998463e1085 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:10.683903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c46ccfa-6118-42f9-aa62-f998463e1085 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:10.684552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c46ccfa-6118-42f9-aa62-f998463e1085 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:10.688694 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2600/5161] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:10 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1393 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:50:10.768806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1c46ccfa-6118-42f9-aa62-f998463e1085 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:10.800745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1c46ccfa-6118-42f9-aa62-f998463e1085 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:10.808352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1c46ccfa-6118-42f9-aa62-f998463e1085 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:10.811921 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1c46ccfa-6118-42f9-aa62-f998463e1085 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1605 microversion: 2.42 time: 0.159412 Oct 24 10:50:10.818620 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2562/5162] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:10 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1605 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:11.177662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-ea93a0a1-f084-43f8-a266-fe1b75c14701 req-30f3fd71-ca81-4623-aa31-e6d285a56639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7efbf530-723d-4ef0-855d-c38e0bb47cc7", "tag": "96d87680-c8c9-4cb5-b203-ef72c929ad05"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:50:11.193207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ea93a0a1-f084-43f8-a266-fe1b75c14701 req-30f3fd71-ca81-4623-aa31-e6d285a56639 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:11.194087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ea93a0a1-f084-43f8-a266-fe1b75c14701 req-30f3fd71-ca81-4623-aa31-e6d285a56639 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:11.194954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ea93a0a1-f084-43f8-a266-fe1b75c14701 req-30f3fd71-ca81-4623-aa31-e6d285a56639 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:11.218347 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ea93a0a1-f084-43f8-a266-fe1b75c14701 req-30f3fd71-ca81-4623-aa31-e6d285a56639 service nova] Creating event network-changed:96d87680-c8c9-4cb5-b203-ef72c929ad05 for instance 7efbf530-723d-4ef0-855d-c38e0bb47cc7 on n-h1-858383-15 Oct 24 10:50:11.225686 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-ea93a0a1-f084-43f8-a266-fe1b75c14701 req-30f3fd71-ca81-4623-aa31-e6d285a56639 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056137 Oct 24 10:50:11.227085 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2601/5163] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:50:11.711686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-680accb7-ad05-4eb9-b849-509954cbc8ef tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:11.712893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-680accb7-ad05-4eb9-b849-509954cbc8ef tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:11.723302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-680accb7-ad05-4eb9-b849-509954cbc8ef tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:11.723800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-680accb7-ad05-4eb9-b849-509954cbc8ef tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:11.724239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-680accb7-ad05-4eb9-b849-509954cbc8ef tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:11.724976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-680accb7-ad05-4eb9-b849-509954cbc8ef tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:11.725432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-680accb7-ad05-4eb9-b849-509954cbc8ef tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:11.725858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-680accb7-ad05-4eb9-b849-509954cbc8ef tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:11.845898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-35c8a4b4-b98e-4b0f-828b-b8c5619d5137 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:11.846599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-35c8a4b4-b98e-4b0f-828b-b8c5619d5137 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:11.853191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35c8a4b4-b98e-4b0f-828b-b8c5619d5137 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:11.854107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35c8a4b4-b98e-4b0f-828b-b8c5619d5137 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:11.854894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35c8a4b4-b98e-4b0f-828b-b8c5619d5137 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:11.855846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35c8a4b4-b98e-4b0f-828b-b8c5619d5137 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:11.856541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35c8a4b4-b98e-4b0f-828b-b8c5619d5137 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:11.857254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35c8a4b4-b98e-4b0f-828b-b8c5619d5137 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:11.984366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-35c8a4b4-b98e-4b0f-828b-b8c5619d5137 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:11.994329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-35c8a4b4-b98e-4b0f-828b-b8c5619d5137 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:12.003467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-35c8a4b4-b98e-4b0f-828b-b8c5619d5137 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:12.006024 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-35c8a4b4-b98e-4b0f-828b-b8c5619d5137 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1605 microversion: 2.42 time: 0.166065 Oct 24 10:50:12.009121 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2602/5164] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:11 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1605 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:12.039110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-680accb7-ad05-4eb9-b849-509954cbc8ef tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:12.047499 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-680accb7-ad05-4eb9-b849-509954cbc8ef tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1393 microversion: 2.1 time: 0.339789 Oct 24 10:50:12.048083 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2563/5165] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:11 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1393 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:12.191142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bec52004-2650-4283-9bd4-b0e74ef7cbf2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-285912626", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7fb4c5a5-316a-47ef-9893-2ec34f5cffe8"}], "security_groups": [{"name": "tempest-securitygroup--665323863"}], "key_name": "tempest-keypair-1770527232", "user_data": "}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:50:12.324429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-bec52004-2650-4283-9bd4-b0e74ef7cbf2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] validate_networks() for [('7fb4c5a5-316a-47ef-9893-2ec34f5cffe8', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:50:12.892708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-bec52004-2650-4283-9bd4-b0e74ef7cbf2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:50:12.893256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-bec52004-2650-4283-9bd4-b0e74ef7cbf2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:50:12.894601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-bec52004-2650-4283-9bd4-b0e74ef7cbf2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:50:12.895278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-bec52004-2650-4283-9bd4-b0e74ef7cbf2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:50:12.896907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-bec52004-2650-4283-9bd4-b0e74ef7cbf2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:50:12.912581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bec52004-2650-4283-9bd4-b0e74ef7cbf2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:12.913709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bec52004-2650-4283-9bd4-b0e74ef7cbf2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:12.914658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bec52004-2650-4283-9bd4-b0e74ef7cbf2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:12.915646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bec52004-2650-4283-9bd4-b0e74ef7cbf2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:12.916820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bec52004-2650-4283-9bd4-b0e74ef7cbf2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:12.918599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bec52004-2650-4283-9bd4-b0e74ef7cbf2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:12.940296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-bec52004-2650-4283-9bd4-b0e74ef7cbf2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Getting quotas for project 0ae874e076c34c44adb00f85aebd000e. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:50:12.946688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-bec52004-2650-4283-9bd4-b0e74ef7cbf2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Getting quotas for user 6da7534777ef4425aefa81bc7e49b69f and project 0ae874e076c34c44adb00f85aebd000e. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:50:12.964055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bec52004-2650-4283-9bd4-b0e74ef7cbf2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:50:12.966796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bec52004-2650-4283-9bd4-b0e74ef7cbf2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:50:13.039038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9deafee4-8641-479f-9e6c-351c03f88313 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:13.040107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9deafee4-8641-479f-9e6c-351c03f88313 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:13.041656 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bec52004-2650-4283-9bd4-b0e74ef7cbf2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.854665 Oct 24 10:50:13.044407 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2603/5166] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:50:12 2022] POST /compute/v2.1/servers => generated 408 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:50:13.049820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9deafee4-8641-479f-9e6c-351c03f88313 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:13.050320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9deafee4-8641-479f-9e6c-351c03f88313 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:13.053463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9deafee4-8641-479f-9e6c-351c03f88313 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:13.055774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9deafee4-8641-479f-9e6c-351c03f88313 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:13.057072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ab8b7ec1-a060-40a5-aa25-498402e79f1e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:13.057400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9deafee4-8641-479f-9e6c-351c03f88313 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:13.057940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ab8b7ec1-a060-40a5-aa25-498402e79f1e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:13.059548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9deafee4-8641-479f-9e6c-351c03f88313 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:13.123028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ab8b7ec1-a060-40a5-aa25-498402e79f1e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:13.132357 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ab8b7ec1-a060-40a5-aa25-498402e79f1e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1245 microversion: 2.1 time: 0.078840 Oct 24 10:50:13.133210 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2604/5167] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:13 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:50:13.138287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0769ab74-9b47-4c4a-8e65-64bd097a1e07 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:13.139934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0769ab74-9b47-4c4a-8e65-64bd097a1e07 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:13.159286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0769ab74-9b47-4c4a-8e65-64bd097a1e07 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:13.159903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0769ab74-9b47-4c4a-8e65-64bd097a1e07 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:13.160348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0769ab74-9b47-4c4a-8e65-64bd097a1e07 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:13.161720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0769ab74-9b47-4c4a-8e65-64bd097a1e07 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:13.162941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0769ab74-9b47-4c4a-8e65-64bd097a1e07 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:13.163579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0769ab74-9b47-4c4a-8e65-64bd097a1e07 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:13.169742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:50:13.198436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9deafee4-8641-479f-9e6c-351c03f88313 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:13.210863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9deafee4-8641-479f-9e6c-351c03f88313 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:13.215235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9deafee4-8641-479f-9e6c-351c03f88313 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:13.221231 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9deafee4-8641-479f-9e6c-351c03f88313 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1605 microversion: 2.42 time: 0.184161 Oct 24 10:50:13.223659 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2564/5168] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:13 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1605 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:13.403035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0769ab74-9b47-4c4a-8e65-64bd097a1e07 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:13.413122 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0769ab74-9b47-4c4a-8e65-64bd097a1e07 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1393 microversion: 2.1 time: 0.278536 Oct 24 10:50:13.413733 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2605/5169] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:13 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1393 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:14.158735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f2b5e1d0-71b1-43f0-bb51-d7574d5ee219 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:14.159350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f2b5e1d0-71b1-43f0-bb51-d7574d5ee219 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:14.178519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2b5e1d0-71b1-43f0-bb51-d7574d5ee219 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:14.179026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2b5e1d0-71b1-43f0-bb51-d7574d5ee219 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:14.179473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2b5e1d0-71b1-43f0-bb51-d7574d5ee219 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:14.180193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2b5e1d0-71b1-43f0-bb51-d7574d5ee219 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:14.180652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2b5e1d0-71b1-43f0-bb51-d7574d5ee219 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:14.181106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2b5e1d0-71b1-43f0-bb51-d7574d5ee219 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:14.255772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d815809a-9da3-41c0-bfdd-39102d9f6c16 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:14.256482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d815809a-9da3-41c0-bfdd-39102d9f6c16 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:14.272516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d815809a-9da3-41c0-bfdd-39102d9f6c16 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:14.273198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d815809a-9da3-41c0-bfdd-39102d9f6c16 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:14.277456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d815809a-9da3-41c0-bfdd-39102d9f6c16 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:14.278874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d815809a-9da3-41c0-bfdd-39102d9f6c16 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:14.283088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d815809a-9da3-41c0-bfdd-39102d9f6c16 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:14.283911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d815809a-9da3-41c0-bfdd-39102d9f6c16 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:14.285705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f2b5e1d0-71b1-43f0-bb51-d7574d5ee219 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:14.300539 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f2b5e1d0-71b1-43f0-bb51-d7574d5ee219 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1297 microversion: 2.1 time: 0.145510 Oct 24 10:50:14.301524 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2565/5170] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:14 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1297 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:14.383741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d815809a-9da3-41c0-bfdd-39102d9f6c16 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:14.394924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d815809a-9da3-41c0-bfdd-39102d9f6c16 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:14.397050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d815809a-9da3-41c0-bfdd-39102d9f6c16 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:14.398656 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d815809a-9da3-41c0-bfdd-39102d9f6c16 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1605 microversion: 2.42 time: 0.149209 Oct 24 10:50:14.409476 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2606/5171] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:14 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1605 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:14.437811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1ebe42cc-99e7-4162-b1bf-adf4aa3fbfe2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:14.438713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1ebe42cc-99e7-4162-b1bf-adf4aa3fbfe2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:14.445241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ebe42cc-99e7-4162-b1bf-adf4aa3fbfe2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:14.446000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ebe42cc-99e7-4162-b1bf-adf4aa3fbfe2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:14.446740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ebe42cc-99e7-4162-b1bf-adf4aa3fbfe2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:14.447728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ebe42cc-99e7-4162-b1bf-adf4aa3fbfe2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:14.448176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ebe42cc-99e7-4162-b1bf-adf4aa3fbfe2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:14.448808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ebe42cc-99e7-4162-b1bf-adf4aa3fbfe2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:14.751874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1ebe42cc-99e7-4162-b1bf-adf4aa3fbfe2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:14.772416 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1ebe42cc-99e7-4162-b1bf-adf4aa3fbfe2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1393 microversion: 2.1 time: 0.338444 Oct 24 10:50:14.777507 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2566/5172] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:14 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1393 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:15.333374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-543e9704-1af6-4928-bfd8-f38d210ca7d5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:15.336074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-543e9704-1af6-4928-bfd8-f38d210ca7d5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:15.347006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-543e9704-1af6-4928-bfd8-f38d210ca7d5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:15.347934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-543e9704-1af6-4928-bfd8-f38d210ca7d5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:15.349423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-543e9704-1af6-4928-bfd8-f38d210ca7d5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:15.350816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-543e9704-1af6-4928-bfd8-f38d210ca7d5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:15.351656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-543e9704-1af6-4928-bfd8-f38d210ca7d5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:15.352385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-543e9704-1af6-4928-bfd8-f38d210ca7d5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:15.427336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-192a90ac-542e-4d0e-a41f-7a0869b997f9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:15.427871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-192a90ac-542e-4d0e-a41f-7a0869b997f9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:15.444493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-192a90ac-542e-4d0e-a41f-7a0869b997f9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:15.445029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-192a90ac-542e-4d0e-a41f-7a0869b997f9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:15.445488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-192a90ac-542e-4d0e-a41f-7a0869b997f9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:15.446196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-192a90ac-542e-4d0e-a41f-7a0869b997f9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:15.446653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-192a90ac-542e-4d0e-a41f-7a0869b997f9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:15.447077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-192a90ac-542e-4d0e-a41f-7a0869b997f9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:15.482270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-543e9704-1af6-4928-bfd8-f38d210ca7d5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:15.500791 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-543e9704-1af6-4928-bfd8-f38d210ca7d5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1303 microversion: 2.1 time: 0.176978 Oct 24 10:50:15.503972 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2607/5173] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:15 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1303 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:15.624660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-192a90ac-542e-4d0e-a41f-7a0869b997f9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:15.645064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-192a90ac-542e-4d0e-a41f-7a0869b997f9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:15.647096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-192a90ac-542e-4d0e-a41f-7a0869b997f9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:15.649213 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-192a90ac-542e-4d0e-a41f-7a0869b997f9 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1605 microversion: 2.42 time: 0.225852 Oct 24 10:50:15.657090 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2567/5174] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:15 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1605 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:50:15.808703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2b1d1ed5-22a5-4ebc-b724-704f91747772 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:15.809683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2b1d1ed5-22a5-4ebc-b724-704f91747772 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:15.820287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1d1ed5-22a5-4ebc-b724-704f91747772 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:15.820783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1d1ed5-22a5-4ebc-b724-704f91747772 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:15.824245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1d1ed5-22a5-4ebc-b724-704f91747772 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:15.825072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1d1ed5-22a5-4ebc-b724-704f91747772 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:15.825546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1d1ed5-22a5-4ebc-b724-704f91747772 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:15.825980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b1d1ed5-22a5-4ebc-b724-704f91747772 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:16.211712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2b1d1ed5-22a5-4ebc-b724-704f91747772 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:16.222684 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2b1d1ed5-22a5-4ebc-b724-704f91747772 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1393 microversion: 2.1 time: 0.417853 Oct 24 10:50:16.227495 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2608/5175] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:15 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1393 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:16.537333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fc0fa627-00e0-4efa-a8b1-0511a2a807f5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:16.538858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fc0fa627-00e0-4efa-a8b1-0511a2a807f5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:16.556579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc0fa627-00e0-4efa-a8b1-0511a2a807f5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:16.557347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc0fa627-00e0-4efa-a8b1-0511a2a807f5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:16.558121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc0fa627-00e0-4efa-a8b1-0511a2a807f5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:16.559115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc0fa627-00e0-4efa-a8b1-0511a2a807f5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:16.572197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc0fa627-00e0-4efa-a8b1-0511a2a807f5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:16.573039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc0fa627-00e0-4efa-a8b1-0511a2a807f5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:16.685402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9711b667-e405-4b06-8d5d-da4b16856576 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:16.686784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9711b667-e405-4b06-8d5d-da4b16856576 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:16.698507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9711b667-e405-4b06-8d5d-da4b16856576 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:16.699005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9711b667-e405-4b06-8d5d-da4b16856576 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:16.699446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9711b667-e405-4b06-8d5d-da4b16856576 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:16.700162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9711b667-e405-4b06-8d5d-da4b16856576 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:16.715965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9711b667-e405-4b06-8d5d-da4b16856576 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:16.716389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9711b667-e405-4b06-8d5d-da4b16856576 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:16.965669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9711b667-e405-4b06-8d5d-da4b16856576 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:16.995969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fc0fa627-00e0-4efa-a8b1-0511a2a807f5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:17.009514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9711b667-e405-4b06-8d5d-da4b16856576 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:17.012026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9711b667-e405-4b06-8d5d-da4b16856576 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:17.016142 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fc0fa627-00e0-4efa-a8b1-0511a2a807f5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1370 microversion: 2.1 time: 0.476031 Oct 24 10:50:17.016788 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2568/5176] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:16 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1370 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:17.019348 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9711b667-e405-4b06-8d5d-da4b16856576 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1605 microversion: 2.42 time: 0.337362 Oct 24 10:50:17.023164 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2609/5177] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:16 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1605 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:17.255566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c3aec4e8-d6a9-4165-87c8-62765124d362 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:17.257046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c3aec4e8-d6a9-4165-87c8-62765124d362 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:17.267042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3aec4e8-d6a9-4165-87c8-62765124d362 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:17.267899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3aec4e8-d6a9-4165-87c8-62765124d362 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:17.268683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3aec4e8-d6a9-4165-87c8-62765124d362 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:17.285130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3aec4e8-d6a9-4165-87c8-62765124d362 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:17.286653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3aec4e8-d6a9-4165-87c8-62765124d362 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:17.287785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c3aec4e8-d6a9-4165-87c8-62765124d362 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:17.732587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c3aec4e8-d6a9-4165-87c8-62765124d362 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:17.745908 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c3aec4e8-d6a9-4165-87c8-62765124d362 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1393 microversion: 2.1 time: 0.495223 Oct 24 10:50:17.775667 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2569/5178] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:17 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1393 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:18.039032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d96fd331-5afa-4637-a14d-c704e431df5c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:18.039641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d96fd331-5afa-4637-a14d-c704e431df5c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:18.052186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d96fd331-5afa-4637-a14d-c704e431df5c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:18.052684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d96fd331-5afa-4637-a14d-c704e431df5c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:18.056696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d96fd331-5afa-4637-a14d-c704e431df5c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:18.057757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d96fd331-5afa-4637-a14d-c704e431df5c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:18.058445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d96fd331-5afa-4637-a14d-c704e431df5c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:18.059042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d96fd331-5afa-4637-a14d-c704e431df5c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:18.068609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6dd581ed-9197-4e9b-b58d-ded15a5e76f7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:18.069512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6dd581ed-9197-4e9b-b58d-ded15a5e76f7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:18.078543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:50:18.084359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6dd581ed-9197-4e9b-b58d-ded15a5e76f7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:18.085483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6dd581ed-9197-4e9b-b58d-ded15a5e76f7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:18.086744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6dd581ed-9197-4e9b-b58d-ded15a5e76f7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:18.089107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6dd581ed-9197-4e9b-b58d-ded15a5e76f7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:18.090514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6dd581ed-9197-4e9b-b58d-ded15a5e76f7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:18.091734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6dd581ed-9197-4e9b-b58d-ded15a5e76f7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:18.180224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:50:18.324378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6dd581ed-9197-4e9b-b58d-ded15a5e76f7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:18.341378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6dd581ed-9197-4e9b-b58d-ded15a5e76f7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:18.344612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6dd581ed-9197-4e9b-b58d-ded15a5e76f7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:18.346078 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6dd581ed-9197-4e9b-b58d-ded15a5e76f7 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1605 microversion: 2.42 time: 0.281903 Oct 24 10:50:18.347145 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2570/5179] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:18 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1605 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:18.352802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-32aa4a12-e03a-4897-8559-148bb76361ac req-912f9d8d-2d64-4b0f-a9da-4d879938a83e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f5b0075-c182-4a77-a15a-b904b39cc9c1", "tag": "9375a35b-fad3-4bd3-acee-11b80d2853cf"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:50:18.364208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-32aa4a12-e03a-4897-8559-148bb76361ac req-912f9d8d-2d64-4b0f-a9da-4d879938a83e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:18.364996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-32aa4a12-e03a-4897-8559-148bb76361ac req-912f9d8d-2d64-4b0f-a9da-4d879938a83e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:18.365596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-32aa4a12-e03a-4897-8559-148bb76361ac req-912f9d8d-2d64-4b0f-a9da-4d879938a83e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:18.382604 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-32aa4a12-e03a-4897-8559-148bb76361ac req-912f9d8d-2d64-4b0f-a9da-4d879938a83e service nova] Creating event network-changed:9375a35b-fad3-4bd3-acee-11b80d2853cf for instance 4f5b0075-c182-4a77-a15a-b904b39cc9c1 on n-h2-858383-15 Oct 24 10:50:18.388583 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-32aa4a12-e03a-4897-8559-148bb76361ac req-912f9d8d-2d64-4b0f-a9da-4d879938a83e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039941 Oct 24 10:50:18.390632 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2571/5180] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:50:18.398143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d96fd331-5afa-4637-a14d-c704e431df5c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:18.409891 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d96fd331-5afa-4637-a14d-c704e431df5c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1370 microversion: 2.1 time: 0.374629 Oct 24 10:50:18.412976 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2610/5181] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:18 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1370 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:18.556826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-eba01d2a-aaf2-44cc-b6b2-b5444be58120 req-369dc1bc-2bf7-43d2-b687-53392e7af560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7efbf530-723d-4ef0-855d-c38e0bb47cc7", "name": "network-vif-plugged", "status": "completed", "tag": "96d87680-c8c9-4cb5-b203-ef72c929ad05"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:50:18.574954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eba01d2a-aaf2-44cc-b6b2-b5444be58120 req-369dc1bc-2bf7-43d2-b687-53392e7af560 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:18.575465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eba01d2a-aaf2-44cc-b6b2-b5444be58120 req-369dc1bc-2bf7-43d2-b687-53392e7af560 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:18.575898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eba01d2a-aaf2-44cc-b6b2-b5444be58120 req-369dc1bc-2bf7-43d2-b687-53392e7af560 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:18.596598 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-eba01d2a-aaf2-44cc-b6b2-b5444be58120 req-369dc1bc-2bf7-43d2-b687-53392e7af560 service nova] Creating event network-vif-plugged:96d87680-c8c9-4cb5-b203-ef72c929ad05 for instance 7efbf530-723d-4ef0-855d-c38e0bb47cc7 on n-h1-858383-15 Oct 24 10:50:18.626700 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-eba01d2a-aaf2-44cc-b6b2-b5444be58120 req-369dc1bc-2bf7-43d2-b687-53392e7af560 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073873 Oct 24 10:50:18.627328 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2572/5182] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:50:18.773306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-51a3c42c-34cd-4b3f-923e-5b410c9f58d8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:18.774226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-51a3c42c-34cd-4b3f-923e-5b410c9f58d8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:18.796660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51a3c42c-34cd-4b3f-923e-5b410c9f58d8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:18.802582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51a3c42c-34cd-4b3f-923e-5b410c9f58d8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:18.804710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51a3c42c-34cd-4b3f-923e-5b410c9f58d8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:18.809467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51a3c42c-34cd-4b3f-923e-5b410c9f58d8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:18.812603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51a3c42c-34cd-4b3f-923e-5b410c9f58d8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:18.813301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51a3c42c-34cd-4b3f-923e-5b410c9f58d8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:19.270480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-51a3c42c-34cd-4b3f-923e-5b410c9f58d8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:19.305571 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-51a3c42c-34cd-4b3f-923e-5b410c9f58d8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1393 microversion: 2.1 time: 0.526081 Oct 24 10:50:19.306621 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2611/5183] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:18 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1393 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:19.377926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3644d025-1915-4765-a5dc-223ecb9e6fd2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:19.379742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3644d025-1915-4765-a5dc-223ecb9e6fd2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:19.410483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3644d025-1915-4765-a5dc-223ecb9e6fd2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:19.411112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3644d025-1915-4765-a5dc-223ecb9e6fd2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:19.411572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3644d025-1915-4765-a5dc-223ecb9e6fd2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:19.412349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3644d025-1915-4765-a5dc-223ecb9e6fd2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:19.412802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3644d025-1915-4765-a5dc-223ecb9e6fd2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:19.418799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3644d025-1915-4765-a5dc-223ecb9e6fd2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:19.434600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9974e3c3-8c52-4b9d-a04f-8db868b8120d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:19.437099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9974e3c3-8c52-4b9d-a04f-8db868b8120d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:19.439008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:50:19.458344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9974e3c3-8c52-4b9d-a04f-8db868b8120d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:19.463016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9974e3c3-8c52-4b9d-a04f-8db868b8120d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:19.463836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9974e3c3-8c52-4b9d-a04f-8db868b8120d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:19.464856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9974e3c3-8c52-4b9d-a04f-8db868b8120d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:19.467546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9974e3c3-8c52-4b9d-a04f-8db868b8120d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:19.468284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9974e3c3-8c52-4b9d-a04f-8db868b8120d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:19.566951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3644d025-1915-4765-a5dc-223ecb9e6fd2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:19.587016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3644d025-1915-4765-a5dc-223ecb9e6fd2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:19.588547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3644d025-1915-4765-a5dc-223ecb9e6fd2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:19.589863 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3644d025-1915-4765-a5dc-223ecb9e6fd2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1605 microversion: 2.42 time: 0.217015 Oct 24 10:50:19.604418 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2573/5184] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:19 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1605 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:19.617033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-26a4de9c-bb7f-42ac-a4af-d92b0decdcd7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:19.617533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-26a4de9c-bb7f-42ac-a4af-d92b0decdcd7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:19.623791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26a4de9c-bb7f-42ac-a4af-d92b0decdcd7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:19.625018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26a4de9c-bb7f-42ac-a4af-d92b0decdcd7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:19.625818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26a4de9c-bb7f-42ac-a4af-d92b0decdcd7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:19.626744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26a4de9c-bb7f-42ac-a4af-d92b0decdcd7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:19.627386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26a4de9c-bb7f-42ac-a4af-d92b0decdcd7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:19.627981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26a4de9c-bb7f-42ac-a4af-d92b0decdcd7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:19.650116 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-26a4de9c-bb7f-42ac-a4af-d92b0decdcd7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] HTTP exception thrown: Instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e could not be found. Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-26a4de9c-bb7f-42ac-a4af-d92b0decdcd7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Request method failure captured: Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e HTTP/1.1 Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmwnIuIZc1Tl9vEr8TvLLys7k1HMZ9MNU5wcS8xr7Pjq3sY7xhdSzLmmStgcIifhS0zJ_xMtACHjHF4b6lSPIPEL5ZG3LD-qwNDqXAVcJD_3Tc8O3D8Upy8sI31CZQDVOh4vYSKX3MAZXUS3FFIRt6kwnnjzCE26xhLIH0I-kIWSvKY Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 886ae7eabe82421ca19e5cd59630e961 Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-860198550 Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/886ae7eabe82421ca19e5cd59630e961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/886ae7eabe82421ca19e5cd59630e961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/886ae7eabe82421ca19e5cd59630e961"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_886ae7eabe82421ca19e5cd59630e961", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeShelveTestJSON-860198550 Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 886ae7eabe82421ca19e5cd59630e961 Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-860198550 Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AttachVolumeShelveTestJSON-860198550-project Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: bf908b0f4e444157a0f28e84de8f8555 Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeShelveTestJSON-860198550-project Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e could not be found. Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'e6eb3578-42ca-4dc5-b31a-e5500aa94f2e'} Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e could not be found. Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:50:19.651911 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:50:19.657830 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e could not be found. Oct 24 10:50:19.657830 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:19.657830 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:50:19.657830 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:19.657830 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:19.657830 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:50:19.657830 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:50:19.657830 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:50:19.657830 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:50:19.657830 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e could not be found. Oct 24 10:50:19.657830 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:19.657830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-26a4de9c-bb7f-42ac-a4af-d92b0decdcd7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Returning 404 to user: Instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:50:19.657830 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-26a4de9c-bb7f-42ac-a4af-d92b0decdcd7 tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 404 len: 111 microversion: 2.20 time: 0.047668 Oct 24 10:50:19.657830 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2574/5185] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:50:19 2022] DELETE /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:50:19.663694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-663f7daa-2cf8-49a5-bd37-a5084afba84d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:19.664301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-663f7daa-2cf8-49a5-bd37-a5084afba84d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] [instance: e6eb3578-42ca-4dc5-b31a-e5500aa94f2e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:19.672369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-663f7daa-2cf8-49a5-bd37-a5084afba84d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:19.672888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-663f7daa-2cf8-49a5-bd37-a5084afba84d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:19.673337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-663f7daa-2cf8-49a5-bd37-a5084afba84d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:19.674052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-663f7daa-2cf8-49a5-bd37-a5084afba84d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:19.674503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-663f7daa-2cf8-49a5-bd37-a5084afba84d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:19.674928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-663f7daa-2cf8-49a5-bd37-a5084afba84d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:19.694525 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-663f7daa-2cf8-49a5-bd37-a5084afba84d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] HTTP exception thrown: Instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e could not be found. Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-663f7daa-2cf8-49a5-bd37-a5084afba84d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Request method failure captured: Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e HTTP/1.1 Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmwnIuIZc1Tl9vEr8TvLLys7k1HMZ9MNU5wcS8xr7Pjq3sY7xhdSzLmmStgcIifhS0zJ_xMtACHjHF4b6lSPIPEL5ZG3LD-qwNDqXAVcJD_3Tc8O3D8Upy8sI31CZQDVOh4vYSKX3MAZXUS3FFIRt6kwnnjzCE26xhLIH0I-kIWSvKY Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 886ae7eabe82421ca19e5cd59630e961 Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-860198550 Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/886ae7eabe82421ca19e5cd59630e961"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/886ae7eabe82421ca19e5cd59630e961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/886ae7eabe82421ca19e5cd59630e961"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_886ae7eabe82421ca19e5cd59630e961", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeShelveTestJSON-860198550 Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 886ae7eabe82421ca19e5cd59630e961 Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-860198550 Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AttachVolumeShelveTestJSON-860198550-project Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: bf908b0f4e444157a0f28e84de8f8555 Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeShelveTestJSON-860198550-project Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e could not be found. Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'e6eb3578-42ca-4dc5-b31a-e5500aa94f2e'} Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e could not be found. Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e could not be found. Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:19.696071 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:50:19.701908 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:19.701908 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:19.701908 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:50:19.701908 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:50:19.701908 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:50:19.701908 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:50:19.701908 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e could not be found. Oct 24 10:50:19.701908 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:19.701908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-663f7daa-2cf8-49a5-bd37-a5084afba84d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] Returning 404 to user: Instance e6eb3578-42ca-4dc5-b31a-e5500aa94f2e could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:50:19.701908 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-663f7daa-2cf8-49a5-bd37-a5084afba84d tempest-AttachVolumeShelveTestJSON-860198550 tempest-AttachVolumeShelveTestJSON-860198550-project] 10.222.0.50 "GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e" status: 404 len: 111 microversion: 2.20 time: 0.037708 Oct 24 10:50:19.719195 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2575/5186] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:19 2022] GET /compute/v2.1/servers/e6eb3578-42ca-4dc5-b31a-e5500aa94f2e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:50:19.773166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9974e3c3-8c52-4b9d-a04f-8db868b8120d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:19.791576 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9974e3c3-8c52-4b9d-a04f-8db868b8120d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1370 microversion: 2.1 time: 0.358023 Oct 24 10:50:19.809296 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2612/5187] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:19 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1370 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:50:20.339118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cab90071-7a69-4edc-b5f3-9413ce02c165 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:20.339918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cab90071-7a69-4edc-b5f3-9413ce02c165 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:20.352307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cab90071-7a69-4edc-b5f3-9413ce02c165 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:20.353760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cab90071-7a69-4edc-b5f3-9413ce02c165 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:20.362632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cab90071-7a69-4edc-b5f3-9413ce02c165 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:20.370250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cab90071-7a69-4edc-b5f3-9413ce02c165 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:20.371237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cab90071-7a69-4edc-b5f3-9413ce02c165 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:20.373917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cab90071-7a69-4edc-b5f3-9413ce02c165 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:20.626333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-97e26eca-db99-470b-983a-de0382f29ab2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:20.627768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-97e26eca-db99-470b-983a-de0382f29ab2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:20.656153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-97e26eca-db99-470b-983a-de0382f29ab2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:20.656650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-97e26eca-db99-470b-983a-de0382f29ab2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:20.657130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-97e26eca-db99-470b-983a-de0382f29ab2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:20.657853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-97e26eca-db99-470b-983a-de0382f29ab2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:20.658324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-97e26eca-db99-470b-983a-de0382f29ab2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:20.658862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-97e26eca-db99-470b-983a-de0382f29ab2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:20.768353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cab90071-7a69-4edc-b5f3-9413ce02c165 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:20.787763 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cab90071-7a69-4edc-b5f3-9413ce02c165 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1393 microversion: 2.1 time: 0.450587 Oct 24 10:50:20.789849 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2576/5188] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:20 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1393 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:20.816707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d34fb704-c8fd-43e6-aa68-4b090be7416e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:20.817741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d34fb704-c8fd-43e6-aa68-4b090be7416e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:20.832444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d34fb704-c8fd-43e6-aa68-4b090be7416e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:20.834271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d34fb704-c8fd-43e6-aa68-4b090be7416e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:20.835002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d34fb704-c8fd-43e6-aa68-4b090be7416e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:20.837789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d34fb704-c8fd-43e6-aa68-4b090be7416e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:20.838887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d34fb704-c8fd-43e6-aa68-4b090be7416e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:20.840114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d34fb704-c8fd-43e6-aa68-4b090be7416e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:20.845242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-97e26eca-db99-470b-983a-de0382f29ab2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:20.856960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-97e26eca-db99-470b-983a-de0382f29ab2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:20.858711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-97e26eca-db99-470b-983a-de0382f29ab2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:20.859916 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-97e26eca-db99-470b-983a-de0382f29ab2 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1605 microversion: 2.42 time: 0.237912 Oct 24 10:50:20.871614 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2613/5189] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:20 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1605 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:21.159524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d34fb704-c8fd-43e6-aa68-4b090be7416e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:21.179539 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d34fb704-c8fd-43e6-aa68-4b090be7416e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1370 microversion: 2.1 time: 0.366498 Oct 24 10:50:21.180917 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2577/5190] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:20 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1370 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:21.812346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b5e757e0-c35f-4ca2-8bce-4626ef77d130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:21.812992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b5e757e0-c35f-4ca2-8bce-4626ef77d130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:21.825877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5e757e0-c35f-4ca2-8bce-4626ef77d130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:21.827505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5e757e0-c35f-4ca2-8bce-4626ef77d130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:21.828197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5e757e0-c35f-4ca2-8bce-4626ef77d130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:21.829419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5e757e0-c35f-4ca2-8bce-4626ef77d130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:21.831828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5e757e0-c35f-4ca2-8bce-4626ef77d130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:21.835105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5e757e0-c35f-4ca2-8bce-4626ef77d130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:21.891876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-af4477e4-9249-40f5-84d6-dbdc388df945 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:21.892701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-af4477e4-9249-40f5-84d6-dbdc388df945 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:21.904017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af4477e4-9249-40f5-84d6-dbdc388df945 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:21.907060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af4477e4-9249-40f5-84d6-dbdc388df945 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:21.909028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af4477e4-9249-40f5-84d6-dbdc388df945 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:21.912098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af4477e4-9249-40f5-84d6-dbdc388df945 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:21.913650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af4477e4-9249-40f5-84d6-dbdc388df945 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:21.917279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af4477e4-9249-40f5-84d6-dbdc388df945 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:22.083621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-af4477e4-9249-40f5-84d6-dbdc388df945 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:22.099401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-af4477e4-9249-40f5-84d6-dbdc388df945 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:22.101738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-af4477e4-9249-40f5-84d6-dbdc388df945 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:22.103931 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-af4477e4-9249-40f5-84d6-dbdc388df945 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1605 microversion: 2.42 time: 0.217319 Oct 24 10:50:22.105091 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2578/5191] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:21 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1605 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:50:22.165371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b5e757e0-c35f-4ca2-8bce-4626ef77d130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:22.179525 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b5e757e0-c35f-4ca2-8bce-4626ef77d130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1564 microversion: 2.1 time: 0.371646 Oct 24 10:50:22.181578 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2614/5192] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:21 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1564 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:22.211306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fe16304a-6ca8-46ac-9e55-58d6c9759a43 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:22.211937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fe16304a-6ca8-46ac-9e55-58d6c9759a43 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:22.219471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-54917ec4-44d9-4157-9dad-20ad9b95c19a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:22.219858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-54917ec4-44d9-4157-9dad-20ad9b95c19a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:22.235224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54917ec4-44d9-4157-9dad-20ad9b95c19a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:22.237070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe16304a-6ca8-46ac-9e55-58d6c9759a43 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:22.237611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe16304a-6ca8-46ac-9e55-58d6c9759a43 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:22.238421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54917ec4-44d9-4157-9dad-20ad9b95c19a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:22.239575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe16304a-6ca8-46ac-9e55-58d6c9759a43 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:22.239889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54917ec4-44d9-4157-9dad-20ad9b95c19a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:22.242477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe16304a-6ca8-46ac-9e55-58d6c9759a43 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:22.242657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54917ec4-44d9-4157-9dad-20ad9b95c19a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:22.244610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe16304a-6ca8-46ac-9e55-58d6c9759a43 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:22.245513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54917ec4-44d9-4157-9dad-20ad9b95c19a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:22.246190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe16304a-6ca8-46ac-9e55-58d6c9759a43 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:22.246908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54917ec4-44d9-4157-9dad-20ad9b95c19a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:22.604278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fe16304a-6ca8-46ac-9e55-58d6c9759a43 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:22.616224 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fe16304a-6ca8-46ac-9e55-58d6c9759a43 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1370 microversion: 2.1 time: 0.408831 Oct 24 10:50:22.631034 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2615/5193] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:22 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1370 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:22.639593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-54917ec4-44d9-4157-9dad-20ad9b95c19a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:22.652348 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-54917ec4-44d9-4157-9dad-20ad9b95c19a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1564 microversion: 2.1 time: 0.445672 Oct 24 10:50:22.653946 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2579/5194] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:22 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1564 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:22.659491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-26f91072-7fc1-4a18-9f0c-eec53b776cc8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:22.663206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-26f91072-7fc1-4a18-9f0c-eec53b776cc8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:22.684614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26f91072-7fc1-4a18-9f0c-eec53b776cc8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:22.685653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26f91072-7fc1-4a18-9f0c-eec53b776cc8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:22.686492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26f91072-7fc1-4a18-9f0c-eec53b776cc8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:22.687543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26f91072-7fc1-4a18-9f0c-eec53b776cc8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:22.688238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26f91072-7fc1-4a18-9f0c-eec53b776cc8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:22.688993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26f91072-7fc1-4a18-9f0c-eec53b776cc8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:22.745113 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-26f91072-7fc1-4a18-9f0c-eec53b776cc8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0/ips" status: 200 len: 145 microversion: 2.1 time: 0.092234 Oct 24 10:50:22.752387 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2616/5195] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Oct 24 10:50:22 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0/ips => generated 145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:50:23.135564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4d067fb5-ddb2-44d7-9e62-fca95b2ea10b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:23.137082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4d067fb5-ddb2-44d7-9e62-fca95b2ea10b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:23.159556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d067fb5-ddb2-44d7-9e62-fca95b2ea10b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:23.161049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d067fb5-ddb2-44d7-9e62-fca95b2ea10b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:23.161586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d067fb5-ddb2-44d7-9e62-fca95b2ea10b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:23.162873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d067fb5-ddb2-44d7-9e62-fca95b2ea10b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:23.162873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d067fb5-ddb2-44d7-9e62-fca95b2ea10b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:23.163159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d067fb5-ddb2-44d7-9e62-fca95b2ea10b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:23.425811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4d067fb5-ddb2-44d7-9e62-fca95b2ea10b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:23.447643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4d067fb5-ddb2-44d7-9e62-fca95b2ea10b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:23.451304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4d067fb5-ddb2-44d7-9e62-fca95b2ea10b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:23.453348 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4d067fb5-ddb2-44d7-9e62-fca95b2ea10b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1605 microversion: 2.42 time: 0.322838 Oct 24 10:50:23.473906 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2580/5196] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:23 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1605 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:23.646833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3d0c6953-5f40-437e-8e9c-c9e21baef1d7 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:23.647411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3d0c6953-5f40-437e-8e9c-c9e21baef1d7 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:23.652504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:50:23.661389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=8 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:50:23.687751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d0c6953-5f40-437e-8e9c-c9e21baef1d7 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:23.691913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d0c6953-5f40-437e-8e9c-c9e21baef1d7 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:23.692571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d0c6953-5f40-437e-8e9c-c9e21baef1d7 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:23.696106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d0c6953-5f40-437e-8e9c-c9e21baef1d7 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:23.696802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d0c6953-5f40-437e-8e9c-c9e21baef1d7 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:23.704606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3d0c6953-5f40-437e-8e9c-c9e21baef1d7 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:24.335761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3d0c6953-5f40-437e-8e9c-c9e21baef1d7 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:24.349774 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3d0c6953-5f40-437e-8e9c-c9e21baef1d7 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1370 microversion: 2.1 time: 0.706874 Oct 24 10:50:24.375481 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2617/5197] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:23 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1370 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:24.488708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b8fa3904-14d3-4388-a620-2646929c8370 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:24.489555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b8fa3904-14d3-4388-a620-2646929c8370 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:24.505246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8fa3904-14d3-4388-a620-2646929c8370 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:24.508092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8fa3904-14d3-4388-a620-2646929c8370 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:24.508967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8fa3904-14d3-4388-a620-2646929c8370 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:24.510292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8fa3904-14d3-4388-a620-2646929c8370 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:24.513935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8fa3904-14d3-4388-a620-2646929c8370 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:24.520550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b8fa3904-14d3-4388-a620-2646929c8370 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:24.676636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b8fa3904-14d3-4388-a620-2646929c8370 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:24.698587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b8fa3904-14d3-4388-a620-2646929c8370 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:24.710973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b8fa3904-14d3-4388-a620-2646929c8370 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:24.712274 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b8fa3904-14d3-4388-a620-2646929c8370 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1605 microversion: 2.42 time: 0.229315 Oct 24 10:50:24.725574 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2581/5198] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:24 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1605 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:24.933839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-eb611020-3662-4933-b433-d3bcaa7544f0 req-25a71f9c-875a-4cb2-9339-507e70c1e258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5b0075-c182-4a77-a15a-b904b39cc9c1", "name": "network-vif-plugged", "status": "completed", "tag": "9375a35b-fad3-4bd3-acee-11b80d2853cf"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:50:24.962022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-eb611020-3662-4933-b433-d3bcaa7544f0 req-25a71f9c-875a-4cb2-9339-507e70c1e258 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:24.962935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-eb611020-3662-4933-b433-d3bcaa7544f0 req-25a71f9c-875a-4cb2-9339-507e70c1e258 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:24.965047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-eb611020-3662-4933-b433-d3bcaa7544f0 req-25a71f9c-875a-4cb2-9339-507e70c1e258 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:25.021278 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-eb611020-3662-4933-b433-d3bcaa7544f0 req-25a71f9c-875a-4cb2-9339-507e70c1e258 service nova] Creating event network-vif-plugged:9375a35b-fad3-4bd3-acee-11b80d2853cf for instance 4f5b0075-c182-4a77-a15a-b904b39cc9c1 on n-h2-858383-15 Oct 24 10:50:25.031605 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-eb611020-3662-4933-b433-d3bcaa7544f0 req-25a71f9c-875a-4cb2-9339-507e70c1e258 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101575 Oct 24 10:50:25.032544 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2618/5199] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:50:25.384111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1f82a6e7-337a-444f-8822-9c2f00eb8a59 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:25.385169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1f82a6e7-337a-444f-8822-9c2f00eb8a59 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:25.420687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f82a6e7-337a-444f-8822-9c2f00eb8a59 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:25.422219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f82a6e7-337a-444f-8822-9c2f00eb8a59 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:25.422664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f82a6e7-337a-444f-8822-9c2f00eb8a59 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:25.423412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f82a6e7-337a-444f-8822-9c2f00eb8a59 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:25.423866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f82a6e7-337a-444f-8822-9c2f00eb8a59 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:25.429743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f82a6e7-337a-444f-8822-9c2f00eb8a59 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:25.653664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-229fbfa2-9b20-45af-98b8-89eef56bc822 tempest-PortsAdminExtendedAttrsTestJSON-963148228 tempest-PortsAdminExtendedAttrsTestJSON-963148228-project-admin] Calling method '.version_select at 0x7f04cbaa6700>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:25.656537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229fbfa2-9b20-45af-98b8-89eef56bc822 tempest-PortsAdminExtendedAttrsTestJSON-963148228 tempest-PortsAdminExtendedAttrsTestJSON-963148228-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:25.657068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229fbfa2-9b20-45af-98b8-89eef56bc822 tempest-PortsAdminExtendedAttrsTestJSON-963148228 tempest-PortsAdminExtendedAttrsTestJSON-963148228-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:25.657520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229fbfa2-9b20-45af-98b8-89eef56bc822 tempest-PortsAdminExtendedAttrsTestJSON-963148228 tempest-PortsAdminExtendedAttrsTestJSON-963148228-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:25.712747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229fbfa2-9b20-45af-98b8-89eef56bc822 tempest-PortsAdminExtendedAttrsTestJSON-963148228 tempest-PortsAdminExtendedAttrsTestJSON-963148228-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:25.713295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229fbfa2-9b20-45af-98b8-89eef56bc822 tempest-PortsAdminExtendedAttrsTestJSON-963148228 tempest-PortsAdminExtendedAttrsTestJSON-963148228-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:25.713970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229fbfa2-9b20-45af-98b8-89eef56bc822 tempest-PortsAdminExtendedAttrsTestJSON-963148228 tempest-PortsAdminExtendedAttrsTestJSON-963148228-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:25.751359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229fbfa2-9b20-45af-98b8-89eef56bc822 tempest-PortsAdminExtendedAttrsTestJSON-963148228 tempest-PortsAdminExtendedAttrsTestJSON-963148228-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:25.755249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229fbfa2-9b20-45af-98b8-89eef56bc822 tempest-PortsAdminExtendedAttrsTestJSON-963148228 tempest-PortsAdminExtendedAttrsTestJSON-963148228-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:25.761999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-229fbfa2-9b20-45af-98b8-89eef56bc822 tempest-PortsAdminExtendedAttrsTestJSON-963148228 tempest-PortsAdminExtendedAttrsTestJSON-963148228-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:25.782003 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-229fbfa2-9b20-45af-98b8-89eef56bc822 tempest-PortsAdminExtendedAttrsTestJSON-963148228 tempest-PortsAdminExtendedAttrsTestJSON-963148228-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.497138 Oct 24 10:50:25.786838 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2582/5200] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 10:50:25 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:50:25.791827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31453cb8-b7f1-4617-a227-7974276102eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:25.805485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31453cb8-b7f1-4617-a227-7974276102eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:25.813128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31453cb8-b7f1-4617-a227-7974276102eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:25.813850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31453cb8-b7f1-4617-a227-7974276102eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:25.814471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31453cb8-b7f1-4617-a227-7974276102eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:25.815375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31453cb8-b7f1-4617-a227-7974276102eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:25.816020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31453cb8-b7f1-4617-a227-7974276102eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:25.816622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31453cb8-b7f1-4617-a227-7974276102eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:26.917991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-31453cb8-b7f1-4617-a227-7974276102eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:26.922516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1f82a6e7-337a-444f-8822-9c2f00eb8a59 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:26.950866 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1f82a6e7-337a-444f-8822-9c2f00eb8a59 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1370 microversion: 2.1 time: 1.571124 Oct 24 10:50:26.973535 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2619/5201] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:25 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1370 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:50:26.979922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-31453cb8-b7f1-4617-a227-7974276102eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:26.987170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-31453cb8-b7f1-4617-a227-7974276102eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:26.995258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4bf505eb-47ff-4375-8dc8-d6171b66df6d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f397f07c-1f41-4bc3-800b-6b9f52928b24"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:50:26.999178 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31453cb8-b7f1-4617-a227-7974276102eb tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1605 microversion: 2.42 time: 1.209796 Oct 24 10:50:26.999808 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2583/5202] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:25 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1605 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:27.006823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4bf505eb-47ff-4375-8dc8-d6171b66df6d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:27.021394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bf505eb-47ff-4375-8dc8-d6171b66df6d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:27.022236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bf505eb-47ff-4375-8dc8-d6171b66df6d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:27.023497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bf505eb-47ff-4375-8dc8-d6171b66df6d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:27.025252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bf505eb-47ff-4375-8dc8-d6171b66df6d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:27.025955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bf505eb-47ff-4375-8dc8-d6171b66df6d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:27.026549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bf505eb-47ff-4375-8dc8-d6171b66df6d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:27.468263 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4bf505eb-47ff-4375-8dc8-d6171b66df6d tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "POST /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490834 Oct 24 10:50:27.476889 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2620/5203] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 10:50:26 2022] POST /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0/os-volume_attachments => generated 194 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:50:27.993851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-af1a8862-9133-42b3-b907-363f6c0134db tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:27.994938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-af1a8862-9133-42b3-b907-363f6c0134db tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:28.020588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af1a8862-9133-42b3-b907-363f6c0134db tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:28.020980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af1a8862-9133-42b3-b907-363f6c0134db tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:28.021439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af1a8862-9133-42b3-b907-363f6c0134db tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:28.022173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af1a8862-9133-42b3-b907-363f6c0134db tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:28.026931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af1a8862-9133-42b3-b907-363f6c0134db tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:28.027448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af1a8862-9133-42b3-b907-363f6c0134db tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:28.030170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-db52737d-c871-4d3d-801c-ab716dad4d62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:28.031578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-db52737d-c871-4d3d-801c-ab716dad4d62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:28.053461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db52737d-c871-4d3d-801c-ab716dad4d62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:28.055648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db52737d-c871-4d3d-801c-ab716dad4d62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:28.057400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db52737d-c871-4d3d-801c-ab716dad4d62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:28.061319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db52737d-c871-4d3d-801c-ab716dad4d62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:28.062035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db52737d-c871-4d3d-801c-ab716dad4d62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:28.063345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db52737d-c871-4d3d-801c-ab716dad4d62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:28.104586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:50:28.429343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-db52737d-c871-4d3d-801c-ab716dad4d62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:28.445260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-db52737d-c871-4d3d-801c-ab716dad4d62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:28.448020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-db52737d-c871-4d3d-801c-ab716dad4d62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:28.450454 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-db52737d-c871-4d3d-801c-ab716dad4d62 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1605 microversion: 2.42 time: 0.425759 Oct 24 10:50:28.454344 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2621/5204] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:28 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1605 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:28.735789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-af1a8862-9133-42b3-b907-363f6c0134db tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:28.749010 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-af1a8862-9133-42b3-b907-363f6c0134db tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1564 microversion: 2.1 time: 0.758639 Oct 24 10:50:28.755198 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2584/5205] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:27 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1564 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:28.775386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-de96a48b-bae4-4fe5-aed1-49fdc9cf0a04 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:28.775793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-de96a48b-bae4-4fe5-aed1-49fdc9cf0a04 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:28.785955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de96a48b-bae4-4fe5-aed1-49fdc9cf0a04 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:28.786440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de96a48b-bae4-4fe5-aed1-49fdc9cf0a04 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:28.787890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de96a48b-bae4-4fe5-aed1-49fdc9cf0a04 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:28.791821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de96a48b-bae4-4fe5-aed1-49fdc9cf0a04 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:28.792692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de96a48b-bae4-4fe5-aed1-49fdc9cf0a04 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:28.793360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de96a48b-bae4-4fe5-aed1-49fdc9cf0a04 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:29.050871 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-de96a48b-bae4-4fe5-aed1-49fdc9cf0a04 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.279787 Oct 24 10:50:29.051728 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2622/5206] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 10:50:28 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-interface => generated 285 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:50:29.180964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d16e79aa-89f1-416b-bd0d-3331f54be9c5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:29.181627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d16e79aa-89f1-416b-bd0d-3331f54be9c5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:29.195851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d16e79aa-89f1-416b-bd0d-3331f54be9c5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:29.196366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d16e79aa-89f1-416b-bd0d-3331f54be9c5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:29.197074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d16e79aa-89f1-416b-bd0d-3331f54be9c5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:29.197548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d16e79aa-89f1-416b-bd0d-3331f54be9c5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:29.198014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d16e79aa-89f1-416b-bd0d-3331f54be9c5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:29.198451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d16e79aa-89f1-416b-bd0d-3331f54be9c5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:29.572747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d16e79aa-89f1-416b-bd0d-3331f54be9c5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:29.584016 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d16e79aa-89f1-416b-bd0d-3331f54be9c5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1564 microversion: 2.1 time: 0.406995 Oct 24 10:50:29.596860 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2585/5207] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:29 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1564 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:29.597395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9766b11b-6fbd-4236-9752-8e0cf407523b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:29.598248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9766b11b-6fbd-4236-9752-8e0cf407523b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:29.622375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-69d753d7-9dea-4188-8b0c-f611e350ea6b req-ad368d0b-ef95-44a1-8695-08a70abbef07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7efbf530-723d-4ef0-855d-c38e0bb47cc7", "tag": "96d87680-c8c9-4cb5-b203-ef72c929ad05"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:50:29.638330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9766b11b-6fbd-4236-9752-8e0cf407523b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:29.639290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9766b11b-6fbd-4236-9752-8e0cf407523b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:29.639945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9766b11b-6fbd-4236-9752-8e0cf407523b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:29.641239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9766b11b-6fbd-4236-9752-8e0cf407523b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:29.641914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9766b11b-6fbd-4236-9752-8e0cf407523b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:29.642539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9766b11b-6fbd-4236-9752-8e0cf407523b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:29.643123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-69d753d7-9dea-4188-8b0c-f611e350ea6b req-ad368d0b-ef95-44a1-8695-08a70abbef07 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:29.643608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-69d753d7-9dea-4188-8b0c-f611e350ea6b req-ad368d0b-ef95-44a1-8695-08a70abbef07 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:29.644042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-69d753d7-9dea-4188-8b0c-f611e350ea6b req-ad368d0b-ef95-44a1-8695-08a70abbef07 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:29.675476 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-69d753d7-9dea-4188-8b0c-f611e350ea6b req-ad368d0b-ef95-44a1-8695-08a70abbef07 service nova] Creating event network-changed:96d87680-c8c9-4cb5-b203-ef72c929ad05 for instance 7efbf530-723d-4ef0-855d-c38e0bb47cc7 on n-h1-858383-15 Oct 24 10:50:29.690906 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-69d753d7-9dea-4188-8b0c-f611e350ea6b req-ad368d0b-ef95-44a1-8695-08a70abbef07 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.482609 Oct 24 10:50:29.691925 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2623/5208] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:50:29.874345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9766b11b-6fbd-4236-9752-8e0cf407523b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:29.884818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9766b11b-6fbd-4236-9752-8e0cf407523b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:29.886327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9766b11b-6fbd-4236-9752-8e0cf407523b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:29.887564 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9766b11b-6fbd-4236-9752-8e0cf407523b tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1605 microversion: 2.42 time: 0.300725 Oct 24 10:50:29.896987 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2586/5209] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:29 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1605 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:30.924001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2dca4b36-6ec5-4aed-9cf2-3e4ae0ac2f02 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:30.925455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2dca4b36-6ec5-4aed-9cf2-3e4ae0ac2f02 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:30.955639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2dca4b36-6ec5-4aed-9cf2-3e4ae0ac2f02 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:30.960676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2dca4b36-6ec5-4aed-9cf2-3e4ae0ac2f02 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:30.961850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2dca4b36-6ec5-4aed-9cf2-3e4ae0ac2f02 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:30.962625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2dca4b36-6ec5-4aed-9cf2-3e4ae0ac2f02 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:30.963173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2dca4b36-6ec5-4aed-9cf2-3e4ae0ac2f02 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:30.969034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2dca4b36-6ec5-4aed-9cf2-3e4ae0ac2f02 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:31.306975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2dca4b36-6ec5-4aed-9cf2-3e4ae0ac2f02 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:31.329991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2dca4b36-6ec5-4aed-9cf2-3e4ae0ac2f02 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:31.332242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2dca4b36-6ec5-4aed-9cf2-3e4ae0ac2f02 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95b808099e26413a9eaf4bba00069efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0233e99754464a45b8e92ebf909fa605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:31.346624 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2dca4b36-6ec5-4aed-9cf2-3e4ae0ac2f02 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 200 len: 1605 microversion: 2.42 time: 0.427416 Oct 24 10:50:31.347767 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2624/5210] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:30 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 1605 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:50:32.379203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-badf2809-2e5e-473e-87ad-47ad0a1c1735 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:32.379803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-badf2809-2e5e-473e-87ad-47ad0a1c1735 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:32.395931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-badf2809-2e5e-473e-87ad-47ad0a1c1735 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:32.396447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-badf2809-2e5e-473e-87ad-47ad0a1c1735 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:32.396920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-badf2809-2e5e-473e-87ad-47ad0a1c1735 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:32.397679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-badf2809-2e5e-473e-87ad-47ad0a1c1735 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:32.398144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-badf2809-2e5e-473e-87ad-47ad0a1c1735 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:32.398576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-badf2809-2e5e-473e-87ad-47ad0a1c1735 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:32.438076 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-badf2809-2e5e-473e-87ad-47ad0a1c1735 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] HTTP exception thrown: Instance 3c84caf0-0586-4590-b18c-684ef8e2a711 could not be found. Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-badf2809-2e5e-473e-87ad-47ad0a1c1735 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Request method failure captured: Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 HTTP/1.1 Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmxqB88n9w6hOfUYGmd5OkXXnnZ946HGWYSL9rI5lv6SWh56h_DuGqvoohj3l1AsdPYNR_EVwUhPjA1hLW85D1waSoCUuiVfzrKAHRiTUmndp0Peo8lOwQH_ag1PyNNcIW-9d5XUAcFMjaPc4gjwtkjVIwDq8QFIFsalqe4lO1Nw018 Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.42 Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 0233e99754464a45b8e92ebf909fa605 Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-799987665 Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0233e99754464a45b8e92ebf909fa605"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0233e99754464a45b8e92ebf909fa605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0233e99754464a45b8e92ebf909fa605"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0233e99754464a45b8e92ebf909fa605", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TaggedBootDevicesTest_v242-799987665 Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 0233e99754464a45b8e92ebf909fa605 Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-799987665 Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TaggedBootDevicesTest_v242-799987665-project Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 95b808099e26413a9eaf4bba00069efb Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TaggedBootDevicesTest_v242-799987665-project Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 3c84caf0-0586-4590-b18c-684ef8e2a711 could not be found. Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '3c84caf0-0586-4590-b18c-684ef8e2a711'} Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c84caf0-0586-4590-b18c-684ef8e2a711 could not be found. Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c84caf0-0586-4590-b18c-684ef8e2a711 could not be found. Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:32.438401 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:50:32.444015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:32.444015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:32.444015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:50:32.444015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:50:32.444015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:50:32.444015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:50:32.444015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c84caf0-0586-4590-b18c-684ef8e2a711 could not be found. Oct 24 10:50:32.444015 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:32.444015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-badf2809-2e5e-473e-87ad-47ad0a1c1735 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Returning 404 to user: Instance 3c84caf0-0586-4590-b18c-684ef8e2a711 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:50:32.444015 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-badf2809-2e5e-473e-87ad-47ad0a1c1735 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 404 len: 111 microversion: 2.42 time: 0.065071 Oct 24 10:50:32.444015 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2587/5211] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:32 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:50:32.450986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-35d64770-692d-452b-92aa-dd6513ec9557 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '.version_select at 0x7f04d04b3af0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:32.481894 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-35d64770-692d-452b-92aa-dd6513ec9557 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679326186" status: 204 len: 0 microversion: 2.42 time: 0.036645 Oct 24 10:50:32.487180 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2625/5212] 10.222.0.50 () {60 vars in 1262 bytes} [Mon Oct 24 10:50:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679326186 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:50:32.739953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c15eebf9-3722-4db9-87fe-2e621d1a929e req-41c1ee04-4713-42a7-a8a4-ff15b9947fdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f5b0075-c182-4a77-a15a-b904b39cc9c1", "tag": "9375a35b-fad3-4bd3-acee-11b80d2853cf"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:50:32.758766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c15eebf9-3722-4db9-87fe-2e621d1a929e req-41c1ee04-4713-42a7-a8a4-ff15b9947fdd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:32.761295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c15eebf9-3722-4db9-87fe-2e621d1a929e req-41c1ee04-4713-42a7-a8a4-ff15b9947fdd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:32.761955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c15eebf9-3722-4db9-87fe-2e621d1a929e req-41c1ee04-4713-42a7-a8a4-ff15b9947fdd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:32.792152 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c15eebf9-3722-4db9-87fe-2e621d1a929e req-41c1ee04-4713-42a7-a8a4-ff15b9947fdd service nova] Creating event network-changed:9375a35b-fad3-4bd3-acee-11b80d2853cf for instance 4f5b0075-c182-4a77-a15a-b904b39cc9c1 on n-h2-858383-15 Oct 24 10:50:32.803477 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c15eebf9-3722-4db9-87fe-2e621d1a929e req-41c1ee04-4713-42a7-a8a4-ff15b9947fdd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067486 Oct 24 10:50:32.804383 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2588/5213] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:50:38.260611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-56eb2456-0377-453c-8855-7df13f3a2870 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:38.261205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-56eb2456-0377-453c-8855-7df13f3a2870 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:38.273067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56eb2456-0377-453c-8855-7df13f3a2870 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:38.273560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56eb2456-0377-453c-8855-7df13f3a2870 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:38.274002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56eb2456-0377-453c-8855-7df13f3a2870 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:38.274713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56eb2456-0377-453c-8855-7df13f3a2870 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:38.275167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56eb2456-0377-453c-8855-7df13f3a2870 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:38.275593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56eb2456-0377-453c-8855-7df13f3a2870 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:38.294235 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-56eb2456-0377-453c-8855-7df13f3a2870 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] HTTP exception thrown: Instance 3c84caf0-0586-4590-b18c-684ef8e2a711 could not be found. Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-56eb2456-0377-453c-8855-7df13f3a2870 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Request method failure captured: Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 HTTP/1.1 Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVmxqB88n9w6hOfUYGmd5OkXXnnZ946HGWYSL9rI5lv6SWh56h_DuGqvoohj3l1AsdPYNR_EVwUhPjA1hLW85D1waSoCUuiVfzrKAHRiTUmndp0Peo8lOwQH_ag1PyNNcIW-9d5XUAcFMjaPc4gjwtkjVIwDq8QFIFsalqe4lO1Nw018 Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-Openstack-Nova-Api-Version: 2.42 Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 0233e99754464a45b8e92ebf909fa605 Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-799987665 Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0233e99754464a45b8e92ebf909fa605"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0233e99754464a45b8e92ebf909fa605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0233e99754464a45b8e92ebf909fa605"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0233e99754464a45b8e92ebf909fa605", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TaggedBootDevicesTest_v242-799987665 Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 0233e99754464a45b8e92ebf909fa605 Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-799987665 Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TaggedBootDevicesTest_v242-799987665-project Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 95b808099e26413a9eaf4bba00069efb Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TaggedBootDevicesTest_v242-799987665-project Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 3c84caf0-0586-4590-b18c-684ef8e2a711 could not be found. Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '3c84caf0-0586-4590-b18c-684ef8e2a711'} Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c84caf0-0586-4590-b18c-684ef8e2a711 could not be found. Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:50:38.296559 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:50:38.303113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c84caf0-0586-4590-b18c-684ef8e2a711 could not be found. Oct 24 10:50:38.303113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:50:38.303113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:50:38.303113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:50:38.303113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:38.303113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:50:38.303113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:50:38.303113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:50:38.303113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:50:38.303113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c84caf0-0586-4590-b18c-684ef8e2a711 could not be found. Oct 24 10:50:38.303113 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:50:38.303113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-56eb2456-0377-453c-8855-7df13f3a2870 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Returning 404 to user: Instance 3c84caf0-0586-4590-b18c-684ef8e2a711 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:50:38.303113 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-56eb2456-0377-453c-8855-7df13f3a2870 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 404 len: 111 microversion: 2.42 time: 0.042455 Oct 24 10:50:38.303113 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2626/5214] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:50:38 2022] DELETE /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:50:38.314834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e177aae-41a1-4ef3-b1c0-24ed43fe9ea6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:38.316682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e177aae-41a1-4ef3-b1c0-24ed43fe9ea6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] [instance: 3c84caf0-0586-4590-b18c-684ef8e2a711] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:38.323248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:50:38.326010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e177aae-41a1-4ef3-b1c0-24ed43fe9ea6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:38.328341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e177aae-41a1-4ef3-b1c0-24ed43fe9ea6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:38.333113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e177aae-41a1-4ef3-b1c0-24ed43fe9ea6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:38.334428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e177aae-41a1-4ef3-b1c0-24ed43fe9ea6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:38.334913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e177aae-41a1-4ef3-b1c0-24ed43fe9ea6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:38.335355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e177aae-41a1-4ef3-b1c0-24ed43fe9ea6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:38.360181 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-1e177aae-41a1-4ef3-b1c0-24ed43fe9ea6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] HTTP exception thrown: Instance 3c84caf0-0586-4590-b18c-684ef8e2a711 could not be found. Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e177aae-41a1-4ef3-b1c0-24ed43fe9ea6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Request method failure captured: Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 HTTP/1.1 Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVmxqB88n9w6hOfUYGmd5OkXXnnZ946HGWYSL9rI5lv6SWh56h_DuGqvoohj3l1AsdPYNR_EVwUhPjA1hLW85D1waSoCUuiVfzrKAHRiTUmndp0Peo8lOwQH_ag1PyNNcIW-9d5XUAcFMjaPc4gjwtkjVIwDq8QFIFsalqe4lO1Nw018 Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.42 Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 0233e99754464a45b8e92ebf909fa605 Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-799987665 Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0233e99754464a45b8e92ebf909fa605"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0233e99754464a45b8e92ebf909fa605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0233e99754464a45b8e92ebf909fa605"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0233e99754464a45b8e92ebf909fa605", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TaggedBootDevicesTest_v242-799987665 Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 0233e99754464a45b8e92ebf909fa605 Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-799987665 Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TaggedBootDevicesTest_v242-799987665-project Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 95b808099e26413a9eaf4bba00069efb Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TaggedBootDevicesTest_v242-799987665-project Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 3c84caf0-0586-4590-b18c-684ef8e2a711 could not be found. Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '3c84caf0-0586-4590-b18c-684ef8e2a711'} Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c84caf0-0586-4590-b18c-684ef8e2a711 could not be found. Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c84caf0-0586-4590-b18c-684ef8e2a711 could not be found. Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:38.362321 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:50:38.367738 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:38.367738 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:50:38.367738 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:50:38.367738 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:50:38.367738 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:50:38.367738 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:50:38.367738 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c84caf0-0586-4590-b18c-684ef8e2a711 could not be found. Oct 24 10:50:38.367738 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:50:38.367738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e177aae-41a1-4ef3-b1c0-24ed43fe9ea6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] Returning 404 to user: Instance 3c84caf0-0586-4590-b18c-684ef8e2a711 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:50:38.367738 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1e177aae-41a1-4ef3-b1c0-24ed43fe9ea6 tempest-TaggedBootDevicesTest_v242-799987665 tempest-TaggedBootDevicesTest_v242-799987665-project] 10.222.0.50 "GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711" status: 404 len: 111 microversion: 2.42 time: 0.056434 Oct 24 10:50:38.368619 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2589/5215] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:50:38 2022] GET /compute/v2.1/servers/3c84caf0-0586-4590-b18c-684ef8e2a711 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:50:44.091994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5e0e2cb7-f07e-4bfd-8aa7-7d3d1f0e1ba7 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:50:44.105626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e0e2cb7-f07e-4bfd-8aa7-7d3d1f0e1ba7 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:44.109078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e0e2cb7-f07e-4bfd-8aa7-7d3d1f0e1ba7 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:44.109635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e0e2cb7-f07e-4bfd-8aa7-7d3d1f0e1ba7 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:44.191886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5e0e2cb7-f07e-4bfd-8aa7-7d3d1f0e1ba7 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Going to try to stop instance {{(pid=120426) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 10:50:44.278511 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5e0e2cb7-f07e-4bfd-8aa7-7d3d1f0e1ba7 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "POST /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0/action" status: 202 len: 0 microversion: 2.1 time: 0.190526 Oct 24 10:50:44.279395 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2627/5216] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:50:44 2022] POST /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:50:44.294238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ae481ddc-977d-419b-935d-d8928b192f51 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:44.297847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ae481ddc-977d-419b-935d-d8928b192f51 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:44.324491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae481ddc-977d-419b-935d-d8928b192f51 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:44.325209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae481ddc-977d-419b-935d-d8928b192f51 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:44.330236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae481ddc-977d-419b-935d-d8928b192f51 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:44.331406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae481ddc-977d-419b-935d-d8928b192f51 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:44.332471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae481ddc-977d-419b-935d-d8928b192f51 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:44.334317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae481ddc-977d-419b-935d-d8928b192f51 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:44.580506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ae481ddc-977d-419b-935d-d8928b192f51 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:44.593920 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ae481ddc-977d-419b-935d-d8928b192f51 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1723 microversion: 2.1 time: 0.310022 Oct 24 10:50:44.599013 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2590/5217] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:44 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:45.632872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dc3d8529-b561-4cc9-8c07-48cbf5735fbe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:45.634331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dc3d8529-b561-4cc9-8c07-48cbf5735fbe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:45.654051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc3d8529-b561-4cc9-8c07-48cbf5735fbe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:45.654629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc3d8529-b561-4cc9-8c07-48cbf5735fbe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:45.655378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc3d8529-b561-4cc9-8c07-48cbf5735fbe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:45.656280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc3d8529-b561-4cc9-8c07-48cbf5735fbe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:45.656718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc3d8529-b561-4cc9-8c07-48cbf5735fbe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:45.657084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc3d8529-b561-4cc9-8c07-48cbf5735fbe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:45.877350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dc3d8529-b561-4cc9-8c07-48cbf5735fbe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:45.886632 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dc3d8529-b561-4cc9-8c07-48cbf5735fbe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1723 microversion: 2.1 time: 0.258989 Oct 24 10:50:45.886632 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2628/5218] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:45 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:46.912105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aae5defc-35eb-4f75-8e83-94a3d94e6141 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:46.912923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aae5defc-35eb-4f75-8e83-94a3d94e6141 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:46.923306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aae5defc-35eb-4f75-8e83-94a3d94e6141 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:46.924065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aae5defc-35eb-4f75-8e83-94a3d94e6141 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:46.924850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aae5defc-35eb-4f75-8e83-94a3d94e6141 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:46.925809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aae5defc-35eb-4f75-8e83-94a3d94e6141 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:46.926554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aae5defc-35eb-4f75-8e83-94a3d94e6141 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:46.927208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aae5defc-35eb-4f75-8e83-94a3d94e6141 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:47.204292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aae5defc-35eb-4f75-8e83-94a3d94e6141 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:47.213996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:50:47.220395 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aae5defc-35eb-4f75-8e83-94a3d94e6141 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1723 microversion: 2.1 time: 0.311379 Oct 24 10:50:47.221234 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2591/5219] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:46 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:48.248406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-69081737-91a7-4869-84dd-5c695064ad68 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:48.257805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-69081737-91a7-4869-84dd-5c695064ad68 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:48.276745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69081737-91a7-4869-84dd-5c695064ad68 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:48.277364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69081737-91a7-4869-84dd-5c695064ad68 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:48.277880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69081737-91a7-4869-84dd-5c695064ad68 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:48.278676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69081737-91a7-4869-84dd-5c695064ad68 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:48.279198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69081737-91a7-4869-84dd-5c695064ad68 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:48.285714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69081737-91a7-4869-84dd-5c695064ad68 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:48.526704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-69081737-91a7-4869-84dd-5c695064ad68 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:48.542359 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-69081737-91a7-4869-84dd-5c695064ad68 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1723 microversion: 2.1 time: 0.297686 Oct 24 10:50:48.543275 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2629/5220] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:48 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:49.575911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6a2eecb7-a1c8-4b64-a5b5-39ae508dd369 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:49.588081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6a2eecb7-a1c8-4b64-a5b5-39ae508dd369 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:49.599481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a2eecb7-a1c8-4b64-a5b5-39ae508dd369 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:49.600260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a2eecb7-a1c8-4b64-a5b5-39ae508dd369 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:49.601157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a2eecb7-a1c8-4b64-a5b5-39ae508dd369 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:49.602767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a2eecb7-a1c8-4b64-a5b5-39ae508dd369 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:49.603514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a2eecb7-a1c8-4b64-a5b5-39ae508dd369 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:49.604306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a2eecb7-a1c8-4b64-a5b5-39ae508dd369 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:49.823429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6a2eecb7-a1c8-4b64-a5b5-39ae508dd369 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:49.835277 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6a2eecb7-a1c8-4b64-a5b5-39ae508dd369 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1723 microversion: 2.1 time: 0.270452 Oct 24 10:50:49.836518 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2592/5221] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:49 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:50.870867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8f1e8251-54f0-4687-afe2-56a9924a4109 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:50.878932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8f1e8251-54f0-4687-afe2-56a9924a4109 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:50.887860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:50:50.890601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f1e8251-54f0-4687-afe2-56a9924a4109 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:50.891560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f1e8251-54f0-4687-afe2-56a9924a4109 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:50.892181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f1e8251-54f0-4687-afe2-56a9924a4109 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:50.893348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f1e8251-54f0-4687-afe2-56a9924a4109 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:50.894367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f1e8251-54f0-4687-afe2-56a9924a4109 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:50.895059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f1e8251-54f0-4687-afe2-56a9924a4109 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:51.114438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8f1e8251-54f0-4687-afe2-56a9924a4109 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:51.129565 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8f1e8251-54f0-4687-afe2-56a9924a4109 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1723 microversion: 2.1 time: 0.263050 Oct 24 10:50:51.130483 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2630/5222] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:50 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:52.156352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e459d88-5fe6-4557-b20e-8578852810be tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:52.157605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e459d88-5fe6-4557-b20e-8578852810be tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:52.183380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e459d88-5fe6-4557-b20e-8578852810be tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:52.183888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e459d88-5fe6-4557-b20e-8578852810be tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:52.184334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e459d88-5fe6-4557-b20e-8578852810be tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:52.185349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e459d88-5fe6-4557-b20e-8578852810be tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:52.186029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e459d88-5fe6-4557-b20e-8578852810be tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:52.187023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e459d88-5fe6-4557-b20e-8578852810be tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:52.533603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1e459d88-5fe6-4557-b20e-8578852810be tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:52.548708 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1e459d88-5fe6-4557-b20e-8578852810be tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1723 microversion: 2.1 time: 0.394026 Oct 24 10:50:52.549582 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2593/5223] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:52 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1723 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:53.582750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cfe0d18d-bee8-4776-8a00-35e043631d88 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:53.583898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cfe0d18d-bee8-4776-8a00-35e043631d88 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:53.599214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfe0d18d-bee8-4776-8a00-35e043631d88 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:53.600025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfe0d18d-bee8-4776-8a00-35e043631d88 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:53.600960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfe0d18d-bee8-4776-8a00-35e043631d88 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:53.602005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfe0d18d-bee8-4776-8a00-35e043631d88 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:53.603369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfe0d18d-bee8-4776-8a00-35e043631d88 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:53.605227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfe0d18d-bee8-4776-8a00-35e043631d88 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:53.899465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cfe0d18d-bee8-4776-8a00-35e043631d88 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:53.924133 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cfe0d18d-bee8-4776-8a00-35e043631d88 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1723 microversion: 2.1 time: 0.352777 Oct 24 10:50:53.940863 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2631/5224] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:53 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1723 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:54.953976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf1422df-0814-4441-8a16-9e918700f9a6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:54.954576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf1422df-0814-4441-8a16-9e918700f9a6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:54.964061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf1422df-0814-4441-8a16-9e918700f9a6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:54.964896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf1422df-0814-4441-8a16-9e918700f9a6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:54.965636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf1422df-0814-4441-8a16-9e918700f9a6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:54.967545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf1422df-0814-4441-8a16-9e918700f9a6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:54.968665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf1422df-0814-4441-8a16-9e918700f9a6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:54.969558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf1422df-0814-4441-8a16-9e918700f9a6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:55.453006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cf1422df-0814-4441-8a16-9e918700f9a6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:55.469214 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf1422df-0814-4441-8a16-9e918700f9a6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1723 microversion: 2.1 time: 0.519925 Oct 24 10:50:55.472973 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2594/5225] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:54 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1723 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:56.506908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-398f2967-1a2e-4499-8227-888736e308fb tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:56.508157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-398f2967-1a2e-4499-8227-888736e308fb tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:56.527083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-398f2967-1a2e-4499-8227-888736e308fb tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:56.533847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-398f2967-1a2e-4499-8227-888736e308fb tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:56.534673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-398f2967-1a2e-4499-8227-888736e308fb tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:56.545818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-398f2967-1a2e-4499-8227-888736e308fb tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:56.546748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-398f2967-1a2e-4499-8227-888736e308fb tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:56.547398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-398f2967-1a2e-4499-8227-888736e308fb tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:56.964283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-398f2967-1a2e-4499-8227-888736e308fb tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:56.995199 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-398f2967-1a2e-4499-8227-888736e308fb tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1723 microversion: 2.1 time: 0.496790 Oct 24 10:50:56.996253 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2632/5226] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:56 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1723 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:58.028080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-73765a4e-d34e-45ee-9880-3ce8127e4147 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:58.028930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-73765a4e-d34e-45ee-9880-3ce8127e4147 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:58.043586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73765a4e-d34e-45ee-9880-3ce8127e4147 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:58.044093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73765a4e-d34e-45ee-9880-3ce8127e4147 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:58.044539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73765a4e-d34e-45ee-9880-3ce8127e4147 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:58.045363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73765a4e-d34e-45ee-9880-3ce8127e4147 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:58.049468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73765a4e-d34e-45ee-9880-3ce8127e4147 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:58.049912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73765a4e-d34e-45ee-9880-3ce8127e4147 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:58.463931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-73765a4e-d34e-45ee-9880-3ce8127e4147 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:50:58.477747 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-73765a4e-d34e-45ee-9880-3ce8127e4147 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1723 microversion: 2.1 time: 0.454544 Oct 24 10:50:58.491925 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2595/5227] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:58 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1723 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:50:58.736241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3dcf92e3-6762-4d72-b7a2-c53076df42a5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:50:58.739760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3dcf92e3-6762-4d72-b7a2-c53076df42a5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:58.756641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dcf92e3-6762-4d72-b7a2-c53076df42a5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:58.757186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dcf92e3-6762-4d72-b7a2-c53076df42a5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:58.757641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dcf92e3-6762-4d72-b7a2-c53076df42a5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:58.758359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dcf92e3-6762-4d72-b7a2-c53076df42a5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:58.758821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dcf92e3-6762-4d72-b7a2-c53076df42a5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:58.759255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dcf92e3-6762-4d72-b7a2-c53076df42a5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:58.774966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:50:58.860421 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3dcf92e3-6762-4d72-b7a2-c53076df42a5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7/action" status: 200 len: 24568 microversion: 2.1 time: 0.128577 Oct 24 10:50:58.861490 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2633/5228] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:50:58 2022] POST /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7/action => generated 24568 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:50:59.505292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-65cddf7d-5281-4532-bd2f-2a1a7183c603 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:50:59.505925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-65cddf7d-5281-4532-bd2f-2a1a7183c603 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:50:59.516374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65cddf7d-5281-4532-bd2f-2a1a7183c603 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:59.517426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65cddf7d-5281-4532-bd2f-2a1a7183c603 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:59.518085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65cddf7d-5281-4532-bd2f-2a1a7183c603 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:50:59.518821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65cddf7d-5281-4532-bd2f-2a1a7183c603 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:50:59.519463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65cddf7d-5281-4532-bd2f-2a1a7183c603 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:50:59.520347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65cddf7d-5281-4532-bd2f-2a1a7183c603 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:00.040497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-65cddf7d-5281-4532-bd2f-2a1a7183c603 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:00.060288 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-65cddf7d-5281-4532-bd2f-2a1a7183c603 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1723 microversion: 2.1 time: 0.559065 Oct 24 10:51:00.063068 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2596/5229] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:50:59 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1723 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:01.093077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-500679d4-2cef-4dc2-b75d-03aeb75cbfc0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:01.093882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-500679d4-2cef-4dc2-b75d-03aeb75cbfc0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:01.139666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-500679d4-2cef-4dc2-b75d-03aeb75cbfc0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:01.140666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-500679d4-2cef-4dc2-b75d-03aeb75cbfc0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:01.141678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-500679d4-2cef-4dc2-b75d-03aeb75cbfc0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:01.142760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-500679d4-2cef-4dc2-b75d-03aeb75cbfc0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:01.143456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-500679d4-2cef-4dc2-b75d-03aeb75cbfc0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:01.144122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-500679d4-2cef-4dc2-b75d-03aeb75cbfc0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:02.016348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-500679d4-2cef-4dc2-b75d-03aeb75cbfc0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:02.026975 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-500679d4-2cef-4dc2-b75d-03aeb75cbfc0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1723 microversion: 2.1 time: 0.940118 Oct 24 10:51:02.027576 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2634/5230] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:01 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1723 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:51:03.052997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6e9b5a98-33a2-4158-a7a5-34157332ec02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:03.054311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6e9b5a98-33a2-4158-a7a5-34157332ec02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:03.068249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e9b5a98-33a2-4158-a7a5-34157332ec02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:03.070497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e9b5a98-33a2-4158-a7a5-34157332ec02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:03.072538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e9b5a98-33a2-4158-a7a5-34157332ec02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:03.073541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e9b5a98-33a2-4158-a7a5-34157332ec02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:03.074017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e9b5a98-33a2-4158-a7a5-34157332ec02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:03.075744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e9b5a98-33a2-4158-a7a5-34157332ec02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:03.297957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6e9b5a98-33a2-4158-a7a5-34157332ec02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:03.309107 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6e9b5a98-33a2-4158-a7a5-34157332ec02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1723 microversion: 2.1 time: 0.260733 Oct 24 10:51:03.310009 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2597/5231] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:03 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:04.335717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fb5feffb-4379-46fa-9b7d-5cff839fc924 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:04.337026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fb5feffb-4379-46fa-9b7d-5cff839fc924 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:04.351224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb5feffb-4379-46fa-9b7d-5cff839fc924 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:04.351739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb5feffb-4379-46fa-9b7d-5cff839fc924 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:04.352192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb5feffb-4379-46fa-9b7d-5cff839fc924 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:04.353060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb5feffb-4379-46fa-9b7d-5cff839fc924 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:04.354193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb5feffb-4379-46fa-9b7d-5cff839fc924 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:04.354193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb5feffb-4379-46fa-9b7d-5cff839fc924 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:04.626314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-457ebea2-cdfd-484c-9655-bc8d63d8f8f3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95392bd9-92c6-4f7d-91bb-53ee1a06ce32"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:51:04.629989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-457ebea2-cdfd-484c-9655-bc8d63d8f8f3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:04.642530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-457ebea2-cdfd-484c-9655-bc8d63d8f8f3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:04.643419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-457ebea2-cdfd-484c-9655-bc8d63d8f8f3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:04.644123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-457ebea2-cdfd-484c-9655-bc8d63d8f8f3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:04.645404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-457ebea2-cdfd-484c-9655-bc8d63d8f8f3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:04.646186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-457ebea2-cdfd-484c-9655-bc8d63d8f8f3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:04.646997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-457ebea2-cdfd-484c-9655-bc8d63d8f8f3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:04.653039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fb5feffb-4379-46fa-9b7d-5cff839fc924 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:04.669694 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fb5feffb-4379-46fa-9b7d-5cff839fc924 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1723 microversion: 2.1 time: 0.337707 Oct 24 10:51:04.673757 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2635/5232] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:04 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1723 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:05.256952 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-457ebea2-cdfd-484c-9655-bc8d63d8f8f3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "POST /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.635838 Oct 24 10:51:05.275349 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2598/5233] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 10:51:04 2022] POST /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments => generated 194 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:51:05.698762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dee68c75-bd70-4682-8c0a-ba25744de58e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:05.699958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dee68c75-bd70-4682-8c0a-ba25744de58e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:05.729954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dee68c75-bd70-4682-8c0a-ba25744de58e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:05.730482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dee68c75-bd70-4682-8c0a-ba25744de58e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:05.730939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dee68c75-bd70-4682-8c0a-ba25744de58e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:05.734169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dee68c75-bd70-4682-8c0a-ba25744de58e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:05.734669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dee68c75-bd70-4682-8c0a-ba25744de58e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:05.735112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dee68c75-bd70-4682-8c0a-ba25744de58e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:06.772300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dee68c75-bd70-4682-8c0a-ba25744de58e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:06.785552 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dee68c75-bd70-4682-8c0a-ba25744de58e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1700 microversion: 2.1 time: 1.091000 Oct 24 10:51:06.801029 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2636/5234] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:05 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1700 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:06.821124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e57c061c-fa1e-4895-b19e-3cd4fa5f0d98 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:51:06.837002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e57c061c-fa1e-4895-b19e-3cd4fa5f0d98 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:06.837774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e57c061c-fa1e-4895-b19e-3cd4fa5f0d98 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:06.838388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e57c061c-fa1e-4895-b19e-3cd4fa5f0d98 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:06.913090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e57c061c-fa1e-4895-b19e-3cd4fa5f0d98 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Going to try to start instance {{(pid=120425) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 10:51:07.037789 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e57c061c-fa1e-4895-b19e-3cd4fa5f0d98 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "POST /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0/action" status: 202 len: 0 microversion: 2.1 time: 0.221738 Oct 24 10:51:07.038715 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2599/5235] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:51:06 2022] POST /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:51:07.047169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-564192f3-d58b-4116-9847-009b6738afd1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:07.047799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-564192f3-d58b-4116-9847-009b6738afd1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:07.068865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-564192f3-d58b-4116-9847-009b6738afd1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:07.069419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-564192f3-d58b-4116-9847-009b6738afd1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:07.069879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-564192f3-d58b-4116-9847-009b6738afd1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:07.070689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-564192f3-d58b-4116-9847-009b6738afd1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:07.071427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-564192f3-d58b-4116-9847-009b6738afd1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:07.071688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-564192f3-d58b-4116-9847-009b6738afd1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:07.663406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-564192f3-d58b-4116-9847-009b6738afd1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:07.682968 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-564192f3-d58b-4116-9847-009b6738afd1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1709 microversion: 2.1 time: 0.640074 Oct 24 10:51:07.683900 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2637/5236] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:07 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1709 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:08.713033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b1e546be-2b25-49f3-80c9-19ce88d0b7b9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:08.713744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b1e546be-2b25-49f3-80c9-19ce88d0b7b9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:08.716005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=22 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:51:08.729425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1e546be-2b25-49f3-80c9-19ce88d0b7b9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:08.729921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1e546be-2b25-49f3-80c9-19ce88d0b7b9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:08.734435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1e546be-2b25-49f3-80c9-19ce88d0b7b9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:08.737597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1e546be-2b25-49f3-80c9-19ce88d0b7b9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:08.738370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1e546be-2b25-49f3-80c9-19ce88d0b7b9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:08.738991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1e546be-2b25-49f3-80c9-19ce88d0b7b9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:09.204296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b1e546be-2b25-49f3-80c9-19ce88d0b7b9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:09.223879 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b1e546be-2b25-49f3-80c9-19ce88d0b7b9 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1709 microversion: 2.1 time: 0.516339 Oct 24 10:51:09.227236 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2600/5237] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:08 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1709 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:10.253757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2a41be27-894a-4ee9-9589-26defe4c3645 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:10.255921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2a41be27-894a-4ee9-9589-26defe4c3645 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:10.276924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a41be27-894a-4ee9-9589-26defe4c3645 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:10.278106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a41be27-894a-4ee9-9589-26defe4c3645 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:10.279303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a41be27-894a-4ee9-9589-26defe4c3645 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:10.285402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a41be27-894a-4ee9-9589-26defe4c3645 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:10.285902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a41be27-894a-4ee9-9589-26defe4c3645 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:10.286355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2a41be27-894a-4ee9-9589-26defe4c3645 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:10.991087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2a41be27-894a-4ee9-9589-26defe4c3645 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:11.005380 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2a41be27-894a-4ee9-9589-26defe4c3645 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1713 microversion: 2.1 time: 0.755417 Oct 24 10:51:11.009554 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2638/5238] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:10 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1713 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:20.871351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:51:20.873541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:51:21.195458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-58557799-9908-446f-8438-80871d12b38a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1267717173", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "d0565b5e-a34e-45b1-aa8c-c4fddfcb907f"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:51:21.330427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-58557799-9908-446f-8438-80871d12b38a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] validate_networks() for [('d0565b5e-a34e-45b1-aa8c-c4fddfcb907f', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:51:22.384606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-58557799-9908-446f-8438-80871d12b38a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:51:22.385216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-58557799-9908-446f-8438-80871d12b38a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:51:22.385541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-58557799-9908-446f-8438-80871d12b38a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:51:22.386090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-58557799-9908-446f-8438-80871d12b38a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:51:22.386462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-58557799-9908-446f-8438-80871d12b38a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:51:22.398092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58557799-9908-446f-8438-80871d12b38a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:22.398642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58557799-9908-446f-8438-80871d12b38a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:22.399370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58557799-9908-446f-8438-80871d12b38a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:22.400158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58557799-9908-446f-8438-80871d12b38a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:22.414131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58557799-9908-446f-8438-80871d12b38a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:22.414809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58557799-9908-446f-8438-80871d12b38a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:22.427105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bd85ea9f-2734-4417-b8f1-da5fe552fba3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:51:22.433032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bd85ea9f-2734-4417-b8f1-da5fe552fba3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:22.445998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-58557799-9908-446f-8438-80871d12b38a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Getting quotas for project e251fc8c08ed4437bdc3d71c53f9c804. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:51:22.452982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-58557799-9908-446f-8438-80871d12b38a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Getting quotas for user ed4c248f15e04c969d576bce28f9bd7a and project e251fc8c08ed4437bdc3d71c53f9c804. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:51:22.458937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=17 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:51:22.467011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=33 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:51:22.468558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd85ea9f-2734-4417-b8f1-da5fe552fba3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:22.469160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd85ea9f-2734-4417-b8f1-da5fe552fba3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:22.469614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd85ea9f-2734-4417-b8f1-da5fe552fba3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:22.470323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd85ea9f-2734-4417-b8f1-da5fe552fba3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:22.470799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd85ea9f-2734-4417-b8f1-da5fe552fba3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:22.473271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-58557799-9908-446f-8438-80871d12b38a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:51:22.476240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-58557799-9908-446f-8438-80871d12b38a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:51:22.485477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd85ea9f-2734-4417-b8f1-da5fe552fba3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:22.547915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-bd85ea9f-2734-4417-b8f1-da5fe552fba3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lazy-loading 'flavor' on Instance uuid 4f5b0075-c182-4a77-a15a-b904b39cc9c1 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:51:22.578120 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-58557799-9908-446f-8438-80871d12b38a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.714946 Oct 24 10:51:22.585343 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2601/5239] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:51:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:51:22.596211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7c8fb37e-cb5e-42d4-89d2-e68005750545 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:22.597358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7c8fb37e-cb5e-42d4-89d2-e68005750545 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:22.734758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7c8fb37e-cb5e-42d4-89d2-e68005750545 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4c248f15e04c969d576bce28f9bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e251fc8c08ed4437bdc3d71c53f9c804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:22.748051 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7c8fb37e-cb5e-42d4-89d2-e68005750545 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 200 len: 1225 microversion: 2.1 time: 0.158491 Oct 24 10:51:22.751081 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2602/5240] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:22 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 1225 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:22.892649 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bd85ea9f-2734-4417-b8f1-da5fe552fba3 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "POST /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/action" status: 200 len: 32 microversion: 2.1 time: 0.469645 Oct 24 10:51:22.898069 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2639/5241] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:51:22 2022] POST /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/action => generated 32 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 10:51:22.911912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b51a2d02-0012-4ced-9665-fd11dbcbb79c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:22.912545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b51a2d02-0012-4ced-9665-fd11dbcbb79c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:22.943271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b51a2d02-0012-4ced-9665-fd11dbcbb79c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:22.943783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b51a2d02-0012-4ced-9665-fd11dbcbb79c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:22.959123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b51a2d02-0012-4ced-9665-fd11dbcbb79c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:22.960636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b51a2d02-0012-4ced-9665-fd11dbcbb79c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:22.961754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b51a2d02-0012-4ced-9665-fd11dbcbb79c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:22.966056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b51a2d02-0012-4ced-9665-fd11dbcbb79c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:23.778145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a9a5014a-a5b7-4fc3-9219-aea499b54f47 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:23.778973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a9a5014a-a5b7-4fc3-9219-aea499b54f47 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:23.795601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9a5014a-a5b7-4fc3-9219-aea499b54f47 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:23.796101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9a5014a-a5b7-4fc3-9219-aea499b54f47 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:23.796540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9a5014a-a5b7-4fc3-9219-aea499b54f47 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:23.797352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9a5014a-a5b7-4fc3-9219-aea499b54f47 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:23.797810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9a5014a-a5b7-4fc3-9219-aea499b54f47 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:23.798673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9a5014a-a5b7-4fc3-9219-aea499b54f47 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:23.815988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b51a2d02-0012-4ced-9665-fd11dbcbb79c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:23.831794 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b51a2d02-0012-4ced-9665-fd11dbcbb79c tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 0.927920 Oct 24 10:51:23.836544 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2603/5242] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:22 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:23.991962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a9a5014a-a5b7-4fc3-9219-aea499b54f47 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4c248f15e04c969d576bce28f9bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e251fc8c08ed4437bdc3d71c53f9c804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:24.007355 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a9a5014a-a5b7-4fc3-9219-aea499b54f47 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 200 len: 1221 microversion: 2.1 time: 0.232505 Oct 24 10:51:24.011154 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2640/5243] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:23 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 1221 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:24.862293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-087c1c2b-742c-4e51-8764-34e28b95e7ca tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:24.863542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-087c1c2b-742c-4e51-8764-34e28b95e7ca tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:24.890106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-087c1c2b-742c-4e51-8764-34e28b95e7ca tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:24.891153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-087c1c2b-742c-4e51-8764-34e28b95e7ca tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:24.892071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-087c1c2b-742c-4e51-8764-34e28b95e7ca tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:24.898839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-087c1c2b-742c-4e51-8764-34e28b95e7ca tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:24.899883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-087c1c2b-742c-4e51-8764-34e28b95e7ca tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:24.900550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-087c1c2b-742c-4e51-8764-34e28b95e7ca tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:25.033735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8c6166c6-c715-4a22-b4ef-17ca92c06075 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:25.034352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8c6166c6-c715-4a22-b4ef-17ca92c06075 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:25.048709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c6166c6-c715-4a22-b4ef-17ca92c06075 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:25.049501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c6166c6-c715-4a22-b4ef-17ca92c06075 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:25.050143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c6166c6-c715-4a22-b4ef-17ca92c06075 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:25.051053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c6166c6-c715-4a22-b4ef-17ca92c06075 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:25.051736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c6166c6-c715-4a22-b4ef-17ca92c06075 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:25.057456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c6166c6-c715-4a22-b4ef-17ca92c06075 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:25.179815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8c6166c6-c715-4a22-b4ef-17ca92c06075 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4c248f15e04c969d576bce28f9bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e251fc8c08ed4437bdc3d71c53f9c804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:25.192345 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8c6166c6-c715-4a22-b4ef-17ca92c06075 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 200 len: 1283 microversion: 2.1 time: 0.159048 Oct 24 10:51:25.193305 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2641/5244] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:25 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 1283 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:51:25.291767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-087c1c2b-742c-4e51-8764-34e28b95e7ca tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:25.301672 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-087c1c2b-742c-4e51-8764-34e28b95e7ca tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 0.444488 Oct 24 10:51:25.307970 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2604/5245] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:24 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:26.224629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0f28bcf5-fac5-4af2-b4f2-a26db48f0a2b tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:26.226065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0f28bcf5-fac5-4af2-b4f2-a26db48f0a2b tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:26.243677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f28bcf5-fac5-4af2-b4f2-a26db48f0a2b tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:26.244508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f28bcf5-fac5-4af2-b4f2-a26db48f0a2b tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:26.246655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f28bcf5-fac5-4af2-b4f2-a26db48f0a2b tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:26.250450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f28bcf5-fac5-4af2-b4f2-a26db48f0a2b tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:26.251228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f28bcf5-fac5-4af2-b4f2-a26db48f0a2b tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:26.251913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f28bcf5-fac5-4af2-b4f2-a26db48f0a2b tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:26.332952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ec18f79e-2a24-4a0a-8f11-9e212caf7d40 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:26.334181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ec18f79e-2a24-4a0a-8f11-9e212caf7d40 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:26.351124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec18f79e-2a24-4a0a-8f11-9e212caf7d40 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:26.352501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec18f79e-2a24-4a0a-8f11-9e212caf7d40 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:26.354568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec18f79e-2a24-4a0a-8f11-9e212caf7d40 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:26.355695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec18f79e-2a24-4a0a-8f11-9e212caf7d40 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:26.356387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec18f79e-2a24-4a0a-8f11-9e212caf7d40 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:26.358474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec18f79e-2a24-4a0a-8f11-9e212caf7d40 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:26.396564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0f28bcf5-fac5-4af2-b4f2-a26db48f0a2b tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4c248f15e04c969d576bce28f9bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e251fc8c08ed4437bdc3d71c53f9c804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:26.411166 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0f28bcf5-fac5-4af2-b4f2-a26db48f0a2b tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 200 len: 1283 microversion: 2.1 time: 0.197787 Oct 24 10:51:26.413238 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2642/5246] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:26 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 1283 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:26.763561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ec18f79e-2a24-4a0a-8f11-9e212caf7d40 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:26.790427 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ec18f79e-2a24-4a0a-8f11-9e212caf7d40 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 0.460453 Oct 24 10:51:26.793124 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2605/5247] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:26 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:51:27.437733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d92e11db-c526-4ab5-93cc-a5979ce29a9d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:27.438687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d92e11db-c526-4ab5-93cc-a5979ce29a9d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:27.453518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d92e11db-c526-4ab5-93cc-a5979ce29a9d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:27.458173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d92e11db-c526-4ab5-93cc-a5979ce29a9d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:27.458741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d92e11db-c526-4ab5-93cc-a5979ce29a9d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:27.462611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d92e11db-c526-4ab5-93cc-a5979ce29a9d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:27.463340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d92e11db-c526-4ab5-93cc-a5979ce29a9d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:27.465164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d92e11db-c526-4ab5-93cc-a5979ce29a9d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:27.633628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d92e11db-c526-4ab5-93cc-a5979ce29a9d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4c248f15e04c969d576bce28f9bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e251fc8c08ed4437bdc3d71c53f9c804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:27.647619 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d92e11db-c526-4ab5-93cc-a5979ce29a9d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 200 len: 1283 microversion: 2.1 time: 0.214860 Oct 24 10:51:27.648606 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2643/5248] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:27 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 1283 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:27.824979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cb03e57f-530e-418a-b497-cff081e6770a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:27.825968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cb03e57f-530e-418a-b497-cff081e6770a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:27.848335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb03e57f-530e-418a-b497-cff081e6770a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:27.849356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb03e57f-530e-418a-b497-cff081e6770a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:27.850150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb03e57f-530e-418a-b497-cff081e6770a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:27.851917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb03e57f-530e-418a-b497-cff081e6770a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:27.855704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb03e57f-530e-418a-b497-cff081e6770a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:27.857759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb03e57f-530e-418a-b497-cff081e6770a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:28.675714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d3f59b0a-7248-4488-a7c7-6cfdffd0177f tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:28.677139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d3f59b0a-7248-4488-a7c7-6cfdffd0177f tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:28.693996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3f59b0a-7248-4488-a7c7-6cfdffd0177f tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:28.698020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3f59b0a-7248-4488-a7c7-6cfdffd0177f tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:28.698690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3f59b0a-7248-4488-a7c7-6cfdffd0177f tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:28.699637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3f59b0a-7248-4488-a7c7-6cfdffd0177f tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:28.702445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3f59b0a-7248-4488-a7c7-6cfdffd0177f tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:28.703264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3f59b0a-7248-4488-a7c7-6cfdffd0177f tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:28.705469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cb03e57f-530e-418a-b497-cff081e6770a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:28.718816 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cb03e57f-530e-418a-b497-cff081e6770a tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 0.904252 Oct 24 10:51:28.719565 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2606/5249] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:27 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:51:29.007700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d3f59b0a-7248-4488-a7c7-6cfdffd0177f tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4c248f15e04c969d576bce28f9bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e251fc8c08ed4437bdc3d71c53f9c804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:29.028769 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d3f59b0a-7248-4488-a7c7-6cfdffd0177f tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 200 len: 1325 microversion: 2.1 time: 0.350979 Oct 24 10:51:29.031467 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2644/5250] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:28 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 1325 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:51:29.743959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e9b42e6e-7556-4f63-b0d1-0dc53d4bc524 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:29.744583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e9b42e6e-7556-4f63-b0d1-0dc53d4bc524 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:29.760255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9b42e6e-7556-4f63-b0d1-0dc53d4bc524 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:29.762061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9b42e6e-7556-4f63-b0d1-0dc53d4bc524 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:29.762671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9b42e6e-7556-4f63-b0d1-0dc53d4bc524 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:29.763580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9b42e6e-7556-4f63-b0d1-0dc53d4bc524 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:29.765540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9b42e6e-7556-4f63-b0d1-0dc53d4bc524 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:29.766369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9b42e6e-7556-4f63-b0d1-0dc53d4bc524 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:30.006660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9b42e6e-7556-4f63-b0d1-0dc53d4bc524 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:30.022208 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e9b42e6e-7556-4f63-b0d1-0dc53d4bc524 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 0.282192 Oct 24 10:51:30.038837 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2607/5251] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:29 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:30.055737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-80be7e85-f100-41a0-864d-02925145fd02 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:30.056329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-80be7e85-f100-41a0-864d-02925145fd02 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:30.065758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80be7e85-f100-41a0-864d-02925145fd02 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:30.066534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80be7e85-f100-41a0-864d-02925145fd02 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:30.067177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80be7e85-f100-41a0-864d-02925145fd02 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:30.068067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80be7e85-f100-41a0-864d-02925145fd02 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:30.068895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80be7e85-f100-41a0-864d-02925145fd02 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:30.069535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80be7e85-f100-41a0-864d-02925145fd02 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:30.447718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-80be7e85-f100-41a0-864d-02925145fd02 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4c248f15e04c969d576bce28f9bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e251fc8c08ed4437bdc3d71c53f9c804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:30.467799 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-80be7e85-f100-41a0-864d-02925145fd02 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 200 len: 1325 microversion: 2.1 time: 0.412748 Oct 24 10:51:30.470394 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2645/5252] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:30 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 1325 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:31.046710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4e9cd74e-f581-4e03-a0d9-04bf2540ff53 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:31.047387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4e9cd74e-f581-4e03-a0d9-04bf2540ff53 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:31.064543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e9cd74e-f581-4e03-a0d9-04bf2540ff53 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:31.069528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e9cd74e-f581-4e03-a0d9-04bf2540ff53 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:31.073440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e9cd74e-f581-4e03-a0d9-04bf2540ff53 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:31.076219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e9cd74e-f581-4e03-a0d9-04bf2540ff53 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:31.077263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e9cd74e-f581-4e03-a0d9-04bf2540ff53 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:31.077736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e9cd74e-f581-4e03-a0d9-04bf2540ff53 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:31.215056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b77df620-ce8a-4838-841a-34f4202116dd req-9d2cabee-9b98-4400-a896-766bc3f5482a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7c2d07a-0a94-49b8-8f35-357cdf886802", "tag": "f0856d1f-d4df-4e48-a73e-8c90322a3736"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:51:31.237720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b77df620-ce8a-4838-841a-34f4202116dd req-9d2cabee-9b98-4400-a896-766bc3f5482a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:31.238820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b77df620-ce8a-4838-841a-34f4202116dd req-9d2cabee-9b98-4400-a896-766bc3f5482a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:31.246123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b77df620-ce8a-4838-841a-34f4202116dd req-9d2cabee-9b98-4400-a896-766bc3f5482a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:31.300132 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b77df620-ce8a-4838-841a-34f4202116dd req-9d2cabee-9b98-4400-a896-766bc3f5482a service nova] Creating event network-changed:f0856d1f-d4df-4e48-a73e-8c90322a3736 for instance b7c2d07a-0a94-49b8-8f35-357cdf886802 on n-h2-858383-15 Oct 24 10:51:31.315507 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b77df620-ce8a-4838-841a-34f4202116dd req-9d2cabee-9b98-4400-a896-766bc3f5482a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.490285 Oct 24 10:51:31.317561 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2608/5253] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:51:31.476389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4e9cd74e-f581-4e03-a0d9-04bf2540ff53 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:31.488213 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4e9cd74e-f581-4e03-a0d9-04bf2540ff53 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 0.445796 Oct 24 10:51:31.490949 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2646/5254] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:31 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:31.502099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dfa7e564-ea36-4c62-a43a-617e7b825507 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:31.502833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dfa7e564-ea36-4c62-a43a-617e7b825507 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:31.525882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfa7e564-ea36-4c62-a43a-617e7b825507 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:31.528700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfa7e564-ea36-4c62-a43a-617e7b825507 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:31.530167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfa7e564-ea36-4c62-a43a-617e7b825507 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:31.531418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfa7e564-ea36-4c62-a43a-617e7b825507 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:31.533506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfa7e564-ea36-4c62-a43a-617e7b825507 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:31.533966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfa7e564-ea36-4c62-a43a-617e7b825507 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:31.778953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dfa7e564-ea36-4c62-a43a-617e7b825507 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4c248f15e04c969d576bce28f9bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e251fc8c08ed4437bdc3d71c53f9c804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:31.801056 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dfa7e564-ea36-4c62-a43a-617e7b825507 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 200 len: 1325 microversion: 2.1 time: 0.301860 Oct 24 10:51:31.801056 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2609/5255] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:31 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 1325 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:32.519818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0454db32-0356-4d5a-ac32-e99cae41f5b5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:32.521211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0454db32-0356-4d5a-ac32-e99cae41f5b5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:32.531447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0454db32-0356-4d5a-ac32-e99cae41f5b5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:32.532326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0454db32-0356-4d5a-ac32-e99cae41f5b5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:32.532885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0454db32-0356-4d5a-ac32-e99cae41f5b5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:32.533840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0454db32-0356-4d5a-ac32-e99cae41f5b5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:32.534506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0454db32-0356-4d5a-ac32-e99cae41f5b5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:32.535153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0454db32-0356-4d5a-ac32-e99cae41f5b5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:32.713885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0454db32-0356-4d5a-ac32-e99cae41f5b5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:32.726282 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0454db32-0356-4d5a-ac32-e99cae41f5b5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 0.210850 Oct 24 10:51:32.726922 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2647/5256] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:32 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:32.831175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-feb56b43-6a4b-4085-a1c9-0dd545df8d2a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:32.831887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-feb56b43-6a4b-4085-a1c9-0dd545df8d2a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:32.869602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:51:32.874344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:51:32.905561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-feb56b43-6a4b-4085-a1c9-0dd545df8d2a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:32.906493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-feb56b43-6a4b-4085-a1c9-0dd545df8d2a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:32.907218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-feb56b43-6a4b-4085-a1c9-0dd545df8d2a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:32.908312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-feb56b43-6a4b-4085-a1c9-0dd545df8d2a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:32.910915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-feb56b43-6a4b-4085-a1c9-0dd545df8d2a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:32.911725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-feb56b43-6a4b-4085-a1c9-0dd545df8d2a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:33.279119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-feb56b43-6a4b-4085-a1c9-0dd545df8d2a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4c248f15e04c969d576bce28f9bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e251fc8c08ed4437bdc3d71c53f9c804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:33.289424 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-feb56b43-6a4b-4085-a1c9-0dd545df8d2a tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 200 len: 1325 microversion: 2.1 time: 0.476695 Oct 24 10:51:33.290022 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2610/5257] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:32 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 1325 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:33.752666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-41db491e-bd2b-481b-b690-4268bfebe241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:33.753582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-41db491e-bd2b-481b-b690-4268bfebe241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:33.764821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41db491e-bd2b-481b-b690-4268bfebe241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:33.765386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41db491e-bd2b-481b-b690-4268bfebe241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:33.767969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41db491e-bd2b-481b-b690-4268bfebe241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:33.770291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41db491e-bd2b-481b-b690-4268bfebe241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:33.770756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41db491e-bd2b-481b-b690-4268bfebe241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:33.772664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41db491e-bd2b-481b-b690-4268bfebe241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:34.084309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-41db491e-bd2b-481b-b690-4268bfebe241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:34.094180 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-41db491e-bd2b-481b-b690-4268bfebe241 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 0.347070 Oct 24 10:51:34.101938 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2648/5258] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:33 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:34.317307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7731e85b-e32b-4281-898f-d5ea105b2099 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:34.317991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7731e85b-e32b-4281-898f-d5ea105b2099 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:34.332967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7731e85b-e32b-4281-898f-d5ea105b2099 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:34.333601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7731e85b-e32b-4281-898f-d5ea105b2099 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:34.336116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7731e85b-e32b-4281-898f-d5ea105b2099 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:34.339184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7731e85b-e32b-4281-898f-d5ea105b2099 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:34.339728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7731e85b-e32b-4281-898f-d5ea105b2099 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:34.340559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7731e85b-e32b-4281-898f-d5ea105b2099 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:34.591166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7731e85b-e32b-4281-898f-d5ea105b2099 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4c248f15e04c969d576bce28f9bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e251fc8c08ed4437bdc3d71c53f9c804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:34.605571 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7731e85b-e32b-4281-898f-d5ea105b2099 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 200 len: 1325 microversion: 2.1 time: 0.289294 Oct 24 10:51:34.614416 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2611/5259] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:34 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 1325 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:35.126375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-881e1918-554b-4d71-bad2-5de02b5b7aa0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:35.128430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-881e1918-554b-4d71-bad2-5de02b5b7aa0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:35.146699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-881e1918-554b-4d71-bad2-5de02b5b7aa0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:35.147175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-881e1918-554b-4d71-bad2-5de02b5b7aa0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:35.147622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-881e1918-554b-4d71-bad2-5de02b5b7aa0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:35.148348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-881e1918-554b-4d71-bad2-5de02b5b7aa0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:35.148851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-881e1918-554b-4d71-bad2-5de02b5b7aa0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:35.149266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-881e1918-554b-4d71-bad2-5de02b5b7aa0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:35.632200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef25164f-8b9c-414f-b136-146b50ece852 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:35.633545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ef25164f-8b9c-414f-b136-146b50ece852 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:35.647835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef25164f-8b9c-414f-b136-146b50ece852 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:35.649484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef25164f-8b9c-414f-b136-146b50ece852 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:35.655111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef25164f-8b9c-414f-b136-146b50ece852 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:35.656640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef25164f-8b9c-414f-b136-146b50ece852 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:35.657446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef25164f-8b9c-414f-b136-146b50ece852 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:35.658067 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef25164f-8b9c-414f-b136-146b50ece852 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:36.158826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-881e1918-554b-4d71-bad2-5de02b5b7aa0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:36.169515 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-881e1918-554b-4d71-bad2-5de02b5b7aa0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 1.047774 Oct 24 10:51:36.170884 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2649/5260] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:35 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:36.285708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ef25164f-8b9c-414f-b136-146b50ece852 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4c248f15e04c969d576bce28f9bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e251fc8c08ed4437bdc3d71c53f9c804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:36.298464 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef25164f-8b9c-414f-b136-146b50ece852 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 200 len: 1325 microversion: 2.1 time: 0.672352 Oct 24 10:51:36.299436 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2612/5261] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:35 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 1325 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:37.194239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8d35c0c1-a31d-4f18-9006-fe1c6b69a14d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:37.194865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8d35c0c1-a31d-4f18-9006-fe1c6b69a14d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:37.229958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d35c0c1-a31d-4f18-9006-fe1c6b69a14d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:37.230473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d35c0c1-a31d-4f18-9006-fe1c6b69a14d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:37.230922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d35c0c1-a31d-4f18-9006-fe1c6b69a14d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:37.234441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d35c0c1-a31d-4f18-9006-fe1c6b69a14d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:37.237011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d35c0c1-a31d-4f18-9006-fe1c6b69a14d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:37.238386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d35c0c1-a31d-4f18-9006-fe1c6b69a14d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:37.324412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cc771731-2f2f-4654-8125-88658dc42d5d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:37.325605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cc771731-2f2f-4654-8125-88658dc42d5d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:37.351145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc771731-2f2f-4654-8125-88658dc42d5d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:37.353351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc771731-2f2f-4654-8125-88658dc42d5d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:37.353819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc771731-2f2f-4654-8125-88658dc42d5d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:37.355310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc771731-2f2f-4654-8125-88658dc42d5d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:37.356604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc771731-2f2f-4654-8125-88658dc42d5d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:37.358688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc771731-2f2f-4654-8125-88658dc42d5d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:37.611703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d35c0c1-a31d-4f18-9006-fe1c6b69a14d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:37.645382 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8d35c0c1-a31d-4f18-9006-fe1c6b69a14d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 0.454711 Oct 24 10:51:37.646563 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2650/5262] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:37 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:37.658437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-40a40f78-cc2d-4acd-9864-ee60ceab780d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:37.660335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-40a40f78-cc2d-4acd-9864-ee60ceab780d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:37.677445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40a40f78-cc2d-4acd-9864-ee60ceab780d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:37.681360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40a40f78-cc2d-4acd-9864-ee60ceab780d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:37.681821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40a40f78-cc2d-4acd-9864-ee60ceab780d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:37.683214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40a40f78-cc2d-4acd-9864-ee60ceab780d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:37.683906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40a40f78-cc2d-4acd-9864-ee60ceab780d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:37.684353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40a40f78-cc2d-4acd-9864-ee60ceab780d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:37.868123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cc771731-2f2f-4654-8125-88658dc42d5d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4c248f15e04c969d576bce28f9bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e251fc8c08ed4437bdc3d71c53f9c804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:37.878665 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cc771731-2f2f-4654-8125-88658dc42d5d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 200 len: 1325 microversion: 2.1 time: 0.559059 Oct 24 10:51:37.882552 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2613/5263] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:37 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 1325 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:51:37.906447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-57bdb64f-e625-4685-aab1-7e7498087152 req-c24bbdc9-f4bb-4f38-ac40-82dd9018e5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c2d07a-0a94-49b8-8f35-357cdf886802", "name": "network-vif-plugged", "status": "completed", "tag": "f0856d1f-d4df-4e48-a73e-8c90322a3736"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:51:37.929993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-57bdb64f-e625-4685-aab1-7e7498087152 req-c24bbdc9-f4bb-4f38-ac40-82dd9018e5d0 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:37.930485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-57bdb64f-e625-4685-aab1-7e7498087152 req-c24bbdc9-f4bb-4f38-ac40-82dd9018e5d0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:37.930941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-57bdb64f-e625-4685-aab1-7e7498087152 req-c24bbdc9-f4bb-4f38-ac40-82dd9018e5d0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:37.946117 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-57bdb64f-e625-4685-aab1-7e7498087152 req-c24bbdc9-f4bb-4f38-ac40-82dd9018e5d0 service nova] Creating event network-vif-plugged:f0856d1f-d4df-4e48-a73e-8c90322a3736 for instance b7c2d07a-0a94-49b8-8f35-357cdf886802 on n-h2-858383-15 Oct 24 10:51:37.952940 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-57bdb64f-e625-4685-aab1-7e7498087152 req-c24bbdc9-f4bb-4f38-ac40-82dd9018e5d0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068670 Oct 24 10:51:37.954249 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2614/5264] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:51:38.455196 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-40a40f78-cc2d-4acd-9864-ee60ceab780d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1835 microversion: 2.1 time: 0.804518 Oct 24 10:51:38.456493 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2651/5265] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:37 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1835 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:38.479929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ae7f124-9a00-4547-b2e9-5210e2516fca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:38.481331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ae7f124-9a00-4547-b2e9-5210e2516fca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:38.494800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ae7f124-9a00-4547-b2e9-5210e2516fca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:38.495460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ae7f124-9a00-4547-b2e9-5210e2516fca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:38.496014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ae7f124-9a00-4547-b2e9-5210e2516fca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:38.496871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ae7f124-9a00-4547-b2e9-5210e2516fca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:38.497458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ae7f124-9a00-4547-b2e9-5210e2516fca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:38.498001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ae7f124-9a00-4547-b2e9-5210e2516fca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:38.674032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a182d5e7-5581-40ca-b9d1-40c5f6ebab4e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:38.674710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a182d5e7-5581-40ca-b9d1-40c5f6ebab4e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:38.691243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a182d5e7-5581-40ca-b9d1-40c5f6ebab4e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:38.691853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a182d5e7-5581-40ca-b9d1-40c5f6ebab4e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:38.692372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a182d5e7-5581-40ca-b9d1-40c5f6ebab4e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:38.693203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a182d5e7-5581-40ca-b9d1-40c5f6ebab4e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:38.693742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a182d5e7-5581-40ca-b9d1-40c5f6ebab4e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:38.694267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a182d5e7-5581-40ca-b9d1-40c5f6ebab4e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:39.041437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2ae7f124-9a00-4547-b2e9-5210e2516fca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:39.054350 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ae7f124-9a00-4547-b2e9-5210e2516fca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1682 microversion: 2.1 time: 0.578829 Oct 24 10:51:39.055328 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2615/5266] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:38 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1682 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:39.072756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c2643a71-718d-4bc3-9998-77a4ff52e905 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:39.075128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c2643a71-718d-4bc3-9998-77a4ff52e905 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:39.106611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2643a71-718d-4bc3-9998-77a4ff52e905 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:39.109201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2643a71-718d-4bc3-9998-77a4ff52e905 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:39.110967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2643a71-718d-4bc3-9998-77a4ff52e905 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:39.111871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2643a71-718d-4bc3-9998-77a4ff52e905 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:39.113673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2643a71-718d-4bc3-9998-77a4ff52e905 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:39.131696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2643a71-718d-4bc3-9998-77a4ff52e905 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:39.180691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a182d5e7-5581-40ca-b9d1-40c5f6ebab4e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:39.190505 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a182d5e7-5581-40ca-b9d1-40c5f6ebab4e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 0.521055 Oct 24 10:51:39.191103 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2652/5267] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:38 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:51:39.294661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3daa8e91-7130-4341-b00a-b05000df31cd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:51:39.297826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3daa8e91-7130-4341-b00a-b05000df31cd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:39.317689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3daa8e91-7130-4341-b00a-b05000df31cd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:39.322925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3daa8e91-7130-4341-b00a-b05000df31cd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:39.325117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3daa8e91-7130-4341-b00a-b05000df31cd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:39.326839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3daa8e91-7130-4341-b00a-b05000df31cd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:39.328073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3daa8e91-7130-4341-b00a-b05000df31cd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:39.329407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3daa8e91-7130-4341-b00a-b05000df31cd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:39.391269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:51:39.476923 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3daa8e91-7130-4341-b00a-b05000df31cd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7/action" status: 200 len: 32644 microversion: 2.1 time: 0.185908 Oct 24 10:51:39.485291 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2653/5268] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:51:39 2022] POST /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7/action => generated 32644 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 10:51:39.584080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c2643a71-718d-4bc3-9998-77a4ff52e905 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4c248f15e04c969d576bce28f9bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e251fc8c08ed4437bdc3d71c53f9c804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:39.597283 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c2643a71-718d-4bc3-9998-77a4ff52e905 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 200 len: 1325 microversion: 2.1 time: 0.540611 Oct 24 10:51:39.602104 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2616/5269] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:39 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 1325 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:39.646795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-18221c69-2336-4132-9715-3843a20fcf3e tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:51:39.649989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-18221c69-2336-4132-9715-3843a20fcf3e tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:39.680379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18221c69-2336-4132-9715-3843a20fcf3e tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:39.681043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18221c69-2336-4132-9715-3843a20fcf3e tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:39.681549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18221c69-2336-4132-9715-3843a20fcf3e tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:39.682328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18221c69-2336-4132-9715-3843a20fcf3e tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:39.682841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18221c69-2336-4132-9715-3843a20fcf3e tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:39.683331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18221c69-2336-4132-9715-3843a20fcf3e tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:39.756206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-18221c69-2336-4132-9715-3843a20fcf3e tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd3efb6bfcf3d42f3b197e41ea3b06694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b11d85eb3f94b92a8cbfb1f61417208', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:39.756978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-18221c69-2336-4132-9715-3843a20fcf3e tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] flavor_id is None. Assuming migration. {{(pid=120426) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 24 10:51:39.757886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-18221c69-2336-4132-9715-3843a20fcf3e tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120426) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 24 10:51:40.229168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9d9131ea-fe75-492f-b73e-6c1a14622660 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:40.231027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9d9131ea-fe75-492f-b73e-6c1a14622660 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:40.251143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d9131ea-fe75-492f-b73e-6c1a14622660 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:40.251646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d9131ea-fe75-492f-b73e-6c1a14622660 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:40.252087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d9131ea-fe75-492f-b73e-6c1a14622660 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:40.252806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d9131ea-fe75-492f-b73e-6c1a14622660 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:40.253285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d9131ea-fe75-492f-b73e-6c1a14622660 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:40.253715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d9131ea-fe75-492f-b73e-6c1a14622660 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:40.357012 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-18221c69-2336-4132-9715-3843a20fcf3e tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7/action" status: 202 len: 0 microversion: 2.1 time: 0.720100 Oct 24 10:51:40.361953 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2654/5270] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:51:39 2022] POST /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7/action => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:51:40.386531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ee7f47cc-1e00-4576-b598-d8d3ce94dbcd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:40.388149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ee7f47cc-1e00-4576-b598-d8d3ce94dbcd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:40.413484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee7f47cc-1e00-4576-b598-d8d3ce94dbcd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:40.417477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee7f47cc-1e00-4576-b598-d8d3ce94dbcd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:40.419207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee7f47cc-1e00-4576-b598-d8d3ce94dbcd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:40.423960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee7f47cc-1e00-4576-b598-d8d3ce94dbcd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:40.425816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee7f47cc-1e00-4576-b598-d8d3ce94dbcd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:40.426517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee7f47cc-1e00-4576-b598-d8d3ce94dbcd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:40.830707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9d9131ea-fe75-492f-b73e-6c1a14622660 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:40.841252 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9d9131ea-fe75-492f-b73e-6c1a14622660 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 0.617334 Oct 24 10:51:40.846187 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2617/5271] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:40 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:40.855994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b27a2490-d60c-4ee0-b693-43dba75b727d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:40.865644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b27a2490-d60c-4ee0-b693-43dba75b727d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:40.876951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ee7f47cc-1e00-4576-b598-d8d3ce94dbcd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:40.879180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b27a2490-d60c-4ee0-b693-43dba75b727d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:40.884620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b27a2490-d60c-4ee0-b693-43dba75b727d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:40.887426 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ee7f47cc-1e00-4576-b598-d8d3ce94dbcd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1691 microversion: 2.1 time: 0.521130 Oct 24 10:51:40.889871 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2655/5272] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:40 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1691 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:40.890913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b27a2490-d60c-4ee0-b693-43dba75b727d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:40.891677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b27a2490-d60c-4ee0-b693-43dba75b727d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:40.892415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b27a2490-d60c-4ee0-b693-43dba75b727d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:40.892865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b27a2490-d60c-4ee0-b693-43dba75b727d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:41.253883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b27a2490-d60c-4ee0-b693-43dba75b727d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4c248f15e04c969d576bce28f9bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e251fc8c08ed4437bdc3d71c53f9c804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:41.262432 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b27a2490-d60c-4ee0-b693-43dba75b727d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 200 len: 1522 microversion: 2.1 time: 0.415184 Oct 24 10:51:41.267388 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2618/5273] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:40 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:41.300076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f82c7e41-7946-4d9a-a610-b072abddf111 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:41.300947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f82c7e41-7946-4d9a-a610-b072abddf111 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:41.308805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f82c7e41-7946-4d9a-a610-b072abddf111 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:41.310171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f82c7e41-7946-4d9a-a610-b072abddf111 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:41.310819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f82c7e41-7946-4d9a-a610-b072abddf111 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:41.311870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f82c7e41-7946-4d9a-a610-b072abddf111 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:41.312534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f82c7e41-7946-4d9a-a610-b072abddf111 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:41.313189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f82c7e41-7946-4d9a-a610-b072abddf111 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:41.350592 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-f82c7e41-7946-4d9a-a610-b072abddf111 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] HTTP exception thrown: Action 999 not found Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f82c7e41-7946-4d9a-a610-b072abddf111 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Request method failure captured: Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802/os-instance-actions/999 HTTP/1.1 Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm4odL0aoqZA-ovE6HIuiRwXhAimMbyhHJ52aAPb1m_TU1h2jbd1xmLkivDH9OFWRvxVOxSwQuK-o5FMQQTC-44mt6Waq9Chc-SjPs3tx1fFJABDACAiYUnQ-J8Me0yUB3Fse9GFV-FCXrfO9xWoMlFYnAGxzvldgFtuMWFyEth_BU0 Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: e251fc8c08ed4437bdc3d71c53f9c804 Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-82989510 Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e251fc8c08ed4437bdc3d71c53f9c804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e251fc8c08ed4437bdc3d71c53f9c804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e251fc8c08ed4437bdc3d71c53f9c804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e251fc8c08ed4437bdc3d71c53f9c804", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-82989510 Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: e251fc8c08ed4437bdc3d71c53f9c804 Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-82989510 Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-InstanceActionsNegativeTestJSON-82989510-project Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ed4c248f15e04c969d576bce28f9bd7a Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-82989510-project Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: exception: Action 999 not found Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'server_id': 'b7c2d07a-0a94-49b8-8f35-357cdf886802', 'id': '999'} Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 24 10:51:41.365338 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:51:41.374339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f82c7e41-7946-4d9a-a610-b072abddf111 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Returning 404 to user: Action 999 not found {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:51:41.374339 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f82c7e41-7946-4d9a-a610-b072abddf111 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.073606 Oct 24 10:51:41.374339 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2656/5274] 10.222.0.50 () {58 vars in 1308 bytes} [Mon Oct 24 10:51:41 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802/os-instance-actions/999 => generated 66 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:51:41.379579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e1e1035a-a6fa-4036-ad7f-6e0f2fb4842e tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '.version_select at 0x7f04cba79820>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:41.380285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e1e1035a-a6fa-4036-ad7f-6e0f2fb4842e tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: 35772658-206c-4990-835c-0d178ddd2e65] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:41.392532 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-e1e1035a-a6fa-4036-ad7f-6e0f2fb4842e tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] HTTP exception thrown: Instance 35772658-206c-4990-835c-0d178ddd2e65 could not be found. Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e1e1035a-a6fa-4036-ad7f-6e0f2fb4842e tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Request method failure captured: Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/35772658-206c-4990-835c-0d178ddd2e65/os-instance-actions HTTP/1.1 Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm4odL0aoqZA-ovE6HIuiRwXhAimMbyhHJ52aAPb1m_TU1h2jbd1xmLkivDH9OFWRvxVOxSwQuK-o5FMQQTC-44mt6Waq9Chc-SjPs3tx1fFJABDACAiYUnQ-J8Me0yUB3Fse9GFV-FCXrfO9xWoMlFYnAGxzvldgFtuMWFyEth_BU0 Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: e251fc8c08ed4437bdc3d71c53f9c804 Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-82989510 Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e251fc8c08ed4437bdc3d71c53f9c804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e251fc8c08ed4437bdc3d71c53f9c804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e251fc8c08ed4437bdc3d71c53f9c804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e251fc8c08ed4437bdc3d71c53f9c804", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-82989510 Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: e251fc8c08ed4437bdc3d71c53f9c804 Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-82989510 Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-InstanceActionsNegativeTestJSON-82989510-project Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ed4c248f15e04c969d576bce28f9bd7a Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-82989510-project Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 35772658-206c-4990-835c-0d178ddd2e65 could not be found. Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'server_id': '35772658-206c-4990-835c-0d178ddd2e65'} Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35772658-206c-4990-835c-0d178ddd2e65 could not be found. Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:51:41.394607 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:51:41.399835 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35772658-206c-4990-835c-0d178ddd2e65 could not be found. Oct 24 10:51:41.399835 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:51:41.399835 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:51:41.399835 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:51:41.399835 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:51:41.399835 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:51:41.399835 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:51:41.399835 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:51:41.399835 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:51:41.399835 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35772658-206c-4990-835c-0d178ddd2e65 could not be found. Oct 24 10:51:41.399835 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:51:41.399835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e1e1035a-a6fa-4036-ad7f-6e0f2fb4842e tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Returning 404 to user: Instance 35772658-206c-4990-835c-0d178ddd2e65 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:51:41.403717 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e1e1035a-a6fa-4036-ad7f-6e0f2fb4842e tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/35772658-206c-4990-835c-0d178ddd2e65/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.028063 Oct 24 10:51:41.406952 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2619/5275] 10.222.0.50 () {58 vars in 1296 bytes} [Mon Oct 24 10:51:41 2022] GET /compute/v2.1/servers/35772658-206c-4990-835c-0d178ddd2e65/os-instance-actions => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:51:41.417237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8ae628d3-a7a6-47bc-a5dd-c95b4901bcbe tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:41.417729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8ae628d3-a7a6-47bc-a5dd-c95b4901bcbe tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:41.444411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ae628d3-a7a6-47bc-a5dd-c95b4901bcbe tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:41.444938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ae628d3-a7a6-47bc-a5dd-c95b4901bcbe tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:41.445380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ae628d3-a7a6-47bc-a5dd-c95b4901bcbe tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:41.446087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ae628d3-a7a6-47bc-a5dd-c95b4901bcbe tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:41.446540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ae628d3-a7a6-47bc-a5dd-c95b4901bcbe tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:41.447404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ae628d3-a7a6-47bc-a5dd-c95b4901bcbe tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:41.481785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8ae628d3-a7a6-47bc-a5dd-c95b4901bcbe tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:51:41.603318 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8ae628d3-a7a6-47bc-a5dd-c95b4901bcbe tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 204 len: 0 microversion: 2.1 time: 0.189891 Oct 24 10:51:41.604536 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2657/5276] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:51:41 2022] DELETE /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:51:41.615805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9246ca18-fc51-4b45-94eb-7bf299735088 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:41.618256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9246ca18-fc51-4b45-94eb-7bf299735088 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:41.631074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9246ca18-fc51-4b45-94eb-7bf299735088 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:41.636143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9246ca18-fc51-4b45-94eb-7bf299735088 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:41.638106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9246ca18-fc51-4b45-94eb-7bf299735088 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:41.639999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9246ca18-fc51-4b45-94eb-7bf299735088 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:41.645369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9246ca18-fc51-4b45-94eb-7bf299735088 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:41.645818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9246ca18-fc51-4b45-94eb-7bf299735088 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:41.874816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ee536761-92c4-465b-9bb2-83489f873e9b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:41.875780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ee536761-92c4-465b-9bb2-83489f873e9b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:41.884242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee536761-92c4-465b-9bb2-83489f873e9b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:41.891036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee536761-92c4-465b-9bb2-83489f873e9b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:41.900436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee536761-92c4-465b-9bb2-83489f873e9b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:41.901478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee536761-92c4-465b-9bb2-83489f873e9b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:41.903981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee536761-92c4-465b-9bb2-83489f873e9b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:41.904944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee536761-92c4-465b-9bb2-83489f873e9b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:42.008276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9246ca18-fc51-4b45-94eb-7bf299735088 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4c248f15e04c969d576bce28f9bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e251fc8c08ed4437bdc3d71c53f9c804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:42.018396 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9246ca18-fc51-4b45-94eb-7bf299735088 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 200 len: 1528 microversion: 2.1 time: 0.409560 Oct 24 10:51:42.031769 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2620/5277] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:41 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 1528 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:42.046464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-710ea334-3b97-44a3-b0ea-1857297df58e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:42.047371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-710ea334-3b97-44a3-b0ea-1857297df58e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:42.081272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-710ea334-3b97-44a3-b0ea-1857297df58e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:42.082034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-710ea334-3b97-44a3-b0ea-1857297df58e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:42.087399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-710ea334-3b97-44a3-b0ea-1857297df58e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:42.088370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-710ea334-3b97-44a3-b0ea-1857297df58e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:42.089194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-710ea334-3b97-44a3-b0ea-1857297df58e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:42.089839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-710ea334-3b97-44a3-b0ea-1857297df58e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:42.146627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:51:42.670187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ee536761-92c4-465b-9bb2-83489f873e9b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:42.686215 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ee536761-92c4-465b-9bb2-83489f873e9b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 0.817435 Oct 24 10:51:42.687324 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2658/5278] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:41 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:42.762196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-710ea334-3b97-44a3-b0ea-1857297df58e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:42.781164 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-710ea334-3b97-44a3-b0ea-1857297df58e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1691 microversion: 2.1 time: 0.747034 Oct 24 10:51:42.792920 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2621/5279] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:42 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1691 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:43.059624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a9b198cd-6f4f-47f9-abed-944f01a72d75 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:43.060340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a9b198cd-6f4f-47f9-abed-944f01a72d75 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:43.073882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9b198cd-6f4f-47f9-abed-944f01a72d75 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:43.074977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9b198cd-6f4f-47f9-abed-944f01a72d75 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:43.075506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9b198cd-6f4f-47f9-abed-944f01a72d75 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:43.077096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9b198cd-6f4f-47f9-abed-944f01a72d75 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:43.082267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9b198cd-6f4f-47f9-abed-944f01a72d75 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:43.082860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9b198cd-6f4f-47f9-abed-944f01a72d75 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:43.361255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a9b198cd-6f4f-47f9-abed-944f01a72d75 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4c248f15e04c969d576bce28f9bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e251fc8c08ed4437bdc3d71c53f9c804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:43.369513 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a9b198cd-6f4f-47f9-abed-944f01a72d75 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 200 len: 1528 microversion: 2.1 time: 0.313639 Oct 24 10:51:43.388104 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2659/5280] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:43 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 1528 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:43.714495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8c333fed-b2eb-4955-8bda-6ae72d6a7d29 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:43.715848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8c333fed-b2eb-4955-8bda-6ae72d6a7d29 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:43.726374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8c333fed-b2eb-4955-8bda-6ae72d6a7d29 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:43.729409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8c333fed-b2eb-4955-8bda-6ae72d6a7d29 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:43.730474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8c333fed-b2eb-4955-8bda-6ae72d6a7d29 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:43.731498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8c333fed-b2eb-4955-8bda-6ae72d6a7d29 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:43.733917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8c333fed-b2eb-4955-8bda-6ae72d6a7d29 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:43.735553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8c333fed-b2eb-4955-8bda-6ae72d6a7d29 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:43.806284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ee648c26-c32e-42e0-b931-25257316dd5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:43.807312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ee648c26-c32e-42e0-b931-25257316dd5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:43.823018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee648c26-c32e-42e0-b931-25257316dd5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:43.824233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee648c26-c32e-42e0-b931-25257316dd5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:43.829293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee648c26-c32e-42e0-b931-25257316dd5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:43.830405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee648c26-c32e-42e0-b931-25257316dd5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:43.831536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee648c26-c32e-42e0-b931-25257316dd5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:43.832319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee648c26-c32e-42e0-b931-25257316dd5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:44.632201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ee648c26-c32e-42e0-b931-25257316dd5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:44.643491 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ee648c26-c32e-42e0-b931-25257316dd5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1691 microversion: 2.1 time: 0.841184 Oct 24 10:51:44.666773 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2660/5281] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:43 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1691 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:44.680570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-09757094-ecd2-496f-9f0c-47b4dbb1d054 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:44.681603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-09757094-ecd2-496f-9f0c-47b4dbb1d054 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:44.693440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09757094-ecd2-496f-9f0c-47b4dbb1d054 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:44.695424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09757094-ecd2-496f-9f0c-47b4dbb1d054 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:44.696801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09757094-ecd2-496f-9f0c-47b4dbb1d054 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:44.698369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09757094-ecd2-496f-9f0c-47b4dbb1d054 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:44.699222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09757094-ecd2-496f-9f0c-47b4dbb1d054 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:44.700180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09757094-ecd2-496f-9f0c-47b4dbb1d054 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:44.725974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8c333fed-b2eb-4955-8bda-6ae72d6a7d29 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:44.739525 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8c333fed-b2eb-4955-8bda-6ae72d6a7d29 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 1.031655 Oct 24 10:51:44.740438 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2622/5282] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:43 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:44.955763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-09757094-ecd2-496f-9f0c-47b4dbb1d054 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4c248f15e04c969d576bce28f9bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e251fc8c08ed4437bdc3d71c53f9c804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:44.970684 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-09757094-ecd2-496f-9f0c-47b4dbb1d054 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 200 len: 1528 microversion: 2.1 time: 0.300132 Oct 24 10:51:44.971142 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2661/5283] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:44 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 1528 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:45.386906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-fe1f4047-5fc0-4244-80e4-1b0697b5b2e2 req-0c6db63b-286a-4d07-8eb3-2a08e3da2b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c2d07a-0a94-49b8-8f35-357cdf886802", "name": "network-vif-deleted", "tag": "f0856d1f-d4df-4e48-a73e-8c90322a3736"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:51:45.419389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fe1f4047-5fc0-4244-80e4-1b0697b5b2e2 req-0c6db63b-286a-4d07-8eb3-2a08e3da2b08 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:45.421020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fe1f4047-5fc0-4244-80e4-1b0697b5b2e2 req-0c6db63b-286a-4d07-8eb3-2a08e3da2b08 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:45.421679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fe1f4047-5fc0-4244-80e4-1b0697b5b2e2 req-0c6db63b-286a-4d07-8eb3-2a08e3da2b08 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:45.452148 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-fe1f4047-5fc0-4244-80e4-1b0697b5b2e2 req-0c6db63b-286a-4d07-8eb3-2a08e3da2b08 service nova] Creating event network-vif-deleted:f0856d1f-d4df-4e48-a73e-8c90322a3736 for instance b7c2d07a-0a94-49b8-8f35-357cdf886802 on n-h2-858383-15 Oct 24 10:51:45.462801 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-fe1f4047-5fc0-4244-80e4-1b0697b5b2e2 req-0c6db63b-286a-4d07-8eb3-2a08e3da2b08 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081122 Oct 24 10:51:45.467517 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2623/5284] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:51:45.678460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-24691d02-13c6-4545-b52a-245fd9d6973d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:45.679089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-24691d02-13c6-4545-b52a-245fd9d6973d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:45.687037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24691d02-13c6-4545-b52a-245fd9d6973d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:45.687823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24691d02-13c6-4545-b52a-245fd9d6973d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:45.688485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24691d02-13c6-4545-b52a-245fd9d6973d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:45.689529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24691d02-13c6-4545-b52a-245fd9d6973d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:45.690205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24691d02-13c6-4545-b52a-245fd9d6973d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:45.690847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24691d02-13c6-4545-b52a-245fd9d6973d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:45.769666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ddb85e40-cb9e-4319-ae75-c29b0ab35e8f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:45.771142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ddb85e40-cb9e-4319-ae75-c29b0ab35e8f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:45.800067 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddb85e40-cb9e-4319-ae75-c29b0ab35e8f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:45.809370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddb85e40-cb9e-4319-ae75-c29b0ab35e8f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:45.810258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddb85e40-cb9e-4319-ae75-c29b0ab35e8f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:45.811303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddb85e40-cb9e-4319-ae75-c29b0ab35e8f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:45.813404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddb85e40-cb9e-4319-ae75-c29b0ab35e8f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:45.814111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddb85e40-cb9e-4319-ae75-c29b0ab35e8f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:46.382218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ddb85e40-cb9e-4319-ae75-c29b0ab35e8f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:46.402204 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ddb85e40-cb9e-4319-ae75-c29b0ab35e8f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 0.639115 Oct 24 10:51:46.403159 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2624/5285] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:45 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:51:46.408985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-49f2367a-a18a-42d6-b273-1ece5d41d43d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:46.409903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-49f2367a-a18a-42d6-b273-1ece5d41d43d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:46.423304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49f2367a-a18a-42d6-b273-1ece5d41d43d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:46.431247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49f2367a-a18a-42d6-b273-1ece5d41d43d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:46.432109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49f2367a-a18a-42d6-b273-1ece5d41d43d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:46.433172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49f2367a-a18a-42d6-b273-1ece5d41d43d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:46.433894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49f2367a-a18a-42d6-b273-1ece5d41d43d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:46.434700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49f2367a-a18a-42d6-b273-1ece5d41d43d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:46.449433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-24691d02-13c6-4545-b52a-245fd9d6973d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:46.471984 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-24691d02-13c6-4545-b52a-245fd9d6973d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1691 microversion: 2.1 time: 0.797811 Oct 24 10:51:46.491645 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2662/5286] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:45 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1691 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:46.523336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49f2367a-a18a-42d6-b273-1ece5d41d43d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:46.524202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49f2367a-a18a-42d6-b273-1ece5d41d43d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:46.524909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49f2367a-a18a-42d6-b273-1ece5d41d43d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:46.525660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-49f2367a-a18a-42d6-b273-1ece5d41d43d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lazy-loading 'fault' on Instance uuid b7c2d07a-0a94-49b8-8f35-357cdf886802 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:51:46.700374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-49f2367a-a18a-42d6-b273-1ece5d41d43d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4c248f15e04c969d576bce28f9bd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e251fc8c08ed4437bdc3d71c53f9c804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:46.716343 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-49f2367a-a18a-42d6-b273-1ece5d41d43d tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 200 len: 1315 microversion: 2.1 time: 0.311280 Oct 24 10:51:46.718798 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2625/5287] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:46 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:47.436867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54b98d7e-c4cc-46c1-a0fa-7a98401c2b1d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:47.439091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-54b98d7e-c4cc-46c1-a0fa-7a98401c2b1d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:47.475055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54b98d7e-c4cc-46c1-a0fa-7a98401c2b1d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:47.476346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54b98d7e-c4cc-46c1-a0fa-7a98401c2b1d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:47.476999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54b98d7e-c4cc-46c1-a0fa-7a98401c2b1d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:47.479003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54b98d7e-c4cc-46c1-a0fa-7a98401c2b1d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:47.479736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54b98d7e-c4cc-46c1-a0fa-7a98401c2b1d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:47.480329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54b98d7e-c4cc-46c1-a0fa-7a98401c2b1d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:47.509107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9be74e54-d29c-4c5d-b740-f26580e1cec7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:47.510579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9be74e54-d29c-4c5d-b740-f26580e1cec7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:47.540994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9be74e54-d29c-4c5d-b740-f26580e1cec7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:47.546522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9be74e54-d29c-4c5d-b740-f26580e1cec7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:47.548219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9be74e54-d29c-4c5d-b740-f26580e1cec7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:47.551486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9be74e54-d29c-4c5d-b740-f26580e1cec7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:47.552157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9be74e54-d29c-4c5d-b740-f26580e1cec7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:47.555027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9be74e54-d29c-4c5d-b740-f26580e1cec7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:47.974595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-54b98d7e-c4cc-46c1-a0fa-7a98401c2b1d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:47.993220 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-54b98d7e-c4cc-46c1-a0fa-7a98401c2b1d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 0.562336 Oct 24 10:51:47.993821 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2663/5288] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:47 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:48.007428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-25616b73-d0c0-401b-b235-d8f4bdbcc7b6 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:48.009654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-25616b73-d0c0-401b-b235-d8f4bdbcc7b6 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] [instance: b7c2d07a-0a94-49b8-8f35-357cdf886802] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:48.019262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9be74e54-d29c-4c5d-b740-f26580e1cec7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:48.023399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25616b73-d0c0-401b-b235-d8f4bdbcc7b6 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:48.023906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25616b73-d0c0-401b-b235-d8f4bdbcc7b6 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:48.028550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25616b73-d0c0-401b-b235-d8f4bdbcc7b6 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:48.030055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25616b73-d0c0-401b-b235-d8f4bdbcc7b6 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:48.031694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25616b73-d0c0-401b-b235-d8f4bdbcc7b6 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:48.033707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25616b73-d0c0-401b-b235-d8f4bdbcc7b6 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:48.036293 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9be74e54-d29c-4c5d-b740-f26580e1cec7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1696 microversion: 2.1 time: 0.531981 Oct 24 10:51:48.051752 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2626/5289] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:47 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1696 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:51:48.066001 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-25616b73-d0c0-401b-b235-d8f4bdbcc7b6 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] HTTP exception thrown: Instance b7c2d07a-0a94-49b8-8f35-357cdf886802 could not be found. Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-25616b73-d0c0-401b-b235-d8f4bdbcc7b6 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Request method failure captured: Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 HTTP/1.1 Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm4odL0aoqZA-ovE6HIuiRwXhAimMbyhHJ52aAPb1m_TU1h2jbd1xmLkivDH9OFWRvxVOxSwQuK-o5FMQQTC-44mt6Waq9Chc-SjPs3tx1fFJABDACAiYUnQ-J8Me0yUB3Fse9GFV-FCXrfO9xWoMlFYnAGxzvldgFtuMWFyEth_BU0 Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: e251fc8c08ed4437bdc3d71c53f9c804 Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-82989510 Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e251fc8c08ed4437bdc3d71c53f9c804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e251fc8c08ed4437bdc3d71c53f9c804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e251fc8c08ed4437bdc3d71c53f9c804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e251fc8c08ed4437bdc3d71c53f9c804", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-82989510 Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: e251fc8c08ed4437bdc3d71c53f9c804 Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-82989510 Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-InstanceActionsNegativeTestJSON-82989510-project Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ed4c248f15e04c969d576bce28f9bd7a Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-82989510-project Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance b7c2d07a-0a94-49b8-8f35-357cdf886802 could not be found. Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'b7c2d07a-0a94-49b8-8f35-357cdf886802'} Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7c2d07a-0a94-49b8-8f35-357cdf886802 could not be found. Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7c2d07a-0a94-49b8-8f35-357cdf886802 could not be found. Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:51:48.067676 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:51:48.070977 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:51:48.070977 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:51:48.070977 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:51:48.070977 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:51:48.070977 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:51:48.070977 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:51:48.070977 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7c2d07a-0a94-49b8-8f35-357cdf886802 could not be found. Oct 24 10:51:48.070977 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:51:48.072973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-25616b73-d0c0-401b-b235-d8f4bdbcc7b6 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] Returning 404 to user: Instance b7c2d07a-0a94-49b8-8f35-357cdf886802 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:51:48.074059 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-25616b73-d0c0-401b-b235-d8f4bdbcc7b6 tempest-InstanceActionsNegativeTestJSON-82989510 tempest-InstanceActionsNegativeTestJSON-82989510-project] 10.222.0.50 "GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802" status: 404 len: 111 microversion: 2.1 time: 0.076408 Oct 24 10:51:48.075422 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2664/5290] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:47 2022] GET /compute/v2.1/servers/b7c2d07a-0a94-49b8-8f35-357cdf886802 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:51:49.023720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c7fcdcdf-bcff-4518-b308-dd6c7836102b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:49.025281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c7fcdcdf-bcff-4518-b308-dd6c7836102b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:49.047240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7fcdcdf-bcff-4518-b308-dd6c7836102b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:49.050471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7fcdcdf-bcff-4518-b308-dd6c7836102b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:49.051497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7fcdcdf-bcff-4518-b308-dd6c7836102b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:49.052262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7fcdcdf-bcff-4518-b308-dd6c7836102b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:49.060379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7fcdcdf-bcff-4518-b308-dd6c7836102b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:49.061514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7fcdcdf-bcff-4518-b308-dd6c7836102b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:49.065386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d829a9f9-7d10-4ba0-8bc0-ed17488dbbae tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:49.066618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d829a9f9-7d10-4ba0-8bc0-ed17488dbbae tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:49.078681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d829a9f9-7d10-4ba0-8bc0-ed17488dbbae tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:49.079712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d829a9f9-7d10-4ba0-8bc0-ed17488dbbae tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:49.080424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d829a9f9-7d10-4ba0-8bc0-ed17488dbbae tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:49.092326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d829a9f9-7d10-4ba0-8bc0-ed17488dbbae tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:49.094020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d829a9f9-7d10-4ba0-8bc0-ed17488dbbae tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:49.094929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d829a9f9-7d10-4ba0-8bc0-ed17488dbbae tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:49.589137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c7fcdcdf-bcff-4518-b308-dd6c7836102b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:49.610299 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c7fcdcdf-bcff-4518-b308-dd6c7836102b tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 0.590173 Oct 24 10:51:49.625677 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2627/5291] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:49 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:51:50.435233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d829a9f9-7d10-4ba0-8bc0-ed17488dbbae tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:50.449196 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d829a9f9-7d10-4ba0-8bc0-ed17488dbbae tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1696 microversion: 2.1 time: 1.388542 Oct 24 10:51:50.459671 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2665/5292] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:49 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1696 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:51:50.636588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e0dc085-4f98-4ae6-82de-c6120d2654e1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:50.637261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0e0dc085-4f98-4ae6-82de-c6120d2654e1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:50.650732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e0dc085-4f98-4ae6-82de-c6120d2654e1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:50.651221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e0dc085-4f98-4ae6-82de-c6120d2654e1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:50.651879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e0dc085-4f98-4ae6-82de-c6120d2654e1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:50.652779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e0dc085-4f98-4ae6-82de-c6120d2654e1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:50.665933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e0dc085-4f98-4ae6-82de-c6120d2654e1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:50.666681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e0dc085-4f98-4ae6-82de-c6120d2654e1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:50.965989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0e0dc085-4f98-4ae6-82de-c6120d2654e1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:50.976622 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e0dc085-4f98-4ae6-82de-c6120d2654e1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 0.344653 Oct 24 10:51:50.977258 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2628/5293] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:50 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:51.474969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a8b1f481-8330-444f-925c-37405f4d2c6f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:51.476713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a8b1f481-8330-444f-925c-37405f4d2c6f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:51.519667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8b1f481-8330-444f-925c-37405f4d2c6f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:51.520655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8b1f481-8330-444f-925c-37405f4d2c6f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:51.525072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8b1f481-8330-444f-925c-37405f4d2c6f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:51.528733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8b1f481-8330-444f-925c-37405f4d2c6f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:51.534253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8b1f481-8330-444f-925c-37405f4d2c6f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:51.537265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8b1f481-8330-444f-925c-37405f4d2c6f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:51.940897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a8b1f481-8330-444f-925c-37405f4d2c6f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:51.958012 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a8b1f481-8330-444f-925c-37405f4d2c6f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1696 microversion: 2.1 time: 0.485682 Oct 24 10:51:51.959713 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2666/5294] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:51 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1696 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:52.028386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a66146f6-949a-4da7-a8a7-d5ff8ce77972 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:52.029056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a66146f6-949a-4da7-a8a7-d5ff8ce77972 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:52.044679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:51:52.068381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a66146f6-949a-4da7-a8a7-d5ff8ce77972 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:52.072185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a66146f6-949a-4da7-a8a7-d5ff8ce77972 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:52.072697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a66146f6-949a-4da7-a8a7-d5ff8ce77972 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:52.073500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a66146f6-949a-4da7-a8a7-d5ff8ce77972 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:52.073974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a66146f6-949a-4da7-a8a7-d5ff8ce77972 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:52.077602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a66146f6-949a-4da7-a8a7-d5ff8ce77972 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:52.669449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a66146f6-949a-4da7-a8a7-d5ff8ce77972 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:52.685374 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a66146f6-949a-4da7-a8a7-d5ff8ce77972 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1734 microversion: 2.1 time: 0.681604 Oct 24 10:51:52.697224 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2629/5295] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:52 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1734 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:52.987428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b31ae22f-c17d-42ba-bf19-4d768d9b7964 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:52.988752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b31ae22f-c17d-42ba-bf19-4d768d9b7964 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:52.995601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:51:53.009042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b31ae22f-c17d-42ba-bf19-4d768d9b7964 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:53.009771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b31ae22f-c17d-42ba-bf19-4d768d9b7964 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:53.010322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b31ae22f-c17d-42ba-bf19-4d768d9b7964 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:53.011225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b31ae22f-c17d-42ba-bf19-4d768d9b7964 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:53.011817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b31ae22f-c17d-42ba-bf19-4d768d9b7964 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:53.012353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b31ae22f-c17d-42ba-bf19-4d768d9b7964 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:53.713304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6675dacf-d8f8-45f9-b1df-e648aebf4187 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:53.713915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6675dacf-d8f8-45f9-b1df-e648aebf4187 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:53.722321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6675dacf-d8f8-45f9-b1df-e648aebf4187 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:53.723041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6675dacf-d8f8-45f9-b1df-e648aebf4187 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:53.723679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6675dacf-d8f8-45f9-b1df-e648aebf4187 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:53.724557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6675dacf-d8f8-45f9-b1df-e648aebf4187 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:53.725201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6675dacf-d8f8-45f9-b1df-e648aebf4187 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:53.725970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6675dacf-d8f8-45f9-b1df-e648aebf4187 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:54.194836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b31ae22f-c17d-42ba-bf19-4d768d9b7964 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:54.201838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6675dacf-d8f8-45f9-b1df-e648aebf4187 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:54.204771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:51:54.211757 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b31ae22f-c17d-42ba-bf19-4d768d9b7964 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1696 microversion: 2.1 time: 1.228938 Oct 24 10:51:54.224860 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2667/5296] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:52 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1696 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:54.225055 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6675dacf-d8f8-45f9-b1df-e648aebf4187 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1714 microversion: 2.1 time: 0.509241 Oct 24 10:51:54.225055 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2630/5297] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:53 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1714 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:51:54.456643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-afe04ab1-6c1b-4415-bc12-6bd4ff4455f1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:54.459226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-afe04ab1-6c1b-4415-bc12-6bd4ff4455f1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:54.478879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afe04ab1-6c1b-4415-bc12-6bd4ff4455f1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:54.479825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afe04ab1-6c1b-4415-bc12-6bd4ff4455f1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:54.483773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afe04ab1-6c1b-4415-bc12-6bd4ff4455f1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:54.484930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afe04ab1-6c1b-4415-bc12-6bd4ff4455f1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:54.485593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afe04ab1-6c1b-4415-bc12-6bd4ff4455f1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:54.486320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afe04ab1-6c1b-4415-bc12-6bd4ff4455f1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:54.626020 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-afe04ab1-6c1b-4415-bc12-6bd4ff4455f1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] HTTP exception thrown: Cannot 'detach_volume' instance 4f5b0075-c182-4a77-a15a-b904b39cc9c1 while it is in vm_state rescued Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-afe04ab1-6c1b-4415-bc12-6bd4ff4455f1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Request method failure captured: Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments/95392bd9-92c6-4f7d-91bb-53ee1a06ce32 HTTP/1.1 Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm1_YpcUoTx6EtuRJqEim52THa9nHc93ggv-rCTsxHF8KCdRzu0B50Tb2gQcOKEkZzR8bjwxbVU1lCLt9l9Nlkw5MZDlojxwV2MAHZbN_UcYOzact8aaTN_ICS6JQcw4OPHcT53rEwR6K2uYrfqZ498tDq4tCZjBExjOK6wvBxhiRXQ Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 0ae874e076c34c44adb00f85aebd000e Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ae874e076c34c44adb00f85aebd000e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 0ae874e076c34c44adb00f85aebd000e Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerRescueNegativeTestJSON-615921797-project Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 6da7534777ef4425aefa81bc7e49b69f Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerRescueNegativeTestJSON-615921797-project Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: exception: Cannot 'detach_volume' instance 4f5b0075-c182-4a77-a15a-b904b39cc9c1 while it is in vm_state rescued Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'server_id': '4f5b0075-c182-4a77-a15a-b904b39cc9c1', 'id': '95392bd9-92c6-4f7d-91bb-53ee1a06ce32'} Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4f5b0075-c182-4a77-a15a-b904b39cc9c1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4f5b0075-c182-4a77-a15a-b904b39cc9c1 while it is in vm_state rescued Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:51:54.627882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:51:54.630988 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:51:54.630988 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:51:54.630988 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:51:54.630988 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:51:54.630988 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4f5b0075-c182-4a77-a15a-b904b39cc9c1 while it is in vm_state rescued Oct 24 10:51:54.630988 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:51:54.632758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-afe04ab1-6c1b-4415-bc12-6bd4ff4455f1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Returning 409 to user: Cannot 'detach_volume' instance 4f5b0075-c182-4a77-a15a-b904b39cc9c1 while it is in vm_state rescued {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:51:54.633828 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-afe04ab1-6c1b-4415-bc12-6bd4ff4455f1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments/95392bd9-92c6-4f7d-91bb-53ee1a06ce32" status: 409 len: 152 microversion: 2.1 time: 0.193342 Oct 24 10:51:54.634987 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2668/5298] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 10:51:54 2022] DELETE /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments/95392bd9-92c6-4f7d-91bb-53ee1a06ce32 => generated 152 bytes in 198 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:51:54.644247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cef51e65-68f4-4130-afec-c8a13b0fca67 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:51:54.644908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cef51e65-68f4-4130-afec-c8a13b0fca67 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:54.653060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cef51e65-68f4-4130-afec-c8a13b0fca67 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:54.653566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cef51e65-68f4-4130-afec-c8a13b0fca67 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:54.654018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cef51e65-68f4-4130-afec-c8a13b0fca67 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:54.655388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cef51e65-68f4-4130-afec-c8a13b0fca67 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:54.656039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cef51e65-68f4-4130-afec-c8a13b0fca67 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:54.656480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cef51e65-68f4-4130-afec-c8a13b0fca67 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:54.784673 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cef51e65-68f4-4130-afec-c8a13b0fca67 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "POST /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/action" status: 202 len: 0 microversion: 2.1 time: 0.144443 Oct 24 10:51:54.785979 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2631/5299] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:51:54 2022] POST /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:51:54.794304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e973637b-273e-487e-89a8-6834157ac804 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:54.794900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e973637b-273e-487e-89a8-6834157ac804 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:54.801800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e973637b-273e-487e-89a8-6834157ac804 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:54.802718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e973637b-273e-487e-89a8-6834157ac804 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:54.803176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e973637b-273e-487e-89a8-6834157ac804 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:54.804447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e973637b-273e-487e-89a8-6834157ac804 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:54.805132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e973637b-273e-487e-89a8-6834157ac804 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:54.806013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e973637b-273e-487e-89a8-6834157ac804 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:55.246891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ebc1a8a0-fb81-43e7-8595-6529dfc8ff00 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:55.247853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ebc1a8a0-fb81-43e7-8595-6529dfc8ff00 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:55.255550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebc1a8a0-fb81-43e7-8595-6529dfc8ff00 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:55.256442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebc1a8a0-fb81-43e7-8595-6529dfc8ff00 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:55.257129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebc1a8a0-fb81-43e7-8595-6529dfc8ff00 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:55.258097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebc1a8a0-fb81-43e7-8595-6529dfc8ff00 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:55.258710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebc1a8a0-fb81-43e7-8595-6529dfc8ff00 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:55.259296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebc1a8a0-fb81-43e7-8595-6529dfc8ff00 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:55.658673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e973637b-273e-487e-89a8-6834157ac804 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:55.669166 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e973637b-273e-487e-89a8-6834157ac804 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1722 microversion: 2.1 time: 0.878839 Oct 24 10:51:55.671030 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2669/5300] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:54 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1722 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:51:56.356675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ebc1a8a0-fb81-43e7-8595-6529dfc8ff00 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:56.371550 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ebc1a8a0-fb81-43e7-8595-6529dfc8ff00 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1696 microversion: 2.1 time: 1.135102 Oct 24 10:51:56.374044 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2632/5301] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:55 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1696 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:56.696698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-865ef000-3bbc-49d8-b2dc-34be67cff6bc tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:56.698416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-865ef000-3bbc-49d8-b2dc-34be67cff6bc tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:56.712392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-865ef000-3bbc-49d8-b2dc-34be67cff6bc tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:56.713348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-865ef000-3bbc-49d8-b2dc-34be67cff6bc tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:56.714065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-865ef000-3bbc-49d8-b2dc-34be67cff6bc tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:56.715048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-865ef000-3bbc-49d8-b2dc-34be67cff6bc tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:56.718975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-865ef000-3bbc-49d8-b2dc-34be67cff6bc tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:56.719672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-865ef000-3bbc-49d8-b2dc-34be67cff6bc tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:56.990346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-865ef000-3bbc-49d8-b2dc-34be67cff6bc tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:57.000272 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-865ef000-3bbc-49d8-b2dc-34be67cff6bc tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1722 microversion: 2.1 time: 0.307438 Oct 24 10:51:57.034302 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2670/5302] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:56 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1722 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:51:57.400222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-11367b87-a760-41b8-9fb8-30c877af5e61 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:57.402837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-11367b87-a760-41b8-9fb8-30c877af5e61 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:57.437990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11367b87-a760-41b8-9fb8-30c877af5e61 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:57.438714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11367b87-a760-41b8-9fb8-30c877af5e61 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:57.440605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11367b87-a760-41b8-9fb8-30c877af5e61 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:57.449954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11367b87-a760-41b8-9fb8-30c877af5e61 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:57.457393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11367b87-a760-41b8-9fb8-30c877af5e61 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:57.458308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11367b87-a760-41b8-9fb8-30c877af5e61 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:57.871057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-11367b87-a760-41b8-9fb8-30c877af5e61 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:57.880251 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-11367b87-a760-41b8-9fb8-30c877af5e61 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1696 microversion: 2.1 time: 0.484472 Oct 24 10:51:57.881287 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2633/5303] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:57 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1696 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:51:58.033328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d35d873-5c20-49d8-8ad1-d5dcee3b9123 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:58.034103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2d35d873-5c20-49d8-8ad1-d5dcee3b9123 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:58.049082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d35d873-5c20-49d8-8ad1-d5dcee3b9123 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:58.049897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d35d873-5c20-49d8-8ad1-d5dcee3b9123 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:58.050529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d35d873-5c20-49d8-8ad1-d5dcee3b9123 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:58.056286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d35d873-5c20-49d8-8ad1-d5dcee3b9123 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:58.057055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d35d873-5c20-49d8-8ad1-d5dcee3b9123 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:58.057642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d35d873-5c20-49d8-8ad1-d5dcee3b9123 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:58.591198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2d35d873-5c20-49d8-8ad1-d5dcee3b9123 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:58.635088 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2d35d873-5c20-49d8-8ad1-d5dcee3b9123 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1728 microversion: 2.1 time: 0.606145 Oct 24 10:51:58.638947 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2671/5304] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:58 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1728 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:51:58.663964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ce0aa20f-95a9-482a-a2a3-c4b1a3182135 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:58.665507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ce0aa20f-95a9-482a-a2a3-c4b1a3182135 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:58.675274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce0aa20f-95a9-482a-a2a3-c4b1a3182135 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:58.676163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce0aa20f-95a9-482a-a2a3-c4b1a3182135 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:58.676857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce0aa20f-95a9-482a-a2a3-c4b1a3182135 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:58.677838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce0aa20f-95a9-482a-a2a3-c4b1a3182135 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:58.678537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce0aa20f-95a9-482a-a2a3-c4b1a3182135 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:58.679183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce0aa20f-95a9-482a-a2a3-c4b1a3182135 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:58.930754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5ce2fb03-b50e-4d3c-bc19-2dd9d8ab2d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:51:58.931658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5ce2fb03-b50e-4d3c-bc19-2dd9d8ab2d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:51:58.949527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ce2fb03-b50e-4d3c-bc19-2dd9d8ab2d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:58.950614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ce2fb03-b50e-4d3c-bc19-2dd9d8ab2d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:58.951554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ce2fb03-b50e-4d3c-bc19-2dd9d8ab2d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:58.953869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ce2fb03-b50e-4d3c-bc19-2dd9d8ab2d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:51:58.955364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ce2fb03-b50e-4d3c-bc19-2dd9d8ab2d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:51:58.956139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5ce2fb03-b50e-4d3c-bc19-2dd9d8ab2d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:51:59.154974 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ce0aa20f-95a9-482a-a2a3-c4b1a3182135 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.494716 Oct 24 10:51:59.166708 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2634/5305] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 10:51:58 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-interface => generated 285 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:51:59.877751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5ce2fb03-b50e-4d3c-bc19-2dd9d8ab2d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:51:59.889869 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5ce2fb03-b50e-4d3c-bc19-2dd9d8ab2d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1695 microversion: 2.1 time: 0.972159 Oct 24 10:51:59.890729 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2672/5306] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:51:58 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1695 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:52:00.273221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f4be48e8-9735-453a-a1d4-29e1189f0ccf req-19bc6efa-123c-416a-8bdf-12cd51a49719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7efbf530-723d-4ef0-855d-c38e0bb47cc7", "name": "network-vif-unplugged", "status": "completed", "tag": "96d87680-c8c9-4cb5-b203-ef72c929ad05"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:00.302214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f4be48e8-9735-453a-a1d4-29e1189f0ccf req-19bc6efa-123c-416a-8bdf-12cd51a49719 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:00.314904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f4be48e8-9735-453a-a1d4-29e1189f0ccf req-19bc6efa-123c-416a-8bdf-12cd51a49719 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:00.316017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f4be48e8-9735-453a-a1d4-29e1189f0ccf req-19bc6efa-123c-416a-8bdf-12cd51a49719 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:00.388724 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f4be48e8-9735-453a-a1d4-29e1189f0ccf req-19bc6efa-123c-416a-8bdf-12cd51a49719 service nova] Creating event network-vif-unplugged:96d87680-c8c9-4cb5-b203-ef72c929ad05 for instance 7efbf530-723d-4ef0-855d-c38e0bb47cc7 on n-h2-858383-15 Oct 24 10:52:00.421735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-f4be48e8-9735-453a-a1d4-29e1189f0ccf req-19bc6efa-123c-416a-8bdf-12cd51a49719 service nova] Instance 7efbf530-723d-4ef0-855d-c38e0bb47cc7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:52:00.438344 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f4be48e8-9735-453a-a1d4-29e1189f0ccf req-19bc6efa-123c-416a-8bdf-12cd51a49719 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.169280 Oct 24 10:52:00.439672 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2635/5307] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:00.917088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-513c33b6-cab0-4108-8fdf-ef63e73f5e39 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:00.918037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-513c33b6-cab0-4108-8fdf-ef63e73f5e39 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:00.943279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-513c33b6-cab0-4108-8fdf-ef63e73f5e39 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:00.946775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-513c33b6-cab0-4108-8fdf-ef63e73f5e39 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:00.947465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-513c33b6-cab0-4108-8fdf-ef63e73f5e39 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:00.950883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-513c33b6-cab0-4108-8fdf-ef63e73f5e39 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:00.954220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-513c33b6-cab0-4108-8fdf-ef63e73f5e39 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:00.954914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-513c33b6-cab0-4108-8fdf-ef63e73f5e39 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:02.070023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-513c33b6-cab0-4108-8fdf-ef63e73f5e39 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:02.091935 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-513c33b6-cab0-4108-8fdf-ef63e73f5e39 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1695 microversion: 2.1 time: 1.179591 Oct 24 10:52:02.095512 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2673/5308] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:00 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1695 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:03.037449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-978dfa6f-a619-467d-a3bc-6f0ec6ebb6e6 req-dd4ad671-b7e3-47c6-8948-9ef5e795dfb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f5b0075-c182-4a77-a15a-b904b39cc9c1", "tag": "9375a35b-fad3-4bd3-acee-11b80d2853cf"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:03.078688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-978dfa6f-a619-467d-a3bc-6f0ec6ebb6e6 req-dd4ad671-b7e3-47c6-8948-9ef5e795dfb5 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:03.080013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-978dfa6f-a619-467d-a3bc-6f0ec6ebb6e6 req-dd4ad671-b7e3-47c6-8948-9ef5e795dfb5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:03.080993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-978dfa6f-a619-467d-a3bc-6f0ec6ebb6e6 req-dd4ad671-b7e3-47c6-8948-9ef5e795dfb5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:03.106133 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-978dfa6f-a619-467d-a3bc-6f0ec6ebb6e6 req-dd4ad671-b7e3-47c6-8948-9ef5e795dfb5 service nova] Creating event network-changed:9375a35b-fad3-4bd3-acee-11b80d2853cf for instance 4f5b0075-c182-4a77-a15a-b904b39cc9c1 on n-h2-858383-15 Oct 24 10:52:03.128415 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-978dfa6f-a619-467d-a3bc-6f0ec6ebb6e6 req-dd4ad671-b7e3-47c6-8948-9ef5e795dfb5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107414 Oct 24 10:52:03.131580 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2674/5309] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:03.139463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-00190ae7-3e31-408c-bbdd-59dbe744e91b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:03.142489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-00190ae7-3e31-408c-bbdd-59dbe744e91b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:03.152435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00190ae7-3e31-408c-bbdd-59dbe744e91b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:03.156414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00190ae7-3e31-408c-bbdd-59dbe744e91b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:03.158567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00190ae7-3e31-408c-bbdd-59dbe744e91b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:03.164937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00190ae7-3e31-408c-bbdd-59dbe744e91b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:03.165928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00190ae7-3e31-408c-bbdd-59dbe744e91b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:03.168475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00190ae7-3e31-408c-bbdd-59dbe744e91b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:03.330773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-40f11297-a92f-4721-8a0a-a35c946fdb24 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-7063588", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:03.334660 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-40f11297-a92f-4721-8a0a-a35c946fdb24 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] HTTP exception thrown: min_count must be <= max_count Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-40f11297-a92f-4721-8a0a-a35c946fdb24 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] Request method failure captured: Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 181 Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm5S1135orMQbWerirMcaMD7VbYkKq2ZRXM9NJXsA0XV6AeWl0NA48ct_vlMr9WDghVe_uedRFaRP3cSZtjR28pfPYUne8u1JWPzyoaIw1REXHRgN_letD9kh3EqS-UTQDRfqhQ2pKWjP6da6sf1ZEnyH7y1FTC64NSY5QVpWX5vxwc Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: e6645dec716a4afcaa734616ea63b22f Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-951119029 Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6645dec716a4afcaa734616ea63b22f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6645dec716a4afcaa734616ea63b22f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e6645dec716a4afcaa734616ea63b22f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e6645dec716a4afcaa734616ea63b22f", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-951119029 Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: e6645dec716a4afcaa734616ea63b22f Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-951119029 Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-MultipleCreateNegativeTestJSON-951119029-project Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 0d98d52a894f43c4be3a2f9fee4422a2 Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-951119029-project Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-7063588", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: exception: min_count must be <= max_count Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-7063588', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 24 10:52:03.340455 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.346981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-40f11297-a92f-4721-8a0a-a35c946fdb24 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] Returning 400 to user: min_count must be <= max_count {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:52:03.348052 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-40f11297-a92f-4721-8a0a-a35c946fdb24 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.681125 Oct 24 10:52:03.349407 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2636/5310] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:52:02 2022] POST /compute/v2.1/servers => generated 74 bytes in 683 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 10:52:03.531734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-22636906-7a09-4dd8-92f4-f91ba2757610 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1486043549", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "max_count": 0}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-22636906-7a09-4dd8-92f4-f91ba2757610 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] Request method failure captured: Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 168 Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm5S1135orMQbWerirMcaMD7VbYkKq2ZRXM9NJXsA0XV6AeWl0NA48ct_vlMr9WDghVe_uedRFaRP3cSZtjR28pfPYUne8u1JWPzyoaIw1REXHRgN_letD9kh3EqS-UTQDRfqhQ2pKWjP6da6sf1ZEnyH7y1FTC64NSY5QVpWX5vxwc Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: e6645dec716a4afcaa734616ea63b22f Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-951119029 Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6645dec716a4afcaa734616ea63b22f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6645dec716a4afcaa734616ea63b22f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e6645dec716a4afcaa734616ea63b22f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e6645dec716a4afcaa734616ea63b22f", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-951119029 Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: e6645dec716a4afcaa734616ea63b22f Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-951119029 Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-MultipleCreateNegativeTestJSON-951119029-project Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 0d98d52a894f43c4be3a2f9fee4422a2 Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-951119029-project Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1486043549", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "max_count": 0}} Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1486043549', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'max_count': 0}}} Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 0 Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:52:03.542128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:52:03.546352 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:52:03.546352 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:52:03.546352 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:52:03.546352 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:52:03.546352 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 24 10:52:03.546352 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.546352 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:03.546352 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.546352 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:03.546352 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:03.546352 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:03.546352 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:52:03.546352 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:52:03.546352 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 24 10:52:03.546352 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.552357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-22636906-7a09-4dd8-92f4-f91ba2757610 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:52:03.553267 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-22636906-7a09-4dd8-92f4-f91ba2757610 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.036840 Oct 24 10:52:03.553869 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2637/5311] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:52:03 2022] POST /compute/v2.1/servers => generated 130 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 10:52:03.655642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33a333ca-07dd-4bea-a03f-0b78fc4e9bd0 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1334431150", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "max_count": 2.5}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33a333ca-07dd-4bea-a03f-0b78fc4e9bd0 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] Request method failure captured: Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 170 Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm5S1135orMQbWerirMcaMD7VbYkKq2ZRXM9NJXsA0XV6AeWl0NA48ct_vlMr9WDghVe_uedRFaRP3cSZtjR28pfPYUne8u1JWPzyoaIw1REXHRgN_letD9kh3EqS-UTQDRfqhQ2pKWjP6da6sf1ZEnyH7y1FTC64NSY5QVpWX5vxwc Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: e6645dec716a4afcaa734616ea63b22f Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-951119029 Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6645dec716a4afcaa734616ea63b22f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6645dec716a4afcaa734616ea63b22f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e6645dec716a4afcaa734616ea63b22f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e6645dec716a4afcaa734616ea63b22f", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-951119029 Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: e6645dec716a4afcaa734616ea63b22f Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-951119029 Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-MultipleCreateNegativeTestJSON-951119029-project Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 0d98d52a894f43c4be3a2f9fee4422a2 Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-951119029-project Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1334431150", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "max_count": 2.5}} Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1334431150', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'max_count': 2.5}}} Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 2.5 Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:52:03.659955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:52:03.667685 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:52:03.667685 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:52:03.667685 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:52:03.667685 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:52:03.667685 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 24 10:52:03.667685 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.667685 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:03.667685 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.667685 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:03.667685 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:03.667685 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:03.667685 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:52:03.667685 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:52:03.667685 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 24 10:52:03.667685 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.667685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33a333ca-07dd-4bea-a03f-0b78fc4e9bd0 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:52:03.667685 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-33a333ca-07dd-4bea-a03f-0b78fc4e9bd0 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.014420 Oct 24 10:52:03.667685 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2638/5312] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:52:03 2022] POST /compute/v2.1/servers => generated 139 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:52:03.739128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4416e454-61e4-40a9-810c-b16836ff4438 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1737013248", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "min_count": 0}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4416e454-61e4-40a9-810c-b16836ff4438 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] Request method failure captured: Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 168 Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm5S1135orMQbWerirMcaMD7VbYkKq2ZRXM9NJXsA0XV6AeWl0NA48ct_vlMr9WDghVe_uedRFaRP3cSZtjR28pfPYUne8u1JWPzyoaIw1REXHRgN_letD9kh3EqS-UTQDRfqhQ2pKWjP6da6sf1ZEnyH7y1FTC64NSY5QVpWX5vxwc Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: e6645dec716a4afcaa734616ea63b22f Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-951119029 Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6645dec716a4afcaa734616ea63b22f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6645dec716a4afcaa734616ea63b22f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e6645dec716a4afcaa734616ea63b22f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e6645dec716a4afcaa734616ea63b22f", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-951119029 Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: e6645dec716a4afcaa734616ea63b22f Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-951119029 Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-MultipleCreateNegativeTestJSON-951119029-project Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 0d98d52a894f43c4be3a2f9fee4422a2 Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-951119029-project Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1737013248", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "min_count": 0}} Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1737013248', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'min_count': 0}}} Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 0 Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:52:03.744136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:52:03.748879 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:52:03.748879 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:52:03.748879 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:52:03.748879 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:52:03.748879 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 24 10:52:03.748879 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.748879 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:03.748879 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.748879 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:03.748879 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:03.748879 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:03.748879 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:52:03.748879 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:52:03.748879 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 24 10:52:03.748879 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.748879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4416e454-61e4-40a9-810c-b16836ff4438 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:52:03.755624 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4416e454-61e4-40a9-810c-b16836ff4438 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.023830 Oct 24 10:52:03.756234 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2639/5313] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:52:03 2022] POST /compute/v2.1/servers => generated 130 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:52:03.853423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-00190ae7-3e31-408c-bbdd-59dbe744e91b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:03.869141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-856818f2-c0ea-44a8-897e-f57f4aaf1f91 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1200801427", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "min_count": 2.5}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-856818f2-c0ea-44a8-897e-f57f4aaf1f91 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] Request method failure captured: Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 170 Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm5S1135orMQbWerirMcaMD7VbYkKq2ZRXM9NJXsA0XV6AeWl0NA48ct_vlMr9WDghVe_uedRFaRP3cSZtjR28pfPYUne8u1JWPzyoaIw1REXHRgN_letD9kh3EqS-UTQDRfqhQ2pKWjP6da6sf1ZEnyH7y1FTC64NSY5QVpWX5vxwc Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: e6645dec716a4afcaa734616ea63b22f Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-951119029 Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6645dec716a4afcaa734616ea63b22f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6645dec716a4afcaa734616ea63b22f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e6645dec716a4afcaa734616ea63b22f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e6645dec716a4afcaa734616ea63b22f", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-951119029 Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: e6645dec716a4afcaa734616ea63b22f Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-951119029 Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-MultipleCreateNegativeTestJSON-951119029-project Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 0d98d52a894f43c4be3a2f9fee4422a2 Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-951119029-project Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1200801427", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "min_count": 2.5}} Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1200801427', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'min_count': 2.5}}} Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 2.5 Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:52:03.874683 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:52:03.878789 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:52:03.878789 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:52:03.878789 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:52:03.878789 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:52:03.878789 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 24 10:52:03.878789 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.878789 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:03.878789 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.878789 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:03.878789 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:03.878789 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:03.878789 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:52:03.878789 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:52:03.878789 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 24 10:52:03.878789 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:03.878789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-856818f2-c0ea-44a8-897e-f57f4aaf1f91 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:52:03.879854 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-856818f2-c0ea-44a8-897e-f57f4aaf1f91 tempest-MultipleCreateNegativeTestJSON-951119029 tempest-MultipleCreateNegativeTestJSON-951119029-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.014756 Oct 24 10:52:03.890107 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-00190ae7-3e31-408c-bbdd-59dbe744e91b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1695 microversion: 2.1 time: 0.755525 Oct 24 10:52:03.892656 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2640/5314] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:52:03 2022] POST /compute/v2.1/servers => generated 139 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:52:03.901119 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2675/5315] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:03 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1695 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:04.099768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-5cf8659f-fb54-4f2b-8bea-b200be1312c6 req-33d4c55e-2272-4d3c-bc5e-239ede4a9127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7efbf530-723d-4ef0-855d-c38e0bb47cc7", "tag": "96d87680-c8c9-4cb5-b203-ef72c929ad05"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:04.139372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5cf8659f-fb54-4f2b-8bea-b200be1312c6 req-33d4c55e-2272-4d3c-bc5e-239ede4a9127 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:04.145177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5cf8659f-fb54-4f2b-8bea-b200be1312c6 req-33d4c55e-2272-4d3c-bc5e-239ede4a9127 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:04.145810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5cf8659f-fb54-4f2b-8bea-b200be1312c6 req-33d4c55e-2272-4d3c-bc5e-239ede4a9127 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:04.166879 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-5cf8659f-fb54-4f2b-8bea-b200be1312c6 req-33d4c55e-2272-4d3c-bc5e-239ede4a9127 service nova] Creating event network-changed:96d87680-c8c9-4cb5-b203-ef72c929ad05 for instance 7efbf530-723d-4ef0-855d-c38e0bb47cc7 on n-h2-858383-15 Oct 24 10:52:04.174390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-5cf8659f-fb54-4f2b-8bea-b200be1312c6 req-33d4c55e-2272-4d3c-bc5e-239ede4a9127 service nova] Instance 7efbf530-723d-4ef0-855d-c38e0bb47cc7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:52:04.191327 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-5cf8659f-fb54-4f2b-8bea-b200be1312c6 req-33d4c55e-2272-4d3c-bc5e-239ede4a9127 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097204 Oct 24 10:52:04.192437 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2641/5316] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:04.931842 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-426864e4-48a6-4811-9a0c-3abfcfa51e42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:04.933322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-426864e4-48a6-4811-9a0c-3abfcfa51e42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:04.951707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-426864e4-48a6-4811-9a0c-3abfcfa51e42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:04.954561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-426864e4-48a6-4811-9a0c-3abfcfa51e42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:04.955421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-426864e4-48a6-4811-9a0c-3abfcfa51e42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:04.956394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-426864e4-48a6-4811-9a0c-3abfcfa51e42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:04.958453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-426864e4-48a6-4811-9a0c-3abfcfa51e42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:04.959494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-426864e4-48a6-4811-9a0c-3abfcfa51e42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:05.201038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-9f471718-6c89-4ec0-961a-6b64c8534322 req-290336e1-78be-4d89-8eab-57ab552d7df9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f5b0075-c182-4a77-a15a-b904b39cc9c1", "tag": "9375a35b-fad3-4bd3-acee-11b80d2853cf"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:05.223023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9f471718-6c89-4ec0-961a-6b64c8534322 req-290336e1-78be-4d89-8eab-57ab552d7df9 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:05.223502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9f471718-6c89-4ec0-961a-6b64c8534322 req-290336e1-78be-4d89-8eab-57ab552d7df9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:05.223918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9f471718-6c89-4ec0-961a-6b64c8534322 req-290336e1-78be-4d89-8eab-57ab552d7df9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:05.251930 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-9f471718-6c89-4ec0-961a-6b64c8534322 req-290336e1-78be-4d89-8eab-57ab552d7df9 service nova] Creating event network-changed:9375a35b-fad3-4bd3-acee-11b80d2853cf for instance 4f5b0075-c182-4a77-a15a-b904b39cc9c1 on n-h2-858383-15 Oct 24 10:52:05.270996 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-9f471718-6c89-4ec0-961a-6b64c8534322 req-290336e1-78be-4d89-8eab-57ab552d7df9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074734 Oct 24 10:52:05.272166 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2642/5317] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:52:05.801740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-426864e4-48a6-4811-9a0c-3abfcfa51e42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:05.835578 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-426864e4-48a6-4811-9a0c-3abfcfa51e42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1695 microversion: 2.1 time: 0.906490 Oct 24 10:52:05.849633 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2676/5318] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:04 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1695 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:06.351473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-02637ff1-b048-41c8-a4b8-d910e45b0a94 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:06.353139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-02637ff1-b048-41c8-a4b8-d910e45b0a94 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:06.365618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02637ff1-b048-41c8-a4b8-d910e45b0a94 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:06.369366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02637ff1-b048-41c8-a4b8-d910e45b0a94 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:06.370101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02637ff1-b048-41c8-a4b8-d910e45b0a94 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:06.373320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02637ff1-b048-41c8-a4b8-d910e45b0a94 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:06.374091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02637ff1-b048-41c8-a4b8-d910e45b0a94 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:06.374764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-02637ff1-b048-41c8-a4b8-d910e45b0a94 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:06.559910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-02637ff1-b048-41c8-a4b8-d910e45b0a94 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lazy-loading 'services' on Instance uuid 8856046c-d409-4791-898d-19e0401f6dc0 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:52:06.585862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:52:06.700168 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-02637ff1-b048-41c8-a4b8-d910e45b0a94 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0/os-volume_attachments/f397f07c-1f41-4bc3-800b-6b9f52928b24" status: 202 len: 0 microversion: 2.1 time: 0.353821 Oct 24 10:52:06.701337 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2643/5319] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 10:52:06 2022] DELETE /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0/os-volume_attachments/f397f07c-1f41-4bc3-800b-6b9f52928b24 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:52:06.866670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8e7e4669-1994-4fc1-80fd-11d423f072e0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:06.867449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8e7e4669-1994-4fc1-80fd-11d423f072e0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:06.892381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e7e4669-1994-4fc1-80fd-11d423f072e0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:06.898647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e7e4669-1994-4fc1-80fd-11d423f072e0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:06.900158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e7e4669-1994-4fc1-80fd-11d423f072e0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:06.908802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e7e4669-1994-4fc1-80fd-11d423f072e0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:06.910707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e7e4669-1994-4fc1-80fd-11d423f072e0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:06.911699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e7e4669-1994-4fc1-80fd-11d423f072e0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:07.296815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8e7e4669-1994-4fc1-80fd-11d423f072e0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:07.316132 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8e7e4669-1994-4fc1-80fd-11d423f072e0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1695 microversion: 2.1 time: 0.453750 Oct 24 10:52:07.329635 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2677/5320] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:06 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1695 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:08.360130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5fe01821-f60e-4fb5-b387-6362fab64614 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:08.360873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5fe01821-f60e-4fb5-b387-6362fab64614 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:08.381163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fe01821-f60e-4fb5-b387-6362fab64614 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:08.381655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fe01821-f60e-4fb5-b387-6362fab64614 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:08.382104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fe01821-f60e-4fb5-b387-6362fab64614 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:08.393541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fe01821-f60e-4fb5-b387-6362fab64614 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:08.394230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fe01821-f60e-4fb5-b387-6362fab64614 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:08.394653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fe01821-f60e-4fb5-b387-6362fab64614 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:08.894636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5fe01821-f60e-4fb5-b387-6362fab64614 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:08.910007 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5fe01821-f60e-4fb5-b387-6362fab64614 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1693 microversion: 2.1 time: 0.556131 Oct 24 10:52:08.912011 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2644/5321] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:08 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1693 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:09.941862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-05a9ec64-50fc-4db2-a314-eb5b620322a0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:09.941862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-05a9ec64-50fc-4db2-a314-eb5b620322a0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:09.963870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05a9ec64-50fc-4db2-a314-eb5b620322a0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:09.963870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05a9ec64-50fc-4db2-a314-eb5b620322a0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:09.964265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05a9ec64-50fc-4db2-a314-eb5b620322a0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:09.970027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05a9ec64-50fc-4db2-a314-eb5b620322a0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:09.970616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05a9ec64-50fc-4db2-a314-eb5b620322a0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:09.971077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05a9ec64-50fc-4db2-a314-eb5b620322a0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:10.705302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-05a9ec64-50fc-4db2-a314-eb5b620322a0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:10.734889 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-05a9ec64-50fc-4db2-a314-eb5b620322a0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1690 microversion: 2.1 time: 0.798176 Oct 24 10:52:10.735493 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2678/5322] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:09 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1690 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:10.763027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-91fd099e-8739-40a8-8a09-588e0b2333d2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:10.766263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-91fd099e-8739-40a8-8a09-588e0b2333d2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:10.781316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91fd099e-8739-40a8-8a09-588e0b2333d2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:10.782082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91fd099e-8739-40a8-8a09-588e0b2333d2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:10.782685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91fd099e-8739-40a8-8a09-588e0b2333d2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:10.783738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91fd099e-8739-40a8-8a09-588e0b2333d2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:10.784363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91fd099e-8739-40a8-8a09-588e0b2333d2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:10.785016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91fd099e-8739-40a8-8a09-588e0b2333d2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:10.860535 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-91fd099e-8739-40a8-8a09-588e0b2333d2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7/action" status: 204 len: 0 microversion: 2.1 time: 0.103693 Oct 24 10:52:10.861682 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2645/5323] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:52:10 2022] POST /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7/action => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:52:10.871188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3799f259-ac0d-4b42-9cd9-0e9d67fffccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:10.872080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3799f259-ac0d-4b42-9cd9-0e9d67fffccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:10.879736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3799f259-ac0d-4b42-9cd9-0e9d67fffccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:10.880527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3799f259-ac0d-4b42-9cd9-0e9d67fffccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:10.881303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3799f259-ac0d-4b42-9cd9-0e9d67fffccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:10.883470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3799f259-ac0d-4b42-9cd9-0e9d67fffccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:10.885312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3799f259-ac0d-4b42-9cd9-0e9d67fffccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:10.885983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3799f259-ac0d-4b42-9cd9-0e9d67fffccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:11.229267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3799f259-ac0d-4b42-9cd9-0e9d67fffccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:11.242251 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3799f259-ac0d-4b42-9cd9-0e9d67fffccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1690 microversion: 2.1 time: 0.375875 Oct 24 10:52:11.252723 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2679/5324] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:10 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1690 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:12.278277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fea4a005-e8d3-49d7-aef6-4963ac3a5f7f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:12.280552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fea4a005-e8d3-49d7-aef6-4963ac3a5f7f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:12.298627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fea4a005-e8d3-49d7-aef6-4963ac3a5f7f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:12.299798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fea4a005-e8d3-49d7-aef6-4963ac3a5f7f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:12.300961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fea4a005-e8d3-49d7-aef6-4963ac3a5f7f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:12.303430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fea4a005-e8d3-49d7-aef6-4963ac3a5f7f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:12.307423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fea4a005-e8d3-49d7-aef6-4963ac3a5f7f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:12.308192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fea4a005-e8d3-49d7-aef6-4963ac3a5f7f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:12.970129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fea4a005-e8d3-49d7-aef6-4963ac3a5f7f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:12.978887 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fea4a005-e8d3-49d7-aef6-4963ac3a5f7f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1690 microversion: 2.1 time: 0.706392 Oct 24 10:52:12.981442 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2646/5325] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:12 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1690 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:14.006697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fba40240-3550-4dfc-b4df-91f989e47e30 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:14.007500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fba40240-3550-4dfc-b4df-91f989e47e30 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:14.020061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fba40240-3550-4dfc-b4df-91f989e47e30 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:14.026351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fba40240-3550-4dfc-b4df-91f989e47e30 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:14.026956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fba40240-3550-4dfc-b4df-91f989e47e30 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:14.029084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fba40240-3550-4dfc-b4df-91f989e47e30 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:14.029721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fba40240-3550-4dfc-b4df-91f989e47e30 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:14.030280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fba40240-3550-4dfc-b4df-91f989e47e30 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:15.227202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fba40240-3550-4dfc-b4df-91f989e47e30 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:15.239186 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fba40240-3550-4dfc-b4df-91f989e47e30 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1690 microversion: 2.1 time: 1.237429 Oct 24 10:52:15.256444 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2680/5326] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:14 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1690 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:16.151504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-93472551-5b99-45d2-97c3-6dd3a7821c6c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:16.166088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93472551-5b99-45d2-97c3-6dd3a7821c6c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:16.170988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93472551-5b99-45d2-97c3-6dd3a7821c6c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:16.172814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93472551-5b99-45d2-97c3-6dd3a7821c6c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:16.226248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-93472551-5b99-45d2-97c3-6dd3a7821c6c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Going to try to stop instance {{(pid=120425) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 10:52:16.274246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-66b15e6c-4da6-4dbd-9c15-cb60eafb31b7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:16.275273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-66b15e6c-4da6-4dbd-9c15-cb60eafb31b7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:16.294688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66b15e6c-4da6-4dbd-9c15-cb60eafb31b7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:16.295768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66b15e6c-4da6-4dbd-9c15-cb60eafb31b7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:16.296220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66b15e6c-4da6-4dbd-9c15-cb60eafb31b7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:16.313049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66b15e6c-4da6-4dbd-9c15-cb60eafb31b7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:16.313695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66b15e6c-4da6-4dbd-9c15-cb60eafb31b7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:16.314348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66b15e6c-4da6-4dbd-9c15-cb60eafb31b7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:16.317180 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-93472551-5b99-45d2-97c3-6dd3a7821c6c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "POST /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0/action" status: 202 len: 0 microversion: 2.1 time: 0.172947 Oct 24 10:52:16.318413 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2647/5327] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:52:16 2022] POST /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:52:16.329816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6250fdf8-2785-4691-9daf-8434af79c7de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:16.330894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6250fdf8-2785-4691-9daf-8434af79c7de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:16.349033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6250fdf8-2785-4691-9daf-8434af79c7de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:16.351966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6250fdf8-2785-4691-9daf-8434af79c7de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:16.352631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6250fdf8-2785-4691-9daf-8434af79c7de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:16.353575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6250fdf8-2785-4691-9daf-8434af79c7de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:16.356162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6250fdf8-2785-4691-9daf-8434af79c7de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:16.356877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6250fdf8-2785-4691-9daf-8434af79c7de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:16.901922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6250fdf8-2785-4691-9daf-8434af79c7de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:16.915209 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6250fdf8-2785-4691-9daf-8434af79c7de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1677 microversion: 2.1 time: 0.592148 Oct 24 10:52:16.916196 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2648/5328] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:16 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1677 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:52:16.922925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-66b15e6c-4da6-4dbd-9c15-cb60eafb31b7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:16.930920 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-66b15e6c-4da6-4dbd-9c15-cb60eafb31b7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1682 microversion: 2.1 time: 0.671169 Oct 24 10:52:16.934746 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2681/5329] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:16 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1682 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:52:17.264208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f66fbae7-3b76-4cb7-8776-d10c2c319c9b req-7a7615dc-ee10-4fe9-a81a-df630b656fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7efbf530-723d-4ef0-855d-c38e0bb47cc7", "name": "network-vif-plugged", "status": "completed", "tag": "96d87680-c8c9-4cb5-b203-ef72c929ad05"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:17.283632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f66fbae7-3b76-4cb7-8776-d10c2c319c9b req-7a7615dc-ee10-4fe9-a81a-df630b656fb7 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:17.288219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f66fbae7-3b76-4cb7-8776-d10c2c319c9b req-7a7615dc-ee10-4fe9-a81a-df630b656fb7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:17.288758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f66fbae7-3b76-4cb7-8776-d10c2c319c9b req-7a7615dc-ee10-4fe9-a81a-df630b656fb7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:17.304713 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f66fbae7-3b76-4cb7-8776-d10c2c319c9b req-7a7615dc-ee10-4fe9-a81a-df630b656fb7 service nova] Creating event network-vif-plugged:96d87680-c8c9-4cb5-b203-ef72c929ad05 for instance 7efbf530-723d-4ef0-855d-c38e0bb47cc7 on n-h2-858383-15 Oct 24 10:52:17.312735 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f66fbae7-3b76-4cb7-8776-d10c2c319c9b req-7a7615dc-ee10-4fe9-a81a-df630b656fb7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052244 Oct 24 10:52:17.313917 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2649/5330] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:17.940202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-55d782a4-2a36-4c33-be42-5355f4b974ce tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:17.941307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-55d782a4-2a36-4c33-be42-5355f4b974ce tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:17.959691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55d782a4-2a36-4c33-be42-5355f4b974ce tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:17.960196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55d782a4-2a36-4c33-be42-5355f4b974ce tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:17.960642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55d782a4-2a36-4c33-be42-5355f4b974ce tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:17.961398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55d782a4-2a36-4c33-be42-5355f4b974ce tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:17.961852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55d782a4-2a36-4c33-be42-5355f4b974ce tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:17.962460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55d782a4-2a36-4c33-be42-5355f4b974ce tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:18.331951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-55d782a4-2a36-4c33-be42-5355f4b974ce tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:18.340772 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-55d782a4-2a36-4c33-be42-5355f4b974ce tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1677 microversion: 2.1 time: 0.404757 Oct 24 10:52:18.345248 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2682/5331] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:17 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1677 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:19.368318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f6c29b31-75a3-49b6-b21c-0d17c27ebb3c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:19.369625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f6c29b31-75a3-49b6-b21c-0d17c27ebb3c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:19.386223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6c29b31-75a3-49b6-b21c-0d17c27ebb3c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:19.386724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6c29b31-75a3-49b6-b21c-0d17c27ebb3c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:19.387169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6c29b31-75a3-49b6-b21c-0d17c27ebb3c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:19.387888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6c29b31-75a3-49b6-b21c-0d17c27ebb3c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:19.388335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6c29b31-75a3-49b6-b21c-0d17c27ebb3c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:19.388812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6c29b31-75a3-49b6-b21c-0d17c27ebb3c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:19.987734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f6c29b31-75a3-49b6-b21c-0d17c27ebb3c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:20.011861 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f6c29b31-75a3-49b6-b21c-0d17c27ebb3c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1677 microversion: 2.1 time: 0.644103 Oct 24 10:52:20.017869 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2650/5332] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:19 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1677 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:21.044114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-176ded80-b08c-474b-95eb-18dfa26fd388 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:21.045902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-176ded80-b08c-474b-95eb-18dfa26fd388 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:21.053319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-176ded80-b08c-474b-95eb-18dfa26fd388 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:21.054133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-176ded80-b08c-474b-95eb-18dfa26fd388 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:21.054793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-176ded80-b08c-474b-95eb-18dfa26fd388 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:21.055796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-176ded80-b08c-474b-95eb-18dfa26fd388 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:21.056483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-176ded80-b08c-474b-95eb-18dfa26fd388 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:21.057259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-176ded80-b08c-474b-95eb-18dfa26fd388 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:21.320386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-176ded80-b08c-474b-95eb-18dfa26fd388 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:21.329601 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-176ded80-b08c-474b-95eb-18dfa26fd388 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1677 microversion: 2.1 time: 0.289594 Oct 24 10:52:21.333882 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2683/5333] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:21 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1677 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:21.496090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c45afd97-2cab-48da-94fb-c3b3455f5b8c tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Action: 'create', calling method: .version_select at 0x7f04cb926af0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-660099006", "policies": ["affinity"]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:21.536759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c45afd97-2cab-48da-94fb-c3b3455f5b8c tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:52:21.559911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c45afd97-2cab-48da-94fb-c3b3455f5b8c tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for user efdddb903f4546aabc0fe0c4aeddd4cd and project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:52:21.667463 n-d-858383-15 devstack@n-api.service[120425]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c45afd97-2cab-48da-94fb-c3b3455f5b8c tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [0abf7c05-d150-487f-8c63-68138362ab14] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 10:52:22.362354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-abd87628-8a26-4a45-890d-d9770be02ce5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:22.362968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-abd87628-8a26-4a45-890d-d9770be02ce5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:22.371651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abd87628-8a26-4a45-890d-d9770be02ce5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:22.372413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abd87628-8a26-4a45-890d-d9770be02ce5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:22.373247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abd87628-8a26-4a45-890d-d9770be02ce5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:22.374377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abd87628-8a26-4a45-890d-d9770be02ce5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:22.374477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abd87628-8a26-4a45-890d-d9770be02ce5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:22.374914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abd87628-8a26-4a45-890d-d9770be02ce5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:22.665335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-abd87628-8a26-4a45-890d-d9770be02ce5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:22.677036 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [None req-c45afd97-2cab-48da-94fb-c3b3455f5b8c tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [0abf7c05-d150-487f-8c63-68138362ab14] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 48206. Oct 24 10:52:22.680617 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-abd87628-8a26-4a45-890d-d9770be02ce5 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1677 microversion: 2.1 time: 0.323116 Oct 24 10:52:22.698812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:52:22.698921 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2684/5334] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:22 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1677 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:52:22.716598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c45afd97-2cab-48da-94fb-c3b3455f5b8c tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:52:22.724344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c45afd97-2cab-48da-94fb-c3b3455f5b8c tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for user efdddb903f4546aabc0fe0c4aeddd4cd and project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:52:22.764244 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c45afd97-2cab-48da-94fb-c3b3455f5b8c tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 1.583113 Oct 24 10:52:22.768142 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2651/5335] 10.222.0.50 () {60 vars in 1174 bytes} [Mon Oct 24 10:52:21 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:22.785619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-88b4d4a9-190e-4544-809b-6fa4813be916 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Action: 'create', calling method: .version_select at 0x7f04cb78f430>, body: {"server_group": {"name": "tempest-server-group-52660458", "policies": ["affinity"]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:22.826496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-88b4d4a9-190e-4544-809b-6fa4813be916 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:52:22.840672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-88b4d4a9-190e-4544-809b-6fa4813be916 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for user efdddb903f4546aabc0fe0c4aeddd4cd and project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:52:22.957018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-88b4d4a9-190e-4544-809b-6fa4813be916 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:52:22.978599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-88b4d4a9-190e-4544-809b-6fa4813be916 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for user efdddb903f4546aabc0fe0c4aeddd4cd and project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:52:23.016603 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-88b4d4a9-190e-4544-809b-6fa4813be916 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.241094 Oct 24 10:52:23.025038 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2685/5336] 10.222.0.50 () {60 vars in 1173 bytes} [Mon Oct 24 10:52:22 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:23.030457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-370758d3-e15b-4d64-84a5-402e6948ca01 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Action: 'create', calling method: .version_select at 0x7f04cb9548b0>, body: {"server_group": {"name": "tempest-server-group-52660458", "policies": ["affinity"]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:23.064637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-370758d3-e15b-4d64-84a5-402e6948ca01 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:52:23.077884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-370758d3-e15b-4d64-84a5-402e6948ca01 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for user efdddb903f4546aabc0fe0c4aeddd4cd and project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:52:23.198147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-370758d3-e15b-4d64-84a5-402e6948ca01 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:52:23.214631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-370758d3-e15b-4d64-84a5-402e6948ca01 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for user efdddb903f4546aabc0fe0c4aeddd4cd and project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:52:23.262481 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-370758d3-e15b-4d64-84a5-402e6948ca01 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.236247 Oct 24 10:52:23.264097 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2652/5337] 10.222.0.50 () {60 vars in 1173 bytes} [Mon Oct 24 10:52:23 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:23.280531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f0212d99-a0e8-4c86-a4af-c18a34350beb tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:23.293032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:52:23.370775 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f0212d99-a0e8-4c86-a4af-c18a34350beb tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/402cab21-21b4-4c24-8739-4bdc05a2b7a2" status: 204 len: 0 microversion: 2.1 time: 0.099613 Oct 24 10:52:23.377705 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2686/5338] 10.222.0.50 () {58 vars in 1266 bytes} [Mon Oct 24 10:52:23 2022] DELETE /compute/v2.1/os-server-groups/402cab21-21b4-4c24-8739-4bdc05a2b7a2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:52:23.386300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b7a3bc6a-21e4-44fb-bf71-1a9511bafb86 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:23.406851 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b7a3bc6a-21e4-44fb-bf71-1a9511bafb86 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 332 microversion: 2.1 time: 0.025019 Oct 24 10:52:23.412402 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2653/5339] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:52:23 2022] GET /compute/v2.1/os-server-groups => generated 332 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:23.431026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-747c36b2-ef82-4a76-9498-8256ae4d7140 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:23.489005 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-747c36b2-ef82-4a76-9498-8256ae4d7140 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/c531c8df-72e2-4716-a16d-cda1e72449e4" status: 204 len: 0 microversion: 2.1 time: 0.069594 Oct 24 10:52:23.491330 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2687/5340] 10.222.0.50 () {58 vars in 1266 bytes} [Mon Oct 24 10:52:23 2022] DELETE /compute/v2.1/os-server-groups/c531c8df-72e2-4716-a16d-cda1e72449e4 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:52:23.500634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-579d4c44-389f-4aa4-8623-d496c9069c17 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:23.524075 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-579d4c44-389f-4aa4-8623-d496c9069c17 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.028291 Oct 24 10:52:23.526061 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2654/5341] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:52:23 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:52:23.541011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7b3576e6-2378-44e9-8006-13694c995fe2 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Action: 'create', calling method: .version_select at 0x7f04cb743700>, body: {"server_group": {"name": "tempest-server-group-92007788", "policies": ["affinity"]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:23.589634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-7b3576e6-2378-44e9-8006-13694c995fe2 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:52:23.603213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-7b3576e6-2378-44e9-8006-13694c995fe2 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for user efdddb903f4546aabc0fe0c4aeddd4cd and project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:52:23.706932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-19597259-dc11-4484-bf0e-5f08dbfac549 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:23.708371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-19597259-dc11-4484-bf0e-5f08dbfac549 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:23.726358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19597259-dc11-4484-bf0e-5f08dbfac549 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:23.727030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19597259-dc11-4484-bf0e-5f08dbfac549 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:23.727488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19597259-dc11-4484-bf0e-5f08dbfac549 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:23.733754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19597259-dc11-4484-bf0e-5f08dbfac549 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:23.735396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19597259-dc11-4484-bf0e-5f08dbfac549 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:23.735857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19597259-dc11-4484-bf0e-5f08dbfac549 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:23.779899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-7b3576e6-2378-44e9-8006-13694c995fe2 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:52:23.790999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-7b3576e6-2378-44e9-8006-13694c995fe2 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for user efdddb903f4546aabc0fe0c4aeddd4cd and project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:52:23.830583 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7b3576e6-2378-44e9-8006-13694c995fe2 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.295228 Oct 24 10:52:23.836871 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2688/5342] 10.222.0.50 () {60 vars in 1173 bytes} [Mon Oct 24 10:52:23 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:23.849073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-25fd19a7-4975-429c-9052-b230ae226111 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:23.908383 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-25fd19a7-4975-429c-9052-b230ae226111 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/2027eb68-d704-4428-b7da-b6ab17d4ecb5" status: 204 len: 0 microversion: 2.1 time: 0.063185 Oct 24 10:52:23.909936 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2689/5343] 10.222.0.50 () {58 vars in 1266 bytes} [Mon Oct 24 10:52:23 2022] DELETE /compute/v2.1/os-server-groups/2027eb68-d704-4428-b7da-b6ab17d4ecb5 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:52:23.924795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4b09583c-82f4-4d4d-94ad-3e7d5ed094ca tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:24.009619 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4b09583c-82f4-4d4d-94ad-3e7d5ed094ca tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.095183 Oct 24 10:52:24.028125 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2690/5344] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:52:23 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:24.048911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9d892fa1-08a7-47ff-a481-a6bfa4597256 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Action: 'create', calling method: .version_select at 0x7f04d04b3a60>, body: {"server_group": {"name": "tempest-server-group-167529209", "policies": ["anti-affinity"]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:24.058554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-19597259-dc11-4484-bf0e-5f08dbfac549 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:24.085522 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-19597259-dc11-4484-bf0e-5f08dbfac549 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1677 microversion: 2.1 time: 0.377267 Oct 24 10:52:24.089470 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2655/5345] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:23 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1677 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:24.161433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-9d892fa1-08a7-47ff-a481-a6bfa4597256 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:52:24.174647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-9d892fa1-08a7-47ff-a481-a6bfa4597256 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for user efdddb903f4546aabc0fe0c4aeddd4cd and project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:52:24.271459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-9d892fa1-08a7-47ff-a481-a6bfa4597256 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:52:24.289856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-9d892fa1-08a7-47ff-a481-a6bfa4597256 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for user efdddb903f4546aabc0fe0c4aeddd4cd and project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_groups'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:52:24.346905 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9d892fa1-08a7-47ff-a481-a6bfa4597256 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.314993 Oct 24 10:52:24.363348 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2691/5346] 10.222.0.50 () {60 vars in 1173 bytes} [Mon Oct 24 10:52:24 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:24.369053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-52416447-f9fb-4f81-9125-79b3f1b51f5d tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:24.526471 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-52416447-f9fb-4f81-9125-79b3f1b51f5d tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/9b4e6bbf-89cd-4f0a-84a0-f202856a7a98" status: 204 len: 0 microversion: 2.1 time: 0.156143 Oct 24 10:52:24.530907 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2656/5347] 10.222.0.50 () {58 vars in 1266 bytes} [Mon Oct 24 10:52:24 2022] DELETE /compute/v2.1/os-server-groups/9b4e6bbf-89cd-4f0a-84a0-f202856a7a98 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 10:52:24.538268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d7a6599d-e5fd-4baf-8c9d-16d7a8443839 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:24.563318 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d7a6599d-e5fd-4baf-8c9d-16d7a8443839 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.030615 Oct 24 10:52:24.568265 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2692/5348] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:52:24 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:24.703373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-2011138721", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "f29a443f-648e-4ed8-a9ac-8340a25318d2"}]}, "os:scheduler_hints": {"group": "fca8abaf-b311-4c14-8d85-f68a271bc777"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:24.904970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] validate_networks() for [('f29a443f-648e-4ed8-a9ac-8340a25318d2', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:52:25.113190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ca85c86c-75e8-41e6-878a-c4d74af0f61a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:25.115021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ca85c86c-75e8-41e6-878a-c4d74af0f61a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:25.147902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca85c86c-75e8-41e6-878a-c4d74af0f61a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:25.148401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca85c86c-75e8-41e6-878a-c4d74af0f61a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:25.149046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca85c86c-75e8-41e6-878a-c4d74af0f61a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:25.149921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca85c86c-75e8-41e6-878a-c4d74af0f61a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:25.150381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca85c86c-75e8-41e6-878a-c4d74af0f61a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:25.150811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca85c86c-75e8-41e6-878a-c4d74af0f61a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:25.165222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=99 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:52:25.867779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ca85c86c-75e8-41e6-878a-c4d74af0f61a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:25.882216 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ca85c86c-75e8-41e6-878a-c4d74af0f61a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1677 microversion: 2.1 time: 0.774113 Oct 24 10:52:25.900409 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2693/5349] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:25 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1677 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:52:26.118578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:52:26.119159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:52:26.119456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:52:26.119862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:52:26.120267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:52:26.142303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:26.142800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:26.143244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:26.151373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:26.152126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:26.152587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:26.177241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for project eacd772e809e4aedbdc95d41298965d9. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:52:26.195510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for user efdddb903f4546aabc0fe0c4aeddd4cd and project eacd772e809e4aedbdc95d41298965d9. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:52:26.241226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:52:26.246119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:52:26.381083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120425) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 24 10:52:26.409514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_group_members'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:52:26.415796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for user efdddb903f4546aabc0fe0c4aeddd4cd and project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_group_members'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:52:26.484707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_group_members'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:52:26.492372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Getting quotas for user efdddb903f4546aabc0fe0c4aeddd4cd and project eacd772e809e4aedbdc95d41298965d9. Resources: {'server_group_members'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:52:26.528640 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0ddd1310-72e4-4db4-acbd-8c001f943ef9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.831432 Oct 24 10:52:26.538187 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2657/5350] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:52:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:52:26.541170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c356a051-3e3e-4fa5-a855-d4eee591c0df tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:26.541798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c356a051-3e3e-4fa5-a855-d4eee591c0df tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:26.711345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c356a051-3e3e-4fa5-a855-d4eee591c0df tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdddb903f4546aabc0fe0c4aeddd4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd772e809e4aedbdc95d41298965d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:26.724950 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c356a051-3e3e-4fa5-a855-d4eee591c0df tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 200 len: 1213 microversion: 2.1 time: 0.187315 Oct 24 10:52:26.745364 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2694/5351] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:26 2022] GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 1213 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:52:26.912969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c5f8ff9a-db0b-460c-9847-d5ea518687e2 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:26.913655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c5f8ff9a-db0b-460c-9847-d5ea518687e2 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:26.939657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5f8ff9a-db0b-460c-9847-d5ea518687e2 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:26.941512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5f8ff9a-db0b-460c-9847-d5ea518687e2 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:26.941982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5f8ff9a-db0b-460c-9847-d5ea518687e2 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:26.943158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5f8ff9a-db0b-460c-9847-d5ea518687e2 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:26.943158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5f8ff9a-db0b-460c-9847-d5ea518687e2 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:26.943602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5f8ff9a-db0b-460c-9847-d5ea518687e2 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:27.408236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c5f8ff9a-db0b-460c-9847-d5ea518687e2 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:27.435184 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c5f8ff9a-db0b-460c-9847-d5ea518687e2 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1654 microversion: 2.1 time: 0.523603 Oct 24 10:52:27.464900 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2658/5352] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:26 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1654 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:27.471445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8bfa92ce-5c39-44a7-bf3e-0a1e6115bb01 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:27.486561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bfa92ce-5c39-44a7-bf3e-0a1e6115bb01 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:27.487072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bfa92ce-5c39-44a7-bf3e-0a1e6115bb01 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:27.489607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bfa92ce-5c39-44a7-bf3e-0a1e6115bb01 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:27.564924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8bfa92ce-5c39-44a7-bf3e-0a1e6115bb01 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Going to try to start instance {{(pid=120426) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 10:52:27.678053 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8bfa92ce-5c39-44a7-bf3e-0a1e6115bb01 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "POST /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0/action" status: 202 len: 0 microversion: 2.1 time: 0.211762 Oct 24 10:52:27.679152 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2695/5353] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:52:27 2022] POST /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:52:27.689998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-77a204a6-6f1f-44f1-a87e-6d9d610d1c44 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:27.690934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-77a204a6-6f1f-44f1-a87e-6d9d610d1c44 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:27.715653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77a204a6-6f1f-44f1-a87e-6d9d610d1c44 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:27.718110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77a204a6-6f1f-44f1-a87e-6d9d610d1c44 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:27.720453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77a204a6-6f1f-44f1-a87e-6d9d610d1c44 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:27.721822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77a204a6-6f1f-44f1-a87e-6d9d610d1c44 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:27.723611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77a204a6-6f1f-44f1-a87e-6d9d610d1c44 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:27.725579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77a204a6-6f1f-44f1-a87e-6d9d610d1c44 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:27.755424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c210f6a1-8953-4165-a9fb-25c6c5f70b53 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:27.756205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c210f6a1-8953-4165-a9fb-25c6c5f70b53 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:27.783464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c210f6a1-8953-4165-a9fb-25c6c5f70b53 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:27.786939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c210f6a1-8953-4165-a9fb-25c6c5f70b53 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:27.787689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c210f6a1-8953-4165-a9fb-25c6c5f70b53 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:27.792521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c210f6a1-8953-4165-a9fb-25c6c5f70b53 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:27.793856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c210f6a1-8953-4165-a9fb-25c6c5f70b53 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:27.798903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c210f6a1-8953-4165-a9fb-25c6c5f70b53 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:28.240102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c210f6a1-8953-4165-a9fb-25c6c5f70b53 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdddb903f4546aabc0fe0c4aeddd4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd772e809e4aedbdc95d41298965d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:28.253832 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c210f6a1-8953-4165-a9fb-25c6c5f70b53 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 200 len: 1217 microversion: 2.1 time: 0.503891 Oct 24 10:52:28.255160 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2696/5354] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:27 2022] GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 1217 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:52:28.334832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-77a204a6-6f1f-44f1-a87e-6d9d610d1c44 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:28.360087 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-77a204a6-6f1f-44f1-a87e-6d9d610d1c44 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1663 microversion: 2.1 time: 0.676004 Oct 24 10:52:28.363275 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2659/5355] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:27 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1663 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:29.290124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0457716c-d828-40fd-8239-b18dc7e2e068 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:29.291659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0457716c-d828-40fd-8239-b18dc7e2e068 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:29.317107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0457716c-d828-40fd-8239-b18dc7e2e068 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:29.317712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0457716c-d828-40fd-8239-b18dc7e2e068 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:29.318387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0457716c-d828-40fd-8239-b18dc7e2e068 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:29.319361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0457716c-d828-40fd-8239-b18dc7e2e068 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:29.320131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0457716c-d828-40fd-8239-b18dc7e2e068 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:29.320755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0457716c-d828-40fd-8239-b18dc7e2e068 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:29.390852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a2163a9d-3921-4800-946e-7b69a238e654 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:29.392145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a2163a9d-3921-4800-946e-7b69a238e654 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:29.416792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:52:29.419165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2163a9d-3921-4800-946e-7b69a238e654 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:29.419746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2163a9d-3921-4800-946e-7b69a238e654 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:29.421671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2163a9d-3921-4800-946e-7b69a238e654 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:29.422805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2163a9d-3921-4800-946e-7b69a238e654 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:29.423500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2163a9d-3921-4800-946e-7b69a238e654 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:29.424162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2163a9d-3921-4800-946e-7b69a238e654 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:29.533372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0457716c-d828-40fd-8239-b18dc7e2e068 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdddb903f4546aabc0fe0c4aeddd4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd772e809e4aedbdc95d41298965d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:29.578676 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0457716c-d828-40fd-8239-b18dc7e2e068 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 200 len: 1283 microversion: 2.1 time: 0.297370 Oct 24 10:52:29.580744 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2697/5356] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:29 2022] GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 1283 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:29.811005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a2163a9d-3921-4800-946e-7b69a238e654 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:29.832875 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a2163a9d-3921-4800-946e-7b69a238e654 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1663 microversion: 2.1 time: 0.444660 Oct 24 10:52:29.835894 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2660/5357] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:29 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1663 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:52:30.606469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b5ca9fab-566b-4b8c-a741-35b8efb4eb5b tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:30.607109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b5ca9fab-566b-4b8c-a741-35b8efb4eb5b tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:30.624790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5ca9fab-566b-4b8c-a741-35b8efb4eb5b tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:30.625487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5ca9fab-566b-4b8c-a741-35b8efb4eb5b tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:30.626290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5ca9fab-566b-4b8c-a741-35b8efb4eb5b tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:30.627027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5ca9fab-566b-4b8c-a741-35b8efb4eb5b tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:30.627487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5ca9fab-566b-4b8c-a741-35b8efb4eb5b tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:30.627916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5ca9fab-566b-4b8c-a741-35b8efb4eb5b tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:30.881963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e5f00f30-5ba5-4afc-b039-e896ae2c33e4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:30.882753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e5f00f30-5ba5-4afc-b039-e896ae2c33e4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:30.906004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5f00f30-5ba5-4afc-b039-e896ae2c33e4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:30.906568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5f00f30-5ba5-4afc-b039-e896ae2c33e4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:30.909059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5f00f30-5ba5-4afc-b039-e896ae2c33e4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:30.910664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5f00f30-5ba5-4afc-b039-e896ae2c33e4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:30.915390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5f00f30-5ba5-4afc-b039-e896ae2c33e4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:30.919419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5f00f30-5ba5-4afc-b039-e896ae2c33e4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:30.926135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b5ca9fab-566b-4b8c-a741-35b8efb4eb5b tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdddb903f4546aabc0fe0c4aeddd4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd772e809e4aedbdc95d41298965d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:30.944809 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b5ca9fab-566b-4b8c-a741-35b8efb4eb5b tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 200 len: 1271 microversion: 2.1 time: 0.340494 Oct 24 10:52:30.945726 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2698/5358] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:30 2022] GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 1271 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:31.807667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e5f00f30-5ba5-4afc-b039-e896ae2c33e4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:31.820405 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e5f00f30-5ba5-4afc-b039-e896ae2c33e4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1667 microversion: 2.1 time: 0.956949 Oct 24 10:52:31.822129 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2661/5359] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:30 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1667 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:31.976733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a7f84b61-f6b8-4b93-a483-6af7fa6cfa98 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:31.977425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a7f84b61-f6b8-4b93-a483-6af7fa6cfa98 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:31.989802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7f84b61-f6b8-4b93-a483-6af7fa6cfa98 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:31.998789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7f84b61-f6b8-4b93-a483-6af7fa6cfa98 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:31.999886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7f84b61-f6b8-4b93-a483-6af7fa6cfa98 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:32.004404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7f84b61-f6b8-4b93-a483-6af7fa6cfa98 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:32.006979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7f84b61-f6b8-4b93-a483-6af7fa6cfa98 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:32.013446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7f84b61-f6b8-4b93-a483-6af7fa6cfa98 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:32.523095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a7f84b61-f6b8-4b93-a483-6af7fa6cfa98 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdddb903f4546aabc0fe0c4aeddd4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd772e809e4aedbdc95d41298965d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:32.534304 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a7f84b61-f6b8-4b93-a483-6af7fa6cfa98 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 200 len: 1313 microversion: 2.1 time: 0.562960 Oct 24 10:52:32.536078 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2699/5360] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:31 2022] GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:32.541111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-538df37a-25ef-4fe8-be69-6f4f00c8783e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:32.541692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-538df37a-25ef-4fe8-be69-6f4f00c8783e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:32.553534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-538df37a-25ef-4fe8-be69-6f4f00c8783e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:32.557537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-538df37a-25ef-4fe8-be69-6f4f00c8783e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:32.558076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-538df37a-25ef-4fe8-be69-6f4f00c8783e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:32.561127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-538df37a-25ef-4fe8-be69-6f4f00c8783e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:32.561824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-538df37a-25ef-4fe8-be69-6f4f00c8783e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:32.562498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-538df37a-25ef-4fe8-be69-6f4f00c8783e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:32.769853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-538df37a-25ef-4fe8-be69-6f4f00c8783e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lazy-loading 'services' on Instance uuid 4f5b0075-c182-4a77-a15a-b904b39cc9c1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:52:32.915180 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-538df37a-25ef-4fe8-be69-6f4f00c8783e tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments/95392bd9-92c6-4f7d-91bb-53ee1a06ce32" status: 202 len: 0 microversion: 2.1 time: 0.376989 Oct 24 10:52:32.915813 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2662/5361] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 10:52:32 2022] DELETE /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments/95392bd9-92c6-4f7d-91bb-53ee1a06ce32 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:52:32.933628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ecaa4693-578c-4dbe-be55-f7403a620dea tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:32.938748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ecaa4693-578c-4dbe-be55-f7403a620dea tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:32.955184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ecaa4693-578c-4dbe-be55-f7403a620dea tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:32.960197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ecaa4693-578c-4dbe-be55-f7403a620dea tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:32.961066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ecaa4693-578c-4dbe-be55-f7403a620dea tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:32.961906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ecaa4693-578c-4dbe-be55-f7403a620dea tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:32.962430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ecaa4693-578c-4dbe-be55-f7403a620dea tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:32.962945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ecaa4693-578c-4dbe-be55-f7403a620dea tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:33.096884 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ecaa4693-578c-4dbe-be55-f7403a620dea tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175510 Oct 24 10:52:33.098606 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2700/5362] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:52:32 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:33.570481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2d89c60b-e4d5-4116-a3f7-010457bfc128 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:33.572235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2d89c60b-e4d5-4116-a3f7-010457bfc128 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:33.593497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d89c60b-e4d5-4116-a3f7-010457bfc128 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:33.594206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d89c60b-e4d5-4116-a3f7-010457bfc128 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:33.596226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d89c60b-e4d5-4116-a3f7-010457bfc128 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:33.597741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d89c60b-e4d5-4116-a3f7-010457bfc128 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:33.604271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d89c60b-e4d5-4116-a3f7-010457bfc128 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:33.604752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d89c60b-e4d5-4116-a3f7-010457bfc128 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:33.719634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-30c9bce6-7c83-4cb2-8416-a048e31a2c04 req-d9e02d7e-9255-45f3-a1c3-0c4879537ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd84def8-cae6-4d9b-a1fc-503643a1fafd", "tag": "c3ca6b14-031b-49d8-84fb-99bc6823cb21"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:33.740384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:52:33.745579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-30c9bce6-7c83-4cb2-8416-a048e31a2c04 req-d9e02d7e-9255-45f3-a1c3-0c4879537ce6 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:33.746072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-30c9bce6-7c83-4cb2-8416-a048e31a2c04 req-d9e02d7e-9255-45f3-a1c3-0c4879537ce6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:33.746520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-30c9bce6-7c83-4cb2-8416-a048e31a2c04 req-d9e02d7e-9255-45f3-a1c3-0c4879537ce6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:34.398362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2d89c60b-e4d5-4116-a3f7-010457bfc128 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdddb903f4546aabc0fe0c4aeddd4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd772e809e4aedbdc95d41298965d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:34.401853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:52:34.421660 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2d89c60b-e4d5-4116-a3f7-010457bfc128 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 200 len: 1313 microversion: 2.1 time: 0.856753 Oct 24 10:52:34.428235 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-30c9bce6-7c83-4cb2-8416-a048e31a2c04 req-d9e02d7e-9255-45f3-a1c3-0c4879537ce6 service nova] Creating event network-changed:c3ca6b14-031b-49d8-84fb-99bc6823cb21 for instance dd84def8-cae6-4d9b-a1fc-503643a1fafd on n-h1-858383-15 Oct 24 10:52:34.429529 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2663/5363] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:33 2022] GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 1313 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:34.462303 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-30c9bce6-7c83-4cb2-8416-a048e31a2c04 req-d9e02d7e-9255-45f3-a1c3-0c4879537ce6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.745185 Oct 24 10:52:34.464366 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2701/5364] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:34.478318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e4fd631a-7f41-442f-b5a5-20d900eeabab tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:34.488979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e4fd631a-7f41-442f-b5a5-20d900eeabab tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:34.556819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4fd631a-7f41-442f-b5a5-20d900eeabab tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:34.561742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4fd631a-7f41-442f-b5a5-20d900eeabab tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:34.563615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4fd631a-7f41-442f-b5a5-20d900eeabab tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:34.571466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4fd631a-7f41-442f-b5a5-20d900eeabab tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:34.573868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4fd631a-7f41-442f-b5a5-20d900eeabab tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:34.576782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4fd631a-7f41-442f-b5a5-20d900eeabab tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:34.707980 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e4fd631a-7f41-442f-b5a5-20d900eeabab tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.271670 Oct 24 10:52:34.709600 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2664/5365] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:52:34 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments => generated 197 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:35.459972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-64c47a30-b1a3-47d9-a273-e7c0843dd7f9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:35.461549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-64c47a30-b1a3-47d9-a273-e7c0843dd7f9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:35.469776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64c47a30-b1a3-47d9-a273-e7c0843dd7f9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:35.470692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64c47a30-b1a3-47d9-a273-e7c0843dd7f9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:35.471465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64c47a30-b1a3-47d9-a273-e7c0843dd7f9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:35.472399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64c47a30-b1a3-47d9-a273-e7c0843dd7f9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:35.473091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64c47a30-b1a3-47d9-a273-e7c0843dd7f9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:35.473800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64c47a30-b1a3-47d9-a273-e7c0843dd7f9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:35.721796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a367bd98-bd71-4360-8fe2-3027ac3071d1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:35.723998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a367bd98-bd71-4360-8fe2-3027ac3071d1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:35.739678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a367bd98-bd71-4360-8fe2-3027ac3071d1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:35.740179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a367bd98-bd71-4360-8fe2-3027ac3071d1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:35.740631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a367bd98-bd71-4360-8fe2-3027ac3071d1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:35.741384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a367bd98-bd71-4360-8fe2-3027ac3071d1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:35.741848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a367bd98-bd71-4360-8fe2-3027ac3071d1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:35.742285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a367bd98-bd71-4360-8fe2-3027ac3071d1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:35.753846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-64c47a30-b1a3-47d9-a273-e7c0843dd7f9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdddb903f4546aabc0fe0c4aeddd4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd772e809e4aedbdc95d41298965d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:35.766180 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-64c47a30-b1a3-47d9-a273-e7c0843dd7f9 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 200 len: 1313 microversion: 2.1 time: 0.310337 Oct 24 10:52:35.780876 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2702/5366] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:35 2022] GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:35.812452 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a367bd98-bd71-4360-8fe2-3027ac3071d1 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095578 Oct 24 10:52:35.813095 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2665/5367] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:52:35 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:36.800587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-296901e1-847f-40b3-b0e8-da5f1d3f1512 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:36.802566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-296901e1-847f-40b3-b0e8-da5f1d3f1512 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:36.810311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=26 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:52:36.813231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-296901e1-847f-40b3-b0e8-da5f1d3f1512 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:36.814459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-296901e1-847f-40b3-b0e8-da5f1d3f1512 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:36.816704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-296901e1-847f-40b3-b0e8-da5f1d3f1512 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:36.818027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-296901e1-847f-40b3-b0e8-da5f1d3f1512 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:36.818967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-296901e1-847f-40b3-b0e8-da5f1d3f1512 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:36.832057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-224247a0-16de-47a6-85ef-0f219c911837 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:36.837630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-296901e1-847f-40b3-b0e8-da5f1d3f1512 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:36.849095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-224247a0-16de-47a6-85ef-0f219c911837 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:36.852068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:52:36.855543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=30 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:52:36.887157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-224247a0-16de-47a6-85ef-0f219c911837 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:36.888189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-224247a0-16de-47a6-85ef-0f219c911837 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:36.889125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-224247a0-16de-47a6-85ef-0f219c911837 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:36.890382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-224247a0-16de-47a6-85ef-0f219c911837 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:36.891233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-224247a0-16de-47a6-85ef-0f219c911837 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:36.893382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-224247a0-16de-47a6-85ef-0f219c911837 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:36.981408 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-224247a0-16de-47a6-85ef-0f219c911837 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158441 Oct 24 10:52:36.990377 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2666/5368] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:52:36 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:37.276094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-296901e1-847f-40b3-b0e8-da5f1d3f1512 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdddb903f4546aabc0fe0c4aeddd4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd772e809e4aedbdc95d41298965d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:37.290679 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-296901e1-847f-40b3-b0e8-da5f1d3f1512 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 200 len: 1313 microversion: 2.1 time: 0.491335 Oct 24 10:52:37.296343 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2703/5369] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:36 2022] GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 1313 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:38.002423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a573864d-ec9b-4211-b23b-d30a235b9050 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:38.005064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a573864d-ec9b-4211-b23b-d30a235b9050 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:38.032137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a573864d-ec9b-4211-b23b-d30a235b9050 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:38.032639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a573864d-ec9b-4211-b23b-d30a235b9050 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:38.033112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a573864d-ec9b-4211-b23b-d30a235b9050 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:38.042276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a573864d-ec9b-4211-b23b-d30a235b9050 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:38.042791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a573864d-ec9b-4211-b23b-d30a235b9050 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:38.043247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a573864d-ec9b-4211-b23b-d30a235b9050 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:38.140386 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a573864d-ec9b-4211-b23b-d30a235b9050 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144195 Oct 24 10:52:38.141052 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2667/5370] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:52:37 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:38.322794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e66487ed-8054-4e0e-bf91-64962f0c2d26 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:38.323414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e66487ed-8054-4e0e-bf91-64962f0c2d26 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:38.339921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e66487ed-8054-4e0e-bf91-64962f0c2d26 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:38.340302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e66487ed-8054-4e0e-bf91-64962f0c2d26 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:38.345291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e66487ed-8054-4e0e-bf91-64962f0c2d26 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:38.349924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e66487ed-8054-4e0e-bf91-64962f0c2d26 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:38.350625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e66487ed-8054-4e0e-bf91-64962f0c2d26 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:38.351360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e66487ed-8054-4e0e-bf91-64962f0c2d26 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:38.867532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e66487ed-8054-4e0e-bf91-64962f0c2d26 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdddb903f4546aabc0fe0c4aeddd4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd772e809e4aedbdc95d41298965d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:38.907243 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e66487ed-8054-4e0e-bf91-64962f0c2d26 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 200 len: 1313 microversion: 2.1 time: 0.588323 Oct 24 10:52:38.910041 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2704/5371] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:38 2022] GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:39.155168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9faa9fca-b586-4bdb-b232-a67af725d25f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:39.160166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9faa9fca-b586-4bdb-b232-a67af725d25f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:39.190865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9faa9fca-b586-4bdb-b232-a67af725d25f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:39.191888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9faa9fca-b586-4bdb-b232-a67af725d25f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:39.192710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9faa9fca-b586-4bdb-b232-a67af725d25f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:39.193948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9faa9fca-b586-4bdb-b232-a67af725d25f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:39.194689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9faa9fca-b586-4bdb-b232-a67af725d25f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:39.195362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9faa9fca-b586-4bdb-b232-a67af725d25f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:39.242837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8caefbc7-6acd-49a5-8ee2-3bebf10dea1d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:39.245097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8caefbc7-6acd-49a5-8ee2-3bebf10dea1d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:39.249419 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9faa9fca-b586-4bdb-b232-a67af725d25f tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098840 Oct 24 10:52:39.250788 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2668/5372] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:52:39 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:39.274894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8caefbc7-6acd-49a5-8ee2-3bebf10dea1d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:39.275406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8caefbc7-6acd-49a5-8ee2-3bebf10dea1d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:39.275855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8caefbc7-6acd-49a5-8ee2-3bebf10dea1d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:39.276583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8caefbc7-6acd-49a5-8ee2-3bebf10dea1d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:39.277077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8caefbc7-6acd-49a5-8ee2-3bebf10dea1d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:39.277494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8caefbc7-6acd-49a5-8ee2-3bebf10dea1d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:39.383293 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8caefbc7-6acd-49a5-8ee2-3bebf10dea1d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7/action" status: 200 len: 24574 microversion: 2.1 time: 0.144106 Oct 24 10:52:39.385072 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2705/5373] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:52:39 2022] POST /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7/action => generated 24574 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 10:52:39.934271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f105b3dd-d2e6-4827-beb5-cc363b3b92db tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:39.935158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f105b3dd-d2e6-4827-beb5-cc363b3b92db tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:39.946328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f105b3dd-d2e6-4827-beb5-cc363b3b92db tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:39.947731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f105b3dd-d2e6-4827-beb5-cc363b3b92db tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:39.948347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f105b3dd-d2e6-4827-beb5-cc363b3b92db tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:39.954139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f105b3dd-d2e6-4827-beb5-cc363b3b92db tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:39.956653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f105b3dd-d2e6-4827-beb5-cc363b3b92db tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:39.957326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f105b3dd-d2e6-4827-beb5-cc363b3b92db tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:40.266952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e5511d32-7444-4ad5-8283-4a11ecc8bfb5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:40.277328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e5511d32-7444-4ad5-8283-4a11ecc8bfb5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:40.294831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5511d32-7444-4ad5-8283-4a11ecc8bfb5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:40.295892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5511d32-7444-4ad5-8283-4a11ecc8bfb5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:40.296562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5511d32-7444-4ad5-8283-4a11ecc8bfb5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:40.297787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5511d32-7444-4ad5-8283-4a11ecc8bfb5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:40.298420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5511d32-7444-4ad5-8283-4a11ecc8bfb5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:40.298996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5511d32-7444-4ad5-8283-4a11ecc8bfb5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:40.326955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f105b3dd-d2e6-4827-beb5-cc363b3b92db tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdddb903f4546aabc0fe0c4aeddd4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd772e809e4aedbdc95d41298965d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:40.343355 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f105b3dd-d2e6-4827-beb5-cc363b3b92db tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 200 len: 1313 microversion: 2.1 time: 0.415636 Oct 24 10:52:40.344010 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2669/5374] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:39 2022] GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:40.379255 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e5511d32-7444-4ad5-8283-4a11ecc8bfb5 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118389 Oct 24 10:52:40.384536 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2706/5375] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:52:40 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:52:41.170994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-eecb14a3-181f-4edb-ad61-d6315c712ebd req-dc46dea8-ecee-478c-b53f-0d7f68d2aba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd84def8-cae6-4d9b-a1fc-503643a1fafd", "name": "network-vif-plugged", "status": "completed", "tag": "c3ca6b14-031b-49d8-84fb-99bc6823cb21"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:41.201833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eecb14a3-181f-4edb-ad61-d6315c712ebd req-dc46dea8-ecee-478c-b53f-0d7f68d2aba2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:41.202697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eecb14a3-181f-4edb-ad61-d6315c712ebd req-dc46dea8-ecee-478c-b53f-0d7f68d2aba2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:41.203348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eecb14a3-181f-4edb-ad61-d6315c712ebd req-dc46dea8-ecee-478c-b53f-0d7f68d2aba2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:41.241582 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-eecb14a3-181f-4edb-ad61-d6315c712ebd req-dc46dea8-ecee-478c-b53f-0d7f68d2aba2 service nova] Creating event network-vif-plugged:c3ca6b14-031b-49d8-84fb-99bc6823cb21 for instance dd84def8-cae6-4d9b-a1fc-503643a1fafd on n-h1-858383-15 Oct 24 10:52:41.261933 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-eecb14a3-181f-4edb-ad61-d6315c712ebd req-dc46dea8-ecee-478c-b53f-0d7f68d2aba2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088925 Oct 24 10:52:41.265330 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2670/5376] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:52:41.368676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b6ab87cd-0c8f-414a-8658-c2e705b603ed tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:41.369473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b6ab87cd-0c8f-414a-8658-c2e705b603ed tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:41.382707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6ab87cd-0c8f-414a-8658-c2e705b603ed tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:41.383441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6ab87cd-0c8f-414a-8658-c2e705b603ed tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:41.384073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6ab87cd-0c8f-414a-8658-c2e705b603ed tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:41.387898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6ab87cd-0c8f-414a-8658-c2e705b603ed tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:41.389860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6ab87cd-0c8f-414a-8658-c2e705b603ed tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:41.391176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6ab87cd-0c8f-414a-8658-c2e705b603ed tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:41.398336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-41cb5ca7-d479-415d-86c8-53cc530cc509 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:41.401720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-41cb5ca7-d479-415d-86c8-53cc530cc509 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:41.416929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41cb5ca7-d479-415d-86c8-53cc530cc509 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:41.418753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41cb5ca7-d479-415d-86c8-53cc530cc509 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:41.421641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41cb5ca7-d479-415d-86c8-53cc530cc509 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:41.422637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41cb5ca7-d479-415d-86c8-53cc530cc509 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:41.425628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41cb5ca7-d479-415d-86c8-53cc530cc509 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:41.426291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41cb5ca7-d479-415d-86c8-53cc530cc509 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:41.479159 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-41cb5ca7-d479-415d-86c8-53cc530cc509 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090286 Oct 24 10:52:41.480037 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2671/5377] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:52:41 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:52:41.641491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b6ab87cd-0c8f-414a-8658-c2e705b603ed tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdddb903f4546aabc0fe0c4aeddd4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd772e809e4aedbdc95d41298965d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:41.657097 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b6ab87cd-0c8f-414a-8658-c2e705b603ed tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 200 len: 1313 microversion: 2.1 time: 0.293637 Oct 24 10:52:41.674140 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2707/5378] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:41 2022] GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:42.492550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b4377196-fc3f-41f6-85c5-cae7d93bec78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:42.495120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b4377196-fc3f-41f6-85c5-cae7d93bec78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:42.511238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4377196-fc3f-41f6-85c5-cae7d93bec78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:42.513918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4377196-fc3f-41f6-85c5-cae7d93bec78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:42.515803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4377196-fc3f-41f6-85c5-cae7d93bec78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:42.519251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4377196-fc3f-41f6-85c5-cae7d93bec78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:42.521403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4377196-fc3f-41f6-85c5-cae7d93bec78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:42.522845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4377196-fc3f-41f6-85c5-cae7d93bec78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:42.601021 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b4377196-fc3f-41f6-85c5-cae7d93bec78 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112884 Oct 24 10:52:42.601642 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2672/5379] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:52:42 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:52:42.682925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e08e75b2-767f-49c8-8f28-6b5dfc1292c8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:42.683833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e08e75b2-767f-49c8-8f28-6b5dfc1292c8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:42.696319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e08e75b2-767f-49c8-8f28-6b5dfc1292c8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:42.699258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e08e75b2-767f-49c8-8f28-6b5dfc1292c8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:42.701749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e08e75b2-767f-49c8-8f28-6b5dfc1292c8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:42.703010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e08e75b2-767f-49c8-8f28-6b5dfc1292c8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:42.703817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e08e75b2-767f-49c8-8f28-6b5dfc1292c8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:42.704480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e08e75b2-767f-49c8-8f28-6b5dfc1292c8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:42.751437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a34f9bf4-f709-4ab0-9bed-cd2815343849 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:42.758789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a34f9bf4-f709-4ab0-9bed-cd2815343849 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:42.766343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a34f9bf4-f709-4ab0-9bed-cd2815343849 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:42.767244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a34f9bf4-f709-4ab0-9bed-cd2815343849 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:42.768240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a34f9bf4-f709-4ab0-9bed-cd2815343849 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:42.769540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a34f9bf4-f709-4ab0-9bed-cd2815343849 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:42.770805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a34f9bf4-f709-4ab0-9bed-cd2815343849 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:42.771722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a34f9bf4-f709-4ab0-9bed-cd2815343849 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:42.802925 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-a34f9bf4-f709-4ab0-9bed-cd2815343849 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] HTTP exception thrown: Cannot 'reboot' instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 while it is in vm_state rescued Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a34f9bf4-f709-4ab0-9bed-cd2815343849 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Request method failure captured: Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9/action HTTP/1.1 Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 28 Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm1_YpcUoTx6EtuRJqEim52THa9nHc93ggv-rCTsxHF8KCdRzu0B50Tb2gQcOKEkZzR8bjwxbVU1lCLt9l9Nlkw5MZDlojxwV2MAHZbN_UcYOzact8aaTN_ICS6JQcw4OPHcT53rEwR6K2uYrfqZ498tDq4tCZjBExjOK6wvBxhiRXQ Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 0ae874e076c34c44adb00f85aebd000e Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ae874e076c34c44adb00f85aebd000e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 0ae874e076c34c44adb00f85aebd000e Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerRescueNegativeTestJSON-615921797-project Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6da7534777ef4425aefa81bc7e49b69f Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-615921797-project Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: {"reboot": {"type": "HARD"}} Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: exception: Cannot 'reboot' instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 while it is in vm_state rescued Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '5e1338eb-7f3d-4680-a0ee-931115da05f9', 'body': {'reboot': {'type': 'HARD'}}} Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 10:52:42.805077 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 10:52:42.808599 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 while it is in vm_state rescued Oct 24 10:52:42.808599 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:42.808599 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:42.808599 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:42.808599 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:42.808599 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:42.808599 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:42.808599 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:52:42.808599 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:52:42.808599 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 while it is in vm_state rescued Oct 24 10:52:42.808599 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:42.813385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a34f9bf4-f709-4ab0-9bed-cd2815343849 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Returning 409 to user: Cannot 'reboot' instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 while it is in vm_state rescued {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:52:42.814566 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a34f9bf4-f709-4ab0-9bed-cd2815343849 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "POST /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9/action" status: 409 len: 145 microversion: 2.1 time: 0.067873 Oct 24 10:52:42.815536 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2673/5380] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:52:42 2022] POST /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9/action => generated 145 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 24 10:52:42.837776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2bfe61a2-7518-4291-aa6c-7e95fa42eafb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:42.840549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2bfe61a2-7518-4291-aa6c-7e95fa42eafb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:42.852378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bfe61a2-7518-4291-aa6c-7e95fa42eafb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:42.852886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bfe61a2-7518-4291-aa6c-7e95fa42eafb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:42.853342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bfe61a2-7518-4291-aa6c-7e95fa42eafb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:42.854037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bfe61a2-7518-4291-aa6c-7e95fa42eafb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:42.854492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bfe61a2-7518-4291-aa6c-7e95fa42eafb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:42.854916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2bfe61a2-7518-4291-aa6c-7e95fa42eafb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:42.901461 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-2bfe61a2-7518-4291-aa6c-7e95fa42eafb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] HTTP exception thrown: Cannot 'rebuild' instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 while it is in vm_state rescued Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2bfe61a2-7518-4291-aa6c-7e95fa42eafb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Request method failure captured: Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9/action HTTP/1.1 Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 65 Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm1_YpcUoTx6EtuRJqEim52THa9nHc93ggv-rCTsxHF8KCdRzu0B50Tb2gQcOKEkZzR8bjwxbVU1lCLt9l9Nlkw5MZDlojxwV2MAHZbN_UcYOzact8aaTN_ICS6JQcw4OPHcT53rEwR6K2uYrfqZ498tDq4tCZjBExjOK6wvBxhiRXQ Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 0ae874e076c34c44adb00f85aebd000e Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ae874e076c34c44adb00f85aebd000e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 0ae874e076c34c44adb00f85aebd000e Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerRescueNegativeTestJSON-615921797-project Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6da7534777ef4425aefa81bc7e49b69f Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-615921797-project Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: {"rebuild": {"imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7"}} Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: exception: Cannot 'rebuild' instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 while it is in vm_state rescued Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '5e1338eb-7f3d-4680-a0ee-931115da05f9', 'body': {'rebuild': {'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7'}}} Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:52:42.903165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 while it is in vm_state rescued Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 while it is in vm_state rescued Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2bfe61a2-7518-4291-aa6c-7e95fa42eafb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Returning 409 to user: Cannot 'rebuild' instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 while it is in vm_state rescued {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2bfe61a2-7518-4291-aa6c-7e95fa42eafb tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "POST /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9/action" status: 409 len: 146 microversion: 2.1 time: 0.080407 Oct 24 10:52:42.907973 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2674/5381] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:52:42 2022] POST /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9/action => generated 146 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:52:42.915826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-763dcd9e-8f25-4040-9515-d6318074b7a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:42.916325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-763dcd9e-8f25-4040-9515-d6318074b7a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:42.939761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-763dcd9e-8f25-4040-9515-d6318074b7a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:42.940416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-763dcd9e-8f25-4040-9515-d6318074b7a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:42.940919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-763dcd9e-8f25-4040-9515-d6318074b7a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:42.941678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-763dcd9e-8f25-4040-9515-d6318074b7a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:42.942139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-763dcd9e-8f25-4040-9515-d6318074b7a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:42.942572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-763dcd9e-8f25-4040-9515-d6318074b7a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:42.974451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e08e75b2-767f-49c8-8f28-6b5dfc1292c8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdddb903f4546aabc0fe0c4aeddd4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd772e809e4aedbdc95d41298965d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:43.009911 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e08e75b2-767f-49c8-8f28-6b5dfc1292c8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 200 len: 1313 microversion: 2.1 time: 0.332868 Oct 24 10:52:43.010666 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2708/5382] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:42 2022] GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:43.023324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-763dcd9e-8f25-4040-9515-d6318074b7a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:52:43.211389 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-763dcd9e-8f25-4040-9515-d6318074b7a2 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 204 len: 0 microversion: 2.1 time: 0.298981 Oct 24 10:52:43.224922 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2675/5383] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:52:42 2022] DELETE /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:52:43.225644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a34305da-94b9-45db-b975-2a6ea20da9ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:43.227681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a34305da-94b9-45db-b975-2a6ea20da9ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:43.242783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a34305da-94b9-45db-b975-2a6ea20da9ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:43.243105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a34305da-94b9-45db-b975-2a6ea20da9ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:43.251545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a34305da-94b9-45db-b975-2a6ea20da9ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:43.252611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a34305da-94b9-45db-b975-2a6ea20da9ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:43.258653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a34305da-94b9-45db-b975-2a6ea20da9ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:43.259979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a34305da-94b9-45db-b975-2a6ea20da9ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:43.908298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a34305da-94b9-45db-b975-2a6ea20da9ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:43.917182 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a34305da-94b9-45db-b975-2a6ea20da9ee tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1688 microversion: 2.1 time: 0.696033 Oct 24 10:52:43.929987 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2709/5384] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:43 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1688 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:44.051766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-24de23c1-3855-4c11-bcfb-9aeb2c8351dd tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:44.054582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-24de23c1-3855-4c11-bcfb-9aeb2c8351dd tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:44.073313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24de23c1-3855-4c11-bcfb-9aeb2c8351dd tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:44.076101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24de23c1-3855-4c11-bcfb-9aeb2c8351dd tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:44.076786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24de23c1-3855-4c11-bcfb-9aeb2c8351dd tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:44.079937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24de23c1-3855-4c11-bcfb-9aeb2c8351dd tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:44.080492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24de23c1-3855-4c11-bcfb-9aeb2c8351dd tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:44.080987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24de23c1-3855-4c11-bcfb-9aeb2c8351dd tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:44.405682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-24de23c1-3855-4c11-bcfb-9aeb2c8351dd tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdddb903f4546aabc0fe0c4aeddd4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd772e809e4aedbdc95d41298965d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:44.414702 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-24de23c1-3855-4c11-bcfb-9aeb2c8351dd tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 200 len: 1497 microversion: 2.1 time: 0.381570 Oct 24 10:52:44.432869 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2676/5385] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:44 2022] GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 1497 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:44.440294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d26e5275-17d7-4b2c-bd99-b0775119d4a8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:44.464928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.compute.server_groups [None req-d26e5275-17d7-4b2c-bd99-b0775119d4a8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Querying cell 75e76125-592d-4292-bea1-3b51451d7165(cell1) for 1 instances {{(pid=120426) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 24 10:52:44.465620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d26e5275-17d7-4b2c-bd99-b0775119d4a8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:44.466107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d26e5275-17d7-4b2c-bd99-b0775119d4a8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:44.466859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d26e5275-17d7-4b2c-bd99-b0775119d4a8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:44.493859 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d26e5275-17d7-4b2c-bd99-b0775119d4a8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/fca8abaf-b311-4c14-8d85-f68a271bc777" status: 200 len: 221 microversion: 2.1 time: 0.057340 Oct 24 10:52:44.501501 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2710/5386] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:52:44 2022] GET /compute/v2.1/os-server-groups/fca8abaf-b311-4c14-8d85-f68a271bc777 => generated 221 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:44.506339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ff9facf-1c2d-443f-8177-4c7b13503186 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:44.506847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ff9facf-1c2d-443f-8177-4c7b13503186 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:44.521128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ff9facf-1c2d-443f-8177-4c7b13503186 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:44.521412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ff9facf-1c2d-443f-8177-4c7b13503186 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:44.522151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ff9facf-1c2d-443f-8177-4c7b13503186 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:44.523048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ff9facf-1c2d-443f-8177-4c7b13503186 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:44.523783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ff9facf-1c2d-443f-8177-4c7b13503186 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:44.524376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ff9facf-1c2d-443f-8177-4c7b13503186 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:44.586356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ff9facf-1c2d-443f-8177-4c7b13503186 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:52:44.954912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c752cc97-f9fe-49e0-ac9a-65714a17b811 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:44.956975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c752cc97-f9fe-49e0-ac9a-65714a17b811 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:44.972790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c752cc97-f9fe-49e0-ac9a-65714a17b811 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:44.974502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c752cc97-f9fe-49e0-ac9a-65714a17b811 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:44.975815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c752cc97-f9fe-49e0-ac9a-65714a17b811 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:44.977615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c752cc97-f9fe-49e0-ac9a-65714a17b811 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:44.980472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c752cc97-f9fe-49e0-ac9a-65714a17b811 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:44.982597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c752cc97-f9fe-49e0-ac9a-65714a17b811 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:44.991080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:52:45.097853 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ff9facf-1c2d-443f-8177-4c7b13503186 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 204 len: 0 microversion: 2.1 time: 0.595085 Oct 24 10:52:45.099472 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2677/5387] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:52:44 2022] DELETE /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:52:45.108355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-34a57d52-9f73-43c6-b681-46c35c8dcdb1 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:45.109570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-34a57d52-9f73-43c6-b681-46c35c8dcdb1 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:45.127437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34a57d52-9f73-43c6-b681-46c35c8dcdb1 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:45.128323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34a57d52-9f73-43c6-b681-46c35c8dcdb1 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:45.132473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34a57d52-9f73-43c6-b681-46c35c8dcdb1 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:45.133566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34a57d52-9f73-43c6-b681-46c35c8dcdb1 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:45.137673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34a57d52-9f73-43c6-b681-46c35c8dcdb1 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:45.138599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34a57d52-9f73-43c6-b681-46c35c8dcdb1 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:45.175237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:52:45.510070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c752cc97-f9fe-49e0-ac9a-65714a17b811 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:45.521531 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c752cc97-f9fe-49e0-ac9a-65714a17b811 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1688 microversion: 2.1 time: 0.572174 Oct 24 10:52:45.522122 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2711/5388] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:44 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1688 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:52:45.573321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-34a57d52-9f73-43c6-b681-46c35c8dcdb1 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdddb903f4546aabc0fe0c4aeddd4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd772e809e4aedbdc95d41298965d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:45.606451 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-34a57d52-9f73-43c6-b681-46c35c8dcdb1 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 200 len: 1503 microversion: 2.1 time: 0.502669 Oct 24 10:52:45.614895 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2678/5389] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:45 2022] GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 1503 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:52:45.638173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8bcaf423-e94b-4251-8a54-ce26bbacc03b tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:45.639454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8bcaf423-e94b-4251-8a54-ce26bbacc03b tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:45.658631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bcaf423-e94b-4251-8a54-ce26bbacc03b tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:45.659332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bcaf423-e94b-4251-8a54-ce26bbacc03b tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:45.659944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bcaf423-e94b-4251-8a54-ce26bbacc03b tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:45.660821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bcaf423-e94b-4251-8a54-ce26bbacc03b tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:45.661457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bcaf423-e94b-4251-8a54-ce26bbacc03b tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:45.662228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bcaf423-e94b-4251-8a54-ce26bbacc03b tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:46.061472 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8bcaf423-e94b-4251-8a54-ce26bbacc03b tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1835 microversion: 2.1 time: 0.426351 Oct 24 10:52:46.062900 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2712/5390] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:45 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1835 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:46.549175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dcc08200-4e6e-4a1e-86c1-92feccad1676 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:46.549799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dcc08200-4e6e-4a1e-86c1-92feccad1676 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:46.567444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcc08200-4e6e-4a1e-86c1-92feccad1676 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:46.568572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcc08200-4e6e-4a1e-86c1-92feccad1676 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:46.571345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcc08200-4e6e-4a1e-86c1-92feccad1676 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:46.572349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcc08200-4e6e-4a1e-86c1-92feccad1676 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:46.572861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcc08200-4e6e-4a1e-86c1-92feccad1676 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:46.573338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcc08200-4e6e-4a1e-86c1-92feccad1676 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:46.638135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b0c259a6-475d-49ae-b399-8adc916c3a50 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:46.639988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b0c259a6-475d-49ae-b399-8adc916c3a50 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:46.652449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b0c259a6-475d-49ae-b399-8adc916c3a50 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:46.656068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b0c259a6-475d-49ae-b399-8adc916c3a50 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:46.656716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b0c259a6-475d-49ae-b399-8adc916c3a50 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:46.661102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b0c259a6-475d-49ae-b399-8adc916c3a50 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:46.661801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b0c259a6-475d-49ae-b399-8adc916c3a50 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:46.662483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b0c259a6-475d-49ae-b399-8adc916c3a50 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:47.713172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dcc08200-4e6e-4a1e-86c1-92feccad1676 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:47.722881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b0c259a6-475d-49ae-b399-8adc916c3a50 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdddb903f4546aabc0fe0c4aeddd4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd772e809e4aedbdc95d41298965d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:47.753436 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b0c259a6-475d-49ae-b399-8adc916c3a50 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 200 len: 1503 microversion: 2.1 time: 1.119167 Oct 24 10:52:47.756615 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dcc08200-4e6e-4a1e-86c1-92feccad1676 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1688 microversion: 2.1 time: 1.214098 Oct 24 10:52:47.789352 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2713/5391] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:46 2022] GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 1503 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:52:47.791129 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2679/5392] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:46 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1688 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:48.789090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ba89d1f5-a053-4183-b925-600aadc63806 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:48.789710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3a1fa42b-1aac-491a-a7fe-056a8fbc86b8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:48.790339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3a1fa42b-1aac-491a-a7fe-056a8fbc86b8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:48.791217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ba89d1f5-a053-4183-b925-600aadc63806 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:48.804740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba89d1f5-a053-4183-b925-600aadc63806 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:48.805519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba89d1f5-a053-4183-b925-600aadc63806 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:48.807620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a1fa42b-1aac-491a-a7fe-056a8fbc86b8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:48.807883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba89d1f5-a053-4183-b925-600aadc63806 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:48.808124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a1fa42b-1aac-491a-a7fe-056a8fbc86b8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:48.808570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a1fa42b-1aac-491a-a7fe-056a8fbc86b8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:48.809183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba89d1f5-a053-4183-b925-600aadc63806 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:48.809331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a1fa42b-1aac-491a-a7fe-056a8fbc86b8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:48.809889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a1fa42b-1aac-491a-a7fe-056a8fbc86b8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:48.810218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a1fa42b-1aac-491a-a7fe-056a8fbc86b8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:48.811209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba89d1f5-a053-4183-b925-600aadc63806 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:48.813965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba89d1f5-a053-4183-b925-600aadc63806 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:49.121346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3a1fa42b-1aac-491a-a7fe-056a8fbc86b8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdddb903f4546aabc0fe0c4aeddd4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacd772e809e4aedbdc95d41298965d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:49.121744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ba89d1f5-a053-4183-b925-600aadc63806 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:49.143925 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3a1fa42b-1aac-491a-a7fe-056a8fbc86b8 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 200 len: 1461 microversion: 2.1 time: 0.357882 Oct 24 10:52:49.147694 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2680/5393] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:48 2022] GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 1461 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:49.157069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-22704c46-db55-4950-887e-039f7bbe059e req-0c07c492-9242-42e0-a851-e5ec597db150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd84def8-cae6-4d9b-a1fc-503643a1fafd", "name": "network-vif-deleted", "tag": "c3ca6b14-031b-49d8-84fb-99bc6823cb21"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:49.177383 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ba89d1f5-a053-4183-b925-600aadc63806 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1621 microversion: 2.1 time: 0.391315 Oct 24 10:52:49.178478 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2714/5394] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:48 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1621 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:49.190354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-22704c46-db55-4950-887e-039f7bbe059e req-0c07c492-9242-42e0-a851-e5ec597db150 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:49.193506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-22704c46-db55-4950-887e-039f7bbe059e req-0c07c492-9242-42e0-a851-e5ec597db150 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:49.194154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-22704c46-db55-4950-887e-039f7bbe059e req-0c07c492-9242-42e0-a851-e5ec597db150 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:49.236293 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-22704c46-db55-4950-887e-039f7bbe059e req-0c07c492-9242-42e0-a851-e5ec597db150 service nova] Creating event network-vif-deleted:c3ca6b14-031b-49d8-84fb-99bc6823cb21 for instance dd84def8-cae6-4d9b-a1fc-503643a1fafd on n-h1-858383-15 Oct 24 10:52:49.242685 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-22704c46-db55-4950-887e-039f7bbe059e req-0c07c492-9242-42e0-a851-e5ec597db150 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091096 Oct 24 10:52:49.243989 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2681/5395] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:49.462251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-6cce9036-e80b-44a2-8ca5-3998b5bb6914 req-54d5bfa3-f799-4e91-90e2-3239e2da65b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5b0075-c182-4a77-a15a-b904b39cc9c1", "name": "network-vif-deleted", "tag": "9375a35b-fad3-4bd3-acee-11b80d2853cf"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:49.487317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6cce9036-e80b-44a2-8ca5-3998b5bb6914 req-54d5bfa3-f799-4e91-90e2-3239e2da65b6 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:49.487818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6cce9036-e80b-44a2-8ca5-3998b5bb6914 req-54d5bfa3-f799-4e91-90e2-3239e2da65b6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:49.488259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6cce9036-e80b-44a2-8ca5-3998b5bb6914 req-54d5bfa3-f799-4e91-90e2-3239e2da65b6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:49.511490 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-6cce9036-e80b-44a2-8ca5-3998b5bb6914 req-54d5bfa3-f799-4e91-90e2-3239e2da65b6 service nova] Creating event network-vif-deleted:9375a35b-fad3-4bd3-acee-11b80d2853cf for instance 4f5b0075-c182-4a77-a15a-b904b39cc9c1 on n-h2-858383-15 Oct 24 10:52:49.538660 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-6cce9036-e80b-44a2-8ca5-3998b5bb6914 req-54d5bfa3-f799-4e91-90e2-3239e2da65b6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088330 Oct 24 10:52:49.541271 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2715/5396] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:50.028227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7820a7db-f559-41a2-8aaa-76c0b5b7515e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:50.028907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7820a7db-f559-41a2-8aaa-76c0b5b7515e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:50.056036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7820a7db-f559-41a2-8aaa-76c0b5b7515e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:50.061306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7820a7db-f559-41a2-8aaa-76c0b5b7515e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:50.061656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7820a7db-f559-41a2-8aaa-76c0b5b7515e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:50.070727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7820a7db-f559-41a2-8aaa-76c0b5b7515e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:50.071337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7820a7db-f559-41a2-8aaa-76c0b5b7515e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:50.071803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7820a7db-f559-41a2-8aaa-76c0b5b7515e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:50.162412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7820a7db-f559-41a2-8aaa-76c0b5b7515e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:52:50.175899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dbdc19ca-7df9-42a2-8353-bd7959af467a tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:50.176732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dbdc19ca-7df9-42a2-8353-bd7959af467a tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:50.206681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbdc19ca-7df9-42a2-8353-bd7959af467a tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:50.211862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbdc19ca-7df9-42a2-8353-bd7959af467a tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:50.213806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbdc19ca-7df9-42a2-8353-bd7959af467a tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:50.216795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbdc19ca-7df9-42a2-8353-bd7959af467a tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:50.226360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbdc19ca-7df9-42a2-8353-bd7959af467a tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:50.235810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dbdc19ca-7df9-42a2-8353-bd7959af467a tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:50.264229 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-dbdc19ca-7df9-42a2-8353-bd7959af467a tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] HTTP exception thrown: Instance dd84def8-cae6-4d9b-a1fc-503643a1fafd could not be found. Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dbdc19ca-7df9-42a2-8353-bd7959af467a tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Request method failure captured: Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd HTTP/1.1 Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm5kwtaDtlTKeaiZukmpjifJYm1tEawORSFggnKqrZZgmfdl-GlCvCcnv7_g83Rfs4oJ4aMdoDI5HG3pi2rlo89BwYNAc06OROWqwsPu4dVQjIMdtpIGm0Xj5i8csKmJ3iG54trHiPbeFuBIC511Hi9ZUeCfDlF5fVS3r9HfGalR7NA Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: eacd772e809e4aedbdc95d41298965d9 Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eacd772e809e4aedbdc95d41298965d9", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: eacd772e809e4aedbdc95d41298965d9 Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerGroupTestJSON-223589316-project Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: efdddb903f4546aabc0fe0c4aeddd4cd Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerGroupTestJSON-223589316-project Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance dd84def8-cae6-4d9b-a1fc-503643a1fafd could not be found. Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'dd84def8-cae6-4d9b-a1fc-503643a1fafd'} Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd84def8-cae6-4d9b-a1fc-503643a1fafd could not be found. Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd84def8-cae6-4d9b-a1fc-503643a1fafd could not be found. Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:50.266231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:50.270002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:50.270002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:50.270002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:50.270002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:52:50.270002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:52:50.270002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd84def8-cae6-4d9b-a1fc-503643a1fafd could not be found. Oct 24 10:52:50.270002 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:50.280528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dbdc19ca-7df9-42a2-8353-bd7959af467a tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Returning 404 to user: Instance dd84def8-cae6-4d9b-a1fc-503643a1fafd could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:52:50.281837 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dbdc19ca-7df9-42a2-8353-bd7959af467a tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 404 len: 111 microversion: 2.1 time: 0.112107 Oct 24 10:52:50.282630 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2716/5397] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:50 2022] GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:52:50.314888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0234caa7-a774-4102-8c3c-d5f422250267 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:50.316085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0234caa7-a774-4102-8c3c-d5f422250267 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:50.332257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0234caa7-a774-4102-8c3c-d5f422250267 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:50.332997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0234caa7-a774-4102-8c3c-d5f422250267 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:50.340661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0234caa7-a774-4102-8c3c-d5f422250267 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:50.342513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0234caa7-a774-4102-8c3c-d5f422250267 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:50.343247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0234caa7-a774-4102-8c3c-d5f422250267 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:50.344462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0234caa7-a774-4102-8c3c-d5f422250267 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:50.444731 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7820a7db-f559-41a2-8aaa-76c0b5b7515e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 204 len: 0 microversion: 2.1 time: 0.423135 Oct 24 10:52:50.445881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0234caa7-a774-4102-8c3c-d5f422250267 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:50.446599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0234caa7-a774-4102-8c3c-d5f422250267 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:50.447260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0234caa7-a774-4102-8c3c-d5f422250267 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:50.447930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-0234caa7-a774-4102-8c3c-d5f422250267 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lazy-loading 'fault' on Instance uuid 4f5b0075-c182-4a77-a15a-b904b39cc9c1 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:52:50.449129 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2682/5398] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:52:50 2022] DELETE /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:52:50.457731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ed4d1b36-261d-4adb-a64e-e0aa7f0a5ae7 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:50.491931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.compute.server_groups [None req-ed4d1b36-261d-4adb-a64e-e0aa7f0a5ae7 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Querying cell 75e76125-592d-4292-bea1-3b51451d7165(cell1) for 1 instances {{(pid=120425) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 24 10:52:50.493273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed4d1b36-261d-4adb-a64e-e0aa7f0a5ae7 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:50.494450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed4d1b36-261d-4adb-a64e-e0aa7f0a5ae7 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:50.495355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ed4d1b36-261d-4adb-a64e-e0aa7f0a5ae7 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:50.528815 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ed4d1b36-261d-4adb-a64e-e0aa7f0a5ae7 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.077651 Oct 24 10:52:50.530382 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2683/5399] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:52:50 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:50.539234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8595eed9-0684-4bab-b9f2-ca86c74a8391 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:50.541266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8595eed9-0684-4bab-b9f2-ca86c74a8391 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:50.552097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8595eed9-0684-4bab-b9f2-ca86c74a8391 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:50.553395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8595eed9-0684-4bab-b9f2-ca86c74a8391 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:50.554448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8595eed9-0684-4bab-b9f2-ca86c74a8391 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:50.556368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8595eed9-0684-4bab-b9f2-ca86c74a8391 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:50.561728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8595eed9-0684-4bab-b9f2-ca86c74a8391 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:50.562540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8595eed9-0684-4bab-b9f2-ca86c74a8391 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:50.835061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0234caa7-a774-4102-8c3c-d5f422250267 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:50.849665 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0234caa7-a774-4102-8c3c-d5f422250267 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1335 microversion: 2.1 time: 0.563080 Oct 24 10:52:50.852215 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2717/5400] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:50 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1335 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:50.859400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7b986217-7730-4bc3-afd1-b6dc3f9b907a tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:50.908619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.compute.server_groups [None req-7b986217-7730-4bc3-afd1-b6dc3f9b907a tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Querying cell 75e76125-592d-4292-bea1-3b51451d7165(cell1) for 1 instances {{(pid=120426) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 24 10:52:50.910258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b986217-7730-4bc3-afd1-b6dc3f9b907a tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:50.912228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b986217-7730-4bc3-afd1-b6dc3f9b907a tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:50.914075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b986217-7730-4bc3-afd1-b6dc3f9b907a tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:50.944062 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7b986217-7730-4bc3-afd1-b6dc3f9b907a tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/fca8abaf-b311-4c14-8d85-f68a271bc777" status: 200 len: 183 microversion: 2.1 time: 0.087345 Oct 24 10:52:50.946060 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2718/5401] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 10:52:50 2022] GET /compute/v2.1/os-server-groups/fca8abaf-b311-4c14-8d85-f68a271bc777 => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:50.969410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d40fcdbd-ab93-4f08-ae52-df021082e88f tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:50.971232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d40fcdbd-ab93-4f08-ae52-df021082e88f tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:50.986610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d40fcdbd-ab93-4f08-ae52-df021082e88f tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:50.987295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d40fcdbd-ab93-4f08-ae52-df021082e88f tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:50.988098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d40fcdbd-ab93-4f08-ae52-df021082e88f tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:50.990086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d40fcdbd-ab93-4f08-ae52-df021082e88f tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:50.991752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d40fcdbd-ab93-4f08-ae52-df021082e88f tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:50.992348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d40fcdbd-ab93-4f08-ae52-df021082e88f tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:51.010330 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-d40fcdbd-ab93-4f08-ae52-df021082e88f tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] HTTP exception thrown: Instance dd84def8-cae6-4d9b-a1fc-503643a1fafd could not be found. Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d40fcdbd-ab93-4f08-ae52-df021082e88f tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Request method failure captured: Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd HTTP/1.1 Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm5kwtaDtlTKeaiZukmpjifJYm1tEawORSFggnKqrZZgmfdl-GlCvCcnv7_g83Rfs4oJ4aMdoDI5HG3pi2rlo89BwYNAc06OROWqwsPu4dVQjIMdtpIGm0Xj5i8csKmJ3iG54trHiPbeFuBIC511Hi9ZUeCfDlF5fVS3r9HfGalR7NA Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: eacd772e809e4aedbdc95d41298965d9 Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eacd772e809e4aedbdc95d41298965d9", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: eacd772e809e4aedbdc95d41298965d9 Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerGroupTestJSON-223589316-project Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: efdddb903f4546aabc0fe0c4aeddd4cd Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerGroupTestJSON-223589316-project Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance dd84def8-cae6-4d9b-a1fc-503643a1fafd could not be found. Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'dd84def8-cae6-4d9b-a1fc-503643a1fafd'} Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd84def8-cae6-4d9b-a1fc-503643a1fafd could not be found. Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:52:51.012299 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:52:51.016746 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd84def8-cae6-4d9b-a1fc-503643a1fafd could not be found. Oct 24 10:52:51.016746 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.016746 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:51.016746 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.016746 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:51.016746 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:51.016746 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:51.016746 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:52:51.016746 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:52:51.016746 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd84def8-cae6-4d9b-a1fc-503643a1fafd could not be found. Oct 24 10:52:51.016746 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.018520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d40fcdbd-ab93-4f08-ae52-df021082e88f tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Returning 404 to user: Instance dd84def8-cae6-4d9b-a1fc-503643a1fafd could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:52:51.020164 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d40fcdbd-ab93-4f08-ae52-df021082e88f tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 404 len: 111 microversion: 2.1 time: 0.067156 Oct 24 10:52:51.021309 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2719/5402] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:52:50 2022] DELETE /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:52:51.031429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b944304c-7359-4c2d-8530-5259d34c51be tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:51.032550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b944304c-7359-4c2d-8530-5259d34c51be tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] [instance: dd84def8-cae6-4d9b-a1fc-503643a1fafd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:51.039699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b944304c-7359-4c2d-8530-5259d34c51be tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:51.040648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b944304c-7359-4c2d-8530-5259d34c51be tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:51.041390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b944304c-7359-4c2d-8530-5259d34c51be tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:51.042517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b944304c-7359-4c2d-8530-5259d34c51be tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:51.043321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b944304c-7359-4c2d-8530-5259d34c51be tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:51.043948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b944304c-7359-4c2d-8530-5259d34c51be tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:51.061527 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-b944304c-7359-4c2d-8530-5259d34c51be tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] HTTP exception thrown: Instance dd84def8-cae6-4d9b-a1fc-503643a1fafd could not be found. Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b944304c-7359-4c2d-8530-5259d34c51be tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Request method failure captured: Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd HTTP/1.1 Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm5kwtaDtlTKeaiZukmpjifJYm1tEawORSFggnKqrZZgmfdl-GlCvCcnv7_g83Rfs4oJ4aMdoDI5HG3pi2rlo89BwYNAc06OROWqwsPu4dVQjIMdtpIGm0Xj5i8csKmJ3iG54trHiPbeFuBIC511Hi9ZUeCfDlF5fVS3r9HfGalR7NA Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: eacd772e809e4aedbdc95d41298965d9 Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eacd772e809e4aedbdc95d41298965d9", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: eacd772e809e4aedbdc95d41298965d9 Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerGroupTestJSON-223589316-project Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: efdddb903f4546aabc0fe0c4aeddd4cd Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerGroupTestJSON-223589316-project Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance dd84def8-cae6-4d9b-a1fc-503643a1fafd could not be found. Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'dd84def8-cae6-4d9b-a1fc-503643a1fafd'} Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd84def8-cae6-4d9b-a1fc-503643a1fafd could not be found. Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd84def8-cae6-4d9b-a1fc-503643a1fafd could not be found. Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:51.064557 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.068572 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:51.068572 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:51.068572 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:51.068572 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:52:51.068572 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:52:51.068572 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd84def8-cae6-4d9b-a1fc-503643a1fafd could not be found. Oct 24 10:52:51.068572 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.070021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b944304c-7359-4c2d-8530-5259d34c51be tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Returning 404 to user: Instance dd84def8-cae6-4d9b-a1fc-503643a1fafd could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:52:51.071392 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b944304c-7359-4c2d-8530-5259d34c51be tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd" status: 404 len: 111 microversion: 2.1 time: 0.046121 Oct 24 10:52:51.072785 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2720/5403] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:51 2022] GET /compute/v2.1/servers/dd84def8-cae6-4d9b-a1fc-503643a1fafd => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:52:51.087264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d41a386-f261-457b-9b16-50703256ca76 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:51.095786 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-2d41a386-f261-457b-9b16-50703256ca76 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] HTTP exception thrown: Instance group 9b4e6bbf-89cd-4f0a-84a0-f202856a7a98 could not be found. Oct 24 10:52:51.098369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8595eed9-0684-4bab-b9f2-ca86c74a8391 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d41a386-f261-457b-9b16-50703256ca76 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Request method failure captured: Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/os-server-groups/9b4e6bbf-89cd-4f0a-84a0-f202856a7a98 HTTP/1.1 Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm5kwtaDtlTKeaiZukmpjifJYm1tEawORSFggnKqrZZgmfdl-GlCvCcnv7_g83Rfs4oJ4aMdoDI5HG3pi2rlo89BwYNAc06OROWqwsPu4dVQjIMdtpIGm0Xj5i8csKmJ3iG54trHiPbeFuBIC511Hi9ZUeCfDlF5fVS3r9HfGalR7NA Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: eacd772e809e4aedbdc95d41298965d9 Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eacd772e809e4aedbdc95d41298965d9", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: eacd772e809e4aedbdc95d41298965d9 Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerGroupTestJSON-223589316-project Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: efdddb903f4546aabc0fe0c4aeddd4cd Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerGroupTestJSON-223589316-project Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance group 9b4e6bbf-89cd-4f0a-84a0-f202856a7a98 could not be found. Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '9b4e6bbf-89cd-4f0a-84a0-f202856a7a98'} Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9b4e6bbf-89cd-4f0a-84a0-f202856a7a98 could not be found. Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9b4e6bbf-89cd-4f0a-84a0-f202856a7a98 could not be found. Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.099348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:51.102825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:51.102825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:51.102825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:52:51.102825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:52:51.102825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9b4e6bbf-89cd-4f0a-84a0-f202856a7a98 could not be found. Oct 24 10:52:51.102825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.102825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d41a386-f261-457b-9b16-50703256ca76 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Returning 404 to user: Instance group 9b4e6bbf-89cd-4f0a-84a0-f202856a7a98 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:52:51.104270 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2d41a386-f261-457b-9b16-50703256ca76 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/9b4e6bbf-89cd-4f0a-84a0-f202856a7a98" status: 404 len: 117 microversion: 2.1 time: 0.020575 Oct 24 10:52:51.106768 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2721/5404] 10.222.0.50 () {58 vars in 1266 bytes} [Mon Oct 24 10:52:51 2022] DELETE /compute/v2.1/os-server-groups/9b4e6bbf-89cd-4f0a-84a0-f202856a7a98 => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:52:51.113774 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8595eed9-0684-4bab-b9f2-ca86c74a8391 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1688 microversion: 2.1 time: 0.581916 Oct 24 10:52:51.115377 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2684/5405] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:50 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1688 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:51.118235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a45cc2c1-6836-432f-a1fc-ddb06e90b3a2 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:51.135045 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-a45cc2c1-6836-432f-a1fc-ddb06e90b3a2 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] HTTP exception thrown: Instance group 2027eb68-d704-4428-b7da-b6ab17d4ecb5 could not be found. Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a45cc2c1-6836-432f-a1fc-ddb06e90b3a2 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Request method failure captured: Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/os-server-groups/2027eb68-d704-4428-b7da-b6ab17d4ecb5 HTTP/1.1 Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm5kwtaDtlTKeaiZukmpjifJYm1tEawORSFggnKqrZZgmfdl-GlCvCcnv7_g83Rfs4oJ4aMdoDI5HG3pi2rlo89BwYNAc06OROWqwsPu4dVQjIMdtpIGm0Xj5i8csKmJ3iG54trHiPbeFuBIC511Hi9ZUeCfDlF5fVS3r9HfGalR7NA Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: eacd772e809e4aedbdc95d41298965d9 Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eacd772e809e4aedbdc95d41298965d9", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: eacd772e809e4aedbdc95d41298965d9 Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerGroupTestJSON-223589316-project Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: efdddb903f4546aabc0fe0c4aeddd4cd Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerGroupTestJSON-223589316-project Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance group 2027eb68-d704-4428-b7da-b6ab17d4ecb5 could not be found. Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '2027eb68-d704-4428-b7da-b6ab17d4ecb5'} Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2027eb68-d704-4428-b7da-b6ab17d4ecb5 could not be found. Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2027eb68-d704-4428-b7da-b6ab17d4ecb5 could not be found. Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.141169 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:51.145516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:51.145516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:51.145516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:52:51.145516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:52:51.145516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2027eb68-d704-4428-b7da-b6ab17d4ecb5 could not be found. Oct 24 10:52:51.145516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.147500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a45cc2c1-6836-432f-a1fc-ddb06e90b3a2 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Returning 404 to user: Instance group 2027eb68-d704-4428-b7da-b6ab17d4ecb5 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:52:51.150044 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a45cc2c1-6836-432f-a1fc-ddb06e90b3a2 tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/2027eb68-d704-4428-b7da-b6ab17d4ecb5" status: 404 len: 117 microversion: 2.1 time: 0.042049 Oct 24 10:52:51.151305 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2722/5406] 10.222.0.50 () {58 vars in 1266 bytes} [Mon Oct 24 10:52:51 2022] DELETE /compute/v2.1/os-server-groups/2027eb68-d704-4428-b7da-b6ab17d4ecb5 => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:52:51.159452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10376a53-cebb-4134-83ff-12311c185b2c tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:51.166214 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-10376a53-cebb-4134-83ff-12311c185b2c tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] HTTP exception thrown: Instance group c531c8df-72e2-4716-a16d-cda1e72449e4 could not be found. Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10376a53-cebb-4134-83ff-12311c185b2c tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Request method failure captured: Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/os-server-groups/c531c8df-72e2-4716-a16d-cda1e72449e4 HTTP/1.1 Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm5kwtaDtlTKeaiZukmpjifJYm1tEawORSFggnKqrZZgmfdl-GlCvCcnv7_g83Rfs4oJ4aMdoDI5HG3pi2rlo89BwYNAc06OROWqwsPu4dVQjIMdtpIGm0Xj5i8csKmJ3iG54trHiPbeFuBIC511Hi9ZUeCfDlF5fVS3r9HfGalR7NA Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: eacd772e809e4aedbdc95d41298965d9 Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eacd772e809e4aedbdc95d41298965d9", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: eacd772e809e4aedbdc95d41298965d9 Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerGroupTestJSON-223589316-project Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: efdddb903f4546aabc0fe0c4aeddd4cd Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerGroupTestJSON-223589316-project Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance group c531c8df-72e2-4716-a16d-cda1e72449e4 could not be found. Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'c531c8df-72e2-4716-a16d-cda1e72449e4'} Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c531c8df-72e2-4716-a16d-cda1e72449e4 could not be found. Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c531c8df-72e2-4716-a16d-cda1e72449e4 could not be found. Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.167890 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:51.171703 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:51.171703 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:51.171703 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:52:51.171703 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:52:51.171703 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c531c8df-72e2-4716-a16d-cda1e72449e4 could not be found. Oct 24 10:52:51.171703 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.171703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10376a53-cebb-4134-83ff-12311c185b2c tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Returning 404 to user: Instance group c531c8df-72e2-4716-a16d-cda1e72449e4 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:52:51.196566 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10376a53-cebb-4134-83ff-12311c185b2c tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/c531c8df-72e2-4716-a16d-cda1e72449e4" status: 404 len: 117 microversion: 2.1 time: 0.039065 Oct 24 10:52:51.207140 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2685/5407] 10.222.0.50 () {58 vars in 1266 bytes} [Mon Oct 24 10:52:51 2022] DELETE /compute/v2.1/os-server-groups/c531c8df-72e2-4716-a16d-cda1e72449e4 => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:52:51.212766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f335d39c-ab61-48e0-bf17-0ed16ee07f5d tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:51.221063 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-f335d39c-ab61-48e0-bf17-0ed16ee07f5d tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] HTTP exception thrown: Instance group 402cab21-21b4-4c24-8739-4bdc05a2b7a2 could not be found. Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f335d39c-ab61-48e0-bf17-0ed16ee07f5d tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Request method failure captured: Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/os-server-groups/402cab21-21b4-4c24-8739-4bdc05a2b7a2 HTTP/1.1 Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm5kwtaDtlTKeaiZukmpjifJYm1tEawORSFggnKqrZZgmfdl-GlCvCcnv7_g83Rfs4oJ4aMdoDI5HG3pi2rlo89BwYNAc06OROWqwsPu4dVQjIMdtpIGm0Xj5i8csKmJ3iG54trHiPbeFuBIC511Hi9ZUeCfDlF5fVS3r9HfGalR7NA Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: eacd772e809e4aedbdc95d41298965d9 Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/eacd772e809e4aedbdc95d41298965d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_eacd772e809e4aedbdc95d41298965d9", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: eacd772e809e4aedbdc95d41298965d9 Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerGroupTestJSON-223589316 Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerGroupTestJSON-223589316-project Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: efdddb903f4546aabc0fe0c4aeddd4cd Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerGroupTestJSON-223589316-project Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance group 402cab21-21b4-4c24-8739-4bdc05a2b7a2 could not be found. Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '402cab21-21b4-4c24-8739-4bdc05a2b7a2'} Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 402cab21-21b4-4c24-8739-4bdc05a2b7a2 could not be found. Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 402cab21-21b4-4c24-8739-4bdc05a2b7a2 could not be found. Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.222706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:51.229838 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:51.229838 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:51.229838 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:52:51.229838 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:52:51.229838 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 402cab21-21b4-4c24-8739-4bdc05a2b7a2 could not be found. Oct 24 10:52:51.229838 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:52:51.229838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f335d39c-ab61-48e0-bf17-0ed16ee07f5d tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Returning 404 to user: Instance group 402cab21-21b4-4c24-8739-4bdc05a2b7a2 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:52:51.229838 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f335d39c-ab61-48e0-bf17-0ed16ee07f5d tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/402cab21-21b4-4c24-8739-4bdc05a2b7a2" status: 404 len: 117 microversion: 2.1 time: 0.016111 Oct 24 10:52:51.229838 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2723/5408] 10.222.0.50 () {58 vars in 1266 bytes} [Mon Oct 24 10:52:51 2022] DELETE /compute/v2.1/os-server-groups/402cab21-21b4-4c24-8739-4bdc05a2b7a2 => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:52:51.234785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d42dfac9-4d16-456a-a1a4-8c7700d339da tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:51.308122 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d42dfac9-4d16-456a-a1a4-8c7700d339da tempest-ServerGroupTestJSON-223589316 tempest-ServerGroupTestJSON-223589316-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/fca8abaf-b311-4c14-8d85-f68a271bc777" status: 204 len: 0 microversion: 2.1 time: 0.078135 Oct 24 10:52:51.308739 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2686/5409] 10.222.0.50 () {58 vars in 1266 bytes} [Mon Oct 24 10:52:51 2022] DELETE /compute/v2.1/os-server-groups/fca8abaf-b311-4c14-8d85-f68a271bc777 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 10:52:51.318204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-8cf4a9e2-1a4c-4cd4-8743-ed8050140837 req-adfb011a-1809-44fa-82fd-d98f4f277bde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7efbf530-723d-4ef0-855d-c38e0bb47cc7", "tag": "96d87680-c8c9-4cb5-b203-ef72c929ad05"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:51.343113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8cf4a9e2-1a4c-4cd4-8743-ed8050140837 req-adfb011a-1809-44fa-82fd-d98f4f277bde service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:51.344901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8cf4a9e2-1a4c-4cd4-8743-ed8050140837 req-adfb011a-1809-44fa-82fd-d98f4f277bde service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:51.346748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8cf4a9e2-1a4c-4cd4-8743-ed8050140837 req-adfb011a-1809-44fa-82fd-d98f4f277bde service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:51.374676 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-8cf4a9e2-1a4c-4cd4-8743-ed8050140837 req-adfb011a-1809-44fa-82fd-d98f4f277bde service nova] Creating event network-changed:96d87680-c8c9-4cb5-b203-ef72c929ad05 for instance 7efbf530-723d-4ef0-855d-c38e0bb47cc7 on n-h2-858383-15 Oct 24 10:52:51.389381 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-8cf4a9e2-1a4c-4cd4-8743-ed8050140837 req-adfb011a-1809-44fa-82fd-d98f4f277bde service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074680 Oct 24 10:52:51.390357 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2724/5410] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:52:51.881822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2fa2f5b5-0d5f-4d69-9713-ed2443d4e647 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:51.883627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2fa2f5b5-0d5f-4d69-9713-ed2443d4e647 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:51.899802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fa2f5b5-0d5f-4d69-9713-ed2443d4e647 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:51.900407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fa2f5b5-0d5f-4d69-9713-ed2443d4e647 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:51.900891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fa2f5b5-0d5f-4d69-9713-ed2443d4e647 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:51.902153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fa2f5b5-0d5f-4d69-9713-ed2443d4e647 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:51.903038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fa2f5b5-0d5f-4d69-9713-ed2443d4e647 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:51.914288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fa2f5b5-0d5f-4d69-9713-ed2443d4e647 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:52.037901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fa2f5b5-0d5f-4d69-9713-ed2443d4e647 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:52.038451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fa2f5b5-0d5f-4d69-9713-ed2443d4e647 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:52.038917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fa2f5b5-0d5f-4d69-9713-ed2443d4e647 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:52.045742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-2fa2f5b5-0d5f-4d69-9713-ed2443d4e647 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lazy-loading 'fault' on Instance uuid 4f5b0075-c182-4a77-a15a-b904b39cc9c1 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:52:52.119685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2fa2f5b5-0d5f-4d69-9713-ed2443d4e647 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:52.137290 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2fa2f5b5-0d5f-4d69-9713-ed2443d4e647 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 200 len: 1335 microversion: 2.1 time: 0.257351 Oct 24 10:52:52.149347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b4ae5dd3-82e2-43e3-8ecf-9ffbd9706f31 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:52.155227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b4ae5dd3-82e2-43e3-8ecf-9ffbd9706f31 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:52.155347 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2687/5411] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:51 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 1335 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:52.166220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ae5dd3-82e2-43e3-8ecf-9ffbd9706f31 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:52.167036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ae5dd3-82e2-43e3-8ecf-9ffbd9706f31 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:52.167591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ae5dd3-82e2-43e3-8ecf-9ffbd9706f31 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:52.168519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ae5dd3-82e2-43e3-8ecf-9ffbd9706f31 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:52.169189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ae5dd3-82e2-43e3-8ecf-9ffbd9706f31 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:52.169722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ae5dd3-82e2-43e3-8ecf-9ffbd9706f31 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:52.593901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b4ae5dd3-82e2-43e3-8ecf-9ffbd9706f31 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:52.605132 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b4ae5dd3-82e2-43e3-8ecf-9ffbd9706f31 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1688 microversion: 2.1 time: 0.466806 Oct 24 10:52:52.605723 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2725/5412] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:52 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1688 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:53.165476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b1bd10d-7554-4493-be89-d68226a77761 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:53.166089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6b1bd10d-7554-4493-be89-d68226a77761 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 4f5b0075-c182-4a77-a15a-b904b39cc9c1] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:53.178585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b1bd10d-7554-4493-be89-d68226a77761 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:53.181298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b1bd10d-7554-4493-be89-d68226a77761 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:53.182406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b1bd10d-7554-4493-be89-d68226a77761 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:53.188546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b1bd10d-7554-4493-be89-d68226a77761 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:53.189305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b1bd10d-7554-4493-be89-d68226a77761 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:53.190055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b1bd10d-7554-4493-be89-d68226a77761 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:53.209425 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-6b1bd10d-7554-4493-be89-d68226a77761 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] HTTP exception thrown: Instance 4f5b0075-c182-4a77-a15a-b904b39cc9c1 could not be found. Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b1bd10d-7554-4493-be89-d68226a77761 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Request method failure captured: Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 HTTP/1.1 Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm1_YpcUoTx6EtuRJqEim52THa9nHc93ggv-rCTsxHF8KCdRzu0B50Tb2gQcOKEkZzR8bjwxbVU1lCLt9l9Nlkw5MZDlojxwV2MAHZbN_UcYOzact8aaTN_ICS6JQcw4OPHcT53rEwR6K2uYrfqZ498tDq4tCZjBExjOK6wvBxhiRXQ Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 0ae874e076c34c44adb00f85aebd000e Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ae874e076c34c44adb00f85aebd000e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 0ae874e076c34c44adb00f85aebd000e Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerRescueNegativeTestJSON-615921797-project Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6da7534777ef4425aefa81bc7e49b69f Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-615921797-project Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 4f5b0075-c182-4a77-a15a-b904b39cc9c1 could not be found. Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '4f5b0075-c182-4a77-a15a-b904b39cc9c1'} Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f5b0075-c182-4a77-a15a-b904b39cc9c1 could not be found. Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f5b0075-c182-4a77-a15a-b904b39cc9c1 could not be found. Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:53.211223 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:53.214724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:53.214724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:53.214724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:53.214724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:53.214724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:52:53.214724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:52:53.214724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f5b0075-c182-4a77-a15a-b904b39cc9c1 could not be found. Oct 24 10:52:53.214724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:53.218335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b1bd10d-7554-4493-be89-d68226a77761 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Returning 404 to user: Instance 4f5b0075-c182-4a77-a15a-b904b39cc9c1 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:52:53.219394 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6b1bd10d-7554-4493-be89-d68226a77761 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1" status: 404 len: 111 microversion: 2.1 time: 0.057787 Oct 24 10:52:53.221450 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2688/5413] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:53 2022] GET /compute/v2.1/servers/4f5b0075-c182-4a77-a15a-b904b39cc9c1 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:52:53.230627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8a19191e-9e4f-496e-a8e6-15a2350a6063 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '.version_select at 0x7f04d0096ca0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:53.264684 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8a19191e-9e4f-496e-a8e6-15a2350a6063 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770527232" status: 202 len: 0 microversion: 2.1 time: 0.038656 Oct 24 10:52:53.266854 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2726/5414] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Oct 24 10:52:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770527232 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:52:53.629748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5192a3df-832e-4579-8e2b-a2ac494bd996 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:53.630380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5192a3df-832e-4579-8e2b-a2ac494bd996 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:53.640186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5192a3df-832e-4579-8e2b-a2ac494bd996 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:53.640696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5192a3df-832e-4579-8e2b-a2ac494bd996 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:53.641173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5192a3df-832e-4579-8e2b-a2ac494bd996 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:53.641899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5192a3df-832e-4579-8e2b-a2ac494bd996 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:53.642364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5192a3df-832e-4579-8e2b-a2ac494bd996 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:53.642797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5192a3df-832e-4579-8e2b-a2ac494bd996 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:54.220005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5192a3df-832e-4579-8e2b-a2ac494bd996 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:52:54.231712 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5192a3df-832e-4579-8e2b-a2ac494bd996 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 200 len: 1620 microversion: 2.1 time: 0.605714 Oct 24 10:52:54.244865 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2689/5415] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:53 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 1620 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:52:54.311489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-dbd0d1ec-cf46-46be-8f4d-7da9be750934 req-41591300-76bd-4c72-a519-851ae363c40b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7efbf530-723d-4ef0-855d-c38e0bb47cc7", "name": "network-vif-deleted", "tag": "96d87680-c8c9-4cb5-b203-ef72c929ad05"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:52:54.354641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dbd0d1ec-cf46-46be-8f4d-7da9be750934 req-41591300-76bd-4c72-a519-851ae363c40b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:54.363549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dbd0d1ec-cf46-46be-8f4d-7da9be750934 req-41591300-76bd-4c72-a519-851ae363c40b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:54.364241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dbd0d1ec-cf46-46be-8f4d-7da9be750934 req-41591300-76bd-4c72-a519-851ae363c40b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:54.397876 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-dbd0d1ec-cf46-46be-8f4d-7da9be750934 req-41591300-76bd-4c72-a519-851ae363c40b service nova] Creating event network-vif-deleted:96d87680-c8c9-4cb5-b203-ef72c929ad05 for instance 7efbf530-723d-4ef0-855d-c38e0bb47cc7 on n-h2-858383-15 Oct 24 10:52:54.409063 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-dbd0d1ec-cf46-46be-8f4d-7da9be750934 req-41591300-76bd-4c72-a519-851ae363c40b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106948 Oct 24 10:52:54.414040 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2727/5416] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:52:55.261365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-29e20ef7-38d8-46d8-975c-8cd63408bc4b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:52:55.262656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-29e20ef7-38d8-46d8-975c-8cd63408bc4b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 7efbf530-723d-4ef0-855d-c38e0bb47cc7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:52:55.272221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29e20ef7-38d8-46d8-975c-8cd63408bc4b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:55.273111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29e20ef7-38d8-46d8-975c-8cd63408bc4b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:55.274056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29e20ef7-38d8-46d8-975c-8cd63408bc4b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:55.275071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29e20ef7-38d8-46d8-975c-8cd63408bc4b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:52:55.275936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29e20ef7-38d8-46d8-975c-8cd63408bc4b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:52:55.276809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29e20ef7-38d8-46d8-975c-8cd63408bc4b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:52:55.312264 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-29e20ef7-38d8-46d8-975c-8cd63408bc4b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] HTTP exception thrown: Instance 7efbf530-723d-4ef0-855d-c38e0bb47cc7 could not be found. Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-29e20ef7-38d8-46d8-975c-8cd63408bc4b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Request method failure captured: Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 HTTP/1.1 Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm3GX82MAk9t_DY3ldBvJqgw4krRRZI91P4i_Ha4QFlAFzgtY357SWlZo2bmt5yQ4BdbJCOJlqOV_m4WkwsNVJwqhdGf2Mb8PfZodPxM72kQRMnwEV3JRp9SnBdSvplatZoPBEyBaXBcJ4mHkyjNtrR7UqU0ub2iwqP0g4u9U6TTz9c Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 45405624633e404ab2d6ff26482a150e Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-626774974 Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/45405624633e404ab2d6ff26482a150e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/45405624633e404ab2d6ff26482a150e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/45405624633e404ab2d6ff26482a150e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_45405624633e404ab2d6ff26482a150e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestNetworkAdvancedServerOps-626774974 Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 45405624633e404ab2d6ff26482a150e Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-626774974 Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestNetworkAdvancedServerOps-626774974-project Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: cdae8836f9784dff90fea5201fd15d1d Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestNetworkAdvancedServerOps-626774974-project Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 7efbf530-723d-4ef0-855d-c38e0bb47cc7 could not be found. Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '7efbf530-723d-4ef0-855d-c38e0bb47cc7'} Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7efbf530-723d-4ef0-855d-c38e0bb47cc7 could not be found. Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7efbf530-723d-4ef0-855d-c38e0bb47cc7 could not be found. Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:55.315002 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:52:55.318677 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:55.318677 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:52:55.318677 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:52:55.318677 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:52:55.318677 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:52:55.318677 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:52:55.318677 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7efbf530-723d-4ef0-855d-c38e0bb47cc7 could not be found. Oct 24 10:52:55.318677 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:52:55.321662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-29e20ef7-38d8-46d8-975c-8cd63408bc4b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Returning 404 to user: Instance 7efbf530-723d-4ef0-855d-c38e0bb47cc7 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:52:55.322790 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-29e20ef7-38d8-46d8-975c-8cd63408bc4b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7" status: 404 len: 111 microversion: 2.1 time: 0.066303 Oct 24 10:52:55.327934 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2690/5417] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:52:55 2022] GET /compute/v2.1/servers/7efbf530-723d-4ef0-855d-c38e0bb47cc7 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:53:09.420956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b1cb39a5-65dc-4cb8-89a2-65f41973afba tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '.version_select at 0x7f04cb6fc430>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:09.429445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:53:09.430771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=51 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:53:09.475491 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b1cb39a5-65dc-4cb8-89a2-65f41973afba tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1260423236" status: 202 len: 0 microversion: 2.1 time: 0.059463 Oct 24 10:53:09.477791 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2728/5418] 10.222.0.50 () {58 vars in 1284 bytes} [Mon Oct 24 10:53:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1260423236 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:53:09.512649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0508dd9a-0d33-44eb-83ab-d3d6688f9551 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'create', calling method: .version_select at 0x7f04cb911ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1996134956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjakY7q4E2eq2p21bGFOeUUlnwvAMtOljMrBgxjbVkhoeVCwilh/RjDAl5JpbF4i/UVJHIee6tLZryts/JLzyVM1DfWFqZmkgFsvhS9LI854M46DLe+cI+q5El2Nb0ZOA=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:53:09.532819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:53:09.535495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:53:09.564280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0508dd9a-0d33-44eb-83ab-d3d6688f9551 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Getting quotas for project 45405624633e404ab2d6ff26482a150e. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:53:09.589020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0508dd9a-0d33-44eb-83ab-d3d6688f9551 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Getting quotas for user cdae8836f9784dff90fea5201fd15d1d and project 45405624633e404ab2d6ff26482a150e. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:53:09.594851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-21cf224f-8fa0-4645-9d45-a6aa8dc1c987 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:09.596822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-21cf224f-8fa0-4645-9d45-a6aa8dc1c987 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:09.624587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21cf224f-8fa0-4645-9d45-a6aa8dc1c987 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:09.625245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21cf224f-8fa0-4645-9d45-a6aa8dc1c987 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:09.625772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21cf224f-8fa0-4645-9d45-a6aa8dc1c987 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:09.626584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21cf224f-8fa0-4645-9d45-a6aa8dc1c987 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:09.640075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21cf224f-8fa0-4645-9d45-a6aa8dc1c987 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:09.640713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21cf224f-8fa0-4645-9d45-a6aa8dc1c987 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:09.669063 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0508dd9a-0d33-44eb-83ab-d3d6688f9551 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.162013 Oct 24 10:53:09.679510 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2691/5419] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:53:09 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:53:09.713248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-21cf224f-8fa0-4645-9d45-a6aa8dc1c987 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:53:09.897171 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-21cf224f-8fa0-4645-9d45-a6aa8dc1c987 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 204 len: 0 microversion: 2.1 time: 0.311005 Oct 24 10:53:09.898706 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2729/5420] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:53:09 2022] DELETE /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:53:09.908806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dcea00b9-35ed-4c6e-9566-49079e6523bf tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:09.909653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dcea00b9-35ed-4c6e-9566-49079e6523bf tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:09.922961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcea00b9-35ed-4c6e-9566-49079e6523bf tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:09.925825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcea00b9-35ed-4c6e-9566-49079e6523bf tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:09.926367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcea00b9-35ed-4c6e-9566-49079e6523bf tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:09.927136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcea00b9-35ed-4c6e-9566-49079e6523bf tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:09.929053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcea00b9-35ed-4c6e-9566-49079e6523bf tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:09.931390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dcea00b9-35ed-4c6e-9566-49079e6523bf tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:10.297931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dcea00b9-35ed-4c6e-9566-49079e6523bf tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:10.314142 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dcea00b9-35ed-4c6e-9566-49079e6523bf tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1507 microversion: 2.1 time: 0.409547 Oct 24 10:53:10.314996 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2692/5421] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:09 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1507 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:11.350263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ad4091e5-cebb-4666-b7d7-3a1844a35744 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:11.360266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ad4091e5-cebb-4666-b7d7-3a1844a35744 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:11.387892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad4091e5-cebb-4666-b7d7-3a1844a35744 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:11.388330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad4091e5-cebb-4666-b7d7-3a1844a35744 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:11.390982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad4091e5-cebb-4666-b7d7-3a1844a35744 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:11.392784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad4091e5-cebb-4666-b7d7-3a1844a35744 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:11.395251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad4091e5-cebb-4666-b7d7-3a1844a35744 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:11.396647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad4091e5-cebb-4666-b7d7-3a1844a35744 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:12.403272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ad4091e5-cebb-4666-b7d7-3a1844a35744 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:12.418286 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ad4091e5-cebb-4666-b7d7-3a1844a35744 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1507 microversion: 2.1 time: 1.077013 Oct 24 10:53:12.422240 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2730/5422] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:11 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1507 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:13.445689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eac9295f-135d-400e-ac2c-79ff67cc1798 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:13.446535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eac9295f-135d-400e-ac2c-79ff67cc1798 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:13.461342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac9295f-135d-400e-ac2c-79ff67cc1798 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:13.461900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac9295f-135d-400e-ac2c-79ff67cc1798 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:13.462276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac9295f-135d-400e-ac2c-79ff67cc1798 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:13.462999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac9295f-135d-400e-ac2c-79ff67cc1798 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:13.463456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac9295f-135d-400e-ac2c-79ff67cc1798 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:13.463990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac9295f-135d-400e-ac2c-79ff67cc1798 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:13.890851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eac9295f-135d-400e-ac2c-79ff67cc1798 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:13.905043 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eac9295f-135d-400e-ac2c-79ff67cc1798 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1465 microversion: 2.1 time: 0.459187 Oct 24 10:53:13.908907 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2693/5423] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:13 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1465 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:14.363918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-81e363ef-7ca5-41aa-a335-67c91e50c0f3 req-2318e324-dce6-4158-9cd3-2e41ceb10f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e1338eb-7f3d-4680-a0ee-931115da05f9", "name": "network-vif-deleted", "tag": "ddf72b1d-9770-4cec-9349-b0bc3aee4a1c"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:53:14.394559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-81e363ef-7ca5-41aa-a335-67c91e50c0f3 req-2318e324-dce6-4158-9cd3-2e41ceb10f32 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:14.396405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-81e363ef-7ca5-41aa-a335-67c91e50c0f3 req-2318e324-dce6-4158-9cd3-2e41ceb10f32 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:14.396880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-81e363ef-7ca5-41aa-a335-67c91e50c0f3 req-2318e324-dce6-4158-9cd3-2e41ceb10f32 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:14.432866 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-81e363ef-7ca5-41aa-a335-67c91e50c0f3 req-2318e324-dce6-4158-9cd3-2e41ceb10f32 service nova] Creating event network-vif-deleted:ddf72b1d-9770-4cec-9349-b0bc3aee4a1c for instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 on n-h2-858383-15 Oct 24 10:53:14.445874 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-81e363ef-7ca5-41aa-a335-67c91e50c0f3 req-2318e324-dce6-4158-9cd3-2e41ceb10f32 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085956 Oct 24 10:53:14.452131 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2731/5424] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:53:14.939371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33c0b5ac-aa5e-4321-813a-b18d6df9aee4 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:14.940640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-33c0b5ac-aa5e-4321-813a-b18d6df9aee4 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:14.973879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33c0b5ac-aa5e-4321-813a-b18d6df9aee4 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:14.976700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33c0b5ac-aa5e-4321-813a-b18d6df9aee4 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:14.977774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33c0b5ac-aa5e-4321-813a-b18d6df9aee4 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:14.982055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33c0b5ac-aa5e-4321-813a-b18d6df9aee4 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:14.985123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33c0b5ac-aa5e-4321-813a-b18d6df9aee4 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:14.987455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33c0b5ac-aa5e-4321-813a-b18d6df9aee4 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:15.086291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33c0b5ac-aa5e-4321-813a-b18d6df9aee4 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:15.086291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33c0b5ac-aa5e-4321-813a-b18d6df9aee4 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:15.087739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33c0b5ac-aa5e-4321-813a-b18d6df9aee4 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:15.088446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-33c0b5ac-aa5e-4321-813a-b18d6df9aee4 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lazy-loading 'fault' on Instance uuid 5e1338eb-7f3d-4680-a0ee-931115da05f9 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:53:15.349201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-33c0b5ac-aa5e-4321-813a-b18d6df9aee4 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:15.361934 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-33c0b5ac-aa5e-4321-813a-b18d6df9aee4 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 200 len: 1311 microversion: 2.1 time: 0.423464 Oct 24 10:53:15.377002 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2694/5425] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:14 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 1311 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:16.390870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-40cfea9b-ba90-4e50-80a3-90dbf3091872 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:16.391973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-40cfea9b-ba90-4e50-80a3-90dbf3091872 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 5e1338eb-7f3d-4680-a0ee-931115da05f9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:16.426347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40cfea9b-ba90-4e50-80a3-90dbf3091872 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:16.428318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40cfea9b-ba90-4e50-80a3-90dbf3091872 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:16.428783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40cfea9b-ba90-4e50-80a3-90dbf3091872 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:16.429556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40cfea9b-ba90-4e50-80a3-90dbf3091872 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:16.430028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40cfea9b-ba90-4e50-80a3-90dbf3091872 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:16.430466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40cfea9b-ba90-4e50-80a3-90dbf3091872 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:16.484824 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-40cfea9b-ba90-4e50-80a3-90dbf3091872 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] HTTP exception thrown: Instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 could not be found. Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-40cfea9b-ba90-4e50-80a3-90dbf3091872 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Request method failure captured: Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 HTTP/1.1 Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm1_YpcUoTx6EtuRJqEim52THa9nHc93ggv-rCTsxHF8KCdRzu0B50Tb2gQcOKEkZzR8bjwxbVU1lCLt9l9Nlkw5MZDlojxwV2MAHZbN_UcYOzact8aaTN_ICS6JQcw4OPHcT53rEwR6K2uYrfqZ498tDq4tCZjBExjOK6wvBxhiRXQ Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 0ae874e076c34c44adb00f85aebd000e Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ae874e076c34c44adb00f85aebd000e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 0ae874e076c34c44adb00f85aebd000e Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerRescueNegativeTestJSON-615921797-project Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 6da7534777ef4425aefa81bc7e49b69f Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerRescueNegativeTestJSON-615921797-project Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 could not be found. Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '5e1338eb-7f3d-4680-a0ee-931115da05f9'} Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 could not be found. Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 could not be found. Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:53:16.495080 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:53:16.502705 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:53:16.502705 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:53:16.502705 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:53:16.502705 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:53:16.502705 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:53:16.502705 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:53:16.502705 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 could not be found. Oct 24 10:53:16.502705 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:53:16.527689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-40cfea9b-ba90-4e50-80a3-90dbf3091872 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Returning 404 to user: Instance 5e1338eb-7f3d-4680-a0ee-931115da05f9 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:53:16.535901 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-40cfea9b-ba90-4e50-80a3-90dbf3091872 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9" status: 404 len: 111 microversion: 2.1 time: 0.150772 Oct 24 10:53:16.542456 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2732/5426] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:16 2022] GET /compute/v2.1/servers/5e1338eb-7f3d-4680-a0ee-931115da05f9 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:53:16.562566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c0af91cf-00ac-4a29-b923-35bed1e10777 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:16.563214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c0af91cf-00ac-4a29-b923-35bed1e10777 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:16.582516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0af91cf-00ac-4a29-b923-35bed1e10777 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:16.583989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0af91cf-00ac-4a29-b923-35bed1e10777 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:16.585215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0af91cf-00ac-4a29-b923-35bed1e10777 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:16.589314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0af91cf-00ac-4a29-b923-35bed1e10777 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:16.590165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0af91cf-00ac-4a29-b923-35bed1e10777 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:16.590780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0af91cf-00ac-4a29-b923-35bed1e10777 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:16.672126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c0af91cf-00ac-4a29-b923-35bed1e10777 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:53:16.879733 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c0af91cf-00ac-4a29-b923-35bed1e10777 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "DELETE /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 204 len: 0 microversion: 2.1 time: 0.328819 Oct 24 10:53:16.884167 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2695/5427] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:53:16 2022] DELETE /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:53:16.888935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e95aeff5-6abd-4791-87cc-8a1bb4474843 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:16.889658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e95aeff5-6abd-4791-87cc-8a1bb4474843 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:16.907696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e95aeff5-6abd-4791-87cc-8a1bb4474843 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:16.908456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e95aeff5-6abd-4791-87cc-8a1bb4474843 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:16.909136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e95aeff5-6abd-4791-87cc-8a1bb4474843 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:16.910060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e95aeff5-6abd-4791-87cc-8a1bb4474843 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:16.914431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e95aeff5-6abd-4791-87cc-8a1bb4474843 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:16.915160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e95aeff5-6abd-4791-87cc-8a1bb4474843 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:18.223521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e95aeff5-6abd-4791-87cc-8a1bb4474843 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:18.235617 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e95aeff5-6abd-4791-87cc-8a1bb4474843 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1521 microversion: 2.1 time: 1.350473 Oct 24 10:53:18.255494 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2733/5428] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:16 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1521 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:53:19.284916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c2c8d33-dcbb-4f48-b046-433365ab07ba tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:19.286689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1c2c8d33-dcbb-4f48-b046-433365ab07ba tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:19.307012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c2c8d33-dcbb-4f48-b046-433365ab07ba tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:19.308281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c2c8d33-dcbb-4f48-b046-433365ab07ba tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:19.309674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c2c8d33-dcbb-4f48-b046-433365ab07ba tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:19.311417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c2c8d33-dcbb-4f48-b046-433365ab07ba tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:19.314062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c2c8d33-dcbb-4f48-b046-433365ab07ba tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:19.315541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c2c8d33-dcbb-4f48-b046-433365ab07ba tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:19.608907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:53:19.873430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1c2c8d33-dcbb-4f48-b046-433365ab07ba tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:19.886619 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1c2c8d33-dcbb-4f48-b046-433365ab07ba tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1521 microversion: 2.1 time: 0.606464 Oct 24 10:53:19.887247 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2696/5429] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:19 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1521 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:20.915894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-43735063-7b3c-4455-95b9-e18d9f877755 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:20.917440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-43735063-7b3c-4455-95b9-e18d9f877755 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:20.938748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43735063-7b3c-4455-95b9-e18d9f877755 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:20.939619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43735063-7b3c-4455-95b9-e18d9f877755 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:20.940284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43735063-7b3c-4455-95b9-e18d9f877755 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:20.941268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43735063-7b3c-4455-95b9-e18d9f877755 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:20.941947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43735063-7b3c-4455-95b9-e18d9f877755 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:20.942874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43735063-7b3c-4455-95b9-e18d9f877755 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:22.152597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-43735063-7b3c-4455-95b9-e18d9f877755 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:22.161589 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-43735063-7b3c-4455-95b9-e18d9f877755 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1521 microversion: 2.1 time: 1.251213 Oct 24 10:53:22.170508 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2734/5430] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:20 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1521 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:23.227414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-41bd025f-de6e-495b-9c77-a38e9f72b67d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:23.229212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-41bd025f-de6e-495b-9c77-a38e9f72b67d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:23.250606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41bd025f-de6e-495b-9c77-a38e9f72b67d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:23.256314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41bd025f-de6e-495b-9c77-a38e9f72b67d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:23.260730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41bd025f-de6e-495b-9c77-a38e9f72b67d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:23.267288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41bd025f-de6e-495b-9c77-a38e9f72b67d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:23.268118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41bd025f-de6e-495b-9c77-a38e9f72b67d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:23.268589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41bd025f-de6e-495b-9c77-a38e9f72b67d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:24.023141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-41bd025f-de6e-495b-9c77-a38e9f72b67d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:24.037392 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-41bd025f-de6e-495b-9c77-a38e9f72b67d tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1521 microversion: 2.1 time: 0.826581 Oct 24 10:53:24.042599 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2697/5431] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:23 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1521 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:24.367044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-7fda3346-9bd6-41b6-991d-bae10bf45067 req-dd0d2ba8-49ca-48f0-a898-686ce0f92f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "305c8bd9-3fdb-48da-920e-13613f65ec41", "name": "network-vif-deleted", "tag": "8aac5c1c-7648-4de2-9e1b-44b559f12f0c"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:53:24.453196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7fda3346-9bd6-41b6-991d-bae10bf45067 req-dd0d2ba8-49ca-48f0-a898-686ce0f92f71 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:24.460274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7fda3346-9bd6-41b6-991d-bae10bf45067 req-dd0d2ba8-49ca-48f0-a898-686ce0f92f71 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:24.466523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7fda3346-9bd6-41b6-991d-bae10bf45067 req-dd0d2ba8-49ca-48f0-a898-686ce0f92f71 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:24.544279 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-7fda3346-9bd6-41b6-991d-bae10bf45067 req-dd0d2ba8-49ca-48f0-a898-686ce0f92f71 service nova] Creating event network-vif-deleted:8aac5c1c-7648-4de2-9e1b-44b559f12f0c for instance 305c8bd9-3fdb-48da-920e-13613f65ec41 on n-h1-858383-15 Oct 24 10:53:24.566899 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-7fda3346-9bd6-41b6-991d-bae10bf45067 req-dd0d2ba8-49ca-48f0-a898-686ce0f92f71 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206330 Oct 24 10:53:24.567585 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2735/5432] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:53:25.072733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-572d65f9-011a-42d2-ac47-2b6788a7a2a0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:25.073402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-572d65f9-011a-42d2-ac47-2b6788a7a2a0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:25.097439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-572d65f9-011a-42d2-ac47-2b6788a7a2a0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:25.098078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-572d65f9-011a-42d2-ac47-2b6788a7a2a0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:25.099814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-572d65f9-011a-42d2-ac47-2b6788a7a2a0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:25.103748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-572d65f9-011a-42d2-ac47-2b6788a7a2a0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:25.104290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-572d65f9-011a-42d2-ac47-2b6788a7a2a0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:25.105087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-572d65f9-011a-42d2-ac47-2b6788a7a2a0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:25.228419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-572d65f9-011a-42d2-ac47-2b6788a7a2a0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:25.228986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-572d65f9-011a-42d2-ac47-2b6788a7a2a0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:25.229436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-572d65f9-011a-42d2-ac47-2b6788a7a2a0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:25.233961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-572d65f9-011a-42d2-ac47-2b6788a7a2a0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lazy-loading 'fault' on Instance uuid 305c8bd9-3fdb-48da-920e-13613f65ec41 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:53:25.504414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-572d65f9-011a-42d2-ac47-2b6788a7a2a0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da7534777ef4425aefa81bc7e49b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae874e076c34c44adb00f85aebd000e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:25.521269 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-572d65f9-011a-42d2-ac47-2b6788a7a2a0 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 200 len: 1312 microversion: 2.1 time: 0.453303 Oct 24 10:53:25.543313 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2698/5433] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:25 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 1312 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:26.551899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54c733c1-ce44-4720-975e-23704f2404f9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:26.552805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-54c733c1-ce44-4720-975e-23704f2404f9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] [instance: 305c8bd9-3fdb-48da-920e-13613f65ec41] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:26.594116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54c733c1-ce44-4720-975e-23704f2404f9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:26.596087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54c733c1-ce44-4720-975e-23704f2404f9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:26.596945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54c733c1-ce44-4720-975e-23704f2404f9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:26.597938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54c733c1-ce44-4720-975e-23704f2404f9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:26.598621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54c733c1-ce44-4720-975e-23704f2404f9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:26.599805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54c733c1-ce44-4720-975e-23704f2404f9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:26.660809 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-54c733c1-ce44-4720-975e-23704f2404f9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] HTTP exception thrown: Instance 305c8bd9-3fdb-48da-920e-13613f65ec41 could not be found. Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54c733c1-ce44-4720-975e-23704f2404f9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Request method failure captured: Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 HTTP/1.1 Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm1_YpcUoTx6EtuRJqEim52THa9nHc93ggv-rCTsxHF8KCdRzu0B50Tb2gQcOKEkZzR8bjwxbVU1lCLt9l9Nlkw5MZDlojxwV2MAHZbN_UcYOzact8aaTN_ICS6JQcw4OPHcT53rEwR6K2uYrfqZ498tDq4tCZjBExjOK6wvBxhiRXQ Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 0ae874e076c34c44adb00f85aebd000e Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ae874e076c34c44adb00f85aebd000e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ae874e076c34c44adb00f85aebd000e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 0ae874e076c34c44adb00f85aebd000e Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-615921797 Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerRescueNegativeTestJSON-615921797-project Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 6da7534777ef4425aefa81bc7e49b69f Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerRescueNegativeTestJSON-615921797-project Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 305c8bd9-3fdb-48da-920e-13613f65ec41 could not be found. Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '305c8bd9-3fdb-48da-920e-13613f65ec41'} Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 305c8bd9-3fdb-48da-920e-13613f65ec41 could not be found. Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 305c8bd9-3fdb-48da-920e-13613f65ec41 could not be found. Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:53:26.663354 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:53:26.668467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:53:26.668467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:53:26.668467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:53:26.668467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:53:26.668467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:53:26.668467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:53:26.668467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 305c8bd9-3fdb-48da-920e-13613f65ec41 could not be found. Oct 24 10:53:26.668467 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:53:26.672576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54c733c1-ce44-4720-975e-23704f2404f9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] Returning 404 to user: Instance 305c8bd9-3fdb-48da-920e-13613f65ec41 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:53:26.673585 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-54c733c1-ce44-4720-975e-23704f2404f9 tempest-ServerRescueNegativeTestJSON-615921797 tempest-ServerRescueNegativeTestJSON-615921797-project] 10.222.0.50 "GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41" status: 404 len: 111 microversion: 2.1 time: 0.127683 Oct 24 10:53:26.679757 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2736/5434] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:26 2022] GET /compute/v2.1/servers/305c8bd9-3fdb-48da-920e-13613f65ec41 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:53:27.761123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-30de7af9-92a2-4732-855c-a8b47935e397 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:27.764532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-30de7af9-92a2-4732-855c-a8b47935e397 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:27.771743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30de7af9-92a2-4732-855c-a8b47935e397 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:27.772769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30de7af9-92a2-4732-855c-a8b47935e397 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:27.773711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30de7af9-92a2-4732-855c-a8b47935e397 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:27.774674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30de7af9-92a2-4732-855c-a8b47935e397 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:27.775894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30de7af9-92a2-4732-855c-a8b47935e397 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:27.776553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30de7af9-92a2-4732-855c-a8b47935e397 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:27.863434 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-30de7af9-92a2-4732-855c-a8b47935e397 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106067 Oct 24 10:53:27.876374 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2699/5435] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:53:27 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:53:27.988249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e871a683-f5f6-47a6-ad5c-6d79938c0a02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:27.989382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e871a683-f5f6-47a6-ad5c-6d79938c0a02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:28.005282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e871a683-f5f6-47a6-ad5c-6d79938c0a02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:28.006213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e871a683-f5f6-47a6-ad5c-6d79938c0a02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:28.006910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e871a683-f5f6-47a6-ad5c-6d79938c0a02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:28.008129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e871a683-f5f6-47a6-ad5c-6d79938c0a02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:28.009089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e871a683-f5f6-47a6-ad5c-6d79938c0a02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:28.009848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e871a683-f5f6-47a6-ad5c-6d79938c0a02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:28.079760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e871a683-f5f6-47a6-ad5c-6d79938c0a02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:53:28.323027 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e871a683-f5f6-47a6-ad5c-6d79938c0a02 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 204 len: 0 microversion: 2.1 time: 0.340300 Oct 24 10:53:28.324476 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2737/5436] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:53:27 2022] DELETE /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:53:28.339219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9cbc2f3c-ede5-464f-af02-2d48c8759d70 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:28.340217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9cbc2f3c-ede5-464f-af02-2d48c8759d70 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:28.356241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cbc2f3c-ede5-464f-af02-2d48c8759d70 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:28.357299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cbc2f3c-ede5-464f-af02-2d48c8759d70 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:28.357880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cbc2f3c-ede5-464f-af02-2d48c8759d70 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:28.358741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cbc2f3c-ede5-464f-af02-2d48c8759d70 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:28.359547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cbc2f3c-ede5-464f-af02-2d48c8759d70 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:28.360099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cbc2f3c-ede5-464f-af02-2d48c8759d70 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:29.073394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e60d5d06-fadc-47f4-80a9-ce05a3b918c7 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-292419376", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "0f07c689-ab17-4928-9d2a-907ec19338c7"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:53:29.083379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9cbc2f3c-ede5-464f-af02-2d48c8759d70 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:29.103754 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9cbc2f3c-ede5-464f-af02-2d48c8759d70 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1673 microversion: 2.1 time: 0.771772 Oct 24 10:53:29.105191 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2700/5437] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:28 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1673 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:29.251755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-e60d5d06-fadc-47f4-80a9-ce05a3b918c7 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] validate_networks() for [('0f07c689-ab17-4928-9d2a-907ec19338c7', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:53:30.475493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-29964ff5-e6dd-4bbd-8a48-9d3ecd5877c1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:30.478071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-29964ff5-e6dd-4bbd-8a48-9d3ecd5877c1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:30.486353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29964ff5-e6dd-4bbd-8a48-9d3ecd5877c1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:30.487165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29964ff5-e6dd-4bbd-8a48-9d3ecd5877c1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:30.487867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29964ff5-e6dd-4bbd-8a48-9d3ecd5877c1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:30.489013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29964ff5-e6dd-4bbd-8a48-9d3ecd5877c1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:30.490461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29964ff5-e6dd-4bbd-8a48-9d3ecd5877c1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:30.491104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29964ff5-e6dd-4bbd-8a48-9d3ecd5877c1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:31.584550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e60d5d06-fadc-47f4-80a9-ce05a3b918c7 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:53:31.590563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-29964ff5-e6dd-4bbd-8a48-9d3ecd5877c1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:31.595824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e60d5d06-fadc-47f4-80a9-ce05a3b918c7 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:53:31.597767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e60d5d06-fadc-47f4-80a9-ce05a3b918c7 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:53:31.598394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e60d5d06-fadc-47f4-80a9-ce05a3b918c7 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:53:31.600971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-e60d5d06-fadc-47f4-80a9-ce05a3b918c7 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:53:31.630166 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-29964ff5-e6dd-4bbd-8a48-9d3ecd5877c1 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1673 microversion: 2.1 time: 1.503805 Oct 24 10:53:31.637696 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2701/5438] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:30 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1673 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:31.650350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e60d5d06-fadc-47f4-80a9-ce05a3b918c7 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:31.650842 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e60d5d06-fadc-47f4-80a9-ce05a3b918c7 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:31.651282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e60d5d06-fadc-47f4-80a9-ce05a3b918c7 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:31.652002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e60d5d06-fadc-47f4-80a9-ce05a3b918c7 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:31.652640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e60d5d06-fadc-47f4-80a9-ce05a3b918c7 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:31.653265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e60d5d06-fadc-47f4-80a9-ce05a3b918c7 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:31.683386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-e60d5d06-fadc-47f4-80a9-ce05a3b918c7 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Getting quotas for project 5f4d3035914a427498202bd137d0e07a. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:53:31.689855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-e60d5d06-fadc-47f4-80a9-ce05a3b918c7 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Getting quotas for user d1960e23cd3f49ba8e7d7c924a963c67 and project 5f4d3035914a427498202bd137d0e07a. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:53:31.704710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e60d5d06-fadc-47f4-80a9-ce05a3b918c7 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:53:31.707625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e60d5d06-fadc-47f4-80a9-ce05a3b918c7 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:53:31.776372 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e60d5d06-fadc-47f4-80a9-ce05a3b918c7 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.136503 Oct 24 10:53:31.777594 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2738/5439] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:53:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 10:53:31.792732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-201a67e4-152d-4f9d-b3a7-c2318b90db99 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:31.793552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-201a67e4-152d-4f9d-b3a7-c2318b90db99 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:32.423994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-201a67e4-152d-4f9d-b3a7-c2318b90db99 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1960e23cd3f49ba8e7d7c924a963c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4d3035914a427498202bd137d0e07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:32.446809 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-201a67e4-152d-4f9d-b3a7-c2318b90db99 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a" status: 200 len: 1215 microversion: 2.1 time: 0.661344 Oct 24 10:53:32.447441 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2702/5440] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:31 2022] GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a => generated 1215 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:32.664153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-65af1ba3-833d-4a81-8d29-69359a0c7ff6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:32.664760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-65af1ba3-833d-4a81-8d29-69359a0c7ff6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:32.680814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-65af1ba3-833d-4a81-8d29-69359a0c7ff6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:32.691118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-65af1ba3-833d-4a81-8d29-69359a0c7ff6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:32.691641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-65af1ba3-833d-4a81-8d29-69359a0c7ff6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:32.692411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-65af1ba3-833d-4a81-8d29-69359a0c7ff6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:32.692898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-65af1ba3-833d-4a81-8d29-69359a0c7ff6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:32.693337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-65af1ba3-833d-4a81-8d29-69359a0c7ff6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:32.994384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-65af1ba3-833d-4a81-8d29-69359a0c7ff6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:33.010500 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-65af1ba3-833d-4a81-8d29-69359a0c7ff6 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1605 microversion: 2.1 time: 0.351067 Oct 24 10:53:33.029616 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2739/5441] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:32 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1605 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:33.470523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-45498159-bd6f-4883-8c85-2d57711923d9 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:33.471743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-45498159-bd6f-4883-8c85-2d57711923d9 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:33.483958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45498159-bd6f-4883-8c85-2d57711923d9 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:33.490810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45498159-bd6f-4883-8c85-2d57711923d9 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:33.491508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45498159-bd6f-4883-8c85-2d57711923d9 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:33.493301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45498159-bd6f-4883-8c85-2d57711923d9 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:33.493796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45498159-bd6f-4883-8c85-2d57711923d9 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:33.494251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-45498159-bd6f-4883-8c85-2d57711923d9 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:33.700748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-45498159-bd6f-4883-8c85-2d57711923d9 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1960e23cd3f49ba8e7d7c924a963c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4d3035914a427498202bd137d0e07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:33.717518 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-45498159-bd6f-4883-8c85-2d57711923d9 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a" status: 200 len: 1267 microversion: 2.1 time: 0.250639 Oct 24 10:53:33.720781 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2703/5442] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:33 2022] GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:33.981160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-32120fca-263c-4912-81e7-349de42a4b4a req-990fac19-8d58-4ca5-a054-6fa629ca53ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8856046c-d409-4791-898d-19e0401f6dc0", "name": "network-vif-deleted", "tag": "7ecdfb45-88b0-476d-baa1-30646c4c023d"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:53:34.012092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-32120fca-263c-4912-81e7-349de42a4b4a req-990fac19-8d58-4ca5-a054-6fa629ca53ee service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:34.016454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-32120fca-263c-4912-81e7-349de42a4b4a req-990fac19-8d58-4ca5-a054-6fa629ca53ee service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:34.018281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-32120fca-263c-4912-81e7-349de42a4b4a req-990fac19-8d58-4ca5-a054-6fa629ca53ee service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:34.040185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d4196085-b67d-40e5-9937-b0f683ea2be7 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:34.040807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d4196085-b67d-40e5-9937-b0f683ea2be7 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:34.052907 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-32120fca-263c-4912-81e7-349de42a4b4a req-990fac19-8d58-4ca5-a054-6fa629ca53ee service nova] Creating event network-vif-deleted:7ecdfb45-88b0-476d-baa1-30646c4c023d for instance 8856046c-d409-4791-898d-19e0401f6dc0 on n-h1-858383-15 Oct 24 10:53:34.054334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4196085-b67d-40e5-9937-b0f683ea2be7 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:34.055349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4196085-b67d-40e5-9937-b0f683ea2be7 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:34.055976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4196085-b67d-40e5-9937-b0f683ea2be7 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:34.056986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4196085-b67d-40e5-9937-b0f683ea2be7 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:34.057621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4196085-b67d-40e5-9937-b0f683ea2be7 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:34.058218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d4196085-b67d-40e5-9937-b0f683ea2be7 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:34.066129 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-32120fca-263c-4912-81e7-349de42a4b4a req-990fac19-8d58-4ca5-a054-6fa629ca53ee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091630 Oct 24 10:53:34.067397 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2740/5443] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:53:34.220405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ab7e4c0c-7254-4885-add5-020a4ce2e2eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-377983862", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "c50ce693-02a8-4bd1-9076-bd506a0446f9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1996134956", "security_groups": [{"name": "tempest-secgroup-smoke-1140825493"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:53:34.278283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d4196085-b67d-40e5-9937-b0f683ea2be7 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:34.287067 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d4196085-b67d-40e5-9937-b0f683ea2be7 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 200 len: 1322 microversion: 2.1 time: 0.250707 Oct 24 10:53:34.287675 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2704/5444] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:34 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:53:34.645217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-ab7e4c0c-7254-4885-add5-020a4ce2e2eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] validate_networks() for [('c50ce693-02a8-4bd1-9076-bd506a0446f9', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:53:34.760611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-63a51930-7653-4361-ab7e-7ca6d3a01778 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:34.761972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-63a51930-7653-4361-ab7e-7ca6d3a01778 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:34.787094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63a51930-7653-4361-ab7e-7ca6d3a01778 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:34.787690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63a51930-7653-4361-ab7e-7ca6d3a01778 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:34.788358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63a51930-7653-4361-ab7e-7ca6d3a01778 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:34.799807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63a51930-7653-4361-ab7e-7ca6d3a01778 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:34.803772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63a51930-7653-4361-ab7e-7ca6d3a01778 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:34.804516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63a51930-7653-4361-ab7e-7ca6d3a01778 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:34.991559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-63a51930-7653-4361-ab7e-7ca6d3a01778 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1960e23cd3f49ba8e7d7c924a963c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4d3035914a427498202bd137d0e07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:35.010979 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-63a51930-7653-4361-ab7e-7ca6d3a01778 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a" status: 200 len: 1273 microversion: 2.1 time: 0.266155 Oct 24 10:53:35.017533 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2705/5445] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:34 2022] GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:35.313946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-50c6ae56-63ac-416c-bf8d-51791219726c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:35.314705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-50c6ae56-63ac-416c-bf8d-51791219726c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:35.325411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50c6ae56-63ac-416c-bf8d-51791219726c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:35.330538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50c6ae56-63ac-416c-bf8d-51791219726c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:35.331130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50c6ae56-63ac-416c-bf8d-51791219726c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:35.332969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50c6ae56-63ac-416c-bf8d-51791219726c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:35.336512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50c6ae56-63ac-416c-bf8d-51791219726c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:35.337260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-50c6ae56-63ac-416c-bf8d-51791219726c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:35.392828 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-50c6ae56-63ac-416c-bf8d-51791219726c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] HTTP exception thrown: Instance 8856046c-d409-4791-898d-19e0401f6dc0 could not be found. Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-50c6ae56-63ac-416c-bf8d-51791219726c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Request method failure captured: Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 HTTP/1.1 Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm1-ho6lDj800c94aMkptcsFhAyG_aQg0YP0T2znWt_9OYbU1J_L-ZM_z-ENPCPusyLpH6ElPbGHn-p6csj73-WS9DKVY5h1-JT8-Z8erkHIvr2ETBcWUtx7UmF1nPsQjHYnOe1KQ3hvPt70GpiF6VmnI587Iri5jmP4L1xUciycDLk Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 520c2b4219cd4573bc817e65756a05ac Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeTestJSON-1687182790 Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/520c2b4219cd4573bc817e65756a05ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/520c2b4219cd4573bc817e65756a05ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/520c2b4219cd4573bc817e65756a05ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_520c2b4219cd4573bc817e65756a05ac", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeTestJSON-1687182790 Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 520c2b4219cd4573bc817e65756a05ac Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1687182790 Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AttachVolumeTestJSON-1687182790-project Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: f38592218a3b4c39a977f49dd653e556 Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeTestJSON-1687182790-project Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 8856046c-d409-4791-898d-19e0401f6dc0 could not be found. Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '8856046c-d409-4791-898d-19e0401f6dc0'} Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8856046c-d409-4791-898d-19e0401f6dc0 could not be found. Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8856046c-d409-4791-898d-19e0401f6dc0 could not be found. Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:53:35.403675 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:53:35.408055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:53:35.408055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:53:35.408055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:53:35.408055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:53:35.408055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:53:35.408055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8856046c-d409-4791-898d-19e0401f6dc0 could not be found. Oct 24 10:53:35.408055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:53:35.413223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-50c6ae56-63ac-416c-bf8d-51791219726c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Returning 404 to user: Instance 8856046c-d409-4791-898d-19e0401f6dc0 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:53:35.414446 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-50c6ae56-63ac-416c-bf8d-51791219726c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 404 len: 111 microversion: 2.1 time: 0.106814 Oct 24 10:53:35.422011 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2706/5446] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:35 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:53:35.431999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2b80ba85-4782-4fe9-823c-b2d4557248a7 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '.version_select at 0x7f04cbaba160>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:35.479943 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2b80ba85-4782-4fe9-823c-b2d4557248a7 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805143861" status: 202 len: 0 microversion: 2.1 time: 0.053407 Oct 24 10:53:35.481609 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2707/5447] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Oct 24 10:53:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805143861 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:53:35.910514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ab7e4c0c-7254-4885-add5-020a4ce2e2eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:53:35.911061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ab7e4c0c-7254-4885-add5-020a4ce2e2eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:53:35.912443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ab7e4c0c-7254-4885-add5-020a4ce2e2eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:53:35.912920 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ab7e4c0c-7254-4885-add5-020a4ce2e2eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:53:35.913327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ab7e4c0c-7254-4885-add5-020a4ce2e2eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:53:35.931022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab7e4c0c-7254-4885-add5-020a4ce2e2eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:35.931518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab7e4c0c-7254-4885-add5-020a4ce2e2eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:35.931974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab7e4c0c-7254-4885-add5-020a4ce2e2eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:35.932703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab7e4c0c-7254-4885-add5-020a4ce2e2eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:35.933187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab7e4c0c-7254-4885-add5-020a4ce2e2eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:35.933632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab7e4c0c-7254-4885-add5-020a4ce2e2eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:35.982057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-ab7e4c0c-7254-4885-add5-020a4ce2e2eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Getting quotas for project 45405624633e404ab2d6ff26482a150e. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:53:36.002032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-ab7e4c0c-7254-4885-add5-020a4ce2e2eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Getting quotas for user cdae8836f9784dff90fea5201fd15d1d and project 45405624633e404ab2d6ff26482a150e. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:53:36.039194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ab7e4c0c-7254-4885-add5-020a4ce2e2eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:53:36.048039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5b578978-c33c-4fe0-a2cd-523f4e7ca91b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:36.049382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5b578978-c33c-4fe0-a2cd-523f4e7ca91b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:36.051088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ab7e4c0c-7254-4885-add5-020a4ce2e2eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:53:36.059224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b578978-c33c-4fe0-a2cd-523f4e7ca91b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:36.060031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b578978-c33c-4fe0-a2cd-523f4e7ca91b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:36.060912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b578978-c33c-4fe0-a2cd-523f4e7ca91b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:36.061909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b578978-c33c-4fe0-a2cd-523f4e7ca91b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:36.062934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b578978-c33c-4fe0-a2cd-523f4e7ca91b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:36.063532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b578978-c33c-4fe0-a2cd-523f4e7ca91b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:36.185171 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ab7e4c0c-7254-4885-add5-020a4ce2e2eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.981919 Oct 24 10:53:36.188590 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2741/5448] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:53:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 2001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 10:53:36.205218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-01faa8da-979a-45a4-bc7c-2531d59997b2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:36.207357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-01faa8da-979a-45a4-bc7c-2531d59997b2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:36.342463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5b578978-c33c-4fe0-a2cd-523f4e7ca91b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1960e23cd3f49ba8e7d7c924a963c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4d3035914a427498202bd137d0e07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:36.354270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:53:36.381750 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5b578978-c33c-4fe0-a2cd-523f4e7ca91b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a" status: 200 len: 1273 microversion: 2.1 time: 0.336241 Oct 24 10:53:36.382730 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2708/5449] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:36 2022] GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:36.444739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-01faa8da-979a-45a4-bc7c-2531d59997b2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:36.484635 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-01faa8da-979a-45a4-bc7c-2531d59997b2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1266 microversion: 2.1 time: 0.287281 Oct 24 10:53:36.491952 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2742/5450] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:36 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1266 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:37.411839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4ce20107-5fc1-4708-801b-c608b27041d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:37.412475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4ce20107-5fc1-4708-801b-c608b27041d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:37.444960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ce20107-5fc1-4708-801b-c608b27041d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:37.446077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ce20107-5fc1-4708-801b-c608b27041d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:37.446728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ce20107-5fc1-4708-801b-c608b27041d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:37.455599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ce20107-5fc1-4708-801b-c608b27041d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:37.456216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ce20107-5fc1-4708-801b-c608b27041d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:37.456675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ce20107-5fc1-4708-801b-c608b27041d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:37.517458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6e5ea999-1a8f-40f7-a0fd-54d566d24ff2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:37.518994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6e5ea999-1a8f-40f7-a0fd-54d566d24ff2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:37.556575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e5ea999-1a8f-40f7-a0fd-54d566d24ff2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:37.558105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e5ea999-1a8f-40f7-a0fd-54d566d24ff2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:37.563433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e5ea999-1a8f-40f7-a0fd-54d566d24ff2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:37.565462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e5ea999-1a8f-40f7-a0fd-54d566d24ff2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:37.572047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e5ea999-1a8f-40f7-a0fd-54d566d24ff2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:37.572514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e5ea999-1a8f-40f7-a0fd-54d566d24ff2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:37.711511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4ce20107-5fc1-4708-801b-c608b27041d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1960e23cd3f49ba8e7d7c924a963c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4d3035914a427498202bd137d0e07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:37.727779 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4ce20107-5fc1-4708-801b-c608b27041d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a" status: 200 len: 1273 microversion: 2.1 time: 0.323851 Oct 24 10:53:37.736054 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2709/5451] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:37 2022] GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a => generated 1273 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:37.762124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e5ea999-1a8f-40f7-a0fd-54d566d24ff2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:37.780307 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6e5ea999-1a8f-40f7-a0fd-54d566d24ff2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1262 microversion: 2.1 time: 0.267501 Oct 24 10:53:37.783096 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2743/5452] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:37 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1262 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:38.755136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9e0628a-0ca8-4019-bb59-ef8034c86095 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:38.755763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f9e0628a-0ca8-4019-bb59-ef8034c86095 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:38.773767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9e0628a-0ca8-4019-bb59-ef8034c86095 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:38.774280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9e0628a-0ca8-4019-bb59-ef8034c86095 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:38.774729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9e0628a-0ca8-4019-bb59-ef8034c86095 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:38.775460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9e0628a-0ca8-4019-bb59-ef8034c86095 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:38.776966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9e0628a-0ca8-4019-bb59-ef8034c86095 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:38.776966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9e0628a-0ca8-4019-bb59-ef8034c86095 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:38.806202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a05624f8-f3a1-4d19-8930-dc56dc463836 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:38.806929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a05624f8-f3a1-4d19-8930-dc56dc463836 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:38.823231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a05624f8-f3a1-4d19-8930-dc56dc463836 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:38.830681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a05624f8-f3a1-4d19-8930-dc56dc463836 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:38.841282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a05624f8-f3a1-4d19-8930-dc56dc463836 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:38.849118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a05624f8-f3a1-4d19-8930-dc56dc463836 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:38.850910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a05624f8-f3a1-4d19-8930-dc56dc463836 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:38.856009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a05624f8-f3a1-4d19-8930-dc56dc463836 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:39.406820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a05624f8-f3a1-4d19-8930-dc56dc463836 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:39.420727 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a05624f8-f3a1-4d19-8930-dc56dc463836 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1324 microversion: 2.1 time: 0.617490 Oct 24 10:53:39.424392 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2744/5453] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:38 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1324 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:40.444682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fba224af-3462-4549-b850-ab7268aa784d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:40.446499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fba224af-3462-4549-b850-ab7268aa784d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:40.462091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:53:40.476827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fba224af-3462-4549-b850-ab7268aa784d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:40.477473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fba224af-3462-4549-b850-ab7268aa784d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:40.477974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fba224af-3462-4549-b850-ab7268aa784d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:40.496711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f9e0628a-0ca8-4019-bb59-ef8034c86095 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1960e23cd3f49ba8e7d7c924a963c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4d3035914a427498202bd137d0e07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:40.504846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fba224af-3462-4549-b850-ab7268aa784d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:40.506688 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f9e0628a-0ca8-4019-bb59-ef8034c86095 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a" status: 200 len: 1315 microversion: 2.1 time: 1.755523 Oct 24 10:53:40.509357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fba224af-3462-4549-b850-ab7268aa784d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:40.509891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fba224af-3462-4549-b850-ab7268aa784d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:40.519693 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2710/5454] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:38 2022] GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a => generated 1315 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:40.554936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:53:40.640433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ecb63f0f-9241-4006-8ebc-cb6957445542 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Action: 'create', calling method: .version_select at 0x7f04cb9113a0>, body: {"keypair": {"name": "tempest-keypair-521956824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5jR4xUYZGHeGi1xoYd9YmLcHR5Zqn3/7bIAM0FpJ3EHnqToMdul8XF9D5PXKrscQPaA2hnFlK/11oqnYA7QcVllPK33nV5qeT3qSbftRPokAxmCq4vrKVgl/c45Vqy7w=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:53:40.646329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:53:40.720097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ecb63f0f-9241-4006-8ebc-cb6957445542 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Getting quotas for project 520c2b4219cd4573bc817e65756a05ac. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:53:40.752615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ecb63f0f-9241-4006-8ebc-cb6957445542 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Getting quotas for user f38592218a3b4c39a977f49dd653e556 and project 520c2b4219cd4573bc817e65756a05ac. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:53:40.807943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fba224af-3462-4549-b850-ab7268aa784d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:40.822663 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fba224af-3462-4549-b850-ab7268aa784d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1324 microversion: 2.1 time: 0.379458 Oct 24 10:53:40.823775 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2745/5455] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:40 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1324 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:40.858127 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ecb63f0f-9241-4006-8ebc-cb6957445542 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.221637 Oct 24 10:53:40.858880 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2711/5456] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:53:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:53:41.549836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d04a9bfa-02e7-404a-8b8b-4f69bfa0dd2a tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:41.551402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d04a9bfa-02e7-404a-8b8b-4f69bfa0dd2a tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:41.565140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d04a9bfa-02e7-404a-8b8b-4f69bfa0dd2a tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:41.566553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d04a9bfa-02e7-404a-8b8b-4f69bfa0dd2a tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:41.570173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d04a9bfa-02e7-404a-8b8b-4f69bfa0dd2a tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:41.571740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d04a9bfa-02e7-404a-8b8b-4f69bfa0dd2a tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:41.573112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d04a9bfa-02e7-404a-8b8b-4f69bfa0dd2a tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:41.573781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d04a9bfa-02e7-404a-8b8b-4f69bfa0dd2a tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:41.847897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-532e4235-1f70-468a-82f6-9e628cb00a9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:41.848656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-532e4235-1f70-468a-82f6-9e628cb00a9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:41.862237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-532e4235-1f70-468a-82f6-9e628cb00a9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:41.863018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-532e4235-1f70-468a-82f6-9e628cb00a9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:41.863637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-532e4235-1f70-468a-82f6-9e628cb00a9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:41.864747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-532e4235-1f70-468a-82f6-9e628cb00a9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:41.869266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-532e4235-1f70-468a-82f6-9e628cb00a9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:41.870155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-532e4235-1f70-468a-82f6-9e628cb00a9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:42.090273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-532e4235-1f70-468a-82f6-9e628cb00a9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:42.103676 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-532e4235-1f70-468a-82f6-9e628cb00a9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1324 microversion: 2.1 time: 0.255664 Oct 24 10:53:42.120652 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2712/5457] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:41 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1324 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:42.394823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d04a9bfa-02e7-404a-8b8b-4f69bfa0dd2a tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1960e23cd3f49ba8e7d7c924a963c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4d3035914a427498202bd137d0e07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:42.405042 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d04a9bfa-02e7-404a-8b8b-4f69bfa0dd2a tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a" status: 200 len: 1315 microversion: 2.1 time: 0.859953 Oct 24 10:53:42.409670 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2746/5458] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:41 2022] GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a => generated 1315 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:43.128683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1960a008-5904-4eae-a04a-d19a6836a848 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:43.130407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1960a008-5904-4eae-a04a-d19a6836a848 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:43.144433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1960a008-5904-4eae-a04a-d19a6836a848 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:43.147451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1960a008-5904-4eae-a04a-d19a6836a848 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:43.150240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1960a008-5904-4eae-a04a-d19a6836a848 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:43.156265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1960a008-5904-4eae-a04a-d19a6836a848 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:43.157604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1960a008-5904-4eae-a04a-d19a6836a848 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:43.158257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1960a008-5904-4eae-a04a-d19a6836a848 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:43.432761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8d671f71-22cc-4be4-887f-99894e50587b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:43.433502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8d671f71-22cc-4be4-887f-99894e50587b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:43.457862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d671f71-22cc-4be4-887f-99894e50587b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:43.459107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d671f71-22cc-4be4-887f-99894e50587b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:43.460165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d671f71-22cc-4be4-887f-99894e50587b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:43.464301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d671f71-22cc-4be4-887f-99894e50587b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:43.467258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d671f71-22cc-4be4-887f-99894e50587b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:43.472479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d671f71-22cc-4be4-887f-99894e50587b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:44.478411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d671f71-22cc-4be4-887f-99894e50587b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1960e23cd3f49ba8e7d7c924a963c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4d3035914a427498202bd137d0e07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:44.495422 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8d671f71-22cc-4be4-887f-99894e50587b tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a" status: 200 len: 1315 microversion: 2.1 time: 1.067683 Oct 24 10:53:44.498010 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2747/5459] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:43 2022] GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a => generated 1315 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:53:44.508820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-3c4734df-ebad-42b7-833a-d8d94ff412f3 req-1c85528f-10bf-4280-b7e8-fb6b14eb8f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3a3140f-9a6d-4139-8954-fb120eb9e91a", "tag": "5de9a6e1-48a2-4978-928d-803803a74464"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:53:44.521237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3c4734df-ebad-42b7-833a-d8d94ff412f3 req-1c85528f-10bf-4280-b7e8-fb6b14eb8f13 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:44.522096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3c4734df-ebad-42b7-833a-d8d94ff412f3 req-1c85528f-10bf-4280-b7e8-fb6b14eb8f13 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:44.523184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3c4734df-ebad-42b7-833a-d8d94ff412f3 req-1c85528f-10bf-4280-b7e8-fb6b14eb8f13 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:44.561581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1960a008-5904-4eae-a04a-d19a6836a848 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:44.571496 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-3c4734df-ebad-42b7-833a-d8d94ff412f3 req-1c85528f-10bf-4280-b7e8-fb6b14eb8f13 service nova] Creating event network-changed:5de9a6e1-48a2-4978-928d-803803a74464 for instance d3a3140f-9a6d-4139-8954-fb120eb9e91a on n-h2-858383-15 Oct 24 10:53:44.577072 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1960a008-5904-4eae-a04a-d19a6836a848 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1392 microversion: 2.1 time: 1.452484 Oct 24 10:53:44.607038 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2713/5460] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:43 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1392 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:44.619588 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-3c4734df-ebad-42b7-833a-d8d94ff412f3 req-1c85528f-10bf-4280-b7e8-fb6b14eb8f13 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119526 Oct 24 10:53:44.620482 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2748/5461] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:53:45.523951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-62d8ecb7-488e-48a9-9680-5ef20653f5f2 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:45.524889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-62d8ecb7-488e-48a9-9680-5ef20653f5f2 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:45.533285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62d8ecb7-488e-48a9-9680-5ef20653f5f2 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:45.551596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62d8ecb7-488e-48a9-9680-5ef20653f5f2 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:45.551755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62d8ecb7-488e-48a9-9680-5ef20653f5f2 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:45.552674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62d8ecb7-488e-48a9-9680-5ef20653f5f2 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:45.563313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62d8ecb7-488e-48a9-9680-5ef20653f5f2 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:45.563886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62d8ecb7-488e-48a9-9680-5ef20653f5f2 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:45.605346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-252c6896-289f-4167-8d55-64160c4fac2f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:45.606057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-252c6896-289f-4167-8d55-64160c4fac2f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:45.620722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-252c6896-289f-4167-8d55-64160c4fac2f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:45.621249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-252c6896-289f-4167-8d55-64160c4fac2f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:45.621678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-252c6896-289f-4167-8d55-64160c4fac2f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:45.622395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-252c6896-289f-4167-8d55-64160c4fac2f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:45.622912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-252c6896-289f-4167-8d55-64160c4fac2f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:45.623857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-252c6896-289f-4167-8d55-64160c4fac2f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:45.957043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:53:46.464945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=14 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:53:47.119417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-252c6896-289f-4167-8d55-64160c4fac2f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:47.137253 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-252c6896-289f-4167-8d55-64160c4fac2f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1392 microversion: 2.1 time: 1.530188 Oct 24 10:53:47.159725 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2749/5462] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:45 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1392 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:53:47.251244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-62d8ecb7-488e-48a9-9680-5ef20653f5f2 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1960e23cd3f49ba8e7d7c924a963c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4d3035914a427498202bd137d0e07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:47.263137 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-62d8ecb7-488e-48a9-9680-5ef20653f5f2 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a" status: 200 len: 1315 microversion: 2.1 time: 1.746043 Oct 24 10:53:47.267065 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2714/5463] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:45 2022] GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a => generated 1315 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:47.480911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f023c4b7-a6d7-4093-9ba5-5156284bee56 req-c82466a1-706b-41a1-96c9-0bebbbfc1c36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bfd7080-7dfd-489b-8128-0e66aec16fff", "tag": "2cae1fc6-3659-43fd-97c3-9b936fe09a4e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:53:47.482298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d192ad09-bdfd-41c8-bc92-bb31f9b5533e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1867069400", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": "none"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:53:47.523717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f023c4b7-a6d7-4093-9ba5-5156284bee56 req-c82466a1-706b-41a1-96c9-0bebbbfc1c36 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:47.525008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f023c4b7-a6d7-4093-9ba5-5156284bee56 req-c82466a1-706b-41a1-96c9-0bebbbfc1c36 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:47.526966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f023c4b7-a6d7-4093-9ba5-5156284bee56 req-c82466a1-706b-41a1-96c9-0bebbbfc1c36 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:47.557852 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f023c4b7-a6d7-4093-9ba5-5156284bee56 req-c82466a1-706b-41a1-96c9-0bebbbfc1c36 service nova] Creating event network-changed:2cae1fc6-3659-43fd-97c3-9b936fe09a4e for instance 3bfd7080-7dfd-489b-8128-0e66aec16fff on n-h1-858383-15 Oct 24 10:53:47.565190 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f023c4b7-a6d7-4093-9ba5-5156284bee56 req-c82466a1-706b-41a1-96c9-0bebbbfc1c36 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092589 Oct 24 10:53:47.566783 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2715/5464] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:53:47.619504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d192ad09-bdfd-41c8-bc92-bb31f9b5533e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:53:47.619928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d192ad09-bdfd-41c8-bc92-bb31f9b5533e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:53:47.620398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d192ad09-bdfd-41c8-bc92-bb31f9b5533e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:53:47.621526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d192ad09-bdfd-41c8-bc92-bb31f9b5533e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:53:47.623152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d192ad09-bdfd-41c8-bc92-bb31f9b5533e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:53:47.647683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d192ad09-bdfd-41c8-bc92-bb31f9b5533e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:47.650122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d192ad09-bdfd-41c8-bc92-bb31f9b5533e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:47.650568 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d192ad09-bdfd-41c8-bc92-bb31f9b5533e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:47.651310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d192ad09-bdfd-41c8-bc92-bb31f9b5533e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:47.651767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d192ad09-bdfd-41c8-bc92-bb31f9b5533e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:47.652191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d192ad09-bdfd-41c8-bc92-bb31f9b5533e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:47.698447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d192ad09-bdfd-41c8-bc92-bb31f9b5533e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Getting quotas for project 8593ec4e937c4d3d834049626c72dbad. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:53:47.717943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d192ad09-bdfd-41c8-bc92-bb31f9b5533e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Getting quotas for user e839ce5d71bc4b0cbaa344d6ee577b00 and project 8593ec4e937c4d3d834049626c72dbad. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:53:47.747337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d192ad09-bdfd-41c8-bc92-bb31f9b5533e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:53:47.749957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d192ad09-bdfd-41c8-bc92-bb31f9b5533e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:53:47.863808 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d192ad09-bdfd-41c8-bc92-bb31f9b5533e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.585059 Oct 24 10:53:47.865139 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2750/5465] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Oct 24 10:53:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 10:53:47.876854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b843febc-e309-49cd-b566-6fd18cf7990a tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:47.877488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b843febc-e309-49cd-b566-6fd18cf7990a tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:48.174315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-464ef6f6-31af-456f-8f52-d30131229820 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:48.175005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-464ef6f6-31af-456f-8f52-d30131229820 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:48.183564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-464ef6f6-31af-456f-8f52-d30131229820 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:48.194991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-464ef6f6-31af-456f-8f52-d30131229820 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:48.195548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-464ef6f6-31af-456f-8f52-d30131229820 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:48.201091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-464ef6f6-31af-456f-8f52-d30131229820 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:48.201984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-464ef6f6-31af-456f-8f52-d30131229820 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:48.202568 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-464ef6f6-31af-456f-8f52-d30131229820 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:48.408888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b843febc-e309-49cd-b566-6fd18cf7990a tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:48.417410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b843febc-e309-49cd-b566-6fd18cf7990a tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:48.426719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b843febc-e309-49cd-b566-6fd18cf7990a tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:48.428216 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b843febc-e309-49cd-b566-6fd18cf7990a tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1278 microversion: 2.57 time: 0.555855 Oct 24 10:53:48.441257 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2716/5466] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:53:47 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1278 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:53:48.453251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c052ba7b-8435-45ab-b699-7ef290f11758 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:48.454205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c052ba7b-8435-45ab-b699-7ef290f11758 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:48.461306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c052ba7b-8435-45ab-b699-7ef290f11758 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:48.462450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c052ba7b-8435-45ab-b699-7ef290f11758 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:48.463149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c052ba7b-8435-45ab-b699-7ef290f11758 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:48.469629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c052ba7b-8435-45ab-b699-7ef290f11758 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:48.470454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c052ba7b-8435-45ab-b699-7ef290f11758 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:48.471081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c052ba7b-8435-45ab-b699-7ef290f11758 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:48.785106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c052ba7b-8435-45ab-b699-7ef290f11758 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1960e23cd3f49ba8e7d7c924a963c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4d3035914a427498202bd137d0e07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:48.796423 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c052ba7b-8435-45ab-b699-7ef290f11758 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a" status: 200 len: 1315 microversion: 2.1 time: 0.353760 Oct 24 10:53:48.797317 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2717/5467] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:48 2022] GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:48.852247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a380f7dd-dde0-4a17-b4bb-091afa8eeaf3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1467345183", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a4acae2-4510-4628-9fd5-81f6365ddf36"}], "security_groups": [{"name": "tempest-securitygroup--1722270711"}], "key_name": "tempest-keypair-521956824", "user_data": "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:53:48.940028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-464ef6f6-31af-456f-8f52-d30131229820 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:48.955022 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-464ef6f6-31af-456f-8f52-d30131229820 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1392 microversion: 2.1 time: 0.787106 Oct 24 10:53:48.957680 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2751/5468] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:48 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1392 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:49.141220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-a380f7dd-dde0-4a17-b4bb-091afa8eeaf3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] validate_networks() for [('9a4acae2-4510-4628-9fd5-81f6365ddf36', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:53:49.458612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-07df69a9-e307-499a-a717-83bd698d68bf tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:49.459854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-07df69a9-e307-499a-a717-83bd698d68bf tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:49.476684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07df69a9-e307-499a-a717-83bd698d68bf tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:49.477484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07df69a9-e307-499a-a717-83bd698d68bf tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:49.478097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07df69a9-e307-499a-a717-83bd698d68bf tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:49.478973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07df69a9-e307-499a-a717-83bd698d68bf tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:49.479584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07df69a9-e307-499a-a717-83bd698d68bf tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:49.480168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07df69a9-e307-499a-a717-83bd698d68bf tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:49.707732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-07df69a9-e307-499a-a717-83bd698d68bf tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:49.723474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-07df69a9-e307-499a-a717-83bd698d68bf tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:49.726606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-07df69a9-e307-499a-a717-83bd698d68bf tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:49.730366 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-07df69a9-e307-499a-a717-83bd698d68bf tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1330 microversion: 2.57 time: 0.275428 Oct 24 10:53:49.760857 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2752/5469] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:53:49 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1330 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:53:49.822468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-323ac997-c088-431b-921a-46bd4903a8fc tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:49.823094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-323ac997-c088-431b-921a-46bd4903a8fc tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:49.831295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-323ac997-c088-431b-921a-46bd4903a8fc tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:49.831800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-323ac997-c088-431b-921a-46bd4903a8fc tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:49.832578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-323ac997-c088-431b-921a-46bd4903a8fc tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:49.837511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-323ac997-c088-431b-921a-46bd4903a8fc tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:49.842656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-323ac997-c088-431b-921a-46bd4903a8fc tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:49.855954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-323ac997-c088-431b-921a-46bd4903a8fc tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:50.449978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-323ac997-c088-431b-921a-46bd4903a8fc tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1960e23cd3f49ba8e7d7c924a963c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4d3035914a427498202bd137d0e07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:50.467331 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-323ac997-c088-431b-921a-46bd4903a8fc tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a" status: 200 len: 1315 microversion: 2.1 time: 0.648947 Oct 24 10:53:50.467957 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2753/5470] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:49 2022] GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:50.472538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8dd381f6-ffcd-4f35-a704-85b3c8c610c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:50.477278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8dd381f6-ffcd-4f35-a704-85b3c8c610c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:50.498359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8dd381f6-ffcd-4f35-a704-85b3c8c610c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:50.499043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8dd381f6-ffcd-4f35-a704-85b3c8c610c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:50.499493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8dd381f6-ffcd-4f35-a704-85b3c8c610c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:50.505328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8dd381f6-ffcd-4f35-a704-85b3c8c610c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:50.506113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8dd381f6-ffcd-4f35-a704-85b3c8c610c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:50.506759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8dd381f6-ffcd-4f35-a704-85b3c8c610c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:50.776389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a380f7dd-dde0-4a17-b4bb-091afa8eeaf3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:53:50.777083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a380f7dd-dde0-4a17-b4bb-091afa8eeaf3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:53:50.777322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a380f7dd-dde0-4a17-b4bb-091afa8eeaf3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:53:50.777735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a380f7dd-dde0-4a17-b4bb-091afa8eeaf3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:53:50.778150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a380f7dd-dde0-4a17-b4bb-091afa8eeaf3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:53:50.789902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a380f7dd-dde0-4a17-b4bb-091afa8eeaf3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:50.790747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a380f7dd-dde0-4a17-b4bb-091afa8eeaf3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:50.791816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a380f7dd-dde0-4a17-b4bb-091afa8eeaf3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:50.794137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a380f7dd-dde0-4a17-b4bb-091afa8eeaf3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:50.794856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a380f7dd-dde0-4a17-b4bb-091afa8eeaf3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:50.795498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a380f7dd-dde0-4a17-b4bb-091afa8eeaf3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:50.823112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-a380f7dd-dde0-4a17-b4bb-091afa8eeaf3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Getting quotas for project 520c2b4219cd4573bc817e65756a05ac. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:53:50.847850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-a380f7dd-dde0-4a17-b4bb-091afa8eeaf3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Getting quotas for user f38592218a3b4c39a977f49dd653e556 and project 520c2b4219cd4573bc817e65756a05ac. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:53:50.874866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a380f7dd-dde0-4a17-b4bb-091afa8eeaf3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:53:50.878700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a380f7dd-dde0-4a17-b4bb-091afa8eeaf3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:53:50.891156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8dd381f6-ffcd-4f35-a704-85b3c8c610c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:50.903786 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8dd381f6-ffcd-4f35-a704-85b3c8c610c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1392 microversion: 2.1 time: 0.434762 Oct 24 10:53:50.909114 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2754/5471] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:50 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1392 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:50.914359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f2cfc1f5-d24a-47c9-b529-e2a8f321ef96 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:50.935127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f2cfc1f5-d24a-47c9-b529-e2a8f321ef96 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:50.946368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2cfc1f5-d24a-47c9-b529-e2a8f321ef96 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:50.947120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2cfc1f5-d24a-47c9-b529-e2a8f321ef96 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:50.947817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2cfc1f5-d24a-47c9-b529-e2a8f321ef96 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:50.948762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2cfc1f5-d24a-47c9-b529-e2a8f321ef96 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:50.949483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2cfc1f5-d24a-47c9-b529-e2a8f321ef96 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:50.950130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2cfc1f5-d24a-47c9-b529-e2a8f321ef96 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:50.993155 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a380f7dd-dde0-4a17-b4bb-091afa8eeaf3 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.141615 Oct 24 10:53:51.001738 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2718/5472] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:53:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 2154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:53:51.007175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-12a22e95-9ee2-46b8-b19f-69f561adb4fb tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:51.008173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-12a22e95-9ee2-46b8-b19f-69f561adb4fb tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:51.163389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-12a22e95-9ee2-46b8-b19f-69f561adb4fb tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:51.177137 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-12a22e95-9ee2-46b8-b19f-69f561adb4fb tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 200 len: 1237 microversion: 2.1 time: 0.173882 Oct 24 10:53:51.199528 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2719/5473] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:51 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 1237 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:51.490370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-048ddd00-7e42-463d-adba-be4367eddbc1 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:51.490898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-048ddd00-7e42-463d-adba-be4367eddbc1 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:51.497242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-048ddd00-7e42-463d-adba-be4367eddbc1 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:51.497957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-048ddd00-7e42-463d-adba-be4367eddbc1 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:51.504660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-048ddd00-7e42-463d-adba-be4367eddbc1 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:51.505688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-048ddd00-7e42-463d-adba-be4367eddbc1 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:51.506336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-048ddd00-7e42-463d-adba-be4367eddbc1 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:51.506935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-048ddd00-7e42-463d-adba-be4367eddbc1 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:51.510649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f2cfc1f5-d24a-47c9-b529-e2a8f321ef96 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:51.524766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f2cfc1f5-d24a-47c9-b529-e2a8f321ef96 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:51.534838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f2cfc1f5-d24a-47c9-b529-e2a8f321ef96 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:51.535981 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f2cfc1f5-d24a-47c9-b529-e2a8f321ef96 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1336 microversion: 2.57 time: 0.625580 Oct 24 10:53:51.542340 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2755/5474] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:53:50 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1336 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:53:51.886462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-048ddd00-7e42-463d-adba-be4367eddbc1 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1960e23cd3f49ba8e7d7c924a963c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4d3035914a427498202bd137d0e07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:51.899937 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-048ddd00-7e42-463d-adba-be4367eddbc1 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a" status: 200 len: 1315 microversion: 2.1 time: 0.413624 Oct 24 10:53:51.913883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-9393004a-8211-403d-81bf-034a700e8427 req-542056cb-9744-4435-9f57-864b2175f904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a3140f-9a6d-4139-8954-fb120eb9e91a", "name": "network-vif-plugged", "status": "completed", "tag": "5de9a6e1-48a2-4978-928d-803803a74464"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:53:51.919465 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2720/5475] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:51 2022] GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:51.933213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2b936bfb-9bdb-48ae-b150-b3428b1283c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:51.937014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2b936bfb-9bdb-48ae-b150-b3428b1283c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:51.947452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9393004a-8211-403d-81bf-034a700e8427 req-542056cb-9744-4435-9f57-864b2175f904 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:51.951948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b936bfb-9bdb-48ae-b150-b3428b1283c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:51.955919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9393004a-8211-403d-81bf-034a700e8427 req-542056cb-9744-4435-9f57-864b2175f904 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:51.956892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b936bfb-9bdb-48ae-b150-b3428b1283c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:51.957056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9393004a-8211-403d-81bf-034a700e8427 req-542056cb-9744-4435-9f57-864b2175f904 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:51.957642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b936bfb-9bdb-48ae-b150-b3428b1283c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:51.958570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b936bfb-9bdb-48ae-b150-b3428b1283c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:51.959191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b936bfb-9bdb-48ae-b150-b3428b1283c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:51.961274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b936bfb-9bdb-48ae-b150-b3428b1283c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:51.992922 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-9393004a-8211-403d-81bf-034a700e8427 req-542056cb-9744-4435-9f57-864b2175f904 service nova] Creating event network-vif-plugged:5de9a6e1-48a2-4978-928d-803803a74464 for instance d3a3140f-9a6d-4139-8954-fb120eb9e91a on n-h2-858383-15 Oct 24 10:53:52.008359 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-9393004a-8211-403d-81bf-034a700e8427 req-542056cb-9744-4435-9f57-864b2175f904 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098227 Oct 24 10:53:52.009320 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2756/5476] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:53:52.208801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4ff41251-5c48-4bdd-a473-9c5e0350d75e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:52.209560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4ff41251-5c48-4bdd-a473-9c5e0350d75e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:52.221383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ff41251-5c48-4bdd-a473-9c5e0350d75e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:52.221903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ff41251-5c48-4bdd-a473-9c5e0350d75e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:52.222577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ff41251-5c48-4bdd-a473-9c5e0350d75e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:52.223306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ff41251-5c48-4bdd-a473-9c5e0350d75e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:52.223771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ff41251-5c48-4bdd-a473-9c5e0350d75e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:52.226104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ff41251-5c48-4bdd-a473-9c5e0350d75e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:52.330365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2b936bfb-9bdb-48ae-b150-b3428b1283c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:52.340794 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2b936bfb-9bdb-48ae-b150-b3428b1283c2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1392 microversion: 2.1 time: 0.416943 Oct 24 10:53:52.361266 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2721/5477] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:51 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1392 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:52.390449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4ff41251-5c48-4bdd-a473-9c5e0350d75e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:52.402662 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4ff41251-5c48-4bdd-a473-9c5e0350d75e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 200 len: 1233 microversion: 2.1 time: 0.200013 Oct 24 10:53:52.422975 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2757/5478] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:52 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 1233 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:53:52.567143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-70f768a1-cb52-4d79-acb2-17f768889d92 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:52.568289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-70f768a1-cb52-4d79-acb2-17f768889d92 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:52.595192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f768a1-cb52-4d79-acb2-17f768889d92 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:52.595696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f768a1-cb52-4d79-acb2-17f768889d92 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:52.596131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f768a1-cb52-4d79-acb2-17f768889d92 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:52.596863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f768a1-cb52-4d79-acb2-17f768889d92 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:52.601241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f768a1-cb52-4d79-acb2-17f768889d92 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:52.601545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f768a1-cb52-4d79-acb2-17f768889d92 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:52.704734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-70f768a1-cb52-4d79-acb2-17f768889d92 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:52.713425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-70f768a1-cb52-4d79-acb2-17f768889d92 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:52.715147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-70f768a1-cb52-4d79-acb2-17f768889d92 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:52.720980 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-70f768a1-cb52-4d79-acb2-17f768889d92 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1357 microversion: 2.57 time: 0.159046 Oct 24 10:53:52.721879 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2722/5479] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:53:52 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:53:52.749630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:53:52.753616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:52.761595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:52.762353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:52.762967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:52.763890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:52.764519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:52.765150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:52.882611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:53:52.883043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:53:52.883524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:53:52.884130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:53:52.885062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:53:52.928998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1b0de2a4-c071-43a2-8061-831a6ecc88b5 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:52.930512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1b0de2a4-c071-43a2-8061-831a6ecc88b5 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:52.949989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b0de2a4-c071-43a2-8061-831a6ecc88b5 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:52.952331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b0de2a4-c071-43a2-8061-831a6ecc88b5 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:52.953399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b0de2a4-c071-43a2-8061-831a6ecc88b5 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:52.955823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b0de2a4-c071-43a2-8061-831a6ecc88b5 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:52.957734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b0de2a4-c071-43a2-8061-831a6ecc88b5 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:52.958610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b0de2a4-c071-43a2-8061-831a6ecc88b5 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:52.974524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:52.984345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:52.985281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:52.985896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:52.988088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:52.988758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:52.989377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:53.028249 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-118807b0-c656-4f52-9f4a-e9526cbfb7fc tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "POST /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f/action" status: 202 len: 1138 microversion: 2.57 time: 0.282798 Oct 24 10:53:53.029449 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2758/5480] 10.222.0.50 () {62 vars in 1320 bytes} [Mon Oct 24 10:53:52 2022] POST /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f/action => generated 1138 bytes in 285 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 24 10:53:53.055387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-04320132-7adc-4949-8a32-17dd8c303260 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:53.056554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-04320132-7adc-4949-8a32-17dd8c303260 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:53.090100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04320132-7adc-4949-8a32-17dd8c303260 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:53.091008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04320132-7adc-4949-8a32-17dd8c303260 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:53.091800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04320132-7adc-4949-8a32-17dd8c303260 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:53.093971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04320132-7adc-4949-8a32-17dd8c303260 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:53.094753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04320132-7adc-4949-8a32-17dd8c303260 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:53.095389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04320132-7adc-4949-8a32-17dd8c303260 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:53.327623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-04320132-7adc-4949-8a32-17dd8c303260 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:53.352714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-04320132-7adc-4949-8a32-17dd8c303260 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:53.362485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-04320132-7adc-4949-8a32-17dd8c303260 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:53.363758 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-04320132-7adc-4949-8a32-17dd8c303260 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.315186 Oct 24 10:53:53.369595 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2759/5481] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:53:53 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:53:53.393405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-40965584-ed7b-4389-88c2-66df993a614f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:53.398011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-40965584-ed7b-4389-88c2-66df993a614f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:53.416498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40965584-ed7b-4389-88c2-66df993a614f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:53.419461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40965584-ed7b-4389-88c2-66df993a614f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:53.420756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40965584-ed7b-4389-88c2-66df993a614f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:53.423503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40965584-ed7b-4389-88c2-66df993a614f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:53.425471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40965584-ed7b-4389-88c2-66df993a614f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:53.426108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-40965584-ed7b-4389-88c2-66df993a614f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:53.501824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1b0de2a4-c071-43a2-8061-831a6ecc88b5 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1960e23cd3f49ba8e7d7c924a963c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4d3035914a427498202bd137d0e07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:53.517223 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1b0de2a4-c071-43a2-8061-831a6ecc88b5 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a" status: 200 len: 1315 microversion: 2.1 time: 0.589828 Oct 24 10:53:53.533125 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2723/5482] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:52 2022] GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:53.549127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fd6a6b3f-4de0-4b43-b599-d885e7871729 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:53.550056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fd6a6b3f-4de0-4b43-b599-d885e7871729 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:53.568661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd6a6b3f-4de0-4b43-b599-d885e7871729 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:53.571910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd6a6b3f-4de0-4b43-b599-d885e7871729 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:53.573753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd6a6b3f-4de0-4b43-b599-d885e7871729 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:53.576114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd6a6b3f-4de0-4b43-b599-d885e7871729 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:53.576608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd6a6b3f-4de0-4b43-b599-d885e7871729 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:53.577167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd6a6b3f-4de0-4b43-b599-d885e7871729 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:53.778989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fd6a6b3f-4de0-4b43-b599-d885e7871729 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:53.788945 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fd6a6b3f-4de0-4b43-b599-d885e7871729 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 200 len: 1295 microversion: 2.1 time: 0.255082 Oct 24 10:53:53.789535 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2724/5483] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:53 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 1295 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:53.828369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-40965584-ed7b-4389-88c2-66df993a614f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:53.838052 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-40965584-ed7b-4389-88c2-66df993a614f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1392 microversion: 2.1 time: 0.460030 Oct 24 10:53:53.838982 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2760/5484] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:53 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1392 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:54.395295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6bc70675-5d9f-4a4b-9e19-b83009e38ce3 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:54.400249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6bc70675-5d9f-4a4b-9e19-b83009e38ce3 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:54.416727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bc70675-5d9f-4a4b-9e19-b83009e38ce3 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:54.417699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bc70675-5d9f-4a4b-9e19-b83009e38ce3 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:54.419405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bc70675-5d9f-4a4b-9e19-b83009e38ce3 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:54.424600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bc70675-5d9f-4a4b-9e19-b83009e38ce3 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:54.425267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bc70675-5d9f-4a4b-9e19-b83009e38ce3 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:54.425928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bc70675-5d9f-4a4b-9e19-b83009e38ce3 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:54.542793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8ed4f43f-6880-4f62-86cf-b49f43a45fff tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:54.544250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8ed4f43f-6880-4f62-86cf-b49f43a45fff tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:54.575247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ed4f43f-6880-4f62-86cf-b49f43a45fff tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:54.575768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ed4f43f-6880-4f62-86cf-b49f43a45fff tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:54.576799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ed4f43f-6880-4f62-86cf-b49f43a45fff tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:54.577567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ed4f43f-6880-4f62-86cf-b49f43a45fff tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:54.578034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ed4f43f-6880-4f62-86cf-b49f43a45fff tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:54.584145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ed4f43f-6880-4f62-86cf-b49f43a45fff tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:54.658030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6bc70675-5d9f-4a4b-9e19-b83009e38ce3 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:54.685399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6bc70675-5d9f-4a4b-9e19-b83009e38ce3 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:54.690536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6bc70675-5d9f-4a4b-9e19-b83009e38ce3 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:54.692680 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6bc70675-5d9f-4a4b-9e19-b83009e38ce3 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.301539 Oct 24 10:53:54.714024 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2725/5485] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:53:54 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:53:54.814152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-11c9f355-1b27-4cf4-9ddc-f223690586e8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:54.814948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-11c9f355-1b27-4cf4-9ddc-f223690586e8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:54.825608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11c9f355-1b27-4cf4-9ddc-f223690586e8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:54.832250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11c9f355-1b27-4cf4-9ddc-f223690586e8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:54.832977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11c9f355-1b27-4cf4-9ddc-f223690586e8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:54.834088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11c9f355-1b27-4cf4-9ddc-f223690586e8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:54.834715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11c9f355-1b27-4cf4-9ddc-f223690586e8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:54.837651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11c9f355-1b27-4cf4-9ddc-f223690586e8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:55.072137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8ed4f43f-6880-4f62-86cf-b49f43a45fff tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1960e23cd3f49ba8e7d7c924a963c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4d3035914a427498202bd137d0e07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:55.074396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:53:55.102395 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8ed4f43f-6880-4f62-86cf-b49f43a45fff tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a" status: 200 len: 1503 microversion: 2.1 time: 0.563666 Oct 24 10:53:55.105085 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2761/5486] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:54 2022] GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a => generated 1503 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:55.119864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5e2185ef-1070-4234-988b-130d1985ccd6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:55.121066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5e2185ef-1070-4234-988b-130d1985ccd6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:55.129819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e2185ef-1070-4234-988b-130d1985ccd6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:55.131194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e2185ef-1070-4234-988b-130d1985ccd6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:55.131993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e2185ef-1070-4234-988b-130d1985ccd6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:55.135712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e2185ef-1070-4234-988b-130d1985ccd6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:55.139354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e2185ef-1070-4234-988b-130d1985ccd6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:55.149020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e2185ef-1070-4234-988b-130d1985ccd6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:55.331584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-11c9f355-1b27-4cf4-9ddc-f223690586e8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:55.341007 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-11c9f355-1b27-4cf4-9ddc-f223690586e8 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 200 len: 1363 microversion: 2.1 time: 0.531323 Oct 24 10:53:55.353656 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2726/5487] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:54 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 1363 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:55.374234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5a36d940-171b-4318-acdb-06b6f40dc831 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:55.375207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5a36d940-171b-4318-acdb-06b6f40dc831 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:55.382925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a36d940-171b-4318-acdb-06b6f40dc831 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:55.392047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a36d940-171b-4318-acdb-06b6f40dc831 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:55.392788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a36d940-171b-4318-acdb-06b6f40dc831 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:55.393658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a36d940-171b-4318-acdb-06b6f40dc831 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:55.394364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a36d940-171b-4318-acdb-06b6f40dc831 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:55.395011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a36d940-171b-4318-acdb-06b6f40dc831 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:55.562217 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5a36d940-171b-4318-acdb-06b6f40dc831 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.207008 Oct 24 10:53:55.565153 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2727/5488] 10.222.0.50 () {58 vars in 1296 bytes} [Mon Oct 24 10:53:55 2022] DELETE /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a/os-server-password => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:53:55.577928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-47b0fe07-a336-4b96-8f24-c37bffc7508e tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:55.578719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-47b0fe07-a336-4b96-8f24-c37bffc7508e tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:55.587441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47b0fe07-a336-4b96-8f24-c37bffc7508e tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:55.588285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47b0fe07-a336-4b96-8f24-c37bffc7508e tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:55.589007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47b0fe07-a336-4b96-8f24-c37bffc7508e tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:55.590032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47b0fe07-a336-4b96-8f24-c37bffc7508e tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:55.590711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47b0fe07-a336-4b96-8f24-c37bffc7508e tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:55.591374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47b0fe07-a336-4b96-8f24-c37bffc7508e tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:55.619279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:53:55.631484 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-47b0fe07-a336-4b96-8f24-c37bffc7508e tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.060760 Oct 24 10:53:55.633348 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2728/5489] 10.222.0.50 () {58 vars in 1293 bytes} [Mon Oct 24 10:53:55 2022] GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a/os-server-password => generated 16 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:53:55.651292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e8ebfdc9-2f1b-4aa8-9d96-d95339004ce9 req-1fd07844-9218-40f8-96b0-a86d7d2faa86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfd7080-7dfd-489b-8128-0e66aec16fff", "name": "network-vif-plugged", "status": "completed", "tag": "2cae1fc6-3659-43fd-97c3-9b936fe09a4e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:53:55.663610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e8ebfdc9-2f1b-4aa8-9d96-d95339004ce9 req-1fd07844-9218-40f8-96b0-a86d7d2faa86 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:55.664477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e8ebfdc9-2f1b-4aa8-9d96-d95339004ce9 req-1fd07844-9218-40f8-96b0-a86d7d2faa86 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:55.665176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e8ebfdc9-2f1b-4aa8-9d96-d95339004ce9 req-1fd07844-9218-40f8-96b0-a86d7d2faa86 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:55.683691 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e8ebfdc9-2f1b-4aa8-9d96-d95339004ce9 req-1fd07844-9218-40f8-96b0-a86d7d2faa86 service nova] Creating event network-vif-plugged:2cae1fc6-3659-43fd-97c3-9b936fe09a4e for instance 3bfd7080-7dfd-489b-8128-0e66aec16fff on n-h1-858383-15 Oct 24 10:53:55.692092 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e8ebfdc9-2f1b-4aa8-9d96-d95339004ce9 req-1fd07844-9218-40f8-96b0-a86d7d2faa86 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058102 Oct 24 10:53:55.693330 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2729/5490] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:53:55.698928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1dcb6d8d-093a-482f-ba65-d2c8e3fdc759 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:55.699769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1dcb6d8d-093a-482f-ba65-d2c8e3fdc759 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:55.706981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dcb6d8d-093a-482f-ba65-d2c8e3fdc759 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:55.707957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dcb6d8d-093a-482f-ba65-d2c8e3fdc759 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:55.708408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dcb6d8d-093a-482f-ba65-d2c8e3fdc759 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:55.708517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5e2185ef-1070-4234-988b-130d1985ccd6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:55.709168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dcb6d8d-093a-482f-ba65-d2c8e3fdc759 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:55.709654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dcb6d8d-093a-482f-ba65-d2c8e3fdc759 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:55.710071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dcb6d8d-093a-482f-ba65-d2c8e3fdc759 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:55.718024 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5e2185ef-1070-4234-988b-130d1985ccd6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1392 microversion: 2.1 time: 0.610778 Oct 24 10:53:55.727873 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2762/5491] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:55 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1392 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:55.734725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5a339625-2683-43b9-ae3c-765cceadf0aa tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:55.741727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5a339625-2683-43b9-ae3c-765cceadf0aa tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:55.752419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a339625-2683-43b9-ae3c-765cceadf0aa tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:55.754941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1dcb6d8d-093a-482f-ba65-d2c8e3fdc759 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:53:55.759473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a339625-2683-43b9-ae3c-765cceadf0aa tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:55.760195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a339625-2683-43b9-ae3c-765cceadf0aa tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:55.761165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a339625-2683-43b9-ae3c-765cceadf0aa tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:55.762065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a339625-2683-43b9-ae3c-765cceadf0aa tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:55.762803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a339625-2683-43b9-ae3c-765cceadf0aa tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:55.973138 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1dcb6d8d-093a-482f-ba65-d2c8e3fdc759 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a" status: 204 len: 0 microversion: 2.1 time: 0.276751 Oct 24 10:53:55.977505 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2730/5492] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:53:55 2022] DELETE /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:53:55.994036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-28d1f003-bc9d-4f3e-80bc-aa4d3d8719d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:55.994770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-28d1f003-bc9d-4f3e-80bc-aa4d3d8719d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:56.011631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28d1f003-bc9d-4f3e-80bc-aa4d3d8719d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:56.011971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28d1f003-bc9d-4f3e-80bc-aa4d3d8719d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:56.012427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28d1f003-bc9d-4f3e-80bc-aa4d3d8719d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:56.013367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28d1f003-bc9d-4f3e-80bc-aa4d3d8719d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:56.014765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28d1f003-bc9d-4f3e-80bc-aa4d3d8719d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:56.015590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-28d1f003-bc9d-4f3e-80bc-aa4d3d8719d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:56.053175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5a339625-2683-43b9-ae3c-765cceadf0aa tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:56.073121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5a339625-2683-43b9-ae3c-765cceadf0aa tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:56.079971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5a339625-2683-43b9-ae3c-765cceadf0aa tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:56.081571 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5a339625-2683-43b9-ae3c-765cceadf0aa tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.352432 Oct 24 10:53:56.084073 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2763/5493] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:53:55 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:53:56.376560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3f0f70a7-77aa-4b37-862e-5b6b29059047 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:56.377661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3f0f70a7-77aa-4b37-862e-5b6b29059047 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:56.387744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f0f70a7-77aa-4b37-862e-5b6b29059047 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:56.389423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f0f70a7-77aa-4b37-862e-5b6b29059047 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:56.391318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f0f70a7-77aa-4b37-862e-5b6b29059047 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:56.392367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f0f70a7-77aa-4b37-862e-5b6b29059047 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:56.393166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f0f70a7-77aa-4b37-862e-5b6b29059047 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:56.393843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f0f70a7-77aa-4b37-862e-5b6b29059047 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:56.960555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-28d1f003-bc9d-4f3e-80bc-aa4d3d8719d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1960e23cd3f49ba8e7d7c924a963c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4d3035914a427498202bd137d0e07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:56.972285 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-28d1f003-bc9d-4f3e-80bc-aa4d3d8719d4 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a" status: 200 len: 1509 microversion: 2.1 time: 0.990828 Oct 24 10:53:56.977183 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2731/5494] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:55 2022] GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a => generated 1509 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:56.982230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e1036f0-cd23-4591-bf19-1c7f83347023 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:56.983207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5e1036f0-cd23-4591-bf19-1c7f83347023 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:57.006975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e1036f0-cd23-4591-bf19-1c7f83347023 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:57.007484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e1036f0-cd23-4591-bf19-1c7f83347023 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:57.007994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e1036f0-cd23-4591-bf19-1c7f83347023 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:57.008931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e1036f0-cd23-4591-bf19-1c7f83347023 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:57.009866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e1036f0-cd23-4591-bf19-1c7f83347023 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:57.010492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e1036f0-cd23-4591-bf19-1c7f83347023 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:57.157172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3f0f70a7-77aa-4b37-862e-5b6b29059047 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:57.166102 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3f0f70a7-77aa-4b37-862e-5b6b29059047 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 200 len: 1363 microversion: 2.1 time: 0.795536 Oct 24 10:53:57.167215 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2764/5495] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:56 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 1363 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:57.173699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-79db07cb-23de-480c-9393-5781ed554302 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:57.174652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-79db07cb-23de-480c-9393-5781ed554302 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:57.182474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79db07cb-23de-480c-9393-5781ed554302 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:57.183234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79db07cb-23de-480c-9393-5781ed554302 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:57.183688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79db07cb-23de-480c-9393-5781ed554302 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:57.184414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79db07cb-23de-480c-9393-5781ed554302 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:57.184909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79db07cb-23de-480c-9393-5781ed554302 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:57.186481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79db07cb-23de-480c-9393-5781ed554302 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:57.297769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-79db07cb-23de-480c-9393-5781ed554302 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:57.306357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-79db07cb-23de-480c-9393-5781ed554302 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:57.308407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-79db07cb-23de-480c-9393-5781ed554302 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:57.311033 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-79db07cb-23de-480c-9393-5781ed554302 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.142177 Oct 24 10:53:57.311629 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2765/5496] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:53:57 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:53:57.481610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5e1036f0-cd23-4591-bf19-1c7f83347023 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:57.490611 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5e1036f0-cd23-4591-bf19-1c7f83347023 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1392 microversion: 2.1 time: 0.512202 Oct 24 10:53:57.506892 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2732/5497] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:56 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1392 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:57.995744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0b0dc709-c7b7-41d2-b73f-038a505fe979 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:57.996287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0b0dc709-c7b7-41d2-b73f-038a505fe979 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:58.003781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:53:58.005878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:53:58.007980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b0dc709-c7b7-41d2-b73f-038a505fe979 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:58.008716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b0dc709-c7b7-41d2-b73f-038a505fe979 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:58.009411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b0dc709-c7b7-41d2-b73f-038a505fe979 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:58.010675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b0dc709-c7b7-41d2-b73f-038a505fe979 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:58.011945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b0dc709-c7b7-41d2-b73f-038a505fe979 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:58.012925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b0dc709-c7b7-41d2-b73f-038a505fe979 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:58.191266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-23a6daef-93a1-438e-ad5b-a08955002532 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:58.193393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-23a6daef-93a1-438e-ad5b-a08955002532 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:58.201782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23a6daef-93a1-438e-ad5b-a08955002532 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:58.203327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23a6daef-93a1-438e-ad5b-a08955002532 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:58.203996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23a6daef-93a1-438e-ad5b-a08955002532 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:58.205392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23a6daef-93a1-438e-ad5b-a08955002532 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:58.206056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23a6daef-93a1-438e-ad5b-a08955002532 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:58.207175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23a6daef-93a1-438e-ad5b-a08955002532 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:58.548264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0b0dc709-c7b7-41d2-b73f-038a505fe979 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1960e23cd3f49ba8e7d7c924a963c67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4d3035914a427498202bd137d0e07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:58.561880 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0b0dc709-c7b7-41d2-b73f-038a505fe979 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a" status: 200 len: 1509 microversion: 2.1 time: 0.569880 Oct 24 10:53:58.566280 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2766/5498] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:57 2022] GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a => generated 1509 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:58.573443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-e7975400-9fe7-46eb-9233-1be42d7afb93 req-86ed185c-5556-4d99-bd00-5c9a1f5f76f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0", "tag": "1adae21c-f941-4b49-90d6-25c815afce32"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:53:58.591030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e7975400-9fe7-46eb-9233-1be42d7afb93 req-86ed185c-5556-4d99-bd00-5c9a1f5f76f5 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:58.594026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e7975400-9fe7-46eb-9233-1be42d7afb93 req-86ed185c-5556-4d99-bd00-5c9a1f5f76f5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:58.595023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e7975400-9fe7-46eb-9233-1be42d7afb93 req-86ed185c-5556-4d99-bd00-5c9a1f5f76f5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:58.639632 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-e7975400-9fe7-46eb-9233-1be42d7afb93 req-86ed185c-5556-4d99-bd00-5c9a1f5f76f5 service nova] Creating event network-changed:1adae21c-f941-4b49-90d6-25c815afce32 for instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 on n-h1-858383-15 Oct 24 10:53:58.671236 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-e7975400-9fe7-46eb-9233-1be42d7afb93 req-86ed185c-5556-4d99-bd00-5c9a1f5f76f5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101442 Oct 24 10:53:58.672605 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2767/5499] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:53:58.695743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fdc231a1-69c8-4a7b-acd2-4ea6d667e58f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:58.697543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fdc231a1-69c8-4a7b-acd2-4ea6d667e58f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:58.725333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fdc231a1-69c8-4a7b-acd2-4ea6d667e58f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:58.726743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fdc231a1-69c8-4a7b-acd2-4ea6d667e58f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:58.727184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fdc231a1-69c8-4a7b-acd2-4ea6d667e58f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:58.728065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fdc231a1-69c8-4a7b-acd2-4ea6d667e58f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:58.728765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fdc231a1-69c8-4a7b-acd2-4ea6d667e58f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:58.729590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fdc231a1-69c8-4a7b-acd2-4ea6d667e58f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:58.773074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-23a6daef-93a1-438e-ad5b-a08955002532 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:58.785014 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-23a6daef-93a1-438e-ad5b-a08955002532 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 200 len: 1363 microversion: 2.1 time: 0.598294 Oct 24 10:53:58.792053 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2733/5500] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:58 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 1363 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:58.805965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f6f018f8-f17c-41d3-b9f2-cf62f632014a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:58.808301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f6f018f8-f17c-41d3-b9f2-cf62f632014a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:58.835280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f018f8-f17c-41d3-b9f2-cf62f632014a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:58.837998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f018f8-f17c-41d3-b9f2-cf62f632014a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:58.847316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f018f8-f17c-41d3-b9f2-cf62f632014a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:58.848461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f018f8-f17c-41d3-b9f2-cf62f632014a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:58.849177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f018f8-f17c-41d3-b9f2-cf62f632014a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:58.849890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6f018f8-f17c-41d3-b9f2-cf62f632014a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:59.067084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fdc231a1-69c8-4a7b-acd2-4ea6d667e58f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:59.080179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fdc231a1-69c8-4a7b-acd2-4ea6d667e58f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:59.087129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fdc231a1-69c8-4a7b-acd2-4ea6d667e58f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:59.090877 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fdc231a1-69c8-4a7b-acd2-4ea6d667e58f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.415939 Oct 24 10:53:59.101175 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2768/5501] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:53:58 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:53:59.110846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-e8aac4ac-715f-47da-9d24-10b0145cb158 req-39e1000d-7e83-4dc4-a941-0a5a4ee8a2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a3140f-9a6d-4139-8954-fb120eb9e91a", "name": "network-vif-deleted", "tag": "5de9a6e1-48a2-4978-928d-803803a74464"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:53:59.122484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e8aac4ac-715f-47da-9d24-10b0145cb158 req-39e1000d-7e83-4dc4-a941-0a5a4ee8a2de service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:59.123608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e8aac4ac-715f-47da-9d24-10b0145cb158 req-39e1000d-7e83-4dc4-a941-0a5a4ee8a2de service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:59.124444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e8aac4ac-715f-47da-9d24-10b0145cb158 req-39e1000d-7e83-4dc4-a941-0a5a4ee8a2de service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:59.144982 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-e8aac4ac-715f-47da-9d24-10b0145cb158 req-39e1000d-7e83-4dc4-a941-0a5a4ee8a2de service nova] Creating event network-vif-deleted:5de9a6e1-48a2-4978-928d-803803a74464 for instance d3a3140f-9a6d-4139-8954-fb120eb9e91a on n-h2-858383-15 Oct 24 10:53:59.155783 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-e8aac4ac-715f-47da-9d24-10b0145cb158 req-39e1000d-7e83-4dc4-a941-0a5a4ee8a2de service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052894 Oct 24 10:53:59.168586 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2769/5502] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:53:59.560564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f6f018f8-f17c-41d3-b9f2-cf62f632014a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:53:59.594572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7685cd82-ed48-4f42-a31f-90b6aa1c2901 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:59.596058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7685cd82-ed48-4f42-a31f-90b6aa1c2901 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] [instance: d3a3140f-9a6d-4139-8954-fb120eb9e91a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:59.619224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7685cd82-ed48-4f42-a31f-90b6aa1c2901 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:59.633285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7685cd82-ed48-4f42-a31f-90b6aa1c2901 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:59.635207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7685cd82-ed48-4f42-a31f-90b6aa1c2901 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:59.639628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7685cd82-ed48-4f42-a31f-90b6aa1c2901 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:59.641620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7685cd82-ed48-4f42-a31f-90b6aa1c2901 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:59.643157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7685cd82-ed48-4f42-a31f-90b6aa1c2901 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:59.664601 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f6f018f8-f17c-41d3-b9f2-cf62f632014a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1564 microversion: 2.1 time: 0.870729 Oct 24 10:53:59.672552 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2734/5503] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:58 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1564 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:53:59.710668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b9375262-b752-4ed8-9998-4db481246350 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:59.719124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b9375262-b752-4ed8-9998-4db481246350 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:59.727666 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-7685cd82-ed48-4f42-a31f-90b6aa1c2901 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] HTTP exception thrown: Instance d3a3140f-9a6d-4139-8954-fb120eb9e91a could not be found. Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7685cd82-ed48-4f42-a31f-90b6aa1c2901 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Request method failure captured: Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a HTTP/1.1 Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm6o1n9MW2SU4ts5mytzboxpseqBLOIRA69AzD1043VTvuyHEDy4VdIqjUVoNfKbtah_nLaSxt2J9vOZV3vI1y_7pBJxS1oolXWZTlRdwO1aERmd_ZfMdkelrwaVw22K0lbvjsbOJzYewzyPgkogJGtbg3qtltDWWKuAe6kFV5gMvp8 Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 5f4d3035914a427498202bd137d0e07a Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerPasswordTestJSON-1542774563 Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5f4d3035914a427498202bd137d0e07a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5f4d3035914a427498202bd137d0e07a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5f4d3035914a427498202bd137d0e07a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5f4d3035914a427498202bd137d0e07a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerPasswordTestJSON-1542774563 Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 5f4d3035914a427498202bd137d0e07a Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1542774563 Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerPasswordTestJSON-1542774563-project Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: d1960e23cd3f49ba8e7d7c924a963c67 Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerPasswordTestJSON-1542774563-project Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance d3a3140f-9a6d-4139-8954-fb120eb9e91a could not be found. Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'd3a3140f-9a6d-4139-8954-fb120eb9e91a'} Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3a3140f-9a6d-4139-8954-fb120eb9e91a could not be found. Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3a3140f-9a6d-4139-8954-fb120eb9e91a could not be found. Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:53:59.733047 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:53:59.736978 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:53:59.736978 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:53:59.736978 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:53:59.736978 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:53:59.736978 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:53:59.736978 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3a3140f-9a6d-4139-8954-fb120eb9e91a could not be found. Oct 24 10:53:59.736978 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:53:59.736978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7685cd82-ed48-4f42-a31f-90b6aa1c2901 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] Returning 404 to user: Instance d3a3140f-9a6d-4139-8954-fb120eb9e91a could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:53:59.737903 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7685cd82-ed48-4f42-a31f-90b6aa1c2901 tempest-ServerPasswordTestJSON-1542774563 tempest-ServerPasswordTestJSON-1542774563-project] 10.222.0.50 "GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a" status: 404 len: 111 microversion: 2.1 time: 0.147182 Oct 24 10:53:59.739149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9375262-b752-4ed8-9998-4db481246350 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:59.748540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9375262-b752-4ed8-9998-4db481246350 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:59.749464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9375262-b752-4ed8-9998-4db481246350 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:59.752068 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2770/5504] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:59 2022] GET /compute/v2.1/servers/d3a3140f-9a6d-4139-8954-fb120eb9e91a => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:53:59.753698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9375262-b752-4ed8-9998-4db481246350 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:59.754343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9375262-b752-4ed8-9998-4db481246350 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:59.756464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9375262-b752-4ed8-9998-4db481246350 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:59.815904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a67ded33-ed96-4781-8026-3e2bbbf1bc46 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:53:59.817014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a67ded33-ed96-4781-8026-3e2bbbf1bc46 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:53:59.837590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a67ded33-ed96-4781-8026-3e2bbbf1bc46 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:59.838577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a67ded33-ed96-4781-8026-3e2bbbf1bc46 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:59.839319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a67ded33-ed96-4781-8026-3e2bbbf1bc46 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:53:59.840450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a67ded33-ed96-4781-8026-3e2bbbf1bc46 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:53:59.840776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a67ded33-ed96-4781-8026-3e2bbbf1bc46 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:53:59.841259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a67ded33-ed96-4781-8026-3e2bbbf1bc46 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:00.224762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a67ded33-ed96-4781-8026-3e2bbbf1bc46 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:00.250000 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a67ded33-ed96-4781-8026-3e2bbbf1bc46 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 200 len: 1363 microversion: 2.1 time: 0.437842 Oct 24 10:54:00.251999 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2771/5505] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:59 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 1363 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:54:00.259595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-23ba8393-b015-41d0-a21b-c3ae56bf1a01 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:00.261629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-23ba8393-b015-41d0-a21b-c3ae56bf1a01 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:00.269133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ba8393-b015-41d0-a21b-c3ae56bf1a01 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:00.270172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ba8393-b015-41d0-a21b-c3ae56bf1a01 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:00.271490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ba8393-b015-41d0-a21b-c3ae56bf1a01 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:00.272679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ba8393-b015-41d0-a21b-c3ae56bf1a01 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:00.273574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ba8393-b015-41d0-a21b-c3ae56bf1a01 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:00.277659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ba8393-b015-41d0-a21b-c3ae56bf1a01 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:00.342821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9375262-b752-4ed8-9998-4db481246350 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:00.356378 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b9375262-b752-4ed8-9998-4db481246350 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1564 microversion: 2.1 time: 0.656691 Oct 24 10:54:00.358598 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2735/5506] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:53:59 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1564 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:54:00.493497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-23ba8393-b015-41d0-a21b-c3ae56bf1a01 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:00.507555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-23ba8393-b015-41d0-a21b-c3ae56bf1a01 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:00.509633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-23ba8393-b015-41d0-a21b-c3ae56bf1a01 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:00.511818 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-23ba8393-b015-41d0-a21b-c3ae56bf1a01 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.258182 Oct 24 10:54:00.529407 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2772/5507] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:00 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:01.278261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e14b98c6-f654-4bab-b300-de7b2ca19c72 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:01.279131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e14b98c6-f654-4bab-b300-de7b2ca19c72 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:01.281925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:54:01.283023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=16 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:54:01.297661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e14b98c6-f654-4bab-b300-de7b2ca19c72 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:01.299410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e14b98c6-f654-4bab-b300-de7b2ca19c72 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:01.301740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e14b98c6-f654-4bab-b300-de7b2ca19c72 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:01.303847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e14b98c6-f654-4bab-b300-de7b2ca19c72 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:01.305951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e14b98c6-f654-4bab-b300-de7b2ca19c72 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:01.306662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e14b98c6-f654-4bab-b300-de7b2ca19c72 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:01.542446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bbc0c062-8147-4149-89a2-4f76b58b6597 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:01.543683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bbc0c062-8147-4149-89a2-4f76b58b6597 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:01.554269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbc0c062-8147-4149-89a2-4f76b58b6597 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:01.559470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbc0c062-8147-4149-89a2-4f76b58b6597 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:01.562415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbc0c062-8147-4149-89a2-4f76b58b6597 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:01.563878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbc0c062-8147-4149-89a2-4f76b58b6597 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:01.565634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbc0c062-8147-4149-89a2-4f76b58b6597 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:01.566924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbc0c062-8147-4149-89a2-4f76b58b6597 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:02.040942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bbc0c062-8147-4149-89a2-4f76b58b6597 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:02.054710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bbc0c062-8147-4149-89a2-4f76b58b6597 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:02.056162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bbc0c062-8147-4149-89a2-4f76b58b6597 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:02.070187 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bbc0c062-8147-4149-89a2-4f76b58b6597 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.531600 Oct 24 10:54:02.071067 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2773/5508] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:01 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:02.378856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e14b98c6-f654-4bab-b300-de7b2ca19c72 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:02.387573 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e14b98c6-f654-4bab-b300-de7b2ca19c72 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 200 len: 1363 microversion: 2.1 time: 1.113219 Oct 24 10:54:02.395039 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2736/5509] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:54:01 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 1363 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:54:03.102516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-64166e98-7364-434b-a0df-74134a30d4eb tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:03.103332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-64166e98-7364-434b-a0df-74134a30d4eb tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:03.124424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64166e98-7364-434b-a0df-74134a30d4eb tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:03.125160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64166e98-7364-434b-a0df-74134a30d4eb tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:03.125777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64166e98-7364-434b-a0df-74134a30d4eb tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:03.127591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64166e98-7364-434b-a0df-74134a30d4eb tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:03.128170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64166e98-7364-434b-a0df-74134a30d4eb tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:03.128709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64166e98-7364-434b-a0df-74134a30d4eb tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:03.421431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9c840aff-c7b2-4f07-93e9-7a4a8ec5a890 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:03.422849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9c840aff-c7b2-4f07-93e9-7a4a8ec5a890 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:03.445371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c840aff-c7b2-4f07-93e9-7a4a8ec5a890 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:03.448667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c840aff-c7b2-4f07-93e9-7a4a8ec5a890 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:03.451458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c840aff-c7b2-4f07-93e9-7a4a8ec5a890 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:03.454408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c840aff-c7b2-4f07-93e9-7a4a8ec5a890 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:03.454918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c840aff-c7b2-4f07-93e9-7a4a8ec5a890 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:03.458194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c840aff-c7b2-4f07-93e9-7a4a8ec5a890 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:03.686294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-64166e98-7364-434b-a0df-74134a30d4eb tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:03.708310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-64166e98-7364-434b-a0df-74134a30d4eb tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:03.710069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-64166e98-7364-434b-a0df-74134a30d4eb tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:03.712700 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-64166e98-7364-434b-a0df-74134a30d4eb tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.615778 Oct 24 10:54:03.740871 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2774/5510] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:03 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:04.278933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9c840aff-c7b2-4f07-93e9-7a4a8ec5a890 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:04.293469 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9c840aff-c7b2-4f07-93e9-7a4a8ec5a890 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 200 len: 1363 microversion: 2.1 time: 0.878752 Oct 24 10:54:04.294066 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2737/5511] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:54:03 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 1363 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:54:04.759799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5fac5516-c99c-4f48-9dfe-e21b920a44d1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:04.761706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5fac5516-c99c-4f48-9dfe-e21b920a44d1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:04.803291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fac5516-c99c-4f48-9dfe-e21b920a44d1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:04.806048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fac5516-c99c-4f48-9dfe-e21b920a44d1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:04.808136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fac5516-c99c-4f48-9dfe-e21b920a44d1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:04.812980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fac5516-c99c-4f48-9dfe-e21b920a44d1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:04.816221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fac5516-c99c-4f48-9dfe-e21b920a44d1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:04.817101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fac5516-c99c-4f48-9dfe-e21b920a44d1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:04.982543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5fac5516-c99c-4f48-9dfe-e21b920a44d1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:04.994611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5fac5516-c99c-4f48-9dfe-e21b920a44d1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:04.999666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5fac5516-c99c-4f48-9dfe-e21b920a44d1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:05.004094 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5fac5516-c99c-4f48-9dfe-e21b920a44d1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.249449 Oct 24 10:54:05.004724 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2775/5512] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:04 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:05.318405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6c335124-8cd7-411c-9fb6-804500adc236 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:05.319672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6c335124-8cd7-411c-9fb6-804500adc236 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:05.335075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c335124-8cd7-411c-9fb6-804500adc236 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:05.340141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c335124-8cd7-411c-9fb6-804500adc236 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:05.341032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c335124-8cd7-411c-9fb6-804500adc236 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:05.351339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c335124-8cd7-411c-9fb6-804500adc236 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:05.352193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c335124-8cd7-411c-9fb6-804500adc236 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:05.354092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c335124-8cd7-411c-9fb6-804500adc236 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:06.037234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eded882b-493f-49ae-9b6f-0a838245ddd2 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:06.037857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-eded882b-493f-49ae-9b6f-0a838245ddd2 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:06.055040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eded882b-493f-49ae-9b6f-0a838245ddd2 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:06.055750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eded882b-493f-49ae-9b6f-0a838245ddd2 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:06.056346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eded882b-493f-49ae-9b6f-0a838245ddd2 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:06.057595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eded882b-493f-49ae-9b6f-0a838245ddd2 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:06.058212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eded882b-493f-49ae-9b6f-0a838245ddd2 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:06.058794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eded882b-493f-49ae-9b6f-0a838245ddd2 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:06.468766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-eded882b-493f-49ae-9b6f-0a838245ddd2 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:06.489287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-eded882b-493f-49ae-9b6f-0a838245ddd2 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:06.494276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-eded882b-493f-49ae-9b6f-0a838245ddd2 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:06.494405 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-eded882b-493f-49ae-9b6f-0a838245ddd2 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.461148 Oct 24 10:54:06.503765 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2776/5513] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:06 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:06.638692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6c335124-8cd7-411c-9fb6-804500adc236 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:06.656389 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6c335124-8cd7-411c-9fb6-804500adc236 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 200 len: 1363 microversion: 2.1 time: 1.341844 Oct 24 10:54:06.657043 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2738/5514] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:54:05 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 1363 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:54:07.408682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-156c02dd-46a7-43eb-998f-a68bf6780c42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:07.410351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-156c02dd-46a7-43eb-998f-a68bf6780c42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:07.432471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-156c02dd-46a7-43eb-998f-a68bf6780c42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:07.433998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-156c02dd-46a7-43eb-998f-a68bf6780c42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:07.435077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-156c02dd-46a7-43eb-998f-a68bf6780c42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:07.437496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-156c02dd-46a7-43eb-998f-a68bf6780c42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:07.438464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-156c02dd-46a7-43eb-998f-a68bf6780c42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:07.441529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-156c02dd-46a7-43eb-998f-a68bf6780c42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:07.465351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3a0e4e34-2c16-4a17-b469-e907ad6c471b req-52ab2851-ae1a-4fc6-8b29-44301402a3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bfd7080-7dfd-489b-8128-0e66aec16fff", "tag": "2cae1fc6-3659-43fd-97c3-9b936fe09a4e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:54:07.495835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3a0e4e34-2c16-4a17-b469-e907ad6c471b req-52ab2851-ae1a-4fc6-8b29-44301402a3d3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:07.502464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3a0e4e34-2c16-4a17-b469-e907ad6c471b req-52ab2851-ae1a-4fc6-8b29-44301402a3d3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:07.503362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3a0e4e34-2c16-4a17-b469-e907ad6c471b req-52ab2851-ae1a-4fc6-8b29-44301402a3d3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:07.543892 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3a0e4e34-2c16-4a17-b469-e907ad6c471b req-52ab2851-ae1a-4fc6-8b29-44301402a3d3 service nova] Creating event network-changed:2cae1fc6-3659-43fd-97c3-9b936fe09a4e for instance 3bfd7080-7dfd-489b-8128-0e66aec16fff on n-h1-858383-15 Oct 24 10:54:07.559559 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3a0e4e34-2c16-4a17-b469-e907ad6c471b req-52ab2851-ae1a-4fc6-8b29-44301402a3d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098200 Oct 24 10:54:07.560182 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2739/5515] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:54:07.574596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00422c43-fda0-49a1-b78a-5d9d5c0d17a1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:07.578555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00422c43-fda0-49a1-b78a-5d9d5c0d17a1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:07.594380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00422c43-fda0-49a1-b78a-5d9d5c0d17a1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:07.595038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00422c43-fda0-49a1-b78a-5d9d5c0d17a1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:07.595497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00422c43-fda0-49a1-b78a-5d9d5c0d17a1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:07.596238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00422c43-fda0-49a1-b78a-5d9d5c0d17a1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:07.596706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00422c43-fda0-49a1-b78a-5d9d5c0d17a1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:07.616903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00422c43-fda0-49a1-b78a-5d9d5c0d17a1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:07.882064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-00422c43-fda0-49a1-b78a-5d9d5c0d17a1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:07.908699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-00422c43-fda0-49a1-b78a-5d9d5c0d17a1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:07.911502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-00422c43-fda0-49a1-b78a-5d9d5c0d17a1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:07.935202 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-00422c43-fda0-49a1-b78a-5d9d5c0d17a1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.355733 Oct 24 10:54:07.935949 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2740/5516] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:07 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:07.962019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-41c1a263-ab80-4444-8d10-71ea7277c059 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:07.965534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-41c1a263-ab80-4444-8d10-71ea7277c059 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:07.992148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c1a263-ab80-4444-8d10-71ea7277c059 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:07.992698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c1a263-ab80-4444-8d10-71ea7277c059 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:07.993173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c1a263-ab80-4444-8d10-71ea7277c059 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:07.998373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c1a263-ab80-4444-8d10-71ea7277c059 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:07.998917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c1a263-ab80-4444-8d10-71ea7277c059 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:08.002036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41c1a263-ab80-4444-8d10-71ea7277c059 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:08.367732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-156c02dd-46a7-43eb-998f-a68bf6780c42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:08.386359 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-156c02dd-46a7-43eb-998f-a68bf6780c42 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1564 microversion: 2.1 time: 0.986305 Oct 24 10:54:08.387902 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2777/5517] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:54:07 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1564 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:54:08.400408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-de17ee1c-fff5-413f-a488-fe3879dd3880 req-314201d0-9240-4020-8a18-d0c47800c11e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0", "name": "network-vif-plugged", "status": "completed", "tag": "1adae21c-f941-4b49-90d6-25c815afce32"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:54:08.427655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-de17ee1c-fff5-413f-a488-fe3879dd3880 req-314201d0-9240-4020-8a18-d0c47800c11e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:08.428214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-de17ee1c-fff5-413f-a488-fe3879dd3880 req-314201d0-9240-4020-8a18-d0c47800c11e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:08.431280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-de17ee1c-fff5-413f-a488-fe3879dd3880 req-314201d0-9240-4020-8a18-d0c47800c11e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:08.470970 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-de17ee1c-fff5-413f-a488-fe3879dd3880 req-314201d0-9240-4020-8a18-d0c47800c11e service nova] Creating event network-vif-plugged:1adae21c-f941-4b49-90d6-25c815afce32 for instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 on n-h1-858383-15 Oct 24 10:54:08.480247 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-de17ee1c-fff5-413f-a488-fe3879dd3880 req-314201d0-9240-4020-8a18-d0c47800c11e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090097 Oct 24 10:54:08.483818 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2778/5518] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:54:08.674969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-41c1a263-ab80-4444-8d10-71ea7277c059 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:08.685616 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-41c1a263-ab80-4444-8d10-71ea7277c059 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 200 len: 1363 microversion: 2.1 time: 0.739800 Oct 24 10:54:08.690361 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2741/5519] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:54:07 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 1363 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:54:08.968442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-29ae2969-42cf-4781-a8dc-201cc751d05e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:08.969449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-29ae2969-42cf-4781-a8dc-201cc751d05e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:09.005181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29ae2969-42cf-4781-a8dc-201cc751d05e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:09.008419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29ae2969-42cf-4781-a8dc-201cc751d05e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:09.008911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29ae2969-42cf-4781-a8dc-201cc751d05e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:09.009682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29ae2969-42cf-4781-a8dc-201cc751d05e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:09.010223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29ae2969-42cf-4781-a8dc-201cc751d05e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:09.010560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-29ae2969-42cf-4781-a8dc-201cc751d05e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:09.230259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-29ae2969-42cf-4781-a8dc-201cc751d05e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:09.246966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-29ae2969-42cf-4781-a8dc-201cc751d05e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:09.250700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-29ae2969-42cf-4781-a8dc-201cc751d05e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:09.254203 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-29ae2969-42cf-4781-a8dc-201cc751d05e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.291353 Oct 24 10:54:09.257326 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2779/5520] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:08 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:09.708687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0d139345-544a-4b33-b162-163834c82086 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:09.709500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0d139345-544a-4b33-b162-163834c82086 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:09.721280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d139345-544a-4b33-b162-163834c82086 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:09.723081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d139345-544a-4b33-b162-163834c82086 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:09.725177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d139345-544a-4b33-b162-163834c82086 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:09.728981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d139345-544a-4b33-b162-163834c82086 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:09.728981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d139345-544a-4b33-b162-163834c82086 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:09.731363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0d139345-544a-4b33-b162-163834c82086 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:10.290051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a512945c-c444-4b23-ad1a-65366549f27d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:10.291993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a512945c-c444-4b23-ad1a-65366549f27d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:10.324218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a512945c-c444-4b23-ad1a-65366549f27d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:10.330548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a512945c-c444-4b23-ad1a-65366549f27d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:10.351865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a512945c-c444-4b23-ad1a-65366549f27d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:10.388377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a512945c-c444-4b23-ad1a-65366549f27d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:10.391593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0d139345-544a-4b33-b162-163834c82086 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:10.398778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a512945c-c444-4b23-ad1a-65366549f27d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:10.399303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a512945c-c444-4b23-ad1a-65366549f27d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:10.407996 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0d139345-544a-4b33-b162-163834c82086 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 200 len: 1363 microversion: 2.1 time: 0.703473 Oct 24 10:54:10.421284 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2742/5521] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:54:09 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 1363 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:54:10.877631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a512945c-c444-4b23-ad1a-65366549f27d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:10.886397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a512945c-c444-4b23-ad1a-65366549f27d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:10.891710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a512945c-c444-4b23-ad1a-65366549f27d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:10.906513 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a512945c-c444-4b23-ad1a-65366549f27d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.623243 Oct 24 10:54:10.907922 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2780/5522] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:10 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:11.435905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4edc47db-0152-4231-88c8-1d0b44dcb817 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:11.436521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4edc47db-0152-4231-88c8-1d0b44dcb817 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:11.439892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:54:11.457145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4edc47db-0152-4231-88c8-1d0b44dcb817 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:11.457648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4edc47db-0152-4231-88c8-1d0b44dcb817 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:11.458089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4edc47db-0152-4231-88c8-1d0b44dcb817 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:11.458803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4edc47db-0152-4231-88c8-1d0b44dcb817 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:11.459257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4edc47db-0152-4231-88c8-1d0b44dcb817 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:11.459684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4edc47db-0152-4231-88c8-1d0b44dcb817 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:11.975877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e9e1b697-a605-4030-a12a-bf5799a02921 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:11.977648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e9e1b697-a605-4030-a12a-bf5799a02921 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:11.986637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:54:11.988130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9e1b697-a605-4030-a12a-bf5799a02921 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:11.988620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9e1b697-a605-4030-a12a-bf5799a02921 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:11.989088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9e1b697-a605-4030-a12a-bf5799a02921 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:11.989801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9e1b697-a605-4030-a12a-bf5799a02921 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:11.995268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4edc47db-0152-4231-88c8-1d0b44dcb817 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:12.009574 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4edc47db-0152-4231-88c8-1d0b44dcb817 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 200 len: 1549 microversion: 2.1 time: 0.577514 Oct 24 10:54:12.010864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9e1b697-a605-4030-a12a-bf5799a02921 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:12.011511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9e1b697-a605-4030-a12a-bf5799a02921 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:12.012434 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2743/5523] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:54:11 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 1549 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:54:12.034240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:54:12.041337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8a72698a-87b6-4b5c-b289-f1ec4e051a21 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:12.044061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8a72698a-87b6-4b5c-b289-f1ec4e051a21 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:12.059147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a72698a-87b6-4b5c-b289-f1ec4e051a21 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:12.061903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a72698a-87b6-4b5c-b289-f1ec4e051a21 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:12.062860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a72698a-87b6-4b5c-b289-f1ec4e051a21 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:12.064313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a72698a-87b6-4b5c-b289-f1ec4e051a21 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:12.066822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a72698a-87b6-4b5c-b289-f1ec4e051a21 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:12.067950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a72698a-87b6-4b5c-b289-f1ec4e051a21 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:12.247258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e9e1b697-a605-4030-a12a-bf5799a02921 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:12.272285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e9e1b697-a605-4030-a12a-bf5799a02921 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:12.277628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e9e1b697-a605-4030-a12a-bf5799a02921 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:12.283054 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e9e1b697-a605-4030-a12a-bf5799a02921 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.338189 Oct 24 10:54:12.316975 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2781/5524] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:11 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:12.386295 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8a72698a-87b6-4b5c-b289-f1ec4e051a21 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.350339 Oct 24 10:54:12.386897 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2744/5525] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 10:54:12 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-interface => generated 285 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:54:13.332431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ba25926e-98d0-4afb-a1aa-089746956d8e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:13.334807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ba25926e-98d0-4afb-a1aa-089746956d8e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:13.350913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba25926e-98d0-4afb-a1aa-089746956d8e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:13.351690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba25926e-98d0-4afb-a1aa-089746956d8e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:13.352304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba25926e-98d0-4afb-a1aa-089746956d8e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:13.353280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba25926e-98d0-4afb-a1aa-089746956d8e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:13.354191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba25926e-98d0-4afb-a1aa-089746956d8e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:13.355014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba25926e-98d0-4afb-a1aa-089746956d8e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:13.488567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ba25926e-98d0-4afb-a1aa-089746956d8e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:13.501837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ba25926e-98d0-4afb-a1aa-089746956d8e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:13.507468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ba25926e-98d0-4afb-a1aa-089746956d8e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:13.509300 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ba25926e-98d0-4afb-a1aa-089746956d8e tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.195799 Oct 24 10:54:13.513310 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2782/5526] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:13 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:14.539760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c00a4f33-2900-4f18-8036-eb1bee7cbca8 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:14.541053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c00a4f33-2900-4f18-8036-eb1bee7cbca8 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:14.555934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c00a4f33-2900-4f18-8036-eb1bee7cbca8 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:14.556521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c00a4f33-2900-4f18-8036-eb1bee7cbca8 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:14.557021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c00a4f33-2900-4f18-8036-eb1bee7cbca8 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:14.570000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c00a4f33-2900-4f18-8036-eb1bee7cbca8 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:14.570508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c00a4f33-2900-4f18-8036-eb1bee7cbca8 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:14.570965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c00a4f33-2900-4f18-8036-eb1bee7cbca8 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:14.609636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:54:15.041790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c00a4f33-2900-4f18-8036-eb1bee7cbca8 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:15.064969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c00a4f33-2900-4f18-8036-eb1bee7cbca8 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:15.066877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c00a4f33-2900-4f18-8036-eb1bee7cbca8 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:15.074654 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c00a4f33-2900-4f18-8036-eb1bee7cbca8 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.538787 Oct 24 10:54:15.075665 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2745/5527] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:14 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:15.616958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-29ca7bee-c36a-4b79-baf4-bc8336416812 req-2939df95-a595-4692-8c82-c05353d546cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0", "tag": "1adae21c-f941-4b49-90d6-25c815afce32"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:54:15.628345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-29ca7bee-c36a-4b79-baf4-bc8336416812 req-2939df95-a595-4692-8c82-c05353d546cb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:15.628844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-29ca7bee-c36a-4b79-baf4-bc8336416812 req-2939df95-a595-4692-8c82-c05353d546cb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:15.629289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-29ca7bee-c36a-4b79-baf4-bc8336416812 req-2939df95-a595-4692-8c82-c05353d546cb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:15.641923 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-29ca7bee-c36a-4b79-baf4-bc8336416812 req-2939df95-a595-4692-8c82-c05353d546cb service nova] Creating event network-changed:1adae21c-f941-4b49-90d6-25c815afce32 for instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 on n-h1-858383-15 Oct 24 10:54:15.650076 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-29ca7bee-c36a-4b79-baf4-bc8336416812 req-2939df95-a595-4692-8c82-c05353d546cb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036774 Oct 24 10:54:15.651309 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2783/5528] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:54:16.107692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-26932aa4-c79e-4054-9776-c6826e9f4da1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:16.108936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-26932aa4-c79e-4054-9776-c6826e9f4da1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:16.125454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26932aa4-c79e-4054-9776-c6826e9f4da1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:16.126266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26932aa4-c79e-4054-9776-c6826e9f4da1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:16.129544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26932aa4-c79e-4054-9776-c6826e9f4da1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:16.130448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26932aa4-c79e-4054-9776-c6826e9f4da1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:16.131027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26932aa4-c79e-4054-9776-c6826e9f4da1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:16.131587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26932aa4-c79e-4054-9776-c6826e9f4da1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:16.302943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-26932aa4-c79e-4054-9776-c6826e9f4da1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:16.314472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-26932aa4-c79e-4054-9776-c6826e9f4da1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:16.315954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-26932aa4-c79e-4054-9776-c6826e9f4da1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:16.322849 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-26932aa4-c79e-4054-9776-c6826e9f4da1 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.216228 Oct 24 10:54:16.323700 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2746/5529] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:16 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:16.486583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-554a9ac2-d6d3-4529-b2d6-452235ebb2ee tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-829697414", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": "none"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:54:16.579164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-554a9ac2-d6d3-4529-b2d6-452235ebb2ee tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:54:16.579595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-554a9ac2-d6d3-4529-b2d6-452235ebb2ee tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:54:16.580071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-554a9ac2-d6d3-4529-b2d6-452235ebb2ee tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:54:16.581352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-554a9ac2-d6d3-4529-b2d6-452235ebb2ee tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:54:16.583422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-554a9ac2-d6d3-4529-b2d6-452235ebb2ee tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:54:16.612125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-554a9ac2-d6d3-4529-b2d6-452235ebb2ee tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:16.612617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-554a9ac2-d6d3-4529-b2d6-452235ebb2ee tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:16.613078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-554a9ac2-d6d3-4529-b2d6-452235ebb2ee tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:16.613991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-554a9ac2-d6d3-4529-b2d6-452235ebb2ee tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:16.614631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-554a9ac2-d6d3-4529-b2d6-452235ebb2ee tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:16.615547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-554a9ac2-d6d3-4529-b2d6-452235ebb2ee tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:16.637207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-554a9ac2-d6d3-4529-b2d6-452235ebb2ee tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Getting quotas for project 91346cf20a1b4adb99998123727f6f35. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:54:16.645130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-554a9ac2-d6d3-4529-b2d6-452235ebb2ee tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Getting quotas for user d8b1565949914a6baf69bba2f4d6dd0c and project 91346cf20a1b4adb99998123727f6f35. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:54:16.661706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-554a9ac2-d6d3-4529-b2d6-452235ebb2ee tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:54:16.664427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-554a9ac2-d6d3-4529-b2d6-452235ebb2ee tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: 6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:54:16.763540 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-554a9ac2-d6d3-4529-b2d6-452235ebb2ee tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.477782 Oct 24 10:54:16.764350 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2784/5530] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Oct 24 10:54:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 24 10:54:16.778315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb71e95a-3c10-4e69-a26e-aa828dc024bf tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:16.778958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bb71e95a-3c10-4e69-a26e-aa828dc024bf tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: 6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:16.933143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bb71e95a-3c10-4e69-a26e-aa828dc024bf tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:16.948677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bb71e95a-3c10-4e69-a26e-aa828dc024bf tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:16.950798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bb71e95a-3c10-4e69-a26e-aa828dc024bf tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:16.953131 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bb71e95a-3c10-4e69-a26e-aa828dc024bf tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e" status: 200 len: 1277 microversion: 2.47 time: 0.179890 Oct 24 10:54:16.955071 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2747/5531] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:16 2022] GET /compute/v2.1/servers/6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:17.042680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b51b6cd5-15cb-4a66-89d1-f435f64c23cc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-499487734", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": "none"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:54:17.135887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b51b6cd5-15cb-4a66-89d1-f435f64c23cc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:54:17.136332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b51b6cd5-15cb-4a66-89d1-f435f64c23cc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:54:17.136812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b51b6cd5-15cb-4a66-89d1-f435f64c23cc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:54:17.139030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b51b6cd5-15cb-4a66-89d1-f435f64c23cc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:54:17.139482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-b51b6cd5-15cb-4a66-89d1-f435f64c23cc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:54:17.174298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b51b6cd5-15cb-4a66-89d1-f435f64c23cc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:17.174798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b51b6cd5-15cb-4a66-89d1-f435f64c23cc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:17.175628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b51b6cd5-15cb-4a66-89d1-f435f64c23cc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:17.176909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b51b6cd5-15cb-4a66-89d1-f435f64c23cc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:17.177706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b51b6cd5-15cb-4a66-89d1-f435f64c23cc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:17.178462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b51b6cd5-15cb-4a66-89d1-f435f64c23cc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:17.220213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-b51b6cd5-15cb-4a66-89d1-f435f64c23cc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Getting quotas for project 91346cf20a1b4adb99998123727f6f35. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:54:17.234167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-b51b6cd5-15cb-4a66-89d1-f435f64c23cc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Getting quotas for user d8b1565949914a6baf69bba2f4d6dd0c and project 91346cf20a1b4adb99998123727f6f35. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:54:17.275178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b51b6cd5-15cb-4a66-89d1-f435f64c23cc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:54:17.277703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b51b6cd5-15cb-4a66-89d1-f435f64c23cc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:54:17.352112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b2b8bcbe-2f00-46d8-b0c4-718e0c396377 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:17.353371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b2b8bcbe-2f00-46d8-b0c4-718e0c396377 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:17.368394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2b8bcbe-2f00-46d8-b0c4-718e0c396377 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:17.376482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2b8bcbe-2f00-46d8-b0c4-718e0c396377 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:17.377274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2b8bcbe-2f00-46d8-b0c4-718e0c396377 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:17.378293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2b8bcbe-2f00-46d8-b0c4-718e0c396377 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:17.380986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2b8bcbe-2f00-46d8-b0c4-718e0c396377 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:17.381667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2b8bcbe-2f00-46d8-b0c4-718e0c396377 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:17.408914 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b51b6cd5-15cb-4a66-89d1-f435f64c23cc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.372340 Oct 24 10:54:17.412142 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2785/5532] 10.222.0.50 () {62 vars in 1188 bytes} [Mon Oct 24 10:54:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 375 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 10:54:17.426716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7fb83544-939d-4047-a78f-e8d30d2c479d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:54:17.433844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7fb83544-939d-4047-a78f-e8d30d2c479d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:17.498912 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7fb83544-939d-4047-a78f-e8d30d2c479d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "PUT /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 991 microversion: 2.47 time: 0.081292 Oct 24 10:54:17.499851 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2786/5533] 10.222.0.50 () {62 vars in 1297 bytes} [Mon Oct 24 10:54:17 2022] PUT /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:54:17.522058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e7492eb6-dff0-4b6d-b0db-f75405101c0e tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:17.522686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e7492eb6-dff0-4b6d-b0db-f75405101c0e tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:17.658499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e7492eb6-dff0-4b6d-b0db-f75405101c0e tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:17.675752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e7492eb6-dff0-4b6d-b0db-f75405101c0e tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:17.678784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e7492eb6-dff0-4b6d-b0db-f75405101c0e tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:17.689397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b2b8bcbe-2f00-46d8-b0c4-718e0c396377 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:17.708234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b2b8bcbe-2f00-46d8-b0c4-718e0c396377 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:17.709824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b2b8bcbe-2f00-46d8-b0c4-718e0c396377 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:17.711092 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b2b8bcbe-2f00-46d8-b0c4-718e0c396377 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.363503 Oct 24 10:54:17.711675 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2748/5534] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:17 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:54:17.711796 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e7492eb6-dff0-4b6d-b0db-f75405101c0e tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1277 microversion: 2.47 time: 0.168752 Oct 24 10:54:17.724872 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2787/5535] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:17 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:54:18.746354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-07bb515a-e6c1-4aa8-b352-e1f2ad540f03 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:18.748997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9a76fe9e-c84d-4fac-bf7d-eb831b67875b tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:18.749995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-07bb515a-e6c1-4aa8-b352-e1f2ad540f03 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:18.752606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9a76fe9e-c84d-4fac-bf7d-eb831b67875b tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:18.768791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a76fe9e-c84d-4fac-bf7d-eb831b67875b tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:18.770758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07bb515a-e6c1-4aa8-b352-e1f2ad540f03 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:18.775775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a76fe9e-c84d-4fac-bf7d-eb831b67875b tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:18.776642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07bb515a-e6c1-4aa8-b352-e1f2ad540f03 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:18.777100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07bb515a-e6c1-4aa8-b352-e1f2ad540f03 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:18.777865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07bb515a-e6c1-4aa8-b352-e1f2ad540f03 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:18.778334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07bb515a-e6c1-4aa8-b352-e1f2ad540f03 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:18.778772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07bb515a-e6c1-4aa8-b352-e1f2ad540f03 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:18.783200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a76fe9e-c84d-4fac-bf7d-eb831b67875b tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:18.783985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a76fe9e-c84d-4fac-bf7d-eb831b67875b tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:18.786209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a76fe9e-c84d-4fac-bf7d-eb831b67875b tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:18.786677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a76fe9e-c84d-4fac-bf7d-eb831b67875b tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:19.003994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9a76fe9e-c84d-4fac-bf7d-eb831b67875b tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:19.021291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9a76fe9e-c84d-4fac-bf7d-eb831b67875b tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:19.031290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9a76fe9e-c84d-4fac-bf7d-eb831b67875b tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:19.033706 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9a76fe9e-c84d-4fac-bf7d-eb831b67875b tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.297139 Oct 24 10:54:19.036767 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2749/5536] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:18 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:19.086178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-07bb515a-e6c1-4aa8-b352-e1f2ad540f03 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:19.101608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-07bb515a-e6c1-4aa8-b352-e1f2ad540f03 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:19.109202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-07bb515a-e6c1-4aa8-b352-e1f2ad540f03 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:19.111566 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-07bb515a-e6c1-4aa8-b352-e1f2ad540f03 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1273 microversion: 2.47 time: 0.371324 Oct 24 10:54:19.112430 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2788/5537] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:18 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1273 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:20.066719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7690d431-9d6c-42bf-8b9c-d8686328c41c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:20.068595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7690d431-9d6c-42bf-8b9c-d8686328c41c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:20.081837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7690d431-9d6c-42bf-8b9c-d8686328c41c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:20.083085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7690d431-9d6c-42bf-8b9c-d8686328c41c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:20.085336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7690d431-9d6c-42bf-8b9c-d8686328c41c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:20.088446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7690d431-9d6c-42bf-8b9c-d8686328c41c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:20.089254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7690d431-9d6c-42bf-8b9c-d8686328c41c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:20.090102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7690d431-9d6c-42bf-8b9c-d8686328c41c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:20.143416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ae375497-7779-4556-bdb6-f6df63ba08cf tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:20.144030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ae375497-7779-4556-bdb6-f6df63ba08cf tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:20.157614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae375497-7779-4556-bdb6-f6df63ba08cf tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:20.159148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae375497-7779-4556-bdb6-f6df63ba08cf tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:20.162140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae375497-7779-4556-bdb6-f6df63ba08cf tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:20.162901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae375497-7779-4556-bdb6-f6df63ba08cf tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:20.163370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae375497-7779-4556-bdb6-f6df63ba08cf tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:20.163804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae375497-7779-4556-bdb6-f6df63ba08cf tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:20.243996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7690d431-9d6c-42bf-8b9c-d8686328c41c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:20.257447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7690d431-9d6c-42bf-8b9c-d8686328c41c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:20.258912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7690d431-9d6c-42bf-8b9c-d8686328c41c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:20.260131 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7690d431-9d6c-42bf-8b9c-d8686328c41c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1366 microversion: 2.57 time: 0.198236 Oct 24 10:54:20.260713 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2750/5538] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:20 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:20.346199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ae375497-7779-4556-bdb6-f6df63ba08cf tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:20.361826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ae375497-7779-4556-bdb6-f6df63ba08cf tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:20.363571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ae375497-7779-4556-bdb6-f6df63ba08cf tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:20.365009 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ae375497-7779-4556-bdb6-f6df63ba08cf tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1329 microversion: 2.47 time: 0.226983 Oct 24 10:54:20.366678 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2789/5539] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:20 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1329 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:21.288149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2a3afab1-6887-4ac9-868c-fa5364c140d6 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:21.288826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2a3afab1-6887-4ac9-868c-fa5364c140d6 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:21.302336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a3afab1-6887-4ac9-868c-fa5364c140d6 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:21.303449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a3afab1-6887-4ac9-868c-fa5364c140d6 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:21.305507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a3afab1-6887-4ac9-868c-fa5364c140d6 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:21.306495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a3afab1-6887-4ac9-868c-fa5364c140d6 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:21.307906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a3afab1-6887-4ac9-868c-fa5364c140d6 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:21.308746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a3afab1-6887-4ac9-868c-fa5364c140d6 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:21.394029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c1be1f0a-ec84-43b7-83b7-8c893b84dae6 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:21.395254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c1be1f0a-ec84-43b7-83b7-8c893b84dae6 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:21.408161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1be1f0a-ec84-43b7-83b7-8c893b84dae6 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:21.411008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1be1f0a-ec84-43b7-83b7-8c893b84dae6 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:21.412446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1be1f0a-ec84-43b7-83b7-8c893b84dae6 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:21.414171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1be1f0a-ec84-43b7-83b7-8c893b84dae6 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:21.415431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1be1f0a-ec84-43b7-83b7-8c893b84dae6 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:21.416475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1be1f0a-ec84-43b7-83b7-8c893b84dae6 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:21.501925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2a3afab1-6887-4ac9-868c-fa5364c140d6 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:21.515165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2a3afab1-6887-4ac9-868c-fa5364c140d6 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:21.535097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2a3afab1-6887-4ac9-868c-fa5364c140d6 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:21.541508 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2a3afab1-6887-4ac9-868c-fa5364c140d6 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1372 microversion: 2.57 time: 0.256727 Oct 24 10:54:21.556290 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2751/5540] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:21 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1372 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:21.591112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c1be1f0a-ec84-43b7-83b7-8c893b84dae6 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:21.602984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c1be1f0a-ec84-43b7-83b7-8c893b84dae6 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:21.604440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c1be1f0a-ec84-43b7-83b7-8c893b84dae6 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:21.605660 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c1be1f0a-ec84-43b7-83b7-8c893b84dae6 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1347 microversion: 2.47 time: 0.218013 Oct 24 10:54:21.606839 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2790/5541] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:21 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1347 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:22.587378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-73e6bb5b-fe75-4009-b8e8-684469fbbb7c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:22.587929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-73e6bb5b-fe75-4009-b8e8-684469fbbb7c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:22.595964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73e6bb5b-fe75-4009-b8e8-684469fbbb7c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:22.596725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73e6bb5b-fe75-4009-b8e8-684469fbbb7c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:22.597337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73e6bb5b-fe75-4009-b8e8-684469fbbb7c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:22.598266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73e6bb5b-fe75-4009-b8e8-684469fbbb7c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:22.598922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73e6bb5b-fe75-4009-b8e8-684469fbbb7c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:22.599539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73e6bb5b-fe75-4009-b8e8-684469fbbb7c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:22.637766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-92b7ba2d-6c3c-469e-b508-36984f7fabf7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:22.639546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-92b7ba2d-6c3c-469e-b508-36984f7fabf7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:22.653745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92b7ba2d-6c3c-469e-b508-36984f7fabf7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:22.655654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92b7ba2d-6c3c-469e-b508-36984f7fabf7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:22.656500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92b7ba2d-6c3c-469e-b508-36984f7fabf7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:22.659284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92b7ba2d-6c3c-469e-b508-36984f7fabf7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:22.663610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92b7ba2d-6c3c-469e-b508-36984f7fabf7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:22.666690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92b7ba2d-6c3c-469e-b508-36984f7fabf7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:22.738650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-73e6bb5b-fe75-4009-b8e8-684469fbbb7c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:22.747641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-73e6bb5b-fe75-4009-b8e8-684469fbbb7c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:22.749643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-73e6bb5b-fe75-4009-b8e8-684469fbbb7c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:22.751205 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-73e6bb5b-fe75-4009-b8e8-684469fbbb7c tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1372 microversion: 2.57 time: 0.168216 Oct 24 10:54:22.752376 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2752/5542] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:22 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:54:22.796020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-92b7ba2d-6c3c-469e-b508-36984f7fabf7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:22.807783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-92b7ba2d-6c3c-469e-b508-36984f7fabf7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:22.809430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-92b7ba2d-6c3c-469e-b508-36984f7fabf7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:22.811369 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-92b7ba2d-6c3c-469e-b508-36984f7fabf7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1335 microversion: 2.47 time: 0.179706 Oct 24 10:54:22.812372 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2791/5543] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:22 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1335 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:54:23.778857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-febcf240-aa7d-4926-a7e9-30ac4f9dbe9d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:23.780148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-febcf240-aa7d-4926-a7e9-30ac4f9dbe9d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:23.788206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-febcf240-aa7d-4926-a7e9-30ac4f9dbe9d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:23.789043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-febcf240-aa7d-4926-a7e9-30ac4f9dbe9d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:23.789716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-febcf240-aa7d-4926-a7e9-30ac4f9dbe9d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:23.790644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-febcf240-aa7d-4926-a7e9-30ac4f9dbe9d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:23.791316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-febcf240-aa7d-4926-a7e9-30ac4f9dbe9d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:23.791860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-febcf240-aa7d-4926-a7e9-30ac4f9dbe9d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:23.839228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d08af187-7453-42ad-a4b6-5997ebf4c302 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:23.840791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d08af187-7453-42ad-a4b6-5997ebf4c302 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:23.852691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d08af187-7453-42ad-a4b6-5997ebf4c302 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:23.853231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d08af187-7453-42ad-a4b6-5997ebf4c302 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:23.853708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d08af187-7453-42ad-a4b6-5997ebf4c302 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:23.854439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d08af187-7453-42ad-a4b6-5997ebf4c302 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:23.854928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d08af187-7453-42ad-a4b6-5997ebf4c302 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:23.855367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d08af187-7453-42ad-a4b6-5997ebf4c302 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:24.251828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d08af187-7453-42ad-a4b6-5997ebf4c302 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:24.265700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d08af187-7453-42ad-a4b6-5997ebf4c302 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:24.267255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d08af187-7453-42ad-a4b6-5997ebf4c302 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:24.268467 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d08af187-7453-42ad-a4b6-5997ebf4c302 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1335 microversion: 2.47 time: 0.434357 Oct 24 10:54:24.272177 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2792/5544] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:23 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1335 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:54:24.298586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-febcf240-aa7d-4926-a7e9-30ac4f9dbe9d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:24.313571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-febcf240-aa7d-4926-a7e9-30ac4f9dbe9d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:24.316455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-febcf240-aa7d-4926-a7e9-30ac4f9dbe9d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:24.317685 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-febcf240-aa7d-4926-a7e9-30ac4f9dbe9d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1372 microversion: 2.57 time: 0.542819 Oct 24 10:54:24.320533 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2753/5545] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:23 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1372 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:25.301594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2e4ebbbf-0f8d-469e-90a4-79b3e531e8de tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:25.302302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2e4ebbbf-0f8d-469e-90a4-79b3e531e8de tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:25.308974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e4ebbbf-0f8d-469e-90a4-79b3e531e8de tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:25.309376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e4ebbbf-0f8d-469e-90a4-79b3e531e8de tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:25.309814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e4ebbbf-0f8d-469e-90a4-79b3e531e8de tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:25.310864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e4ebbbf-0f8d-469e-90a4-79b3e531e8de tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:25.311356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e4ebbbf-0f8d-469e-90a4-79b3e531e8de tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:25.311915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e4ebbbf-0f8d-469e-90a4-79b3e531e8de tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:25.347855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa948402-0753-492d-8687-ac1167d8ed3a tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:25.348479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa948402-0753-492d-8687-ac1167d8ed3a tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:25.361073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa948402-0753-492d-8687-ac1167d8ed3a tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:25.364920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa948402-0753-492d-8687-ac1167d8ed3a tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:25.365397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa948402-0753-492d-8687-ac1167d8ed3a tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:25.366193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa948402-0753-492d-8687-ac1167d8ed3a tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:25.366663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa948402-0753-492d-8687-ac1167d8ed3a tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:25.368803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa948402-0753-492d-8687-ac1167d8ed3a tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:25.395929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2e4ebbbf-0f8d-469e-90a4-79b3e531e8de tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:25.409667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2e4ebbbf-0f8d-469e-90a4-79b3e531e8de tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:25.411454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2e4ebbbf-0f8d-469e-90a4-79b3e531e8de tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:25.413101 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2e4ebbbf-0f8d-469e-90a4-79b3e531e8de tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1335 microversion: 2.47 time: 0.115395 Oct 24 10:54:25.414193 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2793/5546] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:25 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1335 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:25.490233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa948402-0753-492d-8687-ac1167d8ed3a tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:25.500207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa948402-0753-492d-8687-ac1167d8ed3a tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:25.502147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa948402-0753-492d-8687-ac1167d8ed3a tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:25.503248 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa948402-0753-492d-8687-ac1167d8ed3a tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1372 microversion: 2.57 time: 0.160324 Oct 24 10:54:25.503820 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2754/5547] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:25 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:54:26.443558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-43b212f5-fbd2-4c3c-a5d6-8e9015182a2b tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:26.444077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-43b212f5-fbd2-4c3c-a5d6-8e9015182a2b tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:26.452733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43b212f5-fbd2-4c3c-a5d6-8e9015182a2b tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:26.453480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43b212f5-fbd2-4c3c-a5d6-8e9015182a2b tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:26.454225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43b212f5-fbd2-4c3c-a5d6-8e9015182a2b tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:26.456445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43b212f5-fbd2-4c3c-a5d6-8e9015182a2b tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:26.456928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43b212f5-fbd2-4c3c-a5d6-8e9015182a2b tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:26.457518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-43b212f5-fbd2-4c3c-a5d6-8e9015182a2b tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:26.533979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd52d039-2c63-4223-9f73-53ce66d9dcb4 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:26.535705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bd52d039-2c63-4223-9f73-53ce66d9dcb4 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:26.550177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd52d039-2c63-4223-9f73-53ce66d9dcb4 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:26.550447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-43b212f5-fbd2-4c3c-a5d6-8e9015182a2b tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:26.551308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd52d039-2c63-4223-9f73-53ce66d9dcb4 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:26.554532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd52d039-2c63-4223-9f73-53ce66d9dcb4 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:26.556666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd52d039-2c63-4223-9f73-53ce66d9dcb4 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:26.558913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd52d039-2c63-4223-9f73-53ce66d9dcb4 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:26.559772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd52d039-2c63-4223-9f73-53ce66d9dcb4 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:26.562665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-43b212f5-fbd2-4c3c-a5d6-8e9015182a2b tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:26.567721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-43b212f5-fbd2-4c3c-a5d6-8e9015182a2b tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:26.569637 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-43b212f5-fbd2-4c3c-a5d6-8e9015182a2b tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1335 microversion: 2.47 time: 0.130999 Oct 24 10:54:26.570875 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2794/5548] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:26 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1335 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:26.730107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bd52d039-2c63-4223-9f73-53ce66d9dcb4 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:26.744973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bd52d039-2c63-4223-9f73-53ce66d9dcb4 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:26.747452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bd52d039-2c63-4223-9f73-53ce66d9dcb4 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:26.749772 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bd52d039-2c63-4223-9f73-53ce66d9dcb4 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1357 microversion: 2.57 time: 0.223637 Oct 24 10:54:26.750781 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2755/5549] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:26 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:54:26.796930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-deb53f7e-aa14-475f-a887-275dd205e79d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:26.798466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-deb53f7e-aa14-475f-a887-275dd205e79d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:26.818971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-deb53f7e-aa14-475f-a887-275dd205e79d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:26.819532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-deb53f7e-aa14-475f-a887-275dd205e79d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:26.828237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-deb53f7e-aa14-475f-a887-275dd205e79d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:26.829129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-deb53f7e-aa14-475f-a887-275dd205e79d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:26.833137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-deb53f7e-aa14-475f-a887-275dd205e79d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:26.833628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-deb53f7e-aa14-475f-a887-275dd205e79d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:26.867016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-deb53f7e-aa14-475f-a887-275dd205e79d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:54:27.080716 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-deb53f7e-aa14-475f-a887-275dd205e79d tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 204 len: 0 microversion: 2.57 time: 0.288794 Oct 24 10:54:27.081414 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2795/5550] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:54:26 2022] DELETE /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:54:27.090931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f40ec388-3d17-4db2-9036-bebde2fef091 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:27.093354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f40ec388-3d17-4db2-9036-bebde2fef091 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:27.100872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:54:27.108226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f40ec388-3d17-4db2-9036-bebde2fef091 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:27.110968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f40ec388-3d17-4db2-9036-bebde2fef091 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:27.112470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f40ec388-3d17-4db2-9036-bebde2fef091 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:27.113529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f40ec388-3d17-4db2-9036-bebde2fef091 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:27.114442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f40ec388-3d17-4db2-9036-bebde2fef091 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:27.116045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f40ec388-3d17-4db2-9036-bebde2fef091 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:27.229366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f40ec388-3d17-4db2-9036-bebde2fef091 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:27.245953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f40ec388-3d17-4db2-9036-bebde2fef091 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:27.247610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f40ec388-3d17-4db2-9036-bebde2fef091 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:27.249951 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f40ec388-3d17-4db2-9036-bebde2fef091 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1363 microversion: 2.57 time: 0.163836 Oct 24 10:54:27.251113 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2756/5551] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:27 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:27.598121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c85a7372-1b04-4eb3-a99f-4fb1f6faac69 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:27.598915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c85a7372-1b04-4eb3-a99f-4fb1f6faac69 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:27.605823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:54:27.613055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c85a7372-1b04-4eb3-a99f-4fb1f6faac69 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:27.613703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c85a7372-1b04-4eb3-a99f-4fb1f6faac69 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:27.614317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c85a7372-1b04-4eb3-a99f-4fb1f6faac69 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:27.615495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c85a7372-1b04-4eb3-a99f-4fb1f6faac69 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:27.616495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c85a7372-1b04-4eb3-a99f-4fb1f6faac69 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:27.617763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c85a7372-1b04-4eb3-a99f-4fb1f6faac69 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:27.669503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=14 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:54:27.737776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c85a7372-1b04-4eb3-a99f-4fb1f6faac69 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:27.756264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c85a7372-1b04-4eb3-a99f-4fb1f6faac69 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:27.769646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c85a7372-1b04-4eb3-a99f-4fb1f6faac69 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:27.774536 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c85a7372-1b04-4eb3-a99f-4fb1f6faac69 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1356 microversion: 2.47 time: 0.181164 Oct 24 10:54:27.775672 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2796/5552] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:27 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1356 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:54:27.810244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:54:27.820084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:27.830655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:27.831700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:27.832407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:27.833312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:27.833920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:27.834497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:27.981052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:54:27.985087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:54:27.987364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:54:27.989989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:54:27.991657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:54:28.155219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:28.164362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:28.165241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:28.165890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:28.167207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:28.184290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:28.188181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:28.247535 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-26f4cfd5-524c-4d02-ac2a-c7c99fd28332 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "POST /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368/action" status: 202 len: 1078 microversion: 2.47 time: 0.435367 Oct 24 10:54:28.261684 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2757/5553] 10.222.0.50 () {62 vars in 1319 bytes} [Mon Oct 24 10:54:27 2022] POST /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368/action => generated 1078 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 24 10:54:28.276470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-25d47b13-7f6d-4c21-8a18-0cc04b0f48b9 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:28.277243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-25d47b13-7f6d-4c21-8a18-0cc04b0f48b9 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:28.278039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-58a4bdc9-25a0-4b03-82ae-3c16d10d1656 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:28.279063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-58a4bdc9-25a0-4b03-82ae-3c16d10d1656 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:28.286741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58a4bdc9-25a0-4b03-82ae-3c16d10d1656 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:28.287590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58a4bdc9-25a0-4b03-82ae-3c16d10d1656 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:28.288504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58a4bdc9-25a0-4b03-82ae-3c16d10d1656 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:28.289729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58a4bdc9-25a0-4b03-82ae-3c16d10d1656 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:28.290109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25d47b13-7f6d-4c21-8a18-0cc04b0f48b9 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:28.290612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25d47b13-7f6d-4c21-8a18-0cc04b0f48b9 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:28.291044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58a4bdc9-25a0-4b03-82ae-3c16d10d1656 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:28.291175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25d47b13-7f6d-4c21-8a18-0cc04b0f48b9 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:28.291761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25d47b13-7f6d-4c21-8a18-0cc04b0f48b9 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:28.292215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25d47b13-7f6d-4c21-8a18-0cc04b0f48b9 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:28.292516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58a4bdc9-25a0-4b03-82ae-3c16d10d1656 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:28.292626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25d47b13-7f6d-4c21-8a18-0cc04b0f48b9 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:28.489734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-25d47b13-7f6d-4c21-8a18-0cc04b0f48b9 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:28.500079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-25d47b13-7f6d-4c21-8a18-0cc04b0f48b9 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:28.514211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-25d47b13-7f6d-4c21-8a18-0cc04b0f48b9 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:28.517912 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-25d47b13-7f6d-4c21-8a18-0cc04b0f48b9 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.247294 Oct 24 10:54:28.518587 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2797/5554] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:28 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:28.590192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-58a4bdc9-25a0-4b03-82ae-3c16d10d1656 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:28.602968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-58a4bdc9-25a0-4b03-82ae-3c16d10d1656 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:28.604691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-58a4bdc9-25a0-4b03-82ae-3c16d10d1656 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:28.606108 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-58a4bdc9-25a0-4b03-82ae-3c16d10d1656 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1363 microversion: 2.57 time: 0.333962 Oct 24 10:54:28.607385 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2758/5555] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:28 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:29.548646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4b5fbe2f-7258-44aa-8d7a-8e6bba72fa4a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:29.549471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4b5fbe2f-7258-44aa-8d7a-8e6bba72fa4a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:29.557228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b5fbe2f-7258-44aa-8d7a-8e6bba72fa4a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:29.557911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b5fbe2f-7258-44aa-8d7a-8e6bba72fa4a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:29.558559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b5fbe2f-7258-44aa-8d7a-8e6bba72fa4a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:29.559900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b5fbe2f-7258-44aa-8d7a-8e6bba72fa4a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:29.561687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b5fbe2f-7258-44aa-8d7a-8e6bba72fa4a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:29.562421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b5fbe2f-7258-44aa-8d7a-8e6bba72fa4a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:29.634093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1474d76a-b122-4b8c-adc3-1766b1a33f08 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:29.634743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1474d76a-b122-4b8c-adc3-1766b1a33f08 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:29.657749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1474d76a-b122-4b8c-adc3-1766b1a33f08 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:29.658447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1474d76a-b122-4b8c-adc3-1766b1a33f08 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:29.659140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1474d76a-b122-4b8c-adc3-1766b1a33f08 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:29.660069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1474d76a-b122-4b8c-adc3-1766b1a33f08 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:29.661570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1474d76a-b122-4b8c-adc3-1766b1a33f08 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:29.662546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1474d76a-b122-4b8c-adc3-1766b1a33f08 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:29.718676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4b5fbe2f-7258-44aa-8d7a-8e6bba72fa4a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:29.736579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4b5fbe2f-7258-44aa-8d7a-8e6bba72fa4a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:29.743694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4b5fbe2f-7258-44aa-8d7a-8e6bba72fa4a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:29.750524 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4b5fbe2f-7258-44aa-8d7a-8e6bba72fa4a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.208457 Oct 24 10:54:29.753668 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2798/5556] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:29 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:54:29.770161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1474d76a-b122-4b8c-adc3-1766b1a33f08 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:29.771345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1474d76a-b122-4b8c-adc3-1766b1a33f08 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:29.772400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1474d76a-b122-4b8c-adc3-1766b1a33f08 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:29.775449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-1474d76a-b122-4b8c-adc3-1766b1a33f08 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lazy-loading 'fault' on Instance uuid dde011f1-f516-427a-8dcd-3496b3d7b03f {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:54:29.899947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1474d76a-b122-4b8c-adc3-1766b1a33f08 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:29.910618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1474d76a-b122-4b8c-adc3-1766b1a33f08 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:29.915567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1474d76a-b122-4b8c-adc3-1766b1a33f08 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e839ce5d71bc4b0cbaa344d6ee577b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8593ec4e937c4d3d834049626c72dbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:29.920302 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1474d76a-b122-4b8c-adc3-1766b1a33f08 tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 200 len: 1368 microversion: 2.57 time: 0.288488 Oct 24 10:54:29.921931 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2759/5557] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:29 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 1368 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:54:30.785539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-45fc9b16-6f0d-47a5-a06d-8c41a32c99ab tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:30.787712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-45fc9b16-6f0d-47a5-a06d-8c41a32c99ab tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:30.804909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-45fc9b16-6f0d-47a5-a06d-8c41a32c99ab tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:30.807703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-45fc9b16-6f0d-47a5-a06d-8c41a32c99ab tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:30.808682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-45fc9b16-6f0d-47a5-a06d-8c41a32c99ab tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:30.809865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-45fc9b16-6f0d-47a5-a06d-8c41a32c99ab tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:30.811771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-45fc9b16-6f0d-47a5-a06d-8c41a32c99ab tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:30.819960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-45fc9b16-6f0d-47a5-a06d-8c41a32c99ab tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:30.947523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9eabe581-c59d-41c2-be77-b1e3a450ee0f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:30.948201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9eabe581-c59d-41c2-be77-b1e3a450ee0f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] [instance: dde011f1-f516-427a-8dcd-3496b3d7b03f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:30.967666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eabe581-c59d-41c2-be77-b1e3a450ee0f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:30.969393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eabe581-c59d-41c2-be77-b1e3a450ee0f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:30.972124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eabe581-c59d-41c2-be77-b1e3a450ee0f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:30.976062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eabe581-c59d-41c2-be77-b1e3a450ee0f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:30.976706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eabe581-c59d-41c2-be77-b1e3a450ee0f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:30.977367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9eabe581-c59d-41c2-be77-b1e3a450ee0f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:31.015442 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-9eabe581-c59d-41c2-be77-b1e3a450ee0f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] HTTP exception thrown: Instance dde011f1-f516-427a-8dcd-3496b3d7b03f could not be found. Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9eabe581-c59d-41c2-be77-b1e3a450ee0f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Request method failure captured: Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f HTTP/1.1 Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm67VvMEMnXh14uinN1NkpTcP3SY89jRANpsxWkdy4Twnqk7c4sWfMkK3rvHzEGR1a2gX_n2nUrkIokEbmozj4BRks0kvGjWhCwErSETSCpD7xfx5UneNXc54lxz-6odGlplKqR34G3slhE4Wp1nJXLOiOoD9tbJEvnO1Hk8-eCVYh4 Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.57 Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 8593ec4e937c4d3d834049626c72dbad Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerShowV257Test-493992879 Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8593ec4e937c4d3d834049626c72dbad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8593ec4e937c4d3d834049626c72dbad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8593ec4e937c4d3d834049626c72dbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8593ec4e937c4d3d834049626c72dbad", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerShowV257Test-493992879 Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 8593ec4e937c4d3d834049626c72dbad Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerShowV257Test-493992879 Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerShowV257Test-493992879-project Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: e839ce5d71bc4b0cbaa344d6ee577b00 Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerShowV257Test-493992879-project Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance dde011f1-f516-427a-8dcd-3496b3d7b03f could not be found. Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'dde011f1-f516-427a-8dcd-3496b3d7b03f'} Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde011f1-f516-427a-8dcd-3496b3d7b03f could not be found. Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde011f1-f516-427a-8dcd-3496b3d7b03f could not be found. Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:54:31.017215 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:54:31.023340 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:54:31.023340 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:54:31.023340 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:54:31.023340 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:54:31.023340 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:54:31.023340 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde011f1-f516-427a-8dcd-3496b3d7b03f could not be found. Oct 24 10:54:31.023340 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:54:31.023340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9eabe581-c59d-41c2-be77-b1e3a450ee0f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] Returning 404 to user: Instance dde011f1-f516-427a-8dcd-3496b3d7b03f could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:54:31.023340 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9eabe581-c59d-41c2-be77-b1e3a450ee0f tempest-ServerShowV257Test-493992879 tempest-ServerShowV257Test-493992879-project] 10.222.0.50 "GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f" status: 404 len: 111 microversion: 2.57 time: 0.075036 Oct 24 10:54:31.025140 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2760/5558] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:30 2022] GET /compute/v2.1/servers/dde011f1-f516-427a-8dcd-3496b3d7b03f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:54:31.038781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-45fc9b16-6f0d-47a5-a06d-8c41a32c99ab tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:31.051991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-45fc9b16-6f0d-47a5-a06d-8c41a32c99ab tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:31.063096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-45fc9b16-6f0d-47a5-a06d-8c41a32c99ab tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:31.064524 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-45fc9b16-6f0d-47a5-a06d-8c41a32c99ab tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.284084 Oct 24 10:54:31.065616 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2799/5559] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:30 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:32.098223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b978350a-8f40-4c04-bf08-3df2ebfa5367 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:32.098223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b978350a-8f40-4c04-bf08-3df2ebfa5367 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:32.109490 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b978350a-8f40-4c04-bf08-3df2ebfa5367 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:32.110116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b978350a-8f40-4c04-bf08-3df2ebfa5367 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:32.111045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b978350a-8f40-4c04-bf08-3df2ebfa5367 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:32.111914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b978350a-8f40-4c04-bf08-3df2ebfa5367 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:32.112489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b978350a-8f40-4c04-bf08-3df2ebfa5367 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:32.113027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b978350a-8f40-4c04-bf08-3df2ebfa5367 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:32.149399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:54:32.398532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b978350a-8f40-4c04-bf08-3df2ebfa5367 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:32.411962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b978350a-8f40-4c04-bf08-3df2ebfa5367 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:32.416183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b978350a-8f40-4c04-bf08-3df2ebfa5367 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:32.421737 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b978350a-8f40-4c04-bf08-3df2ebfa5367 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.328522 Oct 24 10:54:32.422363 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2761/5560] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:32 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:33.458038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-96602d72-774d-4780-b9f7-a21da6f07a31 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:33.462428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-96602d72-774d-4780-b9f7-a21da6f07a31 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:33.484888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96602d72-774d-4780-b9f7-a21da6f07a31 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:33.485912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96602d72-774d-4780-b9f7-a21da6f07a31 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:33.487740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96602d72-774d-4780-b9f7-a21da6f07a31 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:33.489909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96602d72-774d-4780-b9f7-a21da6f07a31 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:33.492103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96602d72-774d-4780-b9f7-a21da6f07a31 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:33.493151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96602d72-774d-4780-b9f7-a21da6f07a31 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:33.500760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:54:33.635377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-96602d72-774d-4780-b9f7-a21da6f07a31 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:33.651518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-96602d72-774d-4780-b9f7-a21da6f07a31 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:33.656158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-96602d72-774d-4780-b9f7-a21da6f07a31 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:33.660273 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-96602d72-774d-4780-b9f7-a21da6f07a31 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.208906 Oct 24 10:54:33.661713 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2800/5561] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:33 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:34.419586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-72742f26-2f47-4ae5-bdc7-a4a2babd8228 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:54:34.423982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-72742f26-2f47-4ae5-bdc7-a4a2babd8228 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:34.491328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72742f26-2f47-4ae5-bdc7-a4a2babd8228 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:34.492367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72742f26-2f47-4ae5-bdc7-a4a2babd8228 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:34.494334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72742f26-2f47-4ae5-bdc7-a4a2babd8228 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:34.496359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72742f26-2f47-4ae5-bdc7-a4a2babd8228 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:34.501785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72742f26-2f47-4ae5-bdc7-a4a2babd8228 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:34.503626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72742f26-2f47-4ae5-bdc7-a4a2babd8228 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:34.645277 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-72742f26-2f47-4ae5-bdc7-a4a2babd8228 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff/action" status: 200 len: 24558 microversion: 2.1 time: 0.230778 Oct 24 10:54:34.646918 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2762/5562] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:54:34 2022] POST /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff/action => generated 24558 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:54:34.688329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ee75e02e-4b6e-4b77-b85a-98ef719a4041 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:34.689891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ee75e02e-4b6e-4b77-b85a-98ef719a4041 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:34.704273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee75e02e-4b6e-4b77-b85a-98ef719a4041 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:34.704773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee75e02e-4b6e-4b77-b85a-98ef719a4041 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:34.707192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee75e02e-4b6e-4b77-b85a-98ef719a4041 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:34.709045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee75e02e-4b6e-4b77-b85a-98ef719a4041 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:34.710378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee75e02e-4b6e-4b77-b85a-98ef719a4041 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:34.711875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee75e02e-4b6e-4b77-b85a-98ef719a4041 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:35.070001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ee75e02e-4b6e-4b77-b85a-98ef719a4041 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:35.083860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ee75e02e-4b6e-4b77-b85a-98ef719a4041 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:35.087929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ee75e02e-4b6e-4b77-b85a-98ef719a4041 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:35.090298 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ee75e02e-4b6e-4b77-b85a-98ef719a4041 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.406576 Oct 24 10:54:35.116740 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2801/5563] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:34 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:36.136758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-133f9f74-bade-49f9-83a1-57efcff2d767 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:36.137519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-133f9f74-bade-49f9-83a1-57efcff2d767 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:36.149966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-133f9f74-bade-49f9-83a1-57efcff2d767 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:36.158106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-133f9f74-bade-49f9-83a1-57efcff2d767 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:36.158583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-133f9f74-bade-49f9-83a1-57efcff2d767 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:36.159334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-133f9f74-bade-49f9-83a1-57efcff2d767 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:36.165403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-133f9f74-bade-49f9-83a1-57efcff2d767 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:36.165929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-133f9f74-bade-49f9-83a1-57efcff2d767 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:36.299692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-133f9f74-bade-49f9-83a1-57efcff2d767 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:36.310160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-133f9f74-bade-49f9-83a1-57efcff2d767 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:36.312611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-133f9f74-bade-49f9-83a1-57efcff2d767 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:36.315495 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-133f9f74-bade-49f9-83a1-57efcff2d767 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.189665 Oct 24 10:54:36.316612 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2763/5564] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:36 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:37.347117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b8db3565-e37c-4a67-b02d-a69ed283ba14 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:37.348675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b8db3565-e37c-4a67-b02d-a69ed283ba14 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:37.358463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8db3565-e37c-4a67-b02d-a69ed283ba14 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:37.359231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8db3565-e37c-4a67-b02d-a69ed283ba14 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:37.359923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8db3565-e37c-4a67-b02d-a69ed283ba14 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:37.362861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8db3565-e37c-4a67-b02d-a69ed283ba14 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:37.363621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8db3565-e37c-4a67-b02d-a69ed283ba14 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:37.364726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8db3565-e37c-4a67-b02d-a69ed283ba14 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:37.542431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b8db3565-e37c-4a67-b02d-a69ed283ba14 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:37.610140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b8db3565-e37c-4a67-b02d-a69ed283ba14 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:37.615483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b8db3565-e37c-4a67-b02d-a69ed283ba14 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:37.624060 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b8db3565-e37c-4a67-b02d-a69ed283ba14 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.284263 Oct 24 10:54:37.632297 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2802/5565] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:37 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:38.663798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b3e90df0-912a-4e9b-bfb7-d21579043c96 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:38.665456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b3e90df0-912a-4e9b-bfb7-d21579043c96 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:38.678473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3e90df0-912a-4e9b-bfb7-d21579043c96 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:38.679114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3e90df0-912a-4e9b-bfb7-d21579043c96 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:38.679702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3e90df0-912a-4e9b-bfb7-d21579043c96 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:38.685599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3e90df0-912a-4e9b-bfb7-d21579043c96 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:38.686192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3e90df0-912a-4e9b-bfb7-d21579043c96 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:38.686726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3e90df0-912a-4e9b-bfb7-d21579043c96 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:38.820405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b3e90df0-912a-4e9b-bfb7-d21579043c96 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:38.838289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b3e90df0-912a-4e9b-bfb7-d21579043c96 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:38.845825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b3e90df0-912a-4e9b-bfb7-d21579043c96 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:38.848339 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b3e90df0-912a-4e9b-bfb7-d21579043c96 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.187606 Oct 24 10:54:38.851204 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2764/5566] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:38 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:39.876884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-82337d27-fcaa-4f6c-8c41-1bdfd9ae7d6c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:39.877553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-82337d27-fcaa-4f6c-8c41-1bdfd9ae7d6c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:39.891338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82337d27-fcaa-4f6c-8c41-1bdfd9ae7d6c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:39.892313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82337d27-fcaa-4f6c-8c41-1bdfd9ae7d6c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:39.894329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82337d27-fcaa-4f6c-8c41-1bdfd9ae7d6c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:39.895234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82337d27-fcaa-4f6c-8c41-1bdfd9ae7d6c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:39.899286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82337d27-fcaa-4f6c-8c41-1bdfd9ae7d6c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:39.900427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82337d27-fcaa-4f6c-8c41-1bdfd9ae7d6c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:40.119638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-82337d27-fcaa-4f6c-8c41-1bdfd9ae7d6c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:40.153272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-82337d27-fcaa-4f6c-8c41-1bdfd9ae7d6c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:40.161657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-82337d27-fcaa-4f6c-8c41-1bdfd9ae7d6c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:40.163809 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-82337d27-fcaa-4f6c-8c41-1bdfd9ae7d6c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.292046 Oct 24 10:54:40.164909 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2803/5567] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:39 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:41.195055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c92f6cf2-775b-4d19-b49b-eeb6f658ea45 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:41.195678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c92f6cf2-775b-4d19-b49b-eeb6f658ea45 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:41.202549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c92f6cf2-775b-4d19-b49b-eeb6f658ea45 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:41.203040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c92f6cf2-775b-4d19-b49b-eeb6f658ea45 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:41.203480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c92f6cf2-775b-4d19-b49b-eeb6f658ea45 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:41.204195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c92f6cf2-775b-4d19-b49b-eeb6f658ea45 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:41.204649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c92f6cf2-775b-4d19-b49b-eeb6f658ea45 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:41.205097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c92f6cf2-775b-4d19-b49b-eeb6f658ea45 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:41.359829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c92f6cf2-775b-4d19-b49b-eeb6f658ea45 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:41.369641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c92f6cf2-775b-4d19-b49b-eeb6f658ea45 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:41.371414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c92f6cf2-775b-4d19-b49b-eeb6f658ea45 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:41.373920 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c92f6cf2-775b-4d19-b49b-eeb6f658ea45 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.182708 Oct 24 10:54:41.375132 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2765/5568] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:41 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:42.401469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ddba9d89-96f6-43c8-8cba-66483d988c05 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:42.402197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ddba9d89-96f6-43c8-8cba-66483d988c05 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:42.405324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:54:42.427406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddba9d89-96f6-43c8-8cba-66483d988c05 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:42.427898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddba9d89-96f6-43c8-8cba-66483d988c05 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:42.431699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddba9d89-96f6-43c8-8cba-66483d988c05 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:42.432697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddba9d89-96f6-43c8-8cba-66483d988c05 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:42.437386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddba9d89-96f6-43c8-8cba-66483d988c05 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:42.438081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddba9d89-96f6-43c8-8cba-66483d988c05 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:42.647834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ddba9d89-96f6-43c8-8cba-66483d988c05 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:42.661850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ddba9d89-96f6-43c8-8cba-66483d988c05 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:42.663283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ddba9d89-96f6-43c8-8cba-66483d988c05 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:42.664664 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ddba9d89-96f6-43c8-8cba-66483d988c05 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.267562 Oct 24 10:54:42.666842 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2804/5569] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:42 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:43.698457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0559b1e3-df6e-444f-8733-28f86374a6f1 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:43.699079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0559b1e3-df6e-444f-8733-28f86374a6f1 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:43.702888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=54 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:54:43.720770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0559b1e3-df6e-444f-8733-28f86374a6f1 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:43.721661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0559b1e3-df6e-444f-8733-28f86374a6f1 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:43.722276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0559b1e3-df6e-444f-8733-28f86374a6f1 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:43.723178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0559b1e3-df6e-444f-8733-28f86374a6f1 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:43.724865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0559b1e3-df6e-444f-8733-28f86374a6f1 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:43.726899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0559b1e3-df6e-444f-8733-28f86374a6f1 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:44.039654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0559b1e3-df6e-444f-8733-28f86374a6f1 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:44.058569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0559b1e3-df6e-444f-8733-28f86374a6f1 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:44.060016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0559b1e3-df6e-444f-8733-28f86374a6f1 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:44.062146 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0559b1e3-df6e-444f-8733-28f86374a6f1 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.369166 Oct 24 10:54:44.073415 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2766/5570] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:43 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:45.094649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6fa5b69a-3ee3-4179-a8d3-a8b61fd544cd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:45.096301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6fa5b69a-3ee3-4179-a8d3-a8b61fd544cd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:45.112103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6fa5b69a-3ee3-4179-a8d3-a8b61fd544cd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:45.139197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6fa5b69a-3ee3-4179-a8d3-a8b61fd544cd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:45.141740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6fa5b69a-3ee3-4179-a8d3-a8b61fd544cd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:45.142593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6fa5b69a-3ee3-4179-a8d3-a8b61fd544cd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:45.144250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6fa5b69a-3ee3-4179-a8d3-a8b61fd544cd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:45.144703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6fa5b69a-3ee3-4179-a8d3-a8b61fd544cd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:45.277075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6fa5b69a-3ee3-4179-a8d3-a8b61fd544cd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:45.315344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6fa5b69a-3ee3-4179-a8d3-a8b61fd544cd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:45.319618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6fa5b69a-3ee3-4179-a8d3-a8b61fd544cd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:45.323986 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6fa5b69a-3ee3-4179-a8d3-a8b61fd544cd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.235380 Oct 24 10:54:45.324855 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2805/5571] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:45 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:46.354056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-767e948d-48e5-49bc-8d71-89bc6a84f002 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:46.354722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-767e948d-48e5-49bc-8d71-89bc6a84f002 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:46.372719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-767e948d-48e5-49bc-8d71-89bc6a84f002 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:46.373513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-767e948d-48e5-49bc-8d71-89bc6a84f002 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:46.373965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-767e948d-48e5-49bc-8d71-89bc6a84f002 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:46.383469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-767e948d-48e5-49bc-8d71-89bc6a84f002 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:46.385300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-767e948d-48e5-49bc-8d71-89bc6a84f002 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:46.385765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-767e948d-48e5-49bc-8d71-89bc6a84f002 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:46.616185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-767e948d-48e5-49bc-8d71-89bc6a84f002 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:46.635066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-767e948d-48e5-49bc-8d71-89bc6a84f002 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:46.637177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-767e948d-48e5-49bc-8d71-89bc6a84f002 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:46.639962 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-767e948d-48e5-49bc-8d71-89bc6a84f002 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.289895 Oct 24 10:54:46.642092 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2767/5572] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:46 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:47.668264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-52792105-fb41-4e37-a79d-cb2e0dec5b46 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:47.669602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-52792105-fb41-4e37-a79d-cb2e0dec5b46 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:47.680037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-52792105-fb41-4e37-a79d-cb2e0dec5b46 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:47.683592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-52792105-fb41-4e37-a79d-cb2e0dec5b46 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:47.684297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-52792105-fb41-4e37-a79d-cb2e0dec5b46 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:47.688184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-52792105-fb41-4e37-a79d-cb2e0dec5b46 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:47.690799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-52792105-fb41-4e37-a79d-cb2e0dec5b46 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:47.699489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-52792105-fb41-4e37-a79d-cb2e0dec5b46 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:47.942032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-52792105-fb41-4e37-a79d-cb2e0dec5b46 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:47.968094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-52792105-fb41-4e37-a79d-cb2e0dec5b46 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:47.973774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-52792105-fb41-4e37-a79d-cb2e0dec5b46 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:47.979021 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-52792105-fb41-4e37-a79d-cb2e0dec5b46 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.314717 Oct 24 10:54:47.981195 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2806/5573] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:47 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:48.564186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf4d8839-4ccc-466a-8e02-28cd17c24665 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Action: 'create', calling method: .version_select at 0x7f04d4e950d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1017799945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrE1Vx0M3sWvGrErUoIaebw7D6BtfVhZvXWFNtG8qEc6/O+2XjaYfhfeu7K7Fho0OrTYfBs0GrzQ1umqjmnPCUcpxoUmW1kSrWT/m4y/n5cDgCjCq0UxmKHyFPMNlsi1A=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:54:48.616336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-bf4d8839-4ccc-466a-8e02-28cd17c24665 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Getting quotas for project bebb2c9f56284e0799a51ae7b5744aeb. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:54:48.634386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-bf4d8839-4ccc-466a-8e02-28cd17c24665 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Getting quotas for user 793d2a1323db49f0b92e36bf0a1b7f78 and project bebb2c9f56284e0799a51ae7b5744aeb. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:54:48.689207 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bf4d8839-4ccc-466a-8e02-28cd17c24665 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.129894 Oct 24 10:54:48.689906 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2768/5574] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:54:48 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:54:49.009316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d926da58-5980-44d5-a080-b76556ba13bd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:49.011210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d926da58-5980-44d5-a080-b76556ba13bd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:49.028595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d926da58-5980-44d5-a080-b76556ba13bd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:49.033323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d926da58-5980-44d5-a080-b76556ba13bd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:49.034014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d926da58-5980-44d5-a080-b76556ba13bd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:49.035103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d926da58-5980-44d5-a080-b76556ba13bd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:49.035677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d926da58-5980-44d5-a080-b76556ba13bd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:49.036209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d926da58-5980-44d5-a080-b76556ba13bd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:49.887316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d926da58-5980-44d5-a080-b76556ba13bd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:49.906466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d926da58-5980-44d5-a080-b76556ba13bd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:49.915159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d926da58-5980-44d5-a080-b76556ba13bd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:49.927525 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d926da58-5980-44d5-a080-b76556ba13bd tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.914816 Oct 24 10:54:49.928383 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2807/5575] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:49 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:50.958585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c6c0a9c0-217c-4caa-9624-059193aaf519 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:50.958585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c6c0a9c0-217c-4caa-9624-059193aaf519 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:50.963518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-172698f7-bf68-4f92-947f-4b22909cfa5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-522329204", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "9152321e-93ae-49fc-8653-84045c142d71"}], "key_name": "tempest-TestNetworkBasicOps-1017799945", "security_groups": [{"name": "tempest-secgroup-smoke-1676213080"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:54:50.990253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6c0a9c0-217c-4caa-9624-059193aaf519 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:50.993935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6c0a9c0-217c-4caa-9624-059193aaf519 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:50.994711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6c0a9c0-217c-4caa-9624-059193aaf519 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:50.999248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6c0a9c0-217c-4caa-9624-059193aaf519 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:51.002352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6c0a9c0-217c-4caa-9624-059193aaf519 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:51.002807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6c0a9c0-217c-4caa-9624-059193aaf519 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:51.170904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c6c0a9c0-217c-4caa-9624-059193aaf519 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:51.189497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c6c0a9c0-217c-4caa-9624-059193aaf519 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:51.199128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c6c0a9c0-217c-4caa-9624-059193aaf519 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:51.203699 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c6c0a9c0-217c-4caa-9624-059193aaf519 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.253709 Oct 24 10:54:51.207242 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2769/5576] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:50 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:51.474405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-172698f7-bf68-4f92-947f-4b22909cfa5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] validate_networks() for [('9152321e-93ae-49fc-8653-84045c142d71', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:54:52.253458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6ff5a367-bbf6-4526-b526-9fb44c7d13b8 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:52.255338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6ff5a367-bbf6-4526-b526-9fb44c7d13b8 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:52.275633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ff5a367-bbf6-4526-b526-9fb44c7d13b8 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:52.276132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ff5a367-bbf6-4526-b526-9fb44c7d13b8 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:52.280568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ff5a367-bbf6-4526-b526-9fb44c7d13b8 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:52.285051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ff5a367-bbf6-4526-b526-9fb44c7d13b8 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:52.286711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ff5a367-bbf6-4526-b526-9fb44c7d13b8 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:52.287176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ff5a367-bbf6-4526-b526-9fb44c7d13b8 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:52.458621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ff5a367-bbf6-4526-b526-9fb44c7d13b8 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:52.471061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ff5a367-bbf6-4526-b526-9fb44c7d13b8 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:52.473083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ff5a367-bbf6-4526-b526-9fb44c7d13b8 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:52.474495 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6ff5a367-bbf6-4526-b526-9fb44c7d13b8 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.226808 Oct 24 10:54:52.475597 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2770/5577] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:52 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:52.570290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-172698f7-bf68-4f92-947f-4b22909cfa5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:54:52.570774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-172698f7-bf68-4f92-947f-4b22909cfa5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:54:52.571235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-172698f7-bf68-4f92-947f-4b22909cfa5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:54:52.571697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-172698f7-bf68-4f92-947f-4b22909cfa5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:54:52.572254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-172698f7-bf68-4f92-947f-4b22909cfa5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:54:52.606488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-172698f7-bf68-4f92-947f-4b22909cfa5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:52.608633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-172698f7-bf68-4f92-947f-4b22909cfa5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:52.613055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-172698f7-bf68-4f92-947f-4b22909cfa5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:52.618964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-172698f7-bf68-4f92-947f-4b22909cfa5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:52.619879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-172698f7-bf68-4f92-947f-4b22909cfa5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:52.621133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-172698f7-bf68-4f92-947f-4b22909cfa5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:52.718587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-172698f7-bf68-4f92-947f-4b22909cfa5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Getting quotas for project bebb2c9f56284e0799a51ae7b5744aeb. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:54:52.731865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-172698f7-bf68-4f92-947f-4b22909cfa5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Getting quotas for user 793d2a1323db49f0b92e36bf0a1b7f78 and project bebb2c9f56284e0799a51ae7b5744aeb. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:54:52.777999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-172698f7-bf68-4f92-947f-4b22909cfa5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:54:52.781954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-172698f7-bf68-4f92-947f-4b22909cfa5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:54:52.915019 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-172698f7-bf68-4f92-947f-4b22909cfa5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.955223 Oct 24 10:54:52.917099 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2808/5578] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:54:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 10:54:52.929062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b8894ff8-7bf7-4fed-84ee-97afe2d4dc76 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:52.930037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b8894ff8-7bf7-4fed-84ee-97afe2d4dc76 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:53.301113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b8894ff8-7bf7-4fed-84ee-97afe2d4dc76 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:53.313889 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b8894ff8-7bf7-4fed-84ee-97afe2d4dc76 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1248 microversion: 2.1 time: 0.388763 Oct 24 10:54:53.325020 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2771/5579] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:54:52 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1248 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:54:53.507766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-14c78d3c-34c8-4a28-aa2d-c10d70bb14fe tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:53.508869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-14c78d3c-34c8-4a28-aa2d-c10d70bb14fe tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:53.523248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14c78d3c-34c8-4a28-aa2d-c10d70bb14fe tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:53.524010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14c78d3c-34c8-4a28-aa2d-c10d70bb14fe tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:53.524804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14c78d3c-34c8-4a28-aa2d-c10d70bb14fe tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:53.531296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14c78d3c-34c8-4a28-aa2d-c10d70bb14fe tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:53.546261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14c78d3c-34c8-4a28-aa2d-c10d70bb14fe tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:53.548335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-14c78d3c-34c8-4a28-aa2d-c10d70bb14fe tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:53.706873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-14c78d3c-34c8-4a28-aa2d-c10d70bb14fe tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:53.722742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-14c78d3c-34c8-4a28-aa2d-c10d70bb14fe tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:53.726691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-14c78d3c-34c8-4a28-aa2d-c10d70bb14fe tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:53.731096 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-14c78d3c-34c8-4a28-aa2d-c10d70bb14fe tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.227376 Oct 24 10:54:53.734944 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2809/5580] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:53 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:54.349259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fe06039b-0348-435e-abdb-74f569089d43 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:54.350438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fe06039b-0348-435e-abdb-74f569089d43 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:54.369585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe06039b-0348-435e-abdb-74f569089d43 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:54.371611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe06039b-0348-435e-abdb-74f569089d43 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:54.372246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe06039b-0348-435e-abdb-74f569089d43 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:54.374389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe06039b-0348-435e-abdb-74f569089d43 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:54.377450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe06039b-0348-435e-abdb-74f569089d43 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:54.378127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fe06039b-0348-435e-abdb-74f569089d43 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:54.526037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fe06039b-0348-435e-abdb-74f569089d43 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:54.543517 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fe06039b-0348-435e-abdb-74f569089d43 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1244 microversion: 2.1 time: 0.202989 Oct 24 10:54:54.547082 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2772/5581] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:54:54 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1244 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:54:54.764321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f404cf8f-f912-4d67-a61d-f6ea0e595b4d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:54.765321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f404cf8f-f912-4d67-a61d-f6ea0e595b4d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:54.788155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f404cf8f-f912-4d67-a61d-f6ea0e595b4d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:54.789384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f404cf8f-f912-4d67-a61d-f6ea0e595b4d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:54.791139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f404cf8f-f912-4d67-a61d-f6ea0e595b4d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:54.792729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f404cf8f-f912-4d67-a61d-f6ea0e595b4d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:54.797451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f404cf8f-f912-4d67-a61d-f6ea0e595b4d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:54.799339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f404cf8f-f912-4d67-a61d-f6ea0e595b4d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:55.003725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f404cf8f-f912-4d67-a61d-f6ea0e595b4d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:55.020114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f404cf8f-f912-4d67-a61d-f6ea0e595b4d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:55.022675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f404cf8f-f912-4d67-a61d-f6ea0e595b4d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:55.037343 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f404cf8f-f912-4d67-a61d-f6ea0e595b4d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1365 microversion: 2.47 time: 0.279135 Oct 24 10:54:55.038013 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2810/5582] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:54 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1365 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:55.576172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-635768aa-4c2d-4b41-9eca-1dcc8874dc69 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:55.577290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-635768aa-4c2d-4b41-9eca-1dcc8874dc69 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:55.602899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-635768aa-4c2d-4b41-9eca-1dcc8874dc69 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:55.603405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-635768aa-4c2d-4b41-9eca-1dcc8874dc69 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:55.603849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-635768aa-4c2d-4b41-9eca-1dcc8874dc69 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:55.612538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-635768aa-4c2d-4b41-9eca-1dcc8874dc69 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:55.620734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-635768aa-4c2d-4b41-9eca-1dcc8874dc69 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:55.621481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-635768aa-4c2d-4b41-9eca-1dcc8874dc69 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:55.824487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-635768aa-4c2d-4b41-9eca-1dcc8874dc69 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:55.852462 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-635768aa-4c2d-4b41-9eca-1dcc8874dc69 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1306 microversion: 2.1 time: 0.281865 Oct 24 10:54:55.858376 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2773/5583] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:54:55 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1306 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:54:55.911930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-af0bb28f-b73d-474f-a4d4-535d8eb2789f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-806435553", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "8119afda-1685-41a7-bff3-cff1787ee884"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:54:56.052128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-af0bb28f-b73d-474f-a4d4-535d8eb2789f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] validate_networks() for [('8119afda-1685-41a7-bff3-cff1787ee884', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:54:56.066075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-39a99606-7c87-4cb7-b568-91ae9199e40c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:56.066705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-39a99606-7c87-4cb7-b568-91ae9199e40c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:56.082780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39a99606-7c87-4cb7-b568-91ae9199e40c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:56.083560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39a99606-7c87-4cb7-b568-91ae9199e40c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:56.084319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39a99606-7c87-4cb7-b568-91ae9199e40c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:56.085338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39a99606-7c87-4cb7-b568-91ae9199e40c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:56.085957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39a99606-7c87-4cb7-b568-91ae9199e40c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:56.086550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39a99606-7c87-4cb7-b568-91ae9199e40c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:56.354952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-39a99606-7c87-4cb7-b568-91ae9199e40c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:56.368242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-39a99606-7c87-4cb7-b568-91ae9199e40c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:56.375694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-39a99606-7c87-4cb7-b568-91ae9199e40c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:56.376996 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-39a99606-7c87-4cb7-b568-91ae9199e40c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1383 microversion: 2.47 time: 0.316415 Oct 24 10:54:56.379176 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2774/5584] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:56 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1383 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:54:56.889426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-75c6e408-a884-475e-8f50-96431a4c9001 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:56.892097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-75c6e408-a884-475e-8f50-96431a4c9001 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:56.910720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75c6e408-a884-475e-8f50-96431a4c9001 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:56.911276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75c6e408-a884-475e-8f50-96431a4c9001 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:56.911727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75c6e408-a884-475e-8f50-96431a4c9001 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:56.914220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75c6e408-a884-475e-8f50-96431a4c9001 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:56.914794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75c6e408-a884-475e-8f50-96431a4c9001 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:56.916655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75c6e408-a884-475e-8f50-96431a4c9001 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:57.071276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-75c6e408-a884-475e-8f50-96431a4c9001 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:57.084713 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-75c6e408-a884-475e-8f50-96431a4c9001 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1306 microversion: 2.1 time: 0.203246 Oct 24 10:54:57.085370 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2775/5585] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:54:56 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1306 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:54:57.269093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-af0bb28f-b73d-474f-a4d4-535d8eb2789f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:54:57.269678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-af0bb28f-b73d-474f-a4d4-535d8eb2789f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:54:57.270004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-af0bb28f-b73d-474f-a4d4-535d8eb2789f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:54:57.270498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-af0bb28f-b73d-474f-a4d4-535d8eb2789f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:54:57.270917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-af0bb28f-b73d-474f-a4d4-535d8eb2789f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:54:57.292055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af0bb28f-b73d-474f-a4d4-535d8eb2789f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:57.292866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af0bb28f-b73d-474f-a4d4-535d8eb2789f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:57.293490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af0bb28f-b73d-474f-a4d4-535d8eb2789f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:57.294442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af0bb28f-b73d-474f-a4d4-535d8eb2789f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:57.295290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af0bb28f-b73d-474f-a4d4-535d8eb2789f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:57.295996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af0bb28f-b73d-474f-a4d4-535d8eb2789f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:57.344267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-af0bb28f-b73d-474f-a4d4-535d8eb2789f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Getting quotas for project 07c491130537427ebec96d55ee59ea5c. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:54:57.358972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-af0bb28f-b73d-474f-a4d4-535d8eb2789f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Getting quotas for user afb0b42c2f6a49cb83cf4f617b26fe67 and project 07c491130537427ebec96d55ee59ea5c. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:54:57.396342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-af0bb28f-b73d-474f-a4d4-535d8eb2789f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:54:57.413854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0325ae3a-55c3-47f3-8cd5-cd2fe3b7b5d7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:57.414683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0325ae3a-55c3-47f3-8cd5-cd2fe3b7b5d7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:57.418623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-af0bb28f-b73d-474f-a4d4-535d8eb2789f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:54:57.430932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0325ae3a-55c3-47f3-8cd5-cd2fe3b7b5d7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:57.436308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0325ae3a-55c3-47f3-8cd5-cd2fe3b7b5d7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:57.436989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0325ae3a-55c3-47f3-8cd5-cd2fe3b7b5d7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:57.439313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0325ae3a-55c3-47f3-8cd5-cd2fe3b7b5d7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:57.439989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0325ae3a-55c3-47f3-8cd5-cd2fe3b7b5d7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:57.442062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0325ae3a-55c3-47f3-8cd5-cd2fe3b7b5d7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:57.578597 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-af0bb28f-b73d-474f-a4d4-535d8eb2789f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.895805 Oct 24 10:54:57.586272 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2811/5586] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:54:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:54:57.591598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fc4e1b95-e1e4-4dc8-9d98-53df4d43a4b1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:57.593534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fc4e1b95-e1e4-4dc8-9d98-53df4d43a4b1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:57.708900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0325ae3a-55c3-47f3-8cd5-cd2fe3b7b5d7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:57.730783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0325ae3a-55c3-47f3-8cd5-cd2fe3b7b5d7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:57.732713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0325ae3a-55c3-47f3-8cd5-cd2fe3b7b5d7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:57.745513 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0325ae3a-55c3-47f3-8cd5-cd2fe3b7b5d7 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1371 microversion: 2.47 time: 0.325379 Oct 24 10:54:57.746216 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2776/5587] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:57 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1371 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 10:54:57.748227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fc4e1b95-e1e4-4dc8-9d98-53df4d43a4b1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:57.771469 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fc4e1b95-e1e4-4dc8-9d98-53df4d43a4b1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1227 microversion: 2.1 time: 0.182376 Oct 24 10:54:57.772194 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2812/5588] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:54:57 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1227 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:54:58.112926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a7afd234-2229-4b3a-b8bc-4f9faa8c3269 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:58.113564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a7afd234-2229-4b3a-b8bc-4f9faa8c3269 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:58.148715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7afd234-2229-4b3a-b8bc-4f9faa8c3269 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:58.149494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7afd234-2229-4b3a-b8bc-4f9faa8c3269 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:58.149910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7afd234-2229-4b3a-b8bc-4f9faa8c3269 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:58.150690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7afd234-2229-4b3a-b8bc-4f9faa8c3269 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:58.154949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7afd234-2229-4b3a-b8bc-4f9faa8c3269 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:58.155426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7afd234-2229-4b3a-b8bc-4f9faa8c3269 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:58.776659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3ab789e-e3d8-498f-8201-396c13cdc68c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:58.777303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f3ab789e-e3d8-498f-8201-396c13cdc68c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:58.800672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3ab789e-e3d8-498f-8201-396c13cdc68c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:58.801288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3ab789e-e3d8-498f-8201-396c13cdc68c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:58.801867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3ab789e-e3d8-498f-8201-396c13cdc68c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:58.802494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3ab789e-e3d8-498f-8201-396c13cdc68c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:58.809445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3ab789e-e3d8-498f-8201-396c13cdc68c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:58.812196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3ab789e-e3d8-498f-8201-396c13cdc68c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:59.273960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3ab789e-e3d8-498f-8201-396c13cdc68c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:59.306082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3ab789e-e3d8-498f-8201-396c13cdc68c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:59.307670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3ab789e-e3d8-498f-8201-396c13cdc68c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:59.308915 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f3ab789e-e3d8-498f-8201-396c13cdc68c tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1371 microversion: 2.47 time: 0.536900 Oct 24 10:54:59.316746 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2813/5589] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:54:58 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1371 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:54:59.328798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4cf15194-081f-4d4a-8473-69750f8e4e14 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:54:59.331270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4cf15194-081f-4d4a-8473-69750f8e4e14 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:54:59.342999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4cf15194-081f-4d4a-8473-69750f8e4e14 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:59.343707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4cf15194-081f-4d4a-8473-69750f8e4e14 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:59.344152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4cf15194-081f-4d4a-8473-69750f8e4e14 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:59.346190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4cf15194-081f-4d4a-8473-69750f8e4e14 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:54:59.346317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4cf15194-081f-4d4a-8473-69750f8e4e14 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:54:59.346980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4cf15194-081f-4d4a-8473-69750f8e4e14 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:54:59.701836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a7afd234-2229-4b3a-b8bc-4f9faa8c3269 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:59.713746 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a7afd234-2229-4b3a-b8bc-4f9faa8c3269 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1374 microversion: 2.1 time: 1.607493 Oct 24 10:54:59.714551 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2777/5590] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:54:58 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1374 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:54:59.841094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4cf15194-081f-4d4a-8473-69750f8e4e14 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:54:59.850219 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4cf15194-081f-4d4a-8473-69750f8e4e14 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1279 microversion: 2.1 time: 0.531688 Oct 24 10:54:59.854728 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2814/5591] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:54:59 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1279 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:00.347292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a54ae38a-ce03-4da9-af95-56e869a8b66d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:00.348364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a54ae38a-ce03-4da9-af95-56e869a8b66d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:00.368355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a54ae38a-ce03-4da9-af95-56e869a8b66d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:00.370287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a54ae38a-ce03-4da9-af95-56e869a8b66d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:00.373415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a54ae38a-ce03-4da9-af95-56e869a8b66d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:00.374224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a54ae38a-ce03-4da9-af95-56e869a8b66d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:00.374879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a54ae38a-ce03-4da9-af95-56e869a8b66d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:00.375514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a54ae38a-ce03-4da9-af95-56e869a8b66d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:00.493940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a54ae38a-ce03-4da9-af95-56e869a8b66d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:00.512017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a54ae38a-ce03-4da9-af95-56e869a8b66d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:00.519813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a54ae38a-ce03-4da9-af95-56e869a8b66d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:00.528749 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a54ae38a-ce03-4da9-af95-56e869a8b66d tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1356 microversion: 2.47 time: 0.190356 Oct 24 10:55:00.529722 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2778/5592] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:55:00 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1356 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:55:00.562318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9f46abc3-565f-4fa1-b8c8-b776a9fbbefc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:00.570416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9f46abc3-565f-4fa1-b8c8-b776a9fbbefc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:00.572195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9f46abc3-565f-4fa1-b8c8-b776a9fbbefc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Searching by: {'deleted': False, 'project_id': '91346cf20a1b4adb99998123727f6f35'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 10:55:00.580664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f46abc3-565f-4fa1-b8c8-b776a9fbbefc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:00.586691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f46abc3-565f-4fa1-b8c8-b776a9fbbefc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:00.587537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f46abc3-565f-4fa1-b8c8-b776a9fbbefc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:00.588546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f46abc3-565f-4fa1-b8c8-b776a9fbbefc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:00.589848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f46abc3-565f-4fa1-b8c8-b776a9fbbefc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:00.590597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f46abc3-565f-4fa1-b8c8-b776a9fbbefc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:00.744450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d9f91006-3627-44de-b808-cade59e4ec5b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:00.745183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d9f91006-3627-44de-b808-cade59e4ec5b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:00.757758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9f91006-3627-44de-b808-cade59e4ec5b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:00.759413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9f91006-3627-44de-b808-cade59e4ec5b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:00.761211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9f91006-3627-44de-b808-cade59e4ec5b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:00.765651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9f91006-3627-44de-b808-cade59e4ec5b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:00.766538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9f91006-3627-44de-b808-cade59e4ec5b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:00.767218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9f91006-3627-44de-b808-cade59e4ec5b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:00.832001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-9f46abc3-565f-4fa1-b8c8-b776a9fbbefc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 10:55:01.023245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d9f91006-3627-44de-b808-cade59e4ec5b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:01.029436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9f46abc3-565f-4fa1-b8c8-b776a9fbbefc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:01.035981 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d9f91006-3627-44de-b808-cade59e4ec5b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1374 microversion: 2.1 time: 0.299371 Oct 24 10:55:01.037523 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2779/5593] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:00 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1374 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:55:01.042357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f46abc3-565f-4fa1-b8c8-b776a9fbbefc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:01.043093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f46abc3-565f-4fa1-b8c8-b776a9fbbefc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:01.043746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f46abc3-565f-4fa1-b8c8-b776a9fbbefc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:01.051401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-7f9fa7f8-2c19-44ac-accb-63be31fa35ad req-1e2971bb-4c12-4710-9341-a09042344d30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b597a084-c2a0-44e6-b435-ae8d2b13ed98", "tag": "1df17286-8d5f-4346-9991-3ac4c2ed0949"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:01.057888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9f46abc3-565f-4fa1-b8c8-b776a9fbbefc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:01.062501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9f46abc3-565f-4fa1-b8c8-b776a9fbbefc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:01.077688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7f9fa7f8-2c19-44ac-accb-63be31fa35ad req-1e2971bb-4c12-4710-9341-a09042344d30 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:01.078200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7f9fa7f8-2c19-44ac-accb-63be31fa35ad req-1e2971bb-4c12-4710-9341-a09042344d30 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:01.078650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7f9fa7f8-2c19-44ac-accb-63be31fa35ad req-1e2971bb-4c12-4710-9341-a09042344d30 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:01.093336 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-7f9fa7f8-2c19-44ac-accb-63be31fa35ad req-1e2971bb-4c12-4710-9341-a09042344d30 service nova] Creating event network-changed:1df17286-8d5f-4346-9991-3ac4c2ed0949 for instance b597a084-c2a0-44e6-b435-ae8d2b13ed98 on n-h1-858383-15 Oct 24 10:55:01.104906 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-7f9fa7f8-2c19-44ac-accb-63be31fa35ad req-1e2971bb-4c12-4710-9341-a09042344d30 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064578 Oct 24 10:55:01.105911 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2780/5594] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:55:01.111702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d441c970-efb7-4510-a02d-8b13d99e52a0 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:01.112579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d441c970-efb7-4510-a02d-8b13d99e52a0 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:01.138117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d441c970-efb7-4510-a02d-8b13d99e52a0 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:01.139447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d441c970-efb7-4510-a02d-8b13d99e52a0 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:01.140047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d441c970-efb7-4510-a02d-8b13d99e52a0 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:01.141233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d441c970-efb7-4510-a02d-8b13d99e52a0 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:01.141927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d441c970-efb7-4510-a02d-8b13d99e52a0 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:01.142436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d441c970-efb7-4510-a02d-8b13d99e52a0 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:01.171343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:01.293176 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9f46abc3-565f-4fa1-b8c8-b776a9fbbefc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.736120 Oct 24 10:55:01.301144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d441c970-efb7-4510-a02d-8b13d99e52a0 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:01.304604 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2815/5595] 10.222.0.50 () {60 vars in 1187 bytes} [Mon Oct 24 10:55:00 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:55:01.315677 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d441c970-efb7-4510-a02d-8b13d99e52a0 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1285 microversion: 2.1 time: 0.208366 Oct 24 10:55:01.316344 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2781/5596] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:01 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1285 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:01.347263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1ea4b416-e4b7-4e56-b85c-2cbf8d2f873a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:01.348014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1ea4b416-e4b7-4e56-b85c-2cbf8d2f873a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:01.354646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ea4b416-e4b7-4e56-b85c-2cbf8d2f873a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:01.355369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ea4b416-e4b7-4e56-b85c-2cbf8d2f873a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:01.355985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ea4b416-e4b7-4e56-b85c-2cbf8d2f873a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:01.356890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ea4b416-e4b7-4e56-b85c-2cbf8d2f873a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:01.357591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ea4b416-e4b7-4e56-b85c-2cbf8d2f873a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:01.358190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ea4b416-e4b7-4e56-b85c-2cbf8d2f873a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:01.392243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1ea4b416-e4b7-4e56-b85c-2cbf8d2f873a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:55:01.495539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:01.558094 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1ea4b416-e4b7-4e56-b85c-2cbf8d2f873a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 204 len: 0 microversion: 2.47 time: 0.214914 Oct 24 10:55:01.559181 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2816/5597] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:55:01 2022] DELETE /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 24 10:55:01.568980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d094e761-d2c3-43cc-b155-2de0c03ab4bc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:01.569612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d094e761-d2c3-43cc-b155-2de0c03ab4bc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:01.579801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d094e761-d2c3-43cc-b155-2de0c03ab4bc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:01.580306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d094e761-d2c3-43cc-b155-2de0c03ab4bc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:01.580752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d094e761-d2c3-43cc-b155-2de0c03ab4bc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:01.581504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d094e761-d2c3-43cc-b155-2de0c03ab4bc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:01.581967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d094e761-d2c3-43cc-b155-2de0c03ab4bc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:01.582403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d094e761-d2c3-43cc-b155-2de0c03ab4bc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:01.730890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d094e761-d2c3-43cc-b155-2de0c03ab4bc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:01.740905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d094e761-d2c3-43cc-b155-2de0c03ab4bc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:01.742377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d094e761-d2c3-43cc-b155-2de0c03ab4bc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:01.754205 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d094e761-d2c3-43cc-b155-2de0c03ab4bc tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1362 microversion: 2.47 time: 0.179241 Oct 24 10:55:01.756871 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2782/5598] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:55:01 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:55:02.062180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f1ad883c-6383-4835-8d52-2bbfe95123df tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:02.069878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f1ad883c-6383-4835-8d52-2bbfe95123df tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:02.117892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1ad883c-6383-4835-8d52-2bbfe95123df tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:02.127725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1ad883c-6383-4835-8d52-2bbfe95123df tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:02.128189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1ad883c-6383-4835-8d52-2bbfe95123df tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:02.133891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1ad883c-6383-4835-8d52-2bbfe95123df tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:02.144070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1ad883c-6383-4835-8d52-2bbfe95123df tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:02.145646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1ad883c-6383-4835-8d52-2bbfe95123df tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:02.349489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8e5e7b96-3c4e-4da7-811d-a8beef2c141d tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:02.349727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8e5e7b96-3c4e-4da7-811d-a8beef2c141d tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:02.360889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e5e7b96-3c4e-4da7-811d-a8beef2c141d tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:02.361667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e5e7b96-3c4e-4da7-811d-a8beef2c141d tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:02.362298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e5e7b96-3c4e-4da7-811d-a8beef2c141d tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:02.363992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e5e7b96-3c4e-4da7-811d-a8beef2c141d tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:02.364644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e5e7b96-3c4e-4da7-811d-a8beef2c141d tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:02.365262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e5e7b96-3c4e-4da7-811d-a8beef2c141d tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:02.575413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f1ad883c-6383-4835-8d52-2bbfe95123df tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:02.591488 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f1ad883c-6383-4835-8d52-2bbfe95123df tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1374 microversion: 2.1 time: 0.531926 Oct 24 10:55:02.605285 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2817/5599] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:02 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1374 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:02.724488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8e5e7b96-3c4e-4da7-811d-a8beef2c141d tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:02.736160 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8e5e7b96-3c4e-4da7-811d-a8beef2c141d tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1327 microversion: 2.1 time: 0.389363 Oct 24 10:55:02.738370 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2783/5600] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:02 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1327 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:02.787438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ced481ba-439e-478a-994d-9f4966ea50ec tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:02.793007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ced481ba-439e-478a-994d-9f4966ea50ec tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:02.807746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ced481ba-439e-478a-994d-9f4966ea50ec tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:02.813078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ced481ba-439e-478a-994d-9f4966ea50ec tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:02.813677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ced481ba-439e-478a-994d-9f4966ea50ec tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:02.814580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ced481ba-439e-478a-994d-9f4966ea50ec tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:02.815159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ced481ba-439e-478a-994d-9f4966ea50ec tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:02.815694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ced481ba-439e-478a-994d-9f4966ea50ec tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:02.931743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ced481ba-439e-478a-994d-9f4966ea50ec tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:02.945622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ced481ba-439e-478a-994d-9f4966ea50ec tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:02.947026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ced481ba-439e-478a-994d-9f4966ea50ec tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:02.948356 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ced481ba-439e-478a-994d-9f4966ea50ec tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1362 microversion: 2.47 time: 0.165599 Oct 24 10:55:02.970232 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2818/5601] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:55:02 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:55:03.640520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-449c3b6e-fc57-44b7-ad9e-0413362d9d37 req-8ce3936f-473f-47f0-af3c-da8abffa31ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ff84201-7b81-490b-97de-6e3b651182ef", "tag": "e4c0863d-1711-40fc-9991-9a09e1290817"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:03.641631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-76a342a8-30f7-4b89-8e6f-469d17a47d4c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:03.642747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-76a342a8-30f7-4b89-8e6f-469d17a47d4c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:03.661316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a342a8-30f7-4b89-8e6f-469d17a47d4c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:03.661807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a342a8-30f7-4b89-8e6f-469d17a47d4c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:03.662246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a342a8-30f7-4b89-8e6f-469d17a47d4c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:03.673665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a342a8-30f7-4b89-8e6f-469d17a47d4c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:03.675923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a342a8-30f7-4b89-8e6f-469d17a47d4c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:03.677298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76a342a8-30f7-4b89-8e6f-469d17a47d4c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:03.680726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:03.683680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-449c3b6e-fc57-44b7-ad9e-0413362d9d37 req-8ce3936f-473f-47f0-af3c-da8abffa31ee service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:03.688650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-449c3b6e-fc57-44b7-ad9e-0413362d9d37 req-8ce3936f-473f-47f0-af3c-da8abffa31ee service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:03.689112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-449c3b6e-fc57-44b7-ad9e-0413362d9d37 req-8ce3936f-473f-47f0-af3c-da8abffa31ee service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:03.733316 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-449c3b6e-fc57-44b7-ad9e-0413362d9d37 req-8ce3936f-473f-47f0-af3c-da8abffa31ee service nova] Creating event network-changed:e4c0863d-1711-40fc-9991-9a09e1290817 for instance 3ff84201-7b81-490b-97de-6e3b651182ef on n-h1-858383-15 Oct 24 10:55:03.750919 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-449c3b6e-fc57-44b7-ad9e-0413362d9d37 req-8ce3936f-473f-47f0-af3c-da8abffa31ee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132521 Oct 24 10:55:03.755123 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2784/5602] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:55:03.774244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6eb818b5-cdbb-4b4b-837f-6c353e7a762e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:03.775246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6eb818b5-cdbb-4b4b-837f-6c353e7a762e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:03.789890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6eb818b5-cdbb-4b4b-837f-6c353e7a762e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:03.790680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6eb818b5-cdbb-4b4b-837f-6c353e7a762e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:03.791123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6eb818b5-cdbb-4b4b-837f-6c353e7a762e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:03.797308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6eb818b5-cdbb-4b4b-837f-6c353e7a762e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:03.797903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6eb818b5-cdbb-4b4b-837f-6c353e7a762e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:03.798342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6eb818b5-cdbb-4b4b-837f-6c353e7a762e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:03.998684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-76a342a8-30f7-4b89-8e6f-469d17a47d4c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:04.013301 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-76a342a8-30f7-4b89-8e6f-469d17a47d4c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1374 microversion: 2.1 time: 0.396899 Oct 24 10:55:04.015019 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2819/5603] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:03 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1374 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:04.035107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-49ed76e9-80e8-4ee9-a55b-258762662f25 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:04.036319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-49ed76e9-80e8-4ee9-a55b-258762662f25 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:04.042327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49ed76e9-80e8-4ee9-a55b-258762662f25 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:04.042993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49ed76e9-80e8-4ee9-a55b-258762662f25 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:04.043521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49ed76e9-80e8-4ee9-a55b-258762662f25 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:04.044224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49ed76e9-80e8-4ee9-a55b-258762662f25 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:04.045103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49ed76e9-80e8-4ee9-a55b-258762662f25 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:04.045103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49ed76e9-80e8-4ee9-a55b-258762662f25 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:04.198581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-49ed76e9-80e8-4ee9-a55b-258762662f25 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:04.209936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-49ed76e9-80e8-4ee9-a55b-258762662f25 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:04.211083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-49ed76e9-80e8-4ee9-a55b-258762662f25 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:04.220561 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-49ed76e9-80e8-4ee9-a55b-258762662f25 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 200 len: 1362 microversion: 2.47 time: 0.194428 Oct 24 10:55:04.246112 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2820/5604] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:55:04 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:55:04.273576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6eb818b5-cdbb-4b4b-837f-6c353e7a762e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:04.282496 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6eb818b5-cdbb-4b4b-837f-6c353e7a762e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1327 microversion: 2.1 time: 0.522059 Oct 24 10:55:04.283089 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2785/5605] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:03 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1327 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:05.051054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f4c4c9c8-6aaa-4a29-952f-5b910bbba07a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:05.052435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f4c4c9c8-6aaa-4a29-952f-5b910bbba07a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:05.081301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4c4c9c8-6aaa-4a29-952f-5b910bbba07a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:05.082375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4c4c9c8-6aaa-4a29-952f-5b910bbba07a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:05.083052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4c4c9c8-6aaa-4a29-952f-5b910bbba07a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:05.084318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4c4c9c8-6aaa-4a29-952f-5b910bbba07a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:05.085046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4c4c9c8-6aaa-4a29-952f-5b910bbba07a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:05.085708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f4c4c9c8-6aaa-4a29-952f-5b910bbba07a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:05.266641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ccd56578-0ea7-4e93-bcf0-dd4ce6f050e3 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:05.269225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ccd56578-0ea7-4e93-bcf0-dd4ce6f050e3 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: bdb68879-993a-4c25-8048-9cd0062b9368] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:05.301870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccd56578-0ea7-4e93-bcf0-dd4ce6f050e3 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:05.302787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccd56578-0ea7-4e93-bcf0-dd4ce6f050e3 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:05.305006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccd56578-0ea7-4e93-bcf0-dd4ce6f050e3 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:05.306644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccd56578-0ea7-4e93-bcf0-dd4ce6f050e3 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:05.308069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccd56578-0ea7-4e93-bcf0-dd4ce6f050e3 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:05.309715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccd56578-0ea7-4e93-bcf0-dd4ce6f050e3 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:05.364750 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-ccd56578-0ea7-4e93-bcf0-dd4ce6f050e3 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] HTTP exception thrown: Instance bdb68879-993a-4c25-8048-9cd0062b9368 could not be found. Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ccd56578-0ea7-4e93-bcf0-dd4ce6f050e3 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Request method failure captured: Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 HTTP/1.1 Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm7Y_1nBE4RlJcNlaWRLPCxj9sXlxUq5g_PAT9rS1H3CBdkbVtOfvVleUIa9S5ETHvFvd59YZIyrJzrKrU6Iijc2XLBE89Uqx_aYz7h7LX-RMn_u4hNYhSrGb8i34sp440VeQ7ZKrTz-RQDpgDeaJlQWg1sLDmycaAjiJ3yc7-jYG-c Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-Openstack-Nova-Api-Version: 2.47 Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 91346cf20a1b4adb99998123727f6f35 Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerShowV247Test-1922624339 Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/91346cf20a1b4adb99998123727f6f35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/91346cf20a1b4adb99998123727f6f35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/91346cf20a1b4adb99998123727f6f35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_91346cf20a1b4adb99998123727f6f35", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerShowV247Test-1922624339 Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 91346cf20a1b4adb99998123727f6f35 Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerShowV247Test-1922624339 Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerShowV247Test-1922624339-project Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: d8b1565949914a6baf69bba2f4d6dd0c Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerShowV247Test-1922624339-project Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance bdb68879-993a-4c25-8048-9cd0062b9368 could not be found. Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'bdb68879-993a-4c25-8048-9cd0062b9368'} Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdb68879-993a-4c25-8048-9cd0062b9368 could not be found. Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdb68879-993a-4c25-8048-9cd0062b9368 could not be found. Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:55:05.366941 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:55:05.372173 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:55:05.372173 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:55:05.372173 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:55:05.372173 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:55:05.372173 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:55:05.372173 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdb68879-993a-4c25-8048-9cd0062b9368 could not be found. Oct 24 10:55:05.372173 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:55:05.385762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ccd56578-0ea7-4e93-bcf0-dd4ce6f050e3 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Returning 404 to user: Instance bdb68879-993a-4c25-8048-9cd0062b9368 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:55:05.386850 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ccd56578-0ea7-4e93-bcf0-dd4ce6f050e3 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368" status: 404 len: 111 microversion: 2.47 time: 0.128236 Oct 24 10:55:05.392064 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2786/5606] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:55:05 2022] GET /compute/v2.1/servers/bdb68879-993a-4c25-8048-9cd0062b9368 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 24 10:55:05.397641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-576369d9-08b9-4768-a411-05160bee6c86 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:05.398841 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-576369d9-08b9-4768-a411-05160bee6c86 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:05.409541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-576369d9-08b9-4768-a411-05160bee6c86 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:05.416661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-576369d9-08b9-4768-a411-05160bee6c86 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:05.417611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-576369d9-08b9-4768-a411-05160bee6c86 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:05.418624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-576369d9-08b9-4768-a411-05160bee6c86 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:05.419349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-576369d9-08b9-4768-a411-05160bee6c86 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:05.420231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-576369d9-08b9-4768-a411-05160bee6c86 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:05.447478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f4c4c9c8-6aaa-4a29-952f-5b910bbba07a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:05.460032 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f4c4c9c8-6aaa-4a29-952f-5b910bbba07a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1374 microversion: 2.1 time: 0.419760 Oct 24 10:55:05.462914 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2821/5607] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:05 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1374 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:05.469718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aa8cf624-ea4a-40fc-903a-1d2b20946876 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:05.472688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aa8cf624-ea4a-40fc-903a-1d2b20946876 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: 6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:05.499260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa8cf624-ea4a-40fc-903a-1d2b20946876 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:05.500779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa8cf624-ea4a-40fc-903a-1d2b20946876 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:05.501255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa8cf624-ea4a-40fc-903a-1d2b20946876 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:05.501995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa8cf624-ea4a-40fc-903a-1d2b20946876 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:05.502469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa8cf624-ea4a-40fc-903a-1d2b20946876 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:05.502884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa8cf624-ea4a-40fc-903a-1d2b20946876 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:05.585477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aa8cf624-ea4a-40fc-903a-1d2b20946876 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: 6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:55:05.791889 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aa8cf624-ea4a-40fc-903a-1d2b20946876 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e" status: 204 len: 0 microversion: 2.47 time: 0.326214 Oct 24 10:55:05.792535 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2822/5608] 10.222.0.50 () {60 vars in 1280 bytes} [Mon Oct 24 10:55:05 2022] DELETE /compute/v2.1/servers/6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 10:55:05.814215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-94669fa1-1347-410c-9402-d7be892ad300 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:05.814951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-94669fa1-1347-410c-9402-d7be892ad300 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: 6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:05.842392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94669fa1-1347-410c-9402-d7be892ad300 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:05.843091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94669fa1-1347-410c-9402-d7be892ad300 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:05.843547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94669fa1-1347-410c-9402-d7be892ad300 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:05.844440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94669fa1-1347-410c-9402-d7be892ad300 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:05.844920 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94669fa1-1347-410c-9402-d7be892ad300 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:05.845528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94669fa1-1347-410c-9402-d7be892ad300 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:06.187081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94669fa1-1347-410c-9402-d7be892ad300 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:06.204593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94669fa1-1347-410c-9402-d7be892ad300 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:06.211041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94669fa1-1347-410c-9402-d7be892ad300 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:06.213074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-576369d9-08b9-4768-a411-05160bee6c86 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:06.213334 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-94669fa1-1347-410c-9402-d7be892ad300 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e" status: 200 len: 1362 microversion: 2.47 time: 0.413608 Oct 24 10:55:06.237115 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2823/5609] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:55:05 2022] GET /compute/v2.1/servers/6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e => generated 1362 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:55:06.237573 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-576369d9-08b9-4768-a411-05160bee6c86 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1327 microversion: 2.1 time: 0.829282 Oct 24 10:55:06.237573 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2787/5610] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:05 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1327 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:06.500561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e77e5d87-757f-4f68-8533-6f4c79f86120 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:06.506172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e77e5d87-757f-4f68-8533-6f4c79f86120 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:06.527604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e77e5d87-757f-4f68-8533-6f4c79f86120 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:06.533195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e77e5d87-757f-4f68-8533-6f4c79f86120 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:06.533889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e77e5d87-757f-4f68-8533-6f4c79f86120 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:06.539642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e77e5d87-757f-4f68-8533-6f4c79f86120 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:06.540452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e77e5d87-757f-4f68-8533-6f4c79f86120 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:06.541181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e77e5d87-757f-4f68-8533-6f4c79f86120 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:07.179491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e77e5d87-757f-4f68-8533-6f4c79f86120 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:07.190256 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e77e5d87-757f-4f68-8533-6f4c79f86120 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1374 microversion: 2.1 time: 0.705678 Oct 24 10:55:07.201413 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2824/5611] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:06 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1374 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:07.291375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-75fbacd7-1ad1-4c93-a79f-44717504e705 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:07.299745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1601afd1-6991-47a9-9ee9-610c24e188fb tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:07.301903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1601afd1-6991-47a9-9ee9-610c24e188fb tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: 6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:07.303914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-75fbacd7-1ad1-4c93-a79f-44717504e705 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:07.319294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75fbacd7-1ad1-4c93-a79f-44717504e705 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:07.319789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75fbacd7-1ad1-4c93-a79f-44717504e705 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:07.320793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75fbacd7-1ad1-4c93-a79f-44717504e705 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:07.321542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75fbacd7-1ad1-4c93-a79f-44717504e705 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:07.322991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1601afd1-6991-47a9-9ee9-610c24e188fb tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:07.323647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1601afd1-6991-47a9-9ee9-610c24e188fb tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:07.325106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1601afd1-6991-47a9-9ee9-610c24e188fb tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:07.327215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75fbacd7-1ad1-4c93-a79f-44717504e705 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:07.327608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1601afd1-6991-47a9-9ee9-610c24e188fb tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:07.328608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75fbacd7-1ad1-4c93-a79f-44717504e705 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:07.329503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1601afd1-6991-47a9-9ee9-610c24e188fb tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:07.330148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1601afd1-6991-47a9-9ee9-610c24e188fb tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:07.514991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1601afd1-6991-47a9-9ee9-610c24e188fb tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:07.530752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1601afd1-6991-47a9-9ee9-610c24e188fb tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:07.532933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1601afd1-6991-47a9-9ee9-610c24e188fb tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:07.538282 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1601afd1-6991-47a9-9ee9-610c24e188fb tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e" status: 200 len: 1362 microversion: 2.47 time: 0.262837 Oct 24 10:55:07.557489 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2825/5612] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:55:07 2022] GET /compute/v2.1/servers/6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:55:07.679420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-75fbacd7-1ad1-4c93-a79f-44717504e705 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:07.690499 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-75fbacd7-1ad1-4c93-a79f-44717504e705 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1327 microversion: 2.1 time: 0.424057 Oct 24 10:55:07.691484 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2788/5613] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:07 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1327 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:08.220548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a539df22-eba4-4131-aa77-567cd3d95821 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:08.226485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a539df22-eba4-4131-aa77-567cd3d95821 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:08.245629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a539df22-eba4-4131-aa77-567cd3d95821 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:08.247516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a539df22-eba4-4131-aa77-567cd3d95821 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:08.249364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a539df22-eba4-4131-aa77-567cd3d95821 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:08.251337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a539df22-eba4-4131-aa77-567cd3d95821 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:08.254718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a539df22-eba4-4131-aa77-567cd3d95821 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:08.255547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a539df22-eba4-4131-aa77-567cd3d95821 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:08.536116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a539df22-eba4-4131-aa77-567cd3d95821 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:08.552713 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a539df22-eba4-4131-aa77-567cd3d95821 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1374 microversion: 2.1 time: 0.340275 Oct 24 10:55:08.553818 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2826/5614] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:08 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1374 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:08.577201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c73a8b2-2257-4f87-8a27-b76ac0b27793 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:08.577853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4c73a8b2-2257-4f87-8a27-b76ac0b27793 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: 6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:08.585178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c73a8b2-2257-4f87-8a27-b76ac0b27793 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:08.587409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c73a8b2-2257-4f87-8a27-b76ac0b27793 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:08.588138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c73a8b2-2257-4f87-8a27-b76ac0b27793 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:08.589058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c73a8b2-2257-4f87-8a27-b76ac0b27793 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:08.589681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c73a8b2-2257-4f87-8a27-b76ac0b27793 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:08.590258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c73a8b2-2257-4f87-8a27-b76ac0b27793 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:08.634463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c73a8b2-2257-4f87-8a27-b76ac0b27793 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:08.635256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c73a8b2-2257-4f87-8a27-b76ac0b27793 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:08.635734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c73a8b2-2257-4f87-8a27-b76ac0b27793 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:08.636190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-4c73a8b2-2257-4f87-8a27-b76ac0b27793 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lazy-loading 'fault' on Instance uuid 6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:55:08.702023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c73a8b2-2257-4f87-8a27-b76ac0b27793 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:08.713088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c73a8b2-2257-4f87-8a27-b76ac0b27793 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:08.713659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4e2b6675-2f2b-4ce1-a243-9c8b0aa5af4f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:08.714489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4e2b6675-2f2b-4ce1-a243-9c8b0aa5af4f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:08.715240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c73a8b2-2257-4f87-8a27-b76ac0b27793 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd8b1565949914a6baf69bba2f4d6dd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91346cf20a1b4adb99998123727f6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:08.717578 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4c73a8b2-2257-4f87-8a27-b76ac0b27793 tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e" status: 200 len: 1367 microversion: 2.47 time: 0.145520 Oct 24 10:55:08.719457 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2789/5615] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:55:08 2022] GET /compute/v2.1/servers/6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 10:55:08.726889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e2b6675-2f2b-4ce1-a243-9c8b0aa5af4f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:08.728571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e2b6675-2f2b-4ce1-a243-9c8b0aa5af4f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:08.729568 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e2b6675-2f2b-4ce1-a243-9c8b0aa5af4f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:08.741837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e2b6675-2f2b-4ce1-a243-9c8b0aa5af4f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:08.743308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e2b6675-2f2b-4ce1-a243-9c8b0aa5af4f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:08.744809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e2b6675-2f2b-4ce1-a243-9c8b0aa5af4f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:09.074809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4e2b6675-2f2b-4ce1-a243-9c8b0aa5af4f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:09.086743 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4e2b6675-2f2b-4ce1-a243-9c8b0aa5af4f tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1327 microversion: 2.1 time: 0.376845 Oct 24 10:55:09.089808 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2827/5616] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:08 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1327 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:55:09.582977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5806a39-7cec-49e3-a80e-dc07eca32e92 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:09.583860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d5806a39-7cec-49e3-a80e-dc07eca32e92 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:09.596090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5806a39-7cec-49e3-a80e-dc07eca32e92 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:09.596920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5806a39-7cec-49e3-a80e-dc07eca32e92 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:09.601394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5806a39-7cec-49e3-a80e-dc07eca32e92 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:09.602477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5806a39-7cec-49e3-a80e-dc07eca32e92 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:09.603199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5806a39-7cec-49e3-a80e-dc07eca32e92 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:09.603853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5806a39-7cec-49e3-a80e-dc07eca32e92 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:09.755426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-996ba6f7-bb3f-43f5-ab2d-199d0f094d3a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:09.756714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-996ba6f7-bb3f-43f5-ab2d-199d0f094d3a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] [instance: 6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:09.777816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-996ba6f7-bb3f-43f5-ab2d-199d0f094d3a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:09.778352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-996ba6f7-bb3f-43f5-ab2d-199d0f094d3a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:09.778767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-996ba6f7-bb3f-43f5-ab2d-199d0f094d3a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:09.780351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-996ba6f7-bb3f-43f5-ab2d-199d0f094d3a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:09.781075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-996ba6f7-bb3f-43f5-ab2d-199d0f094d3a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:09.785416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-996ba6f7-bb3f-43f5-ab2d-199d0f094d3a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:09.848088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d5806a39-7cec-49e3-a80e-dc07eca32e92 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:09.848303 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-996ba6f7-bb3f-43f5-ab2d-199d0f094d3a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] HTTP exception thrown: Instance 6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e could not be found. Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-996ba6f7-bb3f-43f5-ab2d-199d0f094d3a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Request method failure captured: Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e HTTP/1.1 Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm7Y_1nBE4RlJcNlaWRLPCxj9sXlxUq5g_PAT9rS1H3CBdkbVtOfvVleUIa9S5ETHvFvd59YZIyrJzrKrU6Iijc2XLBE89Uqx_aYz7h7LX-RMn_u4hNYhSrGb8i34sp440VeQ7ZKrTz-RQDpgDeaJlQWg1sLDmycaAjiJ3yc7-jYG-c Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-Openstack-Nova-Api-Version: 2.47 Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 91346cf20a1b4adb99998123727f6f35 Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerShowV247Test-1922624339 Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/91346cf20a1b4adb99998123727f6f35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/91346cf20a1b4adb99998123727f6f35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/91346cf20a1b4adb99998123727f6f35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_91346cf20a1b4adb99998123727f6f35", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerShowV247Test-1922624339 Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 91346cf20a1b4adb99998123727f6f35 Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerShowV247Test-1922624339 Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerShowV247Test-1922624339-project Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: d8b1565949914a6baf69bba2f4d6dd0c Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerShowV247Test-1922624339-project Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e could not be found. Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e'} Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e could not be found. Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e could not be found. Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:55:09.849817 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:55:09.854352 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:55:09.854352 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:55:09.854352 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:55:09.854352 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:55:09.854352 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:55:09.854352 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e could not be found. Oct 24 10:55:09.854352 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:55:09.854352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-996ba6f7-bb3f-43f5-ab2d-199d0f094d3a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] Returning 404 to user: Instance 6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:55:09.854352 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-996ba6f7-bb3f-43f5-ab2d-199d0f094d3a tempest-ServerShowV247Test-1922624339 tempest-ServerShowV247Test-1922624339-project] 10.222.0.50 "GET /compute/v2.1/servers/6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e" status: 404 len: 111 microversion: 2.47 time: 0.100325 Oct 24 10:55:09.862945 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d5806a39-7cec-49e3-a80e-dc07eca32e92 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1374 microversion: 2.1 time: 0.288815 Oct 24 10:55:09.864803 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2790/5617] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:09 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1374 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:09.881408 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2828/5618] 10.222.0.50 () {60 vars in 1277 bytes} [Mon Oct 24 10:55:09 2022] GET /compute/v2.1/servers/6a3f6c98-04c9-4c67-b82f-cfdf8cffef9e => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:55:10.116212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5e2dbb19-4279-40de-8ad7-e1f62f76da1e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:10.134118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-65d868a6-dc6b-4228-84da-05ed7e5fd107 req-b111fe3c-5b4e-4c25-8ea5-444c2fe8b68b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b597a084-c2a0-44e6-b435-ae8d2b13ed98", "name": "network-vif-plugged", "status": "completed", "tag": "1df17286-8d5f-4346-9991-3ac4c2ed0949"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:10.138582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5e2dbb19-4279-40de-8ad7-e1f62f76da1e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:10.151137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e2dbb19-4279-40de-8ad7-e1f62f76da1e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:10.154414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e2dbb19-4279-40de-8ad7-e1f62f76da1e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:10.155267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-65d868a6-dc6b-4228-84da-05ed7e5fd107 req-b111fe3c-5b4e-4c25-8ea5-444c2fe8b68b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:10.155579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-65d868a6-dc6b-4228-84da-05ed7e5fd107 req-b111fe3c-5b4e-4c25-8ea5-444c2fe8b68b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:10.156064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-65d868a6-dc6b-4228-84da-05ed7e5fd107 req-b111fe3c-5b4e-4c25-8ea5-444c2fe8b68b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:10.156537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e2dbb19-4279-40de-8ad7-e1f62f76da1e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:10.158201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e2dbb19-4279-40de-8ad7-e1f62f76da1e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:10.158821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e2dbb19-4279-40de-8ad7-e1f62f76da1e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:10.161331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e2dbb19-4279-40de-8ad7-e1f62f76da1e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:10.167973 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-65d868a6-dc6b-4228-84da-05ed7e5fd107 req-b111fe3c-5b4e-4c25-8ea5-444c2fe8b68b service nova] Creating event network-vif-plugged:1df17286-8d5f-4346-9991-3ac4c2ed0949 for instance b597a084-c2a0-44e6-b435-ae8d2b13ed98 on n-h1-858383-15 Oct 24 10:55:10.174599 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-65d868a6-dc6b-4228-84da-05ed7e5fd107 req-b111fe3c-5b4e-4c25-8ea5-444c2fe8b68b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228082 Oct 24 10:55:10.180742 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2791/5619] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:55:10.416318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5e2dbb19-4279-40de-8ad7-e1f62f76da1e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:10.425133 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5e2dbb19-4279-40de-8ad7-e1f62f76da1e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1327 microversion: 2.1 time: 0.313003 Oct 24 10:55:10.445676 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2829/5620] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:10 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1327 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:55:10.889843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8cfff82c-e802-42d1-b3c9-27619cdd2505 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:10.890780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8cfff82c-e802-42d1-b3c9-27619cdd2505 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:10.906614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cfff82c-e802-42d1-b3c9-27619cdd2505 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:10.907387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cfff82c-e802-42d1-b3c9-27619cdd2505 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:10.907966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cfff82c-e802-42d1-b3c9-27619cdd2505 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:10.909474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cfff82c-e802-42d1-b3c9-27619cdd2505 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:10.910012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cfff82c-e802-42d1-b3c9-27619cdd2505 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:10.910450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8cfff82c-e802-42d1-b3c9-27619cdd2505 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:11.111797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8cfff82c-e802-42d1-b3c9-27619cdd2505 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:11.129526 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8cfff82c-e802-42d1-b3c9-27619cdd2505 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1374 microversion: 2.1 time: 0.245525 Oct 24 10:55:11.157001 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2792/5621] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:10 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1374 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:11.453524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-04921493-37a7-4d37-9f43-23b9d7837062 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:11.454350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-04921493-37a7-4d37-9f43-23b9d7837062 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:11.456502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:11.460331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=16 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:11.476143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04921493-37a7-4d37-9f43-23b9d7837062 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:11.476957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04921493-37a7-4d37-9f43-23b9d7837062 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:11.479527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04921493-37a7-4d37-9f43-23b9d7837062 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:11.480328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04921493-37a7-4d37-9f43-23b9d7837062 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:11.481171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04921493-37a7-4d37-9f43-23b9d7837062 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:11.484049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04921493-37a7-4d37-9f43-23b9d7837062 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:12.077707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-04921493-37a7-4d37-9f43-23b9d7837062 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:12.092276 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-04921493-37a7-4d37-9f43-23b9d7837062 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1327 microversion: 2.1 time: 0.638821 Oct 24 10:55:12.093869 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2830/5622] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:11 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1327 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:12.157069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-345877a4-3662-4dd1-9989-e2d93baac774 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:12.157622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-345877a4-3662-4dd1-9989-e2d93baac774 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:12.174842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-345877a4-3662-4dd1-9989-e2d93baac774 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:12.177196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-345877a4-3662-4dd1-9989-e2d93baac774 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:12.180790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-345877a4-3662-4dd1-9989-e2d93baac774 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:12.182227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-345877a4-3662-4dd1-9989-e2d93baac774 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:12.182916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-345877a4-3662-4dd1-9989-e2d93baac774 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:12.183524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-345877a4-3662-4dd1-9989-e2d93baac774 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:12.379042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-345877a4-3662-4dd1-9989-e2d93baac774 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:12.395715 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-345877a4-3662-4dd1-9989-e2d93baac774 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1374 microversion: 2.1 time: 0.240205 Oct 24 10:55:12.400202 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2793/5623] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:12 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1374 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:13.121170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6b3a8d67-4a97-43e8-a594-0ba2618c2275 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:13.122319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6b3a8d67-4a97-43e8-a594-0ba2618c2275 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:13.131503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:13.159888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b3a8d67-4a97-43e8-a594-0ba2618c2275 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:13.160887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b3a8d67-4a97-43e8-a594-0ba2618c2275 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:13.161578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b3a8d67-4a97-43e8-a594-0ba2618c2275 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:13.166572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b3a8d67-4a97-43e8-a594-0ba2618c2275 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:13.176148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b3a8d67-4a97-43e8-a594-0ba2618c2275 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:13.177266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b3a8d67-4a97-43e8-a594-0ba2618c2275 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:13.427445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6a95caef-e763-4f21-95d0-70958e14f36e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:13.428672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6a95caef-e763-4f21-95d0-70958e14f36e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:13.450781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a95caef-e763-4f21-95d0-70958e14f36e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:13.452422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a95caef-e763-4f21-95d0-70958e14f36e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:13.456179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6b3a8d67-4a97-43e8-a594-0ba2618c2275 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:13.463854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a95caef-e763-4f21-95d0-70958e14f36e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:13.464654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a95caef-e763-4f21-95d0-70958e14f36e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:13.471020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a95caef-e763-4f21-95d0-70958e14f36e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:13.472216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a95caef-e763-4f21-95d0-70958e14f36e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:13.474102 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6b3a8d67-4a97-43e8-a594-0ba2618c2275 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1327 microversion: 2.1 time: 0.358920 Oct 24 10:55:13.475079 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2831/5624] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:13 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1327 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:13.743466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6a95caef-e763-4f21-95d0-70958e14f36e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:13.751985 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6a95caef-e763-4f21-95d0-70958e14f36e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1546 microversion: 2.1 time: 0.330121 Oct 24 10:55:13.765654 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2794/5625] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:13 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1546 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:13.776885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4ac06178-7132-4cba-ace7-3b76001115c4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:13.777711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4ac06178-7132-4cba-ace7-3b76001115c4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:13.799553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:13.801228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ac06178-7132-4cba-ace7-3b76001115c4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:13.801904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ac06178-7132-4cba-ace7-3b76001115c4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:13.802504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ac06178-7132-4cba-ace7-3b76001115c4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:13.803385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ac06178-7132-4cba-ace7-3b76001115c4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:13.804021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ac06178-7132-4cba-ace7-3b76001115c4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:13.804614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4ac06178-7132-4cba-ace7-3b76001115c4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:13.968428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1496fee2-5b4b-4c1a-828f-385e58822d02 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:13.969193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1496fee2-5b4b-4c1a-828f-385e58822d02 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:13.979659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1496fee2-5b4b-4c1a-828f-385e58822d02 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:13.980225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1496fee2-5b4b-4c1a-828f-385e58822d02 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:13.981281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1496fee2-5b4b-4c1a-828f-385e58822d02 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:13.983455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1496fee2-5b4b-4c1a-828f-385e58822d02 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:13.984104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1496fee2-5b4b-4c1a-828f-385e58822d02 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:13.986283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1496fee2-5b4b-4c1a-828f-385e58822d02 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:14.021761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:14.032203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4ac06178-7132-4cba-ace7-3b76001115c4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:14.055814 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4ac06178-7132-4cba-ace7-3b76001115c4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1546 microversion: 2.1 time: 0.282927 Oct 24 10:55:14.061707 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2795/5626] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:13 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1546 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:14.286049 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1496fee2-5b4b-4c1a-828f-385e58822d02 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1836 microversion: 2.1 time: 0.657255 Oct 24 10:55:14.287712 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2832/5627] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:13 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1836 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:55:14.314900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-35d38eef-5050-4447-93ff-db86f7c89757 req-8545650f-c596-41e8-8f4d-afab9c695063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff84201-7b81-490b-97de-6e3b651182ef", "name": "network-vif-plugged", "status": "completed", "tag": "e4c0863d-1711-40fc-9991-9a09e1290817"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:14.337343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-35d38eef-5050-4447-93ff-db86f7c89757 req-8545650f-c596-41e8-8f4d-afab9c695063 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:14.339382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-35d38eef-5050-4447-93ff-db86f7c89757 req-8545650f-c596-41e8-8f4d-afab9c695063 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:14.340706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-35d38eef-5050-4447-93ff-db86f7c89757 req-8545650f-c596-41e8-8f4d-afab9c695063 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:14.368375 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-35d38eef-5050-4447-93ff-db86f7c89757 req-8545650f-c596-41e8-8f4d-afab9c695063 service nova] Creating event network-vif-plugged:e4c0863d-1711-40fc-9991-9a09e1290817 for instance 3ff84201-7b81-490b-97de-6e3b651182ef on n-h1-858383-15 Oct 24 10:55:14.382076 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-35d38eef-5050-4447-93ff-db86f7c89757 req-8545650f-c596-41e8-8f4d-afab9c695063 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079410 Oct 24 10:55:14.387586 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2796/5628] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:55:14.502937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-34ca7274-0799-4605-a85b-45dcf2dee55e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:14.505073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-34ca7274-0799-4605-a85b-45dcf2dee55e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:14.521464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34ca7274-0799-4605-a85b-45dcf2dee55e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:14.522448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34ca7274-0799-4605-a85b-45dcf2dee55e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:14.523190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34ca7274-0799-4605-a85b-45dcf2dee55e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:14.528312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34ca7274-0799-4605-a85b-45dcf2dee55e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:14.529877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34ca7274-0799-4605-a85b-45dcf2dee55e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:14.530581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34ca7274-0799-4605-a85b-45dcf2dee55e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:14.543365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e0c3517-7f00-40fb-aef8-5d15d4262a16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:14.544443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1e0c3517-7f00-40fb-aef8-5d15d4262a16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:14.558750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e0c3517-7f00-40fb-aef8-5d15d4262a16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:14.566939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e0c3517-7f00-40fb-aef8-5d15d4262a16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:14.567409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e0c3517-7f00-40fb-aef8-5d15d4262a16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:14.568177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e0c3517-7f00-40fb-aef8-5d15d4262a16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:14.568643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e0c3517-7f00-40fb-aef8-5d15d4262a16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:14.572507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e0c3517-7f00-40fb-aef8-5d15d4262a16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:14.861383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-34ca7274-0799-4605-a85b-45dcf2dee55e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:14.895638 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-34ca7274-0799-4605-a85b-45dcf2dee55e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1327 microversion: 2.1 time: 0.399549 Oct 24 10:55:14.897957 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2797/5629] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:14 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1327 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:55:14.965627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1e0c3517-7f00-40fb-aef8-5d15d4262a16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:14.980108 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1e0c3517-7f00-40fb-aef8-5d15d4262a16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1683 microversion: 2.1 time: 0.670303 Oct 24 10:55:14.981191 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2833/5630] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:14 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1683 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:15.181610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-820df86e-6366-4663-94fa-774ea756befb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:15.184877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-820df86e-6366-4663-94fa-774ea756befb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:15.196488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-820df86e-6366-4663-94fa-774ea756befb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:15.198741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-820df86e-6366-4663-94fa-774ea756befb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:15.201286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-820df86e-6366-4663-94fa-774ea756befb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:15.204112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-820df86e-6366-4663-94fa-774ea756befb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:15.204946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-820df86e-6366-4663-94fa-774ea756befb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:15.207255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-820df86e-6366-4663-94fa-774ea756befb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:15.835282 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-820df86e-6366-4663-94fa-774ea756befb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff/action" status: 200 len: 32631 microversion: 2.1 time: 0.657892 Oct 24 10:55:15.837687 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2798/5631] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:55:15 2022] POST /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff/action => generated 32631 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:55:15.927057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ebaa378e-2b47-4c91-a8e4-3c0b470e3038 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:15.933439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ebaa378e-2b47-4c91-a8e4-3c0b470e3038 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:15.947440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebaa378e-2b47-4c91-a8e4-3c0b470e3038 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:15.953000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebaa378e-2b47-4c91-a8e4-3c0b470e3038 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:15.954806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebaa378e-2b47-4c91-a8e4-3c0b470e3038 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:15.955693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebaa378e-2b47-4c91-a8e4-3c0b470e3038 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:15.957327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebaa378e-2b47-4c91-a8e4-3c0b470e3038 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:15.958791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebaa378e-2b47-4c91-a8e4-3c0b470e3038 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:15.995531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-72b079cb-4991-4bd8-a0cd-67c405648fe4 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:15.996446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-72b079cb-4991-4bd8-a0cd-67c405648fe4 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:16.006675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b079cb-4991-4bd8-a0cd-67c405648fe4 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:16.007360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b079cb-4991-4bd8-a0cd-67c405648fe4 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:16.010309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b079cb-4991-4bd8-a0cd-67c405648fe4 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:16.011338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b079cb-4991-4bd8-a0cd-67c405648fe4 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:16.012168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b079cb-4991-4bd8-a0cd-67c405648fe4 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:16.012768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b079cb-4991-4bd8-a0cd-67c405648fe4 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:16.110757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-72b079cb-4991-4bd8-a0cd-67c405648fe4 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd3efb6bfcf3d42f3b197e41ea3b06694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b11d85eb3f94b92a8cbfb1f61417208', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:16.112590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-72b079cb-4991-4bd8-a0cd-67c405648fe4 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] flavor_id is None. Assuming migration. {{(pid=120425) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 24 10:55:16.113308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-72b079cb-4991-4bd8-a0cd-67c405648fe4 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120425) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 24 10:55:16.519821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ebaa378e-2b47-4c91-a8e4-3c0b470e3038 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:16.537370 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ebaa378e-2b47-4c91-a8e4-3c0b470e3038 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1327 microversion: 2.1 time: 0.617507 Oct 24 10:55:16.538859 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2834/5632] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:15 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1327 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:16.602602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:16.711172 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-72b079cb-4991-4bd8-a0cd-67c405648fe4 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff/action" status: 202 len: 0 microversion: 2.1 time: 0.720809 Oct 24 10:55:16.712454 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2799/5633] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:55:15 2022] POST /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff/action => generated 0 bytes in 724 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:55:16.722618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6d84ab97-141e-46a7-89d8-e15767a67e35 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:16.723255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6d84ab97-141e-46a7-89d8-e15767a67e35 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:16.731617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d84ab97-141e-46a7-89d8-e15767a67e35 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:16.733006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d84ab97-141e-46a7-89d8-e15767a67e35 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:16.733455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d84ab97-141e-46a7-89d8-e15767a67e35 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:16.734172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d84ab97-141e-46a7-89d8-e15767a67e35 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:16.734624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d84ab97-141e-46a7-89d8-e15767a67e35 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:16.735049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d84ab97-141e-46a7-89d8-e15767a67e35 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:17.315036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6d84ab97-141e-46a7-89d8-e15767a67e35 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:17.325092 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6d84ab97-141e-46a7-89d8-e15767a67e35 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1692 microversion: 2.1 time: 0.608152 Oct 24 10:55:17.339591 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2835/5634] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:16 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1692 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:17.565195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5ca956ce-a04d-41b5-b3e8-9c0426dc8ad1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:17.565943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5ca956ce-a04d-41b5-b3e8-9c0426dc8ad1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:17.582916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ca956ce-a04d-41b5-b3e8-9c0426dc8ad1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:17.583597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ca956ce-a04d-41b5-b3e8-9c0426dc8ad1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:17.584145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ca956ce-a04d-41b5-b3e8-9c0426dc8ad1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:17.585443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ca956ce-a04d-41b5-b3e8-9c0426dc8ad1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:17.586004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ca956ce-a04d-41b5-b3e8-9c0426dc8ad1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:17.586522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5ca956ce-a04d-41b5-b3e8-9c0426dc8ad1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:17.712191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-520ba06f-c2ac-43ea-85fa-c53452da4cdc req-047cedd1-02ac-45b5-952f-5d079e0232dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b597a084-c2a0-44e6-b435-ae8d2b13ed98", "tag": "1df17286-8d5f-4346-9991-3ac4c2ed0949"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:17.734990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-520ba06f-c2ac-43ea-85fa-c53452da4cdc req-047cedd1-02ac-45b5-952f-5d079e0232dd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:17.741053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-520ba06f-c2ac-43ea-85fa-c53452da4cdc req-047cedd1-02ac-45b5-952f-5d079e0232dd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:17.741665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-520ba06f-c2ac-43ea-85fa-c53452da4cdc req-047cedd1-02ac-45b5-952f-5d079e0232dd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:17.770503 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-520ba06f-c2ac-43ea-85fa-c53452da4cdc req-047cedd1-02ac-45b5-952f-5d079e0232dd service nova] Creating event network-changed:1df17286-8d5f-4346-9991-3ac4c2ed0949 for instance b597a084-c2a0-44e6-b435-ae8d2b13ed98 on n-h1-858383-15 Oct 24 10:55:17.784326 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-520ba06f-c2ac-43ea-85fa-c53452da4cdc req-047cedd1-02ac-45b5-952f-5d079e0232dd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076962 Oct 24 10:55:17.789079 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2836/5635] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:55:17.981624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5ca956ce-a04d-41b5-b3e8-9c0426dc8ad1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:17.994153 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5ca956ce-a04d-41b5-b3e8-9c0426dc8ad1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1527 microversion: 2.1 time: 0.436771 Oct 24 10:55:17.996402 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2800/5636] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:17 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1527 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:18.024202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-16d69ca5-f845-4f5a-9ce4-233d1f9c5d71 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:18.025094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-16d69ca5-f845-4f5a-9ce4-233d1f9c5d71 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:18.043428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16d69ca5-f845-4f5a-9ce4-233d1f9c5d71 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:18.044202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16d69ca5-f845-4f5a-9ce4-233d1f9c5d71 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:18.045747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16d69ca5-f845-4f5a-9ce4-233d1f9c5d71 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:18.046687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16d69ca5-f845-4f5a-9ce4-233d1f9c5d71 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:18.047319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16d69ca5-f845-4f5a-9ce4-233d1f9c5d71 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:18.047938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16d69ca5-f845-4f5a-9ce4-233d1f9c5d71 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:18.354882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cdcfaf40-8eb6-4c24-ad0e-6dec505d69f3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:18.356314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cdcfaf40-8eb6-4c24-ad0e-6dec505d69f3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:18.370966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cdcfaf40-8eb6-4c24-ad0e-6dec505d69f3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:18.372234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cdcfaf40-8eb6-4c24-ad0e-6dec505d69f3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:18.376555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cdcfaf40-8eb6-4c24-ad0e-6dec505d69f3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:18.382509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cdcfaf40-8eb6-4c24-ad0e-6dec505d69f3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:18.383346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cdcfaf40-8eb6-4c24-ad0e-6dec505d69f3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:18.385083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cdcfaf40-8eb6-4c24-ad0e-6dec505d69f3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:18.501788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-16d69ca5-f845-4f5a-9ce4-233d1f9c5d71 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:18.520161 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-16d69ca5-f845-4f5a-9ce4-233d1f9c5d71 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1527 microversion: 2.1 time: 0.500166 Oct 24 10:55:18.522407 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2837/5637] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:18 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1527 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:18.713024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cdcfaf40-8eb6-4c24-ad0e-6dec505d69f3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:18.722454 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cdcfaf40-8eb6-4c24-ad0e-6dec505d69f3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1692 microversion: 2.1 time: 0.371857 Oct 24 10:55:18.734536 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2801/5638] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:18 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1692 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:55:18.891071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54bf47bc-ee30-4911-accf-84a1c4941ab6 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:18.895987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-54bf47bc-ee30-4911-accf-84a1c4941ab6 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:18.914507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54bf47bc-ee30-4911-accf-84a1c4941ab6 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:18.915016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54bf47bc-ee30-4911-accf-84a1c4941ab6 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:18.915469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54bf47bc-ee30-4911-accf-84a1c4941ab6 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:18.916205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54bf47bc-ee30-4911-accf-84a1c4941ab6 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:18.916671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54bf47bc-ee30-4911-accf-84a1c4941ab6 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:18.920551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54bf47bc-ee30-4911-accf-84a1c4941ab6 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:18.960613 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-54bf47bc-ee30-4911-accf-84a1c4941ab6 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] HTTP exception thrown: Instance 3ff84201-7b81-490b-97de-6e3b651182ef could not be found. Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54bf47bc-ee30-4911-accf-84a1c4941ab6 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] Request method failure captured: Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef HTTP/1.1 Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm7__gQ2enwb7ioKe7XT-FYrm8MXnIbpE1dYAsGpms8IN5K5Cdl1IBWkNk5tPb9b7OZr-hq_Affola-YCUXM6kK-i34GoNyIhCO5sXhgWbDCbRklq89ZeDfgdF8x8gPIODrXkiRX2Fp7yTHjjbeun461UB390cbog_OsLUGNTM6f6rw Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: df1c13fe407944849acd2e47bcfcd829 Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-184598038 Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/df1c13fe407944849acd2e47bcfcd829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/df1c13fe407944849acd2e47bcfcd829"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/df1c13fe407944849acd2e47bcfcd829"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_df1c13fe407944849acd2e47bcfcd829", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-184598038 Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: df1c13fe407944849acd2e47bcfcd829 Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-184598038 Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestMultiTenantJSON-184598038-project Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 02c287ab72eb489381753a9b5d2ba065 Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-184598038-project Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 3ff84201-7b81-490b-97de-6e3b651182ef could not be found. Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '3ff84201-7b81-490b-97de-6e3b651182ef'} Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff84201-7b81-490b-97de-6e3b651182ef could not be found. Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:55:18.971997 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:55:18.976854 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff84201-7b81-490b-97de-6e3b651182ef could not be found. Oct 24 10:55:18.976854 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:55:18.976854 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:55:18.976854 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:55:18.976854 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:55:18.976854 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:55:18.976854 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:55:18.976854 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:55:18.976854 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:55:18.976854 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff84201-7b81-490b-97de-6e3b651182ef could not be found. Oct 24 10:55:18.976854 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:55:18.976854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54bf47bc-ee30-4911-accf-84a1c4941ab6 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] Returning 404 to user: Instance 3ff84201-7b81-490b-97de-6e3b651182ef could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:55:18.978130 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-54bf47bc-ee30-4911-accf-84a1c4941ab6 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 404 len: 111 microversion: 2.1 time: 0.435166 Oct 24 10:55:18.981380 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2838/5639] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:55:18 2022] DELETE /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 111 bytes in 440 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:55:18.990274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a52e5f0-e700-4043-91d5-ee560e72a1e3 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:18.991501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0a52e5f0-e700-4043-91d5-ee560e72a1e3 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:19.007758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a52e5f0-e700-4043-91d5-ee560e72a1e3 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:19.008637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a52e5f0-e700-4043-91d5-ee560e72a1e3 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:19.011798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a52e5f0-e700-4043-91d5-ee560e72a1e3 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:19.012857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a52e5f0-e700-4043-91d5-ee560e72a1e3 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:19.015908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a52e5f0-e700-4043-91d5-ee560e72a1e3 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:19.017562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a52e5f0-e700-4043-91d5-ee560e72a1e3 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:19.759427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c14638ae-0dc0-4b5a-9603-14fb7c8ce566 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:19.760611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c14638ae-0dc0-4b5a-9603-14fb7c8ce566 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:19.776950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c14638ae-0dc0-4b5a-9603-14fb7c8ce566 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:19.777642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c14638ae-0dc0-4b5a-9603-14fb7c8ce566 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:19.778257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c14638ae-0dc0-4b5a-9603-14fb7c8ce566 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:19.779788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c14638ae-0dc0-4b5a-9603-14fb7c8ce566 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:19.780547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c14638ae-0dc0-4b5a-9603-14fb7c8ce566 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:19.781177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c14638ae-0dc0-4b5a-9603-14fb7c8ce566 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:20.327681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0a52e5f0-e700-4043-91d5-ee560e72a1e3 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:20.343244 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0a52e5f0-e700-4043-91d5-ee560e72a1e3 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1527 microversion: 2.1 time: 1.356906 Oct 24 10:55:20.355077 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2802/5640] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:18 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1527 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:20.387957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-78299678-d165-45b0-91a9-468570a1e871 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] Action: 'update', calling method: >, body: {"server": {"name": "3ff84201-7b81-490b-97de-6e3b651182ef_new"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:20.410467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-78299678-d165-45b0-91a9-468570a1e871 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:20.422399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c14638ae-0dc0-4b5a-9603-14fb7c8ce566 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:20.426260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78299678-d165-45b0-91a9-468570a1e871 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:20.426961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78299678-d165-45b0-91a9-468570a1e871 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:20.427802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78299678-d165-45b0-91a9-468570a1e871 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:20.428719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78299678-d165-45b0-91a9-468570a1e871 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:20.429386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78299678-d165-45b0-91a9-468570a1e871 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:20.429987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-78299678-d165-45b0-91a9-468570a1e871 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:20.443960 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c14638ae-0dc0-4b5a-9603-14fb7c8ce566 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1692 microversion: 2.1 time: 0.688243 Oct 24 10:55:20.455223 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2839/5641] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:19 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1692 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:20.462267 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-78299678-d165-45b0-91a9-468570a1e871 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] HTTP exception thrown: Instance 3ff84201-7b81-490b-97de-6e3b651182ef could not be found. Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-78299678-d165-45b0-91a9-468570a1e871 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] Request method failure captured: Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: request: PUT /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef HTTP/1.1 Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 64 Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm7__gQ2enwb7ioKe7XT-FYrm8MXnIbpE1dYAsGpms8IN5K5Cdl1IBWkNk5tPb9b7OZr-hq_Affola-YCUXM6kK-i34GoNyIhCO5sXhgWbDCbRklq89ZeDfgdF8x8gPIODrXkiRX2Fp7yTHjjbeun461UB390cbog_OsLUGNTM6f6rw Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: df1c13fe407944849acd2e47bcfcd829 Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-184598038 Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/df1c13fe407944849acd2e47bcfcd829"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/df1c13fe407944849acd2e47bcfcd829"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/df1c13fe407944849acd2e47bcfcd829"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_df1c13fe407944849acd2e47bcfcd829", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-184598038 Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: df1c13fe407944849acd2e47bcfcd829 Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-184598038 Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestMultiTenantJSON-184598038-project Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 02c287ab72eb489381753a9b5d2ba065 Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-184598038-project Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: {"server": {"name": "3ff84201-7b81-490b-97de-6e3b651182ef_new"}} Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 3ff84201-7b81-490b-97de-6e3b651182ef could not be found. Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '3ff84201-7b81-490b-97de-6e3b651182ef', 'body': {'server': {'name': '3ff84201-7b81-490b-97de-6e3b651182ef_new'}}} Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff84201-7b81-490b-97de-6e3b651182ef could not be found. Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:55:20.464053 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff84201-7b81-490b-97de-6e3b651182ef could not be found. Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff84201-7b81-490b-97de-6e3b651182ef could not be found. Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-78299678-d165-45b0-91a9-468570a1e871 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] Returning 404 to user: Instance 3ff84201-7b81-490b-97de-6e3b651182ef could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-78299678-d165-45b0-91a9-468570a1e871 tempest-ServersNegativeTestMultiTenantJSON-184598038 tempest-ServersNegativeTestMultiTenantJSON-184598038-project] 10.222.0.50 "PUT /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 404 len: 111 microversion: 2.1 time: 0.086953 Oct 24 10:55:20.468522 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2803/5642] 10.222.0.50 () {60 vars in 1256 bytes} [Mon Oct 24 10:55:20 2022] PUT /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:55:20.480347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-75cacce0-fd8e-4edd-b4e3-2aed2224ab45 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:20.480897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-75cacce0-fd8e-4edd-b4e3-2aed2224ab45 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:20.494425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-75cacce0-fd8e-4edd-b4e3-2aed2224ab45 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:20.494923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-75cacce0-fd8e-4edd-b4e3-2aed2224ab45 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:20.503009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-75cacce0-fd8e-4edd-b4e3-2aed2224ab45 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:20.503990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-75cacce0-fd8e-4edd-b4e3-2aed2224ab45 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:20.504635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-75cacce0-fd8e-4edd-b4e3-2aed2224ab45 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:20.505320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-75cacce0-fd8e-4edd-b4e3-2aed2224ab45 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:20.570405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-75cacce0-fd8e-4edd-b4e3-2aed2224ab45 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:55:20.728686 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-75cacce0-fd8e-4edd-b4e3-2aed2224ab45 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 204 len: 0 microversion: 2.1 time: 0.252496 Oct 24 10:55:20.729455 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2840/5643] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:55:20 2022] DELETE /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:55:20.738679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ff5c9ab6-25df-4001-a9ec-370a85ecc24c tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:20.739336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ff5c9ab6-25df-4001-a9ec-370a85ecc24c tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:20.748743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff5c9ab6-25df-4001-a9ec-370a85ecc24c tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:20.758975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff5c9ab6-25df-4001-a9ec-370a85ecc24c tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:20.759485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff5c9ab6-25df-4001-a9ec-370a85ecc24c tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:20.760266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff5c9ab6-25df-4001-a9ec-370a85ecc24c tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:20.760753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff5c9ab6-25df-4001-a9ec-370a85ecc24c tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:20.761218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff5c9ab6-25df-4001-a9ec-370a85ecc24c tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:21.028142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ff5c9ab6-25df-4001-a9ec-370a85ecc24c tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:21.040325 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ff5c9ab6-25df-4001-a9ec-370a85ecc24c tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1533 microversion: 2.1 time: 0.305613 Oct 24 10:55:21.045091 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2804/5644] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:20 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1533 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:21.485009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7fc89056-8263-402f-a8dd-354d688e1b24 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:21.486376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7fc89056-8263-402f-a8dd-354d688e1b24 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:21.499387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fc89056-8263-402f-a8dd-354d688e1b24 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:21.501717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fc89056-8263-402f-a8dd-354d688e1b24 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:21.507748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fc89056-8263-402f-a8dd-354d688e1b24 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:21.508991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fc89056-8263-402f-a8dd-354d688e1b24 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:21.509556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fc89056-8263-402f-a8dd-354d688e1b24 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:21.509939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fc89056-8263-402f-a8dd-354d688e1b24 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:22.022879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7fc89056-8263-402f-a8dd-354d688e1b24 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:22.042283 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7fc89056-8263-402f-a8dd-354d688e1b24 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1692 microversion: 2.1 time: 0.559248 Oct 24 10:55:22.050029 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2841/5645] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:21 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1692 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:22.065455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1c9909b6-b89d-4009-aa5b-38e730249329 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:22.066233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1c9909b6-b89d-4009-aa5b-38e730249329 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:22.082477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c9909b6-b89d-4009-aa5b-38e730249329 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:22.083046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c9909b6-b89d-4009-aa5b-38e730249329 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:22.086715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c9909b6-b89d-4009-aa5b-38e730249329 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:22.089039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c9909b6-b89d-4009-aa5b-38e730249329 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:22.090513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c9909b6-b89d-4009-aa5b-38e730249329 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:22.090974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1c9909b6-b89d-4009-aa5b-38e730249329 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:22.478430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1c9909b6-b89d-4009-aa5b-38e730249329 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:22.499287 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1c9909b6-b89d-4009-aa5b-38e730249329 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1533 microversion: 2.1 time: 0.435984 Oct 24 10:55:22.501227 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2805/5646] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:22 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1533 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:23.067652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1270f2ce-56b4-4e3b-864c-caa9a7bee562 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:23.068886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1270f2ce-56b4-4e3b-864c-caa9a7bee562 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:23.076708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1270f2ce-56b4-4e3b-864c-caa9a7bee562 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:23.077668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1270f2ce-56b4-4e3b-864c-caa9a7bee562 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:23.078276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1270f2ce-56b4-4e3b-864c-caa9a7bee562 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:23.079155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1270f2ce-56b4-4e3b-864c-caa9a7bee562 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:23.079769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1270f2ce-56b4-4e3b-864c-caa9a7bee562 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:23.080351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1270f2ce-56b4-4e3b-864c-caa9a7bee562 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:23.409738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1270f2ce-56b4-4e3b-864c-caa9a7bee562 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:23.421106 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1270f2ce-56b4-4e3b-864c-caa9a7bee562 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1692 microversion: 2.1 time: 0.356246 Oct 24 10:55:23.421977 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2842/5647] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:23 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1692 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:23.527472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fcdf11ba-0cfa-4a96-aac4-e5a4ca9898b1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:23.530009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fcdf11ba-0cfa-4a96-aac4-e5a4ca9898b1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:23.543421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcdf11ba-0cfa-4a96-aac4-e5a4ca9898b1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:23.544424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcdf11ba-0cfa-4a96-aac4-e5a4ca9898b1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:23.546218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcdf11ba-0cfa-4a96-aac4-e5a4ca9898b1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:23.547479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcdf11ba-0cfa-4a96-aac4-e5a4ca9898b1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:23.550196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcdf11ba-0cfa-4a96-aac4-e5a4ca9898b1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:23.551100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcdf11ba-0cfa-4a96-aac4-e5a4ca9898b1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:24.020094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fcdf11ba-0cfa-4a96-aac4-e5a4ca9898b1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb0b42c2f6a49cb83cf4f617b26fe67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c491130537427ebec96d55ee59ea5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:24.030415 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fcdf11ba-0cfa-4a96-aac4-e5a4ca9898b1 tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 200 len: 1533 microversion: 2.1 time: 0.509111 Oct 24 10:55:24.059491 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2806/5648] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:23 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 1533 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:24.065788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-211daa93-6cac-4806-a0f4-0b6bd5f51467 req-e56c93f0-a7f4-48da-920b-d127dfe87409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff84201-7b81-490b-97de-6e3b651182ef", "name": "network-vif-deleted", "tag": "e4c0863d-1711-40fc-9991-9a09e1290817"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:24.080507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-211daa93-6cac-4806-a0f4-0b6bd5f51467 req-e56c93f0-a7f4-48da-920b-d127dfe87409 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:24.081466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-211daa93-6cac-4806-a0f4-0b6bd5f51467 req-e56c93f0-a7f4-48da-920b-d127dfe87409 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:24.082332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-211daa93-6cac-4806-a0f4-0b6bd5f51467 req-e56c93f0-a7f4-48da-920b-d127dfe87409 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:24.113928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2b55c411-3a88-46b7-9832-68cda4d2b22c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1019456149", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:24.127854 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-211daa93-6cac-4806-a0f4-0b6bd5f51467 req-e56c93f0-a7f4-48da-920b-d127dfe87409 service nova] Creating event network-vif-deleted:e4c0863d-1711-40fc-9991-9a09e1290817 for instance 3ff84201-7b81-490b-97de-6e3b651182ef on n-h1-858383-15 Oct 24 10:55:24.142222 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-211daa93-6cac-4806-a0f4-0b6bd5f51467 req-e56c93f0-a7f4-48da-920b-d127dfe87409 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080558 Oct 24 10:55:24.143037 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2807/5649] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:55:24.259609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-2b55c411-3a88-46b7-9832-68cda4d2b22c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] validate_networks() for [('33496d87-63b8-423d-9b93-72eddb64dec3', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:55:24.450085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e3f78ce9-093a-445a-9bf0-95b37d56a491 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:24.451414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e3f78ce9-093a-445a-9bf0-95b37d56a491 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:24.463487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3f78ce9-093a-445a-9bf0-95b37d56a491 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:24.464001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3f78ce9-093a-445a-9bf0-95b37d56a491 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:24.464453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3f78ce9-093a-445a-9bf0-95b37d56a491 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:24.474894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3f78ce9-093a-445a-9bf0-95b37d56a491 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:24.474894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3f78ce9-093a-445a-9bf0-95b37d56a491 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:24.474894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3f78ce9-093a-445a-9bf0-95b37d56a491 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:24.859076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e3f78ce9-093a-445a-9bf0-95b37d56a491 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:24.873348 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e3f78ce9-093a-445a-9bf0-95b37d56a491 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1697 microversion: 2.1 time: 0.429155 Oct 24 10:55:24.890166 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2808/5650] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:24 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1697 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:55:25.059117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-32466a56-1265-4b41-91ef-3b4779b5aa5e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:25.060043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-32466a56-1265-4b41-91ef-3b4779b5aa5e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] [instance: 3ff84201-7b81-490b-97de-6e3b651182ef] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:25.079808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32466a56-1265-4b41-91ef-3b4779b5aa5e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:25.080441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32466a56-1265-4b41-91ef-3b4779b5aa5e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:25.082826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32466a56-1265-4b41-91ef-3b4779b5aa5e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:25.084312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32466a56-1265-4b41-91ef-3b4779b5aa5e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:25.085249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32466a56-1265-4b41-91ef-3b4779b5aa5e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:25.086687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32466a56-1265-4b41-91ef-3b4779b5aa5e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:25.121998 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-32466a56-1265-4b41-91ef-3b4779b5aa5e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] HTTP exception thrown: Instance 3ff84201-7b81-490b-97de-6e3b651182ef could not be found. Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-32466a56-1265-4b41-91ef-3b4779b5aa5e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Request method failure captured: Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef HTTP/1.1 Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm7ycSbNY_8UA4Wz5cBd9tV6c2SKchsHTIK9j5MS4ZfBeZlu6ctISQfzX9eiDeXnKTYBMgaqPcZmV2ZN7et0Yk002HWku8no6NgO_W0NHhsAYKpCrJqqNotSEvazkKtsXEXFXxn8nXsYbmceyEDv7_sK7oYeSHU5K-L_p3N-C8FeLYg Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 07c491130537427ebec96d55ee59ea5c Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1118418847 Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/07c491130537427ebec96d55ee59ea5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/07c491130537427ebec96d55ee59ea5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/07c491130537427ebec96d55ee59ea5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_07c491130537427ebec96d55ee59ea5c", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1118418847 Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 07c491130537427ebec96d55ee59ea5c Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1118418847 Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1118418847-project Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: afb0b42c2f6a49cb83cf4f617b26fe67 Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1118418847-project Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 3ff84201-7b81-490b-97de-6e3b651182ef could not be found. Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '3ff84201-7b81-490b-97de-6e3b651182ef'} Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff84201-7b81-490b-97de-6e3b651182ef could not be found. Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff84201-7b81-490b-97de-6e3b651182ef could not be found. Oct 24 10:55:25.128982 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:55:25.133287 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:55:25.133287 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:55:25.133287 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:55:25.133287 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:55:25.133287 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:55:25.133287 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:55:25.133287 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:55:25.133287 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff84201-7b81-490b-97de-6e3b651182ef could not be found. Oct 24 10:55:25.133287 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:55:25.137020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-32466a56-1265-4b41-91ef-3b4779b5aa5e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] Returning 404 to user: Instance 3ff84201-7b81-490b-97de-6e3b651182ef could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:55:25.141115 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-32466a56-1265-4b41-91ef-3b4779b5aa5e tempest-ServersNegativeTestMultiTenantJSON-1118418847 tempest-ServersNegativeTestMultiTenantJSON-1118418847-project] 10.222.0.50 "GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef" status: 404 len: 111 microversion: 2.1 time: 0.087389 Oct 24 10:55:25.143049 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2809/5651] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:25 2022] GET /compute/v2.1/servers/3ff84201-7b81-490b-97de-6e3b651182ef => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:55:25.258878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-2b55c411-3a88-46b7-9832-68cda4d2b22c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:55:25.259408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-2b55c411-3a88-46b7-9832-68cda4d2b22c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:55:25.259828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-2b55c411-3a88-46b7-9832-68cda4d2b22c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:55:25.260261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-2b55c411-3a88-46b7-9832-68cda4d2b22c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:55:25.260703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-2b55c411-3a88-46b7-9832-68cda4d2b22c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:55:25.279171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b55c411-3a88-46b7-9832-68cda4d2b22c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:25.279711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b55c411-3a88-46b7-9832-68cda4d2b22c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:25.284246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b55c411-3a88-46b7-9832-68cda4d2b22c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:25.285087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b55c411-3a88-46b7-9832-68cda4d2b22c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:25.285757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b55c411-3a88-46b7-9832-68cda4d2b22c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:25.286511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b55c411-3a88-46b7-9832-68cda4d2b22c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:25.327341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-2b55c411-3a88-46b7-9832-68cda4d2b22c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Getting quotas for project 9dca3140620f4022b1bd7d610163be77. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:55:25.339435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-2b55c411-3a88-46b7-9832-68cda4d2b22c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Getting quotas for user a38c757a515e4a3aa80f82441feef50e and project 9dca3140620f4022b1bd7d610163be77. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:55:25.386924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2b55c411-3a88-46b7-9832-68cda4d2b22c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:55:25.395001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2b55c411-3a88-46b7-9832-68cda4d2b22c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:55:25.485636 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2b55c411-3a88-46b7-9832-68cda4d2b22c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.656369 Oct 24 10:55:25.486962 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2843/5652] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:55:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:55:25.498680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4e0ca7fd-49ef-4ca2-a0cc-ff0996a0de86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:25.500018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4e0ca7fd-49ef-4ca2-a0cc-ff0996a0de86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:25.901754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-13501315-462c-4cd7-bd67-be1eb323c200 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:25.904706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-13501315-462c-4cd7-bd67-be1eb323c200 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:25.949682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13501315-462c-4cd7-bd67-be1eb323c200 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:25.950075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13501315-462c-4cd7-bd67-be1eb323c200 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:25.950529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13501315-462c-4cd7-bd67-be1eb323c200 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:25.951346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13501315-462c-4cd7-bd67-be1eb323c200 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:25.952108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13501315-462c-4cd7-bd67-be1eb323c200 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:25.952548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13501315-462c-4cd7-bd67-be1eb323c200 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:26.518751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4e0ca7fd-49ef-4ca2-a0cc-ff0996a0de86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:26.554072 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4e0ca7fd-49ef-4ca2-a0cc-ff0996a0de86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1217 microversion: 2.1 time: 1.057614 Oct 24 10:55:26.555274 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2810/5653] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:25 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1217 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:26.879829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-13501315-462c-4cd7-bd67-be1eb323c200 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:26.900537 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-13501315-462c-4cd7-bd67-be1eb323c200 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1697 microversion: 2.1 time: 1.001346 Oct 24 10:55:26.904673 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2844/5654] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:25 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1697 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:27.585045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a2902fe7-d10b-4428-bb0a-1a43cf70a7ac tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:27.585730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a2902fe7-d10b-4428-bb0a-1a43cf70a7ac tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:27.613771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2902fe7-d10b-4428-bb0a-1a43cf70a7ac tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:27.614344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2902fe7-d10b-4428-bb0a-1a43cf70a7ac tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:27.615417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2902fe7-d10b-4428-bb0a-1a43cf70a7ac tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:27.616180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2902fe7-d10b-4428-bb0a-1a43cf70a7ac tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:27.620509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2902fe7-d10b-4428-bb0a-1a43cf70a7ac tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:27.621165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2902fe7-d10b-4428-bb0a-1a43cf70a7ac tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:27.850377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a2902fe7-d10b-4428-bb0a-1a43cf70a7ac tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:27.869459 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a2902fe7-d10b-4428-bb0a-1a43cf70a7ac tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1277 microversion: 2.1 time: 0.285703 Oct 24 10:55:27.871443 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2811/5655] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:27 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1277 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:27.929599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2e090501-b666-4d38-9a04-b5c23e9fcb7a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:27.930807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2e090501-b666-4d38-9a04-b5c23e9fcb7a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:27.944078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e090501-b666-4d38-9a04-b5c23e9fcb7a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:27.945322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e090501-b666-4d38-9a04-b5c23e9fcb7a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:27.945967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e090501-b666-4d38-9a04-b5c23e9fcb7a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:27.946859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e090501-b666-4d38-9a04-b5c23e9fcb7a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:27.947981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e090501-b666-4d38-9a04-b5c23e9fcb7a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:27.951629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e090501-b666-4d38-9a04-b5c23e9fcb7a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:28.338605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2e090501-b666-4d38-9a04-b5c23e9fcb7a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:28.352359 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2e090501-b666-4d38-9a04-b5c23e9fcb7a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1697 microversion: 2.1 time: 0.426465 Oct 24 10:55:28.363416 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2845/5656] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:27 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1697 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:28.895878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa9a752b-036d-4baf-ad37-7609f158874e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:28.896503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa9a752b-036d-4baf-ad37-7609f158874e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:28.914307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa9a752b-036d-4baf-ad37-7609f158874e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:28.914838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa9a752b-036d-4baf-ad37-7609f158874e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:28.915656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa9a752b-036d-4baf-ad37-7609f158874e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:28.916403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa9a752b-036d-4baf-ad37-7609f158874e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:28.916881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa9a752b-036d-4baf-ad37-7609f158874e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:28.917315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa9a752b-036d-4baf-ad37-7609f158874e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:29.103520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa9a752b-036d-4baf-ad37-7609f158874e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:29.119757 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa9a752b-036d-4baf-ad37-7609f158874e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1275 microversion: 2.1 time: 0.225678 Oct 24 10:55:29.120401 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2812/5657] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:28 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1275 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:29.383146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-34ece05f-f2d1-4c97-9034-f908be061924 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:29.383771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-34ece05f-f2d1-4c97-9034-f908be061924 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:29.393766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34ece05f-f2d1-4c97-9034-f908be061924 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:29.394265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34ece05f-f2d1-4c97-9034-f908be061924 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:29.394700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34ece05f-f2d1-4c97-9034-f908be061924 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:29.395579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34ece05f-f2d1-4c97-9034-f908be061924 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:29.396200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34ece05f-f2d1-4c97-9034-f908be061924 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:29.396627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34ece05f-f2d1-4c97-9034-f908be061924 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:29.794815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-34ece05f-f2d1-4c97-9034-f908be061924 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:29.803785 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-34ece05f-f2d1-4c97-9034-f908be061924 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1697 microversion: 2.1 time: 0.430690 Oct 24 10:55:29.818092 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2846/5658] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:29 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1697 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:30.067974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-36bc8261-5afe-42b9-b7f5-2c45541a0bba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:30.068615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-36bc8261-5afe-42b9-b7f5-2c45541a0bba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:30.083198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36bc8261-5afe-42b9-b7f5-2c45541a0bba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:30.085848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36bc8261-5afe-42b9-b7f5-2c45541a0bba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:30.086349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36bc8261-5afe-42b9-b7f5-2c45541a0bba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:30.088507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36bc8261-5afe-42b9-b7f5-2c45541a0bba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:30.090570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36bc8261-5afe-42b9-b7f5-2c45541a0bba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:30.091618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36bc8261-5afe-42b9-b7f5-2c45541a0bba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:30.145162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-81971b12-f219-4a3c-8895-de631d18df7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:30.146080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-81971b12-f219-4a3c-8895-de631d18df7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:30.153412 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-36bc8261-5afe-42b9-b7f5-2c45541a0bba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/ips" status: 200 len: 146 microversion: 2.1 time: 0.094634 Oct 24 10:55:30.156778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81971b12-f219-4a3c-8895-de631d18df7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:30.157705 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2813/5659] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Oct 24 10:55:30 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/ips => generated 146 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:55:30.160413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81971b12-f219-4a3c-8895-de631d18df7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:30.161025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81971b12-f219-4a3c-8895-de631d18df7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:30.191154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81971b12-f219-4a3c-8895-de631d18df7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:30.192892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81971b12-f219-4a3c-8895-de631d18df7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:30.195944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81971b12-f219-4a3c-8895-de631d18df7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:30.833503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9c4f26c5-b475-4b15-b2ac-5de072e23582 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:30.834144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9c4f26c5-b475-4b15-b2ac-5de072e23582 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:30.848707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c4f26c5-b475-4b15-b2ac-5de072e23582 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:30.849242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c4f26c5-b475-4b15-b2ac-5de072e23582 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:30.851937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c4f26c5-b475-4b15-b2ac-5de072e23582 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:30.852733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c4f26c5-b475-4b15-b2ac-5de072e23582 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:30.855616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c4f26c5-b475-4b15-b2ac-5de072e23582 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:30.858010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c4f26c5-b475-4b15-b2ac-5de072e23582 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:31.303889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-81971b12-f219-4a3c-8895-de631d18df7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:31.322386 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-81971b12-f219-4a3c-8895-de631d18df7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1317 microversion: 2.1 time: 1.181013 Oct 24 10:55:31.325609 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2847/5660] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:30 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1317 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:55:31.543154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9c4f26c5-b475-4b15-b2ac-5de072e23582 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:31.553608 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9c4f26c5-b475-4b15-b2ac-5de072e23582 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1697 microversion: 2.1 time: 0.724918 Oct 24 10:55:31.556532 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2814/5661] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:30 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1697 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:55:32.356178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b6ca78e2-0ab0-4d90-838b-a539e48d7d34 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:32.356996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b6ca78e2-0ab0-4d90-838b-a539e48d7d34 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:32.371409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6ca78e2-0ab0-4d90-838b-a539e48d7d34 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:32.371920 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6ca78e2-0ab0-4d90-838b-a539e48d7d34 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:32.372347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6ca78e2-0ab0-4d90-838b-a539e48d7d34 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:32.373815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6ca78e2-0ab0-4d90-838b-a539e48d7d34 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:32.376035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6ca78e2-0ab0-4d90-838b-a539e48d7d34 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:32.376731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6ca78e2-0ab0-4d90-838b-a539e48d7d34 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:32.580054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7738e93c-3a7b-4966-8d60-88d939c4304e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:32.581335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7738e93c-3a7b-4966-8d60-88d939c4304e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:32.596544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7738e93c-3a7b-4966-8d60-88d939c4304e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:32.597345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7738e93c-3a7b-4966-8d60-88d939c4304e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:32.597980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7738e93c-3a7b-4966-8d60-88d939c4304e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:32.598932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7738e93c-3a7b-4966-8d60-88d939c4304e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:32.599583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7738e93c-3a7b-4966-8d60-88d939c4304e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:32.600176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7738e93c-3a7b-4966-8d60-88d939c4304e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:32.686357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b6ca78e2-0ab0-4d90-838b-a539e48d7d34 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:32.699921 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b6ca78e2-0ab0-4d90-838b-a539e48d7d34 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1317 microversion: 2.1 time: 0.348045 Oct 24 10:55:32.702401 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2848/5662] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:32 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:32.984430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7738e93c-3a7b-4966-8d60-88d939c4304e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:32.993229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-607ade91-9309-410d-9f38-e9112bdea43b tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "401f4d71-694f-4c30-8f0c-37366b27b49b"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:33.001510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-607ade91-9309-410d-9f38-e9112bdea43b tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:33.008088 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7738e93c-3a7b-4966-8d60-88d939c4304e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1697 microversion: 2.1 time: 0.432316 Oct 24 10:55:33.025771 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2815/5663] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:32 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1697 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:55:33.039262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-607ade91-9309-410d-9f38-e9112bdea43b tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:33.040823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-607ade91-9309-410d-9f38-e9112bdea43b tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:33.043188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-607ade91-9309-410d-9f38-e9112bdea43b tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:33.044206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-607ade91-9309-410d-9f38-e9112bdea43b tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:33.047232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-194b0793-c8dc-4787-a78e-dde35cdf89f0 req-82fe95a4-fe78-4845-94e1-d9f829cb106e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00aedb62-1a0e-47f0-bf42-19c12e9c035b", "tag": "6502e9a3-ede9-43b4-816f-557cd30886f2"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:33.047751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-607ade91-9309-410d-9f38-e9112bdea43b tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:33.048443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-607ade91-9309-410d-9f38-e9112bdea43b tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:33.077033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-194b0793-c8dc-4787-a78e-dde35cdf89f0 req-82fe95a4-fe78-4845-94e1-d9f829cb106e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:33.078266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-194b0793-c8dc-4787-a78e-dde35cdf89f0 req-82fe95a4-fe78-4845-94e1-d9f829cb106e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:33.078812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-194b0793-c8dc-4787-a78e-dde35cdf89f0 req-82fe95a4-fe78-4845-94e1-d9f829cb106e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:33.085154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:33.109126 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-194b0793-c8dc-4787-a78e-dde35cdf89f0 req-82fe95a4-fe78-4845-94e1-d9f829cb106e service nova] Creating event network-changed:6502e9a3-ede9-43b4-816f-557cd30886f2 for instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b on n-h2-858383-15 Oct 24 10:55:33.121565 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-194b0793-c8dc-4787-a78e-dde35cdf89f0 req-82fe95a4-fe78-4845-94e1-d9f829cb106e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092022 Oct 24 10:55:33.125775 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2816/5664] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:55:33.592105 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-607ade91-9309-410d-9f38-e9112bdea43b tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "POST /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.604085 Oct 24 10:55:33.594802 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2849/5665] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 10:55:32 2022] POST /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments => generated 194 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:55:33.725009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-79171f55-fcc8-4669-bb43-136347ed9bde tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:33.725746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-79171f55-fcc8-4669-bb43-136347ed9bde tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:33.732138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79171f55-fcc8-4669-bb43-136347ed9bde tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:33.733194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79171f55-fcc8-4669-bb43-136347ed9bde tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:33.733639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79171f55-fcc8-4669-bb43-136347ed9bde tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:33.734346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79171f55-fcc8-4669-bb43-136347ed9bde tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:33.734805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79171f55-fcc8-4669-bb43-136347ed9bde tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:33.735236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79171f55-fcc8-4669-bb43-136347ed9bde tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:33.893264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-79171f55-fcc8-4669-bb43-136347ed9bde tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:33.904141 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-79171f55-fcc8-4669-bb43-136347ed9bde tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1317 microversion: 2.1 time: 0.183940 Oct 24 10:55:33.904824 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2817/5666] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:33 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:34.043849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-116dbf5a-d57e-4bf6-8e4e-5a4dcc39bcb8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:34.044569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-116dbf5a-d57e-4bf6-8e4e-5a4dcc39bcb8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:34.055083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-116dbf5a-d57e-4bf6-8e4e-5a4dcc39bcb8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:34.055579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-116dbf5a-d57e-4bf6-8e4e-5a4dcc39bcb8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:34.056020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-116dbf5a-d57e-4bf6-8e4e-5a4dcc39bcb8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:34.072265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-116dbf5a-d57e-4bf6-8e4e-5a4dcc39bcb8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:34.074977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-116dbf5a-d57e-4bf6-8e4e-5a4dcc39bcb8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:34.075772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-116dbf5a-d57e-4bf6-8e4e-5a4dcc39bcb8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:34.284710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-116dbf5a-d57e-4bf6-8e4e-5a4dcc39bcb8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:34.297761 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-116dbf5a-d57e-4bf6-8e4e-5a4dcc39bcb8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1697 microversion: 2.1 time: 0.259965 Oct 24 10:55:34.298795 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2850/5667] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:34 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1697 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:34.929355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e71201f0-58cf-4604-9a10-d2cce8bfcb9d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:34.930724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e71201f0-58cf-4604-9a10-d2cce8bfcb9d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:34.938802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e71201f0-58cf-4604-9a10-d2cce8bfcb9d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:34.940107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e71201f0-58cf-4604-9a10-d2cce8bfcb9d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:34.941131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e71201f0-58cf-4604-9a10-d2cce8bfcb9d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:34.942385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e71201f0-58cf-4604-9a10-d2cce8bfcb9d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:34.943191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e71201f0-58cf-4604-9a10-d2cce8bfcb9d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:34.945263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e71201f0-58cf-4604-9a10-d2cce8bfcb9d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:35.116176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e71201f0-58cf-4604-9a10-d2cce8bfcb9d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:35.126561 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e71201f0-58cf-4604-9a10-d2cce8bfcb9d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1317 microversion: 2.1 time: 0.201799 Oct 24 10:55:35.127229 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2818/5668] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:34 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:35.329773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-24ed69fc-3ee6-48bb-b97e-e51005ac9adb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:35.331013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-24ed69fc-3ee6-48bb-b97e-e51005ac9adb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:35.337968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:35.349389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24ed69fc-3ee6-48bb-b97e-e51005ac9adb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:35.352351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24ed69fc-3ee6-48bb-b97e-e51005ac9adb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:35.353046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24ed69fc-3ee6-48bb-b97e-e51005ac9adb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:35.356603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24ed69fc-3ee6-48bb-b97e-e51005ac9adb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:35.357349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24ed69fc-3ee6-48bb-b97e-e51005ac9adb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:35.358335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24ed69fc-3ee6-48bb-b97e-e51005ac9adb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:35.368106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:36.163246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef438a29-d718-4c65-b9a7-6e6afaa346cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:36.163845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ef438a29-d718-4c65-b9a7-6e6afaa346cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:36.183000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef438a29-d718-4c65-b9a7-6e6afaa346cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:36.183508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef438a29-d718-4c65-b9a7-6e6afaa346cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:36.183961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef438a29-d718-4c65-b9a7-6e6afaa346cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:36.184702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef438a29-d718-4c65-b9a7-6e6afaa346cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:36.185199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef438a29-d718-4c65-b9a7-6e6afaa346cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:36.186815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef438a29-d718-4c65-b9a7-6e6afaa346cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:36.267266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:36.545549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:36.903471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-24ed69fc-3ee6-48bb-b97e-e51005ac9adb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:36.927854 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-24ed69fc-3ee6-48bb-b97e-e51005ac9adb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1697 microversion: 2.1 time: 1.601348 Oct 24 10:55:36.929563 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2851/5669] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:35 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1697 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:37.008726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ef438a29-d718-4c65-b9a7-6e6afaa346cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:37.018971 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef438a29-d718-4c65-b9a7-6e6afaa346cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1317 microversion: 2.1 time: 0.859729 Oct 24 10:55:37.020141 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2819/5670] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:36 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1317 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:37.954154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c486f55a-e4f4-442b-92c3-6729f7db1502 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:37.954780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c486f55a-e4f4-442b-92c3-6729f7db1502 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:37.971782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c486f55a-e4f4-442b-92c3-6729f7db1502 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:37.972286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c486f55a-e4f4-442b-92c3-6729f7db1502 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:37.976449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c486f55a-e4f4-442b-92c3-6729f7db1502 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:37.977374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c486f55a-e4f4-442b-92c3-6729f7db1502 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:37.977849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c486f55a-e4f4-442b-92c3-6729f7db1502 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:37.978295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c486f55a-e4f4-442b-92c3-6729f7db1502 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:38.052785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b1ebdb9f-d0e5-4af9-b038-98b6424fd45b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:38.054590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b1ebdb9f-d0e5-4af9-b038-98b6424fd45b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:38.063909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1ebdb9f-d0e5-4af9-b038-98b6424fd45b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:38.064736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1ebdb9f-d0e5-4af9-b038-98b6424fd45b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:38.065487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1ebdb9f-d0e5-4af9-b038-98b6424fd45b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:38.066370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1ebdb9f-d0e5-4af9-b038-98b6424fd45b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:38.066983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1ebdb9f-d0e5-4af9-b038-98b6424fd45b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:38.067840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1ebdb9f-d0e5-4af9-b038-98b6424fd45b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:38.375145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c486f55a-e4f4-442b-92c3-6729f7db1502 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:38.387721 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c486f55a-e4f4-442b-92c3-6729f7db1502 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1697 microversion: 2.1 time: 0.439824 Oct 24 10:55:38.392813 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2852/5671] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:37 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1697 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:38.518849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-f92d6cc4-0897-4b5a-8e66-e35149069130 req-87463d04-cbfe-498e-a2db-950adc9c1832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00aedb62-1a0e-47f0-bf42-19c12e9c035b", "name": "network-vif-plugged", "status": "completed", "tag": "6502e9a3-ede9-43b4-816f-557cd30886f2"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:38.533108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b1ebdb9f-d0e5-4af9-b038-98b6424fd45b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:38.549017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f92d6cc4-0897-4b5a-8e66-e35149069130 req-87463d04-cbfe-498e-a2db-950adc9c1832 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:38.550700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f92d6cc4-0897-4b5a-8e66-e35149069130 req-87463d04-cbfe-498e-a2db-950adc9c1832 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:38.553454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f92d6cc4-0897-4b5a-8e66-e35149069130 req-87463d04-cbfe-498e-a2db-950adc9c1832 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:38.555545 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b1ebdb9f-d0e5-4af9-b038-98b6424fd45b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1317 microversion: 2.1 time: 0.513901 Oct 24 10:55:38.561921 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2820/5672] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:38 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:55:38.592666 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f92d6cc4-0897-4b5a-8e66-e35149069130 req-87463d04-cbfe-498e-a2db-950adc9c1832 service nova] Creating event network-vif-plugged:6502e9a3-ede9-43b4-816f-557cd30886f2 for instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b on n-h2-858383-15 Oct 24 10:55:38.609496 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-f92d6cc4-0897-4b5a-8e66-e35149069130 req-87463d04-cbfe-498e-a2db-950adc9c1832 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094507 Oct 24 10:55:38.612262 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2853/5673] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:55:39.415742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1100050e-4a7a-4fdc-b889-fc328161a1dc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:39.416425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1100050e-4a7a-4fdc-b889-fc328161a1dc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:39.434115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1100050e-4a7a-4fdc-b889-fc328161a1dc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:39.437078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1100050e-4a7a-4fdc-b889-fc328161a1dc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:39.439909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1100050e-4a7a-4fdc-b889-fc328161a1dc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:39.444564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1100050e-4a7a-4fdc-b889-fc328161a1dc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:39.446651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1100050e-4a7a-4fdc-b889-fc328161a1dc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:39.448875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1100050e-4a7a-4fdc-b889-fc328161a1dc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:39.586364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e535b39b-723d-40dd-9554-2dd4c48f56d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:39.589331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e535b39b-723d-40dd-9554-2dd4c48f56d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:39.604120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e535b39b-723d-40dd-9554-2dd4c48f56d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:39.608872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e535b39b-723d-40dd-9554-2dd4c48f56d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:39.609578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e535b39b-723d-40dd-9554-2dd4c48f56d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:39.612337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e535b39b-723d-40dd-9554-2dd4c48f56d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:39.613042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e535b39b-723d-40dd-9554-2dd4c48f56d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:39.614667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e535b39b-723d-40dd-9554-2dd4c48f56d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:39.711782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1100050e-4a7a-4fdc-b889-fc328161a1dc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:39.729506 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1100050e-4a7a-4fdc-b889-fc328161a1dc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1697 microversion: 2.1 time: 0.318286 Oct 24 10:55:39.730575 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2821/5674] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:39 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1697 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:39.869659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e535b39b-723d-40dd-9554-2dd4c48f56d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:39.886523 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e535b39b-723d-40dd-9554-2dd4c48f56d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1317 microversion: 2.1 time: 0.307202 Oct 24 10:55:39.891941 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2854/5675] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:39 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:40.759503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b9c712dd-f116-4413-9396-7b7741811aaa tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:40.760425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b9c712dd-f116-4413-9396-7b7741811aaa tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:40.772755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9c712dd-f116-4413-9396-7b7741811aaa tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:40.774411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9c712dd-f116-4413-9396-7b7741811aaa tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:40.775143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9c712dd-f116-4413-9396-7b7741811aaa tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:40.776217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9c712dd-f116-4413-9396-7b7741811aaa tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:40.777198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9c712dd-f116-4413-9396-7b7741811aaa tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:40.777908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9c712dd-f116-4413-9396-7b7741811aaa tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:40.919170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-374bacd3-df1a-46ad-a368-355877462c85 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:40.920904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-374bacd3-df1a-46ad-a368-355877462c85 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:40.928935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-374bacd3-df1a-46ad-a368-355877462c85 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:40.929542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-374bacd3-df1a-46ad-a368-355877462c85 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:40.944473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-374bacd3-df1a-46ad-a368-355877462c85 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:40.945765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-374bacd3-df1a-46ad-a368-355877462c85 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:40.946631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-374bacd3-df1a-46ad-a368-355877462c85 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:40.949414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-374bacd3-df1a-46ad-a368-355877462c85 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:41.405346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9c712dd-f116-4413-9396-7b7741811aaa tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:41.416818 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b9c712dd-f116-4413-9396-7b7741811aaa tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1697 microversion: 2.1 time: 0.662458 Oct 24 10:55:41.426630 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2822/5676] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:40 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1697 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:41.479217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-374bacd3-df1a-46ad-a368-355877462c85 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:41.493713 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-374bacd3-df1a-46ad-a368-355877462c85 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.577642 Oct 24 10:55:41.497189 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2855/5677] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:40 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:55:41.703626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ceb78cb3-19ae-4b3a-ab52-de7132d78e6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1181855435", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:41.803228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-ceb78cb3-19ae-4b3a-ab52-de7132d78e6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] validate_networks() for [('33496d87-63b8-423d-9b93-72eddb64dec3', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:55:42.443981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5b73d19d-108f-47dc-bc0b-c827b410760e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:42.444619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5b73d19d-108f-47dc-bc0b-c827b410760e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:42.462254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b73d19d-108f-47dc-bc0b-c827b410760e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:42.463923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b73d19d-108f-47dc-bc0b-c827b410760e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:42.464417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b73d19d-108f-47dc-bc0b-c827b410760e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:42.469241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b73d19d-108f-47dc-bc0b-c827b410760e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:42.469241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b73d19d-108f-47dc-bc0b-c827b410760e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:42.469241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b73d19d-108f-47dc-bc0b-c827b410760e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:42.866600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5b73d19d-108f-47dc-bc0b-c827b410760e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:42.890215 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5b73d19d-108f-47dc-bc0b-c827b410760e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1697 microversion: 2.1 time: 0.441604 Oct 24 10:55:42.904880 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2856/5678] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:42 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1697 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:43.045403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ceb78cb3-19ae-4b3a-ab52-de7132d78e6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:55:43.046984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ceb78cb3-19ae-4b3a-ab52-de7132d78e6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:55:43.047478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ceb78cb3-19ae-4b3a-ab52-de7132d78e6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:55:43.049672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ceb78cb3-19ae-4b3a-ab52-de7132d78e6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:55:43.050995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ceb78cb3-19ae-4b3a-ab52-de7132d78e6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:55:43.067047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb78cb3-19ae-4b3a-ab52-de7132d78e6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:43.067610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb78cb3-19ae-4b3a-ab52-de7132d78e6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:43.068065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb78cb3-19ae-4b3a-ab52-de7132d78e6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:43.069298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb78cb3-19ae-4b3a-ab52-de7132d78e6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:43.071028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb78cb3-19ae-4b3a-ab52-de7132d78e6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:43.071680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ceb78cb3-19ae-4b3a-ab52-de7132d78e6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:43.100394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ceb78cb3-19ae-4b3a-ab52-de7132d78e6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Getting quotas for project 9dca3140620f4022b1bd7d610163be77. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:55:43.107254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ceb78cb3-19ae-4b3a-ab52-de7132d78e6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Getting quotas for user a38c757a515e4a3aa80f82441feef50e and project 9dca3140620f4022b1bd7d610163be77. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:55:43.133394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ceb78cb3-19ae-4b3a-ab52-de7132d78e6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:55:43.140081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ceb78cb3-19ae-4b3a-ab52-de7132d78e6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:55:43.240394 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ceb78cb3-19ae-4b3a-ab52-de7132d78e6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.543426 Oct 24 10:55:43.241118 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2823/5679] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:55:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:55:43.255400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1ce9e031-0491-4a9e-8ae1-e458f61ac191 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:43.256881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1ce9e031-0491-4a9e-8ae1-e458f61ac191 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:43.267138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:43.349804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1ce9e031-0491-4a9e-8ae1-e458f61ac191 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:43.358498 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1ce9e031-0491-4a9e-8ae1-e458f61ac191 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1217 microversion: 2.1 time: 0.107591 Oct 24 10:55:43.374921 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2857/5680] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:43 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1217 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:43.922803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0b888648-3dda-4a94-b24d-c2a4bde7c8dd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:43.923516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0b888648-3dda-4a94-b24d-c2a4bde7c8dd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:43.930540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:43.947406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b888648-3dda-4a94-b24d-c2a4bde7c8dd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:43.947976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b888648-3dda-4a94-b24d-c2a4bde7c8dd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:43.948414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b888648-3dda-4a94-b24d-c2a4bde7c8dd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:43.953136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b888648-3dda-4a94-b24d-c2a4bde7c8dd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:43.953762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b888648-3dda-4a94-b24d-c2a4bde7c8dd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:43.955281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b888648-3dda-4a94-b24d-c2a4bde7c8dd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:44.384465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0b888648-3dda-4a94-b24d-c2a4bde7c8dd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:44.387977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6904ceec-4372-4545-906f-05131f5a2abd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:44.388717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6904ceec-4372-4545-906f-05131f5a2abd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:44.399736 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0b888648-3dda-4a94-b24d-c2a4bde7c8dd tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1697 microversion: 2.1 time: 0.483365 Oct 24 10:55:44.403075 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2824/5681] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:43 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1697 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:44.407328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6904ceec-4372-4545-906f-05131f5a2abd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:44.409994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6904ceec-4372-4545-906f-05131f5a2abd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:44.411731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6904ceec-4372-4545-906f-05131f5a2abd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:44.414313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6904ceec-4372-4545-906f-05131f5a2abd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:44.414804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6904ceec-4372-4545-906f-05131f5a2abd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:44.418444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6904ceec-4372-4545-906f-05131f5a2abd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:44.563374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6904ceec-4372-4545-906f-05131f5a2abd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:44.574332 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6904ceec-4372-4545-906f-05131f5a2abd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1213 microversion: 2.1 time: 0.190586 Oct 24 10:55:44.595182 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2858/5682] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:44 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1213 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:55:45.427818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4363c743-cd59-4a02-80ea-941a713f80ca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:45.428452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4363c743-cd59-4a02-80ea-941a713f80ca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:45.440405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4363c743-cd59-4a02-80ea-941a713f80ca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:45.440828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4363c743-cd59-4a02-80ea-941a713f80ca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:45.441399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4363c743-cd59-4a02-80ea-941a713f80ca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:45.447425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4363c743-cd59-4a02-80ea-941a713f80ca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:45.448000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4363c743-cd59-4a02-80ea-941a713f80ca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:45.451269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4363c743-cd59-4a02-80ea-941a713f80ca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:45.607887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3da52b5f-caf2-4b9f-837d-35840e439c54 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:45.608936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3da52b5f-caf2-4b9f-837d-35840e439c54 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:45.626120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3da52b5f-caf2-4b9f-837d-35840e439c54 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:45.627155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3da52b5f-caf2-4b9f-837d-35840e439c54 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:45.629220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3da52b5f-caf2-4b9f-837d-35840e439c54 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:45.630269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3da52b5f-caf2-4b9f-837d-35840e439c54 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:45.632651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3da52b5f-caf2-4b9f-837d-35840e439c54 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:45.636015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3da52b5f-caf2-4b9f-837d-35840e439c54 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:45.943513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3da52b5f-caf2-4b9f-837d-35840e439c54 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:45.960255 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3da52b5f-caf2-4b9f-837d-35840e439c54 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1287 microversion: 2.1 time: 0.361568 Oct 24 10:55:45.961664 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2859/5683] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:45 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1287 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:46.021228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4363c743-cd59-4a02-80ea-941a713f80ca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:46.029639 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4363c743-cd59-4a02-80ea-941a713f80ca tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1696 microversion: 2.1 time: 0.605751 Oct 24 10:55:46.034677 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2825/5684] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:45 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1696 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:46.524974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3da52b5f-caf2-4b9f-837d-35840e439c54 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:46.525953 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3da52b5f-caf2-4b9f-837d-35840e439c54 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001655 Oct 24 10:55:46.526294 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2860/5685] 10.222.0.50 () {56 vars in 886 bytes} [Mon Oct 24 10:55:46 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 24 10:55:46.987965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-669e4ae9-885f-4f7f-8e01-4d150235a856 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:46.988441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-669e4ae9-885f-4f7f-8e01-4d150235a856 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:47.001199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-669e4ae9-885f-4f7f-8e01-4d150235a856 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:47.001700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-669e4ae9-885f-4f7f-8e01-4d150235a856 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:47.003979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-669e4ae9-885f-4f7f-8e01-4d150235a856 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:47.004919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-669e4ae9-885f-4f7f-8e01-4d150235a856 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:47.005394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-669e4ae9-885f-4f7f-8e01-4d150235a856 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:47.005836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-669e4ae9-885f-4f7f-8e01-4d150235a856 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:47.059825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5a135e5e-394c-43b3-8dc0-dd9886170fa7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:47.065345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5a135e5e-394c-43b3-8dc0-dd9886170fa7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:47.074596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a135e5e-394c-43b3-8dc0-dd9886170fa7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:47.076685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a135e5e-394c-43b3-8dc0-dd9886170fa7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:47.079535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a135e5e-394c-43b3-8dc0-dd9886170fa7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:47.080929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a135e5e-394c-43b3-8dc0-dd9886170fa7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:47.082008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a135e5e-394c-43b3-8dc0-dd9886170fa7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:47.082970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a135e5e-394c-43b3-8dc0-dd9886170fa7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:47.179343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-669e4ae9-885f-4f7f-8e01-4d150235a856 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:47.192199 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-669e4ae9-885f-4f7f-8e01-4d150235a856 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1275 microversion: 2.1 time: 0.208353 Oct 24 10:55:47.193692 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2826/5686] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:46 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1275 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:47.223298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e6e32cc0-3907-4ce0-bd00-710eac44739a req-e6eb2930-de0a-46a4-89ce-8579d739cb7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfd7080-7dfd-489b-8128-0e66aec16fff", "name": "network-vif-unplugged", "status": "completed", "tag": "2cae1fc6-3659-43fd-97c3-9b936fe09a4e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:47.243550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e6e32cc0-3907-4ce0-bd00-710eac44739a req-e6eb2930-de0a-46a4-89ce-8579d739cb7c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:47.244306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e6e32cc0-3907-4ce0-bd00-710eac44739a req-e6eb2930-de0a-46a4-89ce-8579d739cb7c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:47.245064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e6e32cc0-3907-4ce0-bd00-710eac44739a req-e6eb2930-de0a-46a4-89ce-8579d739cb7c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:47.267201 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e6e32cc0-3907-4ce0-bd00-710eac44739a req-e6eb2930-de0a-46a4-89ce-8579d739cb7c service nova] Creating event network-vif-unplugged:2cae1fc6-3659-43fd-97c3-9b936fe09a4e for instance 3bfd7080-7dfd-489b-8128-0e66aec16fff on n-h2-858383-15 Oct 24 10:55:47.298517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-e6e32cc0-3907-4ce0-bd00-710eac44739a req-e6eb2930-de0a-46a4-89ce-8579d739cb7c service nova] Instance 3bfd7080-7dfd-489b-8128-0e66aec16fff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:55:47.380877 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e6e32cc0-3907-4ce0-bd00-710eac44739a req-e6eb2930-de0a-46a4-89ce-8579d739cb7c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167096 Oct 24 10:55:47.385753 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2827/5687] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:55:47.411550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5a135e5e-394c-43b3-8dc0-dd9886170fa7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:47.424023 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5a135e5e-394c-43b3-8dc0-dd9886170fa7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1696 microversion: 2.1 time: 0.367683 Oct 24 10:55:47.439481 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2861/5688] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:47 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1696 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:55:48.227339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-37712730-eda6-40c8-9b6e-3928483429d8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:48.228678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-37712730-eda6-40c8-9b6e-3928483429d8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:48.239539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37712730-eda6-40c8-9b6e-3928483429d8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:48.239996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37712730-eda6-40c8-9b6e-3928483429d8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:48.240717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37712730-eda6-40c8-9b6e-3928483429d8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:48.241627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37712730-eda6-40c8-9b6e-3928483429d8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:48.242131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37712730-eda6-40c8-9b6e-3928483429d8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:48.242622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37712730-eda6-40c8-9b6e-3928483429d8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:48.454385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ebbda280-854d-48ff-9cdd-7fba4ef8f823 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:48.455893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ebbda280-854d-48ff-9cdd-7fba4ef8f823 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:48.475777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebbda280-854d-48ff-9cdd-7fba4ef8f823 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:48.476415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebbda280-854d-48ff-9cdd-7fba4ef8f823 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:48.477025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebbda280-854d-48ff-9cdd-7fba4ef8f823 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:48.480349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebbda280-854d-48ff-9cdd-7fba4ef8f823 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:48.481504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebbda280-854d-48ff-9cdd-7fba4ef8f823 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:48.482072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebbda280-854d-48ff-9cdd-7fba4ef8f823 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:48.570637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-37712730-eda6-40c8-9b6e-3928483429d8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:48.582525 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-37712730-eda6-40c8-9b6e-3928483429d8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1317 microversion: 2.1 time: 0.365823 Oct 24 10:55:48.585527 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2828/5689] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:48 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:48.809151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0db68b03-46d9-45c7-819b-981de5f32a19 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:48.813104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0db68b03-46d9-45c7-819b-981de5f32a19 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:48.830763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0db68b03-46d9-45c7-819b-981de5f32a19 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:48.832705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0db68b03-46d9-45c7-819b-981de5f32a19 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:48.833360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0db68b03-46d9-45c7-819b-981de5f32a19 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:48.834262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0db68b03-46d9-45c7-819b-981de5f32a19 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:48.837170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0db68b03-46d9-45c7-819b-981de5f32a19 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:48.838330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0db68b03-46d9-45c7-819b-981de5f32a19 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:48.895547 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0db68b03-46d9-45c7-819b-981de5f32a19 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092425 Oct 24 10:55:48.903405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ebbda280-854d-48ff-9cdd-7fba4ef8f823 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:48.908048 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2829/5690] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:55:48 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:55:48.916508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b0145036-a480-4a60-bb78-e46483af225c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:48.917585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b0145036-a480-4a60-bb78-e46483af225c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:48.927125 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ebbda280-854d-48ff-9cdd-7fba4ef8f823 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1696 microversion: 2.1 time: 0.477937 Oct 24 10:55:48.927660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0145036-a480-4a60-bb78-e46483af225c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:48.928426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0145036-a480-4a60-bb78-e46483af225c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:48.928941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0145036-a480-4a60-bb78-e46483af225c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:48.929444 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2862/5691] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:48 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1696 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:48.936523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0145036-a480-4a60-bb78-e46483af225c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:48.938487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0145036-a480-4a60-bb78-e46483af225c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:48.938960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b0145036-a480-4a60-bb78-e46483af225c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:49.005288 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b0145036-a480-4a60-bb78-e46483af225c tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments/401f4d71-694f-4c30-8f0c-37366b27b49b" status: 200 len: 194 microversion: 2.1 time: 0.095701 Oct 24 10:55:49.013005 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2830/5692] 10.222.0.50 () {58 vars in 1413 bytes} [Mon Oct 24 10:55:48 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments/401f4d71-694f-4c30-8f0c-37366b27b49b => generated 194 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:55:49.295823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-24262753-1066-4a43-ae1a-b19fe6b9018c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:49.299508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-24262753-1066-4a43-ae1a-b19fe6b9018c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:49.330085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24262753-1066-4a43-ae1a-b19fe6b9018c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:49.331280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24262753-1066-4a43-ae1a-b19fe6b9018c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:49.331758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24262753-1066-4a43-ae1a-b19fe6b9018c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:49.332560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24262753-1066-4a43-ae1a-b19fe6b9018c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:49.338117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24262753-1066-4a43-ae1a-b19fe6b9018c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:49.341423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24262753-1066-4a43-ae1a-b19fe6b9018c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:49.531858 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-24262753-1066-4a43-ae1a-b19fe6b9018c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "POST /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98/action" status: 200 len: 24573 microversion: 2.1 time: 0.241338 Oct 24 10:55:49.534010 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2863/5693] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:55:49 2022] POST /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98/action => generated 24573 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:55:49.614466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a2e8b131-0b4d-468a-9684-05b04b52d7f9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:49.615215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a2e8b131-0b4d-468a-9684-05b04b52d7f9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:49.631256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2e8b131-0b4d-468a-9684-05b04b52d7f9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:49.636656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2e8b131-0b4d-468a-9684-05b04b52d7f9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:49.640915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2e8b131-0b4d-468a-9684-05b04b52d7f9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:49.646705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2e8b131-0b4d-468a-9684-05b04b52d7f9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:49.648986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2e8b131-0b4d-468a-9684-05b04b52d7f9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:49.650698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a2e8b131-0b4d-468a-9684-05b04b52d7f9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:49.955399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-858914ae-db9e-4050-b068-6408ac43f7a3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:49.956267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-858914ae-db9e-4050-b068-6408ac43f7a3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:49.982041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-858914ae-db9e-4050-b068-6408ac43f7a3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:49.982640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-858914ae-db9e-4050-b068-6408ac43f7a3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:49.985371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-858914ae-db9e-4050-b068-6408ac43f7a3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:49.986151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-858914ae-db9e-4050-b068-6408ac43f7a3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:49.988107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-858914ae-db9e-4050-b068-6408ac43f7a3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:49.988578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-858914ae-db9e-4050-b068-6408ac43f7a3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:50.007275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a2e8b131-0b4d-468a-9684-05b04b52d7f9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:50.016618 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a2e8b131-0b4d-468a-9684-05b04b52d7f9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1317 microversion: 2.1 time: 0.411456 Oct 24 10:55:50.025222 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2831/5694] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:49 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1317 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:50.097250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c7aba98d-45ec-4000-8b72-f34124e69117 req-6748a180-924e-4dd3-9b72-6d80e85d09fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bfd7080-7dfd-489b-8128-0e66aec16fff", "tag": "2cae1fc6-3659-43fd-97c3-9b936fe09a4e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:50.143225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c7aba98d-45ec-4000-8b72-f34124e69117 req-6748a180-924e-4dd3-9b72-6d80e85d09fc service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:50.143646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c7aba98d-45ec-4000-8b72-f34124e69117 req-6748a180-924e-4dd3-9b72-6d80e85d09fc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:50.151157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c7aba98d-45ec-4000-8b72-f34124e69117 req-6748a180-924e-4dd3-9b72-6d80e85d09fc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:50.198384 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c7aba98d-45ec-4000-8b72-f34124e69117 req-6748a180-924e-4dd3-9b72-6d80e85d09fc service nova] Creating event network-changed:2cae1fc6-3659-43fd-97c3-9b936fe09a4e for instance 3bfd7080-7dfd-489b-8128-0e66aec16fff on n-h2-858383-15 Oct 24 10:55:50.235776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-c7aba98d-45ec-4000-8b72-f34124e69117 req-6748a180-924e-4dd3-9b72-6d80e85d09fc service nova] Instance 3bfd7080-7dfd-489b-8128-0e66aec16fff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:55:50.287157 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c7aba98d-45ec-4000-8b72-f34124e69117 req-6748a180-924e-4dd3-9b72-6d80e85d09fc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193870 Oct 24 10:55:50.288507 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2832/5695] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:55:50.505538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-858914ae-db9e-4050-b068-6408ac43f7a3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:50.519654 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-858914ae-db9e-4050-b068-6408ac43f7a3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1696 microversion: 2.1 time: 0.569515 Oct 24 10:55:50.520861 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2864/5696] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:49 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1696 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:51.046505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-01672a34-9782-4f41-956f-358fe2a7a09d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:51.047222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-01672a34-9782-4f41-956f-358fe2a7a09d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:51.067944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01672a34-9782-4f41-956f-358fe2a7a09d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:51.072571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01672a34-9782-4f41-956f-358fe2a7a09d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:51.074297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01672a34-9782-4f41-956f-358fe2a7a09d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:51.075971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01672a34-9782-4f41-956f-358fe2a7a09d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:51.077264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01672a34-9782-4f41-956f-358fe2a7a09d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:51.078093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01672a34-9782-4f41-956f-358fe2a7a09d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:51.274807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6f9320ea-d3b0-4bc4-a2c1-35c6e81c75b6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1977511508", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:51.329725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-01672a34-9782-4f41-956f-358fe2a7a09d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:51.342902 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-01672a34-9782-4f41-956f-358fe2a7a09d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1317 microversion: 2.1 time: 0.299861 Oct 24 10:55:51.343747 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2833/5697] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:51 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:51.391732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-6f9320ea-d3b0-4bc4-a2c1-35c6e81c75b6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] validate_networks() for None {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:55:51.543987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a221398-5deb-45fc-b445-178bf8e1bfc7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:51.544620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0a221398-5deb-45fc-b445-178bf8e1bfc7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:51.562394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a221398-5deb-45fc-b445-178bf8e1bfc7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:51.562901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a221398-5deb-45fc-b445-178bf8e1bfc7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:51.563352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a221398-5deb-45fc-b445-178bf8e1bfc7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:51.569770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a221398-5deb-45fc-b445-178bf8e1bfc7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:51.570868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a221398-5deb-45fc-b445-178bf8e1bfc7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:51.571481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a221398-5deb-45fc-b445-178bf8e1bfc7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:51.934297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6f9320ea-d3b0-4bc4-a2c1-35c6e81c75b6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:55:51.935085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6f9320ea-d3b0-4bc4-a2c1-35c6e81c75b6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:55:51.936737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6f9320ea-d3b0-4bc4-a2c1-35c6e81c75b6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:55:51.937765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6f9320ea-d3b0-4bc4-a2c1-35c6e81c75b6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:55:51.938603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-6f9320ea-d3b0-4bc4-a2c1-35c6e81c75b6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:55:51.958261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f9320ea-d3b0-4bc4-a2c1-35c6e81c75b6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:51.959479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f9320ea-d3b0-4bc4-a2c1-35c6e81c75b6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:51.960236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f9320ea-d3b0-4bc4-a2c1-35c6e81c75b6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:51.961309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f9320ea-d3b0-4bc4-a2c1-35c6e81c75b6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:51.962801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f9320ea-d3b0-4bc4-a2c1-35c6e81c75b6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:51.963553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f9320ea-d3b0-4bc4-a2c1-35c6e81c75b6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:51.973275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0a221398-5deb-45fc-b445-178bf8e1bfc7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:51.989047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-6f9320ea-d3b0-4bc4-a2c1-35c6e81c75b6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Getting quotas for project 5091683189114d928b6978b362a4182b. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:55:51.993059 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0a221398-5deb-45fc-b445-178bf8e1bfc7 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1696 microversion: 2.1 time: 0.444976 Oct 24 10:55:51.993760 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2834/5698] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:51 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1696 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:51.997382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-6f9320ea-d3b0-4bc4-a2c1-35c6e81c75b6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Getting quotas for user e73d995c472441569251b09450f9be70 and project 5091683189114d928b6978b362a4182b. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:55:52.041091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6f9320ea-d3b0-4bc4-a2c1-35c6e81c75b6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:55:52.049493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6f9320ea-d3b0-4bc4-a2c1-35c6e81c75b6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:55:52.137953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-41535718-45d3-4fd8-b92b-876d2d9cd2ac tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78b93498-7dc2-4e3a-bf5f-26545d6a7ad2"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:52.142744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-41535718-45d3-4fd8-b92b-876d2d9cd2ac tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:52.150516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41535718-45d3-4fd8-b92b-876d2d9cd2ac tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:52.151366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41535718-45d3-4fd8-b92b-876d2d9cd2ac tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:52.152017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41535718-45d3-4fd8-b92b-876d2d9cd2ac tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:52.153445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41535718-45d3-4fd8-b92b-876d2d9cd2ac tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:52.154626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41535718-45d3-4fd8-b92b-876d2d9cd2ac tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:52.155260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41535718-45d3-4fd8-b92b-876d2d9cd2ac tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:52.164703 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6f9320ea-d3b0-4bc4-a2c1-35c6e81c75b6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892097 Oct 24 10:55:52.165428 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2865/5699] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:55:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 10:55:52.185536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5c626898-ee9d-450d-ae1a-1e54006233a2 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:52.189242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5c626898-ee9d-450d-ae1a-1e54006233a2 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:52.286889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5c626898-ee9d-450d-ae1a-1e54006233a2 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73d995c472441569251b09450f9be70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5091683189114d928b6978b362a4182b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:52.311968 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5c626898-ee9d-450d-ae1a-1e54006233a2 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 200 len: 1215 microversion: 2.1 time: 0.129709 Oct 24 10:55:52.336096 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2866/5700] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:52 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:52.374190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-77354002-6b51-4fe0-a2dd-8c34b6cd3663 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:52.374957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-77354002-6b51-4fe0-a2dd-8c34b6cd3663 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:52.392051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77354002-6b51-4fe0-a2dd-8c34b6cd3663 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:52.393858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77354002-6b51-4fe0-a2dd-8c34b6cd3663 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:52.394310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77354002-6b51-4fe0-a2dd-8c34b6cd3663 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:52.397878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77354002-6b51-4fe0-a2dd-8c34b6cd3663 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:52.398518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77354002-6b51-4fe0-a2dd-8c34b6cd3663 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:52.400731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77354002-6b51-4fe0-a2dd-8c34b6cd3663 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:52.696115 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-41535718-45d3-4fd8-b92b-876d2d9cd2ac tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "POST /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.561772 Oct 24 10:55:52.698322 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2835/5701] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 10:55:52 2022] POST /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments => generated 194 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:55:52.771162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-77354002-6b51-4fe0-a2dd-8c34b6cd3663 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:52.784285 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-77354002-6b51-4fe0-a2dd-8c34b6cd3663 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1317 microversion: 2.1 time: 0.416527 Oct 24 10:55:52.784903 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2867/5702] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:52 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:53.029244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d576bbe2-0d4d-4daf-8b16-7401f4a3e33f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:53.030254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d576bbe2-0d4d-4daf-8b16-7401f4a3e33f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:53.069463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d576bbe2-0d4d-4daf-8b16-7401f4a3e33f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:53.069972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d576bbe2-0d4d-4daf-8b16-7401f4a3e33f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:53.070516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d576bbe2-0d4d-4daf-8b16-7401f4a3e33f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:53.071195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d576bbe2-0d4d-4daf-8b16-7401f4a3e33f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:53.071656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d576bbe2-0d4d-4daf-8b16-7401f4a3e33f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:53.073133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d576bbe2-0d4d-4daf-8b16-7401f4a3e33f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:53.082312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:53.131100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:53.132450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:53.346452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8a8e887b-1c65-4ca1-8c89-0d4d0ca3ce4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:53.347397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8a8e887b-1c65-4ca1-8c89-0d4d0ca3ce4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:53.362590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a8e887b-1c65-4ca1-8c89-0d4d0ca3ce4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:53.366801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a8e887b-1c65-4ca1-8c89-0d4d0ca3ce4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:53.371126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a8e887b-1c65-4ca1-8c89-0d4d0ca3ce4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:53.374481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a8e887b-1c65-4ca1-8c89-0d4d0ca3ce4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:53.377945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a8e887b-1c65-4ca1-8c89-0d4d0ca3ce4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:53.378739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a8e887b-1c65-4ca1-8c89-0d4d0ca3ce4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:53.577652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d576bbe2-0d4d-4daf-8b16-7401f4a3e33f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:53.597026 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d576bbe2-0d4d-4daf-8b16-7401f4a3e33f tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1694 microversion: 2.1 time: 0.579100 Oct 24 10:55:53.608289 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2836/5703] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:53 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1694 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:53.616362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d9a4f24e-cd92-4bab-a5eb-2e87acc04041 req-2afc8c72-9ab4-4459-b6e3-09fd2dbf85e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce02187-96ed-47b2-b572-b97ce0840c19", "tag": "b06ad187-f316-40e5-b778-545cf083f9ca"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:53.656650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d9a4f24e-cd92-4bab-a5eb-2e87acc04041 req-2afc8c72-9ab4-4459-b6e3-09fd2dbf85e3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:53.657068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d9a4f24e-cd92-4bab-a5eb-2e87acc04041 req-2afc8c72-9ab4-4459-b6e3-09fd2dbf85e3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:53.657686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d9a4f24e-cd92-4bab-a5eb-2e87acc04041 req-2afc8c72-9ab4-4459-b6e3-09fd2dbf85e3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:53.680276 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d9a4f24e-cd92-4bab-a5eb-2e87acc04041 req-2afc8c72-9ab4-4459-b6e3-09fd2dbf85e3 service nova] Creating event network-changed:b06ad187-f316-40e5-b778-545cf083f9ca for instance bce02187-96ed-47b2-b572-b97ce0840c19 on n-h2-858383-15 Oct 24 10:55:53.684951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8a8e887b-1c65-4ca1-8c89-0d4d0ca3ce4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73d995c472441569251b09450f9be70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5091683189114d928b6978b362a4182b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:53.686747 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d9a4f24e-cd92-4bab-a5eb-2e87acc04041 req-2afc8c72-9ab4-4459-b6e3-09fd2dbf85e3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075829 Oct 24 10:55:53.687824 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2837/5704] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:55:53.698121 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8a8e887b-1c65-4ca1-8c89-0d4d0ca3ce4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 200 len: 1211 microversion: 2.1 time: 0.360631 Oct 24 10:55:53.698738 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2868/5705] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:53 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 1211 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:53.813199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5083479c-d9b9-4237-a843-ce2a346bf5bf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:53.813911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5083479c-d9b9-4237-a843-ce2a346bf5bf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:53.826370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5083479c-d9b9-4237-a843-ce2a346bf5bf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:53.828605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5083479c-d9b9-4237-a843-ce2a346bf5bf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:53.829089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5083479c-d9b9-4237-a843-ce2a346bf5bf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:53.831945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5083479c-d9b9-4237-a843-ce2a346bf5bf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:53.832612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5083479c-d9b9-4237-a843-ce2a346bf5bf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:53.834137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5083479c-d9b9-4237-a843-ce2a346bf5bf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:54.102808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5083479c-d9b9-4237-a843-ce2a346bf5bf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:54.123117 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5083479c-d9b9-4237-a843-ce2a346bf5bf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1317 microversion: 2.1 time: 0.312235 Oct 24 10:55:54.127108 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2838/5706] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:53 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:54.627526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3fba9b9f-54dd-4bf6-ad1d-6a87f16d47f0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:54.628164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3fba9b9f-54dd-4bf6-ad1d-6a87f16d47f0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:54.644497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fba9b9f-54dd-4bf6-ad1d-6a87f16d47f0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:54.645028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fba9b9f-54dd-4bf6-ad1d-6a87f16d47f0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:54.645480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fba9b9f-54dd-4bf6-ad1d-6a87f16d47f0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:54.646202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fba9b9f-54dd-4bf6-ad1d-6a87f16d47f0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:54.646669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fba9b9f-54dd-4bf6-ad1d-6a87f16d47f0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:54.647124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fba9b9f-54dd-4bf6-ad1d-6a87f16d47f0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:54.669522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:55:54.723135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2d2aaba1-7d03-4a25-8695-b7ca24077fff tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:54.723759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2d2aaba1-7d03-4a25-8695-b7ca24077fff tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:54.740201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d2aaba1-7d03-4a25-8695-b7ca24077fff tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:54.740703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d2aaba1-7d03-4a25-8695-b7ca24077fff tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:54.741175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d2aaba1-7d03-4a25-8695-b7ca24077fff tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:54.741899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d2aaba1-7d03-4a25-8695-b7ca24077fff tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:54.742355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d2aaba1-7d03-4a25-8695-b7ca24077fff tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:54.742784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d2aaba1-7d03-4a25-8695-b7ca24077fff tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:55.434880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2d2aaba1-7d03-4a25-8695-b7ca24077fff tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73d995c472441569251b09450f9be70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5091683189114d928b6978b362a4182b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:55.447606 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2d2aaba1-7d03-4a25-8695-b7ca24077fff tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 200 len: 1273 microversion: 2.1 time: 0.725374 Oct 24 10:55:55.460942 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2839/5707] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:54 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 1273 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:55.460942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-da3cb840-ceab-46dc-a822-31d7d93fa443 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:55.460942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-da3cb840-ceab-46dc-a822-31d7d93fa443 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:55.479898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da3cb840-ceab-46dc-a822-31d7d93fa443 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:55.480612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da3cb840-ceab-46dc-a822-31d7d93fa443 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:55.481136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da3cb840-ceab-46dc-a822-31d7d93fa443 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:55.482759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da3cb840-ceab-46dc-a822-31d7d93fa443 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:55.483169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da3cb840-ceab-46dc-a822-31d7d93fa443 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:55.483852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da3cb840-ceab-46dc-a822-31d7d93fa443 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:55.533319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3fba9b9f-54dd-4bf6-ad1d-6a87f16d47f0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:55.545723 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3fba9b9f-54dd-4bf6-ad1d-6a87f16d47f0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1691 microversion: 2.1 time: 0.923402 Oct 24 10:55:55.548439 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2869/5708] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:54 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1691 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:55.571219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d2a3a927-5029-4553-8d23-58244b7f3d0c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:55.572166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d2a3a927-5029-4553-8d23-58244b7f3d0c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:55.580989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2a3a927-5029-4553-8d23-58244b7f3d0c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:55.581866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2a3a927-5029-4553-8d23-58244b7f3d0c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:55.582569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2a3a927-5029-4553-8d23-58244b7f3d0c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:55.583558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2a3a927-5029-4553-8d23-58244b7f3d0c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:55.584239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2a3a927-5029-4553-8d23-58244b7f3d0c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:55.584933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2a3a927-5029-4553-8d23-58244b7f3d0c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:55.716157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-da3cb840-ceab-46dc-a822-31d7d93fa443 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:55.727365 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-da3cb840-ceab-46dc-a822-31d7d93fa443 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1317 microversion: 2.1 time: 0.276130 Oct 24 10:55:55.728445 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2840/5709] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:55 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:55.799704 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d2a3a927-5029-4553-8d23-58244b7f3d0c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff/action" status: 202 len: 0 microversion: 2.1 time: 0.232125 Oct 24 10:55:55.800318 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2870/5710] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:55:55 2022] POST /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:55:55.812042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00153083-9d65-4640-834a-43e48323e130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:55.815942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00153083-9d65-4640-834a-43e48323e130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:55.828435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00153083-9d65-4640-834a-43e48323e130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:55.829651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00153083-9d65-4640-834a-43e48323e130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:55.830342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00153083-9d65-4640-834a-43e48323e130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:55.832512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00153083-9d65-4640-834a-43e48323e130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:55.833558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00153083-9d65-4640-834a-43e48323e130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:55.834215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00153083-9d65-4640-834a-43e48323e130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:56.060368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-00153083-9d65-4640-834a-43e48323e130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:56.070699 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-00153083-9d65-4640-834a-43e48323e130 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1690 microversion: 2.1 time: 0.265251 Oct 24 10:55:56.081893 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2841/5711] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:55 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1690 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:56.475562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-05c167ac-a0a7-42af-86ac-d6b9daa75ae9 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:56.476725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-05c167ac-a0a7-42af-86ac-d6b9daa75ae9 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:56.485686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05c167ac-a0a7-42af-86ac-d6b9daa75ae9 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:56.486577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05c167ac-a0a7-42af-86ac-d6b9daa75ae9 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:56.487263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05c167ac-a0a7-42af-86ac-d6b9daa75ae9 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:56.488302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05c167ac-a0a7-42af-86ac-d6b9daa75ae9 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:56.489069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05c167ac-a0a7-42af-86ac-d6b9daa75ae9 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:56.489759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05c167ac-a0a7-42af-86ac-d6b9daa75ae9 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:56.587369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-05c167ac-a0a7-42af-86ac-d6b9daa75ae9 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73d995c472441569251b09450f9be70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5091683189114d928b6978b362a4182b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:56.602486 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-05c167ac-a0a7-42af-86ac-d6b9daa75ae9 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 200 len: 1273 microversion: 2.1 time: 0.131604 Oct 24 10:55:56.611494 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2871/5712] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:56 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 1273 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:56.665622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-8aee4b1a-73d5-4b5d-a66a-36df7b722d22 req-5e910fa1-2df9-4982-8736-d2326b669ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfd7080-7dfd-489b-8128-0e66aec16fff", "name": "network-vif-plugged", "status": "completed", "tag": "2cae1fc6-3659-43fd-97c3-9b936fe09a4e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:55:56.689300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8aee4b1a-73d5-4b5d-a66a-36df7b722d22 req-5e910fa1-2df9-4982-8736-d2326b669ff0 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:56.690052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8aee4b1a-73d5-4b5d-a66a-36df7b722d22 req-5e910fa1-2df9-4982-8736-d2326b669ff0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:56.690685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8aee4b1a-73d5-4b5d-a66a-36df7b722d22 req-5e910fa1-2df9-4982-8736-d2326b669ff0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:56.719450 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-8aee4b1a-73d5-4b5d-a66a-36df7b722d22 req-5e910fa1-2df9-4982-8736-d2326b669ff0 service nova] Creating event network-vif-plugged:2cae1fc6-3659-43fd-97c3-9b936fe09a4e for instance 3bfd7080-7dfd-489b-8128-0e66aec16fff on n-h2-858383-15 Oct 24 10:55:56.728378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-8aee4b1a-73d5-4b5d-a66a-36df7b722d22 req-5e910fa1-2df9-4982-8736-d2326b669ff0 service nova] Instance 3bfd7080-7dfd-489b-8128-0e66aec16fff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:55:56.751753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7f638c4a-ec9f-4af3-b969-d6442b430c97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:56.752700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7f638c4a-ec9f-4af3-b969-d6442b430c97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:56.772212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f638c4a-ec9f-4af3-b969-d6442b430c97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:56.773259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f638c4a-ec9f-4af3-b969-d6442b430c97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:56.773929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f638c4a-ec9f-4af3-b969-d6442b430c97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:56.787045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f638c4a-ec9f-4af3-b969-d6442b430c97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:56.789369 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-8aee4b1a-73d5-4b5d-a66a-36df7b722d22 req-5e910fa1-2df9-4982-8736-d2326b669ff0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127372 Oct 24 10:55:56.790207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f638c4a-ec9f-4af3-b969-d6442b430c97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:56.791940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f638c4a-ec9f-4af3-b969-d6442b430c97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:56.801812 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2842/5713] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:55:57.069403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7f638c4a-ec9f-4af3-b969-d6442b430c97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:57.085437 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7f638c4a-ec9f-4af3-b969-d6442b430c97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1317 microversion: 2.1 time: 0.336855 Oct 24 10:55:57.098766 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2872/5714] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:56 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:57.104991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8fab02fd-ac89-4fd3-90a3-1458dc79bef2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:57.106087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8fab02fd-ac89-4fd3-90a3-1458dc79bef2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:57.113840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fab02fd-ac89-4fd3-90a3-1458dc79bef2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:57.114686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fab02fd-ac89-4fd3-90a3-1458dc79bef2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:57.115443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fab02fd-ac89-4fd3-90a3-1458dc79bef2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:57.116510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fab02fd-ac89-4fd3-90a3-1458dc79bef2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:57.117714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fab02fd-ac89-4fd3-90a3-1458dc79bef2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:57.118377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fab02fd-ac89-4fd3-90a3-1458dc79bef2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:57.482009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8fab02fd-ac89-4fd3-90a3-1458dc79bef2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:57.495359 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8fab02fd-ac89-4fd3-90a3-1458dc79bef2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1690 microversion: 2.1 time: 0.394041 Oct 24 10:55:57.498721 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2843/5715] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:57 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1690 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:55:57.650398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a866a90e-7776-4fc6-9d8b-429e9406c78a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:57.651032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a866a90e-7776-4fc6-9d8b-429e9406c78a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:57.674729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a866a90e-7776-4fc6-9d8b-429e9406c78a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:57.675231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a866a90e-7776-4fc6-9d8b-429e9406c78a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:57.676280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a866a90e-7776-4fc6-9d8b-429e9406c78a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:57.677320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a866a90e-7776-4fc6-9d8b-429e9406c78a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:57.693710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a866a90e-7776-4fc6-9d8b-429e9406c78a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:57.694278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a866a90e-7776-4fc6-9d8b-429e9406c78a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:57.847129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a866a90e-7776-4fc6-9d8b-429e9406c78a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73d995c472441569251b09450f9be70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5091683189114d928b6978b362a4182b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:57.863945 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a866a90e-7776-4fc6-9d8b-429e9406c78a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 200 len: 1273 microversion: 2.1 time: 0.226021 Oct 24 10:55:57.866592 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2873/5716] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:57 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 1273 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:58.110707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c001eb3b-c605-4ea7-94db-7f700a56bfb2 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:58.112116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c001eb3b-c605-4ea7-94db-7f700a56bfb2 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:58.126247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c001eb3b-c605-4ea7-94db-7f700a56bfb2 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:58.127261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c001eb3b-c605-4ea7-94db-7f700a56bfb2 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:58.128026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c001eb3b-c605-4ea7-94db-7f700a56bfb2 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:58.129001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c001eb3b-c605-4ea7-94db-7f700a56bfb2 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:58.129722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c001eb3b-c605-4ea7-94db-7f700a56bfb2 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:58.130374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c001eb3b-c605-4ea7-94db-7f700a56bfb2 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:58.349890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c001eb3b-c605-4ea7-94db-7f700a56bfb2 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:58.363487 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c001eb3b-c605-4ea7-94db-7f700a56bfb2 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1317 microversion: 2.1 time: 0.254918 Oct 24 10:55:58.365559 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2844/5717] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:58 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:58.521858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e47cbc2-53d4-4602-b618-aed260fae42e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:58.522493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3e47cbc2-53d4-4602-b618-aed260fae42e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:58.540520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e47cbc2-53d4-4602-b618-aed260fae42e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:58.542853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e47cbc2-53d4-4602-b618-aed260fae42e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:58.545291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e47cbc2-53d4-4602-b618-aed260fae42e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:58.548874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e47cbc2-53d4-4602-b618-aed260fae42e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:58.549372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e47cbc2-53d4-4602-b618-aed260fae42e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:58.551160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e47cbc2-53d4-4602-b618-aed260fae42e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:58.891095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9868605b-8023-4fa6-89bc-20fe3f776f78 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:58.891726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9868605b-8023-4fa6-89bc-20fe3f776f78 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:58.912782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9868605b-8023-4fa6-89bc-20fe3f776f78 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:58.913317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9868605b-8023-4fa6-89bc-20fe3f776f78 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:58.913761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9868605b-8023-4fa6-89bc-20fe3f776f78 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:58.922904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9868605b-8023-4fa6-89bc-20fe3f776f78 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:58.923429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9868605b-8023-4fa6-89bc-20fe3f776f78 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:58.923881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9868605b-8023-4fa6-89bc-20fe3f776f78 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:58.959045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3e47cbc2-53d4-4602-b618-aed260fae42e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:58.977442 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3e47cbc2-53d4-4602-b618-aed260fae42e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1690 microversion: 2.1 time: 0.459537 Oct 24 10:55:58.979941 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2874/5718] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:58 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1690 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:59.277753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9868605b-8023-4fa6-89bc-20fe3f776f78 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73d995c472441569251b09450f9be70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5091683189114d928b6978b362a4182b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:59.298354 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9868605b-8023-4fa6-89bc-20fe3f776f78 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 200 len: 1315 microversion: 2.1 time: 0.408491 Oct 24 10:55:59.300172 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2845/5719] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:58 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:55:59.388668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ea01f41d-6c08-4ce6-a9db-064f6f61aafb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:55:59.400194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ea01f41d-6c08-4ce6-a9db-064f6f61aafb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:55:59.409603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea01f41d-6c08-4ce6-a9db-064f6f61aafb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:59.410108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea01f41d-6c08-4ce6-a9db-064f6f61aafb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:59.410551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea01f41d-6c08-4ce6-a9db-064f6f61aafb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:59.411270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea01f41d-6c08-4ce6-a9db-064f6f61aafb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:55:59.413971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea01f41d-6c08-4ce6-a9db-064f6f61aafb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:55:59.414370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea01f41d-6c08-4ce6-a9db-064f6f61aafb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:55:59.757753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ea01f41d-6c08-4ce6-a9db-064f6f61aafb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:55:59.771869 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ea01f41d-6c08-4ce6-a9db-064f6f61aafb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1317 microversion: 2.1 time: 0.388127 Oct 24 10:55:59.772475 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2875/5720] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:59 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:00.003757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-22b6278d-0736-47ab-afd9-15e6b320940c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:00.004765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-22b6278d-0736-47ab-afd9-15e6b320940c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:00.014212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22b6278d-0736-47ab-afd9-15e6b320940c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:00.016758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22b6278d-0736-47ab-afd9-15e6b320940c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:00.019587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22b6278d-0736-47ab-afd9-15e6b320940c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:00.026395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22b6278d-0736-47ab-afd9-15e6b320940c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:00.028311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22b6278d-0736-47ab-afd9-15e6b320940c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:00.029069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22b6278d-0736-47ab-afd9-15e6b320940c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:00.323988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c9841b67-bacb-443f-ae60-7ca79e7b03c6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:00.327310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c9841b67-bacb-443f-ae60-7ca79e7b03c6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:00.339309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9841b67-bacb-443f-ae60-7ca79e7b03c6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:00.340980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9841b67-bacb-443f-ae60-7ca79e7b03c6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:00.342877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9841b67-bacb-443f-ae60-7ca79e7b03c6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:00.343896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9841b67-bacb-443f-ae60-7ca79e7b03c6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:00.346072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9841b67-bacb-443f-ae60-7ca79e7b03c6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:00.347483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9841b67-bacb-443f-ae60-7ca79e7b03c6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:00.891353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-22b6278d-0736-47ab-afd9-15e6b320940c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:00.906322 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-22b6278d-0736-47ab-afd9-15e6b320940c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1690 microversion: 2.1 time: 0.905008 Oct 24 10:56:00.911030 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2846/5721] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:55:59 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1690 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:00.927048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-61216661-7b8f-44cf-b5b2-e1596b0de589 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:00.928051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-61216661-7b8f-44cf-b5b2-e1596b0de589 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:00.966969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61216661-7b8f-44cf-b5b2-e1596b0de589 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:00.970271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61216661-7b8f-44cf-b5b2-e1596b0de589 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:00.970759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61216661-7b8f-44cf-b5b2-e1596b0de589 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:00.975301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c9841b67-bacb-443f-ae60-7ca79e7b03c6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73d995c472441569251b09450f9be70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5091683189114d928b6978b362a4182b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:00.976565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61216661-7b8f-44cf-b5b2-e1596b0de589 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:00.978142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61216661-7b8f-44cf-b5b2-e1596b0de589 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:00.978456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61216661-7b8f-44cf-b5b2-e1596b0de589 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:00.983210 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c9841b67-bacb-443f-ae60-7ca79e7b03c6 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 200 len: 1315 microversion: 2.1 time: 0.663468 Oct 24 10:56:01.004054 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2876/5722] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:00 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:01.225061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-bbbeec4a-5bc3-42ac-873e-4d13f571d57c req-cfe5b829-bc23-4113-937b-fd5bc529a75c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "260e2e6b-7bb4-402a-b571-6b1b439e9a0e", "tag": "ba5c365d-d4b1-46c7-9164-e9f274968407"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:01.242408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-61216661-7b8f-44cf-b5b2-e1596b0de589 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:01.246707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-bbbeec4a-5bc3-42ac-873e-4d13f571d57c req-cfe5b829-bc23-4113-937b-fd5bc529a75c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:01.247464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-bbbeec4a-5bc3-42ac-873e-4d13f571d57c req-cfe5b829-bc23-4113-937b-fd5bc529a75c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:01.252299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-bbbeec4a-5bc3-42ac-873e-4d13f571d57c req-cfe5b829-bc23-4113-937b-fd5bc529a75c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:01.260783 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-61216661-7b8f-44cf-b5b2-e1596b0de589 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1317 microversion: 2.1 time: 0.345110 Oct 24 10:56:01.263621 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2847/5723] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:00 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:01.301989 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-bbbeec4a-5bc3-42ac-873e-4d13f571d57c req-cfe5b829-bc23-4113-937b-fd5bc529a75c service nova] Creating event network-changed:ba5c365d-d4b1-46c7-9164-e9f274968407 for instance 260e2e6b-7bb4-402a-b571-6b1b439e9a0e on n-h1-858383-15 Oct 24 10:56:01.313517 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-bbbeec4a-5bc3-42ac-873e-4d13f571d57c req-cfe5b829-bc23-4113-937b-fd5bc529a75c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092466 Oct 24 10:56:01.315482 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2877/5724] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:56:01.934102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6aa17f1b-700b-49c6-b4c7-67cb4f281709 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:01.936091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6aa17f1b-700b-49c6-b4c7-67cb4f281709 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:01.945474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aa17f1b-700b-49c6-b4c7-67cb4f281709 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:01.945974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aa17f1b-700b-49c6-b4c7-67cb4f281709 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:01.946620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aa17f1b-700b-49c6-b4c7-67cb4f281709 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:01.947401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aa17f1b-700b-49c6-b4c7-67cb4f281709 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:01.948017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aa17f1b-700b-49c6-b4c7-67cb4f281709 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:01.948484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aa17f1b-700b-49c6-b4c7-67cb4f281709 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:02.012203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-53377953-1627-4a5a-8318-43e4c599a01a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:02.014602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-53377953-1627-4a5a-8318-43e4c599a01a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:02.024481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:56:02.027134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53377953-1627-4a5a-8318-43e4c599a01a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:02.027638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53377953-1627-4a5a-8318-43e4c599a01a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:02.028080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53377953-1627-4a5a-8318-43e4c599a01a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:02.033942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53377953-1627-4a5a-8318-43e4c599a01a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:02.034563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53377953-1627-4a5a-8318-43e4c599a01a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:02.035028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53377953-1627-4a5a-8318-43e4c599a01a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:02.290806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=10 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:56:02.375549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6aa17f1b-700b-49c6-b4c7-67cb4f281709 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:02.383877 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6aa17f1b-700b-49c6-b4c7-67cb4f281709 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1690 microversion: 2.1 time: 0.453759 Oct 24 10:56:02.384553 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2848/5725] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:01 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1690 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:02.390197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d9b0ee16-4629-43c3-ab83-d89277748733 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:02.390888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d9b0ee16-4629-43c3-ab83-d89277748733 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:02.397370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9b0ee16-4629-43c3-ab83-d89277748733 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:02.398201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9b0ee16-4629-43c3-ab83-d89277748733 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:02.398795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9b0ee16-4629-43c3-ab83-d89277748733 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:02.399541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9b0ee16-4629-43c3-ab83-d89277748733 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:02.400370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9b0ee16-4629-43c3-ab83-d89277748733 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:02.401532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9b0ee16-4629-43c3-ab83-d89277748733 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:02.407345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-53377953-1627-4a5a-8318-43e4c599a01a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73d995c472441569251b09450f9be70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5091683189114d928b6978b362a4182b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:02.415344 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-53377953-1627-4a5a-8318-43e4c599a01a tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 200 len: 1315 microversion: 2.1 time: 0.409234 Oct 24 10:56:02.429371 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2878/5726] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:02 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:02.648652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d9b0ee16-4629-43c3-ab83-d89277748733 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:02.659390 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d9b0ee16-4629-43c3-ab83-d89277748733 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1317 microversion: 2.1 time: 0.273580 Oct 24 10:56:02.666008 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2849/5727] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:02 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:03.172560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-7c12604e-6774-4d05-a1f4-d7be044cd478 req-d8923407-85dd-4037-bfa2-315fc7ae645d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce02187-96ed-47b2-b572-b97ce0840c19", "name": "network-vif-plugged", "status": "completed", "tag": "b06ad187-f316-40e5-b778-545cf083f9ca"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:03.184610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7c12604e-6774-4d05-a1f4-d7be044cd478 req-d8923407-85dd-4037-bfa2-315fc7ae645d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:03.185551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7c12604e-6774-4d05-a1f4-d7be044cd478 req-d8923407-85dd-4037-bfa2-315fc7ae645d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:03.186371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7c12604e-6774-4d05-a1f4-d7be044cd478 req-d8923407-85dd-4037-bfa2-315fc7ae645d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:03.199401 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-7c12604e-6774-4d05-a1f4-d7be044cd478 req-d8923407-85dd-4037-bfa2-315fc7ae645d service nova] Creating event network-vif-plugged:b06ad187-f316-40e5-b778-545cf083f9ca for instance bce02187-96ed-47b2-b572-b97ce0840c19 on n-h2-858383-15 Oct 24 10:56:03.205410 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-7c12604e-6774-4d05-a1f4-d7be044cd478 req-d8923407-85dd-4037-bfa2-315fc7ae645d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037413 Oct 24 10:56:03.206493 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2879/5728] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:56:03.412693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c7b69c2d-c3e3-45f9-b766-60cb9c79482c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:03.414035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c7b69c2d-c3e3-45f9-b766-60cb9c79482c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:03.422548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7b69c2d-c3e3-45f9-b766-60cb9c79482c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:03.423055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7b69c2d-c3e3-45f9-b766-60cb9c79482c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:03.423505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7b69c2d-c3e3-45f9-b766-60cb9c79482c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:03.424240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7b69c2d-c3e3-45f9-b766-60cb9c79482c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:03.424717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7b69c2d-c3e3-45f9-b766-60cb9c79482c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:03.425474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7b69c2d-c3e3-45f9-b766-60cb9c79482c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:03.448356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d1c17e9c-fb8e-4fd9-ac5d-296ee99b56f1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:03.449567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d1c17e9c-fb8e-4fd9-ac5d-296ee99b56f1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:03.462515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1c17e9c-fb8e-4fd9-ac5d-296ee99b56f1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:03.463362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1c17e9c-fb8e-4fd9-ac5d-296ee99b56f1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:03.464107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1c17e9c-fb8e-4fd9-ac5d-296ee99b56f1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:03.465773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1c17e9c-fb8e-4fd9-ac5d-296ee99b56f1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:03.467808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1c17e9c-fb8e-4fd9-ac5d-296ee99b56f1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:03.469172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1c17e9c-fb8e-4fd9-ac5d-296ee99b56f1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:03.678019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c7b69c2d-c3e3-45f9-b766-60cb9c79482c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:03.695133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d1c17e9c-fb8e-4fd9-ac5d-296ee99b56f1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73d995c472441569251b09450f9be70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5091683189114d928b6978b362a4182b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:03.697996 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c7b69c2d-c3e3-45f9-b766-60cb9c79482c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1690 microversion: 2.1 time: 0.290047 Oct 24 10:56:03.698808 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2850/5729] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:03 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1690 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:03.709096 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d1c17e9c-fb8e-4fd9-ac5d-296ee99b56f1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 200 len: 1315 microversion: 2.1 time: 0.273142 Oct 24 10:56:03.725558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7e2b35b1-1a7d-4ddd-a684-6288ee25a025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:03.727558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7e2b35b1-1a7d-4ddd-a684-6288ee25a025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:03.729353 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2880/5730] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:03 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:03.735776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e2b35b1-1a7d-4ddd-a684-6288ee25a025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:03.736341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e2b35b1-1a7d-4ddd-a684-6288ee25a025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:03.736875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e2b35b1-1a7d-4ddd-a684-6288ee25a025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:03.738289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e2b35b1-1a7d-4ddd-a684-6288ee25a025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:03.738840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e2b35b1-1a7d-4ddd-a684-6288ee25a025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:03.739587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e2b35b1-1a7d-4ddd-a684-6288ee25a025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:03.901098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7e2b35b1-1a7d-4ddd-a684-6288ee25a025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:03.913197 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7e2b35b1-1a7d-4ddd-a684-6288ee25a025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1317 microversion: 2.1 time: 0.211956 Oct 24 10:56:03.918372 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2851/5731] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:03 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:04.722949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-595438cf-ec83-499b-a255-e4311c8f1bb4 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:04.724160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-595438cf-ec83-499b-a255-e4311c8f1bb4 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:04.735931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d861bacd-3a74-41db-ac92-972d39a0c5c1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:04.737217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d861bacd-3a74-41db-ac92-972d39a0c5c1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:04.739891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-595438cf-ec83-499b-a255-e4311c8f1bb4 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:04.740873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-595438cf-ec83-499b-a255-e4311c8f1bb4 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:04.742936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-595438cf-ec83-499b-a255-e4311c8f1bb4 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:04.747180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-595438cf-ec83-499b-a255-e4311c8f1bb4 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:04.749166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-595438cf-ec83-499b-a255-e4311c8f1bb4 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:04.749916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-595438cf-ec83-499b-a255-e4311c8f1bb4 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:04.763028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d861bacd-3a74-41db-ac92-972d39a0c5c1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:04.766436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d861bacd-3a74-41db-ac92-972d39a0c5c1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:04.769996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d861bacd-3a74-41db-ac92-972d39a0c5c1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:04.771618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d861bacd-3a74-41db-ac92-972d39a0c5c1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:04.777469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d861bacd-3a74-41db-ac92-972d39a0c5c1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:04.778226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d861bacd-3a74-41db-ac92-972d39a0c5c1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:05.517265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d861bacd-3a74-41db-ac92-972d39a0c5c1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73d995c472441569251b09450f9be70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5091683189114d928b6978b362a4182b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:05.530285 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d861bacd-3a74-41db-ac92-972d39a0c5c1 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 200 len: 1315 microversion: 2.1 time: 0.800714 Oct 24 10:56:05.531119 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2852/5732] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:04 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 1315 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:05.540650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e91b530-79f4-4808-bb4c-ba93569402a7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:05.541298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5e91b530-79f4-4808-bb4c-ba93569402a7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:05.588976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e91b530-79f4-4808-bb4c-ba93569402a7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:05.590859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e91b530-79f4-4808-bb4c-ba93569402a7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:05.592929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e91b530-79f4-4808-bb4c-ba93569402a7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:05.595110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e91b530-79f4-4808-bb4c-ba93569402a7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:05.597227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e91b530-79f4-4808-bb4c-ba93569402a7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:05.599189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e91b530-79f4-4808-bb4c-ba93569402a7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:05.604378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-595438cf-ec83-499b-a255-e4311c8f1bb4 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:05.615709 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-595438cf-ec83-499b-a255-e4311c8f1bb4 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1690 microversion: 2.1 time: 0.896958 Oct 24 10:56:05.619222 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2881/5733] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:04 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1690 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:06.008140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5e91b530-79f4-4808-bb4c-ba93569402a7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:06.012903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:56:06.026172 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5e91b530-79f4-4808-bb4c-ba93569402a7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1505 microversion: 2.1 time: 0.493804 Oct 24 10:56:06.041413 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2853/5734] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:05 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:06.051054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-19e8c1bb-89e8-43e5-ba40-03ed13a218bc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:06.051550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-19e8c1bb-89e8-43e5-ba40-03ed13a218bc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:06.059783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19e8c1bb-89e8-43e5-ba40-03ed13a218bc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:06.060274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19e8c1bb-89e8-43e5-ba40-03ed13a218bc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:06.062320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19e8c1bb-89e8-43e5-ba40-03ed13a218bc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:06.063249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19e8c1bb-89e8-43e5-ba40-03ed13a218bc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:06.063880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19e8c1bb-89e8-43e5-ba40-03ed13a218bc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:06.064464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19e8c1bb-89e8-43e5-ba40-03ed13a218bc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:06.093886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-19e8c1bb-89e8-43e5-ba40-03ed13a218bc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:56:06.343195 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-19e8c1bb-89e8-43e5-ba40-03ed13a218bc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 204 len: 0 microversion: 2.1 time: 0.296091 Oct 24 10:56:06.347947 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2882/5735] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:56:06 2022] DELETE /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:56:06.356119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b873cbcb-3de6-4e85-b303-1ddf186e5da8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:06.357526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b873cbcb-3de6-4e85-b303-1ddf186e5da8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:06.371616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b873cbcb-3de6-4e85-b303-1ddf186e5da8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:06.373417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b873cbcb-3de6-4e85-b303-1ddf186e5da8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:06.374428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b873cbcb-3de6-4e85-b303-1ddf186e5da8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:06.375960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b873cbcb-3de6-4e85-b303-1ddf186e5da8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:06.376598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b873cbcb-3de6-4e85-b303-1ddf186e5da8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:06.377247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b873cbcb-3de6-4e85-b303-1ddf186e5da8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:06.869241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c2d75ccc-aa70-4bd1-b02d-6e2ea0d7070c req-302dd73d-4baf-4736-8bc2-7d76387e8bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfd7080-7dfd-489b-8128-0e66aec16fff", "name": "network-vif-unplugged", "status": "completed", "tag": "2cae1fc6-3659-43fd-97c3-9b936fe09a4e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:06.908464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c2d75ccc-aa70-4bd1-b02d-6e2ea0d7070c req-302dd73d-4baf-4736-8bc2-7d76387e8bd3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:06.909989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c2d75ccc-aa70-4bd1-b02d-6e2ea0d7070c req-302dd73d-4baf-4736-8bc2-7d76387e8bd3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:06.910933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c2d75ccc-aa70-4bd1-b02d-6e2ea0d7070c req-302dd73d-4baf-4736-8bc2-7d76387e8bd3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:06.942109 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c2d75ccc-aa70-4bd1-b02d-6e2ea0d7070c req-302dd73d-4baf-4736-8bc2-7d76387e8bd3 service nova] Creating event network-vif-unplugged:2cae1fc6-3659-43fd-97c3-9b936fe09a4e for instance 3bfd7080-7dfd-489b-8128-0e66aec16fff on n-h1-858383-15 Oct 24 10:56:06.959066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-c2d75ccc-aa70-4bd1-b02d-6e2ea0d7070c req-302dd73d-4baf-4736-8bc2-7d76387e8bd3 service nova] Instance 3bfd7080-7dfd-489b-8128-0e66aec16fff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:56:06.984004 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c2d75ccc-aa70-4bd1-b02d-6e2ea0d7070c req-302dd73d-4baf-4736-8bc2-7d76387e8bd3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.693651 Oct 24 10:56:06.990248 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2854/5736] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:56:07.003007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-86ce02cc-acc8-4810-b91f-447e442c8cbd tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:07.009398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-86ce02cc-acc8-4810-b91f-447e442c8cbd tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:07.027776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86ce02cc-acc8-4810-b91f-447e442c8cbd tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:07.028571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86ce02cc-acc8-4810-b91f-447e442c8cbd tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:07.029305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86ce02cc-acc8-4810-b91f-447e442c8cbd tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:07.032787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86ce02cc-acc8-4810-b91f-447e442c8cbd tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:07.033562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86ce02cc-acc8-4810-b91f-447e442c8cbd tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:07.037322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-86ce02cc-acc8-4810-b91f-447e442c8cbd tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:07.078449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b873cbcb-3de6-4e85-b303-1ddf186e5da8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:07.084066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:56:07.094314 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b873cbcb-3de6-4e85-b303-1ddf186e5da8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1511 microversion: 2.1 time: 0.744788 Oct 24 10:56:07.098016 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2883/5737] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:06 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1511 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:07.106144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c75caf23-57e9-40de-a7ac-d0579b6a44e5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:07.108768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c75caf23-57e9-40de-a7ac-d0579b6a44e5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:07.132994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c75caf23-57e9-40de-a7ac-d0579b6a44e5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:07.133785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c75caf23-57e9-40de-a7ac-d0579b6a44e5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:07.137430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c75caf23-57e9-40de-a7ac-d0579b6a44e5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:07.138457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c75caf23-57e9-40de-a7ac-d0579b6a44e5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:07.139768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c75caf23-57e9-40de-a7ac-d0579b6a44e5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:07.140535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c75caf23-57e9-40de-a7ac-d0579b6a44e5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:07.854121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c75caf23-57e9-40de-a7ac-d0579b6a44e5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:07.868065 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c75caf23-57e9-40de-a7ac-d0579b6a44e5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1690 microversion: 2.1 time: 0.768744 Oct 24 10:56:07.870054 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2884/5738] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:07 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1690 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:07.885322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-abc818a0-01bb-404d-8edf-8c4fcd7bd79a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:07.893902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-abc818a0-01bb-404d-8edf-8c4fcd7bd79a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:07.917248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abc818a0-01bb-404d-8edf-8c4fcd7bd79a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:07.920532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abc818a0-01bb-404d-8edf-8c4fcd7bd79a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:07.921500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abc818a0-01bb-404d-8edf-8c4fcd7bd79a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:07.922564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abc818a0-01bb-404d-8edf-8c4fcd7bd79a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:07.931964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-86ce02cc-acc8-4810-b91f-447e442c8cbd tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73d995c472441569251b09450f9be70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5091683189114d928b6978b362a4182b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:07.934434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abc818a0-01bb-404d-8edf-8c4fcd7bd79a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:07.936871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abc818a0-01bb-404d-8edf-8c4fcd7bd79a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:07.964495 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-86ce02cc-acc8-4810-b91f-447e442c8cbd tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 200 len: 1315 microversion: 2.1 time: 0.972054 Oct 24 10:56:07.965118 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2855/5739] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:06 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 1315 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:07.993730 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-abc818a0-01bb-404d-8edf-8c4fcd7bd79a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.121270 Oct 24 10:56:07.994986 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2885/5740] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:56:07 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments => generated 371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:56:08.133393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3224ab6b-8259-4d1b-90ed-f2f229c1a04f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:08.134232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3224ab6b-8259-4d1b-90ed-f2f229c1a04f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:08.143539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7fc93c87-1913-4223-b9fc-e604161d45ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:08.144672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7fc93c87-1913-4223-b9fc-e604161d45ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:08.160121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fc93c87-1913-4223-b9fc-e604161d45ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:08.161048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fc93c87-1913-4223-b9fc-e604161d45ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:08.161742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fc93c87-1913-4223-b9fc-e604161d45ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:08.163222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3224ab6b-8259-4d1b-90ed-f2f229c1a04f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:08.163358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fc93c87-1913-4223-b9fc-e604161d45ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:08.163746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3224ab6b-8259-4d1b-90ed-f2f229c1a04f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:08.164236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3224ab6b-8259-4d1b-90ed-f2f229c1a04f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:08.164922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fc93c87-1913-4223-b9fc-e604161d45ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:08.166311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3224ab6b-8259-4d1b-90ed-f2f229c1a04f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:08.166856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3224ab6b-8259-4d1b-90ed-f2f229c1a04f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:08.166968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fc93c87-1913-4223-b9fc-e604161d45ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:08.167252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3224ab6b-8259-4d1b-90ed-f2f229c1a04f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:08.292945 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7fc93c87-1913-4223-b9fc-e604161d45ae tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments/401f4d71-694f-4c30-8f0c-37366b27b49b" status: 200 len: 194 microversion: 2.1 time: 0.153631 Oct 24 10:56:08.300020 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2886/5741] 10.222.0.50 () {58 vars in 1413 bytes} [Mon Oct 24 10:56:08 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments/401f4d71-694f-4c30-8f0c-37366b27b49b => generated 194 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:56:08.314424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-11ae0ee0-3f13-4c11-ae36-b3471aff56ba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:08.321404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-11ae0ee0-3f13-4c11-ae36-b3471aff56ba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:08.343694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ae0ee0-3f13-4c11-ae36-b3471aff56ba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:08.344355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ae0ee0-3f13-4c11-ae36-b3471aff56ba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:08.345098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ae0ee0-3f13-4c11-ae36-b3471aff56ba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:08.347681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ae0ee0-3f13-4c11-ae36-b3471aff56ba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:08.348385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ae0ee0-3f13-4c11-ae36-b3471aff56ba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:08.366400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ae0ee0-3f13-4c11-ae36-b3471aff56ba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:08.574688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-11ae0ee0-3f13-4c11-ae36-b3471aff56ba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lazy-loading 'services' on Instance uuid d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:56:08.716322 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-11ae0ee0-3f13-4c11-ae36-b3471aff56ba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments/401f4d71-694f-4c30-8f0c-37366b27b49b" status: 202 len: 0 microversion: 2.1 time: 0.406142 Oct 24 10:56:08.722543 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2887/5742] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 10:56:08 2022] DELETE /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments/401f4d71-694f-4c30-8f0c-37366b27b49b => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:56:08.896039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-00c40c3c-4506-464f-93a2-821e41c2db4e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:08.897456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-00c40c3c-4506-464f-93a2-821e41c2db4e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:08.907183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00c40c3c-4506-464f-93a2-821e41c2db4e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:08.910796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00c40c3c-4506-464f-93a2-821e41c2db4e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:08.911275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00c40c3c-4506-464f-93a2-821e41c2db4e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:08.915079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00c40c3c-4506-464f-93a2-821e41c2db4e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:08.915781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00c40c3c-4506-464f-93a2-821e41c2db4e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:08.916404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00c40c3c-4506-464f-93a2-821e41c2db4e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:09.587011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-00c40c3c-4506-464f-93a2-821e41c2db4e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:09.599045 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-00c40c3c-4506-464f-93a2-821e41c2db4e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1690 microversion: 2.1 time: 0.707170 Oct 24 10:56:09.601793 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2888/5743] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:08 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1690 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:09.611766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d94e1ca3-3d94-4c8c-a004-94c0f7d25500 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:09.613549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d94e1ca3-3d94-4c8c-a004-94c0f7d25500 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:09.627592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d94e1ca3-3d94-4c8c-a004-94c0f7d25500 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:09.628423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d94e1ca3-3d94-4c8c-a004-94c0f7d25500 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:09.629879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d94e1ca3-3d94-4c8c-a004-94c0f7d25500 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:09.640736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d94e1ca3-3d94-4c8c-a004-94c0f7d25500 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:09.641350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d94e1ca3-3d94-4c8c-a004-94c0f7d25500 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:09.642016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d94e1ca3-3d94-4c8c-a004-94c0f7d25500 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:09.744746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3224ab6b-8259-4d1b-90ed-f2f229c1a04f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:09.764306 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3224ab6b-8259-4d1b-90ed-f2f229c1a04f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 200 len: 1511 microversion: 2.1 time: 1.630348 Oct 24 10:56:09.765435 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2856/5744] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:08 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 1511 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:09.783925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b6b5444b-202e-4cf1-a629-493e825bc9b9 req-9d2229fa-a880-4db2-a4ae-0318889cdab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce02187-96ed-47b2-b572-b97ce0840c19", "name": "network-vif-deleted", "tag": "b06ad187-f316-40e5-b778-545cf083f9ca"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:09.809651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b6b5444b-202e-4cf1-a629-493e825bc9b9 req-9d2229fa-a880-4db2-a4ae-0318889cdab9 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:09.810597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b6b5444b-202e-4cf1-a629-493e825bc9b9 req-9d2229fa-a880-4db2-a4ae-0318889cdab9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:09.810597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b6b5444b-202e-4cf1-a629-493e825bc9b9 req-9d2229fa-a880-4db2-a4ae-0318889cdab9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:09.836433 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b6b5444b-202e-4cf1-a629-493e825bc9b9 req-9d2229fa-a880-4db2-a4ae-0318889cdab9 service nova] Creating event network-vif-deleted:b06ad187-f316-40e5-b778-545cf083f9ca for instance bce02187-96ed-47b2-b572-b97ce0840c19 on n-h2-858383-15 Oct 24 10:56:09.859690 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b6b5444b-202e-4cf1-a629-493e825bc9b9 req-9d2229fa-a880-4db2-a4ae-0318889cdab9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083222 Oct 24 10:56:09.859690 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2857/5745] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:56:09.877094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-8b2d5355-9086-4cba-aa6c-880ae89e136b req-d5b6dc5b-3442-471f-ad17-1a0491e0615a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260e2e6b-7bb4-402a-b571-6b1b439e9a0e", "name": "network-vif-plugged", "status": "completed", "tag": "ba5c365d-d4b1-46c7-9164-e9f274968407"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:09.905922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8b2d5355-9086-4cba-aa6c-880ae89e136b req-d5b6dc5b-3442-471f-ad17-1a0491e0615a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:09.906643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8b2d5355-9086-4cba-aa6c-880ae89e136b req-d5b6dc5b-3442-471f-ad17-1a0491e0615a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:09.907165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8b2d5355-9086-4cba-aa6c-880ae89e136b req-d5b6dc5b-3442-471f-ad17-1a0491e0615a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:09.935955 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-8b2d5355-9086-4cba-aa6c-880ae89e136b req-d5b6dc5b-3442-471f-ad17-1a0491e0615a service nova] Creating event network-vif-plugged:ba5c365d-d4b1-46c7-9164-e9f274968407 for instance 260e2e6b-7bb4-402a-b571-6b1b439e9a0e on n-h1-858383-15 Oct 24 10:56:09.941878 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-8b2d5355-9086-4cba-aa6c-880ae89e136b req-d5b6dc5b-3442-471f-ad17-1a0491e0615a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083998 Oct 24 10:56:09.945423 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2858/5746] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:56:10.011609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-43c58e97-ca4c-4c9e-a2db-775c59b62933 req-23d15d19-2e45-4091-81d2-43f57ab97df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bfd7080-7dfd-489b-8128-0e66aec16fff", "tag": "2cae1fc6-3659-43fd-97c3-9b936fe09a4e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:10.043324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-43c58e97-ca4c-4c9e-a2db-775c59b62933 req-23d15d19-2e45-4091-81d2-43f57ab97df4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:10.043818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-43c58e97-ca4c-4c9e-a2db-775c59b62933 req-23d15d19-2e45-4091-81d2-43f57ab97df4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:10.044261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-43c58e97-ca4c-4c9e-a2db-775c59b62933 req-23d15d19-2e45-4091-81d2-43f57ab97df4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:10.085493 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-43c58e97-ca4c-4c9e-a2db-775c59b62933 req-23d15d19-2e45-4091-81d2-43f57ab97df4 service nova] Creating event network-changed:2cae1fc6-3659-43fd-97c3-9b936fe09a4e for instance 3bfd7080-7dfd-489b-8128-0e66aec16fff on n-h1-858383-15 Oct 24 10:56:10.106999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-43c58e97-ca4c-4c9e-a2db-775c59b62933 req-23d15d19-2e45-4091-81d2-43f57ab97df4 service nova] Instance 3bfd7080-7dfd-489b-8128-0e66aec16fff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 10:56:10.146336 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-43c58e97-ca4c-4c9e-a2db-775c59b62933 req-23d15d19-2e45-4091-81d2-43f57ab97df4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138731 Oct 24 10:56:10.158009 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2859/5747] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:56:10.236430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d94e1ca3-3d94-4c8c-a004-94c0f7d25500 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73d995c472441569251b09450f9be70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5091683189114d928b6978b362a4182b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:10.245896 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d94e1ca3-3d94-4c8c-a004-94c0f7d25500 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 200 len: 1315 microversion: 2.1 time: 0.642706 Oct 24 10:56:10.249152 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2889/5748] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:09 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:10.625749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8a33d5c9-774e-479f-9386-9e1a3f9b058e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:10.626483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8a33d5c9-774e-479f-9386-9e1a3f9b058e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:10.652365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a33d5c9-774e-479f-9386-9e1a3f9b058e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:10.653426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a33d5c9-774e-479f-9386-9e1a3f9b058e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:10.653755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a33d5c9-774e-479f-9386-9e1a3f9b058e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:10.659518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a33d5c9-774e-479f-9386-9e1a3f9b058e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:10.660056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a33d5c9-774e-479f-9386-9e1a3f9b058e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:10.661772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a33d5c9-774e-479f-9386-9e1a3f9b058e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:10.792033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-25270d69-9389-4db1-b955-04813551b5e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:10.797959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-25270d69-9389-4db1-b955-04813551b5e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:10.831165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25270d69-9389-4db1-b955-04813551b5e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:10.831656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25270d69-9389-4db1-b955-04813551b5e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:10.832091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25270d69-9389-4db1-b955-04813551b5e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:10.832805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25270d69-9389-4db1-b955-04813551b5e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:10.833327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25270d69-9389-4db1-b955-04813551b5e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:10.833757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25270d69-9389-4db1-b955-04813551b5e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:10.877821 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-25270d69-9389-4db1-b955-04813551b5e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-25270d69-9389-4db1-b955-04813551b5e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 HTTP/1.1 Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'bce02187-96ed-47b2-b572-b97ce0840c19'} Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:10.889902 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:10.894882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:10.894882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:10.894882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:10.894882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:10.894882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:10.894882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:56:10.894882 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:10.894882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-25270d69-9389-4db1-b955-04813551b5e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:10.894882 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-25270d69-9389-4db1-b955-04813551b5e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 404 len: 111 microversion: 2.1 time: 0.103971 Oct 24 10:56:10.894882 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2890/5749] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:10 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:56:10.905384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-034be52b-5537-4133-908e-45d88baae4d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:10.907962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-034be52b-5537-4133-908e-45d88baae4d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:10.918118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-034be52b-5537-4133-908e-45d88baae4d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:10.919579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-034be52b-5537-4133-908e-45d88baae4d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:10.921444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-034be52b-5537-4133-908e-45d88baae4d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:10.922372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-034be52b-5537-4133-908e-45d88baae4d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:10.923002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-034be52b-5537-4133-908e-45d88baae4d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:10.923775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-034be52b-5537-4133-908e-45d88baae4d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:11.199822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8a33d5c9-774e-479f-9386-9e1a3f9b058e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:11.213039 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8a33d5c9-774e-479f-9386-9e1a3f9b058e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1690 microversion: 2.1 time: 0.592602 Oct 24 10:56:11.225480 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2860/5750] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:10 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1690 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:11.278005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1613b26e-4742-4535-b5ca-890eadc1aa43 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:11.279817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1613b26e-4742-4535-b5ca-890eadc1aa43 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:11.288127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1613b26e-4742-4535-b5ca-890eadc1aa43 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:11.288998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1613b26e-4742-4535-b5ca-890eadc1aa43 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:11.289695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1613b26e-4742-4535-b5ca-890eadc1aa43 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:11.290738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1613b26e-4742-4535-b5ca-890eadc1aa43 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:11.291353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1613b26e-4742-4535-b5ca-890eadc1aa43 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:11.292044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1613b26e-4742-4535-b5ca-890eadc1aa43 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:11.498409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-034be52b-5537-4133-908e-45d88baae4d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:11.510060 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-034be52b-5537-4133-908e-45d88baae4d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.610893 Oct 24 10:56:11.511304 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2891/5751] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:10 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:11.751811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6e25a312-85a1-4654-936b-7b20795099d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6e25a312-85a1-4654-936b-7b20795099d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 163 Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: {"server": {"name": 12345, "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'networks': [{'uuid': '33496d87-63b8-423d-9b93-72eddb64dec3'}]}}} Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 12345 Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:56:11.765092 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:56:11.769260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:56:11.769260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 24 10:56:11.769260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:11.769260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:11.769260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:11.769260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:11.769260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:11.769260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:11.769260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:56:11.769260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:56:11.769260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 24 10:56:11.769260 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:11.786624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6e25a312-85a1-4654-936b-7b20795099d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:11.788234 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6e25a312-85a1-4654-936b-7b20795099d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.042336 Oct 24 10:56:11.793326 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2892/5752] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:56:11 2022] POST /compute/v2.1/servers => generated 127 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:56:11.813683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1613b26e-4742-4535-b5ca-890eadc1aa43 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73d995c472441569251b09450f9be70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5091683189114d928b6978b362a4182b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:11.825193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1ae37805-bacb-4dec-9bde-e28646c61f79 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:11.828284 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1613b26e-4742-4535-b5ca-890eadc1aa43 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 200 len: 1315 microversion: 2.1 time: 0.556226 Oct 24 10:56:11.829016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1ae37805-bacb-4dec-9bde-e28646c61f79 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:11.836302 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2861/5753] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:11 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:11.860753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ae37805-bacb-4dec-9bde-e28646c61f79 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:11.861519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ae37805-bacb-4dec-9bde-e28646c61f79 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:11.862448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ae37805-bacb-4dec-9bde-e28646c61f79 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:11.864859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ae37805-bacb-4dec-9bde-e28646c61f79 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:11.867559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ae37805-bacb-4dec-9bde-e28646c61f79 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:11.868159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ae37805-bacb-4dec-9bde-e28646c61f79 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:12.238735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c463fe8f-3bd0-44cd-a824-6eae34bed819 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:12.239358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c463fe8f-3bd0-44cd-a824-6eae34bed819 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:12.249070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c463fe8f-3bd0-44cd-a824-6eae34bed819 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:12.249859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c463fe8f-3bd0-44cd-a824-6eae34bed819 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:12.251102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c463fe8f-3bd0-44cd-a824-6eae34bed819 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:12.252130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c463fe8f-3bd0-44cd-a824-6eae34bed819 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:12.252772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c463fe8f-3bd0-44cd-a824-6eae34bed819 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:12.253593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c463fe8f-3bd0-44cd-a824-6eae34bed819 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:12.548626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1ae37805-bacb-4dec-9bde-e28646c61f79 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:12.560290 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1ae37805-bacb-4dec-9bde-e28646c61f79 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.762249 Oct 24 10:56:12.568231 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2893/5754] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:11 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:12.593400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b173ea50-eeea-4dd4-b53a-552ff865a9d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:12.594371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b173ea50-eeea-4dd4-b53a-552ff865a9d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:12.603095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b173ea50-eeea-4dd4-b53a-552ff865a9d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:12.603594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b173ea50-eeea-4dd4-b53a-552ff865a9d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:12.604033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b173ea50-eeea-4dd4-b53a-552ff865a9d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:12.606896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b173ea50-eeea-4dd4-b53a-552ff865a9d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:12.608041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b173ea50-eeea-4dd4-b53a-552ff865a9d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:12.610756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b173ea50-eeea-4dd4-b53a-552ff865a9d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:12.781359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c463fe8f-3bd0-44cd-a824-6eae34bed819 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:12.798587 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c463fe8f-3bd0-44cd-a824-6eae34bed819 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1690 microversion: 2.1 time: 0.563559 Oct 24 10:56:12.804795 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2862/5755] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:12 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1690 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:12.862647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1be3b11b-b190-46a2-a3cc-f224620294f4 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:12.863313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1be3b11b-b190-46a2-a3cc-f224620294f4 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:12.871795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1be3b11b-b190-46a2-a3cc-f224620294f4 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:12.872747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1be3b11b-b190-46a2-a3cc-f224620294f4 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:12.884662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1be3b11b-b190-46a2-a3cc-f224620294f4 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:12.886411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1be3b11b-b190-46a2-a3cc-f224620294f4 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:12.887131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1be3b11b-b190-46a2-a3cc-f224620294f4 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:12.887789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1be3b11b-b190-46a2-a3cc-f224620294f4 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:12.943272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b173ea50-eeea-4dd4-b53a-552ff865a9d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:12.959262 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b173ea50-eeea-4dd4-b53a-552ff865a9d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.370117 Oct 24 10:56:12.967376 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2894/5756] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:12 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:13.150388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1be3b11b-b190-46a2-a3cc-f224620294f4 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73d995c472441569251b09450f9be70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5091683189114d928b6978b362a4182b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:13.165188 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1be3b11b-b190-46a2-a3cc-f224620294f4 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 200 len: 1464 microversion: 2.1 time: 0.306693 Oct 24 10:56:13.166086 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2863/5757] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:12 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 1464 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:13.711790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-adc3459a-dda9-4c57-8b9f-d3b8c79a0351 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:13.712680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-adc3459a-dda9-4c57-8b9f-d3b8c79a0351 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:13.715827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:56:13.741956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adc3459a-dda9-4c57-8b9f-d3b8c79a0351 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:13.744167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adc3459a-dda9-4c57-8b9f-d3b8c79a0351 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:13.745690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adc3459a-dda9-4c57-8b9f-d3b8c79a0351 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:13.749257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adc3459a-dda9-4c57-8b9f-d3b8c79a0351 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:13.750656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adc3459a-dda9-4c57-8b9f-d3b8c79a0351 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:13.751311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adc3459a-dda9-4c57-8b9f-d3b8c79a0351 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:13.804852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-adc3459a-dda9-4c57-8b9f-d3b8c79a0351 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:56:13.823054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aef6ea08-7417-4deb-b97b-68ab4fdb865a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:13.823676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aef6ea08-7417-4deb-b97b-68ab4fdb865a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:13.846512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aef6ea08-7417-4deb-b97b-68ab4fdb865a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:13.847026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aef6ea08-7417-4deb-b97b-68ab4fdb865a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:13.847479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aef6ea08-7417-4deb-b97b-68ab4fdb865a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:13.848209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aef6ea08-7417-4deb-b97b-68ab4fdb865a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:13.848751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aef6ea08-7417-4deb-b97b-68ab4fdb865a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:13.853907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aef6ea08-7417-4deb-b97b-68ab4fdb865a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:14.016283 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-adc3459a-dda9-4c57-8b9f-d3b8c79a0351 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "DELETE /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 204 len: 0 microversion: 2.1 time: 0.308061 Oct 24 10:56:14.023782 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2895/5758] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:56:13 2022] DELETE /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:56:14.036753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c33e34e3-9e74-4a77-a76a-f772fe03ca4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:14.037548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c33e34e3-9e74-4a77-a76a-f772fe03ca4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:14.062081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c33e34e3-9e74-4a77-a76a-f772fe03ca4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:14.062604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c33e34e3-9e74-4a77-a76a-f772fe03ca4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:14.063030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c33e34e3-9e74-4a77-a76a-f772fe03ca4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:14.071616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c33e34e3-9e74-4a77-a76a-f772fe03ca4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:14.073078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c33e34e3-9e74-4a77-a76a-f772fe03ca4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:14.075239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c33e34e3-9e74-4a77-a76a-f772fe03ca4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:14.293256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aef6ea08-7417-4deb-b97b-68ab4fdb865a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:14.305637 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aef6ea08-7417-4deb-b97b-68ab4fdb865a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1690 microversion: 2.1 time: 0.486412 Oct 24 10:56:14.306542 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2864/5759] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:13 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1690 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:14.440731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c33e34e3-9e74-4a77-a76a-f772fe03ca4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73d995c472441569251b09450f9be70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5091683189114d928b6978b362a4182b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:14.449982 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c33e34e3-9e74-4a77-a76a-f772fe03ca4d tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 200 len: 1470 microversion: 2.1 time: 0.424763 Oct 24 10:56:14.455391 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2896/5760] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:14 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 1470 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:15.345662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6c92faef-f888-4aae-950d-c428a9b4a244 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:15.347560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6c92faef-f888-4aae-950d-c428a9b4a244 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:15.355363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=82 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:56:15.361035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c92faef-f888-4aae-950d-c428a9b4a244 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:15.361512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c92faef-f888-4aae-950d-c428a9b4a244 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:15.361952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c92faef-f888-4aae-950d-c428a9b4a244 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:15.362767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c92faef-f888-4aae-950d-c428a9b4a244 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:15.363226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c92faef-f888-4aae-950d-c428a9b4a244 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:15.363653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c92faef-f888-4aae-950d-c428a9b4a244 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:15.488773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c2bf703f-67ee-4712-9a06-5d59110e980b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:15.490058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c2bf703f-67ee-4712-9a06-5d59110e980b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:15.498202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2bf703f-67ee-4712-9a06-5d59110e980b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:15.499154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2bf703f-67ee-4712-9a06-5d59110e980b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:15.499848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2bf703f-67ee-4712-9a06-5d59110e980b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:15.501086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2bf703f-67ee-4712-9a06-5d59110e980b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:15.501777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2bf703f-67ee-4712-9a06-5d59110e980b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:15.502432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c2bf703f-67ee-4712-9a06-5d59110e980b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:15.667367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6c92faef-f888-4aae-950d-c428a9b4a244 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:15.677183 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6c92faef-f888-4aae-950d-c428a9b4a244 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1690 microversion: 2.1 time: 0.345447 Oct 24 10:56:15.677964 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2865/5761] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:15 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1690 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:15.771527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c2bf703f-67ee-4712-9a06-5d59110e980b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73d995c472441569251b09450f9be70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5091683189114d928b6978b362a4182b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:15.785220 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c2bf703f-67ee-4712-9a06-5d59110e980b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 200 len: 1470 microversion: 2.1 time: 0.306764 Oct 24 10:56:15.785924 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2897/5762] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:15 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 1470 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:16.126516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-716803c5-cc73-4826-bc72-74554507374f tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:16.127921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-716803c5-cc73-4826-bc72-74554507374f tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:16.134600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-716803c5-cc73-4826-bc72-74554507374f tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:16.135307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-716803c5-cc73-4826-bc72-74554507374f tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:16.135978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-716803c5-cc73-4826-bc72-74554507374f tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:16.136912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-716803c5-cc73-4826-bc72-74554507374f tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:16.137592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-716803c5-cc73-4826-bc72-74554507374f tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:16.138240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-716803c5-cc73-4826-bc72-74554507374f tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:16.171986 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-716803c5-cc73-4826-bc72-74554507374f tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments/78b93498-7dc2-4e3a-bf5f-26545d6a7ad2" status: 200 len: 194 microversion: 2.1 time: 0.057329 Oct 24 10:56:16.173341 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2866/5763] 10.222.0.50 () {58 vars in 1413 bytes} [Mon Oct 24 10:56:16 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments/78b93498-7dc2-4e3a-bf5f-26545d6a7ad2 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:56:16.185456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8adcece1-2f88-448d-90ad-3f9094763003 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:16.186484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8adcece1-2f88-448d-90ad-3f9094763003 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:16.199235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8adcece1-2f88-448d-90ad-3f9094763003 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:16.200060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8adcece1-2f88-448d-90ad-3f9094763003 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:16.200499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8adcece1-2f88-448d-90ad-3f9094763003 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:16.201568 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8adcece1-2f88-448d-90ad-3f9094763003 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:16.202359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8adcece1-2f88-448d-90ad-3f9094763003 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:16.202950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8adcece1-2f88-448d-90ad-3f9094763003 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:16.318840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-8adcece1-2f88-448d-90ad-3f9094763003 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lazy-loading 'services' on Instance uuid d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:56:16.491453 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8adcece1-2f88-448d-90ad-3f9094763003 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments/78b93498-7dc2-4e3a-bf5f-26545d6a7ad2" status: 202 len: 0 microversion: 2.1 time: 0.310822 Oct 24 10:56:16.493837 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2898/5764] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 10:56:16 2022] DELETE /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments/78b93498-7dc2-4e3a-bf5f-26545d6a7ad2 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:56:16.692149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33ebef18-b9de-49c6-aeda-d7a0daba8de9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-981416837", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "238bda82-4b6b-414d-a9a4-2b190b6c334c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:16.705309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2f29b9db-25f0-4d8c-ba04-89800dae8fc0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:16.706151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2f29b9db-25f0-4d8c-ba04-89800dae8fc0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:16.718743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f29b9db-25f0-4d8c-ba04-89800dae8fc0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:16.720694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f29b9db-25f0-4d8c-ba04-89800dae8fc0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:16.737105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f29b9db-25f0-4d8c-ba04-89800dae8fc0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:16.738302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f29b9db-25f0-4d8c-ba04-89800dae8fc0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:16.741078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f29b9db-25f0-4d8c-ba04-89800dae8fc0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:16.743785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f29b9db-25f0-4d8c-ba04-89800dae8fc0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:16.755334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:56:16.862871 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-33ebef18-b9de-49c6-aeda-d7a0daba8de9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Block Device 238bda82-4b6b-414d-a9a4-2b190b6c334c is not bootable. Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33ebef18-b9de-49c6-aeda-d7a0daba8de9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 357 Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-981416837", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "238bda82-4b6b-414d-a9a4-2b190b6c334c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: exception: Block Device 238bda82-4b6b-414d-a9a4-2b190b6c334c is not bootable. Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-981416837', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '238bda82-4b6b-414d-a9a4-2b190b6c334c'}], 'networks': [{'uuid': '33496d87-63b8-423d-9b93-72eddb64dec3'}]}}} Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 238bda82-4b6b-414d-a9a4-2b190b6c334c is not bootable. Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:16.869724 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:16.875981 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:16.875981 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:16.875981 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:16.875981 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 10:56:16.875981 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 24 10:56:16.875981 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 24 10:56:16.875981 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 238bda82-4b6b-414d-a9a4-2b190b6c334c is not bootable. Oct 24 10:56:16.875981 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:16.875981 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:16.875981 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:16.875981 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:16.875981 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:16.875981 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:16.875981 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:16.875981 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:16.875981 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 238bda82-4b6b-414d-a9a4-2b190b6c334c is not bootable. Oct 24 10:56:16.875981 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:16.878249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33ebef18-b9de-49c6-aeda-d7a0daba8de9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 400 to user: Block Device 238bda82-4b6b-414d-a9a4-2b190b6c334c is not bootable. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:16.879042 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-33ebef18-b9de-49c6-aeda-d7a0daba8de9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.190512 Oct 24 10:56:16.883156 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2867/5765] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:56:16 2022] POST /compute/v2.1/servers => generated 110 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:56:16.886935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dd7c395a-4d82-4a64-a2c0-751b4f190f70 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:16.889873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dd7c395a-4d82-4a64-a2c0-751b4f190f70 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:16.901138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd7c395a-4d82-4a64-a2c0-751b4f190f70 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:16.902136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd7c395a-4d82-4a64-a2c0-751b4f190f70 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:16.902367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd7c395a-4d82-4a64-a2c0-751b4f190f70 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:16.903281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd7c395a-4d82-4a64-a2c0-751b4f190f70 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:16.904070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd7c395a-4d82-4a64-a2c0-751b4f190f70 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:16.904720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd7c395a-4d82-4a64-a2c0-751b4f190f70 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:17.229559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2f29b9db-25f0-4d8c-ba04-89800dae8fc0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:17.244962 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2f29b9db-25f0-4d8c-ba04-89800dae8fc0 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1690 microversion: 2.1 time: 0.546018 Oct 24 10:56:17.245555 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2899/5766] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:16 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1690 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:17.270389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-04b1f5e2-41e5-4acd-84aa-0e2fc6430f61 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:17.272710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-04b1f5e2-41e5-4acd-84aa-0e2fc6430f61 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:17.282153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04b1f5e2-41e5-4acd-84aa-0e2fc6430f61 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:17.296349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dd7c395a-4d82-4a64-a2c0-751b4f190f70 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73d995c472441569251b09450f9be70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5091683189114d928b6978b362a4182b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:17.306577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04b1f5e2-41e5-4acd-84aa-0e2fc6430f61 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:17.307032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04b1f5e2-41e5-4acd-84aa-0e2fc6430f61 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:17.307794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04b1f5e2-41e5-4acd-84aa-0e2fc6430f61 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:17.308245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04b1f5e2-41e5-4acd-84aa-0e2fc6430f61 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:17.308670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04b1f5e2-41e5-4acd-84aa-0e2fc6430f61 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:17.311499 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dd7c395a-4d82-4a64-a2c0-751b4f190f70 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 200 len: 1470 microversion: 2.1 time: 0.425875 Oct 24 10:56:17.312805 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2868/5767] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:16 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 1470 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:18.003178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-04b1f5e2-41e5-4acd-84aa-0e2fc6430f61 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:18.016644 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-04b1f5e2-41e5-4acd-84aa-0e2fc6430f61 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.769605 Oct 24 10:56:18.022335 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2900/5768] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:17 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:18.051429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1fec73db-cdae-42c4-a9aa-96da0624e72a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:18.052686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1fec73db-cdae-42c4-a9aa-96da0624e72a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:18.080982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fec73db-cdae-42c4-a9aa-96da0624e72a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:18.081793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fec73db-cdae-42c4-a9aa-96da0624e72a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:18.082466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fec73db-cdae-42c4-a9aa-96da0624e72a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:18.083455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fec73db-cdae-42c4-a9aa-96da0624e72a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:18.084299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fec73db-cdae-42c4-a9aa-96da0624e72a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:18.084985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fec73db-cdae-42c4-a9aa-96da0624e72a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:18.272804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aa9e34f6-399b-4920-b29d-ce78fbbe3c3b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:18.273879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aa9e34f6-399b-4920-b29d-ce78fbbe3c3b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:18.287742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa9e34f6-399b-4920-b29d-ce78fbbe3c3b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:18.289319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa9e34f6-399b-4920-b29d-ce78fbbe3c3b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:18.289987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa9e34f6-399b-4920-b29d-ce78fbbe3c3b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:18.291805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa9e34f6-399b-4920-b29d-ce78fbbe3c3b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:18.295921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa9e34f6-399b-4920-b29d-ce78fbbe3c3b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:18.296580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa9e34f6-399b-4920-b29d-ce78fbbe3c3b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:18.671207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1fec73db-cdae-42c4-a9aa-96da0624e72a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:18.688828 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1fec73db-cdae-42c4-a9aa-96da0624e72a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.641741 Oct 24 10:56:18.691653 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2869/5769] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:18 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:18.709658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-364c408b-a416-4b03-92d7-147394a255b7 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:18.710475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-364c408b-a416-4b03-92d7-147394a255b7 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:18.730823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-364c408b-a416-4b03-92d7-147394a255b7 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:18.732524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-364c408b-a416-4b03-92d7-147394a255b7 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:18.733838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-364c408b-a416-4b03-92d7-147394a255b7 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:18.735351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-364c408b-a416-4b03-92d7-147394a255b7 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:18.736033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-364c408b-a416-4b03-92d7-147394a255b7 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:18.737132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-364c408b-a416-4b03-92d7-147394a255b7 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:18.826906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-364c408b-a416-4b03-92d7-147394a255b7 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:18.830285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-364c408b-a416-4b03-92d7-147394a255b7 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:18.832697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-364c408b-a416-4b03-92d7-147394a255b7 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:18.834112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-364c408b-a416-4b03-92d7-147394a255b7 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lazy-loading 'fault' on Instance uuid 260e2e6b-7bb4-402a-b571-6b1b439e9a0e {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:56:18.878831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aa9e34f6-399b-4920-b29d-ce78fbbe3c3b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:18.894531 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aa9e34f6-399b-4920-b29d-ce78fbbe3c3b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1683 microversion: 2.1 time: 0.624291 Oct 24 10:56:18.911528 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2901/5770] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:18 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1683 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:18.920869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-b55a51f6-08e2-4d3a-baca-6dbb0b72a449 req-4334a044-4bd8-443f-b4fe-88b42b2028b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260e2e6b-7bb4-402a-b571-6b1b439e9a0e", "name": "network-vif-deleted", "tag": "ba5c365d-d4b1-46c7-9164-e9f274968407"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:18.929145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-364c408b-a416-4b03-92d7-147394a255b7 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73d995c472441569251b09450f9be70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5091683189114d928b6978b362a4182b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:18.931904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b55a51f6-08e2-4d3a-baca-6dbb0b72a449 req-4334a044-4bd8-443f-b4fe-88b42b2028b1 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:18.933092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b55a51f6-08e2-4d3a-baca-6dbb0b72a449 req-4334a044-4bd8-443f-b4fe-88b42b2028b1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:18.933697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b55a51f6-08e2-4d3a-baca-6dbb0b72a449 req-4334a044-4bd8-443f-b4fe-88b42b2028b1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:18.944607 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-364c408b-a416-4b03-92d7-147394a255b7 tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 200 len: 1305 microversion: 2.1 time: 0.249671 Oct 24 10:56:18.945391 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2870/5771] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:18 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 1305 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:18.959313 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-b55a51f6-08e2-4d3a-baca-6dbb0b72a449 req-4334a044-4bd8-443f-b4fe-88b42b2028b1 service nova] Creating event network-vif-deleted:ba5c365d-d4b1-46c7-9164-e9f274968407 for instance 260e2e6b-7bb4-402a-b571-6b1b439e9a0e on n-h1-858383-15 Oct 24 10:56:18.972173 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-b55a51f6-08e2-4d3a-baca-6dbb0b72a449 req-4334a044-4bd8-443f-b4fe-88b42b2028b1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058838 Oct 24 10:56:18.976878 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2902/5772] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:56:19.977115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa95696a-00c9-42f5-a22e-90ceb269d11b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:19.978313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa95696a-00c9-42f5-a22e-90ceb269d11b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] [instance: 260e2e6b-7bb4-402a-b571-6b1b439e9a0e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:19.986110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa95696a-00c9-42f5-a22e-90ceb269d11b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:19.986869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa95696a-00c9-42f5-a22e-90ceb269d11b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:19.987484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa95696a-00c9-42f5-a22e-90ceb269d11b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:19.988357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa95696a-00c9-42f5-a22e-90ceb269d11b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:19.989020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa95696a-00c9-42f5-a22e-90ceb269d11b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:19.989614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa95696a-00c9-42f5-a22e-90ceb269d11b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:20.005338 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-aa95696a-00c9-42f5-a22e-90ceb269d11b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] HTTP exception thrown: Instance 260e2e6b-7bb4-402a-b571-6b1b439e9a0e could not be found. Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa95696a-00c9-42f5-a22e-90ceb269d11b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Request method failure captured: Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e HTTP/1.1 Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8zipdn8O82ntL6hZsrE1JKSJfK4AdqKGhvBVcIGJq3_SQaa4Ru68gcJYU_HS5zc2fxVvxVb4YWnQDf8rm8Vxe9sXRQkwoYjhW2FjFIgWJL-Tgipw7kfPV1659C1ynd4bfah0h6i8MNPs-DUaWRSBZQmWODBO1oAI-27eM5SzizCa4 Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 5091683189114d928b6978b362a4182b Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesNegativeTest-1248282408 Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5091683189114d928b6978b362a4182b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5091683189114d928b6978b362a4182b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5091683189114d928b6978b362a4182b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5091683189114d928b6978b362a4182b", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-VolumesNegativeTest-1248282408 Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 5091683189114d928b6978b362a4182b Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesNegativeTest-1248282408 Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-VolumesNegativeTest-1248282408-project Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: e73d995c472441569251b09450f9be70 Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-VolumesNegativeTest-1248282408-project Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 260e2e6b-7bb4-402a-b571-6b1b439e9a0e could not be found. Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '260e2e6b-7bb4-402a-b571-6b1b439e9a0e'} Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 260e2e6b-7bb4-402a-b571-6b1b439e9a0e could not be found. Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 260e2e6b-7bb4-402a-b571-6b1b439e9a0e could not be found. Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:20.007200 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:20.011603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:20.011603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:20.011603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:20.011603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:20.011603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:20.011603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 260e2e6b-7bb4-402a-b571-6b1b439e9a0e could not be found. Oct 24 10:56:20.011603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:20.013342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa95696a-00c9-42f5-a22e-90ceb269d11b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] Returning 404 to user: Instance 260e2e6b-7bb4-402a-b571-6b1b439e9a0e could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:20.015405 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa95696a-00c9-42f5-a22e-90ceb269d11b tempest-VolumesNegativeTest-1248282408 tempest-VolumesNegativeTest-1248282408-project] 10.222.0.50 "GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e" status: 404 len: 111 microversion: 2.1 time: 0.042064 Oct 24 10:56:20.016518 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2871/5773] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:19 2022] GET /compute/v2.1/servers/260e2e6b-7bb4-402a-b571-6b1b439e9a0e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:56:20.817591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-dd6ccb99-e9c7-496d-9aa6-48a3d14997e6 req-c1262eca-5cfc-407f-8362-7c75ab7d9877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfd7080-7dfd-489b-8128-0e66aec16fff", "name": "network-vif-plugged", "status": "completed", "tag": "2cae1fc6-3659-43fd-97c3-9b936fe09a4e"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:20.848739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dd6ccb99-e9c7-496d-9aa6-48a3d14997e6 req-c1262eca-5cfc-407f-8362-7c75ab7d9877 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:20.854661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dd6ccb99-e9c7-496d-9aa6-48a3d14997e6 req-c1262eca-5cfc-407f-8362-7c75ab7d9877 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:20.855232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-dd6ccb99-e9c7-496d-9aa6-48a3d14997e6 req-c1262eca-5cfc-407f-8362-7c75ab7d9877 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:20.905066 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-dd6ccb99-e9c7-496d-9aa6-48a3d14997e6 req-c1262eca-5cfc-407f-8362-7c75ab7d9877 service nova] Creating event network-vif-plugged:2cae1fc6-3659-43fd-97c3-9b936fe09a4e for instance 3bfd7080-7dfd-489b-8128-0e66aec16fff on n-h1-858383-15 Oct 24 10:56:20.915463 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-dd6ccb99-e9c7-496d-9aa6-48a3d14997e6 req-c1262eca-5cfc-407f-8362-7c75ab7d9877 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103383 Oct 24 10:56:20.916770 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2903/5774] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:56:21.669324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e6a6e857-0f0d-43a5-ba7e-32dab39bd5a5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1452131481", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "destination_type": "local"}, {"source_type": "volume", "uuid": "f56ebf65-3d8b-48ca-b453-70b5c0f90708", "destination_type": "invalid"}], "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e6a6e857-0f0d-43a5-ba7e-32dab39bd5a5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 495 Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1452131481", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "destination_type": "local"}, {"source_type": "volume", "uuid": "f56ebf65-3d8b-48ca-b453-70b5c0f90708", "destination_type": "invalid"}], "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1452131481', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'f56ebf65-3d8b-48ca-b453-70b5c0f90708', 'destination_type': 'invalid'}], 'networks': [{'uuid': '33496d87-63b8-423d-9b93-72eddb64dec3'}]}}} Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'invalid' Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:21.678290 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 24 10:56:21.682335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:21.686700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e6a6e857-0f0d-43a5-ba7e-32dab39bd5a5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:21.687761 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e6a6e857-0f0d-43a5-ba7e-32dab39bd5a5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.022557 Oct 24 10:56:21.689907 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2872/5775] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:56:21 2022] POST /compute/v2.1/servers => generated 155 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:56:21.698644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bf48df61-e190-482d-afbc-d17764d958d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:21.700598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bf48df61-e190-482d-afbc-d17764d958d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:21.710080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf48df61-e190-482d-afbc-d17764d958d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:21.710971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf48df61-e190-482d-afbc-d17764d958d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:21.711674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf48df61-e190-482d-afbc-d17764d958d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:21.714662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf48df61-e190-482d-afbc-d17764d958d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:21.715435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf48df61-e190-482d-afbc-d17764d958d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:21.716099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf48df61-e190-482d-afbc-d17764d958d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:22.352000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bf48df61-e190-482d-afbc-d17764d958d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:22.382002 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bf48df61-e190-482d-afbc-d17764d958d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.688499 Oct 24 10:56:22.403047 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2904/5776] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:21 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:22.427689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-66a20776-b1c8-4815-b5eb-a6755dab0cfa tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:22.432114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-66a20776-b1c8-4815-b5eb-a6755dab0cfa tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:22.449840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66a20776-b1c8-4815-b5eb-a6755dab0cfa tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:22.450334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66a20776-b1c8-4815-b5eb-a6755dab0cfa tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:22.452360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66a20776-b1c8-4815-b5eb-a6755dab0cfa tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:22.453849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66a20776-b1c8-4815-b5eb-a6755dab0cfa tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:22.457484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66a20776-b1c8-4815-b5eb-a6755dab0cfa tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:22.458269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66a20776-b1c8-4815-b5eb-a6755dab0cfa tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:22.815421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-66a20776-b1c8-4815-b5eb-a6755dab0cfa tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:22.844375 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-66a20776-b1c8-4815-b5eb-a6755dab0cfa tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.428131 Oct 24 10:56:22.845739 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2873/5777] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:22 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:22.923289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-853c515d-1c40-4946-9b93-92a64f6b2696 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1452038354", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-853c515d-1c40-4946-9b93-92a64f6b2696 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 492 Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1452038354", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1452038354', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '33496d87-63b8-423d-9b93-72eddb64dec3'}]}}} Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:22.932530 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 24 10:56:22.935590 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:22.942485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-853c515d-1c40-4946-9b93-92a64f6b2696 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:22.944311 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-853c515d-1c40-4946-9b93-92a64f6b2696 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.027385 Oct 24 10:56:22.945297 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2905/5778] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:56:22 2022] POST /compute/v2.1/servers => generated 624 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:56:22.954658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-11323dde-1922-4c3a-b816-c163fc2b0fa5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:22.955281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-11323dde-1922-4c3a-b816-c163fc2b0fa5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:22.970121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11323dde-1922-4c3a-b816-c163fc2b0fa5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:22.972169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11323dde-1922-4c3a-b816-c163fc2b0fa5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:22.973760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11323dde-1922-4c3a-b816-c163fc2b0fa5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:22.975619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11323dde-1922-4c3a-b816-c163fc2b0fa5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:22.977043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11323dde-1922-4c3a-b816-c163fc2b0fa5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:22.978639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-11323dde-1922-4c3a-b816-c163fc2b0fa5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:23.291994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-11323dde-1922-4c3a-b816-c163fc2b0fa5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:23.295670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:56:23.309942 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-11323dde-1922-4c3a-b816-c163fc2b0fa5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.359668 Oct 24 10:56:23.314061 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2874/5779] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:22 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:23.344497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2b0a6da6-5f14-4f3f-acb1-f68290aaff2a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:23.346686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2b0a6da6-5f14-4f3f-acb1-f68290aaff2a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:23.360369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b0a6da6-5f14-4f3f-acb1-f68290aaff2a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:23.361748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b0a6da6-5f14-4f3f-acb1-f68290aaff2a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:23.362701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b0a6da6-5f14-4f3f-acb1-f68290aaff2a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:23.363648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b0a6da6-5f14-4f3f-acb1-f68290aaff2a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:23.364471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b0a6da6-5f14-4f3f-acb1-f68290aaff2a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:23.365147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b0a6da6-5f14-4f3f-acb1-f68290aaff2a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:23.939525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2b0a6da6-5f14-4f3f-acb1-f68290aaff2a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:23.955948 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2b0a6da6-5f14-4f3f-acb1-f68290aaff2a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.611717 Oct 24 10:56:23.956626 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2906/5780] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:23 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:24.094686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7a54f3c3-ebf2-4828-9116-8854ae4e2e0a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7a54f3c3-ebf2-4828-9116-8854ae4e2e0a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 416 Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'networks': [{'uuid': '33496d87-63b8-423d-9b93-72eddb64dec3'}]}}} Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:24.100128 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 10:56:24.103398 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:24.109502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7a54f3c3-ebf2-4828-9116-8854ae4e2e0a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:24.113175 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7a54f3c3-ebf2-4828-9116-8854ae4e2e0a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.032698 Oct 24 10:56:24.126260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0e94d43f-0980-4420-9f28-65555612a8c4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:24.127217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0e94d43f-0980-4420-9f28-65555612a8c4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:24.137988 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2875/5781] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:56:24 2022] POST /compute/v2.1/servers => generated 619 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:56:24.156865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e94d43f-0980-4420-9f28-65555612a8c4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:24.162288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e94d43f-0980-4420-9f28-65555612a8c4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:24.162877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e94d43f-0980-4420-9f28-65555612a8c4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:24.163762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e94d43f-0980-4420-9f28-65555612a8c4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:24.164327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e94d43f-0980-4420-9f28-65555612a8c4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:24.164997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e94d43f-0980-4420-9f28-65555612a8c4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:24.634435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0e94d43f-0980-4420-9f28-65555612a8c4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:24.647009 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0e94d43f-0980-4420-9f28-65555612a8c4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.527946 Oct 24 10:56:24.649457 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2907/5782] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:24 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:24.680154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2abafad3-0217-4813-ade6-fa1e9d019695 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:24.681028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2abafad3-0217-4813-ade6-fa1e9d019695 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:24.699539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2abafad3-0217-4813-ade6-fa1e9d019695 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:24.702669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2abafad3-0217-4813-ade6-fa1e9d019695 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:24.703999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2abafad3-0217-4813-ade6-fa1e9d019695 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:24.705140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2abafad3-0217-4813-ade6-fa1e9d019695 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:24.705810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2abafad3-0217-4813-ade6-fa1e9d019695 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:24.706667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2abafad3-0217-4813-ade6-fa1e9d019695 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:25.041376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2abafad3-0217-4813-ade6-fa1e9d019695 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:25.050933 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2abafad3-0217-4813-ade6-fa1e9d019695 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.376206 Oct 24 10:56:25.051509 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2876/5783] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:24 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:25.126632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d0bc64f1-837f-441a-b866-d2e8a730cc63 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-841108726", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": -1, "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:25.143482 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-d0bc64f1-837f-441a-b866-d2e8a730cc63 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Flavor -1 could not be found. Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d0bc64f1-837f-441a-b866-d2e8a730cc63 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 205 Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-841108726", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": -1, "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: exception: Flavor -1 could not be found. Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-841108726', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': -1, 'networks': [{'uuid': '33496d87-63b8-423d-9b93-72eddb64dec3'}]}}} Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:25.146461 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:25.150278 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:25.150278 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:25.150278 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:25.150278 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:25.150278 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 10:56:25.150278 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 24 10:56:25.150278 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 24 10:56:25.150278 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 24 10:56:25.150278 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:25.150278 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:25.150278 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:25.150278 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:25.150278 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:25.150278 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:25.150278 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:25.150278 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:25.150278 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 24 10:56:25.150278 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:25.154389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d0bc64f1-837f-441a-b866-d2e8a730cc63 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:25.155743 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d0bc64f1-837f-441a-b866-d2e8a730cc63 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.034056 Oct 24 10:56:25.165455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5c2fb6a1-b53b-4868-8eb8-b62a2d411abc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:25.166741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c2fb6a1-b53b-4868-8eb8-b62a2d411abc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:25.171888 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2908/5784] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:56:25 2022] POST /compute/v2.1/servers => generated 73 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 24 10:56:25.174261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c2fb6a1-b53b-4868-8eb8-b62a2d411abc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:25.175026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c2fb6a1-b53b-4868-8eb8-b62a2d411abc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:25.175879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c2fb6a1-b53b-4868-8eb8-b62a2d411abc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:25.176828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c2fb6a1-b53b-4868-8eb8-b62a2d411abc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:25.177490 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c2fb6a1-b53b-4868-8eb8-b62a2d411abc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:25.178113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c2fb6a1-b53b-4868-8eb8-b62a2d411abc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:25.444922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5c2fb6a1-b53b-4868-8eb8-b62a2d411abc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:25.453709 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5c2fb6a1-b53b-4868-8eb8-b62a2d411abc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.292563 Oct 24 10:56:25.457801 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2877/5785] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:25 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:25.487782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b6a4a444-1a49-4589-994f-c6fb74522062 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:25.491452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b6a4a444-1a49-4589-994f-c6fb74522062 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:25.506915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6a4a444-1a49-4589-994f-c6fb74522062 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:25.507753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6a4a444-1a49-4589-994f-c6fb74522062 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:25.508377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6a4a444-1a49-4589-994f-c6fb74522062 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:25.509302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6a4a444-1a49-4589-994f-c6fb74522062 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:25.510216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6a4a444-1a49-4589-994f-c6fb74522062 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:25.511374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6a4a444-1a49-4589-994f-c6fb74522062 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:25.661185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f50bd2b8-9aca-4e20-bcde-b8eccf9947f4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:25.663834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f50bd2b8-9aca-4e20-bcde-b8eccf9947f4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:25.671073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f50bd2b8-9aca-4e20-bcde-b8eccf9947f4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:25.671659 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f50bd2b8-9aca-4e20-bcde-b8eccf9947f4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:25.672240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f50bd2b8-9aca-4e20-bcde-b8eccf9947f4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:25.673352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f50bd2b8-9aca-4e20-bcde-b8eccf9947f4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:25.674178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f50bd2b8-9aca-4e20-bcde-b8eccf9947f4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:25.674917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f50bd2b8-9aca-4e20-bcde-b8eccf9947f4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:25.743058 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f50bd2b8-9aca-4e20-bcde-b8eccf9947f4 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086460 Oct 24 10:56:25.745559 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2878/5786] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:56:25 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 10:56:25.932702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b6a4a444-1a49-4589-994f-c6fb74522062 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:25.937336 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b6a4a444-1a49-4589-994f-c6fb74522062 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.456316 Oct 24 10:56:25.937751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c9f53052-c64d-47e9-bcf5-d0eb17c7d950 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:25.938457 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2909/5787] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:25 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:25.939998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c9f53052-c64d-47e9-bcf5-d0eb17c7d950 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:25.956561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9f53052-c64d-47e9-bcf5-d0eb17c7d950 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:25.957117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9f53052-c64d-47e9-bcf5-d0eb17c7d950 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:25.957565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9f53052-c64d-47e9-bcf5-d0eb17c7d950 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:25.958287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9f53052-c64d-47e9-bcf5-d0eb17c7d950 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:25.959236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9f53052-c64d-47e9-bcf5-d0eb17c7d950 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:25.959236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9f53052-c64d-47e9-bcf5-d0eb17c7d950 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:26.006105 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c9f53052-c64d-47e9-bcf5-d0eb17c7d950 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072123 Oct 24 10:56:26.007162 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2879/5788] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 10:56:25 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 10:56:26.030487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e686c37-35d1-4acc-a2a3-a9aab0502729 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1243818172", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e686c37-35d1-4acc-a2a3-a9aab0502729 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 173 Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1243818172", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1243818172', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '33496d87-63b8-423d-9b93-72eddb64dec3'}]}}} Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi -1 Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:56:26.035809 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:56:26.040706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:56:26.040706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:56:26.040706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:56:26.040706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 24 10:56:26.040706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:26.040706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:26.040706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:26.040706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:26.040706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:26.040706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:26.040706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:56:26.040706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:56:26.040706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 24 10:56:26.040706 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:26.043093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e686c37-35d1-4acc-a2a3-a9aab0502729 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:26.044133 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1e686c37-35d1-4acc-a2a3-a9aab0502729 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.021611 Oct 24 10:56:26.045452 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2910/5789] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:56:26 2022] POST /compute/v2.1/servers => generated 145 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:56:26.053813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-95ef5b4f-36a9-4796-b7a9-ec609e1a8d2f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:26.054655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-95ef5b4f-36a9-4796-b7a9-ec609e1a8d2f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:26.065008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95ef5b4f-36a9-4796-b7a9-ec609e1a8d2f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:26.066898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95ef5b4f-36a9-4796-b7a9-ec609e1a8d2f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:26.067668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95ef5b4f-36a9-4796-b7a9-ec609e1a8d2f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:26.069230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95ef5b4f-36a9-4796-b7a9-ec609e1a8d2f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:26.069868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95ef5b4f-36a9-4796-b7a9-ec609e1a8d2f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:26.070471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95ef5b4f-36a9-4796-b7a9-ec609e1a8d2f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:26.159760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9c553ebf-2922-4969-bbc1-705b4f7cc934 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:26.160262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9c553ebf-2922-4969-bbc1-705b4f7cc934 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:26.167631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c553ebf-2922-4969-bbc1-705b4f7cc934 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:26.168126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c553ebf-2922-4969-bbc1-705b4f7cc934 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:26.168564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c553ebf-2922-4969-bbc1-705b4f7cc934 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:26.169306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c553ebf-2922-4969-bbc1-705b4f7cc934 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:26.170349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c553ebf-2922-4969-bbc1-705b4f7cc934 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:26.170780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9c553ebf-2922-4969-bbc1-705b4f7cc934 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:26.198279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9c553ebf-2922-4969-bbc1-705b4f7cc934 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:56:26.320651 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9c553ebf-2922-4969-bbc1-705b4f7cc934 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 204 len: 0 microversion: 2.1 time: 0.162192 Oct 24 10:56:26.339780 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2911/5790] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:56:26 2022] DELETE /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 10:56:26.347063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ab9e6529-2c14-472f-a98c-609e2de9a3de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:26.351552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ab9e6529-2c14-472f-a98c-609e2de9a3de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:26.362043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab9e6529-2c14-472f-a98c-609e2de9a3de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:26.363080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab9e6529-2c14-472f-a98c-609e2de9a3de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:26.363682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab9e6529-2c14-472f-a98c-609e2de9a3de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:26.365374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab9e6529-2c14-472f-a98c-609e2de9a3de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:26.366005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab9e6529-2c14-472f-a98c-609e2de9a3de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:26.367163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab9e6529-2c14-472f-a98c-609e2de9a3de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:26.504933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-95ef5b4f-36a9-4796-b7a9-ec609e1a8d2f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:26.522143 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-95ef5b4f-36a9-4796-b7a9-ec609e1a8d2f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.472639 Oct 24 10:56:26.536860 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2880/5791] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:26 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:26.548420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-21be7bd9-b80e-4342-a1f3-a15354e30cbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:26.549071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-21be7bd9-b80e-4342-a1f3-a15354e30cbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:26.555078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21be7bd9-b80e-4342-a1f3-a15354e30cbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:26.555562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21be7bd9-b80e-4342-a1f3-a15354e30cbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:26.555997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21be7bd9-b80e-4342-a1f3-a15354e30cbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:26.556688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21be7bd9-b80e-4342-a1f3-a15354e30cbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:26.557171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21be7bd9-b80e-4342-a1f3-a15354e30cbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:26.557598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21be7bd9-b80e-4342-a1f3-a15354e30cbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:26.716562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ab9e6529-2c14-472f-a98c-609e2de9a3de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:26.734508 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ab9e6529-2c14-472f-a98c-609e2de9a3de tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 200 len: 1674 microversion: 2.1 time: 0.392917 Oct 24 10:56:26.737319 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2912/5792] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:26 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 1674 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:26.853294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-21be7bd9-b80e-4342-a1f3-a15354e30cbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:26.871222 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-21be7bd9-b80e-4342-a1f3-a15354e30cbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.326576 Oct 24 10:56:26.881326 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2881/5793] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:26 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:26.953774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-146a9560-bf31-48e3-acc9-37b03c4f7a4c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-791417625", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:26.960522 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-146a9560-bf31-48e3-acc9-37b03c4f7a4c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-146a9560-bf31-48e3-acc9-37b03c4f7a4c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 215 Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-791417625", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-791417625', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:26.963561 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:26.968798 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:26.968798 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:26.968798 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:26.968798 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:26.968798 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:26.968798 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:26.968798 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 24 10:56:26.968798 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:26.972850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-146a9560-bf31-48e3-acc9-37b03c4f7a4c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:26.974188 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-146a9560-bf31-48e3-acc9-37b03c4f7a4c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.026999 Oct 24 10:56:26.975345 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2913/5794] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:56:26 2022] POST /compute/v2.1/servers => generated 123 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:56:26.984145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f77da309-9810-4106-9cb4-8cd4fc5e0146 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:26.984791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f77da309-9810-4106-9cb4-8cd4fc5e0146 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:26.993742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f77da309-9810-4106-9cb4-8cd4fc5e0146 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:26.994782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f77da309-9810-4106-9cb4-8cd4fc5e0146 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:26.995627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f77da309-9810-4106-9cb4-8cd4fc5e0146 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:26.996672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f77da309-9810-4106-9cb4-8cd4fc5e0146 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:26.997757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f77da309-9810-4106-9cb4-8cd4fc5e0146 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:26.998500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f77da309-9810-4106-9cb4-8cd4fc5e0146 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:27.405782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f77da309-9810-4106-9cb4-8cd4fc5e0146 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:27.415883 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f77da309-9810-4106-9cb4-8cd4fc5e0146 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.436363 Oct 24 10:56:27.428860 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2882/5795] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:26 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:27.443129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5bf03837-7ebd-4c1b-9f6e-7281b95c413f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:27.443928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5bf03837-7ebd-4c1b-9f6e-7281b95c413f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:27.454589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bf03837-7ebd-4c1b-9f6e-7281b95c413f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:27.455740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bf03837-7ebd-4c1b-9f6e-7281b95c413f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:27.456550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bf03837-7ebd-4c1b-9f6e-7281b95c413f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:27.457995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bf03837-7ebd-4c1b-9f6e-7281b95c413f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:27.458809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bf03837-7ebd-4c1b-9f6e-7281b95c413f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:27.459529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bf03837-7ebd-4c1b-9f6e-7281b95c413f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:27.749980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5bf03837-7ebd-4c1b-9f6e-7281b95c413f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:27.759137 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5bf03837-7ebd-4c1b-9f6e-7281b95c413f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.321252 Oct 24 10:56:27.760221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-05069518-0908-4fff-96a7-09916b6991fe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:27.761012 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2914/5796] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:27 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:27.761128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-05069518-0908-4fff-96a7-09916b6991fe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:27.767761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05069518-0908-4fff-96a7-09916b6991fe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:27.768435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05069518-0908-4fff-96a7-09916b6991fe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:27.769063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05069518-0908-4fff-96a7-09916b6991fe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:27.769956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05069518-0908-4fff-96a7-09916b6991fe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:27.770426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05069518-0908-4fff-96a7-09916b6991fe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:27.771142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05069518-0908-4fff-96a7-09916b6991fe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:27.902300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-083feab6-d88d-450c-bcf6-e5cc9f9b8f55 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-507798229", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "key_name": "tempest-key-1259675574", "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:28.018934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-083feab6-d88d-450c-bcf6-e5cc9f9b8f55 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] validate_networks() for [('33496d87-63b8-423d-9b93-72eddb64dec3', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:56:28.121400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-05069518-0908-4fff-96a7-09916b6991fe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:28.132620 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-05069518-0908-4fff-96a7-09916b6991fe tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 200 len: 1674 microversion: 2.1 time: 0.376867 Oct 24 10:56:28.147067 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2883/5797] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:27 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 1674 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:28.800523 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-083feab6-d88d-450c-bcf6-e5cc9f9b8f55 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Invalid key_name provided. Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-083feab6-d88d-450c-bcf6-e5cc9f9b8f55 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 246 Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-507798229", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "key_name": "tempest-key-1259675574", "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid key_name provided. Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-507798229', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'key_name': 'tempest-key-1259675574', 'networks': [{'uuid': '33496d87-63b8-423d-9b93-72eddb64dec3'}]}}} Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1259675574 not found for user a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:28.802959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 24 10:56:28.807896 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:28.811654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-083feab6-d88d-450c-bcf6-e5cc9f9b8f55 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 400 to user: Invalid key_name provided. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:28.820470 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-083feab6-d88d-450c-bcf6-e5cc9f9b8f55 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.926191 Oct 24 10:56:28.822683 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2915/5798] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:56:27 2022] POST /compute/v2.1/servers => generated 70 bytes in 936 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 24 10:56:28.831911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9dd8aab2-8295-48eb-90df-c79a2b21e1ec tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:28.833152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9dd8aab2-8295-48eb-90df-c79a2b21e1ec tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:28.853055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dd8aab2-8295-48eb-90df-c79a2b21e1ec tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:28.855939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dd8aab2-8295-48eb-90df-c79a2b21e1ec tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:28.856626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dd8aab2-8295-48eb-90df-c79a2b21e1ec tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:28.858427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dd8aab2-8295-48eb-90df-c79a2b21e1ec tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:28.860647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dd8aab2-8295-48eb-90df-c79a2b21e1ec tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:28.861341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dd8aab2-8295-48eb-90df-c79a2b21e1ec tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:29.158380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8adefd05-72ba-4f8b-8ed3-cbd54b4da252 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:29.159155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8adefd05-72ba-4f8b-8ed3-cbd54b4da252 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:29.180113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8adefd05-72ba-4f8b-8ed3-cbd54b4da252 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:29.183948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8adefd05-72ba-4f8b-8ed3-cbd54b4da252 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:29.184808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8adefd05-72ba-4f8b-8ed3-cbd54b4da252 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:29.185877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8adefd05-72ba-4f8b-8ed3-cbd54b4da252 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:29.186568 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8adefd05-72ba-4f8b-8ed3-cbd54b4da252 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:29.187214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8adefd05-72ba-4f8b-8ed3-cbd54b4da252 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:29.662923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9dd8aab2-8295-48eb-90df-c79a2b21e1ec tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:29.679271 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9dd8aab2-8295-48eb-90df-c79a2b21e1ec tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.852411 Oct 24 10:56:29.688423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8adefd05-72ba-4f8b-8ed3-cbd54b4da252 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:29.691182 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2884/5799] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:28 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:29.696597 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8adefd05-72ba-4f8b-8ed3-cbd54b4da252 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 200 len: 1674 microversion: 2.1 time: 0.542688 Oct 24 10:56:29.697235 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2916/5800] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:29 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 1674 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:29.718165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eb73d526-d463-4aef-a982-aa7bcdc5ab4b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:29.718976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eb73d526-d463-4aef-a982-aa7bcdc5ab4b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:29.727302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb73d526-d463-4aef-a982-aa7bcdc5ab4b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:29.727730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb73d526-d463-4aef-a982-aa7bcdc5ab4b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:29.728169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb73d526-d463-4aef-a982-aa7bcdc5ab4b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:29.728898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb73d526-d463-4aef-a982-aa7bcdc5ab4b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:29.729554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb73d526-d463-4aef-a982-aa7bcdc5ab4b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:29.730920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb73d526-d463-4aef-a982-aa7bcdc5ab4b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:29.994034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eb73d526-d463-4aef-a982-aa7bcdc5ab4b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:30.032646 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eb73d526-d463-4aef-a982-aa7bcdc5ab4b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.320298 Oct 24 10:56:30.035300 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2885/5801] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:29 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:30.295068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b5ce312f-4e91-4b54-8023-2779000464d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1236945797", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:30.470806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.security_group_api [None req-b5ce312f-4e91-4b54-8023-2779000464d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Neutron security group does_not_exist not found {{(pid=120426) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 24 10:56:30.471385 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-b5ce312f-4e91-4b54-8023-2779000464d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b5ce312f-4e91-4b54-8023-2779000464d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 258 Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1236945797", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1236945797', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '33496d87-63b8-423d-9b93-72eddb64dec3'}]}}} Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 24 10:56:30.478614 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 24 10:56:30.483764 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:30.487729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b5ce312f-4e91-4b54-8023-2779000464d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:30.487729 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b5ce312f-4e91-4b54-8023-2779000464d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.195968 Oct 24 10:56:30.488011 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2917/5802] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:56:30 2022] POST /compute/v2.1/servers => generated 106 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:56:30.496716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-48100c82-9ad6-4055-bb93-a8bb543c4a6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:30.497562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-48100c82-9ad6-4055-bb93-a8bb543c4a6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:30.511382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48100c82-9ad6-4055-bb93-a8bb543c4a6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:30.512231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48100c82-9ad6-4055-bb93-a8bb543c4a6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:30.512818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48100c82-9ad6-4055-bb93-a8bb543c4a6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:30.514142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48100c82-9ad6-4055-bb93-a8bb543c4a6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:30.514611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48100c82-9ad6-4055-bb93-a8bb543c4a6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:30.515049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48100c82-9ad6-4055-bb93-a8bb543c4a6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:30.723227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-24bba0d3-c2c4-41ec-81e4-6527db9c9202 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:30.724010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-24bba0d3-c2c4-41ec-81e4-6527db9c9202 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:30.735682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24bba0d3-c2c4-41ec-81e4-6527db9c9202 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:30.736091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24bba0d3-c2c4-41ec-81e4-6527db9c9202 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:30.736530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24bba0d3-c2c4-41ec-81e4-6527db9c9202 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:30.737284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24bba0d3-c2c4-41ec-81e4-6527db9c9202 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:30.737736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24bba0d3-c2c4-41ec-81e4-6527db9c9202 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:30.738171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24bba0d3-c2c4-41ec-81e4-6527db9c9202 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:30.882840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-24bba0d3-c2c4-41ec-81e4-6527db9c9202 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f38592218a3b4c39a977f49dd653e556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520c2b4219cd4573bc817e65756a05ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:30.895450 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-24bba0d3-c2c4-41ec-81e4-6527db9c9202 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 200 len: 1606 microversion: 2.1 time: 0.177031 Oct 24 10:56:30.896697 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2918/5803] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:30 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 1606 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:30.937962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-48100c82-9ad6-4055-bb93-a8bb543c4a6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:30.951043 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-48100c82-9ad6-4055-bb93-a8bb543c4a6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.458918 Oct 24 10:56:30.952309 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2886/5804] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:30 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:30.977703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0fa82fff-d70e-4ea3-8f2c-7f158c982901 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:30.979974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0fa82fff-d70e-4ea3-8f2c-7f158c982901 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:30.988431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fa82fff-d70e-4ea3-8f2c-7f158c982901 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:30.989376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fa82fff-d70e-4ea3-8f2c-7f158c982901 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:30.990760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fa82fff-d70e-4ea3-8f2c-7f158c982901 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:30.992004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fa82fff-d70e-4ea3-8f2c-7f158c982901 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:30.992698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fa82fff-d70e-4ea3-8f2c-7f158c982901 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:30.993384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0fa82fff-d70e-4ea3-8f2c-7f158c982901 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:31.034626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-39f440cb-b24d-44c3-9fe8-9b1fd9be5675 req-e19dcf10-3b01-4cec-bb4f-d36d064fdb6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0", "name": "network-vif-deleted", "tag": "1adae21c-f941-4b49-90d6-25c815afce32"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:31.048186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-39f440cb-b24d-44c3-9fe8-9b1fd9be5675 req-e19dcf10-3b01-4cec-bb4f-d36d064fdb6d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:31.048796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-39f440cb-b24d-44c3-9fe8-9b1fd9be5675 req-e19dcf10-3b01-4cec-bb4f-d36d064fdb6d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:31.049211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-39f440cb-b24d-44c3-9fe8-9b1fd9be5675 req-e19dcf10-3b01-4cec-bb4f-d36d064fdb6d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:31.063917 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-39f440cb-b24d-44c3-9fe8-9b1fd9be5675 req-e19dcf10-3b01-4cec-bb4f-d36d064fdb6d service nova] Creating event network-vif-deleted:1adae21c-f941-4b49-90d6-25c815afce32 for instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 on n-h1-858383-15 Oct 24 10:56:31.076267 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-39f440cb-b24d-44c3-9fe8-9b1fd9be5675 req-e19dcf10-3b01-4cec-bb4f-d36d064fdb6d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042368 Oct 24 10:56:31.077439 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2887/5805] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:56:31.305097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0fa82fff-d70e-4ea3-8f2c-7f158c982901 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:31.319459 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0fa82fff-d70e-4ea3-8f2c-7f158c982901 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.346123 Oct 24 10:56:31.330123 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2919/5806] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:30 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:31.344404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43729a07-9ba3-4a8a-8252-ef3e4e21d10d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:31.345303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-43729a07-9ba3-4a8a-8252-ef3e4e21d10d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: dc2f11ab-f89e-414a-ad59-1f97a17da77d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:31.351594 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-43729a07-9ba3-4a8a-8252-ef3e4e21d10d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance dc2f11ab-f89e-414a-ad59-1f97a17da77d could not be found. Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43729a07-9ba3-4a8a-8252-ef3e4e21d10d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/dc2f11ab-f89e-414a-ad59-1f97a17da77d HTTP/1.1 Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance dc2f11ab-f89e-414a-ad59-1f97a17da77d could not be found. Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'dc2f11ab-f89e-414a-ad59-1f97a17da77d'} Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc2f11ab-f89e-414a-ad59-1f97a17da77d could not be found. Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc2f11ab-f89e-414a-ad59-1f97a17da77d could not be found. Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:31.353541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:31.358031 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:31.358031 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:31.358031 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:31.358031 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:31.358031 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:31.358031 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:31.358031 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc2f11ab-f89e-414a-ad59-1f97a17da77d could not be found. Oct 24 10:56:31.358031 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:31.360231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43729a07-9ba3-4a8a-8252-ef3e4e21d10d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance dc2f11ab-f89e-414a-ad59-1f97a17da77d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:31.361360 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-43729a07-9ba3-4a8a-8252-ef3e4e21d10d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dc2f11ab-f89e-414a-ad59-1f97a17da77d" status: 404 len: 111 microversion: 2.1 time: 0.022529 Oct 24 10:56:31.362195 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2888/5807] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:56:31 2022] DELETE /compute/v2.1/servers/dc2f11ab-f89e-414a-ad59-1f97a17da77d => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:56:31.372623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-087f96c0-509f-462d-b250-53d9ef3468f0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:31.373752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-087f96c0-509f-462d-b250-53d9ef3468f0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:31.382958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-087f96c0-509f-462d-b250-53d9ef3468f0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:31.383555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-087f96c0-509f-462d-b250-53d9ef3468f0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:31.384521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-087f96c0-509f-462d-b250-53d9ef3468f0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:31.385816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-087f96c0-509f-462d-b250-53d9ef3468f0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:31.386908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-087f96c0-509f-462d-b250-53d9ef3468f0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:31.387564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-087f96c0-509f-462d-b250-53d9ef3468f0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:31.576388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-087f96c0-509f-462d-b250-53d9ef3468f0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:31.586883 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-087f96c0-509f-462d-b250-53d9ef3468f0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.219824 Oct 24 10:56:31.601976 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2920/5808] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:31 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:31.616580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dfc0e262-fd14-46ac-8ae8-f73e5159b83c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:31.617354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dfc0e262-fd14-46ac-8ae8-f73e5159b83c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:31.626268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfc0e262-fd14-46ac-8ae8-f73e5159b83c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:31.626796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfc0e262-fd14-46ac-8ae8-f73e5159b83c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:31.627542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfc0e262-fd14-46ac-8ae8-f73e5159b83c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:31.628494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfc0e262-fd14-46ac-8ae8-f73e5159b83c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:31.629339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfc0e262-fd14-46ac-8ae8-f73e5159b83c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:31.630012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfc0e262-fd14-46ac-8ae8-f73e5159b83c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:31.923130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-26783ebc-055c-4641-8f9f-3d72a581ecba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:31.923767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-26783ebc-055c-4641-8f9f-3d72a581ecba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:31.956635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26783ebc-055c-4641-8f9f-3d72a581ecba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:31.963110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26783ebc-055c-4641-8f9f-3d72a581ecba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:31.965208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26783ebc-055c-4641-8f9f-3d72a581ecba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:31.966255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26783ebc-055c-4641-8f9f-3d72a581ecba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:31.967085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26783ebc-055c-4641-8f9f-3d72a581ecba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:31.967784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26783ebc-055c-4641-8f9f-3d72a581ecba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:31.990324 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-26783ebc-055c-4641-8f9f-3d72a581ecba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] HTTP exception thrown: Instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 could not be found. Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-26783ebc-055c-4641-8f9f-3d72a581ecba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Request method failure captured: Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 HTTP/1.1 Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm1-ho6lDj800c94aMkptcsFhAyG_aQg0YP0T2znWt_9OYbU1J_L-ZM_z-ENPCPusyLpH6ElPbGHn-p6csj73-WS9DKVY5h1-JT8-Z8erkHIvr2ETBcWUtx7UmF1nPsQjHYnOe1KQ3hvPt70GpiF6VmnI587Iri5jmP4L1xUciycDLk Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 520c2b4219cd4573bc817e65756a05ac Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AttachVolumeTestJSON-1687182790 Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/520c2b4219cd4573bc817e65756a05ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/520c2b4219cd4573bc817e65756a05ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/520c2b4219cd4573bc817e65756a05ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_520c2b4219cd4573bc817e65756a05ac", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AttachVolumeTestJSON-1687182790 Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 520c2b4219cd4573bc817e65756a05ac Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1687182790 Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AttachVolumeTestJSON-1687182790-project Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: f38592218a3b4c39a977f49dd653e556 Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AttachVolumeTestJSON-1687182790-project Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 could not be found. Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'd2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0'} Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 could not be found. Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 could not be found. Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:31.995507 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:32.001314 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:32.001314 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:32.001314 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:32.001314 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:32.001314 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:32.001314 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 could not be found. Oct 24 10:56:32.001314 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:32.003754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-26783ebc-055c-4641-8f9f-3d72a581ecba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Returning 404 to user: Instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:32.006338 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-26783ebc-055c-4641-8f9f-3d72a581ecba tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 404 len: 111 microversion: 2.1 time: 0.088466 Oct 24 10:56:32.007240 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2921/5809] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:31 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:56:32.018413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dfc0e262-fd14-46ac-8ae8-f73e5159b83c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:32.019855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1333e951-3e3b-49c8-a46a-8f7bba17582e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '.version_select at 0x7f04d0ce9ee0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:32.029510 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dfc0e262-fd14-46ac-8ae8-f73e5159b83c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.420141 Oct 24 10:56:32.049010 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2889/5810] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:31 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:32.052578 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1333e951-3e3b-49c8-a46a-8f7bba17582e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-521956824" status: 202 len: 0 microversion: 2.1 time: 0.039907 Oct 24 10:56:32.056639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c3037538-c541-442d-8174-5d7ec517c9d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:32.056639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c3037538-c541-442d-8174-5d7ec517c9d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 24 10:56:32.056639 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-c3037538-c541-442d-8174-5d7ec517c9d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 24 10:56:32.058353 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2922/5811] 10.222.0.50 () {58 vars in 1218 bytes} [Mon Oct 24 10:56:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-521956824 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c3037538-c541-442d-8174-5d7ec517c9d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 9223372036854775808 could not be found. Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '9223372036854775808'} Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:32.073176 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:32.078604 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:32.078604 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:32.078604 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:32.078604 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 24 10:56:32.078604 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:32.078604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c3037538-c541-442d-8174-5d7ec517c9d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:32.078604 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c3037538-c541-442d-8174-5d7ec517c9d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.025189 Oct 24 10:56:32.078604 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2890/5812] 10.222.0.50 () {58 vars in 1188 bytes} [Mon Oct 24 10:56:32 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:56:32.095923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2c499e4b-2dfc-4ee7-b091-fb44d4e1e20f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:32.097602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2c499e4b-2dfc-4ee7-b091-fb44d4e1e20f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:32.120283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c499e4b-2dfc-4ee7-b091-fb44d4e1e20f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:32.120803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c499e4b-2dfc-4ee7-b091-fb44d4e1e20f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:32.124062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c499e4b-2dfc-4ee7-b091-fb44d4e1e20f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:32.125023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c499e4b-2dfc-4ee7-b091-fb44d4e1e20f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:32.126655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c499e4b-2dfc-4ee7-b091-fb44d4e1e20f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:32.127110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c499e4b-2dfc-4ee7-b091-fb44d4e1e20f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:32.145107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:56:32.769167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2c499e4b-2dfc-4ee7-b091-fb44d4e1e20f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:32.779978 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2c499e4b-2dfc-4ee7-b091-fb44d4e1e20f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.696243 Oct 24 10:56:32.781286 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2923/5813] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:32 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:32.805532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a35197f0-78e8-4f5e-8497-85b70c1358cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:32.806433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a35197f0-78e8-4f5e-8497-85b70c1358cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:32.815447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a35197f0-78e8-4f5e-8497-85b70c1358cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:32.816257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a35197f0-78e8-4f5e-8497-85b70c1358cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:32.816989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a35197f0-78e8-4f5e-8497-85b70c1358cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:32.817936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a35197f0-78e8-4f5e-8497-85b70c1358cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:32.818618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a35197f0-78e8-4f5e-8497-85b70c1358cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:32.819270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a35197f0-78e8-4f5e-8497-85b70c1358cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:33.145251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a35197f0-78e8-4f5e-8497-85b70c1358cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:33.160145 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a35197f0-78e8-4f5e-8497-85b70c1358cb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.358330 Oct 24 10:56:33.161760 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2891/5814] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:32 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:33.184820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8117077b-9ff4-4a7e-90a9-80af164e58f9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:33.185879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8117077b-9ff4-4a7e-90a9-80af164e58f9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Failed to fetch instance by id -1 {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 24 10:56:33.186598 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-8117077b-9ff4-4a7e-90a9-80af164e58f9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance -1 could not be found. Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8117077b-9ff4-4a7e-90a9-80af164e58f9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance -1 could not be found. Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '-1'} Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:33.188428 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:33.192555 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:33.192555 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:33.192555 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 24 10:56:33.192555 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:33.192555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8117077b-9ff4-4a7e-90a9-80af164e58f9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:33.192555 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8117077b-9ff4-4a7e-90a9-80af164e58f9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.009310 Oct 24 10:56:33.198901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d438ffff-737f-4f08-92fe-ac3978e8b7bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:33.199532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d438ffff-737f-4f08-92fe-ac3978e8b7bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:33.201022 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2924/5815] 10.222.0.50 () {58 vars in 1137 bytes} [Mon Oct 24 10:56:33 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:56:33.206322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d438ffff-737f-4f08-92fe-ac3978e8b7bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:33.206827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d438ffff-737f-4f08-92fe-ac3978e8b7bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:33.207271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d438ffff-737f-4f08-92fe-ac3978e8b7bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:33.208193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d438ffff-737f-4f08-92fe-ac3978e8b7bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:33.208664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d438ffff-737f-4f08-92fe-ac3978e8b7bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:33.209131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d438ffff-737f-4f08-92fe-ac3978e8b7bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:33.457660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d438ffff-737f-4f08-92fe-ac3978e8b7bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:33.467556 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d438ffff-737f-4f08-92fe-ac3978e8b7bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.271976 Oct 24 10:56:33.469478 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2892/5816] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:33 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:33.496864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ef719258-0a24-4d90-92d0-cf837a1f73bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:33.497514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ef719258-0a24-4d90-92d0-cf837a1f73bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:33.504689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef719258-0a24-4d90-92d0-cf837a1f73bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:33.517232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef719258-0a24-4d90-92d0-cf837a1f73bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:33.517983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef719258-0a24-4d90-92d0-cf837a1f73bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:33.518741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef719258-0a24-4d90-92d0-cf837a1f73bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:33.519367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef719258-0a24-4d90-92d0-cf837a1f73bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:33.519794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef719258-0a24-4d90-92d0-cf837a1f73bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:33.768230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ef719258-0a24-4d90-92d0-cf837a1f73bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:33.783149 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ef719258-0a24-4d90-92d0-cf837a1f73bb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.289597 Oct 24 10:56:33.798127 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2925/5817] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:33 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:33.810228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5d74877-8084-47b8-933e-ac06d05c5e22 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:33.812091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d5d74877-8084-47b8-933e-ac06d05c5e22 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: a15a484f-3bfe-40dd-93e1-23a431781d93] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:33.818974 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-d5d74877-8084-47b8-933e-ac06d05c5e22 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance a15a484f-3bfe-40dd-93e1-23a431781d93 could not be found. Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5d74877-8084-47b8-933e-ac06d05c5e22 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/a15a484f-3bfe-40dd-93e1-23a431781d93/action HTTP/1.1 Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 19 Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: {"forceDelete": {}} Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance a15a484f-3bfe-40dd-93e1-23a431781d93 could not be found. Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'a15a484f-3bfe-40dd-93e1-23a431781d93', 'body': {'forceDelete': {}}} Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15a484f-3bfe-40dd-93e1-23a431781d93 could not be found. Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15a484f-3bfe-40dd-93e1-23a431781d93 could not be found. Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:33.829903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:33.838014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:33.838014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:33.838014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15a484f-3bfe-40dd-93e1-23a431781d93 could not be found. Oct 24 10:56:33.838014 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:33.838014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5d74877-8084-47b8-933e-ac06d05c5e22 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance a15a484f-3bfe-40dd-93e1-23a431781d93 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:33.838014 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d5d74877-8084-47b8-933e-ac06d05c5e22 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/a15a484f-3bfe-40dd-93e1-23a431781d93/action" status: 404 len: 111 microversion: 2.1 time: 0.027496 Oct 24 10:56:33.838014 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2893/5818] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:56:33 2022] POST /compute/v2.1/servers/a15a484f-3bfe-40dd-93e1-23a431781d93/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:56:33.847029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-32a499f7-10f0-478d-b2da-fc5aed0bf790 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:33.847976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-32a499f7-10f0-478d-b2da-fc5aed0bf790 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:33.856128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32a499f7-10f0-478d-b2da-fc5aed0bf790 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:33.856732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32a499f7-10f0-478d-b2da-fc5aed0bf790 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:33.857406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32a499f7-10f0-478d-b2da-fc5aed0bf790 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:33.858993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32a499f7-10f0-478d-b2da-fc5aed0bf790 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:33.859902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32a499f7-10f0-478d-b2da-fc5aed0bf790 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:33.860594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32a499f7-10f0-478d-b2da-fc5aed0bf790 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:34.164347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-32a499f7-10f0-478d-b2da-fc5aed0bf790 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:34.174691 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-32a499f7-10f0-478d-b2da-fc5aed0bf790 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.334013 Oct 24 10:56:34.198779 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2926/5819] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:33 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:34.208810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb2c3532-0a8e-4a20-8c1a-dfe4e92c2e91 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:34.210443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bb2c3532-0a8e-4a20-8c1a-dfe4e92c2e91 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:34.218363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb2c3532-0a8e-4a20-8c1a-dfe4e92c2e91 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:34.219213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb2c3532-0a8e-4a20-8c1a-dfe4e92c2e91 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:34.220339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb2c3532-0a8e-4a20-8c1a-dfe4e92c2e91 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:34.222299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb2c3532-0a8e-4a20-8c1a-dfe4e92c2e91 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:34.223373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb2c3532-0a8e-4a20-8c1a-dfe4e92c2e91 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:34.224086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb2c3532-0a8e-4a20-8c1a-dfe4e92c2e91 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:34.473304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bb2c3532-0a8e-4a20-8c1a-dfe4e92c2e91 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:34.483712 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bb2c3532-0a8e-4a20-8c1a-dfe4e92c2e91 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.278881 Oct 24 10:56:34.484567 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2894/5820] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:34 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:34.507386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6a71227b-bb44-4152-85ba-e865994b04b8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:34.510071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6a71227b-bb44-4152-85ba-e865994b04b8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 495ad936-fe2d-4964-a66a-3e21e085f244] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:34.516996 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-6a71227b-bb44-4152-85ba-e865994b04b8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance 495ad936-fe2d-4964-a66a-3e21e085f244 could not be found. Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6a71227b-bb44-4152-85ba-e865994b04b8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/495ad936-fe2d-4964-a66a-3e21e085f244/action HTTP/1.1 Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 39 Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: {"os-getConsoleOutput": {"length": 10}} Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 495ad936-fe2d-4964-a66a-3e21e085f244 could not be found. Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '495ad936-fe2d-4964-a66a-3e21e085f244', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 495ad936-fe2d-4964-a66a-3e21e085f244 could not be found. Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 495ad936-fe2d-4964-a66a-3e21e085f244 could not be found. Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:34.521237 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:34.525357 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:34.525357 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:34.525357 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:34.525357 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:34.525357 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 495ad936-fe2d-4964-a66a-3e21e085f244 could not be found. Oct 24 10:56:34.525357 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:34.528761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6a71227b-bb44-4152-85ba-e865994b04b8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance 495ad936-fe2d-4964-a66a-3e21e085f244 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:34.529821 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6a71227b-bb44-4152-85ba-e865994b04b8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/495ad936-fe2d-4964-a66a-3e21e085f244/action" status: 404 len: 111 microversion: 2.1 time: 0.027036 Oct 24 10:56:34.530647 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2927/5821] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:56:34 2022] POST /compute/v2.1/servers/495ad936-fe2d-4964-a66a-3e21e085f244/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:56:34.539189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ed42f36-3a3a-4f4a-9fe9-a809d186d2de tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:34.539425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ed42f36-3a3a-4f4a-9fe9-a809d186d2de tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:34.545863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ed42f36-3a3a-4f4a-9fe9-a809d186d2de tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:34.546363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ed42f36-3a3a-4f4a-9fe9-a809d186d2de tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:34.546811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ed42f36-3a3a-4f4a-9fe9-a809d186d2de tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:34.547527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ed42f36-3a3a-4f4a-9fe9-a809d186d2de tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:34.547988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ed42f36-3a3a-4f4a-9fe9-a809d186d2de tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:34.548420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ed42f36-3a3a-4f4a-9fe9-a809d186d2de tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:34.871713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2ed42f36-3a3a-4f4a-9fe9-a809d186d2de tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:34.880683 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ed42f36-3a3a-4f4a-9fe9-a809d186d2de tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.345781 Oct 24 10:56:34.881405 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2895/5822] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:34 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:34.907208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-af710b92-c2c9-45d2-885f-9130b0558d6a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:34.907971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-af710b92-c2c9-45d2-885f-9130b0558d6a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:34.915399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af710b92-c2c9-45d2-885f-9130b0558d6a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:34.915893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af710b92-c2c9-45d2-885f-9130b0558d6a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:34.916533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af710b92-c2c9-45d2-885f-9130b0558d6a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:34.917302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af710b92-c2c9-45d2-885f-9130b0558d6a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:34.917761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af710b92-c2c9-45d2-885f-9130b0558d6a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:34.918195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af710b92-c2c9-45d2-885f-9130b0558d6a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:35.133971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-af710b92-c2c9-45d2-885f-9130b0558d6a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:35.144005 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-af710b92-c2c9-45d2-885f-9130b0558d6a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.241008 Oct 24 10:56:35.155776 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2928/5823] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:34 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:35.170359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e12e522-d473-4522-9f16-4f4d6c68feb9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:35.171445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e12e522-d473-4522-9f16-4f4d6c68feb9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: c4c93b22-7fd9-4e17-998a-7833ba633bf8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:35.177725 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-1e12e522-d473-4522-9f16-4f4d6c68feb9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance c4c93b22-7fd9-4e17-998a-7833ba633bf8 could not be found. Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e12e522-d473-4522-9f16-4f4d6c68feb9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/c4c93b22-7fd9-4e17-998a-7833ba633bf8 HTTP/1.1 Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance c4c93b22-7fd9-4e17-998a-7833ba633bf8 could not be found. Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'c4c93b22-7fd9-4e17-998a-7833ba633bf8'} Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4c93b22-7fd9-4e17-998a-7833ba633bf8 could not be found. Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4c93b22-7fd9-4e17-998a-7833ba633bf8 could not be found. Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:35.184594 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:35.188811 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:35.188811 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:35.188811 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:35.188811 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4c93b22-7fd9-4e17-998a-7833ba633bf8 could not be found. Oct 24 10:56:35.188811 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:35.191549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e12e522-d473-4522-9f16-4f4d6c68feb9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance c4c93b22-7fd9-4e17-998a-7833ba633bf8 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:35.193105 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1e12e522-d473-4522-9f16-4f4d6c68feb9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/c4c93b22-7fd9-4e17-998a-7833ba633bf8" status: 404 len: 111 microversion: 2.1 time: 0.026734 Oct 24 10:56:35.193993 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2896/5824] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:35 2022] GET /compute/v2.1/servers/c4c93b22-7fd9-4e17-998a-7833ba633bf8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:56:35.205588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7e6974e6-da39-4aae-82ff-e594c53db57f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:35.206635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7e6974e6-da39-4aae-82ff-e594c53db57f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:35.219981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e6974e6-da39-4aae-82ff-e594c53db57f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:35.220728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e6974e6-da39-4aae-82ff-e594c53db57f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:35.225754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e6974e6-da39-4aae-82ff-e594c53db57f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:35.226873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e6974e6-da39-4aae-82ff-e594c53db57f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:35.227370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e6974e6-da39-4aae-82ff-e594c53db57f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:35.227916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e6974e6-da39-4aae-82ff-e594c53db57f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:35.415683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7e6974e6-da39-4aae-82ff-e594c53db57f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:35.424740 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7e6974e6-da39-4aae-82ff-e594c53db57f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.225277 Oct 24 10:56:35.425527 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2929/5825] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:35 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:35.455667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a177f333-c6d2-4616-951b-3505657990c8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:35.457262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a177f333-c6d2-4616-951b-3505657990c8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:35.465920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a177f333-c6d2-4616-951b-3505657990c8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:35.467255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a177f333-c6d2-4616-951b-3505657990c8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:35.468225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a177f333-c6d2-4616-951b-3505657990c8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:35.469226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a177f333-c6d2-4616-951b-3505657990c8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:35.469910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a177f333-c6d2-4616-951b-3505657990c8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:35.470524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a177f333-c6d2-4616-951b-3505657990c8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:35.476047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:56:35.772512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a177f333-c6d2-4616-951b-3505657990c8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:35.792047 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a177f333-c6d2-4616-951b-3505657990c8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.339072 Oct 24 10:56:35.816398 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2897/5826] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:35 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:35.984442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c798ad80-ef88-419f-b319-f50d086ddd6d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-324389907", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c798ad80-ef88-419f-b319-f50d086ddd6d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 237 Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-324389907", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-324389907', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '33496d87-63b8-423d-9b93-72eddb64dec3'}]}}} Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:36.007821 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c798ad80-ef88-419f-b319-f50d086ddd6d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:36.014030 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c798ad80-ef88-419f-b319-f50d086ddd6d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.032329 Oct 24 10:56:36.020860 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2930/5827] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:56:35 2022] POST /compute/v2.1/servers => generated 139 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:56:36.022632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9d7ea6c-a2ef-47ce-ba84-d86ced1acdcd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:36.023623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f9d7ea6c-a2ef-47ce-ba84-d86ced1acdcd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:36.033001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9d7ea6c-a2ef-47ce-ba84-d86ced1acdcd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:36.045829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9d7ea6c-a2ef-47ce-ba84-d86ced1acdcd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:36.046724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9d7ea6c-a2ef-47ce-ba84-d86ced1acdcd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:36.047580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9d7ea6c-a2ef-47ce-ba84-d86ced1acdcd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:36.048153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9d7ea6c-a2ef-47ce-ba84-d86ced1acdcd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:36.048687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9d7ea6c-a2ef-47ce-ba84-d86ced1acdcd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:36.235906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-187540d7-cf23-4a5a-b94e-cdb0c9503543 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Action: 'create', calling method: .version_select at 0x7f04d0cc0b80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1464023613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRRIo8InfVpclIHhSpNW0/AoDyNJuBLiTdqfGc4dQExjwGIeZXEAQHWaxQnjy60om/q82hy+VhYkv4xo8VOA95s5qRXrualVLIC6ktUMR3xJT0yMUoivz9nxT7ngSC6sQ=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:36.283145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-187540d7-cf23-4a5a-b94e-cdb0c9503543 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Getting quotas for project bebb2c9f56284e0799a51ae7b5744aeb. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:56:36.289943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-187540d7-cf23-4a5a-b94e-cdb0c9503543 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Getting quotas for user 793d2a1323db49f0b92e36bf0a1b7f78 and project bebb2c9f56284e0799a51ae7b5744aeb. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:56:36.331082 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-187540d7-cf23-4a5a-b94e-cdb0c9503543 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.110994 Oct 24 10:56:36.332986 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2931/5828] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:56:36 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:56:37.154664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f9d7ea6c-a2ef-47ce-ba84-d86ced1acdcd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:37.170530 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f9d7ea6c-a2ef-47ce-ba84-d86ced1acdcd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 1.151656 Oct 24 10:56:37.171151 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2898/5829] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:36 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:37.196173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ba940ff6-423f-4f82-bbb0-1efbd986ea97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:37.197399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ba940ff6-423f-4f82-bbb0-1efbd986ea97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:37.205638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba940ff6-423f-4f82-bbb0-1efbd986ea97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:37.206381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba940ff6-423f-4f82-bbb0-1efbd986ea97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:37.206985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba940ff6-423f-4f82-bbb0-1efbd986ea97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:37.207879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba940ff6-423f-4f82-bbb0-1efbd986ea97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:37.208500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba940ff6-423f-4f82-bbb0-1efbd986ea97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:37.209141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba940ff6-423f-4f82-bbb0-1efbd986ea97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:37.526790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ba940ff6-423f-4f82-bbb0-1efbd986ea97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:37.550836 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ba940ff6-423f-4f82-bbb0-1efbd986ea97 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.358770 Oct 24 10:56:37.551444 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2932/5830] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:37 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:37.655426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fb499c23-4ff9-49aa-8753-041df6e75695 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-561301362", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fb499c23-4ff9-49aa-8753-041df6e75695 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 234 Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-561301362", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-561301362', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '33496d87-63b8-423d-9b93-72eddb64dec3'}]}}} Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:37.670895 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fb499c23-4ff9-49aa-8753-041df6e75695 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fb499c23-4ff9-49aa-8753-041df6e75695 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.022696 Oct 24 10:56:37.675934 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2899/5831] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:56:37 2022] POST /compute/v2.1/servers => generated 133 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:56:37.690283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fe1cf242-275f-4591-be49-04ae4b5bfd86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:37.690945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fe1cf242-275f-4591-be49-04ae4b5bfd86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:37.704911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe1cf242-275f-4591-be49-04ae4b5bfd86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:37.705433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe1cf242-275f-4591-be49-04ae4b5bfd86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:37.705878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe1cf242-275f-4591-be49-04ae4b5bfd86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:37.716267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe1cf242-275f-4591-be49-04ae4b5bfd86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:37.718040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe1cf242-275f-4591-be49-04ae4b5bfd86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:37.726535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe1cf242-275f-4591-be49-04ae4b5bfd86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:38.460508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fe1cf242-275f-4591-be49-04ae4b5bfd86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:38.478661 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fe1cf242-275f-4591-be49-04ae4b5bfd86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.798441 Oct 24 10:56:38.495742 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2933/5832] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:37 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:38.504895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7f1ccece-4330-4a7a-955b-8a2af942d108 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:38.506116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7f1ccece-4330-4a7a-955b-8a2af942d108 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:38.518916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f1ccece-4330-4a7a-955b-8a2af942d108 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:38.519278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f1ccece-4330-4a7a-955b-8a2af942d108 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:38.519729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f1ccece-4330-4a7a-955b-8a2af942d108 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:38.520449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f1ccece-4330-4a7a-955b-8a2af942d108 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:38.520950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f1ccece-4330-4a7a-955b-8a2af942d108 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:38.521388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f1ccece-4330-4a7a-955b-8a2af942d108 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:39.056924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7f1ccece-4330-4a7a-955b-8a2af942d108 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:39.070161 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7f1ccece-4330-4a7a-955b-8a2af942d108 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.568985 Oct 24 10:56:39.071664 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2900/5833] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:38 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:39.096229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d5b69735-0749-4927-b59d-c703908462ea tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:39.096782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d5b69735-0749-4927-b59d-c703908462ea tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 5b42db84-5f9c-4b84-a623-45363a1d65d3] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:39.107350 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-d5b69735-0749-4927-b59d-c703908462ea tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance 5b42db84-5f9c-4b84-a623-45363a1d65d3 could not be found. Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d5b69735-0749-4927-b59d-c703908462ea tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/5b42db84-5f9c-4b84-a623-45363a1d65d3/action HTTP/1.1 Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 13 Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: {"pause": {}} Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 5b42db84-5f9c-4b84-a623-45363a1d65d3 could not be found. Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '5b42db84-5f9c-4b84-a623-45363a1d65d3', 'body': {'pause': {}}} Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b42db84-5f9c-4b84-a623-45363a1d65d3 could not be found. Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b42db84-5f9c-4b84-a623-45363a1d65d3 could not be found. Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:39.119150 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:39.124610 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:39.124610 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:39.124610 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b42db84-5f9c-4b84-a623-45363a1d65d3 could not be found. Oct 24 10:56:39.124610 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:39.126055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d5b69735-0749-4927-b59d-c703908462ea tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance 5b42db84-5f9c-4b84-a623-45363a1d65d3 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:39.127162 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d5b69735-0749-4927-b59d-c703908462ea tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/5b42db84-5f9c-4b84-a623-45363a1d65d3/action" status: 404 len: 111 microversion: 2.1 time: 0.036444 Oct 24 10:56:39.127961 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2934/5834] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:56:39 2022] POST /compute/v2.1/servers/5b42db84-5f9c-4b84-a623-45363a1d65d3/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:56:39.145751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-212aad40-4278-4191-bcb2-88d327e1b481 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:39.146845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-212aad40-4278-4191-bcb2-88d327e1b481 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:39.159305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-212aad40-4278-4191-bcb2-88d327e1b481 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:39.159866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-212aad40-4278-4191-bcb2-88d327e1b481 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:39.160933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-212aad40-4278-4191-bcb2-88d327e1b481 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:39.161660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-212aad40-4278-4191-bcb2-88d327e1b481 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:39.162199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-212aad40-4278-4191-bcb2-88d327e1b481 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:39.162683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-212aad40-4278-4191-bcb2-88d327e1b481 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:39.665347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-212aad40-4278-4191-bcb2-88d327e1b481 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:39.686076 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-212aad40-4278-4191-bcb2-88d327e1b481 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.552127 Oct 24 10:56:39.694942 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2901/5835] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:39 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:39.724351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6209105a-5261-402a-bd6b-06cd80319d90 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:39.725607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6209105a-5261-402a-bd6b-06cd80319d90 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:39.741875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6209105a-5261-402a-bd6b-06cd80319d90 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:39.742360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6209105a-5261-402a-bd6b-06cd80319d90 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:39.743012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6209105a-5261-402a-bd6b-06cd80319d90 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:39.743902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6209105a-5261-402a-bd6b-06cd80319d90 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:39.744520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6209105a-5261-402a-bd6b-06cd80319d90 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:39.745159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6209105a-5261-402a-bd6b-06cd80319d90 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:40.298419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6209105a-5261-402a-bd6b-06cd80319d90 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:40.315317 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6209105a-5261-402a-bd6b-06cd80319d90 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.594100 Oct 24 10:56:40.316682 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2935/5836] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:39 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:40.345427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-919cc2a8-8e19-43af-b5b7-413c8c1ef62d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:40.346578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-919cc2a8-8e19-43af-b5b7-413c8c1ef62d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:40.354345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-919cc2a8-8e19-43af-b5b7-413c8c1ef62d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:40.355220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-919cc2a8-8e19-43af-b5b7-413c8c1ef62d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:40.356116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-919cc2a8-8e19-43af-b5b7-413c8c1ef62d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:40.371723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-919cc2a8-8e19-43af-b5b7-413c8c1ef62d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:40.375923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-919cc2a8-8e19-43af-b5b7-413c8c1ef62d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:40.376979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-919cc2a8-8e19-43af-b5b7-413c8c1ef62d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:40.543828 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-919cc2a8-8e19-43af-b5b7-413c8c1ef62d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action" status: 202 len: 0 microversion: 2.1 time: 0.203346 Oct 24 10:56:40.544150 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2902/5837] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:56:40 2022] POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:56:40.553015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-52baf11a-61e3-4082-8096-b0faa31b891e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:40.553961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-52baf11a-61e3-4082-8096-b0faa31b891e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:40.564418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-52baf11a-61e3-4082-8096-b0faa31b891e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:40.565300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-52baf11a-61e3-4082-8096-b0faa31b891e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:40.567722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-52baf11a-61e3-4082-8096-b0faa31b891e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:40.568919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-52baf11a-61e3-4082-8096-b0faa31b891e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:40.570687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-52baf11a-61e3-4082-8096-b0faa31b891e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:40.571664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-52baf11a-61e3-4082-8096-b0faa31b891e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:41.776605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-52baf11a-61e3-4082-8096-b0faa31b891e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:41.791704 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-52baf11a-61e3-4082-8096-b0faa31b891e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1510 microversion: 2.1 time: 1.242729 Oct 24 10:56:41.796173 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2936/5838] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:40 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1510 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:42.295820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-84fa5227-a2ac-41b2-9403-244a47a9e57f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-886058116", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "47d57e58-edf1-4d95-90f8-68427e7dcba3"}], "key_name": "tempest-TestNetworkBasicOps-1464023613", "security_groups": [{"name": "tempest-secgroup-smoke-411345593"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:42.571597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-84fa5227-a2ac-41b2-9403-244a47a9e57f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] validate_networks() for [('47d57e58-edf1-4d95-90f8-68427e7dcba3', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:56:42.822502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fec71eb7-3bf2-4887-8b41-e3744c5298ef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:42.823122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fec71eb7-3bf2-4887-8b41-e3744c5298ef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:42.826099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:56:42.836925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fec71eb7-3bf2-4887-8b41-e3744c5298ef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:42.837424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fec71eb7-3bf2-4887-8b41-e3744c5298ef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:42.837869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fec71eb7-3bf2-4887-8b41-e3744c5298ef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:42.838587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fec71eb7-3bf2-4887-8b41-e3744c5298ef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:42.839046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fec71eb7-3bf2-4887-8b41-e3744c5298ef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:42.839472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fec71eb7-3bf2-4887-8b41-e3744c5298ef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:43.474274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fec71eb7-3bf2-4887-8b41-e3744c5298ef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:43.506528 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fec71eb7-3bf2-4887-8b41-e3744c5298ef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1490 microversion: 2.1 time: 0.687778 Oct 24 10:56:43.523630 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2937/5839] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:42 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1490 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:43.546156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a9044611-6e0f-4540-ab93-f65638a6bb78 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:43.546957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a9044611-6e0f-4540-ab93-f65638a6bb78 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:43.555404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9044611-6e0f-4540-ab93-f65638a6bb78 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:43.556150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9044611-6e0f-4540-ab93-f65638a6bb78 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:43.556684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9044611-6e0f-4540-ab93-f65638a6bb78 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:43.557634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9044611-6e0f-4540-ab93-f65638a6bb78 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:43.558363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9044611-6e0f-4540-ab93-f65638a6bb78 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:43.562335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9044611-6e0f-4540-ab93-f65638a6bb78 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:43.606973 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-a9044611-6e0f-4540-ab93-f65638a6bb78 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Cannot 'pause' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state paused Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a9044611-6e0f-4540-ab93-f65638a6bb78 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action HTTP/1.1 Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 13 Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: {"pause": {}} Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: exception: Cannot 'pause' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state paused Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '00aedb62-1a0e-47f0-bf42-19c12e9c035b', 'body': {'pause': {}}} Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b in vm_state paused. Cannot pause while the instance is in this state. Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state paused Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:43.609633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:43.614353 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:43.614353 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:43.614353 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:43.614353 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state paused Oct 24 10:56:43.614353 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:43.617014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a9044611-6e0f-4540-ab93-f65638a6bb78 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 409 to user: Cannot 'pause' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state paused {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:43.623585 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a9044611-6e0f-4540-ab93-f65638a6bb78 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action" status: 409 len: 143 microversion: 2.1 time: 0.078547 Oct 24 10:56:43.626335 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2938/5840] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:56:43 2022] POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action => generated 143 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:56:43.643561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eb98e72e-83bd-4574-8238-7be2be795daf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:43.645929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-eb98e72e-83bd-4574-8238-7be2be795daf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:43.653104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb98e72e-83bd-4574-8238-7be2be795daf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:43.653743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb98e72e-83bd-4574-8238-7be2be795daf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:43.655511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb98e72e-83bd-4574-8238-7be2be795daf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:43.656685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb98e72e-83bd-4574-8238-7be2be795daf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:43.657604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb98e72e-83bd-4574-8238-7be2be795daf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:43.658275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb98e72e-83bd-4574-8238-7be2be795daf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:43.751538 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-eb98e72e-83bd-4574-8238-7be2be795daf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action" status: 202 len: 0 microversion: 2.1 time: 0.120136 Oct 24 10:56:43.765190 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2939/5841] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:56:43 2022] POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:56:43.782117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-203c1483-92e9-42a5-8fba-8d24985ec1ba tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:43.783231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-203c1483-92e9-42a5-8fba-8d24985ec1ba tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:43.805423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-203c1483-92e9-42a5-8fba-8d24985ec1ba tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:43.806303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-203c1483-92e9-42a5-8fba-8d24985ec1ba tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:43.807043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-203c1483-92e9-42a5-8fba-8d24985ec1ba tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:43.809226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-203c1483-92e9-42a5-8fba-8d24985ec1ba tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:43.809962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-203c1483-92e9-42a5-8fba-8d24985ec1ba tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:43.811375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-203c1483-92e9-42a5-8fba-8d24985ec1ba tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:44.098362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-84fa5227-a2ac-41b2-9403-244a47a9e57f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:56:44.098923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-84fa5227-a2ac-41b2-9403-244a47a9e57f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:56:44.099254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-84fa5227-a2ac-41b2-9403-244a47a9e57f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:56:44.099668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-84fa5227-a2ac-41b2-9403-244a47a9e57f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:56:44.100088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-84fa5227-a2ac-41b2-9403-244a47a9e57f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:56:44.113453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84fa5227-a2ac-41b2-9403-244a47a9e57f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:44.113953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84fa5227-a2ac-41b2-9403-244a47a9e57f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:44.114397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84fa5227-a2ac-41b2-9403-244a47a9e57f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:44.115142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84fa5227-a2ac-41b2-9403-244a47a9e57f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:44.115603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84fa5227-a2ac-41b2-9403-244a47a9e57f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:44.116032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-84fa5227-a2ac-41b2-9403-244a47a9e57f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:44.171153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-84fa5227-a2ac-41b2-9403-244a47a9e57f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Getting quotas for project bebb2c9f56284e0799a51ae7b5744aeb. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:56:44.183108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-84fa5227-a2ac-41b2-9403-244a47a9e57f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Getting quotas for user 793d2a1323db49f0b92e36bf0a1b7f78 and project bebb2c9f56284e0799a51ae7b5744aeb. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:56:44.211577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-84fa5227-a2ac-41b2-9403-244a47a9e57f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:56:44.215339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-84fa5227-a2ac-41b2-9403-244a47a9e57f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:56:44.245846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-203c1483-92e9-42a5-8fba-8d24985ec1ba tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:44.270056 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-203c1483-92e9-42a5-8fba-8d24985ec1ba tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1497 microversion: 2.1 time: 0.504538 Oct 24 10:56:44.273073 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2940/5842] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:43 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1497 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:44.281944 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-84fa5227-a2ac-41b2-9403-244a47a9e57f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.992657 Oct 24 10:56:44.289491 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2903/5843] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:56:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 2001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:56:44.294817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-97e0bcfd-8294-4221-a4e4-ee4713a9d2df tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:44.295607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-97e0bcfd-8294-4221-a4e4-ee4713a9d2df tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:44.441505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-97e0bcfd-8294-4221-a4e4-ee4713a9d2df tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:44.453574 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-97e0bcfd-8294-4221-a4e4-ee4713a9d2df tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8" status: 200 len: 1248 microversion: 2.1 time: 0.159382 Oct 24 10:56:44.454673 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2941/5844] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:44 2022] GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8 => generated 1248 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:45.295629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fd611b68-e1e1-4e64-acb5-d14a54472983 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:45.297271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fd611b68-e1e1-4e64-acb5-d14a54472983 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:45.306756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd611b68-e1e1-4e64-acb5-d14a54472983 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:45.307546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd611b68-e1e1-4e64-acb5-d14a54472983 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:45.308426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd611b68-e1e1-4e64-acb5-d14a54472983 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:45.309581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd611b68-e1e1-4e64-acb5-d14a54472983 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:45.310389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd611b68-e1e1-4e64-acb5-d14a54472983 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:45.311281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd611b68-e1e1-4e64-acb5-d14a54472983 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:45.483441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a9f0c071-e5a1-47c3-9208-6d36b6d95502 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:45.484069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a9f0c071-e5a1-47c3-9208-6d36b6d95502 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:45.501600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9f0c071-e5a1-47c3-9208-6d36b6d95502 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:45.504808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9f0c071-e5a1-47c3-9208-6d36b6d95502 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:45.508943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9f0c071-e5a1-47c3-9208-6d36b6d95502 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:45.510104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9f0c071-e5a1-47c3-9208-6d36b6d95502 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:45.510838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9f0c071-e5a1-47c3-9208-6d36b6d95502 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:45.521606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9f0c071-e5a1-47c3-9208-6d36b6d95502 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:46.080752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a9f0c071-e5a1-47c3-9208-6d36b6d95502 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:46.092678 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a9f0c071-e5a1-47c3-9208-6d36b6d95502 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8" status: 200 len: 1244 microversion: 2.1 time: 0.614329 Oct 24 10:56:46.095497 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2942/5845] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:45 2022] GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8 => generated 1244 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:46.321051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fd611b68-e1e1-4e64-acb5-d14a54472983 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:46.336419 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fd611b68-e1e1-4e64-acb5-d14a54472983 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 1.046029 Oct 24 10:56:46.338757 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2904/5846] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:45 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:46.365634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-987d40ef-64a6-4580-905b-3dd1a75a9ad4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:46.366262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-987d40ef-64a6-4580-905b-3dd1a75a9ad4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:46.376670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-987d40ef-64a6-4580-905b-3dd1a75a9ad4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:46.379611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-987d40ef-64a6-4580-905b-3dd1a75a9ad4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:46.380237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-987d40ef-64a6-4580-905b-3dd1a75a9ad4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:46.385539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-987d40ef-64a6-4580-905b-3dd1a75a9ad4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:46.386105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-987d40ef-64a6-4580-905b-3dd1a75a9ad4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:46.386558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-987d40ef-64a6-4580-905b-3dd1a75a9ad4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:46.475455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-787d22df-c8e9-404e-896e-ce8369aa573e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:46.476310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-787d22df-c8e9-404e-896e-ce8369aa573e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:46.483061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:56:46.485432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-787d22df-c8e9-404e-896e-ce8369aa573e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:46.486370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-787d22df-c8e9-404e-896e-ce8369aa573e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:46.487051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-787d22df-c8e9-404e-896e-ce8369aa573e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:46.488046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-787d22df-c8e9-404e-896e-ce8369aa573e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:46.488738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-787d22df-c8e9-404e-896e-ce8369aa573e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:46.489523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-787d22df-c8e9-404e-896e-ce8369aa573e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:46.514276 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-787d22df-c8e9-404e-896e-ce8369aa573e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] HTTP exception thrown: Instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 could not be found. Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-787d22df-c8e9-404e-896e-ce8369aa573e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Request method failure captured: Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 HTTP/1.1 Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm1-ho6lDj800c94aMkptcsFhAyG_aQg0YP0T2znWt_9OYbU1J_L-ZM_z-ENPCPusyLpH6ElPbGHn-p6csj73-WS9DKVY5h1-JT8-Z8erkHIvr2ETBcWUtx7UmF1nPsQjHYnOe1KQ3hvPt70GpiF6VmnI587Iri5jmP4L1xUciycDLk Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 520c2b4219cd4573bc817e65756a05ac Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeTestJSON-1687182790 Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/520c2b4219cd4573bc817e65756a05ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/520c2b4219cd4573bc817e65756a05ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/520c2b4219cd4573bc817e65756a05ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_520c2b4219cd4573bc817e65756a05ac", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeTestJSON-1687182790 Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 520c2b4219cd4573bc817e65756a05ac Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1687182790 Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AttachVolumeTestJSON-1687182790-project Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: f38592218a3b4c39a977f49dd653e556 Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeTestJSON-1687182790-project Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 could not be found. Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'd2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0'} Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 could not be found. Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:46.516541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:46.525785 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 could not be found. Oct 24 10:56:46.525785 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:46.525785 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:46.525785 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:46.525785 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:46.525785 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:46.525785 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:46.525785 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:46.525785 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:46.525785 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 could not be found. Oct 24 10:56:46.525785 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:46.525785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-787d22df-c8e9-404e-896e-ce8369aa573e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Returning 404 to user: Instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:46.525785 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-787d22df-c8e9-404e-896e-ce8369aa573e tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 404 len: 111 microversion: 2.1 time: 0.047377 Oct 24 10:56:46.525785 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2905/5847] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:56:46 2022] DELETE /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:56:46.530728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-92afe476-acc7-4c1f-89ca-68d48606998a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:46.534887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-92afe476-acc7-4c1f-89ca-68d48606998a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:46.551278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92afe476-acc7-4c1f-89ca-68d48606998a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:46.551890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92afe476-acc7-4c1f-89ca-68d48606998a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:46.552411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92afe476-acc7-4c1f-89ca-68d48606998a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:46.553264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92afe476-acc7-4c1f-89ca-68d48606998a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:46.553798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92afe476-acc7-4c1f-89ca-68d48606998a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:46.554307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-92afe476-acc7-4c1f-89ca-68d48606998a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:46.575986 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-92afe476-acc7-4c1f-89ca-68d48606998a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] HTTP exception thrown: Instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 could not be found. Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-92afe476-acc7-4c1f-89ca-68d48606998a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Request method failure captured: Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 HTTP/1.1 Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm1-ho6lDj800c94aMkptcsFhAyG_aQg0YP0T2znWt_9OYbU1J_L-ZM_z-ENPCPusyLpH6ElPbGHn-p6csj73-WS9DKVY5h1-JT8-Z8erkHIvr2ETBcWUtx7UmF1nPsQjHYnOe1KQ3hvPt70GpiF6VmnI587Iri5jmP4L1xUciycDLk Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 520c2b4219cd4573bc817e65756a05ac Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeTestJSON-1687182790 Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/520c2b4219cd4573bc817e65756a05ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/520c2b4219cd4573bc817e65756a05ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/520c2b4219cd4573bc817e65756a05ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_520c2b4219cd4573bc817e65756a05ac", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeTestJSON-1687182790 Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 520c2b4219cd4573bc817e65756a05ac Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1687182790 Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AttachVolumeTestJSON-1687182790-project Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: f38592218a3b4c39a977f49dd653e556 Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeTestJSON-1687182790-project Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 could not be found. Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'd2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0'} Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 could not be found. Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 could not be found. Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:46.578354 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:46.587093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:46.587093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:46.587093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:46.587093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:46.587093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:46.587093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 could not be found. Oct 24 10:56:46.587093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:46.589493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-92afe476-acc7-4c1f-89ca-68d48606998a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Returning 404 to user: Instance d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:46.590825 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-92afe476-acc7-4c1f-89ca-68d48606998a tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0" status: 404 len: 111 microversion: 2.1 time: 0.066927 Oct 24 10:56:46.593573 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2906/5848] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:46 2022] GET /compute/v2.1/servers/d2c01b3e-4a7a-49dc-8bbc-ddaba3e1b4d0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:56:46.801782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-987d40ef-64a6-4580-905b-3dd1a75a9ad4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:46.818398 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-987d40ef-64a6-4580-905b-3dd1a75a9ad4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.456408 Oct 24 10:56:46.829321 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2943/5849] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:46 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:46.856735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb674d50-ae24-40ea-b1b1-893851a3cc83 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:46.863627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bb674d50-ae24-40ea-b1b1-893851a3cc83 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:46.880734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb674d50-ae24-40ea-b1b1-893851a3cc83 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:46.883254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb674d50-ae24-40ea-b1b1-893851a3cc83 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:46.883933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb674d50-ae24-40ea-b1b1-893851a3cc83 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:46.887050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb674d50-ae24-40ea-b1b1-893851a3cc83 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:46.887720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb674d50-ae24-40ea-b1b1-893851a3cc83 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:46.888333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb674d50-ae24-40ea-b1b1-893851a3cc83 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:46.921750 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-bb674d50-ae24-40ea-b1b1-893851a3cc83 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb674d50-ae24-40ea-b1b1-893851a3cc83 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19/action HTTP/1.1 Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 28 Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: {"reboot": {"type": "SOFT"}} Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'bce02187-96ed-47b2-b572-b97ce0840c19', 'body': {'reboot': {'type': 'SOFT'}}} Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:46.923671 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:46.928134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:56:46.928134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:46.928134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:46.928134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:46.928134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:46.928134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:46.928134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:46.928134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:46.928134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:46.928134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:56:46.928134 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:46.928134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb674d50-ae24-40ea-b1b1-893851a3cc83 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:46.928134 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bb674d50-ae24-40ea-b1b1-893851a3cc83 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19/action" status: 404 len: 111 microversion: 2.1 time: 0.073298 Oct 24 10:56:46.928993 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2907/5850] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:56:46 2022] POST /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19/action => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:56:46.934135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-613c9028-6efc-4c23-ab3a-ae2cedd23ce8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:46.934759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-613c9028-6efc-4c23-ab3a-ae2cedd23ce8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:46.961379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-613c9028-6efc-4c23-ab3a-ae2cedd23ce8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:46.962003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-613c9028-6efc-4c23-ab3a-ae2cedd23ce8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:46.962424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-613c9028-6efc-4c23-ab3a-ae2cedd23ce8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:46.963184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-613c9028-6efc-4c23-ab3a-ae2cedd23ce8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:46.963644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-613c9028-6efc-4c23-ab3a-ae2cedd23ce8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:46.964073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-613c9028-6efc-4c23-ab3a-ae2cedd23ce8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:47.120045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e2bd066d-e99b-4054-a8db-fd6b2a04710c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:47.120670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e2bd066d-e99b-4054-a8db-fd6b2a04710c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:47.139512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2bd066d-e99b-4054-a8db-fd6b2a04710c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:47.140354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2bd066d-e99b-4054-a8db-fd6b2a04710c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:47.141101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2bd066d-e99b-4054-a8db-fd6b2a04710c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:47.146234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2bd066d-e99b-4054-a8db-fd6b2a04710c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:47.146742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2bd066d-e99b-4054-a8db-fd6b2a04710c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:47.147191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e2bd066d-e99b-4054-a8db-fd6b2a04710c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:47.410096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e2bd066d-e99b-4054-a8db-fd6b2a04710c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:47.425659 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e2bd066d-e99b-4054-a8db-fd6b2a04710c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8" status: 200 len: 1306 microversion: 2.1 time: 0.309402 Oct 24 10:56:47.426191 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2908/5851] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:47 2022] GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8 => generated 1306 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:48.019748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-613c9028-6efc-4c23-ab3a-ae2cedd23ce8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:48.033506 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-613c9028-6efc-4c23-ab3a-ae2cedd23ce8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 1.103252 Oct 24 10:56:48.036083 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2944/5852] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:46 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:48.062701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b273edbd-3226-4606-a183-402e637e6343 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:48.063532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b273edbd-3226-4606-a183-402e637e6343 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:48.076409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b273edbd-3226-4606-a183-402e637e6343 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:48.077625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b273edbd-3226-4606-a183-402e637e6343 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:48.078331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b273edbd-3226-4606-a183-402e637e6343 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:48.080136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b273edbd-3226-4606-a183-402e637e6343 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:48.082750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b273edbd-3226-4606-a183-402e637e6343 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:48.083835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b273edbd-3226-4606-a183-402e637e6343 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:48.456941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e66edf5c-f51f-4b48-9fb2-b491e2d99b3e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:48.457984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e66edf5c-f51f-4b48-9fb2-b491e2d99b3e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:48.472769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e66edf5c-f51f-4b48-9fb2-b491e2d99b3e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:48.473304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e66edf5c-f51f-4b48-9fb2-b491e2d99b3e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:48.473753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e66edf5c-f51f-4b48-9fb2-b491e2d99b3e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:48.484602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e66edf5c-f51f-4b48-9fb2-b491e2d99b3e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:48.485585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e66edf5c-f51f-4b48-9fb2-b491e2d99b3e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:48.488089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e66edf5c-f51f-4b48-9fb2-b491e2d99b3e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:48.503581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:56:48.563858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b273edbd-3226-4606-a183-402e637e6343 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:48.591200 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b273edbd-3226-4606-a183-402e637e6343 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.534110 Oct 24 10:56:48.595614 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2909/5853] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:48 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:48.621156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f92c18cf-b04a-4e75-a098-8d6f52406527 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:48.624454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f92c18cf-b04a-4e75-a098-8d6f52406527 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: d6fc9dd3-79ad-4294-b62b-5a26d3bed224] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:48.634549 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-f92c18cf-b04a-4e75-a098-8d6f52406527 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance d6fc9dd3-79ad-4294-b62b-5a26d3bed224 could not be found. Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f92c18cf-b04a-4e75-a098-8d6f52406527 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/d6fc9dd3-79ad-4294-b62b-5a26d3bed224/action HTTP/1.1 Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 28 Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: {"reboot": {"type": "SOFT"}} Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance d6fc9dd3-79ad-4294-b62b-5a26d3bed224 could not be found. Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'd6fc9dd3-79ad-4294-b62b-5a26d3bed224', 'body': {'reboot': {'type': 'SOFT'}}} Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6fc9dd3-79ad-4294-b62b-5a26d3bed224 could not be found. Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6fc9dd3-79ad-4294-b62b-5a26d3bed224 could not be found. Oct 24 10:56:48.638006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:48.644684 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:48.644684 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:48.644684 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:48.644684 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:48.644684 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:48.644684 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:48.644684 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:48.644684 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6fc9dd3-79ad-4294-b62b-5a26d3bed224 could not be found. Oct 24 10:56:48.644684 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:48.646629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f92c18cf-b04a-4e75-a098-8d6f52406527 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance d6fc9dd3-79ad-4294-b62b-5a26d3bed224 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:48.647728 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f92c18cf-b04a-4e75-a098-8d6f52406527 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/d6fc9dd3-79ad-4294-b62b-5a26d3bed224/action" status: 404 len: 111 microversion: 2.1 time: 0.030999 Oct 24 10:56:48.652349 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2910/5854] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:56:48 2022] POST /compute/v2.1/servers/d6fc9dd3-79ad-4294-b62b-5a26d3bed224/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:56:48.658228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a55e74c2-3bd8-4603-a7c6-bc5e7baa37d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:48.658843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a55e74c2-3bd8-4603-a7c6-bc5e7baa37d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:48.666326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a55e74c2-3bd8-4603-a7c6-bc5e7baa37d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:48.667054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a55e74c2-3bd8-4603-a7c6-bc5e7baa37d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:48.667697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a55e74c2-3bd8-4603-a7c6-bc5e7baa37d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:48.668583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a55e74c2-3bd8-4603-a7c6-bc5e7baa37d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:48.669541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a55e74c2-3bd8-4603-a7c6-bc5e7baa37d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:48.670676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a55e74c2-3bd8-4603-a7c6-bc5e7baa37d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:49.064035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a55e74c2-3bd8-4603-a7c6-bc5e7baa37d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:49.074841 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a55e74c2-3bd8-4603-a7c6-bc5e7baa37d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.420940 Oct 24 10:56:49.075782 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2911/5855] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:48 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:49.110153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5c6deb61-7b08-448d-bf56-b5eedf77a854 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:49.111146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c6deb61-7b08-448d-bf56-b5eedf77a854 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:49.125902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c6deb61-7b08-448d-bf56-b5eedf77a854 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:49.126678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c6deb61-7b08-448d-bf56-b5eedf77a854 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:49.127323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c6deb61-7b08-448d-bf56-b5eedf77a854 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:49.129168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c6deb61-7b08-448d-bf56-b5eedf77a854 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:49.130703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c6deb61-7b08-448d-bf56-b5eedf77a854 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:49.132115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c6deb61-7b08-448d-bf56-b5eedf77a854 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:49.281582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e66edf5c-f51f-4b48-9fb2-b491e2d99b3e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:49.293834 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e66edf5c-f51f-4b48-9fb2-b491e2d99b3e tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8" status: 200 len: 1373 microversion: 2.1 time: 0.847767 Oct 24 10:56:49.294493 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2945/5856] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:48 2022] GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8 => generated 1373 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:49.512674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5c6deb61-7b08-448d-bf56-b5eedf77a854 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:49.522227 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5c6deb61-7b08-448d-bf56-b5eedf77a854 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.423778 Oct 24 10:56:49.529258 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2912/5857] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:49 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:49.559052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7f387061-270e-4cea-b9e2-589c90cac013 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:49.568077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7f387061-270e-4cea-b9e2-589c90cac013 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:49.586635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f387061-270e-4cea-b9e2-589c90cac013 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:49.587776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f387061-270e-4cea-b9e2-589c90cac013 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:49.589041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f387061-270e-4cea-b9e2-589c90cac013 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:49.590667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f387061-270e-4cea-b9e2-589c90cac013 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:49.592732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f387061-270e-4cea-b9e2-589c90cac013 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:49.593539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f387061-270e-4cea-b9e2-589c90cac013 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:49.633226 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-7f387061-270e-4cea-b9e2-589c90cac013 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7f387061-270e-4cea-b9e2-589c90cac013 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19/action HTTP/1.1 Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 65 Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: {"rebuild": {"imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7"}} Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'bce02187-96ed-47b2-b572-b97ce0840c19', 'body': {'rebuild': {'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7'}}} Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 24 10:56:49.650173 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 24 10:56:49.655696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 24 10:56:49.655696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:56:49.655696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:56:49.655696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:49.655696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:49.655696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:56:49.655696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:49.655696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:49.655696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:49.655696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:49.655696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:49.655696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:49.655696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:49.655696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:49.655696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:56:49.655696 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:49.658068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7f387061-270e-4cea-b9e2-589c90cac013 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:49.662064 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7f387061-270e-4cea-b9e2-589c90cac013 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19/action" status: 404 len: 111 microversion: 2.1 time: 0.112880 Oct 24 10:56:49.667890 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2946/5858] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:56:49 2022] POST /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19/action => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:56:49.689094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f393a3f9-c2c2-4983-9283-35a84707dcbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:49.691021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f393a3f9-c2c2-4983-9283-35a84707dcbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:49.700399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f393a3f9-c2c2-4983-9283-35a84707dcbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:49.701489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f393a3f9-c2c2-4983-9283-35a84707dcbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:49.702348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f393a3f9-c2c2-4983-9283-35a84707dcbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:49.705065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f393a3f9-c2c2-4983-9283-35a84707dcbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:49.706470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f393a3f9-c2c2-4983-9283-35a84707dcbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:49.707163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f393a3f9-c2c2-4983-9283-35a84707dcbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:50.173426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f393a3f9-c2c2-4983-9283-35a84707dcbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:50.192795 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f393a3f9-c2c2-4983-9283-35a84707dcbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.519366 Oct 24 10:56:50.194068 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2913/5859] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:49 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:50.224242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4f5fa20e-4883-414e-8e12-244441f4805e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:50.225067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4f5fa20e-4883-414e-8e12-244441f4805e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:50.243147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f5fa20e-4883-414e-8e12-244441f4805e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:50.246289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f5fa20e-4883-414e-8e12-244441f4805e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:50.247245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f5fa20e-4883-414e-8e12-244441f4805e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:50.248286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f5fa20e-4883-414e-8e12-244441f4805e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:50.252029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f5fa20e-4883-414e-8e12-244441f4805e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:50.253253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f5fa20e-4883-414e-8e12-244441f4805e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:50.323571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-23cd4dd5-ceba-4c43-baed-37a937f173b2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:50.324502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-23cd4dd5-ceba-4c43-baed-37a937f173b2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:50.342827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23cd4dd5-ceba-4c43-baed-37a937f173b2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:50.344911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23cd4dd5-ceba-4c43-baed-37a937f173b2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:50.346386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23cd4dd5-ceba-4c43-baed-37a937f173b2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:50.349531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23cd4dd5-ceba-4c43-baed-37a937f173b2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:50.351288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23cd4dd5-ceba-4c43-baed-37a937f173b2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:50.353404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23cd4dd5-ceba-4c43-baed-37a937f173b2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:50.921751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4f5fa20e-4883-414e-8e12-244441f4805e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:50.935734 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4f5fa20e-4883-414e-8e12-244441f4805e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.719162 Oct 24 10:56:50.947655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-23cd4dd5-ceba-4c43-baed-37a937f173b2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:50.959794 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2947/5860] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:50 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:50.969469 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-23cd4dd5-ceba-4c43-baed-37a937f173b2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8" status: 200 len: 1373 microversion: 2.1 time: 0.649625 Oct 24 10:56:50.970136 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2914/5861] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:50 2022] GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8 => generated 1373 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:50.977050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-98cfd734-2379-4065-941c-86de278d60cf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:50.978302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-98cfd734-2379-4065-941c-86de278d60cf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 993f45ed-db20-4191-96ea-d1fd97c77a61] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:50.985248 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-98cfd734-2379-4065-941c-86de278d60cf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance 993f45ed-db20-4191-96ea-d1fd97c77a61 could not be found. Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-98cfd734-2379-4065-941c-86de278d60cf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/993f45ed-db20-4191-96ea-d1fd97c77a61/action HTTP/1.1 Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 65 Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: {"rebuild": {"imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7"}} Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 993f45ed-db20-4191-96ea-d1fd97c77a61 could not be found. Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '993f45ed-db20-4191-96ea-d1fd97c77a61', 'body': {'rebuild': {'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7'}}} Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 993f45ed-db20-4191-96ea-d1fd97c77a61 could not be found. Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 24 10:56:50.986981 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:56:50.992235 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:56:50.992235 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:50.992235 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:50.992235 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 993f45ed-db20-4191-96ea-d1fd97c77a61 could not be found. Oct 24 10:56:50.992235 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:50.992235 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:50.992235 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:50.992235 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:50.992235 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:50.992235 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:50.992235 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:50.992235 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:50.992235 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 993f45ed-db20-4191-96ea-d1fd97c77a61 could not be found. Oct 24 10:56:50.992235 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:50.995084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-98cfd734-2379-4065-941c-86de278d60cf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance 993f45ed-db20-4191-96ea-d1fd97c77a61 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:50.997169 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-98cfd734-2379-4065-941c-86de278d60cf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/993f45ed-db20-4191-96ea-d1fd97c77a61/action" status: 404 len: 111 microversion: 2.1 time: 0.034347 Oct 24 10:56:51.003555 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2948/5862] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:56:50 2022] POST /compute/v2.1/servers/993f45ed-db20-4191-96ea-d1fd97c77a61/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:56:51.008657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-380f8153-e0f3-43cb-9b36-dabc587f12be tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:51.010722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-380f8153-e0f3-43cb-9b36-dabc587f12be tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:51.024457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-380f8153-e0f3-43cb-9b36-dabc587f12be tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:51.025234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-380f8153-e0f3-43cb-9b36-dabc587f12be tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:51.033591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-380f8153-e0f3-43cb-9b36-dabc587f12be tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:51.034594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-380f8153-e0f3-43cb-9b36-dabc587f12be tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:51.035588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-380f8153-e0f3-43cb-9b36-dabc587f12be tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:51.037853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-380f8153-e0f3-43cb-9b36-dabc587f12be tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:51.206852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5a31891d-96eb-4529-b4a7-28b07a33565c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:51.210457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5a31891d-96eb-4529-b4a7-28b07a33565c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:51.231924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a31891d-96eb-4529-b4a7-28b07a33565c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:51.237987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a31891d-96eb-4529-b4a7-28b07a33565c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:51.240528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a31891d-96eb-4529-b4a7-28b07a33565c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:51.241358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a31891d-96eb-4529-b4a7-28b07a33565c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:51.241843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a31891d-96eb-4529-b4a7-28b07a33565c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:51.248430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a31891d-96eb-4529-b4a7-28b07a33565c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:51.372398 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5a31891d-96eb-4529-b4a7-28b07a33565c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff/action" status: 200 len: 62926 microversion: 2.1 time: 0.171143 Oct 24 10:56:51.384620 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2949/5863] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:56:51 2022] POST /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff/action => generated 62926 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:56:51.462060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-380f8153-e0f3-43cb-9b36-dabc587f12be tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:51.473213 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-380f8153-e0f3-43cb-9b36-dabc587f12be tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.466497 Oct 24 10:56:51.477175 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2915/5864] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:51 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:51.501840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b2d97f1-02a2-4ab5-9b53-240ca360e1f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:51.502585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8b2d97f1-02a2-4ab5-9b53-240ca360e1f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:51.511895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b2d97f1-02a2-4ab5-9b53-240ca360e1f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:51.512445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b2d97f1-02a2-4ab5-9b53-240ca360e1f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:51.527495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b2d97f1-02a2-4ab5-9b53-240ca360e1f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:51.528625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b2d97f1-02a2-4ab5-9b53-240ca360e1f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:51.530446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b2d97f1-02a2-4ab5-9b53-240ca360e1f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:51.532919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b2d97f1-02a2-4ab5-9b53-240ca360e1f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:51.851741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-65a051f1-d934-4d4b-ae86-cb8bc48c7dcc req-fdcc3bad-c771-4d91-89fb-0b35becf598c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3716c187-1470-41fb-8cc0-0f5b80706ec8", "tag": "768ab8e1-3cea-490f-9398-f543fc548e84"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:51.888277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8b2d97f1-02a2-4ab5-9b53-240ca360e1f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:51.890365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-65a051f1-d934-4d4b-ae86-cb8bc48c7dcc req-fdcc3bad-c771-4d91-89fb-0b35becf598c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:51.893909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-65a051f1-d934-4d4b-ae86-cb8bc48c7dcc req-fdcc3bad-c771-4d91-89fb-0b35becf598c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:51.896734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-65a051f1-d934-4d4b-ae86-cb8bc48c7dcc req-fdcc3bad-c771-4d91-89fb-0b35becf598c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:51.901837 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b2d97f1-02a2-4ab5-9b53-240ca360e1f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.404257 Oct 24 10:56:51.919213 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2916/5865] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:51 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:51.931497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-01c009fa-8ef1-4487-8bff-64216cf99e4c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:51.932050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-01c009fa-8ef1-4487-8bff-64216cf99e4c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 3636bd58-6218-449a-a6a0-eb0b9e7353ee] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:51.943759 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-65a051f1-d934-4d4b-ae86-cb8bc48c7dcc req-fdcc3bad-c771-4d91-89fb-0b35becf598c service nova] Creating event network-changed:768ab8e1-3cea-490f-9398-f543fc548e84 for instance 3716c187-1470-41fb-8cc0-0f5b80706ec8 on n-h2-858383-15 Oct 24 10:56:51.945675 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-01c009fa-8ef1-4487-8bff-64216cf99e4c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance 3636bd58-6218-449a-a6a0-eb0b9e7353ee could not be found. Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-01c009fa-8ef1-4487-8bff-64216cf99e4c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/3636bd58-6218-449a-a6a0-eb0b9e7353ee/action HTTP/1.1 Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 15 Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: {"restore": {}} Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 3636bd58-6218-449a-a6a0-eb0b9e7353ee could not be found. Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '3636bd58-6218-449a-a6a0-eb0b9e7353ee', 'body': {'restore': {}}} Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3636bd58-6218-449a-a6a0-eb0b9e7353ee could not be found. Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3636bd58-6218-449a-a6a0-eb0b9e7353ee could not be found. Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:51.952795 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:51.960877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:51.960877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:51.960877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3636bd58-6218-449a-a6a0-eb0b9e7353ee could not be found. Oct 24 10:56:51.960877 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:51.960877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-01c009fa-8ef1-4487-8bff-64216cf99e4c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance 3636bd58-6218-449a-a6a0-eb0b9e7353ee could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:51.960877 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-01c009fa-8ef1-4487-8bff-64216cf99e4c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/3636bd58-6218-449a-a6a0-eb0b9e7353ee/action" status: 404 len: 111 microversion: 2.1 time: 0.030643 Oct 24 10:56:51.963870 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-65a051f1-d934-4d4b-ae86-cb8bc48c7dcc req-fdcc3bad-c771-4d91-89fb-0b35becf598c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.476581 Oct 24 10:56:51.964515 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2950/5866] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:56:51.971482 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2917/5867] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:56:51 2022] POST /compute/v2.1/servers/3636bd58-6218-449a-a6a0-eb0b9e7353ee/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:56:51.985043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c5fc4957-ee08-4d28-a5a3-fea5c1c64fbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:51.985928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c5fc4957-ee08-4d28-a5a3-fea5c1c64fbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:51.995231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5fc4957-ee08-4d28-a5a3-fea5c1c64fbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:51.995840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5fc4957-ee08-4d28-a5a3-fea5c1c64fbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:51.996400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5fc4957-ee08-4d28-a5a3-fea5c1c64fbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:51.997583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5fc4957-ee08-4d28-a5a3-fea5c1c64fbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:51.998704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5fc4957-ee08-4d28-a5a3-fea5c1c64fbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:51.999259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5fc4957-ee08-4d28-a5a3-fea5c1c64fbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:52.000248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1fa02e1c-e43a-4976-a1a0-44eb5541a73a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:52.000908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1fa02e1c-e43a-4976-a1a0-44eb5541a73a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:52.028703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fa02e1c-e43a-4976-a1a0-44eb5541a73a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:52.029789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fa02e1c-e43a-4976-a1a0-44eb5541a73a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:52.030437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fa02e1c-e43a-4976-a1a0-44eb5541a73a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:52.031334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fa02e1c-e43a-4976-a1a0-44eb5541a73a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:52.037286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fa02e1c-e43a-4976-a1a0-44eb5541a73a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:52.037754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fa02e1c-e43a-4976-a1a0-44eb5541a73a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:52.160335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:56:52.533372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c5fc4957-ee08-4d28-a5a3-fea5c1c64fbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:52.546704 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c5fc4957-ee08-4d28-a5a3-fea5c1c64fbf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.568982 Oct 24 10:56:52.547966 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2951/5868] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:51 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:52.576430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d247b812-b6cc-44aa-b8c5-7e46b4933f0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:52.577406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d247b812-b6cc-44aa-b8c5-7e46b4933f0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:52.586075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d247b812-b6cc-44aa-b8c5-7e46b4933f0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:52.586794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d247b812-b6cc-44aa-b8c5-7e46b4933f0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:52.587433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d247b812-b6cc-44aa-b8c5-7e46b4933f0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:52.588326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d247b812-b6cc-44aa-b8c5-7e46b4933f0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:52.589043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d247b812-b6cc-44aa-b8c5-7e46b4933f0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:52.589646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d247b812-b6cc-44aa-b8c5-7e46b4933f0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:53.236118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1fa02e1c-e43a-4976-a1a0-44eb5541a73a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:53.246131 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1fa02e1c-e43a-4976-a1a0-44eb5541a73a tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8" status: 200 len: 1373 microversion: 2.1 time: 1.250695 Oct 24 10:56:53.246716 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2918/5869] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:51 2022] GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8 => generated 1373 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:53.331895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d247b812-b6cc-44aa-b8c5-7e46b4933f0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:53.343053 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d247b812-b6cc-44aa-b8c5-7e46b4933f0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.772259 Oct 24 10:56:53.344281 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2952/5870] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:52 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:53.368093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-339d1634-08d8-46d9-8db9-4c78ee7f9294 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:53.368908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-339d1634-08d8-46d9-8db9-4c78ee7f9294 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:53.378386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-339d1634-08d8-46d9-8db9-4c78ee7f9294 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:53.379131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-339d1634-08d8-46d9-8db9-4c78ee7f9294 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:53.379805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-339d1634-08d8-46d9-8db9-4c78ee7f9294 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:53.380775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-339d1634-08d8-46d9-8db9-4c78ee7f9294 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:53.381483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-339d1634-08d8-46d9-8db9-4c78ee7f9294 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:53.382150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-339d1634-08d8-46d9-8db9-4c78ee7f9294 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:53.455951 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-339d1634-08d8-46d9-8db9-4c78ee7f9294 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Cannot 'restore' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-339d1634-08d8-46d9-8db9-4c78ee7f9294 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action HTTP/1.1 Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 15 Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: {"restore": {}} Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: exception: Cannot 'restore' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '00aedb62-1a0e-47f0-bf42-19c12e9c035b', 'body': {'restore': {}}} Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b in vm_state active. Cannot restore while the instance is in this state. Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:53.459940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:53.463988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:53.463988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:53.463988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:53.463988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active Oct 24 10:56:53.463988 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:53.468626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-339d1634-08d8-46d9-8db9-4c78ee7f9294 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 409 to user: Cannot 'restore' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:53.469709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c5193e0c-345c-43a6-8f8a-56c36f0779b0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:53.470232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c5193e0c-345c-43a6-8f8a-56c36f0779b0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:53.471349 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-339d1634-08d8-46d9-8db9-4c78ee7f9294 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action" status: 409 len: 145 microversion: 2.1 time: 0.107454 Oct 24 10:56:53.476169 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2919/5871] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:56:53 2022] POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action => generated 145 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:56:53.483155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5193e0c-345c-43a6-8f8a-56c36f0779b0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:53.488434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-786809f2-ac8d-42d7-84ce-372758b0d11c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:53.489430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-786809f2-ac8d-42d7-84ce-372758b0d11c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:53.499311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5193e0c-345c-43a6-8f8a-56c36f0779b0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:53.499768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5193e0c-345c-43a6-8f8a-56c36f0779b0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:53.503087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5193e0c-345c-43a6-8f8a-56c36f0779b0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:53.503849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5193e0c-345c-43a6-8f8a-56c36f0779b0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:53.505454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5193e0c-345c-43a6-8f8a-56c36f0779b0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:53.512387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-786809f2-ac8d-42d7-84ce-372758b0d11c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:53.516118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-786809f2-ac8d-42d7-84ce-372758b0d11c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:53.516915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-786809f2-ac8d-42d7-84ce-372758b0d11c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:53.520488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-786809f2-ac8d-42d7-84ce-372758b0d11c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:53.521228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-786809f2-ac8d-42d7-84ce-372758b0d11c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:53.521906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-786809f2-ac8d-42d7-84ce-372758b0d11c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:53.533235 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-c5193e0c-345c-43a6-8f8a-56c36f0779b0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] HTTP exception thrown: Instance 8856046c-d409-4791-898d-19e0401f6dc0 could not be found. Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c5193e0c-345c-43a6-8f8a-56c36f0779b0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Request method failure captured: Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 HTTP/1.1 Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm1-ho6lDj800c94aMkptcsFhAyG_aQg0YP0T2znWt_9OYbU1J_L-ZM_z-ENPCPusyLpH6ElPbGHn-p6csj73-WS9DKVY5h1-JT8-Z8erkHIvr2ETBcWUtx7UmF1nPsQjHYnOe1KQ3hvPt70GpiF6VmnI587Iri5jmP4L1xUciycDLk Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 520c2b4219cd4573bc817e65756a05ac Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AttachVolumeTestJSON-1687182790 Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/520c2b4219cd4573bc817e65756a05ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/520c2b4219cd4573bc817e65756a05ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/520c2b4219cd4573bc817e65756a05ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_520c2b4219cd4573bc817e65756a05ac", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AttachVolumeTestJSON-1687182790 Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 520c2b4219cd4573bc817e65756a05ac Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1687182790 Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AttachVolumeTestJSON-1687182790-project Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: f38592218a3b4c39a977f49dd653e556 Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AttachVolumeTestJSON-1687182790-project Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 8856046c-d409-4791-898d-19e0401f6dc0 could not be found. Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '8856046c-d409-4791-898d-19e0401f6dc0'} Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8856046c-d409-4791-898d-19e0401f6dc0 could not be found. Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:53.550327 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:53.555259 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8856046c-d409-4791-898d-19e0401f6dc0 could not be found. Oct 24 10:56:53.555259 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:53.555259 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:53.555259 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:53.555259 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:53.555259 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:53.555259 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:53.555259 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:53.555259 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:53.555259 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8856046c-d409-4791-898d-19e0401f6dc0 could not be found. Oct 24 10:56:53.555259 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:53.559037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c5193e0c-345c-43a6-8f8a-56c36f0779b0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Returning 404 to user: Instance 8856046c-d409-4791-898d-19e0401f6dc0 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:53.560241 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c5193e0c-345c-43a6-8f8a-56c36f0779b0 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 404 len: 111 microversion: 2.1 time: 0.102741 Oct 24 10:56:53.564123 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2953/5872] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:56:53 2022] DELETE /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:56:53.584671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3ee6beee-feab-436e-9a02-f1771142b008 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:53.585739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3ee6beee-feab-436e-9a02-f1771142b008 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] [instance: 8856046c-d409-4791-898d-19e0401f6dc0] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:53.610996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ee6beee-feab-436e-9a02-f1771142b008 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:53.611724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ee6beee-feab-436e-9a02-f1771142b008 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:53.612392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ee6beee-feab-436e-9a02-f1771142b008 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:53.613370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ee6beee-feab-436e-9a02-f1771142b008 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:53.614068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ee6beee-feab-436e-9a02-f1771142b008 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:53.614714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ee6beee-feab-436e-9a02-f1771142b008 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:53.638563 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-3ee6beee-feab-436e-9a02-f1771142b008 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] HTTP exception thrown: Instance 8856046c-d409-4791-898d-19e0401f6dc0 could not be found. Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3ee6beee-feab-436e-9a02-f1771142b008 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Request method failure captured: Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 HTTP/1.1 Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm1-ho6lDj800c94aMkptcsFhAyG_aQg0YP0T2znWt_9OYbU1J_L-ZM_z-ENPCPusyLpH6ElPbGHn-p6csj73-WS9DKVY5h1-JT8-Z8erkHIvr2ETBcWUtx7UmF1nPsQjHYnOe1KQ3hvPt70GpiF6VmnI587Iri5jmP4L1xUciycDLk Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 520c2b4219cd4573bc817e65756a05ac Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AttachVolumeTestJSON-1687182790 Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/520c2b4219cd4573bc817e65756a05ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/520c2b4219cd4573bc817e65756a05ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/520c2b4219cd4573bc817e65756a05ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_520c2b4219cd4573bc817e65756a05ac", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AttachVolumeTestJSON-1687182790 Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 520c2b4219cd4573bc817e65756a05ac Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1687182790 Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AttachVolumeTestJSON-1687182790-project Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: f38592218a3b4c39a977f49dd653e556 Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AttachVolumeTestJSON-1687182790-project Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 8856046c-d409-4791-898d-19e0401f6dc0 could not be found. Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '8856046c-d409-4791-898d-19e0401f6dc0'} Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8856046c-d409-4791-898d-19e0401f6dc0 could not be found. Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8856046c-d409-4791-898d-19e0401f6dc0 could not be found. Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:53.640644 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:53.644775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:53.644775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:53.644775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:53.644775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:53.644775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:53.644775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8856046c-d409-4791-898d-19e0401f6dc0 could not be found. Oct 24 10:56:53.644775 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:56:53.648294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3ee6beee-feab-436e-9a02-f1771142b008 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] Returning 404 to user: Instance 8856046c-d409-4791-898d-19e0401f6dc0 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:53.649533 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3ee6beee-feab-436e-9a02-f1771142b008 tempest-AttachVolumeTestJSON-1687182790 tempest-AttachVolumeTestJSON-1687182790-project] 10.222.0.50 "GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0" status: 404 len: 111 microversion: 2.1 time: 0.074814 Oct 24 10:56:53.650801 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2954/5873] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:53 2022] GET /compute/v2.1/servers/8856046c-d409-4791-898d-19e0401f6dc0 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:56:53.943767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-786809f2-ac8d-42d7-84ce-372758b0d11c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:53.954367 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-786809f2-ac8d-42d7-84ce-372758b0d11c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.469707 Oct 24 10:56:53.957536 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2920/5874] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:53 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:53.992483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-df5a55bf-e752-4407-8e33-b889f190d77b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:53.993648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-df5a55bf-e752-4407-8e33-b889f190d77b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:54.005129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df5a55bf-e752-4407-8e33-b889f190d77b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:54.005925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df5a55bf-e752-4407-8e33-b889f190d77b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:54.006545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df5a55bf-e752-4407-8e33-b889f190d77b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:54.007424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df5a55bf-e752-4407-8e33-b889f190d77b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:54.009351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df5a55bf-e752-4407-8e33-b889f190d77b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:54.009946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df5a55bf-e752-4407-8e33-b889f190d77b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:54.271899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0991b555-fae7-4044-bf76-0417ff7e461b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:54.272451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0991b555-fae7-4044-bf76-0417ff7e461b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:54.284467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:56:54.288675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:56:54.292470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0991b555-fae7-4044-bf76-0417ff7e461b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:54.292968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0991b555-fae7-4044-bf76-0417ff7e461b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:54.293406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0991b555-fae7-4044-bf76-0417ff7e461b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:54.299978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0991b555-fae7-4044-bf76-0417ff7e461b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:54.300479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0991b555-fae7-4044-bf76-0417ff7e461b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:54.300945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0991b555-fae7-4044-bf76-0417ff7e461b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:54.449526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:56:54.740456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0991b555-fae7-4044-bf76-0417ff7e461b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:54.744201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-df5a55bf-e752-4407-8e33-b889f190d77b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:54.759366 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0991b555-fae7-4044-bf76-0417ff7e461b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8" status: 200 len: 1373 microversion: 2.1 time: 0.491888 Oct 24 10:56:54.759971 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2921/5875] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:54 2022] GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8 => generated 1373 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:54.764879 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-df5a55bf-e752-4407-8e33-b889f190d77b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.776126 Oct 24 10:56:54.766002 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2955/5876] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:53 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:54.790890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b7bd091-7b9c-469e-af62-1b190362b038 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:54.791756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8b7bd091-7b9c-469e-af62-1b190362b038 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 094f623f-bcd7-4709-872c-27a0f9aa52a5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:54.798135 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-8b7bd091-7b9c-469e-af62-1b190362b038 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance 094f623f-bcd7-4709-872c-27a0f9aa52a5 could not be found. Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b7bd091-7b9c-469e-af62-1b190362b038 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/094f623f-bcd7-4709-872c-27a0f9aa52a5/action HTTP/1.1 Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 14 Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: {"resume": {}} Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 094f623f-bcd7-4709-872c-27a0f9aa52a5 could not be found. Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '094f623f-bcd7-4709-872c-27a0f9aa52a5', 'body': {'resume': {}}} Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 094f623f-bcd7-4709-872c-27a0f9aa52a5 could not be found. Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 094f623f-bcd7-4709-872c-27a0f9aa52a5 could not be found. Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:54.806546 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:54.815735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:54.815735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:54.815735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 094f623f-bcd7-4709-872c-27a0f9aa52a5 could not be found. Oct 24 10:56:54.815735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:54.815735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b7bd091-7b9c-469e-af62-1b190362b038 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance 094f623f-bcd7-4709-872c-27a0f9aa52a5 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:54.815735 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b7bd091-7b9c-469e-af62-1b190362b038 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/094f623f-bcd7-4709-872c-27a0f9aa52a5/action" status: 404 len: 111 microversion: 2.1 time: 0.021389 Oct 24 10:56:54.815735 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2922/5877] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:56:54 2022] POST /compute/v2.1/servers/094f623f-bcd7-4709-872c-27a0f9aa52a5/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:56:54.821784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a8f53453-d568-4b96-bcee-6d465173e0a1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:54.822453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a8f53453-d568-4b96-bcee-6d465173e0a1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:54.832394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8f53453-d568-4b96-bcee-6d465173e0a1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:54.833110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8f53453-d568-4b96-bcee-6d465173e0a1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:54.838557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8f53453-d568-4b96-bcee-6d465173e0a1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:54.839316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8f53453-d568-4b96-bcee-6d465173e0a1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:54.839862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8f53453-d568-4b96-bcee-6d465173e0a1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:54.840303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8f53453-d568-4b96-bcee-6d465173e0a1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:55.333953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a8f53453-d568-4b96-bcee-6d465173e0a1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:55.346408 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a8f53453-d568-4b96-bcee-6d465173e0a1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.532420 Oct 24 10:56:55.348336 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2956/5878] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:54 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:55.375587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31a85922-5d5e-48c9-b0ae-d31dc1c8efbe tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:55.376874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31a85922-5d5e-48c9-b0ae-d31dc1c8efbe tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:55.389926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31a85922-5d5e-48c9-b0ae-d31dc1c8efbe tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:55.392315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31a85922-5d5e-48c9-b0ae-d31dc1c8efbe tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:55.393075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31a85922-5d5e-48c9-b0ae-d31dc1c8efbe tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:55.394085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31a85922-5d5e-48c9-b0ae-d31dc1c8efbe tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:55.394764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31a85922-5d5e-48c9-b0ae-d31dc1c8efbe tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:55.395446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31a85922-5d5e-48c9-b0ae-d31dc1c8efbe tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:55.787117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bc7fa804-10e3-4d0f-885f-89bcc066d815 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:55.788491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bc7fa804-10e3-4d0f-885f-89bcc066d815 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:55.793260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-31a85922-5d5e-48c9-b0ae-d31dc1c8efbe tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:55.813782 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31a85922-5d5e-48c9-b0ae-d31dc1c8efbe tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.443485 Oct 24 10:56:55.826120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc7fa804-10e3-4d0f-885f-89bcc066d815 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:55.826120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc7fa804-10e3-4d0f-885f-89bcc066d815 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:55.827197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc7fa804-10e3-4d0f-885f-89bcc066d815 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:55.827941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc7fa804-10e3-4d0f-885f-89bcc066d815 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:55.832869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc7fa804-10e3-4d0f-885f-89bcc066d815 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:55.833774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc7fa804-10e3-4d0f-885f-89bcc066d815 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:55.839906 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2923/5879] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:55 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:55.848479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c746a217-3a0d-4ae7-b25b-fc3a419461a4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:55.851178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c746a217-3a0d-4ae7-b25b-fc3a419461a4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:55.858329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c746a217-3a0d-4ae7-b25b-fc3a419461a4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:55.859513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c746a217-3a0d-4ae7-b25b-fc3a419461a4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:55.860494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c746a217-3a0d-4ae7-b25b-fc3a419461a4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:55.861495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c746a217-3a0d-4ae7-b25b-fc3a419461a4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:55.862181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c746a217-3a0d-4ae7-b25b-fc3a419461a4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:55.862852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c746a217-3a0d-4ae7-b25b-fc3a419461a4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:55.892567 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-c746a217-3a0d-4ae7-b25b-fc3a419461a4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Cannot 'resume' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c746a217-3a0d-4ae7-b25b-fc3a419461a4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action HTTP/1.1 Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 14 Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: {"resume": {}} Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: exception: Cannot 'resume' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '00aedb62-1a0e-47f0-bf42-19c12e9c035b', 'body': {'resume': {}}} Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b in vm_state active. Cannot resume while the instance is in this state. Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:55.894820 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:55.900635 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:55.900635 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:55.900635 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:55.900635 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:55.900635 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:55.900635 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active Oct 24 10:56:55.900635 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:55.904828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c746a217-3a0d-4ae7-b25b-fc3a419461a4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 409 to user: Cannot 'resume' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:55.906130 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c746a217-3a0d-4ae7-b25b-fc3a419461a4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action" status: 409 len: 144 microversion: 2.1 time: 0.064473 Oct 24 10:56:55.910936 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2924/5880] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:56:55 2022] POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action => generated 144 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:56:55.917412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e9bddf6-4220-45c9-8b87-9161eb297e98 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:55.918370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e9bddf6-4220-45c9-8b87-9161eb297e98 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:55.929715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e9bddf6-4220-45c9-8b87-9161eb297e98 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:55.930501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e9bddf6-4220-45c9-8b87-9161eb297e98 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:55.931200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e9bddf6-4220-45c9-8b87-9161eb297e98 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:55.932137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e9bddf6-4220-45c9-8b87-9161eb297e98 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:55.932865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e9bddf6-4220-45c9-8b87-9161eb297e98 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:55.933557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e9bddf6-4220-45c9-8b87-9161eb297e98 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:56.869363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bc7fa804-10e3-4d0f-885f-89bcc066d815 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:56.889173 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bc7fa804-10e3-4d0f-885f-89bcc066d815 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8" status: 200 len: 1373 microversion: 2.1 time: 1.105851 Oct 24 10:56:56.889784 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2957/5881] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:55 2022] GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8 => generated 1373 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:56.909640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1e9bddf6-4220-45c9-8b87-9161eb297e98 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:56.930602 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1e9bddf6-4220-45c9-8b87-9161eb297e98 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 1.016328 Oct 24 10:56:56.934981 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2925/5882] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:55 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:56.971966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eeaac4d9-b9f4-4ff0-900a-da28279861cc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:56.973806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-eeaac4d9-b9f4-4ff0-900a-da28279861cc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:56.989360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eeaac4d9-b9f4-4ff0-900a-da28279861cc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:56.993276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eeaac4d9-b9f4-4ff0-900a-da28279861cc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:56.994252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eeaac4d9-b9f4-4ff0-900a-da28279861cc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:56.995602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eeaac4d9-b9f4-4ff0-900a-da28279861cc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:56.996517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eeaac4d9-b9f4-4ff0-900a-da28279861cc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:56.998734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eeaac4d9-b9f4-4ff0-900a-da28279861cc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:57.182895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-2d151d4d-8082-4274-af33-29544de89a93 req-2a6a02c4-8756-48a8-9cc0-be73650204db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3716c187-1470-41fb-8cc0-0f5b80706ec8", "name": "network-vif-plugged", "status": "completed", "tag": "768ab8e1-3cea-490f-9398-f543fc548e84"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:57.218216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2d151d4d-8082-4274-af33-29544de89a93 req-2a6a02c4-8756-48a8-9cc0-be73650204db service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:57.219364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2d151d4d-8082-4274-af33-29544de89a93 req-2a6a02c4-8756-48a8-9cc0-be73650204db service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:57.220229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2d151d4d-8082-4274-af33-29544de89a93 req-2a6a02c4-8756-48a8-9cc0-be73650204db service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:57.244766 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-2d151d4d-8082-4274-af33-29544de89a93 req-2a6a02c4-8756-48a8-9cc0-be73650204db service nova] Creating event network-vif-plugged:768ab8e1-3cea-490f-9398-f543fc548e84 for instance 3716c187-1470-41fb-8cc0-0f5b80706ec8 on n-h2-858383-15 Oct 24 10:56:57.252684 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-2d151d4d-8082-4274-af33-29544de89a93 req-2a6a02c4-8756-48a8-9cc0-be73650204db service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074831 Oct 24 10:56:57.254254 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2926/5883] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:56:57.581704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dc6edda3-541a-433b-9c07-5fe206323fa1 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-32535910", "availability_zone": "foo_zone"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:57.588828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.aggregate [None req-dc6edda3-541a-433b-9c07-5fe206323fa1 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Generated uuid a49ee9af-7b87-4e01-b146-821db6d7986f for aggregate {{(pid=120425) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 24 10:56:57.650379 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dc6edda3-541a-433b-9c07-5fe206323fa1 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 207 microversion: 2.1 time: 0.276633 Oct 24 10:56:57.652024 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2927/5884] 10.222.0.50 () {60 vars in 1164 bytes} [Mon Oct 24 10:56:57 2022] POST /compute/v2.1/os-aggregates => generated 207 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:56:57.674562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a50748cb-9e26-4f16-b2e4-57f140784ce7 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:57.719351 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a50748cb-9e26-4f16-b2e4-57f140784ce7 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 317 microversion: 2.1 time: 0.056058 Oct 24 10:56:57.720719 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2928/5885] 10.222.0.50 () {60 vars in 1194 bytes} [Mon Oct 24 10:56:57 2022] POST /compute/v2.1/os-aggregates/19/action => generated 317 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:56:57.733348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a10b8e6-ab50-4b8a-9764-35d84bcd87d9 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:57.737730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a10b8e6-ab50-4b8a-9764-35d84bcd87d9 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:57.738769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a10b8e6-ab50-4b8a-9764-35d84bcd87d9 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:57.739468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a10b8e6-ab50-4b8a-9764-35d84bcd87d9 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:57.740486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a10b8e6-ab50-4b8a-9764-35d84bcd87d9 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:57.741338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a10b8e6-ab50-4b8a-9764-35d84bcd87d9 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:57.742056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a10b8e6-ab50-4b8a-9764-35d84bcd87d9 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:57.748299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-eeaac4d9-b9f4-4ff0-900a-da28279861cc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:57.768001 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-eeaac4d9-b9f4-4ff0-900a-da28279861cc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.802014 Oct 24 10:56:57.769894 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2958/5886] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:56 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:57.801714 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0a10b8e6-ab50-4b8a-9764-35d84bcd87d9 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.073521 Oct 24 10:56:57.803092 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2929/5887] 10.222.0.50 () {58 vars in 1176 bytes} [Mon Oct 24 10:56:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:56:57.815320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-55f4fd9f-d5d6-4e7a-be50-ec109d7963c3 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:57.830265 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-55f4fd9f-d5d6-4e7a-be50-ec109d7963c3 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 296 microversion: 2.1 time: 0.019602 Oct 24 10:56:57.831546 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2959/5888] 10.222.0.50 () {58 vars in 1143 bytes} [Mon Oct 24 10:56:57 2022] GET /compute/v2.1/os-aggregates => generated 296 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:56:57.845803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-58a29105-4d88-40e1-9544-fc6f35bdef94 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-15"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:57.868619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58a29105-4d88-40e1-9544-fc6f35bdef94 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:57.869195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58a29105-4d88-40e1-9544-fc6f35bdef94 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:57.869641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-58a29105-4d88-40e1-9544-fc6f35bdef94 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:57.922413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a99d9eae-0fad-4ecc-8200-1b0b222661fc tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:57.925164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a99d9eae-0fad-4ecc-8200-1b0b222661fc tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:57.939911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a99d9eae-0fad-4ecc-8200-1b0b222661fc tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:57.943871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a99d9eae-0fad-4ecc-8200-1b0b222661fc tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:57.944571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a99d9eae-0fad-4ecc-8200-1b0b222661fc tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:57.945543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a99d9eae-0fad-4ecc-8200-1b0b222661fc tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:57.946262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a99d9eae-0fad-4ecc-8200-1b0b222661fc tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:57.947791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a99d9eae-0fad-4ecc-8200-1b0b222661fc tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:58.085314 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-58a29105-4d88-40e1-9544-fc6f35bdef94 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.245582 Oct 24 10:56:58.087990 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2930/5889] 10.222.0.50 () {60 vars in 1194 bytes} [Mon Oct 24 10:56:57 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:56:58.095275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c0e99cd4-cf06-492f-a141-fe7229aea6fa tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c0e99cd4-cf06-492f-a141-fe7229aea6fa tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 160 Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: {"server": {"name": "", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "33496d87-63b8-423d-9b93-72eddb64dec3"}]}} Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'body': {'server': {'name': '', 'imageRef': 'a9689e0d-06ef-475e-9c75-9e39befd50b7', 'flavorRef': '452', 'networks': [{'uuid': '33496d87-63b8-423d-9b93-72eddb64dec3'}]}}} Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi '' Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:56:58.101731 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:56:58.105802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:56:58.105802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 24 10:56:58.105802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:58.105802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:58.105802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:58.105802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:58.105802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:58.105802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:58.105802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:56:58.105802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:56:58.105802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 24 10:56:58.105802 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:58.109055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c0e99cd4-cf06-492f-a141-fe7229aea6fa tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:58.111318 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c0e99cd4-cf06-492f-a141-fe7229aea6fa tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.021149 Oct 24 10:56:58.112299 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2931/5890] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:56:58 2022] POST /compute/v2.1/servers => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:56:58.119370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-87353b67-a694-42bd-842e-a129acb006da tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:58.136566 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-87353b67-a694-42bd-842e-a129acb006da tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.023008 Oct 24 10:56:58.139421 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2932/5891] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:56:58 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:56:58.150747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9ef733d7-c0d6-4cf7-b164-d588fd9f8a0a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:58.151784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9ef733d7-c0d6-4cf7-b164-d588fd9f8a0a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:58.161323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ef733d7-c0d6-4cf7-b164-d588fd9f8a0a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:58.161878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ef733d7-c0d6-4cf7-b164-d588fd9f8a0a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:58.162346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ef733d7-c0d6-4cf7-b164-d588fd9f8a0a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:58.163072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ef733d7-c0d6-4cf7-b164-d588fd9f8a0a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:58.163600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ef733d7-c0d6-4cf7-b164-d588fd9f8a0a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:58.164119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ef733d7-c0d6-4cf7-b164-d588fd9f8a0a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:58.437652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a99d9eae-0fad-4ecc-8200-1b0b222661fc tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:58.454110 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a99d9eae-0fad-4ecc-8200-1b0b222661fc tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8" status: 200 len: 1373 microversion: 2.1 time: 0.543039 Oct 24 10:56:58.458482 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2960/5892] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:57 2022] GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8 => generated 1373 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:58.466421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4fa60473-5327-425c-90e1-3b3e3966529c tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1494681435", "availability_zone": "foo_zone"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:58.528651 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4fa60473-5327-425c-90e1-3b3e3966529c tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.068841 Oct 24 10:56:58.530588 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2961/5893] 10.222.0.50 () {60 vars in 1173 bytes} [Mon Oct 24 10:56:58 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:56:58.546790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-be3e3b7a-38b8-45ad-a4c3-c650b814b951 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:58.570190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9ef733d7-c0d6-4cf7-b164-d588fd9f8a0a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:58.582652 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9ef733d7-c0d6-4cf7-b164-d588fd9f8a0a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.441686 Oct 24 10:56:58.585321 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2933/5894] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:58 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:58.615671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-88d79424-8a51-4616-bebc-40b77c3dbee1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:58.621874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-88d79424-8a51-4616-bebc-40b77c3dbee1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:58.630223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88d79424-8a51-4616-bebc-40b77c3dbee1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:58.633015 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-be3e3b7a-38b8-45ad-a4c3-c650b814b951 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.094650 Oct 24 10:56:58.634590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88d79424-8a51-4616-bebc-40b77c3dbee1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:58.635789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88d79424-8a51-4616-bebc-40b77c3dbee1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:58.640003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88d79424-8a51-4616-bebc-40b77c3dbee1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:58.640818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88d79424-8a51-4616-bebc-40b77c3dbee1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:58.641487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88d79424-8a51-4616-bebc-40b77c3dbee1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:58.641629 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2962/5895] 10.222.0.50 () {60 vars in 1194 bytes} [Mon Oct 24 10:56:58 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:56:58.647047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dad5e3ee-8061-4e45-bff8-c70e40143dcf tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:58.665590 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dad5e3ee-8061-4e45-bff8-c70e40143dcf tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.022836 Oct 24 10:56:58.666523 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2963/5896] 10.222.0.50 () {58 vars in 1152 bytes} [Mon Oct 24 10:56:58 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:56:58.684801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-346f5dda-e8b6-482d-a854-4bce3e8bc1c7 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-15"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:58.711001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-346f5dda-e8b6-482d-a854-4bce3e8bc1c7 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:58.711836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-346f5dda-e8b6-482d-a854-4bce3e8bc1c7 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:58.712475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-346f5dda-e8b6-482d-a854-4bce3e8bc1c7 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:58.958323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-88d79424-8a51-4616-bebc-40b77c3dbee1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:58.968110 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-88d79424-8a51-4616-bebc-40b77c3dbee1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.356585 Oct 24 10:56:58.974021 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2934/5897] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:58 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:56:59.002103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2216ef6a-cd27-4207-bdab-aff51b25a9b3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:56:59.003048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2216ef6a-cd27-4207-bdab-aff51b25a9b3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 61371574-1a94-41cd-a456-d10b9de9c808] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:59.013826 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-2216ef6a-cd27-4207-bdab-aff51b25a9b3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance 61371574-1a94-41cd-a456-d10b9de9c808 could not be found. Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2216ef6a-cd27-4207-bdab-aff51b25a9b3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/61371574-1a94-41cd-a456-d10b9de9c808/action HTTP/1.1 Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 14 Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: {"shelve": {}} Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 61371574-1a94-41cd-a456-d10b9de9c808 could not be found. Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '61371574-1a94-41cd-a456-d10b9de9c808', 'body': {'shelve': {}}} Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61371574-1a94-41cd-a456-d10b9de9c808 could not be found. Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61371574-1a94-41cd-a456-d10b9de9c808 could not be found. Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:56:59.039645 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:56:59.047424 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:56:59.047424 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:56:59.047424 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61371574-1a94-41cd-a456-d10b9de9c808 could not be found. Oct 24 10:56:59.047424 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:56:59.047424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2216ef6a-cd27-4207-bdab-aff51b25a9b3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance 61371574-1a94-41cd-a456-d10b9de9c808 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:56:59.047424 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2216ef6a-cd27-4207-bdab-aff51b25a9b3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/61371574-1a94-41cd-a456-d10b9de9c808/action" status: 404 len: 111 microversion: 2.1 time: 0.051512 Oct 24 10:56:59.052729 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2935/5898] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:56:58 2022] POST /compute/v2.1/servers/61371574-1a94-41cd-a456-d10b9de9c808/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:56:59.062015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7df56322-f1c7-4a92-b56a-78c8c654cf56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:59.064018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7df56322-f1c7-4a92-b56a-78c8c654cf56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:59.077233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7df56322-f1c7-4a92-b56a-78c8c654cf56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:59.079640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7df56322-f1c7-4a92-b56a-78c8c654cf56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:59.082346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7df56322-f1c7-4a92-b56a-78c8c654cf56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:59.084430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7df56322-f1c7-4a92-b56a-78c8c654cf56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:59.085419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7df56322-f1c7-4a92-b56a-78c8c654cf56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:59.087713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7df56322-f1c7-4a92-b56a-78c8c654cf56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:59.349651 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-346f5dda-e8b6-482d-a854-4bce3e8bc1c7 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.674242 Oct 24 10:56:59.352111 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2964/5899] 10.222.0.50 () {60 vars in 1194 bytes} [Mon Oct 24 10:56:58 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:56:59.389874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1919d7be-332f-4d52-8698-b12464915e98 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:59.443852 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1919d7be-332f-4d52-8698-b12464915e98 tempest-TestAggregatesBasicOps-834365426 tempest-TestAggregatesBasicOps-834365426-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.082955 Oct 24 10:56:59.446808 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2965/5900] 10.222.0.50 () {58 vars in 1155 bytes} [Mon Oct 24 10:56:59 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 24 10:56:59.482751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5b0305f0-e196-4a8b-8ec9-05ab71ac74aa tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:59.483743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5b0305f0-e196-4a8b-8ec9-05ab71ac74aa tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:59.501740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b0305f0-e196-4a8b-8ec9-05ab71ac74aa tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:59.502248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b0305f0-e196-4a8b-8ec9-05ab71ac74aa tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:59.505904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b0305f0-e196-4a8b-8ec9-05ab71ac74aa tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:59.508440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b0305f0-e196-4a8b-8ec9-05ab71ac74aa tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:59.509937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b0305f0-e196-4a8b-8ec9-05ab71ac74aa tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:59.510416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b0305f0-e196-4a8b-8ec9-05ab71ac74aa tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:59.515055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7df56322-f1c7-4a92-b56a-78c8c654cf56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:56:59.525412 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7df56322-f1c7-4a92-b56a-78c8c654cf56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.468770 Oct 24 10:56:59.528648 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2936/5901] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:59 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:56:59.559384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fa3ffc39-8284-4da9-85b4-a31519d88de6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:56:59.561158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fa3ffc39-8284-4da9-85b4-a31519d88de6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:56:59.573050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa3ffc39-8284-4da9-85b4-a31519d88de6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:59.573564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa3ffc39-8284-4da9-85b4-a31519d88de6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:59.574012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa3ffc39-8284-4da9-85b4-a31519d88de6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:56:59.579441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa3ffc39-8284-4da9-85b4-a31519d88de6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:56:59.580088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa3ffc39-8284-4da9-85b4-a31519d88de6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:56:59.580559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa3ffc39-8284-4da9-85b4-a31519d88de6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:00.092366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fa3ffc39-8284-4da9-85b4-a31519d88de6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:00.104603 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fa3ffc39-8284-4da9-85b4-a31519d88de6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.550307 Oct 24 10:57:00.110837 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2937/5902] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:59 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:00.129935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9de56322-8b1b-4820-8b17-24841e0e5413 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:57:00.130729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9de56322-8b1b-4820-8b17-24841e0e5413 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:00.137192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9de56322-8b1b-4820-8b17-24841e0e5413 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:00.137896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9de56322-8b1b-4820-8b17-24841e0e5413 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:00.138539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9de56322-8b1b-4820-8b17-24841e0e5413 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:00.139409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9de56322-8b1b-4820-8b17-24841e0e5413 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:00.140076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9de56322-8b1b-4820-8b17-24841e0e5413 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:00.140665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9de56322-8b1b-4820-8b17-24841e0e5413 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:00.172302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-9de56322-8b1b-4820-8b17-24841e0e5413 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lazy-loading 'flavor' on Instance uuid 00aedb62-1a0e-47f0-bf42-19c12e9c035b {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:57:00.512549 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9de56322-8b1b-4820-8b17-24841e0e5413 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action" status: 202 len: 0 microversion: 2.1 time: 0.386265 Oct 24 10:57:00.518069 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2938/5903] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:57:00 2022] POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:57:00.538413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e8ccfd6f-9163-4e0c-b54b-79d60e77cc96 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:00.539613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e8ccfd6f-9163-4e0c-b54b-79d60e77cc96 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:00.552608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8ccfd6f-9163-4e0c-b54b-79d60e77cc96 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:00.553626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8ccfd6f-9163-4e0c-b54b-79d60e77cc96 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:00.563344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8ccfd6f-9163-4e0c-b54b-79d60e77cc96 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:00.564520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8ccfd6f-9163-4e0c-b54b-79d60e77cc96 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:00.567101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8ccfd6f-9163-4e0c-b54b-79d60e77cc96 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:00.567937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8ccfd6f-9163-4e0c-b54b-79d60e77cc96 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:00.838249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5b0305f0-e196-4a8b-8ec9-05ab71ac74aa tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:00.853153 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5b0305f0-e196-4a8b-8ec9-05ab71ac74aa tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8" status: 200 len: 1545 microversion: 2.1 time: 1.375491 Oct 24 10:57:00.856007 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2966/5904] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:56:59 2022] GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8 => generated 1545 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:00.882484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d0f28dd0-00c6-4794-b1b8-2fa759d038da tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:00.883292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d0f28dd0-00c6-4794-b1b8-2fa759d038da tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:00.902387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0f28dd0-00c6-4794-b1b8-2fa759d038da tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:00.903357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0f28dd0-00c6-4794-b1b8-2fa759d038da tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:00.904941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0f28dd0-00c6-4794-b1b8-2fa759d038da tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:00.905880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0f28dd0-00c6-4794-b1b8-2fa759d038da tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:00.906522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0f28dd0-00c6-4794-b1b8-2fa759d038da tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:00.907372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0f28dd0-00c6-4794-b1b8-2fa759d038da tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:01.246025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e8ccfd6f-9163-4e0c-b54b-79d60e77cc96 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:01.256336 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e8ccfd6f-9163-4e0c-b54b-79d60e77cc96 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1511 microversion: 2.1 time: 0.736557 Oct 24 10:57:01.272868 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2939/5905] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:00 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1511 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:01.372101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d0f28dd0-00c6-4794-b1b8-2fa759d038da tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:01.386848 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d0f28dd0-00c6-4794-b1b8-2fa759d038da tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8" status: 200 len: 1545 microversion: 2.1 time: 0.509095 Oct 24 10:57:01.387706 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2967/5906] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:00 2022] GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8 => generated 1545 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:57:02.287288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7f096f4d-1125-4548-8cfd-e2d9734caaf6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:02.288928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7f096f4d-1125-4548-8cfd-e2d9734caaf6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:02.296921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f096f4d-1125-4548-8cfd-e2d9734caaf6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:02.297867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f096f4d-1125-4548-8cfd-e2d9734caaf6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:02.298627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f096f4d-1125-4548-8cfd-e2d9734caaf6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:02.299725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f096f4d-1125-4548-8cfd-e2d9734caaf6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:02.300369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f096f4d-1125-4548-8cfd-e2d9734caaf6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:02.301017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f096f4d-1125-4548-8cfd-e2d9734caaf6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:02.734593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7f096f4d-1125-4548-8cfd-e2d9734caaf6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:02.745857 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7f096f4d-1125-4548-8cfd-e2d9734caaf6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1511 microversion: 2.1 time: 0.462880 Oct 24 10:57:02.746777 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2940/5907] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:02 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1511 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:03.773408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b8a37265-8d4a-4691-9e55-d09bd11abc0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:03.781869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b8a37265-8d4a-4691-9e55-d09bd11abc0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:03.794453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8a37265-8d4a-4691-9e55-d09bd11abc0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:03.795477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8a37265-8d4a-4691-9e55-d09bd11abc0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:03.796599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8a37265-8d4a-4691-9e55-d09bd11abc0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:03.797834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8a37265-8d4a-4691-9e55-d09bd11abc0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:03.798481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8a37265-8d4a-4691-9e55-d09bd11abc0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:03.799172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8a37265-8d4a-4691-9e55-d09bd11abc0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:04.578555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b8a37265-8d4a-4691-9e55-d09bd11abc0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:04.586800 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b8a37265-8d4a-4691-9e55-d09bd11abc0e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1511 microversion: 2.1 time: 0.817867 Oct 24 10:57:04.590863 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2968/5908] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:03 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1511 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:05.618013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-458e94c1-fa38-4389-bbe9-270a19feed74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:05.618629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-458e94c1-fa38-4389-bbe9-270a19feed74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:05.627477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-458e94c1-fa38-4389-bbe9-270a19feed74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:05.627892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-458e94c1-fa38-4389-bbe9-270a19feed74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:05.628342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-458e94c1-fa38-4389-bbe9-270a19feed74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:05.629094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-458e94c1-fa38-4389-bbe9-270a19feed74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:05.629562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-458e94c1-fa38-4389-bbe9-270a19feed74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:05.629995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-458e94c1-fa38-4389-bbe9-270a19feed74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:05.682049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:57:06.284342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-458e94c1-fa38-4389-bbe9-270a19feed74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:06.293837 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-458e94c1-fa38-4389-bbe9-270a19feed74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1511 microversion: 2.1 time: 0.679674 Oct 24 10:57:06.296977 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2941/5909] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:05 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1511 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:07.320361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d584339b-5d5a-40cb-8052-aaad7c84afa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:07.321024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d584339b-5d5a-40cb-8052-aaad7c84afa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:07.330965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d584339b-5d5a-40cb-8052-aaad7c84afa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:07.331823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d584339b-5d5a-40cb-8052-aaad7c84afa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:07.332439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d584339b-5d5a-40cb-8052-aaad7c84afa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:07.333362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d584339b-5d5a-40cb-8052-aaad7c84afa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:07.334008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d584339b-5d5a-40cb-8052-aaad7c84afa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:07.334601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d584339b-5d5a-40cb-8052-aaad7c84afa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:07.795533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d584339b-5d5a-40cb-8052-aaad7c84afa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:07.805979 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d584339b-5d5a-40cb-8052-aaad7c84afa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1511 microversion: 2.1 time: 0.489413 Oct 24 10:57:07.835910 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2969/5910] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:07 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1511 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:08.836011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a96066f6-78d5-49e6-b77f-b8e091c1fc9f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:08.837581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a96066f6-78d5-49e6-b77f-b8e091c1fc9f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:08.840823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:57:08.853748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a96066f6-78d5-49e6-b77f-b8e091c1fc9f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:08.858321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a96066f6-78d5-49e6-b77f-b8e091c1fc9f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:08.859060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a96066f6-78d5-49e6-b77f-b8e091c1fc9f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:08.860162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a96066f6-78d5-49e6-b77f-b8e091c1fc9f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:08.860861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a96066f6-78d5-49e6-b77f-b8e091c1fc9f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:08.861471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a96066f6-78d5-49e6-b77f-b8e091c1fc9f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:09.300570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a96066f6-78d5-49e6-b77f-b8e091c1fc9f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:09.340076 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a96066f6-78d5-49e6-b77f-b8e091c1fc9f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1511 microversion: 2.1 time: 0.489499 Oct 24 10:57:09.343873 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2942/5911] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:08 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1511 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:10.372481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-64906844-d237-45e0-a470-b7a5da390b73 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:10.375137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-64906844-d237-45e0-a470-b7a5da390b73 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:10.392553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64906844-d237-45e0-a470-b7a5da390b73 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:10.393083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64906844-d237-45e0-a470-b7a5da390b73 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:10.393528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64906844-d237-45e0-a470-b7a5da390b73 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:10.394256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64906844-d237-45e0-a470-b7a5da390b73 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:10.394717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64906844-d237-45e0-a470-b7a5da390b73 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:10.395151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64906844-d237-45e0-a470-b7a5da390b73 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:10.983470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-64906844-d237-45e0-a470-b7a5da390b73 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:11.002546 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-64906844-d237-45e0-a470-b7a5da390b73 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1511 microversion: 2.1 time: 0.634132 Oct 24 10:57:11.003416 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2970/5912] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:10 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1511 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:12.031538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-623f3ff3-6a31-404c-b41a-c65d6a1e1c25 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:12.033330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-623f3ff3-6a31-404c-b41a-c65d6a1e1c25 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:12.060344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-623f3ff3-6a31-404c-b41a-c65d6a1e1c25 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:12.061160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-623f3ff3-6a31-404c-b41a-c65d6a1e1c25 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:12.061696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-623f3ff3-6a31-404c-b41a-c65d6a1e1c25 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:12.062445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-623f3ff3-6a31-404c-b41a-c65d6a1e1c25 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:12.062918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-623f3ff3-6a31-404c-b41a-c65d6a1e1c25 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:12.063359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-623f3ff3-6a31-404c-b41a-c65d6a1e1c25 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:12.424149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-623f3ff3-6a31-404c-b41a-c65d6a1e1c25 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:12.437805 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-623f3ff3-6a31-404c-b41a-c65d6a1e1c25 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1511 microversion: 2.1 time: 0.412703 Oct 24 10:57:12.439673 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2943/5913] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:12 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1511 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:13.466422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cb92a54c-d557-48c6-89e4-02d5b360dbf4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:13.467335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cb92a54c-d557-48c6-89e4-02d5b360dbf4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:13.474872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:57:13.485218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb92a54c-d557-48c6-89e4-02d5b360dbf4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:13.486115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb92a54c-d557-48c6-89e4-02d5b360dbf4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:13.488173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb92a54c-d557-48c6-89e4-02d5b360dbf4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:13.490363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb92a54c-d557-48c6-89e4-02d5b360dbf4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:13.491155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb92a54c-d557-48c6-89e4-02d5b360dbf4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:13.494382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb92a54c-d557-48c6-89e4-02d5b360dbf4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:13.529033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:57:13.977299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cb92a54c-d557-48c6-89e4-02d5b360dbf4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:13.986350 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cb92a54c-d557-48c6-89e4-02d5b360dbf4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1511 microversion: 2.1 time: 0.524664 Oct 24 10:57:13.990548 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2971/5914] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:13 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1511 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:14.541945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e69d6c62-7bb4-49b5-9d24-7be81eeb6e09 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:14.542654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e69d6c62-7bb4-49b5-9d24-7be81eeb6e09 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:14.556789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e69d6c62-7bb4-49b5-9d24-7be81eeb6e09 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:14.563761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e69d6c62-7bb4-49b5-9d24-7be81eeb6e09 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:14.563761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e69d6c62-7bb4-49b5-9d24-7be81eeb6e09 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:14.571702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e69d6c62-7bb4-49b5-9d24-7be81eeb6e09 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:14.576349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e69d6c62-7bb4-49b5-9d24-7be81eeb6e09 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:14.580317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e69d6c62-7bb4-49b5-9d24-7be81eeb6e09 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:14.966463 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e69d6c62-7bb4-49b5-9d24-7be81eeb6e09 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1836 microversion: 2.1 time: 0.425376 Oct 24 10:57:14.973092 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2944/5915] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:14 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1836 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:15.012890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f301bb97-4c30-48fe-80ee-dfb687d81ca3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:15.014550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f301bb97-4c30-48fe-80ee-dfb687d81ca3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:15.021742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f301bb97-4c30-48fe-80ee-dfb687d81ca3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:15.030246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f301bb97-4c30-48fe-80ee-dfb687d81ca3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:15.031096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f301bb97-4c30-48fe-80ee-dfb687d81ca3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:15.035891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f301bb97-4c30-48fe-80ee-dfb687d81ca3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:15.036477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f301bb97-4c30-48fe-80ee-dfb687d81ca3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:15.037056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f301bb97-4c30-48fe-80ee-dfb687d81ca3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:15.848866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f301bb97-4c30-48fe-80ee-dfb687d81ca3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:15.861126 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f301bb97-4c30-48fe-80ee-dfb687d81ca3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1511 microversion: 2.1 time: 0.853265 Oct 24 10:57:15.870744 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2972/5916] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:15 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1511 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:16.574697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad877a0d-b9e9-49bd-854b-db80ba4dca52 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:16.575922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad877a0d-b9e9-49bd-854b-db80ba4dca52 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:16.586349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-38e50323-2898-487a-8f5a-225b3b5482fe req-672ea3d4-53bc-46f2-aced-c94026cc5c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bfd7080-7dfd-489b-8128-0e66aec16fff", "tag": "2cae1fc6-3659-43fd-97c3-9b936fe09a4e"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:57:16.594788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:57:16.614143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-38e50323-2898-487a-8f5a-225b3b5482fe req-672ea3d4-53bc-46f2-aced-c94026cc5c43 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:16.615090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-38e50323-2898-487a-8f5a-225b3b5482fe req-672ea3d4-53bc-46f2-aced-c94026cc5c43 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:16.615745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-38e50323-2898-487a-8f5a-225b3b5482fe req-672ea3d4-53bc-46f2-aced-c94026cc5c43 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:16.620763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad877a0d-b9e9-49bd-854b-db80ba4dca52 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:16.622197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad877a0d-b9e9-49bd-854b-db80ba4dca52 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:16.623046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad877a0d-b9e9-49bd-854b-db80ba4dca52 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:16.624875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad877a0d-b9e9-49bd-854b-db80ba4dca52 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:16.626234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad877a0d-b9e9-49bd-854b-db80ba4dca52 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:16.626998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad877a0d-b9e9-49bd-854b-db80ba4dca52 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:16.629961 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-38e50323-2898-487a-8f5a-225b3b5482fe req-672ea3d4-53bc-46f2-aced-c94026cc5c43 service nova] Creating event network-changed:2cae1fc6-3659-43fd-97c3-9b936fe09a4e for instance 3bfd7080-7dfd-489b-8128-0e66aec16fff on n-h1-858383-15 Oct 24 10:57:16.636950 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-38e50323-2898-487a-8f5a-225b3b5482fe req-672ea3d4-53bc-46f2-aced-c94026cc5c43 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055120 Oct 24 10:57:16.638197 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2973/5917] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:57:16.737087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad877a0d-b9e9-49bd-854b-db80ba4dca52 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:57:16.892852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-281bb268-19cf-41f1-b580-658a9ed7f99a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:16.893911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-281bb268-19cf-41f1-b580-658a9ed7f99a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:16.904102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-281bb268-19cf-41f1-b580-658a9ed7f99a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:16.905433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-281bb268-19cf-41f1-b580-658a9ed7f99a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:16.911666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-281bb268-19cf-41f1-b580-658a9ed7f99a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:16.913497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-281bb268-19cf-41f1-b580-658a9ed7f99a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:16.918519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-281bb268-19cf-41f1-b580-658a9ed7f99a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:16.918519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-281bb268-19cf-41f1-b580-658a9ed7f99a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:16.990350 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad877a0d-b9e9-49bd-854b-db80ba4dca52 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 204 len: 0 microversion: 2.1 time: 0.419142 Oct 24 10:57:16.995684 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2945/5918] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:57:16 2022] DELETE /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:57:17.020647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dd08f99a-ec4b-41e8-baf2-2ed132367d79 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:17.022531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dd08f99a-ec4b-41e8-baf2-2ed132367d79 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:17.038522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd08f99a-ec4b-41e8-baf2-2ed132367d79 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:17.039942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd08f99a-ec4b-41e8-baf2-2ed132367d79 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:17.040816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd08f99a-ec4b-41e8-baf2-2ed132367d79 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:17.042245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd08f99a-ec4b-41e8-baf2-2ed132367d79 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:17.043071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd08f99a-ec4b-41e8-baf2-2ed132367d79 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:17.043901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd08f99a-ec4b-41e8-baf2-2ed132367d79 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:17.285899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-281bb268-19cf-41f1-b580-658a9ed7f99a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:17.296958 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-281bb268-19cf-41f1-b580-658a9ed7f99a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1532 microversion: 2.1 time: 0.409557 Oct 24 10:57:17.304283 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2974/5919] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:16 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1532 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:17.426227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dd08f99a-ec4b-41e8-baf2-2ed132367d79 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:17.436905 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dd08f99a-ec4b-41e8-baf2-2ed132367d79 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1689 microversion: 2.1 time: 0.439458 Oct 24 10:57:17.461578 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2946/5920] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:16 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1689 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:18.329981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b63240c7-0dcb-44af-9806-7c73bf266fe3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:18.333002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b63240c7-0dcb-44af-9806-7c73bf266fe3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:18.352357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b63240c7-0dcb-44af-9806-7c73bf266fe3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:18.353369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b63240c7-0dcb-44af-9806-7c73bf266fe3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:18.358271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b63240c7-0dcb-44af-9806-7c73bf266fe3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:18.363421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b63240c7-0dcb-44af-9806-7c73bf266fe3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:18.373922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b63240c7-0dcb-44af-9806-7c73bf266fe3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:18.374587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b63240c7-0dcb-44af-9806-7c73bf266fe3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:18.469273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c902f95b-774d-459c-b868-3f4056e2e7d6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:18.469905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c902f95b-774d-459c-b868-3f4056e2e7d6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:18.486540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c902f95b-774d-459c-b868-3f4056e2e7d6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:18.487109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c902f95b-774d-459c-b868-3f4056e2e7d6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:18.495097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c902f95b-774d-459c-b868-3f4056e2e7d6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:18.498858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c902f95b-774d-459c-b868-3f4056e2e7d6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:18.499360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c902f95b-774d-459c-b868-3f4056e2e7d6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:18.503338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c902f95b-774d-459c-b868-3f4056e2e7d6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:19.443831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b63240c7-0dcb-44af-9806-7c73bf266fe3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:19.458310 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b63240c7-0dcb-44af-9806-7c73bf266fe3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1532 microversion: 2.1 time: 1.140671 Oct 24 10:57:19.459651 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2975/5921] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:18 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1532 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:19.771458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c902f95b-774d-459c-b868-3f4056e2e7d6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:19.786899 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c902f95b-774d-459c-b868-3f4056e2e7d6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1689 microversion: 2.1 time: 1.325814 Oct 24 10:57:19.806570 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2947/5922] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:18 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1689 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:57:19.874164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-6ea7bffe-0bf9-48d7-8e78-18a1f66bb7bc req-a5607f0f-56c6-487b-989e-c6e639bac417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00aedb62-1a0e-47f0-bf42-19c12e9c035b", "name": "network-vif-plugged", "status": "completed", "tag": "6502e9a3-ede9-43b4-816f-557cd30886f2"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:57:19.904082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6ea7bffe-0bf9-48d7-8e78-18a1f66bb7bc req-a5607f0f-56c6-487b-989e-c6e639bac417 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:19.908274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6ea7bffe-0bf9-48d7-8e78-18a1f66bb7bc req-a5607f0f-56c6-487b-989e-c6e639bac417 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:19.908740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6ea7bffe-0bf9-48d7-8e78-18a1f66bb7bc req-a5607f0f-56c6-487b-989e-c6e639bac417 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:19.958505 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-6ea7bffe-0bf9-48d7-8e78-18a1f66bb7bc req-a5607f0f-56c6-487b-989e-c6e639bac417 service nova] Creating event network-vif-plugged:6502e9a3-ede9-43b4-816f-557cd30886f2 for instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b on n-h2-858383-15 Oct 24 10:57:19.982387 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-6ea7bffe-0bf9-48d7-8e78-18a1f66bb7bc req-a5607f0f-56c6-487b-989e-c6e639bac417 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112646 Oct 24 10:57:19.985623 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2976/5923] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:57:20.486908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-116e44ee-7fc1-459a-a2d8-ffaf82e901e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:20.487475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-116e44ee-7fc1-459a-a2d8-ffaf82e901e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:20.508434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-116e44ee-7fc1-459a-a2d8-ffaf82e901e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:20.509389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-116e44ee-7fc1-459a-a2d8-ffaf82e901e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:20.509828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-116e44ee-7fc1-459a-a2d8-ffaf82e901e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:20.511409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-116e44ee-7fc1-459a-a2d8-ffaf82e901e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:20.512134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-116e44ee-7fc1-459a-a2d8-ffaf82e901e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:20.512582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-116e44ee-7fc1-459a-a2d8-ffaf82e901e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:20.813676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e299d5a8-b5e0-4cfd-b35a-db87f47ef0f2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:20.814469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e299d5a8-b5e0-4cfd-b35a-db87f47ef0f2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:20.830097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e299d5a8-b5e0-4cfd-b35a-db87f47ef0f2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:20.830729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e299d5a8-b5e0-4cfd-b35a-db87f47ef0f2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:20.831028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e299d5a8-b5e0-4cfd-b35a-db87f47ef0f2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:20.831754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e299d5a8-b5e0-4cfd-b35a-db87f47ef0f2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:20.832448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e299d5a8-b5e0-4cfd-b35a-db87f47ef0f2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:20.832923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e299d5a8-b5e0-4cfd-b35a-db87f47ef0f2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:21.253738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-116e44ee-7fc1-459a-a2d8-ffaf82e901e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:21.293707 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-116e44ee-7fc1-459a-a2d8-ffaf82e901e4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1527 microversion: 2.1 time: 0.810991 Oct 24 10:57:21.296553 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2948/5924] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:20 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1527 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:21.301879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b5cf70b6-565b-4acd-b9ea-3dfaf802f32d req-ad9e7859-5f99-4a84-a5d9-2559692c269a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfd7080-7dfd-489b-8128-0e66aec16fff", "name": "network-vif-deleted", "tag": "2cae1fc6-3659-43fd-97c3-9b936fe09a4e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:57:21.313006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e299d5a8-b5e0-4cfd-b35a-db87f47ef0f2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:21.338657 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e299d5a8-b5e0-4cfd-b35a-db87f47ef0f2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 200 len: 1502 microversion: 2.1 time: 0.529406 Oct 24 10:57:21.341276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b5cf70b6-565b-4acd-b9ea-3dfaf802f32d req-ad9e7859-5f99-4a84-a5d9-2559692c269a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:21.343313 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2977/5925] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:20 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 1502 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:21.345216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b5cf70b6-565b-4acd-b9ea-3dfaf802f32d req-ad9e7859-5f99-4a84-a5d9-2559692c269a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:21.349619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b5cf70b6-565b-4acd-b9ea-3dfaf802f32d req-ad9e7859-5f99-4a84-a5d9-2559692c269a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:21.394875 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b5cf70b6-565b-4acd-b9ea-3dfaf802f32d req-ad9e7859-5f99-4a84-a5d9-2559692c269a service nova] Creating event network-vif-deleted:2cae1fc6-3659-43fd-97c3-9b936fe09a4e for instance 3bfd7080-7dfd-489b-8128-0e66aec16fff on n-h1-858383-15 Oct 24 10:57:21.424239 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b5cf70b6-565b-4acd-b9ea-3dfaf802f32d req-ad9e7859-5f99-4a84-a5d9-2559692c269a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125696 Oct 24 10:57:21.435178 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2949/5926] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:57:22.325440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b2fd83f6-c2d6-4fc3-b3b4-edc8d0b24288 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:22.327073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b2fd83f6-c2d6-4fc3-b3b4-edc8d0b24288 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:22.347443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2fd83f6-c2d6-4fc3-b3b4-edc8d0b24288 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:22.347946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2fd83f6-c2d6-4fc3-b3b4-edc8d0b24288 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:22.370145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43f6cad2-8409-4794-8f61-51aaf1fe2613 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:22.370866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-43f6cad2-8409-4794-8f61-51aaf1fe2613 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 3bfd7080-7dfd-489b-8128-0e66aec16fff] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:22.373612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2fd83f6-c2d6-4fc3-b3b4-edc8d0b24288 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:22.374446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2fd83f6-c2d6-4fc3-b3b4-edc8d0b24288 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:22.374934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2fd83f6-c2d6-4fc3-b3b4-edc8d0b24288 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:22.375377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2fd83f6-c2d6-4fc3-b3b4-edc8d0b24288 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:22.400579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43f6cad2-8409-4794-8f61-51aaf1fe2613 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:22.401222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43f6cad2-8409-4794-8f61-51aaf1fe2613 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:22.401690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43f6cad2-8409-4794-8f61-51aaf1fe2613 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:22.402715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43f6cad2-8409-4794-8f61-51aaf1fe2613 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:22.403181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43f6cad2-8409-4794-8f61-51aaf1fe2613 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:22.409631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43f6cad2-8409-4794-8f61-51aaf1fe2613 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:22.497831 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-43f6cad2-8409-4794-8f61-51aaf1fe2613 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] HTTP exception thrown: Instance 3bfd7080-7dfd-489b-8128-0e66aec16fff could not be found. Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43f6cad2-8409-4794-8f61-51aaf1fe2613 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Request method failure captured: Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff HTTP/1.1 Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm3GX82MAk9t_DY3ldBvJqgw4krRRZI91P4i_Ha4QFlAFzgtY357SWlZo2bmt5yQ4BdbJCOJlqOV_m4WkwsNVJwqhdGf2Mb8PfZodPxM72kQRMnwEV3JRp9SnBdSvplatZoPBEyBaXBcJ4mHkyjNtrR7UqU0ub2iwqP0g4u9U6TTz9c Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 45405624633e404ab2d6ff26482a150e Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-626774974 Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/45405624633e404ab2d6ff26482a150e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/45405624633e404ab2d6ff26482a150e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/45405624633e404ab2d6ff26482a150e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_45405624633e404ab2d6ff26482a150e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestNetworkAdvancedServerOps-626774974 Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 45405624633e404ab2d6ff26482a150e Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-626774974 Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestNetworkAdvancedServerOps-626774974-project Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: cdae8836f9784dff90fea5201fd15d1d Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestNetworkAdvancedServerOps-626774974-project Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 3bfd7080-7dfd-489b-8128-0e66aec16fff could not be found. Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '3bfd7080-7dfd-489b-8128-0e66aec16fff'} Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bfd7080-7dfd-489b-8128-0e66aec16fff could not be found. Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bfd7080-7dfd-489b-8128-0e66aec16fff could not be found. Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:57:22.499900 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:57:22.506086 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:57:22.506086 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:57:22.506086 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:57:22.506086 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:57:22.506086 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:57:22.506086 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:57:22.506086 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bfd7080-7dfd-489b-8128-0e66aec16fff could not be found. Oct 24 10:57:22.506086 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:57:22.517746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43f6cad2-8409-4794-8f61-51aaf1fe2613 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Returning 404 to user: Instance 3bfd7080-7dfd-489b-8128-0e66aec16fff could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:57:22.518956 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-43f6cad2-8409-4794-8f61-51aaf1fe2613 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff" status: 404 len: 111 microversion: 2.1 time: 0.155967 Oct 24 10:57:22.520080 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2950/5927] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:22 2022] GET /compute/v2.1/servers/3bfd7080-7dfd-489b-8128-0e66aec16fff => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:57:23.504323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b2fd83f6-c2d6-4fc3-b3b4-edc8d0b24288 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:23.519621 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b2fd83f6-c2d6-4fc3-b3b4-edc8d0b24288 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1527 microversion: 2.1 time: 1.198849 Oct 24 10:57:23.524509 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2978/5928] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:22 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1527 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:24.552268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-763efe0b-bb45-435c-8616-ad5901ffafa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:24.553249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-763efe0b-bb45-435c-8616-ad5901ffafa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:24.586133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-763efe0b-bb45-435c-8616-ad5901ffafa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:24.586962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-763efe0b-bb45-435c-8616-ad5901ffafa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:24.588167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-763efe0b-bb45-435c-8616-ad5901ffafa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:24.590452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-763efe0b-bb45-435c-8616-ad5901ffafa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:24.591135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-763efe0b-bb45-435c-8616-ad5901ffafa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:24.591807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-763efe0b-bb45-435c-8616-ad5901ffafa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:24.981586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-763efe0b-bb45-435c-8616-ad5901ffafa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:24.996161 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-763efe0b-bb45-435c-8616-ad5901ffafa7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1527 microversion: 2.1 time: 0.449008 Oct 24 10:57:25.004906 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2951/5929] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:24 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1527 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:26.035490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ed21861a-effc-44eb-8c4c-69b9edee7c74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:26.036790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ed21861a-effc-44eb-8c4c-69b9edee7c74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:26.046739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed21861a-effc-44eb-8c4c-69b9edee7c74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:26.051901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed21861a-effc-44eb-8c4c-69b9edee7c74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:26.052589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed21861a-effc-44eb-8c4c-69b9edee7c74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:26.053527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed21861a-effc-44eb-8c4c-69b9edee7c74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:26.053994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed21861a-effc-44eb-8c4c-69b9edee7c74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:26.054425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed21861a-effc-44eb-8c4c-69b9edee7c74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:26.436655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ed21861a-effc-44eb-8c4c-69b9edee7c74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:26.473526 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ed21861a-effc-44eb-8c4c-69b9edee7c74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1527 microversion: 2.1 time: 0.438833 Oct 24 10:57:26.477097 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2979/5930] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:26 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1527 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:27.503423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ea14ebd-cb69-41ee-8378-4066c322a4f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:27.507315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0ea14ebd-cb69-41ee-8378-4066c322a4f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:27.522027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ea14ebd-cb69-41ee-8378-4066c322a4f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:27.525378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ea14ebd-cb69-41ee-8378-4066c322a4f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:27.526515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ea14ebd-cb69-41ee-8378-4066c322a4f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:27.528031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ea14ebd-cb69-41ee-8378-4066c322a4f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:27.530381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ea14ebd-cb69-41ee-8378-4066c322a4f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:27.530914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ea14ebd-cb69-41ee-8378-4066c322a4f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:28.413203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0ea14ebd-cb69-41ee-8378-4066c322a4f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:28.427085 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0ea14ebd-cb69-41ee-8378-4066c322a4f6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1527 microversion: 2.1 time: 0.930608 Oct 24 10:57:28.445887 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2952/5931] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:27 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1527 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:29.455230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-42afb922-e90e-495a-a13b-14e34353d5d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:29.455866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-42afb922-e90e-495a-a13b-14e34353d5d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:29.470941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42afb922-e90e-495a-a13b-14e34353d5d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:29.471439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42afb922-e90e-495a-a13b-14e34353d5d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:29.479938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42afb922-e90e-495a-a13b-14e34353d5d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:29.494522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42afb922-e90e-495a-a13b-14e34353d5d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:29.495361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42afb922-e90e-495a-a13b-14e34353d5d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:29.496015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42afb922-e90e-495a-a13b-14e34353d5d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:30.189797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-42afb922-e90e-495a-a13b-14e34353d5d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:30.204595 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-42afb922-e90e-495a-a13b-14e34353d5d9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1527 microversion: 2.1 time: 0.753723 Oct 24 10:57:30.208466 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2980/5932] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:29 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1527 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:30.569394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-19c4a374-a480-40da-bd88-62beb2e088f3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '.version_select at 0x7f04cba4fd30>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:30.651553 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-19c4a374-a480-40da-bd88-62beb2e088f3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1996134956" status: 202 len: 0 microversion: 2.1 time: 0.087891 Oct 24 10:57:30.653363 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2953/5933] 10.222.0.50 () {58 vars in 1284 bytes} [Mon Oct 24 10:57:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1996134956 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:57:30.702294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ae9d048e-ece5-415a-a5c5-fce3dea4c042 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'create', calling method: .version_select at 0x7f04d0901430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-254497017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ4S0jfOfBSPDea7E4DII8hB3Ou7KGPXXAJQwzRNBqvZ5ETfAFlhKGZpqvYXPJATQAIaemTkV3E+LA1aGoQhv0KML5LZhK3C8AJSO8AMCLviS+v4q/uOFn57pLXvq9dPQ=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:57:30.731560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-ae9d048e-ece5-415a-a5c5-fce3dea4c042 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Getting quotas for project 45405624633e404ab2d6ff26482a150e. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:57:30.741653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-ae9d048e-ece5-415a-a5c5-fce3dea4c042 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Getting quotas for user cdae8836f9784dff90fea5201fd15d1d and project 45405624633e404ab2d6ff26482a150e. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:57:30.792189 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ae9d048e-ece5-415a-a5c5-fce3dea4c042 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.095090 Oct 24 10:57:30.793430 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2981/5934] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:57:30 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:57:31.236189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-426cd958-5bc4-4f3b-abbd-5fc47f536a5a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:31.237440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-426cd958-5bc4-4f3b-abbd-5fc47f536a5a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:31.258259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-426cd958-5bc4-4f3b-abbd-5fc47f536a5a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:31.258755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-426cd958-5bc4-4f3b-abbd-5fc47f536a5a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:31.259217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-426cd958-5bc4-4f3b-abbd-5fc47f536a5a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:31.259938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-426cd958-5bc4-4f3b-abbd-5fc47f536a5a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:31.260485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-426cd958-5bc4-4f3b-abbd-5fc47f536a5a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:31.279441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-426cd958-5bc4-4f3b-abbd-5fc47f536a5a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:32.083955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-426cd958-5bc4-4f3b-abbd-5fc47f536a5a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:32.098905 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-426cd958-5bc4-4f3b-abbd-5fc47f536a5a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1527 microversion: 2.1 time: 0.866400 Oct 24 10:57:32.102433 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2954/5935] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:31 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1527 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:33.127748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4a226d7b-7034-4e54-ba32-94b85bd6eab9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:33.128433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4a226d7b-7034-4e54-ba32-94b85bd6eab9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:33.161991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a226d7b-7034-4e54-ba32-94b85bd6eab9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:33.162507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a226d7b-7034-4e54-ba32-94b85bd6eab9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:33.166535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a226d7b-7034-4e54-ba32-94b85bd6eab9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:33.167756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a226d7b-7034-4e54-ba32-94b85bd6eab9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:33.168257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a226d7b-7034-4e54-ba32-94b85bd6eab9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:33.168680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a226d7b-7034-4e54-ba32-94b85bd6eab9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:33.549652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4a226d7b-7034-4e54-ba32-94b85bd6eab9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:33.561220 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4a226d7b-7034-4e54-ba32-94b85bd6eab9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1527 microversion: 2.1 time: 0.436518 Oct 24 10:57:33.566095 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2982/5936] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:33 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1527 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:33.601357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cd83739b-2472-4e58-8ec2-508a9cbb420d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:33.602409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cd83739b-2472-4e58-8ec2-508a9cbb420d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:33.616776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd83739b-2472-4e58-8ec2-508a9cbb420d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:33.617518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd83739b-2472-4e58-8ec2-508a9cbb420d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:33.618948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd83739b-2472-4e58-8ec2-508a9cbb420d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:33.620742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd83739b-2472-4e58-8ec2-508a9cbb420d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:33.621428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd83739b-2472-4e58-8ec2-508a9cbb420d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:33.622029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cd83739b-2472-4e58-8ec2-508a9cbb420d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:33.667676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cd83739b-2472-4e58-8ec2-508a9cbb420d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:57:33.841525 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cd83739b-2472-4e58-8ec2-508a9cbb420d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8" status: 204 len: 0 microversion: 2.1 time: 0.244745 Oct 24 10:57:33.842265 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2955/5937] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:57:33 2022] DELETE /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:57:33.850899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e9f7c8b4-6bae-4cc3-8431-325a153a929c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:33.851823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e9f7c8b4-6bae-4cc3-8431-325a153a929c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:33.867194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9f7c8b4-6bae-4cc3-8431-325a153a929c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:33.867425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9f7c8b4-6bae-4cc3-8431-325a153a929c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:33.867825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9f7c8b4-6bae-4cc3-8431-325a153a929c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:33.871154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9f7c8b4-6bae-4cc3-8431-325a153a929c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:33.871813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9f7c8b4-6bae-4cc3-8431-325a153a929c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:33.872431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9f7c8b4-6bae-4cc3-8431-325a153a929c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:34.171093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e9f7c8b4-6bae-4cc3-8431-325a153a929c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:34.183919 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e9f7c8b4-6bae-4cc3-8431-325a153a929c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8" status: 200 len: 1551 microversion: 2.1 time: 0.337321 Oct 24 10:57:34.194434 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2983/5938] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:33 2022] GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8 => generated 1551 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:34.590961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c28b1952-3b5a-4713-8d80-6e444157a581 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:34.592238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c28b1952-3b5a-4713-8d80-6e444157a581 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:34.614254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c28b1952-3b5a-4713-8d80-6e444157a581 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:34.614910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c28b1952-3b5a-4713-8d80-6e444157a581 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:34.615501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c28b1952-3b5a-4713-8d80-6e444157a581 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:34.616276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c28b1952-3b5a-4713-8d80-6e444157a581 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:34.617477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c28b1952-3b5a-4713-8d80-6e444157a581 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:34.618317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c28b1952-3b5a-4713-8d80-6e444157a581 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:35.031143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c28b1952-3b5a-4713-8d80-6e444157a581 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:35.044735 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c28b1952-3b5a-4713-8d80-6e444157a581 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1527 microversion: 2.1 time: 0.458163 Oct 24 10:57:35.059484 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2956/5939] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:34 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1527 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:35.221907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c0db9ab6-d59f-48f8-8ee9-06b0aea41f05 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:35.222923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c0db9ab6-d59f-48f8-8ee9-06b0aea41f05 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:35.239727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0db9ab6-d59f-48f8-8ee9-06b0aea41f05 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:35.240243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0db9ab6-d59f-48f8-8ee9-06b0aea41f05 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:35.241855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0db9ab6-d59f-48f8-8ee9-06b0aea41f05 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:35.242612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0db9ab6-d59f-48f8-8ee9-06b0aea41f05 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:35.243080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0db9ab6-d59f-48f8-8ee9-06b0aea41f05 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:35.245850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0db9ab6-d59f-48f8-8ee9-06b0aea41f05 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:35.935373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c0db9ab6-d59f-48f8-8ee9-06b0aea41f05 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:35.945737 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c0db9ab6-d59f-48f8-8ee9-06b0aea41f05 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8" status: 200 len: 1551 microversion: 2.1 time: 0.731071 Oct 24 10:57:35.946496 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2984/5940] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:35 2022] GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8 => generated 1551 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:36.079175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-31412a75-fc02-47c7-9e7b-e4f4f4bc50d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:36.080085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-31412a75-fc02-47c7-9e7b-e4f4f4bc50d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:36.103998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31412a75-fc02-47c7-9e7b-e4f4f4bc50d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:36.106925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31412a75-fc02-47c7-9e7b-e4f4f4bc50d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:36.110482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31412a75-fc02-47c7-9e7b-e4f4f4bc50d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:36.113824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31412a75-fc02-47c7-9e7b-e4f4f4bc50d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:36.118326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31412a75-fc02-47c7-9e7b-e4f4f4bc50d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:36.119328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-31412a75-fc02-47c7-9e7b-e4f4f4bc50d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:36.222524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:57:36.602959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-31412a75-fc02-47c7-9e7b-e4f4f4bc50d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:36.612343 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-31412a75-fc02-47c7-9e7b-e4f4f4bc50d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1527 microversion: 2.1 time: 0.539151 Oct 24 10:57:36.614465 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2957/5941] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:36 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1527 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:36.973996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5e3766c7-a3a1-4301-811e-4b64a90850e9 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:36.974712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5e3766c7-a3a1-4301-811e-4b64a90850e9 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:36.992343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e3766c7-a3a1-4301-811e-4b64a90850e9 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:36.994216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e3766c7-a3a1-4301-811e-4b64a90850e9 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:36.994954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e3766c7-a3a1-4301-811e-4b64a90850e9 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:36.997029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e3766c7-a3a1-4301-811e-4b64a90850e9 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:37.000971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e3766c7-a3a1-4301-811e-4b64a90850e9 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:37.001609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e3766c7-a3a1-4301-811e-4b64a90850e9 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:37.192245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5e3766c7-a3a1-4301-811e-4b64a90850e9 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:37.204594 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5e3766c7-a3a1-4301-811e-4b64a90850e9 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8" status: 200 len: 1484 microversion: 2.1 time: 0.236784 Oct 24 10:57:37.205231 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2985/5942] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:36 2022] GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8 => generated 1484 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:37.426870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-0e517812-1f80-47f7-9bdb-3726a8d538a8 req-f17b37ae-46e4-4e45-a2a7-5faae3ac4d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3716c187-1470-41fb-8cc0-0f5b80706ec8", "name": "network-vif-deleted", "tag": "768ab8e1-3cea-490f-9398-f543fc548e84"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:57:37.459616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0e517812-1f80-47f7-9bdb-3726a8d538a8 req-f17b37ae-46e4-4e45-a2a7-5faae3ac4d9f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:37.460570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0e517812-1f80-47f7-9bdb-3726a8d538a8 req-f17b37ae-46e4-4e45-a2a7-5faae3ac4d9f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:37.461868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0e517812-1f80-47f7-9bdb-3726a8d538a8 req-f17b37ae-46e4-4e45-a2a7-5faae3ac4d9f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:37.497797 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-0e517812-1f80-47f7-9bdb-3726a8d538a8 req-f17b37ae-46e4-4e45-a2a7-5faae3ac4d9f service nova] Creating event network-vif-deleted:768ab8e1-3cea-490f-9398-f543fc548e84 for instance 3716c187-1470-41fb-8cc0-0f5b80706ec8 on n-h2-858383-15 Oct 24 10:57:37.522813 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-0e517812-1f80-47f7-9bdb-3726a8d538a8 req-f17b37ae-46e4-4e45-a2a7-5faae3ac4d9f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092635 Oct 24 10:57:37.525348 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2958/5943] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:57:37.638712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3305b64-a943-4f0b-961c-c9a7d0f3140f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:37.639422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f3305b64-a943-4f0b-961c-c9a7d0f3140f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:37.649184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3305b64-a943-4f0b-961c-c9a7d0f3140f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:37.656139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3305b64-a943-4f0b-961c-c9a7d0f3140f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:37.657199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3305b64-a943-4f0b-961c-c9a7d0f3140f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:37.658316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3305b64-a943-4f0b-961c-c9a7d0f3140f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:37.659146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3305b64-a943-4f0b-961c-c9a7d0f3140f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:37.660508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3305b64-a943-4f0b-961c-c9a7d0f3140f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:37.941127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3305b64-a943-4f0b-961c-c9a7d0f3140f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:37.966472 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f3305b64-a943-4f0b-961c-c9a7d0f3140f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1527 microversion: 2.1 time: 0.317194 Oct 24 10:57:37.975046 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2986/5944] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:37 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1527 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:38.246735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-08e95440-f462-4f34-8175-b571ca5f64d4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:38.247821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-08e95440-f462-4f34-8175-b571ca5f64d4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:38.278407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08e95440-f462-4f34-8175-b571ca5f64d4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:38.278801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08e95440-f462-4f34-8175-b571ca5f64d4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:38.287595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08e95440-f462-4f34-8175-b571ca5f64d4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:38.296269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08e95440-f462-4f34-8175-b571ca5f64d4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:38.298645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08e95440-f462-4f34-8175-b571ca5f64d4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:38.300212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08e95440-f462-4f34-8175-b571ca5f64d4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:38.494039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08e95440-f462-4f34-8175-b571ca5f64d4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:38.497654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08e95440-f462-4f34-8175-b571ca5f64d4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:38.500895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08e95440-f462-4f34-8175-b571ca5f64d4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:38.502928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-08e95440-f462-4f34-8175-b571ca5f64d4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lazy-loading 'fault' on Instance uuid 3716c187-1470-41fb-8cc0-0f5b80706ec8 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:57:38.667422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-08e95440-f462-4f34-8175-b571ca5f64d4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:38.685742 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-08e95440-f462-4f34-8175-b571ca5f64d4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8" status: 200 len: 1338 microversion: 2.1 time: 0.454260 Oct 24 10:57:38.688716 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2959/5945] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:38 2022] GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8 => generated 1338 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:39.006194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-84467d7f-e493-4954-9002-4441a1702ac5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:39.007887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-84467d7f-e493-4954-9002-4441a1702ac5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:39.016007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84467d7f-e493-4954-9002-4441a1702ac5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:39.016989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84467d7f-e493-4954-9002-4441a1702ac5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:39.017877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84467d7f-e493-4954-9002-4441a1702ac5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:39.018849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84467d7f-e493-4954-9002-4441a1702ac5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:39.019688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84467d7f-e493-4954-9002-4441a1702ac5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:39.020369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84467d7f-e493-4954-9002-4441a1702ac5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:39.276120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-84467d7f-e493-4954-9002-4441a1702ac5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:39.288508 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-84467d7f-e493-4954-9002-4441a1702ac5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1527 microversion: 2.1 time: 0.293633 Oct 24 10:57:39.290082 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2987/5946] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:38 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1527 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:39.716698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bde45e89-9e39-4951-8880-e019231c5b7b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:39.718282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bde45e89-9e39-4951-8880-e019231c5b7b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 3716c187-1470-41fb-8cc0-0f5b80706ec8] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:39.751875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bde45e89-9e39-4951-8880-e019231c5b7b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:39.753281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bde45e89-9e39-4951-8880-e019231c5b7b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:39.757374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bde45e89-9e39-4951-8880-e019231c5b7b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:39.758373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bde45e89-9e39-4951-8880-e019231c5b7b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:39.761710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bde45e89-9e39-4951-8880-e019231c5b7b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:39.762357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bde45e89-9e39-4951-8880-e019231c5b7b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:39.814398 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-bde45e89-9e39-4951-8880-e019231c5b7b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] HTTP exception thrown: Instance 3716c187-1470-41fb-8cc0-0f5b80706ec8 could not be found. Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bde45e89-9e39-4951-8880-e019231c5b7b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Request method failure captured: Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8 HTTP/1.1 Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm7pKn4HG9VNnqi8U3r4YXHcIv--zEJiWTA8urPQBnKI2B9TVmXt3UC-rxPzSEDNcwxw_L8eLXbXr7KgdMXLP78Buew1siRpbCzls7gr6ExQYdLFGRxyBbFQxSgmGd5a-KRSBepVwbI3XDHTci7ri4poXQt_Q8VaUNHDUG8teazsQGI Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: bebb2c9f56284e0799a51ae7b5744aeb Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestNetworkBasicOps-1994842966 Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bebb2c9f56284e0799a51ae7b5744aeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bebb2c9f56284e0799a51ae7b5744aeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bebb2c9f56284e0799a51ae7b5744aeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bebb2c9f56284e0799a51ae7b5744aeb", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestNetworkBasicOps-1994842966 Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: bebb2c9f56284e0799a51ae7b5744aeb Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestNetworkBasicOps-1994842966 Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestNetworkBasicOps-1994842966-project Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 793d2a1323db49f0b92e36bf0a1b7f78 Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestNetworkBasicOps-1994842966-project Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 3716c187-1470-41fb-8cc0-0f5b80706ec8 could not be found. Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '3716c187-1470-41fb-8cc0-0f5b80706ec8'} Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3716c187-1470-41fb-8cc0-0f5b80706ec8 could not be found. Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3716c187-1470-41fb-8cc0-0f5b80706ec8 could not be found. Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:57:39.819787 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:57:39.824382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:57:39.824382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:57:39.824382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:57:39.824382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:57:39.824382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:57:39.824382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3716c187-1470-41fb-8cc0-0f5b80706ec8 could not be found. Oct 24 10:57:39.824382 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:57:39.824382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bde45e89-9e39-4951-8880-e019231c5b7b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Returning 404 to user: Instance 3716c187-1470-41fb-8cc0-0f5b80706ec8 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:57:39.824382 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bde45e89-9e39-4951-8880-e019231c5b7b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8" status: 404 len: 111 microversion: 2.1 time: 0.112427 Oct 24 10:57:39.826223 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2960/5947] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:39 2022] GET /compute/v2.1/servers/3716c187-1470-41fb-8cc0-0f5b80706ec8 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:57:40.285659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4ae9ed4a-c2cc-4492-8cfb-ede163656684 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '.version_select at 0x7f04cb7c7040>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:40.315719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-54517bf7-43ae-4ac8-b8ee-9fb8c7d8b335 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:40.316496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-54517bf7-43ae-4ac8-b8ee-9fb8c7d8b335 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:40.346521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54517bf7-43ae-4ac8-b8ee-9fb8c7d8b335 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:40.348359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54517bf7-43ae-4ac8-b8ee-9fb8c7d8b335 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:40.349617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54517bf7-43ae-4ac8-b8ee-9fb8c7d8b335 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:40.352692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54517bf7-43ae-4ac8-b8ee-9fb8c7d8b335 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:40.363364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54517bf7-43ae-4ac8-b8ee-9fb8c7d8b335 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:40.367270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54517bf7-43ae-4ac8-b8ee-9fb8c7d8b335 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:40.375350 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4ae9ed4a-c2cc-4492-8cfb-ede163656684 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1464023613" status: 202 len: 0 microversion: 2.1 time: 0.094408 Oct 24 10:57:40.376420 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2988/5948] 10.222.0.50 () {58 vars in 1257 bytes} [Mon Oct 24 10:57:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1464023613 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:57:40.703355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-54517bf7-43ae-4ac8-b8ee-9fb8c7d8b335 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:40.712606 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-54517bf7-43ae-4ac8-b8ee-9fb8c7d8b335 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1527 microversion: 2.1 time: 0.402152 Oct 24 10:57:40.721621 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2961/5949] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:40 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1527 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:41.744942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:57:41.754042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7541a2a7-1c51-4966-9bd0-97c0147dbeaf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:41.755448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7541a2a7-1c51-4966-9bd0-97c0147dbeaf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:41.793398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7541a2a7-1c51-4966-9bd0-97c0147dbeaf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:41.799576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7541a2a7-1c51-4966-9bd0-97c0147dbeaf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:41.800275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7541a2a7-1c51-4966-9bd0-97c0147dbeaf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:41.803499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7541a2a7-1c51-4966-9bd0-97c0147dbeaf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:41.806407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7541a2a7-1c51-4966-9bd0-97c0147dbeaf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:41.807025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7541a2a7-1c51-4966-9bd0-97c0147dbeaf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:42.482894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7541a2a7-1c51-4966-9bd0-97c0147dbeaf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:42.499514 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7541a2a7-1c51-4966-9bd0-97c0147dbeaf tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1527 microversion: 2.1 time: 0.752931 Oct 24 10:57:42.506830 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2989/5950] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:41 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1527 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:43.528676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a47c820f-f157-4e1e-b54d-992be16aed1a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:43.529710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a47c820f-f157-4e1e-b54d-992be16aed1a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:43.545318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a47c820f-f157-4e1e-b54d-992be16aed1a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:43.545807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a47c820f-f157-4e1e-b54d-992be16aed1a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:43.554671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a47c820f-f157-4e1e-b54d-992be16aed1a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:43.559347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a47c820f-f157-4e1e-b54d-992be16aed1a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:43.563441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a47c820f-f157-4e1e-b54d-992be16aed1a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:43.565599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a47c820f-f157-4e1e-b54d-992be16aed1a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:45.293743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a47c820f-f157-4e1e-b54d-992be16aed1a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:45.309489 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a47c820f-f157-4e1e-b54d-992be16aed1a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1527 microversion: 2.1 time: 1.782517 Oct 24 10:57:45.313457 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2962/5951] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:43 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1527 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:46.335809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6995271c-8213-470f-9b18-e3e55a40c613 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:46.337202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6995271c-8213-470f-9b18-e3e55a40c613 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:46.350802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:57:46.360109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6995271c-8213-470f-9b18-e3e55a40c613 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:46.360884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6995271c-8213-470f-9b18-e3e55a40c613 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:46.361484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6995271c-8213-470f-9b18-e3e55a40c613 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:46.363025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6995271c-8213-470f-9b18-e3e55a40c613 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:46.363818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6995271c-8213-470f-9b18-e3e55a40c613 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:46.366981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6995271c-8213-470f-9b18-e3e55a40c613 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:46.437235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=93 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:57:46.484137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-761e639b-72c5-46fc-bfae-401274f15050 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:46.485241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-761e639b-72c5-46fc-bfae-401274f15050 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:46.508678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-761e639b-72c5-46fc-bfae-401274f15050 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:46.509217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-761e639b-72c5-46fc-bfae-401274f15050 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:46.509672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-761e639b-72c5-46fc-bfae-401274f15050 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:46.520542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-761e639b-72c5-46fc-bfae-401274f15050 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:46.525582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-761e639b-72c5-46fc-bfae-401274f15050 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:46.526114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-761e639b-72c5-46fc-bfae-401274f15050 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:46.665777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-761e639b-72c5-46fc-bfae-401274f15050 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:57:46.824114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6995271c-8213-470f-9b18-e3e55a40c613 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:46.838843 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6995271c-8213-470f-9b18-e3e55a40c613 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1509 microversion: 2.1 time: 0.506111 Oct 24 10:57:46.840035 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2990/5952] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:46 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1509 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:46.855234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-8ffeec70-2006-4d42-a679-161ab109d97e req-0f6895ed-d9e0-43e8-9cd5-41879bfa1bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b597a084-c2a0-44e6-b435-ae8d2b13ed98", "tag": "1df17286-8d5f-4346-9991-3ac4c2ed0949"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:57:46.911103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8ffeec70-2006-4d42-a679-161ab109d97e req-0f6895ed-d9e0-43e8-9cd5-41879bfa1bc3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:46.912095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8ffeec70-2006-4d42-a679-161ab109d97e req-0f6895ed-d9e0-43e8-9cd5-41879bfa1bc3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:46.912771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8ffeec70-2006-4d42-a679-161ab109d97e req-0f6895ed-d9e0-43e8-9cd5-41879bfa1bc3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:46.943215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:57:46.944209 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-8ffeec70-2006-4d42-a679-161ab109d97e req-0f6895ed-d9e0-43e8-9cd5-41879bfa1bc3 service nova] Creating event network-changed:1df17286-8d5f-4346-9991-3ac4c2ed0949 for instance b597a084-c2a0-44e6-b435-ae8d2b13ed98 on n-h1-858383-15 Oct 24 10:57:46.959258 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-8ffeec70-2006-4d42-a679-161ab109d97e req-0f6895ed-d9e0-43e8-9cd5-41879bfa1bc3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112174 Oct 24 10:57:46.960290 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2991/5953] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:57:46.990680 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-761e639b-72c5-46fc-bfae-401274f15050 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 204 len: 0 microversion: 2.1 time: 0.510609 Oct 24 10:57:46.993182 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2963/5954] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:57:46 2022] DELETE /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:57:47.005248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ea250a78-6ac1-4c35-9425-37c0e38191c5 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:47.006138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ea250a78-6ac1-4c35-9425-37c0e38191c5 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:47.017704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea250a78-6ac1-4c35-9425-37c0e38191c5 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:47.024527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea250a78-6ac1-4c35-9425-37c0e38191c5 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:47.025373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea250a78-6ac1-4c35-9425-37c0e38191c5 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:47.026366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea250a78-6ac1-4c35-9425-37c0e38191c5 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:47.027189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea250a78-6ac1-4c35-9425-37c0e38191c5 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:47.027843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea250a78-6ac1-4c35-9425-37c0e38191c5 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:47.504677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ea250a78-6ac1-4c35-9425-37c0e38191c5 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:47.525021 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ea250a78-6ac1-4c35-9425-37c0e38191c5 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1669 microversion: 2.1 time: 0.525697 Oct 24 10:57:47.553481 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2992/5955] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:46 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1669 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:47.865868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-44e3e995-622b-463a-9ab2-10ad27b762f8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:47.866667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-44e3e995-622b-463a-9ab2-10ad27b762f8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:47.884599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44e3e995-622b-463a-9ab2-10ad27b762f8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:47.886676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44e3e995-622b-463a-9ab2-10ad27b762f8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:47.887753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44e3e995-622b-463a-9ab2-10ad27b762f8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:47.893140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44e3e995-622b-463a-9ab2-10ad27b762f8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:47.899187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44e3e995-622b-463a-9ab2-10ad27b762f8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:47.900689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44e3e995-622b-463a-9ab2-10ad27b762f8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:48.553879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-668aaf34-a5d7-48be-8fd0-9abef18c8cf4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:48.554510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-668aaf34-a5d7-48be-8fd0-9abef18c8cf4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:48.586619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-668aaf34-a5d7-48be-8fd0-9abef18c8cf4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:48.587268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-668aaf34-a5d7-48be-8fd0-9abef18c8cf4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:48.604651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-668aaf34-a5d7-48be-8fd0-9abef18c8cf4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:48.605847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-668aaf34-a5d7-48be-8fd0-9abef18c8cf4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:48.608185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-668aaf34-a5d7-48be-8fd0-9abef18c8cf4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:48.611722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-668aaf34-a5d7-48be-8fd0-9abef18c8cf4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:49.177410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-44e3e995-622b-463a-9ab2-10ad27b762f8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:49.193353 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-44e3e995-622b-463a-9ab2-10ad27b762f8 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1509 microversion: 2.1 time: 1.330484 Oct 24 10:57:49.194629 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2964/5956] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:47 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1509 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:49.330897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-668aaf34-a5d7-48be-8fd0-9abef18c8cf4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:49.348520 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-668aaf34-a5d7-48be-8fd0-9abef18c8cf4 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1669 microversion: 2.1 time: 0.796257 Oct 24 10:57:49.384211 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2993/5957] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:48 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1669 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:50.220290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43772e87-759f-4eec-bceb-c9dca215e9d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:50.221034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-43772e87-759f-4eec-bceb-c9dca215e9d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:50.231618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43772e87-759f-4eec-bceb-c9dca215e9d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:50.232127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43772e87-759f-4eec-bceb-c9dca215e9d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:50.232610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43772e87-759f-4eec-bceb-c9dca215e9d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:50.233413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43772e87-759f-4eec-bceb-c9dca215e9d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:50.233830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43772e87-759f-4eec-bceb-c9dca215e9d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:50.234264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43772e87-759f-4eec-bceb-c9dca215e9d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:50.335476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-f4ebd9d7-50c1-449b-888d-babb8e4b22fa req-cd7fb4ac-9262-469e-974e-585a7c65117c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00aedb62-1a0e-47f0-bf42-19c12e9c035b", "name": "network-vif-unplugged", "status": "completed", "tag": "6502e9a3-ede9-43b4-816f-557cd30886f2"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:57:50.362417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f4ebd9d7-50c1-449b-888d-babb8e4b22fa req-cd7fb4ac-9262-469e-974e-585a7c65117c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:50.362918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f4ebd9d7-50c1-449b-888d-babb8e4b22fa req-cd7fb4ac-9262-469e-974e-585a7c65117c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:50.363358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f4ebd9d7-50c1-449b-888d-babb8e4b22fa req-cd7fb4ac-9262-469e-974e-585a7c65117c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:50.387302 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f4ebd9d7-50c1-449b-888d-babb8e4b22fa req-cd7fb4ac-9262-469e-974e-585a7c65117c service nova] Creating event network-vif-unplugged:6502e9a3-ede9-43b4-816f-557cd30886f2 for instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b on n-h2-858383-15 Oct 24 10:57:50.402684 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-f4ebd9d7-50c1-449b-888d-babb8e4b22fa req-cd7fb4ac-9262-469e-974e-585a7c65117c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070706 Oct 24 10:57:50.403581 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2994/5958] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:57:50.408801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-15c8dd55-3193-49bd-b55b-5a84d68d40d1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:50.421247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-15c8dd55-3193-49bd-b55b-5a84d68d40d1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:50.427952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15c8dd55-3193-49bd-b55b-5a84d68d40d1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:50.441634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15c8dd55-3193-49bd-b55b-5a84d68d40d1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:50.442388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15c8dd55-3193-49bd-b55b-5a84d68d40d1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:50.443316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15c8dd55-3193-49bd-b55b-5a84d68d40d1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:50.443953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15c8dd55-3193-49bd-b55b-5a84d68d40d1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:50.444576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15c8dd55-3193-49bd-b55b-5a84d68d40d1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:50.803402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-43772e87-759f-4eec-bceb-c9dca215e9d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:50.834740 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-43772e87-759f-4eec-bceb-c9dca215e9d3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1509 microversion: 2.1 time: 0.615560 Oct 24 10:57:50.840035 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2965/5959] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:50 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1509 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:50.855393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-15c8dd55-3193-49bd-b55b-5a84d68d40d1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:50.865305 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-15c8dd55-3193-49bd-b55b-5a84d68d40d1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1669 microversion: 2.1 time: 0.460464 Oct 24 10:57:50.868532 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2995/5960] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:50 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1669 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:51.092396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-648ade84-adce-4b9b-9b87-81ad5401d0fb req-f5422c18-1bfd-4f69-981f-cb1eaf2cb43c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b597a084-c2a0-44e6-b435-ae8d2b13ed98", "name": "network-vif-deleted", "tag": "1df17286-8d5f-4346-9991-3ac4c2ed0949"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:57:51.132978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-648ade84-adce-4b9b-9b87-81ad5401d0fb req-f5422c18-1bfd-4f69-981f-cb1eaf2cb43c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:51.136129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-648ade84-adce-4b9b-9b87-81ad5401d0fb req-f5422c18-1bfd-4f69-981f-cb1eaf2cb43c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:51.142350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-648ade84-adce-4b9b-9b87-81ad5401d0fb req-f5422c18-1bfd-4f69-981f-cb1eaf2cb43c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:51.193671 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-648ade84-adce-4b9b-9b87-81ad5401d0fb req-f5422c18-1bfd-4f69-981f-cb1eaf2cb43c service nova] Creating event network-vif-deleted:1df17286-8d5f-4346-9991-3ac4c2ed0949 for instance b597a084-c2a0-44e6-b435-ae8d2b13ed98 on n-h1-858383-15 Oct 24 10:57:51.205975 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-648ade84-adce-4b9b-9b87-81ad5401d0fb req-f5422c18-1bfd-4f69-981f-cb1eaf2cb43c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131044 Oct 24 10:57:51.208811 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2966/5961] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:57:51.867895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-302d9943-ff68-4c49-a9b4-00d8365688cd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:51.869105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-302d9943-ff68-4c49-a9b4-00d8365688cd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:51.891267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-302d9943-ff68-4c49-a9b4-00d8365688cd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:51.892666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-302d9943-ff68-4c49-a9b4-00d8365688cd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:51.893973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-302d9943-ff68-4c49-a9b4-00d8365688cd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:51.895098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-302d9943-ff68-4c49-a9b4-00d8365688cd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:51.896495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1dc405a6-6dc5-4299-bb70-40fd2cc3738b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:51.897729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-302d9943-ff68-4c49-a9b4-00d8365688cd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:51.898570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1dc405a6-6dc5-4299-bb70-40fd2cc3738b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:51.900086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-302d9943-ff68-4c49-a9b4-00d8365688cd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:51.923264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dc405a6-6dc5-4299-bb70-40fd2cc3738b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:51.929407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dc405a6-6dc5-4299-bb70-40fd2cc3738b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:51.930197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dc405a6-6dc5-4299-bb70-40fd2cc3738b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:51.931211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dc405a6-6dc5-4299-bb70-40fd2cc3738b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:51.935147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dc405a6-6dc5-4299-bb70-40fd2cc3738b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:51.935874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dc405a6-6dc5-4299-bb70-40fd2cc3738b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:52.021879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dc405a6-6dc5-4299-bb70-40fd2cc3738b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:52.022759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dc405a6-6dc5-4299-bb70-40fd2cc3738b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:52.023539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1dc405a6-6dc5-4299-bb70-40fd2cc3738b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:52.024249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-1dc405a6-6dc5-4299-bb70-40fd2cc3738b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lazy-loading 'fault' on Instance uuid b597a084-c2a0-44e6-b435-ae8d2b13ed98 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:57:52.139335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1dc405a6-6dc5-4299-bb70-40fd2cc3738b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:52.154001 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1dc405a6-6dc5-4299-bb70-40fd2cc3738b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 200 len: 1338 microversion: 2.1 time: 0.259052 Oct 24 10:57:52.154964 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2967/5962] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:51 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 1338 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:57:52.359973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-302d9943-ff68-4c49-a9b4-00d8365688cd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:52.376490 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-302d9943-ff68-4c49-a9b4-00d8365688cd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1509 microversion: 2.1 time: 0.511705 Oct 24 10:57:52.381050 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2996/5963] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:51 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1509 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:52.916881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-621d99a6-185c-4762-93c9-008102ba5d8d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-835565602", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "fd5a62b9-a4fc-4d67-87ac-6a005c66d823"}], "key_name": "tempest-TestNetworkAdvancedServerOps-254497017", "security_groups": [{"name": "tempest-secgroup-smoke-2009018215"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:57:53.156048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-621d99a6-185c-4762-93c9-008102ba5d8d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] validate_networks() for [('fd5a62b9-a4fc-4d67-87ac-6a005c66d823', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:57:53.181209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2620a57a-fcc3-461b-90ab-b7127d17f9a2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:53.181879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2620a57a-fcc3-461b-90ab-b7127d17f9a2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: b597a084-c2a0-44e6-b435-ae8d2b13ed98] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:53.192503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2620a57a-fcc3-461b-90ab-b7127d17f9a2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:53.193049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2620a57a-fcc3-461b-90ab-b7127d17f9a2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:53.193608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2620a57a-fcc3-461b-90ab-b7127d17f9a2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:53.196155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2620a57a-fcc3-461b-90ab-b7127d17f9a2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:53.196945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2620a57a-fcc3-461b-90ab-b7127d17f9a2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:53.197800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2620a57a-fcc3-461b-90ab-b7127d17f9a2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:53.218436 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-2620a57a-fcc3-461b-90ab-b7127d17f9a2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] HTTP exception thrown: Instance b597a084-c2a0-44e6-b435-ae8d2b13ed98 could not be found. Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2620a57a-fcc3-461b-90ab-b7127d17f9a2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Request method failure captured: Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 HTTP/1.1 Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm7pKn4HG9VNnqi8U3r4YXHcIv--zEJiWTA8urPQBnKI2B9TVmXt3UC-rxPzSEDNcwxw_L8eLXbXr7KgdMXLP78Buew1siRpbCzls7gr6ExQYdLFGRxyBbFQxSgmGd5a-KRSBepVwbI3XDHTci7ri4poXQt_Q8VaUNHDUG8teazsQGI Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: bebb2c9f56284e0799a51ae7b5744aeb Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestNetworkBasicOps-1994842966 Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bebb2c9f56284e0799a51ae7b5744aeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bebb2c9f56284e0799a51ae7b5744aeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bebb2c9f56284e0799a51ae7b5744aeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bebb2c9f56284e0799a51ae7b5744aeb", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestNetworkBasicOps-1994842966 Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: bebb2c9f56284e0799a51ae7b5744aeb Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestNetworkBasicOps-1994842966 Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestNetworkBasicOps-1994842966-project Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 793d2a1323db49f0b92e36bf0a1b7f78 Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestNetworkBasicOps-1994842966-project Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance b597a084-c2a0-44e6-b435-ae8d2b13ed98 could not be found. Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'b597a084-c2a0-44e6-b435-ae8d2b13ed98'} Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b597a084-c2a0-44e6-b435-ae8d2b13ed98 could not be found. Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b597a084-c2a0-44e6-b435-ae8d2b13ed98 could not be found. Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:57:53.220499 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:57:53.225999 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:57:53.225999 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:57:53.225999 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:57:53.225999 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:57:53.225999 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:57:53.225999 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b597a084-c2a0-44e6-b435-ae8d2b13ed98 could not be found. Oct 24 10:57:53.225999 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:57:53.228192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2620a57a-fcc3-461b-90ab-b7127d17f9a2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Returning 404 to user: Instance b597a084-c2a0-44e6-b435-ae8d2b13ed98 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:57:53.229350 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2620a57a-fcc3-461b-90ab-b7127d17f9a2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98" status: 404 len: 111 microversion: 2.1 time: 0.053720 Oct 24 10:57:53.230886 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2997/5964] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:53 2022] GET /compute/v2.1/servers/b597a084-c2a0-44e6-b435-ae8d2b13ed98 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:57:53.404998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a41c397b-7801-47cc-9ea5-ea02f9280b3d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:53.405633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a41c397b-7801-47cc-9ea5-ea02f9280b3d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:53.419036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a41c397b-7801-47cc-9ea5-ea02f9280b3d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:53.420323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a41c397b-7801-47cc-9ea5-ea02f9280b3d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:53.421750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a41c397b-7801-47cc-9ea5-ea02f9280b3d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:53.422913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a41c397b-7801-47cc-9ea5-ea02f9280b3d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:53.424139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a41c397b-7801-47cc-9ea5-ea02f9280b3d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:53.426268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a41c397b-7801-47cc-9ea5-ea02f9280b3d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:53.782049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a41c397b-7801-47cc-9ea5-ea02f9280b3d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:53.796555 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a41c397b-7801-47cc-9ea5-ea02f9280b3d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1452 microversion: 2.1 time: 0.395598 Oct 24 10:57:53.797273 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2998/5965] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:53 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1452 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:57:53.806233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ae271ccc-77eb-4099-b237-a87fdfda43c6 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '.version_select at 0x7f04cba9bf70>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:53.837510 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ae271ccc-77eb-4099-b237-a87fdfda43c6 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1017799945" status: 202 len: 0 microversion: 2.1 time: 0.037683 Oct 24 10:57:53.843474 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 2999/5966] 10.222.0.50 () {58 vars in 1257 bytes} [Mon Oct 24 10:57:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1017799945 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:57:53.850255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dd07ba41-7cd4-4210-913b-b86ca196bcb0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:53.851579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dd07ba41-7cd4-4210-913b-b86ca196bcb0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:53.878436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd07ba41-7cd4-4210-913b-b86ca196bcb0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:53.878955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd07ba41-7cd4-4210-913b-b86ca196bcb0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:53.879412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd07ba41-7cd4-4210-913b-b86ca196bcb0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:53.880162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd07ba41-7cd4-4210-913b-b86ca196bcb0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:53.880625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd07ba41-7cd4-4210-913b-b86ca196bcb0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:53.881089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd07ba41-7cd4-4210-913b-b86ca196bcb0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:54.450385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dd07ba41-7cd4-4210-913b-b86ca196bcb0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:54.457529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-621d99a6-185c-4762-93c9-008102ba5d8d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:57:54.457956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-621d99a6-185c-4762-93c9-008102ba5d8d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:57:54.458434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-621d99a6-185c-4762-93c9-008102ba5d8d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:57:54.458856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-621d99a6-185c-4762-93c9-008102ba5d8d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:57:54.459891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-621d99a6-185c-4762-93c9-008102ba5d8d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:57:54.470499 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dd07ba41-7cd4-4210-913b-b86ca196bcb0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1452 microversion: 2.1 time: 0.625005 Oct 24 10:57:54.471089 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3000/5967] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:53 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1452 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:54.488973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-621d99a6-185c-4762-93c9-008102ba5d8d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:54.502387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-621d99a6-185c-4762-93c9-008102ba5d8d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:54.503105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-621d99a6-185c-4762-93c9-008102ba5d8d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:54.504153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-621d99a6-185c-4762-93c9-008102ba5d8d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:54.508421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-621d99a6-185c-4762-93c9-008102ba5d8d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:54.508904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-621d99a6-185c-4762-93c9-008102ba5d8d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:54.557107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-621d99a6-185c-4762-93c9-008102ba5d8d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Getting quotas for project 45405624633e404ab2d6ff26482a150e. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:57:54.588978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-621d99a6-185c-4762-93c9-008102ba5d8d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Getting quotas for user cdae8836f9784dff90fea5201fd15d1d and project 45405624633e404ab2d6ff26482a150e. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:57:54.641725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-761bf155-d0b3-4ef1-b834-abfbbb8b5b43 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:57:54.642278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-761bf155-d0b3-4ef1-b834-abfbbb8b5b43 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:54.646107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-621d99a6-185c-4762-93c9-008102ba5d8d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:57:54.652584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-761bf155-d0b3-4ef1-b834-abfbbb8b5b43 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:54.655094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-621d99a6-185c-4762-93c9-008102ba5d8d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:57:54.661290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-761bf155-d0b3-4ef1-b834-abfbbb8b5b43 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:54.662253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-761bf155-d0b3-4ef1-b834-abfbbb8b5b43 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:54.663199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-761bf155-d0b3-4ef1-b834-abfbbb8b5b43 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:54.663999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-761bf155-d0b3-4ef1-b834-abfbbb8b5b43 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:54.664592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-761bf155-d0b3-4ef1-b834-abfbbb8b5b43 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:54.718058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-761bf155-d0b3-4ef1-b834-abfbbb8b5b43 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lazy-loading 'flavor' on Instance uuid 00aedb62-1a0e-47f0-bf42-19c12e9c035b {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:57:54.751819 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-761bf155-d0b3-4ef1-b834-abfbbb8b5b43 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Cannot 'shelve' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state shelved_offloaded Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-761bf155-d0b3-4ef1-b834-abfbbb8b5b43 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action HTTP/1.1 Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 14 Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: {"shelve": {}} Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: exception: Cannot 'shelve' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state shelved_offloaded Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '00aedb62-1a0e-47f0-bf42-19c12e9c035b', 'body': {'shelve': {}}} Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 10:57:54.758280 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 10:57:54.764478 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 10:57:54.764478 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state shelved_offloaded Oct 24 10:57:54.764478 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:57:54.764478 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:57:54.764478 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:57:54.764478 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:57:54.764478 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:57:54.764478 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:57:54.764478 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:57:54.764478 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:57:54.764478 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state shelved_offloaded Oct 24 10:57:54.764478 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:57:54.769160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-761bf155-d0b3-4ef1-b834-abfbbb8b5b43 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 409 to user: Cannot 'shelve' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state shelved_offloaded {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:57:54.772520 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-761bf155-d0b3-4ef1-b834-abfbbb8b5b43 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action" status: 409 len: 155 microversion: 2.1 time: 0.134462 Oct 24 10:57:54.778977 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3001/5968] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:57:54 2022] POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action => generated 155 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:57:54.788405 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-621d99a6-185c-4762-93c9-008102ba5d8d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.875901 Oct 24 10:57:54.791788 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2968/5969] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:57:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 10:57:54.795726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ff3966b1-2238-47e6-b494-b50fc0b5b755 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:57:54.796599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ff3966b1-2238-47e6-b494-b50fc0b5b755 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:54.804825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a6aa4afe-0b30-4326-98ba-93471f840f0e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:54.805672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a6aa4afe-0b30-4326-98ba-93471f840f0e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:54.825705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff3966b1-2238-47e6-b494-b50fc0b5b755 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:54.827512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff3966b1-2238-47e6-b494-b50fc0b5b755 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:54.844164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff3966b1-2238-47e6-b494-b50fc0b5b755 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:54.847256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff3966b1-2238-47e6-b494-b50fc0b5b755 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:54.847762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff3966b1-2238-47e6-b494-b50fc0b5b755 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:54.848207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ff3966b1-2238-47e6-b494-b50fc0b5b755 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:54.933762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a6aa4afe-0b30-4326-98ba-93471f840f0e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:54.945624 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a6aa4afe-0b30-4326-98ba-93471f840f0e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1265 microversion: 2.1 time: 0.144201 Oct 24 10:57:54.946082 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2969/5970] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:54 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:57:54.992012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ff3966b1-2238-47e6-b494-b50fc0b5b755 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120426) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 24 10:57:55.230392 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ff3966b1-2238-47e6-b494-b50fc0b5b755 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action" status: 202 len: 0 microversion: 2.1 time: 0.448165 Oct 24 10:57:55.234212 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3002/5971] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:57:54 2022] POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:57:55.242251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-efef84cf-ffd4-4d54-897d-c53085f83bbc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:55.247462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-efef84cf-ffd4-4d54-897d-c53085f83bbc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:55.278618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efef84cf-ffd4-4d54-897d-c53085f83bbc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:55.294458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efef84cf-ffd4-4d54-897d-c53085f83bbc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:55.308594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efef84cf-ffd4-4d54-897d-c53085f83bbc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:55.311333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efef84cf-ffd4-4d54-897d-c53085f83bbc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:55.316762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efef84cf-ffd4-4d54-897d-c53085f83bbc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:55.320791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efef84cf-ffd4-4d54-897d-c53085f83bbc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:55.970884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8503ccca-513c-40aa-945d-0214c7353563 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:55.971515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8503ccca-513c-40aa-945d-0214c7353563 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:55.996583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8503ccca-513c-40aa-945d-0214c7353563 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:56.006322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8503ccca-513c-40aa-945d-0214c7353563 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:56.006984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8503ccca-513c-40aa-945d-0214c7353563 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:56.009531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8503ccca-513c-40aa-945d-0214c7353563 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:56.011300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8503ccca-513c-40aa-945d-0214c7353563 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:56.012592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8503ccca-513c-40aa-945d-0214c7353563 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:56.325874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8503ccca-513c-40aa-945d-0214c7353563 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:56.355950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-efef84cf-ffd4-4d54-897d-c53085f83bbc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:56.359510 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8503ccca-513c-40aa-945d-0214c7353563 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1261 microversion: 2.1 time: 0.394153 Oct 24 10:57:56.361964 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3003/5972] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:55 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1261 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:57:56.382366 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-efef84cf-ffd4-4d54-897d-c53085f83bbc tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1460 microversion: 2.1 time: 1.143877 Oct 24 10:57:56.384976 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2970/5973] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:55 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1460 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:57.386148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-44555586-d1fa-4ea3-8697-308288f71fd3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:57.387349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-44555586-d1fa-4ea3-8697-308288f71fd3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:57.400382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44555586-d1fa-4ea3-8697-308288f71fd3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:57.409411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44555586-d1fa-4ea3-8697-308288f71fd3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:57.412134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b162c2ff-6f05-4d3e-a564-91f7e1c5b716 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:57.412915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b162c2ff-6f05-4d3e-a564-91f7e1c5b716 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:57.413410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44555586-d1fa-4ea3-8697-308288f71fd3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:57.414688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44555586-d1fa-4ea3-8697-308288f71fd3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:57.416268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44555586-d1fa-4ea3-8697-308288f71fd3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:57.418032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44555586-d1fa-4ea3-8697-308288f71fd3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:57.426701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b162c2ff-6f05-4d3e-a564-91f7e1c5b716 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:57.427561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b162c2ff-6f05-4d3e-a564-91f7e1c5b716 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:57.428233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b162c2ff-6f05-4d3e-a564-91f7e1c5b716 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:57.429251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b162c2ff-6f05-4d3e-a564-91f7e1c5b716 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:57.430066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b162c2ff-6f05-4d3e-a564-91f7e1c5b716 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:57.431075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b162c2ff-6f05-4d3e-a564-91f7e1c5b716 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:57.712370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-44555586-d1fa-4ea3-8697-308288f71fd3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:57.732158 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-44555586-d1fa-4ea3-8697-308288f71fd3 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1323 microversion: 2.1 time: 0.345117 Oct 24 10:57:57.733465 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3004/5974] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:57 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1323 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:58.003030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b162c2ff-6f05-4d3e-a564-91f7e1c5b716 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:58.012493 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b162c2ff-6f05-4d3e-a564-91f7e1c5b716 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1460 microversion: 2.1 time: 0.604695 Oct 24 10:57:58.013145 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2971/5975] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:57 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1460 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:57:58.763482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e3c769cc-8173-4cb6-879a-2de9d155c62e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:58.765464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e3c769cc-8173-4cb6-879a-2de9d155c62e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:58.795001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3c769cc-8173-4cb6-879a-2de9d155c62e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:58.797592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3c769cc-8173-4cb6-879a-2de9d155c62e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:58.798356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3c769cc-8173-4cb6-879a-2de9d155c62e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:58.799304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3c769cc-8173-4cb6-879a-2de9d155c62e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:58.803497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3c769cc-8173-4cb6-879a-2de9d155c62e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:58.805435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3c769cc-8173-4cb6-879a-2de9d155c62e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:59.042476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eff74ba1-0108-464e-b006-15925a4b6bbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:57:59.043281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eff74ba1-0108-464e-b006-15925a4b6bbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:57:59.056030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eff74ba1-0108-464e-b006-15925a4b6bbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:59.056533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eff74ba1-0108-464e-b006-15925a4b6bbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:59.057095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eff74ba1-0108-464e-b006-15925a4b6bbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:59.057846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eff74ba1-0108-464e-b006-15925a4b6bbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:57:59.058317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eff74ba1-0108-464e-b006-15925a4b6bbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:57:59.058875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eff74ba1-0108-464e-b006-15925a4b6bbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:57:59.578904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e3c769cc-8173-4cb6-879a-2de9d155c62e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:59.600454 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e3c769cc-8173-4cb6-879a-2de9d155c62e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1391 microversion: 2.1 time: 0.843567 Oct 24 10:57:59.604012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eff74ba1-0108-464e-b006-15925a4b6bbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:57:59.612218 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3005/5976] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:58 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1391 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:57:59.618501 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eff74ba1-0108-464e-b006-15925a4b6bbb tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1518 microversion: 2.1 time: 0.579654 Oct 24 10:57:59.633175 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2972/5977] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:57:59 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1518 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:58:00.635963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d64b37f0-6732-4686-8889-165055cffa16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:00.636528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d64b37f0-6732-4686-8889-165055cffa16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:00.650207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4a308d2a-9e01-4b78-93b4-a31ad5e7e185 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:00.650696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d64b37f0-6732-4686-8889-165055cffa16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:00.651397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d64b37f0-6732-4686-8889-165055cffa16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:00.651923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4a308d2a-9e01-4b78-93b4-a31ad5e7e185 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:00.654860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d64b37f0-6732-4686-8889-165055cffa16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:00.655441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d64b37f0-6732-4686-8889-165055cffa16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:00.655917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d64b37f0-6732-4686-8889-165055cffa16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:00.661991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d64b37f0-6732-4686-8889-165055cffa16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:00.665740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a308d2a-9e01-4b78-93b4-a31ad5e7e185 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:00.673628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a308d2a-9e01-4b78-93b4-a31ad5e7e185 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:00.674256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a308d2a-9e01-4b78-93b4-a31ad5e7e185 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:00.675159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a308d2a-9e01-4b78-93b4-a31ad5e7e185 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:00.675781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a308d2a-9e01-4b78-93b4-a31ad5e7e185 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:00.676487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a308d2a-9e01-4b78-93b4-a31ad5e7e185 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:01.268075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d64b37f0-6732-4686-8889-165055cffa16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:01.279216 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d64b37f0-6732-4686-8889-165055cffa16 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1391 microversion: 2.1 time: 0.647470 Oct 24 10:58:01.280711 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3006/5978] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:00 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1391 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:01.281644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4a308d2a-9e01-4b78-93b4-a31ad5e7e185 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:01.294656 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4a308d2a-9e01-4b78-93b4-a31ad5e7e185 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1518 microversion: 2.1 time: 0.648258 Oct 24 10:58:01.297978 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2973/5979] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:00 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1518 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:58:02.097176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-21698063-88af-45af-bc34-95cf88912f96 req-1371787a-29eb-43e9-b794-c1e69c80046f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86941fe7-4e24-4be2-896a-65f088996bdd", "tag": "2f8b8cd3-65c1-4f5c-afdf-bd4e36a9ebef"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:02.125941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-21698063-88af-45af-bc34-95cf88912f96 req-1371787a-29eb-43e9-b794-c1e69c80046f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:02.128585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-21698063-88af-45af-bc34-95cf88912f96 req-1371787a-29eb-43e9-b794-c1e69c80046f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:02.130109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-21698063-88af-45af-bc34-95cf88912f96 req-1371787a-29eb-43e9-b794-c1e69c80046f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:02.156924 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-21698063-88af-45af-bc34-95cf88912f96 req-1371787a-29eb-43e9-b794-c1e69c80046f service nova] Creating event network-changed:2f8b8cd3-65c1-4f5c-afdf-bd4e36a9ebef for instance 86941fe7-4e24-4be2-896a-65f088996bdd on n-h1-858383-15 Oct 24 10:58:02.167052 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-21698063-88af-45af-bc34-95cf88912f96 req-1371787a-29eb-43e9-b794-c1e69c80046f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083061 Oct 24 10:58:02.168077 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3007/5980] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:58:02.322532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-56c98e5c-dcfe-4ae3-96bf-4b110cae8438 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:02.330455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-56c98e5c-dcfe-4ae3-96bf-4b110cae8438 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:02.330719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f9a43ecc-aec9-4c06-85a3-e4a00ad8b40a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:02.332051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f9a43ecc-aec9-4c06-85a3-e4a00ad8b40a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:02.349360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56c98e5c-dcfe-4ae3-96bf-4b110cae8438 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:02.354559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9a43ecc-aec9-4c06-85a3-e4a00ad8b40a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:02.357193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9a43ecc-aec9-4c06-85a3-e4a00ad8b40a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:02.358396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56c98e5c-dcfe-4ae3-96bf-4b110cae8438 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:02.360492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9a43ecc-aec9-4c06-85a3-e4a00ad8b40a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:02.362077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9a43ecc-aec9-4c06-85a3-e4a00ad8b40a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:02.362610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56c98e5c-dcfe-4ae3-96bf-4b110cae8438 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:02.363945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9a43ecc-aec9-4c06-85a3-e4a00ad8b40a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:02.364934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56c98e5c-dcfe-4ae3-96bf-4b110cae8438 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:02.367217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f9a43ecc-aec9-4c06-85a3-e4a00ad8b40a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:02.368351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56c98e5c-dcfe-4ae3-96bf-4b110cae8438 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:02.373989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56c98e5c-dcfe-4ae3-96bf-4b110cae8438 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:03.070829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f9a43ecc-aec9-4c06-85a3-e4a00ad8b40a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:03.094693 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f9a43ecc-aec9-4c06-85a3-e4a00ad8b40a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1518 microversion: 2.1 time: 0.770401 Oct 24 10:58:03.115138 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3008/5981] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:02 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1518 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:58:03.208554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-56c98e5c-dcfe-4ae3-96bf-4b110cae8438 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:03.219356 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-56c98e5c-dcfe-4ae3-96bf-4b110cae8438 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1391 microversion: 2.1 time: 0.900123 Oct 24 10:58:03.221137 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2974/5982] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:02 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1391 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:04.125875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cb91cf6c-a292-43ce-ad66-a2734f37c750 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:04.127046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cb91cf6c-a292-43ce-ad66-a2734f37c750 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:04.178206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb91cf6c-a292-43ce-ad66-a2734f37c750 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:04.186802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb91cf6c-a292-43ce-ad66-a2734f37c750 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:04.187297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb91cf6c-a292-43ce-ad66-a2734f37c750 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:04.188040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb91cf6c-a292-43ce-ad66-a2734f37c750 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:04.189480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb91cf6c-a292-43ce-ad66-a2734f37c750 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:04.190204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb91cf6c-a292-43ce-ad66-a2734f37c750 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:04.248250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2be1aa13-8130-4242-8886-d5099ffa3986 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:04.249176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2be1aa13-8130-4242-8886-d5099ffa3986 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:04.261212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:58:04.267272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2be1aa13-8130-4242-8886-d5099ffa3986 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:04.269538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2be1aa13-8130-4242-8886-d5099ffa3986 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:04.277741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2be1aa13-8130-4242-8886-d5099ffa3986 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:04.279982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2be1aa13-8130-4242-8886-d5099ffa3986 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:04.282206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2be1aa13-8130-4242-8886-d5099ffa3986 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:04.285575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2be1aa13-8130-4242-8886-d5099ffa3986 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:04.360882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:58:04.531712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:58:04.893505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cb91cf6c-a292-43ce-ad66-a2734f37c750 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:04.907060 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cb91cf6c-a292-43ce-ad66-a2734f37c750 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1518 microversion: 2.1 time: 0.787636 Oct 24 10:58:04.930999 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3009/5983] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:04 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1518 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:04.941427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:58:05.028967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2be1aa13-8130-4242-8886-d5099ffa3986 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:05.047271 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2be1aa13-8130-4242-8886-d5099ffa3986 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1391 microversion: 2.1 time: 0.803009 Oct 24 10:58:05.051618 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2975/5984] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:04 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1391 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:05.943389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f631d180-12d7-4a43-bd77-bfa694046f74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:05.944656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f631d180-12d7-4a43-bd77-bfa694046f74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:05.957477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f631d180-12d7-4a43-bd77-bfa694046f74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:05.960419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f631d180-12d7-4a43-bd77-bfa694046f74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:05.963032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f631d180-12d7-4a43-bd77-bfa694046f74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:05.965563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f631d180-12d7-4a43-bd77-bfa694046f74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:05.969269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f631d180-12d7-4a43-bd77-bfa694046f74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:05.970504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f631d180-12d7-4a43-bd77-bfa694046f74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:06.079914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-08611dcc-ba2c-4d8b-9c6e-98b3d699033e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:06.080587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-08611dcc-ba2c-4d8b-9c6e-98b3d699033e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:06.106393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08611dcc-ba2c-4d8b-9c6e-98b3d699033e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:06.109362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08611dcc-ba2c-4d8b-9c6e-98b3d699033e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:06.110122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08611dcc-ba2c-4d8b-9c6e-98b3d699033e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:06.111157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08611dcc-ba2c-4d8b-9c6e-98b3d699033e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:06.111837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08611dcc-ba2c-4d8b-9c6e-98b3d699033e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:06.113247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08611dcc-ba2c-4d8b-9c6e-98b3d699033e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:06.648730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-08611dcc-ba2c-4d8b-9c6e-98b3d699033e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:06.661032 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-08611dcc-ba2c-4d8b-9c6e-98b3d699033e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1391 microversion: 2.1 time: 0.588856 Oct 24 10:58:06.667535 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2976/5985] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:06 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1391 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:58:06.931670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f631d180-12d7-4a43-bd77-bfa694046f74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:06.950294 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f631d180-12d7-4a43-bd77-bfa694046f74 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1518 microversion: 2.1 time: 1.002326 Oct 24 10:58:06.953311 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3010/5986] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:05 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1518 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:07.694088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ee8b9ba9-aee5-4abd-807d-05e88449ac89 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:07.698119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ee8b9ba9-aee5-4abd-807d-05e88449ac89 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:07.727757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee8b9ba9-aee5-4abd-807d-05e88449ac89 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:07.728275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee8b9ba9-aee5-4abd-807d-05e88449ac89 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:07.728728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee8b9ba9-aee5-4abd-807d-05e88449ac89 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:07.737172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee8b9ba9-aee5-4abd-807d-05e88449ac89 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:07.737975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee8b9ba9-aee5-4abd-807d-05e88449ac89 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:07.738509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee8b9ba9-aee5-4abd-807d-05e88449ac89 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:07.978259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-842b34db-3295-44e8-a046-c6948b35cf6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:07.978883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-842b34db-3295-44e8-a046-c6948b35cf6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:08.006588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-842b34db-3295-44e8-a046-c6948b35cf6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:08.007983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-842b34db-3295-44e8-a046-c6948b35cf6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:08.010005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-842b34db-3295-44e8-a046-c6948b35cf6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:08.011077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-842b34db-3295-44e8-a046-c6948b35cf6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:08.013365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-842b34db-3295-44e8-a046-c6948b35cf6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:08.014879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-842b34db-3295-44e8-a046-c6948b35cf6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:08.358581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ee8b9ba9-aee5-4abd-807d-05e88449ac89 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:08.383849 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ee8b9ba9-aee5-4abd-807d-05e88449ac89 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1391 microversion: 2.1 time: 0.691603 Oct 24 10:58:08.389918 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2977/5987] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:07 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1391 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:08.615136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-842b34db-3295-44e8-a046-c6948b35cf6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:08.633169 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-842b34db-3295-44e8-a046-c6948b35cf6b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1518 microversion: 2.1 time: 0.653648 Oct 24 10:58:08.634447 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3011/5988] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:07 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1518 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:09.421992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-549ef36c-d35f-4989-a3b6-07f9db9a7d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:09.422695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-549ef36c-d35f-4989-a3b6-07f9db9a7d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:09.465021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-549ef36c-d35f-4989-a3b6-07f9db9a7d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:09.465021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-549ef36c-d35f-4989-a3b6-07f9db9a7d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:09.468104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-549ef36c-d35f-4989-a3b6-07f9db9a7d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:09.468961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-549ef36c-d35f-4989-a3b6-07f9db9a7d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:09.469456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-549ef36c-d35f-4989-a3b6-07f9db9a7d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:09.469888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-549ef36c-d35f-4989-a3b6-07f9db9a7d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:09.661140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bf128c94-d23d-413b-b266-f2fe7d5a2a6c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:09.663494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bf128c94-d23d-413b-b266-f2fe7d5a2a6c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:09.688959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf128c94-d23d-413b-b266-f2fe7d5a2a6c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:09.699005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf128c94-d23d-413b-b266-f2fe7d5a2a6c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:09.700086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf128c94-d23d-413b-b266-f2fe7d5a2a6c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:09.701550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf128c94-d23d-413b-b266-f2fe7d5a2a6c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:09.702854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf128c94-d23d-413b-b266-f2fe7d5a2a6c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:09.703910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf128c94-d23d-413b-b266-f2fe7d5a2a6c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:10.118175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-549ef36c-d35f-4989-a3b6-07f9db9a7d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:10.145349 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-549ef36c-d35f-4989-a3b6-07f9db9a7d8e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1391 microversion: 2.1 time: 0.730121 Oct 24 10:58:10.146640 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2978/5989] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:09 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1391 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:10.689386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-de951275-995e-4f0b-b197-d941795c2b9f req-e05f9a6a-a48c-4649-9fb3-521a1db6d228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86941fe7-4e24-4be2-896a-65f088996bdd", "name": "network-vif-plugged", "status": "completed", "tag": "2f8b8cd3-65c1-4f5c-afdf-bd4e36a9ebef"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:10.708704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-de951275-995e-4f0b-b197-d941795c2b9f req-e05f9a6a-a48c-4649-9fb3-521a1db6d228 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:10.714754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-de951275-995e-4f0b-b197-d941795c2b9f req-e05f9a6a-a48c-4649-9fb3-521a1db6d228 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:10.715212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-de951275-995e-4f0b-b197-d941795c2b9f req-e05f9a6a-a48c-4649-9fb3-521a1db6d228 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:10.745693 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-de951275-995e-4f0b-b197-d941795c2b9f req-e05f9a6a-a48c-4649-9fb3-521a1db6d228 service nova] Creating event network-vif-plugged:2f8b8cd3-65c1-4f5c-afdf-bd4e36a9ebef for instance 86941fe7-4e24-4be2-896a-65f088996bdd on n-h1-858383-15 Oct 24 10:58:10.760239 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-de951275-995e-4f0b-b197-d941795c2b9f req-e05f9a6a-a48c-4649-9fb3-521a1db6d228 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075119 Oct 24 10:58:10.760897 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2979/5990] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:58:10.999433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bf128c94-d23d-413b-b266-f2fe7d5a2a6c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:11.022513 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bf128c94-d23d-413b-b266-f2fe7d5a2a6c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1518 microversion: 2.1 time: 1.357041 Oct 24 10:58:11.023186 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3012/5991] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:09 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1518 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:58:11.180541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-407d5b06-6a14-46fe-9eff-f3bac161232e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:11.182388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-407d5b06-6a14-46fe-9eff-f3bac161232e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:11.195232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-407d5b06-6a14-46fe-9eff-f3bac161232e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:11.197887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-407d5b06-6a14-46fe-9eff-f3bac161232e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:11.199964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-407d5b06-6a14-46fe-9eff-f3bac161232e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:11.200998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-407d5b06-6a14-46fe-9eff-f3bac161232e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:11.202039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-407d5b06-6a14-46fe-9eff-f3bac161232e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:11.205003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-407d5b06-6a14-46fe-9eff-f3bac161232e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:11.883437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-407d5b06-6a14-46fe-9eff-f3bac161232e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:11.903011 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-407d5b06-6a14-46fe-9eff-f3bac161232e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1391 microversion: 2.1 time: 0.730149 Oct 24 10:58:11.908314 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2980/5992] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:11 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1391 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:12.056358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-05480a46-1d66-4bd9-90d2-46521d3c7826 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:12.058078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-05480a46-1d66-4bd9-90d2-46521d3c7826 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:12.068949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05480a46-1d66-4bd9-90d2-46521d3c7826 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:12.073284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05480a46-1d66-4bd9-90d2-46521d3c7826 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:12.074745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05480a46-1d66-4bd9-90d2-46521d3c7826 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:12.077410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05480a46-1d66-4bd9-90d2-46521d3c7826 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:12.081107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05480a46-1d66-4bd9-90d2-46521d3c7826 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:12.082982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05480a46-1d66-4bd9-90d2-46521d3c7826 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:12.494909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-05480a46-1d66-4bd9-90d2-46521d3c7826 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:12.503771 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-05480a46-1d66-4bd9-90d2-46521d3c7826 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1518 microversion: 2.1 time: 0.451696 Oct 24 10:58:12.504360 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3013/5993] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:12 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1518 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:58:12.944818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-35e22d3d-9be6-4de6-96aa-85dd9c582fa2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:12.944818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-35e22d3d-9be6-4de6-96aa-85dd9c582fa2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:12.946083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35e22d3d-9be6-4de6-96aa-85dd9c582fa2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:12.965265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35e22d3d-9be6-4de6-96aa-85dd9c582fa2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:12.969553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35e22d3d-9be6-4de6-96aa-85dd9c582fa2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:12.972549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35e22d3d-9be6-4de6-96aa-85dd9c582fa2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:12.978500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35e22d3d-9be6-4de6-96aa-85dd9c582fa2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:12.992932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35e22d3d-9be6-4de6-96aa-85dd9c582fa2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:13.534028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-41d74049-98ec-4c8a-8206-55f885290339 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:13.535423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-41d74049-98ec-4c8a-8206-55f885290339 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:13.551331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41d74049-98ec-4c8a-8206-55f885290339 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:13.551832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41d74049-98ec-4c8a-8206-55f885290339 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:13.552354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41d74049-98ec-4c8a-8206-55f885290339 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:13.553165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41d74049-98ec-4c8a-8206-55f885290339 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:13.553738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41d74049-98ec-4c8a-8206-55f885290339 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:13.554144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41d74049-98ec-4c8a-8206-55f885290339 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:13.558489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-35e22d3d-9be6-4de6-96aa-85dd9c582fa2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:13.573964 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-35e22d3d-9be6-4de6-96aa-85dd9c582fa2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1564 microversion: 2.1 time: 0.646627 Oct 24 10:58:13.574883 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2981/5994] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:12 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1564 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:13.606227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8f5324dd-7293-46ca-b364-baf3e1f7a49c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:13.606856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8f5324dd-7293-46ca-b364-baf3e1f7a49c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:13.621729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f5324dd-7293-46ca-b364-baf3e1f7a49c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:13.624685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f5324dd-7293-46ca-b364-baf3e1f7a49c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:13.631294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f5324dd-7293-46ca-b364-baf3e1f7a49c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:13.632668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f5324dd-7293-46ca-b364-baf3e1f7a49c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:13.633336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f5324dd-7293-46ca-b364-baf3e1f7a49c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:13.633942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f5324dd-7293-46ca-b364-baf3e1f7a49c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:14.170495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8f5324dd-7293-46ca-b364-baf3e1f7a49c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:14.183066 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8f5324dd-7293-46ca-b364-baf3e1f7a49c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1564 microversion: 2.1 time: 0.580725 Oct 24 10:58:14.188855 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2982/5995] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:13 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1564 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:58:14.261007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-41d74049-98ec-4c8a-8206-55f885290339 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:14.275548 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-41d74049-98ec-4c8a-8206-55f885290339 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1518 microversion: 2.1 time: 0.746314 Oct 24 10:58:14.285245 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3014/5996] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:13 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1518 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:15.313599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c1870ae2-4745-4c49-8d7b-264fa4aeef7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:15.314228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c1870ae2-4745-4c49-8d7b-264fa4aeef7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:15.337601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1870ae2-4745-4c49-8d7b-264fa4aeef7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:15.338440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1870ae2-4745-4c49-8d7b-264fa4aeef7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:15.345268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1870ae2-4745-4c49-8d7b-264fa4aeef7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:15.346004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1870ae2-4745-4c49-8d7b-264fa4aeef7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:15.348963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1870ae2-4745-4c49-8d7b-264fa4aeef7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:15.350036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1870ae2-4745-4c49-8d7b-264fa4aeef7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:16.329934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c1870ae2-4745-4c49-8d7b-264fa4aeef7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:16.345512 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c1870ae2-4745-4c49-8d7b-264fa4aeef7b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1518 microversion: 2.1 time: 1.030015 Oct 24 10:58:16.347411 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2983/5997] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:15 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1518 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:17.372643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4c2a709c-4e64-499d-ae24-70cdb5c55025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:17.374709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4c2a709c-4e64-499d-ae24-70cdb5c55025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:17.382298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:58:17.398987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c2a709c-4e64-499d-ae24-70cdb5c55025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:17.399496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c2a709c-4e64-499d-ae24-70cdb5c55025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:17.399941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c2a709c-4e64-499d-ae24-70cdb5c55025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:17.400667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c2a709c-4e64-499d-ae24-70cdb5c55025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:17.401152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c2a709c-4e64-499d-ae24-70cdb5c55025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:17.401590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c2a709c-4e64-499d-ae24-70cdb5c55025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:19.174793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4c2a709c-4e64-499d-ae24-70cdb5c55025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:19.213532 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4c2a709c-4e64-499d-ae24-70cdb5c55025 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1518 microversion: 2.1 time: 1.844492 Oct 24 10:58:19.214169 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3015/5998] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:17 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1518 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:19.966679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dcd92e20-5692-496d-bebd-a8aa556b4726 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Action: 'create', calling method: .version_select at 0x7f04d02ca8b0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1183691877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPX9/VZTP/4MeEveG6qysVvKojvl3v0hjW6dYlho7IShtGHEXDUu3bpESF+9j0O/9zvjQjPOQP5tOjIHyQS5+h315hEd6VBEgvpUiB9DvKqX0CH0R148kFWzuJhS3DpNg=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:19.987123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:58:20.011154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-dcd92e20-5692-496d-bebd-a8aa556b4726 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Getting quotas for project bebb2c9f56284e0799a51ae7b5744aeb. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:58:20.066488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-dcd92e20-5692-496d-bebd-a8aa556b4726 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Getting quotas for user 793d2a1323db49f0b92e36bf0a1b7f78 and project bebb2c9f56284e0799a51ae7b5744aeb. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:58:20.145256 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dcd92e20-5692-496d-bebd-a8aa556b4726 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.182846 Oct 24 10:58:20.146172 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2984/5999] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:58:19 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:58:20.252518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-50df1177-25e2-4878-a9fb-950d83546c76 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:20.253164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-50df1177-25e2-4878-a9fb-950d83546c76 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:20.272578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50df1177-25e2-4878-a9fb-950d83546c76 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:20.274575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50df1177-25e2-4878-a9fb-950d83546c76 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:20.275234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50df1177-25e2-4878-a9fb-950d83546c76 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:20.277115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50df1177-25e2-4878-a9fb-950d83546c76 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:20.277972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50df1177-25e2-4878-a9fb-950d83546c76 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:20.280282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50df1177-25e2-4878-a9fb-950d83546c76 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:20.804487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-50df1177-25e2-4878-a9fb-950d83546c76 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:20.822924 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-50df1177-25e2-4878-a9fb-950d83546c76 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1518 microversion: 2.1 time: 0.572474 Oct 24 10:58:20.839542 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3016/6000] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:20 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1518 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:21.858078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f40dd3de-5396-4847-a7a7-343ebfbfbe71 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:21.859048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f40dd3de-5396-4847-a7a7-343ebfbfbe71 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:21.877408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f40dd3de-5396-4847-a7a7-343ebfbfbe71 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:21.877914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f40dd3de-5396-4847-a7a7-343ebfbfbe71 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:21.878357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f40dd3de-5396-4847-a7a7-343ebfbfbe71 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:21.879077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f40dd3de-5396-4847-a7a7-343ebfbfbe71 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:21.879536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f40dd3de-5396-4847-a7a7-343ebfbfbe71 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:21.879971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f40dd3de-5396-4847-a7a7-343ebfbfbe71 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:22.223586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d4e61d0a-760e-4925-b17e-f974fc44126e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:22.224463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d4e61d0a-760e-4925-b17e-f974fc44126e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:22.239728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4e61d0a-760e-4925-b17e-f974fc44126e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:22.240394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4e61d0a-760e-4925-b17e-f974fc44126e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:22.242159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4e61d0a-760e-4925-b17e-f974fc44126e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:22.242550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f40dd3de-5396-4847-a7a7-343ebfbfbe71 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:22.244006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4e61d0a-760e-4925-b17e-f974fc44126e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:22.244554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4e61d0a-760e-4925-b17e-f974fc44126e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:22.246587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4e61d0a-760e-4925-b17e-f974fc44126e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:22.253919 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f40dd3de-5396-4847-a7a7-343ebfbfbe71 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1518 microversion: 2.1 time: 0.404994 Oct 24 10:58:22.254437 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2985/6001] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:21 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1518 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:22.270474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-72b1cdc7-f2ba-4c4a-b6a1-48178e725713 req-0bba735d-a1b5-4bf5-a12b-21bae4f85927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86941fe7-4e24-4be2-896a-65f088996bdd", "tag": "2f8b8cd3-65c1-4f5c-afdf-bd4e36a9ebef"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:22.303103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-72b1cdc7-f2ba-4c4a-b6a1-48178e725713 req-0bba735d-a1b5-4bf5-a12b-21bae4f85927 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:22.308428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-72b1cdc7-f2ba-4c4a-b6a1-48178e725713 req-0bba735d-a1b5-4bf5-a12b-21bae4f85927 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:22.311861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-72b1cdc7-f2ba-4c4a-b6a1-48178e725713 req-0bba735d-a1b5-4bf5-a12b-21bae4f85927 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:22.366366 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-72b1cdc7-f2ba-4c4a-b6a1-48178e725713 req-0bba735d-a1b5-4bf5-a12b-21bae4f85927 service nova] Creating event network-changed:2f8b8cd3-65c1-4f5c-afdf-bd4e36a9ebef for instance 86941fe7-4e24-4be2-896a-65f088996bdd on n-h1-858383-15 Oct 24 10:58:22.390870 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-72b1cdc7-f2ba-4c4a-b6a1-48178e725713 req-0bba735d-a1b5-4bf5-a12b-21bae4f85927 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129985 Oct 24 10:58:22.391821 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2986/6002] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:58:22.464750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f25ac592-36dd-43a9-ad0f-9134574e6211 req-a01df059-5bb2-4ae0-aa70-310d819579e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00aedb62-1a0e-47f0-bf42-19c12e9c035b", "name": "network-vif-plugged", "status": "completed", "tag": "6502e9a3-ede9-43b4-816f-557cd30886f2"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:22.493308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f25ac592-36dd-43a9-ad0f-9134574e6211 req-a01df059-5bb2-4ae0-aa70-310d819579e8 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:22.493796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f25ac592-36dd-43a9-ad0f-9134574e6211 req-a01df059-5bb2-4ae0-aa70-310d819579e8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:22.494236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f25ac592-36dd-43a9-ad0f-9134574e6211 req-a01df059-5bb2-4ae0-aa70-310d819579e8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:22.541997 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f25ac592-36dd-43a9-ad0f-9134574e6211 req-a01df059-5bb2-4ae0-aa70-310d819579e8 service nova] Creating event network-vif-plugged:6502e9a3-ede9-43b4-816f-557cd30886f2 for instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b on n-h2-858383-15 Oct 24 10:58:22.554820 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f25ac592-36dd-43a9-ad0f-9134574e6211 req-a01df059-5bb2-4ae0-aa70-310d819579e8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094468 Oct 24 10:58:22.555713 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2987/6003] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 24 10:58:22.862734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d4e61d0a-760e-4925-b17e-f974fc44126e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:22.876971 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d4e61d0a-760e-4925-b17e-f974fc44126e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1564 microversion: 2.1 time: 0.658267 Oct 24 10:58:22.880309 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3017/6004] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:22 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1564 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:23.281948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-010986e2-c26f-4004-bd45-5dc78209d761 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:23.282835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-010986e2-c26f-4004-bd45-5dc78209d761 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:23.299989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-010986e2-c26f-4004-bd45-5dc78209d761 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:23.300491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-010986e2-c26f-4004-bd45-5dc78209d761 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:23.307552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-010986e2-c26f-4004-bd45-5dc78209d761 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:23.307552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-010986e2-c26f-4004-bd45-5dc78209d761 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:23.308129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-010986e2-c26f-4004-bd45-5dc78209d761 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:23.308649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-010986e2-c26f-4004-bd45-5dc78209d761 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:24.377650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-010986e2-c26f-4004-bd45-5dc78209d761 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:24.386742 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-010986e2-c26f-4004-bd45-5dc78209d761 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1518 microversion: 2.1 time: 1.110734 Oct 24 10:58:24.387344 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2988/6005] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:23 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1518 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:24.789400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1896d37d-3e8b-4ada-ab0d-4c82429dceee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-803306492", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "0bd5cdef-bb72-4ecc-9b25-18edfc8490d6"}], "key_name": "tempest-TestNetworkBasicOps-1183691877", "security_groups": [{"name": "tempest-secgroup-smoke-320169593"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:25.083731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-1896d37d-3e8b-4ada-ab0d-4c82429dceee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] validate_networks() for [('0bd5cdef-bb72-4ecc-9b25-18edfc8490d6', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:58:25.424779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f736c540-01e3-4032-88e3-ccc484e81d00 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:25.430098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f736c540-01e3-4032-88e3-ccc484e81d00 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:25.461508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f736c540-01e3-4032-88e3-ccc484e81d00 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:25.474436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f736c540-01e3-4032-88e3-ccc484e81d00 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:25.475543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f736c540-01e3-4032-88e3-ccc484e81d00 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:25.477248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f736c540-01e3-4032-88e3-ccc484e81d00 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:25.484754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f736c540-01e3-4032-88e3-ccc484e81d00 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:25.486244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f736c540-01e3-4032-88e3-ccc484e81d00 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:25.902862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f736c540-01e3-4032-88e3-ccc484e81d00 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:25.923360 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f736c540-01e3-4032-88e3-ccc484e81d00 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1518 microversion: 2.1 time: 0.510118 Oct 24 10:58:25.937614 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2989/6006] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:25 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1518 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:25.965048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1896d37d-3e8b-4ada-ab0d-4c82429dceee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:58:25.965567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1896d37d-3e8b-4ada-ab0d-4c82429dceee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:58:25.965965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1896d37d-3e8b-4ada-ab0d-4c82429dceee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:58:25.966543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1896d37d-3e8b-4ada-ab0d-4c82429dceee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:58:25.967511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1896d37d-3e8b-4ada-ab0d-4c82429dceee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:58:25.981406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1896d37d-3e8b-4ada-ab0d-4c82429dceee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:25.981887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1896d37d-3e8b-4ada-ab0d-4c82429dceee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:25.982579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1896d37d-3e8b-4ada-ab0d-4c82429dceee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:25.983474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1896d37d-3e8b-4ada-ab0d-4c82429dceee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:25.984099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1896d37d-3e8b-4ada-ab0d-4c82429dceee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:25.990742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1896d37d-3e8b-4ada-ab0d-4c82429dceee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:26.012157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-1896d37d-3e8b-4ada-ab0d-4c82429dceee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Getting quotas for project bebb2c9f56284e0799a51ae7b5744aeb. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:58:26.019985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-1896d37d-3e8b-4ada-ab0d-4c82429dceee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Getting quotas for user 793d2a1323db49f0b92e36bf0a1b7f78 and project bebb2c9f56284e0799a51ae7b5744aeb. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:58:26.045826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1896d37d-3e8b-4ada-ab0d-4c82429dceee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:58:26.050715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1896d37d-3e8b-4ada-ab0d-4c82429dceee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:58:26.109611 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1896d37d-3e8b-4ada-ab0d-4c82429dceee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.323421 Oct 24 10:58:26.110218 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3018/6007] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:58:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 10:58:26.122639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-18b9931c-e133-46dc-9deb-6dade9824d4f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:26.123351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-18b9931c-e133-46dc-9deb-6dade9824d4f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:26.272449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-18b9931c-e133-46dc-9deb-6dade9824d4f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:26.284499 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-18b9931c-e133-46dc-9deb-6dade9824d4f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6" status: 200 len: 1248 microversion: 2.1 time: 0.165386 Oct 24 10:58:26.285157 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2990/6008] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:26 2022] GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 => generated 1248 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:26.962072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2118c779-3a95-4dd7-8640-2b7985266841 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:26.962706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2118c779-3a95-4dd7-8640-2b7985266841 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:26.977720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2118c779-3a95-4dd7-8640-2b7985266841 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:26.980240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2118c779-3a95-4dd7-8640-2b7985266841 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:26.981049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2118c779-3a95-4dd7-8640-2b7985266841 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:26.981951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2118c779-3a95-4dd7-8640-2b7985266841 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:26.982982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2118c779-3a95-4dd7-8640-2b7985266841 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:26.983877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2118c779-3a95-4dd7-8640-2b7985266841 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:27.267493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2118c779-3a95-4dd7-8640-2b7985266841 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:27.276054 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2118c779-3a95-4dd7-8640-2b7985266841 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.327470 Oct 24 10:58:27.282411 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3019/6009] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:26 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:27.307029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-de9c94c8-401d-4952-ad86-bf4fd8a58599 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:27.308611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-de9c94c8-401d-4952-ad86-bf4fd8a58599 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:27.313236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-99ea32eb-5324-4810-ab7c-6c6a6549c776 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:27.316581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-99ea32eb-5324-4810-ab7c-6c6a6549c776 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:27.323852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de9c94c8-401d-4952-ad86-bf4fd8a58599 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:27.325075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de9c94c8-401d-4952-ad86-bf4fd8a58599 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:27.326394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de9c94c8-401d-4952-ad86-bf4fd8a58599 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:27.330886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de9c94c8-401d-4952-ad86-bf4fd8a58599 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:27.331039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99ea32eb-5324-4810-ab7c-6c6a6549c776 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:27.331546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99ea32eb-5324-4810-ab7c-6c6a6549c776 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:27.332811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99ea32eb-5324-4810-ab7c-6c6a6549c776 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:27.333410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de9c94c8-401d-4952-ad86-bf4fd8a58599 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:27.334599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99ea32eb-5324-4810-ab7c-6c6a6549c776 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:27.335384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de9c94c8-401d-4952-ad86-bf4fd8a58599 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:27.335909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99ea32eb-5324-4810-ab7c-6c6a6549c776 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:27.336541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99ea32eb-5324-4810-ab7c-6c6a6549c776 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:27.473245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-99ea32eb-5324-4810-ab7c-6c6a6549c776 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:27.482890 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-99ea32eb-5324-4810-ab7c-6c6a6549c776 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6" status: 200 len: 1300 microversion: 2.1 time: 0.178089 Oct 24 10:58:27.493255 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3020/6010] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:27 2022] GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 => generated 1300 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:27.631294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-de9c94c8-401d-4952-ad86-bf4fd8a58599 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:27.639905 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-de9c94c8-401d-4952-ad86-bf4fd8a58599 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.336984 Oct 24 10:58:27.644930 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2991/6011] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:27 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:27.673260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8c1ab0e6-dff3-4099-9249-427c6f60e015 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:27.673889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8c1ab0e6-dff3-4099-9249-427c6f60e015 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:27.686316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c1ab0e6-dff3-4099-9249-427c6f60e015 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:27.686990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c1ab0e6-dff3-4099-9249-427c6f60e015 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:27.687496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c1ab0e6-dff3-4099-9249-427c6f60e015 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:27.688150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c1ab0e6-dff3-4099-9249-427c6f60e015 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:27.688605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c1ab0e6-dff3-4099-9249-427c6f60e015 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:27.689061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c1ab0e6-dff3-4099-9249-427c6f60e015 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:28.088427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8c1ab0e6-dff3-4099-9249-427c6f60e015 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:28.101681 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8c1ab0e6-dff3-4099-9249-427c6f60e015 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.433903 Oct 24 10:58:28.103075 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3021/6012] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:27 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:28.127745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a3f78fe8-b0b7-47b6-a671-9bb136c843d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:28.138421 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-a3f78fe8-b0b7-47b6-a671-9bb136c843d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance d2cd2a4c-d3c9-46e0-81fb-438001c6b74a has no mapping to a cell. Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a3f78fe8-b0b7-47b6-a671-9bb136c843d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/d2cd2a4c-d3c9-46e0-81fb-438001c6b74a/action HTTP/1.1 Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 15 Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: {"os-stop": {}} Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance d2cd2a4c-d3c9-46e0-81fb-438001c6b74a has no mapping to a cell. Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'd2cd2a4c-d3c9-46e0-81fb-438001c6b74a', 'body': {'os-stop': {}}} Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance d2cd2a4c-d3c9-46e0-81fb-438001c6b74a has no mapping to a cell. Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:58:28.147285 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2cd2a4c-d3c9-46e0-81fb-438001c6b74a has no mapping to a cell. Oct 24 10:58:28.155905 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:28.155905 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:28.155905 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:28.155905 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:28.155905 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:28.155905 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:28.155905 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:58:28.155905 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:58:28.155905 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2cd2a4c-d3c9-46e0-81fb-438001c6b74a has no mapping to a cell. Oct 24 10:58:28.155905 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:28.155905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a3f78fe8-b0b7-47b6-a671-9bb136c843d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance d2cd2a4c-d3c9-46e0-81fb-438001c6b74a has no mapping to a cell. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:58:28.167704 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a3f78fe8-b0b7-47b6-a671-9bb136c843d0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/d2cd2a4c-d3c9-46e0-81fb-438001c6b74a/action" status: 404 len: 117 microversion: 2.1 time: 0.033353 Oct 24 10:58:28.177733 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2992/6013] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:58:28 2022] POST /compute/v2.1/servers/d2cd2a4c-d3c9-46e0-81fb-438001c6b74a/action => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:58:28.182992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-07757e14-efad-4d8e-aba7-565794a7be87 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:28.184547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-07757e14-efad-4d8e-aba7-565794a7be87 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:28.194356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07757e14-efad-4d8e-aba7-565794a7be87 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:28.195041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07757e14-efad-4d8e-aba7-565794a7be87 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:28.195620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07757e14-efad-4d8e-aba7-565794a7be87 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:28.197332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07757e14-efad-4d8e-aba7-565794a7be87 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:28.197884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07757e14-efad-4d8e-aba7-565794a7be87 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:28.198393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07757e14-efad-4d8e-aba7-565794a7be87 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:28.427250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-07757e14-efad-4d8e-aba7-565794a7be87 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:28.440314 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-07757e14-efad-4d8e-aba7-565794a7be87 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.265964 Oct 24 10:58:28.442883 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3022/6014] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:28 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:58:28.469035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2f538c5f-7caf-4076-89e6-64a823913629 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:28.469737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2f538c5f-7caf-4076-89e6-64a823913629 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:28.495340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f538c5f-7caf-4076-89e6-64a823913629 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:28.496944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f538c5f-7caf-4076-89e6-64a823913629 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:28.501460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f538c5f-7caf-4076-89e6-64a823913629 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:28.502483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f538c5f-7caf-4076-89e6-64a823913629 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:28.507614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f5917e1b-8a40-4da7-954a-d3c14e947d8b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:28.508585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f5917e1b-8a40-4da7-954a-d3c14e947d8b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:28.516511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f538c5f-7caf-4076-89e6-64a823913629 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:28.517212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f538c5f-7caf-4076-89e6-64a823913629 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:28.526525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f5917e1b-8a40-4da7-954a-d3c14e947d8b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:28.527012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f5917e1b-8a40-4da7-954a-d3c14e947d8b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:28.527455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f5917e1b-8a40-4da7-954a-d3c14e947d8b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:28.528175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f5917e1b-8a40-4da7-954a-d3c14e947d8b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:28.539120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f5917e1b-8a40-4da7-954a-d3c14e947d8b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:28.539601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f5917e1b-8a40-4da7-954a-d3c14e947d8b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:28.753334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f5917e1b-8a40-4da7-954a-d3c14e947d8b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:28.769143 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f5917e1b-8a40-4da7-954a-d3c14e947d8b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6" status: 200 len: 1306 microversion: 2.1 time: 0.264828 Oct 24 10:58:28.785327 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3023/6015] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:28 2022] GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 => generated 1306 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:28.821091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2f538c5f-7caf-4076-89e6-64a823913629 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:28.831648 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2f538c5f-7caf-4076-89e6-64a823913629 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.367133 Oct 24 10:58:28.837969 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2993/6016] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:28 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:28.861829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0bc90d78-acfa-4652-8dae-87bda9d96ed7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:28.874423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0bc90d78-acfa-4652-8dae-87bda9d96ed7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 8b725851-afe0-4381-af16-1be25af30d39] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:28.888317 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-0bc90d78-acfa-4652-8dae-87bda9d96ed7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance 8b725851-afe0-4381-af16-1be25af30d39 could not be found. Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0bc90d78-acfa-4652-8dae-87bda9d96ed7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/8b725851-afe0-4381-af16-1be25af30d39/action HTTP/1.1 Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 15 Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: {"suspend": {}} Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 8b725851-afe0-4381-af16-1be25af30d39 could not be found. Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '8b725851-afe0-4381-af16-1be25af30d39', 'body': {'suspend': {}}} Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b725851-afe0-4381-af16-1be25af30d39 could not be found. Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b725851-afe0-4381-af16-1be25af30d39 could not be found. Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:28.896982 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:28.901734 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:58:28.901734 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:58:28.901734 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b725851-afe0-4381-af16-1be25af30d39 could not be found. Oct 24 10:58:28.901734 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:28.901734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0bc90d78-acfa-4652-8dae-87bda9d96ed7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance 8b725851-afe0-4381-af16-1be25af30d39 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:58:28.904911 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0bc90d78-acfa-4652-8dae-87bda9d96ed7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/8b725851-afe0-4381-af16-1be25af30d39/action" status: 404 len: 111 microversion: 2.1 time: 0.045159 Oct 24 10:58:28.906252 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3024/6017] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:58:28 2022] POST /compute/v2.1/servers/8b725851-afe0-4381-af16-1be25af30d39/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 10:58:28.923595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-111c5843-1e02-45d2-9863-6e2159c1cd8c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:28.924237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-111c5843-1e02-45d2-9863-6e2159c1cd8c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:28.930417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-111c5843-1e02-45d2-9863-6e2159c1cd8c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:28.931054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-111c5843-1e02-45d2-9863-6e2159c1cd8c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:28.931563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-111c5843-1e02-45d2-9863-6e2159c1cd8c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:28.932276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-111c5843-1e02-45d2-9863-6e2159c1cd8c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:28.932947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-111c5843-1e02-45d2-9863-6e2159c1cd8c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:28.933602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-111c5843-1e02-45d2-9863-6e2159c1cd8c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:29.140032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-111c5843-1e02-45d2-9863-6e2159c1cd8c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:29.149526 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-111c5843-1e02-45d2-9863-6e2159c1cd8c tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.239118 Oct 24 10:58:29.150650 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2994/6018] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:28 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:29.177951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ea0714ac-4df9-47fd-8825-e9f2f640463f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:29.179260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ea0714ac-4df9-47fd-8825-e9f2f640463f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:29.189027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea0714ac-4df9-47fd-8825-e9f2f640463f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:29.189869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea0714ac-4df9-47fd-8825-e9f2f640463f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:29.190921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea0714ac-4df9-47fd-8825-e9f2f640463f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:29.191815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea0714ac-4df9-47fd-8825-e9f2f640463f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:29.192421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea0714ac-4df9-47fd-8825-e9f2f640463f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:29.193034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea0714ac-4df9-47fd-8825-e9f2f640463f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:29.356502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ea0714ac-4df9-47fd-8825-e9f2f640463f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:29.366074 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ea0714ac-4df9-47fd-8825-e9f2f640463f tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.192798 Oct 24 10:58:29.366525 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3025/6019] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:29 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:29.397169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ce8dc9fd-d8c2-48eb-bac4-ae89166f5e30 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:29.398111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ce8dc9fd-d8c2-48eb-bac4-ae89166f5e30 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:29.407189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8dc9fd-d8c2-48eb-bac4-ae89166f5e30 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:29.407764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8dc9fd-d8c2-48eb-bac4-ae89166f5e30 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:29.408278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8dc9fd-d8c2-48eb-bac4-ae89166f5e30 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:29.409812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8dc9fd-d8c2-48eb-bac4-ae89166f5e30 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:29.410477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8dc9fd-d8c2-48eb-bac4-ae89166f5e30 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:29.411109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce8dc9fd-d8c2-48eb-bac4-ae89166f5e30 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:29.442795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-ce8dc9fd-d8c2-48eb-bac4-ae89166f5e30 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lazy-loading 'flavor' on Instance uuid 00aedb62-1a0e-47f0-bf42-19c12e9c035b {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:58:29.510833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:58:29.562350 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ce8dc9fd-d8c2-48eb-bac4-ae89166f5e30 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action" status: 202 len: 0 microversion: 2.1 time: 0.174618 Oct 24 10:58:29.563315 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2995/6020] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:58:29 2022] POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:58:29.578773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7c8fe51b-91a5-4472-9430-184ed0f44db1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:29.579441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7c8fe51b-91a5-4472-9430-184ed0f44db1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:29.593264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c8fe51b-91a5-4472-9430-184ed0f44db1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:29.594154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c8fe51b-91a5-4472-9430-184ed0f44db1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:29.595141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c8fe51b-91a5-4472-9430-184ed0f44db1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:29.596701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c8fe51b-91a5-4472-9430-184ed0f44db1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:29.597403 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c8fe51b-91a5-4472-9430-184ed0f44db1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:29.598214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c8fe51b-91a5-4472-9430-184ed0f44db1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:29.794400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0572849a-7a2c-492a-934f-0a5c0445c4eb tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:29.796099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0572849a-7a2c-492a-934f-0a5c0445c4eb tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:29.817632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0572849a-7a2c-492a-934f-0a5c0445c4eb tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:29.817979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0572849a-7a2c-492a-934f-0a5c0445c4eb tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:29.818559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0572849a-7a2c-492a-934f-0a5c0445c4eb tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:29.820095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0572849a-7a2c-492a-934f-0a5c0445c4eb tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:29.824303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0572849a-7a2c-492a-934f-0a5c0445c4eb tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:29.825147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0572849a-7a2c-492a-934f-0a5c0445c4eb tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:29.881238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7c8fe51b-91a5-4472-9430-184ed0f44db1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:29.894925 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7c8fe51b-91a5-4472-9430-184ed0f44db1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1513 microversion: 2.1 time: 0.325742 Oct 24 10:58:29.910712 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3026/6021] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:29 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1513 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:30.074287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0572849a-7a2c-492a-934f-0a5c0445c4eb tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:30.085162 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0572849a-7a2c-492a-934f-0a5c0445c4eb tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6" status: 200 len: 1373 microversion: 2.1 time: 0.295157 Oct 24 10:58:30.086175 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2996/6022] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:29 2022] GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 => generated 1373 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:30.923404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a173fc40-c4d2-4ebd-970a-b63909676646 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:30.924028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a173fc40-c4d2-4ebd-970a-b63909676646 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:30.932181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a173fc40-c4d2-4ebd-970a-b63909676646 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:30.932926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a173fc40-c4d2-4ebd-970a-b63909676646 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:30.933720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a173fc40-c4d2-4ebd-970a-b63909676646 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:30.934686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a173fc40-c4d2-4ebd-970a-b63909676646 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:30.935362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a173fc40-c4d2-4ebd-970a-b63909676646 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:30.937495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a173fc40-c4d2-4ebd-970a-b63909676646 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:31.141284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa24dc6b-adb8-4308-80a3-7654ce2e32c1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:31.143074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa24dc6b-adb8-4308-80a3-7654ce2e32c1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:31.153850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a173fc40-c4d2-4ebd-970a-b63909676646 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:31.164364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:58:31.173255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa24dc6b-adb8-4308-80a3-7654ce2e32c1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:31.173789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa24dc6b-adb8-4308-80a3-7654ce2e32c1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:31.174509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa24dc6b-adb8-4308-80a3-7654ce2e32c1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:31.177376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa24dc6b-adb8-4308-80a3-7654ce2e32c1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:31.179798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa24dc6b-adb8-4308-80a3-7654ce2e32c1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:31.181076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa24dc6b-adb8-4308-80a3-7654ce2e32c1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:31.191886 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a173fc40-c4d2-4ebd-970a-b63909676646 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1496 microversion: 2.1 time: 0.272131 Oct 24 10:58:31.213758 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3027/6023] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:30 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1496 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:31.231765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-11111346-e67a-4154-8262-29056997d23b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:31.234885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-11111346-e67a-4154-8262-29056997d23b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:31.253713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11111346-e67a-4154-8262-29056997d23b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:31.254607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11111346-e67a-4154-8262-29056997d23b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:31.255283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11111346-e67a-4154-8262-29056997d23b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:31.256609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11111346-e67a-4154-8262-29056997d23b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:31.258467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11111346-e67a-4154-8262-29056997d23b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:31.259154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11111346-e67a-4154-8262-29056997d23b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:31.303436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-11111346-e67a-4154-8262-29056997d23b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lazy-loading 'flavor' on Instance uuid 00aedb62-1a0e-47f0-bf42-19c12e9c035b {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:58:31.322430 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-11111346-e67a-4154-8262-29056997d23b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Cannot 'suspend' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state suspended Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-11111346-e67a-4154-8262-29056997d23b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action HTTP/1.1 Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 15 Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: {"suspend": {}} Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: exception: Cannot 'suspend' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state suspended Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '00aedb62-1a0e-47f0-bf42-19c12e9c035b', 'body': {'suspend': {}}} Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b in vm_state suspended. Cannot suspend while the instance is in this state. Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 24 10:58:31.325756 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 10:58:31.332711 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 10:58:31.332711 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 10:58:31.332711 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state suspended Oct 24 10:58:31.332711 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:31.332711 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:31.332711 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:31.332711 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:31.332711 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:31.332711 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:31.332711 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:58:31.332711 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:58:31.332711 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state suspended Oct 24 10:58:31.332711 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:31.335623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-11111346-e67a-4154-8262-29056997d23b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 409 to user: Cannot 'suspend' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state suspended {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:58:31.337010 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-11111346-e67a-4154-8262-29056997d23b tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action" status: 409 len: 148 microversion: 2.1 time: 0.118755 Oct 24 10:58:31.338428 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3028/6024] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:58:31 2022] POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action => generated 148 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:58:31.347749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-533e2e70-a7c8-45c5-9985-a3ea2ff31a73 req-510f17a6-1f69-46ed-a579-d0cac8630801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17c2cff3-9bc0-4324-9614-9ab08ef7c6a6", "tag": "849b6b01-61ac-4000-8b6f-118139276577"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:31.359691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-533e2e70-a7c8-45c5-9985-a3ea2ff31a73 req-510f17a6-1f69-46ed-a579-d0cac8630801 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:31.360681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-533e2e70-a7c8-45c5-9985-a3ea2ff31a73 req-510f17a6-1f69-46ed-a579-d0cac8630801 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:31.361490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-533e2e70-a7c8-45c5-9985-a3ea2ff31a73 req-510f17a6-1f69-46ed-a579-d0cac8630801 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:31.377428 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-533e2e70-a7c8-45c5-9985-a3ea2ff31a73 req-510f17a6-1f69-46ed-a579-d0cac8630801 service nova] Creating event network-changed:849b6b01-61ac-4000-8b6f-118139276577 for instance 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 on n-h2-858383-15 Oct 24 10:58:31.383103 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-533e2e70-a7c8-45c5-9985-a3ea2ff31a73 req-510f17a6-1f69-46ed-a579-d0cac8630801 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043143 Oct 24 10:58:31.384163 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3029/6025] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:58:31.393201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-294dcc9f-5cd8-4429-b119-528e282b4bc7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:31.395356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-294dcc9f-5cd8-4429-b119-528e282b4bc7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:31.403513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-294dcc9f-5cd8-4429-b119-528e282b4bc7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:31.405418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-294dcc9f-5cd8-4429-b119-528e282b4bc7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:31.406446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-294dcc9f-5cd8-4429-b119-528e282b4bc7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:31.408851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-294dcc9f-5cd8-4429-b119-528e282b4bc7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:31.410581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-294dcc9f-5cd8-4429-b119-528e282b4bc7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:31.411304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-294dcc9f-5cd8-4429-b119-528e282b4bc7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:31.501190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-aa24dc6b-adb8-4308-80a3-7654ce2e32c1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:31.514746 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa24dc6b-adb8-4308-80a3-7654ce2e32c1 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6" status: 200 len: 1373 microversion: 2.1 time: 0.403015 Oct 24 10:58:31.515438 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2997/6026] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:31 2022] GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 => generated 1373 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:58:31.560079 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-294dcc9f-5cd8-4429-b119-528e282b4bc7 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action" status: 202 len: 0 microversion: 2.1 time: 0.172211 Oct 24 10:58:31.561444 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3030/6027] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:58:31 2022] POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:58:31.570055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-703903aa-b6e1-4d86-abaa-b932dc83b174 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:31.571201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-703903aa-b6e1-4d86-abaa-b932dc83b174 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:31.581270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-703903aa-b6e1-4d86-abaa-b932dc83b174 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:31.582210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-703903aa-b6e1-4d86-abaa-b932dc83b174 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:31.583359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-703903aa-b6e1-4d86-abaa-b932dc83b174 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:31.585324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-703903aa-b6e1-4d86-abaa-b932dc83b174 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:31.586130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-703903aa-b6e1-4d86-abaa-b932dc83b174 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:31.586774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-703903aa-b6e1-4d86-abaa-b932dc83b174 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:31.965260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-703903aa-b6e1-4d86-abaa-b932dc83b174 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:31.978208 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-703903aa-b6e1-4d86-abaa-b932dc83b174 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1502 microversion: 2.1 time: 0.412218 Oct 24 10:58:31.995214 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2998/6028] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:31 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1502 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:32.544164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b48fbc63-9c8b-430c-94c1-f940488cd715 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:32.544938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b48fbc63-9c8b-430c-94c1-f940488cd715 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:32.559082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b48fbc63-9c8b-430c-94c1-f940488cd715 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:32.560216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b48fbc63-9c8b-430c-94c1-f940488cd715 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:32.561659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b48fbc63-9c8b-430c-94c1-f940488cd715 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:32.562674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b48fbc63-9c8b-430c-94c1-f940488cd715 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:32.563373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b48fbc63-9c8b-430c-94c1-f940488cd715 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:32.564035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b48fbc63-9c8b-430c-94c1-f940488cd715 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:32.803210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b48fbc63-9c8b-430c-94c1-f940488cd715 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:32.812497 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b48fbc63-9c8b-430c-94c1-f940488cd715 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6" status: 200 len: 1373 microversion: 2.1 time: 0.273272 Oct 24 10:58:32.817422 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3031/6029] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:32 2022] GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 => generated 1373 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:33.005505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-035c8125-dd6b-4e96-95c9-d1e943c9eec0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:33.006726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-035c8125-dd6b-4e96-95c9-d1e943c9eec0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:33.019412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-035c8125-dd6b-4e96-95c9-d1e943c9eec0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:33.020111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-035c8125-dd6b-4e96-95c9-d1e943c9eec0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:33.020733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-035c8125-dd6b-4e96-95c9-d1e943c9eec0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:33.021689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-035c8125-dd6b-4e96-95c9-d1e943c9eec0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:33.033620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-035c8125-dd6b-4e96-95c9-d1e943c9eec0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:33.034340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-035c8125-dd6b-4e96-95c9-d1e943c9eec0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:33.389291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-035c8125-dd6b-4e96-95c9-d1e943c9eec0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:33.399468 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-035c8125-dd6b-4e96-95c9-d1e943c9eec0 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1502 microversion: 2.1 time: 0.397666 Oct 24 10:58:33.413547 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 2999/6030] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:33 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1502 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:33.835720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b3f56e31-f069-440a-b25b-fdd06bcd71ee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:33.836904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b3f56e31-f069-440a-b25b-fdd06bcd71ee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:33.846037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3f56e31-f069-440a-b25b-fdd06bcd71ee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:33.846778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3f56e31-f069-440a-b25b-fdd06bcd71ee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:33.847385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3f56e31-f069-440a-b25b-fdd06bcd71ee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:33.848268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3f56e31-f069-440a-b25b-fdd06bcd71ee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:33.848936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3f56e31-f069-440a-b25b-fdd06bcd71ee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:33.849395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3f56e31-f069-440a-b25b-fdd06bcd71ee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:34.147675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b3f56e31-f069-440a-b25b-fdd06bcd71ee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:34.180298 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b3f56e31-f069-440a-b25b-fdd06bcd71ee tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6" status: 200 len: 1373 microversion: 2.1 time: 0.348197 Oct 24 10:58:34.181428 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3032/6031] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:33 2022] GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 => generated 1373 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:34.425613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dec5049c-cee5-4a33-95e0-614087b4e098 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:34.426244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dec5049c-cee5-4a33-95e0-614087b4e098 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:34.436314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dec5049c-cee5-4a33-95e0-614087b4e098 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:34.436814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dec5049c-cee5-4a33-95e0-614087b4e098 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:34.441908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dec5049c-cee5-4a33-95e0-614087b4e098 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:34.443064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dec5049c-cee5-4a33-95e0-614087b4e098 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:34.444431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dec5049c-cee5-4a33-95e0-614087b4e098 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:34.445119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dec5049c-cee5-4a33-95e0-614087b4e098 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:34.794612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dec5049c-cee5-4a33-95e0-614087b4e098 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:34.809437 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dec5049c-cee5-4a33-95e0-614087b4e098 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1502 microversion: 2.1 time: 0.387706 Oct 24 10:58:34.810356 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3000/6032] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:34 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1502 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:35.211499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e2f836a5-6db8-4fb0-88d2-395398f61c86 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:35.212781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e2f836a5-6db8-4fb0-88d2-395398f61c86 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:35.222487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2f836a5-6db8-4fb0-88d2-395398f61c86 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:35.223199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2f836a5-6db8-4fb0-88d2-395398f61c86 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:35.223938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2f836a5-6db8-4fb0-88d2-395398f61c86 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:35.225059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2f836a5-6db8-4fb0-88d2-395398f61c86 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:35.225717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2f836a5-6db8-4fb0-88d2-395398f61c86 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:35.226342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2f836a5-6db8-4fb0-88d2-395398f61c86 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:35.550560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e2f836a5-6db8-4fb0-88d2-395398f61c86 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:35.569668 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e2f836a5-6db8-4fb0-88d2-395398f61c86 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6" status: 200 len: 1373 microversion: 2.1 time: 0.363518 Oct 24 10:58:35.571298 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3033/6033] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:35 2022] GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 => generated 1373 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:35.848750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0b06cf01-07bc-4ea1-92d6-d0abafa59af1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:35.849615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0b06cf01-07bc-4ea1-92d6-d0abafa59af1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:35.858140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b06cf01-07bc-4ea1-92d6-d0abafa59af1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:35.858895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b06cf01-07bc-4ea1-92d6-d0abafa59af1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:35.859613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b06cf01-07bc-4ea1-92d6-d0abafa59af1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:35.861216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b06cf01-07bc-4ea1-92d6-d0abafa59af1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:35.861914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b06cf01-07bc-4ea1-92d6-d0abafa59af1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:35.863054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b06cf01-07bc-4ea1-92d6-d0abafa59af1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:36.119447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0b06cf01-07bc-4ea1-92d6-d0abafa59af1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:36.134404 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0b06cf01-07bc-4ea1-92d6-d0abafa59af1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.292271 Oct 24 10:58:36.136511 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3001/6034] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:35 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:36.163273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8e8dd52b-f398-49ad-a043-ffaeb62f5ff9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:36.163998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8e8dd52b-f398-49ad-a043-ffaeb62f5ff9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:36.166701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:58:36.167502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:58:36.175435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e8dd52b-f398-49ad-a043-ffaeb62f5ff9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:36.181018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e8dd52b-f398-49ad-a043-ffaeb62f5ff9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:36.181663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e8dd52b-f398-49ad-a043-ffaeb62f5ff9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:36.182707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e8dd52b-f398-49ad-a043-ffaeb62f5ff9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:36.184109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e8dd52b-f398-49ad-a043-ffaeb62f5ff9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:36.184823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8e8dd52b-f398-49ad-a043-ffaeb62f5ff9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:36.480063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8e8dd52b-f398-49ad-a043-ffaeb62f5ff9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:36.500051 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8e8dd52b-f398-49ad-a043-ffaeb62f5ff9 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.340835 Oct 24 10:58:36.500979 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3034/6035] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:36 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:36.523864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d64e97f2-560d-429c-9f7f-193bc871a2b3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:36.524808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d64e97f2-560d-429c-9f7f-193bc871a2b3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 2e36fecf-3608-43c5-a2cc-2e646ff6f631] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:36.532548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:58:36.537336 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-d64e97f2-560d-429c-9f7f-193bc871a2b3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance 2e36fecf-3608-43c5-a2cc-2e646ff6f631 could not be found. Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d64e97f2-560d-429c-9f7f-193bc871a2b3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/2e36fecf-3608-43c5-a2cc-2e646ff6f631/action HTTP/1.1 Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 15 Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: {"unpause": {}} Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 2e36fecf-3608-43c5-a2cc-2e646ff6f631 could not be found. Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '2e36fecf-3608-43c5-a2cc-2e646ff6f631', 'body': {'unpause': {}}} Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e36fecf-3608-43c5-a2cc-2e646ff6f631 could not be found. Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e36fecf-3608-43c5-a2cc-2e646ff6f631 could not be found. Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:36.542052 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:36.548337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:58:36.548337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:58:36.548337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e36fecf-3608-43c5-a2cc-2e646ff6f631 could not be found. Oct 24 10:58:36.548337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:36.548815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d64e97f2-560d-429c-9f7f-193bc871a2b3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance 2e36fecf-3608-43c5-a2cc-2e646ff6f631 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:58:36.551763 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d64e97f2-560d-429c-9f7f-193bc871a2b3 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/2e36fecf-3608-43c5-a2cc-2e646ff6f631/action" status: 404 len: 111 microversion: 2.1 time: 0.032642 Oct 24 10:58:36.552443 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3002/6036] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:58:36 2022] POST /compute/v2.1/servers/2e36fecf-3608-43c5-a2cc-2e646ff6f631/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:58:36.565813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-78057e61-35bf-4f69-ab08-bd0cc6dd04ad tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:36.566861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-78057e61-35bf-4f69-ab08-bd0cc6dd04ad tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:36.574426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78057e61-35bf-4f69-ab08-bd0cc6dd04ad tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:36.574935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78057e61-35bf-4f69-ab08-bd0cc6dd04ad tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:36.575380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78057e61-35bf-4f69-ab08-bd0cc6dd04ad tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:36.576392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78057e61-35bf-4f69-ab08-bd0cc6dd04ad tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:36.576976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78057e61-35bf-4f69-ab08-bd0cc6dd04ad tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:36.577416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78057e61-35bf-4f69-ab08-bd0cc6dd04ad tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:36.594752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-af8cdc0f-2967-4a0d-8a41-0dbb5239d53c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:36.595807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-af8cdc0f-2967-4a0d-8a41-0dbb5239d53c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:36.616174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af8cdc0f-2967-4a0d-8a41-0dbb5239d53c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:36.616923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af8cdc0f-2967-4a0d-8a41-0dbb5239d53c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:36.617998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af8cdc0f-2967-4a0d-8a41-0dbb5239d53c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:36.620399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af8cdc0f-2967-4a0d-8a41-0dbb5239d53c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:36.621054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af8cdc0f-2967-4a0d-8a41-0dbb5239d53c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:36.621524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af8cdc0f-2967-4a0d-8a41-0dbb5239d53c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:36.980121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-78057e61-35bf-4f69-ab08-bd0cc6dd04ad tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:36.990055 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-78057e61-35bf-4f69-ab08-bd0cc6dd04ad tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.430140 Oct 24 10:58:36.995321 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3035/6037] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:36 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:37.026095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c8e37347-d5f3-4812-8e2d-a2e2b4f62b56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:37.026726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c8e37347-d5f3-4812-8e2d-a2e2b4f62b56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:37.035036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8e37347-d5f3-4812-8e2d-a2e2b4f62b56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:37.035784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8e37347-d5f3-4812-8e2d-a2e2b4f62b56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:37.036394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8e37347-d5f3-4812-8e2d-a2e2b4f62b56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:37.037466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-af8cdc0f-2967-4a0d-8a41-0dbb5239d53c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:37.038263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8e37347-d5f3-4812-8e2d-a2e2b4f62b56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:37.038735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8e37347-d5f3-4812-8e2d-a2e2b4f62b56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:37.039223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8e37347-d5f3-4812-8e2d-a2e2b4f62b56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:37.047822 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-af8cdc0f-2967-4a0d-8a41-0dbb5239d53c tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6" status: 200 len: 1373 microversion: 2.1 time: 0.457809 Oct 24 10:58:37.053383 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3003/6038] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:36 2022] GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 => generated 1373 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:37.275877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c8e37347-d5f3-4812-8e2d-a2e2b4f62b56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:37.291122 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c8e37347-d5f3-4812-8e2d-a2e2b4f62b56 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.270581 Oct 24 10:58:37.292290 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3036/6039] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:37 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:58:37.320693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef6a8345-1653-41e4-89ea-2817e697d7d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:37.321284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ef6a8345-1653-41e4-89ea-2817e697d7d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:37.330499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef6a8345-1653-41e4-89ea-2817e697d7d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:37.331287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef6a8345-1653-41e4-89ea-2817e697d7d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:37.331760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef6a8345-1653-41e4-89ea-2817e697d7d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:37.332744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef6a8345-1653-41e4-89ea-2817e697d7d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:37.333486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef6a8345-1653-41e4-89ea-2817e697d7d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:37.334109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef6a8345-1653-41e4-89ea-2817e697d7d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:37.362910 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-ef6a8345-1653-41e4-89ea-2817e697d7d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Cannot 'unpause' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef6a8345-1653-41e4-89ea-2817e697d7d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action HTTP/1.1 Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 15 Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: {"unpause": {}} Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: exception: Cannot 'unpause' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '00aedb62-1a0e-47f0-bf42-19c12e9c035b', 'body': {'unpause': {}}} Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b in vm_state active. Cannot unpause while the instance is in this state. Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:37.364237 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:37.368883 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:37.368883 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:58:37.368883 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:58:37.368883 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active Oct 24 10:58:37.368883 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:37.370892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef6a8345-1653-41e4-89ea-2817e697d7d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 409 to user: Cannot 'unpause' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:58:37.385810 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef6a8345-1653-41e4-89ea-2817e697d7d1 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action" status: 409 len: 145 microversion: 2.1 time: 0.071150 Oct 24 10:58:37.386435 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3004/6040] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:58:37 2022] POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action => generated 145 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 10:58:37.398684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f35eb865-13a1-494d-bb2c-b51bb324bee6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:37.399301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f35eb865-13a1-494d-bb2c-b51bb324bee6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:37.413810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f35eb865-13a1-494d-bb2c-b51bb324bee6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:37.414321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f35eb865-13a1-494d-bb2c-b51bb324bee6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:37.414763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f35eb865-13a1-494d-bb2c-b51bb324bee6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:37.417991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f35eb865-13a1-494d-bb2c-b51bb324bee6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:37.418659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f35eb865-13a1-494d-bb2c-b51bb324bee6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:37.419700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f35eb865-13a1-494d-bb2c-b51bb324bee6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:37.614127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f35eb865-13a1-494d-bb2c-b51bb324bee6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:37.622995 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f35eb865-13a1-494d-bb2c-b51bb324bee6 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.227945 Oct 24 10:58:37.625569 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3037/6041] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:37 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:37.642198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-246249af-91f7-45b0-998a-582946cf59e0 req-6a9e1232-ad93-4e21-8cc4-1e9eae3edc2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c2cff3-9bc0-4324-9614-9ab08ef7c6a6", "name": "network-vif-plugged", "status": "completed", "tag": "849b6b01-61ac-4000-8b6f-118139276577"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:37.650447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6d56aedb-64b8-4c9d-963f-b0f0c81ce16a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:37.653078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6d56aedb-64b8-4c9d-963f-b0f0c81ce16a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:37.666524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-246249af-91f7-45b0-998a-582946cf59e0 req-6a9e1232-ad93-4e21-8cc4-1e9eae3edc2c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:37.669014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d56aedb-64b8-4c9d-963f-b0f0c81ce16a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:37.669499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-246249af-91f7-45b0-998a-582946cf59e0 req-6a9e1232-ad93-4e21-8cc4-1e9eae3edc2c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:37.670122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d56aedb-64b8-4c9d-963f-b0f0c81ce16a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:37.670690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-246249af-91f7-45b0-998a-582946cf59e0 req-6a9e1232-ad93-4e21-8cc4-1e9eae3edc2c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:37.671205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d56aedb-64b8-4c9d-963f-b0f0c81ce16a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:37.672124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d56aedb-64b8-4c9d-963f-b0f0c81ce16a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:37.676411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d56aedb-64b8-4c9d-963f-b0f0c81ce16a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:37.677210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d56aedb-64b8-4c9d-963f-b0f0c81ce16a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:37.696854 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-246249af-91f7-45b0-998a-582946cf59e0 req-6a9e1232-ad93-4e21-8cc4-1e9eae3edc2c service nova] Creating event network-vif-plugged:849b6b01-61ac-4000-8b6f-118139276577 for instance 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 on n-h2-858383-15 Oct 24 10:58:37.710458 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-246249af-91f7-45b0-998a-582946cf59e0 req-6a9e1232-ad93-4e21-8cc4-1e9eae3edc2c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072436 Oct 24 10:58:37.712714 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3005/6042] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:58:37.893219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6d56aedb-64b8-4c9d-963f-b0f0c81ce16a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:37.907928 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6d56aedb-64b8-4c9d-963f-b0f0c81ce16a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.257789 Oct 24 10:58:37.909834 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3038/6043] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:37 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:58:37.937509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b16bff68-b866-4c2d-a16e-7eb76b0c8457 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:37.938228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b16bff68-b866-4c2d-a16e-7eb76b0c8457 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 2fbd22aa-e046-49fb-ac0e-98b610c22370] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:37.945634 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-b16bff68-b866-4c2d-a16e-7eb76b0c8457 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance 2fbd22aa-e046-49fb-ac0e-98b610c22370 could not be found. Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b16bff68-b866-4c2d-a16e-7eb76b0c8457 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/2fbd22aa-e046-49fb-ac0e-98b610c22370/action HTTP/1.1 Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 18 Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: {"unshelve": null} Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 2fbd22aa-e046-49fb-ac0e-98b610c22370 could not be found. Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '2fbd22aa-e046-49fb-ac0e-98b610c22370', 'body': {'unshelve': None}} Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fbd22aa-e046-49fb-ac0e-98b610c22370 could not be found. Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fbd22aa-e046-49fb-ac0e-98b610c22370 could not be found. Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:37.948017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:37.953992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:37.953992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:37.953992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:37.953992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:37.953992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:58:37.953992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:58:37.953992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fbd22aa-e046-49fb-ac0e-98b610c22370 could not be found. Oct 24 10:58:37.953992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:37.955474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b16bff68-b866-4c2d-a16e-7eb76b0c8457 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance 2fbd22aa-e046-49fb-ac0e-98b610c22370 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:58:37.956494 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b16bff68-b866-4c2d-a16e-7eb76b0c8457 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/2fbd22aa-e046-49fb-ac0e-98b610c22370/action" status: 404 len: 111 microversion: 2.1 time: 0.027512 Oct 24 10:58:37.961286 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3006/6044] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:58:37 2022] POST /compute/v2.1/servers/2fbd22aa-e046-49fb-ac0e-98b610c22370/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:58:37.965673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c381b82a-1639-4bc6-9433-dfa071913e6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:37.966170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c381b82a-1639-4bc6-9433-dfa071913e6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:37.974264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c381b82a-1639-4bc6-9433-dfa071913e6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:37.977223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c381b82a-1639-4bc6-9433-dfa071913e6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:37.978659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c381b82a-1639-4bc6-9433-dfa071913e6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:37.980231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c381b82a-1639-4bc6-9433-dfa071913e6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:37.980707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c381b82a-1639-4bc6-9433-dfa071913e6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:37.981174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c381b82a-1639-4bc6-9433-dfa071913e6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:38.073466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2a96be5e-c90f-4762-8c26-d08608541c5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:38.075382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2a96be5e-c90f-4762-8c26-d08608541c5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:38.088569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a96be5e-c90f-4762-8c26-d08608541c5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:38.089148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a96be5e-c90f-4762-8c26-d08608541c5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:38.093580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a96be5e-c90f-4762-8c26-d08608541c5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:38.094392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a96be5e-c90f-4762-8c26-d08608541c5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:38.094974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a96be5e-c90f-4762-8c26-d08608541c5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:38.095416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a96be5e-c90f-4762-8c26-d08608541c5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:38.175810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c381b82a-1639-4bc6-9433-dfa071913e6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:38.186719 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c381b82a-1639-4bc6-9433-dfa071913e6e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.223078 Oct 24 10:58:38.187416 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3039/6045] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:37 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:58:38.213541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-041e3a05-a5cf-4c3d-b90c-9e3715637c08 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:38.214505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-041e3a05-a5cf-4c3d-b90c-9e3715637c08 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:38.222112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-041e3a05-a5cf-4c3d-b90c-9e3715637c08 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:38.223048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-041e3a05-a5cf-4c3d-b90c-9e3715637c08 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:38.223772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-041e3a05-a5cf-4c3d-b90c-9e3715637c08 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:38.226569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-041e3a05-a5cf-4c3d-b90c-9e3715637c08 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:38.227497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-041e3a05-a5cf-4c3d-b90c-9e3715637c08 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:38.228228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-041e3a05-a5cf-4c3d-b90c-9e3715637c08 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:38.436638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-041e3a05-a5cf-4c3d-b90c-9e3715637c08 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:38.449039 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-041e3a05-a5cf-4c3d-b90c-9e3715637c08 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.240005 Oct 24 10:58:38.465374 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3040/6046] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:38 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:58:38.471144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2a96be5e-c90f-4762-8c26-d08608541c5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:38.480122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-333f6111-276b-4f48-99b5-b8cd2b972c45 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:38.480853 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2a96be5e-c90f-4762-8c26-d08608541c5d tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6" status: 200 len: 1373 microversion: 2.1 time: 0.412529 Oct 24 10:58:38.481176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-333f6111-276b-4f48-99b5-b8cd2b972c45 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:38.488421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-333f6111-276b-4f48-99b5-b8cd2b972c45 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:38.489249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-333f6111-276b-4f48-99b5-b8cd2b972c45 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:38.489945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-333f6111-276b-4f48-99b5-b8cd2b972c45 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:38.490864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-333f6111-276b-4f48-99b5-b8cd2b972c45 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:38.491535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-333f6111-276b-4f48-99b5-b8cd2b972c45 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:38.492181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-333f6111-276b-4f48-99b5-b8cd2b972c45 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:38.505059 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3007/6047] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:38 2022] GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 => generated 1373 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:58:38.521787 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-333f6111-276b-4f48-99b5-b8cd2b972c45 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Cannot 'unshelve' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-333f6111-276b-4f48-99b5-b8cd2b972c45 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action HTTP/1.1 Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 18 Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: {"unshelve": null} Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: exception: Cannot 'unshelve' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '00aedb62-1a0e-47f0-bf42-19c12e9c035b', 'body': {'unshelve': None}} Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b in vm_state active. Cannot unshelve while the instance is in this state. Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 10:58:38.523633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 10:58:38.528284 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active Oct 24 10:58:38.528284 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:38.528284 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:38.528284 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:38.528284 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:38.528284 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:38.528284 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:38.528284 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:58:38.528284 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:58:38.528284 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active Oct 24 10:58:38.528284 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:38.528284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-333f6111-276b-4f48-99b5-b8cd2b972c45 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 409 to user: Cannot 'unshelve' instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b while it is in vm_state active {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:58:38.528284 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-333f6111-276b-4f48-99b5-b8cd2b972c45 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action" status: 409 len: 146 microversion: 2.1 time: 0.049613 Oct 24 10:58:38.528284 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3041/6048] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:58:38 2022] POST /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b/action => generated 146 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 24 10:58:38.534854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4d551cbb-5164-4a06-b0f8-467132959f46 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:38.535477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4d551cbb-5164-4a06-b0f8-467132959f46 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:38.542691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d551cbb-5164-4a06-b0f8-467132959f46 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:38.543169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d551cbb-5164-4a06-b0f8-467132959f46 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:38.543609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d551cbb-5164-4a06-b0f8-467132959f46 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:38.544320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d551cbb-5164-4a06-b0f8-467132959f46 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:38.544774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d551cbb-5164-4a06-b0f8-467132959f46 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:38.545279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d551cbb-5164-4a06-b0f8-467132959f46 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:38.759525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4d551cbb-5164-4a06-b0f8-467132959f46 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:38.769568 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4d551cbb-5164-4a06-b0f8-467132959f46 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.238802 Oct 24 10:58:38.771014 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3008/6049] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:38 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:38.799029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a1d828a5-90eb-496c-886f-c045986a4bef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:38.800469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a1d828a5-90eb-496c-886f-c045986a4bef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:38.809770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1d828a5-90eb-496c-886f-c045986a4bef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:38.810532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1d828a5-90eb-496c-886f-c045986a4bef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:38.813220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1d828a5-90eb-496c-886f-c045986a4bef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:38.814160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1d828a5-90eb-496c-886f-c045986a4bef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:38.814631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1d828a5-90eb-496c-886f-c045986a4bef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:38.815063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1d828a5-90eb-496c-886f-c045986a4bef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:39.063189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a1d828a5-90eb-496c-886f-c045986a4bef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:39.076055 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a1d828a5-90eb-496c-886f-c045986a4bef tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.280888 Oct 24 10:58:39.077909 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3042/6050] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:38 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:39.101366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab76ff78-eaba-496b-9008-0c929c3c38ff tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1534824235_updated"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:39.104109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ab76ff78-eaba-496b-9008-0c929c3c38ff tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: a79d795e-be03-4ba7-a76d-73ab7389c940] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:39.111631 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-ab76ff78-eaba-496b-9008-0c929c3c38ff tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance a79d795e-be03-4ba7-a76d-73ab7389c940 could not be found. Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab76ff78-eaba-496b-9008-0c929c3c38ff tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: request: PUT /compute/v2.1/servers/a79d795e-be03-4ba7-a76d-73ab7389c940 HTTP/1.1 Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 81 Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1534824235_updated"}} Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance a79d795e-be03-4ba7-a76d-73ab7389c940 could not be found. Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'a79d795e-be03-4ba7-a76d-73ab7389c940', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1534824235_updated'}}} Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a79d795e-be03-4ba7-a76d-73ab7389c940 could not be found. Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 24 10:58:39.114255 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:58:39.119385 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:58:39.119385 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:58:39.119385 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:58:39.119385 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a79d795e-be03-4ba7-a76d-73ab7389c940 could not be found. Oct 24 10:58:39.119385 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:39.119385 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:39.119385 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:39.119385 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:39.119385 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:39.119385 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:39.119385 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:58:39.119385 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:58:39.119385 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a79d795e-be03-4ba7-a76d-73ab7389c940 could not be found. Oct 24 10:58:39.119385 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:39.119385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab76ff78-eaba-496b-9008-0c929c3c38ff tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance a79d795e-be03-4ba7-a76d-73ab7389c940 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:58:39.119385 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ab76ff78-eaba-496b-9008-0c929c3c38ff tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "PUT /compute/v2.1/servers/a79d795e-be03-4ba7-a76d-73ab7389c940" status: 404 len: 111 microversion: 2.1 time: 0.019629 Oct 24 10:58:39.128358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-28904b07-2a46-4c84-bf5a-a0b638f3b389 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:39.129354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-28904b07-2a46-4c84-bf5a-a0b638f3b389 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:39.132914 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3009/6051] 10.222.0.50 () {60 vars in 1256 bytes} [Mon Oct 24 10:58:39 2022] PUT /compute/v2.1/servers/a79d795e-be03-4ba7-a76d-73ab7389c940 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:58:39.138099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28904b07-2a46-4c84-bf5a-a0b638f3b389 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:39.139883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28904b07-2a46-4c84-bf5a-a0b638f3b389 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:39.141955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28904b07-2a46-4c84-bf5a-a0b638f3b389 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:39.142857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28904b07-2a46-4c84-bf5a-a0b638f3b389 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:39.143467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28904b07-2a46-4c84-bf5a-a0b638f3b389 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:39.144184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-28904b07-2a46-4c84-bf5a-a0b638f3b389 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:39.348022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-28904b07-2a46-4c84-bf5a-a0b638f3b389 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:39.361210 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-28904b07-2a46-4c84-bf5a-a0b638f3b389 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.239772 Oct 24 10:58:39.362475 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3043/6052] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:39 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:58:39.385310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-21363d37-d70f-43a5-9026-cc5536b9300d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:39.386011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-21363d37-d70f-43a5-9026-cc5536b9300d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:39.406543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21363d37-d70f-43a5-9026-cc5536b9300d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:39.410088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21363d37-d70f-43a5-9026-cc5536b9300d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:39.410708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21363d37-d70f-43a5-9026-cc5536b9300d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:39.411902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21363d37-d70f-43a5-9026-cc5536b9300d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:39.412782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21363d37-d70f-43a5-9026-cc5536b9300d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:39.413572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21363d37-d70f-43a5-9026-cc5536b9300d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:39.506097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3fd0f27d-ac98-49f0-9f68-777b7caa8c3b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:39.507517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3fd0f27d-ac98-49f0-9f68-777b7caa8c3b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:39.521858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fd0f27d-ac98-49f0-9f68-777b7caa8c3b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:39.523704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fd0f27d-ac98-49f0-9f68-777b7caa8c3b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:39.525983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fd0f27d-ac98-49f0-9f68-777b7caa8c3b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:39.529410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fd0f27d-ac98-49f0-9f68-777b7caa8c3b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:39.531056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fd0f27d-ac98-49f0-9f68-777b7caa8c3b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:39.532047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fd0f27d-ac98-49f0-9f68-777b7caa8c3b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:39.562321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:58:39.580703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-21363d37-d70f-43a5-9026-cc5536b9300d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:39.594130 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-21363d37-d70f-43a5-9026-cc5536b9300d tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.212635 Oct 24 10:58:39.595288 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3010/6053] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:39 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:39.620514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80b97b75-8da6-4113-829d-c586f5f4e589 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80b97b75-8da6-4113-829d-c586f5f4e589 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: request: PUT /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b HTTP/1.1 Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 280 Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '00aedb62-1a0e-47f0-bf42-19c12e9c035b', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:39.624541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 10:58:39.629409 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:39.637933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80b97b75-8da6-4113-829d-c586f5f4e589 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:58:39.639885 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-80b97b75-8da6-4113-829d-c586f5f4e589 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "PUT /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 400 len: 619 microversion: 2.1 time: 0.023362 Oct 24 10:58:39.644213 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3011/6054] 10.222.0.50 () {60 vars in 1257 bytes} [Mon Oct 24 10:58:39 2022] PUT /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:58:39.649231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e8be405e-83ec-47ea-8809-206cae52e986 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:39.650091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e8be405e-83ec-47ea-8809-206cae52e986 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:39.658702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8be405e-83ec-47ea-8809-206cae52e986 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:39.659447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8be405e-83ec-47ea-8809-206cae52e986 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:39.660106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8be405e-83ec-47ea-8809-206cae52e986 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:39.661075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8be405e-83ec-47ea-8809-206cae52e986 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:39.661770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8be405e-83ec-47ea-8809-206cae52e986 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:39.662424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8be405e-83ec-47ea-8809-206cae52e986 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:39.785150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3fd0f27d-ac98-49f0-9f68-777b7caa8c3b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:39.799781 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3fd0f27d-ac98-49f0-9f68-777b7caa8c3b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6" status: 200 len: 1545 microversion: 2.1 time: 0.297488 Oct 24 10:58:39.801882 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3044/6055] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:39 2022] GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 => generated 1545 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:39.824724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dd31c39d-3c3d-4daf-9fba-6f4b851731ec tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:39.825650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dd31c39d-3c3d-4daf-9fba-6f4b851731ec tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:39.832778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd31c39d-3c3d-4daf-9fba-6f4b851731ec tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:39.833677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd31c39d-3c3d-4daf-9fba-6f4b851731ec tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:39.834283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd31c39d-3c3d-4daf-9fba-6f4b851731ec tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:39.835170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd31c39d-3c3d-4daf-9fba-6f4b851731ec tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:39.835792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd31c39d-3c3d-4daf-9fba-6f4b851731ec tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:39.836399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd31c39d-3c3d-4daf-9fba-6f4b851731ec tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:40.035669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e8be405e-83ec-47ea-8809-206cae52e986 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:40.047444 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e8be405e-83ec-47ea-8809-206cae52e986 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.401697 Oct 24 10:58:40.048259 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3012/6056] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:39 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:40.078791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4dfb8751-940d-4ed7-9868-1b743bec3419 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:40.080145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4dfb8751-940d-4ed7-9868-1b743bec3419 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:40.086386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4dfb8751-940d-4ed7-9868-1b743bec3419 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:40.087079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4dfb8751-940d-4ed7-9868-1b743bec3419 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:40.087683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4dfb8751-940d-4ed7-9868-1b743bec3419 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:40.088553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4dfb8751-940d-4ed7-9868-1b743bec3419 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:40.089231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4dfb8751-940d-4ed7-9868-1b743bec3419 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:40.090019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4dfb8751-940d-4ed7-9868-1b743bec3419 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:40.152544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dd31c39d-3c3d-4daf-9fba-6f4b851731ec tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:40.162758 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dd31c39d-3c3d-4daf-9fba-6f4b851731ec tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6" status: 200 len: 1545 microversion: 2.1 time: 0.341966 Oct 24 10:58:40.191440 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3045/6057] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:39 2022] GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 => generated 1545 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:40.260508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4dfb8751-940d-4ed7-9868-1b743bec3419 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:40.270384 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4dfb8751-940d-4ed7-9868-1b743bec3419 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.195442 Oct 24 10:58:40.277677 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3013/6058] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:40 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:40.313623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c1514623-4647-4a7d-8593-d0c0c44f20bd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c1514623-4647-4a7d-8593-d0c0c44f20bd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: request: PUT /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b HTTP/1.1 Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 24 Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: {"server": {"name": ""}} Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '00aedb62-1a0e-47f0-bf42-19c12e9c035b', 'body': {'server': {'name': ''}}} Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise error Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi '' Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 10:58:40.320874 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 10:58:40.327172 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 24 10:58:40.327172 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:40.327172 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:40.327172 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:40.327172 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:40.327172 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:40.327172 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:40.327172 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 10:58:40.327172 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 10:58:40.327172 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 24 10:58:40.327172 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:40.330561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c1514623-4647-4a7d-8593-d0c0c44f20bd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:58:40.331621 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c1514623-4647-4a7d-8593-d0c0c44f20bd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "PUT /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 400 len: 108 microversion: 2.1 time: 0.023054 Oct 24 10:58:40.340942 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3046/6059] 10.222.0.50 () {60 vars in 1256 bytes} [Mon Oct 24 10:58:40 2022] PUT /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 108 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 10:58:40.349765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7b9839d4-0cf8-450b-9cec-c7ba04125ff5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:40.350618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7b9839d4-0cf8-450b-9cec-c7ba04125ff5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:40.362628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b9839d4-0cf8-450b-9cec-c7ba04125ff5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:40.364030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b9839d4-0cf8-450b-9cec-c7ba04125ff5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:40.366993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b9839d4-0cf8-450b-9cec-c7ba04125ff5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:40.367751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b9839d4-0cf8-450b-9cec-c7ba04125ff5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:40.369256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b9839d4-0cf8-450b-9cec-c7ba04125ff5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:40.371040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b9839d4-0cf8-450b-9cec-c7ba04125ff5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:40.700119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7b9839d4-0cf8-450b-9cec-c7ba04125ff5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:40.708687 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7b9839d4-0cf8-450b-9cec-c7ba04125ff5 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1505 microversion: 2.1 time: 0.363070 Oct 24 10:58:40.709479 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3014/6060] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:40 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:43.216685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-ac75f615-7233-436c-bfd5-7b4b00779b34 req-de40e94b-d17d-4e59-853e-09249e2d7e73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17c2cff3-9bc0-4324-9614-9ab08ef7c6a6", "tag": "849b6b01-61ac-4000-8b6f-118139276577"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:43.253004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ac75f615-7233-436c-bfd5-7b4b00779b34 req-de40e94b-d17d-4e59-853e-09249e2d7e73 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:43.253503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ac75f615-7233-436c-bfd5-7b4b00779b34 req-de40e94b-d17d-4e59-853e-09249e2d7e73 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:43.253947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ac75f615-7233-436c-bfd5-7b4b00779b34 req-de40e94b-d17d-4e59-853e-09249e2d7e73 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:43.281058 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ac75f615-7233-436c-bfd5-7b4b00779b34 req-de40e94b-d17d-4e59-853e-09249e2d7e73 service nova] Creating event network-changed:849b6b01-61ac-4000-8b6f-118139276577 for instance 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 on n-h2-858383-15 Oct 24 10:58:43.291103 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-ac75f615-7233-436c-bfd5-7b4b00779b34 req-de40e94b-d17d-4e59-853e-09249e2d7e73 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084599 Oct 24 10:58:43.292574 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3047/6061] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:58:48.197069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7361a26e-52d9-4cd8-a8c5-9ad1dfbf4d40 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:48.200131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7361a26e-52d9-4cd8-a8c5-9ad1dfbf4d40 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:48.214953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7361a26e-52d9-4cd8-a8c5-9ad1dfbf4d40 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:48.216590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7361a26e-52d9-4cd8-a8c5-9ad1dfbf4d40 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:48.218624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7361a26e-52d9-4cd8-a8c5-9ad1dfbf4d40 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:48.219540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7361a26e-52d9-4cd8-a8c5-9ad1dfbf4d40 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:48.224044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7361a26e-52d9-4cd8-a8c5-9ad1dfbf4d40 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:48.224713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7361a26e-52d9-4cd8-a8c5-9ad1dfbf4d40 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:48.346007 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7361a26e-52d9-4cd8-a8c5-9ad1dfbf4d40 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd/action" status: 200 len: 24533 microversion: 2.1 time: 0.144031 Oct 24 10:58:48.347476 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3015/6062] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:58:48 2022] POST /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd/action => generated 24533 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 10:58:48.865541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-25a15f78-42ec-443a-a88c-630504324e3e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:48.865541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-25a15f78-42ec-443a-a88c-630504324e3e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:48.877422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:58:48.882210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25a15f78-42ec-443a-a88c-630504324e3e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:48.882716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25a15f78-42ec-443a-a88c-630504324e3e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:48.883165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25a15f78-42ec-443a-a88c-630504324e3e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:48.883885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25a15f78-42ec-443a-a88c-630504324e3e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:48.884346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25a15f78-42ec-443a-a88c-630504324e3e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:48.884775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25a15f78-42ec-443a-a88c-630504324e3e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:48.934225 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-25a15f78-42ec-443a-a88c-630504324e3e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-25a15f78-42ec-443a-a88c-630504324e3e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 HTTP/1.1 Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'bce02187-96ed-47b2-b572-b97ce0840c19'} Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:58:48.936738 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:58:48.970053 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:58:48.970053 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:48.970053 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:48.970053 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:48.970053 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:48.970053 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:48.970053 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:48.970053 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:58:48.970053 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:58:48.970053 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:58:48.970053 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 10:58:48.970053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-25a15f78-42ec-443a-a88c-630504324e3e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:58:48.970053 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-25a15f78-42ec-443a-a88c-630504324e3e tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 404 len: 111 microversion: 2.1 time: 0.082439 Oct 24 10:58:48.970053 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3048/6063] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:58:48 2022] DELETE /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:58:48.978938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb99b045-8f2b-44b9-a599-f3ded8adaa86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:48.978938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bb99b045-8f2b-44b9-a599-f3ded8adaa86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: bce02187-96ed-47b2-b572-b97ce0840c19] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:48.978938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb99b045-8f2b-44b9-a599-f3ded8adaa86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:48.978938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb99b045-8f2b-44b9-a599-f3ded8adaa86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:48.978938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb99b045-8f2b-44b9-a599-f3ded8adaa86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:48.978938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb99b045-8f2b-44b9-a599-f3ded8adaa86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:48.978938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb99b045-8f2b-44b9-a599-f3ded8adaa86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:48.978938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb99b045-8f2b-44b9-a599-f3ded8adaa86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:49.027873 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-bb99b045-8f2b-44b9-a599-f3ded8adaa86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb99b045-8f2b-44b9-a599-f3ded8adaa86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 HTTP/1.1 Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'bce02187-96ed-47b2-b572-b97ce0840c19'} Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:49.030975 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:49.036299 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:49.036299 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:49.036299 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:49.036299 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:58:49.036299 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:58:49.036299 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. Oct 24 10:58:49.036299 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:49.036299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb99b045-8f2b-44b9-a599-f3ded8adaa86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance bce02187-96ed-47b2-b572-b97ce0840c19 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:58:49.036299 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bb99b045-8f2b-44b9-a599-f3ded8adaa86 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19" status: 404 len: 111 microversion: 2.1 time: 0.088022 Oct 24 10:58:49.050741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-873d0683-d08c-404d-a9ab-7572771df14a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:49.051540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-873d0683-d08c-404d-a9ab-7572771df14a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:49.056597 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3016/6064] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:48 2022] GET /compute/v2.1/servers/bce02187-96ed-47b2-b572-b97ce0840c19 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:58:49.058437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-873d0683-d08c-404d-a9ab-7572771df14a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:49.060190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-873d0683-d08c-404d-a9ab-7572771df14a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:49.061928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-873d0683-d08c-404d-a9ab-7572771df14a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:49.062992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-873d0683-d08c-404d-a9ab-7572771df14a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:49.063673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-873d0683-d08c-404d-a9ab-7572771df14a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:49.064487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-873d0683-d08c-404d-a9ab-7572771df14a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:49.101514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-873d0683-d08c-404d-a9ab-7572771df14a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:58:49.235605 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-873d0683-d08c-404d-a9ab-7572771df14a tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "DELETE /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 204 len: 0 microversion: 2.1 time: 0.189630 Oct 24 10:58:49.237276 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3049/6065] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:58:49 2022] DELETE /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:58:49.245678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fa4ea8ba-f926-4a18-862d-fbd5bb8c83fd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:49.246365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fa4ea8ba-f926-4a18-862d-fbd5bb8c83fd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:49.261325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa4ea8ba-f926-4a18-862d-fbd5bb8c83fd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:49.261794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa4ea8ba-f926-4a18-862d-fbd5bb8c83fd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:49.264146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa4ea8ba-f926-4a18-862d-fbd5bb8c83fd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:49.265570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa4ea8ba-f926-4a18-862d-fbd5bb8c83fd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:49.266072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa4ea8ba-f926-4a18-862d-fbd5bb8c83fd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:49.268118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa4ea8ba-f926-4a18-862d-fbd5bb8c83fd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:49.629956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fa4ea8ba-f926-4a18-862d-fbd5bb8c83fd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:49.635718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:58:49.664166 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fa4ea8ba-f926-4a18-862d-fbd5bb8c83fd tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1511 microversion: 2.1 time: 0.407705 Oct 24 10:58:49.668614 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3017/6066] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:49 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1511 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:50.693381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-179e8be0-4c68-423a-a5a4-29f7c7901da4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:50.695340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-179e8be0-4c68-423a-a5a4-29f7c7901da4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:50.704072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-179e8be0-4c68-423a-a5a4-29f7c7901da4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:50.718322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-179e8be0-4c68-423a-a5a4-29f7c7901da4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:50.722639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-179e8be0-4c68-423a-a5a4-29f7c7901da4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:50.724038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-179e8be0-4c68-423a-a5a4-29f7c7901da4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:50.724756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-179e8be0-4c68-423a-a5a4-29f7c7901da4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:50.726448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-179e8be0-4c68-423a-a5a4-29f7c7901da4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:50.986674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-179e8be0-4c68-423a-a5a4-29f7c7901da4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:50.995778 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-179e8be0-4c68-423a-a5a4-29f7c7901da4 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1511 microversion: 2.1 time: 0.307603 Oct 24 10:58:51.000810 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3050/6067] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:50 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1511 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:52.033706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ebbb11dc-ccd3-4808-a631-f10717c36810 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:52.034339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ebbb11dc-ccd3-4808-a631-f10717c36810 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:52.042127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:58:52.064392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebbb11dc-ccd3-4808-a631-f10717c36810 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:52.068030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebbb11dc-ccd3-4808-a631-f10717c36810 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:52.070151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebbb11dc-ccd3-4808-a631-f10717c36810 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:52.073877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebbb11dc-ccd3-4808-a631-f10717c36810 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:52.077458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebbb11dc-ccd3-4808-a631-f10717c36810 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:52.089084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebbb11dc-ccd3-4808-a631-f10717c36810 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:52.246590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ebbb11dc-ccd3-4808-a631-f10717c36810 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c757a515e4a3aa80f82441feef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dca3140620f4022b1bd7d610163be77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:58:52.255461 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ebbb11dc-ccd3-4808-a631-f10717c36810 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 200 len: 1469 microversion: 2.1 time: 0.227619 Oct 24 10:58:52.269482 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3018/6068] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:52 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 1469 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:58:52.317105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-74037115-2a8c-4bfa-894c-90a8a2c6112b req-eea92b47-dd1e-49e6-b0ed-422580b60e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00aedb62-1a0e-47f0-bf42-19c12e9c035b", "name": "network-vif-deleted", "tag": "6502e9a3-ede9-43b4-816f-557cd30886f2"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:58:52.332747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-74037115-2a8c-4bfa-894c-90a8a2c6112b req-eea92b47-dd1e-49e6-b0ed-422580b60e1f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:52.333417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-74037115-2a8c-4bfa-894c-90a8a2c6112b req-eea92b47-dd1e-49e6-b0ed-422580b60e1f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:52.333851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-74037115-2a8c-4bfa-894c-90a8a2c6112b req-eea92b47-dd1e-49e6-b0ed-422580b60e1f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:52.368148 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-74037115-2a8c-4bfa-894c-90a8a2c6112b req-eea92b47-dd1e-49e6-b0ed-422580b60e1f service nova] Creating event network-vif-deleted:6502e9a3-ede9-43b4-816f-557cd30886f2 for instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b on n-h2-858383-15 Oct 24 10:58:52.386523 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-74037115-2a8c-4bfa-894c-90a8a2c6112b req-eea92b47-dd1e-49e6-b0ed-422580b60e1f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073478 Oct 24 10:58:52.396063 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3051/6069] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:58:53.287438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9abfcc2-7633-4779-a406-67d3d3201d06 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:58:53.288926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f9abfcc2-7633-4779-a406-67d3d3201d06 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] [instance: 00aedb62-1a0e-47f0-bf42-19c12e9c035b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:58:53.301582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9abfcc2-7633-4779-a406-67d3d3201d06 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:53.302073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9abfcc2-7633-4779-a406-67d3d3201d06 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:53.307713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9abfcc2-7633-4779-a406-67d3d3201d06 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:53.308524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9abfcc2-7633-4779-a406-67d3d3201d06 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:58:53.309026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9abfcc2-7633-4779-a406-67d3d3201d06 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:58:53.309657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9abfcc2-7633-4779-a406-67d3d3201d06 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:58:53.333926 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-f9abfcc2-7633-4779-a406-67d3d3201d06 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] HTTP exception thrown: Instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b could not be found. Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9abfcc2-7633-4779-a406-67d3d3201d06 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Request method failure captured: Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b HTTP/1.1 Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm8bNhNcqm8MN5JaiOQhozdsRRauIiGH1C596akxac_cfwDRM7wOXKE6Qb_6t4Hd2yKEblDFVhGlatWxY86ukuCl8YmYOPrmskCfqkCryzyYC_yWoLzRAs39-66ZSu0gVczq7dRkJC_KAN8rSLxa96c8gWnnNVAdqfe_3deYhT4cDFI Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9dca3140620f4022b1bd7d610163be77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9dca3140620f4022b1bd7d610163be77", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 9dca3140620f4022b1bd7d610163be77 Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1675829741 Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: a38c757a515e4a3aa80f82441feef50e Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-1675829741-project Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b could not be found. Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '00aedb62-1a0e-47f0-bf42-19c12e9c035b'} Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b could not be found. Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b could not be found. Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:58:53.341097 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:53.346551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:58:53.346551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:58:53.346551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:58:53.346551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:58:53.346551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:58:53.346551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b could not be found. Oct 24 10:58:53.346551 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:58:53.346551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9abfcc2-7633-4779-a406-67d3d3201d06 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] Returning 404 to user: Instance 00aedb62-1a0e-47f0-bf42-19c12e9c035b could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:58:53.346551 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f9abfcc2-7633-4779-a406-67d3d3201d06 tempest-ServersNegativeTestJSON-1675829741 tempest-ServersNegativeTestJSON-1675829741-project] 10.222.0.50 "GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b" status: 404 len: 111 microversion: 2.1 time: 0.060985 Oct 24 10:58:53.347529 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3019/6070] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:58:53 2022] GET /compute/v2.1/servers/00aedb62-1a0e-47f0-bf42-19c12e9c035b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:59:04.153178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:59:04.153930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:59:04.303020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-af269350-0db8-4ec1-b877-549e5ac93939 tempest-ComputeTenantNetworksTest-133920427 tempest-ComputeTenantNetworksTest-133920427-project] Calling method '.version_select at 0x7f04cb6730d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:04.339540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-66de1ab8-a97a-4a61-8ab8-0fb6fe441ba6 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:59:04.342829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-66de1ab8-a97a-4a61-8ab8-0fb6fe441ba6 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:04.349479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:59:04.350584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=9 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:59:04.353342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66de1ab8-a97a-4a61-8ab8-0fb6fe441ba6 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:04.354267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66de1ab8-a97a-4a61-8ab8-0fb6fe441ba6 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:04.354782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66de1ab8-a97a-4a61-8ab8-0fb6fe441ba6 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:04.355897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66de1ab8-a97a-4a61-8ab8-0fb6fe441ba6 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:04.356699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66de1ab8-a97a-4a61-8ab8-0fb6fe441ba6 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:04.357399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-66de1ab8-a97a-4a61-8ab8-0fb6fe441ba6 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:04.437353 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-66de1ab8-a97a-4a61-8ab8-0fb6fe441ba6 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "POST /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6/action" status: 200 len: 24569 microversion: 2.1 time: 0.101731 Oct 24 10:59:04.444375 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3020/6071] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:59:04 2022] POST /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6/action => generated 24569 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:59:04.708243 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-af269350-0db8-4ec1-b877-549e5ac93939 tempest-ComputeTenantNetworksTest-133920427 tempest-ComputeTenantNetworksTest-133920427-project] 10.222.0.50 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.556921 Oct 24 10:59:04.709155 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3052/6072] 10.222.0.50 () {58 vars in 1158 bytes} [Mon Oct 24 10:59:04 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:59:04.722519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d8a101e4-6d93-401e-a974-d9ed42f49bbb tempest-ComputeTenantNetworksTest-133920427 tempest-ComputeTenantNetworksTest-133920427-project] Calling method '.version_select at 0x7f04cba334c0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:05.274700 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d8a101e4-6d93-401e-a974-d9ed42f49bbb tempest-ComputeTenantNetworksTest-133920427 tempest-ComputeTenantNetworksTest-133920427-project] 10.222.0.50 "GET /compute/v2.1/os-tenant-networks/f27f70d1-b9fb-4867-ace9-e43b1434f939" status: 200 len: 139 microversion: 2.1 time: 0.557273 Oct 24 10:59:05.275293 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3021/6073] 10.222.0.50 () {58 vars in 1269 bytes} [Mon Oct 24 10:59:04 2022] GET /compute/v2.1/os-tenant-networks/f27f70d1-b9fb-4867-ace9-e43b1434f939 => generated 139 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:59:08.027907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-af269350-0db8-4ec1-b877-549e5ac93939 tempest-ComputeTenantNetworksTest-133920427 tempest-ComputeTenantNetworksTest-133920427-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:08.029398 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-af269350-0db8-4ec1-b877-549e5ac93939 tempest-ComputeTenantNetworksTest-133920427 tempest-ComputeTenantNetworksTest-133920427-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001707 Oct 24 10:59:08.030385 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3053/6074] 10.222.0.50 () {56 vars in 886 bytes} [Mon Oct 24 10:59:08 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 24 10:59:08.039901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d8a101e4-6d93-401e-a974-d9ed42f49bbb tempest-ComputeTenantNetworksTest-133920427 tempest-ComputeTenantNetworksTest-133920427-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:08.041492 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d8a101e4-6d93-401e-a974-d9ed42f49bbb tempest-ComputeTenantNetworksTest-133920427 tempest-ComputeTenantNetworksTest-133920427-project] 10.222.0.50 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002531 Oct 24 10:59:08.042179 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3022/6075] 10.222.0.50 () {54 vars in 1035 bytes} [Mon Oct 24 10:59:08 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 24 10:59:08.050293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-af269350-0db8-4ec1-b877-549e5ac93939 tempest-ComputeTenantNetworksTest-133920427 tempest-ComputeTenantNetworksTest-133920427-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:08.050902 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-af269350-0db8-4ec1-b877-549e5ac93939 tempest-ComputeTenantNetworksTest-133920427 tempest-ComputeTenantNetworksTest-133920427-project] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 24 10:59:08.051622 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3054/6076] 10.222.0.50 () {54 vars in 1041 bytes} [Mon Oct 24 10:59:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:59:08.061522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d8a101e4-6d93-401e-a974-d9ed42f49bbb tempest-ComputeTenantNetworksTest-133920427 tempest-ComputeTenantNetworksTest-133920427-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:08.062510 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d8a101e4-6d93-401e-a974-d9ed42f49bbb tempest-ComputeTenantNetworksTest-133920427 tempest-ComputeTenantNetworksTest-133920427-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001630 Oct 24 10:59:08.062882 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3023/6077] 10.222.0.50 () {56 vars in 886 bytes} [Mon Oct 24 10:59:08 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 24 10:59:15.573708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fc02a902-7e30-4926-a7aa-d9b4850a7c09 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:59:15.583483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fc02a902-7e30-4926-a7aa-d9b4850a7c09 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:15.601452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fc02a902-7e30-4926-a7aa-d9b4850a7c09 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:15.605560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fc02a902-7e30-4926-a7aa-d9b4850a7c09 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:15.607170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fc02a902-7e30-4926-a7aa-d9b4850a7c09 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:15.611170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fc02a902-7e30-4926-a7aa-d9b4850a7c09 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:15.612928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fc02a902-7e30-4926-a7aa-d9b4850a7c09 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:15.614057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fc02a902-7e30-4926-a7aa-d9b4850a7c09 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:15.753778 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fc02a902-7e30-4926-a7aa-d9b4850a7c09 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "POST /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6/action" status: 200 len: 32644 microversion: 2.1 time: 0.186365 Oct 24 10:59:15.755183 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3055/6078] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:59:15 2022] POST /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6/action => generated 32644 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:59:18.207244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-bc76911a-13b8-4073-92c2-39a0fbd7eff5 req-5e88bd93-1069-448b-b0db-dc061c65f2de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17c2cff3-9bc0-4324-9614-9ab08ef7c6a6", "tag": "849b6b01-61ac-4000-8b6f-118139276577"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:59:18.208035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7157ca2b-486e-44f9-94bb-27767fc2a564 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:18.209426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7157ca2b-486e-44f9-94bb-27767fc2a564 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:18.231965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:59:18.237026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:59:18.246718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7157ca2b-486e-44f9-94bb-27767fc2a564 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:18.250439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7157ca2b-486e-44f9-94bb-27767fc2a564 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:18.255654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7157ca2b-486e-44f9-94bb-27767fc2a564 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:18.258055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7157ca2b-486e-44f9-94bb-27767fc2a564 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:18.259007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7157ca2b-486e-44f9-94bb-27767fc2a564 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:18.260345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7157ca2b-486e-44f9-94bb-27767fc2a564 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:18.260848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-bc76911a-13b8-4073-92c2-39a0fbd7eff5 req-5e88bd93-1069-448b-b0db-dc061c65f2de service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:18.269634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-bc76911a-13b8-4073-92c2-39a0fbd7eff5 req-5e88bd93-1069-448b-b0db-dc061c65f2de service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:18.270634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-bc76911a-13b8-4073-92c2-39a0fbd7eff5 req-5e88bd93-1069-448b-b0db-dc061c65f2de service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:18.309651 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-bc76911a-13b8-4073-92c2-39a0fbd7eff5 req-5e88bd93-1069-448b-b0db-dc061c65f2de service nova] Creating event network-changed:849b6b01-61ac-4000-8b6f-118139276577 for instance 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 on n-h2-858383-15 Oct 24 10:59:18.326842 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-bc76911a-13b8-4073-92c2-39a0fbd7eff5 req-5e88bd93-1069-448b-b0db-dc061c65f2de service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122471 Oct 24 10:59:18.333626 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3056/6079] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:59:18.340759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7157ca2b-486e-44f9-94bb-27767fc2a564 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:59:18.542634 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7157ca2b-486e-44f9-94bb-27767fc2a564 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "DELETE /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6" status: 204 len: 0 microversion: 2.1 time: 0.346401 Oct 24 10:59:18.544377 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3024/6080] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:59:18 2022] DELETE /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:59:18.557052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5a747613-389e-4de4-aa64-66e93401d65f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:18.561640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5a747613-389e-4de4-aa64-66e93401d65f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:18.581747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a747613-389e-4de4-aa64-66e93401d65f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:18.582461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a747613-389e-4de4-aa64-66e93401d65f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:18.584141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a747613-389e-4de4-aa64-66e93401d65f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:18.585096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a747613-389e-4de4-aa64-66e93401d65f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:18.587535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a747613-389e-4de4-aa64-66e93401d65f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:18.588662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a747613-389e-4de4-aa64-66e93401d65f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:18.595478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-883b8e94-4d2f-4d92-8c52-25b50ff78eb6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:18.596192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-883b8e94-4d2f-4d92-8c52-25b50ff78eb6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:18.624667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-883b8e94-4d2f-4d92-8c52-25b50ff78eb6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:18.627685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-883b8e94-4d2f-4d92-8c52-25b50ff78eb6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:18.629838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-883b8e94-4d2f-4d92-8c52-25b50ff78eb6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:18.632299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-883b8e94-4d2f-4d92-8c52-25b50ff78eb6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:18.642293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-883b8e94-4d2f-4d92-8c52-25b50ff78eb6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:18.643453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-883b8e94-4d2f-4d92-8c52-25b50ff78eb6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:19.560720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-883b8e94-4d2f-4d92-8c52-25b50ff78eb6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:19.582585 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-883b8e94-4d2f-4d92-8c52-25b50ff78eb6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1682 microversion: 2.1 time: 0.990406 Oct 24 10:59:19.583803 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3025/6081] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:18 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1682 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:59:19.732362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5a747613-389e-4de4-aa64-66e93401d65f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:19.744302 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5a747613-389e-4de4-aa64-66e93401d65f tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6" status: 200 len: 1670 microversion: 2.1 time: 1.194376 Oct 24 10:59:19.745717 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3057/6082] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:18 2022] GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 => generated 1670 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:19.937490 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cdd59cc6-6ece-4325-a853-863c80c4471a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:59:19.945275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cdd59cc6-6ece-4325-a853-863c80c4471a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:19.959418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cdd59cc6-6ece-4325-a853-863c80c4471a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:19.960139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cdd59cc6-6ece-4325-a853-863c80c4471a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:19.966605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cdd59cc6-6ece-4325-a853-863c80c4471a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:19.967634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cdd59cc6-6ece-4325-a853-863c80c4471a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:19.968280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cdd59cc6-6ece-4325-a853-863c80c4471a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:19.968772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cdd59cc6-6ece-4325-a853-863c80c4471a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:20.084076 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cdd59cc6-6ece-4325-a853-863c80c4471a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd/action" status: 200 len: 32609 microversion: 2.1 time: 0.151309 Oct 24 10:59:20.085236 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3026/6083] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:59:19 2022] POST /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd/action => generated 32609 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:59:20.257925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a7959dd3-0a8a-493c-b3c4-53382a882379 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:20.258945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a7959dd3-0a8a-493c-b3c4-53382a882379 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:20.282127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7959dd3-0a8a-493c-b3c4-53382a882379 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:20.283176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7959dd3-0a8a-493c-b3c4-53382a882379 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:20.284334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7959dd3-0a8a-493c-b3c4-53382a882379 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:20.287421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7959dd3-0a8a-493c-b3c4-53382a882379 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:20.303119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7959dd3-0a8a-493c-b3c4-53382a882379 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:20.304173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7959dd3-0a8a-493c-b3c4-53382a882379 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:20.771872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0c8ec9d5-b451-48f7-90c3-52a75671bc4b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:20.773598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0c8ec9d5-b451-48f7-90c3-52a75671bc4b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:20.790375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c8ec9d5-b451-48f7-90c3-52a75671bc4b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:20.793320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c8ec9d5-b451-48f7-90c3-52a75671bc4b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:20.793934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c8ec9d5-b451-48f7-90c3-52a75671bc4b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:20.799587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c8ec9d5-b451-48f7-90c3-52a75671bc4b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:20.800085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c8ec9d5-b451-48f7-90c3-52a75671bc4b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:20.800655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c8ec9d5-b451-48f7-90c3-52a75671bc4b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:21.190597 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a7959dd3-0a8a-493c-b3c4-53382a882379 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1835 microversion: 2.1 time: 0.938121 Oct 24 10:59:21.204936 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3058/6084] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:20 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1835 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:21.226531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b4f52e90-29c2-43db-a759-89e72b74171d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:59:21.229625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b4f52e90-29c2-43db-a759-89e72b74171d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:21.239197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4f52e90-29c2-43db-a759-89e72b74171d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:21.239839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4f52e90-29c2-43db-a759-89e72b74171d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:21.240297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4f52e90-29c2-43db-a759-89e72b74171d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:21.241066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4f52e90-29c2-43db-a759-89e72b74171d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:21.241528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4f52e90-29c2-43db-a759-89e72b74171d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:21.241959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4f52e90-29c2-43db-a759-89e72b74171d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:21.311950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-b4f52e90-29c2-43db-a759-89e72b74171d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lazy-loading 'flavor' on Instance uuid 86941fe7-4e24-4be2-896a-65f088996bdd {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:59:21.314458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0c8ec9d5-b451-48f7-90c3-52a75671bc4b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:21.329830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b4f52e90-29c2-43db-a759-89e72b74171d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Going to try to live migrate instance to another host {{(pid=120426) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 24 10:59:21.330054 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0c8ec9d5-b451-48f7-90c3-52a75671bc4b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6" status: 200 len: 1670 microversion: 2.1 time: 0.562029 Oct 24 10:59:21.330472 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3027/6085] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:20 2022] GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 => generated 1670 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:22.514661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-584cf5c8-78e0-43f3-a34e-ac0f2f0ce1f7 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Action: 'create', calling method: .version_select at 0x7f04cb9d78b0>, body: {"keypair": {"name": "tempest-keypair-859061108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuFn8RerSgEbAH4xb0cUdXAf7ormfm/fuzOdYOZYA7g5F+lb5Oc3lvWHQIgIgDhLqJGd3xapbHOoc7Cds2UFmSEBTmiBnvf1QQatFgeCFb/k23K6L315yjPkkVvOrdssA=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:59:22.551183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-584cf5c8-78e0-43f3-a34e-ac0f2f0ce1f7 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Getting quotas for project a10ff6644b9b4215b1b7c82b98342a79. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:59:22.557035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-584cf5c8-78e0-43f3-a34e-ac0f2f0ce1f7 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Getting quotas for user da9e4e22dda84476a30e6b6bd27c68a6 and project a10ff6644b9b4215b1b7c82b98342a79. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:59:22.618209 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-584cf5c8-78e0-43f3-a34e-ac0f2f0ce1f7 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.267973 Oct 24 10:59:22.621145 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3028/6086] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 10:59:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:59:22.632707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f3c671d5-2ae4-44b6-944c-232ff3abddc2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:22.634973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f3c671d5-2ae4-44b6-944c-232ff3abddc2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:22.644454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3c671d5-2ae4-44b6-944c-232ff3abddc2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:22.645199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3c671d5-2ae4-44b6-944c-232ff3abddc2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:22.646129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3c671d5-2ae4-44b6-944c-232ff3abddc2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:22.647017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3c671d5-2ae4-44b6-944c-232ff3abddc2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:22.647640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3c671d5-2ae4-44b6-944c-232ff3abddc2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:22.648233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3c671d5-2ae4-44b6-944c-232ff3abddc2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:22.749755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3c671d5-2ae4-44b6-944c-232ff3abddc2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:22.750546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3c671d5-2ae4-44b6-944c-232ff3abddc2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:22.751153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3c671d5-2ae4-44b6-944c-232ff3abddc2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:22.751769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-f3c671d5-2ae4-44b6-944c-232ff3abddc2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lazy-loading 'fault' on Instance uuid 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 10:59:22.908151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f3c671d5-2ae4-44b6-944c-232ff3abddc2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '793d2a1323db49f0b92e36bf0a1b7f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebb2c9f56284e0799a51ae7b5744aeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:22.925791 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f3c671d5-2ae4-44b6-944c-232ff3abddc2 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6" status: 200 len: 1489 microversion: 2.1 time: 0.302566 Oct 24 10:59:22.927148 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3029/6087] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:22 2022] GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 => generated 1489 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:22.941746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d2989b6e-aca2-4398-bacd-713511006226 req-4b207394-820f-4011-9043-f1901678f2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c2cff3-9bc0-4324-9614-9ab08ef7c6a6", "name": "network-vif-deleted", "tag": "849b6b01-61ac-4000-8b6f-118139276577"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:59:22.970128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d2989b6e-aca2-4398-bacd-713511006226 req-4b207394-820f-4011-9043-f1901678f2c2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:22.974412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d2989b6e-aca2-4398-bacd-713511006226 req-4b207394-820f-4011-9043-f1901678f2c2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:22.975832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d2989b6e-aca2-4398-bacd-713511006226 req-4b207394-820f-4011-9043-f1901678f2c2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:23.004951 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d2989b6e-aca2-4398-bacd-713511006226 req-4b207394-820f-4011-9043-f1901678f2c2 service nova] Creating event network-vif-deleted:849b6b01-61ac-4000-8b6f-118139276577 for instance 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 on n-h2-858383-15 Oct 24 10:59:23.020979 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d2989b6e-aca2-4398-bacd-713511006226 req-4b207394-820f-4011-9043-f1901678f2c2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091632 Oct 24 10:59:23.021630 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3030/6088] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:59:23.953862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-64c47b7b-2e3e-40b0-9908-7152f2bfc85b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:23.954439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-64c47b7b-2e3e-40b0-9908-7152f2bfc85b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] [instance: 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:23.970513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64c47b7b-2e3e-40b0-9908-7152f2bfc85b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:23.971016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64c47b7b-2e3e-40b0-9908-7152f2bfc85b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:23.971458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64c47b7b-2e3e-40b0-9908-7152f2bfc85b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:23.972175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64c47b7b-2e3e-40b0-9908-7152f2bfc85b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:23.977691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64c47b7b-2e3e-40b0-9908-7152f2bfc85b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:23.978383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64c47b7b-2e3e-40b0-9908-7152f2bfc85b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:24.008672 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-64c47b7b-2e3e-40b0-9908-7152f2bfc85b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] HTTP exception thrown: Instance 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 could not be found. Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-64c47b7b-2e3e-40b0-9908-7152f2bfc85b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Request method failure captured: Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 HTTP/1.1 Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm7pKn4HG9VNnqi8U3r4YXHcIv--zEJiWTA8urPQBnKI2B9TVmXt3UC-rxPzSEDNcwxw_L8eLXbXr7KgdMXLP78Buew1siRpbCzls7gr6ExQYdLFGRxyBbFQxSgmGd5a-KRSBepVwbI3XDHTci7ri4poXQt_Q8VaUNHDUG8teazsQGI Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: bebb2c9f56284e0799a51ae7b5744aeb Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestNetworkBasicOps-1994842966 Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bebb2c9f56284e0799a51ae7b5744aeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bebb2c9f56284e0799a51ae7b5744aeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bebb2c9f56284e0799a51ae7b5744aeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bebb2c9f56284e0799a51ae7b5744aeb", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestNetworkBasicOps-1994842966 Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: bebb2c9f56284e0799a51ae7b5744aeb Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestNetworkBasicOps-1994842966 Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestNetworkBasicOps-1994842966-project Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 793d2a1323db49f0b92e36bf0a1b7f78 Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestNetworkBasicOps-1994842966-project Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 could not be found. Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '17c2cff3-9bc0-4324-9614-9ab08ef7c6a6'} Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 could not be found. Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 could not be found. Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:59:24.010705 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:59:24.016353 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:59:24.016353 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:59:24.016353 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:59:24.016353 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:59:24.016353 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:59:24.016353 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 could not be found. Oct 24 10:59:24.016353 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:59:24.020478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-64c47b7b-2e3e-40b0-9908-7152f2bfc85b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Returning 404 to user: Instance 17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:59:24.023736 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-64c47b7b-2e3e-40b0-9908-7152f2bfc85b tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6" status: 404 len: 111 microversion: 2.1 time: 0.075647 Oct 24 10:59:24.026460 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3031/6089] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:23 2022] GET /compute/v2.1/servers/17c2cff3-9bc0-4324-9614-9ab08ef7c6a6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:59:24.902877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-39fe7bee-f2f1-4af7-8e82-ecb8217b77c0 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] Calling method '.version_select at 0x7f04cba45430>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:25.000824 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-39fe7bee-f2f1-4af7-8e82-ecb8217b77c0 tempest-TestNetworkBasicOps-1994842966 tempest-TestNetworkBasicOps-1994842966-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1183691877" status: 202 len: 0 microversion: 2.1 time: 0.102123 Oct 24 10:59:25.002486 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3032/6090] 10.222.0.50 () {58 vars in 1257 bytes} [Mon Oct 24 10:59:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1183691877 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 10:59:26.148809 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b4f52e90-29c2-43db-a759-89e72b74171d tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd/action" status: 202 len: 0 microversion: 2.1 time: 4.926130 Oct 24 10:59:26.150372 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3059/6091] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:59:21 2022] POST /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd/action => generated 0 bytes in 4928 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 10:59:26.160188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1b2c5b9c-036a-4c05-9441-c678533e2654 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:26.161607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1b2c5b9c-036a-4c05-9441-c678533e2654 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:26.171933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b2c5b9c-036a-4c05-9441-c678533e2654 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:26.172883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b2c5b9c-036a-4c05-9441-c678533e2654 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:26.173618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b2c5b9c-036a-4c05-9441-c678533e2654 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:26.174598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b2c5b9c-036a-4c05-9441-c678533e2654 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:26.176143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b2c5b9c-036a-4c05-9441-c678533e2654 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:26.176983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b2c5b9c-036a-4c05-9441-c678533e2654 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:26.881424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1b2c5b9c-036a-4c05-9441-c678533e2654 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:26.899152 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1b2c5b9c-036a-4c05-9441-c678533e2654 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1692 microversion: 2.1 time: 0.743573 Oct 24 10:59:26.905001 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3033/6092] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:26 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1692 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:27.929841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a6e4ab41-0f16-4107-9ce9-b05a324cb083 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:27.930426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a6e4ab41-0f16-4107-9ce9-b05a324cb083 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:27.940402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6e4ab41-0f16-4107-9ce9-b05a324cb083 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:27.940916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6e4ab41-0f16-4107-9ce9-b05a324cb083 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:27.941354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6e4ab41-0f16-4107-9ce9-b05a324cb083 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:27.942083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6e4ab41-0f16-4107-9ce9-b05a324cb083 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:27.942523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6e4ab41-0f16-4107-9ce9-b05a324cb083 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:27.942948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a6e4ab41-0f16-4107-9ce9-b05a324cb083 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:28.304425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-957e7ca9-311f-4edb-b83a-b8773eefff78 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1390706176", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b82d466-b601-44d7-abeb-7c2705af48cc"}], "security_groups": [{"name": "tempest-securitygroup--323395139"}], "key_name": "tempest-keypair-859061108", "user_data": "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:59:29.287732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-957e7ca9-311f-4edb-b83a-b8773eefff78 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] validate_networks() for [('6b82d466-b601-44d7-abeb-7c2705af48cc', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 10:59:29.581854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a6e4ab41-0f16-4107-9ce9-b05a324cb083 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:29.594343 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a6e4ab41-0f16-4107-9ce9-b05a324cb083 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1692 microversion: 2.1 time: 1.668417 Oct 24 10:59:29.601161 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3060/6093] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:27 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1692 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:29.608790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-0b4d0c6b-654b-4af6-956b-633429c03399 req-06992f37-2218-4f1f-b8d3-6763b1f7b749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86941fe7-4e24-4be2-896a-65f088996bdd", "name": "network-vif-unplugged", "status": "completed", "tag": "2f8b8cd3-65c1-4f5c-afdf-bd4e36a9ebef"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:59:29.643244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-0b4d0c6b-654b-4af6-956b-633429c03399 req-06992f37-2218-4f1f-b8d3-6763b1f7b749 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:29.643743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-0b4d0c6b-654b-4af6-956b-633429c03399 req-06992f37-2218-4f1f-b8d3-6763b1f7b749 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:29.644193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-0b4d0c6b-654b-4af6-956b-633429c03399 req-06992f37-2218-4f1f-b8d3-6763b1f7b749 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:29.687461 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-0b4d0c6b-654b-4af6-956b-633429c03399 req-06992f37-2218-4f1f-b8d3-6763b1f7b749 service nova] Creating event network-vif-unplugged:2f8b8cd3-65c1-4f5c-afdf-bd4e36a9ebef for instance 86941fe7-4e24-4be2-896a-65f088996bdd on n-h1-858383-15 Oct 24 10:59:29.694739 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-0b4d0c6b-654b-4af6-956b-633429c03399 req-06992f37-2218-4f1f-b8d3-6763b1f7b749 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090201 Oct 24 10:59:29.696742 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3061/6094] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:59:30.627447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fd77e584-7969-4993-92ce-694f9162efeb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:30.628176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fd77e584-7969-4993-92ce-694f9162efeb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:30.643092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd77e584-7969-4993-92ce-694f9162efeb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:30.644705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd77e584-7969-4993-92ce-694f9162efeb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:30.645471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd77e584-7969-4993-92ce-694f9162efeb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:30.650048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd77e584-7969-4993-92ce-694f9162efeb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:30.652730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd77e584-7969-4993-92ce-694f9162efeb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:30.654230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd77e584-7969-4993-92ce-694f9162efeb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:30.906688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-957e7ca9-311f-4edb-b83a-b8773eefff78 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 10:59:30.907255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-957e7ca9-311f-4edb-b83a-b8773eefff78 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 10:59:30.907882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-957e7ca9-311f-4edb-b83a-b8773eefff78 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 10:59:30.908410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-957e7ca9-311f-4edb-b83a-b8773eefff78 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 10:59:30.909966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-957e7ca9-311f-4edb-b83a-b8773eefff78 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 10:59:30.946250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-957e7ca9-311f-4edb-b83a-b8773eefff78 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:30.947086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-957e7ca9-311f-4edb-b83a-b8773eefff78 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:30.947931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-957e7ca9-311f-4edb-b83a-b8773eefff78 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:30.950098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-957e7ca9-311f-4edb-b83a-b8773eefff78 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:30.961205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-957e7ca9-311f-4edb-b83a-b8773eefff78 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:30.962932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-957e7ca9-311f-4edb-b83a-b8773eefff78 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:31.015215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-957e7ca9-311f-4edb-b83a-b8773eefff78 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Getting quotas for project a10ff6644b9b4215b1b7c82b98342a79. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 10:59:31.025417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-957e7ca9-311f-4edb-b83a-b8773eefff78 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Getting quotas for user da9e4e22dda84476a30e6b6bd27c68a6 and project a10ff6644b9b4215b1b7c82b98342a79. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 10:59:31.071409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-957e7ca9-311f-4edb-b83a-b8773eefff78 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 10:59:31.079265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-957e7ca9-311f-4edb-b83a-b8773eefff78 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 10:59:31.218952 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-957e7ca9-311f-4edb-b83a-b8773eefff78 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.918911 Oct 24 10:59:31.224003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fd77e584-7969-4993-92ce-694f9162efeb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:31.234664 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fd77e584-7969-4993-92ce-694f9162efeb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1692 microversion: 2.1 time: 0.612560 Oct 24 10:59:31.239839 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3062/6096] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:30 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1692 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:31.239988 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3034/6096] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 10:59:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 2938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 10:59:31.247967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-46accb59-3967-40ef-9e7c-f7716b7c325f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:31.254861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-46accb59-3967-40ef-9e7c-f7716b7c325f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:31.515688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-46accb59-3967-40ef-9e7c-f7716b7c325f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:31.524300 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-46accb59-3967-40ef-9e7c-f7716b7c325f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 200 len: 1241 microversion: 2.1 time: 0.280033 Oct 24 10:59:31.528977 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3063/6097] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:31 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 1241 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:31.720082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-fa388ec4-da43-4811-8e6e-c63eb9567dee req-54476371-b6e5-4022-9523-3f22993168eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86941fe7-4e24-4be2-896a-65f088996bdd", "tag": "2f8b8cd3-65c1-4f5c-afdf-bd4e36a9ebef"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:59:31.742171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fa388ec4-da43-4811-8e6e-c63eb9567dee req-54476371-b6e5-4022-9523-3f22993168eb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:31.742675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fa388ec4-da43-4811-8e6e-c63eb9567dee req-54476371-b6e5-4022-9523-3f22993168eb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:31.743327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fa388ec4-da43-4811-8e6e-c63eb9567dee req-54476371-b6e5-4022-9523-3f22993168eb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:31.767029 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-fa388ec4-da43-4811-8e6e-c63eb9567dee req-54476371-b6e5-4022-9523-3f22993168eb service nova] Creating event network-changed:2f8b8cd3-65c1-4f5c-afdf-bd4e36a9ebef for instance 86941fe7-4e24-4be2-896a-65f088996bdd on n-h1-858383-15 Oct 24 10:59:31.773359 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-fa388ec4-da43-4811-8e6e-c63eb9567dee req-54476371-b6e5-4022-9523-3f22993168eb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059267 Oct 24 10:59:31.775207 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3035/6098] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:59:32.284593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6588591e-26ff-416a-9e88-47722016029c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:32.284593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6588591e-26ff-416a-9e88-47722016029c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:32.297127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6588591e-26ff-416a-9e88-47722016029c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:32.297775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6588591e-26ff-416a-9e88-47722016029c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:32.298397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6588591e-26ff-416a-9e88-47722016029c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:32.299830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6588591e-26ff-416a-9e88-47722016029c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:32.299830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6588591e-26ff-416a-9e88-47722016029c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:32.300334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6588591e-26ff-416a-9e88-47722016029c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:32.555391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d167ef39-d24e-4517-b9c7-30370b98ca1d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:32.561058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d167ef39-d24e-4517-b9c7-30370b98ca1d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:32.584176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d167ef39-d24e-4517-b9c7-30370b98ca1d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:32.590262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d167ef39-d24e-4517-b9c7-30370b98ca1d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:32.591194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d167ef39-d24e-4517-b9c7-30370b98ca1d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:32.593897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d167ef39-d24e-4517-b9c7-30370b98ca1d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:32.595208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d167ef39-d24e-4517-b9c7-30370b98ca1d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:32.596210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d167ef39-d24e-4517-b9c7-30370b98ca1d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:33.053493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d167ef39-d24e-4517-b9c7-30370b98ca1d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:33.081036 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d167ef39-d24e-4517-b9c7-30370b98ca1d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 200 len: 1237 microversion: 2.1 time: 0.534170 Oct 24 10:59:33.083003 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3036/6099] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:32 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 1237 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:33.138588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6588591e-26ff-416a-9e88-47722016029c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:33.154650 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6588591e-26ff-416a-9e88-47722016029c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1692 microversion: 2.1 time: 0.884854 Oct 24 10:59:33.155636 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3064/6100] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:32 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1692 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:34.117268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d202c601-fc85-4966-b812-37c0c121a72b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:34.118602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d202c601-fc85-4966-b812-37c0c121a72b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:34.148986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d202c601-fc85-4966-b812-37c0c121a72b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:34.157762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d202c601-fc85-4966-b812-37c0c121a72b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:34.158606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d202c601-fc85-4966-b812-37c0c121a72b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:34.165384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d202c601-fc85-4966-b812-37c0c121a72b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:34.167582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d202c601-fc85-4966-b812-37c0c121a72b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:34.168037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d202c601-fc85-4966-b812-37c0c121a72b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:34.183479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-24f8e7e8-316c-41a4-83a3-40db948d2f23 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:34.185650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-24f8e7e8-316c-41a4-83a3-40db948d2f23 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:34.230979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24f8e7e8-316c-41a4-83a3-40db948d2f23 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:34.231476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24f8e7e8-316c-41a4-83a3-40db948d2f23 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:34.234908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24f8e7e8-316c-41a4-83a3-40db948d2f23 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:34.237442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24f8e7e8-316c-41a4-83a3-40db948d2f23 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:34.240102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24f8e7e8-316c-41a4-83a3-40db948d2f23 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:34.245066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24f8e7e8-316c-41a4-83a3-40db948d2f23 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:34.323364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d202c601-fc85-4966-b812-37c0c121a72b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:34.332681 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d202c601-fc85-4966-b812-37c0c121a72b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 200 len: 1299 microversion: 2.1 time: 0.225023 Oct 24 10:59:34.333917 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3037/6101] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:34 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 1299 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:34.756779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-24f8e7e8-316c-41a4-83a3-40db948d2f23 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:34.769341 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-24f8e7e8-316c-41a4-83a3-40db948d2f23 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1692 microversion: 2.1 time: 0.590720 Oct 24 10:59:34.786504 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3065/6102] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:34 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1692 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:35.359456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d8a902ab-fa66-4197-9a60-5aa31e5ba0d9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:35.360857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d8a902ab-fa66-4197-9a60-5aa31e5ba0d9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:35.375392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8a902ab-fa66-4197-9a60-5aa31e5ba0d9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:35.376202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8a902ab-fa66-4197-9a60-5aa31e5ba0d9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:35.376908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8a902ab-fa66-4197-9a60-5aa31e5ba0d9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:35.377878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8a902ab-fa66-4197-9a60-5aa31e5ba0d9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:35.378540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8a902ab-fa66-4197-9a60-5aa31e5ba0d9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:35.379187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8a902ab-fa66-4197-9a60-5aa31e5ba0d9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:35.792752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4ae0f3f8-ddd0-4531-9fc6-d0348c23d745 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:35.793402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4ae0f3f8-ddd0-4531-9fc6-d0348c23d745 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:35.805680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ae0f3f8-ddd0-4531-9fc6-d0348c23d745 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:35.806172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ae0f3f8-ddd0-4531-9fc6-d0348c23d745 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:35.806612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ae0f3f8-ddd0-4531-9fc6-d0348c23d745 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:35.807333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ae0f3f8-ddd0-4531-9fc6-d0348c23d745 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:35.807787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ae0f3f8-ddd0-4531-9fc6-d0348c23d745 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:35.808211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ae0f3f8-ddd0-4531-9fc6-d0348c23d745 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:35.819417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d8a902ab-fa66-4197-9a60-5aa31e5ba0d9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:35.833479 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d8a902ab-fa66-4197-9a60-5aa31e5ba0d9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 200 len: 1299 microversion: 2.1 time: 0.477898 Oct 24 10:59:35.840354 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3038/6103] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:35 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 1299 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:36.414005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4ae0f3f8-ddd0-4531-9fc6-d0348c23d745 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:36.430396 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4ae0f3f8-ddd0-4531-9fc6-d0348c23d745 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1692 microversion: 2.1 time: 0.641279 Oct 24 10:59:36.449456 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3066/6104] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:35 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1692 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:59:36.867656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-65d11172-3bfe-40bd-8c45-4fe8b49b8445 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:36.868282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-65d11172-3bfe-40bd-8c45-4fe8b49b8445 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:36.877086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65d11172-3bfe-40bd-8c45-4fe8b49b8445 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:36.877579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65d11172-3bfe-40bd-8c45-4fe8b49b8445 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:36.878027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65d11172-3bfe-40bd-8c45-4fe8b49b8445 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:36.878752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65d11172-3bfe-40bd-8c45-4fe8b49b8445 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:36.879210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65d11172-3bfe-40bd-8c45-4fe8b49b8445 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:36.879646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-65d11172-3bfe-40bd-8c45-4fe8b49b8445 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:37.360820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-65d11172-3bfe-40bd-8c45-4fe8b49b8445 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:37.370831 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-65d11172-3bfe-40bd-8c45-4fe8b49b8445 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 200 len: 1366 microversion: 2.1 time: 0.507337 Oct 24 10:59:37.381623 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3039/6105] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:36 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 1366 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:37.455758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fdc3d3e6-5772-4b78-ad30-6f021706c714 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:37.456431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fdc3d3e6-5772-4b78-ad30-6f021706c714 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:37.471372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fdc3d3e6-5772-4b78-ad30-6f021706c714 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:37.471884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fdc3d3e6-5772-4b78-ad30-6f021706c714 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:37.472371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fdc3d3e6-5772-4b78-ad30-6f021706c714 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:37.473092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fdc3d3e6-5772-4b78-ad30-6f021706c714 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:37.473623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fdc3d3e6-5772-4b78-ad30-6f021706c714 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:37.474024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fdc3d3e6-5772-4b78-ad30-6f021706c714 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:37.895551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fdc3d3e6-5772-4b78-ad30-6f021706c714 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:37.913304 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fdc3d3e6-5772-4b78-ad30-6f021706c714 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1692 microversion: 2.1 time: 0.461511 Oct 24 10:59:37.914901 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3067/6106] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:37 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1692 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:38.400386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-042a3e7b-8b6a-402f-80ff-80f028ba55b1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:38.401117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-042a3e7b-8b6a-402f-80ff-80f028ba55b1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:38.417430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-042a3e7b-8b6a-402f-80ff-80f028ba55b1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:38.418188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-042a3e7b-8b6a-402f-80ff-80f028ba55b1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:38.418724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-042a3e7b-8b6a-402f-80ff-80f028ba55b1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:38.419560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-042a3e7b-8b6a-402f-80ff-80f028ba55b1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:38.423392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-042a3e7b-8b6a-402f-80ff-80f028ba55b1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:38.423934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-042a3e7b-8b6a-402f-80ff-80f028ba55b1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:38.943063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3442a977-aa3c-4910-a0e6-25ce0c93d96c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:38.943682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3442a977-aa3c-4910-a0e6-25ce0c93d96c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:38.955792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3442a977-aa3c-4910-a0e6-25ce0c93d96c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:38.956635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3442a977-aa3c-4910-a0e6-25ce0c93d96c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:38.957469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3442a977-aa3c-4910-a0e6-25ce0c93d96c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:38.960025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3442a977-aa3c-4910-a0e6-25ce0c93d96c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:38.961090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3442a977-aa3c-4910-a0e6-25ce0c93d96c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:38.961827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3442a977-aa3c-4910-a0e6-25ce0c93d96c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:39.247519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-042a3e7b-8b6a-402f-80ff-80f028ba55b1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:39.277978 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-042a3e7b-8b6a-402f-80ff-80f028ba55b1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 200 len: 1366 microversion: 2.1 time: 0.883615 Oct 24 10:59:39.278593 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3040/6107] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:38 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 1366 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:39.453528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3442a977-aa3c-4910-a0e6-25ce0c93d96c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:39.463797 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3442a977-aa3c-4910-a0e6-25ce0c93d96c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1692 microversion: 2.1 time: 0.524565 Oct 24 10:59:39.476592 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3068/6108] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:38 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1692 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:59:39.995311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a6839ac8-110f-46a5-867a-869155160a39 req-1a9aa6bc-1e04-468e-bf34-50aaf54c9773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d0cfd3-33a6-473c-8d33-1a7ff418e838", "tag": "03f55c95-9041-4ba1-8725-a0501ce7516b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:59:40.019308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a6839ac8-110f-46a5-867a-869155160a39 req-1a9aa6bc-1e04-468e-bf34-50aaf54c9773 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:40.019787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a6839ac8-110f-46a5-867a-869155160a39 req-1a9aa6bc-1e04-468e-bf34-50aaf54c9773 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:40.022626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a6839ac8-110f-46a5-867a-869155160a39 req-1a9aa6bc-1e04-468e-bf34-50aaf54c9773 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:40.050000 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a6839ac8-110f-46a5-867a-869155160a39 req-1a9aa6bc-1e04-468e-bf34-50aaf54c9773 service nova] Creating event network-changed:03f55c95-9041-4ba1-8725-a0501ce7516b for instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 on n-h1-858383-15 Oct 24 10:59:40.077041 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a6839ac8-110f-46a5-867a-869155160a39 req-1a9aa6bc-1e04-468e-bf34-50aaf54c9773 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084742 Oct 24 10:59:40.077723 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3041/6109] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:59:40.303181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ebfb4dd1-5887-49bc-8101-a86126ea0e07 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:40.308351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ebfb4dd1-5887-49bc-8101-a86126ea0e07 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:40.330634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebfb4dd1-5887-49bc-8101-a86126ea0e07 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:40.331639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebfb4dd1-5887-49bc-8101-a86126ea0e07 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:40.338786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebfb4dd1-5887-49bc-8101-a86126ea0e07 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:40.341066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebfb4dd1-5887-49bc-8101-a86126ea0e07 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:40.343848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebfb4dd1-5887-49bc-8101-a86126ea0e07 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:40.344768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebfb4dd1-5887-49bc-8101-a86126ea0e07 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:40.506890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-614f82de-db98-423e-ade5-7d77febcc144 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:40.508888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-614f82de-db98-423e-ade5-7d77febcc144 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:40.537064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-614f82de-db98-423e-ade5-7d77febcc144 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:40.538230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-614f82de-db98-423e-ade5-7d77febcc144 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:40.539277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-614f82de-db98-423e-ade5-7d77febcc144 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:40.542731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-614f82de-db98-423e-ade5-7d77febcc144 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:40.546739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-614f82de-db98-423e-ade5-7d77febcc144 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:40.547288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-614f82de-db98-423e-ade5-7d77febcc144 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:40.807501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ebfb4dd1-5887-49bc-8101-a86126ea0e07 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:40.827599 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ebfb4dd1-5887-49bc-8101-a86126ea0e07 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 200 len: 1366 microversion: 2.1 time: 0.528580 Oct 24 10:59:40.847138 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3069/6110] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:40 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 1366 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:40.984602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:59:41.042882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=10 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:59:41.057610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-614f82de-db98-423e-ade5-7d77febcc144 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:41.077936 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-614f82de-db98-423e-ade5-7d77febcc144 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1692 microversion: 2.1 time: 0.578280 Oct 24 10:59:41.079550 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3042/6111] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:40 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1692 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:41.852668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:59:41.863459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2795a4cf-002b-44cb-a2f4-d08cd7bfab5b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:41.864889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2795a4cf-002b-44cb-a2f4-d08cd7bfab5b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:41.877391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2795a4cf-002b-44cb-a2f4-d08cd7bfab5b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:41.878118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2795a4cf-002b-44cb-a2f4-d08cd7bfab5b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:41.879126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2795a4cf-002b-44cb-a2f4-d08cd7bfab5b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:41.880752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2795a4cf-002b-44cb-a2f4-d08cd7bfab5b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:41.882137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2795a4cf-002b-44cb-a2f4-d08cd7bfab5b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:41.882920 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2795a4cf-002b-44cb-a2f4-d08cd7bfab5b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:42.104810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f192da52-d2c1-4ab1-80a7-f00cee913c2e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:42.105678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f192da52-d2c1-4ab1-80a7-f00cee913c2e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:42.115018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f192da52-d2c1-4ab1-80a7-f00cee913c2e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:42.115919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f192da52-d2c1-4ab1-80a7-f00cee913c2e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:42.116609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f192da52-d2c1-4ab1-80a7-f00cee913c2e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:42.117636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f192da52-d2c1-4ab1-80a7-f00cee913c2e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:42.118453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f192da52-d2c1-4ab1-80a7-f00cee913c2e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:42.119109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f192da52-d2c1-4ab1-80a7-f00cee913c2e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:42.151319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2795a4cf-002b-44cb-a2f4-d08cd7bfab5b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:42.168084 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2795a4cf-002b-44cb-a2f4-d08cd7bfab5b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 200 len: 1366 microversion: 2.1 time: 0.316838 Oct 24 10:59:42.169389 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3070/6112] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:41 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:42.414070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f192da52-d2c1-4ab1-80a7-f00cee913c2e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:42.428266 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f192da52-d2c1-4ab1-80a7-f00cee913c2e tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1682 microversion: 2.1 time: 0.328377 Oct 24 10:59:42.434189 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3043/6113] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:42 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1682 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:59:42.451991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-03a2412b-3209-400b-bcb2-db5a49bc3302 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:42.452930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-03a2412b-3209-400b-bcb2-db5a49bc3302 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:42.466669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03a2412b-3209-400b-bcb2-db5a49bc3302 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:42.467392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03a2412b-3209-400b-bcb2-db5a49bc3302 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:42.469530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03a2412b-3209-400b-bcb2-db5a49bc3302 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:42.471076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03a2412b-3209-400b-bcb2-db5a49bc3302 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:42.474138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03a2412b-3209-400b-bcb2-db5a49bc3302 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:42.474921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-03a2412b-3209-400b-bcb2-db5a49bc3302 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:42.797666 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-03a2412b-3209-400b-bcb2-db5a49bc3302 tempest-TestNetworkAdvancedServerOps-1063328316 tempest-TestNetworkAdvancedServerOps-1063328316-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1835 microversion: 2.1 time: 0.349657 Oct 24 10:59:42.801261 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3071/6114] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:42 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1835 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:42.831207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-604486d0-46a9-4c71-8fcd-3e1becdae3de tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:42.832222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-604486d0-46a9-4c71-8fcd-3e1becdae3de tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:42.840944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-604486d0-46a9-4c71-8fcd-3e1becdae3de tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:42.842803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-604486d0-46a9-4c71-8fcd-3e1becdae3de tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:42.843855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-604486d0-46a9-4c71-8fcd-3e1becdae3de tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:42.845498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-604486d0-46a9-4c71-8fcd-3e1becdae3de tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:42.846204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-604486d0-46a9-4c71-8fcd-3e1becdae3de tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:42.847140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-604486d0-46a9-4c71-8fcd-3e1becdae3de tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:42.852619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:59:43.149927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-604486d0-46a9-4c71-8fcd-3e1becdae3de tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:43.162850 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-604486d0-46a9-4c71-8fcd-3e1becdae3de tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1682 microversion: 2.1 time: 0.334426 Oct 24 10:59:43.183395 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3044/6115] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:42 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1682 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:43.195290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-baf0228d-470d-400b-b845-3c28c61ba7da tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:43.204402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-baf0228d-470d-400b-b845-3c28c61ba7da tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:43.223653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-baf0228d-470d-400b-b845-3c28c61ba7da tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:43.225225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-baf0228d-470d-400b-b845-3c28c61ba7da tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:43.229114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-baf0228d-470d-400b-b845-3c28c61ba7da tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:43.230557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-baf0228d-470d-400b-b845-3c28c61ba7da tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:43.232277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-baf0228d-470d-400b-b845-3c28c61ba7da tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:43.233267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-baf0228d-470d-400b-b845-3c28c61ba7da tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:43.301505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-554dacd7-4cf4-4616-97a4-f4f3fc5280a5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:59:43.305221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-554dacd7-4cf4-4616-97a4-f4f3fc5280a5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:43.318931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-554dacd7-4cf4-4616-97a4-f4f3fc5280a5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:43.320387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-554dacd7-4cf4-4616-97a4-f4f3fc5280a5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:43.321240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-554dacd7-4cf4-4616-97a4-f4f3fc5280a5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:43.322658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-554dacd7-4cf4-4616-97a4-f4f3fc5280a5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:43.323796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-554dacd7-4cf4-4616-97a4-f4f3fc5280a5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:43.324546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-554dacd7-4cf4-4616-97a4-f4f3fc5280a5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:43.345200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:59:43.517759 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-554dacd7-4cf4-4616-97a4-f4f3fc5280a5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd/action" status: 200 len: 38611 microversion: 2.1 time: 0.229096 Oct 24 10:59:43.519293 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3045/6116] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 10:59:43 2022] POST /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd/action => generated 38611 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 10:59:43.880704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-baf0228d-470d-400b-b845-3c28c61ba7da tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:43.899226 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-baf0228d-470d-400b-b845-3c28c61ba7da tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 200 len: 1366 microversion: 2.1 time: 0.711706 Oct 24 10:59:43.914859 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3072/6117] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:43 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 1366 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:44.929997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e904cfa3-8b56-4ff5-80ed-82af4b812bd2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:44.933919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e904cfa3-8b56-4ff5-80ed-82af4b812bd2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:44.980546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e904cfa3-8b56-4ff5-80ed-82af4b812bd2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:44.984139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e904cfa3-8b56-4ff5-80ed-82af4b812bd2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:44.984651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e904cfa3-8b56-4ff5-80ed-82af4b812bd2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:44.990527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e904cfa3-8b56-4ff5-80ed-82af4b812bd2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:44.991046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e904cfa3-8b56-4ff5-80ed-82af4b812bd2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:44.991495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e904cfa3-8b56-4ff5-80ed-82af4b812bd2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:45.350627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e904cfa3-8b56-4ff5-80ed-82af4b812bd2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:45.366224 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e904cfa3-8b56-4ff5-80ed-82af4b812bd2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 200 len: 1366 microversion: 2.1 time: 0.441909 Oct 24 10:59:45.380645 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3046/6118] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:44 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 1366 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:46.392350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-08bd8fe5-71a8-49e9-9d89-0fa65b983f83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:46.393583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-08bd8fe5-71a8-49e9-9d89-0fa65b983f83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:46.402991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=41 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:59:46.406780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08bd8fe5-71a8-49e9-9d89-0fa65b983f83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:46.408771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08bd8fe5-71a8-49e9-9d89-0fa65b983f83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:46.410076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08bd8fe5-71a8-49e9-9d89-0fa65b983f83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:46.411373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08bd8fe5-71a8-49e9-9d89-0fa65b983f83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:46.412242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08bd8fe5-71a8-49e9-9d89-0fa65b983f83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:46.412953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08bd8fe5-71a8-49e9-9d89-0fa65b983f83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:47.030963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8d3ea8a9-ffc3-437d-9379-5d67e41f7ba5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:47.031497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8d3ea8a9-ffc3-437d-9379-5d67e41f7ba5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:47.043751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d3ea8a9-ffc3-437d-9379-5d67e41f7ba5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:47.044251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d3ea8a9-ffc3-437d-9379-5d67e41f7ba5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:47.044985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d3ea8a9-ffc3-437d-9379-5d67e41f7ba5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:47.049366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d3ea8a9-ffc3-437d-9379-5d67e41f7ba5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:47.049978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d3ea8a9-ffc3-437d-9379-5d67e41f7ba5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:47.050701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d3ea8a9-ffc3-437d-9379-5d67e41f7ba5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:47.103458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8d3ea8a9-ffc3-437d-9379-5d67e41f7ba5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 10:59:47.150014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-08bd8fe5-71a8-49e9-9d89-0fa65b983f83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:47.162109 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-08bd8fe5-71a8-49e9-9d89-0fa65b983f83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 200 len: 1366 microversion: 2.1 time: 0.775248 Oct 24 10:59:47.169014 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3073/6119] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:46 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 1366 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:47.185355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-8308371a-3b23-45e2-a1f8-8efbc12383bc req-ac85b1da-eb8b-4be2-a066-1881102a0115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86941fe7-4e24-4be2-896a-65f088996bdd", "tag": "2f8b8cd3-65c1-4f5c-afdf-bd4e36a9ebef"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:59:47.231394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8308371a-3b23-45e2-a1f8-8efbc12383bc req-ac85b1da-eb8b-4be2-a066-1881102a0115 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:47.234236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8308371a-3b23-45e2-a1f8-8efbc12383bc req-ac85b1da-eb8b-4be2-a066-1881102a0115 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:47.235024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8308371a-3b23-45e2-a1f8-8efbc12383bc req-ac85b1da-eb8b-4be2-a066-1881102a0115 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:47.253414 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-8308371a-3b23-45e2-a1f8-8efbc12383bc req-ac85b1da-eb8b-4be2-a066-1881102a0115 service nova] Creating event network-changed:2f8b8cd3-65c1-4f5c-afdf-bd4e36a9ebef for instance 86941fe7-4e24-4be2-896a-65f088996bdd on n-h2-858383-15 Oct 24 10:59:47.260166 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-8308371a-3b23-45e2-a1f8-8efbc12383bc req-ac85b1da-eb8b-4be2-a066-1881102a0115 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084272 Oct 24 10:59:47.261704 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3074/6120] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:59:47.319644 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8d3ea8a9-ffc3-437d-9379-5d67e41f7ba5 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "DELETE /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 204 len: 0 microversion: 2.1 time: 0.293319 Oct 24 10:59:47.321379 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3047/6121] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 10:59:47 2022] DELETE /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 10:59:47.338420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b6d31e51-6e94-47c5-bfac-10c7bacc64ed tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:47.339186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b6d31e51-6e94-47c5-bfac-10c7bacc64ed tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:47.353949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6d31e51-6e94-47c5-bfac-10c7bacc64ed tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:47.357317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6d31e51-6e94-47c5-bfac-10c7bacc64ed tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:47.359828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6d31e51-6e94-47c5-bfac-10c7bacc64ed tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:47.361800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6d31e51-6e94-47c5-bfac-10c7bacc64ed tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:47.364308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6d31e51-6e94-47c5-bfac-10c7bacc64ed tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:47.365415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6d31e51-6e94-47c5-bfac-10c7bacc64ed tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:47.730712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a3badb2a-7603-46b1-8ce6-6f3b0dc059eb req-6393ccf0-6cca-4f49-baba-10acbe2021fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d0cfd3-33a6-473c-8d33-1a7ff418e838", "name": "network-vif-plugged", "status": "completed", "tag": "03f55c95-9041-4ba1-8725-a0501ce7516b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:59:47.760008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a3badb2a-7603-46b1-8ce6-6f3b0dc059eb req-6393ccf0-6cca-4f49-baba-10acbe2021fd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:47.760769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a3badb2a-7603-46b1-8ce6-6f3b0dc059eb req-6393ccf0-6cca-4f49-baba-10acbe2021fd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:47.761518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a3badb2a-7603-46b1-8ce6-6f3b0dc059eb req-6393ccf0-6cca-4f49-baba-10acbe2021fd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:47.797299 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a3badb2a-7603-46b1-8ce6-6f3b0dc059eb req-6393ccf0-6cca-4f49-baba-10acbe2021fd service nova] Creating event network-vif-plugged:03f55c95-9041-4ba1-8725-a0501ce7516b for instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 on n-h1-858383-15 Oct 24 10:59:47.806735 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a3badb2a-7603-46b1-8ce6-6f3b0dc059eb req-6393ccf0-6cca-4f49-baba-10acbe2021fd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080508 Oct 24 10:59:47.809702 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3048/6122] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:59:48.188664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e4fb45a5-75ba-41d9-a0cf-10e08740f351 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:48.189656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e4fb45a5-75ba-41d9-a0cf-10e08740f351 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:48.201194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4fb45a5-75ba-41d9-a0cf-10e08740f351 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:48.205468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4fb45a5-75ba-41d9-a0cf-10e08740f351 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:48.206000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4fb45a5-75ba-41d9-a0cf-10e08740f351 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:48.206934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4fb45a5-75ba-41d9-a0cf-10e08740f351 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:48.207570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4fb45a5-75ba-41d9-a0cf-10e08740f351 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:48.208469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4fb45a5-75ba-41d9-a0cf-10e08740f351 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:48.863488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b6d31e51-6e94-47c5-bfac-10c7bacc64ed tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:48.876814 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b6d31e51-6e94-47c5-bfac-10c7bacc64ed tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 200 len: 1688 microversion: 2.1 time: 1.547576 Oct 24 10:59:48.894220 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3075/6123] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:47 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 1688 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:49.310443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e4fb45a5-75ba-41d9-a0cf-10e08740f351 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:49.333856 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e4fb45a5-75ba-41d9-a0cf-10e08740f351 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 200 len: 1366 microversion: 2.1 time: 1.149691 Oct 24 10:59:49.351061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-1d7b0000-bd1f-4e40-8963-09fb5c3884db req-e7d4df65-7d60-4cf5-8bd8-1731df76e40e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86941fe7-4e24-4be2-896a-65f088996bdd", "name": "network-vif-deleted", "tag": "2f8b8cd3-65c1-4f5c-afdf-bd4e36a9ebef"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:59:49.355671 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3049/6124] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:48 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 1366 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 10:59:49.387020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1d7b0000-bd1f-4e40-8963-09fb5c3884db req-e7d4df65-7d60-4cf5-8bd8-1731df76e40e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:49.387513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1d7b0000-bd1f-4e40-8963-09fb5c3884db req-e7d4df65-7d60-4cf5-8bd8-1731df76e40e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:49.387945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1d7b0000-bd1f-4e40-8963-09fb5c3884db req-e7d4df65-7d60-4cf5-8bd8-1731df76e40e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:49.450412 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-1d7b0000-bd1f-4e40-8963-09fb5c3884db req-e7d4df65-7d60-4cf5-8bd8-1731df76e40e service nova] Creating event network-vif-deleted:2f8b8cd3-65c1-4f5c-afdf-bd4e36a9ebef for instance 86941fe7-4e24-4be2-896a-65f088996bdd on n-h2-858383-15 Oct 24 10:59:49.462513 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-1d7b0000-bd1f-4e40-8963-09fb5c3884db req-e7d4df65-7d60-4cf5-8bd8-1731df76e40e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135567 Oct 24 10:59:49.463402 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3076/6125] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 10:59:49.906415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b96b22fc-7eac-4d80-8d7f-30b6c10717b2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:49.907735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b96b22fc-7eac-4d80-8d7f-30b6c10717b2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 86941fe7-4e24-4be2-896a-65f088996bdd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:49.917963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:59:49.940159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b96b22fc-7eac-4d80-8d7f-30b6c10717b2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:49.941887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b96b22fc-7eac-4d80-8d7f-30b6c10717b2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:49.943872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b96b22fc-7eac-4d80-8d7f-30b6c10717b2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:49.945261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b96b22fc-7eac-4d80-8d7f-30b6c10717b2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:49.947305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b96b22fc-7eac-4d80-8d7f-30b6c10717b2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:49.948215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b96b22fc-7eac-4d80-8d7f-30b6c10717b2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:49.973171 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-b96b22fc-7eac-4d80-8d7f-30b6c10717b2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] HTTP exception thrown: Instance 86941fe7-4e24-4be2-896a-65f088996bdd could not be found. Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b96b22fc-7eac-4d80-8d7f-30b6c10717b2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Request method failure captured: Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd HTTP/1.1 Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm3GX82MAk9t_DY3ldBvJqgw4krRRZI91P4i_Ha4QFlAFzgtY357SWlZo2bmt5yQ4BdbJCOJlqOV_m4WkwsNVJwqhdGf2Mb8PfZodPxM72kQRMnwEV3JRp9SnBdSvplatZoPBEyBaXBcJ4mHkyjNtrR7UqU0ub2iwqP0g4u9U6TTz9c Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 45405624633e404ab2d6ff26482a150e Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-626774974 Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/45405624633e404ab2d6ff26482a150e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/45405624633e404ab2d6ff26482a150e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/45405624633e404ab2d6ff26482a150e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_45405624633e404ab2d6ff26482a150e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestNetworkAdvancedServerOps-626774974 Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 45405624633e404ab2d6ff26482a150e Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-626774974 Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestNetworkAdvancedServerOps-626774974-project Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: cdae8836f9784dff90fea5201fd15d1d Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestNetworkAdvancedServerOps-626774974-project Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 86941fe7-4e24-4be2-896a-65f088996bdd could not be found. Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '86941fe7-4e24-4be2-896a-65f088996bdd'} Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86941fe7-4e24-4be2-896a-65f088996bdd could not be found. Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86941fe7-4e24-4be2-896a-65f088996bdd could not be found. Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:59:49.976940 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 10:59:49.985333 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:59:49.985333 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 10:59:49.985333 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 10:59:49.985333 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 10:59:49.985333 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 10:59:49.985333 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 10:59:49.985333 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86941fe7-4e24-4be2-896a-65f088996bdd could not be found. Oct 24 10:59:49.985333 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 10:59:49.985333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b96b22fc-7eac-4d80-8d7f-30b6c10717b2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Returning 404 to user: Instance 86941fe7-4e24-4be2-896a-65f088996bdd could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 10:59:49.985333 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b96b22fc-7eac-4d80-8d7f-30b6c10717b2 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd" status: 404 len: 111 microversion: 2.1 time: 0.081913 Oct 24 10:59:49.985333 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3050/6126] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:49 2022] GET /compute/v2.1/servers/86941fe7-4e24-4be2-896a-65f088996bdd => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 10:59:50.368230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fe2d983c-ed2e-4008-87d8-efc10525882b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:50.369888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fe2d983c-ed2e-4008-87d8-efc10525882b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:50.389994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe2d983c-ed2e-4008-87d8-efc10525882b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:50.390857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe2d983c-ed2e-4008-87d8-efc10525882b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:50.391678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe2d983c-ed2e-4008-87d8-efc10525882b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:50.392632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe2d983c-ed2e-4008-87d8-efc10525882b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:50.393478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe2d983c-ed2e-4008-87d8-efc10525882b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:50.394194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe2d983c-ed2e-4008-87d8-efc10525882b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:51.213014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fe2d983c-ed2e-4008-87d8-efc10525882b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 10:59:51.226592 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fe2d983c-ed2e-4008-87d8-efc10525882b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 200 len: 1556 microversion: 2.1 time: 0.865624 Oct 24 10:59:51.257513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f06b56a3-18b3-4f87-814d-7ffebc7ad513 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 10:59:51.258131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f06b56a3-18b3-4f87-814d-7ffebc7ad513 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 10:59:51.266287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f06b56a3-18b3-4f87-814d-7ffebc7ad513 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:51.266903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f06b56a3-18b3-4f87-814d-7ffebc7ad513 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:51.269209 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3077/6127] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 10:59:50 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 1556 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 10:59:51.269409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f06b56a3-18b3-4f87-814d-7ffebc7ad513 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:51.270133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f06b56a3-18b3-4f87-814d-7ffebc7ad513 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:51.271173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f06b56a3-18b3-4f87-814d-7ffebc7ad513 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:51.273078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f06b56a3-18b3-4f87-814d-7ffebc7ad513 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:51.596154 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f06b56a3-18b3-4f87-814d-7ffebc7ad513 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.343275 Oct 24 10:59:51.598010 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3051/6128] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 10:59:51 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-interface => generated 284 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 10:59:55.339040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-1f754c3b-8ced-4471-952f-f711f19e1cd4 req-a6c1d8f4-0ce5-4137-be52-d566274f0629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d0cfd3-33a6-473c-8d33-1a7ff418e838", "tag": "03f55c95-9041-4ba1-8725-a0501ce7516b"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 10:59:55.368268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1f754c3b-8ced-4471-952f-f711f19e1cd4 req-a6c1d8f4-0ce5-4137-be52-d566274f0629 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 10:59:55.368761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1f754c3b-8ced-4471-952f-f711f19e1cd4 req-a6c1d8f4-0ce5-4137-be52-d566274f0629 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 10:59:55.369237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1f754c3b-8ced-4471-952f-f711f19e1cd4 req-a6c1d8f4-0ce5-4137-be52-d566274f0629 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 10:59:55.436949 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-1f754c3b-8ced-4471-952f-f711f19e1cd4 req-a6c1d8f4-0ce5-4137-be52-d566274f0629 service nova] Creating event network-changed:03f55c95-9041-4ba1-8725-a0501ce7516b for instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 on n-h1-858383-15 Oct 24 10:59:55.456233 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-1f754c3b-8ced-4471-952f-f711f19e1cd4 req-a6c1d8f4-0ce5-4137-be52-d566274f0629 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118563 Oct 24 10:59:55.460821 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3078/6129] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 10:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:00:00.723625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b3e040c-e1ef-4928-a69d-a53b3e312d38 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '.version_select at 0x7f04cb9bfb80>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:00:00.769560 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6b3e040c-e1ef-4928-a69d-a53b3e312d38 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-254497017" status: 202 len: 0 microversion: 2.1 time: 0.053196 Oct 24 11:00:00.770309 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3052/6130] 10.222.0.50 () {58 vars in 1281 bytes} [Mon Oct 24 11:00:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-254497017 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:00:00.796723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-10111a75-7241-4156-bfe9-9477c2a6cab8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'create', calling method: .version_select at 0x7f04d0618160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1592495439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwey/0Uou1OnKc5jLP/d+NicMxsl03fFycbpz/xeYFZKQzkViy7SiZ3CPsLZi9mDSUnOctYdACsHIZ1HFCGbYbD+W1VBnnKanHS8s2vkfrHf5YQYpjEYmT0RMFigx4J6g=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:00:00.838635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-10111a75-7241-4156-bfe9-9477c2a6cab8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Getting quotas for project 45405624633e404ab2d6ff26482a150e. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:00:00.856162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-10111a75-7241-4156-bfe9-9477c2a6cab8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Getting quotas for user cdae8836f9784dff90fea5201fd15d1d and project 45405624633e404ab2d6ff26482a150e. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:00:00.910894 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-10111a75-7241-4156-bfe9-9477c2a6cab8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.119841 Oct 24 11:00:00.918071 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3079/6131] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:00:00 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:00:19.138068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:00:19.147216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:00:19.882522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-19f5d5b5-5efa-4f3b-bb92-2c171aef7509 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-902652631", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "39150536-ca62-49cc-8527-65a5e9b05182"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1592495439", "security_groups": [{"name": "tempest-secgroup-smoke-1449015091"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:00:20.164282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-19f5d5b5-5efa-4f3b-bb92-2c171aef7509 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] validate_networks() for [('39150536-ca62-49cc-8527-65a5e9b05182', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:00:20.977009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-19f5d5b5-5efa-4f3b-bb92-2c171aef7509 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:00:20.978781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-19f5d5b5-5efa-4f3b-bb92-2c171aef7509 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:00:20.979328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-19f5d5b5-5efa-4f3b-bb92-2c171aef7509 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:00:20.979755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-19f5d5b5-5efa-4f3b-bb92-2c171aef7509 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:00:20.980227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-19f5d5b5-5efa-4f3b-bb92-2c171aef7509 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:00:21.002372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19f5d5b5-5efa-4f3b-bb92-2c171aef7509 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:21.003145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19f5d5b5-5efa-4f3b-bb92-2c171aef7509 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:21.004201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19f5d5b5-5efa-4f3b-bb92-2c171aef7509 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:21.005202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19f5d5b5-5efa-4f3b-bb92-2c171aef7509 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:21.006305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19f5d5b5-5efa-4f3b-bb92-2c171aef7509 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:21.007013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19f5d5b5-5efa-4f3b-bb92-2c171aef7509 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:21.042314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-19f5d5b5-5efa-4f3b-bb92-2c171aef7509 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Getting quotas for project 45405624633e404ab2d6ff26482a150e. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:00:21.050496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-19f5d5b5-5efa-4f3b-bb92-2c171aef7509 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Getting quotas for user cdae8836f9784dff90fea5201fd15d1d and project 45405624633e404ab2d6ff26482a150e. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:00:21.072396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-19f5d5b5-5efa-4f3b-bb92-2c171aef7509 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:00:21.075557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-19f5d5b5-5efa-4f3b-bb92-2c171aef7509 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:00:21.159480 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-19f5d5b5-5efa-4f3b-bb92-2c171aef7509 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.022121 Oct 24 11:00:21.168904 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3053/6132] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:00:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 2030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:00:21.178037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2dc4edb6-16d3-41f0-89d6-08c45d8d3876 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:00:21.178774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2dc4edb6-16d3-41f0-89d6-08c45d8d3876 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:00:21.181135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=26 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:00:21.183181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:00:21.187164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:00:21.466676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2dc4edb6-16d3-41f0-89d6-08c45d8d3876 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:00:21.475302 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2dc4edb6-16d3-41f0-89d6-08c45d8d3876 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1266 microversion: 2.1 time: 0.301375 Oct 24 11:00:21.479632 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3080/6133] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:00:21 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:00:22.500807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fc69844a-5c6c-4fde-b664-ef737cc3ae3d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:00:22.501484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fc69844a-5c6c-4fde-b664-ef737cc3ae3d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:00:22.516186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc69844a-5c6c-4fde-b664-ef737cc3ae3d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:22.516687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc69844a-5c6c-4fde-b664-ef737cc3ae3d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:22.517253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc69844a-5c6c-4fde-b664-ef737cc3ae3d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:22.525332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc69844a-5c6c-4fde-b664-ef737cc3ae3d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:22.526029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc69844a-5c6c-4fde-b664-ef737cc3ae3d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:22.526656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fc69844a-5c6c-4fde-b664-ef737cc3ae3d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:22.726990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fc69844a-5c6c-4fde-b664-ef737cc3ae3d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:00:22.747663 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fc69844a-5c6c-4fde-b664-ef737cc3ae3d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1262 microversion: 2.1 time: 0.246051 Oct 24 11:00:22.752618 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3054/6134] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:00:22 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1262 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:00:23.777121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-481a0765-0922-4b72-9ed1-a47546f7694d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:00:23.778043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-481a0765-0922-4b72-9ed1-a47546f7694d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:00:23.800329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-481a0765-0922-4b72-9ed1-a47546f7694d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:23.801848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-481a0765-0922-4b72-9ed1-a47546f7694d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:23.802781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-481a0765-0922-4b72-9ed1-a47546f7694d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:23.806507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-481a0765-0922-4b72-9ed1-a47546f7694d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:23.807194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-481a0765-0922-4b72-9ed1-a47546f7694d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:23.809541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-481a0765-0922-4b72-9ed1-a47546f7694d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:23.951330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-481a0765-0922-4b72-9ed1-a47546f7694d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:00:23.970438 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-481a0765-0922-4b72-9ed1-a47546f7694d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1324 microversion: 2.1 time: 0.198458 Oct 24 11:00:23.972352 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3081/6135] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:00:23 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1324 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:00:24.997509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c9372d44-8228-41a7-a004-961df512e117 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:00:24.998808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c9372d44-8228-41a7-a004-961df512e117 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:00:25.012355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9372d44-8228-41a7-a004-961df512e117 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:25.012877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9372d44-8228-41a7-a004-961df512e117 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:25.013327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9372d44-8228-41a7-a004-961df512e117 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:25.022031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9372d44-8228-41a7-a004-961df512e117 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:25.022553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9372d44-8228-41a7-a004-961df512e117 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:25.023006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9372d44-8228-41a7-a004-961df512e117 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:25.450866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c9372d44-8228-41a7-a004-961df512e117 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:00:25.459183 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c9372d44-8228-41a7-a004-961df512e117 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1392 microversion: 2.1 time: 0.465896 Oct 24 11:00:25.464798 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3055/6136] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:00:24 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1392 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:00:26.486228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-47f8a622-a688-4bca-8779-4017455db356 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:00:26.487501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-47f8a622-a688-4bca-8779-4017455db356 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:00:26.501845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47f8a622-a688-4bca-8779-4017455db356 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:26.503372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47f8a622-a688-4bca-8779-4017455db356 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:26.507448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47f8a622-a688-4bca-8779-4017455db356 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:26.512582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47f8a622-a688-4bca-8779-4017455db356 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:26.512582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47f8a622-a688-4bca-8779-4017455db356 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:26.512582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47f8a622-a688-4bca-8779-4017455db356 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:26.834725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-47f8a622-a688-4bca-8779-4017455db356 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:00:26.843956 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-47f8a622-a688-4bca-8779-4017455db356 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1392 microversion: 2.1 time: 0.361785 Oct 24 11:00:26.848184 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3082/6137] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:00:26 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1392 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:00:27.872770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-57b71c2e-4c0c-4a56-92e9-64116580df6a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:00:27.874368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-57b71c2e-4c0c-4a56-92e9-64116580df6a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:00:27.889887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57b71c2e-4c0c-4a56-92e9-64116580df6a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:27.891854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57b71c2e-4c0c-4a56-92e9-64116580df6a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:27.893095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57b71c2e-4c0c-4a56-92e9-64116580df6a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:27.895302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57b71c2e-4c0c-4a56-92e9-64116580df6a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:27.897219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57b71c2e-4c0c-4a56-92e9-64116580df6a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:27.898034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-57b71c2e-4c0c-4a56-92e9-64116580df6a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:28.100001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-b13d44b7-7af2-4ada-9381-c4154e063976 req-0efe85cc-81ca-4cb8-b403-0e9642c2d7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882", "tag": "8217556b-199a-4877-b73c-71c827fe8a70"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:00:28.131067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b13d44b7-7af2-4ada-9381-c4154e063976 req-0efe85cc-81ca-4cb8-b403-0e9642c2d7e2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:28.131777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b13d44b7-7af2-4ada-9381-c4154e063976 req-0efe85cc-81ca-4cb8-b403-0e9642c2d7e2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:28.132381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b13d44b7-7af2-4ada-9381-c4154e063976 req-0efe85cc-81ca-4cb8-b403-0e9642c2d7e2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:28.146719 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-b13d44b7-7af2-4ada-9381-c4154e063976 req-0efe85cc-81ca-4cb8-b403-0e9642c2d7e2 service nova] Creating event network-changed:8217556b-199a-4877-b73c-71c827fe8a70 for instance 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 on n-h2-858383-15 Oct 24 11:00:28.159579 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-b13d44b7-7af2-4ada-9381-c4154e063976 req-0efe85cc-81ca-4cb8-b403-0e9642c2d7e2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065878 Oct 24 11:00:28.161154 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3083/6138] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:00:28.275267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-57b71c2e-4c0c-4a56-92e9-64116580df6a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:00:28.292454 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-57b71c2e-4c0c-4a56-92e9-64116580df6a tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1392 microversion: 2.1 time: 0.422079 Oct 24 11:00:28.294958 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3056/6139] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:00:27 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1392 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:00:29.324280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cfd1aa76-1fe5-4d91-855a-5962d9db4611 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:00:29.327192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cfd1aa76-1fe5-4d91-855a-5962d9db4611 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:00:29.348174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfd1aa76-1fe5-4d91-855a-5962d9db4611 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:29.349647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfd1aa76-1fe5-4d91-855a-5962d9db4611 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:29.350402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfd1aa76-1fe5-4d91-855a-5962d9db4611 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:29.351955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfd1aa76-1fe5-4d91-855a-5962d9db4611 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:29.352708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfd1aa76-1fe5-4d91-855a-5962d9db4611 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:29.354279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfd1aa76-1fe5-4d91-855a-5962d9db4611 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:29.760682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cfd1aa76-1fe5-4d91-855a-5962d9db4611 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:00:29.771717 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cfd1aa76-1fe5-4d91-855a-5962d9db4611 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1392 microversion: 2.1 time: 0.455948 Oct 24 11:00:29.773333 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3084/6140] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:00:29 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1392 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:00:30.797209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fdb1c12d-881d-4fdf-86e3-4ee5127341eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:00:30.798675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fdb1c12d-881d-4fdf-86e3-4ee5127341eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:00:30.806597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdb1c12d-881d-4fdf-86e3-4ee5127341eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:30.807411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdb1c12d-881d-4fdf-86e3-4ee5127341eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:30.808073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdb1c12d-881d-4fdf-86e3-4ee5127341eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:30.809099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdb1c12d-881d-4fdf-86e3-4ee5127341eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:30.810021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdb1c12d-881d-4fdf-86e3-4ee5127341eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:30.810970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fdb1c12d-881d-4fdf-86e3-4ee5127341eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:31.025789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:00:31.038551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fdb1c12d-881d-4fdf-86e3-4ee5127341eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:00:31.059690 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fdb1c12d-881d-4fdf-86e3-4ee5127341eb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1392 microversion: 2.1 time: 0.267490 Oct 24 11:00:31.069993 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3057/6141] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:00:30 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1392 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:00:32.087840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-22a4b4f8-53ea-4ced-92f9-f250ce81a60d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:00:32.090325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-22a4b4f8-53ea-4ced-92f9-f250ce81a60d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:00:32.094141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:00:32.110778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22a4b4f8-53ea-4ced-92f9-f250ce81a60d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:32.111153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22a4b4f8-53ea-4ced-92f9-f250ce81a60d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:32.111600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22a4b4f8-53ea-4ced-92f9-f250ce81a60d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:32.112325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22a4b4f8-53ea-4ced-92f9-f250ce81a60d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:32.112787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22a4b4f8-53ea-4ced-92f9-f250ce81a60d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:32.113251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22a4b4f8-53ea-4ced-92f9-f250ce81a60d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:32.455573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-22a4b4f8-53ea-4ced-92f9-f250ce81a60d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:00:32.464322 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-22a4b4f8-53ea-4ced-92f9-f250ce81a60d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1392 microversion: 2.1 time: 0.381251 Oct 24 11:00:32.465463 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3085/6142] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:00:32 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1392 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:00:33.494388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c58c09e3-3e85-4d5a-9c1f-7fca400fb65c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:00:33.497201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c58c09e3-3e85-4d5a-9c1f-7fca400fb65c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:00:33.515860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:00:33.521778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c58c09e3-3e85-4d5a-9c1f-7fca400fb65c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:33.522438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c58c09e3-3e85-4d5a-9c1f-7fca400fb65c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:33.523064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c58c09e3-3e85-4d5a-9c1f-7fca400fb65c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:33.523893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c58c09e3-3e85-4d5a-9c1f-7fca400fb65c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:33.525192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c58c09e3-3e85-4d5a-9c1f-7fca400fb65c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:33.528908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c58c09e3-3e85-4d5a-9c1f-7fca400fb65c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:33.747694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c58c09e3-3e85-4d5a-9c1f-7fca400fb65c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:00:33.756720 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c58c09e3-3e85-4d5a-9c1f-7fca400fb65c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1392 microversion: 2.1 time: 0.273109 Oct 24 11:00:33.762042 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3058/6143] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:00:33 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1392 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:00:34.621331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-d5102c55-02cc-458b-8db3-8d3f40602dcc req-825dce1c-c02d-4673-a409-1ada8e1ae5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882", "name": "network-vif-plugged", "status": "completed", "tag": "8217556b-199a-4877-b73c-71c827fe8a70"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:00:34.650590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d5102c55-02cc-458b-8db3-8d3f40602dcc req-825dce1c-c02d-4673-a409-1ada8e1ae5c7 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:34.653156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d5102c55-02cc-458b-8db3-8d3f40602dcc req-825dce1c-c02d-4673-a409-1ada8e1ae5c7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:34.653789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d5102c55-02cc-458b-8db3-8d3f40602dcc req-825dce1c-c02d-4673-a409-1ada8e1ae5c7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:34.704794 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-d5102c55-02cc-458b-8db3-8d3f40602dcc req-825dce1c-c02d-4673-a409-1ada8e1ae5c7 service nova] Creating event network-vif-plugged:8217556b-199a-4877-b73c-71c827fe8a70 for instance 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 on n-h2-858383-15 Oct 24 11:00:34.725464 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-d5102c55-02cc-458b-8db3-8d3f40602dcc req-825dce1c-c02d-4673-a409-1ada8e1ae5c7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.492079 Oct 24 11:00:34.726079 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3086/6144] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:00:34.799083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c6fec898-e6da-4c98-b485-943923f195fe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:00:34.799713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c6fec898-e6da-4c98-b485-943923f195fe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:00:34.815046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6fec898-e6da-4c98-b485-943923f195fe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:34.819499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6fec898-e6da-4c98-b485-943923f195fe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:34.821533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6fec898-e6da-4c98-b485-943923f195fe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:34.823131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6fec898-e6da-4c98-b485-943923f195fe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:34.825993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6fec898-e6da-4c98-b485-943923f195fe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:34.826991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6fec898-e6da-4c98-b485-943923f195fe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:35.109570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c6fec898-e6da-4c98-b485-943923f195fe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:00:35.134348 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c6fec898-e6da-4c98-b485-943923f195fe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1392 microversion: 2.1 time: 0.354771 Oct 24 11:00:35.135733 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3059/6145] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:00:34 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1392 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:00:36.168233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f653c2c5-97df-47e7-b26b-ac9eec138ccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:00:36.169572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f653c2c5-97df-47e7-b26b-ac9eec138ccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:00:36.180226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f653c2c5-97df-47e7-b26b-ac9eec138ccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:36.181074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f653c2c5-97df-47e7-b26b-ac9eec138ccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:36.182159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f653c2c5-97df-47e7-b26b-ac9eec138ccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:36.183711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f653c2c5-97df-47e7-b26b-ac9eec138ccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:36.184333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f653c2c5-97df-47e7-b26b-ac9eec138ccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:36.185224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f653c2c5-97df-47e7-b26b-ac9eec138ccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:36.738596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f653c2c5-97df-47e7-b26b-ac9eec138ccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:00:36.752388 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f653c2c5-97df-47e7-b26b-ac9eec138ccb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1392 microversion: 2.1 time: 0.589819 Oct 24 11:00:36.754210 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3087/6146] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:00:36 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1392 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:00:37.774917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-27fc054a-35e8-4f6e-ba79-5ad738739d9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:00:37.776330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-27fc054a-35e8-4f6e-ba79-5ad738739d9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:00:37.785373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27fc054a-35e8-4f6e-ba79-5ad738739d9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:37.786362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27fc054a-35e8-4f6e-ba79-5ad738739d9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:37.788318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27fc054a-35e8-4f6e-ba79-5ad738739d9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:37.789184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27fc054a-35e8-4f6e-ba79-5ad738739d9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:37.789730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27fc054a-35e8-4f6e-ba79-5ad738739d9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:37.791011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-27fc054a-35e8-4f6e-ba79-5ad738739d9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:38.151586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-27fc054a-35e8-4f6e-ba79-5ad738739d9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:00:38.171107 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-27fc054a-35e8-4f6e-ba79-5ad738739d9d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1565 microversion: 2.1 time: 0.398723 Oct 24 11:00:38.194777 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3060/6147] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:00:37 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1565 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:00:38.199417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c884e08e-85f2-4289-a516-92f7bd33e31b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:00:38.200054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c884e08e-85f2-4289-a516-92f7bd33e31b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:00:38.233907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c884e08e-85f2-4289-a516-92f7bd33e31b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:38.235035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c884e08e-85f2-4289-a516-92f7bd33e31b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:38.235707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c884e08e-85f2-4289-a516-92f7bd33e31b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:38.236911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c884e08e-85f2-4289-a516-92f7bd33e31b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:38.237592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c884e08e-85f2-4289-a516-92f7bd33e31b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:38.238186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c884e08e-85f2-4289-a516-92f7bd33e31b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:38.605532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c884e08e-85f2-4289-a516-92f7bd33e31b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:00:38.627157 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c884e08e-85f2-4289-a516-92f7bd33e31b tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1565 microversion: 2.1 time: 0.433698 Oct 24 11:00:38.645016 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3088/6148] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:00:38 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1565 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:00:42.317334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-566f965b-f2a3-4350-904b-1afef6af5ae6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:00:42.318058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-566f965b-f2a3-4350-904b-1afef6af5ae6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:00:42.318335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-f43ec6b1-687a-4004-a7eb-419e0983efb9 req-54fbb4db-5670-47d0-85ed-88530d4ff8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882", "tag": "8217556b-199a-4877-b73c-71c827fe8a70"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:00:42.348015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-566f965b-f2a3-4350-904b-1afef6af5ae6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:42.352394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-566f965b-f2a3-4350-904b-1afef6af5ae6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:42.353857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-566f965b-f2a3-4350-904b-1afef6af5ae6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:42.355063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-566f965b-f2a3-4350-904b-1afef6af5ae6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:42.356789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f43ec6b1-687a-4004-a7eb-419e0983efb9 req-54fbb4db-5670-47d0-85ed-88530d4ff8f9 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:42.357523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-566f965b-f2a3-4350-904b-1afef6af5ae6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:42.359835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f43ec6b1-687a-4004-a7eb-419e0983efb9 req-54fbb4db-5670-47d0-85ed-88530d4ff8f9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:42.360796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-566f965b-f2a3-4350-904b-1afef6af5ae6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:42.361393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f43ec6b1-687a-4004-a7eb-419e0983efb9 req-54fbb4db-5670-47d0-85ed-88530d4ff8f9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:42.402559 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f43ec6b1-687a-4004-a7eb-419e0983efb9 req-54fbb4db-5670-47d0-85ed-88530d4ff8f9 service nova] Creating event network-changed:8217556b-199a-4877-b73c-71c827fe8a70 for instance 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 on n-h2-858383-15 Oct 24 11:00:42.420283 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-f43ec6b1-687a-4004-a7eb-419e0983efb9 req-54fbb4db-5670-47d0-85ed-88530d4ff8f9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104007 Oct 24 11:00:42.422524 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3089/6149] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:00:42.887374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-566f965b-f2a3-4350-904b-1afef6af5ae6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:00:42.906018 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-566f965b-f2a3-4350-904b-1afef6af5ae6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1565 microversion: 2.1 time: 0.589467 Oct 24 11:00:42.914063 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3061/6150] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:00:42 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1565 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:00:58.527322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3a1280ec-abe7-4e0e-b146-8521f2210bbc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:00:58.528367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3a1280ec-abe7-4e0e-b146-8521f2210bbc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:00:58.534121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=22 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:00:58.535047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=42 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:00:58.556046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a1280ec-abe7-4e0e-b146-8521f2210bbc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:58.557659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a1280ec-abe7-4e0e-b146-8521f2210bbc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:58.558338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a1280ec-abe7-4e0e-b146-8521f2210bbc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:58.559565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a1280ec-abe7-4e0e-b146-8521f2210bbc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:00:58.562560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a1280ec-abe7-4e0e-b146-8521f2210bbc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:00:58.563184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3a1280ec-abe7-4e0e-b146-8521f2210bbc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:00:58.635433 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3a1280ec-abe7-4e0e-b146-8521f2210bbc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/ips" status: 200 len: 149 microversion: 2.1 time: 0.112092 Oct 24 11:00:58.644923 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3090/6151] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Oct 24 11:00:58 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/ips => generated 149 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:01:01.499663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f7d3e887-85ee-4a4e-a0c6-b695780f9505 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d07325c1-a728-4fcd-a607-2c7f3357c533"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:01:01.504401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f7d3e887-85ee-4a4e-a0c6-b695780f9505 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:01.511351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:01:01.512606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=50 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:01:01.516019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7d3e887-85ee-4a4e-a0c6-b695780f9505 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:01.516984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7d3e887-85ee-4a4e-a0c6-b695780f9505 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:01.517859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7d3e887-85ee-4a4e-a0c6-b695780f9505 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:01.518727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7d3e887-85ee-4a4e-a0c6-b695780f9505 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:01.519860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7d3e887-85ee-4a4e-a0c6-b695780f9505 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:01.520442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7d3e887-85ee-4a4e-a0c6-b695780f9505 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:01.645487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-18eb4da8-8aaa-411d-a7da-aa394f6fe911 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:01:01.648804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-18eb4da8-8aaa-411d-a7da-aa394f6fe911 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:01.667493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18eb4da8-8aaa-411d-a7da-aa394f6fe911 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:01.668233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18eb4da8-8aaa-411d-a7da-aa394f6fe911 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:01.668700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18eb4da8-8aaa-411d-a7da-aa394f6fe911 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:01.669458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18eb4da8-8aaa-411d-a7da-aa394f6fe911 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:01.671876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18eb4da8-8aaa-411d-a7da-aa394f6fe911 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:01.672407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18eb4da8-8aaa-411d-a7da-aa394f6fe911 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:01.781285 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-18eb4da8-8aaa-411d-a7da-aa394f6fe911 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882/action" status: 200 len: 24570 microversion: 2.1 time: 0.141333 Oct 24 11:01:01.788981 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3091/6152] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:01:01 2022] POST /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882/action => generated 24570 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 11:01:01.976114 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f7d3e887-85ee-4a4e-a0c6-b695780f9505 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "POST /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.481226 Oct 24 11:01:01.979746 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3062/6153] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 11:01:01 2022] POST /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments => generated 194 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:01:12.493320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:01:12.496207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:12.512258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:01:12.520303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=8 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:01:12.543138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:12.543653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:12.544089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:12.549498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:12.550218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:12.550887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:12.833323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:01:12.833941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:01:12.834572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:01:12.835495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:01:12.836657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:01:12.962749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:12.981739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:12.982397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:12.985507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:12.987005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:12.987888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:12.990074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:13.060033 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-de4734f1-d66e-4e87-9f6d-ffe74d20808c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882/action" status: 202 len: 1138 microversion: 2.1 time: 0.571562 Oct 24 11:01:13.069805 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3092/6154] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:01:12 2022] POST /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882/action => generated 1138 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 24 11:01:13.093810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:01:13.094735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:01:13.100121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8f9ef05c-5002-419f-b8e8-a6fb7f93c234 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:13.101173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8f9ef05c-5002-419f-b8e8-a6fb7f93c234 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:13.125350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f9ef05c-5002-419f-b8e8-a6fb7f93c234 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:13.130426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f9ef05c-5002-419f-b8e8-a6fb7f93c234 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:13.131556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f9ef05c-5002-419f-b8e8-a6fb7f93c234 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:13.135639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f9ef05c-5002-419f-b8e8-a6fb7f93c234 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:13.145938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f9ef05c-5002-419f-b8e8-a6fb7f93c234 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:13.146595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f9ef05c-5002-419f-b8e8-a6fb7f93c234 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:13.443775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8f9ef05c-5002-419f-b8e8-a6fb7f93c234 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:13.455004 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8f9ef05c-5002-419f-b8e8-a6fb7f93c234 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1693 microversion: 2.1 time: 0.363144 Oct 24 11:01:13.458042 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3063/6155] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:13 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1693 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:14.485055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4a62820e-0f84-483e-b316-16d111630b72 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:14.485714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4a62820e-0f84-483e-b316-16d111630b72 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:14.498263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a62820e-0f84-483e-b316-16d111630b72 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:14.501589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a62820e-0f84-483e-b316-16d111630b72 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:14.502131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a62820e-0f84-483e-b316-16d111630b72 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:14.502944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a62820e-0f84-483e-b316-16d111630b72 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:14.505639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a62820e-0f84-483e-b316-16d111630b72 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:14.506176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a62820e-0f84-483e-b316-16d111630b72 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:14.807658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4a62820e-0f84-483e-b316-16d111630b72 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:14.817048 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4a62820e-0f84-483e-b316-16d111630b72 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1693 microversion: 2.1 time: 0.336670 Oct 24 11:01:14.818397 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3093/6156] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:14 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1693 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:15.842771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-868d2aa9-ac5b-40f9-9dd6-c65b37e1d781 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:15.843468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-868d2aa9-ac5b-40f9-9dd6-c65b37e1d781 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:15.851132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-868d2aa9-ac5b-40f9-9dd6-c65b37e1d781 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:15.852275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-868d2aa9-ac5b-40f9-9dd6-c65b37e1d781 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:15.852926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-868d2aa9-ac5b-40f9-9dd6-c65b37e1d781 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:15.853796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-868d2aa9-ac5b-40f9-9dd6-c65b37e1d781 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:15.854437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-868d2aa9-ac5b-40f9-9dd6-c65b37e1d781 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:15.855034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-868d2aa9-ac5b-40f9-9dd6-c65b37e1d781 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:16.200990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-868d2aa9-ac5b-40f9-9dd6-c65b37e1d781 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:16.237458 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-868d2aa9-ac5b-40f9-9dd6-c65b37e1d781 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1693 microversion: 2.1 time: 0.399895 Oct 24 11:01:16.242638 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3064/6157] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:15 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1693 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:17.270034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ae6ad5c3-fd1e-4d94-b8c1-178496b81971 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:17.270670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ae6ad5c3-fd1e-4d94-b8c1-178496b81971 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:17.300998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae6ad5c3-fd1e-4d94-b8c1-178496b81971 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:17.301602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae6ad5c3-fd1e-4d94-b8c1-178496b81971 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:17.304682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae6ad5c3-fd1e-4d94-b8c1-178496b81971 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:17.305492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae6ad5c3-fd1e-4d94-b8c1-178496b81971 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:17.305970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae6ad5c3-fd1e-4d94-b8c1-178496b81971 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:17.318775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae6ad5c3-fd1e-4d94-b8c1-178496b81971 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:17.665140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ae6ad5c3-fd1e-4d94-b8c1-178496b81971 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:17.678320 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ae6ad5c3-fd1e-4d94-b8c1-178496b81971 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1693 microversion: 2.1 time: 0.412634 Oct 24 11:01:17.697149 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3094/6158] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:17 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1693 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:18.409727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0f256f2f-a94c-4830-b719-d4dac7ea9d0d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Action: 'create', calling method: .version_select at 0x7f04cbaac820>, body: {"keypair": {"name": "tempest-keypair-527215569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3YT86Ght3U/Hxn0JvE9J+OE+cXJvJU29auxcd01ContN3cUZrTy3migFYBX6OzzruSqPEBevllVYBKGmtu3Z30bQbKm+Ens4/3J7NWDvkqbM0knkg7blQbesJI+iqSvQ=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:01:18.432722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0f256f2f-a94c-4830-b719-d4dac7ea9d0d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Getting quotas for project a10ff6644b9b4215b1b7c82b98342a79. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:01:18.443139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0f256f2f-a94c-4830-b719-d4dac7ea9d0d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Getting quotas for user da9e4e22dda84476a30e6b6bd27c68a6 and project a10ff6644b9b4215b1b7c82b98342a79. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:01:18.473122 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0f256f2f-a94c-4830-b719-d4dac7ea9d0d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.068797 Oct 24 11:01:18.474539 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3065/6159] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:01:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:01:18.704424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e67ed85f-8748-47d1-9337-2f42e4956b04 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:18.705024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e67ed85f-8748-47d1-9337-2f42e4956b04 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:18.731975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e67ed85f-8748-47d1-9337-2f42e4956b04 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:18.732516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e67ed85f-8748-47d1-9337-2f42e4956b04 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:18.734012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e67ed85f-8748-47d1-9337-2f42e4956b04 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:18.734750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e67ed85f-8748-47d1-9337-2f42e4956b04 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:18.735215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e67ed85f-8748-47d1-9337-2f42e4956b04 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:18.735647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e67ed85f-8748-47d1-9337-2f42e4956b04 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:19.046407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e67ed85f-8748-47d1-9337-2f42e4956b04 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:19.055998 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e67ed85f-8748-47d1-9337-2f42e4956b04 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1693 microversion: 2.1 time: 0.356079 Oct 24 11:01:19.056584 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3095/6160] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:18 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1693 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:20.083030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4f316a4e-bb51-44aa-b237-5cc872a8b8c6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:20.083789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4f316a4e-bb51-44aa-b237-5cc872a8b8c6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:20.122115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f316a4e-bb51-44aa-b237-5cc872a8b8c6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:20.122921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f316a4e-bb51-44aa-b237-5cc872a8b8c6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:20.124430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f316a4e-bb51-44aa-b237-5cc872a8b8c6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:20.128115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f316a4e-bb51-44aa-b237-5cc872a8b8c6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:20.130291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f316a4e-bb51-44aa-b237-5cc872a8b8c6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:20.131692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f316a4e-bb51-44aa-b237-5cc872a8b8c6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:20.462302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4f316a4e-bb51-44aa-b237-5cc872a8b8c6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:20.494814 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4f316a4e-bb51-44aa-b237-5cc872a8b8c6 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1693 microversion: 2.1 time: 0.408567 Oct 24 11:01:20.495469 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3066/6161] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:20 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1693 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:20.734576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aad66fcb-5dc9-42ea-b020-fc849d71a954 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-271763649", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b82d466-b601-44d7-abeb-7c2705af48cc"}], "security_groups": [{"name": "tempest-securitygroup--1569406877"}], "key_name": "tempest-keypair-527215569", "user_data": "}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:01:21.233988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-aad66fcb-5dc9-42ea-b020-fc849d71a954 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] validate_networks() for [('6b82d466-b601-44d7-abeb-7c2705af48cc', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:01:21.519969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8db36b18-4189-4b60-a932-05e3795409cb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:21.520580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8db36b18-4189-4b60-a932-05e3795409cb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:21.541016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8db36b18-4189-4b60-a932-05e3795409cb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:21.543281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8db36b18-4189-4b60-a932-05e3795409cb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:21.553506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8db36b18-4189-4b60-a932-05e3795409cb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:21.554541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8db36b18-4189-4b60-a932-05e3795409cb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:21.555197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8db36b18-4189-4b60-a932-05e3795409cb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:21.556023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8db36b18-4189-4b60-a932-05e3795409cb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:22.107156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8db36b18-4189-4b60-a932-05e3795409cb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:22.120405 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8db36b18-4189-4b60-a932-05e3795409cb tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1693 microversion: 2.1 time: 0.604097 Oct 24 11:01:22.131816 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3067/6162] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:21 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1693 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:22.426268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-aad66fcb-5dc9-42ea-b020-fc849d71a954 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:01:22.426845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-aad66fcb-5dc9-42ea-b020-fc849d71a954 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:01:22.427712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-aad66fcb-5dc9-42ea-b020-fc849d71a954 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:01:22.428230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-aad66fcb-5dc9-42ea-b020-fc849d71a954 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:01:22.428805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-aad66fcb-5dc9-42ea-b020-fc849d71a954 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:01:22.448114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aad66fcb-5dc9-42ea-b020-fc849d71a954 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:22.448764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aad66fcb-5dc9-42ea-b020-fc849d71a954 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:22.449350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aad66fcb-5dc9-42ea-b020-fc849d71a954 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:22.450624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aad66fcb-5dc9-42ea-b020-fc849d71a954 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:22.451195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aad66fcb-5dc9-42ea-b020-fc849d71a954 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:22.452427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aad66fcb-5dc9-42ea-b020-fc849d71a954 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:22.501987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-aad66fcb-5dc9-42ea-b020-fc849d71a954 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Getting quotas for project a10ff6644b9b4215b1b7c82b98342a79. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:01:22.508172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-aad66fcb-5dc9-42ea-b020-fc849d71a954 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Getting quotas for user da9e4e22dda84476a30e6b6bd27c68a6 and project a10ff6644b9b4215b1b7c82b98342a79. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:01:22.526324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aad66fcb-5dc9-42ea-b020-fc849d71a954 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:01:22.528948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aad66fcb-5dc9-42ea-b020-fc849d71a954 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:01:22.608676 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aad66fcb-5dc9-42ea-b020-fc849d71a954 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.888807 Oct 24 11:01:22.616290 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3096/6163] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:01:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:01:22.624981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09b02026-0fea-4a19-a387-340bbc11ae53 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:22.626634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09b02026-0fea-4a19-a387-340bbc11ae53 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:22.812381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-09b02026-0fea-4a19-a387-340bbc11ae53 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:22.827295 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-09b02026-0fea-4a19-a387-340bbc11ae53 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 200 len: 1240 microversion: 2.1 time: 0.209736 Oct 24 11:01:22.828433 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3068/6164] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:22 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 1240 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:01:23.169512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6ed77973-dafb-45cc-987e-6854df16109c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:23.171748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6ed77973-dafb-45cc-987e-6854df16109c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:23.186769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ed77973-dafb-45cc-987e-6854df16109c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:23.187513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ed77973-dafb-45cc-987e-6854df16109c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:23.188550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ed77973-dafb-45cc-987e-6854df16109c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:23.191424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ed77973-dafb-45cc-987e-6854df16109c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:23.195607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ed77973-dafb-45cc-987e-6854df16109c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:23.196585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ed77973-dafb-45cc-987e-6854df16109c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:23.693886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6ed77973-dafb-45cc-987e-6854df16109c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:23.706979 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6ed77973-dafb-45cc-987e-6854df16109c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1693 microversion: 2.1 time: 0.544694 Oct 24 11:01:23.708882 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3097/6165] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:23 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1693 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:23.853687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-98de81d6-4d96-44c8-a115-f6ddd638deba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:23.854316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-98de81d6-4d96-44c8-a115-f6ddd638deba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:23.868400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98de81d6-4d96-44c8-a115-f6ddd638deba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:23.868914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98de81d6-4d96-44c8-a115-f6ddd638deba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:23.869361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98de81d6-4d96-44c8-a115-f6ddd638deba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:23.885718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98de81d6-4d96-44c8-a115-f6ddd638deba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:23.886253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98de81d6-4d96-44c8-a115-f6ddd638deba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:23.890324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-98de81d6-4d96-44c8-a115-f6ddd638deba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:24.022986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-98de81d6-4d96-44c8-a115-f6ddd638deba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:24.083595 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-98de81d6-4d96-44c8-a115-f6ddd638deba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 200 len: 1292 microversion: 2.1 time: 0.233126 Oct 24 11:01:24.103805 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3069/6166] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:23 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 1292 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:24.732634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a4c61b71-04f3-4958-9a19-e6d31f09cc3c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:24.734742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a4c61b71-04f3-4958-9a19-e6d31f09cc3c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:24.743928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4c61b71-04f3-4958-9a19-e6d31f09cc3c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:24.744732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4c61b71-04f3-4958-9a19-e6d31f09cc3c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:24.745484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4c61b71-04f3-4958-9a19-e6d31f09cc3c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:24.747693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4c61b71-04f3-4958-9a19-e6d31f09cc3c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:24.748440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4c61b71-04f3-4958-9a19-e6d31f09cc3c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:24.749863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4c61b71-04f3-4958-9a19-e6d31f09cc3c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:25.111021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0b67ccea-5223-4d28-a5ec-1b599157e12e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:25.111677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0b67ccea-5223-4d28-a5ec-1b599157e12e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:25.129406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b67ccea-5223-4d28-a5ec-1b599157e12e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:25.133450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b67ccea-5223-4d28-a5ec-1b599157e12e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:25.135382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b67ccea-5223-4d28-a5ec-1b599157e12e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:25.142273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b67ccea-5223-4d28-a5ec-1b599157e12e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:25.147406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b67ccea-5223-4d28-a5ec-1b599157e12e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:25.148810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b67ccea-5223-4d28-a5ec-1b599157e12e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:25.308691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a4c61b71-04f3-4958-9a19-e6d31f09cc3c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:25.318075 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a4c61b71-04f3-4958-9a19-e6d31f09cc3c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1693 microversion: 2.1 time: 0.589115 Oct 24 11:01:25.324488 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3098/6167] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:24 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1693 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:25.376767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0b67ccea-5223-4d28-a5ec-1b599157e12e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:25.387631 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0b67ccea-5223-4d28-a5ec-1b599157e12e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 200 len: 1298 microversion: 2.1 time: 0.281235 Oct 24 11:01:25.396849 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3070/6168] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:25 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 1298 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:26.347902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f6a848d8-d28d-4992-af56-48f570487f82 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:26.348533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f6a848d8-d28d-4992-af56-48f570487f82 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:26.378480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6a848d8-d28d-4992-af56-48f570487f82 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:26.379002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6a848d8-d28d-4992-af56-48f570487f82 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:26.379470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6a848d8-d28d-4992-af56-48f570487f82 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:26.380186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6a848d8-d28d-4992-af56-48f570487f82 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:26.380654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6a848d8-d28d-4992-af56-48f570487f82 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:26.381192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6a848d8-d28d-4992-af56-48f570487f82 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:26.421608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ea3d569c-f8e3-442b-aa89-8ba433c5c56e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:26.422211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ea3d569c-f8e3-442b-aa89-8ba433c5c56e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:26.450964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea3d569c-f8e3-442b-aa89-8ba433c5c56e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:26.462150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea3d569c-f8e3-442b-aa89-8ba433c5c56e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:26.462688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea3d569c-f8e3-442b-aa89-8ba433c5c56e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:26.463466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea3d569c-f8e3-442b-aa89-8ba433c5c56e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:26.466835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea3d569c-f8e3-442b-aa89-8ba433c5c56e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:26.467313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea3d569c-f8e3-442b-aa89-8ba433c5c56e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:27.191483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f6a848d8-d28d-4992-af56-48f570487f82 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:27.208742 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f6a848d8-d28d-4992-af56-48f570487f82 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1699 microversion: 2.1 time: 0.858014 Oct 24 11:01:27.215977 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3099/6169] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:26 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1699 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:27.302404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ea3d569c-f8e3-442b-aa89-8ba433c5c56e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:27.324078 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ea3d569c-f8e3-442b-aa89-8ba433c5c56e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 200 len: 1366 microversion: 2.1 time: 0.904045 Oct 24 11:01:27.332852 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3071/6170] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:26 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 1366 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:28.238913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1ba754ce-b45a-4afd-9e41-3bcc8242fb5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:28.240504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1ba754ce-b45a-4afd-9e41-3bcc8242fb5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:28.255993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ba754ce-b45a-4afd-9e41-3bcc8242fb5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:28.257279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ba754ce-b45a-4afd-9e41-3bcc8242fb5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:28.257897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ba754ce-b45a-4afd-9e41-3bcc8242fb5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:28.258778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ba754ce-b45a-4afd-9e41-3bcc8242fb5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:28.259635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ba754ce-b45a-4afd-9e41-3bcc8242fb5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:28.260226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ba754ce-b45a-4afd-9e41-3bcc8242fb5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:28.324034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-b65f7165-6d06-4d0f-9483-ef835352c462 req-cad3c72f-0117-4ac1-96e3-780fb5d03b3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33939031-e4c1-45c6-9aa1-c8751f6ab150", "tag": "bcbe60d9-84d3-49f4-ae82-82bcd420b74a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:01:28.346567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b65f7165-6d06-4d0f-9483-ef835352c462 req-cad3c72f-0117-4ac1-96e3-780fb5d03b3b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:28.347461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b65f7165-6d06-4d0f-9483-ef835352c462 req-cad3c72f-0117-4ac1-96e3-780fb5d03b3b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:28.353511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b65f7165-6d06-4d0f-9483-ef835352c462 req-cad3c72f-0117-4ac1-96e3-780fb5d03b3b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:28.386278 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-b65f7165-6d06-4d0f-9483-ef835352c462 req-cad3c72f-0117-4ac1-96e3-780fb5d03b3b service nova] Creating event network-changed:bcbe60d9-84d3-49f4-ae82-82bcd420b74a for instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 on n-h1-858383-15 Oct 24 11:01:28.403190 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-b65f7165-6d06-4d0f-9483-ef835352c462 req-cad3c72f-0117-4ac1-96e3-780fb5d03b3b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.381681 Oct 24 11:01:28.406726 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3100/6171] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:01:28.433057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cdc32ca2-bdfb-4f0f-b0a2-63828ebe7c1c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:28.439193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cdc32ca2-bdfb-4f0f-b0a2-63828ebe7c1c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:28.462192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cdc32ca2-bdfb-4f0f-b0a2-63828ebe7c1c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:28.462967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cdc32ca2-bdfb-4f0f-b0a2-63828ebe7c1c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:28.463582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cdc32ca2-bdfb-4f0f-b0a2-63828ebe7c1c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:28.464463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cdc32ca2-bdfb-4f0f-b0a2-63828ebe7c1c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:28.465122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cdc32ca2-bdfb-4f0f-b0a2-63828ebe7c1c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:28.466446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cdc32ca2-bdfb-4f0f-b0a2-63828ebe7c1c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:28.976073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1ba754ce-b45a-4afd-9e41-3bcc8242fb5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:28.989405 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1ba754ce-b45a-4afd-9e41-3bcc8242fb5c tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1684 microversion: 2.1 time: 0.754794 Oct 24 11:01:28.990063 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3072/6172] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:28 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1684 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:01:29.206860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cdc32ca2-bdfb-4f0f-b0a2-63828ebe7c1c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:29.225168 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cdc32ca2-bdfb-4f0f-b0a2-63828ebe7c1c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 200 len: 1366 microversion: 2.1 time: 0.812228 Oct 24 11:01:29.227400 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3101/6173] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:28 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 1366 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:29.324686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-5a3b7f98-106c-46df-9b60-6c2cd927cac0 req-3c3b4abd-3116-4558-a628-128d06f8a226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882", "name": "network-vif-unplugged", "status": "completed", "tag": "8217556b-199a-4877-b73c-71c827fe8a70"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:01:29.355191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5a3b7f98-106c-46df-9b60-6c2cd927cac0 req-3c3b4abd-3116-4558-a628-128d06f8a226 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:29.360585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5a3b7f98-106c-46df-9b60-6c2cd927cac0 req-3c3b4abd-3116-4558-a628-128d06f8a226 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:29.364716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5a3b7f98-106c-46df-9b60-6c2cd927cac0 req-3c3b4abd-3116-4558-a628-128d06f8a226 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:29.416648 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-5a3b7f98-106c-46df-9b60-6c2cd927cac0 req-3c3b4abd-3116-4558-a628-128d06f8a226 service nova] Creating event network-vif-unplugged:8217556b-199a-4877-b73c-71c827fe8a70 for instance 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 on n-h2-858383-15 Oct 24 11:01:29.435490 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-5a3b7f98-106c-46df-9b60-6c2cd927cac0 req-3c3b4abd-3116-4558-a628-128d06f8a226 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114760 Oct 24 11:01:29.463185 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3073/6174] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:01:30.255178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bab46f29-7d33-487a-8261-a5bbb1ed72e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:30.255802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bab46f29-7d33-487a-8261-a5bbb1ed72e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:30.275673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bab46f29-7d33-487a-8261-a5bbb1ed72e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:30.276446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bab46f29-7d33-487a-8261-a5bbb1ed72e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:30.279285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bab46f29-7d33-487a-8261-a5bbb1ed72e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:30.284754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bab46f29-7d33-487a-8261-a5bbb1ed72e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:30.285731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bab46f29-7d33-487a-8261-a5bbb1ed72e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:30.286357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bab46f29-7d33-487a-8261-a5bbb1ed72e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:31.310212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bab46f29-7d33-487a-8261-a5bbb1ed72e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:31.322147 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bab46f29-7d33-487a-8261-a5bbb1ed72e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 200 len: 1366 microversion: 2.1 time: 1.070709 Oct 24 11:01:31.340242 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3102/6175] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:30 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 1366 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:32.347231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-af74ad01-1ad6-415a-8ff0-6ff4052ad8e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:32.348587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-af74ad01-1ad6-415a-8ff0-6ff4052ad8e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:32.359563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af74ad01-1ad6-415a-8ff0-6ff4052ad8e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:32.360387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af74ad01-1ad6-415a-8ff0-6ff4052ad8e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:32.361088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af74ad01-1ad6-415a-8ff0-6ff4052ad8e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:32.362461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af74ad01-1ad6-415a-8ff0-6ff4052ad8e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:32.363073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af74ad01-1ad6-415a-8ff0-6ff4052ad8e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:32.363640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af74ad01-1ad6-415a-8ff0-6ff4052ad8e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:32.817389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:01:32.978549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-1ca30dd0-3883-4577-86e1-26c322e9864c req-75c8f277-f6dd-403a-bb40-54bbe96efe6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882", "name": "network-vif-plugged", "status": "completed", "tag": "8217556b-199a-4877-b73c-71c827fe8a70"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:01:32.995585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:01:32.996649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:01:33.005759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1ca30dd0-3883-4577-86e1-26c322e9864c req-75c8f277-f6dd-403a-bb40-54bbe96efe6e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:33.006309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1ca30dd0-3883-4577-86e1-26c322e9864c req-75c8f277-f6dd-403a-bb40-54bbe96efe6e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:33.006772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1ca30dd0-3883-4577-86e1-26c322e9864c req-75c8f277-f6dd-403a-bb40-54bbe96efe6e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:33.034888 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-1ca30dd0-3883-4577-86e1-26c322e9864c req-75c8f277-f6dd-403a-bb40-54bbe96efe6e service nova] Creating event network-vif-plugged:8217556b-199a-4877-b73c-71c827fe8a70 for instance 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 on n-h2-858383-15 Oct 24 11:01:33.037438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-af74ad01-1ad6-415a-8ff0-6ff4052ad8e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:33.050610 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-1ca30dd0-3883-4577-86e1-26c322e9864c req-75c8f277-f6dd-403a-bb40-54bbe96efe6e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072501 Oct 24 11:01:33.051265 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3103/6176] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:01:33.052709 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-af74ad01-1ad6-415a-8ff0-6ff4052ad8e2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 200 len: 1366 microversion: 2.1 time: 0.708473 Oct 24 11:01:33.055058 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3074/6177] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:32 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 1366 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:34.081140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e442cb36-db00-49d5-8798-78cf27a88af4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:34.081856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e442cb36-db00-49d5-8798-78cf27a88af4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:34.100608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e442cb36-db00-49d5-8798-78cf27a88af4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:34.105043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e442cb36-db00-49d5-8798-78cf27a88af4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:34.105751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e442cb36-db00-49d5-8798-78cf27a88af4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:34.106659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e442cb36-db00-49d5-8798-78cf27a88af4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:34.109443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e442cb36-db00-49d5-8798-78cf27a88af4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:34.110294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e442cb36-db00-49d5-8798-78cf27a88af4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:34.506537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e442cb36-db00-49d5-8798-78cf27a88af4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:34.517500 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e442cb36-db00-49d5-8798-78cf27a88af4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 200 len: 1366 microversion: 2.1 time: 0.441814 Oct 24 11:01:34.518692 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3104/6178] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:34 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 1366 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:35.544155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6cfb4ee0-7454-4936-ba7d-8c415bb99226 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:35.546394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6cfb4ee0-7454-4936-ba7d-8c415bb99226 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:35.563507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cfb4ee0-7454-4936-ba7d-8c415bb99226 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:35.565481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cfb4ee0-7454-4936-ba7d-8c415bb99226 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:35.566115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cfb4ee0-7454-4936-ba7d-8c415bb99226 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:35.568413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cfb4ee0-7454-4936-ba7d-8c415bb99226 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:35.570022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cfb4ee0-7454-4936-ba7d-8c415bb99226 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:35.571628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6cfb4ee0-7454-4936-ba7d-8c415bb99226 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:35.723828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-6db2fd9e-3b7b-4b2e-8b8f-e2aa77242b05 req-2fbe52c5-59e7-492a-aeb6-d685ebe8207e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33939031-e4c1-45c6-9aa1-c8751f6ab150", "name": "network-vif-plugged", "status": "completed", "tag": "bcbe60d9-84d3-49f4-ae82-82bcd420b74a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:01:35.737303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6db2fd9e-3b7b-4b2e-8b8f-e2aa77242b05 req-2fbe52c5-59e7-492a-aeb6-d685ebe8207e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:35.738457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6db2fd9e-3b7b-4b2e-8b8f-e2aa77242b05 req-2fbe52c5-59e7-492a-aeb6-d685ebe8207e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:35.739013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6db2fd9e-3b7b-4b2e-8b8f-e2aa77242b05 req-2fbe52c5-59e7-492a-aeb6-d685ebe8207e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:35.756233 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-6db2fd9e-3b7b-4b2e-8b8f-e2aa77242b05 req-2fbe52c5-59e7-492a-aeb6-d685ebe8207e service nova] Creating event network-vif-plugged:bcbe60d9-84d3-49f4-ae82-82bcd420b74a for instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 on n-h1-858383-15 Oct 24 11:01:35.766990 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-6db2fd9e-3b7b-4b2e-8b8f-e2aa77242b05 req-2fbe52c5-59e7-492a-aeb6-d685ebe8207e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050271 Oct 24 11:01:35.767927 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3105/6179] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:01:35.963242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6cfb4ee0-7454-4936-ba7d-8c415bb99226 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:35.971762 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6cfb4ee0-7454-4936-ba7d-8c415bb99226 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 200 len: 1366 microversion: 2.1 time: 0.432567 Oct 24 11:01:35.972452 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3075/6180] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:35 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 1366 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:36.996971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ce37e5a7-5f47-4b02-bb16-8bdf4ba69c26 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:36.997694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ce37e5a7-5f47-4b02-bb16-8bdf4ba69c26 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:37.016324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce37e5a7-5f47-4b02-bb16-8bdf4ba69c26 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:37.017303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce37e5a7-5f47-4b02-bb16-8bdf4ba69c26 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:37.019209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce37e5a7-5f47-4b02-bb16-8bdf4ba69c26 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:37.021353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce37e5a7-5f47-4b02-bb16-8bdf4ba69c26 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:37.024483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce37e5a7-5f47-4b02-bb16-8bdf4ba69c26 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:37.025795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce37e5a7-5f47-4b02-bb16-8bdf4ba69c26 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:37.987784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ce37e5a7-5f47-4b02-bb16-8bdf4ba69c26 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:38.006557 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ce37e5a7-5f47-4b02-bb16-8bdf4ba69c26 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 200 len: 1366 microversion: 2.1 time: 1.014642 Oct 24 11:01:38.013069 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3106/6181] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:36 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 1366 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:39.035860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8d1cb1a6-e322-4ea6-bb47-06c7fe0d5557 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:39.037712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8d1cb1a6-e322-4ea6-bb47-06c7fe0d5557 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:39.073933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d1cb1a6-e322-4ea6-bb47-06c7fe0d5557 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:39.075778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d1cb1a6-e322-4ea6-bb47-06c7fe0d5557 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:39.076325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d1cb1a6-e322-4ea6-bb47-06c7fe0d5557 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:39.078894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d1cb1a6-e322-4ea6-bb47-06c7fe0d5557 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:39.084238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d1cb1a6-e322-4ea6-bb47-06c7fe0d5557 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:39.084786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8d1cb1a6-e322-4ea6-bb47-06c7fe0d5557 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:39.587399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8d1cb1a6-e322-4ea6-bb47-06c7fe0d5557 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:01:39.603459 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8d1cb1a6-e322-4ea6-bb47-06c7fe0d5557 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 200 len: 1557 microversion: 2.1 time: 0.570502 Oct 24 11:01:39.604111 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3076/6182] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:01:39 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 1557 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:01:39.630845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1792ae8c-f9cb-4b69-92d9-89fda23ba30d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:01:39.631992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1792ae8c-f9cb-4b69-92d9-89fda23ba30d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:39.643982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1792ae8c-f9cb-4b69-92d9-89fda23ba30d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:39.644735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1792ae8c-f9cb-4b69-92d9-89fda23ba30d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:39.646287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1792ae8c-f9cb-4b69-92d9-89fda23ba30d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:39.647175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1792ae8c-f9cb-4b69-92d9-89fda23ba30d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:39.647905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1792ae8c-f9cb-4b69-92d9-89fda23ba30d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:39.648494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1792ae8c-f9cb-4b69-92d9-89fda23ba30d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:39.869619 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1792ae8c-f9cb-4b69-92d9-89fda23ba30d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.242251 Oct 24 11:01:39.870240 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3107/6183] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 11:01:39 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150/os-interface => generated 285 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:01:42.810144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-59433fa8-6b81-49ed-bb08-598d09868459 req-c20c83c7-d125-46f6-b1e4-eb5c92d7bc20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33939031-e4c1-45c6-9aa1-c8751f6ab150", "tag": "bcbe60d9-84d3-49f4-ae82-82bcd420b74a"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:01:42.828005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-59433fa8-6b81-49ed-bb08-598d09868459 req-c20c83c7-d125-46f6-b1e4-eb5c92d7bc20 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:42.828504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-59433fa8-6b81-49ed-bb08-598d09868459 req-c20c83c7-d125-46f6-b1e4-eb5c92d7bc20 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:42.828977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-59433fa8-6b81-49ed-bb08-598d09868459 req-c20c83c7-d125-46f6-b1e4-eb5c92d7bc20 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:42.862049 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-59433fa8-6b81-49ed-bb08-598d09868459 req-c20c83c7-d125-46f6-b1e4-eb5c92d7bc20 service nova] Creating event network-changed:bcbe60d9-84d3-49f4-ae82-82bcd420b74a for instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 on n-h1-858383-15 Oct 24 11:01:42.871277 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-59433fa8-6b81-49ed-bb08-598d09868459 req-c20c83c7-d125-46f6-b1e4-eb5c92d7bc20 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065557 Oct 24 11:01:42.877531 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3077/6184] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:01:55.416141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a4a2b971-c3ba-454f-a938-d6731faf0d01 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:01:55.418928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a4a2b971-c3ba-454f-a938-d6731faf0d01 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:01:55.444174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:01:55.445715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:01:55.447697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4a2b971-c3ba-454f-a938-d6731faf0d01 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:55.448685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4a2b971-c3ba-454f-a938-d6731faf0d01 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:55.449355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4a2b971-c3ba-454f-a938-d6731faf0d01 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:55.450929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4a2b971-c3ba-454f-a938-d6731faf0d01 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:01:55.451596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4a2b971-c3ba-454f-a938-d6731faf0d01 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:01:55.452538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4a2b971-c3ba-454f-a938-d6731faf0d01 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:01:55.603833 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a4a2b971-c3ba-454f-a938-d6731faf0d01 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "POST /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882/action" status: 200 len: 24561 microversion: 2.1 time: 0.192582 Oct 24 11:01:55.604413 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3108/6185] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:01:55 2022] POST /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882/action => generated 24561 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 11:02:08.614500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0831360f-b347-44be-bd8f-9fbe217bc7e8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:08.615120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-c101a255-4948-47fc-b5e9-afdc71b4a678 req-1a5e611a-9b84-4e10-a35e-c903762df1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882", "tag": "8217556b-199a-4877-b73c-71c827fe8a70"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:02:08.616199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0831360f-b347-44be-bd8f-9fbe217bc7e8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:08.629724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:02:08.631819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:02:08.632558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:02:08.635803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=70 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:02:08.636716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c101a255-4948-47fc-b5e9-afdc71b4a678 req-1a5e611a-9b84-4e10-a35e-c903762df1f5 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:08.637243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c101a255-4948-47fc-b5e9-afdc71b4a678 req-1a5e611a-9b84-4e10-a35e-c903762df1f5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:08.637680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c101a255-4948-47fc-b5e9-afdc71b4a678 req-1a5e611a-9b84-4e10-a35e-c903762df1f5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:08.642099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0831360f-b347-44be-bd8f-9fbe217bc7e8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:08.642942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0831360f-b347-44be-bd8f-9fbe217bc7e8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:08.643572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0831360f-b347-44be-bd8f-9fbe217bc7e8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:08.645056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0831360f-b347-44be-bd8f-9fbe217bc7e8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:08.648908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0831360f-b347-44be-bd8f-9fbe217bc7e8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:08.649653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0831360f-b347-44be-bd8f-9fbe217bc7e8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:08.690826 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-c101a255-4948-47fc-b5e9-afdc71b4a678 req-1a5e611a-9b84-4e10-a35e-c903762df1f5 service nova] Creating event network-changed:8217556b-199a-4877-b73c-71c827fe8a70 for instance 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 on n-h2-858383-15 Oct 24 11:02:08.720876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0831360f-b347-44be-bd8f-9fbe217bc7e8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:02:08.735497 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-c101a255-4948-47fc-b5e9-afdc71b4a678 req-1a5e611a-9b84-4e10-a35e-c903762df1f5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129817 Oct 24 11:02:08.740375 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3109/6186] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:02:08.958347 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0831360f-b347-44be-bd8f-9fbe217bc7e8 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "DELETE /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 204 len: 0 microversion: 2.1 time: 0.350193 Oct 24 11:02:08.958881 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3078/6187] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:02:08 2022] DELETE /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:02:08.968803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4bf348de-c99e-4a6a-9caa-8e2566f6fecc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:08.969705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4bf348de-c99e-4a6a-9caa-8e2566f6fecc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:08.986119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bf348de-c99e-4a6a-9caa-8e2566f6fecc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:08.986628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bf348de-c99e-4a6a-9caa-8e2566f6fecc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:08.987081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bf348de-c99e-4a6a-9caa-8e2566f6fecc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:08.987816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bf348de-c99e-4a6a-9caa-8e2566f6fecc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:08.988268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bf348de-c99e-4a6a-9caa-8e2566f6fecc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:08.993517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bf348de-c99e-4a6a-9caa-8e2566f6fecc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:09.309442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4bf348de-c99e-4a6a-9caa-8e2566f6fecc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:09.319110 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4bf348de-c99e-4a6a-9caa-8e2566f6fecc tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1690 microversion: 2.1 time: 0.355625 Oct 24 11:02:09.319692 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3110/6188] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:08 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1690 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:10.348544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b4608bac-8939-4d99-badd-78d6bb69e68d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:10.349373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b4608bac-8939-4d99-badd-78d6bb69e68d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:10.373479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4608bac-8939-4d99-badd-78d6bb69e68d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:10.381101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4608bac-8939-4d99-badd-78d6bb69e68d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:10.381888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4608bac-8939-4d99-badd-78d6bb69e68d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:10.382859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4608bac-8939-4d99-badd-78d6bb69e68d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:10.383523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4608bac-8939-4d99-badd-78d6bb69e68d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:10.387498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b4608bac-8939-4d99-badd-78d6bb69e68d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:11.079719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b4608bac-8939-4d99-badd-78d6bb69e68d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:11.109234 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b4608bac-8939-4d99-badd-78d6bb69e68d tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1690 microversion: 2.1 time: 0.758859 Oct 24 11:02:11.109234 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3079/6189] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:10 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1690 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:12.133985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-24f383fd-5a63-43a0-9333-f33393c81529 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:12.134798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-24f383fd-5a63-43a0-9333-f33393c81529 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:12.151651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24f383fd-5a63-43a0-9333-f33393c81529 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:12.157733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24f383fd-5a63-43a0-9333-f33393c81529 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:12.158526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24f383fd-5a63-43a0-9333-f33393c81529 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:12.159574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24f383fd-5a63-43a0-9333-f33393c81529 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:12.160463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24f383fd-5a63-43a0-9333-f33393c81529 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:12.161154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-24f383fd-5a63-43a0-9333-f33393c81529 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:12.397792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-24f383fd-5a63-43a0-9333-f33393c81529 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:12.430591 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-24f383fd-5a63-43a0-9333-f33393c81529 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1503 microversion: 2.1 time: 0.300478 Oct 24 11:02:12.433199 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3111/6190] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:12 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1503 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:13.213274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f50ef7ba-0fbf-4ec0-b238-4f6ab69bbe0a req-d8ca48d0-3559-49ba-b439-ccacd125bbf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882", "name": "network-vif-deleted", "tag": "8217556b-199a-4877-b73c-71c827fe8a70"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:02:13.237428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f50ef7ba-0fbf-4ec0-b238-4f6ab69bbe0a req-d8ca48d0-3559-49ba-b439-ccacd125bbf2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:13.237917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f50ef7ba-0fbf-4ec0-b238-4f6ab69bbe0a req-d8ca48d0-3559-49ba-b439-ccacd125bbf2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:13.238539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f50ef7ba-0fbf-4ec0-b238-4f6ab69bbe0a req-d8ca48d0-3559-49ba-b439-ccacd125bbf2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:13.282853 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f50ef7ba-0fbf-4ec0-b238-4f6ab69bbe0a req-d8ca48d0-3559-49ba-b439-ccacd125bbf2 service nova] Creating event network-vif-deleted:8217556b-199a-4877-b73c-71c827fe8a70 for instance 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 on n-h2-858383-15 Oct 24 11:02:13.307463 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f50ef7ba-0fbf-4ec0-b238-4f6ab69bbe0a req-d8ca48d0-3559-49ba-b439-ccacd125bbf2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.535312 Oct 24 11:02:13.310190 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3080/6191] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:02:13.460895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bd5bbc15-32e3-4037-967e-bfb77059a364 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:13.461537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bd5bbc15-32e3-4037-967e-bfb77059a364 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:13.479422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd5bbc15-32e3-4037-967e-bfb77059a364 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:13.487892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd5bbc15-32e3-4037-967e-bfb77059a364 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:13.488667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd5bbc15-32e3-4037-967e-bfb77059a364 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:13.498431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd5bbc15-32e3-4037-967e-bfb77059a364 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:13.502943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd5bbc15-32e3-4037-967e-bfb77059a364 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:13.505272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd5bbc15-32e3-4037-967e-bfb77059a364 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:13.665955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd5bbc15-32e3-4037-967e-bfb77059a364 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:13.668549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd5bbc15-32e3-4037-967e-bfb77059a364 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:13.670290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bd5bbc15-32e3-4037-967e-bfb77059a364 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:13.671603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-bd5bbc15-32e3-4037-967e-bfb77059a364 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lazy-loading 'fault' on Instance uuid 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:02:13.755679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bd5bbc15-32e3-4037-967e-bfb77059a364 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdae8836f9784dff90fea5201fd15d1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45405624633e404ab2d6ff26482a150e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:13.766907 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bd5bbc15-32e3-4037-967e-bfb77059a364 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 200 len: 1356 microversion: 2.1 time: 0.310236 Oct 24 11:02:13.775061 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3112/6192] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:13 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 1356 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:14.796655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-727c3b95-95ff-4710-b613-305aa6864dbe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:14.798101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-727c3b95-95ff-4710-b613-305aa6864dbe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [instance: 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:14.804808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-727c3b95-95ff-4710-b613-305aa6864dbe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:14.805335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-727c3b95-95ff-4710-b613-305aa6864dbe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:14.805782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-727c3b95-95ff-4710-b613-305aa6864dbe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:14.806579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-727c3b95-95ff-4710-b613-305aa6864dbe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:14.807224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-727c3b95-95ff-4710-b613-305aa6864dbe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:14.807659 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-727c3b95-95ff-4710-b613-305aa6864dbe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:14.831065 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-727c3b95-95ff-4710-b613-305aa6864dbe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] HTTP exception thrown: Instance 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 could not be found. Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-727c3b95-95ff-4710-b613-305aa6864dbe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Request method failure captured: Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 HTTP/1.1 Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVm3GX82MAk9t_DY3ldBvJqgw4krRRZI91P4i_Ha4QFlAFzgtY357SWlZo2bmt5yQ4BdbJCOJlqOV_m4WkwsNVJwqhdGf2Mb8PfZodPxM72kQRMnwEV3JRp9SnBdSvplatZoPBEyBaXBcJ4mHkyjNtrR7UqU0ub2iwqP0g4u9U6TTz9c Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 45405624633e404ab2d6ff26482a150e Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-626774974 Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/45405624633e404ab2d6ff26482a150e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/45405624633e404ab2d6ff26482a150e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/45405624633e404ab2d6ff26482a150e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_45405624633e404ab2d6ff26482a150e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestNetworkAdvancedServerOps-626774974 Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 45405624633e404ab2d6ff26482a150e Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-626774974 Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestNetworkAdvancedServerOps-626774974-project Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: cdae8836f9784dff90fea5201fd15d1d Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestNetworkAdvancedServerOps-626774974-project Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 could not be found. Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882'} Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 could not be found. Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 could not be found. Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:02:14.833233 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:02:14.837860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:02:14.837860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:02:14.837860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:02:14.837860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:02:14.837860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:02:14.837860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:02:14.837860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 could not be found. Oct 24 11:02:14.837860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:02:14.837860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-727c3b95-95ff-4710-b613-305aa6864dbe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Returning 404 to user: Instance 12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:02:14.837860 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-727c3b95-95ff-4710-b613-305aa6864dbe tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882" status: 404 len: 111 microversion: 2.1 time: 0.043404 Oct 24 11:02:14.839467 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3081/6193] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:14 2022] GET /compute/v2.1/servers/12eb88dd-3fa4-4cdc-8dbf-2ca2709d6882 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 11:02:25.550153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e5015ff4-6991-45fb-824f-5a28157a3b26 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] Calling method '.version_select at 0x7f04d11e6310>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:25.563896 n-d-858383-15 devstack@n-api.service[120426]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e5015ff4-6991-45fb-824f-5a28157a3b26 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [2660e984-5ff8-4471-bc8f-cfede2631425] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 11:02:25.565404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=10 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:02:25.570844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=22 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:02:26.572533 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [None req-e5015ff4-6991-45fb-824f-5a28157a3b26 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] [2660e984-5ff8-4471-bc8f-cfede2631425] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 33844. Oct 24 11:02:26.618136 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e5015ff4-6991-45fb-824f-5a28157a3b26 tempest-TestNetworkAdvancedServerOps-626774974 tempest-TestNetworkAdvancedServerOps-626774974-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1592495439" status: 202 len: 0 microversion: 2.1 time: 1.071799 Oct 24 11:02:26.620484 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3113/6194] 10.222.0.50 () {58 vars in 1284 bytes} [Mon Oct 24 11:02:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1592495439 => generated 0 bytes in 1075 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:02:33.942992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-acd1cc79-0242-46f3-a2ab-83e2f714e81b tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1225677505", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "6e76b814-2a3d-42aa-a6ce-b97ea3f45fbc"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:02:33.960802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:02:33.963643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:02:34.071709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-acd1cc79-0242-46f3-a2ab-83e2f714e81b tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] validate_networks() for [('6e76b814-2a3d-42aa-a6ce-b97ea3f45fbc', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:02:34.847194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-acd1cc79-0242-46f3-a2ab-83e2f714e81b tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:02:34.848008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-acd1cc79-0242-46f3-a2ab-83e2f714e81b tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:02:34.848765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-acd1cc79-0242-46f3-a2ab-83e2f714e81b tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:02:34.848988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-acd1cc79-0242-46f3-a2ab-83e2f714e81b tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:02:34.849754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-acd1cc79-0242-46f3-a2ab-83e2f714e81b tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:02:34.868277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acd1cc79-0242-46f3-a2ab-83e2f714e81b tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:34.869192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acd1cc79-0242-46f3-a2ab-83e2f714e81b tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:34.869915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acd1cc79-0242-46f3-a2ab-83e2f714e81b tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:34.871256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acd1cc79-0242-46f3-a2ab-83e2f714e81b tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:34.872010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acd1cc79-0242-46f3-a2ab-83e2f714e81b tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:34.872655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-acd1cc79-0242-46f3-a2ab-83e2f714e81b tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:34.895388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-acd1cc79-0242-46f3-a2ab-83e2f714e81b tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Getting quotas for project ba709c74314b49f48e684aa99eb4a433. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:02:34.902090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-acd1cc79-0242-46f3-a2ab-83e2f714e81b tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Getting quotas for user 6abfc205e99840259c8eb68560817581 and project ba709c74314b49f48e684aa99eb4a433. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:02:34.916011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-acd1cc79-0242-46f3-a2ab-83e2f714e81b tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:02:34.918858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-acd1cc79-0242-46f3-a2ab-83e2f714e81b tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:02:35.020395 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-acd1cc79-0242-46f3-a2ab-83e2f714e81b tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.079773 Oct 24 11:02:35.021097 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3082/6195] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:02:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 11:02:35.033719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c19fa928-762c-4505-83b3-4b2c39e10212 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:35.035476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c19fa928-762c-4505-83b3-4b2c39e10212 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:35.196196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c19fa928-762c-4505-83b3-4b2c39e10212 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:35.205037 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c19fa928-762c-4505-83b3-4b2c39e10212 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22" status: 200 len: 1214 microversion: 2.1 time: 0.175745 Oct 24 11:02:35.205508 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3114/6196] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:35 2022] GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:36.232308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c6405a84-a06e-411e-83fb-4b8b7c9a380f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:36.233137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c6405a84-a06e-411e-83fb-4b8b7c9a380f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:36.250332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6405a84-a06e-411e-83fb-4b8b7c9a380f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:36.250843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6405a84-a06e-411e-83fb-4b8b7c9a380f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:36.251290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6405a84-a06e-411e-83fb-4b8b7c9a380f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:36.252022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6405a84-a06e-411e-83fb-4b8b7c9a380f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:36.252485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6405a84-a06e-411e-83fb-4b8b7c9a380f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:36.252939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c6405a84-a06e-411e-83fb-4b8b7c9a380f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:36.419335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c6405a84-a06e-411e-83fb-4b8b7c9a380f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:36.435243 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c6405a84-a06e-411e-83fb-4b8b7c9a380f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22" status: 200 len: 1218 microversion: 2.1 time: 0.207830 Oct 24 11:02:36.449274 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3083/6197] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:36 2022] GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 => generated 1218 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:36.692606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1c76e3b0-5c88-47dd-b9f9-b92cc57494fd tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-180482106", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "92c62273-c3c0-444a-be3c-ed1509c113b8"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:02:36.806270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-1c76e3b0-5c88-47dd-b9f9-b92cc57494fd tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] validate_networks() for [('92c62273-c3c0-444a-be3c-ed1509c113b8', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:02:37.374899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1c76e3b0-5c88-47dd-b9f9-b92cc57494fd tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:02:37.375514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1c76e3b0-5c88-47dd-b9f9-b92cc57494fd tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:02:37.376010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1c76e3b0-5c88-47dd-b9f9-b92cc57494fd tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:02:37.376438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1c76e3b0-5c88-47dd-b9f9-b92cc57494fd tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:02:37.377030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1c76e3b0-5c88-47dd-b9f9-b92cc57494fd tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:02:37.391009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c76e3b0-5c88-47dd-b9f9-b92cc57494fd tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:37.391572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c76e3b0-5c88-47dd-b9f9-b92cc57494fd tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:37.392312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c76e3b0-5c88-47dd-b9f9-b92cc57494fd tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:37.393326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c76e3b0-5c88-47dd-b9f9-b92cc57494fd tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:37.394083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c76e3b0-5c88-47dd-b9f9-b92cc57494fd tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:37.394544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1c76e3b0-5c88-47dd-b9f9-b92cc57494fd tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:37.423604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-1c76e3b0-5c88-47dd-b9f9-b92cc57494fd tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Getting quotas for project 8fa2066161ad4dfcbdb1b78ffe0896e5. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:02:37.431864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-1c76e3b0-5c88-47dd-b9f9-b92cc57494fd tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Getting quotas for user 4aafacbb96924fc4a17389a051a91301 and project 8fa2066161ad4dfcbdb1b78ffe0896e5. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:02:37.454271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1c76e3b0-5c88-47dd-b9f9-b92cc57494fd tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:02:37.456948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1c76e3b0-5c88-47dd-b9f9-b92cc57494fd tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:02:37.463951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-629ff37d-0963-44b7-88ae-681eecd1f5e4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:37.464783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-629ff37d-0963-44b7-88ae-681eecd1f5e4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:37.488676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-629ff37d-0963-44b7-88ae-681eecd1f5e4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:37.489465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-629ff37d-0963-44b7-88ae-681eecd1f5e4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:37.490728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-629ff37d-0963-44b7-88ae-681eecd1f5e4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:37.491623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-629ff37d-0963-44b7-88ae-681eecd1f5e4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:37.492226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-629ff37d-0963-44b7-88ae-681eecd1f5e4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:37.492730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-629ff37d-0963-44b7-88ae-681eecd1f5e4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:37.528315 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1c76e3b0-5c88-47dd-b9f9-b92cc57494fd tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.093842 Oct 24 11:02:37.529831 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3115/6198] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:02:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 11:02:37.560631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c07f817b-cde5-4d3f-9ec8-a65fdbad85d1 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:37.564410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c07f817b-cde5-4d3f-9ec8-a65fdbad85d1 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:37.672201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-629ff37d-0963-44b7-88ae-681eecd1f5e4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:37.690932 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-629ff37d-0963-44b7-88ae-681eecd1f5e4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22" status: 200 len: 1272 microversion: 2.1 time: 0.230958 Oct 24 11:02:37.692917 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3084/6199] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:37 2022] GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 => generated 1272 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:37.696240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c07f817b-cde5-4d3f-9ec8-a65fdbad85d1 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:37.709540 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c07f817b-cde5-4d3f-9ec8-a65fdbad85d1 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1214 microversion: 2.1 time: 0.158600 Oct 24 11:02:37.710477 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3116/6200] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:37 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:38.721442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7550b226-3d14-44a7-9b15-624951400093 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:38.722202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7550b226-3d14-44a7-9b15-624951400093 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:38.729331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7550b226-3d14-44a7-9b15-624951400093 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:38.729827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7550b226-3d14-44a7-9b15-624951400093 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:38.730291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7550b226-3d14-44a7-9b15-624951400093 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:38.730983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7550b226-3d14-44a7-9b15-624951400093 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:38.731444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7550b226-3d14-44a7-9b15-624951400093 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:38.731875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7550b226-3d14-44a7-9b15-624951400093 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:38.740762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e826da87-ec8c-48fb-9fee-551dfbd60d04 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:38.741568 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e826da87-ec8c-48fb-9fee-551dfbd60d04 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:38.750631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e826da87-ec8c-48fb-9fee-551dfbd60d04 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:38.751012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e826da87-ec8c-48fb-9fee-551dfbd60d04 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:38.751548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e826da87-ec8c-48fb-9fee-551dfbd60d04 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:38.752351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e826da87-ec8c-48fb-9fee-551dfbd60d04 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:38.752939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e826da87-ec8c-48fb-9fee-551dfbd60d04 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:38.753484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e826da87-ec8c-48fb-9fee-551dfbd60d04 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:38.840179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e826da87-ec8c-48fb-9fee-551dfbd60d04 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:38.849914 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e826da87-ec8c-48fb-9fee-551dfbd60d04 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1266 microversion: 2.1 time: 0.113284 Oct 24 11:02:38.850505 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3117/6201] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:38 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:02:38.914729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7550b226-3d14-44a7-9b15-624951400093 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:38.923842 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7550b226-3d14-44a7-9b15-624951400093 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22" status: 200 len: 1314 microversion: 2.1 time: 0.206349 Oct 24 11:02:38.925622 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3085/6202] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:38 2022] GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:39.614066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-ea8a0a6a-071e-41c2-a944-806fc7e8c525 req-75cadced-1949-49c5-98d1-8e81391b16d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eaee084-1269-4a90-9d9e-4bb2bf2d9e22", "tag": "fdba89f5-5bce-49bc-b531-b2c8d65226bd"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:02:39.631351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ea8a0a6a-071e-41c2-a944-806fc7e8c525 req-75cadced-1949-49c5-98d1-8e81391b16d9 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:39.632188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ea8a0a6a-071e-41c2-a944-806fc7e8c525 req-75cadced-1949-49c5-98d1-8e81391b16d9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:39.632860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ea8a0a6a-071e-41c2-a944-806fc7e8c525 req-75cadced-1949-49c5-98d1-8e81391b16d9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:39.649740 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ea8a0a6a-071e-41c2-a944-806fc7e8c525 req-75cadced-1949-49c5-98d1-8e81391b16d9 service nova] Creating event network-changed:fdba89f5-5bce-49bc-b531-b2c8d65226bd for instance 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 on n-h2-858383-15 Oct 24 11:02:39.673027 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-ea8a0a6a-071e-41c2-a944-806fc7e8c525 req-75cadced-1949-49c5-98d1-8e81391b16d9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055181 Oct 24 11:02:39.674483 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3118/6203] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:02:39.877240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-36837f21-109b-44e4-873a-966b681b5036 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:39.878463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-36837f21-109b-44e4-873a-966b681b5036 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:39.889515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36837f21-109b-44e4-873a-966b681b5036 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:39.889964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36837f21-109b-44e4-873a-966b681b5036 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:39.891494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36837f21-109b-44e4-873a-966b681b5036 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:39.892911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36837f21-109b-44e4-873a-966b681b5036 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:39.893550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36837f21-109b-44e4-873a-966b681b5036 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:39.894644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36837f21-109b-44e4-873a-966b681b5036 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:39.949057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3b1ed640-9288-42ba-8c02-23e44a954156 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:39.950012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3b1ed640-9288-42ba-8c02-23e44a954156 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:39.969080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1ed640-9288-42ba-8c02-23e44a954156 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:39.973905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1ed640-9288-42ba-8c02-23e44a954156 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:39.974895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1ed640-9288-42ba-8c02-23e44a954156 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:39.976467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1ed640-9288-42ba-8c02-23e44a954156 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:39.978338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1ed640-9288-42ba-8c02-23e44a954156 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:39.980017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1ed640-9288-42ba-8c02-23e44a954156 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:40.336426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-36837f21-109b-44e4-873a-966b681b5036 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:40.350782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3b1ed640-9288-42ba-8c02-23e44a954156 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:40.361571 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-36837f21-109b-44e4-873a-966b681b5036 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1314 microversion: 2.1 time: 0.489837 Oct 24 11:02:40.363225 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3b1ed640-9288-42ba-8c02-23e44a954156 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22" status: 200 len: 1314 microversion: 2.1 time: 0.419032 Oct 24 11:02:40.364561 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3086/6204] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:39 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:40.374527 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3119/6205] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:39 2022] GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:41.140367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-9fc611c3-4ea4-4392-b862-c22bdba0413f req-39f446b2-78f5-4cd6-bc63-42d8d19e8fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1499c7a8-df86-425f-ad4f-911b8cca47ec", "tag": "0f174c39-ebb3-43ac-8361-fe14ca401865"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:02:41.164202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9fc611c3-4ea4-4392-b862-c22bdba0413f req-39f446b2-78f5-4cd6-bc63-42d8d19e8fe4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:41.165333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9fc611c3-4ea4-4392-b862-c22bdba0413f req-39f446b2-78f5-4cd6-bc63-42d8d19e8fe4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:41.166200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9fc611c3-4ea4-4392-b862-c22bdba0413f req-39f446b2-78f5-4cd6-bc63-42d8d19e8fe4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:41.187911 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-9fc611c3-4ea4-4392-b862-c22bdba0413f req-39f446b2-78f5-4cd6-bc63-42d8d19e8fe4 service nova] Creating event network-changed:0f174c39-ebb3-43ac-8361-fe14ca401865 for instance 1499c7a8-df86-425f-ad4f-911b8cca47ec on n-h1-858383-15 Oct 24 11:02:41.201019 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-9fc611c3-4ea4-4392-b862-c22bdba0413f req-39f446b2-78f5-4cd6-bc63-42d8d19e8fe4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065108 Oct 24 11:02:41.202382 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3087/6206] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:02:41.389103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a1c69ab0-03b1-4f83-a575-f17c5086e869 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:41.391300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a1c69ab0-03b1-4f83-a575-f17c5086e869 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:41.395037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf729e83-ca51-467f-8fd5-2da9d683cb9d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:41.396865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf729e83-ca51-467f-8fd5-2da9d683cb9d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:41.399106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1c69ab0-03b1-4f83-a575-f17c5086e869 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:41.399654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1c69ab0-03b1-4f83-a575-f17c5086e869 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:41.400897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1c69ab0-03b1-4f83-a575-f17c5086e869 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:41.401427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1c69ab0-03b1-4f83-a575-f17c5086e869 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:41.402089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1c69ab0-03b1-4f83-a575-f17c5086e869 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:41.402739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a1c69ab0-03b1-4f83-a575-f17c5086e869 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:41.407086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf729e83-ca51-467f-8fd5-2da9d683cb9d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:41.407725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf729e83-ca51-467f-8fd5-2da9d683cb9d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:41.408299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf729e83-ca51-467f-8fd5-2da9d683cb9d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:41.409179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf729e83-ca51-467f-8fd5-2da9d683cb9d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:41.409706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf729e83-ca51-467f-8fd5-2da9d683cb9d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:41.410412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf729e83-ca51-467f-8fd5-2da9d683cb9d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:41.751379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a1c69ab0-03b1-4f83-a575-f17c5086e869 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:41.754770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cf729e83-ca51-467f-8fd5-2da9d683cb9d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:41.782786 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf729e83-ca51-467f-8fd5-2da9d683cb9d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22" status: 200 len: 1314 microversion: 2.1 time: 0.394606 Oct 24 11:02:41.784775 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a1c69ab0-03b1-4f83-a575-f17c5086e869 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1314 microversion: 2.1 time: 0.400919 Oct 24 11:02:41.785716 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3088/6207] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:41 2022] GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:41.788795 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3120/6208] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:41 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:42.810656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7ad614b7-7e3e-414b-b99c-7da335f96a08 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:42.811935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7ad614b7-7e3e-414b-b99c-7da335f96a08 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:42.816773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-526c97cc-8e96-42af-854b-dcffaa4caa63 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:42.818461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-526c97cc-8e96-42af-854b-dcffaa4caa63 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:42.824914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ad614b7-7e3e-414b-b99c-7da335f96a08 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:42.825442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ad614b7-7e3e-414b-b99c-7da335f96a08 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:42.825885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ad614b7-7e3e-414b-b99c-7da335f96a08 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:42.828555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-526c97cc-8e96-42af-854b-dcffaa4caa63 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:42.829499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-526c97cc-8e96-42af-854b-dcffaa4caa63 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:42.830176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-526c97cc-8e96-42af-854b-dcffaa4caa63 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:42.831184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-526c97cc-8e96-42af-854b-dcffaa4caa63 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:42.831925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-526c97cc-8e96-42af-854b-dcffaa4caa63 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:42.832942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-526c97cc-8e96-42af-854b-dcffaa4caa63 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:42.837866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ad614b7-7e3e-414b-b99c-7da335f96a08 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:42.838373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ad614b7-7e3e-414b-b99c-7da335f96a08 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:42.838830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ad614b7-7e3e-414b-b99c-7da335f96a08 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:43.130288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7ad614b7-7e3e-414b-b99c-7da335f96a08 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:43.137367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-526c97cc-8e96-42af-854b-dcffaa4caa63 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:43.144354 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7ad614b7-7e3e-414b-b99c-7da335f96a08 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22" status: 200 len: 1314 microversion: 2.1 time: 0.337566 Oct 24 11:02:43.145405 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3089/6209] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:42 2022] GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:43.157011 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-526c97cc-8e96-42af-854b-dcffaa4caa63 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1314 microversion: 2.1 time: 0.337226 Oct 24 11:02:43.163880 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3121/6210] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:42 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:44.170223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e492ec7-ecf5-4a1d-8907-c0e1491ecc06 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:44.171615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0e492ec7-ecf5-4a1d-8907-c0e1491ecc06 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:44.172725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4e059909-cdc7-4999-b7cc-63db150a8ca7 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:44.173455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4e059909-cdc7-4999-b7cc-63db150a8ca7 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:44.179425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e492ec7-ecf5-4a1d-8907-c0e1491ecc06 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:44.179952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e059909-cdc7-4999-b7cc-63db150a8ca7 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:44.180516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e059909-cdc7-4999-b7cc-63db150a8ca7 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:44.180892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e492ec7-ecf5-4a1d-8907-c0e1491ecc06 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:44.181122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e059909-cdc7-4999-b7cc-63db150a8ca7 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:44.181935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e059909-cdc7-4999-b7cc-63db150a8ca7 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:44.182370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e492ec7-ecf5-4a1d-8907-c0e1491ecc06 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:44.182588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e059909-cdc7-4999-b7cc-63db150a8ca7 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:44.183116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e059909-cdc7-4999-b7cc-63db150a8ca7 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:44.183959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e492ec7-ecf5-4a1d-8907-c0e1491ecc06 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:44.184731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e492ec7-ecf5-4a1d-8907-c0e1491ecc06 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:44.185830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e492ec7-ecf5-4a1d-8907-c0e1491ecc06 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:44.481322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4e059909-cdc7-4999-b7cc-63db150a8ca7 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:44.491511 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4e059909-cdc7-4999-b7cc-63db150a8ca7 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1314 microversion: 2.1 time: 0.323030 Oct 24 11:02:44.492560 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3122/6211] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:44 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:02:44.498206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f628968a-45f1-4615-bd82-0d564d10ab37 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:44.499251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f628968a-45f1-4615-bd82-0d564d10ab37 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:44.506261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f628968a-45f1-4615-bd82-0d564d10ab37 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:44.506762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f628968a-45f1-4615-bd82-0d564d10ab37 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:44.507203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f628968a-45f1-4615-bd82-0d564d10ab37 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:44.507916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f628968a-45f1-4615-bd82-0d564d10ab37 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:44.508379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f628968a-45f1-4615-bd82-0d564d10ab37 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:44.508811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f628968a-45f1-4615-bd82-0d564d10ab37 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:44.526076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0e492ec7-ecf5-4a1d-8907-c0e1491ecc06 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:44.534712 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e492ec7-ecf5-4a1d-8907-c0e1491ecc06 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22" status: 200 len: 1314 microversion: 2.1 time: 0.369046 Oct 24 11:02:44.535300 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3090/6212] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:44 2022] GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:44.548494 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f628968a-45f1-4615-bd82-0d564d10ab37 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150/ips" status: 200 len: 151 microversion: 2.1 time: 0.054677 Oct 24 11:02:44.555936 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3123/6213] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Oct 24 11:02:44 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150/ips => generated 151 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:02:44.562102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-77361f2d-8ec3-40e2-80de-36e5879fb235 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d07325c1-a728-4fcd-a607-2c7f3357c533"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:02:44.564546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-77361f2d-8ec3-40e2-80de-36e5879fb235 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:44.575616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77361f2d-8ec3-40e2-80de-36e5879fb235 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:44.576124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77361f2d-8ec3-40e2-80de-36e5879fb235 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:44.576569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77361f2d-8ec3-40e2-80de-36e5879fb235 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:44.577536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77361f2d-8ec3-40e2-80de-36e5879fb235 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:44.578000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77361f2d-8ec3-40e2-80de-36e5879fb235 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:44.578430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77361f2d-8ec3-40e2-80de-36e5879fb235 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:44.701086 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-77361f2d-8ec3-40e2-80de-36e5879fb235 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] HTTP exception thrown: Invalid volume: volume d07325c1-a728-4fcd-a607-2c7f3357c533 is already attached to instances: 64d0cfd3-33a6-473c-8d33-1a7ff418e838 Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-77361f2d-8ec3-40e2-80de-36e5879fb235 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Request method failure captured: Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150/os-volume_attachments HTTP/1.1 Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 74 Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnAKAHP5OOfm-uCWTjFJTzXa0YLKSuouosUciU14TRf3JmMepl7Z3nYn7w4Ibs55CltNd_hrYn98Pw4N-ToeUd4QusviP9lFlPXOJGwfHRkdtQPCg9kRiq2YXaf55wJAz2KjxNTj7AXjHUrV-JebO1VNsJhWCbt5cfPkaHFUJTxTNxM Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a10ff6644b9b4215b1b7c82b98342a79", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: da9e4e22dda84476a30e6b6bd27c68a6 Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: {"volumeAttachment": {"volumeId": "d07325c1-a728-4fcd-a607-2c7f3357c533"}} Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid volume: volume d07325c1-a728-4fcd-a607-2c7f3357c533 is already attached to instances: 64d0cfd3-33a6-473c-8d33-1a7ff418e838 Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'server_id': '33939031-e4c1-45c6-9aa1-c8751f6ab150', 'body': {'volumeAttachment': {'volumeId': 'd07325c1-a728-4fcd-a607-2c7f3357c533'}}} Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in attach_volume Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4972, in _check_volume_already_attached Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d07325c1-a728-4fcd-a607-2c7f3357c533 is already attached to instances: 64d0cfd3-33a6-473c-8d33-1a7ff418e838 Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 11:02:44.704682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 11:02:44.709339 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 11:02:44.709339 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 11:02:44.709339 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 24 11:02:44.709339 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 11:02:44.709339 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d07325c1-a728-4fcd-a607-2c7f3357c533 is already attached to instances: 64d0cfd3-33a6-473c-8d33-1a7ff418e838 Oct 24 11:02:44.709339 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:02:44.709339 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:02:44.709339 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:02:44.709339 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:02:44.709339 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:02:44.709339 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:02:44.709339 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:02:44.709339 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:02:44.709339 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d07325c1-a728-4fcd-a607-2c7f3357c533 is already attached to instances: 64d0cfd3-33a6-473c-8d33-1a7ff418e838 Oct 24 11:02:44.709339 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:02:44.711406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-77361f2d-8ec3-40e2-80de-36e5879fb235 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Returning 400 to user: Invalid volume: volume d07325c1-a728-4fcd-a607-2c7f3357c533 is already attached to instances: 64d0cfd3-33a6-473c-8d33-1a7ff418e838 {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:02:44.711904 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-77361f2d-8ec3-40e2-80de-36e5879fb235 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "POST /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.153918 Oct 24 11:02:44.716530 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3091/6214] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 11:02:44 2022] POST /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150/os-volume_attachments => generated 174 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 11:02:44.722779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54d8bcb2-869f-4d68-ad4f-fa368be0f7ae tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:44.723289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-54d8bcb2-869f-4d68-ad4f-fa368be0f7ae tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:44.729441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54d8bcb2-869f-4d68-ad4f-fa368be0f7ae tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:44.729907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54d8bcb2-869f-4d68-ad4f-fa368be0f7ae tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:44.730357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54d8bcb2-869f-4d68-ad4f-fa368be0f7ae tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:44.731059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54d8bcb2-869f-4d68-ad4f-fa368be0f7ae tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:44.731524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54d8bcb2-869f-4d68-ad4f-fa368be0f7ae tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:44.731955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54d8bcb2-869f-4d68-ad4f-fa368be0f7ae tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:44.769429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-54d8bcb2-869f-4d68-ad4f-fa368be0f7ae tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:02:44.922170 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-54d8bcb2-869f-4d68-ad4f-fa368be0f7ae tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "DELETE /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 204 len: 0 microversion: 2.1 time: 0.203843 Oct 24 11:02:44.923008 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3124/6215] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:02:44 2022] DELETE /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:02:44.932703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c2e3dccd-b693-4a85-9c67-c053604244fc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:44.933478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c2e3dccd-b693-4a85-9c67-c053604244fc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:44.936290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:02:44.937797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:02:44.943123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2e3dccd-b693-4a85-9c67-c053604244fc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:44.943613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2e3dccd-b693-4a85-9c67-c053604244fc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:44.944054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2e3dccd-b693-4a85-9c67-c053604244fc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:44.944853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2e3dccd-b693-4a85-9c67-c053604244fc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:44.945318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2e3dccd-b693-4a85-9c67-c053604244fc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:44.945749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c2e3dccd-b693-4a85-9c67-c053604244fc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:45.055019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a6c5f4d0-3a0f-4683-bd18-b3c21ba328d1 req-071c0236-5f8f-4376-9408-c19af0ccacf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eaee084-1269-4a90-9d9e-4bb2bf2d9e22", "name": "network-vif-plugged", "status": "completed", "tag": "fdba89f5-5bce-49bc-b531-b2c8d65226bd"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:02:45.065995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a6c5f4d0-3a0f-4683-bd18-b3c21ba328d1 req-071c0236-5f8f-4376-9408-c19af0ccacf6 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:45.066756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a6c5f4d0-3a0f-4683-bd18-b3c21ba328d1 req-071c0236-5f8f-4376-9408-c19af0ccacf6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:45.067421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a6c5f4d0-3a0f-4683-bd18-b3c21ba328d1 req-071c0236-5f8f-4376-9408-c19af0ccacf6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:45.086209 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a6c5f4d0-3a0f-4683-bd18-b3c21ba328d1 req-071c0236-5f8f-4376-9408-c19af0ccacf6 service nova] Creating event network-vif-plugged:fdba89f5-5bce-49bc-b531-b2c8d65226bd for instance 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 on n-h2-858383-15 Oct 24 11:02:45.091781 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a6c5f4d0-3a0f-4683-bd18-b3c21ba328d1 req-071c0236-5f8f-4376-9408-c19af0ccacf6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041127 Oct 24 11:02:45.093054 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3125/6216] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:02:45.112769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c2e3dccd-b693-4a85-9c67-c053604244fc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:45.122916 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c2e3dccd-b693-4a85-9c67-c053604244fc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 200 len: 1682 microversion: 2.1 time: 0.194954 Oct 24 11:02:45.124167 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3092/6217] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:44 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 1682 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:02:45.518871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-02ad2e91-aebd-4484-91ab-86263cbafb3d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:45.519668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-02ad2e91-aebd-4484-91ab-86263cbafb3d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:45.534914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02ad2e91-aebd-4484-91ab-86263cbafb3d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:45.535407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02ad2e91-aebd-4484-91ab-86263cbafb3d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:45.535843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02ad2e91-aebd-4484-91ab-86263cbafb3d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:45.536542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02ad2e91-aebd-4484-91ab-86263cbafb3d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:45.537043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02ad2e91-aebd-4484-91ab-86263cbafb3d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:45.537504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02ad2e91-aebd-4484-91ab-86263cbafb3d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:45.558773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43fe0b1e-b39a-447b-a3f9-8265ec41fc67 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:45.559398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-43fe0b1e-b39a-447b-a3f9-8265ec41fc67 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:45.567262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43fe0b1e-b39a-447b-a3f9-8265ec41fc67 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:45.567757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43fe0b1e-b39a-447b-a3f9-8265ec41fc67 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:45.568202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43fe0b1e-b39a-447b-a3f9-8265ec41fc67 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:45.568934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43fe0b1e-b39a-447b-a3f9-8265ec41fc67 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:45.569596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43fe0b1e-b39a-447b-a3f9-8265ec41fc67 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:45.570418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43fe0b1e-b39a-447b-a3f9-8265ec41fc67 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:45.749749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-02ad2e91-aebd-4484-91ab-86263cbafb3d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:45.763455 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-02ad2e91-aebd-4484-91ab-86263cbafb3d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1314 microversion: 2.1 time: 0.249858 Oct 24 11:02:45.765004 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3126/6218] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:45 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:45.788541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-43fe0b1e-b39a-447b-a3f9-8265ec41fc67 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:45.804318 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-43fe0b1e-b39a-447b-a3f9-8265ec41fc67 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22" status: 200 len: 1314 microversion: 2.1 time: 0.249260 Oct 24 11:02:45.809515 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3093/6219] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:45 2022] GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:46.150394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-91234310-4c25-4725-a911-ca6ba711ccef tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:46.151138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-91234310-4c25-4725-a911-ca6ba711ccef tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:46.158868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91234310-4c25-4725-a911-ca6ba711ccef tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:46.159658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91234310-4c25-4725-a911-ca6ba711ccef tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:46.160258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91234310-4c25-4725-a911-ca6ba711ccef tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:46.161287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91234310-4c25-4725-a911-ca6ba711ccef tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:46.161905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91234310-4c25-4725-a911-ca6ba711ccef tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:46.162495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91234310-4c25-4725-a911-ca6ba711ccef tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:46.304485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-91234310-4c25-4725-a911-ca6ba711ccef tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:46.314108 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-91234310-4c25-4725-a911-ca6ba711ccef tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 200 len: 1682 microversion: 2.1 time: 0.168440 Oct 24 11:02:46.314710 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3127/6220] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:46 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:46.791548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7fa82291-ee84-4685-9199-f18e5293f596 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:46.792173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7fa82291-ee84-4685-9199-f18e5293f596 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:46.800740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fa82291-ee84-4685-9199-f18e5293f596 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:46.801387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fa82291-ee84-4685-9199-f18e5293f596 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:46.802035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fa82291-ee84-4685-9199-f18e5293f596 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:46.802796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fa82291-ee84-4685-9199-f18e5293f596 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:46.803357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fa82291-ee84-4685-9199-f18e5293f596 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:46.804013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7fa82291-ee84-4685-9199-f18e5293f596 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:46.827828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b3e90156-1a41-4f82-a471-9fb2762a7345 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:46.828522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b3e90156-1a41-4f82-a471-9fb2762a7345 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:46.837115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3e90156-1a41-4f82-a471-9fb2762a7345 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:46.838517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3e90156-1a41-4f82-a471-9fb2762a7345 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:46.839914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3e90156-1a41-4f82-a471-9fb2762a7345 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:46.840800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3e90156-1a41-4f82-a471-9fb2762a7345 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:46.841423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3e90156-1a41-4f82-a471-9fb2762a7345 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:46.842038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3e90156-1a41-4f82-a471-9fb2762a7345 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:47.250107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7fa82291-ee84-4685-9199-f18e5293f596 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:47.258581 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7fa82291-ee84-4685-9199-f18e5293f596 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1314 microversion: 2.1 time: 0.471489 Oct 24 11:02:47.259173 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3094/6221] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:46 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:47.277209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b3e90156-1a41-4f82-a471-9fb2762a7345 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:47.299912 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b3e90156-1a41-4f82-a471-9fb2762a7345 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22" status: 200 len: 1498 microversion: 2.1 time: 0.476148 Oct 24 11:02:47.323289 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3128/6222] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:46 2022] GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 => generated 1498 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:02:47.346883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6670d9c1-6cd3-49d9-a557-3c5e513f1903 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:47.348297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6670d9c1-6cd3-49d9-a557-3c5e513f1903 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:47.367195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6670d9c1-6cd3-49d9-a557-3c5e513f1903 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:47.368121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6670d9c1-6cd3-49d9-a557-3c5e513f1903 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:47.368588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6670d9c1-6cd3-49d9-a557-3c5e513f1903 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:47.369369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6670d9c1-6cd3-49d9-a557-3c5e513f1903 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:47.369836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6670d9c1-6cd3-49d9-a557-3c5e513f1903 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:47.370281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6670d9c1-6cd3-49d9-a557-3c5e513f1903 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:47.714210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6670d9c1-6cd3-49d9-a557-3c5e513f1903 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:47.734737 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6670d9c1-6cd3-49d9-a557-3c5e513f1903 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 200 len: 1682 microversion: 2.1 time: 0.396901 Oct 24 11:02:47.749627 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3095/6223] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:47 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 1682 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:47.998323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-ce3b318d-6856-4243-9893-19797162b341 req-9eb27d04-68dc-46a9-bf74-0a64163bfedb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1499c7a8-df86-425f-ad4f-911b8cca47ec", "name": "network-vif-plugged", "status": "completed", "tag": "0f174c39-ebb3-43ac-8361-fe14ca401865"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:02:48.019396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:02:48.023823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=10 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:02:48.033561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ce3b318d-6856-4243-9893-19797162b341 req-9eb27d04-68dc-46a9-bf74-0a64163bfedb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:48.035362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ce3b318d-6856-4243-9893-19797162b341 req-9eb27d04-68dc-46a9-bf74-0a64163bfedb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:48.036557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ce3b318d-6856-4243-9893-19797162b341 req-9eb27d04-68dc-46a9-bf74-0a64163bfedb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:48.068052 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ce3b318d-6856-4243-9893-19797162b341 req-9eb27d04-68dc-46a9-bf74-0a64163bfedb service nova] Creating event network-vif-plugged:0f174c39-ebb3-43ac-8361-fe14ca401865 for instance 1499c7a8-df86-425f-ad4f-911b8cca47ec on n-h1-858383-15 Oct 24 11:02:48.092874 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-ce3b318d-6856-4243-9893-19797162b341 req-9eb27d04-68dc-46a9-bf74-0a64163bfedb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099598 Oct 24 11:02:48.096596 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3129/6224] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:02:48.182446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0bc9b7ab-b2c1-4c28-b054-9b5b2eabf7c5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:48.182990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0bc9b7ab-b2c1-4c28-b054-9b5b2eabf7c5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:48.212179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bc9b7ab-b2c1-4c28-b054-9b5b2eabf7c5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:48.213348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bc9b7ab-b2c1-4c28-b054-9b5b2eabf7c5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:48.213983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bc9b7ab-b2c1-4c28-b054-9b5b2eabf7c5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:48.218269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bc9b7ab-b2c1-4c28-b054-9b5b2eabf7c5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:48.225459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bc9b7ab-b2c1-4c28-b054-9b5b2eabf7c5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:48.228746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bc9b7ab-b2c1-4c28-b054-9b5b2eabf7c5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:48.287221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7f975e53-0463-48c7-89ee-08cfa228d19d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:48.288486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7f975e53-0463-48c7-89ee-08cfa228d19d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:48.297182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f975e53-0463-48c7-89ee-08cfa228d19d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:48.297916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f975e53-0463-48c7-89ee-08cfa228d19d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:48.298474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0bc9b7ab-b2c1-4c28-b054-9b5b2eabf7c5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:02:48.298642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f975e53-0463-48c7-89ee-08cfa228d19d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:48.299618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f975e53-0463-48c7-89ee-08cfa228d19d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:48.300556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f975e53-0463-48c7-89ee-08cfa228d19d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:48.301264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f975e53-0463-48c7-89ee-08cfa228d19d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:48.534903 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0bc9b7ab-b2c1-4c28-b054-9b5b2eabf7c5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22" status: 204 len: 0 microversion: 2.1 time: 0.357347 Oct 24 11:02:48.541882 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3096/6225] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:02:48 2022] DELETE /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:02:48.554840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-8de435c6-5b19-4d60-9a36-63a2abd64040 req-34a3813d-4ecf-4d72-9226-a0e79d613fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33939031-e4c1-45c6-9aa1-c8751f6ab150", "name": "network-vif-deleted", "tag": "bcbe60d9-84d3-49f4-ae82-82bcd420b74a"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:02:48.581625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8de435c6-5b19-4d60-9a36-63a2abd64040 req-34a3813d-4ecf-4d72-9226-a0e79d613fd8 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:48.583885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8de435c6-5b19-4d60-9a36-63a2abd64040 req-34a3813d-4ecf-4d72-9226-a0e79d613fd8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:48.584494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8de435c6-5b19-4d60-9a36-63a2abd64040 req-34a3813d-4ecf-4d72-9226-a0e79d613fd8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:48.608074 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-8de435c6-5b19-4d60-9a36-63a2abd64040 req-34a3813d-4ecf-4d72-9226-a0e79d613fd8 service nova] Creating event network-vif-deleted:bcbe60d9-84d3-49f4-ae82-82bcd420b74a for instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 on n-h1-858383-15 Oct 24 11:02:48.614433 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-8de435c6-5b19-4d60-9a36-63a2abd64040 req-34a3813d-4ecf-4d72-9226-a0e79d613fd8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070225 Oct 24 11:02:48.615065 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3097/6226] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:02:48.620725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-08cf8f8a-7923-4363-afb4-81e26227710f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:48.621649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-08cf8f8a-7923-4363-afb4-81e26227710f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:48.633261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08cf8f8a-7923-4363-afb4-81e26227710f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:48.633955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08cf8f8a-7923-4363-afb4-81e26227710f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:48.635876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08cf8f8a-7923-4363-afb4-81e26227710f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:48.636929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08cf8f8a-7923-4363-afb4-81e26227710f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:48.637554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08cf8f8a-7923-4363-afb4-81e26227710f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:48.638167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08cf8f8a-7923-4363-afb4-81e26227710f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:48.701364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7f975e53-0463-48c7-89ee-08cfa228d19d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:48.718919 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7f975e53-0463-48c7-89ee-08cfa228d19d tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1314 microversion: 2.1 time: 0.435824 Oct 24 11:02:48.721436 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3130/6227] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:48 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:02:48.761429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2f9a6a9c-9c8a-4d9e-b9b5-8331a8a05b3f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:48.762314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2f9a6a9c-9c8a-4d9e-b9b5-8331a8a05b3f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:48.770388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f9a6a9c-9c8a-4d9e-b9b5-8331a8a05b3f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:48.773566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f9a6a9c-9c8a-4d9e-b9b5-8331a8a05b3f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:48.774028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f9a6a9c-9c8a-4d9e-b9b5-8331a8a05b3f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:48.774766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f9a6a9c-9c8a-4d9e-b9b5-8331a8a05b3f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:48.775408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f9a6a9c-9c8a-4d9e-b9b5-8331a8a05b3f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:48.776225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f9a6a9c-9c8a-4d9e-b9b5-8331a8a05b3f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:48.815672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f9a6a9c-9c8a-4d9e-b9b5-8331a8a05b3f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:48.816561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f9a6a9c-9c8a-4d9e-b9b5-8331a8a05b3f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:48.817359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f9a6a9c-9c8a-4d9e-b9b5-8331a8a05b3f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:48.818011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-2f9a6a9c-9c8a-4d9e-b9b5-8331a8a05b3f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lazy-loading 'fault' on Instance uuid 33939031-e4c1-45c6-9aa1-c8751f6ab150 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:02:48.831010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-08cf8f8a-7923-4363-afb4-81e26227710f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:48.842407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:02:48.854356 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-08cf8f8a-7923-4363-afb4-81e26227710f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22" status: 200 len: 1504 microversion: 2.1 time: 0.236763 Oct 24 11:02:48.855271 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3098/6228] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:48 2022] GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 => generated 1504 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:48.887354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2f9a6a9c-9c8a-4d9e-b9b5-8331a8a05b3f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:48.898047 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2f9a6a9c-9c8a-4d9e-b9b5-8331a8a05b3f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 200 len: 1330 microversion: 2.1 time: 0.141328 Oct 24 11:02:48.898702 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3131/6229] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:48 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 1330 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:49.744128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fea37bfe-45d1-44d5-9fc1-40fe8ff6edcc tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:49.745532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fea37bfe-45d1-44d5-9fc1-40fe8ff6edcc tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:49.756146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fea37bfe-45d1-44d5-9fc1-40fe8ff6edcc tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:49.757034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fea37bfe-45d1-44d5-9fc1-40fe8ff6edcc tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:49.757639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fea37bfe-45d1-44d5-9fc1-40fe8ff6edcc tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:49.758585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fea37bfe-45d1-44d5-9fc1-40fe8ff6edcc tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:49.759057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fea37bfe-45d1-44d5-9fc1-40fe8ff6edcc tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:49.759496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fea37bfe-45d1-44d5-9fc1-40fe8ff6edcc tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:49.880378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7b3d6baf-fe5d-48b8-beec-08fe1d07f037 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:49.881111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7b3d6baf-fe5d-48b8-beec-08fe1d07f037 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:49.894028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b3d6baf-fe5d-48b8-beec-08fe1d07f037 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:49.897386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b3d6baf-fe5d-48b8-beec-08fe1d07f037 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:49.898144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b3d6baf-fe5d-48b8-beec-08fe1d07f037 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:49.899087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b3d6baf-fe5d-48b8-beec-08fe1d07f037 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:49.899502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b3d6baf-fe5d-48b8-beec-08fe1d07f037 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:49.904961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7b3d6baf-fe5d-48b8-beec-08fe1d07f037 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:50.021635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fea37bfe-45d1-44d5-9fc1-40fe8ff6edcc tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:50.031818 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fea37bfe-45d1-44d5-9fc1-40fe8ff6edcc tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1314 microversion: 2.1 time: 0.294506 Oct 24 11:02:50.033493 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3099/6230] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:49 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:50.053744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-187511f1-9086-4637-bc6e-0eeef1c255af tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:50.054386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-187511f1-9086-4637-bc6e-0eeef1c255af tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:50.061986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-187511f1-9086-4637-bc6e-0eeef1c255af tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:50.074933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-187511f1-9086-4637-bc6e-0eeef1c255af tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:50.075770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-187511f1-9086-4637-bc6e-0eeef1c255af tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:50.076736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-187511f1-9086-4637-bc6e-0eeef1c255af tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:50.077808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-187511f1-9086-4637-bc6e-0eeef1c255af tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:50.079386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-187511f1-9086-4637-bc6e-0eeef1c255af tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:50.171829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-187511f1-9086-4637-bc6e-0eeef1c255af tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:50.174237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-187511f1-9086-4637-bc6e-0eeef1c255af tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:50.174831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-187511f1-9086-4637-bc6e-0eeef1c255af tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:50.175402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-187511f1-9086-4637-bc6e-0eeef1c255af tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lazy-loading 'fault' on Instance uuid 33939031-e4c1-45c6-9aa1-c8751f6ab150 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:02:50.227628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7b3d6baf-fe5d-48b8-beec-08fe1d07f037 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:50.237128 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7b3d6baf-fe5d-48b8-beec-08fe1d07f037 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22" status: 200 len: 1504 microversion: 2.1 time: 0.361027 Oct 24 11:02:50.246936 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3132/6231] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:49 2022] GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 => generated 1504 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:02:50.255401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-187511f1-9086-4637-bc6e-0eeef1c255af tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:50.266164 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-187511f1-9086-4637-bc6e-0eeef1c255af tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 200 len: 1330 microversion: 2.1 time: 0.230956 Oct 24 11:02:50.267885 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3100/6232] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:50 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 1330 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:50.728997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-b09e0749-27d6-485a-a968-820a256f8218 req-6c69bb38-6807-4297-8cf0-fdfd8fdcf70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eaee084-1269-4a90-9d9e-4bb2bf2d9e22", "name": "network-vif-deleted", "tag": "fdba89f5-5bce-49bc-b531-b2c8d65226bd"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:02:50.749767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b09e0749-27d6-485a-a968-820a256f8218 req-6c69bb38-6807-4297-8cf0-fdfd8fdcf70c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:50.750300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b09e0749-27d6-485a-a968-820a256f8218 req-6c69bb38-6807-4297-8cf0-fdfd8fdcf70c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:50.750689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b09e0749-27d6-485a-a968-820a256f8218 req-6c69bb38-6807-4297-8cf0-fdfd8fdcf70c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:50.762311 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-b09e0749-27d6-485a-a968-820a256f8218 req-6c69bb38-6807-4297-8cf0-fdfd8fdcf70c service nova] Creating event network-vif-deleted:fdba89f5-5bce-49bc-b531-b2c8d65226bd for instance 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 on n-h2-858383-15 Oct 24 11:02:50.768380 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-b09e0749-27d6-485a-a968-820a256f8218 req-6c69bb38-6807-4297-8cf0-fdfd8fdcf70c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043642 Oct 24 11:02:50.769232 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3133/6233] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:02:51.055754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8c6ad39f-2ad3-4543-af27-3efa55bce4f9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:51.056659 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8c6ad39f-2ad3-4543-af27-3efa55bce4f9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:51.064684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8c6ad39f-2ad3-4543-af27-3efa55bce4f9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:51.065343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8c6ad39f-2ad3-4543-af27-3efa55bce4f9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:51.065912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8c6ad39f-2ad3-4543-af27-3efa55bce4f9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:51.066833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8c6ad39f-2ad3-4543-af27-3efa55bce4f9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:51.067401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8c6ad39f-2ad3-4543-af27-3efa55bce4f9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:51.067964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8c6ad39f-2ad3-4543-af27-3efa55bce4f9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:51.255666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8c6ad39f-2ad3-4543-af27-3efa55bce4f9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:51.267631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-42c5f8a5-4897-41d0-a070-4d146d9f11be tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:51.268990 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8c6ad39f-2ad3-4543-af27-3efa55bce4f9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1498 microversion: 2.1 time: 0.216655 Oct 24 11:02:51.269318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-42c5f8a5-4897-41d0-a070-4d146d9f11be tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:51.270095 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3101/6234] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:51 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1498 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:51.276849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42c5f8a5-4897-41d0-a070-4d146d9f11be tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:51.277347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42c5f8a5-4897-41d0-a070-4d146d9f11be tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:51.277794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42c5f8a5-4897-41d0-a070-4d146d9f11be tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:51.278502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42c5f8a5-4897-41d0-a070-4d146d9f11be tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:51.278960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42c5f8a5-4897-41d0-a070-4d146d9f11be tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:51.279391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42c5f8a5-4897-41d0-a070-4d146d9f11be tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:51.284299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:02:51.319311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42c5f8a5-4897-41d0-a070-4d146d9f11be tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:51.320086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42c5f8a5-4897-41d0-a070-4d146d9f11be tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:51.320698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42c5f8a5-4897-41d0-a070-4d146d9f11be tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:51.321016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3a7331e4-73ef-4eb1-a484-00be8f1d0a47 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:51.321544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-42c5f8a5-4897-41d0-a070-4d146d9f11be tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lazy-loading 'fault' on Instance uuid 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:02:51.329180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3a7331e4-73ef-4eb1-a484-00be8f1d0a47 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:51.337176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a7331e4-73ef-4eb1-a484-00be8f1d0a47 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:51.337948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a7331e4-73ef-4eb1-a484-00be8f1d0a47 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:51.338678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a7331e4-73ef-4eb1-a484-00be8f1d0a47 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:51.339573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a7331e4-73ef-4eb1-a484-00be8f1d0a47 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:51.340182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a7331e4-73ef-4eb1-a484-00be8f1d0a47 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:51.340816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a7331e4-73ef-4eb1-a484-00be8f1d0a47 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:51.368623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-42c5f8a5-4897-41d0-a070-4d146d9f11be tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:51.369093 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-3a7331e4-73ef-4eb1-a484-00be8f1d0a47 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] HTTP exception thrown: Instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 could not be found. Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3a7331e4-73ef-4eb1-a484-00be8f1d0a47 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Request method failure captured: Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 HTTP/1.1 Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnAKAHP5OOfm-uCWTjFJTzXa0YLKSuouosUciU14TRf3JmMepl7Z3nYn7w4Ibs55CltNd_hrYn98Pw4N-ToeUd4QusviP9lFlPXOJGwfHRkdtQPCg9kRiq2YXaf55wJAz2KjxNTj7AXjHUrV-JebO1VNsJhWCbt5cfPkaHFUJTxTNxM Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a10ff6644b9b4215b1b7c82b98342a79", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: da9e4e22dda84476a30e6b6bd27c68a6 Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 could not be found. Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '33939031-e4c1-45c6-9aa1-c8751f6ab150'} Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 could not be found. Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 could not be found. Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:02:51.373165 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:02:51.377865 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:02:51.377865 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:02:51.377865 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:02:51.377865 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:02:51.377865 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:02:51.377865 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 could not be found. Oct 24 11:02:51.377865 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:02:51.377865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3a7331e4-73ef-4eb1-a484-00be8f1d0a47 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Returning 404 to user: Instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:02:51.377865 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3a7331e4-73ef-4eb1-a484-00be8f1d0a47 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 404 len: 111 microversion: 2.1 time: 0.078795 Oct 24 11:02:51.378478 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3102/6235] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:51 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:02:51.381454 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-42c5f8a5-4897-41d0-a070-4d146d9f11be tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22" status: 200 len: 1304 microversion: 2.1 time: 0.119030 Oct 24 11:02:51.393727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-29266500-df54-4856-809e-55c7c818e70b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:51.394528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-29266500-df54-4856-809e-55c7c818e70b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:51.396111 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3134/6236] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:51 2022] GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:51.406402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d806b7c-4bfa-452c-83c6-f2013ffb2ec3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '.version_select at 0x7f04cb5e43a0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:51.409718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29266500-df54-4856-809e-55c7c818e70b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:51.410325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29266500-df54-4856-809e-55c7c818e70b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:51.410782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29266500-df54-4856-809e-55c7c818e70b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:51.412580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29266500-df54-4856-809e-55c7c818e70b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:51.413376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29266500-df54-4856-809e-55c7c818e70b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:51.416561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29266500-df54-4856-809e-55c7c818e70b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:51.436144 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2d806b7c-4bfa-452c-83c6-f2013ffb2ec3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-527215569" status: 202 len: 0 microversion: 2.1 time: 0.038572 Oct 24 11:02:51.437626 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3135/6237] 10.222.0.50 () {58 vars in 1218 bytes} [Mon Oct 24 11:02:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-527215569 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:02:51.711874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-29266500-df54-4856-809e-55c7c818e70b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:51.727238 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-29266500-df54-4856-809e-55c7c818e70b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1498 microversion: 2.1 time: 0.341567 Oct 24 11:02:51.728308 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3103/6238] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:51 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1498 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:51.761214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3f8e1cf8-84cd-4522-b46a-802255dd6ae9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:02:51.761787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3f8e1cf8-84cd-4522-b46a-802255dd6ae9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:51.781317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f8e1cf8-84cd-4522-b46a-802255dd6ae9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:51.782017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f8e1cf8-84cd-4522-b46a-802255dd6ae9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:51.783876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f8e1cf8-84cd-4522-b46a-802255dd6ae9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:51.784802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f8e1cf8-84cd-4522-b46a-802255dd6ae9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:51.786191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f8e1cf8-84cd-4522-b46a-802255dd6ae9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:51.787322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f8e1cf8-84cd-4522-b46a-802255dd6ae9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:51.834096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-3f8e1cf8-84cd-4522-b46a-802255dd6ae9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lazy-loading 'flavor' on Instance uuid 1499c7a8-df86-425f-ad4f-911b8cca47ec {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:02:51.956549 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3f8e1cf8-84cd-4522-b46a-802255dd6ae9 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "POST /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec/action" status: 202 len: 0 microversion: 2.1 time: 0.205373 Oct 24 11:02:51.957790 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3136/6239] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:02:51 2022] POST /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:02:51.967562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9f86262c-82f4-40bc-ac84-1b284d610044 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:51.968347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9f86262c-82f4-40bc-ac84-1b284d610044 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:51.976497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f86262c-82f4-40bc-ac84-1b284d610044 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:51.977355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f86262c-82f4-40bc-ac84-1b284d610044 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:51.978180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f86262c-82f4-40bc-ac84-1b284d610044 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:51.979150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f86262c-82f4-40bc-ac84-1b284d610044 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:51.980128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f86262c-82f4-40bc-ac84-1b284d610044 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:51.981139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f86262c-82f4-40bc-ac84-1b284d610044 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:52.201102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9f86262c-82f4-40bc-ac84-1b284d610044 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:52.217719 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9f86262c-82f4-40bc-ac84-1b284d610044 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1506 microversion: 2.1 time: 0.255239 Oct 24 11:02:52.218885 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3104/6240] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:51 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:52.412701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-76059486-de46-40da-b39c-253efc0c3b88 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:52.413815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-76059486-de46-40da-b39c-253efc0c3b88 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:52.422306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76059486-de46-40da-b39c-253efc0c3b88 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:52.422839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76059486-de46-40da-b39c-253efc0c3b88 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:52.423445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76059486-de46-40da-b39c-253efc0c3b88 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:52.424595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76059486-de46-40da-b39c-253efc0c3b88 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:52.425232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76059486-de46-40da-b39c-253efc0c3b88 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:52.425809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-76059486-de46-40da-b39c-253efc0c3b88 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:52.444071 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-76059486-de46-40da-b39c-253efc0c3b88 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] HTTP exception thrown: Instance 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 could not be found. Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-76059486-de46-40da-b39c-253efc0c3b88 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Request method failure captured: Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 HTTP/1.1 Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnDGmcCGxYYojAlgntJ4RfDTgikgb4JoaMgIiF9qRtDwrplnpoaOZ-KEDWk9PiZu5O87-X-ApEkelGWlb_aLGILyBflGUILCQ0WS8gf7g2bFfinHZrqBqNp9fu6BxdWJtjWUdpx0I6JbKwlKj-gNH7BH3FoWPLm7f-_jTSEyAOgVLB8 Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: ba709c74314b49f48e684aa99eb4a433 Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-VolumesActionsTest-670074001 Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ba709c74314b49f48e684aa99eb4a433"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ba709c74314b49f48e684aa99eb4a433"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ba709c74314b49f48e684aa99eb4a433"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ba709c74314b49f48e684aa99eb4a433", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-VolumesActionsTest-670074001 Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: ba709c74314b49f48e684aa99eb4a433 Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-VolumesActionsTest-670074001 Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-VolumesActionsTest-670074001-project Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 6abfc205e99840259c8eb68560817581 Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-VolumesActionsTest-670074001-project Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 could not be found. Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '8eaee084-1269-4a90-9d9e-4bb2bf2d9e22'} Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 could not be found. Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 could not be found. Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:02:52.446311 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:02:52.450679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:02:52.450679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:02:52.450679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:02:52.450679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:02:52.450679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:02:52.450679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 could not be found. Oct 24 11:02:52.450679 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:02:52.454480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-76059486-de46-40da-b39c-253efc0c3b88 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Returning 404 to user: Instance 8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:02:52.455540 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-76059486-de46-40da-b39c-253efc0c3b88 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22" status: 404 len: 111 microversion: 2.1 time: 0.048693 Oct 24 11:02:52.456577 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3137/6241] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:52 2022] GET /compute/v2.1/servers/8eaee084-1269-4a90-9d9e-4bb2bf2d9e22 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:02:52.569709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e830749-6c0a-489a-b573-eb8f59747f14 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:52.570217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5e830749-6c0a-489a-b573-eb8f59747f14 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:52.588311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e830749-6c0a-489a-b573-eb8f59747f14 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:52.588880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e830749-6c0a-489a-b573-eb8f59747f14 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:52.589325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e830749-6c0a-489a-b573-eb8f59747f14 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:52.590051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e830749-6c0a-489a-b573-eb8f59747f14 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:52.590942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e830749-6c0a-489a-b573-eb8f59747f14 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:52.594935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e830749-6c0a-489a-b573-eb8f59747f14 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:52.599910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8830b738-1a51-4635-93a2-241aac8daefb tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-580501803", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "6e76b814-2a3d-42aa-a6ce-b97ea3f45fbc"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:02:52.691739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-5e830749-6c0a-489a-b573-eb8f59747f14 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lazy-loading 'services' on Instance uuid 64d0cfd3-33a6-473c-8d33-1a7ff418e838 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:02:52.696875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-8830b738-1a51-4635-93a2-241aac8daefb tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] validate_networks() for [('6e76b814-2a3d-42aa-a6ce-b97ea3f45fbc', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:02:52.795186 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5e830749-6c0a-489a-b573-eb8f59747f14 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "DELETE /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments/d07325c1-a728-4fcd-a607-2c7f3357c533" status: 202 len: 0 microversion: 2.1 time: 0.225129 Oct 24 11:02:52.798589 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3105/6242] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 11:02:52 2022] DELETE /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments/d07325c1-a728-4fcd-a607-2c7f3357c533 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:02:52.821690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-38badb31-0822-41e6-b812-9f2126adcb4d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:52.832010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-38badb31-0822-41e6-b812-9f2126adcb4d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:52.840389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-38badb31-0822-41e6-b812-9f2126adcb4d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:52.842079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-38badb31-0822-41e6-b812-9f2126adcb4d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:52.843460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-38badb31-0822-41e6-b812-9f2126adcb4d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:52.845511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-38badb31-0822-41e6-b812-9f2126adcb4d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:52.846325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-38badb31-0822-41e6-b812-9f2126adcb4d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:52.847058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-38badb31-0822-41e6-b812-9f2126adcb4d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:52.906446 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-38badb31-0822-41e6-b812-9f2126adcb4d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102844 Oct 24 11:02:52.907667 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3106/6243] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:02:52 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:02:53.245604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-83af4b44-8dd7-47a1-83ed-0b4b00f281ec tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:53.248075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-83af4b44-8dd7-47a1-83ed-0b4b00f281ec tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:53.275563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83af4b44-8dd7-47a1-83ed-0b4b00f281ec tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:53.278860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83af4b44-8dd7-47a1-83ed-0b4b00f281ec tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:53.279479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83af4b44-8dd7-47a1-83ed-0b4b00f281ec tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:53.284024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83af4b44-8dd7-47a1-83ed-0b4b00f281ec tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:53.284660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83af4b44-8dd7-47a1-83ed-0b4b00f281ec tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:53.285281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83af4b44-8dd7-47a1-83ed-0b4b00f281ec tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:53.304236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8830b738-1a51-4635-93a2-241aac8daefb tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:02:53.305037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8830b738-1a51-4635-93a2-241aac8daefb tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:02:53.305717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8830b738-1a51-4635-93a2-241aac8daefb tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:02:53.306371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8830b738-1a51-4635-93a2-241aac8daefb tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:02:53.307332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8830b738-1a51-4635-93a2-241aac8daefb tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:02:53.318495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8830b738-1a51-4635-93a2-241aac8daefb tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:53.319324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8830b738-1a51-4635-93a2-241aac8daefb tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:53.319983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8830b738-1a51-4635-93a2-241aac8daefb tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:53.321085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8830b738-1a51-4635-93a2-241aac8daefb tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:53.321764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8830b738-1a51-4635-93a2-241aac8daefb tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:53.322551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8830b738-1a51-4635-93a2-241aac8daefb tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:53.341677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-8830b738-1a51-4635-93a2-241aac8daefb tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Getting quotas for project ba709c74314b49f48e684aa99eb4a433. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:02:53.349224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-8830b738-1a51-4635-93a2-241aac8daefb tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Getting quotas for user 6abfc205e99840259c8eb68560817581 and project ba709c74314b49f48e684aa99eb4a433. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:02:53.367025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8830b738-1a51-4635-93a2-241aac8daefb tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:02:53.370614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8830b738-1a51-4635-93a2-241aac8daefb tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: a12e8806-3b51-49d1-a210-bad31519a82f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:02:53.437000 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8830b738-1a51-4635-93a2-241aac8daefb tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.840448 Oct 24 11:02:53.445503 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3138/6244] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:02:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 11:02:53.450890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-80014015-03be-4392-bd83-cb140abb1ed2 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:53.451890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-80014015-03be-4392-bd83-cb140abb1ed2 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: a12e8806-3b51-49d1-a210-bad31519a82f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:53.459442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:02:53.470211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-83af4b44-8dd7-47a1-83ed-0b4b00f281ec tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:53.486160 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-83af4b44-8dd7-47a1-83ed-0b4b00f281ec tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1489 microversion: 2.1 time: 0.245496 Oct 24 11:02:53.487422 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3107/6245] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:53 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1489 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:53.515417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5286bb0e-2810-4365-82a9-40c270ce7436 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:02:53.516485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5286bb0e-2810-4365-82a9-40c270ce7436 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:53.525068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5286bb0e-2810-4365-82a9-40c270ce7436 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:53.525810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5286bb0e-2810-4365-82a9-40c270ce7436 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:53.526489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5286bb0e-2810-4365-82a9-40c270ce7436 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:53.527367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5286bb0e-2810-4365-82a9-40c270ce7436 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:53.527982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5286bb0e-2810-4365-82a9-40c270ce7436 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:53.528596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5286bb0e-2810-4365-82a9-40c270ce7436 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:53.566506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-80014015-03be-4392-bd83-cb140abb1ed2 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:53.576479 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-80014015-03be-4392-bd83-cb140abb1ed2 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f" status: 200 len: 1213 microversion: 2.1 time: 0.128579 Oct 24 11:02:53.580394 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3139/6246] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:53 2022] GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f => generated 1213 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:53.632502 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5286bb0e-2810-4365-82a9-40c270ce7436 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "POST /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec/action" status: 202 len: 0 microversion: 2.1 time: 0.122466 Oct 24 11:02:53.647008 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3108/6247] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:02:53 2022] POST /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:02:53.659719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c99aa445-92bb-48a6-8b83-6b2f4afef222 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:53.667266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c99aa445-92bb-48a6-8b83-6b2f4afef222 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:53.689735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c99aa445-92bb-48a6-8b83-6b2f4afef222 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:53.690233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c99aa445-92bb-48a6-8b83-6b2f4afef222 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:53.691725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c99aa445-92bb-48a6-8b83-6b2f4afef222 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:53.695033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c99aa445-92bb-48a6-8b83-6b2f4afef222 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:53.697107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c99aa445-92bb-48a6-8b83-6b2f4afef222 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:53.697851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c99aa445-92bb-48a6-8b83-6b2f4afef222 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:53.921893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0014ca8f-d591-4e22-bec7-6af6f9e3ed3a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:53.925543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0014ca8f-d591-4e22-bec7-6af6f9e3ed3a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:53.948289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0014ca8f-d591-4e22-bec7-6af6f9e3ed3a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:53.949650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0014ca8f-d591-4e22-bec7-6af6f9e3ed3a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:53.953493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0014ca8f-d591-4e22-bec7-6af6f9e3ed3a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:53.954520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0014ca8f-d591-4e22-bec7-6af6f9e3ed3a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:53.955148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0014ca8f-d591-4e22-bec7-6af6f9e3ed3a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:53.955942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0014ca8f-d591-4e22-bec7-6af6f9e3ed3a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:54.019822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c99aa445-92bb-48a6-8b83-6b2f4afef222 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:54.024643 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0014ca8f-d591-4e22-bec7-6af6f9e3ed3a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108542 Oct 24 11:02:54.027675 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c99aa445-92bb-48a6-8b83-6b2f4afef222 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1495 microversion: 2.1 time: 0.376209 Oct 24 11:02:54.029801 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3109/6248] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:02:53 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:02:54.041244 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3140/6249] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:53 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1495 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:54.605441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-204447ff-1905-4aef-80b3-209209eb450a tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:54.606807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-204447ff-1905-4aef-80b3-209209eb450a tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: a12e8806-3b51-49d1-a210-bad31519a82f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:54.620329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-204447ff-1905-4aef-80b3-209209eb450a tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:54.623576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-204447ff-1905-4aef-80b3-209209eb450a tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:54.624661 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-204447ff-1905-4aef-80b3-209209eb450a tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:54.625682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-204447ff-1905-4aef-80b3-209209eb450a tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:54.627242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-204447ff-1905-4aef-80b3-209209eb450a tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:54.631103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-204447ff-1905-4aef-80b3-209209eb450a tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:54.813425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-204447ff-1905-4aef-80b3-209209eb450a tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:54.825104 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-204447ff-1905-4aef-80b3-209209eb450a tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f" status: 200 len: 1209 microversion: 2.1 time: 0.224480 Oct 24 11:02:54.826276 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3110/6250] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:54 2022] GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f => generated 1209 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:55.037209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e82b1d1f-2906-4f89-98f4-187e730f2368 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:55.040333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e82b1d1f-2906-4f89-98f4-187e730f2368 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:55.049633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e82b1d1f-2906-4f89-98f4-187e730f2368 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:55.050387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e82b1d1f-2906-4f89-98f4-187e730f2368 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:55.051000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e82b1d1f-2906-4f89-98f4-187e730f2368 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:55.051941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e82b1d1f-2906-4f89-98f4-187e730f2368 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:55.052103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8a6e4650-e5cf-4504-be49-2c46381f89ef tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:55.052729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e82b1d1f-2906-4f89-98f4-187e730f2368 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:55.052881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8a6e4650-e5cf-4504-be49-2c46381f89ef tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:55.053530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e82b1d1f-2906-4f89-98f4-187e730f2368 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:55.086100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a6e4650-e5cf-4504-be49-2c46381f89ef tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:55.089503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a6e4650-e5cf-4504-be49-2c46381f89ef tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:55.090214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a6e4650-e5cf-4504-be49-2c46381f89ef tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:55.092245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a6e4650-e5cf-4504-be49-2c46381f89ef tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:55.095315 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e82b1d1f-2906-4f89-98f4-187e730f2368 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062049 Oct 24 11:02:55.095524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a6e4650-e5cf-4504-be49-2c46381f89ef tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:55.095850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a6e4650-e5cf-4504-be49-2c46381f89ef tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:55.101484 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3141/6251] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:02:55 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:02:55.296368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8a6e4650-e5cf-4504-be49-2c46381f89ef tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:55.307349 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8a6e4650-e5cf-4504-be49-2c46381f89ef tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1495 microversion: 2.1 time: 0.259337 Oct 24 11:02:55.321592 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3111/6252] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:55 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1495 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:55.851378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-68fa19f6-d88d-443e-a28f-7b7f7c0447b5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:55.853228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-68fa19f6-d88d-443e-a28f-7b7f7c0447b5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: a12e8806-3b51-49d1-a210-bad31519a82f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:55.885996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68fa19f6-d88d-443e-a28f-7b7f7c0447b5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:55.891616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68fa19f6-d88d-443e-a28f-7b7f7c0447b5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:55.894681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68fa19f6-d88d-443e-a28f-7b7f7c0447b5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:55.895801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68fa19f6-d88d-443e-a28f-7b7f7c0447b5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:55.899125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68fa19f6-d88d-443e-a28f-7b7f7c0447b5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:55.899871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68fa19f6-d88d-443e-a28f-7b7f7c0447b5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:56.063818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-68fa19f6-d88d-443e-a28f-7b7f7c0447b5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:56.088820 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-68fa19f6-d88d-443e-a28f-7b7f7c0447b5 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f" status: 200 len: 1283 microversion: 2.1 time: 0.238479 Oct 24 11:02:56.092141 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3142/6253] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:55 2022] GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f => generated 1283 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:56.108245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-23ad5ced-cea3-44ec-9d10-3ace6ae011cf tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:56.110854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-23ad5ced-cea3-44ec-9d10-3ace6ae011cf tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:56.125481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23ad5ced-cea3-44ec-9d10-3ace6ae011cf tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:56.125984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23ad5ced-cea3-44ec-9d10-3ace6ae011cf tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:56.126433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23ad5ced-cea3-44ec-9d10-3ace6ae011cf tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:56.128320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23ad5ced-cea3-44ec-9d10-3ace6ae011cf tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:56.134750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23ad5ced-cea3-44ec-9d10-3ace6ae011cf tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:56.135210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-23ad5ced-cea3-44ec-9d10-3ace6ae011cf tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:56.199001 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-23ad5ced-cea3-44ec-9d10-3ace6ae011cf tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095110 Oct 24 11:02:56.199609 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3112/6254] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:02:56 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:02:56.333256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4849ffe2-8530-4a4a-991a-f785deb6a7f1 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:56.334190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4849ffe2-8530-4a4a-991a-f785deb6a7f1 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:56.341716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4849ffe2-8530-4a4a-991a-f785deb6a7f1 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:56.343026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4849ffe2-8530-4a4a-991a-f785deb6a7f1 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:56.343914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4849ffe2-8530-4a4a-991a-f785deb6a7f1 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:56.344947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4849ffe2-8530-4a4a-991a-f785deb6a7f1 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:56.345579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4849ffe2-8530-4a4a-991a-f785deb6a7f1 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:56.346170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4849ffe2-8530-4a4a-991a-f785deb6a7f1 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:56.537501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4849ffe2-8530-4a4a-991a-f785deb6a7f1 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:56.553494 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4849ffe2-8530-4a4a-991a-f785deb6a7f1 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1498 microversion: 2.1 time: 0.224942 Oct 24 11:02:56.554090 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3143/6255] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:56 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1498 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:56.580452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2044f0ba-db93-494f-b62b-f3870a32b6ff tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:02:56.581305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2044f0ba-db93-494f-b62b-f3870a32b6ff tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:56.589242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2044f0ba-db93-494f-b62b-f3870a32b6ff tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:56.590055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2044f0ba-db93-494f-b62b-f3870a32b6ff tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:56.590689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2044f0ba-db93-494f-b62b-f3870a32b6ff tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:56.591589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2044f0ba-db93-494f-b62b-f3870a32b6ff tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:56.592332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2044f0ba-db93-494f-b62b-f3870a32b6ff tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:56.593085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2044f0ba-db93-494f-b62b-f3870a32b6ff tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:56.622295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-2044f0ba-db93-494f-b62b-f3870a32b6ff tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lazy-loading 'flavor' on Instance uuid 1499c7a8-df86-425f-ad4f-911b8cca47ec {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:02:56.648948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:02:56.746878 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2044f0ba-db93-494f-b62b-f3870a32b6ff tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "POST /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec/action" status: 202 len: 0 microversion: 2.1 time: 0.171564 Oct 24 11:02:56.747536 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3113/6256] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:02:56 2022] POST /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:02:56.761736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2ee97664-10e0-4be9-92dc-44684f72906a tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:56.762527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2ee97664-10e0-4be9-92dc-44684f72906a tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:56.789547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ee97664-10e0-4be9-92dc-44684f72906a tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:56.790218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ee97664-10e0-4be9-92dc-44684f72906a tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:56.790981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ee97664-10e0-4be9-92dc-44684f72906a tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:56.792289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ee97664-10e0-4be9-92dc-44684f72906a tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:56.793090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ee97664-10e0-4be9-92dc-44684f72906a tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:56.793861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2ee97664-10e0-4be9-92dc-44684f72906a tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:57.015208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2ee97664-10e0-4be9-92dc-44684f72906a tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:57.026757 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2ee97664-10e0-4be9-92dc-44684f72906a tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1506 microversion: 2.1 time: 0.274679 Oct 24 11:02:57.045908 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3144/6257] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:56 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:02:57.135366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-74bc7085-a407-4f8b-9424-1d24064b9600 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:57.137445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-74bc7085-a407-4f8b-9424-1d24064b9600 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: a12e8806-3b51-49d1-a210-bad31519a82f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:57.165820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74bc7085-a407-4f8b-9424-1d24064b9600 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:57.166355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74bc7085-a407-4f8b-9424-1d24064b9600 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:57.166991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74bc7085-a407-4f8b-9424-1d24064b9600 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:57.167888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74bc7085-a407-4f8b-9424-1d24064b9600 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:57.168503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74bc7085-a407-4f8b-9424-1d24064b9600 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:57.169339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74bc7085-a407-4f8b-9424-1d24064b9600 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:57.213363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b75f695a-6acd-4f4f-b3c7-77f5fcbca26d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:57.215793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b75f695a-6acd-4f4f-b3c7-77f5fcbca26d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:57.224140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b75f695a-6acd-4f4f-b3c7-77f5fcbca26d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:57.224804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b75f695a-6acd-4f4f-b3c7-77f5fcbca26d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:57.226054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b75f695a-6acd-4f4f-b3c7-77f5fcbca26d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:57.226908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b75f695a-6acd-4f4f-b3c7-77f5fcbca26d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:57.227513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b75f695a-6acd-4f4f-b3c7-77f5fcbca26d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:57.228081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b75f695a-6acd-4f4f-b3c7-77f5fcbca26d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:57.304518 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b75f695a-6acd-4f4f-b3c7-77f5fcbca26d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096191 Oct 24 11:02:57.313831 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3145/6258] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:02:57 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:02:57.543138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-74bc7085-a407-4f8b-9424-1d24064b9600 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:57.563242 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-74bc7085-a407-4f8b-9424-1d24064b9600 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f" status: 200 len: 1313 microversion: 2.1 time: 0.442772 Oct 24 11:02:57.564797 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3114/6259] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:57 2022] GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:58.057663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d299ec39-a5c8-411d-a114-287254141b9c tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:58.058545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d299ec39-a5c8-411d-a114-287254141b9c tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:58.085688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d299ec39-a5c8-411d-a114-287254141b9c tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:58.086325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d299ec39-a5c8-411d-a114-287254141b9c tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:58.086787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d299ec39-a5c8-411d-a114-287254141b9c tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:58.097513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d299ec39-a5c8-411d-a114-287254141b9c tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:58.099245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d299ec39-a5c8-411d-a114-287254141b9c tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:58.100170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d299ec39-a5c8-411d-a114-287254141b9c tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:58.334558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-215fb8af-e92f-4a11-be68-dec9b4969fa4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:58.337078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-215fb8af-e92f-4a11-be68-dec9b4969fa4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:58.355135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-215fb8af-e92f-4a11-be68-dec9b4969fa4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:58.356003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-215fb8af-e92f-4a11-be68-dec9b4969fa4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:58.356732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-215fb8af-e92f-4a11-be68-dec9b4969fa4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:58.357687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-215fb8af-e92f-4a11-be68-dec9b4969fa4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:58.358525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-215fb8af-e92f-4a11-be68-dec9b4969fa4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:58.359155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-215fb8af-e92f-4a11-be68-dec9b4969fa4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:58.440221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d299ec39-a5c8-411d-a114-287254141b9c tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:58.442059 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-215fb8af-e92f-4a11-be68-dec9b4969fa4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112543 Oct 24 11:02:58.442650 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3115/6260] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:02:58 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:02:58.451221 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d299ec39-a5c8-411d-a114-287254141b9c tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1489 microversion: 2.1 time: 0.398522 Oct 24 11:02:58.468938 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3146/6261] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:58 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1489 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:58.482409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d3fb9b1c-2019-429d-b97e-42cabbd773f6 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:02:58.483708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d3fb9b1c-2019-429d-b97e-42cabbd773f6 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:58.491767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3fb9b1c-2019-429d-b97e-42cabbd773f6 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:58.492526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3fb9b1c-2019-429d-b97e-42cabbd773f6 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:58.493157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3fb9b1c-2019-429d-b97e-42cabbd773f6 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:58.494075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3fb9b1c-2019-429d-b97e-42cabbd773f6 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:58.494945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3fb9b1c-2019-429d-b97e-42cabbd773f6 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:58.495676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3fb9b1c-2019-429d-b97e-42cabbd773f6 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:58.589986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-556fcdf6-7e59-45e3-9bbe-ddcf43686e33 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:58.590844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-556fcdf6-7e59-45e3-9bbe-ddcf43686e33 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: a12e8806-3b51-49d1-a210-bad31519a82f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:58.636384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-556fcdf6-7e59-45e3-9bbe-ddcf43686e33 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:58.642605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-556fcdf6-7e59-45e3-9bbe-ddcf43686e33 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:58.643038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-556fcdf6-7e59-45e3-9bbe-ddcf43686e33 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:58.649289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-556fcdf6-7e59-45e3-9bbe-ddcf43686e33 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:58.649923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-556fcdf6-7e59-45e3-9bbe-ddcf43686e33 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:58.655582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-556fcdf6-7e59-45e3-9bbe-ddcf43686e33 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:58.683311 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d3fb9b1c-2019-429d-b97e-42cabbd773f6 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "POST /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec/action" status: 202 len: 0 microversion: 2.1 time: 0.205136 Oct 24 11:02:58.684294 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3116/6262] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:02:58 2022] POST /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 11:02:58.699210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f3727536-fbd9-4cd6-a4b9-4f5ae949bc6d req-769a0589-36a2-4014-8442-874b3c451de4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12e8806-3b51-49d1-a210-bad31519a82f", "tag": "e2c69aec-3f4f-4fd7-959c-b44ad9ac3a17"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:02:58.720538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f3727536-fbd9-4cd6-a4b9-4f5ae949bc6d req-769a0589-36a2-4014-8442-874b3c451de4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:58.737570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f3727536-fbd9-4cd6-a4b9-4f5ae949bc6d req-769a0589-36a2-4014-8442-874b3c451de4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:58.739107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f3727536-fbd9-4cd6-a4b9-4f5ae949bc6d req-769a0589-36a2-4014-8442-874b3c451de4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:58.791735 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f3727536-fbd9-4cd6-a4b9-4f5ae949bc6d req-769a0589-36a2-4014-8442-874b3c451de4 service nova] Creating event network-changed:e2c69aec-3f4f-4fd7-959c-b44ad9ac3a17 for instance a12e8806-3b51-49d1-a210-bad31519a82f on n-h2-858383-15 Oct 24 11:02:58.807156 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f3727536-fbd9-4cd6-a4b9-4f5ae949bc6d req-769a0589-36a2-4014-8442-874b3c451de4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118338 Oct 24 11:02:58.811162 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3117/6263] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:02:58.848056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a147a5e4-c3fb-431a-a865-553b9383fa61 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:58.848925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a147a5e4-c3fb-431a-a865-553b9383fa61 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:58.869160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a147a5e4-c3fb-431a-a865-553b9383fa61 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:58.869675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a147a5e4-c3fb-431a-a865-553b9383fa61 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:58.870119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a147a5e4-c3fb-431a-a865-553b9383fa61 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:58.870855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a147a5e4-c3fb-431a-a865-553b9383fa61 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:58.871320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a147a5e4-c3fb-431a-a865-553b9383fa61 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:58.871756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a147a5e4-c3fb-431a-a865-553b9383fa61 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:59.169677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a147a5e4-c3fb-431a-a865-553b9383fa61 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:59.181367 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a147a5e4-c3fb-431a-a865-553b9383fa61 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1495 microversion: 2.1 time: 0.367928 Oct 24 11:02:59.185205 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3118/6264] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:58 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1495 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:02:59.193767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-556fcdf6-7e59-45e3-9bbe-ddcf43686e33 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:02:59.206998 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-556fcdf6-7e59-45e3-9bbe-ddcf43686e33 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f" status: 200 len: 1313 microversion: 2.1 time: 0.618498 Oct 24 11:02:59.214578 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3147/6265] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:02:58 2022] GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f => generated 1313 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:02:59.455501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fa56564f-a89d-44d9-bb71-11a01b5fd510 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:02:59.457384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fa56564f-a89d-44d9-bb71-11a01b5fd510 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:02:59.464894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa56564f-a89d-44d9-bb71-11a01b5fd510 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:59.465672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa56564f-a89d-44d9-bb71-11a01b5fd510 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:59.466298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa56564f-a89d-44d9-bb71-11a01b5fd510 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:59.467175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa56564f-a89d-44d9-bb71-11a01b5fd510 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:02:59.467871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa56564f-a89d-44d9-bb71-11a01b5fd510 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:02:59.468734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa56564f-a89d-44d9-bb71-11a01b5fd510 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:02:59.544043 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fa56564f-a89d-44d9-bb71-11a01b5fd510 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094022 Oct 24 11:02:59.544641 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3119/6266] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:02:59 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:03:00.215952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d75e9fc4-9ee8-4e32-9c0b-1b332db20abe tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:00.216576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d75e9fc4-9ee8-4e32-9c0b-1b332db20abe tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:00.228801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d75e9fc4-9ee8-4e32-9c0b-1b332db20abe tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:00.229325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d75e9fc4-9ee8-4e32-9c0b-1b332db20abe tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:00.234794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d75e9fc4-9ee8-4e32-9c0b-1b332db20abe tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:00.238328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d75e9fc4-9ee8-4e32-9c0b-1b332db20abe tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:00.241041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c556ea0-1618-4433-b885-f1e999e1a25d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:00.241858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4c556ea0-1618-4433-b885-f1e999e1a25d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: a12e8806-3b51-49d1-a210-bad31519a82f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:00.246963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d75e9fc4-9ee8-4e32-9c0b-1b332db20abe tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:00.248344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:03:00.250705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c556ea0-1618-4433-b885-f1e999e1a25d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:00.251393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c556ea0-1618-4433-b885-f1e999e1a25d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:00.252106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c556ea0-1618-4433-b885-f1e999e1a25d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:00.252926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d75e9fc4-9ee8-4e32-9c0b-1b332db20abe tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:00.253336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c556ea0-1618-4433-b885-f1e999e1a25d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:00.253951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c556ea0-1618-4433-b885-f1e999e1a25d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:00.254679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c556ea0-1618-4433-b885-f1e999e1a25d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:00.616334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c556ea0-1618-4433-b885-f1e999e1a25d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:00.628568 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4c556ea0-1618-4433-b885-f1e999e1a25d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f" status: 200 len: 1313 microversion: 2.1 time: 0.388658 Oct 24 11:03:00.628568 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3120/6267] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:00 2022] GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:03:00.646029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cc373026-e395-4394-b06c-dea9cddef77c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:00.646029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cc373026-e395-4394-b06c-dea9cddef77c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:00.646258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc373026-e395-4394-b06c-dea9cddef77c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:00.647090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc373026-e395-4394-b06c-dea9cddef77c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:00.647658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc373026-e395-4394-b06c-dea9cddef77c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:00.648394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc373026-e395-4394-b06c-dea9cddef77c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:00.648957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d75e9fc4-9ee8-4e32-9c0b-1b332db20abe tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:00.649089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc373026-e395-4394-b06c-dea9cddef77c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:00.649427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc373026-e395-4394-b06c-dea9cddef77c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:00.659491 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d75e9fc4-9ee8-4e32-9c0b-1b332db20abe tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1495 microversion: 2.1 time: 0.448327 Oct 24 11:03:00.670040 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3148/6268] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:00 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1495 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:00.701521 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cc373026-e395-4394-b06c-dea9cddef77c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074262 Oct 24 11:03:00.708103 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3121/6269] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:03:00 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 11:03:00.776545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c4a82f2c-ee03-49b7-801f-79476ad5fa9e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:00.777078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c4a82f2c-ee03-49b7-801f-79476ad5fa9e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:00.784142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4a82f2c-ee03-49b7-801f-79476ad5fa9e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:00.784544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4a82f2c-ee03-49b7-801f-79476ad5fa9e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:00.785685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4a82f2c-ee03-49b7-801f-79476ad5fa9e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:00.786361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4a82f2c-ee03-49b7-801f-79476ad5fa9e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:00.787246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4a82f2c-ee03-49b7-801f-79476ad5fa9e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:00.787953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4a82f2c-ee03-49b7-801f-79476ad5fa9e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:00.818816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c4a82f2c-ee03-49b7-801f-79476ad5fa9e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:03:00.935230 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c4a82f2c-ee03-49b7-801f-79476ad5fa9e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "DELETE /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 204 len: 0 microversion: 2.1 time: 0.162167 Oct 24 11:03:00.936291 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3149/6270] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:03:00 2022] DELETE /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 11:03:00.945340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1449e485-3f55-484f-81fc-17a6f6442bac tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:00.946336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1449e485-3f55-484f-81fc-17a6f6442bac tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:00.953376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1449e485-3f55-484f-81fc-17a6f6442bac tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:00.954148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1449e485-3f55-484f-81fc-17a6f6442bac tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:00.954854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1449e485-3f55-484f-81fc-17a6f6442bac tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:00.955836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1449e485-3f55-484f-81fc-17a6f6442bac tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:00.956295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1449e485-3f55-484f-81fc-17a6f6442bac tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:00.957060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1449e485-3f55-484f-81fc-17a6f6442bac tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:01.114358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1449e485-3f55-484f-81fc-17a6f6442bac tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:01.129942 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1449e485-3f55-484f-81fc-17a6f6442bac tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 200 len: 1680 microversion: 2.1 time: 0.184292 Oct 24 11:03:01.130174 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3122/6271] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:00 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 1680 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:01.662682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3fdd94e5-6519-48d9-9f54-62efa6ce68f9 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:01.665093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3fdd94e5-6519-48d9-9f54-62efa6ce68f9 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: a12e8806-3b51-49d1-a210-bad31519a82f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:01.672568 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fdd94e5-6519-48d9-9f54-62efa6ce68f9 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:01.673374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fdd94e5-6519-48d9-9f54-62efa6ce68f9 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:01.674123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fdd94e5-6519-48d9-9f54-62efa6ce68f9 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:01.675492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fdd94e5-6519-48d9-9f54-62efa6ce68f9 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:01.675865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fdd94e5-6519-48d9-9f54-62efa6ce68f9 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:01.676349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fdd94e5-6519-48d9-9f54-62efa6ce68f9 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:01.692980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-70fa6479-f332-45f8-8258-9858eaa4c297 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:01.693803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-70fa6479-f332-45f8-8258-9858eaa4c297 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:01.704067 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70fa6479-f332-45f8-8258-9858eaa4c297 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:01.704682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70fa6479-f332-45f8-8258-9858eaa4c297 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:01.705282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70fa6479-f332-45f8-8258-9858eaa4c297 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:01.706126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70fa6479-f332-45f8-8258-9858eaa4c297 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:01.706702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70fa6479-f332-45f8-8258-9858eaa4c297 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:01.707241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70fa6479-f332-45f8-8258-9858eaa4c297 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:01.718994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:03:01.915641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3fdd94e5-6519-48d9-9f54-62efa6ce68f9 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:01.924560 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3fdd94e5-6519-48d9-9f54-62efa6ce68f9 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f" status: 200 len: 1313 microversion: 2.1 time: 0.266075 Oct 24 11:03:01.943608 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3150/6272] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:01 2022] GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:01.970737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-70fa6479-f332-45f8-8258-9858eaa4c297 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:01.981073 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-70fa6479-f332-45f8-8258-9858eaa4c297 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1495 microversion: 2.1 time: 0.293255 Oct 24 11:03:01.982460 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3123/6273] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:01 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1495 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:03:02.159651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d52a97c9-85b9-4433-9579-937d74e0e266 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:02.160425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d52a97c9-85b9-4433-9579-937d74e0e266 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:02.169790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d52a97c9-85b9-4433-9579-937d74e0e266 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:02.171496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d52a97c9-85b9-4433-9579-937d74e0e266 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:02.171605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d52a97c9-85b9-4433-9579-937d74e0e266 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:02.172387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d52a97c9-85b9-4433-9579-937d74e0e266 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:02.172902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d52a97c9-85b9-4433-9579-937d74e0e266 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:02.173317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d52a97c9-85b9-4433-9579-937d74e0e266 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:02.459422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d52a97c9-85b9-4433-9579-937d74e0e266 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:02.468572 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d52a97c9-85b9-4433-9579-937d74e0e266 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 200 len: 1680 microversion: 2.1 time: 0.313570 Oct 24 11:03:02.469724 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3151/6274] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:02 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 1680 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:02.957171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f3eb0dc1-b1b7-4775-8cce-ffde43287ec6 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:02.959857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f3eb0dc1-b1b7-4775-8cce-ffde43287ec6 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: a12e8806-3b51-49d1-a210-bad31519a82f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:02.971393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3eb0dc1-b1b7-4775-8cce-ffde43287ec6 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:02.972635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3eb0dc1-b1b7-4775-8cce-ffde43287ec6 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:02.972635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3eb0dc1-b1b7-4775-8cce-ffde43287ec6 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:02.973927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3eb0dc1-b1b7-4775-8cce-ffde43287ec6 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:02.973927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3eb0dc1-b1b7-4775-8cce-ffde43287ec6 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:02.973927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3eb0dc1-b1b7-4775-8cce-ffde43287ec6 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:03.013163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a3da8867-4bab-48d3-a75c-3e2882fc4c28 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:03.023098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a3da8867-4bab-48d3-a75c-3e2882fc4c28 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:03.029749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3da8867-4bab-48d3-a75c-3e2882fc4c28 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:03.031873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3da8867-4bab-48d3-a75c-3e2882fc4c28 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:03.032494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3da8867-4bab-48d3-a75c-3e2882fc4c28 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:03.033430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3da8867-4bab-48d3-a75c-3e2882fc4c28 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:03.034066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3da8867-4bab-48d3-a75c-3e2882fc4c28 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:03.034672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3da8867-4bab-48d3-a75c-3e2882fc4c28 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:03.277689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a3da8867-4bab-48d3-a75c-3e2882fc4c28 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:03.287836 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a3da8867-4bab-48d3-a75c-3e2882fc4c28 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1498 microversion: 2.1 time: 0.283302 Oct 24 11:03:03.291167 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3152/6275] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:03 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1498 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:03.326171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8c032416-7b27-487f-89f7-1e2780f74801 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:03.329091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8c032416-7b27-487f-89f7-1e2780f74801 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:03.339230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:03:03.341982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c032416-7b27-487f-89f7-1e2780f74801 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:03.348655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c032416-7b27-487f-89f7-1e2780f74801 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:03.349227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c032416-7b27-487f-89f7-1e2780f74801 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:03.350181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c032416-7b27-487f-89f7-1e2780f74801 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:03.351357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c032416-7b27-487f-89f7-1e2780f74801 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:03.352334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c032416-7b27-487f-89f7-1e2780f74801 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:03.391741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f3eb0dc1-b1b7-4775-8cce-ffde43287ec6 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:03.414986 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f3eb0dc1-b1b7-4775-8cce-ffde43287ec6 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f" status: 200 len: 1313 microversion: 2.1 time: 0.461650 Oct 24 11:03:03.415696 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3124/6276] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:02 2022] GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:03:03.440022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8c032416-7b27-487f-89f7-1e2780f74801 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:03:03.496251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-77f5fd05-e980-4d80-9302-35d7fc6e3a17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:03.505908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-77f5fd05-e980-4d80-9302-35d7fc6e3a17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:03.532088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77f5fd05-e980-4d80-9302-35d7fc6e3a17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:03.532625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77f5fd05-e980-4d80-9302-35d7fc6e3a17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:03.533108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77f5fd05-e980-4d80-9302-35d7fc6e3a17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:03.535895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77f5fd05-e980-4d80-9302-35d7fc6e3a17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:03.536708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77f5fd05-e980-4d80-9302-35d7fc6e3a17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:03.537603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-77f5fd05-e980-4d80-9302-35d7fc6e3a17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:03.588521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=8 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:03:03.598940 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8c032416-7b27-487f-89f7-1e2780f74801 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 204 len: 0 microversion: 2.1 time: 0.279508 Oct 24 11:03:03.599822 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3153/6277] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:03:03 2022] DELETE /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:03:03.616681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d0f2e718-ec78-4e86-aadf-acc4316e23a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:03.621595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d0f2e718-ec78-4e86-aadf-acc4316e23a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:03.631854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0f2e718-ec78-4e86-aadf-acc4316e23a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:03.632431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0f2e718-ec78-4e86-aadf-acc4316e23a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:03.633105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0f2e718-ec78-4e86-aadf-acc4316e23a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:03.633895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0f2e718-ec78-4e86-aadf-acc4316e23a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:03.634358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0f2e718-ec78-4e86-aadf-acc4316e23a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:03.634972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0f2e718-ec78-4e86-aadf-acc4316e23a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:03.897021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-77f5fd05-e980-4d80-9302-35d7fc6e3a17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:03.899096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d0f2e718-ec78-4e86-aadf-acc4316e23a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:03.905331 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-77f5fd05-e980-4d80-9302-35d7fc6e3a17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 200 len: 1680 microversion: 2.1 time: 0.413740 Oct 24 11:03:03.916939 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3125/6278] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:03 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 1680 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:03.917253 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d0f2e718-ec78-4e86-aadf-acc4316e23a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1504 microversion: 2.1 time: 0.300911 Oct 24 11:03:03.917253 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3154/6279] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:03 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1504 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:04.151867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-25781e27-b80e-448e-8eae-a1746e2e625b req-bed6dbb8-a859-432c-8798-291c3f200fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d0cfd3-33a6-473c-8d33-1a7ff418e838", "name": "network-vif-deleted", "tag": "03f55c95-9041-4ba1-8725-a0501ce7516b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:04.169725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-25781e27-b80e-448e-8eae-a1746e2e625b req-bed6dbb8-a859-432c-8798-291c3f200fc5 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:04.170214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-25781e27-b80e-448e-8eae-a1746e2e625b req-bed6dbb8-a859-432c-8798-291c3f200fc5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:04.171196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-25781e27-b80e-448e-8eae-a1746e2e625b req-bed6dbb8-a859-432c-8798-291c3f200fc5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:04.186108 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-25781e27-b80e-448e-8eae-a1746e2e625b req-bed6dbb8-a859-432c-8798-291c3f200fc5 service nova] Creating event network-vif-deleted:03f55c95-9041-4ba1-8725-a0501ce7516b for instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 on n-h1-858383-15 Oct 24 11:03:04.193903 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-25781e27-b80e-448e-8eae-a1746e2e625b req-bed6dbb8-a859-432c-8798-291c3f200fc5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049987 Oct 24 11:03:04.194293 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3126/6280] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:03:04.441471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bce6dccb-57a9-4241-a6f5-4cf6ebf9e35e tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:04.442369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bce6dccb-57a9-4241-a6f5-4cf6ebf9e35e tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: a12e8806-3b51-49d1-a210-bad31519a82f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:04.449694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bce6dccb-57a9-4241-a6f5-4cf6ebf9e35e tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:04.450182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bce6dccb-57a9-4241-a6f5-4cf6ebf9e35e tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:04.450872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bce6dccb-57a9-4241-a6f5-4cf6ebf9e35e tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:04.453054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bce6dccb-57a9-4241-a6f5-4cf6ebf9e35e tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:04.454775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bce6dccb-57a9-4241-a6f5-4cf6ebf9e35e tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:04.455223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bce6dccb-57a9-4241-a6f5-4cf6ebf9e35e tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:04.666155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bce6dccb-57a9-4241-a6f5-4cf6ebf9e35e tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:04.676299 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bce6dccb-57a9-4241-a6f5-4cf6ebf9e35e tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f" status: 200 len: 1313 microversion: 2.1 time: 0.239342 Oct 24 11:03:04.680861 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3155/6281] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:04 2022] GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:04.936440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-30687332-f91f-485e-b638-2b539845a6c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:04.938040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-30687332-f91f-485e-b638-2b539845a6c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:04.948994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d80cc0ff-b86f-4c1e-925d-23dfa8f58b8b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:04.949826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d80cc0ff-b86f-4c1e-925d-23dfa8f58b8b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:04.953977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30687332-f91f-485e-b638-2b539845a6c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:04.954493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30687332-f91f-485e-b638-2b539845a6c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:04.954943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30687332-f91f-485e-b638-2b539845a6c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:04.955670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30687332-f91f-485e-b638-2b539845a6c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:04.956131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30687332-f91f-485e-b638-2b539845a6c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:04.956572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30687332-f91f-485e-b638-2b539845a6c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:04.966445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d80cc0ff-b86f-4c1e-925d-23dfa8f58b8b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:04.967427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d80cc0ff-b86f-4c1e-925d-23dfa8f58b8b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:04.971317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d80cc0ff-b86f-4c1e-925d-23dfa8f58b8b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:04.973066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d80cc0ff-b86f-4c1e-925d-23dfa8f58b8b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:04.974251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d80cc0ff-b86f-4c1e-925d-23dfa8f58b8b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:04.977182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d80cc0ff-b86f-4c1e-925d-23dfa8f58b8b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:05.051192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-30687332-f91f-485e-b638-2b539845a6c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:05.063948 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-30687332-f91f-485e-b638-2b539845a6c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 200 len: 1613 microversion: 2.1 time: 0.133377 Oct 24 11:03:05.065102 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3127/6282] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:04 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 1613 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:05.282040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d80cc0ff-b86f-4c1e-925d-23dfa8f58b8b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:05.291480 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d80cc0ff-b86f-4c1e-925d-23dfa8f58b8b tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1504 microversion: 2.1 time: 0.359426 Oct 24 11:03:05.292131 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3156/6283] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:04 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1504 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:05.425454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-753260fa-a30c-41a4-aad2-3d665c1a8e36 req-710fdae2-bf1a-45bd-8b92-4cece8fba6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12e8806-3b51-49d1-a210-bad31519a82f", "name": "network-vif-plugged", "status": "completed", "tag": "e2c69aec-3f4f-4fd7-959c-b44ad9ac3a17"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:05.458566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-753260fa-a30c-41a4-aad2-3d665c1a8e36 req-710fdae2-bf1a-45bd-8b92-4cece8fba6c7 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:05.459070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-753260fa-a30c-41a4-aad2-3d665c1a8e36 req-710fdae2-bf1a-45bd-8b92-4cece8fba6c7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:05.459518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-753260fa-a30c-41a4-aad2-3d665c1a8e36 req-710fdae2-bf1a-45bd-8b92-4cece8fba6c7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:05.479062 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-753260fa-a30c-41a4-aad2-3d665c1a8e36 req-710fdae2-bf1a-45bd-8b92-4cece8fba6c7 service nova] Creating event network-vif-plugged:e2c69aec-3f4f-4fd7-959c-b44ad9ac3a17 for instance a12e8806-3b51-49d1-a210-bad31519a82f on n-h2-858383-15 Oct 24 11:03:05.492563 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-753260fa-a30c-41a4-aad2-3d665c1a8e36 req-710fdae2-bf1a-45bd-8b92-4cece8fba6c7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070867 Oct 24 11:03:05.496778 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3128/6284] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:03:05.710622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b8ad63a5-cb1c-46b9-9878-dd70c3909117 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:05.711894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b8ad63a5-cb1c-46b9-9878-dd70c3909117 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: a12e8806-3b51-49d1-a210-bad31519a82f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:05.727789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8ad63a5-cb1c-46b9-9878-dd70c3909117 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:05.728578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8ad63a5-cb1c-46b9-9878-dd70c3909117 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:05.729219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8ad63a5-cb1c-46b9-9878-dd70c3909117 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:05.730121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8ad63a5-cb1c-46b9-9878-dd70c3909117 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:05.731070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8ad63a5-cb1c-46b9-9878-dd70c3909117 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:05.734344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b8ad63a5-cb1c-46b9-9878-dd70c3909117 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:05.970141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b8ad63a5-cb1c-46b9-9878-dd70c3909117 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:05.993525 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b8ad63a5-cb1c-46b9-9878-dd70c3909117 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f" status: 200 len: 1313 microversion: 2.1 time: 0.287799 Oct 24 11:03:05.998719 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3157/6285] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:05 2022] GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:06.089317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-44eaa114-7265-49a1-8195-e30a8d3e6cba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:06.090615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-44eaa114-7265-49a1-8195-e30a8d3e6cba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:06.101870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44eaa114-7265-49a1-8195-e30a8d3e6cba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:06.102819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44eaa114-7265-49a1-8195-e30a8d3e6cba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:06.103523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44eaa114-7265-49a1-8195-e30a8d3e6cba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:06.104505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44eaa114-7265-49a1-8195-e30a8d3e6cba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:06.105352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44eaa114-7265-49a1-8195-e30a8d3e6cba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:06.106445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44eaa114-7265-49a1-8195-e30a8d3e6cba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:06.177794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44eaa114-7265-49a1-8195-e30a8d3e6cba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:06.178699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44eaa114-7265-49a1-8195-e30a8d3e6cba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:06.179456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44eaa114-7265-49a1-8195-e30a8d3e6cba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:06.180144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-44eaa114-7265-49a1-8195-e30a8d3e6cba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lazy-loading 'fault' on Instance uuid 64d0cfd3-33a6-473c-8d33-1a7ff418e838 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:03:06.235009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-44eaa114-7265-49a1-8195-e30a8d3e6cba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:06.241326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:03:06.254796 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-44eaa114-7265-49a1-8195-e30a8d3e6cba tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 200 len: 1331 microversion: 2.1 time: 0.169697 Oct 24 11:03:06.259187 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3129/6286] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:06 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 1331 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:06.315948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8cbe8182-bac0-4732-8fbf-69d71185f8a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:06.316630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8cbe8182-bac0-4732-8fbf-69d71185f8a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:06.333135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cbe8182-bac0-4732-8fbf-69d71185f8a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:06.333918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cbe8182-bac0-4732-8fbf-69d71185f8a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:06.334549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cbe8182-bac0-4732-8fbf-69d71185f8a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:06.335446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cbe8182-bac0-4732-8fbf-69d71185f8a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:06.336079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cbe8182-bac0-4732-8fbf-69d71185f8a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:06.337496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cbe8182-bac0-4732-8fbf-69d71185f8a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:06.571899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8cbe8182-bac0-4732-8fbf-69d71185f8a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aafacbb96924fc4a17389a051a91301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa2066161ad4dfcbdb1b78ffe0896e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:06.583619 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8cbe8182-bac0-4732-8fbf-69d71185f8a2 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 200 len: 1504 microversion: 2.1 time: 0.271574 Oct 24 11:03:06.584554 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3158/6287] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:06 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 1504 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:06.679348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f2b33d51-cb66-4012-bdd7-5e1145a74bbf req-bff50704-b7b5-4161-9479-cb6dc40d2606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1499c7a8-df86-425f-ad4f-911b8cca47ec", "name": "network-vif-deleted", "tag": "0f174c39-ebb3-43ac-8361-fe14ca401865"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:06.691083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f2b33d51-cb66-4012-bdd7-5e1145a74bbf req-bff50704-b7b5-4161-9479-cb6dc40d2606 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:06.691721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f2b33d51-cb66-4012-bdd7-5e1145a74bbf req-bff50704-b7b5-4161-9479-cb6dc40d2606 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:06.692272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f2b33d51-cb66-4012-bdd7-5e1145a74bbf req-bff50704-b7b5-4161-9479-cb6dc40d2606 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:06.716636 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f2b33d51-cb66-4012-bdd7-5e1145a74bbf req-bff50704-b7b5-4161-9479-cb6dc40d2606 service nova] Creating event network-vif-deleted:0f174c39-ebb3-43ac-8361-fe14ca401865 for instance 1499c7a8-df86-425f-ad4f-911b8cca47ec on n-h1-858383-15 Oct 24 11:03:06.725479 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f2b33d51-cb66-4012-bdd7-5e1145a74bbf req-bff50704-b7b5-4161-9479-cb6dc40d2606 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050137 Oct 24 11:03:06.726364 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3130/6288] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:03:07.019398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7865c1d5-cf09-4285-903f-99f9445cafe2 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:07.020119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7865c1d5-cf09-4285-903f-99f9445cafe2 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: a12e8806-3b51-49d1-a210-bad31519a82f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:07.028897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7865c1d5-cf09-4285-903f-99f9445cafe2 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:07.029405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7865c1d5-cf09-4285-903f-99f9445cafe2 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:07.029854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7865c1d5-cf09-4285-903f-99f9445cafe2 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:07.030876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7865c1d5-cf09-4285-903f-99f9445cafe2 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:07.031354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7865c1d5-cf09-4285-903f-99f9445cafe2 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:07.031792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7865c1d5-cf09-4285-903f-99f9445cafe2 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:07.182676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7865c1d5-cf09-4285-903f-99f9445cafe2 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:07.194717 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7865c1d5-cf09-4285-903f-99f9445cafe2 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f" status: 200 len: 1498 microversion: 2.1 time: 0.180126 Oct 24 11:03:07.195657 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3159/6289] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:07 2022] GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f => generated 1498 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:07.280927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f4bc34cd-b182-4ed8-9a17-29458df93147 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:07.281904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f4bc34cd-b182-4ed8-9a17-29458df93147 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:07.291357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4bc34cd-b182-4ed8-9a17-29458df93147 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:07.294967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4bc34cd-b182-4ed8-9a17-29458df93147 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:07.295459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4bc34cd-b182-4ed8-9a17-29458df93147 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:07.298760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4bc34cd-b182-4ed8-9a17-29458df93147 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:07.301261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4bc34cd-b182-4ed8-9a17-29458df93147 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:07.301738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4bc34cd-b182-4ed8-9a17-29458df93147 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:07.337127 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-f4bc34cd-b182-4ed8-9a17-29458df93147 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] HTTP exception thrown: Instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 could not be found. Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f4bc34cd-b182-4ed8-9a17-29458df93147 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Request method failure captured: Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 HTTP/1.1 Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnAKAHP5OOfm-uCWTjFJTzXa0YLKSuouosUciU14TRf3JmMepl7Z3nYn7w4Ibs55CltNd_hrYn98Pw4N-ToeUd4QusviP9lFlPXOJGwfHRkdtQPCg9kRiq2YXaf55wJAz2KjxNTj7AXjHUrV-JebO1VNsJhWCbt5cfPkaHFUJTxTNxM Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a10ff6644b9b4215b1b7c82b98342a79", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: da9e4e22dda84476a30e6b6bd27c68a6 Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 could not be found. Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '64d0cfd3-33a6-473c-8d33-1a7ff418e838'} Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 could not be found. Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 could not be found. Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:03:07.341595 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:03:07.346147 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:03:07.346147 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:03:07.346147 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:03:07.346147 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:03:07.346147 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:03:07.346147 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 could not be found. Oct 24 11:03:07.346147 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:03:07.346147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f4bc34cd-b182-4ed8-9a17-29458df93147 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Returning 404 to user: Instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:03:07.346147 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f4bc34cd-b182-4ed8-9a17-29458df93147 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 404 len: 111 microversion: 2.1 time: 0.069056 Oct 24 11:03:07.347742 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3131/6290] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:07 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:03:07.354423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ae45333e-d65f-45c6-ab87-4176b393c099 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '.version_select at 0x7f04cb5dd160>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:07.397839 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ae45333e-d65f-45c6-ab87-4176b393c099 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-859061108" status: 202 len: 0 microversion: 2.1 time: 0.047367 Oct 24 11:03:07.398558 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3160/6291] 10.222.0.50 () {58 vars in 1218 bytes} [Mon Oct 24 11:03:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-859061108 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:03:07.609850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e324c4e-9804-45bc-b623-ff9d7b4de837 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:07.610961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5e324c4e-9804-45bc-b623-ff9d7b4de837 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] [instance: 1499c7a8-df86-425f-ad4f-911b8cca47ec] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:07.619509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e324c4e-9804-45bc-b623-ff9d7b4de837 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:07.625539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e324c4e-9804-45bc-b623-ff9d7b4de837 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:07.626004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e324c4e-9804-45bc-b623-ff9d7b4de837 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:07.626756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e324c4e-9804-45bc-b623-ff9d7b4de837 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:07.627223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e324c4e-9804-45bc-b623-ff9d7b4de837 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:07.627656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e324c4e-9804-45bc-b623-ff9d7b4de837 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:07.653604 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-5e324c4e-9804-45bc-b623-ff9d7b4de837 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] HTTP exception thrown: Instance 1499c7a8-df86-425f-ad4f-911b8cca47ec could not be found. Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e324c4e-9804-45bc-b623-ff9d7b4de837 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Request method failure captured: Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec HTTP/1.1 Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnDI6vkbsyXLJPaeVtWt1hkXpsEY_D83hofMDTUguRUeg5y6iJ36B2upDU20KUUrE2dyQSvLRzt9KYSTa__A3I7uGdCme2OAHFe3UwhjUXG45X7nJ1HiAFoO7z94hVtDNZDC9fUIsmGntDT7FzMkrQe6pV0goCcufjdFf85XzJ9M1DY Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 8fa2066161ad4dfcbdb1b78ffe0896e5 Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestServerAdvancedOps-228519863 Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fa2066161ad4dfcbdb1b78ffe0896e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8fa2066161ad4dfcbdb1b78ffe0896e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8fa2066161ad4dfcbdb1b78ffe0896e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8fa2066161ad4dfcbdb1b78ffe0896e5", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestServerAdvancedOps-228519863 Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 8fa2066161ad4dfcbdb1b78ffe0896e5 Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestServerAdvancedOps-228519863 Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestServerAdvancedOps-228519863-project Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 4aafacbb96924fc4a17389a051a91301 Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestServerAdvancedOps-228519863-project Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 1499c7a8-df86-425f-ad4f-911b8cca47ec could not be found. Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '1499c7a8-df86-425f-ad4f-911b8cca47ec'} Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1499c7a8-df86-425f-ad4f-911b8cca47ec could not be found. Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1499c7a8-df86-425f-ad4f-911b8cca47ec could not be found. Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:03:07.655782 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:03:07.661691 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:03:07.661691 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:03:07.661691 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:03:07.661691 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:03:07.661691 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:03:07.661691 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1499c7a8-df86-425f-ad4f-911b8cca47ec could not be found. Oct 24 11:03:07.661691 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:03:07.661691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e324c4e-9804-45bc-b623-ff9d7b4de837 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] Returning 404 to user: Instance 1499c7a8-df86-425f-ad4f-911b8cca47ec could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:03:07.661691 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5e324c4e-9804-45bc-b623-ff9d7b4de837 tempest-TestServerAdvancedOps-228519863 tempest-TestServerAdvancedOps-228519863-project] 10.222.0.50 "GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec" status: 404 len: 111 microversion: 2.1 time: 0.052603 Oct 24 11:03:07.661691 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3132/6292] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:07 2022] GET /compute/v2.1/servers/1499c7a8-df86-425f-ad4f-911b8cca47ec => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:03:07.847279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4d861476-7648-4941-ad68-199c6570601f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:07.847789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4d861476-7648-4941-ad68-199c6570601f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: a12e8806-3b51-49d1-a210-bad31519a82f] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:07.857441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d861476-7648-4941-ad68-199c6570601f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:07.860330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d861476-7648-4941-ad68-199c6570601f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:07.861067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d861476-7648-4941-ad68-199c6570601f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:07.865143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d861476-7648-4941-ad68-199c6570601f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:07.868193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d861476-7648-4941-ad68-199c6570601f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:07.869011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d861476-7648-4941-ad68-199c6570601f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:07.908638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4d861476-7648-4941-ad68-199c6570601f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: a12e8806-3b51-49d1-a210-bad31519a82f] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:03:08.011945 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4d861476-7648-4941-ad68-199c6570601f tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f" status: 204 len: 0 microversion: 2.1 time: 0.169537 Oct 24 11:03:08.012781 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3161/6293] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:03:07 2022] DELETE /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:03:08.022771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-248a6cc8-356b-455e-9666-af796ca8c442 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:08.023461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-248a6cc8-356b-455e-9666-af796ca8c442 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: a12e8806-3b51-49d1-a210-bad31519a82f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:08.036108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-248a6cc8-356b-455e-9666-af796ca8c442 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:08.037802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-248a6cc8-356b-455e-9666-af796ca8c442 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:08.039450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-248a6cc8-356b-455e-9666-af796ca8c442 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:08.040419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-248a6cc8-356b-455e-9666-af796ca8c442 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:08.041835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-248a6cc8-356b-455e-9666-af796ca8c442 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:08.042453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-248a6cc8-356b-455e-9666-af796ca8c442 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:08.630280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-248a6cc8-356b-455e-9666-af796ca8c442 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:08.640105 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-248a6cc8-356b-455e-9666-af796ca8c442 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f" status: 200 len: 1504 microversion: 2.1 time: 0.622387 Oct 24 11:03:08.657218 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3133/6294] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:08 2022] GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f => generated 1504 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:08.822038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3089e3e9-7f5f-4e8a-ab42-3edec1431953 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Action: 'create', calling method: .version_select at 0x7f04cb5dd160>, body: {"keypair": {"name": "tempest-keypair-1980117330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKsxOt7+aduCcL4fIVWQaq2fLcHtS1HMKErDhOQ8ZLMAxN5+BrxlgUDSvVjFxZ/jf3stUMIYXzRjf6JsDZhd5DrGj7T42X5k0dLOA5nwZPnjeyDpWqtrz0YQ8N+RuPkbg=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:08.854646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-3089e3e9-7f5f-4e8a-ab42-3edec1431953 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Getting quotas for project a10ff6644b9b4215b1b7c82b98342a79. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:03:08.861920 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-3089e3e9-7f5f-4e8a-ab42-3edec1431953 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Getting quotas for user da9e4e22dda84476a30e6b6bd27c68a6 and project a10ff6644b9b4215b1b7c82b98342a79. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:03:08.919190 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3089e3e9-7f5f-4e8a-ab42-3edec1431953 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.100753 Oct 24 11:03:08.922651 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3162/6295] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:03:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:03:09.664239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e7084ae0-fb74-462a-bf77-a15b7260c7f4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:09.664869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e7084ae0-fb74-462a-bf77-a15b7260c7f4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: a12e8806-3b51-49d1-a210-bad31519a82f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:09.675698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7084ae0-fb74-462a-bf77-a15b7260c7f4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:09.676193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7084ae0-fb74-462a-bf77-a15b7260c7f4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:09.676646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7084ae0-fb74-462a-bf77-a15b7260c7f4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:09.681794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7084ae0-fb74-462a-bf77-a15b7260c7f4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:09.682286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7084ae0-fb74-462a-bf77-a15b7260c7f4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:09.682720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7084ae0-fb74-462a-bf77-a15b7260c7f4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:10.002522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e7084ae0-fb74-462a-bf77-a15b7260c7f4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:10.015753 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e7084ae0-fb74-462a-bf77-a15b7260c7f4 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f" status: 200 len: 1504 microversion: 2.1 time: 0.354550 Oct 24 11:03:10.016724 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3134/6296] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:09 2022] GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:10.426476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-313852b3-930b-40e5-ba60-726cb0338dc4 req-5fb097a1-f4d1-4ff1-93fc-e7edc01f2c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12e8806-3b51-49d1-a210-bad31519a82f", "name": "network-vif-deleted", "tag": "e2c69aec-3f4f-4fd7-959c-b44ad9ac3a17"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:10.449496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-313852b3-930b-40e5-ba60-726cb0338dc4 req-5fb097a1-f4d1-4ff1-93fc-e7edc01f2c7d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:10.454206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-313852b3-930b-40e5-ba60-726cb0338dc4 req-5fb097a1-f4d1-4ff1-93fc-e7edc01f2c7d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:10.456172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-313852b3-930b-40e5-ba60-726cb0338dc4 req-5fb097a1-f4d1-4ff1-93fc-e7edc01f2c7d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:10.490025 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-313852b3-930b-40e5-ba60-726cb0338dc4 req-5fb097a1-f4d1-4ff1-93fc-e7edc01f2c7d service nova] Creating event network-vif-deleted:e2c69aec-3f4f-4fd7-959c-b44ad9ac3a17 for instance a12e8806-3b51-49d1-a210-bad31519a82f on n-h2-858383-15 Oct 24 11:03:10.516448 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-313852b3-930b-40e5-ba60-726cb0338dc4 req-5fb097a1-f4d1-4ff1-93fc-e7edc01f2c7d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092001 Oct 24 11:03:10.517116 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3163/6297] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:03:11.045927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-df7a457c-5bc4-4fc0-ab68-72a07be2f74d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:11.048239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-df7a457c-5bc4-4fc0-ab68-72a07be2f74d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: a12e8806-3b51-49d1-a210-bad31519a82f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:11.066874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df7a457c-5bc4-4fc0-ab68-72a07be2f74d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:11.067880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df7a457c-5bc4-4fc0-ab68-72a07be2f74d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:11.068636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df7a457c-5bc4-4fc0-ab68-72a07be2f74d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:11.069574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df7a457c-5bc4-4fc0-ab68-72a07be2f74d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:11.070311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df7a457c-5bc4-4fc0-ab68-72a07be2f74d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:11.070722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df7a457c-5bc4-4fc0-ab68-72a07be2f74d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:11.110934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df7a457c-5bc4-4fc0-ab68-72a07be2f74d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:11.111688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df7a457c-5bc4-4fc0-ab68-72a07be2f74d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:11.112126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df7a457c-5bc4-4fc0-ab68-72a07be2f74d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:11.112574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-df7a457c-5bc4-4fc0-ab68-72a07be2f74d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lazy-loading 'fault' on Instance uuid a12e8806-3b51-49d1-a210-bad31519a82f {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:03:11.159468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-df7a457c-5bc4-4fc0-ab68-72a07be2f74d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfc205e99840259c8eb68560817581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba709c74314b49f48e684aa99eb4a433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:11.169277 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-df7a457c-5bc4-4fc0-ab68-72a07be2f74d tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f" status: 200 len: 1303 microversion: 2.1 time: 0.132634 Oct 24 11:03:11.170268 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3135/6298] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:11 2022] GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f => generated 1303 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:11.667496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1b6a72b4-314f-4028-8ff4-0ee70c8a9f91 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-458908272", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b82d466-b601-44d7-abeb-7c2705af48cc"}], "security_groups": [{"name": "tempest-securitygroup--1840375088"}], "key_name": "tempest-keypair-1980117330", "user_data": "}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:11.782113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-1b6a72b4-314f-4028-8ff4-0ee70c8a9f91 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] validate_networks() for [('6b82d466-b601-44d7-abeb-7c2705af48cc', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:03:11.895007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5fe945bf-c4d6-4f96-96c2-74d0245cff33 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Action: 'create', calling method: .version_select at 0x7f04cb856670>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-981309114", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHwldrALkxywcgHXQ+pSQTe0c5mE+MWh0H//W0ClS7mXCpaE2VWxCKS7Kg3LIym23WlKWmZXMjaNNXMqtb/UgLQVIjO9f9CO11WNYC4ojbLG4cwsFV7SKKubZswR+aqzQ=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:11.913992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-5fe945bf-c4d6-4f96-96c2-74d0245cff33 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Getting quotas for project a3a8a814fc1a4d3b95fecf712f5274a1. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:03:11.919499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-5fe945bf-c4d6-4f96-96c2-74d0245cff33 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Getting quotas for user ded681a9997f44678934f42fa1687fb5 and project a3a8a814fc1a4d3b95fecf712f5274a1. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:03:11.949708 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5fe945bf-c4d6-4f96-96c2-74d0245cff33 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.059473 Oct 24 11:03:11.950653 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3136/6299] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:03:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:03:12.193462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a41c3d35-e4a8-4478-9d10-ab3dfdda2239 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:12.194421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a41c3d35-e4a8-4478-9d10-ab3dfdda2239 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] [instance: a12e8806-3b51-49d1-a210-bad31519a82f] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:12.203154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a41c3d35-e4a8-4478-9d10-ab3dfdda2239 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:12.203760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a41c3d35-e4a8-4478-9d10-ab3dfdda2239 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:12.205198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a41c3d35-e4a8-4478-9d10-ab3dfdda2239 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:12.206003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a41c3d35-e4a8-4478-9d10-ab3dfdda2239 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:12.206540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a41c3d35-e4a8-4478-9d10-ab3dfdda2239 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:12.218447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a41c3d35-e4a8-4478-9d10-ab3dfdda2239 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:12.234006 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-a41c3d35-e4a8-4478-9d10-ab3dfdda2239 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] HTTP exception thrown: Instance a12e8806-3b51-49d1-a210-bad31519a82f could not be found. Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a41c3d35-e4a8-4478-9d10-ab3dfdda2239 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Request method failure captured: Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f HTTP/1.1 Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnDGmcCGxYYojAlgntJ4RfDTgikgb4JoaMgIiF9qRtDwrplnpoaOZ-KEDWk9PiZu5O87-X-ApEkelGWlb_aLGILyBflGUILCQ0WS8gf7g2bFfinHZrqBqNp9fu6BxdWJtjWUdpx0I6JbKwlKj-gNH7BH3FoWPLm7f-_jTSEyAOgVLB8 Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: ba709c74314b49f48e684aa99eb4a433 Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesActionsTest-670074001 Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ba709c74314b49f48e684aa99eb4a433"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ba709c74314b49f48e684aa99eb4a433"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ba709c74314b49f48e684aa99eb4a433"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ba709c74314b49f48e684aa99eb4a433", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-VolumesActionsTest-670074001 Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: ba709c74314b49f48e684aa99eb4a433 Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesActionsTest-670074001 Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-VolumesActionsTest-670074001-project Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6abfc205e99840259c8eb68560817581 Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-VolumesActionsTest-670074001-project Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance a12e8806-3b51-49d1-a210-bad31519a82f could not be found. Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'a12e8806-3b51-49d1-a210-bad31519a82f'} Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a12e8806-3b51-49d1-a210-bad31519a82f could not be found. Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a12e8806-3b51-49d1-a210-bad31519a82f could not be found. Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:03:12.236017 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:03:12.239736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:03:12.239736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:03:12.239736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:03:12.239736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:03:12.239736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:03:12.239736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a12e8806-3b51-49d1-a210-bad31519a82f could not be found. Oct 24 11:03:12.239736 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:03:12.241842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a41c3d35-e4a8-4478-9d10-ab3dfdda2239 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] Returning 404 to user: Instance a12e8806-3b51-49d1-a210-bad31519a82f could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:03:12.242949 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a41c3d35-e4a8-4478-9d10-ab3dfdda2239 tempest-VolumesActionsTest-670074001 tempest-VolumesActionsTest-670074001-project] 10.222.0.50 "GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f" status: 404 len: 111 microversion: 2.1 time: 0.054030 Oct 24 11:03:12.244154 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3137/6300] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:12 2022] GET /compute/v2.1/servers/a12e8806-3b51-49d1-a210-bad31519a82f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 11:03:12.321132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1b6a72b4-314f-4028-8ff4-0ee70c8a9f91 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:03:12.321884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1b6a72b4-314f-4028-8ff4-0ee70c8a9f91 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:03:12.322849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1b6a72b4-314f-4028-8ff4-0ee70c8a9f91 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:03:12.323540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1b6a72b4-314f-4028-8ff4-0ee70c8a9f91 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:03:12.324122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1b6a72b4-314f-4028-8ff4-0ee70c8a9f91 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:03:12.340325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b6a72b4-314f-4028-8ff4-0ee70c8a9f91 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:12.344553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b6a72b4-314f-4028-8ff4-0ee70c8a9f91 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:12.345436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b6a72b4-314f-4028-8ff4-0ee70c8a9f91 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:12.347986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b6a72b4-314f-4028-8ff4-0ee70c8a9f91 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:12.349876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b6a72b4-314f-4028-8ff4-0ee70c8a9f91 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:12.352496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b6a72b4-314f-4028-8ff4-0ee70c8a9f91 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:12.406724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-1b6a72b4-314f-4028-8ff4-0ee70c8a9f91 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Getting quotas for project a10ff6644b9b4215b1b7c82b98342a79. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:03:12.430679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-1b6a72b4-314f-4028-8ff4-0ee70c8a9f91 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Getting quotas for user da9e4e22dda84476a30e6b6bd27c68a6 and project a10ff6644b9b4215b1b7c82b98342a79. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:03:12.447555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1b6a72b4-314f-4028-8ff4-0ee70c8a9f91 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:03:12.450371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1b6a72b4-314f-4028-8ff4-0ee70c8a9f91 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:03:12.526788 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1b6a72b4-314f-4028-8ff4-0ee70c8a9f91 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.864292 Oct 24 11:03:12.541565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b903194-697a-46fc-9714-bbf6d6192778 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:12.542702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8b903194-697a-46fc-9714-bbf6d6192778 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:12.550043 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3164/6301] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:03:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:03:12.617268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8b903194-697a-46fc-9714-bbf6d6192778 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:12.631521 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b903194-697a-46fc-9714-bbf6d6192778 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1241 microversion: 2.1 time: 0.094760 Oct 24 11:03:12.639306 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3138/6302] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:12 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:13.663398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-db195c63-3123-4aca-a529-69868f52a3d5 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:13.665223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-db195c63-3123-4aca-a529-69868f52a3d5 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:13.683736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:03:13.685740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db195c63-3123-4aca-a529-69868f52a3d5 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:13.686518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db195c63-3123-4aca-a529-69868f52a3d5 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:13.688582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db195c63-3123-4aca-a529-69868f52a3d5 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:13.694485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db195c63-3123-4aca-a529-69868f52a3d5 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:13.695641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db195c63-3123-4aca-a529-69868f52a3d5 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:13.696280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db195c63-3123-4aca-a529-69868f52a3d5 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:13.819424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-db195c63-3123-4aca-a529-69868f52a3d5 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:13.850570 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-db195c63-3123-4aca-a529-69868f52a3d5 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1237 microversion: 2.1 time: 0.193831 Oct 24 11:03:13.851167 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3165/6303] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:13 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1237 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:14.176204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2c7174c2-b08e-4b6f-b1b4-4c76950e9dd5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1355613893", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8949d3dc-59fa-4647-8eae-64d57e12ce01", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-981309114", "security_groups": [{"name": "tempest-secgroup-smoke-120857611"}], "networks": [{"uuid": "32f72f31-3d63-4301-8876-38df4a6b1866"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:14.459005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-2c7174c2-b08e-4b6f-b1b4-4c76950e9dd5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] validate_networks() for [('32f72f31-3d63-4301-8876-38df4a6b1866', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:03:14.887593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-70bb663a-f015-41cb-9c05-1e6fecd44ec0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:14.888333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-70bb663a-f015-41cb-9c05-1e6fecd44ec0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:14.920370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70bb663a-f015-41cb-9c05-1e6fecd44ec0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:14.927892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70bb663a-f015-41cb-9c05-1e6fecd44ec0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:14.928516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70bb663a-f015-41cb-9c05-1e6fecd44ec0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:14.929320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70bb663a-f015-41cb-9c05-1e6fecd44ec0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:14.934455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70bb663a-f015-41cb-9c05-1e6fecd44ec0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:14.935109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70bb663a-f015-41cb-9c05-1e6fecd44ec0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:15.133215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-70bb663a-f015-41cb-9c05-1e6fecd44ec0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:15.147724 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-70bb663a-f015-41cb-9c05-1e6fecd44ec0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1299 microversion: 2.1 time: 0.266347 Oct 24 11:03:15.148042 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3166/6304] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:14 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1299 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:03:15.204959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2c7174c2-b08e-4b6f-b1b4-4c76950e9dd5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:03:15.206100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2c7174c2-b08e-4b6f-b1b4-4c76950e9dd5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:03:15.206770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2c7174c2-b08e-4b6f-b1b4-4c76950e9dd5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:03:15.207364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2c7174c2-b08e-4b6f-b1b4-4c76950e9dd5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:03:15.208009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-2c7174c2-b08e-4b6f-b1b4-4c76950e9dd5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:03:15.220899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c7174c2-b08e-4b6f-b1b4-4c76950e9dd5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:15.222227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c7174c2-b08e-4b6f-b1b4-4c76950e9dd5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:15.224112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c7174c2-b08e-4b6f-b1b4-4c76950e9dd5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:15.225609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c7174c2-b08e-4b6f-b1b4-4c76950e9dd5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:15.226830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c7174c2-b08e-4b6f-b1b4-4c76950e9dd5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:15.229104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2c7174c2-b08e-4b6f-b1b4-4c76950e9dd5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:15.269989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-2c7174c2-b08e-4b6f-b1b4-4c76950e9dd5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Getting quotas for project a3a8a814fc1a4d3b95fecf712f5274a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:03:15.287552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-2c7174c2-b08e-4b6f-b1b4-4c76950e9dd5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Getting quotas for user ded681a9997f44678934f42fa1687fb5 and project a3a8a814fc1a4d3b95fecf712f5274a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:03:15.446684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2c7174c2-b08e-4b6f-b1b4-4c76950e9dd5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:03:15.449541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2c7174c2-b08e-4b6f-b1b4-4c76950e9dd5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8949d3dc-59fa-4647-8eae-64d57e12ce01',volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:03:15.748622 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2c7174c2-b08e-4b6f-b1b4-4c76950e9dd5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.576250 Oct 24 11:03:15.750750 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3139/6305] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:03:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 11:03:15.761983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d177ae05-eb13-4aea-900b-330cf0381fb9 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:15.762607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d177ae05-eb13-4aea-900b-330cf0381fb9 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:15.900772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d177ae05-eb13-4aea-900b-330cf0381fb9 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:15.910243 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d177ae05-eb13-4aea-900b-330cf0381fb9 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1098 microversion: 2.1 time: 0.152094 Oct 24 11:03:15.916563 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3167/6306] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:15 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1098 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:16.175921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9ad6a2de-659b-4042-bdcc-ffdcafdd0370 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:16.176879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9ad6a2de-659b-4042-bdcc-ffdcafdd0370 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:16.192969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ad6a2de-659b-4042-bdcc-ffdcafdd0370 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:16.194923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ad6a2de-659b-4042-bdcc-ffdcafdd0370 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:16.196070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ad6a2de-659b-4042-bdcc-ffdcafdd0370 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:16.197934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ad6a2de-659b-4042-bdcc-ffdcafdd0370 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:16.201557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ad6a2de-659b-4042-bdcc-ffdcafdd0370 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:16.202759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ad6a2de-659b-4042-bdcc-ffdcafdd0370 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:16.443967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9ad6a2de-659b-4042-bdcc-ffdcafdd0370 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:16.461982 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9ad6a2de-659b-4042-bdcc-ffdcafdd0370 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1299 microversion: 2.1 time: 0.293954 Oct 24 11:03:16.463156 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3140/6307] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:16 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1299 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:16.935880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-33d1cc17-c061-4731-94d4-8266b8f64db3 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:16.938071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-33d1cc17-c061-4731-94d4-8266b8f64db3 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:17.117042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-33d1cc17-c061-4731-94d4-8266b8f64db3 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:17.127620 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-33d1cc17-c061-4731-94d4-8266b8f64db3 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1098 microversion: 2.1 time: 0.195543 Oct 24 11:03:17.130608 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3168/6308] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:16 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1098 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:17.487934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ee313449-4c86-49d0-a1ab-3d37fd7e16a0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:17.488556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ee313449-4c86-49d0-a1ab-3d37fd7e16a0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:17.511757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee313449-4c86-49d0-a1ab-3d37fd7e16a0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:17.516284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee313449-4c86-49d0-a1ab-3d37fd7e16a0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:17.517486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee313449-4c86-49d0-a1ab-3d37fd7e16a0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:17.518595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee313449-4c86-49d0-a1ab-3d37fd7e16a0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:17.520733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee313449-4c86-49d0-a1ab-3d37fd7e16a0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:17.522501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee313449-4c86-49d0-a1ab-3d37fd7e16a0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:17.896868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ee313449-4c86-49d0-a1ab-3d37fd7e16a0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:17.905454 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ee313449-4c86-49d0-a1ab-3d37fd7e16a0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1367 microversion: 2.1 time: 0.422730 Oct 24 11:03:17.908764 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3141/6309] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:17 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:18.155804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1a80ce93-9411-4f2e-b38e-6feffe5e7d94 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:18.156430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1a80ce93-9411-4f2e-b38e-6feffe5e7d94 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:18.174379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a80ce93-9411-4f2e-b38e-6feffe5e7d94 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:18.174940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a80ce93-9411-4f2e-b38e-6feffe5e7d94 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:18.175385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a80ce93-9411-4f2e-b38e-6feffe5e7d94 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:18.176851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a80ce93-9411-4f2e-b38e-6feffe5e7d94 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:18.178140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a80ce93-9411-4f2e-b38e-6feffe5e7d94 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:18.179083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a80ce93-9411-4f2e-b38e-6feffe5e7d94 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:18.189856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:03:18.347434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1a80ce93-9411-4f2e-b38e-6feffe5e7d94 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:18.360934 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1a80ce93-9411-4f2e-b38e-6feffe5e7d94 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1196 microversion: 2.1 time: 0.210235 Oct 24 11:03:18.362160 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3169/6310] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:18 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1196 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:18.929750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-edea23f2-8dbd-42ee-931d-ea854ecd1c52 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:18.930622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-edea23f2-8dbd-42ee-931d-ea854ecd1c52 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:18.942954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edea23f2-8dbd-42ee-931d-ea854ecd1c52 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:18.954994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edea23f2-8dbd-42ee-931d-ea854ecd1c52 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:18.955664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edea23f2-8dbd-42ee-931d-ea854ecd1c52 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:18.956525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edea23f2-8dbd-42ee-931d-ea854ecd1c52 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:18.959031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edea23f2-8dbd-42ee-931d-ea854ecd1c52 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:18.961072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edea23f2-8dbd-42ee-931d-ea854ecd1c52 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:19.180175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-edea23f2-8dbd-42ee-931d-ea854ecd1c52 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:19.192581 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-edea23f2-8dbd-42ee-931d-ea854ecd1c52 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1367 microversion: 2.1 time: 0.266638 Oct 24 11:03:19.193990 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3142/6311] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:18 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:19.387919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e340f06b-048b-490c-9b0d-aebb8748e642 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:19.389417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e340f06b-048b-490c-9b0d-aebb8748e642 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:19.403600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e340f06b-048b-490c-9b0d-aebb8748e642 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:19.404458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e340f06b-048b-490c-9b0d-aebb8748e642 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:19.405296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e340f06b-048b-490c-9b0d-aebb8748e642 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:19.406825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e340f06b-048b-490c-9b0d-aebb8748e642 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:19.407515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e340f06b-048b-490c-9b0d-aebb8748e642 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:19.409358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e340f06b-048b-490c-9b0d-aebb8748e642 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:19.550954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e340f06b-048b-490c-9b0d-aebb8748e642 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:19.559512 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e340f06b-048b-490c-9b0d-aebb8748e642 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1214 microversion: 2.1 time: 0.175413 Oct 24 11:03:19.567770 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3170/6312] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:19 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1214 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:03:20.222619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8f35f4da-38ec-4fca-b077-7796a8a7fba9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:20.224040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8f35f4da-38ec-4fca-b077-7796a8a7fba9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:20.237364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f35f4da-38ec-4fca-b077-7796a8a7fba9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:20.238032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f35f4da-38ec-4fca-b077-7796a8a7fba9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:20.238738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f35f4da-38ec-4fca-b077-7796a8a7fba9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:20.239694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f35f4da-38ec-4fca-b077-7796a8a7fba9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:20.240374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f35f4da-38ec-4fca-b077-7796a8a7fba9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:20.241064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8f35f4da-38ec-4fca-b077-7796a8a7fba9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:20.543847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8f35f4da-38ec-4fca-b077-7796a8a7fba9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:20.554275 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8f35f4da-38ec-4fca-b077-7796a8a7fba9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1367 microversion: 2.1 time: 0.336485 Oct 24 11:03:20.555434 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3143/6313] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:20 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:20.589644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8fadc51a-6590-4bd1-abd9-6b9c6900f3fe tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:20.590455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8fadc51a-6590-4bd1-abd9-6b9c6900f3fe tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:20.604970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fadc51a-6590-4bd1-abd9-6b9c6900f3fe tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:20.605688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fadc51a-6590-4bd1-abd9-6b9c6900f3fe tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:20.607073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fadc51a-6590-4bd1-abd9-6b9c6900f3fe tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:20.611940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fadc51a-6590-4bd1-abd9-6b9c6900f3fe tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:20.612630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fadc51a-6590-4bd1-abd9-6b9c6900f3fe tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:20.613813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8fadc51a-6590-4bd1-abd9-6b9c6900f3fe tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:20.766338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8fadc51a-6590-4bd1-abd9-6b9c6900f3fe tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:20.784856 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8fadc51a-6590-4bd1-abd9-6b9c6900f3fe tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1214 microversion: 2.1 time: 0.198323 Oct 24 11:03:20.808617 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3171/6314] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:20 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1214 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:21.577907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d80e7b53-8187-4a07-8170-f4285c43ef83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:21.578645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d80e7b53-8187-4a07-8170-f4285c43ef83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:21.595166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d80e7b53-8187-4a07-8170-f4285c43ef83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:21.595610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d80e7b53-8187-4a07-8170-f4285c43ef83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:21.598258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d80e7b53-8187-4a07-8170-f4285c43ef83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:21.599038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d80e7b53-8187-4a07-8170-f4285c43ef83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:21.599517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d80e7b53-8187-4a07-8170-f4285c43ef83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:21.604380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d80e7b53-8187-4a07-8170-f4285c43ef83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:21.817172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-113d82f9-5d08-4532-a074-dbb409169baf tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:21.818488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-113d82f9-5d08-4532-a074-dbb409169baf tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:21.844664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-113d82f9-5d08-4532-a074-dbb409169baf tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:21.845599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-113d82f9-5d08-4532-a074-dbb409169baf tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:21.846211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-113d82f9-5d08-4532-a074-dbb409169baf tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:21.861823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-113d82f9-5d08-4532-a074-dbb409169baf tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:21.879641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-113d82f9-5d08-4532-a074-dbb409169baf tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:21.880277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-113d82f9-5d08-4532-a074-dbb409169baf tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:22.033522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-113d82f9-5d08-4532-a074-dbb409169baf tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:22.055883 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-113d82f9-5d08-4532-a074-dbb409169baf tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1214 microversion: 2.1 time: 0.244456 Oct 24 11:03:22.065515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d80e7b53-8187-4a07-8170-f4285c43ef83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:22.074251 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d80e7b53-8187-4a07-8170-f4285c43ef83 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1367 microversion: 2.1 time: 0.500899 Oct 24 11:03:22.076571 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3172/6315] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:21 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1214 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:22.088112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-d2ab5d38-f9a0-4363-b2a8-242a613fb5cd req-ab66b80a-d285-4c17-b3c3-cd53997e1752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "129cf12f-25b4-49e3-afc7-4d8640344201", "tag": "284a7f25-336e-4e74-af84-8dbd289b8b4a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:22.102675 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3144/6316] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:21 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1367 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:22.103570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d2ab5d38-f9a0-4363-b2a8-242a613fb5cd req-ab66b80a-d285-4c17-b3c3-cd53997e1752 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:22.104280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d2ab5d38-f9a0-4363-b2a8-242a613fb5cd req-ab66b80a-d285-4c17-b3c3-cd53997e1752 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:22.105471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d2ab5d38-f9a0-4363-b2a8-242a613fb5cd req-ab66b80a-d285-4c17-b3c3-cd53997e1752 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:22.142545 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-d2ab5d38-f9a0-4363-b2a8-242a613fb5cd req-ab66b80a-d285-4c17-b3c3-cd53997e1752 service nova] Creating event network-changed:284a7f25-336e-4e74-af84-8dbd289b8b4a for instance 129cf12f-25b4-49e3-afc7-4d8640344201 on n-h2-858383-15 Oct 24 11:03:22.151401 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-d2ab5d38-f9a0-4363-b2a8-242a613fb5cd req-ab66b80a-d285-4c17-b3c3-cd53997e1752 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072546 Oct 24 11:03:22.152468 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3173/6317] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:03:23.089899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b9039d54-2a91-4a59-a65c-2f6d24651aca tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:23.091324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b9039d54-2a91-4a59-a65c-2f6d24651aca tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:23.112198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0ab965b4-e9a7-44bb-a5f6-5aed71e86231 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:23.119068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0ab965b4-e9a7-44bb-a5f6-5aed71e86231 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:23.128382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9039d54-2a91-4a59-a65c-2f6d24651aca tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:23.128382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9039d54-2a91-4a59-a65c-2f6d24651aca tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:23.128697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9039d54-2a91-4a59-a65c-2f6d24651aca tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:23.138547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:03:23.152484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ab965b4-e9a7-44bb-a5f6-5aed71e86231 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:23.156156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ab965b4-e9a7-44bb-a5f6-5aed71e86231 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:23.157274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ab965b4-e9a7-44bb-a5f6-5aed71e86231 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:23.159609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ab965b4-e9a7-44bb-a5f6-5aed71e86231 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:23.160999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ab965b4-e9a7-44bb-a5f6-5aed71e86231 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:23.161547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9039d54-2a91-4a59-a65c-2f6d24651aca tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:23.164577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9039d54-2a91-4a59-a65c-2f6d24651aca tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:23.168383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9039d54-2a91-4a59-a65c-2f6d24651aca tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:23.180397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ab965b4-e9a7-44bb-a5f6-5aed71e86231 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:23.947909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0ab965b4-e9a7-44bb-a5f6-5aed71e86231 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:23.962366 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0ab965b4-e9a7-44bb-a5f6-5aed71e86231 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1367 microversion: 2.1 time: 0.855923 Oct 24 11:03:23.966541 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3174/6318] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:23 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1367 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:03:23.973831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9039d54-2a91-4a59-a65c-2f6d24651aca tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:23.992904 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b9039d54-2a91-4a59-a65c-2f6d24651aca tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1281 microversion: 2.1 time: 0.912883 Oct 24 11:03:23.994862 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3145/6319] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:23 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1281 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:24.994862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ddaeae32-4622-403e-be90-d89b5100e3c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:24.995681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ddaeae32-4622-403e-be90-d89b5100e3c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:25.012091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaeae32-4622-403e-be90-d89b5100e3c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:25.015909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaeae32-4622-403e-be90-d89b5100e3c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:25.019736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaeae32-4622-403e-be90-d89b5100e3c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:25.020117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6625cf3a-4322-47f2-a047-8431c7d6a51d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:25.021352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6625cf3a-4322-47f2-a047-8431c7d6a51d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:25.022469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaeae32-4622-403e-be90-d89b5100e3c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:25.023080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaeae32-4622-403e-be90-d89b5100e3c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:25.024383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaeae32-4622-403e-be90-d89b5100e3c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:25.039868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6625cf3a-4322-47f2-a047-8431c7d6a51d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:25.045298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6625cf3a-4322-47f2-a047-8431c7d6a51d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:25.045816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6625cf3a-4322-47f2-a047-8431c7d6a51d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:25.052589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6625cf3a-4322-47f2-a047-8431c7d6a51d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:25.053349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6625cf3a-4322-47f2-a047-8431c7d6a51d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:25.054831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6625cf3a-4322-47f2-a047-8431c7d6a51d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:25.249903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:03:25.325097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:03:25.377563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6625cf3a-4322-47f2-a047-8431c7d6a51d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:25.396150 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6625cf3a-4322-47f2-a047-8431c7d6a51d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1281 microversion: 2.1 time: 0.379715 Oct 24 11:03:25.399509 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3146/6320] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:25 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1281 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:25.457536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ddaeae32-4622-403e-be90-d89b5100e3c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:25.471449 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ddaeae32-4622-403e-be90-d89b5100e3c0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1367 microversion: 2.1 time: 0.481168 Oct 24 11:03:25.481246 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3175/6321] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:24 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1367 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:26.157257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-365c3d03-d4ef-4e8a-9e12-8324ced34e04 req-d765465e-141f-4162-8c4e-01d2f0a4eeb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f185ae20-51ff-406e-9717-78352a36f5cd", "tag": "8d629348-dc03-4347-b47b-90a89bd901c9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:26.187731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-365c3d03-d4ef-4e8a-9e12-8324ced34e04 req-d765465e-141f-4162-8c4e-01d2f0a4eeb7 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:26.188222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-365c3d03-d4ef-4e8a-9e12-8324ced34e04 req-d765465e-141f-4162-8c4e-01d2f0a4eeb7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:26.188655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-365c3d03-d4ef-4e8a-9e12-8324ced34e04 req-d765465e-141f-4162-8c4e-01d2f0a4eeb7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:26.214379 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-365c3d03-d4ef-4e8a-9e12-8324ced34e04 req-d765465e-141f-4162-8c4e-01d2f0a4eeb7 service nova] Creating event network-changed:8d629348-dc03-4347-b47b-90a89bd901c9 for instance f185ae20-51ff-406e-9717-78352a36f5cd on n-h1-858383-15 Oct 24 11:03:26.254636 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-365c3d03-d4ef-4e8a-9e12-8324ced34e04 req-d765465e-141f-4162-8c4e-01d2f0a4eeb7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102651 Oct 24 11:03:26.257890 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3147/6322] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:03:26.422485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3fe2ccb0-c0ab-48d8-a2f1-769ed7a36f82 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:26.423428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3fe2ccb0-c0ab-48d8-a2f1-769ed7a36f82 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:26.439414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fe2ccb0-c0ab-48d8-a2f1-769ed7a36f82 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:26.440219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fe2ccb0-c0ab-48d8-a2f1-769ed7a36f82 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:26.440990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fe2ccb0-c0ab-48d8-a2f1-769ed7a36f82 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:26.441924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fe2ccb0-c0ab-48d8-a2f1-769ed7a36f82 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:26.442571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fe2ccb0-c0ab-48d8-a2f1-769ed7a36f82 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:26.443188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fe2ccb0-c0ab-48d8-a2f1-769ed7a36f82 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:26.497818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c5dce5bf-72bb-4d24-a144-4f7c147e0288 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:26.499850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c5dce5bf-72bb-4d24-a144-4f7c147e0288 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:26.521887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5dce5bf-72bb-4d24-a144-4f7c147e0288 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:26.522394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5dce5bf-72bb-4d24-a144-4f7c147e0288 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:26.524907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5dce5bf-72bb-4d24-a144-4f7c147e0288 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:26.525694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5dce5bf-72bb-4d24-a144-4f7c147e0288 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:26.526178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5dce5bf-72bb-4d24-a144-4f7c147e0288 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:26.526618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c5dce5bf-72bb-4d24-a144-4f7c147e0288 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:27.126864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c5dce5bf-72bb-4d24-a144-4f7c147e0288 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:27.127710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=14 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:03:27.148073 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c5dce5bf-72bb-4d24-a144-4f7c147e0288 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1367 microversion: 2.1 time: 0.652259 Oct 24 11:03:27.153848 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3148/6323] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:26 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1367 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:27.205384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3fe2ccb0-c0ab-48d8-a2f1-769ed7a36f82 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:27.214189 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3fe2ccb0-c0ab-48d8-a2f1-769ed7a36f82 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1281 microversion: 2.1 time: 0.797010 Oct 24 11:03:27.227561 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3176/6324] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:26 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1281 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:28.176114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b585bd33-8ea2-4e9c-9c0b-e6ad7f086cdb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:28.177781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b585bd33-8ea2-4e9c-9c0b-e6ad7f086cdb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:28.215212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b585bd33-8ea2-4e9c-9c0b-e6ad7f086cdb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:28.219119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b585bd33-8ea2-4e9c-9c0b-e6ad7f086cdb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:28.221471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b585bd33-8ea2-4e9c-9c0b-e6ad7f086cdb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:28.226373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b585bd33-8ea2-4e9c-9c0b-e6ad7f086cdb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:28.227520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b585bd33-8ea2-4e9c-9c0b-e6ad7f086cdb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:28.230957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b585bd33-8ea2-4e9c-9c0b-e6ad7f086cdb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:28.242896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cd46403a-45ec-4543-8701-1a3699d8aa11 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:28.243527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cd46403a-45ec-4543-8701-1a3699d8aa11 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:28.263346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd46403a-45ec-4543-8701-1a3699d8aa11 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:28.266118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd46403a-45ec-4543-8701-1a3699d8aa11 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:28.270075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd46403a-45ec-4543-8701-1a3699d8aa11 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:28.275303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd46403a-45ec-4543-8701-1a3699d8aa11 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:28.277860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd46403a-45ec-4543-8701-1a3699d8aa11 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:28.278523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd46403a-45ec-4543-8701-1a3699d8aa11 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:28.609555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b585bd33-8ea2-4e9c-9c0b-e6ad7f086cdb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:28.624508 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b585bd33-8ea2-4e9c-9c0b-e6ad7f086cdb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1367 microversion: 2.1 time: 0.453070 Oct 24 11:03:28.628645 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3149/6325] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:28 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1367 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:28.730473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cd46403a-45ec-4543-8701-1a3699d8aa11 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:28.742760 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cd46403a-45ec-4543-8701-1a3699d8aa11 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1281 microversion: 2.1 time: 0.504338 Oct 24 11:03:28.758791 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3177/6326] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:28 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1281 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:29.651170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e18d561e-0c67-4ffe-99f2-66fe2420b027 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:29.651813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e18d561e-0c67-4ffe-99f2-66fe2420b027 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:29.675892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e18d561e-0c67-4ffe-99f2-66fe2420b027 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:29.676394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e18d561e-0c67-4ffe-99f2-66fe2420b027 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:29.676890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e18d561e-0c67-4ffe-99f2-66fe2420b027 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:29.683825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e18d561e-0c67-4ffe-99f2-66fe2420b027 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:29.684323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e18d561e-0c67-4ffe-99f2-66fe2420b027 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:29.684770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e18d561e-0c67-4ffe-99f2-66fe2420b027 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:29.779234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-061e1508-2d8c-4366-b1f8-889937506653 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:29.780123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-061e1508-2d8c-4366-b1f8-889937506653 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:29.814154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-061e1508-2d8c-4366-b1f8-889937506653 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:29.814738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-061e1508-2d8c-4366-b1f8-889937506653 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:29.817342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-061e1508-2d8c-4366-b1f8-889937506653 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:29.820121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-061e1508-2d8c-4366-b1f8-889937506653 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:29.824191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-061e1508-2d8c-4366-b1f8-889937506653 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:29.828357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-061e1508-2d8c-4366-b1f8-889937506653 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:29.926017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e18d561e-0c67-4ffe-99f2-66fe2420b027 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:29.936030 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e18d561e-0c67-4ffe-99f2-66fe2420b027 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1367 microversion: 2.1 time: 0.289140 Oct 24 11:03:29.937654 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3150/6327] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:29 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:30.309741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-061e1508-2d8c-4366-b1f8-889937506653 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:30.388210 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-061e1508-2d8c-4366-b1f8-889937506653 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1269 microversion: 2.1 time: 0.622563 Oct 24 11:03:30.388814 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3178/6328] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:29 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1269 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:30.962545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e9e9b07-8d5a-470a-90e6-2d404ce5029b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:30.963151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5e9e9b07-8d5a-470a-90e6-2d404ce5029b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:30.966016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:03:30.983873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e9e9b07-8d5a-470a-90e6-2d404ce5029b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:30.993680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e9e9b07-8d5a-470a-90e6-2d404ce5029b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:30.994342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e9e9b07-8d5a-470a-90e6-2d404ce5029b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:30.995275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e9e9b07-8d5a-470a-90e6-2d404ce5029b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:31.001393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e9e9b07-8d5a-470a-90e6-2d404ce5029b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:31.004009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e9e9b07-8d5a-470a-90e6-2d404ce5029b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:31.263455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5e9e9b07-8d5a-470a-90e6-2d404ce5029b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:31.275459 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5e9e9b07-8d5a-470a-90e6-2d404ce5029b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1367 microversion: 2.1 time: 0.316022 Oct 24 11:03:31.276615 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3151/6329] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:30 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:31.429482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7775b09a-bdd0-49b9-b707-604ed575a68f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:31.430158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7775b09a-bdd0-49b9-b707-604ed575a68f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:31.452710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7775b09a-bdd0-49b9-b707-604ed575a68f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:31.456328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7775b09a-bdd0-49b9-b707-604ed575a68f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:31.457040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7775b09a-bdd0-49b9-b707-604ed575a68f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:31.457990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7775b09a-bdd0-49b9-b707-604ed575a68f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:31.458625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7775b09a-bdd0-49b9-b707-604ed575a68f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:31.459223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7775b09a-bdd0-49b9-b707-604ed575a68f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:31.790001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7775b09a-bdd0-49b9-b707-604ed575a68f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:31.803834 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7775b09a-bdd0-49b9-b707-604ed575a68f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1269 microversion: 2.1 time: 0.392280 Oct 24 11:03:31.827735 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3179/6330] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:31 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1269 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:32.305863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-250bc2e4-99d4-43a4-a69b-0bb9d53e8353 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:32.307734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-250bc2e4-99d4-43a4-a69b-0bb9d53e8353 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:32.319398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-250bc2e4-99d4-43a4-a69b-0bb9d53e8353 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:32.320183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-250bc2e4-99d4-43a4-a69b-0bb9d53e8353 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:32.321068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-250bc2e4-99d4-43a4-a69b-0bb9d53e8353 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:32.322212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-250bc2e4-99d4-43a4-a69b-0bb9d53e8353 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:32.322836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-250bc2e4-99d4-43a4-a69b-0bb9d53e8353 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:32.323430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-250bc2e4-99d4-43a4-a69b-0bb9d53e8353 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:32.330885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=100 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:03:32.422868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-692cbf70-7d3b-4775-8bd8-00fc1232a64a req-997a2a95-454c-498e-8671-5d24903bf7ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "129cf12f-25b4-49e3-afc7-4d8640344201", "name": "network-vif-plugged", "status": "completed", "tag": "284a7f25-336e-4e74-af84-8dbd289b8b4a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:32.470543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-692cbf70-7d3b-4775-8bd8-00fc1232a64a req-997a2a95-454c-498e-8671-5d24903bf7ec service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:32.472151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-692cbf70-7d3b-4775-8bd8-00fc1232a64a req-997a2a95-454c-498e-8671-5d24903bf7ec service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:32.476491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-692cbf70-7d3b-4775-8bd8-00fc1232a64a req-997a2a95-454c-498e-8671-5d24903bf7ec service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:32.557122 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-692cbf70-7d3b-4775-8bd8-00fc1232a64a req-997a2a95-454c-498e-8671-5d24903bf7ec service nova] Creating event network-vif-plugged:284a7f25-336e-4e74-af84-8dbd289b8b4a for instance 129cf12f-25b4-49e3-afc7-4d8640344201 on n-h2-858383-15 Oct 24 11:03:32.577189 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-692cbf70-7d3b-4775-8bd8-00fc1232a64a req-997a2a95-454c-498e-8671-5d24903bf7ec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168660 Oct 24 11:03:32.586020 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3180/6331] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:03:32.732642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-250bc2e4-99d4-43a4-a69b-0bb9d53e8353 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:32.747519 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-250bc2e4-99d4-43a4-a69b-0bb9d53e8353 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1367 microversion: 2.1 time: 0.447383 Oct 24 11:03:32.748480 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3152/6332] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:32 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1367 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:32.832991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9325b1bc-2e37-4cd2-8694-163c90d8f78c tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:32.833658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9325b1bc-2e37-4cd2-8694-163c90d8f78c tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:32.859770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9325b1bc-2e37-4cd2-8694-163c90d8f78c tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:32.860705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9325b1bc-2e37-4cd2-8694-163c90d8f78c tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:32.861188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9325b1bc-2e37-4cd2-8694-163c90d8f78c tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:32.861937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9325b1bc-2e37-4cd2-8694-163c90d8f78c tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:32.863497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9325b1bc-2e37-4cd2-8694-163c90d8f78c tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:32.864142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9325b1bc-2e37-4cd2-8694-163c90d8f78c tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:33.139910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9325b1bc-2e37-4cd2-8694-163c90d8f78c tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:33.157577 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9325b1bc-2e37-4cd2-8694-163c90d8f78c tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1269 microversion: 2.1 time: 0.332476 Oct 24 11:03:33.169975 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3181/6333] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:32 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1269 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:33.772577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad9eb164-83d6-4e20-b4c1-5aab71a71a3b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:33.775083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad9eb164-83d6-4e20-b4c1-5aab71a71a3b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:33.802064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad9eb164-83d6-4e20-b4c1-5aab71a71a3b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:33.803008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad9eb164-83d6-4e20-b4c1-5aab71a71a3b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:33.804582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad9eb164-83d6-4e20-b4c1-5aab71a71a3b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:33.807126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad9eb164-83d6-4e20-b4c1-5aab71a71a3b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:33.814549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad9eb164-83d6-4e20-b4c1-5aab71a71a3b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:33.815399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad9eb164-83d6-4e20-b4c1-5aab71a71a3b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:34.186004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-16721b32-3835-4d0e-afe5-c9c935e7e6dd tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:34.188141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-16721b32-3835-4d0e-afe5-c9c935e7e6dd tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:34.200657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16721b32-3835-4d0e-afe5-c9c935e7e6dd tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:34.203538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16721b32-3835-4d0e-afe5-c9c935e7e6dd tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:34.206396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16721b32-3835-4d0e-afe5-c9c935e7e6dd tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:34.209745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16721b32-3835-4d0e-afe5-c9c935e7e6dd tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:34.212317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16721b32-3835-4d0e-afe5-c9c935e7e6dd tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:34.213205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-16721b32-3835-4d0e-afe5-c9c935e7e6dd tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:34.229601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ad9eb164-83d6-4e20-b4c1-5aab71a71a3b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:34.254991 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad9eb164-83d6-4e20-b4c1-5aab71a71a3b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1367 microversion: 2.1 time: 0.487581 Oct 24 11:03:34.258388 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3153/6334] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:33 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:34.732059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-16721b32-3835-4d0e-afe5-c9c935e7e6dd tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:34.750051 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-16721b32-3835-4d0e-afe5-c9c935e7e6dd tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1269 microversion: 2.1 time: 0.569168 Oct 24 11:03:34.765663 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3182/6335] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:34 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1269 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:35.281870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b23f9cbe-192a-483e-8e13-41a0fb81f565 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:35.282492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b23f9cbe-192a-483e-8e13-41a0fb81f565 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:35.297414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b23f9cbe-192a-483e-8e13-41a0fb81f565 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:35.298171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b23f9cbe-192a-483e-8e13-41a0fb81f565 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:35.299797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b23f9cbe-192a-483e-8e13-41a0fb81f565 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:35.301400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b23f9cbe-192a-483e-8e13-41a0fb81f565 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:35.303891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b23f9cbe-192a-483e-8e13-41a0fb81f565 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:35.305351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b23f9cbe-192a-483e-8e13-41a0fb81f565 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:35.778529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c5dd0d4a-bd4d-4fa3-9c47-0bbd082321f1 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:35.779149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c5dd0d4a-bd4d-4fa3-9c47-0bbd082321f1 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:35.799935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5dd0d4a-bd4d-4fa3-9c47-0bbd082321f1 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:35.804614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5dd0d4a-bd4d-4fa3-9c47-0bbd082321f1 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:35.806644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5dd0d4a-bd4d-4fa3-9c47-0bbd082321f1 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:35.808205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5dd0d4a-bd4d-4fa3-9c47-0bbd082321f1 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:35.808855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5dd0d4a-bd4d-4fa3-9c47-0bbd082321f1 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:35.810376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5dd0d4a-bd4d-4fa3-9c47-0bbd082321f1 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:36.174187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b23f9cbe-192a-483e-8e13-41a0fb81f565 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:36.200661 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b23f9cbe-192a-483e-8e13-41a0fb81f565 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1557 microversion: 2.1 time: 0.918771 Oct 24 11:03:36.207572 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3154/6336] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:35 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1557 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:36.235383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-63061a1c-bf34-4130-aa16-51e1641c48bc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:36.236666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-63061a1c-bf34-4130-aa16-51e1641c48bc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:36.254458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63061a1c-bf34-4130-aa16-51e1641c48bc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:36.255008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63061a1c-bf34-4130-aa16-51e1641c48bc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:36.255457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63061a1c-bf34-4130-aa16-51e1641c48bc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:36.256358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63061a1c-bf34-4130-aa16-51e1641c48bc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:36.256820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63061a1c-bf34-4130-aa16-51e1641c48bc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:36.257269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63061a1c-bf34-4130-aa16-51e1641c48bc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:36.335687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c5dd0d4a-bd4d-4fa3-9c47-0bbd082321f1 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:36.355695 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c5dd0d4a-bd4d-4fa3-9c47-0bbd082321f1 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1269 microversion: 2.1 time: 0.582067 Oct 24 11:03:36.378722 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3183/6337] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:35 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1269 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:03:36.435005 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-63061a1c-bf34-4130-aa16-51e1641c48bc tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.204868 Oct 24 11:03:36.437352 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3155/6338] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 11:03:36 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-interface => generated 284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:03:37.386112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3586782d-007d-4852-8539-44d43aef81d3 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:37.394573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3586782d-007d-4852-8539-44d43aef81d3 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:37.410998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3586782d-007d-4852-8539-44d43aef81d3 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:37.428086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3586782d-007d-4852-8539-44d43aef81d3 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:37.429328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3586782d-007d-4852-8539-44d43aef81d3 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:37.430120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3586782d-007d-4852-8539-44d43aef81d3 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:37.430550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3586782d-007d-4852-8539-44d43aef81d3 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:37.430983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3586782d-007d-4852-8539-44d43aef81d3 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:37.834351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3586782d-007d-4852-8539-44d43aef81d3 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:37.850318 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3586782d-007d-4852-8539-44d43aef81d3 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1269 microversion: 2.1 time: 0.467801 Oct 24 11:03:37.877783 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3184/6339] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:37 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1269 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:38.612115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eac5f862-10cc-414c-8a73-4545032db736 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:38.614426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac5f862-10cc-414c-8a73-4545032db736 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:38.615097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac5f862-10cc-414c-8a73-4545032db736 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:38.615701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac5f862-10cc-414c-8a73-4545032db736 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:38.616614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac5f862-10cc-414c-8a73-4545032db736 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:38.622292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac5f862-10cc-414c-8a73-4545032db736 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:38.622995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eac5f862-10cc-414c-8a73-4545032db736 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:38.665997 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eac5f862-10cc-414c-8a73-4545032db736 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.265808 Oct 24 11:03:38.667533 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3156/6340] 10.222.0.50 () {58 vars in 1185 bytes} [Mon Oct 24 11:03:38 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:03:38.882829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0d0ad8ba-43a3-4f6e-b709-bc69674f03c0 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:38.883453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0d0ad8ba-43a3-4f6e-b709-bc69674f03c0 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:38.894414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e7c1db6f-0ef4-43a3-9a45-425790c36452 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-682118338", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "availability_zone": "nova:n-h1-858383-15", "networks": [{"uuid": "d050f181-07cc-46a8-9d21-788063376239"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:38.918482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d0ad8ba-43a3-4f6e-b709-bc69674f03c0 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:38.929163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d0ad8ba-43a3-4f6e-b709-bc69674f03c0 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:38.930365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d0ad8ba-43a3-4f6e-b709-bc69674f03c0 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:38.933546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d0ad8ba-43a3-4f6e-b709-bc69674f03c0 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:38.937928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d0ad8ba-43a3-4f6e-b709-bc69674f03c0 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:38.938591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0d0ad8ba-43a3-4f6e-b709-bc69674f03c0 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:39.054928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-e7c1db6f-0ef4-43a3-9a45-425790c36452 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] validate_networks() for [('d050f181-07cc-46a8-9d21-788063376239', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:03:39.334716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0d0ad8ba-43a3-4f6e-b709-bc69674f03c0 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:39.356753 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0d0ad8ba-43a3-4f6e-b709-bc69674f03c0 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1269 microversion: 2.1 time: 0.478901 Oct 24 11:03:39.365386 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3185/6341] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:38 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1269 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:39.370230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-420525cf-b2b2-465e-b80c-7e4f25ae67eb req-fc15057b-8864-440a-a62b-5b996d27acb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "129cf12f-25b4-49e3-afc7-4d8640344201", "tag": "284a7f25-336e-4e74-af84-8dbd289b8b4a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:39.414406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-420525cf-b2b2-465e-b80c-7e4f25ae67eb req-fc15057b-8864-440a-a62b-5b996d27acb4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:39.421678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-420525cf-b2b2-465e-b80c-7e4f25ae67eb req-fc15057b-8864-440a-a62b-5b996d27acb4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:39.422419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-420525cf-b2b2-465e-b80c-7e4f25ae67eb req-fc15057b-8864-440a-a62b-5b996d27acb4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:39.454002 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-420525cf-b2b2-465e-b80c-7e4f25ae67eb req-fc15057b-8864-440a-a62b-5b996d27acb4 service nova] Creating event network-changed:284a7f25-336e-4e74-af84-8dbd289b8b4a for instance 129cf12f-25b4-49e3-afc7-4d8640344201 on n-h2-858383-15 Oct 24 11:03:39.470171 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-420525cf-b2b2-465e-b80c-7e4f25ae67eb req-fc15057b-8864-440a-a62b-5b996d27acb4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103439 Oct 24 11:03:39.473021 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3186/6342] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:03:40.215207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e7c1db6f-0ef4-43a3-9a45-425790c36452 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:03:40.215785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e7c1db6f-0ef4-43a3-9a45-425790c36452 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:03:40.216123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e7c1db6f-0ef4-43a3-9a45-425790c36452 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:03:40.216545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e7c1db6f-0ef4-43a3-9a45-425790c36452 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:03:40.216994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e7c1db6f-0ef4-43a3-9a45-425790c36452 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:03:40.232638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7c1db6f-0ef4-43a3-9a45-425790c36452 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:40.233175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7c1db6f-0ef4-43a3-9a45-425790c36452 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:40.234158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7c1db6f-0ef4-43a3-9a45-425790c36452 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:40.239655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7c1db6f-0ef4-43a3-9a45-425790c36452 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:40.240403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7c1db6f-0ef4-43a3-9a45-425790c36452 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:40.246687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7c1db6f-0ef4-43a3-9a45-425790c36452 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:40.291163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-e7c1db6f-0ef4-43a3-9a45-425790c36452 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Getting quotas for project 4ed4c266f702486ebe44512d6259737f. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:03:40.333316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-e7c1db6f-0ef4-43a3-9a45-425790c36452 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Getting quotas for user e441204143604347b0c7fdf3a4b21e33 and project 4ed4c266f702486ebe44512d6259737f. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:03:40.352275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e7c1db6f-0ef4-43a3-9a45-425790c36452 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:03:40.354692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e7c1db6f-0ef4-43a3-9a45-425790c36452 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:03:40.395879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-246bb868-d703-44a1-9c4e-32ffd8ff9699 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:40.397855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-246bb868-d703-44a1-9c4e-32ffd8ff9699 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:40.441176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-246bb868-d703-44a1-9c4e-32ffd8ff9699 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:40.441684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-246bb868-d703-44a1-9c4e-32ffd8ff9699 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:40.442137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-246bb868-d703-44a1-9c4e-32ffd8ff9699 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:40.442864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-246bb868-d703-44a1-9c4e-32ffd8ff9699 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:40.443330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-246bb868-d703-44a1-9c4e-32ffd8ff9699 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:40.443763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-246bb868-d703-44a1-9c4e-32ffd8ff9699 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:40.497074 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e7c1db6f-0ef4-43a3-9a45-425790c36452 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.606647 Oct 24 11:03:40.497719 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3157/6343] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:03:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:03:40.520758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-04e257a1-b59f-46f9-a431-b2f2e9494857 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:40.521487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-04e257a1-b59f-46f9-a431-b2f2e9494857 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:40.659006 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-04e257a1-b59f-46f9-a431-b2f2e9494857 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1328 microversion: 2.1 time: 0.151302 Oct 24 11:03:40.670308 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3158/6344] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:40 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1328 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:03:41.658309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-246bb868-d703-44a1-9c4e-32ffd8ff9699 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:41.686768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:03:41.687010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5a49035d-e992-46a8-a2f7-a4757d2e7abd tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:41.687486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5a49035d-e992-46a8-a2f7-a4757d2e7abd tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:41.696418 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-246bb868-d703-44a1-9c4e-32ffd8ff9699 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1269 microversion: 2.1 time: 1.306937 Oct 24 11:03:41.701932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a49035d-e992-46a8-a2f7-a4757d2e7abd tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:41.703059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a49035d-e992-46a8-a2f7-a4757d2e7abd tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:41.703512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a49035d-e992-46a8-a2f7-a4757d2e7abd tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:41.704242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a49035d-e992-46a8-a2f7-a4757d2e7abd tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:41.704709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a49035d-e992-46a8-a2f7-a4757d2e7abd tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:41.705177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a49035d-e992-46a8-a2f7-a4757d2e7abd tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:41.723468 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3187/6345] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:40 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1269 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:41.981974 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5a49035d-e992-46a8-a2f7-a4757d2e7abd tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1345 microversion: 2.1 time: 0.298998 Oct 24 11:03:41.985653 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3159/6346] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:41 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1345 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:42.730167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9135d6dd-7f02-47a2-a9b6-7455f79ed34d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:42.731802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9135d6dd-7f02-47a2-a9b6-7455f79ed34d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:42.744050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9135d6dd-7f02-47a2-a9b6-7455f79ed34d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:42.744927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9135d6dd-7f02-47a2-a9b6-7455f79ed34d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:42.745539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9135d6dd-7f02-47a2-a9b6-7455f79ed34d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:42.746701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9135d6dd-7f02-47a2-a9b6-7455f79ed34d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:42.747374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9135d6dd-7f02-47a2-a9b6-7455f79ed34d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:42.748336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9135d6dd-7f02-47a2-a9b6-7455f79ed34d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:43.011541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f7716e32-c18d-4efa-9d27-118d3878c134 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:43.012172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f7716e32-c18d-4efa-9d27-118d3878c134 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:43.028465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7716e32-c18d-4efa-9d27-118d3878c134 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:43.035618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7716e32-c18d-4efa-9d27-118d3878c134 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:43.036292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7716e32-c18d-4efa-9d27-118d3878c134 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:43.042950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7716e32-c18d-4efa-9d27-118d3878c134 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:43.045404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7716e32-c18d-4efa-9d27-118d3878c134 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:43.050543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7716e32-c18d-4efa-9d27-118d3878c134 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:43.059158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9135d6dd-7f02-47a2-a9b6-7455f79ed34d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:43.070908 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9135d6dd-7f02-47a2-a9b6-7455f79ed34d tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1269 microversion: 2.1 time: 0.351079 Oct 24 11:03:43.072605 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3188/6347] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:42 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1269 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:43.187563 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f7716e32-c18d-4efa-9d27-118d3878c134 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1435 microversion: 2.1 time: 0.180292 Oct 24 11:03:43.189701 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3160/6348] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:43 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1435 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:44.105323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-568397ad-f2f8-475f-8bad-b55858b8c588 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:44.105959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-568397ad-f2f8-475f-8bad-b55858b8c588 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:44.116319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=51 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:03:44.123250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-568397ad-f2f8-475f-8bad-b55858b8c588 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:44.123751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-568397ad-f2f8-475f-8bad-b55858b8c588 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:44.124261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-568397ad-f2f8-475f-8bad-b55858b8c588 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:44.133706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-568397ad-f2f8-475f-8bad-b55858b8c588 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:44.135950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-568397ad-f2f8-475f-8bad-b55858b8c588 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:44.140330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-568397ad-f2f8-475f-8bad-b55858b8c588 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:44.213810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a99eecbc-e14f-46ac-a315-731690943a87 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:44.215045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a99eecbc-e14f-46ac-a315-731690943a87 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:44.235374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a99eecbc-e14f-46ac-a315-731690943a87 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:44.243029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a99eecbc-e14f-46ac-a315-731690943a87 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:44.246521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a99eecbc-e14f-46ac-a315-731690943a87 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:44.250667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a99eecbc-e14f-46ac-a315-731690943a87 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:44.254739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a99eecbc-e14f-46ac-a315-731690943a87 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:44.256189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a99eecbc-e14f-46ac-a315-731690943a87 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:44.669718 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a99eecbc-e14f-46ac-a315-731690943a87 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1465 microversion: 2.1 time: 0.455477 Oct 24 11:03:44.673260 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3161/6349] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:44 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1465 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:44.695761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-855de7c4-1608-4933-8556-cf71db0f94ef req-666a39ee-069d-49af-b722-cc47cdd7137a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f185ae20-51ff-406e-9717-78352a36f5cd", "name": "network-vif-plugged", "status": "completed", "tag": "8d629348-dc03-4347-b47b-90a89bd901c9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:44.727107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-855de7c4-1608-4933-8556-cf71db0f94ef req-666a39ee-069d-49af-b722-cc47cdd7137a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:44.727859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-855de7c4-1608-4933-8556-cf71db0f94ef req-666a39ee-069d-49af-b722-cc47cdd7137a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:44.728463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-855de7c4-1608-4933-8556-cf71db0f94ef req-666a39ee-069d-49af-b722-cc47cdd7137a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:44.754305 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-855de7c4-1608-4933-8556-cf71db0f94ef req-666a39ee-069d-49af-b722-cc47cdd7137a service nova] Creating event network-vif-plugged:8d629348-dc03-4347-b47b-90a89bd901c9 for instance f185ae20-51ff-406e-9717-78352a36f5cd on n-h1-858383-15 Oct 24 11:03:44.766329 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-855de7c4-1608-4933-8556-cf71db0f94ef req-666a39ee-069d-49af-b722-cc47cdd7137a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090139 Oct 24 11:03:44.766935 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3162/6350] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:03:44.767604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-568397ad-f2f8-475f-8bad-b55858b8c588 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:44.790911 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-568397ad-f2f8-475f-8bad-b55858b8c588 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1269 microversion: 2.1 time: 0.696286 Oct 24 11:03:44.797579 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3189/6351] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:44 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1269 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:45.223428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-30a5b999-bd67-47d9-bdbb-5070e867d6e4 req-7eddfd63-f46a-44c8-a7d6-a3c0ecf845e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a851375c-1059-435a-8c09-0ee8da9f723a", "tag": "067f4449-c8ff-489a-9c63-2fcf13cb82a0"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:45.247081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-30a5b999-bd67-47d9-bdbb-5070e867d6e4 req-7eddfd63-f46a-44c8-a7d6-a3c0ecf845e0 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:45.250348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-30a5b999-bd67-47d9-bdbb-5070e867d6e4 req-7eddfd63-f46a-44c8-a7d6-a3c0ecf845e0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:45.253299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-30a5b999-bd67-47d9-bdbb-5070e867d6e4 req-7eddfd63-f46a-44c8-a7d6-a3c0ecf845e0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:45.285643 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-30a5b999-bd67-47d9-bdbb-5070e867d6e4 req-7eddfd63-f46a-44c8-a7d6-a3c0ecf845e0 service nova] Creating event network-changed:067f4449-c8ff-489a-9c63-2fcf13cb82a0 for instance a851375c-1059-435a-8c09-0ee8da9f723a on n-h1-858383-15 Oct 24 11:03:45.291404 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-30a5b999-bd67-47d9-bdbb-5070e867d6e4 req-7eddfd63-f46a-44c8-a7d6-a3c0ecf845e0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072212 Oct 24 11:03:45.296122 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3163/6352] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:03:45.695516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-09abea61-6281-4635-a5a5-8209e0495e5e tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:45.697915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-09abea61-6281-4635-a5a5-8209e0495e5e tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:45.709726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09abea61-6281-4635-a5a5-8209e0495e5e tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:45.710582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09abea61-6281-4635-a5a5-8209e0495e5e tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:45.711247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09abea61-6281-4635-a5a5-8209e0495e5e tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:45.712301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09abea61-6281-4635-a5a5-8209e0495e5e tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:45.713009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09abea61-6281-4635-a5a5-8209e0495e5e tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:45.713650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09abea61-6281-4635-a5a5-8209e0495e5e tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:45.823292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09f460b3-ccdf-4244-9502-df63e57e94c5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:45.824305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09f460b3-ccdf-4244-9502-df63e57e94c5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:45.840683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09f460b3-ccdf-4244-9502-df63e57e94c5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:45.841630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09f460b3-ccdf-4244-9502-df63e57e94c5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:45.842237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09f460b3-ccdf-4244-9502-df63e57e94c5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:45.846956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09f460b3-ccdf-4244-9502-df63e57e94c5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:45.848107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09f460b3-ccdf-4244-9502-df63e57e94c5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:45.849024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09f460b3-ccdf-4244-9502-df63e57e94c5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:46.027810 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-09abea61-6281-4635-a5a5-8209e0495e5e tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1465 microversion: 2.1 time: 0.335922 Oct 24 11:03:46.035753 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3190/6353] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:45 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1465 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:46.151919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-09f460b3-ccdf-4244-9502-df63e57e94c5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:46.170121 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-09f460b3-ccdf-4244-9502-df63e57e94c5 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1269 microversion: 2.1 time: 0.351428 Oct 24 11:03:46.171282 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3164/6354] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:45 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1269 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:03:47.052011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e332403f-ce0f-400d-9971-9847315e0e48 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:47.052630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e332403f-ce0f-400d-9971-9847315e0e48 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:47.066055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e332403f-ce0f-400d-9971-9847315e0e48 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:47.078256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e332403f-ce0f-400d-9971-9847315e0e48 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:47.078984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e332403f-ce0f-400d-9971-9847315e0e48 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:47.079893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e332403f-ce0f-400d-9971-9847315e0e48 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:47.080513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e332403f-ce0f-400d-9971-9847315e0e48 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:47.081165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e332403f-ce0f-400d-9971-9847315e0e48 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:47.195629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7093b657-9f82-4ffe-80d3-d470f10f7983 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:47.196250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7093b657-9f82-4ffe-80d3-d470f10f7983 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:47.209947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7093b657-9f82-4ffe-80d3-d470f10f7983 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:47.214570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7093b657-9f82-4ffe-80d3-d470f10f7983 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:47.218849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7093b657-9f82-4ffe-80d3-d470f10f7983 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:47.219939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7093b657-9f82-4ffe-80d3-d470f10f7983 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:47.220580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7093b657-9f82-4ffe-80d3-d470f10f7983 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:47.223394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7093b657-9f82-4ffe-80d3-d470f10f7983 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:47.314691 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e332403f-ce0f-400d-9971-9847315e0e48 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1465 microversion: 2.1 time: 0.265662 Oct 24 11:03:47.335903 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3191/6355] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:47 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1465 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:47.509947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7093b657-9f82-4ffe-80d3-d470f10f7983 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:47.534537 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7093b657-9f82-4ffe-80d3-d470f10f7983 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1457 microversion: 2.1 time: 0.337660 Oct 24 11:03:47.537975 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3165/6356] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:47 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1457 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:47.562493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-99aa37b5-1460-480f-8060-b539b0849dac tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:47.563138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-99aa37b5-1460-480f-8060-b539b0849dac tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:47.570313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99aa37b5-1460-480f-8060-b539b0849dac tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:47.570808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99aa37b5-1460-480f-8060-b539b0849dac tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:47.571252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99aa37b5-1460-480f-8060-b539b0849dac tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:47.571984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99aa37b5-1460-480f-8060-b539b0849dac tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:47.572450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99aa37b5-1460-480f-8060-b539b0849dac tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:47.573014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99aa37b5-1460-480f-8060-b539b0849dac tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:47.783923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-99aa37b5-1460-480f-8060-b539b0849dac tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:03:47.794437 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-99aa37b5-1460-480f-8060-b539b0849dac tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1457 microversion: 2.1 time: 0.236505 Oct 24 11:03:47.813429 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3192/6357] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:47 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1457 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:48.348016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c81fd0a0-ff61-4839-a2f9-610141c3edc3 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:48.349382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c81fd0a0-ff61-4839-a2f9-610141c3edc3 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:48.361969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c81fd0a0-ff61-4839-a2f9-610141c3edc3 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:48.362472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c81fd0a0-ff61-4839-a2f9-610141c3edc3 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:48.362917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c81fd0a0-ff61-4839-a2f9-610141c3edc3 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:48.363672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c81fd0a0-ff61-4839-a2f9-610141c3edc3 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:48.364132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c81fd0a0-ff61-4839-a2f9-610141c3edc3 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:48.367398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c81fd0a0-ff61-4839-a2f9-610141c3edc3 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:48.607251 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c81fd0a0-ff61-4839-a2f9-610141c3edc3 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1465 microversion: 2.1 time: 0.262352 Oct 24 11:03:48.609907 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3166/6358] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:48 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1465 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:49.631320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b5ffda94-f0e9-4208-a7f1-ef6b2f23a2de tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:49.631982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b5ffda94-f0e9-4208-a7f1-ef6b2f23a2de tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:49.639871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5ffda94-f0e9-4208-a7f1-ef6b2f23a2de tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:49.640650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5ffda94-f0e9-4208-a7f1-ef6b2f23a2de tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:49.641140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5ffda94-f0e9-4208-a7f1-ef6b2f23a2de tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:49.641856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5ffda94-f0e9-4208-a7f1-ef6b2f23a2de tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:49.642313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5ffda94-f0e9-4208-a7f1-ef6b2f23a2de tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:49.642744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5ffda94-f0e9-4208-a7f1-ef6b2f23a2de tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:49.907687 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b5ffda94-f0e9-4208-a7f1-ef6b2f23a2de tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1465 microversion: 2.1 time: 0.270902 Oct 24 11:03:49.908781 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3193/6359] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:49 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1465 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:50.747883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ebf777e5-6475-49d6-a933-d95aa75dc3b6 req-40b68a53-fa44-418e-9920-17e39a48acfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f185ae20-51ff-406e-9717-78352a36f5cd", "tag": "8d629348-dc03-4347-b47b-90a89bd901c9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:50.795210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:03:50.799847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:03:50.805494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ebf777e5-6475-49d6-a933-d95aa75dc3b6 req-40b68a53-fa44-418e-9920-17e39a48acfe service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:50.806311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ebf777e5-6475-49d6-a933-d95aa75dc3b6 req-40b68a53-fa44-418e-9920-17e39a48acfe service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:50.806776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ebf777e5-6475-49d6-a933-d95aa75dc3b6 req-40b68a53-fa44-418e-9920-17e39a48acfe service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:50.824163 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ebf777e5-6475-49d6-a933-d95aa75dc3b6 req-40b68a53-fa44-418e-9920-17e39a48acfe service nova] Creating event network-changed:8d629348-dc03-4347-b47b-90a89bd901c9 for instance f185ae20-51ff-406e-9717-78352a36f5cd on n-h1-858383-15 Oct 24 11:03:50.834766 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ebf777e5-6475-49d6-a933-d95aa75dc3b6 req-40b68a53-fa44-418e-9920-17e39a48acfe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094291 Oct 24 11:03:50.835397 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3167/6360] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:03:50.936188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d82aa1c1-d895-4fe7-b155-1fbea02afb2f tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:50.937168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d82aa1c1-d895-4fe7-b155-1fbea02afb2f tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:50.949532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d82aa1c1-d895-4fe7-b155-1fbea02afb2f tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:50.950027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d82aa1c1-d895-4fe7-b155-1fbea02afb2f tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:50.950464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d82aa1c1-d895-4fe7-b155-1fbea02afb2f tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:50.957064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d82aa1c1-d895-4fe7-b155-1fbea02afb2f tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:50.958054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d82aa1c1-d895-4fe7-b155-1fbea02afb2f tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:50.959476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d82aa1c1-d895-4fe7-b155-1fbea02afb2f tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:51.522934 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d82aa1c1-d895-4fe7-b155-1fbea02afb2f tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1465 microversion: 2.1 time: 0.591412 Oct 24 11:03:51.523542 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3194/6361] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:50 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1465 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:52.549190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2fe82764-a1d8-48fb-b4c7-c2db4c2bcf57 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:52.549961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2fe82764-a1d8-48fb-b4c7-c2db4c2bcf57 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:52.564627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fe82764-a1d8-48fb-b4c7-c2db4c2bcf57 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:52.572947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fe82764-a1d8-48fb-b4c7-c2db4c2bcf57 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:52.573590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fe82764-a1d8-48fb-b4c7-c2db4c2bcf57 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:52.574370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fe82764-a1d8-48fb-b4c7-c2db4c2bcf57 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:52.574846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fe82764-a1d8-48fb-b4c7-c2db4c2bcf57 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:52.575278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2fe82764-a1d8-48fb-b4c7-c2db4c2bcf57 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:52.877584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-87377845-acba-4539-9f14-724bde90d850 req-c717faf2-0719-4ad9-b74a-d17d820a277c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f185ae20-51ff-406e-9717-78352a36f5cd", "tag": "8d629348-dc03-4347-b47b-90a89bd901c9"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:52.894498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-87377845-acba-4539-9f14-724bde90d850 req-c717faf2-0719-4ad9-b74a-d17d820a277c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:52.894984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-87377845-acba-4539-9f14-724bde90d850 req-c717faf2-0719-4ad9-b74a-d17d820a277c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:52.895414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-87377845-acba-4539-9f14-724bde90d850 req-c717faf2-0719-4ad9-b74a-d17d820a277c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:52.925129 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-87377845-acba-4539-9f14-724bde90d850 req-c717faf2-0719-4ad9-b74a-d17d820a277c service nova] Creating event network-changed:8d629348-dc03-4347-b47b-90a89bd901c9 for instance f185ae20-51ff-406e-9717-78352a36f5cd on n-h1-858383-15 Oct 24 11:03:52.944139 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-87377845-acba-4539-9f14-724bde90d850 req-c717faf2-0719-4ad9-b74a-d17d820a277c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070442 Oct 24 11:03:52.948670 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3195/6362] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:03:52.974147 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2fe82764-a1d8-48fb-b4c7-c2db4c2bcf57 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1465 microversion: 2.1 time: 0.429655 Oct 24 11:03:52.985388 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3168/6363] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:52 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1465 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:53.998145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ae5a0233-ec0e-42ac-988b-685ae6b82577 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:53.998848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ae5a0233-ec0e-42ac-988b-685ae6b82577 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:54.005728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae5a0233-ec0e-42ac-988b-685ae6b82577 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:54.006620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae5a0233-ec0e-42ac-988b-685ae6b82577 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:54.007279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae5a0233-ec0e-42ac-988b-685ae6b82577 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:54.008521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae5a0233-ec0e-42ac-988b-685ae6b82577 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:54.009067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae5a0233-ec0e-42ac-988b-685ae6b82577 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:54.009739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ae5a0233-ec0e-42ac-988b-685ae6b82577 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:54.163382 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ae5a0233-ec0e-42ac-988b-685ae6b82577 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1465 microversion: 2.1 time: 0.170077 Oct 24 11:03:54.163963 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3196/6364] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:53 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1465 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:54.585573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e5515bec-5597-4041-bafa-db733ed8ddf1 req-94e1bc5d-bac4-4097-ab1d-b74cc1ac8594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a851375c-1059-435a-8c09-0ee8da9f723a", "name": "network-vif-plugged", "status": "completed", "tag": "067f4449-c8ff-489a-9c63-2fcf13cb82a0"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:54.598701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e5515bec-5597-4041-bafa-db733ed8ddf1 req-94e1bc5d-bac4-4097-ab1d-b74cc1ac8594 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:54.599488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e5515bec-5597-4041-bafa-db733ed8ddf1 req-94e1bc5d-bac4-4097-ab1d-b74cc1ac8594 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:54.600148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e5515bec-5597-4041-bafa-db733ed8ddf1 req-94e1bc5d-bac4-4097-ab1d-b74cc1ac8594 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:54.618133 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e5515bec-5597-4041-bafa-db733ed8ddf1 req-94e1bc5d-bac4-4097-ab1d-b74cc1ac8594 service nova] Creating event network-vif-plugged:067f4449-c8ff-489a-9c63-2fcf13cb82a0 for instance a851375c-1059-435a-8c09-0ee8da9f723a on n-h1-858383-15 Oct 24 11:03:54.623480 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e5515bec-5597-4041-bafa-db733ed8ddf1 req-94e1bc5d-bac4-4097-ab1d-b74cc1ac8594 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041653 Oct 24 11:03:54.625057 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3169/6365] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:03:54.966559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-7832fa8b-fbf6-4124-9018-1c9c298c800f req-a37d82e7-afa9-43c9-aefd-f7ce59ae12ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f185ae20-51ff-406e-9717-78352a36f5cd", "tag": "8d629348-dc03-4347-b47b-90a89bd901c9"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:54.978627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7832fa8b-fbf6-4124-9018-1c9c298c800f req-a37d82e7-afa9-43c9-aefd-f7ce59ae12ba service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:54.979123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7832fa8b-fbf6-4124-9018-1c9c298c800f req-a37d82e7-afa9-43c9-aefd-f7ce59ae12ba service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:54.979560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7832fa8b-fbf6-4124-9018-1c9c298c800f req-a37d82e7-afa9-43c9-aefd-f7ce59ae12ba service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:54.991701 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-7832fa8b-fbf6-4124-9018-1c9c298c800f req-a37d82e7-afa9-43c9-aefd-f7ce59ae12ba service nova] Creating event network-changed:8d629348-dc03-4347-b47b-90a89bd901c9 for instance f185ae20-51ff-406e-9717-78352a36f5cd on n-h1-858383-15 Oct 24 11:03:54.998666 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-7832fa8b-fbf6-4124-9018-1c9c298c800f req-a37d82e7-afa9-43c9-aefd-f7ce59ae12ba service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035733 Oct 24 11:03:55.000272 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3197/6366] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:03:55.191650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3a7c47b1-a66a-4d65-8576-367a835eb0ab tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:55.192429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3a7c47b1-a66a-4d65-8576-367a835eb0ab tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:55.199654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a7c47b1-a66a-4d65-8576-367a835eb0ab tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:55.200406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a7c47b1-a66a-4d65-8576-367a835eb0ab tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:55.201207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a7c47b1-a66a-4d65-8576-367a835eb0ab tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:55.202163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a7c47b1-a66a-4d65-8576-367a835eb0ab tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:55.203814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a7c47b1-a66a-4d65-8576-367a835eb0ab tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:55.204435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a7c47b1-a66a-4d65-8576-367a835eb0ab tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:55.350982 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3a7c47b1-a66a-4d65-8576-367a835eb0ab tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1465 microversion: 2.1 time: 0.167610 Oct 24 11:03:55.351575 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3170/6367] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:55 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1465 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:56.377750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6c660ca1-cc09-49c6-8c26-3db1d3d27157 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:56.378412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6c660ca1-cc09-49c6-8c26-3db1d3d27157 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:56.386023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c660ca1-cc09-49c6-8c26-3db1d3d27157 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:56.386521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c660ca1-cc09-49c6-8c26-3db1d3d27157 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:56.386958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c660ca1-cc09-49c6-8c26-3db1d3d27157 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:56.387661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c660ca1-cc09-49c6-8c26-3db1d3d27157 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:56.388298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c660ca1-cc09-49c6-8c26-3db1d3d27157 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:56.388916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c660ca1-cc09-49c6-8c26-3db1d3d27157 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:56.555626 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6c660ca1-cc09-49c6-8c26-3db1d3d27157 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1650 microversion: 2.1 time: 0.183807 Oct 24 11:03:56.556219 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3198/6368] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:56 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1650 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:56.578200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-120d7476-f917-4982-802f-942c3d74a060 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:56.578819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-120d7476-f917-4982-802f-942c3d74a060 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:56.586022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-120d7476-f917-4982-802f-942c3d74a060 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:56.586519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-120d7476-f917-4982-802f-942c3d74a060 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:56.586957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-120d7476-f917-4982-802f-942c3d74a060 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:56.587663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-120d7476-f917-4982-802f-942c3d74a060 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:56.588114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-120d7476-f917-4982-802f-942c3d74a060 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:56.588534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-120d7476-f917-4982-802f-942c3d74a060 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:56.730729 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-120d7476-f917-4982-802f-942c3d74a060 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1650 microversion: 2.1 time: 0.156501 Oct 24 11:03:56.731325 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3171/6369] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:56 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1650 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:56.752428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7243f10c-9240-451c-912c-538f64cecb57 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:56.753351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7243f10c-9240-451c-912c-538f64cecb57 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:56.760759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7243f10c-9240-451c-912c-538f64cecb57 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:56.761309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7243f10c-9240-451c-912c-538f64cecb57 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:56.761816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7243f10c-9240-451c-912c-538f64cecb57 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:56.762526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7243f10c-9240-451c-912c-538f64cecb57 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:56.763192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7243f10c-9240-451c-912c-538f64cecb57 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:56.763630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7243f10c-9240-451c-912c-538f64cecb57 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:56.911525 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7243f10c-9240-451c-912c-538f64cecb57 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1650 microversion: 2.1 time: 0.162778 Oct 24 11:03:56.912150 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3199/6370] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:56 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1650 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:03:56.987019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-403614b3-65c2-491d-b11d-4bf8bdd73817 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1815143635", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "availability_zone": "nova:n-h2-858383-15", "networks": [{"uuid": "d050f181-07cc-46a8-9d21-788063376239"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:03:57.144630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-403614b3-65c2-491d-b11d-4bf8bdd73817 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] validate_networks() for [('d050f181-07cc-46a8-9d21-788063376239', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:03:57.961699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-403614b3-65c2-491d-b11d-4bf8bdd73817 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:03:57.962259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-403614b3-65c2-491d-b11d-4bf8bdd73817 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:03:57.962588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-403614b3-65c2-491d-b11d-4bf8bdd73817 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:03:57.963509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-403614b3-65c2-491d-b11d-4bf8bdd73817 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:03:57.964095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-403614b3-65c2-491d-b11d-4bf8bdd73817 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:03:57.974922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-403614b3-65c2-491d-b11d-4bf8bdd73817 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:57.975493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-403614b3-65c2-491d-b11d-4bf8bdd73817 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:57.975881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-403614b3-65c2-491d-b11d-4bf8bdd73817 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:57.976592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-403614b3-65c2-491d-b11d-4bf8bdd73817 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:57.977216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-403614b3-65c2-491d-b11d-4bf8bdd73817 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:57.977500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-403614b3-65c2-491d-b11d-4bf8bdd73817 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:57.996145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-403614b3-65c2-491d-b11d-4bf8bdd73817 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Getting quotas for project 4ed4c266f702486ebe44512d6259737f. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:03:58.002286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-403614b3-65c2-491d-b11d-4bf8bdd73817 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Getting quotas for user e441204143604347b0c7fdf3a4b21e33 and project 4ed4c266f702486ebe44512d6259737f. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:03:58.015416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-403614b3-65c2-491d-b11d-4bf8bdd73817 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:03:58.018282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-403614b3-65c2-491d-b11d-4bf8bdd73817 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: e3d370f1-3a66-4779-aa52-2a41e77806a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:03:58.099068 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-403614b3-65c2-491d-b11d-4bf8bdd73817 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.119999 Oct 24 11:03:58.099805 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3172/6371] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:03:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:03:58.112772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d417fadd-0d08-42e1-b992-70c1c885d96e tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:58.114851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d417fadd-0d08-42e1-b992-70c1c885d96e tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: e3d370f1-3a66-4779-aa52-2a41e77806a5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:58.209318 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d417fadd-0d08-42e1-b992-70c1c885d96e tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5" status: 200 len: 1329 microversion: 2.1 time: 0.099363 Oct 24 11:03:58.209950 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3200/6372] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:58 2022] GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5 => generated 1329 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:03:59.235030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab0c8cea-37fc-4018-893b-8bd47e967f06 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:03:59.235656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ab0c8cea-37fc-4018-893b-8bd47e967f06 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: e3d370f1-3a66-4779-aa52-2a41e77806a5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:03:59.241990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab0c8cea-37fc-4018-893b-8bd47e967f06 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:59.242701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab0c8cea-37fc-4018-893b-8bd47e967f06 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:59.243325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab0c8cea-37fc-4018-893b-8bd47e967f06 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:59.244024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab0c8cea-37fc-4018-893b-8bd47e967f06 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:03:59.244515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab0c8cea-37fc-4018-893b-8bd47e967f06 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:03:59.244966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab0c8cea-37fc-4018-893b-8bd47e967f06 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:03:59.343790 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ab0c8cea-37fc-4018-893b-8bd47e967f06 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5" status: 200 len: 1418 microversion: 2.1 time: 0.113217 Oct 24 11:03:59.344493 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3173/6373] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:03:59 2022] GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5 => generated 1418 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:00.368797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c1d0a77f-2149-482c-aad0-ad695051ce27 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:00.370035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c1d0a77f-2149-482c-aad0-ad695051ce27 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: e3d370f1-3a66-4779-aa52-2a41e77806a5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:00.406406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1d0a77f-2149-482c-aad0-ad695051ce27 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:00.406960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1d0a77f-2149-482c-aad0-ad695051ce27 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:00.407418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1d0a77f-2149-482c-aad0-ad695051ce27 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:00.408239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1d0a77f-2149-482c-aad0-ad695051ce27 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:00.417733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1d0a77f-2149-482c-aad0-ad695051ce27 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:00.418393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c1d0a77f-2149-482c-aad0-ad695051ce27 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:00.586896 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c1d0a77f-2149-482c-aad0-ad695051ce27 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5" status: 200 len: 1466 microversion: 2.1 time: 0.222325 Oct 24 11:04:00.600882 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3201/6374] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:00 2022] GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5 => generated 1466 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:01.079227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-9b1854dd-c307-4684-9236-22da67512a9b req-cb481c11-07a6-46c8-b455-3c24ee183a79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3d370f1-3a66-4779-aa52-2a41e77806a5", "tag": "3ab4d13f-b048-443d-af9c-0bcc82660bd8"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:01.090459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:04:01.093220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9b1854dd-c307-4684-9236-22da67512a9b req-cb481c11-07a6-46c8-b455-3c24ee183a79 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:01.093937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9b1854dd-c307-4684-9236-22da67512a9b req-cb481c11-07a6-46c8-b455-3c24ee183a79 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:01.094477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9b1854dd-c307-4684-9236-22da67512a9b req-cb481c11-07a6-46c8-b455-3c24ee183a79 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:01.110479 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-9b1854dd-c307-4684-9236-22da67512a9b req-cb481c11-07a6-46c8-b455-3c24ee183a79 service nova] Creating event network-changed:3ab4d13f-b048-443d-af9c-0bcc82660bd8 for instance e3d370f1-3a66-4779-aa52-2a41e77806a5 on n-h2-858383-15 Oct 24 11:04:01.122131 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-9b1854dd-c307-4684-9236-22da67512a9b req-cb481c11-07a6-46c8-b455-3c24ee183a79 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047439 Oct 24 11:04:01.123622 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3174/6375] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:04:01.611627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-77825e88-1a7b-47fe-8468-30b5ad8971ef tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:01.612824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-77825e88-1a7b-47fe-8468-30b5ad8971ef tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: e3d370f1-3a66-4779-aa52-2a41e77806a5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:01.620725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77825e88-1a7b-47fe-8468-30b5ad8971ef tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:01.621558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77825e88-1a7b-47fe-8468-30b5ad8971ef tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:01.622030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77825e88-1a7b-47fe-8468-30b5ad8971ef tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:01.622880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77825e88-1a7b-47fe-8468-30b5ad8971ef tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:01.623713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77825e88-1a7b-47fe-8468-30b5ad8971ef tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:01.624661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77825e88-1a7b-47fe-8468-30b5ad8971ef tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:01.778179 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-77825e88-1a7b-47fe-8468-30b5ad8971ef tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5" status: 200 len: 1466 microversion: 2.1 time: 0.170300 Oct 24 11:04:01.779163 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3202/6376] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:01 2022] GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5 => generated 1466 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:02.091704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e6ebbeb8-481e-48ad-9aaf-e9d407cddb5c tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-4578014", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:02.149174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-e6ebbeb8-481e-48ad-9aaf-e9d407cddb5c tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] validate_networks() for None {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:04:02.435142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e6ebbeb8-481e-48ad-9aaf-e9d407cddb5c tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:04:02.435578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e6ebbeb8-481e-48ad-9aaf-e9d407cddb5c tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:04:02.436089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e6ebbeb8-481e-48ad-9aaf-e9d407cddb5c tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:04:02.437043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e6ebbeb8-481e-48ad-9aaf-e9d407cddb5c tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:04:02.437465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e6ebbeb8-481e-48ad-9aaf-e9d407cddb5c tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:04:02.447073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6ebbeb8-481e-48ad-9aaf-e9d407cddb5c tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:02.447558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6ebbeb8-481e-48ad-9aaf-e9d407cddb5c tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:02.447997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6ebbeb8-481e-48ad-9aaf-e9d407cddb5c tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:02.448728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6ebbeb8-481e-48ad-9aaf-e9d407cddb5c tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:02.449213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6ebbeb8-481e-48ad-9aaf-e9d407cddb5c tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:02.449641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6ebbeb8-481e-48ad-9aaf-e9d407cddb5c tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:02.458522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:04:02.470946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-e6ebbeb8-481e-48ad-9aaf-e9d407cddb5c tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Getting quotas for project ca94fa33c46c404190805fb219d3881a. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:04:02.476408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-e6ebbeb8-481e-48ad-9aaf-e9d407cddb5c tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Getting quotas for user 2367bc74d6ff47cc9cdc503df1e1448d and project ca94fa33c46c404190805fb219d3881a. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:04:02.489124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e6ebbeb8-481e-48ad-9aaf-e9d407cddb5c tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:04:02.491708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e6ebbeb8-481e-48ad-9aaf-e9d407cddb5c tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:04:02.540111 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e6ebbeb8-481e-48ad-9aaf-e9d407cddb5c tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.452269 Oct 24 11:04:02.541072 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3175/6377] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:04:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:04:02.552466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d0761576-ee93-4e4a-b352-411fe470dc0d tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:02.553319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d0761576-ee93-4e4a-b352-411fe470dc0d tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:02.620433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d0761576-ee93-4e4a-b352-411fe470dc0d tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367bc74d6ff47cc9cdc503df1e1448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca94fa33c46c404190805fb219d3881a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:02.631719 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d0761576-ee93-4e4a-b352-411fe470dc0d tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd" status: 200 len: 1211 microversion: 2.1 time: 0.083117 Oct 24 11:04:02.632352 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3203/6378] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:02 2022] GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:02.803163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1fbdf684-88c9-4d4c-81fa-1f5c25529878 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:02.804153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1fbdf684-88c9-4d4c-81fa-1f5c25529878 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: e3d370f1-3a66-4779-aa52-2a41e77806a5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:02.811628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fbdf684-88c9-4d4c-81fa-1f5c25529878 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:02.813131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fbdf684-88c9-4d4c-81fa-1f5c25529878 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:02.813874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fbdf684-88c9-4d4c-81fa-1f5c25529878 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:02.814948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fbdf684-88c9-4d4c-81fa-1f5c25529878 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:02.815737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fbdf684-88c9-4d4c-81fa-1f5c25529878 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:02.816396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1fbdf684-88c9-4d4c-81fa-1f5c25529878 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:03.025880 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1fbdf684-88c9-4d4c-81fa-1f5c25529878 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5" status: 200 len: 1466 microversion: 2.1 time: 0.226517 Oct 24 11:04:03.026931 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3176/6379] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:02 2022] GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5 => generated 1466 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:03.656596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d381311e-b5f1-4c25-b4df-6390d8c9af73 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:03.657721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d381311e-b5f1-4c25-b4df-6390d8c9af73 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:03.667073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d381311e-b5f1-4c25-b4df-6390d8c9af73 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:03.667800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d381311e-b5f1-4c25-b4df-6390d8c9af73 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:03.668856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d381311e-b5f1-4c25-b4df-6390d8c9af73 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:03.669903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d381311e-b5f1-4c25-b4df-6390d8c9af73 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:03.671880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d381311e-b5f1-4c25-b4df-6390d8c9af73 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:03.672352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d381311e-b5f1-4c25-b4df-6390d8c9af73 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:03.740758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d381311e-b5f1-4c25-b4df-6390d8c9af73 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367bc74d6ff47cc9cdc503df1e1448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca94fa33c46c404190805fb219d3881a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:03.752698 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d381311e-b5f1-4c25-b4df-6390d8c9af73 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd" status: 200 len: 1263 microversion: 2.1 time: 0.100514 Oct 24 11:04:03.753397 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3204/6380] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:03 2022] GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd => generated 1263 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:04.053158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad37c5a8-c895-4c83-8122-4a87726f2db6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:04.053846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad37c5a8-c895-4c83-8122-4a87726f2db6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: e3d370f1-3a66-4779-aa52-2a41e77806a5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:04.068248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad37c5a8-c895-4c83-8122-4a87726f2db6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:04.071186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad37c5a8-c895-4c83-8122-4a87726f2db6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:04.071678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad37c5a8-c895-4c83-8122-4a87726f2db6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:04.072395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad37c5a8-c895-4c83-8122-4a87726f2db6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:04.074770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad37c5a8-c895-4c83-8122-4a87726f2db6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:04.075279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad37c5a8-c895-4c83-8122-4a87726f2db6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:04.316266 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad37c5a8-c895-4c83-8122-4a87726f2db6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5" status: 200 len: 1466 microversion: 2.1 time: 0.266903 Oct 24 11:04:04.319138 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3177/6381] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:04 2022] GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5 => generated 1466 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:04.782869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0c26770b-0a55-47fc-b281-abb672cba739 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:04.784393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0c26770b-0a55-47fc-b281-abb672cba739 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:04.795450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c26770b-0a55-47fc-b281-abb672cba739 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:04.797761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c26770b-0a55-47fc-b281-abb672cba739 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:04.798414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c26770b-0a55-47fc-b281-abb672cba739 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:04.799396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c26770b-0a55-47fc-b281-abb672cba739 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:04.800113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c26770b-0a55-47fc-b281-abb672cba739 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:04.800797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0c26770b-0a55-47fc-b281-abb672cba739 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:04.932097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0c26770b-0a55-47fc-b281-abb672cba739 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367bc74d6ff47cc9cdc503df1e1448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca94fa33c46c404190805fb219d3881a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:04.955824 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0c26770b-0a55-47fc-b281-abb672cba739 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd" status: 200 len: 1269 microversion: 2.1 time: 0.182503 Oct 24 11:04:04.956439 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3205/6382] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:04 2022] GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd => generated 1269 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:05.346689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f8b81907-44fc-4965-8abf-0391db172cf5 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:05.347425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f8b81907-44fc-4965-8abf-0391db172cf5 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: e3d370f1-3a66-4779-aa52-2a41e77806a5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:05.362288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8b81907-44fc-4965-8abf-0391db172cf5 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:05.363201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8b81907-44fc-4965-8abf-0391db172cf5 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:05.364348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8b81907-44fc-4965-8abf-0391db172cf5 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:05.365384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8b81907-44fc-4965-8abf-0391db172cf5 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:05.366083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8b81907-44fc-4965-8abf-0391db172cf5 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:05.366738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f8b81907-44fc-4965-8abf-0391db172cf5 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:05.454660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-4a221623-30e1-42b5-87cd-7389da110746 req-3474d803-be9a-4599-a447-3ab8ee9c9d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3d370f1-3a66-4779-aa52-2a41e77806a5", "name": "network-vif-plugged", "status": "completed", "tag": "3ab4d13f-b048-443d-af9c-0bcc82660bd8"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:05.475534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4a221623-30e1-42b5-87cd-7389da110746 req-3474d803-be9a-4599-a447-3ab8ee9c9d5b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:05.476279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4a221623-30e1-42b5-87cd-7389da110746 req-3474d803-be9a-4599-a447-3ab8ee9c9d5b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:05.476720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4a221623-30e1-42b5-87cd-7389da110746 req-3474d803-be9a-4599-a447-3ab8ee9c9d5b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:05.501049 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-4a221623-30e1-42b5-87cd-7389da110746 req-3474d803-be9a-4599-a447-3ab8ee9c9d5b service nova] Creating event network-vif-plugged:3ab4d13f-b048-443d-af9c-0bcc82660bd8 for instance e3d370f1-3a66-4779-aa52-2a41e77806a5 on n-h2-858383-15 Oct 24 11:04:05.515932 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-4a221623-30e1-42b5-87cd-7389da110746 req-3474d803-be9a-4599-a447-3ab8ee9c9d5b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064876 Oct 24 11:04:05.522118 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3206/6383] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:04:05.572016 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f8b81907-44fc-4965-8abf-0391db172cf5 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5" status: 200 len: 1466 microversion: 2.1 time: 0.230188 Oct 24 11:04:05.597143 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3178/6384] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:05 2022] GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5 => generated 1466 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:05.981634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4dbb15a7-187c-4163-8da5-36187350a4ff tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:05.982293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4dbb15a7-187c-4163-8da5-36187350a4ff tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:05.990999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4dbb15a7-187c-4163-8da5-36187350a4ff tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:05.991674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4dbb15a7-187c-4163-8da5-36187350a4ff tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:05.992298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4dbb15a7-187c-4163-8da5-36187350a4ff tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:05.993214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4dbb15a7-187c-4163-8da5-36187350a4ff tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:05.994007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4dbb15a7-187c-4163-8da5-36187350a4ff tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:05.994766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4dbb15a7-187c-4163-8da5-36187350a4ff tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:06.178015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4dbb15a7-187c-4163-8da5-36187350a4ff tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367bc74d6ff47cc9cdc503df1e1448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca94fa33c46c404190805fb219d3881a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:06.185851 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4dbb15a7-187c-4163-8da5-36187350a4ff tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd" status: 200 len: 1311 microversion: 2.1 time: 0.209124 Oct 24 11:04:06.201461 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3207/6385] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:05 2022] GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd => generated 1311 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:06.360088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-6d0b3073-e0c1-4675-963c-396204dde965 req-c7451ca8-96af-455b-9a35-7c107e4abb99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0afbaab5-70da-4f20-979f-79a69b8648bd", "tag": "4dfda9ef-db1b-41e5-b430-f6a70b435d91"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:06.376125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6d0b3073-e0c1-4675-963c-396204dde965 req-c7451ca8-96af-455b-9a35-7c107e4abb99 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:06.376989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6d0b3073-e0c1-4675-963c-396204dde965 req-c7451ca8-96af-455b-9a35-7c107e4abb99 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:06.377660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6d0b3073-e0c1-4675-963c-396204dde965 req-c7451ca8-96af-455b-9a35-7c107e4abb99 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:06.390901 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-6d0b3073-e0c1-4675-963c-396204dde965 req-c7451ca8-96af-455b-9a35-7c107e4abb99 service nova] Creating event network-changed:4dfda9ef-db1b-41e5-b430-f6a70b435d91 for instance 0afbaab5-70da-4f20-979f-79a69b8648bd on n-h1-858383-15 Oct 24 11:04:06.398168 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-6d0b3073-e0c1-4675-963c-396204dde965 req-c7451ca8-96af-455b-9a35-7c107e4abb99 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042243 Oct 24 11:04:06.399184 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3179/6386] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:04:06.603481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e0599f4b-8d48-49c3-8c75-aba215dbd89b tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:06.604409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e0599f4b-8d48-49c3-8c75-aba215dbd89b tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: e3d370f1-3a66-4779-aa52-2a41e77806a5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:06.611596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0599f4b-8d48-49c3-8c75-aba215dbd89b tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:06.612103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0599f4b-8d48-49c3-8c75-aba215dbd89b tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:06.612554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0599f4b-8d48-49c3-8c75-aba215dbd89b tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:06.613465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0599f4b-8d48-49c3-8c75-aba215dbd89b tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:06.614088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0599f4b-8d48-49c3-8c75-aba215dbd89b tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:06.614513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0599f4b-8d48-49c3-8c75-aba215dbd89b tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:06.633143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:04:06.766119 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e0599f4b-8d48-49c3-8c75-aba215dbd89b tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5" status: 200 len: 1466 microversion: 2.1 time: 0.166251 Oct 24 11:04:06.769595 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3208/6387] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:06 2022] GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5 => generated 1466 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:07.210061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d882ece1-1dcc-4ef2-a741-569f6fe62f10 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:07.210758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d882ece1-1dcc-4ef2-a741-569f6fe62f10 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:07.217545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d882ece1-1dcc-4ef2-a741-569f6fe62f10 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:07.218029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d882ece1-1dcc-4ef2-a741-569f6fe62f10 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:07.218493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d882ece1-1dcc-4ef2-a741-569f6fe62f10 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:07.219249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d882ece1-1dcc-4ef2-a741-569f6fe62f10 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:07.219704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d882ece1-1dcc-4ef2-a741-569f6fe62f10 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:07.220126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d882ece1-1dcc-4ef2-a741-569f6fe62f10 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:07.391586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d882ece1-1dcc-4ef2-a741-569f6fe62f10 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367bc74d6ff47cc9cdc503df1e1448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca94fa33c46c404190805fb219d3881a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:07.401331 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d882ece1-1dcc-4ef2-a741-569f6fe62f10 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd" status: 200 len: 1311 microversion: 2.1 time: 0.195493 Oct 24 11:04:07.401964 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3180/6388] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:07 2022] GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd => generated 1311 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:07.789619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9cb90795-fa8e-4ddc-9e4e-c28d8c0acc12 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:07.790238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9cb90795-fa8e-4ddc-9e4e-c28d8c0acc12 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: e3d370f1-3a66-4779-aa52-2a41e77806a5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:07.797291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cb90795-fa8e-4ddc-9e4e-c28d8c0acc12 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:07.797773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cb90795-fa8e-4ddc-9e4e-c28d8c0acc12 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:07.798267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cb90795-fa8e-4ddc-9e4e-c28d8c0acc12 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:07.798901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cb90795-fa8e-4ddc-9e4e-c28d8c0acc12 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:07.799352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cb90795-fa8e-4ddc-9e4e-c28d8c0acc12 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:07.799777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cb90795-fa8e-4ddc-9e4e-c28d8c0acc12 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:08.238705 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9cb90795-fa8e-4ddc-9e4e-c28d8c0acc12 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5" status: 200 len: 1652 microversion: 2.1 time: 0.451833 Oct 24 11:04:08.239668 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3209/6389] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:07 2022] GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5 => generated 1652 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:08.269568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c252e12-24cc-4318-ac7b-6ea809f13f3a tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:08.271434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4c252e12-24cc-4318-ac7b-6ea809f13f3a tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: e3d370f1-3a66-4779-aa52-2a41e77806a5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:08.280205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c252e12-24cc-4318-ac7b-6ea809f13f3a tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:08.282189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c252e12-24cc-4318-ac7b-6ea809f13f3a tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:08.283330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c252e12-24cc-4318-ac7b-6ea809f13f3a tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:08.284360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c252e12-24cc-4318-ac7b-6ea809f13f3a tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:08.285148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c252e12-24cc-4318-ac7b-6ea809f13f3a tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:08.285931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c252e12-24cc-4318-ac7b-6ea809f13f3a tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:08.426386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-86f4bdad-20eb-40f1-865b-91de21cd9ce6 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:08.427287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-86f4bdad-20eb-40f1-865b-91de21cd9ce6 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:08.434366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-86f4bdad-20eb-40f1-865b-91de21cd9ce6 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:08.435393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-86f4bdad-20eb-40f1-865b-91de21cd9ce6 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:08.435845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-86f4bdad-20eb-40f1-865b-91de21cd9ce6 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:08.436553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-86f4bdad-20eb-40f1-865b-91de21cd9ce6 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:08.437050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-86f4bdad-20eb-40f1-865b-91de21cd9ce6 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:08.437654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-86f4bdad-20eb-40f1-865b-91de21cd9ce6 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:08.443396 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4c252e12-24cc-4318-ac7b-6ea809f13f3a tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5" status: 200 len: 1652 microversion: 2.1 time: 0.178990 Oct 24 11:04:08.444610 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3181/6390] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:08 2022] GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5 => generated 1652 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:08.470438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a8a2661c-347c-4c58-80fb-565bc3fe7c5f tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:08.471168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a8a2661c-347c-4c58-80fb-565bc3fe7c5f tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: e3d370f1-3a66-4779-aa52-2a41e77806a5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:08.477543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8a2661c-347c-4c58-80fb-565bc3fe7c5f tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:08.478082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8a2661c-347c-4c58-80fb-565bc3fe7c5f tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:08.478553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8a2661c-347c-4c58-80fb-565bc3fe7c5f tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:08.479403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8a2661c-347c-4c58-80fb-565bc3fe7c5f tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:08.479850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8a2661c-347c-4c58-80fb-565bc3fe7c5f tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:08.480399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8a2661c-347c-4c58-80fb-565bc3fe7c5f tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:08.723256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-86f4bdad-20eb-40f1-865b-91de21cd9ce6 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367bc74d6ff47cc9cdc503df1e1448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca94fa33c46c404190805fb219d3881a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:08.731322 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-86f4bdad-20eb-40f1-865b-91de21cd9ce6 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd" status: 200 len: 1311 microversion: 2.1 time: 0.309641 Oct 24 11:04:08.731888 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3210/6391] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:08 2022] GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd => generated 1311 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:08.752550 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a8a2661c-347c-4c58-80fb-565bc3fe7c5f tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5" status: 200 len: 1652 microversion: 2.1 time: 0.286876 Oct 24 11:04:08.753204 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3182/6392] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:08 2022] GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5 => generated 1652 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:04:08.774904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a5a45abc-b023-41a6-a6b8-7654337c3aa7 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:08.775453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a5a45abc-b023-41a6-a6b8-7654337c3aa7 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: e3d370f1-3a66-4779-aa52-2a41e77806a5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:08.783728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a5a45abc-b023-41a6-a6b8-7654337c3aa7 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:08.784770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a5a45abc-b023-41a6-a6b8-7654337c3aa7 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:08.785532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a5a45abc-b023-41a6-a6b8-7654337c3aa7 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:08.786530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a5a45abc-b023-41a6-a6b8-7654337c3aa7 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:08.787191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a5a45abc-b023-41a6-a6b8-7654337c3aa7 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:08.788047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a5a45abc-b023-41a6-a6b8-7654337c3aa7 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:08.821170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a5a45abc-b023-41a6-a6b8-7654337c3aa7 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: e3d370f1-3a66-4779-aa52-2a41e77806a5] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:04:08.901934 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a5a45abc-b023-41a6-a6b8-7654337c3aa7 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "DELETE /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5" status: 204 len: 0 microversion: 2.1 time: 0.130448 Oct 24 11:04:08.902658 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3211/6393] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:04:08 2022] DELETE /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 11:04:08.912016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dfb76b28-5a2d-48a2-b3ce-6f2553440768 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:08.912642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dfb76b28-5a2d-48a2-b3ce-6f2553440768 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: e3d370f1-3a66-4779-aa52-2a41e77806a5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:08.919208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfb76b28-5a2d-48a2-b3ce-6f2553440768 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:08.919730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfb76b28-5a2d-48a2-b3ce-6f2553440768 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:08.920178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfb76b28-5a2d-48a2-b3ce-6f2553440768 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:08.920912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfb76b28-5a2d-48a2-b3ce-6f2553440768 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:08.921362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfb76b28-5a2d-48a2-b3ce-6f2553440768 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:08.921887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dfb76b28-5a2d-48a2-b3ce-6f2553440768 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:09.056564 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dfb76b28-5a2d-48a2-b3ce-6f2553440768 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5" status: 200 len: 1658 microversion: 2.1 time: 0.148623 Oct 24 11:04:09.057169 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3183/6394] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:08 2022] GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5 => generated 1658 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:09.756432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-63ce370b-a5ab-45d5-8419-023ca5436013 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:09.757181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-63ce370b-a5ab-45d5-8419-023ca5436013 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:09.763563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-63ce370b-a5ab-45d5-8419-023ca5436013 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:09.763943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-63ce370b-a5ab-45d5-8419-023ca5436013 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:09.764470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-63ce370b-a5ab-45d5-8419-023ca5436013 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:09.765385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-63ce370b-a5ab-45d5-8419-023ca5436013 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:09.766024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-63ce370b-a5ab-45d5-8419-023ca5436013 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:09.766472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-63ce370b-a5ab-45d5-8419-023ca5436013 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:09.912638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-63ce370b-a5ab-45d5-8419-023ca5436013 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367bc74d6ff47cc9cdc503df1e1448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca94fa33c46c404190805fb219d3881a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:09.920802 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-63ce370b-a5ab-45d5-8419-023ca5436013 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd" status: 200 len: 1311 microversion: 2.1 time: 0.168581 Oct 24 11:04:09.921386 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3212/6395] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:09 2022] GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd => generated 1311 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:10.079977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a11d1a77-c1ef-4ff6-9d04-bd8bb9ba6673 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:10.080627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a11d1a77-c1ef-4ff6-9d04-bd8bb9ba6673 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: e3d370f1-3a66-4779-aa52-2a41e77806a5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:10.088253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a11d1a77-c1ef-4ff6-9d04-bd8bb9ba6673 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:10.088759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a11d1a77-c1ef-4ff6-9d04-bd8bb9ba6673 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:10.089205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a11d1a77-c1ef-4ff6-9d04-bd8bb9ba6673 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:10.089954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a11d1a77-c1ef-4ff6-9d04-bd8bb9ba6673 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:10.090521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a11d1a77-c1ef-4ff6-9d04-bd8bb9ba6673 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:10.090954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a11d1a77-c1ef-4ff6-9d04-bd8bb9ba6673 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:10.238299 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a11d1a77-c1ef-4ff6-9d04-bd8bb9ba6673 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5" status: 200 len: 1658 microversion: 2.1 time: 0.162367 Oct 24 11:04:10.239225 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3184/6396] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:10 2022] GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5 => generated 1658 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:10.867938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-02984c49-9d20-4822-88e8-b5979ac103bb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:10.868450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-02984c49-9d20-4822-88e8-b5979ac103bb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:10.875548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02984c49-9d20-4822-88e8-b5979ac103bb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:10.876268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02984c49-9d20-4822-88e8-b5979ac103bb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:10.876741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02984c49-9d20-4822-88e8-b5979ac103bb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:10.877527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02984c49-9d20-4822-88e8-b5979ac103bb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:10.878006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02984c49-9d20-4822-88e8-b5979ac103bb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:10.878460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-02984c49-9d20-4822-88e8-b5979ac103bb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:10.904683 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-02984c49-9d20-4822-88e8-b5979ac103bb tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/ips" status: 200 len: 150 microversion: 2.1 time: 0.040678 Oct 24 11:04:10.905311 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3213/6397] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Oct 24 11:04:10 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:04:10.944573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-59a00ec0-5476-474d-9c80-d6878ac7a68a tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:10.945709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-59a00ec0-5476-474d-9c80-d6878ac7a68a tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:10.952432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59a00ec0-5476-474d-9c80-d6878ac7a68a tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:10.954699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59a00ec0-5476-474d-9c80-d6878ac7a68a tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:10.955834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59a00ec0-5476-474d-9c80-d6878ac7a68a tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:10.956782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59a00ec0-5476-474d-9c80-d6878ac7a68a tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:10.957500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59a00ec0-5476-474d-9c80-d6878ac7a68a tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:10.958042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59a00ec0-5476-474d-9c80-d6878ac7a68a tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:11.223245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-2f6ca220-1f5f-4515-a04f-5179a321d9c6 req-f713ebbc-14e6-4c8c-bbae-e71d0494c76b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3d370f1-3a66-4779-aa52-2a41e77806a5", "name": "network-vif-deleted", "tag": "3ab4d13f-b048-443d-af9c-0bcc82660bd8"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:11.242071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2f6ca220-1f5f-4515-a04f-5179a321d9c6 req-f713ebbc-14e6-4c8c-bbae-e71d0494c76b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:11.243271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-59a00ec0-5476-474d-9c80-d6878ac7a68a tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367bc74d6ff47cc9cdc503df1e1448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca94fa33c46c404190805fb219d3881a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:11.245714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2f6ca220-1f5f-4515-a04f-5179a321d9c6 req-f713ebbc-14e6-4c8c-bbae-e71d0494c76b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:11.246447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2f6ca220-1f5f-4515-a04f-5179a321d9c6 req-f713ebbc-14e6-4c8c-bbae-e71d0494c76b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:11.262415 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-59a00ec0-5476-474d-9c80-d6878ac7a68a tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd" status: 200 len: 1311 microversion: 2.1 time: 0.322299 Oct 24 11:04:11.276673 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3185/6398] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:10 2022] GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd => generated 1311 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:11.287885 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-2f6ca220-1f5f-4515-a04f-5179a321d9c6 req-f713ebbc-14e6-4c8c-bbae-e71d0494c76b service nova] Creating event network-vif-deleted:3ab4d13f-b048-443d-af9c-0bcc82660bd8 for instance e3d370f1-3a66-4779-aa52-2a41e77806a5 on n-h2-858383-15 Oct 24 11:04:11.304990 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-2f6ca220-1f5f-4515-a04f-5179a321d9c6 req-f713ebbc-14e6-4c8c-bbae-e71d0494c76b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086264 Oct 24 11:04:11.309801 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3214/6399] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:04:11.312265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0307148-9e61-4e10-9ec4-475af361d2c0 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:11.315744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f0307148-9e61-4e10-9ec4-475af361d2c0 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: e3d370f1-3a66-4779-aa52-2a41e77806a5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:11.345047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0307148-9e61-4e10-9ec4-475af361d2c0 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:11.346537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0307148-9e61-4e10-9ec4-475af361d2c0 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:11.347202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0307148-9e61-4e10-9ec4-475af361d2c0 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:11.350391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0307148-9e61-4e10-9ec4-475af361d2c0 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:11.351346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0307148-9e61-4e10-9ec4-475af361d2c0 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:11.352883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0307148-9e61-4e10-9ec4-475af361d2c0 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:11.525848 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f0307148-9e61-4e10-9ec4-475af361d2c0 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5" status: 200 len: 1451 microversion: 2.1 time: 0.247727 Oct 24 11:04:11.526529 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3186/6400] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:11 2022] GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5 => generated 1451 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:12.298417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-320bd950-1a88-4071-bcd6-31ec3184a901 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:12.299140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-320bd950-1a88-4071-bcd6-31ec3184a901 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:12.305705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-320bd950-1a88-4071-bcd6-31ec3184a901 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:12.306200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-320bd950-1a88-4071-bcd6-31ec3184a901 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:12.306683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-320bd950-1a88-4071-bcd6-31ec3184a901 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:12.307386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-320bd950-1a88-4071-bcd6-31ec3184a901 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:12.307860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-320bd950-1a88-4071-bcd6-31ec3184a901 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:12.308289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-320bd950-1a88-4071-bcd6-31ec3184a901 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:12.513833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-320bd950-1a88-4071-bcd6-31ec3184a901 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367bc74d6ff47cc9cdc503df1e1448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca94fa33c46c404190805fb219d3881a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:12.530302 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-320bd950-1a88-4071-bcd6-31ec3184a901 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd" status: 200 len: 1311 microversion: 2.1 time: 0.237879 Oct 24 11:04:12.531860 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3215/6401] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:12 2022] GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd => generated 1311 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:12.558432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-178003fd-6368-4c4e-a04f-bad4346496c9 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:12.560600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-178003fd-6368-4c4e-a04f-bad4346496c9 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: e3d370f1-3a66-4779-aa52-2a41e77806a5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:12.564408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:04:12.565417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:04:12.598583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-178003fd-6368-4c4e-a04f-bad4346496c9 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:12.599247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-178003fd-6368-4c4e-a04f-bad4346496c9 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:12.599792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-178003fd-6368-4c4e-a04f-bad4346496c9 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:12.600667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-178003fd-6368-4c4e-a04f-bad4346496c9 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:12.601574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-178003fd-6368-4c4e-a04f-bad4346496c9 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:12.602180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-178003fd-6368-4c4e-a04f-bad4346496c9 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:12.620177 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-178003fd-6368-4c4e-a04f-bad4346496c9 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] HTTP exception thrown: Instance e3d370f1-3a66-4779-aa52-2a41e77806a5 could not be found. Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-178003fd-6368-4c4e-a04f-bad4346496c9 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Request method failure captured: Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5 HTTP/1.1 Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnEKlg6yDxB8s5uk5CXrx88WIkkH_E5aqNqch0C6XHctkULIMkWgZxCX64MrbzAFsanEg5fCMBjH5R0S-0xpN2_nr5ePQDFAIArCH77UWAq2X-DJ9qx-xbCfTjsnRZxg6ZoYAlEI95I8keq8z5O_PBfeeh8ETEQyq_wWwQ0Dml5t1Js Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4ed4c266f702486ebe44512d6259737f Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestServerMultinode-569371929 Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4ed4c266f702486ebe44512d6259737f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4ed4c266f702486ebe44512d6259737f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4ed4c266f702486ebe44512d6259737f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4ed4c266f702486ebe44512d6259737f", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestServerMultinode-569371929 Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4ed4c266f702486ebe44512d6259737f Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestServerMultinode-569371929 Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestServerMultinode-569371929-project-admin Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: e441204143604347b0c7fdf3a4b21e33 Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestServerMultinode-569371929-project-admin Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance e3d370f1-3a66-4779-aa52-2a41e77806a5 could not be found. Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'e3d370f1-3a66-4779-aa52-2a41e77806a5'} Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3d370f1-3a66-4779-aa52-2a41e77806a5 could not be found. Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3d370f1-3a66-4779-aa52-2a41e77806a5 could not be found. Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:04:12.622055 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:04:12.627041 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:04:12.627041 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:04:12.627041 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:04:12.627041 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:04:12.627041 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:04:12.627041 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3d370f1-3a66-4779-aa52-2a41e77806a5 could not be found. Oct 24 11:04:12.627041 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:04:12.627041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-178003fd-6368-4c4e-a04f-bad4346496c9 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Returning 404 to user: Instance e3d370f1-3a66-4779-aa52-2a41e77806a5 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:04:12.628075 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-178003fd-6368-4c4e-a04f-bad4346496c9 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5" status: 404 len: 111 microversion: 2.1 time: 0.073523 Oct 24 11:04:12.629012 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3187/6402] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:12 2022] GET /compute/v2.1/servers/e3d370f1-3a66-4779-aa52-2a41e77806a5 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:04:12.637394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ee13ba9b-c535-4a57-bedc-481ca8084711 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:12.638370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ee13ba9b-c535-4a57-bedc-481ca8084711 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:12.645583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:04:12.647245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee13ba9b-c535-4a57-bedc-481ca8084711 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:12.648166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee13ba9b-c535-4a57-bedc-481ca8084711 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:12.649098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee13ba9b-c535-4a57-bedc-481ca8084711 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:12.650095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee13ba9b-c535-4a57-bedc-481ca8084711 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:12.650812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee13ba9b-c535-4a57-bedc-481ca8084711 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:12.651429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee13ba9b-c535-4a57-bedc-481ca8084711 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:12.681272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ee13ba9b-c535-4a57-bedc-481ca8084711 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:04:12.759213 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ee13ba9b-c535-4a57-bedc-481ca8084711 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "DELETE /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 204 len: 0 microversion: 2.1 time: 0.125792 Oct 24 11:04:12.759936 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3216/6403] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:04:12 2022] DELETE /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:04:12.768878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-673fb6af-14af-4c33-b244-a5fe800b240b tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:12.769493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-673fb6af-14af-4c33-b244-a5fe800b240b tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:12.775566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-673fb6af-14af-4c33-b244-a5fe800b240b tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:12.776004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-673fb6af-14af-4c33-b244-a5fe800b240b tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:12.776449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-673fb6af-14af-4c33-b244-a5fe800b240b tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:12.777219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-673fb6af-14af-4c33-b244-a5fe800b240b tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:12.777677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-673fb6af-14af-4c33-b244-a5fe800b240b tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:12.778121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-673fb6af-14af-4c33-b244-a5fe800b240b tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:12.912323 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-673fb6af-14af-4c33-b244-a5fe800b240b tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1656 microversion: 2.1 time: 0.147898 Oct 24 11:04:12.912944 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3188/6404] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:12 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1656 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:13.559616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6ffbf6dc-af18-4973-8b07-4e5f56231df0 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:13.560254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6ffbf6dc-af18-4973-8b07-4e5f56231df0 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:13.567398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ffbf6dc-af18-4973-8b07-4e5f56231df0 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:13.567880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ffbf6dc-af18-4973-8b07-4e5f56231df0 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:13.568321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ffbf6dc-af18-4973-8b07-4e5f56231df0 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:13.569096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ffbf6dc-af18-4973-8b07-4e5f56231df0 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:13.569558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ffbf6dc-af18-4973-8b07-4e5f56231df0 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:13.569991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ffbf6dc-af18-4973-8b07-4e5f56231df0 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:13.650119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3bbdac18-fe16-49f6-a6c2-6a35ffa0abf0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57e796f7-5c72-43a9-aa67-e0c2bbbe3482"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:13.653774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3bbdac18-fe16-49f6-a6c2-6a35ffa0abf0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:13.661523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bbdac18-fe16-49f6-a6c2-6a35ffa0abf0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:13.662264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bbdac18-fe16-49f6-a6c2-6a35ffa0abf0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:13.662704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bbdac18-fe16-49f6-a6c2-6a35ffa0abf0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:13.663578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bbdac18-fe16-49f6-a6c2-6a35ffa0abf0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:13.664037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bbdac18-fe16-49f6-a6c2-6a35ffa0abf0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:13.664469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bbdac18-fe16-49f6-a6c2-6a35ffa0abf0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:13.714431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6ffbf6dc-af18-4973-8b07-4e5f56231df0 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367bc74d6ff47cc9cdc503df1e1448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca94fa33c46c404190805fb219d3881a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:13.723223 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6ffbf6dc-af18-4973-8b07-4e5f56231df0 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd" status: 200 len: 1311 microversion: 2.1 time: 0.168102 Oct 24 11:04:13.724098 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3217/6405] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:13 2022] GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd => generated 1311 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:13.935652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ce0fa5c4-5c46-4ac2-81e1-01a7da321971 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:13.936415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ce0fa5c4-5c46-4ac2-81e1-01a7da321971 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:13.942760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce0fa5c4-5c46-4ac2-81e1-01a7da321971 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:13.943351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce0fa5c4-5c46-4ac2-81e1-01a7da321971 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:13.943903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce0fa5c4-5c46-4ac2-81e1-01a7da321971 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:13.944681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce0fa5c4-5c46-4ac2-81e1-01a7da321971 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:13.945168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce0fa5c4-5c46-4ac2-81e1-01a7da321971 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:13.945602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce0fa5c4-5c46-4ac2-81e1-01a7da321971 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:14.094821 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ce0fa5c4-5c46-4ac2-81e1-01a7da321971 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1656 microversion: 2.1 time: 0.163009 Oct 24 11:04:14.096179 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3218/6406] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:13 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1656 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:14.233897 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3bbdac18-fe16-49f6-a6c2-6a35ffa0abf0 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "POST /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.587456 Oct 24 11:04:14.236034 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3189/6407] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 11:04:13 2022] POST /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments => generated 194 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:04:14.356810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-6c0a3ba0-f9c7-451a-93d7-afd6af087b90 req-0e87ac84-f486-4cdc-863f-d299f01990d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0afbaab5-70da-4f20-979f-79a69b8648bd", "name": "network-vif-plugged", "status": "completed", "tag": "4dfda9ef-db1b-41e5-b430-f6a70b435d91"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:14.364286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:04:14.371478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6c0a3ba0-f9c7-451a-93d7-afd6af087b90 req-0e87ac84-f486-4cdc-863f-d299f01990d3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:14.372249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6c0a3ba0-f9c7-451a-93d7-afd6af087b90 req-0e87ac84-f486-4cdc-863f-d299f01990d3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:14.372878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6c0a3ba0-f9c7-451a-93d7-afd6af087b90 req-0e87ac84-f486-4cdc-863f-d299f01990d3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:14.388039 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-6c0a3ba0-f9c7-451a-93d7-afd6af087b90 req-0e87ac84-f486-4cdc-863f-d299f01990d3 service nova] Creating event network-vif-plugged:4dfda9ef-db1b-41e5-b430-f6a70b435d91 for instance 0afbaab5-70da-4f20-979f-79a69b8648bd on n-h1-858383-15 Oct 24 11:04:14.394941 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-6c0a3ba0-f9c7-451a-93d7-afd6af087b90 req-0e87ac84-f486-4cdc-863f-d299f01990d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041622 Oct 24 11:04:14.397112 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3219/6408] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:04:14.753163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8783eb31-ee5e-4f17-833f-caa7530941c5 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:14.754635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8783eb31-ee5e-4f17-833f-caa7530941c5 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:14.763952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8783eb31-ee5e-4f17-833f-caa7530941c5 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:14.766592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8783eb31-ee5e-4f17-833f-caa7530941c5 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:14.767228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8783eb31-ee5e-4f17-833f-caa7530941c5 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:14.769453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8783eb31-ee5e-4f17-833f-caa7530941c5 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:14.770431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8783eb31-ee5e-4f17-833f-caa7530941c5 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:14.771072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8783eb31-ee5e-4f17-833f-caa7530941c5 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:14.945815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8783eb31-ee5e-4f17-833f-caa7530941c5 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367bc74d6ff47cc9cdc503df1e1448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca94fa33c46c404190805fb219d3881a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:14.955852 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8783eb31-ee5e-4f17-833f-caa7530941c5 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd" status: 200 len: 1311 microversion: 2.1 time: 0.208709 Oct 24 11:04:14.957439 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3190/6409] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:14 2022] GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd => generated 1311 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:15.123052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-75c67f9d-3e74-4536-a017-579596317023 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:15.124713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-75c67f9d-3e74-4536-a017-579596317023 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:15.136873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-75c67f9d-3e74-4536-a017-579596317023 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:15.153947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-75c67f9d-3e74-4536-a017-579596317023 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:15.155582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-75c67f9d-3e74-4536-a017-579596317023 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:15.157274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-75c67f9d-3e74-4536-a017-579596317023 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:15.158056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-75c67f9d-3e74-4536-a017-579596317023 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:15.158822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-75c67f9d-3e74-4536-a017-579596317023 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:15.220249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-fd0e1398-ea35-4053-aec7-a9300122f121 req-2d86feac-ecfb-4856-8a78-194ab8b8b47e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a851375c-1059-435a-8c09-0ee8da9f723a", "name": "network-vif-deleted", "tag": "067f4449-c8ff-489a-9c63-2fcf13cb82a0"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:15.233740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fd0e1398-ea35-4053-aec7-a9300122f121 req-2d86feac-ecfb-4856-8a78-194ab8b8b47e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:15.235915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fd0e1398-ea35-4053-aec7-a9300122f121 req-2d86feac-ecfb-4856-8a78-194ab8b8b47e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:15.237140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fd0e1398-ea35-4053-aec7-a9300122f121 req-2d86feac-ecfb-4856-8a78-194ab8b8b47e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:15.261427 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-fd0e1398-ea35-4053-aec7-a9300122f121 req-2d86feac-ecfb-4856-8a78-194ab8b8b47e service nova] Creating event network-vif-deleted:067f4449-c8ff-489a-9c63-2fcf13cb82a0 for instance a851375c-1059-435a-8c09-0ee8da9f723a on n-h1-858383-15 Oct 24 11:04:15.271451 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-fd0e1398-ea35-4053-aec7-a9300122f121 req-2d86feac-ecfb-4856-8a78-194ab8b8b47e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054043 Oct 24 11:04:15.272311 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3191/6410] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:04:15.318162 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-75c67f9d-3e74-4536-a017-579596317023 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1614 microversion: 2.1 time: 0.201541 Oct 24 11:04:15.319345 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3220/6411] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:15 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1614 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:15.981459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-54748fbd-7264-4bb0-a6eb-17a4732d2d5f tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:15.982383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-54748fbd-7264-4bb0-a6eb-17a4732d2d5f tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:15.989772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54748fbd-7264-4bb0-a6eb-17a4732d2d5f tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:15.990269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54748fbd-7264-4bb0-a6eb-17a4732d2d5f tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:15.990712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54748fbd-7264-4bb0-a6eb-17a4732d2d5f tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:15.991489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54748fbd-7264-4bb0-a6eb-17a4732d2d5f tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:15.991992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54748fbd-7264-4bb0-a6eb-17a4732d2d5f tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:15.992426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-54748fbd-7264-4bb0-a6eb-17a4732d2d5f tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:16.169659 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-54748fbd-7264-4bb0-a6eb-17a4732d2d5f tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367bc74d6ff47cc9cdc503df1e1448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca94fa33c46c404190805fb219d3881a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:16.179082 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-54748fbd-7264-4bb0-a6eb-17a4732d2d5f tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd" status: 200 len: 1311 microversion: 2.1 time: 0.202962 Oct 24 11:04:16.180085 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3192/6412] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:15 2022] GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd => generated 1311 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:16.344901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c7428a71-509c-4b04-97c5-d01cea1c6acb tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:16.345791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c7428a71-509c-4b04-97c5-d01cea1c6acb tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:16.356469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7428a71-509c-4b04-97c5-d01cea1c6acb tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:16.357001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7428a71-509c-4b04-97c5-d01cea1c6acb tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:16.357449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7428a71-509c-4b04-97c5-d01cea1c6acb tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:16.358694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7428a71-509c-4b04-97c5-d01cea1c6acb tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:16.359787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7428a71-509c-4b04-97c5-d01cea1c6acb tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:16.360492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7428a71-509c-4b04-97c5-d01cea1c6acb tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:16.415113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7428a71-509c-4b04-97c5-d01cea1c6acb tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:16.415620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7428a71-509c-4b04-97c5-d01cea1c6acb tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:16.416334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7428a71-509c-4b04-97c5-d01cea1c6acb tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:16.417038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-c7428a71-509c-4b04-97c5-d01cea1c6acb tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lazy-loading 'fault' on Instance uuid a851375c-1059-435a-8c09-0ee8da9f723a {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:04:16.497989 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c7428a71-509c-4b04-97c5-d01cea1c6acb tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 200 len: 1455 microversion: 2.1 time: 0.157356 Oct 24 11:04:16.499435 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3221/6413] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:16 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:17.204906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a764b2b3-564b-4dc8-bd63-4e443e428758 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:17.206235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a764b2b3-564b-4dc8-bd63-4e443e428758 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:17.214268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a764b2b3-564b-4dc8-bd63-4e443e428758 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:17.214778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a764b2b3-564b-4dc8-bd63-4e443e428758 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:17.215296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a764b2b3-564b-4dc8-bd63-4e443e428758 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:17.216187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a764b2b3-564b-4dc8-bd63-4e443e428758 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:17.216757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a764b2b3-564b-4dc8-bd63-4e443e428758 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:17.217291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a764b2b3-564b-4dc8-bd63-4e443e428758 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:17.223962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:04:17.378247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a764b2b3-564b-4dc8-bd63-4e443e428758 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367bc74d6ff47cc9cdc503df1e1448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca94fa33c46c404190805fb219d3881a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:17.387765 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a764b2b3-564b-4dc8-bd63-4e443e428758 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd" status: 200 len: 1461 microversion: 2.1 time: 0.188626 Oct 24 11:04:17.388496 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3193/6414] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:17 2022] GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd => generated 1461 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:17.415165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-263310fe-96ed-404a-84c9-11324a6dd3ad tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9fa4815-6f91-4baf-a510-185e7b32fce3", "device": "/dev/sdb"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:17.418894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-263310fe-96ed-404a-84c9-11324a6dd3ad tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:17.428255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-263310fe-96ed-404a-84c9-11324a6dd3ad tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:17.428827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-263310fe-96ed-404a-84c9-11324a6dd3ad tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:17.429297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-263310fe-96ed-404a-84c9-11324a6dd3ad tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:17.430074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-263310fe-96ed-404a-84c9-11324a6dd3ad tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:17.430553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-263310fe-96ed-404a-84c9-11324a6dd3ad tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:17.431038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-263310fe-96ed-404a-84c9-11324a6dd3ad tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:17.525076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9226f7f-2097-475a-ab44-f1300ad106a6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:17.525957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f9226f7f-2097-475a-ab44-f1300ad106a6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] [instance: a851375c-1059-435a-8c09-0ee8da9f723a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:17.536440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9226f7f-2097-475a-ab44-f1300ad106a6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:17.537343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9226f7f-2097-475a-ab44-f1300ad106a6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:17.538300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9226f7f-2097-475a-ab44-f1300ad106a6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:17.539229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9226f7f-2097-475a-ab44-f1300ad106a6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:17.540060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9226f7f-2097-475a-ab44-f1300ad106a6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:17.540787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9226f7f-2097-475a-ab44-f1300ad106a6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:17.560963 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-f9226f7f-2097-475a-ab44-f1300ad106a6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] HTTP exception thrown: Instance a851375c-1059-435a-8c09-0ee8da9f723a could not be found. Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9226f7f-2097-475a-ab44-f1300ad106a6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Request method failure captured: Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a HTTP/1.1 Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnEKlg6yDxB8s5uk5CXrx88WIkkH_E5aqNqch0C6XHctkULIMkWgZxCX64MrbzAFsanEg5fCMBjH5R0S-0xpN2_nr5ePQDFAIArCH77UWAq2X-DJ9qx-xbCfTjsnRZxg6ZoYAlEI95I8keq8z5O_PBfeeh8ETEQyq_wWwQ0Dml5t1Js Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4ed4c266f702486ebe44512d6259737f Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestServerMultinode-569371929 Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4ed4c266f702486ebe44512d6259737f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4ed4c266f702486ebe44512d6259737f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4ed4c266f702486ebe44512d6259737f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4ed4c266f702486ebe44512d6259737f", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestServerMultinode-569371929 Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4ed4c266f702486ebe44512d6259737f Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestServerMultinode-569371929 Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestServerMultinode-569371929-project-admin Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: e441204143604347b0c7fdf3a4b21e33 Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestServerMultinode-569371929-project-admin Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance a851375c-1059-435a-8c09-0ee8da9f723a could not be found. Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'a851375c-1059-435a-8c09-0ee8da9f723a'} Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a851375c-1059-435a-8c09-0ee8da9f723a could not be found. Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a851375c-1059-435a-8c09-0ee8da9f723a could not be found. Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:04:17.565058 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:04:17.570051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:04:17.570051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:04:17.570051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:04:17.570051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:04:17.570051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:04:17.570051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a851375c-1059-435a-8c09-0ee8da9f723a could not be found. Oct 24 11:04:17.570051 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:04:17.581176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9226f7f-2097-475a-ab44-f1300ad106a6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] Returning 404 to user: Instance a851375c-1059-435a-8c09-0ee8da9f723a could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:04:17.583090 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f9226f7f-2097-475a-ab44-f1300ad106a6 tempest-TestServerMultinode-569371929 tempest-TestServerMultinode-569371929-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a" status: 404 len: 111 microversion: 2.1 time: 0.061978 Oct 24 11:04:17.584344 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3194/6415] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:17 2022] GET /compute/v2.1/servers/a851375c-1059-435a-8c09-0ee8da9f723a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 11:04:17.616067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:04:17.789345 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-263310fe-96ed-404a-84c9-11324a6dd3ad tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "POST /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378891 Oct 24 11:04:17.797371 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3222/6416] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 11:04:17 2022] POST /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:04:26.517287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e5e10ed8-e240-4864-ad0e-c795b2686e9f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57e796f7-5c72-43a9-aa67-e0c2bbbe3482"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:26.521548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e5e10ed8-e240-4864-ad0e-c795b2686e9f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:26.542008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5e10ed8-e240-4864-ad0e-c795b2686e9f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:26.542785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5e10ed8-e240-4864-ad0e-c795b2686e9f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:26.543525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5e10ed8-e240-4864-ad0e-c795b2686e9f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:26.544453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5e10ed8-e240-4864-ad0e-c795b2686e9f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:26.545147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5e10ed8-e240-4864-ad0e-c795b2686e9f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:26.546283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5e10ed8-e240-4864-ad0e-c795b2686e9f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:26.920694 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-e5e10ed8-e240-4864-ad0e-c795b2686e9f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] HTTP exception thrown: Invalid volume: volume 57e796f7-5c72-43a9-aa67-e0c2bbbe3482 is already attached to instances: 129cf12f-25b4-49e3-afc7-4d8640344201 Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e5e10ed8-e240-4864-ad0e-c795b2686e9f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Request method failure captured: Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments HTTP/1.1 Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 74 Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnAKAHP5OOfm-uCWTjFJTzXa0YLKSuouosUciU14TRf3JmMepl7Z3nYn7w4Ibs55CltNd_hrYn98Pw4N-ToeUd4QusviP9lFlPXOJGwfHRkdtQPCg9kRiq2YXaf55wJAz2KjxNTj7AXjHUrV-JebO1VNsJhWCbt5cfPkaHFUJTxTNxM Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a10ff6644b9b4215b1b7c82b98342a79", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: da9e4e22dda84476a30e6b6bd27c68a6 Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: {"volumeAttachment": {"volumeId": "57e796f7-5c72-43a9-aa67-e0c2bbbe3482"}} Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid volume: volume 57e796f7-5c72-43a9-aa67-e0c2bbbe3482 is already attached to instances: 129cf12f-25b4-49e3-afc7-4d8640344201 Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'server_id': '129cf12f-25b4-49e3-afc7-4d8640344201', 'body': {'volumeAttachment': {'volumeId': '57e796f7-5c72-43a9-aa67-e0c2bbbe3482'}}} Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in attach_volume Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4972, in _check_volume_already_attached Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 57e796f7-5c72-43a9-aa67-e0c2bbbe3482 is already attached to instances: 129cf12f-25b4-49e3-afc7-4d8640344201 Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 11:04:26.925133 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 11:04:26.930768 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 11:04:26.930768 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 11:04:26.930768 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 24 11:04:26.930768 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 11:04:26.930768 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 57e796f7-5c72-43a9-aa67-e0c2bbbe3482 is already attached to instances: 129cf12f-25b4-49e3-afc7-4d8640344201 Oct 24 11:04:26.930768 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:04:26.930768 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:04:26.930768 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:04:26.930768 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:04:26.930768 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:04:26.930768 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:04:26.930768 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:04:26.930768 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:04:26.930768 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 57e796f7-5c72-43a9-aa67-e0c2bbbe3482 is already attached to instances: 129cf12f-25b4-49e3-afc7-4d8640344201 Oct 24 11:04:26.930768 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:04:26.930768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e5e10ed8-e240-4864-ad0e-c795b2686e9f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Returning 400 to user: Invalid volume: volume 57e796f7-5c72-43a9-aa67-e0c2bbbe3482 is already attached to instances: 129cf12f-25b4-49e3-afc7-4d8640344201 {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:04:26.930768 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e5e10ed8-e240-4864-ad0e-c795b2686e9f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "POST /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.414664 Oct 24 11:04:26.930768 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3195/6417] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 11:04:26 2022] POST /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments => generated 174 bytes in 417 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 11:04:27.031283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a897ea3b-e9e5-42b3-9d4e-0eded140bc12 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:27.032523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a897ea3b-e9e5-42b3-9d4e-0eded140bc12 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:27.040782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a897ea3b-e9e5-42b3-9d4e-0eded140bc12 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:27.041828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a897ea3b-e9e5-42b3-9d4e-0eded140bc12 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:27.042452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a897ea3b-e9e5-42b3-9d4e-0eded140bc12 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:27.043391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a897ea3b-e9e5-42b3-9d4e-0eded140bc12 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:27.043831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a897ea3b-e9e5-42b3-9d4e-0eded140bc12 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:27.044263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a897ea3b-e9e5-42b3-9d4e-0eded140bc12 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:27.511527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-a897ea3b-e9e5-42b3-9d4e-0eded140bc12 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lazy-loading 'services' on Instance uuid 129cf12f-25b4-49e3-afc7-4d8640344201 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:04:27.648599 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a897ea3b-e9e5-42b3-9d4e-0eded140bc12 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "DELETE /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments/57e796f7-5c72-43a9-aa67-e0c2bbbe3482" status: 202 len: 0 microversion: 2.1 time: 0.623176 Oct 24 11:04:27.650400 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3223/6418] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 11:04:27 2022] DELETE /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments/57e796f7-5c72-43a9-aa67-e0c2bbbe3482 => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:04:27.659882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-da8895f1-4ad0-4290-9479-0b49de3ab014 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:27.663025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-da8895f1-4ad0-4290-9479-0b49de3ab014 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:27.676112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da8895f1-4ad0-4290-9479-0b49de3ab014 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:27.676720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da8895f1-4ad0-4290-9479-0b49de3ab014 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:27.677276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da8895f1-4ad0-4290-9479-0b49de3ab014 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:27.678111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da8895f1-4ad0-4290-9479-0b49de3ab014 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:27.678665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da8895f1-4ad0-4290-9479-0b49de3ab014 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:27.679672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-da8895f1-4ad0-4290-9479-0b49de3ab014 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:27.736457 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-da8895f1-4ad0-4290-9479-0b49de3ab014 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078866 Oct 24 11:04:27.738509 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3196/6419] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:04:27 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:04:27.770225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e152434b-5bfa-4fd0-89ee-8edf73a8325e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:27.770956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e152434b-5bfa-4fd0-89ee-8edf73a8325e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:27.773553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-25898627-d090-49fa-89ae-89edcedd8aab req-1d052d83-a244-4c85-ad9a-6a6ab31b401b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f185ae20-51ff-406e-9717-78352a36f5cd", "tag": "8d629348-dc03-4347-b47b-90a89bd901c9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:27.787990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e152434b-5bfa-4fd0-89ee-8edf73a8325e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:27.789721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-25898627-d090-49fa-89ae-89edcedd8aab req-1d052d83-a244-4c85-ad9a-6a6ab31b401b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:27.791048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-25898627-d090-49fa-89ae-89edcedd8aab req-1d052d83-a244-4c85-ad9a-6a6ab31b401b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:27.791928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-25898627-d090-49fa-89ae-89edcedd8aab req-1d052d83-a244-4c85-ad9a-6a6ab31b401b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:27.802996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e152434b-5bfa-4fd0-89ee-8edf73a8325e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:27.804096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e152434b-5bfa-4fd0-89ee-8edf73a8325e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:27.805139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e152434b-5bfa-4fd0-89ee-8edf73a8325e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:27.807113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e152434b-5bfa-4fd0-89ee-8edf73a8325e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:27.807563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e152434b-5bfa-4fd0-89ee-8edf73a8325e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:27.812491 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-25898627-d090-49fa-89ae-89edcedd8aab req-1d052d83-a244-4c85-ad9a-6a6ab31b401b service nova] Creating event network-changed:8d629348-dc03-4347-b47b-90a89bd901c9 for instance f185ae20-51ff-406e-9717-78352a36f5cd on n-h1-858383-15 Oct 24 11:04:27.824882 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-25898627-d090-49fa-89ae-89edcedd8aab req-1d052d83-a244-4c85-ad9a-6a6ab31b401b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055398 Oct 24 11:04:27.827293 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3197/6420] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:04:27.846001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e152434b-5bfa-4fd0-89ee-8edf73a8325e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:04:27.961177 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e152434b-5bfa-4fd0-89ee-8edf73a8325e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 204 len: 0 microversion: 2.1 time: 0.198356 Oct 24 11:04:27.962573 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3224/6421] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:04:27 2022] DELETE /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 11:04:27.978749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4fd67c8c-a71e-4522-98c9-c59d0ce29c5e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:27.979705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4fd67c8c-a71e-4522-98c9-c59d0ce29c5e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:27.988549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4fd67c8c-a71e-4522-98c9-c59d0ce29c5e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:27.989491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4fd67c8c-a71e-4522-98c9-c59d0ce29c5e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:27.990352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4fd67c8c-a71e-4522-98c9-c59d0ce29c5e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:27.992142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4fd67c8c-a71e-4522-98c9-c59d0ce29c5e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:27.992871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4fd67c8c-a71e-4522-98c9-c59d0ce29c5e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:27.993609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4fd67c8c-a71e-4522-98c9-c59d0ce29c5e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:28.233059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4fd67c8c-a71e-4522-98c9-c59d0ce29c5e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:28.247161 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4fd67c8c-a71e-4522-98c9-c59d0ce29c5e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1582 microversion: 2.1 time: 0.279692 Oct 24 11:04:28.261619 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3198/6422] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:27 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1582 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:28.751847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-824ccda5-2e23-4810-ab91-aebb14eda993 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:28.754168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-824ccda5-2e23-4810-ab91-aebb14eda993 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:28.769036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-824ccda5-2e23-4810-ab91-aebb14eda993 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:28.769541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-824ccda5-2e23-4810-ab91-aebb14eda993 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:28.769987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-824ccda5-2e23-4810-ab91-aebb14eda993 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:28.777042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-824ccda5-2e23-4810-ab91-aebb14eda993 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:28.778804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-824ccda5-2e23-4810-ab91-aebb14eda993 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:28.780158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-824ccda5-2e23-4810-ab91-aebb14eda993 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:28.832359 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-824ccda5-2e23-4810-ab91-aebb14eda993 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085389 Oct 24 11:04:28.833501 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3225/6423] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:04:28 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:04:29.277329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d264f1f0-4332-440d-a9b6-123f24ac3925 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:29.282452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d264f1f0-4332-440d-a9b6-123f24ac3925 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:29.316725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d264f1f0-4332-440d-a9b6-123f24ac3925 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:29.319998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d264f1f0-4332-440d-a9b6-123f24ac3925 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:29.319998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d264f1f0-4332-440d-a9b6-123f24ac3925 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:29.320693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d264f1f0-4332-440d-a9b6-123f24ac3925 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:29.321214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d264f1f0-4332-440d-a9b6-123f24ac3925 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:29.324636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d264f1f0-4332-440d-a9b6-123f24ac3925 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:29.689201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d264f1f0-4332-440d-a9b6-123f24ac3925 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:29.699842 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d264f1f0-4332-440d-a9b6-123f24ac3925 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1582 microversion: 2.1 time: 0.427565 Oct 24 11:04:29.701037 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3199/6424] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:29 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1582 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:29.845111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bb17d50c-4d84-4293-8cd7-7d12de8c2bc3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:29.847337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bb17d50c-4d84-4293-8cd7-7d12de8c2bc3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:29.858377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb17d50c-4d84-4293-8cd7-7d12de8c2bc3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:29.858899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb17d50c-4d84-4293-8cd7-7d12de8c2bc3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:29.859472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb17d50c-4d84-4293-8cd7-7d12de8c2bc3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:29.861382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb17d50c-4d84-4293-8cd7-7d12de8c2bc3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:29.862098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb17d50c-4d84-4293-8cd7-7d12de8c2bc3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:29.862688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb17d50c-4d84-4293-8cd7-7d12de8c2bc3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:29.904442 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bb17d50c-4d84-4293-8cd7-7d12de8c2bc3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062692 Oct 24 11:04:29.906138 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3226/6425] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:04:29 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:04:30.371270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3bea588f-e7b0-45b3-8473-12ead5ba7b17 req-5421a30a-1134-4353-aa3e-dbfc63c62583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f185ae20-51ff-406e-9717-78352a36f5cd", "name": "network-vif-deleted", "tag": "8d629348-dc03-4347-b47b-90a89bd901c9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:30.386278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3bea588f-e7b0-45b3-8473-12ead5ba7b17 req-5421a30a-1134-4353-aa3e-dbfc63c62583 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:30.387047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3bea588f-e7b0-45b3-8473-12ead5ba7b17 req-5421a30a-1134-4353-aa3e-dbfc63c62583 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:30.387742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3bea588f-e7b0-45b3-8473-12ead5ba7b17 req-5421a30a-1134-4353-aa3e-dbfc63c62583 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:30.403579 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3bea588f-e7b0-45b3-8473-12ead5ba7b17 req-5421a30a-1134-4353-aa3e-dbfc63c62583 service nova] Creating event network-vif-deleted:8d629348-dc03-4347-b47b-90a89bd901c9 for instance f185ae20-51ff-406e-9717-78352a36f5cd on n-h1-858383-15 Oct 24 11:04:30.410836 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3bea588f-e7b0-45b3-8473-12ead5ba7b17 req-5421a30a-1134-4353-aa3e-dbfc63c62583 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043362 Oct 24 11:04:30.412934 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3200/6426] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:04:30.730997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cc563c6b-972e-430c-876a-fea634e79fed tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:30.730997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cc563c6b-972e-430c-876a-fea634e79fed tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:30.738535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc563c6b-972e-430c-876a-fea634e79fed tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:30.739040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc563c6b-972e-430c-876a-fea634e79fed tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:30.739484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc563c6b-972e-430c-876a-fea634e79fed tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:30.745314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc563c6b-972e-430c-876a-fea634e79fed tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:30.746086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc563c6b-972e-430c-876a-fea634e79fed tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:30.746724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc563c6b-972e-430c-876a-fea634e79fed tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:30.848136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cc563c6b-972e-430c-876a-fea634e79fed tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:30.858592 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cc563c6b-972e-430c-876a-fea634e79fed tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1229 microversion: 2.1 time: 0.133754 Oct 24 11:04:30.870929 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3227/6427] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:30 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1229 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:30.919760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e266d540-5984-44bf-98f8-237283573c6e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:30.922209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e266d540-5984-44bf-98f8-237283573c6e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:30.929230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e266d540-5984-44bf-98f8-237283573c6e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:30.929863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e266d540-5984-44bf-98f8-237283573c6e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:30.930541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e266d540-5984-44bf-98f8-237283573c6e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:30.931303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e266d540-5984-44bf-98f8-237283573c6e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:30.931762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e266d540-5984-44bf-98f8-237283573c6e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:30.932215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e266d540-5984-44bf-98f8-237283573c6e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:30.965523 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e266d540-5984-44bf-98f8-237283573c6e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050929 Oct 24 11:04:30.966109 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3201/6428] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:04:30 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:04:31.883835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-588da19a-0b6b-4538-96cc-c5d82f47e182 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:31.884375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-588da19a-0b6b-4538-96cc-c5d82f47e182 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:31.892240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-588da19a-0b6b-4538-96cc-c5d82f47e182 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:31.892728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-588da19a-0b6b-4538-96cc-c5d82f47e182 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:31.893196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-588da19a-0b6b-4538-96cc-c5d82f47e182 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:31.893900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-588da19a-0b6b-4538-96cc-c5d82f47e182 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:31.894358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-588da19a-0b6b-4538-96cc-c5d82f47e182 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:31.894789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-588da19a-0b6b-4538-96cc-c5d82f47e182 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:31.962779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-588da19a-0b6b-4538-96cc-c5d82f47e182 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:31.971611 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-588da19a-0b6b-4538-96cc-c5d82f47e182 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1229 microversion: 2.1 time: 0.091737 Oct 24 11:04:31.973479 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3228/6429] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:31 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:31.987244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e5c5d6e1-18ec-42d8-beb6-b4bea64aa483 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:31.989559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e5c5d6e1-18ec-42d8-beb6-b4bea64aa483 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:31.997938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5c5d6e1-18ec-42d8-beb6-b4bea64aa483 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:31.998524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5c5d6e1-18ec-42d8-beb6-b4bea64aa483 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:31.999069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5c5d6e1-18ec-42d8-beb6-b4bea64aa483 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:31.999852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5c5d6e1-18ec-42d8-beb6-b4bea64aa483 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:32.000927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5c5d6e1-18ec-42d8-beb6-b4bea64aa483 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:32.001438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5c5d6e1-18ec-42d8-beb6-b4bea64aa483 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:32.035154 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e5c5d6e1-18ec-42d8-beb6-b4bea64aa483 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052280 Oct 24 11:04:32.035734 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3202/6430] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:04:31 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:04:32.998486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-09a95745-22c7-4dac-aad4-ab7c47d25d2e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:32.999767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-09a95745-22c7-4dac-aad4-ab7c47d25d2e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:33.009743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09a95745-22c7-4dac-aad4-ab7c47d25d2e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:33.010718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09a95745-22c7-4dac-aad4-ab7c47d25d2e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:33.011425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09a95745-22c7-4dac-aad4-ab7c47d25d2e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:33.012300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09a95745-22c7-4dac-aad4-ab7c47d25d2e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:33.013123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09a95745-22c7-4dac-aad4-ab7c47d25d2e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:33.013709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09a95745-22c7-4dac-aad4-ab7c47d25d2e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:33.051134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-75bb916e-7e9b-4b41-adc0-b5c4deba417f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:33.053975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-75bb916e-7e9b-4b41-adc0-b5c4deba417f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:33.071665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:04:33.076583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75bb916e-7e9b-4b41-adc0-b5c4deba417f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:33.077281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75bb916e-7e9b-4b41-adc0-b5c4deba417f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:33.079494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75bb916e-7e9b-4b41-adc0-b5c4deba417f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:33.080658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75bb916e-7e9b-4b41-adc0-b5c4deba417f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:33.081623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75bb916e-7e9b-4b41-adc0-b5c4deba417f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:33.086501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75bb916e-7e9b-4b41-adc0-b5c4deba417f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:33.091783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-09a95745-22c7-4dac-aad4-ab7c47d25d2e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:33.118204 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-09a95745-22c7-4dac-aad4-ab7c47d25d2e tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1229 microversion: 2.1 time: 0.125791 Oct 24 11:04:33.120747 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3229/6431] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:32 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1229 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:33.145684 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-75bb916e-7e9b-4b41-adc0-b5c4deba417f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101088 Oct 24 11:04:33.152000 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3203/6432] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:04:33 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 11:04:33.249242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b5a3cfa7-b138-4d55-946b-e85003aed2e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:33.249751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b5a3cfa7-b138-4d55-946b-e85003aed2e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:33.257727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5a3cfa7-b138-4d55-946b-e85003aed2e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:33.258232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5a3cfa7-b138-4d55-946b-e85003aed2e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:33.258680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5a3cfa7-b138-4d55-946b-e85003aed2e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:33.259411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5a3cfa7-b138-4d55-946b-e85003aed2e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:33.259872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5a3cfa7-b138-4d55-946b-e85003aed2e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:33.260367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5a3cfa7-b138-4d55-946b-e85003aed2e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:33.289698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b5a3cfa7-b138-4d55-946b-e85003aed2e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:04:33.382079 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b5a3cfa7-b138-4d55-946b-e85003aed2e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "DELETE /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 204 len: 0 microversion: 2.1 time: 0.136078 Oct 24 11:04:33.382769 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3230/6433] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:04:33 2022] DELETE /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:04:33.391836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb22ffca-1bbc-4ad4-ac15-9843bf89ab73 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:33.392460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bb22ffca-1bbc-4ad4-ac15-9843bf89ab73 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:33.403274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb22ffca-1bbc-4ad4-ac15-9843bf89ab73 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:33.404554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb22ffca-1bbc-4ad4-ac15-9843bf89ab73 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:33.405298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb22ffca-1bbc-4ad4-ac15-9843bf89ab73 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:33.408371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb22ffca-1bbc-4ad4-ac15-9843bf89ab73 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:33.409448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb22ffca-1bbc-4ad4-ac15-9843bf89ab73 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:33.410115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb22ffca-1bbc-4ad4-ac15-9843bf89ab73 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:33.571613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bb22ffca-1bbc-4ad4-ac15-9843bf89ab73 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:33.580762 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bb22ffca-1bbc-4ad4-ac15-9843bf89ab73 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1682 microversion: 2.1 time: 0.193642 Oct 24 11:04:33.581608 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3204/6434] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:33 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1682 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:34.145837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e145c3f3-6cd5-4beb-8902-1e2f23b4108f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:34.146556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e145c3f3-6cd5-4beb-8902-1e2f23b4108f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:34.154236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e145c3f3-6cd5-4beb-8902-1e2f23b4108f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:34.154758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e145c3f3-6cd5-4beb-8902-1e2f23b4108f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:34.155555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e145c3f3-6cd5-4beb-8902-1e2f23b4108f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:34.157119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e145c3f3-6cd5-4beb-8902-1e2f23b4108f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:34.157957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e145c3f3-6cd5-4beb-8902-1e2f23b4108f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:34.158486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e145c3f3-6cd5-4beb-8902-1e2f23b4108f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:34.247544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e145c3f3-6cd5-4beb-8902-1e2f23b4108f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:34.256846 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e145c3f3-6cd5-4beb-8902-1e2f23b4108f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1229 microversion: 2.1 time: 0.116843 Oct 24 11:04:34.265928 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3231/6435] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:34 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1229 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:34.606550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-89655934-5a7a-4ba1-bdf9-9555b53cf8d4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:34.612191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-89655934-5a7a-4ba1-bdf9-9555b53cf8d4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:34.624149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89655934-5a7a-4ba1-bdf9-9555b53cf8d4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:34.627126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89655934-5a7a-4ba1-bdf9-9555b53cf8d4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:34.628115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89655934-5a7a-4ba1-bdf9-9555b53cf8d4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:34.629121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89655934-5a7a-4ba1-bdf9-9555b53cf8d4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:34.629817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89655934-5a7a-4ba1-bdf9-9555b53cf8d4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:34.630511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89655934-5a7a-4ba1-bdf9-9555b53cf8d4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:34.802471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-89655934-5a7a-4ba1-bdf9-9555b53cf8d4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:34.812246 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-89655934-5a7a-4ba1-bdf9-9555b53cf8d4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1682 microversion: 2.1 time: 0.210311 Oct 24 11:04:34.825645 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3205/6436] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:34 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1682 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:35.288744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1d671556-efa7-4d24-83a0-7726d0ca4c56 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:35.290138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1d671556-efa7-4d24-83a0-7726d0ca4c56 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:35.299248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d671556-efa7-4d24-83a0-7726d0ca4c56 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:35.300132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d671556-efa7-4d24-83a0-7726d0ca4c56 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:35.300821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d671556-efa7-4d24-83a0-7726d0ca4c56 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:35.301868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d671556-efa7-4d24-83a0-7726d0ca4c56 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:35.302444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d671556-efa7-4d24-83a0-7726d0ca4c56 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:35.303190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d671556-efa7-4d24-83a0-7726d0ca4c56 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:35.405356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1d671556-efa7-4d24-83a0-7726d0ca4c56 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:35.415176 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1d671556-efa7-4d24-83a0-7726d0ca4c56 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1229 microversion: 2.1 time: 0.130649 Oct 24 11:04:35.426611 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3232/6437] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:35 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1229 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:35.838305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c893e0ff-f1dc-4564-9331-9da44ea90777 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:35.839777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c893e0ff-f1dc-4564-9331-9da44ea90777 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:35.853123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c893e0ff-f1dc-4564-9331-9da44ea90777 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:35.854434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c893e0ff-f1dc-4564-9331-9da44ea90777 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:35.856459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c893e0ff-f1dc-4564-9331-9da44ea90777 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:35.858070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c893e0ff-f1dc-4564-9331-9da44ea90777 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:35.865191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c893e0ff-f1dc-4564-9331-9da44ea90777 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:35.866064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c893e0ff-f1dc-4564-9331-9da44ea90777 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:35.996767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c893e0ff-f1dc-4564-9331-9da44ea90777 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:36.017584 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c893e0ff-f1dc-4564-9331-9da44ea90777 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1614 microversion: 2.1 time: 0.183151 Oct 24 11:04:36.020321 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3206/6438] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:35 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1614 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:36.439923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bfdcf779-2a3b-4f8e-ba85-a561b67173ff tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:36.440556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bfdcf779-2a3b-4f8e-ba85-a561b67173ff tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:36.459788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bfdcf779-2a3b-4f8e-ba85-a561b67173ff tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:36.460276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bfdcf779-2a3b-4f8e-ba85-a561b67173ff tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:36.460726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bfdcf779-2a3b-4f8e-ba85-a561b67173ff tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:36.461484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bfdcf779-2a3b-4f8e-ba85-a561b67173ff tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:36.461952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bfdcf779-2a3b-4f8e-ba85-a561b67173ff tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:36.462388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bfdcf779-2a3b-4f8e-ba85-a561b67173ff tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:36.585432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bfdcf779-2a3b-4f8e-ba85-a561b67173ff tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:36.597092 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bfdcf779-2a3b-4f8e-ba85-a561b67173ff tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1229 microversion: 2.1 time: 0.161195 Oct 24 11:04:36.605233 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3233/6439] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:36 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1229 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:37.048782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f3cd198e-be58-4701-8946-1330eab48690 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:37.050033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f3cd198e-be58-4701-8946-1330eab48690 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:37.065040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3cd198e-be58-4701-8946-1330eab48690 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:37.065830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3cd198e-be58-4701-8946-1330eab48690 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:37.066291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3cd198e-be58-4701-8946-1330eab48690 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:37.067044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3cd198e-be58-4701-8946-1330eab48690 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:37.067513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3cd198e-be58-4701-8946-1330eab48690 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:37.073062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3cd198e-be58-4701-8946-1330eab48690 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:37.197160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-d71c3b7b-5c29-45da-9b1b-6216291a8206 req-7cdd3dd6-8c12-4032-92c7-3bd707560e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "129cf12f-25b4-49e3-afc7-4d8640344201", "name": "network-vif-deleted", "tag": "284a7f25-336e-4e74-af84-8dbd289b8b4a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:37.210986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d71c3b7b-5c29-45da-9b1b-6216291a8206 req-7cdd3dd6-8c12-4032-92c7-3bd707560e46 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:37.211881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d71c3b7b-5c29-45da-9b1b-6216291a8206 req-7cdd3dd6-8c12-4032-92c7-3bd707560e46 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:37.212544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d71c3b7b-5c29-45da-9b1b-6216291a8206 req-7cdd3dd6-8c12-4032-92c7-3bd707560e46 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:37.231593 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-d71c3b7b-5c29-45da-9b1b-6216291a8206 req-7cdd3dd6-8c12-4032-92c7-3bd707560e46 service nova] Creating event network-vif-deleted:284a7f25-336e-4e74-af84-8dbd289b8b4a for instance 129cf12f-25b4-49e3-afc7-4d8640344201 on n-h2-858383-15 Oct 24 11:04:37.236940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f3cd198e-be58-4701-8946-1330eab48690 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:37.258239 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f3cd198e-be58-4701-8946-1330eab48690 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 200 len: 1614 microversion: 2.1 time: 0.214090 Oct 24 11:04:37.263471 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-d71c3b7b-5c29-45da-9b1b-6216291a8206 req-7cdd3dd6-8c12-4032-92c7-3bd707560e46 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070018 Oct 24 11:04:37.264090 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3207/6440] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:37 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 1614 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:37.265261 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3234/6441] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:04:37.624425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e114daa5-083a-43b4-be96-2cd846cb149f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:37.625506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e114daa5-083a-43b4-be96-2cd846cb149f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:37.633748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e114daa5-083a-43b4-be96-2cd846cb149f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:37.636810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e114daa5-083a-43b4-be96-2cd846cb149f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:37.637537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e114daa5-083a-43b4-be96-2cd846cb149f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:37.641182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e114daa5-083a-43b4-be96-2cd846cb149f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:37.643168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e114daa5-083a-43b4-be96-2cd846cb149f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:37.643835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e114daa5-083a-43b4-be96-2cd846cb149f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:37.772351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e114daa5-083a-43b4-be96-2cd846cb149f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:37.802431 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e114daa5-083a-43b4-be96-2cd846cb149f tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1229 microversion: 2.1 time: 0.182488 Oct 24 11:04:37.809993 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3208/6442] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:37 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1229 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:38.293283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-567ce4f9-4b05-4651-8d14-752850b0836f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:38.294006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-567ce4f9-4b05-4651-8d14-752850b0836f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:38.306661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-567ce4f9-4b05-4651-8d14-752850b0836f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:38.307319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-567ce4f9-4b05-4651-8d14-752850b0836f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:38.308522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-567ce4f9-4b05-4651-8d14-752850b0836f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:38.309453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-567ce4f9-4b05-4651-8d14-752850b0836f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:38.310073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-567ce4f9-4b05-4651-8d14-752850b0836f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:38.310709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-567ce4f9-4b05-4651-8d14-752850b0836f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:38.316670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:04:38.330042 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-567ce4f9-4b05-4651-8d14-752850b0836f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] HTTP exception thrown: Instance 129cf12f-25b4-49e3-afc7-4d8640344201 could not be found. Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-567ce4f9-4b05-4651-8d14-752850b0836f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Request method failure captured: Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 HTTP/1.1 Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnAKAHP5OOfm-uCWTjFJTzXa0YLKSuouosUciU14TRf3JmMepl7Z3nYn7w4Ibs55CltNd_hrYn98Pw4N-ToeUd4QusviP9lFlPXOJGwfHRkdtQPCg9kRiq2YXaf55wJAz2KjxNTj7AXjHUrV-JebO1VNsJhWCbt5cfPkaHFUJTxTNxM Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a10ff6644b9b4215b1b7c82b98342a79", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: da9e4e22dda84476a30e6b6bd27c68a6 Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 129cf12f-25b4-49e3-afc7-4d8640344201 could not be found. Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '129cf12f-25b4-49e3-afc7-4d8640344201'} Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 129cf12f-25b4-49e3-afc7-4d8640344201 could not be found. Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 129cf12f-25b4-49e3-afc7-4d8640344201 could not be found. Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:04:38.331890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:04:38.336224 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:04:38.336224 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:04:38.336224 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:04:38.336224 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:04:38.336224 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:04:38.336224 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 129cf12f-25b4-49e3-afc7-4d8640344201 could not be found. Oct 24 11:04:38.336224 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:04:38.336224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-567ce4f9-4b05-4651-8d14-752850b0836f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Returning 404 to user: Instance 129cf12f-25b4-49e3-afc7-4d8640344201 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:04:38.336224 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-567ce4f9-4b05-4651-8d14-752850b0836f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 404 len: 111 microversion: 2.1 time: 0.048094 Oct 24 11:04:38.341082 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3235/6443] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:38 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 11:04:38.345775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e1d117c-b454-4d40-9894-5d4e7836524f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '.version_select at 0x7f04cbaacca0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:38.368522 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e1d117c-b454-4d40-9894-5d4e7836524f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980117330" status: 202 len: 0 microversion: 2.1 time: 0.027231 Oct 24 11:04:38.372497 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3209/6444] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Oct 24 11:04:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980117330 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:04:38.834461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8c3c3ccf-42cc-4f2e-879e-de46d0a9b42a tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:38.835331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8c3c3ccf-42cc-4f2e-879e-de46d0a9b42a tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:38.846864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c3c3ccf-42cc-4f2e-879e-de46d0a9b42a tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:38.862460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c3c3ccf-42cc-4f2e-879e-de46d0a9b42a tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:38.866423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c3c3ccf-42cc-4f2e-879e-de46d0a9b42a tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:38.870757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c3c3ccf-42cc-4f2e-879e-de46d0a9b42a tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:38.871501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c3c3ccf-42cc-4f2e-879e-de46d0a9b42a tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:38.872374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c3c3ccf-42cc-4f2e-879e-de46d0a9b42a tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:38.996478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c3c3ccf-42cc-4f2e-879e-de46d0a9b42a tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:38.997319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c3c3ccf-42cc-4f2e-879e-de46d0a9b42a tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:38.997771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c3c3ccf-42cc-4f2e-879e-de46d0a9b42a tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:38.998424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-8c3c3ccf-42cc-4f2e-879e-de46d0a9b42a tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lazy-loading 'fault' on Instance uuid f185ae20-51ff-406e-9717-78352a36f5cd {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:04:39.051727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8c3c3ccf-42cc-4f2e-879e-de46d0a9b42a tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded681a9997f44678934f42fa1687fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8a814fc1a4d3b95fecf712f5274a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:39.060308 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8c3c3ccf-42cc-4f2e-879e-de46d0a9b42a tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 200 len: 1234 microversion: 2.1 time: 0.230243 Oct 24 11:04:39.060818 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3236/6445] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:38 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 1234 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:39.228657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9a9eb6c0-f90a-43a5-90eb-1bd9b944d6c4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Action: 'create', calling method: .version_select at 0x7f04cb8a6940>, body: {"keypair": {"name": "tempest-keypair-1431420972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/MTdaROe9tT/Lo3XpF/xYH7lnzODIL59XMdzn5cy4touGWAa5FqCkMdUAhDjX3RDX0cJP7dwc7640qa7FOYp1PKq06Lre+d6ufpErI41/mGvMeccnZbQmf1rritUqmAg=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:39.256696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-9a9eb6c0-f90a-43a5-90eb-1bd9b944d6c4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Getting quotas for project a10ff6644b9b4215b1b7c82b98342a79. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:04:39.263711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-9a9eb6c0-f90a-43a5-90eb-1bd9b944d6c4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Getting quotas for user da9e4e22dda84476a30e6b6bd27c68a6 and project a10ff6644b9b4215b1b7c82b98342a79. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:04:39.294916 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9a9eb6c0-f90a-43a5-90eb-1bd9b944d6c4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070667 Oct 24 11:04:39.295725 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3210/6446] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:04:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:04:40.089399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bdc09e14-c44a-4f64-85f2-dc8b2aea3fea tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:40.090897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bdc09e14-c44a-4f64-85f2-dc8b2aea3fea tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] [instance: f185ae20-51ff-406e-9717-78352a36f5cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:40.104897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bdc09e14-c44a-4f64-85f2-dc8b2aea3fea tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:40.105605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bdc09e14-c44a-4f64-85f2-dc8b2aea3fea tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:40.107592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bdc09e14-c44a-4f64-85f2-dc8b2aea3fea tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:40.108517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bdc09e14-c44a-4f64-85f2-dc8b2aea3fea tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:40.110137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bdc09e14-c44a-4f64-85f2-dc8b2aea3fea tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:40.115532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bdc09e14-c44a-4f64-85f2-dc8b2aea3fea tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:40.163131 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-bdc09e14-c44a-4f64-85f2-dc8b2aea3fea tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] HTTP exception thrown: Instance f185ae20-51ff-406e-9717-78352a36f5cd could not be found. Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bdc09e14-c44a-4f64-85f2-dc8b2aea3fea tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Request method failure captured: Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd HTTP/1.1 Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnAu_6HX-HL8Wzb9XRSScJlLwuGNuWFa04_6Ynm0aQ2PFAYbgBdzGnZCxH01wn9tyAaepkusrjA_XuJH70aCqkMulYq3QHE3tncJeqQvl5K7dObRXiavzULkUXNPWY8Zdt2t2NdUfAKM3Cat38ebtnY0u3haA5vsnW5FuUkNUJPkKxk Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: a3a8a814fc1a4d3b95fecf712f5274a1 Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestVolumeBackupRestore-756415834 Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a3a8a814fc1a4d3b95fecf712f5274a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a3a8a814fc1a4d3b95fecf712f5274a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a3a8a814fc1a4d3b95fecf712f5274a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a3a8a814fc1a4d3b95fecf712f5274a1", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestVolumeBackupRestore-756415834 Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: a3a8a814fc1a4d3b95fecf712f5274a1 Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestVolumeBackupRestore-756415834 Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestVolumeBackupRestore-756415834-project Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ded681a9997f44678934f42fa1687fb5 Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestVolumeBackupRestore-756415834-project Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance f185ae20-51ff-406e-9717-78352a36f5cd could not be found. Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'f185ae20-51ff-406e-9717-78352a36f5cd'} Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f185ae20-51ff-406e-9717-78352a36f5cd could not be found. Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f185ae20-51ff-406e-9717-78352a36f5cd could not be found. Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:04:40.169825 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:04:40.175380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:04:40.175380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:04:40.175380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:04:40.175380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:04:40.175380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:04:40.175380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f185ae20-51ff-406e-9717-78352a36f5cd could not be found. Oct 24 11:04:40.175380 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:04:40.178290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bdc09e14-c44a-4f64-85f2-dc8b2aea3fea tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Returning 404 to user: Instance f185ae20-51ff-406e-9717-78352a36f5cd could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:04:40.179359 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bdc09e14-c44a-4f64-85f2-dc8b2aea3fea tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd" status: 404 len: 111 microversion: 2.1 time: 0.094242 Oct 24 11:04:40.184577 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3237/6447] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:40 2022] GET /compute/v2.1/servers/f185ae20-51ff-406e-9717-78352a36f5cd => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:04:40.497466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-10e3dc1b-d3c8-4bf7-984a-3456ea281811 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] Calling method '.version_select at 0x7f04cb612430>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:40.538457 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-10e3dc1b-d3c8-4bf7-984a-3456ea281811 tempest-TestVolumeBackupRestore-756415834 tempest-TestVolumeBackupRestore-756415834-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-981309114" status: 202 len: 0 microversion: 2.1 time: 0.045527 Oct 24 11:04:40.542311 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3238/6448] 10.222.0.50 () {58 vars in 1266 bytes} [Mon Oct 24 11:04:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-981309114 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:04:40.806198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c001dae6-8fa1-4f31-9b24-b05edcbdb544 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Action: 'create', calling method: .version_select at 0x7f04cb8ab1f0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1552156643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIkhgLiMbk2OkDkbdGBM3lBCDTqHhljFXQz45ZcXGdnu0t5fa0/MMSiOMaBS5huxPOt1gMEPDdwCEX6sPMyNC9Ze24t8FQhIOd6kyPwl7HCMhW5P1uL99EOS4EhdXrvIg=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:40.840998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c001dae6-8fa1-4f31-9b24-b05edcbdb544 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Getting quotas for project d681efb474fb4d3bb62e07ca2d16bc33. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:04:40.850100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c001dae6-8fa1-4f31-9b24-b05edcbdb544 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Getting quotas for user 97b622ac85ed493ab3c8a1761a480ada and project d681efb474fb4d3bb62e07ca2d16bc33. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:04:40.896595 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c001dae6-8fa1-4f31-9b24-b05edcbdb544 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.496224 Oct 24 11:04:40.897631 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3211/6449] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:04:40 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:04:41.833203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a3ef78c5-2277-4aa1-ae11-56c1198b1083 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1553442051", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b82d466-b601-44d7-abeb-7c2705af48cc"}], "security_groups": [{"name": "tempest-securitygroup--1852790822"}], "key_name": "tempest-keypair-1431420972", "user_data": "}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:42.204440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-a3ef78c5-2277-4aa1-ae11-56c1198b1083 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] validate_networks() for [('6b82d466-b601-44d7-abeb-7c2705af48cc', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:04:43.053414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a3ef78c5-2277-4aa1-ae11-56c1198b1083 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:04:43.054055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a3ef78c5-2277-4aa1-ae11-56c1198b1083 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:04:43.054742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a3ef78c5-2277-4aa1-ae11-56c1198b1083 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:04:43.054949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a3ef78c5-2277-4aa1-ae11-56c1198b1083 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:04:43.055213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a3ef78c5-2277-4aa1-ae11-56c1198b1083 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:04:43.083442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3ef78c5-2277-4aa1-ae11-56c1198b1083 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:43.088528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3ef78c5-2277-4aa1-ae11-56c1198b1083 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:43.089397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3ef78c5-2277-4aa1-ae11-56c1198b1083 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:43.094898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3ef78c5-2277-4aa1-ae11-56c1198b1083 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:43.095692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3ef78c5-2277-4aa1-ae11-56c1198b1083 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:43.097842 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3ef78c5-2277-4aa1-ae11-56c1198b1083 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:43.222637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-a3ef78c5-2277-4aa1-ae11-56c1198b1083 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Getting quotas for project a10ff6644b9b4215b1b7c82b98342a79. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:04:43.236894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-a3ef78c5-2277-4aa1-ae11-56c1198b1083 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Getting quotas for user da9e4e22dda84476a30e6b6bd27c68a6 and project a10ff6644b9b4215b1b7c82b98342a79. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:04:43.272374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a3ef78c5-2277-4aa1-ae11-56c1198b1083 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:04:43.278628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a3ef78c5-2277-4aa1-ae11-56c1198b1083 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:04:43.413700 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a3ef78c5-2277-4aa1-ae11-56c1198b1083 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.586941 Oct 24 11:04:43.417994 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3239/6450] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:04:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:04:43.431896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-913ad530-513c-435b-addd-436d06093cb8 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:43.432605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-913ad530-513c-435b-addd-436d06093cb8 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:44.152543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-913ad530-513c-435b-addd-436d06093cb8 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:44.171553 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-913ad530-513c-435b-addd-436d06093cb8 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 200 len: 1242 microversion: 2.1 time: 0.745539 Oct 24 11:04:44.173001 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3212/6451] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:43 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 1242 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:45.195576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-35744166-0bc4-43b4-a4d9-c6f9916c8ef1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:45.196143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-35744166-0bc4-43b4-a4d9-c6f9916c8ef1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:45.198936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:04:45.216687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35744166-0bc4-43b4-a4d9-c6f9916c8ef1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:45.218355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35744166-0bc4-43b4-a4d9-c6f9916c8ef1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:45.223840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35744166-0bc4-43b4-a4d9-c6f9916c8ef1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:45.227235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35744166-0bc4-43b4-a4d9-c6f9916c8ef1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:45.229795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35744166-0bc4-43b4-a4d9-c6f9916c8ef1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:45.232208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35744166-0bc4-43b4-a4d9-c6f9916c8ef1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:45.510281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-35744166-0bc4-43b4-a4d9-c6f9916c8ef1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:45.573642 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-35744166-0bc4-43b4-a4d9-c6f9916c8ef1 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 200 len: 1294 microversion: 2.1 time: 0.377307 Oct 24 11:04:45.579774 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3240/6452] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:45 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 1294 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:46.600636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e397f820-22da-4902-940f-cb93fa0ec80a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:46.602068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e397f820-22da-4902-940f-cb93fa0ec80a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:46.632144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e397f820-22da-4902-940f-cb93fa0ec80a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:46.632779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e397f820-22da-4902-940f-cb93fa0ec80a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:46.637103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e397f820-22da-4902-940f-cb93fa0ec80a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:46.637965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e397f820-22da-4902-940f-cb93fa0ec80a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:46.638453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e397f820-22da-4902-940f-cb93fa0ec80a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:46.638897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e397f820-22da-4902-940f-cb93fa0ec80a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:46.889629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e397f820-22da-4902-940f-cb93fa0ec80a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:46.907585 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e397f820-22da-4902-940f-cb93fa0ec80a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 200 len: 1300 microversion: 2.1 time: 0.311645 Oct 24 11:04:46.908476 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3213/6453] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:46 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 1300 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:47.951140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c04391a1-9895-4b05-bd3d-f366f26fc2f3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:47.951140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c04391a1-9895-4b05-bd3d-f366f26fc2f3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:47.971828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c04391a1-9895-4b05-bd3d-f366f26fc2f3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:47.972324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c04391a1-9895-4b05-bd3d-f366f26fc2f3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:47.972767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c04391a1-9895-4b05-bd3d-f366f26fc2f3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:47.973510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c04391a1-9895-4b05-bd3d-f366f26fc2f3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:47.985695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c04391a1-9895-4b05-bd3d-f366f26fc2f3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:47.990330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c04391a1-9895-4b05-bd3d-f366f26fc2f3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:48.323379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c04391a1-9895-4b05-bd3d-f366f26fc2f3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:48.337154 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c04391a1-9895-4b05-bd3d-f366f26fc2f3 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 200 len: 1368 microversion: 2.1 time: 0.388788 Oct 24 11:04:48.338875 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3241/6454] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:47 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 1368 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:49.369497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3d2d4c37-eec5-407d-970e-453222bd89cd tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:49.370118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3d2d4c37-eec5-407d-970e-453222bd89cd tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:49.383693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d2d4c37-eec5-407d-970e-453222bd89cd tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:49.384190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d2d4c37-eec5-407d-970e-453222bd89cd tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:49.384633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d2d4c37-eec5-407d-970e-453222bd89cd tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:49.385390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d2d4c37-eec5-407d-970e-453222bd89cd tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:49.385847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d2d4c37-eec5-407d-970e-453222bd89cd tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:49.386279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d2d4c37-eec5-407d-970e-453222bd89cd tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:49.411258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=90 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:04:49.704934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-4f6e02aa-5019-42f7-b87d-b9d2e210f09d req-bb3d8d7b-9c72-4a42-a5a8-672d87d2f84a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ae5a9df-d2fa-4caf-829d-87fb3b799065", "tag": "6a025f8a-9c84-4a4d-a522-9e55fb01c45d"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:49.728692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4f6e02aa-5019-42f7-b87d-b9d2e210f09d req-bb3d8d7b-9c72-4a42-a5a8-672d87d2f84a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:49.731565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4f6e02aa-5019-42f7-b87d-b9d2e210f09d req-bb3d8d7b-9c72-4a42-a5a8-672d87d2f84a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:49.732021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4f6e02aa-5019-42f7-b87d-b9d2e210f09d req-bb3d8d7b-9c72-4a42-a5a8-672d87d2f84a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:49.776488 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-4f6e02aa-5019-42f7-b87d-b9d2e210f09d req-bb3d8d7b-9c72-4a42-a5a8-672d87d2f84a service nova] Creating event network-changed:6a025f8a-9c84-4a4d-a522-9e55fb01c45d for instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 on n-h2-858383-15 Oct 24 11:04:49.805701 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-4f6e02aa-5019-42f7-b87d-b9d2e210f09d req-bb3d8d7b-9c72-4a42-a5a8-672d87d2f84a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096527 Oct 24 11:04:49.817269 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3242/6455] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:04:49.855127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3d2d4c37-eec5-407d-970e-453222bd89cd tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:49.867771 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3d2d4c37-eec5-407d-970e-453222bd89cd tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 200 len: 1368 microversion: 2.1 time: 0.502676 Oct 24 11:04:49.870891 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3214/6456] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:49 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 1368 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:50.894265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ac583096-28f7-4109-b5d0-a19acbe8f439 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:50.895739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ac583096-28f7-4109-b5d0-a19acbe8f439 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:50.911390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac583096-28f7-4109-b5d0-a19acbe8f439 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:50.911903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac583096-28f7-4109-b5d0-a19acbe8f439 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:50.912362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac583096-28f7-4109-b5d0-a19acbe8f439 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:50.913129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac583096-28f7-4109-b5d0-a19acbe8f439 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:50.913596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac583096-28f7-4109-b5d0-a19acbe8f439 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:50.919957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ac583096-28f7-4109-b5d0-a19acbe8f439 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:51.306954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ac583096-28f7-4109-b5d0-a19acbe8f439 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:51.319420 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ac583096-28f7-4109-b5d0-a19acbe8f439 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 200 len: 1368 microversion: 2.1 time: 0.430192 Oct 24 11:04:51.323141 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3243/6457] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:50 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 1368 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:52.353595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fec6f088-6838-4bbf-9f78-d432a72d29f4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:52.354956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fec6f088-6838-4bbf-9f78-d432a72d29f4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:52.373596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fec6f088-6838-4bbf-9f78-d432a72d29f4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:52.376169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fec6f088-6838-4bbf-9f78-d432a72d29f4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:52.380122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fec6f088-6838-4bbf-9f78-d432a72d29f4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:52.381112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fec6f088-6838-4bbf-9f78-d432a72d29f4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:52.381850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fec6f088-6838-4bbf-9f78-d432a72d29f4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:52.383176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fec6f088-6838-4bbf-9f78-d432a72d29f4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:52.806905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-294952306-access_point-633844020", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "929fb8d3-b984-4b65-a8ad-8f44e31d8176"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1552156643", "security_groups": [{"name": "tempest-secgroup_access--65030842"}, {"name": "tempest-secgroup_general--103682923"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:53.113245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:04:53.257985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:04:53.323449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fec6f088-6838-4bbf-9f78-d432a72d29f4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:53.335341 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fec6f088-6838-4bbf-9f78-d432a72d29f4 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 200 len: 1368 microversion: 2.1 time: 0.987833 Oct 24 11:04:53.338806 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3215/6458] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:52 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 1368 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:53.554711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] validate_networks() for [('929fb8d3-b984-4b65-a8ad-8f44e31d8176', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:04:54.362435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=10 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:04:54.371404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-af95c01e-61e5-4d59-9c38-8f1ebce52249 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:54.373317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-af95c01e-61e5-4d59-9c38-8f1ebce52249 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:54.382747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af95c01e-61e5-4d59-9c38-8f1ebce52249 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:54.383704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af95c01e-61e5-4d59-9c38-8f1ebce52249 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:54.384522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af95c01e-61e5-4d59-9c38-8f1ebce52249 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:54.385448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af95c01e-61e5-4d59-9c38-8f1ebce52249 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:54.386110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af95c01e-61e5-4d59-9c38-8f1ebce52249 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:54.386705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af95c01e-61e5-4d59-9c38-8f1ebce52249 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:54.773855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-af95c01e-61e5-4d59-9c38-8f1ebce52249 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:54.785224 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-af95c01e-61e5-4d59-9c38-8f1ebce52249 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 200 len: 1368 microversion: 2.1 time: 0.424393 Oct 24 11:04:54.793435 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3216/6459] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:54 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 1368 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:54.847375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:04:54.847375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:04:54.847375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:04:54.847375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:04:54.847375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:04:54.860969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:54.861751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:54.863929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:54.865112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:54.865828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:54.866520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:54.898291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Getting quotas for project d681efb474fb4d3bb62e07ca2d16bc33. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:04:54.905192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Getting quotas for user 97b622ac85ed493ab3c8a1761a480ada and project d681efb474fb4d3bb62e07ca2d16bc33. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:04:54.921508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:04:54.925360 n-d-858383-15 devstack@n-api.service[120426]: WARNING nova.utils [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-294952306-access_point-633844020 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-294952306-acc Oct 24 11:04:54.926484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:04:54.989698 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-701a49b4-f987-4188-85c8-9c86f48d9594 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 455 microversion: 2.1 time: 2.186375 Oct 24 11:04:54.999288 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3244/6460] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:04:52 2022] POST /compute/v2.1/servers => generated 455 bytes in 2197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 11:04:55.002827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cac63ea2-0421-45a6-afe7-915eaa669e69 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:55.003435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cac63ea2-0421-45a6-afe7-915eaa669e69 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:55.089168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cac63ea2-0421-45a6-afe7-915eaa669e69 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:55.096461 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cac63ea2-0421-45a6-afe7-915eaa669e69 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 200 len: 1293 microversion: 2.1 time: 0.098111 Oct 24 11:04:55.097092 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3217/6461] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:54 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:04:55.810638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-95662399-68ea-455c-84c9-259f90e124f6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:55.811272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-95662399-68ea-455c-84c9-259f90e124f6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:55.830130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95662399-68ea-455c-84c9-259f90e124f6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:55.830623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95662399-68ea-455c-84c9-259f90e124f6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:55.831074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95662399-68ea-455c-84c9-259f90e124f6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:55.831802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95662399-68ea-455c-84c9-259f90e124f6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:55.832273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95662399-68ea-455c-84c9-259f90e124f6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:55.832706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-95662399-68ea-455c-84c9-259f90e124f6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:56.126712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6a1f5b1c-0bef-487e-bcf3-6ef588760292 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:56.127538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6a1f5b1c-0bef-487e-bcf3-6ef588760292 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:56.147748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a1f5b1c-0bef-487e-bcf3-6ef588760292 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:56.148529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a1f5b1c-0bef-487e-bcf3-6ef588760292 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:56.149218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a1f5b1c-0bef-487e-bcf3-6ef588760292 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:56.150479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a1f5b1c-0bef-487e-bcf3-6ef588760292 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:56.151368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a1f5b1c-0bef-487e-bcf3-6ef588760292 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:56.152048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a1f5b1c-0bef-487e-bcf3-6ef588760292 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:56.208513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-95662399-68ea-455c-84c9-259f90e124f6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:56.217314 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-95662399-68ea-455c-84c9-259f90e124f6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 200 len: 1368 microversion: 2.1 time: 0.410421 Oct 24 11:04:56.233706 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3245/6462] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:55 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 1368 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:56.316019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6a1f5b1c-0bef-487e-bcf3-6ef588760292 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:56.325353 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6a1f5b1c-0bef-487e-bcf3-6ef588760292 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 200 len: 1345 microversion: 2.1 time: 0.206342 Oct 24 11:04:56.325953 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3218/6463] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:56 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 1345 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:57.241882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f45bb203-f726-4b1b-a7a9-779ee7990897 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:57.243659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f45bb203-f726-4b1b-a7a9-779ee7990897 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:57.257515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f45bb203-f726-4b1b-a7a9-779ee7990897 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:57.258277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f45bb203-f726-4b1b-a7a9-779ee7990897 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:57.261961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f45bb203-f726-4b1b-a7a9-779ee7990897 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:57.263056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f45bb203-f726-4b1b-a7a9-779ee7990897 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:57.263750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f45bb203-f726-4b1b-a7a9-779ee7990897 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:57.266599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f45bb203-f726-4b1b-a7a9-779ee7990897 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:57.356000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf07866d-b992-42ae-92c9-5197e8e91aeb tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:57.356402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bf07866d-b992-42ae-92c9-5197e8e91aeb tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:57.367212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf07866d-b992-42ae-92c9-5197e8e91aeb tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:57.367633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf07866d-b992-42ae-92c9-5197e8e91aeb tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:57.368079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf07866d-b992-42ae-92c9-5197e8e91aeb tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:57.368924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf07866d-b992-42ae-92c9-5197e8e91aeb tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:57.369286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf07866d-b992-42ae-92c9-5197e8e91aeb tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:57.369750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf07866d-b992-42ae-92c9-5197e8e91aeb tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:57.602930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bf07866d-b992-42ae-92c9-5197e8e91aeb tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:57.620450 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bf07866d-b992-42ae-92c9-5197e8e91aeb tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 200 len: 1351 microversion: 2.1 time: 0.270280 Oct 24 11:04:57.624076 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3219/6464] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:57 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 1351 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:57.792869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f45bb203-f726-4b1b-a7a9-779ee7990897 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:57.814744 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f45bb203-f726-4b1b-a7a9-779ee7990897 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 200 len: 1368 microversion: 2.1 time: 0.578036 Oct 24 11:04:57.815768 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3246/6465] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:57 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 1368 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:04:58.079903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-2d5b698f-3f44-4a1e-aa43-3b43a6a7861d req-18dbc11a-58e1-4ae8-8159-4dc0e75e5333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae5a9df-d2fa-4caf-829d-87fb3b799065", "name": "network-vif-plugged", "status": "completed", "tag": "6a025f8a-9c84-4a4d-a522-9e55fb01c45d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:58.103465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2d5b698f-3f44-4a1e-aa43-3b43a6a7861d req-18dbc11a-58e1-4ae8-8159-4dc0e75e5333 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:58.104125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2d5b698f-3f44-4a1e-aa43-3b43a6a7861d req-18dbc11a-58e1-4ae8-8159-4dc0e75e5333 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:58.104592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2d5b698f-3f44-4a1e-aa43-3b43a6a7861d req-18dbc11a-58e1-4ae8-8159-4dc0e75e5333 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:58.138152 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-2d5b698f-3f44-4a1e-aa43-3b43a6a7861d req-18dbc11a-58e1-4ae8-8159-4dc0e75e5333 service nova] Creating event network-vif-plugged:6a025f8a-9c84-4a4d-a522-9e55fb01c45d for instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 on n-h2-858383-15 Oct 24 11:04:58.145688 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-2d5b698f-3f44-4a1e-aa43-3b43a6a7861d req-18dbc11a-58e1-4ae8-8159-4dc0e75e5333 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073173 Oct 24 11:04:58.146908 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3220/6466] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:04:58.646591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5fb121b8-9a16-46ce-b065-b31e5e68e9a6 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:58.647218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5fb121b8-9a16-46ce-b065-b31e5e68e9a6 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:58.664717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fb121b8-9a16-46ce-b065-b31e5e68e9a6 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:58.665268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fb121b8-9a16-46ce-b065-b31e5e68e9a6 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:58.665720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fb121b8-9a16-46ce-b065-b31e5e68e9a6 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:58.666459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fb121b8-9a16-46ce-b065-b31e5e68e9a6 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:58.666921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fb121b8-9a16-46ce-b065-b31e5e68e9a6 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:58.667615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5fb121b8-9a16-46ce-b065-b31e5e68e9a6 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:58.846438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d1e57a8b-3ac1-4170-a168-014debdb5786 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:04:58.847675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d1e57a8b-3ac1-4170-a168-014debdb5786 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:04:58.869483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1e57a8b-3ac1-4170-a168-014debdb5786 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:58.878825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1e57a8b-3ac1-4170-a168-014debdb5786 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:58.879547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1e57a8b-3ac1-4170-a168-014debdb5786 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:58.880490 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1e57a8b-3ac1-4170-a168-014debdb5786 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:58.881175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1e57a8b-3ac1-4170-a168-014debdb5786 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:58.882882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1e57a8b-3ac1-4170-a168-014debdb5786 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:59.109214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5fb121b8-9a16-46ce-b065-b31e5e68e9a6 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:59.130490 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5fb121b8-9a16-46ce-b065-b31e5e68e9a6 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 200 len: 1468 microversion: 2.1 time: 0.487986 Oct 24 11:04:59.132293 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3247/6467] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:58 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 1468 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:04:59.168847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d1e57a8b-3ac1-4170-a168-014debdb5786 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:04:59.184485 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d1e57a8b-3ac1-4170-a168-014debdb5786 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 200 len: 1368 microversion: 2.1 time: 0.345413 Oct 24 11:04:59.192816 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3221/6468] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:04:58 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 1368 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:04:59.297534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-6f70985f-4e0e-4e34-8652-ddb6605eb460 req-293cdece-f4cb-442c-8579-179805970c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131f69b2-1939-4211-a289-c03759f7d383", "tag": "f76e9ba4-25d3-4a1b-b12a-3970c21f0da4"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:04:59.320544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6f70985f-4e0e-4e34-8652-ddb6605eb460 req-293cdece-f4cb-442c-8579-179805970c2d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:04:59.323567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6f70985f-4e0e-4e34-8652-ddb6605eb460 req-293cdece-f4cb-442c-8579-179805970c2d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:04:59.324316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6f70985f-4e0e-4e34-8652-ddb6605eb460 req-293cdece-f4cb-442c-8579-179805970c2d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:04:59.359633 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-6f70985f-4e0e-4e34-8652-ddb6605eb460 req-293cdece-f4cb-442c-8579-179805970c2d service nova] Creating event network-changed:f76e9ba4-25d3-4a1b-b12a-3970c21f0da4 for instance 131f69b2-1939-4211-a289-c03759f7d383 on n-h1-858383-15 Oct 24 11:04:59.365996 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-6f70985f-4e0e-4e34-8652-ddb6605eb460 req-293cdece-f4cb-442c-8579-179805970c2d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072960 Oct 24 11:04:59.368477 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3248/6469] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:05:00.153941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-55a7e209-dd88-4b5d-8dbb-16fdd844abf7 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:00.154556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-55a7e209-dd88-4b5d-8dbb-16fdd844abf7 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:00.163265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-55a7e209-dd88-4b5d-8dbb-16fdd844abf7 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:00.163909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-55a7e209-dd88-4b5d-8dbb-16fdd844abf7 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:00.164350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-55a7e209-dd88-4b5d-8dbb-16fdd844abf7 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:00.165135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-55a7e209-dd88-4b5d-8dbb-16fdd844abf7 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:00.165544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-55a7e209-dd88-4b5d-8dbb-16fdd844abf7 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:00.166156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-55a7e209-dd88-4b5d-8dbb-16fdd844abf7 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:00.221087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5b0a7707-01c4-47ac-a00c-713acf8382b9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:00.222128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5b0a7707-01c4-47ac-a00c-713acf8382b9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:00.242788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b0a7707-01c4-47ac-a00c-713acf8382b9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:00.243785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b0a7707-01c4-47ac-a00c-713acf8382b9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:00.245379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b0a7707-01c4-47ac-a00c-713acf8382b9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:00.246507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b0a7707-01c4-47ac-a00c-713acf8382b9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:00.252612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b0a7707-01c4-47ac-a00c-713acf8382b9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:00.253404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b0a7707-01c4-47ac-a00c-713acf8382b9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:00.487372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-55a7e209-dd88-4b5d-8dbb-16fdd844abf7 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:05:00.499221 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-55a7e209-dd88-4b5d-8dbb-16fdd844abf7 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 200 len: 1468 microversion: 2.1 time: 0.349105 Oct 24 11:05:00.513464 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3222/6470] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:05:00 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 1468 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:05:00.543676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5b0a7707-01c4-47ac-a00c-713acf8382b9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:05:00.552560 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5b0a7707-01c4-47ac-a00c-713acf8382b9 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 200 len: 1558 microversion: 2.1 time: 0.336902 Oct 24 11:05:00.554083 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3249/6471] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:05:00 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 1558 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:05:00.582957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eb123ec8-40bf-4f8e-9977-7a52e471f889 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:00.583738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eb123ec8-40bf-4f8e-9977-7a52e471f889 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:00.592855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb123ec8-40bf-4f8e-9977-7a52e471f889 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:00.593489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb123ec8-40bf-4f8e-9977-7a52e471f889 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:00.594781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb123ec8-40bf-4f8e-9977-7a52e471f889 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:00.595854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb123ec8-40bf-4f8e-9977-7a52e471f889 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:00.596542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb123ec8-40bf-4f8e-9977-7a52e471f889 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:00.597246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eb123ec8-40bf-4f8e-9977-7a52e471f889 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:00.698154 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eb123ec8-40bf-4f8e-9977-7a52e471f889 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120840 Oct 24 11:05:00.699079 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3223/6472] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 11:05:00 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:05:01.527946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1011e4e4-c9e7-43bc-8a61-6a84e1170b83 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:01.529331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1011e4e4-c9e7-43bc-8a61-6a84e1170b83 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:01.539578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1011e4e4-c9e7-43bc-8a61-6a84e1170b83 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:01.540522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1011e4e4-c9e7-43bc-8a61-6a84e1170b83 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:01.541206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1011e4e4-c9e7-43bc-8a61-6a84e1170b83 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:01.542221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1011e4e4-c9e7-43bc-8a61-6a84e1170b83 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:01.543213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1011e4e4-c9e7-43bc-8a61-6a84e1170b83 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:01.543879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1011e4e4-c9e7-43bc-8a61-6a84e1170b83 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:02.221634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1011e4e4-c9e7-43bc-8a61-6a84e1170b83 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:05:02.233509 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1011e4e4-c9e7-43bc-8a61-6a84e1170b83 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 200 len: 1468 microversion: 2.1 time: 0.709927 Oct 24 11:05:02.236256 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3250/6473] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:05:01 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 1468 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:05:02.513115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-2a64ad33-3137-41cc-8c36-9f8637a233bb req-520588be-00f7-4a9e-aab6-5bc6fd92b9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ae5a9df-d2fa-4caf-829d-87fb3b799065", "tag": "6a025f8a-9c84-4a4d-a522-9e55fb01c45d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:05:02.532763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2a64ad33-3137-41cc-8c36-9f8637a233bb req-520588be-00f7-4a9e-aab6-5bc6fd92b9f9 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:02.537682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2a64ad33-3137-41cc-8c36-9f8637a233bb req-520588be-00f7-4a9e-aab6-5bc6fd92b9f9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:02.538148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2a64ad33-3137-41cc-8c36-9f8637a233bb req-520588be-00f7-4a9e-aab6-5bc6fd92b9f9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:02.561038 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-2a64ad33-3137-41cc-8c36-9f8637a233bb req-520588be-00f7-4a9e-aab6-5bc6fd92b9f9 service nova] Creating event network-changed:6a025f8a-9c84-4a4d-a522-9e55fb01c45d for instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 on n-h2-858383-15 Oct 24 11:05:02.571142 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-2a64ad33-3137-41cc-8c36-9f8637a233bb req-520588be-00f7-4a9e-aab6-5bc6fd92b9f9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062625 Oct 24 11:05:02.577293 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3224/6474] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:05:03.262995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a05c9838-815e-4e74-ba3c-6f61c82e1ea1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:03.263698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a05c9838-815e-4e74-ba3c-6f61c82e1ea1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:03.270730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a05c9838-815e-4e74-ba3c-6f61c82e1ea1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:03.271310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a05c9838-815e-4e74-ba3c-6f61c82e1ea1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:03.272066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a05c9838-815e-4e74-ba3c-6f61c82e1ea1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:03.272975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a05c9838-815e-4e74-ba3c-6f61c82e1ea1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:03.273511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a05c9838-815e-4e74-ba3c-6f61c82e1ea1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:03.274183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a05c9838-815e-4e74-ba3c-6f61c82e1ea1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:03.457942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a05c9838-815e-4e74-ba3c-6f61c82e1ea1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:05:03.466179 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a05c9838-815e-4e74-ba3c-6f61c82e1ea1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 200 len: 1468 microversion: 2.1 time: 0.209623 Oct 24 11:05:03.466903 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3251/6475] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:05:03 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 1468 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:05:04.492130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2185a4cb-86f6-4a82-856f-d2d146c3b294 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:04.492855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2185a4cb-86f6-4a82-856f-d2d146c3b294 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:04.496112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:05:04.504205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2185a4cb-86f6-4a82-856f-d2d146c3b294 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:04.505082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2185a4cb-86f6-4a82-856f-d2d146c3b294 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:04.505723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2185a4cb-86f6-4a82-856f-d2d146c3b294 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:04.507136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2185a4cb-86f6-4a82-856f-d2d146c3b294 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:04.508159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2185a4cb-86f6-4a82-856f-d2d146c3b294 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:04.508788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2185a4cb-86f6-4a82-856f-d2d146c3b294 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:04.671636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2185a4cb-86f6-4a82-856f-d2d146c3b294 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:05:04.680759 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2185a4cb-86f6-4a82-856f-d2d146c3b294 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 200 len: 1468 microversion: 2.1 time: 0.192958 Oct 24 11:05:04.681566 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3225/6476] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:05:04 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 1468 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:05:05.705183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9390b718-b3a1-4645-a6d7-cbe182c37958 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:05.706613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9390b718-b3a1-4645-a6d7-cbe182c37958 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:05.712985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:05:05.713749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:05:05.715830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9390b718-b3a1-4645-a6d7-cbe182c37958 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:05.716536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9390b718-b3a1-4645-a6d7-cbe182c37958 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:05.717284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9390b718-b3a1-4645-a6d7-cbe182c37958 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:05.718126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9390b718-b3a1-4645-a6d7-cbe182c37958 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:05.718785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9390b718-b3a1-4645-a6d7-cbe182c37958 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:05.719770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9390b718-b3a1-4645-a6d7-cbe182c37958 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:05.911060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9390b718-b3a1-4645-a6d7-cbe182c37958 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:05:05.919539 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9390b718-b3a1-4645-a6d7-cbe182c37958 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 200 len: 1468 microversion: 2.1 time: 0.218917 Oct 24 11:05:05.920122 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3252/6477] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:05:05 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 1468 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:05:06.561497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-73098ab0-ca09-4281-97b7-615d56c3231c req-9cbd9995-6c67-40b3-a9ad-0f1967591d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131f69b2-1939-4211-a289-c03759f7d383", "name": "network-vif-plugged", "status": "completed", "tag": "f76e9ba4-25d3-4a1b-b12a-3970c21f0da4"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:05:06.571140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:05:06.574402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-73098ab0-ca09-4281-97b7-615d56c3231c req-9cbd9995-6c67-40b3-a9ad-0f1967591d45 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:06.574913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-73098ab0-ca09-4281-97b7-615d56c3231c req-9cbd9995-6c67-40b3-a9ad-0f1967591d45 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:06.575472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-73098ab0-ca09-4281-97b7-615d56c3231c req-9cbd9995-6c67-40b3-a9ad-0f1967591d45 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:06.588757 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-73098ab0-ca09-4281-97b7-615d56c3231c req-9cbd9995-6c67-40b3-a9ad-0f1967591d45 service nova] Creating event network-vif-plugged:f76e9ba4-25d3-4a1b-b12a-3970c21f0da4 for instance 131f69b2-1939-4211-a289-c03759f7d383 on n-h1-858383-15 Oct 24 11:05:06.593738 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-73098ab0-ca09-4281-97b7-615d56c3231c req-9cbd9995-6c67-40b3-a9ad-0f1967591d45 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036429 Oct 24 11:05:06.594399 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3226/6478] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:05:06.943420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-67a8560e-6dfc-414b-ae81-ca3564d2b8ae tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:06.944163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-67a8560e-6dfc-414b-ae81-ca3564d2b8ae tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:06.951315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-67a8560e-6dfc-414b-ae81-ca3564d2b8ae tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:06.951854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-67a8560e-6dfc-414b-ae81-ca3564d2b8ae tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:06.952330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-67a8560e-6dfc-414b-ae81-ca3564d2b8ae tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:06.953138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-67a8560e-6dfc-414b-ae81-ca3564d2b8ae tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:06.953628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-67a8560e-6dfc-414b-ae81-ca3564d2b8ae tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:06.954055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-67a8560e-6dfc-414b-ae81-ca3564d2b8ae tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:07.093286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-67a8560e-6dfc-414b-ae81-ca3564d2b8ae tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:05:07.101433 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-67a8560e-6dfc-414b-ae81-ca3564d2b8ae tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 200 len: 1468 microversion: 2.1 time: 0.162183 Oct 24 11:05:07.102149 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3253/6479] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:05:06 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 1468 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:05:08.125289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4dc87efe-90fe-4219-a22d-5a33ded2e21d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:08.126735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4dc87efe-90fe-4219-a22d-5a33ded2e21d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:08.133247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4dc87efe-90fe-4219-a22d-5a33ded2e21d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:08.133747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4dc87efe-90fe-4219-a22d-5a33ded2e21d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:08.134199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4dc87efe-90fe-4219-a22d-5a33ded2e21d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:08.135096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4dc87efe-90fe-4219-a22d-5a33ded2e21d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:08.135368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4dc87efe-90fe-4219-a22d-5a33ded2e21d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:08.135803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4dc87efe-90fe-4219-a22d-5a33ded2e21d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:08.305595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4dc87efe-90fe-4219-a22d-5a33ded2e21d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:05:08.314197 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4dc87efe-90fe-4219-a22d-5a33ded2e21d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 200 len: 1468 microversion: 2.1 time: 0.194249 Oct 24 11:05:08.314769 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3227/6480] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:05:08 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 1468 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:05:09.338192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3fa2f9ce-1a71-4e15-b3d8-b9f310c86f72 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:09.338883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3fa2f9ce-1a71-4e15-b3d8-b9f310c86f72 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:09.346711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fa2f9ce-1a71-4e15-b3d8-b9f310c86f72 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:09.347203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fa2f9ce-1a71-4e15-b3d8-b9f310c86f72 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:09.347649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fa2f9ce-1a71-4e15-b3d8-b9f310c86f72 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:09.348354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fa2f9ce-1a71-4e15-b3d8-b9f310c86f72 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:09.348812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fa2f9ce-1a71-4e15-b3d8-b9f310c86f72 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:09.349267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3fa2f9ce-1a71-4e15-b3d8-b9f310c86f72 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:09.351899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=85 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:05:09.503879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3fa2f9ce-1a71-4e15-b3d8-b9f310c86f72 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:05:09.512257 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3fa2f9ce-1a71-4e15-b3d8-b9f310c86f72 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 200 len: 1639 microversion: 2.1 time: 0.178422 Oct 24 11:05:09.512867 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3254/6481] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:05:09 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 1639 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:05:09.536038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5224a695-74c9-4c08-88d2-602b1f54de4e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:09.536655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5224a695-74c9-4c08-88d2-602b1f54de4e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:09.543883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5224a695-74c9-4c08-88d2-602b1f54de4e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:09.544372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5224a695-74c9-4c08-88d2-602b1f54de4e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:09.544812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5224a695-74c9-4c08-88d2-602b1f54de4e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:09.545549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5224a695-74c9-4c08-88d2-602b1f54de4e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:09.546100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5224a695-74c9-4c08-88d2-602b1f54de4e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:09.546459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5224a695-74c9-4c08-88d2-602b1f54de4e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:09.697179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5224a695-74c9-4c08-88d2-602b1f54de4e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:05:09.706011 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5224a695-74c9-4c08-88d2-602b1f54de4e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 200 len: 1639 microversion: 2.1 time: 0.174663 Oct 24 11:05:09.706619 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3228/6482] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:05:09 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 1639 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:05:09.731533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e8a43524-e3e9-4ee7-aea3-469bb212674e tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:09.732259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e8a43524-e3e9-4ee7-aea3-469bb212674e tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:09.738661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8a43524-e3e9-4ee7-aea3-469bb212674e tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:09.739217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8a43524-e3e9-4ee7-aea3-469bb212674e tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:09.739745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8a43524-e3e9-4ee7-aea3-469bb212674e tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:09.740512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8a43524-e3e9-4ee7-aea3-469bb212674e tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:09.741063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8a43524-e3e9-4ee7-aea3-469bb212674e tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:09.741557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e8a43524-e3e9-4ee7-aea3-469bb212674e tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:10.019358 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e8a43524-e3e9-4ee7-aea3-469bb212674e tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 200 len: 1792 microversion: 2.1 time: 0.291420 Oct 24 11:05:10.020120 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3255/6483] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:05:09 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 1792 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:05:11.731850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e598b1ad-fd4b-4619-98c1-cfc0b5a06245 req-1bcaab99-1796-4f4d-97cd-81eb3240b448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131f69b2-1939-4211-a289-c03759f7d383", "tag": "f76e9ba4-25d3-4a1b-b12a-3970c21f0da4"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:05:11.753246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e598b1ad-fd4b-4619-98c1-cfc0b5a06245 req-1bcaab99-1796-4f4d-97cd-81eb3240b448 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:11.753680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e598b1ad-fd4b-4619-98c1-cfc0b5a06245 req-1bcaab99-1796-4f4d-97cd-81eb3240b448 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:11.754185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e598b1ad-fd4b-4619-98c1-cfc0b5a06245 req-1bcaab99-1796-4f4d-97cd-81eb3240b448 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:11.780257 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e598b1ad-fd4b-4619-98c1-cfc0b5a06245 req-1bcaab99-1796-4f4d-97cd-81eb3240b448 service nova] Creating event network-changed:f76e9ba4-25d3-4a1b-b12a-3970c21f0da4 for instance 131f69b2-1939-4211-a289-c03759f7d383 on n-h1-858383-15 Oct 24 11:05:11.814747 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e598b1ad-fd4b-4619-98c1-cfc0b5a06245 req-1bcaab99-1796-4f4d-97cd-81eb3240b448 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086428 Oct 24 11:05:11.815467 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3229/6484] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:05:34.880394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3ecf9e7-cbdd-4c8c-b72d-a90641a73cf6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:34.881365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f3ecf9e7-cbdd-4c8c-b72d-a90641a73cf6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:34.884087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:05:34.884771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=11 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:05:34.890830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3ecf9e7-cbdd-4c8c-b72d-a90641a73cf6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:34.891641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3ecf9e7-cbdd-4c8c-b72d-a90641a73cf6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:34.892136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3ecf9e7-cbdd-4c8c-b72d-a90641a73cf6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:34.892861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3ecf9e7-cbdd-4c8c-b72d-a90641a73cf6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:34.893336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3ecf9e7-cbdd-4c8c-b72d-a90641a73cf6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:34.893770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3ecf9e7-cbdd-4c8c-b72d-a90641a73cf6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:34.926113 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f3ecf9e7-cbdd-4c8c-b72d-a90641a73cf6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/ips" status: 200 len: 150 microversion: 2.1 time: 0.050148 Oct 24 11:05:34.929019 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3256/6485] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Oct 24 11:05:34 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/ips => generated 150 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:05:36.332440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=9 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:05:36.333348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=71 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:05:36.338196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5dd28aeb-d341-4a5f-a15c-a54cd7488f79 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e95b7cf-86dd-4ba8-b7f9-5d3993349068"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:05:36.340988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5dd28aeb-d341-4a5f-a15c-a54cd7488f79 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:36.348484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dd28aeb-d341-4a5f-a15c-a54cd7488f79 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:36.349041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dd28aeb-d341-4a5f-a15c-a54cd7488f79 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:36.349495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dd28aeb-d341-4a5f-a15c-a54cd7488f79 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:36.350311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dd28aeb-d341-4a5f-a15c-a54cd7488f79 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:36.350779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dd28aeb-d341-4a5f-a15c-a54cd7488f79 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:36.351217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5dd28aeb-d341-4a5f-a15c-a54cd7488f79 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:36.632941 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5dd28aeb-d341-4a5f-a15c-a54cd7488f79 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "POST /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302297 Oct 24 11:05:36.633561 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3230/6486] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 11:05:36 2022] POST /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:05:36.849259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7e9b4aa4-bb20-44b1-b6f6-e0bb923d5049 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:36.849785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7e9b4aa4-bb20-44b1-b6f6-e0bb923d5049 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:36.857174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e9b4aa4-bb20-44b1-b6f6-e0bb923d5049 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:36.857664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e9b4aa4-bb20-44b1-b6f6-e0bb923d5049 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:36.858102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e9b4aa4-bb20-44b1-b6f6-e0bb923d5049 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:36.858808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e9b4aa4-bb20-44b1-b6f6-e0bb923d5049 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:36.859264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e9b4aa4-bb20-44b1-b6f6-e0bb923d5049 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:36.859690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7e9b4aa4-bb20-44b1-b6f6-e0bb923d5049 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:36.946116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-7e9b4aa4-bb20-44b1-b6f6-e0bb923d5049 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lazy-loading 'services' on Instance uuid 0afbaab5-70da-4f20-979f-79a69b8648bd {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:05:37.020712 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7e9b4aa4-bb20-44b1-b6f6-e0bb923d5049 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd/os-volume_attachments/e9fa4815-6f91-4baf-a510-185e7b32fce3" status: 202 len: 0 microversion: 2.1 time: 0.175969 Oct 24 11:05:37.021473 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3257/6487] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 11:05:36 2022] DELETE /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd/os-volume_attachments/e9fa4815-6f91-4baf-a510-185e7b32fce3 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:05:43.896673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5c02dff2-f3e0-4971-894a-c992ed8d9ee7 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:43.897435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c02dff2-f3e0-4971-894a-c992ed8d9ee7 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:43.912945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c02dff2-f3e0-4971-894a-c992ed8d9ee7 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:43.913512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c02dff2-f3e0-4971-894a-c992ed8d9ee7 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:43.914052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c02dff2-f3e0-4971-894a-c992ed8d9ee7 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:43.914890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c02dff2-f3e0-4971-894a-c992ed8d9ee7 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:43.915717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c02dff2-f3e0-4971-894a-c992ed8d9ee7 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:43.916462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c02dff2-f3e0-4971-894a-c992ed8d9ee7 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:43.962166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c02dff2-f3e0-4971-894a-c992ed8d9ee7 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:05:44.040520 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5c02dff2-f3e0-4971-894a-c992ed8d9ee7 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd" status: 204 len: 0 microversion: 2.1 time: 0.147822 Oct 24 11:05:44.041107 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3231/6488] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:05:43 2022] DELETE /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:05:44.051753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-abdef58c-beea-4e40-b50a-274a55c0eeac tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:44.052470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-abdef58c-beea-4e40-b50a-274a55c0eeac tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:44.058805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abdef58c-beea-4e40-b50a-274a55c0eeac tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:44.059298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abdef58c-beea-4e40-b50a-274a55c0eeac tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:44.059744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abdef58c-beea-4e40-b50a-274a55c0eeac tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:44.060442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abdef58c-beea-4e40-b50a-274a55c0eeac tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:44.060926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abdef58c-beea-4e40-b50a-274a55c0eeac tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:44.061357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-abdef58c-beea-4e40-b50a-274a55c0eeac tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:44.197327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-abdef58c-beea-4e40-b50a-274a55c0eeac tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367bc74d6ff47cc9cdc503df1e1448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca94fa33c46c404190805fb219d3881a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:05:44.206365 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-abdef58c-beea-4e40-b50a-274a55c0eeac tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd" status: 200 len: 1467 microversion: 2.1 time: 0.159968 Oct 24 11:05:44.206947 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3258/6489] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:05:44 2022] GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd => generated 1467 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:05:45.230859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a020ac65-4ea9-42a6-bdeb-5e1784d28a82 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:45.231482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a020ac65-4ea9-42a6-bdeb-5e1784d28a82 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:45.240177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a020ac65-4ea9-42a6-bdeb-5e1784d28a82 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:45.240672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a020ac65-4ea9-42a6-bdeb-5e1784d28a82 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:45.241154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a020ac65-4ea9-42a6-bdeb-5e1784d28a82 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:45.241873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a020ac65-4ea9-42a6-bdeb-5e1784d28a82 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:45.242330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a020ac65-4ea9-42a6-bdeb-5e1784d28a82 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:45.242761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a020ac65-4ea9-42a6-bdeb-5e1784d28a82 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:45.385293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a020ac65-4ea9-42a6-bdeb-5e1784d28a82 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367bc74d6ff47cc9cdc503df1e1448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca94fa33c46c404190805fb219d3881a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:05:45.393713 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a020ac65-4ea9-42a6-bdeb-5e1784d28a82 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd" status: 200 len: 1467 microversion: 2.1 time: 0.167230 Oct 24 11:05:45.394510 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3232/6490] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:05:45 2022] GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd => generated 1467 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:05:46.417897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dc66622c-8796-465e-a05d-8feb45ac8a3e tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:46.419490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dc66622c-8796-465e-a05d-8feb45ac8a3e tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:46.427248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc66622c-8796-465e-a05d-8feb45ac8a3e tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:46.427739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc66622c-8796-465e-a05d-8feb45ac8a3e tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:46.428183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc66622c-8796-465e-a05d-8feb45ac8a3e tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:46.428932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc66622c-8796-465e-a05d-8feb45ac8a3e tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:46.429394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc66622c-8796-465e-a05d-8feb45ac8a3e tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:46.429826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc66622c-8796-465e-a05d-8feb45ac8a3e tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:46.454384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-95a9ed1e-dd67-4f48-a236-dca3eefc378e req-ab293885-393a-4aeb-b5c0-f71d9ac9ae4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0afbaab5-70da-4f20-979f-79a69b8648bd", "name": "network-vif-deleted", "tag": "4dfda9ef-db1b-41e5-b430-f6a70b435d91"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:05:46.464704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-95a9ed1e-dd67-4f48-a236-dca3eefc378e req-ab293885-393a-4aeb-b5c0-f71d9ac9ae4b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:46.465290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-95a9ed1e-dd67-4f48-a236-dca3eefc378e req-ab293885-393a-4aeb-b5c0-f71d9ac9ae4b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:46.465923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-95a9ed1e-dd67-4f48-a236-dca3eefc378e req-ab293885-393a-4aeb-b5c0-f71d9ac9ae4b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:46.478721 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-95a9ed1e-dd67-4f48-a236-dca3eefc378e req-ab293885-393a-4aeb-b5c0-f71d9ac9ae4b service nova] Creating event network-vif-deleted:4dfda9ef-db1b-41e5-b430-f6a70b435d91 for instance 0afbaab5-70da-4f20-979f-79a69b8648bd on n-h1-858383-15 Oct 24 11:05:46.483527 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-95a9ed1e-dd67-4f48-a236-dca3eefc378e req-ab293885-393a-4aeb-b5c0-f71d9ac9ae4b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033302 Oct 24 11:05:46.484135 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3233/6491] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:05:46.506338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dc66622c-8796-465e-a05d-8feb45ac8a3e tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367bc74d6ff47cc9cdc503df1e1448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca94fa33c46c404190805fb219d3881a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:05:46.514584 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dc66622c-8796-465e-a05d-8feb45ac8a3e tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd" status: 200 len: 1425 microversion: 2.1 time: 0.101136 Oct 24 11:05:46.515171 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3259/6492] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:05:46 2022] GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd => generated 1425 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:05:47.540492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-943a6e85-f7fb-4b6b-9a22-d427e1199875 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:47.541227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-943a6e85-f7fb-4b6b-9a22-d427e1199875 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] [instance: 0afbaab5-70da-4f20-979f-79a69b8648bd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:47.548464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-943a6e85-f7fb-4b6b-9a22-d427e1199875 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:47.548988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-943a6e85-f7fb-4b6b-9a22-d427e1199875 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:47.549427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-943a6e85-f7fb-4b6b-9a22-d427e1199875 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:47.550120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-943a6e85-f7fb-4b6b-9a22-d427e1199875 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:47.550575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-943a6e85-f7fb-4b6b-9a22-d427e1199875 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:47.551012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-943a6e85-f7fb-4b6b-9a22-d427e1199875 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:47.564361 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-943a6e85-f7fb-4b6b-9a22-d427e1199875 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] HTTP exception thrown: Instance 0afbaab5-70da-4f20-979f-79a69b8648bd could not be found. Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-943a6e85-f7fb-4b6b-9a22-d427e1199875 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Request method failure captured: Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd HTTP/1.1 Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnEg1OMs0fs5O-TyH_JGfwFLduRlMMILH-rHwmoM96AhfbPiBo_IwCHWh01ZhXAZFPzZUxRgNdLzYgDvphVf1c74tn81aWTgGVDL_y527lZ5khkYbnwSmmeYtQc9uesH3dAmd8f5KiOM3l-afhCHR1P9FWeC6jNlwOziLlerIjxiVpE Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: ca94fa33c46c404190805fb219d3881a Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesBackupsTest-299628743 Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ca94fa33c46c404190805fb219d3881a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ca94fa33c46c404190805fb219d3881a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ca94fa33c46c404190805fb219d3881a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ca94fa33c46c404190805fb219d3881a", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-VolumesBackupsTest-299628743 Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: ca94fa33c46c404190805fb219d3881a Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesBackupsTest-299628743 Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-VolumesBackupsTest-299628743-project Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 2367bc74d6ff47cc9cdc503df1e1448d Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-VolumesBackupsTest-299628743-project Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 0afbaab5-70da-4f20-979f-79a69b8648bd could not be found. Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '0afbaab5-70da-4f20-979f-79a69b8648bd'} Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0afbaab5-70da-4f20-979f-79a69b8648bd could not be found. Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0afbaab5-70da-4f20-979f-79a69b8648bd could not be found. Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:05:47.565992 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:05:47.571127 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:05:47.571127 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:05:47.571127 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:05:47.571127 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:05:47.571127 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:05:47.571127 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0afbaab5-70da-4f20-979f-79a69b8648bd could not be found. Oct 24 11:05:47.571127 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:05:47.571127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-943a6e85-f7fb-4b6b-9a22-d427e1199875 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] Returning 404 to user: Instance 0afbaab5-70da-4f20-979f-79a69b8648bd could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:05:47.571127 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-943a6e85-f7fb-4b6b-9a22-d427e1199875 tempest-VolumesBackupsTest-299628743 tempest-VolumesBackupsTest-299628743-project] 10.222.0.50 "GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd" status: 404 len: 111 microversion: 2.1 time: 0.032066 Oct 24 11:05:47.571127 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3234/6493] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:05:47 2022] GET /compute/v2.1/servers/0afbaab5-70da-4f20-979f-79a69b8648bd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:05:51.572334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c811498a-5f75-4a57-9a75-2c2c5aca2f32 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:51.572854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c811498a-5f75-4a57-9a75-2c2c5aca2f32 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:51.579891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c811498a-5f75-4a57-9a75-2c2c5aca2f32 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:51.580384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c811498a-5f75-4a57-9a75-2c2c5aca2f32 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:51.580828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c811498a-5f75-4a57-9a75-2c2c5aca2f32 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:51.581561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c811498a-5f75-4a57-9a75-2c2c5aca2f32 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:51.582031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c811498a-5f75-4a57-9a75-2c2c5aca2f32 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:51.582452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c811498a-5f75-4a57-9a75-2c2c5aca2f32 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:51.679248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-c811498a-5f75-4a57-9a75-2c2c5aca2f32 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lazy-loading 'services' on Instance uuid 2ae5a9df-d2fa-4caf-829d-87fb3b799065 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:05:51.757506 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c811498a-5f75-4a57-9a75-2c2c5aca2f32 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/os-volume_attachments/9e95b7cf-86dd-4ba8-b7f9-5d3993349068" status: 202 len: 0 microversion: 2.1 time: 0.189216 Oct 24 11:05:51.758197 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3260/6494] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 11:05:51 2022] DELETE /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/os-volume_attachments/9e95b7cf-86dd-4ba8-b7f9-5d3993349068 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:05:51.767169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c583471f-3f89-44a7-b6bd-eae1f155098a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:51.769380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c583471f-3f89-44a7-b6bd-eae1f155098a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:51.780087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c583471f-3f89-44a7-b6bd-eae1f155098a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:51.780593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c583471f-3f89-44a7-b6bd-eae1f155098a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:51.781065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c583471f-3f89-44a7-b6bd-eae1f155098a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:51.781846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c583471f-3f89-44a7-b6bd-eae1f155098a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:51.782631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c583471f-3f89-44a7-b6bd-eae1f155098a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:51.783269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c583471f-3f89-44a7-b6bd-eae1f155098a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:51.816625 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c583471f-3f89-44a7-b6bd-eae1f155098a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053831 Oct 24 11:05:51.817168 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3235/6495] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:05:51 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:05:52.831063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6b5ab248-5361-4802-bf80-99fb85228589 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:52.833893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6b5ab248-5361-4802-bf80-99fb85228589 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:52.842972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b5ab248-5361-4802-bf80-99fb85228589 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:52.843773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b5ab248-5361-4802-bf80-99fb85228589 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:52.844976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b5ab248-5361-4802-bf80-99fb85228589 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:52.845958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b5ab248-5361-4802-bf80-99fb85228589 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:52.846490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b5ab248-5361-4802-bf80-99fb85228589 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:52.847016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b5ab248-5361-4802-bf80-99fb85228589 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:52.881509 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6b5ab248-5361-4802-bf80-99fb85228589 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055629 Oct 24 11:05:52.882117 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3261/6496] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:05:52 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:05:53.894754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1b8437e9-3a08-4ebc-85c1-b4e2ee83f631 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:53.897256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1b8437e9-3a08-4ebc-85c1-b4e2ee83f631 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:53.904993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b8437e9-3a08-4ebc-85c1-b4e2ee83f631 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:53.905785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b8437e9-3a08-4ebc-85c1-b4e2ee83f631 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:53.906235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b8437e9-3a08-4ebc-85c1-b4e2ee83f631 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:53.907801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b8437e9-3a08-4ebc-85c1-b4e2ee83f631 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:53.908375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b8437e9-3a08-4ebc-85c1-b4e2ee83f631 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:53.908816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b8437e9-3a08-4ebc-85c1-b4e2ee83f631 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:53.945537 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1b8437e9-3a08-4ebc-85c1-b4e2ee83f631 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055394 Oct 24 11:05:53.946334 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3236/6497] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:05:53 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:05:54.959070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e41f62af-3046-424c-8dc1-fa5c6391077a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:54.961275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e41f62af-3046-424c-8dc1-fa5c6391077a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:54.968660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e41f62af-3046-424c-8dc1-fa5c6391077a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:54.969766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e41f62af-3046-424c-8dc1-fa5c6391077a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:54.970293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e41f62af-3046-424c-8dc1-fa5c6391077a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:54.971011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e41f62af-3046-424c-8dc1-fa5c6391077a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:54.971743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e41f62af-3046-424c-8dc1-fa5c6391077a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:54.972199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e41f62af-3046-424c-8dc1-fa5c6391077a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:55.008527 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e41f62af-3046-424c-8dc1-fa5c6391077a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054482 Oct 24 11:05:55.013932 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3262/6498] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:05:54 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:05:56.022048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6faf63aa-c1de-452c-90c0-40653af3f27c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:56.024988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6faf63aa-c1de-452c-90c0-40653af3f27c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:56.033007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6faf63aa-c1de-452c-90c0-40653af3f27c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:56.033508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6faf63aa-c1de-452c-90c0-40653af3f27c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:56.034103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6faf63aa-c1de-452c-90c0-40653af3f27c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:56.034820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6faf63aa-c1de-452c-90c0-40653af3f27c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:56.035437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6faf63aa-c1de-452c-90c0-40653af3f27c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:56.036016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6faf63aa-c1de-452c-90c0-40653af3f27c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:56.072632 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6faf63aa-c1de-452c-90c0-40653af3f27c tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054239 Oct 24 11:05:56.076873 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3237/6499] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:05:56 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:05:57.086221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9fde04ce-6000-4750-9d5f-7b97e3d93b1b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:57.088490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9fde04ce-6000-4750-9d5f-7b97e3d93b1b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:57.096177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9fde04ce-6000-4750-9d5f-7b97e3d93b1b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:57.096982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9fde04ce-6000-4750-9d5f-7b97e3d93b1b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:57.097712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9fde04ce-6000-4750-9d5f-7b97e3d93b1b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:57.098816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9fde04ce-6000-4750-9d5f-7b97e3d93b1b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:57.099307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9fde04ce-6000-4750-9d5f-7b97e3d93b1b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:57.099753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9fde04ce-6000-4750-9d5f-7b97e3d93b1b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:57.131995 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9fde04ce-6000-4750-9d5f-7b97e3d93b1b tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049751 Oct 24 11:05:57.132528 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3263/6500] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:05:57 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 11:05:57.199266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-deee662b-2332-4581-972c-86bbeb75074f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:57.199810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-deee662b-2332-4581-972c-86bbeb75074f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:57.207467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-deee662b-2332-4581-972c-86bbeb75074f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:57.207899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-deee662b-2332-4581-972c-86bbeb75074f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:57.208337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-deee662b-2332-4581-972c-86bbeb75074f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:57.209061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-deee662b-2332-4581-972c-86bbeb75074f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:57.209518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-deee662b-2332-4581-972c-86bbeb75074f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:57.210152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-deee662b-2332-4581-972c-86bbeb75074f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:57.239145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-deee662b-2332-4581-972c-86bbeb75074f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:05:57.324806 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-deee662b-2332-4581-972c-86bbeb75074f tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 204 len: 0 microversion: 2.1 time: 0.129119 Oct 24 11:05:57.329032 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3238/6501] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:05:57 2022] DELETE /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:05:57.334535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e1a244df-61ab-4649-81d7-f6820aece81a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:57.335454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e1a244df-61ab-4649-81d7-f6820aece81a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:57.341814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1a244df-61ab-4649-81d7-f6820aece81a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:57.342339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1a244df-61ab-4649-81d7-f6820aece81a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:57.342787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1a244df-61ab-4649-81d7-f6820aece81a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:57.343529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1a244df-61ab-4649-81d7-f6820aece81a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:57.343995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1a244df-61ab-4649-81d7-f6820aece81a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:57.344988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e1a244df-61ab-4649-81d7-f6820aece81a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:57.480486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e1a244df-61ab-4649-81d7-f6820aece81a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:05:57.489146 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e1a244df-61ab-4649-81d7-f6820aece81a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 200 len: 1683 microversion: 2.1 time: 0.158818 Oct 24 11:05:57.489715 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3264/6502] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:05:57 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:05:58.523238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3e86ddea-a6fe-481d-81bb-4df961a05df8 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:58.524778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3e86ddea-a6fe-481d-81bb-4df961a05df8 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:58.532755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e86ddea-a6fe-481d-81bb-4df961a05df8 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:58.533382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e86ddea-a6fe-481d-81bb-4df961a05df8 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:58.533892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e86ddea-a6fe-481d-81bb-4df961a05df8 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:58.534673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e86ddea-a6fe-481d-81bb-4df961a05df8 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:58.535199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e86ddea-a6fe-481d-81bb-4df961a05df8 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:58.535726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3e86ddea-a6fe-481d-81bb-4df961a05df8 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:58.678861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3e86ddea-a6fe-481d-81bb-4df961a05df8 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:05:58.686882 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3e86ddea-a6fe-481d-81bb-4df961a05df8 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 200 len: 1683 microversion: 2.1 time: 0.168171 Oct 24 11:05:58.687685 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3239/6503] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:05:58 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:05:59.713871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-637a0b04-9b2f-48ec-8ed8-278dc099d86e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:05:59.715319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-637a0b04-9b2f-48ec-8ed8-278dc099d86e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:05:59.723728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-637a0b04-9b2f-48ec-8ed8-278dc099d86e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:59.724264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-637a0b04-9b2f-48ec-8ed8-278dc099d86e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:59.724720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-637a0b04-9b2f-48ec-8ed8-278dc099d86e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:59.725526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-637a0b04-9b2f-48ec-8ed8-278dc099d86e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:05:59.725987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-637a0b04-9b2f-48ec-8ed8-278dc099d86e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:05:59.726433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-637a0b04-9b2f-48ec-8ed8-278dc099d86e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:05:59.876242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-637a0b04-9b2f-48ec-8ed8-278dc099d86e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:05:59.886761 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-637a0b04-9b2f-48ec-8ed8-278dc099d86e tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 200 len: 1683 microversion: 2.1 time: 0.174568 Oct 24 11:05:59.900860 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3265/6504] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:05:59 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:00.243858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d70c9c66-e5f9-4fb5-91fd-22df4bf6dbbb req-09bb7895-e14f-43b6-a85a-2a7f2337c2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae5a9df-d2fa-4caf-829d-87fb3b799065", "name": "network-vif-deleted", "tag": "6a025f8a-9c84-4a4d-a522-9e55fb01c45d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:06:00.274073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d70c9c66-e5f9-4fb5-91fd-22df4bf6dbbb req-09bb7895-e14f-43b6-a85a-2a7f2337c2b6 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:00.275067 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d70c9c66-e5f9-4fb5-91fd-22df4bf6dbbb req-09bb7895-e14f-43b6-a85a-2a7f2337c2b6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:00.275516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d70c9c66-e5f9-4fb5-91fd-22df4bf6dbbb req-09bb7895-e14f-43b6-a85a-2a7f2337c2b6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:00.289597 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d70c9c66-e5f9-4fb5-91fd-22df4bf6dbbb req-09bb7895-e14f-43b6-a85a-2a7f2337c2b6 service nova] Creating event network-vif-deleted:6a025f8a-9c84-4a4d-a522-9e55fb01c45d for instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 on n-h2-858383-15 Oct 24 11:06:00.308000 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d70c9c66-e5f9-4fb5-91fd-22df4bf6dbbb req-09bb7895-e14f-43b6-a85a-2a7f2337c2b6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069527 Oct 24 11:06:00.309013 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3240/6505] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:06:00.914124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0770854f-20e7-4dea-a7e9-138aaa570739 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:00.915118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0770854f-20e7-4dea-a7e9-138aaa570739 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:00.923380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0770854f-20e7-4dea-a7e9-138aaa570739 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:00.924234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0770854f-20e7-4dea-a7e9-138aaa570739 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:00.924960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0770854f-20e7-4dea-a7e9-138aaa570739 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:00.925930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0770854f-20e7-4dea-a7e9-138aaa570739 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:00.926667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0770854f-20e7-4dea-a7e9-138aaa570739 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:00.927163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0770854f-20e7-4dea-a7e9-138aaa570739 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:00.965233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0770854f-20e7-4dea-a7e9-138aaa570739 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:00.966062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0770854f-20e7-4dea-a7e9-138aaa570739 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:00.966731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0770854f-20e7-4dea-a7e9-138aaa570739 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:00.967406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-0770854f-20e7-4dea-a7e9-138aaa570739 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lazy-loading 'fault' on Instance uuid 2ae5a9df-d2fa-4caf-829d-87fb3b799065 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:06:01.016940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0770854f-20e7-4dea-a7e9-138aaa570739 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9e4e22dda84476a30e6b6bd27c68a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ff6644b9b4215b1b7c82b98342a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:01.029016 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0770854f-20e7-4dea-a7e9-138aaa570739 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 200 len: 1332 microversion: 2.1 time: 0.118651 Oct 24 11:06:01.030018 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3266/6506] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:00 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 1332 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:02.054502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e9cb83a9-4315-42e6-a44b-b94f5070bae2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:02.055111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e9cb83a9-4315-42e6-a44b-b94f5070bae2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:02.062083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9cb83a9-4315-42e6-a44b-b94f5070bae2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:02.062568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9cb83a9-4315-42e6-a44b-b94f5070bae2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:02.063019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9cb83a9-4315-42e6-a44b-b94f5070bae2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:02.063727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9cb83a9-4315-42e6-a44b-b94f5070bae2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:02.064181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9cb83a9-4315-42e6-a44b-b94f5070bae2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:02.064619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9cb83a9-4315-42e6-a44b-b94f5070bae2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:02.077876 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-e9cb83a9-4315-42e6-a44b-b94f5070bae2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] HTTP exception thrown: Instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 could not be found. Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e9cb83a9-4315-42e6-a44b-b94f5070bae2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Request method failure captured: Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 HTTP/1.1 Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnAKAHP5OOfm-uCWTjFJTzXa0YLKSuouosUciU14TRf3JmMepl7Z3nYn7w4Ibs55CltNd_hrYn98Pw4N-ToeUd4QusviP9lFlPXOJGwfHRkdtQPCg9kRiq2YXaf55wJAz2KjxNTj7AXjHUrV-JebO1VNsJhWCbt5cfPkaHFUJTxTNxM Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a10ff6644b9b4215b1b7c82b98342a79", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: da9e4e22dda84476a30e6b6bd27c68a6 Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 could not be found. Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '2ae5a9df-d2fa-4caf-829d-87fb3b799065'} Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 could not be found. Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 could not be found. Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:02.080110 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:02.088539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:02.088539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:02.088539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:02.088539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:06:02.088539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:06:02.088539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 could not be found. Oct 24 11:06:02.088539 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:02.088539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e9cb83a9-4315-42e6-a44b-b94f5070bae2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Returning 404 to user: Instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:06:02.088539 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e9cb83a9-4315-42e6-a44b-b94f5070bae2 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 404 len: 111 microversion: 2.1 time: 0.031502 Oct 24 11:06:02.088539 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3241/6507] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:02 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:06:02.090658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e53633a8-0b55-4196-9bf4-bcc3fe4292b5 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '.version_select at 0x7f04d0cc0f70>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:02.113415 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e53633a8-0b55-4196-9bf4-bcc3fe4292b5 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431420972" status: 202 len: 0 microversion: 2.1 time: 0.026510 Oct 24 11:06:02.114017 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3267/6508] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Oct 24 11:06:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431420972 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:06:06.026157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2297fa82-24bb-457b-801c-279836a2f7ca tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:06.026674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2297fa82-24bb-457b-801c-279836a2f7ca tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:06.034313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2297fa82-24bb-457b-801c-279836a2f7ca tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:06.034804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2297fa82-24bb-457b-801c-279836a2f7ca tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:06.035282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2297fa82-24bb-457b-801c-279836a2f7ca tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:06.036006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2297fa82-24bb-457b-801c-279836a2f7ca tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:06.036447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2297fa82-24bb-457b-801c-279836a2f7ca tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:06.036893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2297fa82-24bb-457b-801c-279836a2f7ca tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:06.055680 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-2297fa82-24bb-457b-801c-279836a2f7ca tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] HTTP exception thrown: Instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 could not be found. Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2297fa82-24bb-457b-801c-279836a2f7ca tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Request method failure captured: Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 HTTP/1.1 Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnAKAHP5OOfm-uCWTjFJTzXa0YLKSuouosUciU14TRf3JmMepl7Z3nYn7w4Ibs55CltNd_hrYn98Pw4N-ToeUd4QusviP9lFlPXOJGwfHRkdtQPCg9kRiq2YXaf55wJAz2KjxNTj7AXjHUrV-JebO1VNsJhWCbt5cfPkaHFUJTxTNxM Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a10ff6644b9b4215b1b7c82b98342a79", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: da9e4e22dda84476a30e6b6bd27c68a6 Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 could not be found. Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '2ae5a9df-d2fa-4caf-829d-87fb3b799065'} Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 could not be found. Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:06:06.058500 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:06:06.064080 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 could not be found. Oct 24 11:06:06.064080 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:06.064080 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:06.064080 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:06.064080 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:06.064080 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:06.064080 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:06.064080 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:06:06.064080 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:06:06.064080 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 could not be found. Oct 24 11:06:06.064080 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:06.064080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2297fa82-24bb-457b-801c-279836a2f7ca tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Returning 404 to user: Instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:06:06.064080 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2297fa82-24bb-457b-801c-279836a2f7ca tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 404 len: 111 microversion: 2.1 time: 0.038588 Oct 24 11:06:06.065907 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3242/6509] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:06:06 2022] DELETE /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:06:06.072372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-18a55bdb-0e08-4d44-9adf-14dc4edbf112 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:06.073021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-18a55bdb-0e08-4d44-9adf-14dc4edbf112 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 2ae5a9df-d2fa-4caf-829d-87fb3b799065] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:06.075596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:06:06.081998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18a55bdb-0e08-4d44-9adf-14dc4edbf112 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:06.082488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18a55bdb-0e08-4d44-9adf-14dc4edbf112 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:06.082923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18a55bdb-0e08-4d44-9adf-14dc4edbf112 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:06.083626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18a55bdb-0e08-4d44-9adf-14dc4edbf112 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:06.084081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18a55bdb-0e08-4d44-9adf-14dc4edbf112 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:06.084509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18a55bdb-0e08-4d44-9adf-14dc4edbf112 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:06.089398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:06:06.099754 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-18a55bdb-0e08-4d44-9adf-14dc4edbf112 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] HTTP exception thrown: Instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 could not be found. Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-18a55bdb-0e08-4d44-9adf-14dc4edbf112 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Request method failure captured: Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 HTTP/1.1 Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnAKAHP5OOfm-uCWTjFJTzXa0YLKSuouosUciU14TRf3JmMepl7Z3nYn7w4Ibs55CltNd_hrYn98Pw4N-ToeUd4QusviP9lFlPXOJGwfHRkdtQPCg9kRiq2YXaf55wJAz2KjxNTj7AXjHUrV-JebO1VNsJhWCbt5cfPkaHFUJTxTNxM Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a10ff6644b9b4215b1b7c82b98342a79", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: da9e4e22dda84476a30e6b6bd27c68a6 Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 could not be found. Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '2ae5a9df-d2fa-4caf-829d-87fb3b799065'} Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 could not be found. Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 could not be found. Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:06.101448 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:06.105416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:06.105416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:06.105416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:06.105416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:06:06.105416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:06:06.105416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 could not be found. Oct 24 11:06:06.105416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:06.105416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-18a55bdb-0e08-4d44-9adf-14dc4edbf112 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Returning 404 to user: Instance 2ae5a9df-d2fa-4caf-829d-87fb3b799065 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:06:06.105416 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-18a55bdb-0e08-4d44-9adf-14dc4edbf112 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065" status: 404 len: 111 microversion: 2.1 time: 0.034403 Oct 24 11:06:06.105416 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3268/6510] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:06 2022] GET /compute/v2.1/servers/2ae5a9df-d2fa-4caf-829d-87fb3b799065 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:06:09.378494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-64ececef-a05c-49ce-845a-1eb6ccc6f507 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:09.379026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-64ececef-a05c-49ce-845a-1eb6ccc6f507 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:09.382533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:06:09.388978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64ececef-a05c-49ce-845a-1eb6ccc6f507 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:09.389506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64ececef-a05c-49ce-845a-1eb6ccc6f507 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:09.389947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64ececef-a05c-49ce-845a-1eb6ccc6f507 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:09.390652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64ececef-a05c-49ce-845a-1eb6ccc6f507 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:09.391195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64ececef-a05c-49ce-845a-1eb6ccc6f507 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:09.392132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-64ececef-a05c-49ce-845a-1eb6ccc6f507 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:09.395571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:06:09.408763 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-64ececef-a05c-49ce-845a-1eb6ccc6f507 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] HTTP exception thrown: Instance 129cf12f-25b4-49e3-afc7-4d8640344201 could not be found. Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-64ececef-a05c-49ce-845a-1eb6ccc6f507 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Request method failure captured: Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 HTTP/1.1 Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnAKAHP5OOfm-uCWTjFJTzXa0YLKSuouosUciU14TRf3JmMepl7Z3nYn7w4Ibs55CltNd_hrYn98Pw4N-ToeUd4QusviP9lFlPXOJGwfHRkdtQPCg9kRiq2YXaf55wJAz2KjxNTj7AXjHUrV-JebO1VNsJhWCbt5cfPkaHFUJTxTNxM Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a10ff6644b9b4215b1b7c82b98342a79", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: da9e4e22dda84476a30e6b6bd27c68a6 Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 129cf12f-25b4-49e3-afc7-4d8640344201 could not be found. Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '129cf12f-25b4-49e3-afc7-4d8640344201'} Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 129cf12f-25b4-49e3-afc7-4d8640344201 could not be found. Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:06:09.410394 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:06:09.416603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 129cf12f-25b4-49e3-afc7-4d8640344201 could not be found. Oct 24 11:06:09.416603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.416603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:09.416603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.416603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:09.416603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:09.416603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:09.416603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:06:09.416603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:06:09.416603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 129cf12f-25b4-49e3-afc7-4d8640344201 could not be found. Oct 24 11:06:09.416603 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.416603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-64ececef-a05c-49ce-845a-1eb6ccc6f507 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Returning 404 to user: Instance 129cf12f-25b4-49e3-afc7-4d8640344201 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:06:09.416603 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-64ececef-a05c-49ce-845a-1eb6ccc6f507 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "DELETE /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 404 len: 111 microversion: 2.1 time: 0.038082 Oct 24 11:06:09.416603 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3243/6511] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:06:09 2022] DELETE /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:06:09.423687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d607b9bc-45bb-48ae-9f89-994b017c599a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:09.425494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d607b9bc-45bb-48ae-9f89-994b017c599a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 129cf12f-25b4-49e3-afc7-4d8640344201] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:09.434220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d607b9bc-45bb-48ae-9f89-994b017c599a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:09.435116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d607b9bc-45bb-48ae-9f89-994b017c599a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:09.435565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d607b9bc-45bb-48ae-9f89-994b017c599a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:09.436276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d607b9bc-45bb-48ae-9f89-994b017c599a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:09.436738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d607b9bc-45bb-48ae-9f89-994b017c599a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:09.437254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d607b9bc-45bb-48ae-9f89-994b017c599a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:09.451949 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-d607b9bc-45bb-48ae-9f89-994b017c599a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] HTTP exception thrown: Instance 129cf12f-25b4-49e3-afc7-4d8640344201 could not be found. Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d607b9bc-45bb-48ae-9f89-994b017c599a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Request method failure captured: Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 HTTP/1.1 Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnAKAHP5OOfm-uCWTjFJTzXa0YLKSuouosUciU14TRf3JmMepl7Z3nYn7w4Ibs55CltNd_hrYn98Pw4N-ToeUd4QusviP9lFlPXOJGwfHRkdtQPCg9kRiq2YXaf55wJAz2KjxNTj7AXjHUrV-JebO1VNsJhWCbt5cfPkaHFUJTxTNxM Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a10ff6644b9b4215b1b7c82b98342a79", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: da9e4e22dda84476a30e6b6bd27c68a6 Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 129cf12f-25b4-49e3-afc7-4d8640344201 could not be found. Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '129cf12f-25b4-49e3-afc7-4d8640344201'} Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 129cf12f-25b4-49e3-afc7-4d8640344201 could not be found. Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 129cf12f-25b4-49e3-afc7-4d8640344201 could not be found. Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:09.453516 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.458313 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:09.458313 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:09.458313 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:09.458313 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:06:09.458313 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:06:09.458313 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 129cf12f-25b4-49e3-afc7-4d8640344201 could not be found. Oct 24 11:06:09.458313 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.458313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d607b9bc-45bb-48ae-9f89-994b017c599a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Returning 404 to user: Instance 129cf12f-25b4-49e3-afc7-4d8640344201 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:06:09.458313 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d607b9bc-45bb-48ae-9f89-994b017c599a tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201" status: 404 len: 111 microversion: 2.1 time: 0.036893 Oct 24 11:06:09.458313 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3269/6512] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:09 2022] GET /compute/v2.1/servers/129cf12f-25b4-49e3-afc7-4d8640344201 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:06:09.465147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-440650d3-af1c-48cb-8584-db1b42cedc17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:09.465656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-440650d3-af1c-48cb-8584-db1b42cedc17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:09.472707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-440650d3-af1c-48cb-8584-db1b42cedc17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:09.473332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-440650d3-af1c-48cb-8584-db1b42cedc17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:09.473666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-440650d3-af1c-48cb-8584-db1b42cedc17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:09.474384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-440650d3-af1c-48cb-8584-db1b42cedc17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:09.474848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-440650d3-af1c-48cb-8584-db1b42cedc17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:09.475284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-440650d3-af1c-48cb-8584-db1b42cedc17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:09.490937 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-440650d3-af1c-48cb-8584-db1b42cedc17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] HTTP exception thrown: Instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 could not be found. Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-440650d3-af1c-48cb-8584-db1b42cedc17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Request method failure captured: Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 HTTP/1.1 Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnAKAHP5OOfm-uCWTjFJTzXa0YLKSuouosUciU14TRf3JmMepl7Z3nYn7w4Ibs55CltNd_hrYn98Pw4N-ToeUd4QusviP9lFlPXOJGwfHRkdtQPCg9kRiq2YXaf55wJAz2KjxNTj7AXjHUrV-JebO1VNsJhWCbt5cfPkaHFUJTxTNxM Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a10ff6644b9b4215b1b7c82b98342a79", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: da9e4e22dda84476a30e6b6bd27c68a6 Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 could not be found. Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '33939031-e4c1-45c6-9aa1-c8751f6ab150'} Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 could not be found. Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:06:09.492881 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:06:09.497541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 could not be found. Oct 24 11:06:09.497541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.497541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:09.497541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.497541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:09.497541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:09.497541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:09.497541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:06:09.497541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:06:09.497541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 could not be found. Oct 24 11:06:09.497541 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.497541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-440650d3-af1c-48cb-8584-db1b42cedc17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Returning 404 to user: Instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:06:09.497541 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-440650d3-af1c-48cb-8584-db1b42cedc17 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "DELETE /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 404 len: 111 microversion: 2.1 time: 0.033443 Oct 24 11:06:09.498539 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3244/6513] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:06:09 2022] DELETE /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:06:09.504053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-56daa611-639c-45b4-be59-0b97094ce76d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:09.504686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-56daa611-639c-45b4-be59-0b97094ce76d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 33939031-e4c1-45c6-9aa1-c8751f6ab150] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:09.511393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56daa611-639c-45b4-be59-0b97094ce76d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:09.512336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56daa611-639c-45b4-be59-0b97094ce76d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:09.513003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56daa611-639c-45b4-be59-0b97094ce76d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:09.513926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56daa611-639c-45b4-be59-0b97094ce76d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:09.514563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56daa611-639c-45b4-be59-0b97094ce76d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:09.515164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-56daa611-639c-45b4-be59-0b97094ce76d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:09.531712 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-56daa611-639c-45b4-be59-0b97094ce76d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] HTTP exception thrown: Instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 could not be found. Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-56daa611-639c-45b4-be59-0b97094ce76d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Request method failure captured: Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 HTTP/1.1 Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnAKAHP5OOfm-uCWTjFJTzXa0YLKSuouosUciU14TRf3JmMepl7Z3nYn7w4Ibs55CltNd_hrYn98Pw4N-ToeUd4QusviP9lFlPXOJGwfHRkdtQPCg9kRiq2YXaf55wJAz2KjxNTj7AXjHUrV-JebO1VNsJhWCbt5cfPkaHFUJTxTNxM Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a10ff6644b9b4215b1b7c82b98342a79", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: da9e4e22dda84476a30e6b6bd27c68a6 Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 could not be found. Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '33939031-e4c1-45c6-9aa1-c8751f6ab150'} Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 could not be found. Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 could not be found. Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:09.534343 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.540348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:09.540348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:09.540348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:09.540348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:06:09.540348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:06:09.540348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 could not be found. Oct 24 11:06:09.540348 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:09.540348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-56daa611-639c-45b4-be59-0b97094ce76d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Returning 404 to user: Instance 33939031-e4c1-45c6-9aa1-c8751f6ab150 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:06:09.540348 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-56daa611-639c-45b4-be59-0b97094ce76d tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150" status: 404 len: 111 microversion: 2.1 time: 0.036533 Oct 24 11:06:09.540348 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3270/6514] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:09 2022] GET /compute/v2.1/servers/33939031-e4c1-45c6-9aa1-c8751f6ab150 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:06:13.879697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b3f4bb4b-550f-4766-95a1-f1c5dfd1f6e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:13.880279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b3f4bb4b-550f-4766-95a1-f1c5dfd1f6e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:13.887152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3f4bb4b-550f-4766-95a1-f1c5dfd1f6e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:13.887645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3f4bb4b-550f-4766-95a1-f1c5dfd1f6e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:13.888093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3f4bb4b-550f-4766-95a1-f1c5dfd1f6e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:13.888816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3f4bb4b-550f-4766-95a1-f1c5dfd1f6e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:13.889311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3f4bb4b-550f-4766-95a1-f1c5dfd1f6e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:13.889748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3f4bb4b-550f-4766-95a1-f1c5dfd1f6e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:13.904494 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-b3f4bb4b-550f-4766-95a1-f1c5dfd1f6e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] HTTP exception thrown: Instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 could not be found. Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b3f4bb4b-550f-4766-95a1-f1c5dfd1f6e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Request method failure captured: Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 HTTP/1.1 Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnAKAHP5OOfm-uCWTjFJTzXa0YLKSuouosUciU14TRf3JmMepl7Z3nYn7w4Ibs55CltNd_hrYn98Pw4N-ToeUd4QusviP9lFlPXOJGwfHRkdtQPCg9kRiq2YXaf55wJAz2KjxNTj7AXjHUrV-JebO1VNsJhWCbt5cfPkaHFUJTxTNxM Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a10ff6644b9b4215b1b7c82b98342a79", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: da9e4e22dda84476a30e6b6bd27c68a6 Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 could not be found. Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '64d0cfd3-33a6-473c-8d33-1a7ff418e838'} Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 could not be found. Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:06:13.906146 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:06:13.911848 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 could not be found. Oct 24 11:06:13.911848 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:13.911848 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:13.911848 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:13.911848 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:13.911848 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:13.911848 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:13.911848 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:06:13.911848 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:06:13.911848 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 could not be found. Oct 24 11:06:13.911848 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:13.911848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b3f4bb4b-550f-4766-95a1-f1c5dfd1f6e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Returning 404 to user: Instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:06:13.911848 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b3f4bb4b-550f-4766-95a1-f1c5dfd1f6e6 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "DELETE /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 404 len: 111 microversion: 2.1 time: 0.032616 Oct 24 11:06:13.911848 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3245/6515] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:06:13 2022] DELETE /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:06:13.917263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-78084e74-0ac0-489d-84bd-21ad2c42ea28 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:13.917895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-78084e74-0ac0-489d-84bd-21ad2c42ea28 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] [instance: 64d0cfd3-33a6-473c-8d33-1a7ff418e838] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:13.926015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78084e74-0ac0-489d-84bd-21ad2c42ea28 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:13.926516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78084e74-0ac0-489d-84bd-21ad2c42ea28 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:13.926966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78084e74-0ac0-489d-84bd-21ad2c42ea28 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:13.927696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78084e74-0ac0-489d-84bd-21ad2c42ea28 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:13.928163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78084e74-0ac0-489d-84bd-21ad2c42ea28 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:13.928600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78084e74-0ac0-489d-84bd-21ad2c42ea28 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:13.943294 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-78084e74-0ac0-489d-84bd-21ad2c42ea28 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] HTTP exception thrown: Instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 could not be found. Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-78084e74-0ac0-489d-84bd-21ad2c42ea28 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Request method failure captured: Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 HTTP/1.1 Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnAKAHP5OOfm-uCWTjFJTzXa0YLKSuouosUciU14TRf3JmMepl7Z3nYn7w4Ibs55CltNd_hrYn98Pw4N-ToeUd4QusviP9lFlPXOJGwfHRkdtQPCg9kRiq2YXaf55wJAz2KjxNTj7AXjHUrV-JebO1VNsJhWCbt5cfPkaHFUJTxTNxM Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a10ff6644b9b4215b1b7c82b98342a79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a10ff6644b9b4215b1b7c82b98342a79", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: a10ff6644b9b4215b1b7c82b98342a79 Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-521126623 Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: da9e4e22dda84476a30e6b6bd27c68a6 Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-AttachVolumeNegativeTest-521126623-project Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 could not be found. Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '64d0cfd3-33a6-473c-8d33-1a7ff418e838'} Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 could not be found. Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 could not be found. Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:13.945128 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:13.950026 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:13.950026 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:13.950026 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:13.950026 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:06:13.950026 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:06:13.950026 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 could not be found. Oct 24 11:06:13.950026 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:13.950026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-78084e74-0ac0-489d-84bd-21ad2c42ea28 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] Returning 404 to user: Instance 64d0cfd3-33a6-473c-8d33-1a7ff418e838 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:06:13.950026 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-78084e74-0ac0-489d-84bd-21ad2c42ea28 tempest-AttachVolumeNegativeTest-521126623 tempest-AttachVolumeNegativeTest-521126623-project] 10.222.0.50 "GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838" status: 404 len: 111 microversion: 2.1 time: 0.033431 Oct 24 11:06:13.956497 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3271/6516] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:13 2022] GET /compute/v2.1/servers/64d0cfd3-33a6-473c-8d33-1a7ff418e838 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:06:20.086509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7ef4149e-721d-4ebc-942c-7f5bb43b7992 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Action: 'create', calling method: .version_select at 0x7f04cb99a820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1132698553"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:06:20.519602 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7ef4149e-721d-4ebc-942c-7f5bb43b7992 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.584617 Oct 24 11:06:20.520225 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3246/6517] 10.222.0.50 () {60 vars in 1155 bytes} [Mon Oct 24 11:06:19 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 586 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 24 11:06:20.533995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a4df19b6-412e-4492-b770-6b0bdd2a5ec7 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04d0a8fe50>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:20.621936 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a4df19b6-412e-4492-b770-6b0bdd2a5ec7 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267" status: 200 len: 345 microversion: 2.1 time: 0.092305 Oct 24 11:06:20.623039 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3272/6518] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 11:06:20 2022] GET /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267 => generated 345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:06:21.644170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-384718e8-e510-4daf-a212-497707e89610 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04cb9e3f70>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:21.732527 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-384718e8-e510-4daf-a212-497707e89610 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267" status: 200 len: 345 microversion: 2.1 time: 0.095817 Oct 24 11:06:21.733150 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3247/6519] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 11:06:21 2022] GET /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267 => generated 345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:06:22.748405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8a8df170-80d9-4d78-8065-bcaef965e633 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04cbabe280>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:22.814726 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8a8df170-80d9-4d78-8065-bcaef965e633 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267" status: 200 len: 346 microversion: 2.1 time: 0.070847 Oct 24 11:06:22.815330 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3273/6520] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 11:06:22 2022] GET /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267 => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:06:22.829616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ed04d632-8bde-435b-96e0-f7a3e199f9d6 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Action: 'create', calling method: .version_select at 0x7f04cb99ab80>, body: {"snapshot": {"volume_id": "ed30b347-9231-42e5-bb00-e353c8d6b267", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-192189339"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:06:23.023004 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ed04d632-8bde-435b-96e0-f7a3e199f9d6 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.198090 Oct 24 11:06:23.026650 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3248/6521] 10.222.0.50 () {60 vars in 1162 bytes} [Mon Oct 24 11:06:22 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:06:23.041927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-798ddc95-1b0f-4d81-bee3-1b24a82674a7 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04cb632790>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:23.101324 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-798ddc95-1b0f-4d81-bee3-1b24a82674a7 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6" status: 200 len: 286 microversion: 2.1 time: 0.066260 Oct 24 11:06:23.102439 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3274/6522] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Oct 24 11:06:23 2022] GET /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:06:23.117217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-880c9b00-bbb5-4f2e-a006-092982715911 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04cba4faf0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:23.161147 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-880c9b00-bbb5-4f2e-a006-092982715911 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.051523 Oct 24 11:06:23.162261 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3249/6523] 10.222.0.50 () {58 vars in 1140 bytes} [Mon Oct 24 11:06:23 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:06:23.174319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-803df630-2f16-4fae-8bb8-0cc30f49e34b tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04d0a8f5e0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:23.224719 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-803df630-2f16-4fae-8bb8-0cc30f49e34b tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6" status: 200 len: 286 microversion: 2.1 time: 0.055239 Oct 24 11:06:23.230755 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3275/6524] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Oct 24 11:06:23 2022] GET /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:06:23.742481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d670daa6-6a02-4552-88f8-cf5f3eff538f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1579901986", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "2b728643-f2e0-4f8a-a5a9-1a2b0d3ac02a"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1552156643", "security_groups": []}, "os:scheduler_hints": {"different_host": ["131f69b2-1939-4211-a289-c03759f7d383"]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:06:23.823432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-d670daa6-6a02-4552-88f8-cf5f3eff538f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] validate_networks() for [('2b728643-f2e0-4f8a-a5a9-1a2b0d3ac02a', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:06:23.895731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=5 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:06:24.235513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=7 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:06:24.237035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=7 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:06:24.243179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f1dcc226-70c7-4604-890a-bf9de440726a tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04cbabef70>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:24.308946 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f1dcc226-70c7-4604-890a-bf9de440726a tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6" status: 200 len: 286 microversion: 2.1 time: 0.074889 Oct 24 11:06:24.309915 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3276/6525] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Oct 24 11:06:24 2022] GET /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:06:24.695403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d670daa6-6a02-4552-88f8-cf5f3eff538f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:06:24.703107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d670daa6-6a02-4552-88f8-cf5f3eff538f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:06:24.703616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d670daa6-6a02-4552-88f8-cf5f3eff538f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:06:24.704088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d670daa6-6a02-4552-88f8-cf5f3eff538f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:06:24.705126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d670daa6-6a02-4552-88f8-cf5f3eff538f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:06:24.718400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d670daa6-6a02-4552-88f8-cf5f3eff538f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:24.719219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d670daa6-6a02-4552-88f8-cf5f3eff538f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:24.719777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d670daa6-6a02-4552-88f8-cf5f3eff538f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:24.720693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d670daa6-6a02-4552-88f8-cf5f3eff538f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:24.721221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d670daa6-6a02-4552-88f8-cf5f3eff538f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:24.721653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d670daa6-6a02-4552-88f8-cf5f3eff538f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:24.745131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-d670daa6-6a02-4552-88f8-cf5f3eff538f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Getting quotas for project d681efb474fb4d3bb62e07ca2d16bc33. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:06:24.755477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-d670daa6-6a02-4552-88f8-cf5f3eff538f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Getting quotas for user 97b622ac85ed493ab3c8a1761a480ada and project d681efb474fb4d3bb62e07ca2d16bc33. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:06:24.777491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d670daa6-6a02-4552-88f8-cf5f3eff538f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:06:24.780393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d670daa6-6a02-4552-88f8-cf5f3eff538f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:06:24.864417 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d670daa6-6a02-4552-88f8-cf5f3eff538f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.125875 Oct 24 11:06:24.870678 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3250/6526] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:06:23 2022] POST /compute/v2.1/servers => generated 361 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:06:24.890316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-961ea07f-08b8-4af8-82c7-20928ec1806a tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:24.894783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-961ea07f-08b8-4af8-82c7-20928ec1806a tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:25.037082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-961ea07f-08b8-4af8-82c7-20928ec1806a tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:25.047251 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-961ea07f-08b8-4af8-82c7-20928ec1806a tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf" status: 200 len: 1242 microversion: 2.1 time: 0.165158 Oct 24 11:06:25.048545 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3277/6527] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:24 2022] GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf => generated 1242 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:25.325380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-54df3939-9fda-48c6-8458-162665e1ec80 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04cb99a9d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:25.383304 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-54df3939-9fda-48c6-8458-162665e1ec80 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6" status: 200 len: 287 microversion: 2.1 time: 0.064457 Oct 24 11:06:25.383881 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3251/6528] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Oct 24 11:06:25 2022] GET /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:06:25.396309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-11d72774-d405-4f13-9f79-36e5318a0063 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04cb6e5f70>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:25.527928 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-11d72774-d405-4f13-9f79-36e5318a0063 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "DELETE /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6" status: 202 len: 0 microversion: 2.1 time: 0.136291 Oct 24 11:06:25.528516 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3278/6529] 10.222.0.50 () {58 vars in 1254 bytes} [Mon Oct 24 11:06:25 2022] DELETE /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:06:25.537419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6a9c0d24-33b3-44ec-aecc-2e858bc5bc14 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04cb84f310>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:25.600336 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6a9c0d24-33b3-44ec-aecc-2e858bc5bc14 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6" status: 200 len: 286 microversion: 2.1 time: 0.067081 Oct 24 11:06:25.601131 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3252/6530] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Oct 24 11:06:25 2022] GET /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6 => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:06:26.072964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d046b27d-ee34-4ef9-8a0d-752d01858e46 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:26.073593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d046b27d-ee34-4ef9-8a0d-752d01858e46 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:26.083274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d046b27d-ee34-4ef9-8a0d-752d01858e46 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:26.083776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d046b27d-ee34-4ef9-8a0d-752d01858e46 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:26.084229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d046b27d-ee34-4ef9-8a0d-752d01858e46 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:26.084974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d046b27d-ee34-4ef9-8a0d-752d01858e46 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:26.085439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d046b27d-ee34-4ef9-8a0d-752d01858e46 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:26.090434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d046b27d-ee34-4ef9-8a0d-752d01858e46 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:26.274807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d046b27d-ee34-4ef9-8a0d-752d01858e46 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:26.286436 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d046b27d-ee34-4ef9-8a0d-752d01858e46 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf" status: 200 len: 1238 microversion: 2.1 time: 0.217310 Oct 24 11:06:26.287469 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3279/6531] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:26 2022] GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf => generated 1238 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:26.615484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6ea91078-444a-4bbb-8f8a-899bbd904303 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04cba45f70>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:26.657541 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6ea91078-444a-4bbb-8f8a-899bbd904303 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6" status: 200 len: 286 microversion: 2.1 time: 0.047238 Oct 24 11:06:26.658390 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3253/6532] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Oct 24 11:06:26 2022] GET /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6 => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:06:27.316269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-013ff7ce-6feb-4aa9-87d6-c7fef3e0fb88 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:27.316914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-013ff7ce-6feb-4aa9-87d6-c7fef3e0fb88 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:27.326618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-013ff7ce-6feb-4aa9-87d6-c7fef3e0fb88 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:27.327369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-013ff7ce-6feb-4aa9-87d6-c7fef3e0fb88 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:27.327983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-013ff7ce-6feb-4aa9-87d6-c7fef3e0fb88 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:27.329956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-013ff7ce-6feb-4aa9-87d6-c7fef3e0fb88 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:27.330601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-013ff7ce-6feb-4aa9-87d6-c7fef3e0fb88 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:27.331205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-013ff7ce-6feb-4aa9-87d6-c7fef3e0fb88 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:27.425870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-013ff7ce-6feb-4aa9-87d6-c7fef3e0fb88 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:27.444688 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-013ff7ce-6feb-4aa9-87d6-c7fef3e0fb88 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf" status: 200 len: 1300 microversion: 2.1 time: 0.134700 Oct 24 11:06:27.447226 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3280/6533] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:27 2022] GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf => generated 1300 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:27.676238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ec95982-9889-44b6-9f4b-36f3d12c4cb2 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04cb84f8b0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:27.750422 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0ec95982-9889-44b6-9f4b-36f3d12c4cb2 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6" status: 200 len: 286 microversion: 2.1 time: 0.082948 Oct 24 11:06:27.751974 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3254/6534] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Oct 24 11:06:27 2022] GET /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:06:28.472367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d08e5b07-6f01-46ae-81e6-935d4e305288 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:28.473318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d08e5b07-6f01-46ae-81e6-935d4e305288 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:28.480396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d08e5b07-6f01-46ae-81e6-935d4e305288 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:28.480993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d08e5b07-6f01-46ae-81e6-935d4e305288 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:28.481500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d08e5b07-6f01-46ae-81e6-935d4e305288 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:28.482302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d08e5b07-6f01-46ae-81e6-935d4e305288 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:28.482966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d08e5b07-6f01-46ae-81e6-935d4e305288 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:28.483465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d08e5b07-6f01-46ae-81e6-935d4e305288 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:28.572307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d08e5b07-6f01-46ae-81e6-935d4e305288 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:28.592345 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d08e5b07-6f01-46ae-81e6-935d4e305288 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf" status: 200 len: 1300 microversion: 2.1 time: 0.113542 Oct 24 11:06:28.596569 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3281/6535] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:28 2022] GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf => generated 1300 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:28.621868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e04d8d99-f9dc-463c-b753-728caa9546bd req-384d1b33-194d-4ed1-b306-757dfab26e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a6c54d3-896a-4b1d-b553-b70f38a09abf", "tag": "3dbd6519-e459-4847-93a7-0e4cecfc3e35"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:06:28.633486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e04d8d99-f9dc-463c-b753-728caa9546bd req-384d1b33-194d-4ed1-b306-757dfab26e0c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:28.633970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e04d8d99-f9dc-463c-b753-728caa9546bd req-384d1b33-194d-4ed1-b306-757dfab26e0c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:28.634401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e04d8d99-f9dc-463c-b753-728caa9546bd req-384d1b33-194d-4ed1-b306-757dfab26e0c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:28.659392 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e04d8d99-f9dc-463c-b753-728caa9546bd req-384d1b33-194d-4ed1-b306-757dfab26e0c service nova] Creating event network-changed:3dbd6519-e459-4847-93a7-0e4cecfc3e35 for instance 3a6c54d3-896a-4b1d-b553-b70f38a09abf on n-h2-858383-15 Oct 24 11:06:28.665937 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e04d8d99-f9dc-463c-b753-728caa9546bd req-384d1b33-194d-4ed1-b306-757dfab26e0c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047887 Oct 24 11:06:28.667191 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3255/6536] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:06:28.763513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d5316d4d-b71c-4420-abc6-d39b73de4d9a tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04d0a8f550>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:28.791505 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-d5316d4d-b71c-4420-abc6-d39b73de4d9a tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] HTTP exception thrown: Snapshot 6f355330-d8b0-4997-b70d-0b04738cc7a6 could not be found. Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d5316d4d-b71c-4420-abc6-d39b73de4d9a tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Request method failure captured: Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6 HTTP/1.1 Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnGrG_-JFaJjDyT9q1VbKHPLsb_Hv0xusYUVaMzBtQMKIxHjIFYOqW6CNb3eQYutQmcxxllfFgu9U6IL4tCTx2RlBQ37s7NNjwSjrazIfYeBQ8nrvDHF4ReWJLp_AOR8LUePvjGtJwS8tFlG0BTD9mJGxJxEIJXLNhDYkkLIL3aX2ic Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 12fa964b32674f73aa39e6d68a082938 Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-978726960 Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/12fa964b32674f73aa39e6d68a082938"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/12fa964b32674f73aa39e6d68a082938"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/12fa964b32674f73aa39e6d68a082938"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_12fa964b32674f73aa39e6d68a082938", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-VolumesSnapshotsTestJSON-978726960 Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 12fa964b32674f73aa39e6d68a082938 Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-978726960 Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-VolumesSnapshotsTestJSON-978726960-project Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 6ea3974e7c57420db2e33f7cd7c27d87 Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-VolumesSnapshotsTestJSON-978726960-project Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: exception: Snapshot 6f355330-d8b0-4997-b70d-0b04738cc7a6 could not be found. Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '6f355330-d8b0-4997-b70d-0b04738cc7a6'} Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6f355330-d8b0-4997-b70d-0b04738cc7a6 could not be found. (HTTP 404) (Request-ID: req-fdb390c2-2a57-4286-8f91-ea6d11e51abf) Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 11:06:28.802787 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6f355330-d8b0-4997-b70d-0b04738cc7a6 could not be found. Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6f355330-d8b0-4997-b70d-0b04738cc7a6 could not be found. Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6f355330-d8b0-4997-b70d-0b04738cc7a6 could not be found. Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d5316d4d-b71c-4420-abc6-d39b73de4d9a tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Returning 404 to user: Snapshot 6f355330-d8b0-4997-b70d-0b04738cc7a6 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:06:28.807750 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d5316d4d-b71c-4420-abc6-d39b73de4d9a tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6" status: 404 len: 111 microversion: 2.1 time: 0.044871 Oct 24 11:06:28.811348 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3282/6537] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Oct 24 11:06:28 2022] GET /compute/v2.1/os-snapshots/6f355330-d8b0-4997-b70d-0b04738cc7a6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:06:28.819846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10a622ab-9e2d-4959-87a9-72c3da458eb7 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04cbb890d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:28.889187 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10a622ab-9e2d-4959-87a9-72c3da458eb7 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267" status: 202 len: 0 microversion: 2.1 time: 0.076169 Oct 24 11:06:28.893867 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3256/6538] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Oct 24 11:06:28 2022] DELETE /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:06:28.899204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f2741062-e1a1-4060-8f96-17f75da34e7c tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04cba9b670>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:28.964538 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f2741062-e1a1-4060-8f96-17f75da34e7c tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267" status: 200 len: 345 microversion: 2.1 time: 0.069757 Oct 24 11:06:28.965158 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3283/6539] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 11:06:28 2022] GET /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267 => generated 345 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:06:29.617800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68229d1e-d846-4cd3-9ac2-48ba88abd9d1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:29.618607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-68229d1e-d846-4cd3-9ac2-48ba88abd9d1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:29.628067 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68229d1e-d846-4cd3-9ac2-48ba88abd9d1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:29.628573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68229d1e-d846-4cd3-9ac2-48ba88abd9d1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:29.629394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68229d1e-d846-4cd3-9ac2-48ba88abd9d1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:29.630286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68229d1e-d846-4cd3-9ac2-48ba88abd9d1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:29.630286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68229d1e-d846-4cd3-9ac2-48ba88abd9d1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:29.630676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68229d1e-d846-4cd3-9ac2-48ba88abd9d1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:29.720303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-68229d1e-d846-4cd3-9ac2-48ba88abd9d1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:29.728261 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-68229d1e-d846-4cd3-9ac2-48ba88abd9d1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf" status: 200 len: 1300 microversion: 2.1 time: 0.114606 Oct 24 11:06:29.729005 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3257/6540] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:29 2022] GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf => generated 1300 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:29.982554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a5d32b35-a6c6-43a7-94a2-416aeabd5eb8 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04d0a8f8b0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:30.043172 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a5d32b35-a6c6-43a7-94a2-416aeabd5eb8 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267" status: 200 len: 345 microversion: 2.1 time: 0.065332 Oct 24 11:06:30.043943 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3284/6541] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 11:06:29 2022] GET /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:06:30.764978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5874a86-ee4c-4059-ada1-7d1e8a767d38 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:30.766874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d5874a86-ee4c-4059-ada1-7d1e8a767d38 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:30.775168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5874a86-ee4c-4059-ada1-7d1e8a767d38 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:30.775656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5874a86-ee4c-4059-ada1-7d1e8a767d38 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:30.776093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5874a86-ee4c-4059-ada1-7d1e8a767d38 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:30.776802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5874a86-ee4c-4059-ada1-7d1e8a767d38 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:30.777275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5874a86-ee4c-4059-ada1-7d1e8a767d38 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:30.777697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5874a86-ee4c-4059-ada1-7d1e8a767d38 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:30.877823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d5874a86-ee4c-4059-ada1-7d1e8a767d38 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:30.886340 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d5874a86-ee4c-4059-ada1-7d1e8a767d38 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf" status: 200 len: 1300 microversion: 2.1 time: 0.138638 Oct 24 11:06:30.887063 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3258/6542] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:30 2022] GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf => generated 1300 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:31.059146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3ea4666-1e81-4a6b-9676-b8921db1193b tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04cbaa43a0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:31.090334 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-f3ea4666-1e81-4a6b-9676-b8921db1193b tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] HTTP exception thrown: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3ea4666-1e81-4a6b-9676-b8921db1193b tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Request method failure captured: Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267 HTTP/1.1 Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnGrG_-JFaJjDyT9q1VbKHPLsb_Hv0xusYUVaMzBtQMKIxHjIFYOqW6CNb3eQYutQmcxxllfFgu9U6IL4tCTx2RlBQ37s7NNjwSjrazIfYeBQ8nrvDHF4ReWJLp_AOR8LUePvjGtJwS8tFlG0BTD9mJGxJxEIJXLNhDYkkLIL3aX2ic Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 12fa964b32674f73aa39e6d68a082938 Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-978726960 Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/12fa964b32674f73aa39e6d68a082938"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/12fa964b32674f73aa39e6d68a082938"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/12fa964b32674f73aa39e6d68a082938"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_12fa964b32674f73aa39e6d68a082938", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-VolumesSnapshotsTestJSON-978726960 Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 12fa964b32674f73aa39e6d68a082938 Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-978726960 Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-VolumesSnapshotsTestJSON-978726960-project Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 6ea3974e7c57420db2e33f7cd7c27d87 Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-VolumesSnapshotsTestJSON-978726960-project Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: exception: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'ed30b347-9231-42e5-bb00-e353c8d6b267'} Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. (HTTP 404) (Request-ID: req-87858675-2b02-42d8-a553-87843e7ef391) Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 11:06:31.092790 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3ea4666-1e81-4a6b-9676-b8921db1193b tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Returning 404 to user: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:06:31.098006 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f3ea4666-1e81-4a6b-9676-b8921db1193b tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267" status: 404 len: 109 microversion: 2.1 time: 0.040312 Oct 24 11:06:31.105047 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3285/6543] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 11:06:31 2022] GET /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:06:31.107476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-52a7fb5c-62d0-42c7-90ea-ba568cc8d4e6 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04d4e8d8b0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:31.165610 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-52a7fb5c-62d0-42c7-90ea-ba568cc8d4e6 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] HTTP exception thrown: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-52a7fb5c-62d0-42c7-90ea-ba568cc8d4e6 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Request method failure captured: Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267 HTTP/1.1 Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnGrG_-JFaJjDyT9q1VbKHPLsb_Hv0xusYUVaMzBtQMKIxHjIFYOqW6CNb3eQYutQmcxxllfFgu9U6IL4tCTx2RlBQ37s7NNjwSjrazIfYeBQ8nrvDHF4ReWJLp_AOR8LUePvjGtJwS8tFlG0BTD9mJGxJxEIJXLNhDYkkLIL3aX2ic Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 12fa964b32674f73aa39e6d68a082938 Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-978726960 Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/12fa964b32674f73aa39e6d68a082938"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/12fa964b32674f73aa39e6d68a082938"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/12fa964b32674f73aa39e6d68a082938"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_12fa964b32674f73aa39e6d68a082938", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-VolumesSnapshotsTestJSON-978726960 Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 12fa964b32674f73aa39e6d68a082938 Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-978726960 Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-VolumesSnapshotsTestJSON-978726960-project Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 6ea3974e7c57420db2e33f7cd7c27d87 Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-VolumesSnapshotsTestJSON-978726960-project Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: method: Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: exception: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'ed30b347-9231-42e5-bb00-e353c8d6b267'} Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. (HTTP 404) (Request-ID: req-9dd180f4-e74a-4451-9d8b-85dce97d6b9e) Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 11:06:31.167846 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-52a7fb5c-62d0-42c7-90ea-ba568cc8d4e6 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Returning 404 to user: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-52a7fb5c-62d0-42c7-90ea-ba568cc8d4e6 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267" status: 404 len: 109 microversion: 2.1 time: 0.066154 Oct 24 11:06:31.174367 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3259/6544] 10.222.0.50 () {58 vars in 1248 bytes} [Mon Oct 24 11:06:31 2022] DELETE /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:06:31.181919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-39c0d34f-dc3b-40e1-abeb-9fe65166ac22 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Calling method '.version_select at 0x7f04cbaa4ca0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:31.211142 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-39c0d34f-dc3b-40e1-abeb-9fe65166ac22 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] HTTP exception thrown: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-39c0d34f-dc3b-40e1-abeb-9fe65166ac22 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Request method failure captured: Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267 HTTP/1.1 Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnGrG_-JFaJjDyT9q1VbKHPLsb_Hv0xusYUVaMzBtQMKIxHjIFYOqW6CNb3eQYutQmcxxllfFgu9U6IL4tCTx2RlBQ37s7NNjwSjrazIfYeBQ8nrvDHF4ReWJLp_AOR8LUePvjGtJwS8tFlG0BTD9mJGxJxEIJXLNhDYkkLIL3aX2ic Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 12fa964b32674f73aa39e6d68a082938 Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-978726960 Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/12fa964b32674f73aa39e6d68a082938"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/12fa964b32674f73aa39e6d68a082938"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/12fa964b32674f73aa39e6d68a082938"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_12fa964b32674f73aa39e6d68a082938", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-VolumesSnapshotsTestJSON-978726960 Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 12fa964b32674f73aa39e6d68a082938 Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-978726960 Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-VolumesSnapshotsTestJSON-978726960-project Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 6ea3974e7c57420db2e33f7cd7c27d87 Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-VolumesSnapshotsTestJSON-978726960-project Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: method: Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: exception: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'ed30b347-9231-42e5-bb00-e353c8d6b267'} Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. (HTTP 404) (Request-ID: req-34647cab-7afd-4b1c-b91f-4c1d40cbff0c) Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 11:06:31.213323 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-39c0d34f-dc3b-40e1-abeb-9fe65166ac22 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] Returning 404 to user: Volume ed30b347-9231-42e5-bb00-e353c8d6b267 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:06:31.218645 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-39c0d34f-dc3b-40e1-abeb-9fe65166ac22 tempest-VolumesSnapshotsTestJSON-978726960 tempest-VolumesSnapshotsTestJSON-978726960-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267" status: 404 len: 109 microversion: 2.1 time: 0.037116 Oct 24 11:06:31.224914 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3286/6545] 10.222.0.50 () {58 vars in 1245 bytes} [Mon Oct 24 11:06:31 2022] GET /compute/v2.1/os-volumes/ed30b347-9231-42e5-bb00-e353c8d6b267 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:06:31.912264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5909d5db-862e-4bb0-8a21-7b163048f013 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:31.912761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5909d5db-862e-4bb0-8a21-7b163048f013 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:31.928636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5909d5db-862e-4bb0-8a21-7b163048f013 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:31.929341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5909d5db-862e-4bb0-8a21-7b163048f013 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:31.929656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5909d5db-862e-4bb0-8a21-7b163048f013 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:31.930527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5909d5db-862e-4bb0-8a21-7b163048f013 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:31.933615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5909d5db-862e-4bb0-8a21-7b163048f013 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:31.934189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5909d5db-862e-4bb0-8a21-7b163048f013 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:32.133435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5909d5db-862e-4bb0-8a21-7b163048f013 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:32.143379 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5909d5db-862e-4bb0-8a21-7b163048f013 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf" status: 200 len: 1300 microversion: 2.1 time: 0.237312 Oct 24 11:06:32.159370 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3260/6546] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:31 2022] GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf => generated 1300 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:33.172014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e540c149-47b8-4594-9f4c-116bfaa8eaac tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:33.172681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e540c149-47b8-4594-9f4c-116bfaa8eaac tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:33.180077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e540c149-47b8-4594-9f4c-116bfaa8eaac tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:33.181201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e540c149-47b8-4594-9f4c-116bfaa8eaac tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:33.181201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e540c149-47b8-4594-9f4c-116bfaa8eaac tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:33.181779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e540c149-47b8-4594-9f4c-116bfaa8eaac tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:33.182243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e540c149-47b8-4594-9f4c-116bfaa8eaac tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:33.182677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e540c149-47b8-4594-9f4c-116bfaa8eaac tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:33.298538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e540c149-47b8-4594-9f4c-116bfaa8eaac tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:33.310825 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e540c149-47b8-4594-9f4c-116bfaa8eaac tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf" status: 200 len: 1300 microversion: 2.1 time: 0.145984 Oct 24 11:06:33.311724 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3287/6547] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:33 2022] GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf => generated 1300 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:34.304711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3cebddfe-2ede-4fd0-a905-d209965d4119 req-a1d7d87c-b712-4b98-8eeb-c9b11524bd8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a6c54d3-896a-4b1d-b553-b70f38a09abf", "name": "network-vif-plugged", "status": "completed", "tag": "3dbd6519-e459-4847-93a7-0e4cecfc3e35"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:06:34.316149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3cebddfe-2ede-4fd0-a905-d209965d4119 req-a1d7d87c-b712-4b98-8eeb-c9b11524bd8b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:34.316635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3cebddfe-2ede-4fd0-a905-d209965d4119 req-a1d7d87c-b712-4b98-8eeb-c9b11524bd8b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:34.317583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3cebddfe-2ede-4fd0-a905-d209965d4119 req-a1d7d87c-b712-4b98-8eeb-c9b11524bd8b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:34.330279 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3cebddfe-2ede-4fd0-a905-d209965d4119 req-a1d7d87c-b712-4b98-8eeb-c9b11524bd8b service nova] Creating event network-vif-plugged:3dbd6519-e459-4847-93a7-0e4cecfc3e35 for instance 3a6c54d3-896a-4b1d-b553-b70f38a09abf on n-h2-858383-15 Oct 24 11:06:34.337601 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3cebddfe-2ede-4fd0-a905-d209965d4119 req-a1d7d87c-b712-4b98-8eeb-c9b11524bd8b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229556 Oct 24 11:06:34.341310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d734cbfc-88ad-4a3b-9077-586f02ca305f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:34.342858 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3261/6548] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:06:34.343079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d734cbfc-88ad-4a3b-9077-586f02ca305f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:34.353614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d734cbfc-88ad-4a3b-9077-586f02ca305f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:34.354126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d734cbfc-88ad-4a3b-9077-586f02ca305f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:34.354663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d734cbfc-88ad-4a3b-9077-586f02ca305f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:34.355567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d734cbfc-88ad-4a3b-9077-586f02ca305f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:34.356248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d734cbfc-88ad-4a3b-9077-586f02ca305f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:34.356699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d734cbfc-88ad-4a3b-9077-586f02ca305f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:34.459828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d734cbfc-88ad-4a3b-9077-586f02ca305f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:34.469261 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d734cbfc-88ad-4a3b-9077-586f02ca305f tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf" status: 200 len: 1300 microversion: 2.1 time: 0.136272 Oct 24 11:06:34.470751 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3288/6549] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:34 2022] GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf => generated 1300 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:35.497876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a664accc-6b71-4eb1-81b8-ff66ebb4ccc1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:35.498771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a664accc-6b71-4eb1-81b8-ff66ebb4ccc1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:35.505438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:06:35.506789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:06:35.510223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a664accc-6b71-4eb1-81b8-ff66ebb4ccc1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:35.511222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a664accc-6b71-4eb1-81b8-ff66ebb4ccc1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:35.511944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a664accc-6b71-4eb1-81b8-ff66ebb4ccc1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:35.512802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a664accc-6b71-4eb1-81b8-ff66ebb4ccc1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:35.513426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a664accc-6b71-4eb1-81b8-ff66ebb4ccc1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:35.513966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a664accc-6b71-4eb1-81b8-ff66ebb4ccc1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:35.613800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a664accc-6b71-4eb1-81b8-ff66ebb4ccc1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:35.636554 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a664accc-6b71-4eb1-81b8-ff66ebb4ccc1 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf" status: 200 len: 1300 microversion: 2.1 time: 0.142087 Oct 24 11:06:35.638323 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3262/6550] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:35 2022] GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf => generated 1300 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:36.664827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f8c2346c-2bad-4600-8479-3825d4b1f663 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:36.665728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f8c2346c-2bad-4600-8479-3825d4b1f663 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:36.668216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:06:36.677303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8c2346c-2bad-4600-8479-3825d4b1f663 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:36.677919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8c2346c-2bad-4600-8479-3825d4b1f663 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:36.678485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8c2346c-2bad-4600-8479-3825d4b1f663 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:36.679255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8c2346c-2bad-4600-8479-3825d4b1f663 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:36.679880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8c2346c-2bad-4600-8479-3825d4b1f663 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:36.680478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f8c2346c-2bad-4600-8479-3825d4b1f663 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:36.765740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f8c2346c-2bad-4600-8479-3825d4b1f663 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:36.774706 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f8c2346c-2bad-4600-8479-3825d4b1f663 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf" status: 200 len: 1473 microversion: 2.1 time: 0.114468 Oct 24 11:06:36.775409 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3289/6551] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:36 2022] GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf => generated 1473 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:36.797391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-418fbe39-58f9-45f3-a3a3-ac709eeda659 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:36.799253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-418fbe39-58f9-45f3-a3a3-ac709eeda659 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:36.807225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-418fbe39-58f9-45f3-a3a3-ac709eeda659 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:36.808032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-418fbe39-58f9-45f3-a3a3-ac709eeda659 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:36.808670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-418fbe39-58f9-45f3-a3a3-ac709eeda659 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:36.809404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-418fbe39-58f9-45f3-a3a3-ac709eeda659 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:36.810014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-418fbe39-58f9-45f3-a3a3-ac709eeda659 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:36.810668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-418fbe39-58f9-45f3-a3a3-ac709eeda659 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:36.914885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-418fbe39-58f9-45f3-a3a3-ac709eeda659 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:36.924036 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-418fbe39-58f9-45f3-a3a3-ac709eeda659 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf" status: 200 len: 1473 microversion: 2.1 time: 0.130652 Oct 24 11:06:36.937902 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3263/6552] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:36 2022] GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf => generated 1473 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:36.947077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-73e9a0be-c45b-4ec4-ac44-e0f85059661a tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:36.947701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-73e9a0be-c45b-4ec4-ac44-e0f85059661a tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:36.954268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73e9a0be-c45b-4ec4-ac44-e0f85059661a tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:36.954767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73e9a0be-c45b-4ec4-ac44-e0f85059661a tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:36.955212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73e9a0be-c45b-4ec4-ac44-e0f85059661a tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:36.955926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73e9a0be-c45b-4ec4-ac44-e0f85059661a tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:36.956384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73e9a0be-c45b-4ec4-ac44-e0f85059661a tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:36.956951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73e9a0be-c45b-4ec4-ac44-e0f85059661a tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:37.046264 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-73e9a0be-c45b-4ec4-ac44-e0f85059661a tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf" status: 200 len: 1626 microversion: 2.1 time: 0.102528 Oct 24 11:06:37.047370 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3290/6553] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:36 2022] GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf => generated 1626 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:37.073288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-60e73879-fe87-41e9-8cb0-4eea701a6be6 tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:37.073905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-60e73879-fe87-41e9-8cb0-4eea701a6be6 tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:37.082266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60e73879-fe87-41e9-8cb0-4eea701a6be6 tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:37.082771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60e73879-fe87-41e9-8cb0-4eea701a6be6 tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:37.083221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60e73879-fe87-41e9-8cb0-4eea701a6be6 tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:37.084148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60e73879-fe87-41e9-8cb0-4eea701a6be6 tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:37.084618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60e73879-fe87-41e9-8cb0-4eea701a6be6 tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:37.085076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60e73879-fe87-41e9-8cb0-4eea701a6be6 tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:37.241311 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-60e73879-fe87-41e9-8cb0-4eea701a6be6 tempest-TestSecurityGroupsBasicOps-2067731684 tempest-TestSecurityGroupsBasicOps-2067731684-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 200 len: 1911 microversion: 2.1 time: 0.171581 Oct 24 11:06:37.241896 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3264/6554] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:37 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 1911 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:37.316106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c6a9314e-195c-4a94-b523-a28f351df332 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:37.316612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c6a9314e-195c-4a94-b523-a28f351df332 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:37.322691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6a9314e-195c-4a94-b523-a28f351df332 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:37.323185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6a9314e-195c-4a94-b523-a28f351df332 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:37.323664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6a9314e-195c-4a94-b523-a28f351df332 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:37.324382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6a9314e-195c-4a94-b523-a28f351df332 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:37.324867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6a9314e-195c-4a94-b523-a28f351df332 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:37.325299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6a9314e-195c-4a94-b523-a28f351df332 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:37.354102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c6a9314e-195c-4a94-b523-a28f351df332 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:06:37.440253 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c6a9314e-195c-4a94-b523-a28f351df332 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf" status: 204 len: 0 microversion: 2.1 time: 0.127690 Oct 24 11:06:37.445732 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3291/6555] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:06:37 2022] DELETE /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:06:37.451055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-858c005e-ac0e-4f88-856f-4437ea69e92b tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:37.451763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-858c005e-ac0e-4f88-856f-4437ea69e92b tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:37.459381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-858c005e-ac0e-4f88-856f-4437ea69e92b tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:37.459996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-858c005e-ac0e-4f88-856f-4437ea69e92b tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:37.460645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-858c005e-ac0e-4f88-856f-4437ea69e92b tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:37.461386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-858c005e-ac0e-4f88-856f-4437ea69e92b tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:37.462026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-858c005e-ac0e-4f88-856f-4437ea69e92b tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:37.462465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-858c005e-ac0e-4f88-856f-4437ea69e92b tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:37.555506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-858c005e-ac0e-4f88-856f-4437ea69e92b tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:37.564965 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-858c005e-ac0e-4f88-856f-4437ea69e92b tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf" status: 200 len: 1479 microversion: 2.1 time: 0.118214 Oct 24 11:06:37.565544 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3265/6556] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:37 2022] GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf => generated 1479 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:06:38.589986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-91a9ddb4-a088-40bb-b35c-9cfcf7f51493 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:38.590827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-91a9ddb4-a088-40bb-b35c-9cfcf7f51493 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:38.598835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91a9ddb4-a088-40bb-b35c-9cfcf7f51493 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:38.599411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91a9ddb4-a088-40bb-b35c-9cfcf7f51493 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:38.600024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91a9ddb4-a088-40bb-b35c-9cfcf7f51493 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:38.600793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91a9ddb4-a088-40bb-b35c-9cfcf7f51493 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:38.601482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91a9ddb4-a088-40bb-b35c-9cfcf7f51493 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:38.602079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91a9ddb4-a088-40bb-b35c-9cfcf7f51493 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:38.731823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-91a9ddb4-a088-40bb-b35c-9cfcf7f51493 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:38.741306 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-91a9ddb4-a088-40bb-b35c-9cfcf7f51493 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf" status: 200 len: 1479 microversion: 2.1 time: 0.155744 Oct 24 11:06:38.757845 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3292/6557] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:38 2022] GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf => generated 1479 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:39.550259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a70d27cb-6d8c-469a-905c-e31842355442 req-620472b6-5ed8-49b2-8f57-548057226040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a6c54d3-896a-4b1d-b553-b70f38a09abf", "name": "network-vif-deleted", "tag": "3dbd6519-e459-4847-93a7-0e4cecfc3e35"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:06:39.560989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:06:39.582323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a70d27cb-6d8c-469a-905c-e31842355442 req-620472b6-5ed8-49b2-8f57-548057226040 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:39.583079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a70d27cb-6d8c-469a-905c-e31842355442 req-620472b6-5ed8-49b2-8f57-548057226040 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:39.583760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a70d27cb-6d8c-469a-905c-e31842355442 req-620472b6-5ed8-49b2-8f57-548057226040 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:39.619511 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a70d27cb-6d8c-469a-905c-e31842355442 req-620472b6-5ed8-49b2-8f57-548057226040 service nova] Creating event network-vif-deleted:3dbd6519-e459-4847-93a7-0e4cecfc3e35 for instance 3a6c54d3-896a-4b1d-b553-b70f38a09abf on n-h2-858383-15 Oct 24 11:06:39.632741 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a70d27cb-6d8c-469a-905c-e31842355442 req-620472b6-5ed8-49b2-8f57-548057226040 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086641 Oct 24 11:06:39.633845 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3266/6558] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:06:39.774324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d13847e3-d580-4447-a398-d36febef6d76 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:39.775119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d13847e3-d580-4447-a398-d36febef6d76 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:39.784562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d13847e3-d580-4447-a398-d36febef6d76 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:39.785348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d13847e3-d580-4447-a398-d36febef6d76 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:39.786365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d13847e3-d580-4447-a398-d36febef6d76 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:39.787332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d13847e3-d580-4447-a398-d36febef6d76 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:39.787996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d13847e3-d580-4447-a398-d36febef6d76 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:39.788490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d13847e3-d580-4447-a398-d36febef6d76 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:39.823889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d13847e3-d580-4447-a398-d36febef6d76 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:39.824337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d13847e3-d580-4447-a398-d36febef6d76 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:39.824864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d13847e3-d580-4447-a398-d36febef6d76 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:39.825388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-d13847e3-d580-4447-a398-d36febef6d76 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lazy-loading 'fault' on Instance uuid 3a6c54d3-896a-4b1d-b553-b70f38a09abf {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:06:39.868441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d13847e3-d580-4447-a398-d36febef6d76 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:39.878339 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d13847e3-d580-4447-a398-d36febef6d76 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf" status: 200 len: 1332 microversion: 2.1 time: 0.116365 Oct 24 11:06:39.878922 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3293/6559] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:39 2022] GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:40.902012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a735bd2c-d276-4c58-92ea-392651e4f790 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:40.902795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a735bd2c-d276-4c58-92ea-392651e4f790 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 3a6c54d3-896a-4b1d-b553-b70f38a09abf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:40.911557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a735bd2c-d276-4c58-92ea-392651e4f790 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:40.912050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a735bd2c-d276-4c58-92ea-392651e4f790 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:40.912536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a735bd2c-d276-4c58-92ea-392651e4f790 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:40.913291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a735bd2c-d276-4c58-92ea-392651e4f790 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:40.913929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a735bd2c-d276-4c58-92ea-392651e4f790 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:40.914532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a735bd2c-d276-4c58-92ea-392651e4f790 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:40.932362 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-a735bd2c-d276-4c58-92ea-392651e4f790 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] HTTP exception thrown: Instance 3a6c54d3-896a-4b1d-b553-b70f38a09abf could not be found. Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a735bd2c-d276-4c58-92ea-392651e4f790 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Request method failure captured: Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf HTTP/1.1 Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnFGhaLhO9oUElyhR4q4cU5Rv3aXcFba5J5sBwYEp8DVNzDw88WJfprz_T3nDFcNDc-Mh8aCKp0MSswrHeEKwEQUMUjC7ckxGMJQmYbgcbsE2YeV0LVxjqS40LJcO4QGZUVDZln2PqsRQnI_Tkwnjgdz3rWM4uk6aS_vJjvKtqZRCmg Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: d681efb474fb4d3bb62e07ca2d16bc33 Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-294952306 Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d681efb474fb4d3bb62e07ca2d16bc33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d681efb474fb4d3bb62e07ca2d16bc33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d681efb474fb4d3bb62e07ca2d16bc33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d681efb474fb4d3bb62e07ca2d16bc33", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestSecurityGroupsBasicOps-294952306 Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: d681efb474fb4d3bb62e07ca2d16bc33 Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-294952306 Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestSecurityGroupsBasicOps-294952306-project Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 97b622ac85ed493ab3c8a1761a480ada Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestSecurityGroupsBasicOps-294952306-project Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 3a6c54d3-896a-4b1d-b553-b70f38a09abf could not be found. Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '3a6c54d3-896a-4b1d-b553-b70f38a09abf'} Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a6c54d3-896a-4b1d-b553-b70f38a09abf could not be found. Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a6c54d3-896a-4b1d-b553-b70f38a09abf could not be found. Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:40.934423 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:40.939906 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:40.939906 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:40.939906 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:40.939906 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:06:40.939906 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:06:40.939906 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a6c54d3-896a-4b1d-b553-b70f38a09abf could not be found. Oct 24 11:06:40.939906 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:40.941601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a735bd2c-d276-4c58-92ea-392651e4f790 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Returning 404 to user: Instance 3a6c54d3-896a-4b1d-b553-b70f38a09abf could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:06:40.942713 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a735bd2c-d276-4c58-92ea-392651e4f790 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf" status: 404 len: 111 microversion: 2.1 time: 0.044954 Oct 24 11:06:40.943788 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3267/6560] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:40 2022] GET /compute/v2.1/servers/3a6c54d3-896a-4b1d-b553-b70f38a09abf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:06:47.058945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aed02fbe-2127-469c-a00f-9c53ea91029d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:47.059564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aed02fbe-2127-469c-a00f-9c53ea91029d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:47.062452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e8fda899-ef24-4f5c-a424-3f8d34261054 req-3a6c9dad-cf53-49a8-8fc1-9a9650eaaca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131f69b2-1939-4211-a289-c03759f7d383", "tag": "f76e9ba4-25d3-4a1b-b12a-3970c21f0da4"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:06:47.074916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e8fda899-ef24-4f5c-a424-3f8d34261054 req-3a6c9dad-cf53-49a8-8fc1-9a9650eaaca4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:47.075161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aed02fbe-2127-469c-a00f-9c53ea91029d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:47.075698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aed02fbe-2127-469c-a00f-9c53ea91029d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:47.075993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e8fda899-ef24-4f5c-a424-3f8d34261054 req-3a6c9dad-cf53-49a8-8fc1-9a9650eaaca4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:47.076160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aed02fbe-2127-469c-a00f-9c53ea91029d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:47.076762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e8fda899-ef24-4f5c-a424-3f8d34261054 req-3a6c9dad-cf53-49a8-8fc1-9a9650eaaca4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:47.078109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aed02fbe-2127-469c-a00f-9c53ea91029d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:47.079722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aed02fbe-2127-469c-a00f-9c53ea91029d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:47.080188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aed02fbe-2127-469c-a00f-9c53ea91029d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:47.089956 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e8fda899-ef24-4f5c-a424-3f8d34261054 req-3a6c9dad-cf53-49a8-8fc1-9a9650eaaca4 service nova] Creating event network-changed:f76e9ba4-25d3-4a1b-b12a-3970c21f0da4 for instance 131f69b2-1939-4211-a289-c03759f7d383 on n-h1-858383-15 Oct 24 11:06:47.095672 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e8fda899-ef24-4f5c-a424-3f8d34261054 req-3a6c9dad-cf53-49a8-8fc1-9a9650eaaca4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037886 Oct 24 11:06:47.096492 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3268/6561] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:06:47.133666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aed02fbe-2127-469c-a00f-9c53ea91029d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:06:47.240781 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aed02fbe-2127-469c-a00f-9c53ea91029d tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "DELETE /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 204 len: 0 microversion: 2.1 time: 0.186336 Oct 24 11:06:47.241742 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3294/6562] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:06:47 2022] DELETE /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:06:47.253754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f216c1ed-cac3-49f0-a4d5-0e4482226df0 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:47.255306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f216c1ed-cac3-49f0-a4d5-0e4482226df0 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:47.264122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f216c1ed-cac3-49f0-a4d5-0e4482226df0 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:47.265004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f216c1ed-cac3-49f0-a4d5-0e4482226df0 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:47.265865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f216c1ed-cac3-49f0-a4d5-0e4482226df0 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:47.267565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f216c1ed-cac3-49f0-a4d5-0e4482226df0 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:47.268329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f216c1ed-cac3-49f0-a4d5-0e4482226df0 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:47.269025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f216c1ed-cac3-49f0-a4d5-0e4482226df0 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:47.568194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f216c1ed-cac3-49f0-a4d5-0e4482226df0 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:47.577137 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f216c1ed-cac3-49f0-a4d5-0e4482226df0 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 200 len: 1764 microversion: 2.1 time: 0.330642 Oct 24 11:06:47.583676 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3269/6563] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:47 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 1764 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:48.612277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d704fa99-f49f-45b8-8deb-b2338af5cc30 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:48.613396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d704fa99-f49f-45b8-8deb-b2338af5cc30 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:48.631005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d704fa99-f49f-45b8-8deb-b2338af5cc30 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:48.631492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d704fa99-f49f-45b8-8deb-b2338af5cc30 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:48.632058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d704fa99-f49f-45b8-8deb-b2338af5cc30 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:48.632774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d704fa99-f49f-45b8-8deb-b2338af5cc30 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:48.633440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d704fa99-f49f-45b8-8deb-b2338af5cc30 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:48.634252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d704fa99-f49f-45b8-8deb-b2338af5cc30 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:48.869781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d704fa99-f49f-45b8-8deb-b2338af5cc30 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:48.879970 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d704fa99-f49f-45b8-8deb-b2338af5cc30 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 200 len: 1764 microversion: 2.1 time: 0.274045 Oct 24 11:06:48.891048 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3295/6564] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:48 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 1764 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:49.280653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c09c7470-62a2-42d7-8600-fcc9eae523c5 req-b89e0dac-85de-4610-9fe7-1d31d1e4a2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131f69b2-1939-4211-a289-c03759f7d383", "name": "network-vif-deleted", "tag": "f76e9ba4-25d3-4a1b-b12a-3970c21f0da4"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:06:49.296776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c09c7470-62a2-42d7-8600-fcc9eae523c5 req-b89e0dac-85de-4610-9fe7-1d31d1e4a2a4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:49.298265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c09c7470-62a2-42d7-8600-fcc9eae523c5 req-b89e0dac-85de-4610-9fe7-1d31d1e4a2a4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:49.298997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c09c7470-62a2-42d7-8600-fcc9eae523c5 req-b89e0dac-85de-4610-9fe7-1d31d1e4a2a4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:49.315085 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c09c7470-62a2-42d7-8600-fcc9eae523c5 req-b89e0dac-85de-4610-9fe7-1d31d1e4a2a4 service nova] Creating event network-vif-deleted:f76e9ba4-25d3-4a1b-b12a-3970c21f0da4 for instance 131f69b2-1939-4211-a289-c03759f7d383 on n-h1-858383-15 Oct 24 11:06:49.322615 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c09c7470-62a2-42d7-8600-fcc9eae523c5 req-b89e0dac-85de-4610-9fe7-1d31d1e4a2a4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045360 Oct 24 11:06:49.323949 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3270/6565] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:06:49.906750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e2c94027-8dc1-4f4c-afaf-4a37ab3de194 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:49.908074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e2c94027-8dc1-4f4c-afaf-4a37ab3de194 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:49.915163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2c94027-8dc1-4f4c-afaf-4a37ab3de194 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:49.915647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2c94027-8dc1-4f4c-afaf-4a37ab3de194 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:49.916081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2c94027-8dc1-4f4c-afaf-4a37ab3de194 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:49.916785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2c94027-8dc1-4f4c-afaf-4a37ab3de194 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:49.917267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2c94027-8dc1-4f4c-afaf-4a37ab3de194 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:49.918292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2c94027-8dc1-4f4c-afaf-4a37ab3de194 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:49.955886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2c94027-8dc1-4f4c-afaf-4a37ab3de194 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:49.956369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2c94027-8dc1-4f4c-afaf-4a37ab3de194 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:49.956806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2c94027-8dc1-4f4c-afaf-4a37ab3de194 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:49.957289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-e2c94027-8dc1-4f4c-afaf-4a37ab3de194 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lazy-loading 'fault' on Instance uuid 131f69b2-1939-4211-a289-c03759f7d383 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:06:49.960416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:06:50.005546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e2c94027-8dc1-4f4c-afaf-4a37ab3de194 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b622ac85ed493ab3c8a1761a480ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd681efb474fb4d3bb62e07ca2d16bc33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:06:50.013130 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e2c94027-8dc1-4f4c-afaf-4a37ab3de194 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 200 len: 1383 microversion: 2.1 time: 0.110518 Oct 24 11:06:50.013705 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3296/6566] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:49 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 1383 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:06:51.039320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0f95cd6f-f7e3-42cb-817e-fe041c42cc8e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:51.040039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0f95cd6f-f7e3-42cb-817e-fe041c42cc8e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] [instance: 131f69b2-1939-4211-a289-c03759f7d383] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:06:51.048139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f95cd6f-f7e3-42cb-817e-fe041c42cc8e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:51.048778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f95cd6f-f7e3-42cb-817e-fe041c42cc8e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:51.049462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f95cd6f-f7e3-42cb-817e-fe041c42cc8e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:51.050333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f95cd6f-f7e3-42cb-817e-fe041c42cc8e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:06:51.050965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f95cd6f-f7e3-42cb-817e-fe041c42cc8e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:06:51.051405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0f95cd6f-f7e3-42cb-817e-fe041c42cc8e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:06:51.065852 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-0f95cd6f-f7e3-42cb-817e-fe041c42cc8e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] HTTP exception thrown: Instance 131f69b2-1939-4211-a289-c03759f7d383 could not be found. Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0f95cd6f-f7e3-42cb-817e-fe041c42cc8e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Request method failure captured: Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 HTTP/1.1 Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnFGhaLhO9oUElyhR4q4cU5Rv3aXcFba5J5sBwYEp8DVNzDw88WJfprz_T3nDFcNDc-Mh8aCKp0MSswrHeEKwEQUMUjC7ckxGMJQmYbgcbsE2YeV0LVxjqS40LJcO4QGZUVDZln2PqsRQnI_Tkwnjgdz3rWM4uk6aS_vJjvKtqZRCmg Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: d681efb474fb4d3bb62e07ca2d16bc33 Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-294952306 Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d681efb474fb4d3bb62e07ca2d16bc33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d681efb474fb4d3bb62e07ca2d16bc33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d681efb474fb4d3bb62e07ca2d16bc33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d681efb474fb4d3bb62e07ca2d16bc33", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestSecurityGroupsBasicOps-294952306 Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: d681efb474fb4d3bb62e07ca2d16bc33 Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-294952306 Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestSecurityGroupsBasicOps-294952306-project Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 97b622ac85ed493ab3c8a1761a480ada Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestSecurityGroupsBasicOps-294952306-project Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 131f69b2-1939-4211-a289-c03759f7d383 could not be found. Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '131f69b2-1939-4211-a289-c03759f7d383'} Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 131f69b2-1939-4211-a289-c03759f7d383 could not be found. Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 131f69b2-1939-4211-a289-c03759f7d383 could not be found. Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:06:51.067955 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:51.072144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:06:51.072144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:06:51.072144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:06:51.072144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:06:51.072144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:06:51.072144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 131f69b2-1939-4211-a289-c03759f7d383 could not be found. Oct 24 11:06:51.072144 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:06:51.072144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0f95cd6f-f7e3-42cb-817e-fe041c42cc8e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Returning 404 to user: Instance 131f69b2-1939-4211-a289-c03759f7d383 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:06:51.072144 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0f95cd6f-f7e3-42cb-817e-fe041c42cc8e tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383" status: 404 len: 111 microversion: 2.1 time: 0.034647 Oct 24 11:06:51.072144 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3271/6567] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:06:51 2022] GET /compute/v2.1/servers/131f69b2-1939-4211-a289-c03759f7d383 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:06:55.164425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ae27ad3c-8e5e-445e-9b9c-6b8943c86757 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] Calling method '.version_select at 0x7f04d4df3ca0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:06:55.178263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:06:55.216984 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ae27ad3c-8e5e-445e-9b9c-6b8943c86757 tempest-TestSecurityGroupsBasicOps-294952306 tempest-TestSecurityGroupsBasicOps-294952306-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1552156643" status: 202 len: 0 microversion: 2.1 time: 0.056551 Oct 24 11:06:55.218307 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3297/6568] 10.222.0.50 () {58 vars in 1278 bytes} [Mon Oct 24 11:06:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1552156643 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:07:51.923769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=11 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:07:51.925113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=64 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:07:51.925953 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:07:51.926096 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:07:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.50) !!! Oct 24 11:07:52.082591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10394025-137a-4949-a8b0-5915dbbf3a2c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-718518331", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "9bb1214d-685c-4845-987c-9c9ab985bfd3"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:07:52.140190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-10394025-137a-4949-a8b0-5915dbbf3a2c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] validate_networks() for [('9bb1214d-685c-4845-987c-9c9ab985bfd3', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:07:52.505279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-10394025-137a-4949-a8b0-5915dbbf3a2c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:07:52.505719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-10394025-137a-4949-a8b0-5915dbbf3a2c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:07:52.506248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-10394025-137a-4949-a8b0-5915dbbf3a2c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:07:52.506621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-10394025-137a-4949-a8b0-5915dbbf3a2c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:07:52.507042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-10394025-137a-4949-a8b0-5915dbbf3a2c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:07:52.516338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10394025-137a-4949-a8b0-5915dbbf3a2c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:07:52.516861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10394025-137a-4949-a8b0-5915dbbf3a2c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:07:52.517313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10394025-137a-4949-a8b0-5915dbbf3a2c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:07:52.518060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10394025-137a-4949-a8b0-5915dbbf3a2c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:07:52.518525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10394025-137a-4949-a8b0-5915dbbf3a2c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:07:52.518963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10394025-137a-4949-a8b0-5915dbbf3a2c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:07:52.536052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-10394025-137a-4949-a8b0-5915dbbf3a2c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Getting quotas for project be44e83cfdfc485d97fc891a5b1c4744. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:07:52.541491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-10394025-137a-4949-a8b0-5915dbbf3a2c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Getting quotas for user 38afe855fe744d25adeef84162a12fa7 and project be44e83cfdfc485d97fc891a5b1c4744. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:07:52.555458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-10394025-137a-4949-a8b0-5915dbbf3a2c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:07:52.557830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-10394025-137a-4949-a8b0-5915dbbf3a2c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] [instance: 349c05f2-b42c-4613-aaca-6443ee23817a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:07:52.604075 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10394025-137a-4949-a8b0-5915dbbf3a2c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682260 Oct 24 11:07:52.604735 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3272/6569] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:07:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:07:52.615500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:07:52.616245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:07:52.617599 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:07:52.617849 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:07:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a (ip 10.222.0.50) !!! Oct 24 11:07:52.625071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-659adb2a-7c1a-4ba1-b1c6-087aab6de692 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:07:52.625620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-659adb2a-7c1a-4ba1-b1c6-087aab6de692 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] [instance: 349c05f2-b42c-4613-aaca-6443ee23817a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:07:52.693978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-659adb2a-7c1a-4ba1-b1c6-087aab6de692 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38afe855fe744d25adeef84162a12fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44e83cfdfc485d97fc891a5b1c4744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:07:52.701880 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-659adb2a-7c1a-4ba1-b1c6-087aab6de692 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] 10.222.0.50 "GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a" status: 200 len: 1213 microversion: 2.1 time: 0.088386 Oct 24 11:07:52.702940 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3298/6570] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:07:52 2022] GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:07:53.725836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3dfa22b9-1cbe-4601-8998-5965f19ad154 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:07:53.726465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3dfa22b9-1cbe-4601-8998-5965f19ad154 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] [instance: 349c05f2-b42c-4613-aaca-6443ee23817a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:07:53.735664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dfa22b9-1cbe-4601-8998-5965f19ad154 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:07:53.736412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dfa22b9-1cbe-4601-8998-5965f19ad154 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:07:53.737204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dfa22b9-1cbe-4601-8998-5965f19ad154 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:07:53.737919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dfa22b9-1cbe-4601-8998-5965f19ad154 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:07:53.738379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dfa22b9-1cbe-4601-8998-5965f19ad154 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:07:53.738808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dfa22b9-1cbe-4601-8998-5965f19ad154 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:07:53.809768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3dfa22b9-1cbe-4601-8998-5965f19ad154 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38afe855fe744d25adeef84162a12fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44e83cfdfc485d97fc891a5b1c4744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:07:53.819195 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3dfa22b9-1cbe-4601-8998-5965f19ad154 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] 10.222.0.50 "GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a" status: 200 len: 1273 microversion: 2.1 time: 0.097426 Oct 24 11:07:53.833467 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3273/6571] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:07:53 2022] GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a => generated 1273 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:07:54.844860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-65d99ff1-f3e7-4c07-9564-8819965e1319 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:07:54.845472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-65d99ff1-f3e7-4c07-9564-8819965e1319 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] [instance: 349c05f2-b42c-4613-aaca-6443ee23817a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:07:54.852810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-65d99ff1-f3e7-4c07-9564-8819965e1319 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:07:54.853319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-65d99ff1-f3e7-4c07-9564-8819965e1319 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:07:54.853761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-65d99ff1-f3e7-4c07-9564-8819965e1319 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:07:54.854668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-65d99ff1-f3e7-4c07-9564-8819965e1319 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:07:54.855966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-65d99ff1-f3e7-4c07-9564-8819965e1319 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:07:54.856885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-65d99ff1-f3e7-4c07-9564-8819965e1319 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:07:55.061519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-65d99ff1-f3e7-4c07-9564-8819965e1319 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38afe855fe744d25adeef84162a12fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44e83cfdfc485d97fc891a5b1c4744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:07:55.080925 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-65d99ff1-f3e7-4c07-9564-8819965e1319 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] 10.222.0.50 "GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a" status: 200 len: 1313 microversion: 2.1 time: 0.240966 Oct 24 11:07:55.082615 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3299/6572] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:07:54 2022] GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:07:55.483249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ccb6fcdd-c0b0-4428-9a54-153a5aa60ca9 req-c4f41dbd-f605-435b-891b-e8ac4e08a988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "349c05f2-b42c-4613-aaca-6443ee23817a", "tag": "d40d4d3b-4aca-4665-8bad-bdfd14ff163f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:07:55.493380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ccb6fcdd-c0b0-4428-9a54-153a5aa60ca9 req-c4f41dbd-f605-435b-891b-e8ac4e08a988 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:07:55.493897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ccb6fcdd-c0b0-4428-9a54-153a5aa60ca9 req-c4f41dbd-f605-435b-891b-e8ac4e08a988 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:07:55.494327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ccb6fcdd-c0b0-4428-9a54-153a5aa60ca9 req-c4f41dbd-f605-435b-891b-e8ac4e08a988 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:07:55.507967 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ccb6fcdd-c0b0-4428-9a54-153a5aa60ca9 req-c4f41dbd-f605-435b-891b-e8ac4e08a988 service nova] Creating event network-changed:d40d4d3b-4aca-4665-8bad-bdfd14ff163f for instance 349c05f2-b42c-4613-aaca-6443ee23817a on n-h1-858383-15 Oct 24 11:07:55.513381 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ccb6fcdd-c0b0-4428-9a54-153a5aa60ca9 req-c4f41dbd-f605-435b-891b-e8ac4e08a988 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121891 Oct 24 11:07:55.513992 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3274/6573] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:07:56.108084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-05faeef5-1bef-4222-9406-f300fbbddf2a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:07:56.108829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-05faeef5-1bef-4222-9406-f300fbbddf2a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] [instance: 349c05f2-b42c-4613-aaca-6443ee23817a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:07:56.115842 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05faeef5-1bef-4222-9406-f300fbbddf2a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:07:56.116331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05faeef5-1bef-4222-9406-f300fbbddf2a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:07:56.116772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05faeef5-1bef-4222-9406-f300fbbddf2a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:07:56.117577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05faeef5-1bef-4222-9406-f300fbbddf2a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:07:56.118047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05faeef5-1bef-4222-9406-f300fbbddf2a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:07:56.118603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05faeef5-1bef-4222-9406-f300fbbddf2a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:07:56.264015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-05faeef5-1bef-4222-9406-f300fbbddf2a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38afe855fe744d25adeef84162a12fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44e83cfdfc485d97fc891a5b1c4744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:07:56.272081 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-05faeef5-1bef-4222-9406-f300fbbddf2a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] 10.222.0.50 "GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a" status: 200 len: 1313 microversion: 2.1 time: 0.168345 Oct 24 11:07:56.272539 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3300/6574] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:07:56 2022] GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:07:57.295989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9610840b-d74a-42c4-845e-7982da14a384 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:07:57.296704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9610840b-d74a-42c4-845e-7982da14a384 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] [instance: 349c05f2-b42c-4613-aaca-6443ee23817a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:07:57.303717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9610840b-d74a-42c4-845e-7982da14a384 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:07:57.304206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9610840b-d74a-42c4-845e-7982da14a384 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:07:57.304647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9610840b-d74a-42c4-845e-7982da14a384 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:07:57.305376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9610840b-d74a-42c4-845e-7982da14a384 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:07:57.305836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9610840b-d74a-42c4-845e-7982da14a384 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:07:57.306267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9610840b-d74a-42c4-845e-7982da14a384 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:07:57.452235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9610840b-d74a-42c4-845e-7982da14a384 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38afe855fe744d25adeef84162a12fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44e83cfdfc485d97fc891a5b1c4744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:07:57.460006 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9610840b-d74a-42c4-845e-7982da14a384 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] 10.222.0.50 "GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a" status: 200 len: 1313 microversion: 2.1 time: 0.169331 Oct 24 11:07:57.460587 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3275/6575] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:07:57 2022] GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:07:58.484133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1fa151cb-cb9a-488e-9348-f4fc402f08e6 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:07:58.484748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1fa151cb-cb9a-488e-9348-f4fc402f08e6 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] [instance: 349c05f2-b42c-4613-aaca-6443ee23817a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:07:58.491640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1fa151cb-cb9a-488e-9348-f4fc402f08e6 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:07:58.492128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1fa151cb-cb9a-488e-9348-f4fc402f08e6 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:07:58.492570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1fa151cb-cb9a-488e-9348-f4fc402f08e6 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:07:58.493291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1fa151cb-cb9a-488e-9348-f4fc402f08e6 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:07:58.493751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1fa151cb-cb9a-488e-9348-f4fc402f08e6 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:07:58.494177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1fa151cb-cb9a-488e-9348-f4fc402f08e6 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:07:58.631013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1fa151cb-cb9a-488e-9348-f4fc402f08e6 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38afe855fe744d25adeef84162a12fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44e83cfdfc485d97fc891a5b1c4744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:07:58.639978 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1fa151cb-cb9a-488e-9348-f4fc402f08e6 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] 10.222.0.50 "GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a" status: 200 len: 1313 microversion: 2.1 time: 0.159950 Oct 24 11:07:58.640562 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3301/6576] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:07:58 2022] GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:07:59.664324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b7193eca-fced-4832-9778-4d0c06aa99c0 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:07:59.665073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b7193eca-fced-4832-9778-4d0c06aa99c0 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] [instance: 349c05f2-b42c-4613-aaca-6443ee23817a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:07:59.673426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b7193eca-fced-4832-9778-4d0c06aa99c0 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:07:59.673971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b7193eca-fced-4832-9778-4d0c06aa99c0 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:07:59.674417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b7193eca-fced-4832-9778-4d0c06aa99c0 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:07:59.675272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b7193eca-fced-4832-9778-4d0c06aa99c0 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:07:59.676209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b7193eca-fced-4832-9778-4d0c06aa99c0 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:07:59.676788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b7193eca-fced-4832-9778-4d0c06aa99c0 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:07:59.825847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b7193eca-fced-4832-9778-4d0c06aa99c0 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38afe855fe744d25adeef84162a12fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44e83cfdfc485d97fc891a5b1c4744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:07:59.833745 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b7193eca-fced-4832-9778-4d0c06aa99c0 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] 10.222.0.50 "GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a" status: 200 len: 1313 microversion: 2.1 time: 0.173693 Oct 24 11:07:59.834273 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3276/6577] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:07:59 2022] GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:08:00.857850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d979ac61-6330-4dfe-8f3d-98b6864646d7 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:08:00.858475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d979ac61-6330-4dfe-8f3d-98b6864646d7 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] [instance: 349c05f2-b42c-4613-aaca-6443ee23817a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:08:00.865428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d979ac61-6330-4dfe-8f3d-98b6864646d7 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:00.865923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d979ac61-6330-4dfe-8f3d-98b6864646d7 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:00.866366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d979ac61-6330-4dfe-8f3d-98b6864646d7 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:00.867078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d979ac61-6330-4dfe-8f3d-98b6864646d7 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:00.867539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d979ac61-6330-4dfe-8f3d-98b6864646d7 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:00.867962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d979ac61-6330-4dfe-8f3d-98b6864646d7 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:01.006356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d979ac61-6330-4dfe-8f3d-98b6864646d7 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38afe855fe744d25adeef84162a12fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44e83cfdfc485d97fc891a5b1c4744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:08:01.015263 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d979ac61-6330-4dfe-8f3d-98b6864646d7 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] 10.222.0.50 "GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a" status: 200 len: 1313 microversion: 2.1 time: 0.162256 Oct 24 11:08:01.015866 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3302/6578] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:08:00 2022] GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:08:01.517397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-41e88079-d394-4aa6-ace1-da9362cccf0f req-75e29d37-acea-47e6-a803-1fb8f307c558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349c05f2-b42c-4613-aaca-6443ee23817a", "name": "network-vif-plugged", "status": "completed", "tag": "d40d4d3b-4aca-4665-8bad-bdfd14ff163f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:08:01.528622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-41e88079-d394-4aa6-ace1-da9362cccf0f req-75e29d37-acea-47e6-a803-1fb8f307c558 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:01.535611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-41e88079-d394-4aa6-ace1-da9362cccf0f req-75e29d37-acea-47e6-a803-1fb8f307c558 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:01.535611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-41e88079-d394-4aa6-ace1-da9362cccf0f req-75e29d37-acea-47e6-a803-1fb8f307c558 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:01.548972 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-41e88079-d394-4aa6-ace1-da9362cccf0f req-75e29d37-acea-47e6-a803-1fb8f307c558 service nova] Creating event network-vif-plugged:d40d4d3b-4aca-4665-8bad-bdfd14ff163f for instance 349c05f2-b42c-4613-aaca-6443ee23817a on n-h1-858383-15 Oct 24 11:08:01.554138 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-41e88079-d394-4aa6-ace1-da9362cccf0f req-75e29d37-acea-47e6-a803-1fb8f307c558 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041298 Oct 24 11:08:01.554985 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3277/6579] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:08:02.040275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e26158c-133e-40a4-aab3-8d92aef6df1d tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:08:02.040866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1e26158c-133e-40a4-aab3-8d92aef6df1d tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] [instance: 349c05f2-b42c-4613-aaca-6443ee23817a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:08:02.048208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e26158c-133e-40a4-aab3-8d92aef6df1d tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:02.048692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e26158c-133e-40a4-aab3-8d92aef6df1d tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:02.049166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e26158c-133e-40a4-aab3-8d92aef6df1d tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:02.049862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e26158c-133e-40a4-aab3-8d92aef6df1d tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:02.050320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e26158c-133e-40a4-aab3-8d92aef6df1d tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:02.050749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e26158c-133e-40a4-aab3-8d92aef6df1d tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:02.184617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1e26158c-133e-40a4-aab3-8d92aef6df1d tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38afe855fe744d25adeef84162a12fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44e83cfdfc485d97fc891a5b1c4744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:08:02.192507 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1e26158c-133e-40a4-aab3-8d92aef6df1d tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] 10.222.0.50 "GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a" status: 200 len: 1313 microversion: 2.1 time: 0.156804 Oct 24 11:08:02.193119 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3303/6580] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:08:02 2022] GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:08:03.213908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:08:03.214853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:08:03.219647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-702228cf-8623-4319-953a-64f0834c2c4f tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:08:03.220359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-702228cf-8623-4319-953a-64f0834c2c4f tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] [instance: 349c05f2-b42c-4613-aaca-6443ee23817a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:08:03.227522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-702228cf-8623-4319-953a-64f0834c2c4f tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:03.228012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-702228cf-8623-4319-953a-64f0834c2c4f tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:03.228453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-702228cf-8623-4319-953a-64f0834c2c4f tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:03.229183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-702228cf-8623-4319-953a-64f0834c2c4f tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:03.229690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-702228cf-8623-4319-953a-64f0834c2c4f tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:03.230138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-702228cf-8623-4319-953a-64f0834c2c4f tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:03.367657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-702228cf-8623-4319-953a-64f0834c2c4f tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38afe855fe744d25adeef84162a12fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44e83cfdfc485d97fc891a5b1c4744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:08:03.376228 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-702228cf-8623-4319-953a-64f0834c2c4f tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] 10.222.0.50 "GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a" status: 200 len: 1497 microversion: 2.1 time: 0.164127 Oct 24 11:08:03.376985 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3278/6581] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:08:03 2022] GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:08:05.784256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9f85510c-20cc-44c1-a7f4-f2ec4897161c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:08:05.784910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9f85510c-20cc-44c1-a7f4-f2ec4897161c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] [instance: 349c05f2-b42c-4613-aaca-6443ee23817a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:08:05.787015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:08:05.794046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f85510c-20cc-44c1-a7f4-f2ec4897161c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:05.794537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f85510c-20cc-44c1-a7f4-f2ec4897161c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:05.795331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f85510c-20cc-44c1-a7f4-f2ec4897161c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:05.796116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f85510c-20cc-44c1-a7f4-f2ec4897161c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:05.796755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f85510c-20cc-44c1-a7f4-f2ec4897161c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:05.797367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f85510c-20cc-44c1-a7f4-f2ec4897161c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:05.830962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9f85510c-20cc-44c1-a7f4-f2ec4897161c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] [instance: 349c05f2-b42c-4613-aaca-6443ee23817a] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:08:05.929262 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9f85510c-20cc-44c1-a7f4-f2ec4897161c tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] 10.222.0.50 "DELETE /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a" status: 204 len: 0 microversion: 2.1 time: 0.148822 Oct 24 11:08:05.929935 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3304/6582] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:08:05 2022] DELETE /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:08:05.938325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7908d022-70e3-4340-b65c-8701e956986a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:08:05.939071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7908d022-70e3-4340-b65c-8701e956986a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] [instance: 349c05f2-b42c-4613-aaca-6443ee23817a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:08:05.946259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7908d022-70e3-4340-b65c-8701e956986a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:05.946839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7908d022-70e3-4340-b65c-8701e956986a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:05.947359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7908d022-70e3-4340-b65c-8701e956986a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:05.948137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7908d022-70e3-4340-b65c-8701e956986a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:05.948675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7908d022-70e3-4340-b65c-8701e956986a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:05.949218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7908d022-70e3-4340-b65c-8701e956986a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:06.086977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7908d022-70e3-4340-b65c-8701e956986a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38afe855fe744d25adeef84162a12fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44e83cfdfc485d97fc891a5b1c4744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:08:06.095980 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7908d022-70e3-4340-b65c-8701e956986a tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] 10.222.0.50 "GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a" status: 200 len: 1503 microversion: 2.1 time: 0.161636 Oct 24 11:08:06.096586 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3279/6583] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:08:05 2022] GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:08:07.123382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3c5b44c7-493c-4469-891d-71ebf4637ed9 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:08:07.124655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3c5b44c7-493c-4469-891d-71ebf4637ed9 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] [instance: 349c05f2-b42c-4613-aaca-6443ee23817a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:08:07.132389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3c5b44c7-493c-4469-891d-71ebf4637ed9 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:07.132911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3c5b44c7-493c-4469-891d-71ebf4637ed9 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:07.133555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3c5b44c7-493c-4469-891d-71ebf4637ed9 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:07.134069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3c5b44c7-493c-4469-891d-71ebf4637ed9 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:07.134528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3c5b44c7-493c-4469-891d-71ebf4637ed9 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:07.134958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3c5b44c7-493c-4469-891d-71ebf4637ed9 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:07.284267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3c5b44c7-493c-4469-891d-71ebf4637ed9 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38afe855fe744d25adeef84162a12fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44e83cfdfc485d97fc891a5b1c4744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:08:07.291962 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3c5b44c7-493c-4469-891d-71ebf4637ed9 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] 10.222.0.50 "GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a" status: 200 len: 1503 microversion: 2.1 time: 0.173787 Oct 24 11:08:07.292813 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3305/6584] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:08:07 2022] GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:08:07.942213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-31e06597-5fbb-498d-b09d-446f7275c89e req-fe1d2195-1c3c-4331-9d5f-232bd3a6725f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349c05f2-b42c-4613-aaca-6443ee23817a", "name": "network-vif-deleted", "tag": "d40d4d3b-4aca-4665-8bad-bdfd14ff163f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:08:07.953901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-31e06597-5fbb-498d-b09d-446f7275c89e req-fe1d2195-1c3c-4331-9d5f-232bd3a6725f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:07.954390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-31e06597-5fbb-498d-b09d-446f7275c89e req-fe1d2195-1c3c-4331-9d5f-232bd3a6725f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:07.954824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-31e06597-5fbb-498d-b09d-446f7275c89e req-fe1d2195-1c3c-4331-9d5f-232bd3a6725f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:07.967784 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-31e06597-5fbb-498d-b09d-446f7275c89e req-fe1d2195-1c3c-4331-9d5f-232bd3a6725f service nova] Creating event network-vif-deleted:d40d4d3b-4aca-4665-8bad-bdfd14ff163f for instance 349c05f2-b42c-4613-aaca-6443ee23817a on n-h1-858383-15 Oct 24 11:08:07.972867 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-31e06597-5fbb-498d-b09d-446f7275c89e req-fe1d2195-1c3c-4331-9d5f-232bd3a6725f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034699 Oct 24 11:08:07.973478 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3280/6585] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:08:08.316024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f7eeb95b-b5de-48a4-a33b-446a36dd23e2 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:08:08.316678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f7eeb95b-b5de-48a4-a33b-446a36dd23e2 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] [instance: 349c05f2-b42c-4613-aaca-6443ee23817a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:08:08.323604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7eeb95b-b5de-48a4-a33b-446a36dd23e2 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:08.324188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7eeb95b-b5de-48a4-a33b-446a36dd23e2 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:08.324712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7eeb95b-b5de-48a4-a33b-446a36dd23e2 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:08.325454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7eeb95b-b5de-48a4-a33b-446a36dd23e2 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:08.325918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7eeb95b-b5de-48a4-a33b-446a36dd23e2 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:08.326351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7eeb95b-b5de-48a4-a33b-446a36dd23e2 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:08.358514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7eeb95b-b5de-48a4-a33b-446a36dd23e2 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:08.358999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7eeb95b-b5de-48a4-a33b-446a36dd23e2 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:08.359442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7eeb95b-b5de-48a4-a33b-446a36dd23e2 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:08.359892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-f7eeb95b-b5de-48a4-a33b-446a36dd23e2 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lazy-loading 'fault' on Instance uuid 349c05f2-b42c-4613-aaca-6443ee23817a {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:08:08.404330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f7eeb95b-b5de-48a4-a33b-446a36dd23e2 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38afe855fe744d25adeef84162a12fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44e83cfdfc485d97fc891a5b1c4744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:08:08.413295 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f7eeb95b-b5de-48a4-a33b-446a36dd23e2 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] 10.222.0.50 "GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a" status: 200 len: 1303 microversion: 2.1 time: 0.100857 Oct 24 11:08:08.413983 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3306/6586] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:08:08 2022] GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:08:09.440815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f3b6d7b7-9614-4819-9562-3f855ee26c82 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:08:09.441540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f3b6d7b7-9614-4819-9562-3f855ee26c82 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] [instance: 349c05f2-b42c-4613-aaca-6443ee23817a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:08:09.447902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3b6d7b7-9614-4819-9562-3f855ee26c82 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:09.448384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3b6d7b7-9614-4819-9562-3f855ee26c82 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:09.448822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3b6d7b7-9614-4819-9562-3f855ee26c82 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:09.450157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3b6d7b7-9614-4819-9562-3f855ee26c82 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:08:09.450613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3b6d7b7-9614-4819-9562-3f855ee26c82 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:08:09.451146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3b6d7b7-9614-4819-9562-3f855ee26c82 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:08:09.464378 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-f3b6d7b7-9614-4819-9562-3f855ee26c82 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] HTTP exception thrown: Instance 349c05f2-b42c-4613-aaca-6443ee23817a could not be found. Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f3b6d7b7-9614-4819-9562-3f855ee26c82 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Request method failure captured: Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a HTTP/1.1 Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnIGqNSSgI0eiCJUr7X5nbO-va4KI5MUjPWiqDJZ2aL1hVYkVzMieapmKk9gHN79OHKn7d84PrwpnAYvdTd1dZtCywj0wZNe0gxZdqCocLdcAqI3muY_bPx8yY1PHUXDRbS2QL0rlbiOcUm57UH8QiuzylEdzZu3yNpU8xdSN4tJpPE Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: be44e83cfdfc485d97fc891a5b1c4744 Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesActionsTest-188453226 Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/be44e83cfdfc485d97fc891a5b1c4744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/be44e83cfdfc485d97fc891a5b1c4744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/be44e83cfdfc485d97fc891a5b1c4744"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_be44e83cfdfc485d97fc891a5b1c4744", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-VolumesActionsTest-188453226 Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: be44e83cfdfc485d97fc891a5b1c4744 Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesActionsTest-188453226 Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-VolumesActionsTest-188453226-project Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 38afe855fe744d25adeef84162a12fa7 Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-VolumesActionsTest-188453226-project Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 349c05f2-b42c-4613-aaca-6443ee23817a could not be found. Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '349c05f2-b42c-4613-aaca-6443ee23817a'} Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 349c05f2-b42c-4613-aaca-6443ee23817a could not be found. Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 349c05f2-b42c-4613-aaca-6443ee23817a could not be found. Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:08:09.466275 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:08:09.471437 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:08:09.471437 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:08:09.471437 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:08:09.471437 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:08:09.471437 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:08:09.471437 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 349c05f2-b42c-4613-aaca-6443ee23817a could not be found. Oct 24 11:08:09.471437 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:08:09.471437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f3b6d7b7-9614-4819-9562-3f855ee26c82 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] Returning 404 to user: Instance 349c05f2-b42c-4613-aaca-6443ee23817a could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:08:09.471437 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f3b6d7b7-9614-4819-9562-3f855ee26c82 tempest-VolumesActionsTest-188453226 tempest-VolumesActionsTest-188453226-project] 10.222.0.50 "GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a" status: 404 len: 111 microversion: 2.1 time: 0.031935 Oct 24 11:08:09.471437 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3281/6587] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:08:09 2022] GET /compute/v2.1/servers/349c05f2-b42c-4613-aaca-6443ee23817a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:10:12.500175 n-d-858383-15 devstack@n-api.service[120426]: ERROR oslo.messaging._drivers.impl_rabbit [-] [05048d7c-6448-4d6e-b9e7-4fa04d95d8b6] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 11:10:12.500972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:10:12.501709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:10:12.502494 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:10:12.502635 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:10:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.50) !!! Oct 24 11:10:12.507972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3cfc24f4-378f-40d4-ba53-10d85e2313eb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-63097159", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "99dcbd5b-e2f9-4f53-be8c-e7f06f4152e2"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:10:12.741426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-3cfc24f4-378f-40d4-ba53-10d85e2313eb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] validate_networks() for [('99dcbd5b-e2f9-4f53-be8c-e7f06f4152e2', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:10:13.202782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-3cfc24f4-378f-40d4-ba53-10d85e2313eb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:10:13.203207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-3cfc24f4-378f-40d4-ba53-10d85e2313eb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:10:13.203684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-3cfc24f4-378f-40d4-ba53-10d85e2313eb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:10:13.204121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-3cfc24f4-378f-40d4-ba53-10d85e2313eb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:10:13.204615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-3cfc24f4-378f-40d4-ba53-10d85e2313eb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:10:13.213505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cfc24f4-378f-40d4-ba53-10d85e2313eb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:13.213987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cfc24f4-378f-40d4-ba53-10d85e2313eb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:13.214459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cfc24f4-378f-40d4-ba53-10d85e2313eb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:13.215186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cfc24f4-378f-40d4-ba53-10d85e2313eb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:13.215646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cfc24f4-378f-40d4-ba53-10d85e2313eb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:13.216073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cfc24f4-378f-40d4-ba53-10d85e2313eb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:13.233306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-3cfc24f4-378f-40d4-ba53-10d85e2313eb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Getting quotas for project c5a9ea0ac6fb439b9c887405a962e51b. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:10:13.239329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-3cfc24f4-378f-40d4-ba53-10d85e2313eb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Getting quotas for user 252727661cc043af94f5d21078506b2a and project c5a9ea0ac6fb439b9c887405a962e51b. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:10:13.251587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3cfc24f4-378f-40d4-ba53-10d85e2313eb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:10:13.253903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3cfc24f4-378f-40d4-ba53-10d85e2313eb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:10:13.301155 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3cfc24f4-378f-40d4-ba53-10d85e2313eb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803236 Oct 24 11:10:13.301805 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3307/6588] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:10:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:10:13.311372 n-d-858383-15 devstack@n-api.service[120425]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1abc338e-6c14-4311-a7b3-814582834b4a] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 11:10:13.312558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:10:13.313973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=40 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:10:13.315404 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 24 11:10:13.315552 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:10:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd (ip 10.222.0.50) !!! Oct 24 11:10:13.320116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b3e1c765-da74-4fee-80c3-1fa3730aaeeb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:10:13.320927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b3e1c765-da74-4fee-80c3-1fa3730aaeeb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:10:13.452815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b3e1c765-da74-4fee-80c3-1fa3730aaeeb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:10:13.460773 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b3e1c765-da74-4fee-80c3-1fa3730aaeeb tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd" status: 200 len: 1217 microversion: 2.1 time: 0.151728 Oct 24 11:10:13.461490 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3282/6589] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:10:13 2022] GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:10:14.487623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c27e6b49-db51-46e6-b07d-f7c302a4944f tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:10:14.488343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c27e6b49-db51-46e6-b07d-f7c302a4944f tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:10:14.496882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c27e6b49-db51-46e6-b07d-f7c302a4944f tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:14.497540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c27e6b49-db51-46e6-b07d-f7c302a4944f tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:14.497979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c27e6b49-db51-46e6-b07d-f7c302a4944f tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:14.498689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c27e6b49-db51-46e6-b07d-f7c302a4944f tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:14.499140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c27e6b49-db51-46e6-b07d-f7c302a4944f tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:14.499567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c27e6b49-db51-46e6-b07d-f7c302a4944f tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:14.506611 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] [05048d7c-6448-4d6e-b9e7-4fa04d95d8b6] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 44762. Oct 24 11:10:14.566044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c27e6b49-db51-46e6-b07d-f7c302a4944f tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:10:14.573897 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c27e6b49-db51-46e6-b07d-f7c302a4944f tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd" status: 200 len: 1275 microversion: 2.1 time: 0.094085 Oct 24 11:10:14.574486 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3308/6590] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:10:14 2022] GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd => generated 1275 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:10:15.598227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-07d3024b-6812-47cf-bcf5-f80a1d699327 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:10:15.598845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-07d3024b-6812-47cf-bcf5-f80a1d699327 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:10:15.609761 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] [1abc338e-6c14-4311-a7b3-814582834b4a] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 44766. Oct 24 11:10:15.615879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07d3024b-6812-47cf-bcf5-f80a1d699327 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:15.616364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07d3024b-6812-47cf-bcf5-f80a1d699327 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:15.616799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07d3024b-6812-47cf-bcf5-f80a1d699327 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:15.617541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07d3024b-6812-47cf-bcf5-f80a1d699327 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:15.617995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07d3024b-6812-47cf-bcf5-f80a1d699327 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:15.618418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-07d3024b-6812-47cf-bcf5-f80a1d699327 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:15.740336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-5abc084c-38dd-4369-8cfd-32536affd339 req-d0604443-9667-48dc-8e9b-885dc172f37f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd", "tag": "ef3a99bb-54a0-4364-8ad0-4b244756bdeb"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:10:15.753331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5abc084c-38dd-4369-8cfd-32536affd339 req-d0604443-9667-48dc-8e9b-885dc172f37f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:15.753879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-07d3024b-6812-47cf-bcf5-f80a1d699327 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:10:15.754207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5abc084c-38dd-4369-8cfd-32536affd339 req-d0604443-9667-48dc-8e9b-885dc172f37f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:15.754804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5abc084c-38dd-4369-8cfd-32536affd339 req-d0604443-9667-48dc-8e9b-885dc172f37f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:15.761589 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-07d3024b-6812-47cf-bcf5-f80a1d699327 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd" status: 200 len: 1317 microversion: 2.1 time: 0.167908 Oct 24 11:10:15.762699 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3283/6591] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:10:15 2022] GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:10:15.767987 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-5abc084c-38dd-4369-8cfd-32536affd339 req-d0604443-9667-48dc-8e9b-885dc172f37f service nova] Creating event network-changed:ef3a99bb-54a0-4364-8ad0-4b244756bdeb for instance f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd on n-h1-858383-15 Oct 24 11:10:15.773103 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-5abc084c-38dd-4369-8cfd-32536affd339 req-d0604443-9667-48dc-8e9b-885dc172f37f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038437 Oct 24 11:10:15.773703 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3309/6592] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:10:16.785920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f4aa6005-bbe0-4a5a-88ca-86a8f85be9d5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:10:16.786526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f4aa6005-bbe0-4a5a-88ca-86a8f85be9d5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:10:16.793659 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4aa6005-bbe0-4a5a-88ca-86a8f85be9d5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:16.794156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4aa6005-bbe0-4a5a-88ca-86a8f85be9d5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:16.794590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4aa6005-bbe0-4a5a-88ca-86a8f85be9d5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:16.795435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4aa6005-bbe0-4a5a-88ca-86a8f85be9d5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:16.795890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4aa6005-bbe0-4a5a-88ca-86a8f85be9d5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:16.796313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4aa6005-bbe0-4a5a-88ca-86a8f85be9d5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:16.932452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f4aa6005-bbe0-4a5a-88ca-86a8f85be9d5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:10:16.941052 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f4aa6005-bbe0-4a5a-88ca-86a8f85be9d5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd" status: 200 len: 1317 microversion: 2.1 time: 0.159965 Oct 24 11:10:16.941762 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3284/6593] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:10:16 2022] GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:10:17.964998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a8e16526-7ddf-4ee9-bf25-9164489f3ee4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:10:17.965712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a8e16526-7ddf-4ee9-bf25-9164489f3ee4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:10:17.972410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8e16526-7ddf-4ee9-bf25-9164489f3ee4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:17.972913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8e16526-7ddf-4ee9-bf25-9164489f3ee4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:17.973356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8e16526-7ddf-4ee9-bf25-9164489f3ee4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:17.974046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8e16526-7ddf-4ee9-bf25-9164489f3ee4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:17.974502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8e16526-7ddf-4ee9-bf25-9164489f3ee4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:17.974931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8e16526-7ddf-4ee9-bf25-9164489f3ee4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:18.110871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a8e16526-7ddf-4ee9-bf25-9164489f3ee4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:10:18.119515 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a8e16526-7ddf-4ee9-bf25-9164489f3ee4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd" status: 200 len: 1317 microversion: 2.1 time: 0.159610 Oct 24 11:10:18.120322 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3310/6594] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:10:17 2022] GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:10:19.143774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e69a63d0-6c60-4a04-a7d1-f87c4d42b4c0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:10:19.144393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e69a63d0-6c60-4a04-a7d1-f87c4d42b4c0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:10:19.151239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e69a63d0-6c60-4a04-a7d1-f87c4d42b4c0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:19.151724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e69a63d0-6c60-4a04-a7d1-f87c4d42b4c0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:19.152164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e69a63d0-6c60-4a04-a7d1-f87c4d42b4c0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:19.152885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e69a63d0-6c60-4a04-a7d1-f87c4d42b4c0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:19.153344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e69a63d0-6c60-4a04-a7d1-f87c4d42b4c0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:19.153776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e69a63d0-6c60-4a04-a7d1-f87c4d42b4c0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:19.287721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e69a63d0-6c60-4a04-a7d1-f87c4d42b4c0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:10:19.295356 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e69a63d0-6c60-4a04-a7d1-f87c4d42b4c0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd" status: 200 len: 1317 microversion: 2.1 time: 0.156142 Oct 24 11:10:19.295926 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3285/6595] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:10:19 2022] GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:10:20.322618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7ae9e12c-aec4-4297-a520-9e9e26e5fed1 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:10:20.323241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7ae9e12c-aec4-4297-a520-9e9e26e5fed1 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:10:20.331004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ae9e12c-aec4-4297-a520-9e9e26e5fed1 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:20.331490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ae9e12c-aec4-4297-a520-9e9e26e5fed1 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:20.331923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ae9e12c-aec4-4297-a520-9e9e26e5fed1 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:20.332628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ae9e12c-aec4-4297-a520-9e9e26e5fed1 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:20.333103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ae9e12c-aec4-4297-a520-9e9e26e5fed1 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:20.333530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ae9e12c-aec4-4297-a520-9e9e26e5fed1 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:20.473477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7ae9e12c-aec4-4297-a520-9e9e26e5fed1 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:10:20.482253 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7ae9e12c-aec4-4297-a520-9e9e26e5fed1 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd" status: 200 len: 1317 microversion: 2.1 time: 0.163472 Oct 24 11:10:20.482842 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3311/6596] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:10:20 2022] GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:10:21.507189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf92936e-f5de-4ad3-a098-1a668dbdc4bf tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:10:21.507813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf92936e-f5de-4ad3-a098-1a668dbdc4bf tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:10:21.514658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf92936e-f5de-4ad3-a098-1a668dbdc4bf tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:21.515142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf92936e-f5de-4ad3-a098-1a668dbdc4bf tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:21.515581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf92936e-f5de-4ad3-a098-1a668dbdc4bf tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:21.517338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf92936e-f5de-4ad3-a098-1a668dbdc4bf tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:21.517912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf92936e-f5de-4ad3-a098-1a668dbdc4bf tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:21.518352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf92936e-f5de-4ad3-a098-1a668dbdc4bf tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:21.649626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cf92936e-f5de-4ad3-a098-1a668dbdc4bf tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:10:21.657519 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf92936e-f5de-4ad3-a098-1a668dbdc4bf tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd" status: 200 len: 1317 microversion: 2.1 time: 0.154258 Oct 24 11:10:21.658095 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3286/6597] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:10:21 2022] GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:10:22.168852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a80e39c0-46c9-4546-84d4-4a2b790f9ba4 req-420f4e3e-fe88-49cd-b25d-a9202eb99bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd", "name": "network-vif-plugged", "status": "completed", "tag": "ef3a99bb-54a0-4364-8ad0-4b244756bdeb"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:10:22.180341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a80e39c0-46c9-4546-84d4-4a2b790f9ba4 req-420f4e3e-fe88-49cd-b25d-a9202eb99bb8 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:22.180855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a80e39c0-46c9-4546-84d4-4a2b790f9ba4 req-420f4e3e-fe88-49cd-b25d-a9202eb99bb8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:22.181363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a80e39c0-46c9-4546-84d4-4a2b790f9ba4 req-420f4e3e-fe88-49cd-b25d-a9202eb99bb8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:22.193465 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a80e39c0-46c9-4546-84d4-4a2b790f9ba4 req-420f4e3e-fe88-49cd-b25d-a9202eb99bb8 service nova] Creating event network-vif-plugged:ef3a99bb-54a0-4364-8ad0-4b244756bdeb for instance f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd on n-h1-858383-15 Oct 24 11:10:22.198422 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a80e39c0-46c9-4546-84d4-4a2b790f9ba4 req-420f4e3e-fe88-49cd-b25d-a9202eb99bb8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033537 Oct 24 11:10:22.199039 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3312/6598] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:10:22.680977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1f7c5439-e1d4-4e20-bdcf-42ed9e5c4202 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:10:22.681602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1f7c5439-e1d4-4e20-bdcf-42ed9e5c4202 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:10:22.688681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f7c5439-e1d4-4e20-bdcf-42ed9e5c4202 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:22.689229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f7c5439-e1d4-4e20-bdcf-42ed9e5c4202 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:22.689674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f7c5439-e1d4-4e20-bdcf-42ed9e5c4202 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:22.690374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f7c5439-e1d4-4e20-bdcf-42ed9e5c4202 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:22.690838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f7c5439-e1d4-4e20-bdcf-42ed9e5c4202 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:22.691276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f7c5439-e1d4-4e20-bdcf-42ed9e5c4202 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:22.823680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1f7c5439-e1d4-4e20-bdcf-42ed9e5c4202 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:10:22.832482 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1f7c5439-e1d4-4e20-bdcf-42ed9e5c4202 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd" status: 200 len: 1317 microversion: 2.1 time: 0.155464 Oct 24 11:10:22.833103 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3287/6599] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:10:22 2022] GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:10:23.855114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:10:23.855914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:10:23.860226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0712d908-1955-4440-9e24-a85a422bbf5c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:10:23.860968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0712d908-1955-4440-9e24-a85a422bbf5c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:10:23.868029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0712d908-1955-4440-9e24-a85a422bbf5c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:23.868505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0712d908-1955-4440-9e24-a85a422bbf5c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:23.868980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0712d908-1955-4440-9e24-a85a422bbf5c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:23.869673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0712d908-1955-4440-9e24-a85a422bbf5c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:23.870126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0712d908-1955-4440-9e24-a85a422bbf5c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:23.870550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0712d908-1955-4440-9e24-a85a422bbf5c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:24.002827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0712d908-1955-4440-9e24-a85a422bbf5c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:10:24.010586 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0712d908-1955-4440-9e24-a85a422bbf5c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd" status: 200 len: 1507 microversion: 2.1 time: 0.158309 Oct 24 11:10:24.011172 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3313/6600] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:10:23 2022] GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:10:39.242154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6528ab27-0a8f-4d88-b180-e2759bca871e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf00fa00-5278-4ec7-a38a-3202b4d3a7a3", "device": "/dev/sdb"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:10:39.244551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6528ab27-0a8f-4d88-b180-e2759bca871e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:10:39.246461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:10:39.247999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=14 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:10:39.249016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=30 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:10:39.255376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6528ab27-0a8f-4d88-b180-e2759bca871e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:39.255859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6528ab27-0a8f-4d88-b180-e2759bca871e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:39.256293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6528ab27-0a8f-4d88-b180-e2759bca871e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:39.257025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6528ab27-0a8f-4d88-b180-e2759bca871e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:10:39.257482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6528ab27-0a8f-4d88-b180-e2759bca871e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:10:39.257907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6528ab27-0a8f-4d88-b180-e2759bca871e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:10:39.516645 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6528ab27-0a8f-4d88-b180-e2759bca871e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "POST /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278049 Oct 24 11:10:39.517387 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3288/6601] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 11:10:39 2022] POST /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:11:03.346990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c522737d-9d72-4fa6-8db4-685e2f1593e0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:03.347487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c522737d-9d72-4fa6-8db4-685e2f1593e0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:03.349418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:11:03.350258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=30 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:11:03.356746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c522737d-9d72-4fa6-8db4-685e2f1593e0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:03.357292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c522737d-9d72-4fa6-8db4-685e2f1593e0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:03.357856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c522737d-9d72-4fa6-8db4-685e2f1593e0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:03.359108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c522737d-9d72-4fa6-8db4-685e2f1593e0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:03.359736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c522737d-9d72-4fa6-8db4-685e2f1593e0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:03.360287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c522737d-9d72-4fa6-8db4-685e2f1593e0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:03.442675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-c522737d-9d72-4fa6-8db4-685e2f1593e0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lazy-loading 'services' on Instance uuid f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:11:03.513933 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c522737d-9d72-4fa6-8db4-685e2f1593e0 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd/os-volume_attachments/cf00fa00-5278-4ec7-a38a-3202b4d3a7a3" status: 202 len: 0 microversion: 2.1 time: 0.171523 Oct 24 11:11:03.514588 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3314/6602] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 11:11:03 2022] DELETE /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd/os-volume_attachments/cf00fa00-5278-4ec7-a38a-3202b4d3a7a3 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:11:08.886862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:11:08.887674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:11:08.892057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fa7e6686-fcef-4f18-99d6-9321ee3fa50b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:08.892647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fa7e6686-fcef-4f18-99d6-9321ee3fa50b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:08.900037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa7e6686-fcef-4f18-99d6-9321ee3fa50b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:08.900525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa7e6686-fcef-4f18-99d6-9321ee3fa50b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:08.901000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa7e6686-fcef-4f18-99d6-9321ee3fa50b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:08.901692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa7e6686-fcef-4f18-99d6-9321ee3fa50b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:08.902150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa7e6686-fcef-4f18-99d6-9321ee3fa50b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:08.902580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa7e6686-fcef-4f18-99d6-9321ee3fa50b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:08.929450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fa7e6686-fcef-4f18-99d6-9321ee3fa50b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:11:09.007002 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fa7e6686-fcef-4f18-99d6-9321ee3fa50b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd" status: 204 len: 0 microversion: 2.1 time: 0.121758 Oct 24 11:11:09.007641 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3289/6603] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:11:08 2022] DELETE /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:11:09.017732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-70f7fda3-b12c-4195-a783-01b1dfa09c69 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:09.018573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-70f7fda3-b12c-4195-a783-01b1dfa09c69 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:09.025813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70f7fda3-b12c-4195-a783-01b1dfa09c69 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:09.026302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70f7fda3-b12c-4195-a783-01b1dfa09c69 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:09.026743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70f7fda3-b12c-4195-a783-01b1dfa09c69 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:09.027447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70f7fda3-b12c-4195-a783-01b1dfa09c69 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:09.027902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70f7fda3-b12c-4195-a783-01b1dfa09c69 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:09.028361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70f7fda3-b12c-4195-a783-01b1dfa09c69 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:09.164524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-70f7fda3-b12c-4195-a783-01b1dfa09c69 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:11:09.173432 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-70f7fda3-b12c-4195-a783-01b1dfa09c69 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd" status: 200 len: 1513 microversion: 2.1 time: 0.161035 Oct 24 11:11:09.174016 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3315/6604] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:11:09 2022] GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:11:10.197352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4bbcec2b-49c8-4a36-a704-96cf73f95f21 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:10.198050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4bbcec2b-49c8-4a36-a704-96cf73f95f21 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:10.204791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bbcec2b-49c8-4a36-a704-96cf73f95f21 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:10.205299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bbcec2b-49c8-4a36-a704-96cf73f95f21 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:10.205739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bbcec2b-49c8-4a36-a704-96cf73f95f21 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:10.206424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bbcec2b-49c8-4a36-a704-96cf73f95f21 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:10.206874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bbcec2b-49c8-4a36-a704-96cf73f95f21 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:10.207299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bbcec2b-49c8-4a36-a704-96cf73f95f21 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:10.339776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4bbcec2b-49c8-4a36-a704-96cf73f95f21 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:11:10.348068 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4bbcec2b-49c8-4a36-a704-96cf73f95f21 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd" status: 200 len: 1513 microversion: 2.1 time: 0.155010 Oct 24 11:11:10.348635 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3290/6605] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:11:10 2022] GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:11:11.182660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-53df07fe-1b3d-48ae-b8c2-1d8fc125fc14 req-9a7efc31-f2c5-4d54-a512-2b3de6d03e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd", "name": "network-vif-deleted", "tag": "ef3a99bb-54a0-4364-8ad0-4b244756bdeb"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:11:11.193973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-53df07fe-1b3d-48ae-b8c2-1d8fc125fc14 req-9a7efc31-f2c5-4d54-a512-2b3de6d03e02 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:11.194464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-53df07fe-1b3d-48ae-b8c2-1d8fc125fc14 req-9a7efc31-f2c5-4d54-a512-2b3de6d03e02 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:11.194899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-53df07fe-1b3d-48ae-b8c2-1d8fc125fc14 req-9a7efc31-f2c5-4d54-a512-2b3de6d03e02 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:11.208068 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-53df07fe-1b3d-48ae-b8c2-1d8fc125fc14 req-9a7efc31-f2c5-4d54-a512-2b3de6d03e02 service nova] Creating event network-vif-deleted:ef3a99bb-54a0-4364-8ad0-4b244756bdeb for instance f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd on n-h1-858383-15 Oct 24 11:11:11.213097 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-53df07fe-1b3d-48ae-b8c2-1d8fc125fc14 req-9a7efc31-f2c5-4d54-a512-2b3de6d03e02 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034158 Oct 24 11:11:11.213710 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3316/6606] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:11:11.372065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7b208c36-9ba9-4280-8554-d242c2e0cb77 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:11.372686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7b208c36-9ba9-4280-8554-d242c2e0cb77 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:11.380496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b208c36-9ba9-4280-8554-d242c2e0cb77 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:11.381018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b208c36-9ba9-4280-8554-d242c2e0cb77 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:11.381455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b208c36-9ba9-4280-8554-d242c2e0cb77 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:11.382156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b208c36-9ba9-4280-8554-d242c2e0cb77 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:11.382615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b208c36-9ba9-4280-8554-d242c2e0cb77 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:11.383048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b208c36-9ba9-4280-8554-d242c2e0cb77 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:11.414288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b208c36-9ba9-4280-8554-d242c2e0cb77 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:11.414765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b208c36-9ba9-4280-8554-d242c2e0cb77 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:11.415202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b208c36-9ba9-4280-8554-d242c2e0cb77 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:11.415644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-7b208c36-9ba9-4280-8554-d242c2e0cb77 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lazy-loading 'fault' on Instance uuid f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:11:11.456526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7b208c36-9ba9-4280-8554-d242c2e0cb77 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:11:11.464219 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7b208c36-9ba9-4280-8554-d242c2e0cb77 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd" status: 200 len: 1307 microversion: 2.1 time: 0.096430 Oct 24 11:11:11.464815 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3291/6607] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:11:11 2022] GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:11:12.489569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fefb0ee5-8d33-47d4-9aa8-73069ed7bf32 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:12.490275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fefb0ee5-8d33-47d4-9aa8-73069ed7bf32 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:12.496431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fefb0ee5-8d33-47d4-9aa8-73069ed7bf32 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:12.496947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fefb0ee5-8d33-47d4-9aa8-73069ed7bf32 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:12.497389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fefb0ee5-8d33-47d4-9aa8-73069ed7bf32 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:12.498080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fefb0ee5-8d33-47d4-9aa8-73069ed7bf32 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:12.498534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fefb0ee5-8d33-47d4-9aa8-73069ed7bf32 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:12.498965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fefb0ee5-8d33-47d4-9aa8-73069ed7bf32 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:12.512574 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-fefb0ee5-8d33-47d4-9aa8-73069ed7bf32 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] HTTP exception thrown: Instance f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd could not be found. Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fefb0ee5-8d33-47d4-9aa8-73069ed7bf32 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Request method failure captured: Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd HTTP/1.1 Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnJeL6fOp00mlnegTwt_LQ1bYYH80y_tMMs8glRrtbdqD2hjsz-x4Ix0_YyZoll1qfyMMFlGGr0Xdyjl4MSCVvzvIFtKFgAfRXVgW9KQq8DC7PtcUpzgsV0BOtCtgb0aTjd8FPhL-_cVQJVoHrPonI5dHFkEiCeXVX3JqiAC2o7jrsw Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: c5a9ea0ac6fb439b9c887405a962e51b Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1057524285 Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c5a9ea0ac6fb439b9c887405a962e51b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c5a9ea0ac6fb439b9c887405a962e51b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c5a9ea0ac6fb439b9c887405a962e51b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c5a9ea0ac6fb439b9c887405a962e51b", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-VolumesSnapshotTestJSON-1057524285 Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: c5a9ea0ac6fb439b9c887405a962e51b Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1057524285 Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-VolumesSnapshotTestJSON-1057524285-project Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 252727661cc043af94f5d21078506b2a Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-VolumesSnapshotTestJSON-1057524285-project Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd could not be found. Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd'} Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd could not be found. Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd could not be found. Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:11:12.514216 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:11:12.518959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:11:12.518959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:11:12.518959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:11:12.518959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:11:12.518959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:11:12.518959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd could not be found. Oct 24 11:11:12.518959 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:11:12.518959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fefb0ee5-8d33-47d4-9aa8-73069ed7bf32 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Returning 404 to user: Instance f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:11:12.518959 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fefb0ee5-8d33-47d4-9aa8-73069ed7bf32 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd" status: 404 len: 111 microversion: 2.1 time: 0.031340 Oct 24 11:11:12.518959 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3317/6608] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:11:12 2022] GET /compute/v2.1/servers/f14a5a8f-2969-4ef7-8768-88fc0dbfd3cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:11:19.286776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8a2bc3b7-4f2e-4a9b-9d5b-8791987fc431 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1148341876", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "99dcbd5b-e2f9-4f53-be8c-e7f06f4152e2"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:11:19.341063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-8a2bc3b7-4f2e-4a9b-9d5b-8791987fc431 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] validate_networks() for [('99dcbd5b-e2f9-4f53-be8c-e7f06f4152e2', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:11:19.699459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-8a2bc3b7-4f2e-4a9b-9d5b-8791987fc431 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:11:19.699921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-8a2bc3b7-4f2e-4a9b-9d5b-8791987fc431 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:11:19.700403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-8a2bc3b7-4f2e-4a9b-9d5b-8791987fc431 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:11:19.700819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-8a2bc3b7-4f2e-4a9b-9d5b-8791987fc431 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:11:19.701343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-8a2bc3b7-4f2e-4a9b-9d5b-8791987fc431 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:11:19.710374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a2bc3b7-4f2e-4a9b-9d5b-8791987fc431 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:19.710861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a2bc3b7-4f2e-4a9b-9d5b-8791987fc431 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:19.711305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a2bc3b7-4f2e-4a9b-9d5b-8791987fc431 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:19.712041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a2bc3b7-4f2e-4a9b-9d5b-8791987fc431 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:19.712505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a2bc3b7-4f2e-4a9b-9d5b-8791987fc431 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:19.712960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8a2bc3b7-4f2e-4a9b-9d5b-8791987fc431 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:19.730111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-8a2bc3b7-4f2e-4a9b-9d5b-8791987fc431 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Getting quotas for project c5a9ea0ac6fb439b9c887405a962e51b. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:11:19.736052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-8a2bc3b7-4f2e-4a9b-9d5b-8791987fc431 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Getting quotas for user 252727661cc043af94f5d21078506b2a and project c5a9ea0ac6fb439b9c887405a962e51b. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:11:19.748341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8a2bc3b7-4f2e-4a9b-9d5b-8791987fc431 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:11:19.751371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8a2bc3b7-4f2e-4a9b-9d5b-8791987fc431 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:11:19.796108 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8a2bc3b7-4f2e-4a9b-9d5b-8791987fc431 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513179 Oct 24 11:11:19.796774 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3292/6609] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:11:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:11:19.808878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e74134a2-26fc-423f-9431-14fca13bf599 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:19.809506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e74134a2-26fc-423f-9431-14fca13bf599 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:19.867476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e74134a2-26fc-423f-9431-14fca13bf599 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:11:19.874173 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e74134a2-26fc-423f-9431-14fca13bf599 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a" status: 200 len: 1219 microversion: 2.1 time: 0.069293 Oct 24 11:11:19.874746 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3318/6610] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:11:19 2022] GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:11:20.899931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-82147c8c-7287-48ce-a7c4-8a3a4a0a89fd tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:20.900758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-82147c8c-7287-48ce-a7c4-8a3a4a0a89fd tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:20.908946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82147c8c-7287-48ce-a7c4-8a3a4a0a89fd tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:20.909536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82147c8c-7287-48ce-a7c4-8a3a4a0a89fd tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:20.910054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82147c8c-7287-48ce-a7c4-8a3a4a0a89fd tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:20.910835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82147c8c-7287-48ce-a7c4-8a3a4a0a89fd tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:20.911470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82147c8c-7287-48ce-a7c4-8a3a4a0a89fd tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:20.911979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82147c8c-7287-48ce-a7c4-8a3a4a0a89fd tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:20.979624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-82147c8c-7287-48ce-a7c4-8a3a4a0a89fd tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:11:20.988215 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-82147c8c-7287-48ce-a7c4-8a3a4a0a89fd tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a" status: 200 len: 1289 microversion: 2.1 time: 0.093963 Oct 24 11:11:20.988931 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3293/6611] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:11:20 2022] GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a => generated 1289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:11:22.011917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c82dd029-89f7-4537-b2bd-db0ccf7f2ee5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:22.013748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c82dd029-89f7-4537-b2bd-db0ccf7f2ee5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:22.028440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c82dd029-89f7-4537-b2bd-db0ccf7f2ee5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:22.028968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c82dd029-89f7-4537-b2bd-db0ccf7f2ee5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:22.029408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c82dd029-89f7-4537-b2bd-db0ccf7f2ee5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:22.030585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c82dd029-89f7-4537-b2bd-db0ccf7f2ee5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:22.031068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c82dd029-89f7-4537-b2bd-db0ccf7f2ee5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:22.032367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c82dd029-89f7-4537-b2bd-db0ccf7f2ee5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:22.183965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c82dd029-89f7-4537-b2bd-db0ccf7f2ee5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:11:22.193287 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c82dd029-89f7-4537-b2bd-db0ccf7f2ee5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a" status: 200 len: 1319 microversion: 2.1 time: 0.185456 Oct 24 11:11:22.194094 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3319/6612] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:11:22 2022] GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:11:22.386603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-fba85751-2046-4cb5-a5c8-ded25fb9d20f req-59be8926-6988-40b0-bd47-8a11660edddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9726ee-58ea-4fa5-87b7-c3f8f103588a", "tag": "6888b039-3057-463b-9ebe-aec361b87358"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:11:22.399212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fba85751-2046-4cb5-a5c8-ded25fb9d20f req-59be8926-6988-40b0-bd47-8a11660edddd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:22.399790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fba85751-2046-4cb5-a5c8-ded25fb9d20f req-59be8926-6988-40b0-bd47-8a11660edddd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:22.400238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fba85751-2046-4cb5-a5c8-ded25fb9d20f req-59be8926-6988-40b0-bd47-8a11660edddd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:22.412712 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-fba85751-2046-4cb5-a5c8-ded25fb9d20f req-59be8926-6988-40b0-bd47-8a11660edddd service nova] Creating event network-changed:6888b039-3057-463b-9ebe-aec361b87358 for instance 3d9726ee-58ea-4fa5-87b7-c3f8f103588a on n-h1-858383-15 Oct 24 11:11:22.417566 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-fba85751-2046-4cb5-a5c8-ded25fb9d20f req-59be8926-6988-40b0-bd47-8a11660edddd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034814 Oct 24 11:11:22.418180 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3294/6613] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:11:23.216276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c6c9cd0e-3b4e-4c9b-9e30-fc68282511d3 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:23.216903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c6c9cd0e-3b4e-4c9b-9e30-fc68282511d3 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:23.224304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6c9cd0e-3b4e-4c9b-9e30-fc68282511d3 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:23.224787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6c9cd0e-3b4e-4c9b-9e30-fc68282511d3 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:23.225249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6c9cd0e-3b4e-4c9b-9e30-fc68282511d3 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:23.225942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6c9cd0e-3b4e-4c9b-9e30-fc68282511d3 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:23.226392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6c9cd0e-3b4e-4c9b-9e30-fc68282511d3 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:23.226815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6c9cd0e-3b4e-4c9b-9e30-fc68282511d3 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:23.353261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c6c9cd0e-3b4e-4c9b-9e30-fc68282511d3 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:11:23.361008 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c6c9cd0e-3b4e-4c9b-9e30-fc68282511d3 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a" status: 200 len: 1319 microversion: 2.1 time: 0.148576 Oct 24 11:11:23.361583 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3320/6614] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:11:23 2022] GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:11:24.385315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d8b2bf45-6c8b-46fa-b0a7-d691410154a4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:24.385978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d8b2bf45-6c8b-46fa-b0a7-d691410154a4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:24.392281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8b2bf45-6c8b-46fa-b0a7-d691410154a4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:24.392763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8b2bf45-6c8b-46fa-b0a7-d691410154a4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:24.393226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8b2bf45-6c8b-46fa-b0a7-d691410154a4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:24.393917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8b2bf45-6c8b-46fa-b0a7-d691410154a4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:24.394374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8b2bf45-6c8b-46fa-b0a7-d691410154a4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:24.394820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d8b2bf45-6c8b-46fa-b0a7-d691410154a4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:24.527757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d8b2bf45-6c8b-46fa-b0a7-d691410154a4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:11:24.535915 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d8b2bf45-6c8b-46fa-b0a7-d691410154a4 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a" status: 200 len: 1319 microversion: 2.1 time: 0.155797 Oct 24 11:11:24.536495 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3295/6615] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:11:24 2022] GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:11:25.559604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bc93ce3b-8f9f-40dc-aff6-76db0e2a4196 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:25.560225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bc93ce3b-8f9f-40dc-aff6-76db0e2a4196 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:25.567336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc93ce3b-8f9f-40dc-aff6-76db0e2a4196 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:25.567928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc93ce3b-8f9f-40dc-aff6-76db0e2a4196 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:25.568366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc93ce3b-8f9f-40dc-aff6-76db0e2a4196 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:25.569086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc93ce3b-8f9f-40dc-aff6-76db0e2a4196 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:25.569537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc93ce3b-8f9f-40dc-aff6-76db0e2a4196 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:25.569963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc93ce3b-8f9f-40dc-aff6-76db0e2a4196 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:25.697661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bc93ce3b-8f9f-40dc-aff6-76db0e2a4196 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:11:25.706204 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bc93ce3b-8f9f-40dc-aff6-76db0e2a4196 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a" status: 200 len: 1319 microversion: 2.1 time: 0.150540 Oct 24 11:11:25.706780 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3321/6616] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:11:25 2022] GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:11:26.728818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d0d80588-ed2f-4e46-8731-4fb2741d2df5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:26.729393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d0d80588-ed2f-4e46-8731-4fb2741d2df5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:26.736677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0d80588-ed2f-4e46-8731-4fb2741d2df5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:26.737193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0d80588-ed2f-4e46-8731-4fb2741d2df5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:26.737635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0d80588-ed2f-4e46-8731-4fb2741d2df5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:26.738329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0d80588-ed2f-4e46-8731-4fb2741d2df5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:26.738784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0d80588-ed2f-4e46-8731-4fb2741d2df5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:26.739212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0d80588-ed2f-4e46-8731-4fb2741d2df5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:26.874159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d0d80588-ed2f-4e46-8731-4fb2741d2df5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:11:26.882872 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d0d80588-ed2f-4e46-8731-4fb2741d2df5 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a" status: 200 len: 1319 microversion: 2.1 time: 0.158002 Oct 24 11:11:26.883514 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3296/6617] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:11:26 2022] GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:11:27.908393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cf218e83-8a69-497f-9c41-f75f40dd68a9 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:27.909175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cf218e83-8a69-497f-9c41-f75f40dd68a9 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:27.917460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf218e83-8a69-497f-9c41-f75f40dd68a9 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:27.918087 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf218e83-8a69-497f-9c41-f75f40dd68a9 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:27.918748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf218e83-8a69-497f-9c41-f75f40dd68a9 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:27.919912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf218e83-8a69-497f-9c41-f75f40dd68a9 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:27.920602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf218e83-8a69-497f-9c41-f75f40dd68a9 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:27.921018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf218e83-8a69-497f-9c41-f75f40dd68a9 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:28.051520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cf218e83-8a69-497f-9c41-f75f40dd68a9 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:11:28.059537 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cf218e83-8a69-497f-9c41-f75f40dd68a9 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a" status: 200 len: 1319 microversion: 2.1 time: 0.156507 Oct 24 11:11:28.060123 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3322/6618] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:11:27 2022] GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:11:28.529759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-f3c78545-c9ca-4aa5-817a-74b49c407239 req-aac5f17b-3bb2-49f1-84c4-620cff8ac61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9726ee-58ea-4fa5-87b7-c3f8f103588a", "name": "network-vif-plugged", "status": "completed", "tag": "6888b039-3057-463b-9ebe-aec361b87358"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:11:28.541142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f3c78545-c9ca-4aa5-817a-74b49c407239 req-aac5f17b-3bb2-49f1-84c4-620cff8ac61e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:28.541630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f3c78545-c9ca-4aa5-817a-74b49c407239 req-aac5f17b-3bb2-49f1-84c4-620cff8ac61e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:28.542073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-f3c78545-c9ca-4aa5-817a-74b49c407239 req-aac5f17b-3bb2-49f1-84c4-620cff8ac61e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:28.553921 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-f3c78545-c9ca-4aa5-817a-74b49c407239 req-aac5f17b-3bb2-49f1-84c4-620cff8ac61e service nova] Creating event network-vif-plugged:6888b039-3057-463b-9ebe-aec361b87358 for instance 3d9726ee-58ea-4fa5-87b7-c3f8f103588a on n-h1-858383-15 Oct 24 11:11:28.558904 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-f3c78545-c9ca-4aa5-817a-74b49c407239 req-aac5f17b-3bb2-49f1-84c4-620cff8ac61e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032925 Oct 24 11:11:28.559507 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3297/6619] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:11:29.085127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-17f6d20f-72f1-4a65-8bca-e92361c5fd00 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:29.085746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-17f6d20f-72f1-4a65-8bca-e92361c5fd00 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:29.092640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-17f6d20f-72f1-4a65-8bca-e92361c5fd00 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:29.093149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-17f6d20f-72f1-4a65-8bca-e92361c5fd00 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:29.093584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-17f6d20f-72f1-4a65-8bca-e92361c5fd00 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:29.094275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-17f6d20f-72f1-4a65-8bca-e92361c5fd00 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:29.094727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-17f6d20f-72f1-4a65-8bca-e92361c5fd00 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:29.095152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-17f6d20f-72f1-4a65-8bca-e92361c5fd00 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:29.223488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-17f6d20f-72f1-4a65-8bca-e92361c5fd00 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:11:29.230960 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-17f6d20f-72f1-4a65-8bca-e92361c5fd00 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a" status: 200 len: 1319 microversion: 2.1 time: 0.149795 Oct 24 11:11:29.231535 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3323/6620] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:11:29 2022] GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:11:30.252770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:11:30.253606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:11:30.257960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4e24b236-771a-4056-8751-97ac5aacbbd8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:30.258666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4e24b236-771a-4056-8751-97ac5aacbbd8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:30.265724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e24b236-771a-4056-8751-97ac5aacbbd8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:30.266208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e24b236-771a-4056-8751-97ac5aacbbd8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:30.267269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e24b236-771a-4056-8751-97ac5aacbbd8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:30.267968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e24b236-771a-4056-8751-97ac5aacbbd8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:30.268424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e24b236-771a-4056-8751-97ac5aacbbd8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:30.268874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4e24b236-771a-4056-8751-97ac5aacbbd8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:30.402599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4e24b236-771a-4056-8751-97ac5aacbbd8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:11:30.410785 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4e24b236-771a-4056-8751-97ac5aacbbd8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a" status: 200 len: 1508 microversion: 2.1 time: 0.159956 Oct 24 11:11:30.411384 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3298/6621] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:11:30 2022] GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:11:30.433552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-82003d24-00ad-4cad-9664-f147b4fc2c35 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c1f4397-c948-4116-abdd-940314f5c741", "device": "/dev/sdb"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:11:30.435985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-82003d24-00ad-4cad-9664-f147b4fc2c35 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:30.438082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:11:30.445136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82003d24-00ad-4cad-9664-f147b4fc2c35 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:30.445561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82003d24-00ad-4cad-9664-f147b4fc2c35 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:30.446009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82003d24-00ad-4cad-9664-f147b4fc2c35 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:30.446706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82003d24-00ad-4cad-9664-f147b4fc2c35 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:30.447192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82003d24-00ad-4cad-9664-f147b4fc2c35 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:30.447622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-82003d24-00ad-4cad-9664-f147b4fc2c35 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:30.699702 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-82003d24-00ad-4cad-9664-f147b4fc2c35 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "POST /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269842 Oct 24 11:11:30.700697 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3324/6622] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 11:11:30 2022] POST /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:11:52.245115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b9038d5-fa53-48bb-b709-165b2076c0d8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:52.245641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8b9038d5-fa53-48bb-b709-165b2076c0d8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:52.247643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:11:52.248439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:11:52.255131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b9038d5-fa53-48bb-b709-165b2076c0d8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:52.255615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b9038d5-fa53-48bb-b709-165b2076c0d8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:52.256053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b9038d5-fa53-48bb-b709-165b2076c0d8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:52.256744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b9038d5-fa53-48bb-b709-165b2076c0d8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:52.257222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b9038d5-fa53-48bb-b709-165b2076c0d8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:52.257646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b9038d5-fa53-48bb-b709-165b2076c0d8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:52.339598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-8b9038d5-fa53-48bb-b709-165b2076c0d8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lazy-loading 'services' on Instance uuid 3d9726ee-58ea-4fa5-87b7-c3f8f103588a {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:11:52.409007 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b9038d5-fa53-48bb-b709-165b2076c0d8 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a/os-volume_attachments/3c1f4397-c948-4116-abdd-940314f5c741" status: 202 len: 0 microversion: 2.1 time: 0.167816 Oct 24 11:11:52.409618 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3299/6623] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 11:11:52 2022] DELETE /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a/os-volume_attachments/3c1f4397-c948-4116-abdd-940314f5c741 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:11:57.775677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-09120391-9017-43f5-ad90-996593cf354a tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:57.776269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-09120391-9017-43f5-ad90-996593cf354a tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:57.778852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=24 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:11:57.779675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:11:57.787352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09120391-9017-43f5-ad90-996593cf354a tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:57.787842 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09120391-9017-43f5-ad90-996593cf354a tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:57.788283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09120391-9017-43f5-ad90-996593cf354a tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:57.789022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09120391-9017-43f5-ad90-996593cf354a tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:57.789487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09120391-9017-43f5-ad90-996593cf354a tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:57.789917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-09120391-9017-43f5-ad90-996593cf354a tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:57.820187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-09120391-9017-43f5-ad90-996593cf354a tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:11:57.896047 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-09120391-9017-43f5-ad90-996593cf354a tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a" status: 204 len: 0 microversion: 2.1 time: 0.124344 Oct 24 11:11:57.897090 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3325/6624] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:11:57 2022] DELETE /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:11:57.904117 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:11:57.904620 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:11:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a (ip 10.222.0.50) !!! Oct 24 11:11:57.909121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cbd71715-427b-4885-bbba-c4780e6cda4e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:57.909814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cbd71715-427b-4885-bbba-c4780e6cda4e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:57.917652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbd71715-427b-4885-bbba-c4780e6cda4e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:57.918142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbd71715-427b-4885-bbba-c4780e6cda4e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:57.918579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbd71715-427b-4885-bbba-c4780e6cda4e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:57.919296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbd71715-427b-4885-bbba-c4780e6cda4e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:57.919732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbd71715-427b-4885-bbba-c4780e6cda4e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:57.920344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cbd71715-427b-4885-bbba-c4780e6cda4e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:58.054338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cbd71715-427b-4885-bbba-c4780e6cda4e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:11:58.062156 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cbd71715-427b-4885-bbba-c4780e6cda4e tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a" status: 200 len: 1514 microversion: 2.1 time: 0.160163 Oct 24 11:11:58.062738 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3300/6625] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:11:57 2022] GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:11:59.085848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54b40244-feea-418c-a3f7-261f6f444b5b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:11:59.086558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-54b40244-feea-418c-a3f7-261f6f444b5b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:11:59.093427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54b40244-feea-418c-a3f7-261f6f444b5b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:59.094234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54b40244-feea-418c-a3f7-261f6f444b5b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:59.094682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54b40244-feea-418c-a3f7-261f6f444b5b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:59.095390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54b40244-feea-418c-a3f7-261f6f444b5b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:11:59.095848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54b40244-feea-418c-a3f7-261f6f444b5b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:11:59.096292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54b40244-feea-418c-a3f7-261f6f444b5b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:11:59.231865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-54b40244-feea-418c-a3f7-261f6f444b5b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:11:59.240277 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-54b40244-feea-418c-a3f7-261f6f444b5b tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a" status: 200 len: 1514 microversion: 2.1 time: 0.158777 Oct 24 11:11:59.240935 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3326/6626] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:11:59 2022] GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:12:00.034157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-4dbea23f-242a-423c-a33c-c8a7fed0b773 req-de2b289f-3462-4e5c-970c-49857fc8504b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9726ee-58ea-4fa5-87b7-c3f8f103588a", "name": "network-vif-deleted", "tag": "6888b039-3057-463b-9ebe-aec361b87358"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:12:00.045566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4dbea23f-242a-423c-a33c-c8a7fed0b773 req-de2b289f-3462-4e5c-970c-49857fc8504b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:12:00.046058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4dbea23f-242a-423c-a33c-c8a7fed0b773 req-de2b289f-3462-4e5c-970c-49857fc8504b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:12:00.046472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4dbea23f-242a-423c-a33c-c8a7fed0b773 req-de2b289f-3462-4e5c-970c-49857fc8504b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:12:00.058090 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-4dbea23f-242a-423c-a33c-c8a7fed0b773 req-de2b289f-3462-4e5c-970c-49857fc8504b service nova] Creating event network-vif-deleted:6888b039-3057-463b-9ebe-aec361b87358 for instance 3d9726ee-58ea-4fa5-87b7-c3f8f103588a on n-h1-858383-15 Oct 24 11:12:00.063232 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-4dbea23f-242a-423c-a33c-c8a7fed0b773 req-de2b289f-3462-4e5c-970c-49857fc8504b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033665 Oct 24 11:12:00.063828 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3301/6627] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:12:00.263493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c7bae61e-3f7f-4c7b-8862-9103ae92411c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:12:00.264143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c7bae61e-3f7f-4c7b-8862-9103ae92411c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:12:00.271971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7bae61e-3f7f-4c7b-8862-9103ae92411c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:12:00.272461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7bae61e-3f7f-4c7b-8862-9103ae92411c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:12:00.272929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7bae61e-3f7f-4c7b-8862-9103ae92411c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:12:00.273632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7bae61e-3f7f-4c7b-8862-9103ae92411c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:12:00.274090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7bae61e-3f7f-4c7b-8862-9103ae92411c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:12:00.274521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7bae61e-3f7f-4c7b-8862-9103ae92411c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:12:00.306166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7bae61e-3f7f-4c7b-8862-9103ae92411c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:12:00.306656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7bae61e-3f7f-4c7b-8862-9103ae92411c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:12:00.307102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7bae61e-3f7f-4c7b-8862-9103ae92411c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:12:00.307589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-c7bae61e-3f7f-4c7b-8862-9103ae92411c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lazy-loading 'fault' on Instance uuid 3d9726ee-58ea-4fa5-87b7-c3f8f103588a {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:12:00.348922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c7bae61e-3f7f-4c7b-8862-9103ae92411c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252727661cc043af94f5d21078506b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a9ea0ac6fb439b9c887405a962e51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:12:00.356582 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c7bae61e-3f7f-4c7b-8862-9103ae92411c tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a" status: 200 len: 1309 microversion: 2.1 time: 0.097007 Oct 24 11:12:00.357186 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3327/6628] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:12:00 2022] GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:12:01.381403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cb8caa7e-696c-4960-bdf0-03620bf12d59 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:12:01.382027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cb8caa7e-696c-4960-bdf0-03620bf12d59 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] [instance: 3d9726ee-58ea-4fa5-87b7-c3f8f103588a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:12:01.388342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb8caa7e-696c-4960-bdf0-03620bf12d59 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:12:01.388854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb8caa7e-696c-4960-bdf0-03620bf12d59 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:12:01.389296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb8caa7e-696c-4960-bdf0-03620bf12d59 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:12:01.389994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb8caa7e-696c-4960-bdf0-03620bf12d59 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:12:01.390989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb8caa7e-696c-4960-bdf0-03620bf12d59 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:12:01.391608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb8caa7e-696c-4960-bdf0-03620bf12d59 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:12:01.404888 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-cb8caa7e-696c-4960-bdf0-03620bf12d59 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] HTTP exception thrown: Instance 3d9726ee-58ea-4fa5-87b7-c3f8f103588a could not be found. Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cb8caa7e-696c-4960-bdf0-03620bf12d59 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Request method failure captured: Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a HTTP/1.1 Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnJeL6fOp00mlnegTwt_LQ1bYYH80y_tMMs8glRrtbdqD2hjsz-x4Ix0_YyZoll1qfyMMFlGGr0Xdyjl4MSCVvzvIFtKFgAfRXVgW9KQq8DC7PtcUpzgsV0BOtCtgb0aTjd8FPhL-_cVQJVoHrPonI5dHFkEiCeXVX3JqiAC2o7jrsw Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: c5a9ea0ac6fb439b9c887405a962e51b Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1057524285 Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c5a9ea0ac6fb439b9c887405a962e51b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c5a9ea0ac6fb439b9c887405a962e51b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c5a9ea0ac6fb439b9c887405a962e51b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c5a9ea0ac6fb439b9c887405a962e51b", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-VolumesSnapshotTestJSON-1057524285 Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: c5a9ea0ac6fb439b9c887405a962e51b Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1057524285 Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-VolumesSnapshotTestJSON-1057524285-project Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 252727661cc043af94f5d21078506b2a Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-VolumesSnapshotTestJSON-1057524285-project Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 3d9726ee-58ea-4fa5-87b7-c3f8f103588a could not be found. Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '3d9726ee-58ea-4fa5-87b7-c3f8f103588a'} Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d9726ee-58ea-4fa5-87b7-c3f8f103588a could not be found. Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d9726ee-58ea-4fa5-87b7-c3f8f103588a could not be found. Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:12:01.407682 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:12:01.411719 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:12:01.411719 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:12:01.411719 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:12:01.411719 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:12:01.411719 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:12:01.411719 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d9726ee-58ea-4fa5-87b7-c3f8f103588a could not be found. Oct 24 11:12:01.411719 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:12:01.411719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cb8caa7e-696c-4960-bdf0-03620bf12d59 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] Returning 404 to user: Instance 3d9726ee-58ea-4fa5-87b7-c3f8f103588a could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:12:01.411719 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cb8caa7e-696c-4960-bdf0-03620bf12d59 tempest-VolumesSnapshotTestJSON-1057524285 tempest-VolumesSnapshotTestJSON-1057524285-project] 10.222.0.50 "GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a" status: 404 len: 111 microversion: 2.1 time: 0.032975 Oct 24 11:12:01.411719 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3302/6629] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:12:01 2022] GET /compute/v2.1/servers/3d9726ee-58ea-4fa5-87b7-c3f8f103588a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 11:13:01.875901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:13:01.876702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:13:01.882098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1263025820", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3f1250e7-c7cf-4a74-bbfc-18c91969c587", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fd5ed2ae-44e8-4a94-8b2b-fd64f1a0661a"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:13:01.962768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] validate_networks() for [('fd5ed2ae-44e8-4a94-8b2b-fd64f1a0661a', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:13:02.355967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:13:02.356420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:13:02.356930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:13:02.357345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:13:02.357759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:13:02.368951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:02.369439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:02.369892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:02.370620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:02.371104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:02.371531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:02.393888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Getting quotas for project 7643b3a05e304f89a945f512536e2df6. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:13:02.399465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Getting quotas for user ea036c351f864bd0bb927e15e897c9e3 and project 7643b3a05e304f89a945f512536e2df6. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:13:02.463138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:13:02.465293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f1250e7-c7cf-4a74-bbfc-18c91969c587',volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:13:02.599956 n-d-858383-15 devstack@n-api.service[120426]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [ecea82d8-105f-4644-a19a-49dac1cbf827] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 11:13:03.610186 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [ecea82d8-105f-4644-a19a-49dac1cbf827] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 45656. Oct 24 11:13:03.618518 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3622c165-2a8a-4062-a3f3-b6b86b393b13 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.744555 Oct 24 11:13:03.619204 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3328/6630] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:13:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:13:03.629615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=8 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:13:03.631016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:13:03.636079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-39bb2284-72fa-4fad-909f-3bcc37cf1266 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:03.637035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-39bb2284-72fa-4fad-909f-3bcc37cf1266 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:03.700111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-39bb2284-72fa-4fad-909f-3bcc37cf1266 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:03.708707 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-39bb2284-72fa-4fad-909f-3bcc37cf1266 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1057 microversion: 2.1 time: 0.081810 Oct 24 11:13:03.709341 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3303/6631] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:03 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1057 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:04.732611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0311a58b-5115-4195-95c8-6cb6d11f09a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:04.733190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0311a58b-5115-4195-95c8-6cb6d11f09a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:04.740023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0311a58b-5115-4195-95c8-6cb6d11f09a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:04.740514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0311a58b-5115-4195-95c8-6cb6d11f09a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:04.740984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0311a58b-5115-4195-95c8-6cb6d11f09a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:04.741698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0311a58b-5115-4195-95c8-6cb6d11f09a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:04.742160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0311a58b-5115-4195-95c8-6cb6d11f09a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:04.742600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0311a58b-5115-4195-95c8-6cb6d11f09a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:04.804775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0311a58b-5115-4195-95c8-6cb6d11f09a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:04.813069 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0311a58b-5115-4195-95c8-6cb6d11f09a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1155 microversion: 2.1 time: 0.085261 Oct 24 11:13:04.813645 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3329/6632] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:04 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1155 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:05.838691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1bbf2966-759a-4e6c-9d7e-75a3ab7e2135 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:05.839595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1bbf2966-759a-4e6c-9d7e-75a3ab7e2135 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:05.858385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bbf2966-759a-4e6c-9d7e-75a3ab7e2135 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:05.859093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bbf2966-759a-4e6c-9d7e-75a3ab7e2135 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:05.859733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bbf2966-759a-4e6c-9d7e-75a3ab7e2135 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:05.860539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bbf2966-759a-4e6c-9d7e-75a3ab7e2135 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:05.861326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bbf2966-759a-4e6c-9d7e-75a3ab7e2135 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:05.862816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1bbf2966-759a-4e6c-9d7e-75a3ab7e2135 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:06.068090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1bbf2966-759a-4e6c-9d7e-75a3ab7e2135 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:06.076578 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1bbf2966-759a-4e6c-9d7e-75a3ab7e2135 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1215 microversion: 2.1 time: 0.243299 Oct 24 11:13:06.077309 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3304/6633] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:05 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1215 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:06.679570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-1ae82578-00c1-4000-8c53-23c2e555a812 req-dd4c2367-f59d-49e5-845d-9ea872d0bc3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e04f1528-ce62-4a57-b387-5c0e2685df32", "tag": "e5e2a1fa-96ae-4afb-ac03-a4b59c983cb5"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:13:06.690351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1ae82578-00c1-4000-8c53-23c2e555a812 req-dd4c2367-f59d-49e5-845d-9ea872d0bc3c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:06.690837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1ae82578-00c1-4000-8c53-23c2e555a812 req-dd4c2367-f59d-49e5-845d-9ea872d0bc3c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:06.691274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1ae82578-00c1-4000-8c53-23c2e555a812 req-dd4c2367-f59d-49e5-845d-9ea872d0bc3c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:06.704212 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-1ae82578-00c1-4000-8c53-23c2e555a812 req-dd4c2367-f59d-49e5-845d-9ea872d0bc3c service nova] Creating event network-changed:e5e2a1fa-96ae-4afb-ac03-a4b59c983cb5 for instance e04f1528-ce62-4a57-b387-5c0e2685df32 on n-h1-858383-15 Oct 24 11:13:06.710289 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-1ae82578-00c1-4000-8c53-23c2e555a812 req-dd4c2367-f59d-49e5-845d-9ea872d0bc3c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193719 Oct 24 11:13:06.711058 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3330/6634] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:13:07.100349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-de073939-8e9a-4d1e-96b9-155f19c89690 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:07.101251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-de073939-8e9a-4d1e-96b9-155f19c89690 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:07.108495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de073939-8e9a-4d1e-96b9-155f19c89690 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:07.109096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de073939-8e9a-4d1e-96b9-155f19c89690 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:07.109780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de073939-8e9a-4d1e-96b9-155f19c89690 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:07.110560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de073939-8e9a-4d1e-96b9-155f19c89690 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:07.111154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de073939-8e9a-4d1e-96b9-155f19c89690 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:07.111748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de073939-8e9a-4d1e-96b9-155f19c89690 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:07.255685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-de073939-8e9a-4d1e-96b9-155f19c89690 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:07.264078 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-de073939-8e9a-4d1e-96b9-155f19c89690 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1215 microversion: 2.1 time: 0.167737 Oct 24 11:13:07.264877 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3305/6635] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:07 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1215 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:08.290538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f7ba334b-ab48-4af3-be52-df7ae0e219ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:08.291367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f7ba334b-ab48-4af3-be52-df7ae0e219ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:08.297962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7ba334b-ab48-4af3-be52-df7ae0e219ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:08.299111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7ba334b-ab48-4af3-be52-df7ae0e219ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:08.299954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7ba334b-ab48-4af3-be52-df7ae0e219ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:08.300751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7ba334b-ab48-4af3-be52-df7ae0e219ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:08.301282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7ba334b-ab48-4af3-be52-df7ae0e219ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:08.301938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f7ba334b-ab48-4af3-be52-df7ae0e219ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:08.444960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f7ba334b-ab48-4af3-be52-df7ae0e219ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:08.452738 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f7ba334b-ab48-4af3-be52-df7ae0e219ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1215 microversion: 2.1 time: 0.168250 Oct 24 11:13:08.453340 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3331/6636] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:08 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1215 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:09.479760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f17e261c-634e-4054-8e4a-327d83f1e390 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:09.480537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f17e261c-634e-4054-8e4a-327d83f1e390 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:09.488749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17e261c-634e-4054-8e4a-327d83f1e390 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:09.489271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17e261c-634e-4054-8e4a-327d83f1e390 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:09.489715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17e261c-634e-4054-8e4a-327d83f1e390 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:09.490418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17e261c-634e-4054-8e4a-327d83f1e390 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:09.490877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17e261c-634e-4054-8e4a-327d83f1e390 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:09.491306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f17e261c-634e-4054-8e4a-327d83f1e390 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:09.626060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f17e261c-634e-4054-8e4a-327d83f1e390 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:09.634214 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f17e261c-634e-4054-8e4a-327d83f1e390 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1215 microversion: 2.1 time: 0.158374 Oct 24 11:13:09.634881 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3306/6637] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:09 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1215 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:10.659632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f1c6e9a7-7e69-4954-835b-38fd3a277f62 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:10.660531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f1c6e9a7-7e69-4954-835b-38fd3a277f62 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:10.667535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1c6e9a7-7e69-4954-835b-38fd3a277f62 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:10.668040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1c6e9a7-7e69-4954-835b-38fd3a277f62 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:10.668475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1c6e9a7-7e69-4954-835b-38fd3a277f62 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:10.669194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1c6e9a7-7e69-4954-835b-38fd3a277f62 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:10.669649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1c6e9a7-7e69-4954-835b-38fd3a277f62 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:10.670073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1c6e9a7-7e69-4954-835b-38fd3a277f62 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:10.798927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f1c6e9a7-7e69-4954-835b-38fd3a277f62 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:10.806778 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f1c6e9a7-7e69-4954-835b-38fd3a277f62 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1203 microversion: 2.1 time: 0.152359 Oct 24 11:13:10.807350 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3332/6638] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:10 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:11.831484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-70f7bdca-c0cb-4bbc-bb37-eea34e06799b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:11.832098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-70f7bdca-c0cb-4bbc-bb37-eea34e06799b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:11.838771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f7bdca-c0cb-4bbc-bb37-eea34e06799b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:11.839261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f7bdca-c0cb-4bbc-bb37-eea34e06799b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:11.839700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f7bdca-c0cb-4bbc-bb37-eea34e06799b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:11.840393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f7bdca-c0cb-4bbc-bb37-eea34e06799b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:11.840868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f7bdca-c0cb-4bbc-bb37-eea34e06799b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:11.841301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70f7bdca-c0cb-4bbc-bb37-eea34e06799b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:11.973198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-70f7bdca-c0cb-4bbc-bb37-eea34e06799b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:11.981019 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-70f7bdca-c0cb-4bbc-bb37-eea34e06799b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1203 microversion: 2.1 time: 0.154253 Oct 24 11:13:11.981599 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3307/6639] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:11 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:13.003841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-deb38e88-87f3-4731-accc-0c39691e8ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:13.004511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-deb38e88-87f3-4731-accc-0c39691e8ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:13.007251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:13:13.007940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:13:13.014166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-deb38e88-87f3-4731-accc-0c39691e8ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:13.014695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-deb38e88-87f3-4731-accc-0c39691e8ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:13.015144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-deb38e88-87f3-4731-accc-0c39691e8ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:13.015843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-deb38e88-87f3-4731-accc-0c39691e8ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:13.016300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-deb38e88-87f3-4731-accc-0c39691e8ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:13.016943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-deb38e88-87f3-4731-accc-0c39691e8ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:13.147659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-deb38e88-87f3-4731-accc-0c39691e8ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:13.155639 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-deb38e88-87f3-4731-accc-0c39691e8ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1203 microversion: 2.1 time: 0.156372 Oct 24 11:13:13.156218 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3333/6640] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:12 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:14.180185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bc3a3a1d-bbb4-4164-80ba-f87f4fc93203 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:14.181163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bc3a3a1d-bbb4-4164-80ba-f87f4fc93203 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:14.184012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:13:14.190422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc3a3a1d-bbb4-4164-80ba-f87f4fc93203 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:14.190905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc3a3a1d-bbb4-4164-80ba-f87f4fc93203 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:14.191342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc3a3a1d-bbb4-4164-80ba-f87f4fc93203 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:14.192035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc3a3a1d-bbb4-4164-80ba-f87f4fc93203 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:14.192487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc3a3a1d-bbb4-4164-80ba-f87f4fc93203 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:14.192933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc3a3a1d-bbb4-4164-80ba-f87f4fc93203 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:14.321810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bc3a3a1d-bbb4-4164-80ba-f87f4fc93203 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:14.329720 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bc3a3a1d-bbb4-4164-80ba-f87f4fc93203 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1203 microversion: 2.1 time: 0.154248 Oct 24 11:13:14.330478 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3308/6641] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:14 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:15.352782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d3c9d8e8-a558-45b4-9352-7058d7218b1a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:15.353430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d3c9d8e8-a558-45b4-9352-7058d7218b1a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:15.359477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3c9d8e8-a558-45b4-9352-7058d7218b1a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:15.359962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3c9d8e8-a558-45b4-9352-7058d7218b1a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:15.360987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3c9d8e8-a558-45b4-9352-7058d7218b1a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:15.361815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3c9d8e8-a558-45b4-9352-7058d7218b1a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:15.362284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3c9d8e8-a558-45b4-9352-7058d7218b1a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:15.362719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d3c9d8e8-a558-45b4-9352-7058d7218b1a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:15.497336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d3c9d8e8-a558-45b4-9352-7058d7218b1a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:15.505522 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d3c9d8e8-a558-45b4-9352-7058d7218b1a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1203 microversion: 2.1 time: 0.156936 Oct 24 11:13:15.506107 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3334/6642] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:15 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:16.529100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-010b4916-54d5-4be6-9fef-9071e140820a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:16.529730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-010b4916-54d5-4be6-9fef-9071e140820a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:16.536803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-010b4916-54d5-4be6-9fef-9071e140820a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:16.537323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-010b4916-54d5-4be6-9fef-9071e140820a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:16.537765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-010b4916-54d5-4be6-9fef-9071e140820a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:16.538460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-010b4916-54d5-4be6-9fef-9071e140820a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:16.538917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-010b4916-54d5-4be6-9fef-9071e140820a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:16.539408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-010b4916-54d5-4be6-9fef-9071e140820a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:16.667390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-010b4916-54d5-4be6-9fef-9071e140820a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:16.675377 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-010b4916-54d5-4be6-9fef-9071e140820a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1203 microversion: 2.1 time: 0.150537 Oct 24 11:13:16.675953 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3309/6643] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:16 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:17.698999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6230cec4-856d-4e9a-a273-b996e397a5ed tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:17.699622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6230cec4-856d-4e9a-a273-b996e397a5ed tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:17.706868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6230cec4-856d-4e9a-a273-b996e397a5ed tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:17.707348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6230cec4-856d-4e9a-a273-b996e397a5ed tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:17.707812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6230cec4-856d-4e9a-a273-b996e397a5ed tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:17.708504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6230cec4-856d-4e9a-a273-b996e397a5ed tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:17.708986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6230cec4-856d-4e9a-a273-b996e397a5ed tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:17.709415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6230cec4-856d-4e9a-a273-b996e397a5ed tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:17.841924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6230cec4-856d-4e9a-a273-b996e397a5ed tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:17.850512 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6230cec4-856d-4e9a-a273-b996e397a5ed tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1203 microversion: 2.1 time: 0.155455 Oct 24 11:13:17.851095 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3335/6644] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:17 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:18.872548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a3486776-8331-4536-880f-9767ff35b6fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:18.873227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a3486776-8331-4536-880f-9767ff35b6fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:18.880379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3486776-8331-4536-880f-9767ff35b6fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:18.880898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3486776-8331-4536-880f-9767ff35b6fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:18.881349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3486776-8331-4536-880f-9767ff35b6fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:18.882050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3486776-8331-4536-880f-9767ff35b6fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:18.882517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3486776-8331-4536-880f-9767ff35b6fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:18.882951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a3486776-8331-4536-880f-9767ff35b6fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:19.011627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a3486776-8331-4536-880f-9767ff35b6fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:19.019492 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a3486776-8331-4536-880f-9767ff35b6fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1203 microversion: 2.1 time: 0.150817 Oct 24 11:13:19.020075 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3310/6645] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:18 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:20.043111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-33ef6e81-fa4f-4fe9-abf3-3cc0c75e1884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:20.043662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-33ef6e81-fa4f-4fe9-abf3-3cc0c75e1884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:20.050502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33ef6e81-fa4f-4fe9-abf3-3cc0c75e1884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:20.050982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33ef6e81-fa4f-4fe9-abf3-3cc0c75e1884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:20.051417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33ef6e81-fa4f-4fe9-abf3-3cc0c75e1884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:20.052108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33ef6e81-fa4f-4fe9-abf3-3cc0c75e1884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:20.052555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33ef6e81-fa4f-4fe9-abf3-3cc0c75e1884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:20.053024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33ef6e81-fa4f-4fe9-abf3-3cc0c75e1884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:20.184995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-33ef6e81-fa4f-4fe9-abf3-3cc0c75e1884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:20.192873 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-33ef6e81-fa4f-4fe9-abf3-3cc0c75e1884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1203 microversion: 2.1 time: 0.153822 Oct 24 11:13:20.193469 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3336/6646] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:20 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:21.160744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-7b193c5a-1956-47a3-9349-40da41a21554 req-1ad8236b-914b-484c-946c-100e48755814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e04f1528-ce62-4a57-b387-5c0e2685df32", "name": "network-vif-plugged", "status": "completed", "tag": "e5e2a1fa-96ae-4afb-ac03-a4b59c983cb5"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:13:21.170872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7b193c5a-1956-47a3-9349-40da41a21554 req-1ad8236b-914b-484c-946c-100e48755814 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:21.171288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7b193c5a-1956-47a3-9349-40da41a21554 req-1ad8236b-914b-484c-946c-100e48755814 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:21.171719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-7b193c5a-1956-47a3-9349-40da41a21554 req-1ad8236b-914b-484c-946c-100e48755814 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:21.185455 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-7b193c5a-1956-47a3-9349-40da41a21554 req-1ad8236b-914b-484c-946c-100e48755814 service nova] Creating event network-vif-plugged:e5e2a1fa-96ae-4afb-ac03-a4b59c983cb5 for instance e04f1528-ce62-4a57-b387-5c0e2685df32 on n-h1-858383-15 Oct 24 11:13:21.191375 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-7b193c5a-1956-47a3-9349-40da41a21554 req-1ad8236b-914b-484c-946c-100e48755814 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112957 Oct 24 11:13:21.192025 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3311/6647] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:13:21.215511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-addf8328-e3ab-4ca5-aeda-aca868fae579 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:21.216132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-addf8328-e3ab-4ca5-aeda-aca868fae579 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:21.223234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-addf8328-e3ab-4ca5-aeda-aca868fae579 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:21.223720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-addf8328-e3ab-4ca5-aeda-aca868fae579 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:21.224158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-addf8328-e3ab-4ca5-aeda-aca868fae579 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:21.224915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-addf8328-e3ab-4ca5-aeda-aca868fae579 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:21.225344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-addf8328-e3ab-4ca5-aeda-aca868fae579 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:21.225770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-addf8328-e3ab-4ca5-aeda-aca868fae579 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:21.356094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-addf8328-e3ab-4ca5-aeda-aca868fae579 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:21.364026 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-addf8328-e3ab-4ca5-aeda-aca868fae579 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1203 microversion: 2.1 time: 0.152362 Oct 24 11:13:21.364678 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3337/6648] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:21 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:22.388743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ced23961-47cd-4326-9af0-497b384c726a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:22.389504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ced23961-47cd-4326-9af0-497b384c726a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:22.396481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ced23961-47cd-4326-9af0-497b384c726a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:22.396979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ced23961-47cd-4326-9af0-497b384c726a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:22.397425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ced23961-47cd-4326-9af0-497b384c726a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:22.398110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ced23961-47cd-4326-9af0-497b384c726a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:22.398560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ced23961-47cd-4326-9af0-497b384c726a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:22.398976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ced23961-47cd-4326-9af0-497b384c726a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:22.529986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ced23961-47cd-4326-9af0-497b384c726a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:22.538720 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ced23961-47cd-4326-9af0-497b384c726a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1203 microversion: 2.1 time: 0.155201 Oct 24 11:13:22.539288 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3312/6649] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:22 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:23.561059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-be97daed-ef69-4ef2-aaae-e235b6b08bff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:23.561677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-be97daed-ef69-4ef2-aaae-e235b6b08bff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:23.569134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be97daed-ef69-4ef2-aaae-e235b6b08bff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:23.569618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be97daed-ef69-4ef2-aaae-e235b6b08bff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:23.570056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be97daed-ef69-4ef2-aaae-e235b6b08bff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:23.570748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be97daed-ef69-4ef2-aaae-e235b6b08bff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:23.571202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be97daed-ef69-4ef2-aaae-e235b6b08bff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:23.571629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be97daed-ef69-4ef2-aaae-e235b6b08bff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:23.709720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-be97daed-ef69-4ef2-aaae-e235b6b08bff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:23.717534 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-be97daed-ef69-4ef2-aaae-e235b6b08bff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1391 microversion: 2.1 time: 0.160434 Oct 24 11:13:23.718114 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3338/6650] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:23 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:23.740348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6c08f6cd-0e69-4b91-94e0-fd488a9a27a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:23.741014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6c08f6cd-0e69-4b91-94e0-fd488a9a27a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:23.747895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c08f6cd-0e69-4b91-94e0-fd488a9a27a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:23.748376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c08f6cd-0e69-4b91-94e0-fd488a9a27a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:23.748816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c08f6cd-0e69-4b91-94e0-fd488a9a27a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:23.749537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c08f6cd-0e69-4b91-94e0-fd488a9a27a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:23.749994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c08f6cd-0e69-4b91-94e0-fd488a9a27a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:23.750423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c08f6cd-0e69-4b91-94e0-fd488a9a27a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:23.879070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6c08f6cd-0e69-4b91-94e0-fd488a9a27a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:23.886787 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6c08f6cd-0e69-4b91-94e0-fd488a9a27a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1391 microversion: 2.1 time: 0.150521 Oct 24 11:13:23.887367 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3313/6651] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:23 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:23.909271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-df5a0794-278b-4060-8b79-e974c6591de9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:23.909900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-df5a0794-278b-4060-8b79-e974c6591de9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:23.915975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df5a0794-278b-4060-8b79-e974c6591de9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:23.916464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df5a0794-278b-4060-8b79-e974c6591de9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:23.917010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df5a0794-278b-4060-8b79-e974c6591de9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:23.917708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df5a0794-278b-4060-8b79-e974c6591de9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:23.918171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df5a0794-278b-4060-8b79-e974c6591de9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:23.918602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-df5a0794-278b-4060-8b79-e974c6591de9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:24.050310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-df5a0794-278b-4060-8b79-e974c6591de9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:24.058073 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-df5a0794-278b-4060-8b79-e974c6591de9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1391 microversion: 2.1 time: 0.153131 Oct 24 11:13:24.058647 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3339/6652] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:23 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:24.080513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5588e07d-fa96-43ff-817c-3e904da58d63 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:24.080981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5588e07d-fa96-43ff-817c-3e904da58d63 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:24.086937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5588e07d-fa96-43ff-817c-3e904da58d63 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:24.087424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5588e07d-fa96-43ff-817c-3e904da58d63 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:24.087864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5588e07d-fa96-43ff-817c-3e904da58d63 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:24.088556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5588e07d-fa96-43ff-817c-3e904da58d63 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:24.089047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5588e07d-fa96-43ff-817c-3e904da58d63 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:24.089480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5588e07d-fa96-43ff-817c-3e904da58d63 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:24.114960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5588e07d-fa96-43ff-817c-3e904da58d63 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:13:24.196531 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5588e07d-fa96-43ff-817c-3e904da58d63 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 204 len: 0 microversion: 2.1 time: 0.119727 Oct 24 11:13:24.197220 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3314/6653] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:13:24 2022] DELETE /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:13:24.208975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c347b087-5b39-41ab-a65e-880e4d69d2bc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:24.209646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c347b087-5b39-41ab-a65e-880e4d69d2bc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:24.215953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c347b087-5b39-41ab-a65e-880e4d69d2bc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:24.216456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c347b087-5b39-41ab-a65e-880e4d69d2bc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:24.216926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c347b087-5b39-41ab-a65e-880e4d69d2bc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:24.217623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c347b087-5b39-41ab-a65e-880e4d69d2bc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:24.218078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c347b087-5b39-41ab-a65e-880e4d69d2bc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:24.218504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c347b087-5b39-41ab-a65e-880e4d69d2bc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:24.362870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c347b087-5b39-41ab-a65e-880e4d69d2bc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:24.371658 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c347b087-5b39-41ab-a65e-880e4d69d2bc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1397 microversion: 2.1 time: 0.168487 Oct 24 11:13:24.373190 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3340/6654] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:24 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1397 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:25.400387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-600a41f7-2de1-419e-bd1a-e98de2478534 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:25.401039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-600a41f7-2de1-419e-bd1a-e98de2478534 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:25.408908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-600a41f7-2de1-419e-bd1a-e98de2478534 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:25.409391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-600a41f7-2de1-419e-bd1a-e98de2478534 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:25.409825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-600a41f7-2de1-419e-bd1a-e98de2478534 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:25.410514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-600a41f7-2de1-419e-bd1a-e98de2478534 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:25.410967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-600a41f7-2de1-419e-bd1a-e98de2478534 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:25.411395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-600a41f7-2de1-419e-bd1a-e98de2478534 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:25.542570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-600a41f7-2de1-419e-bd1a-e98de2478534 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:25.550544 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-600a41f7-2de1-419e-bd1a-e98de2478534 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1397 microversion: 2.1 time: 0.154717 Oct 24 11:13:25.551138 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3315/6655] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:25 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1397 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:26.574071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8f8f54e4-523c-44b3-93ee-aad18240a15b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:26.574685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8f8f54e4-523c-44b3-93ee-aad18240a15b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:26.581787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f8f54e4-523c-44b3-93ee-aad18240a15b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:26.582369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f8f54e4-523c-44b3-93ee-aad18240a15b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:26.582839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f8f54e4-523c-44b3-93ee-aad18240a15b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:26.583557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f8f54e4-523c-44b3-93ee-aad18240a15b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:26.584014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f8f54e4-523c-44b3-93ee-aad18240a15b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:26.584442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f8f54e4-523c-44b3-93ee-aad18240a15b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:26.653565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8f8f54e4-523c-44b3-93ee-aad18240a15b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:26.661809 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8f8f54e4-523c-44b3-93ee-aad18240a15b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1355 microversion: 2.1 time: 0.091890 Oct 24 11:13:26.662393 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3341/6656] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:26 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1355 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:26.687132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-15573f9b-3be2-4d1f-b1e6-278ddeedbd8a req-07a58b31-0c9a-4caf-9b3d-b9a02eeb3327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e04f1528-ce62-4a57-b387-5c0e2685df32", "name": "network-vif-deleted", "tag": "e5e2a1fa-96ae-4afb-ac03-a4b59c983cb5"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:13:26.698651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-15573f9b-3be2-4d1f-b1e6-278ddeedbd8a req-07a58b31-0c9a-4caf-9b3d-b9a02eeb3327 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:26.699133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-15573f9b-3be2-4d1f-b1e6-278ddeedbd8a req-07a58b31-0c9a-4caf-9b3d-b9a02eeb3327 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:26.699563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-15573f9b-3be2-4d1f-b1e6-278ddeedbd8a req-07a58b31-0c9a-4caf-9b3d-b9a02eeb3327 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:26.711594 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-15573f9b-3be2-4d1f-b1e6-278ddeedbd8a req-07a58b31-0c9a-4caf-9b3d-b9a02eeb3327 service nova] Creating event network-vif-deleted:e5e2a1fa-96ae-4afb-ac03-a4b59c983cb5 for instance e04f1528-ce62-4a57-b387-5c0e2685df32 on n-h1-858383-15 Oct 24 11:13:26.717039 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-15573f9b-3be2-4d1f-b1e6-278ddeedbd8a req-07a58b31-0c9a-4caf-9b3d-b9a02eeb3327 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033429 Oct 24 11:13:26.717649 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3316/6657] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:13:27.685686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7008e140-dc0b-4728-a412-97eb821ff6db tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:27.686308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7008e140-dc0b-4728-a412-97eb821ff6db tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:27.693479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7008e140-dc0b-4728-a412-97eb821ff6db tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:27.694013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7008e140-dc0b-4728-a412-97eb821ff6db tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:27.694443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7008e140-dc0b-4728-a412-97eb821ff6db tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:27.695139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7008e140-dc0b-4728-a412-97eb821ff6db tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:27.695595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7008e140-dc0b-4728-a412-97eb821ff6db tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:27.696027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7008e140-dc0b-4728-a412-97eb821ff6db tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:27.759661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7008e140-dc0b-4728-a412-97eb821ff6db tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:27.767635 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7008e140-dc0b-4728-a412-97eb821ff6db tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1188 microversion: 2.1 time: 0.085967 Oct 24 11:13:27.768217 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3342/6658] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:27 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:28.791311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-21654354-466b-4b6b-a731-78c13bdb1c7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:28.792140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-21654354-466b-4b6b-a731-78c13bdb1c7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:28.798554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21654354-466b-4b6b-a731-78c13bdb1c7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:28.799044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21654354-466b-4b6b-a731-78c13bdb1c7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:28.799495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21654354-466b-4b6b-a731-78c13bdb1c7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:28.800210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21654354-466b-4b6b-a731-78c13bdb1c7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:28.800671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21654354-466b-4b6b-a731-78c13bdb1c7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:28.801133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-21654354-466b-4b6b-a731-78c13bdb1c7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:28.866119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-21654354-466b-4b6b-a731-78c13bdb1c7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:28.874177 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-21654354-466b-4b6b-a731-78c13bdb1c7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1188 microversion: 2.1 time: 0.088064 Oct 24 11:13:28.874767 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3317/6659] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:28 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:29.896414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-679f4420-45c6-44fe-972b-270e70f70094 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:29.897055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-679f4420-45c6-44fe-972b-270e70f70094 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:29.904796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-679f4420-45c6-44fe-972b-270e70f70094 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:29.905325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-679f4420-45c6-44fe-972b-270e70f70094 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:29.905771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-679f4420-45c6-44fe-972b-270e70f70094 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:29.906560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-679f4420-45c6-44fe-972b-270e70f70094 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:29.907548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-679f4420-45c6-44fe-972b-270e70f70094 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:29.908075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-679f4420-45c6-44fe-972b-270e70f70094 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:29.976355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-679f4420-45c6-44fe-972b-270e70f70094 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:29.984675 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-679f4420-45c6-44fe-972b-270e70f70094 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1188 microversion: 2.1 time: 0.092205 Oct 24 11:13:29.985534 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3343/6660] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:29 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:13:31.007743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8e387b3f-3af9-4c04-a2eb-d9972682f9d1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:31.008394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8e387b3f-3af9-4c04-a2eb-d9972682f9d1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:31.015337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e387b3f-3af9-4c04-a2eb-d9972682f9d1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:31.015898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e387b3f-3af9-4c04-a2eb-d9972682f9d1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:31.016510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e387b3f-3af9-4c04-a2eb-d9972682f9d1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:31.017276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e387b3f-3af9-4c04-a2eb-d9972682f9d1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:31.017740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e387b3f-3af9-4c04-a2eb-d9972682f9d1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:31.018170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e387b3f-3af9-4c04-a2eb-d9972682f9d1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:31.053129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e387b3f-3af9-4c04-a2eb-d9972682f9d1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:31.053619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e387b3f-3af9-4c04-a2eb-d9972682f9d1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:31.054100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e387b3f-3af9-4c04-a2eb-d9972682f9d1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:31.054551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-8e387b3f-3af9-4c04-a2eb-d9972682f9d1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lazy-loading 'fault' on Instance uuid e04f1528-ce62-4a57-b387-5c0e2685df32 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:13:31.097509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8e387b3f-3af9-4c04-a2eb-d9972682f9d1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:31.105144 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8e387b3f-3af9-4c04-a2eb-d9972682f9d1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 200 len: 1193 microversion: 2.1 time: 0.101403 Oct 24 11:13:31.105726 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3318/6661] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:31 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 1193 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:32.128879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5984e21c-1a01-4579-91dc-d5dc4ee3a443 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:32.129503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5984e21c-1a01-4579-91dc-d5dc4ee3a443 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: e04f1528-ce62-4a57-b387-5c0e2685df32] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:32.132263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:13:32.137792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5984e21c-1a01-4579-91dc-d5dc4ee3a443 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:32.138283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5984e21c-1a01-4579-91dc-d5dc4ee3a443 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:32.138727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5984e21c-1a01-4579-91dc-d5dc4ee3a443 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:32.139435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5984e21c-1a01-4579-91dc-d5dc4ee3a443 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:32.139893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5984e21c-1a01-4579-91dc-d5dc4ee3a443 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:32.140327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5984e21c-1a01-4579-91dc-d5dc4ee3a443 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:32.144372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=89 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:13:32.156259 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-5984e21c-1a01-4579-91dc-d5dc4ee3a443 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] HTTP exception thrown: Instance e04f1528-ce62-4a57-b387-5c0e2685df32 could not be found. Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5984e21c-1a01-4579-91dc-d5dc4ee3a443 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Request method failure captured: Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 HTTP/1.1 Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnM2OqlSOkhfxDfVEeTT94IwX8qn5k49naomhNLud1uic_lKwej-RJQ1PZooBFuUMpS4DQEMNgRR3ENofPbDmyI7Cy_YSVUuCsvfRNdcFM4T5H_sDbiD3-ZTRmSQR0yoz-aOqM9u5ViLunGIsswJX3XnF9XyVytj9jbL6H3Gm1Ht-2Q Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7643b3a05e304f89a945f512536e2df6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ea036c351f864bd0bb927e15e897c9e3 Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance e04f1528-ce62-4a57-b387-5c0e2685df32 could not be found. Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'e04f1528-ce62-4a57-b387-5c0e2685df32'} Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e04f1528-ce62-4a57-b387-5c0e2685df32 could not be found. Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e04f1528-ce62-4a57-b387-5c0e2685df32 could not be found. Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:13:32.158754 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:13:32.163045 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:13:32.163045 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:13:32.163045 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:13:32.163045 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:13:32.163045 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:13:32.163045 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e04f1528-ce62-4a57-b387-5c0e2685df32 could not be found. Oct 24 11:13:32.163045 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:13:32.163045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5984e21c-1a01-4579-91dc-d5dc4ee3a443 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Returning 404 to user: Instance e04f1528-ce62-4a57-b387-5c0e2685df32 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:13:32.163045 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5984e21c-1a01-4579-91dc-d5dc4ee3a443 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32" status: 404 len: 111 microversion: 2.1 time: 0.035254 Oct 24 11:13:32.163045 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3344/6662] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:32 2022] GET /compute/v2.1/servers/e04f1528-ce62-4a57-b387-5c0e2685df32 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:13:37.085733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd4e932d-8acc-4ced-a554-61a2178b8284 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-631339677", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3f8854fe-1e89-4407-8247-1315ce9cfac9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fd5ed2ae-44e8-4a94-8b2b-fd64f1a0661a"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:13:37.097931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:13:37.150049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-bd4e932d-8acc-4ced-a554-61a2178b8284 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] validate_networks() for [('fd5ed2ae-44e8-4a94-8b2b-fd64f1a0661a', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:13:37.629334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-bd4e932d-8acc-4ced-a554-61a2178b8284 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:13:37.629767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-bd4e932d-8acc-4ced-a554-61a2178b8284 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:13:37.630243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-bd4e932d-8acc-4ced-a554-61a2178b8284 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:13:37.630655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-bd4e932d-8acc-4ced-a554-61a2178b8284 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:13:37.631070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-bd4e932d-8acc-4ced-a554-61a2178b8284 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:13:37.639943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd4e932d-8acc-4ced-a554-61a2178b8284 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:37.640424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd4e932d-8acc-4ced-a554-61a2178b8284 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:37.640893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd4e932d-8acc-4ced-a554-61a2178b8284 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:37.641631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd4e932d-8acc-4ced-a554-61a2178b8284 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:37.642409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd4e932d-8acc-4ced-a554-61a2178b8284 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:37.642849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd4e932d-8acc-4ced-a554-61a2178b8284 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:37.648391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:13:37.663676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-bd4e932d-8acc-4ced-a554-61a2178b8284 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Getting quotas for project 7643b3a05e304f89a945f512536e2df6. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:13:37.668951 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-bd4e932d-8acc-4ced-a554-61a2178b8284 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Getting quotas for user ea036c351f864bd0bb927e15e897c9e3 and project 7643b3a05e304f89a945f512536e2df6. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:13:37.726141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bd4e932d-8acc-4ced-a554-61a2178b8284 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:13:37.728167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bd4e932d-8acc-4ced-a554-61a2178b8284 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f8854fe-1e89-4407-8247-1315ce9cfac9',volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:13:37.854232 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bd4e932d-8acc-4ced-a554-61a2178b8284 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772471 Oct 24 11:13:37.854893 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3319/6663] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:13:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:13:37.866585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-71bd8b9d-89fb-42df-b431-81bf39a5e7f2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:37.867206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-71bd8b9d-89fb-42df-b431-81bf39a5e7f2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:37.870577 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:13:37.870715 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:13:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 (ip 10.222.0.50) !!! Oct 24 11:13:37.936651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-71bd8b9d-89fb-42df-b431-81bf39a5e7f2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:37.945082 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-71bd8b9d-89fb-42df-b431-81bf39a5e7f2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1056 microversion: 2.1 time: 0.082308 Oct 24 11:13:37.945658 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3345/6664] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:37 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1056 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:38.969270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9a26d07d-a3a7-49b9-9168-8a147fe8c658 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:38.971349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9a26d07d-a3a7-49b9-9168-8a147fe8c658 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:38.978708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a26d07d-a3a7-49b9-9168-8a147fe8c658 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:38.979478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a26d07d-a3a7-49b9-9168-8a147fe8c658 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:38.980042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a26d07d-a3a7-49b9-9168-8a147fe8c658 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:38.980993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a26d07d-a3a7-49b9-9168-8a147fe8c658 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:38.981450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a26d07d-a3a7-49b9-9168-8a147fe8c658 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:38.981938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a26d07d-a3a7-49b9-9168-8a147fe8c658 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:39.049009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9a26d07d-a3a7-49b9-9168-8a147fe8c658 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:39.057079 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9a26d07d-a3a7-49b9-9168-8a147fe8c658 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1162 microversion: 2.1 time: 0.093195 Oct 24 11:13:39.057655 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3320/6665] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:38 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1162 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:40.080281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2aa4441f-4209-4ec6-a9e1-e13c500669bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:40.081798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2aa4441f-4209-4ec6-a9e1-e13c500669bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:40.088791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2aa4441f-4209-4ec6-a9e1-e13c500669bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:40.089556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2aa4441f-4209-4ec6-a9e1-e13c500669bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:40.090066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2aa4441f-4209-4ec6-a9e1-e13c500669bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:40.090834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2aa4441f-4209-4ec6-a9e1-e13c500669bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:40.091357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2aa4441f-4209-4ec6-a9e1-e13c500669bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:40.092113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2aa4441f-4209-4ec6-a9e1-e13c500669bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:40.270213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2aa4441f-4209-4ec6-a9e1-e13c500669bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:40.278540 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2aa4441f-4209-4ec6-a9e1-e13c500669bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1214 microversion: 2.1 time: 0.202770 Oct 24 11:13:40.279630 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3346/6666] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:40 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:40.416596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c0d5156e-420d-4d0f-b20a-408fec4eb8a6 req-818f341d-11f1-41e5-8850-0670d31f8382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea63dd89-6e5d-4d81-859c-dee45b168e97", "tag": "ec9bdf08-561f-4e89-8fe4-826a6e88518f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:13:40.434986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c0d5156e-420d-4d0f-b20a-408fec4eb8a6 req-818f341d-11f1-41e5-8850-0670d31f8382 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:40.435546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c0d5156e-420d-4d0f-b20a-408fec4eb8a6 req-818f341d-11f1-41e5-8850-0670d31f8382 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:40.436051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c0d5156e-420d-4d0f-b20a-408fec4eb8a6 req-818f341d-11f1-41e5-8850-0670d31f8382 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:40.458989 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c0d5156e-420d-4d0f-b20a-408fec4eb8a6 req-818f341d-11f1-41e5-8850-0670d31f8382 service nova] Creating event network-changed:ec9bdf08-561f-4e89-8fe4-826a6e88518f for instance ea63dd89-6e5d-4d81-859c-dee45b168e97 on n-h1-858383-15 Oct 24 11:13:40.465468 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c0d5156e-420d-4d0f-b20a-408fec4eb8a6 req-818f341d-11f1-41e5-8850-0670d31f8382 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059050 Oct 24 11:13:40.466877 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3321/6667] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:13:41.302026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8719d38f-d917-4058-9b46-fe3af2758f7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:41.302654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8719d38f-d917-4058-9b46-fe3af2758f7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:41.309773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8719d38f-d917-4058-9b46-fe3af2758f7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:41.310264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8719d38f-d917-4058-9b46-fe3af2758f7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:41.310739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8719d38f-d917-4058-9b46-fe3af2758f7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:41.311452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8719d38f-d917-4058-9b46-fe3af2758f7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:41.311913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8719d38f-d917-4058-9b46-fe3af2758f7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:41.312344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8719d38f-d917-4058-9b46-fe3af2758f7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:41.461860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8719d38f-d917-4058-9b46-fe3af2758f7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:41.471165 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8719d38f-d917-4058-9b46-fe3af2758f7d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1214 microversion: 2.1 time: 0.172899 Oct 24 11:13:41.471443 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3347/6668] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:41 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1214 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:42.496182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e9dd3059-9608-4195-89d4-44f4dced6768 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:42.496809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e9dd3059-9608-4195-89d4-44f4dced6768 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:42.503786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9dd3059-9608-4195-89d4-44f4dced6768 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:42.504283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9dd3059-9608-4195-89d4-44f4dced6768 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:42.504729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9dd3059-9608-4195-89d4-44f4dced6768 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:42.505452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9dd3059-9608-4195-89d4-44f4dced6768 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:42.505916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9dd3059-9608-4195-89d4-44f4dced6768 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:42.506347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9dd3059-9608-4195-89d4-44f4dced6768 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:42.637262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9dd3059-9608-4195-89d4-44f4dced6768 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:42.645635 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e9dd3059-9608-4195-89d4-44f4dced6768 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1214 microversion: 2.1 time: 0.154805 Oct 24 11:13:42.646218 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3322/6669] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:42 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:43.667633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-00ad71db-ed44-40a1-ae3a-e169229df773 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:43.668256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-00ad71db-ed44-40a1-ae3a-e169229df773 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:43.675622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00ad71db-ed44-40a1-ae3a-e169229df773 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:43.676112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00ad71db-ed44-40a1-ae3a-e169229df773 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:43.676585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00ad71db-ed44-40a1-ae3a-e169229df773 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:43.677398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00ad71db-ed44-40a1-ae3a-e169229df773 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:43.677867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00ad71db-ed44-40a1-ae3a-e169229df773 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:43.678298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-00ad71db-ed44-40a1-ae3a-e169229df773 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:43.813144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-00ad71db-ed44-40a1-ae3a-e169229df773 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:43.822031 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-00ad71db-ed44-40a1-ae3a-e169229df773 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1214 microversion: 2.1 time: 0.158291 Oct 24 11:13:43.822612 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3348/6670] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:43 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:44.845954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7487bf6d-f0d6-4135-aa88-5e3866ad0a43 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:44.846562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7487bf6d-f0d6-4135-aa88-5e3866ad0a43 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:44.853484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7487bf6d-f0d6-4135-aa88-5e3866ad0a43 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:44.853965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7487bf6d-f0d6-4135-aa88-5e3866ad0a43 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:44.854403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7487bf6d-f0d6-4135-aa88-5e3866ad0a43 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:44.855092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7487bf6d-f0d6-4135-aa88-5e3866ad0a43 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:44.855541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7487bf6d-f0d6-4135-aa88-5e3866ad0a43 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:44.855961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7487bf6d-f0d6-4135-aa88-5e3866ad0a43 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:44.990713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7487bf6d-f0d6-4135-aa88-5e3866ad0a43 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:44.998411 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7487bf6d-f0d6-4135-aa88-5e3866ad0a43 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1202 microversion: 2.1 time: 0.157627 Oct 24 11:13:44.998985 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3323/6671] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:44 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:46.022298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3f83f75f-5a91-44c8-855b-c22b748adb41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:46.022867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3f83f75f-5a91-44c8-855b-c22b748adb41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:46.029777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f83f75f-5a91-44c8-855b-c22b748adb41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:46.030263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f83f75f-5a91-44c8-855b-c22b748adb41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:46.030695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f83f75f-5a91-44c8-855b-c22b748adb41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:46.031381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f83f75f-5a91-44c8-855b-c22b748adb41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:46.032495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f83f75f-5a91-44c8-855b-c22b748adb41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:46.033053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f83f75f-5a91-44c8-855b-c22b748adb41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:46.165722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3f83f75f-5a91-44c8-855b-c22b748adb41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:46.173636 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3f83f75f-5a91-44c8-855b-c22b748adb41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1202 microversion: 2.1 time: 0.155522 Oct 24 11:13:46.174210 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3349/6672] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:46 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:47.196089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e1a5eef-cd18-4405-bf91-4b453634629c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:47.197380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e1a5eef-cd18-4405-bf91-4b453634629c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:47.204152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e1a5eef-cd18-4405-bf91-4b453634629c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:47.204648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e1a5eef-cd18-4405-bf91-4b453634629c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:47.205118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e1a5eef-cd18-4405-bf91-4b453634629c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:47.205820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e1a5eef-cd18-4405-bf91-4b453634629c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:47.206281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e1a5eef-cd18-4405-bf91-4b453634629c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:47.206713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e1a5eef-cd18-4405-bf91-4b453634629c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:47.343185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1e1a5eef-cd18-4405-bf91-4b453634629c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:47.351651 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1e1a5eef-cd18-4405-bf91-4b453634629c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1202 microversion: 2.1 time: 0.159459 Oct 24 11:13:47.352229 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3324/6673] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:47 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:13:48.375164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5e2452d6-ac00-42ce-a16a-2522057a5595 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:48.376379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5e2452d6-ac00-42ce-a16a-2522057a5595 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:48.379114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:13:48.384881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e2452d6-ac00-42ce-a16a-2522057a5595 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:48.385370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e2452d6-ac00-42ce-a16a-2522057a5595 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:48.385812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e2452d6-ac00-42ce-a16a-2522057a5595 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:48.386510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e2452d6-ac00-42ce-a16a-2522057a5595 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:48.386968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e2452d6-ac00-42ce-a16a-2522057a5595 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:48.387398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5e2452d6-ac00-42ce-a16a-2522057a5595 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:48.517947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5e2452d6-ac00-42ce-a16a-2522057a5595 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:48.525742 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5e2452d6-ac00-42ce-a16a-2522057a5595 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1202 microversion: 2.1 time: 0.154558 Oct 24 11:13:48.526318 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3350/6674] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:48 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:49.549235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c47d56a8-3c20-4016-a8b0-85b16669f891 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:49.549859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c47d56a8-3c20-4016-a8b0-85b16669f891 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:49.551820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:13:49.552533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:13:49.559950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c47d56a8-3c20-4016-a8b0-85b16669f891 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:49.560438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c47d56a8-3c20-4016-a8b0-85b16669f891 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:49.560903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c47d56a8-3c20-4016-a8b0-85b16669f891 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:49.561630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c47d56a8-3c20-4016-a8b0-85b16669f891 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:49.562092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c47d56a8-3c20-4016-a8b0-85b16669f891 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:49.562561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c47d56a8-3c20-4016-a8b0-85b16669f891 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:49.700345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c47d56a8-3c20-4016-a8b0-85b16669f891 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:49.708172 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c47d56a8-3c20-4016-a8b0-85b16669f891 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1202 microversion: 2.1 time: 0.163126 Oct 24 11:13:49.708759 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3325/6675] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:49 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1202 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:50.731414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cd3ccc08-f601-4a01-b5a5-9aca43ee3921 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:50.732037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cd3ccc08-f601-4a01-b5a5-9aca43ee3921 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:50.739213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd3ccc08-f601-4a01-b5a5-9aca43ee3921 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:50.739700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd3ccc08-f601-4a01-b5a5-9aca43ee3921 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:50.740144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd3ccc08-f601-4a01-b5a5-9aca43ee3921 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:50.740855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd3ccc08-f601-4a01-b5a5-9aca43ee3921 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:50.741335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd3ccc08-f601-4a01-b5a5-9aca43ee3921 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:50.741767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd3ccc08-f601-4a01-b5a5-9aca43ee3921 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:50.870306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cd3ccc08-f601-4a01-b5a5-9aca43ee3921 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:50.878850 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cd3ccc08-f601-4a01-b5a5-9aca43ee3921 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1202 microversion: 2.1 time: 0.151395 Oct 24 11:13:50.879420 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3351/6676] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:50 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:51.902107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6800ef94-ddcf-4478-a8a9-f9ec79f61892 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:51.902722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6800ef94-ddcf-4478-a8a9-f9ec79f61892 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:51.911856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6800ef94-ddcf-4478-a8a9-f9ec79f61892 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:51.912337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6800ef94-ddcf-4478-a8a9-f9ec79f61892 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:51.912777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6800ef94-ddcf-4478-a8a9-f9ec79f61892 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:51.913487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6800ef94-ddcf-4478-a8a9-f9ec79f61892 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:51.913941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6800ef94-ddcf-4478-a8a9-f9ec79f61892 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:51.914365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6800ef94-ddcf-4478-a8a9-f9ec79f61892 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:52.041134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6800ef94-ddcf-4478-a8a9-f9ec79f61892 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:52.048859 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6800ef94-ddcf-4478-a8a9-f9ec79f61892 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1202 microversion: 2.1 time: 0.150922 Oct 24 11:13:52.049433 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3326/6677] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:51 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:53.071586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ba32f84e-61c5-4b27-bf8e-a5986589ac38 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:53.072203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ba32f84e-61c5-4b27-bf8e-a5986589ac38 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:53.079290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba32f84e-61c5-4b27-bf8e-a5986589ac38 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:53.079769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba32f84e-61c5-4b27-bf8e-a5986589ac38 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:53.080205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba32f84e-61c5-4b27-bf8e-a5986589ac38 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:53.080920 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba32f84e-61c5-4b27-bf8e-a5986589ac38 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:53.081376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba32f84e-61c5-4b27-bf8e-a5986589ac38 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:53.081802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba32f84e-61c5-4b27-bf8e-a5986589ac38 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:53.214987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ba32f84e-61c5-4b27-bf8e-a5986589ac38 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:53.223555 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ba32f84e-61c5-4b27-bf8e-a5986589ac38 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1202 microversion: 2.1 time: 0.155816 Oct 24 11:13:53.224129 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3352/6678] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:53 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:54.246236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-edaabb1b-51f0-4bed-bf26-22a8e52ffb25 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:54.246851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-edaabb1b-51f0-4bed-bf26-22a8e52ffb25 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:54.254624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edaabb1b-51f0-4bed-bf26-22a8e52ffb25 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:54.255104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edaabb1b-51f0-4bed-bf26-22a8e52ffb25 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:54.255542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edaabb1b-51f0-4bed-bf26-22a8e52ffb25 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:54.256230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edaabb1b-51f0-4bed-bf26-22a8e52ffb25 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:54.256680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edaabb1b-51f0-4bed-bf26-22a8e52ffb25 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:54.257133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-edaabb1b-51f0-4bed-bf26-22a8e52ffb25 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:54.387636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-edaabb1b-51f0-4bed-bf26-22a8e52ffb25 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:54.395547 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-edaabb1b-51f0-4bed-bf26-22a8e52ffb25 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1202 microversion: 2.1 time: 0.153283 Oct 24 11:13:54.396116 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3327/6679] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:54 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:55.271502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-54c2ad49-138c-4b29-b341-ea5f5d0cfb0c req-3dd24959-b7a7-4c39-a3a9-2b0436defbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea63dd89-6e5d-4d81-859c-dee45b168e97", "name": "network-vif-plugged", "status": "completed", "tag": "ec9bdf08-561f-4e89-8fe4-826a6e88518f"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:13:55.282531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-54c2ad49-138c-4b29-b341-ea5f5d0cfb0c req-3dd24959-b7a7-4c39-a3a9-2b0436defbb4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:55.283015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-54c2ad49-138c-4b29-b341-ea5f5d0cfb0c req-3dd24959-b7a7-4c39-a3a9-2b0436defbb4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:55.283467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-54c2ad49-138c-4b29-b341-ea5f5d0cfb0c req-3dd24959-b7a7-4c39-a3a9-2b0436defbb4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:55.296278 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-54c2ad49-138c-4b29-b341-ea5f5d0cfb0c req-3dd24959-b7a7-4c39-a3a9-2b0436defbb4 service nova] Creating event network-vif-plugged:ec9bdf08-561f-4e89-8fe4-826a6e88518f for instance ea63dd89-6e5d-4d81-859c-dee45b168e97 on n-h1-858383-15 Oct 24 11:13:55.301407 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-54c2ad49-138c-4b29-b341-ea5f5d0cfb0c req-3dd24959-b7a7-4c39-a3a9-2b0436defbb4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033599 Oct 24 11:13:55.302024 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3353/6680] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:13:55.418645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-93cb861d-e958-4201-924c-1aef1b515e4b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:55.419404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-93cb861d-e958-4201-924c-1aef1b515e4b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:55.426847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93cb861d-e958-4201-924c-1aef1b515e4b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:55.427414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93cb861d-e958-4201-924c-1aef1b515e4b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:55.427931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93cb861d-e958-4201-924c-1aef1b515e4b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:55.428633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93cb861d-e958-4201-924c-1aef1b515e4b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:55.429251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93cb861d-e958-4201-924c-1aef1b515e4b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:55.429679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93cb861d-e958-4201-924c-1aef1b515e4b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:55.562422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-93cb861d-e958-4201-924c-1aef1b515e4b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:55.570668 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-93cb861d-e958-4201-924c-1aef1b515e4b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1202 microversion: 2.1 time: 0.155948 Oct 24 11:13:55.571263 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3328/6681] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:55 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:56.595462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-244f77d1-3c06-4bf5-9173-6ddccec6d161 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:56.596159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-244f77d1-3c06-4bf5-9173-6ddccec6d161 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:56.602493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-244f77d1-3c06-4bf5-9173-6ddccec6d161 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:56.602982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-244f77d1-3c06-4bf5-9173-6ddccec6d161 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:56.603467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-244f77d1-3c06-4bf5-9173-6ddccec6d161 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:56.604137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-244f77d1-3c06-4bf5-9173-6ddccec6d161 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:56.604588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-244f77d1-3c06-4bf5-9173-6ddccec6d161 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:56.605050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-244f77d1-3c06-4bf5-9173-6ddccec6d161 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:56.738724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-244f77d1-3c06-4bf5-9173-6ddccec6d161 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:56.746421 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-244f77d1-3c06-4bf5-9173-6ddccec6d161 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1202 microversion: 2.1 time: 0.156093 Oct 24 11:13:56.747004 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3354/6682] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:56 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:57.770618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-231dc3cf-b86f-48aa-9f0a-1eb0a740c071 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:57.771228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-231dc3cf-b86f-48aa-9f0a-1eb0a740c071 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:57.778367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-231dc3cf-b86f-48aa-9f0a-1eb0a740c071 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:57.778838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-231dc3cf-b86f-48aa-9f0a-1eb0a740c071 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:57.779272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-231dc3cf-b86f-48aa-9f0a-1eb0a740c071 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:57.779963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-231dc3cf-b86f-48aa-9f0a-1eb0a740c071 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:57.780412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-231dc3cf-b86f-48aa-9f0a-1eb0a740c071 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:57.780853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-231dc3cf-b86f-48aa-9f0a-1eb0a740c071 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:57.909492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-231dc3cf-b86f-48aa-9f0a-1eb0a740c071 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:57.917165 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-231dc3cf-b86f-48aa-9f0a-1eb0a740c071 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1389 microversion: 2.1 time: 0.150478 Oct 24 11:13:57.917899 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3329/6683] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:57 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:57.941505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-66978a43-9d5d-49e1-b256-211f81a00f3f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:57.942119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-66978a43-9d5d-49e1-b256-211f81a00f3f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:57.949136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66978a43-9d5d-49e1-b256-211f81a00f3f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:57.949614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66978a43-9d5d-49e1-b256-211f81a00f3f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:57.950045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66978a43-9d5d-49e1-b256-211f81a00f3f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:57.950740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66978a43-9d5d-49e1-b256-211f81a00f3f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:57.951190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66978a43-9d5d-49e1-b256-211f81a00f3f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:57.951614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66978a43-9d5d-49e1-b256-211f81a00f3f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:58.083610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-66978a43-9d5d-49e1-b256-211f81a00f3f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:58.091447 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-66978a43-9d5d-49e1-b256-211f81a00f3f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1389 microversion: 2.1 time: 0.154744 Oct 24 11:13:58.092027 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3355/6684] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:57 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:58.114071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3c8a8e48-23a3-4ee3-949e-cc259abab3f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:58.114689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3c8a8e48-23a3-4ee3-949e-cc259abab3f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:58.120988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c8a8e48-23a3-4ee3-949e-cc259abab3f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:58.121488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c8a8e48-23a3-4ee3-949e-cc259abab3f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:58.121938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c8a8e48-23a3-4ee3-949e-cc259abab3f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:58.122644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c8a8e48-23a3-4ee3-949e-cc259abab3f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:58.123106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c8a8e48-23a3-4ee3-949e-cc259abab3f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:58.123537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c8a8e48-23a3-4ee3-949e-cc259abab3f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:58.251117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c8a8e48-23a3-4ee3-949e-cc259abab3f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:58.258958 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3c8a8e48-23a3-4ee3-949e-cc259abab3f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1389 microversion: 2.1 time: 0.148774 Oct 24 11:13:58.259536 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3330/6685] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:58 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1389 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:58.281638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ea2d96cd-2335-4ee8-88eb-bdc714408bf4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:58.282147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ea2d96cd-2335-4ee8-88eb-bdc714408bf4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:58.288962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea2d96cd-2335-4ee8-88eb-bdc714408bf4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:58.289376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea2d96cd-2335-4ee8-88eb-bdc714408bf4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:58.289817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea2d96cd-2335-4ee8-88eb-bdc714408bf4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:58.290520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea2d96cd-2335-4ee8-88eb-bdc714408bf4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:58.290979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea2d96cd-2335-4ee8-88eb-bdc714408bf4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:58.291409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea2d96cd-2335-4ee8-88eb-bdc714408bf4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:58.316330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ea2d96cd-2335-4ee8-88eb-bdc714408bf4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:13:58.391409 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ea2d96cd-2335-4ee8-88eb-bdc714408bf4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 204 len: 0 microversion: 2.1 time: 0.112733 Oct 24 11:13:58.392062 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3356/6686] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:13:58 2022] DELETE /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:13:58.400741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e85a5863-553b-4306-b53e-a54a43d07a9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:58.401382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e85a5863-553b-4306-b53e-a54a43d07a9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:58.407706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e85a5863-553b-4306-b53e-a54a43d07a9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:58.408186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e85a5863-553b-4306-b53e-a54a43d07a9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:58.408620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e85a5863-553b-4306-b53e-a54a43d07a9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:58.409341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e85a5863-553b-4306-b53e-a54a43d07a9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:58.409790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e85a5863-553b-4306-b53e-a54a43d07a9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:58.410213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e85a5863-553b-4306-b53e-a54a43d07a9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:58.541122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e85a5863-553b-4306-b53e-a54a43d07a9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:58.549254 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e85a5863-553b-4306-b53e-a54a43d07a9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1395 microversion: 2.1 time: 0.152854 Oct 24 11:13:58.549823 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3331/6687] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:58 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1395 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:13:59.573265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f5e94d8a-6b7d-4410-ae5f-b20c743e6f14 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:13:59.573964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f5e94d8a-6b7d-4410-ae5f-b20c743e6f14 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:13:59.581663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f5e94d8a-6b7d-4410-ae5f-b20c743e6f14 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:59.582143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f5e94d8a-6b7d-4410-ae5f-b20c743e6f14 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:59.582578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f5e94d8a-6b7d-4410-ae5f-b20c743e6f14 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:59.583270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f5e94d8a-6b7d-4410-ae5f-b20c743e6f14 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:13:59.583751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f5e94d8a-6b7d-4410-ae5f-b20c743e6f14 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:13:59.584176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f5e94d8a-6b7d-4410-ae5f-b20c743e6f14 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:13:59.714328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f5e94d8a-6b7d-4410-ae5f-b20c743e6f14 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:13:59.722816 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f5e94d8a-6b7d-4410-ae5f-b20c743e6f14 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1395 microversion: 2.1 time: 0.153917 Oct 24 11:13:59.723385 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3357/6688] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:13:59 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1395 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:00.583741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-eeff8df0-58f1-4a1a-9521-2d9a443aef3c req-58a9a513-7a06-4ac5-aa1a-b381f0b53066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea63dd89-6e5d-4d81-859c-dee45b168e97", "name": "network-vif-deleted", "tag": "ec9bdf08-561f-4e89-8fe4-826a6e88518f"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:14:00.594802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eeff8df0-58f1-4a1a-9521-2d9a443aef3c req-58a9a513-7a06-4ac5-aa1a-b381f0b53066 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:00.595834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eeff8df0-58f1-4a1a-9521-2d9a443aef3c req-58a9a513-7a06-4ac5-aa1a-b381f0b53066 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:00.596418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eeff8df0-58f1-4a1a-9521-2d9a443aef3c req-58a9a513-7a06-4ac5-aa1a-b381f0b53066 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:00.612279 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-eeff8df0-58f1-4a1a-9521-2d9a443aef3c req-58a9a513-7a06-4ac5-aa1a-b381f0b53066 service nova] Creating event network-vif-deleted:ec9bdf08-561f-4e89-8fe4-826a6e88518f for instance ea63dd89-6e5d-4d81-859c-dee45b168e97 on n-h1-858383-15 Oct 24 11:14:00.618137 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-eeff8df0-58f1-4a1a-9521-2d9a443aef3c req-58a9a513-7a06-4ac5-aa1a-b381f0b53066 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038126 Oct 24 11:14:00.618600 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3332/6689] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:14:00.746141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1640f50a-e84b-4348-b438-0310773d2349 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:00.746766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1640f50a-e84b-4348-b438-0310773d2349 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:00.754612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1640f50a-e84b-4348-b438-0310773d2349 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:00.755104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1640f50a-e84b-4348-b438-0310773d2349 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:00.755546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1640f50a-e84b-4348-b438-0310773d2349 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:00.756248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1640f50a-e84b-4348-b438-0310773d2349 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:00.756705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1640f50a-e84b-4348-b438-0310773d2349 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:00.757172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1640f50a-e84b-4348-b438-0310773d2349 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:00.820469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1640f50a-e84b-4348-b438-0310773d2349 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:00.828453 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1640f50a-e84b-4348-b438-0310773d2349 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1187 microversion: 2.1 time: 0.086239 Oct 24 11:14:00.829158 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3358/6690] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:00 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:01.853073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ccf7157a-baf8-4bf0-9d44-76c751e1f774 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:01.853775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ccf7157a-baf8-4bf0-9d44-76c751e1f774 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:01.859971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccf7157a-baf8-4bf0-9d44-76c751e1f774 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:01.860453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccf7157a-baf8-4bf0-9d44-76c751e1f774 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:01.861469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccf7157a-baf8-4bf0-9d44-76c751e1f774 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:01.862206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccf7157a-baf8-4bf0-9d44-76c751e1f774 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:01.862660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccf7157a-baf8-4bf0-9d44-76c751e1f774 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:01.863089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccf7157a-baf8-4bf0-9d44-76c751e1f774 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:01.930384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ccf7157a-baf8-4bf0-9d44-76c751e1f774 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:01.938401 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ccf7157a-baf8-4bf0-9d44-76c751e1f774 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1187 microversion: 2.1 time: 0.090451 Oct 24 11:14:01.940158 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3333/6691] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:01 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:02.962174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-725cacb5-8414-46d9-9ecd-85936e139576 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:02.962840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-725cacb5-8414-46d9-9ecd-85936e139576 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:02.965817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:14:02.971602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-725cacb5-8414-46d9-9ecd-85936e139576 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:02.972186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-725cacb5-8414-46d9-9ecd-85936e139576 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:02.972631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-725cacb5-8414-46d9-9ecd-85936e139576 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:02.973369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-725cacb5-8414-46d9-9ecd-85936e139576 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:02.973831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-725cacb5-8414-46d9-9ecd-85936e139576 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:02.974258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-725cacb5-8414-46d9-9ecd-85936e139576 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:02.978084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:14:03.042667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-725cacb5-8414-46d9-9ecd-85936e139576 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:03.050763 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-725cacb5-8414-46d9-9ecd-85936e139576 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1187 microversion: 2.1 time: 0.092551 Oct 24 11:14:03.051344 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3359/6692] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:02 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:04.074246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5a905bba-caed-48d4-9d42-6f4a18df13ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:04.074789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5a905bba-caed-48d4-9d42-6f4a18df13ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:04.082279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a905bba-caed-48d4-9d42-6f4a18df13ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:04.082778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a905bba-caed-48d4-9d42-6f4a18df13ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:04.083223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a905bba-caed-48d4-9d42-6f4a18df13ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:04.083932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a905bba-caed-48d4-9d42-6f4a18df13ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:04.084396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a905bba-caed-48d4-9d42-6f4a18df13ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:04.084846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a905bba-caed-48d4-9d42-6f4a18df13ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:04.146916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5a905bba-caed-48d4-9d42-6f4a18df13ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:04.155125 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5a905bba-caed-48d4-9d42-6f4a18df13ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 200 len: 1187 microversion: 2.1 time: 0.085015 Oct 24 11:14:04.155714 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3334/6693] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:04 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:05.181993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b5693c0f-f000-4f83-998a-dc38bc39548b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:05.182607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b5693c0f-f000-4f83-998a-dc38bc39548b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: ea63dd89-6e5d-4d81-859c-dee45b168e97] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:05.191132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5693c0f-f000-4f83-998a-dc38bc39548b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:05.191698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5693c0f-f000-4f83-998a-dc38bc39548b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:05.192153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5693c0f-f000-4f83-998a-dc38bc39548b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:05.192908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5693c0f-f000-4f83-998a-dc38bc39548b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:05.193378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5693c0f-f000-4f83-998a-dc38bc39548b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:05.193813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b5693c0f-f000-4f83-998a-dc38bc39548b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:05.212688 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-b5693c0f-f000-4f83-998a-dc38bc39548b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] HTTP exception thrown: Instance ea63dd89-6e5d-4d81-859c-dee45b168e97 could not be found. Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b5693c0f-f000-4f83-998a-dc38bc39548b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Request method failure captured: Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 HTTP/1.1 Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnM2OqlSOkhfxDfVEeTT94IwX8qn5k49naomhNLud1uic_lKwej-RJQ1PZooBFuUMpS4DQEMNgRR3ENofPbDmyI7Cy_YSVUuCsvfRNdcFM4T5H_sDbiD3-ZTRmSQR0yoz-aOqM9u5ViLunGIsswJX3XnF9XyVytj9jbL6H3Gm1Ht-2Q Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7643b3a05e304f89a945f512536e2df6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ea036c351f864bd0bb927e15e897c9e3 Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance ea63dd89-6e5d-4d81-859c-dee45b168e97 could not be found. Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'ea63dd89-6e5d-4d81-859c-dee45b168e97'} Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea63dd89-6e5d-4d81-859c-dee45b168e97 could not be found. Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea63dd89-6e5d-4d81-859c-dee45b168e97 could not be found. Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:14:05.214436 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:14:05.218210 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:14:05.218210 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:14:05.218210 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:14:05.218210 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:14:05.218210 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:14:05.218210 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea63dd89-6e5d-4d81-859c-dee45b168e97 could not be found. Oct 24 11:14:05.218210 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:14:05.218210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b5693c0f-f000-4f83-998a-dc38bc39548b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Returning 404 to user: Instance ea63dd89-6e5d-4d81-859c-dee45b168e97 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:14:05.218210 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b5693c0f-f000-4f83-998a-dc38bc39548b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97" status: 404 len: 111 microversion: 2.1 time: 0.038090 Oct 24 11:14:05.218210 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3360/6694] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:05 2022] GET /compute/v2.1/servers/ea63dd89-6e5d-4d81-859c-dee45b168e97 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:14:26.200160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-468355a1-845b-4ba4-849e-bb4cc4856394 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1572108901", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "124591e2-493c-449b-954f-78cf09a4dda6", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "fd5ed2ae-44e8-4a94-8b2b-fd64f1a0661a"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:14:26.211793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:14:26.212610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=83 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:14:26.295314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-468355a1-845b-4ba4-849e-bb4cc4856394 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] validate_networks() for [('fd5ed2ae-44e8-4a94-8b2b-fd64f1a0661a', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:14:26.727180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-468355a1-845b-4ba4-849e-bb4cc4856394 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:14:26.727602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-468355a1-845b-4ba4-849e-bb4cc4856394 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:14:26.728072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-468355a1-845b-4ba4-849e-bb4cc4856394 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:14:26.728482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-468355a1-845b-4ba4-849e-bb4cc4856394 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:14:26.728911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-468355a1-845b-4ba4-849e-bb4cc4856394 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:14:26.740254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-468355a1-845b-4ba4-849e-bb4cc4856394 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:26.740734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-468355a1-845b-4ba4-849e-bb4cc4856394 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:26.741197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-468355a1-845b-4ba4-849e-bb4cc4856394 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:26.741971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-468355a1-845b-4ba4-849e-bb4cc4856394 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:26.742513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-468355a1-845b-4ba4-849e-bb4cc4856394 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:26.742940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-468355a1-845b-4ba4-849e-bb4cc4856394 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:26.761375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-468355a1-845b-4ba4-849e-bb4cc4856394 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Getting quotas for project 7643b3a05e304f89a945f512536e2df6. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:14:26.768409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-468355a1-845b-4ba4-849e-bb4cc4856394 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Getting quotas for user ea036c351f864bd0bb927e15e897c9e3 and project 7643b3a05e304f89a945f512536e2df6. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:14:26.784034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-468355a1-845b-4ba4-849e-bb4cc4856394 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:14:26.787449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-468355a1-845b-4ba4-849e-bb4cc4856394 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='124591e2-493c-449b-954f-78cf09a4dda6',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:14:26.876605 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-468355a1-845b-4ba4-849e-bb4cc4856394 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682537 Oct 24 11:14:26.877231 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3335/6695] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:14:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:14:26.888630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c5721012-160c-4b31-8cff-2d4193769df1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:26.889276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c5721012-160c-4b31-8cff-2d4193769df1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:26.891762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:14:26.892411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=7 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:14:26.963747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c5721012-160c-4b31-8cff-2d4193769df1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:26.972260 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c5721012-160c-4b31-8cff-2d4193769df1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1057 microversion: 2.1 time: 0.087572 Oct 24 11:14:26.973478 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3361/6696] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:26 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1057 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:28.002224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9aed6dc2-0491-4c47-bbec-b78b4c77fd9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:28.003670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9aed6dc2-0491-4c47-bbec-b78b4c77fd9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:28.013893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9aed6dc2-0491-4c47-bbec-b78b4c77fd9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:28.014390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9aed6dc2-0491-4c47-bbec-b78b4c77fd9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:28.014851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9aed6dc2-0491-4c47-bbec-b78b4c77fd9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:28.015558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9aed6dc2-0491-4c47-bbec-b78b4c77fd9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:28.016050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9aed6dc2-0491-4c47-bbec-b78b4c77fd9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:28.016899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9aed6dc2-0491-4c47-bbec-b78b4c77fd9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:28.088192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9aed6dc2-0491-4c47-bbec-b78b4c77fd9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:28.096857 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9aed6dc2-0491-4c47-bbec-b78b4c77fd9f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1127 microversion: 2.1 time: 0.100242 Oct 24 11:14:28.108872 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3336/6697] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:27 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1127 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:29.122325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-53dd650d-e120-4445-a599-78ad493e493d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:29.123816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-53dd650d-e120-4445-a599-78ad493e493d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:29.135402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53dd650d-e120-4445-a599-78ad493e493d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:29.136215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53dd650d-e120-4445-a599-78ad493e493d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:29.136662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53dd650d-e120-4445-a599-78ad493e493d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:29.137444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53dd650d-e120-4445-a599-78ad493e493d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:29.137907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53dd650d-e120-4445-a599-78ad493e493d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:29.138341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53dd650d-e120-4445-a599-78ad493e493d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:29.288428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-53dd650d-e120-4445-a599-78ad493e493d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:29.296667 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-53dd650d-e120-4445-a599-78ad493e493d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1169 microversion: 2.1 time: 0.178347 Oct 24 11:14:29.298837 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3362/6698] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:29 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1169 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:29.378265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-18536712-dad8-49af-b7bc-07ce0172eb61 req-75cc42ab-5edb-4ed7-9e4e-84766074fc52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d6f646a-8f13-4576-8f5a-09b3d4886e1d", "tag": "f8c14498-db24-4e8d-9f52-de1473df8ce5"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:14:29.390085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-18536712-dad8-49af-b7bc-07ce0172eb61 req-75cc42ab-5edb-4ed7-9e4e-84766074fc52 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:29.391676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-18536712-dad8-49af-b7bc-07ce0172eb61 req-75cc42ab-5edb-4ed7-9e4e-84766074fc52 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:29.392312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-18536712-dad8-49af-b7bc-07ce0172eb61 req-75cc42ab-5edb-4ed7-9e4e-84766074fc52 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:29.406068 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-18536712-dad8-49af-b7bc-07ce0172eb61 req-75cc42ab-5edb-4ed7-9e4e-84766074fc52 service nova] Creating event network-changed:f8c14498-db24-4e8d-9f52-de1473df8ce5 for instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d on n-h1-858383-15 Oct 24 11:14:29.412590 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-18536712-dad8-49af-b7bc-07ce0172eb61 req-75cc42ab-5edb-4ed7-9e4e-84766074fc52 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038170 Oct 24 11:14:29.413970 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3337/6699] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:14:30.320440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7c65e05f-d567-4096-a713-ff3b26f024d7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:30.321180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7c65e05f-d567-4096-a713-ff3b26f024d7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:30.328367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c65e05f-d567-4096-a713-ff3b26f024d7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:30.329327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c65e05f-d567-4096-a713-ff3b26f024d7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:30.329851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c65e05f-d567-4096-a713-ff3b26f024d7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:30.330636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c65e05f-d567-4096-a713-ff3b26f024d7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:30.331169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c65e05f-d567-4096-a713-ff3b26f024d7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:30.331732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c65e05f-d567-4096-a713-ff3b26f024d7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:30.478535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7c65e05f-d567-4096-a713-ff3b26f024d7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:30.487214 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7c65e05f-d567-4096-a713-ff3b26f024d7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1169 microversion: 2.1 time: 0.170731 Oct 24 11:14:30.487816 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3363/6700] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:30 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1169 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:31.513062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f3907e30-7f9c-42c7-a6f9-47c662fb92f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:31.513889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f3907e30-7f9c-42c7-a6f9-47c662fb92f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:31.521515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3907e30-7f9c-42c7-a6f9-47c662fb92f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:31.522132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3907e30-7f9c-42c7-a6f9-47c662fb92f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:31.522650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3907e30-7f9c-42c7-a6f9-47c662fb92f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:31.523375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3907e30-7f9c-42c7-a6f9-47c662fb92f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:31.523802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3907e30-7f9c-42c7-a6f9-47c662fb92f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:31.524230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3907e30-7f9c-42c7-a6f9-47c662fb92f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:31.707655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f3907e30-7f9c-42c7-a6f9-47c662fb92f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:31.716068 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f3907e30-7f9c-42c7-a6f9-47c662fb92f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1169 microversion: 2.1 time: 0.209017 Oct 24 11:14:31.716652 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3338/6701] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:31 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1169 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:32.741740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ba4159b6-22cf-4f42-9201-d043971dc6e6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:32.743858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ba4159b6-22cf-4f42-9201-d043971dc6e6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:32.751287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba4159b6-22cf-4f42-9201-d043971dc6e6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:32.751788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba4159b6-22cf-4f42-9201-d043971dc6e6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:32.752242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba4159b6-22cf-4f42-9201-d043971dc6e6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:32.753262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba4159b6-22cf-4f42-9201-d043971dc6e6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:32.753821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba4159b6-22cf-4f42-9201-d043971dc6e6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:32.754580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba4159b6-22cf-4f42-9201-d043971dc6e6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:32.925887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ba4159b6-22cf-4f42-9201-d043971dc6e6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:32.939987 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ba4159b6-22cf-4f42-9201-d043971dc6e6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1169 microversion: 2.1 time: 0.202379 Oct 24 11:14:32.951254 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3364/6702] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:32 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1169 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:33.973220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-41a099ac-b5f7-4f50-8612-4d46808361c9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:33.973968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-41a099ac-b5f7-4f50-8612-4d46808361c9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:33.981764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41a099ac-b5f7-4f50-8612-4d46808361c9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:33.982255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41a099ac-b5f7-4f50-8612-4d46808361c9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:33.982682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41a099ac-b5f7-4f50-8612-4d46808361c9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:33.983481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41a099ac-b5f7-4f50-8612-4d46808361c9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:33.984111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41a099ac-b5f7-4f50-8612-4d46808361c9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:33.984909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-41a099ac-b5f7-4f50-8612-4d46808361c9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:34.160974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-41a099ac-b5f7-4f50-8612-4d46808361c9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:34.170828 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-41a099ac-b5f7-4f50-8612-4d46808361c9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1169 microversion: 2.1 time: 0.202876 Oct 24 11:14:34.171424 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3339/6703] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:33 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1169 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:35.196362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8b852d8d-e9e5-454a-9cd2-967e930b9cac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:35.197275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8b852d8d-e9e5-454a-9cd2-967e930b9cac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:35.204736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b852d8d-e9e5-454a-9cd2-967e930b9cac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:35.205785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b852d8d-e9e5-454a-9cd2-967e930b9cac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:35.205785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b852d8d-e9e5-454a-9cd2-967e930b9cac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:35.206328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b852d8d-e9e5-454a-9cd2-967e930b9cac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:35.206944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b852d8d-e9e5-454a-9cd2-967e930b9cac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:35.207961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b852d8d-e9e5-454a-9cd2-967e930b9cac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:35.343395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8b852d8d-e9e5-454a-9cd2-967e930b9cac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:35.351978 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8b852d8d-e9e5-454a-9cd2-967e930b9cac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1169 microversion: 2.1 time: 0.159525 Oct 24 11:14:35.352975 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3365/6704] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:35 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1169 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:36.375731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-742151e0-f54f-4543-b054-39dd3ae36779 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:36.376342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-742151e0-f54f-4543-b054-39dd3ae36779 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:36.383186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-742151e0-f54f-4543-b054-39dd3ae36779 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:36.383667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-742151e0-f54f-4543-b054-39dd3ae36779 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:36.384099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-742151e0-f54f-4543-b054-39dd3ae36779 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:36.384898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-742151e0-f54f-4543-b054-39dd3ae36779 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:36.385349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-742151e0-f54f-4543-b054-39dd3ae36779 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:36.385773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-742151e0-f54f-4543-b054-39dd3ae36779 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:36.513949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-742151e0-f54f-4543-b054-39dd3ae36779 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:36.522301 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-742151e0-f54f-4543-b054-39dd3ae36779 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1169 microversion: 2.1 time: 0.150567 Oct 24 11:14:36.522870 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3340/6705] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:36 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1169 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:37.545564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-847a5bda-d210-49fe-b74d-e992b3fba3df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:37.546105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-847a5bda-d210-49fe-b74d-e992b3fba3df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:37.549509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:14:37.555009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-847a5bda-d210-49fe-b74d-e992b3fba3df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:37.555491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-847a5bda-d210-49fe-b74d-e992b3fba3df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:37.555930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-847a5bda-d210-49fe-b74d-e992b3fba3df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:37.556647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-847a5bda-d210-49fe-b74d-e992b3fba3df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:37.557130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-847a5bda-d210-49fe-b74d-e992b3fba3df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:37.557566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-847a5bda-d210-49fe-b74d-e992b3fba3df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:37.698723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-847a5bda-d210-49fe-b74d-e992b3fba3df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:37.707756 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-847a5bda-d210-49fe-b74d-e992b3fba3df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1169 microversion: 2.1 time: 0.165911 Oct 24 11:14:37.708730 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3366/6706] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:37 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1169 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:14:38.730573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7b118ac2-6e4f-4f7d-a90b-e01624896a83 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:38.731200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7b118ac2-6e4f-4f7d-a90b-e01624896a83 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:38.733168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:14:38.733819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:14:38.741633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b118ac2-6e4f-4f7d-a90b-e01624896a83 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:38.742118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b118ac2-6e4f-4f7d-a90b-e01624896a83 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:38.742554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b118ac2-6e4f-4f7d-a90b-e01624896a83 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:38.743284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b118ac2-6e4f-4f7d-a90b-e01624896a83 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:38.743736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b118ac2-6e4f-4f7d-a90b-e01624896a83 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:38.744162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b118ac2-6e4f-4f7d-a90b-e01624896a83 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:38.881527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7b118ac2-6e4f-4f7d-a90b-e01624896a83 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:38.889444 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7b118ac2-6e4f-4f7d-a90b-e01624896a83 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1169 microversion: 2.1 time: 0.162920 Oct 24 11:14:38.890026 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3341/6707] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:38 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1169 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:39.913663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d6e84761-64dc-4b43-8567-df333219c6df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:39.914289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d6e84761-64dc-4b43-8567-df333219c6df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:39.923068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6e84761-64dc-4b43-8567-df333219c6df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:39.923731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6e84761-64dc-4b43-8567-df333219c6df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:39.924185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6e84761-64dc-4b43-8567-df333219c6df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:39.925000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6e84761-64dc-4b43-8567-df333219c6df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:39.925492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6e84761-64dc-4b43-8567-df333219c6df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:39.925963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6e84761-64dc-4b43-8567-df333219c6df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:40.069443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d6e84761-64dc-4b43-8567-df333219c6df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:40.078941 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d6e84761-64dc-4b43-8567-df333219c6df tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1169 microversion: 2.1 time: 0.169199 Oct 24 11:14:40.079560 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3367/6708] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:39 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1169 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:41.101774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5d2d5804-7a83-44ee-b938-d45b78e65ccc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:41.102273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5d2d5804-7a83-44ee-b938-d45b78e65ccc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:41.109276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d2d5804-7a83-44ee-b938-d45b78e65ccc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:41.109767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d2d5804-7a83-44ee-b938-d45b78e65ccc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:41.110248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d2d5804-7a83-44ee-b938-d45b78e65ccc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:41.110995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d2d5804-7a83-44ee-b938-d45b78e65ccc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:41.111456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d2d5804-7a83-44ee-b938-d45b78e65ccc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:41.111923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d2d5804-7a83-44ee-b938-d45b78e65ccc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:41.243578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5d2d5804-7a83-44ee-b938-d45b78e65ccc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:41.252120 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5d2d5804-7a83-44ee-b938-d45b78e65ccc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1169 microversion: 2.1 time: 0.154231 Oct 24 11:14:41.252704 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3342/6709] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:41 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1169 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:42.276368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cde05732-be50-4d9e-acde-908c1e3bd71b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:42.277020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cde05732-be50-4d9e-acde-908c1e3bd71b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:42.285324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cde05732-be50-4d9e-acde-908c1e3bd71b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:42.285822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cde05732-be50-4d9e-acde-908c1e3bd71b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:42.286259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cde05732-be50-4d9e-acde-908c1e3bd71b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:42.286974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cde05732-be50-4d9e-acde-908c1e3bd71b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:42.287427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cde05732-be50-4d9e-acde-908c1e3bd71b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:42.287871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cde05732-be50-4d9e-acde-908c1e3bd71b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:42.427794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cde05732-be50-4d9e-acde-908c1e3bd71b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:42.436822 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cde05732-be50-4d9e-acde-908c1e3bd71b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1169 microversion: 2.1 time: 0.164907 Oct 24 11:14:42.437429 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3368/6710] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:42 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1169 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:43.460920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5f14023b-1e63-45e3-80ee-285eb8be9383 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:43.461561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5f14023b-1e63-45e3-80ee-285eb8be9383 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:43.468554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f14023b-1e63-45e3-80ee-285eb8be9383 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:43.469132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f14023b-1e63-45e3-80ee-285eb8be9383 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:43.470220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f14023b-1e63-45e3-80ee-285eb8be9383 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:43.471084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f14023b-1e63-45e3-80ee-285eb8be9383 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:43.471539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f14023b-1e63-45e3-80ee-285eb8be9383 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:43.471963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5f14023b-1e63-45e3-80ee-285eb8be9383 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:43.600860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5f14023b-1e63-45e3-80ee-285eb8be9383 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:43.608491 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5f14023b-1e63-45e3-80ee-285eb8be9383 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1203 microversion: 2.1 time: 0.151509 Oct 24 11:14:43.609086 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3343/6711] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:43 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:44.632900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4c7c2126-428b-4c75-a153-6fead0b1900a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:44.633512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4c7c2126-428b-4c75-a153-6fead0b1900a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:44.639660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c7c2126-428b-4c75-a153-6fead0b1900a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:44.640134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c7c2126-428b-4c75-a153-6fead0b1900a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:44.640565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c7c2126-428b-4c75-a153-6fead0b1900a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:44.641817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c7c2126-428b-4c75-a153-6fead0b1900a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:44.642317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c7c2126-428b-4c75-a153-6fead0b1900a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:44.642757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4c7c2126-428b-4c75-a153-6fead0b1900a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:44.771459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4c7c2126-428b-4c75-a153-6fead0b1900a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:44.781081 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4c7c2126-428b-4c75-a153-6fead0b1900a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1203 microversion: 2.1 time: 0.152235 Oct 24 11:14:44.781668 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3369/6712] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:44 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:45.804541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09da8bfa-1c47-4962-b40c-06ce22846185 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:45.805199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09da8bfa-1c47-4962-b40c-06ce22846185 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:45.811710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09da8bfa-1c47-4962-b40c-06ce22846185 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:45.812197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09da8bfa-1c47-4962-b40c-06ce22846185 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:45.812642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09da8bfa-1c47-4962-b40c-06ce22846185 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:45.813372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09da8bfa-1c47-4962-b40c-06ce22846185 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:45.813827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09da8bfa-1c47-4962-b40c-06ce22846185 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:45.814258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09da8bfa-1c47-4962-b40c-06ce22846185 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:45.948366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-09da8bfa-1c47-4962-b40c-06ce22846185 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:45.956730 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-09da8bfa-1c47-4962-b40c-06ce22846185 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1203 microversion: 2.1 time: 0.156331 Oct 24 11:14:45.957340 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3344/6713] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:45 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:46.980229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8258100d-cbc1-4dcd-8f22-2da1db331c32 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:46.980856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8258100d-cbc1-4dcd-8f22-2da1db331c32 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:46.988703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8258100d-cbc1-4dcd-8f22-2da1db331c32 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:46.989215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8258100d-cbc1-4dcd-8f22-2da1db331c32 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:46.989654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8258100d-cbc1-4dcd-8f22-2da1db331c32 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:46.990353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8258100d-cbc1-4dcd-8f22-2da1db331c32 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:46.990814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8258100d-cbc1-4dcd-8f22-2da1db331c32 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:46.991242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8258100d-cbc1-4dcd-8f22-2da1db331c32 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:47.121238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8258100d-cbc1-4dcd-8f22-2da1db331c32 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:47.129398 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8258100d-cbc1-4dcd-8f22-2da1db331c32 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1203 microversion: 2.1 time: 0.153048 Oct 24 11:14:47.129986 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3370/6714] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:46 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:48.151885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-47f3f4a2-2321-487b-9b9a-6f7d8e577e51 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:48.152535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-47f3f4a2-2321-487b-9b9a-6f7d8e577e51 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:48.160221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47f3f4a2-2321-487b-9b9a-6f7d8e577e51 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:48.160709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47f3f4a2-2321-487b-9b9a-6f7d8e577e51 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:48.161183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47f3f4a2-2321-487b-9b9a-6f7d8e577e51 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:48.161884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47f3f4a2-2321-487b-9b9a-6f7d8e577e51 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:48.162341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47f3f4a2-2321-487b-9b9a-6f7d8e577e51 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:48.162767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47f3f4a2-2321-487b-9b9a-6f7d8e577e51 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:48.302765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-47f3f4a2-2321-487b-9b9a-6f7d8e577e51 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:48.310771 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-47f3f4a2-2321-487b-9b9a-6f7d8e577e51 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1203 microversion: 2.1 time: 0.163142 Oct 24 11:14:48.311347 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3345/6715] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:48 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:49.334862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-be674cad-1482-4444-9995-f26f01f3b222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:49.335505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-be674cad-1482-4444-9995-f26f01f3b222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:49.342522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be674cad-1482-4444-9995-f26f01f3b222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:49.343004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be674cad-1482-4444-9995-f26f01f3b222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:49.343436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be674cad-1482-4444-9995-f26f01f3b222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:49.344641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be674cad-1482-4444-9995-f26f01f3b222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:49.345120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be674cad-1482-4444-9995-f26f01f3b222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:49.345548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be674cad-1482-4444-9995-f26f01f3b222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:49.475068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-be674cad-1482-4444-9995-f26f01f3b222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:49.482969 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-be674cad-1482-4444-9995-f26f01f3b222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1203 microversion: 2.1 time: 0.152034 Oct 24 11:14:49.483575 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3371/6716] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:49 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:50.506787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e240cbe6-56e9-4146-ad50-68bfd5f296f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:50.507406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e240cbe6-56e9-4146-ad50-68bfd5f296f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:50.514426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e240cbe6-56e9-4146-ad50-68bfd5f296f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:50.514914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e240cbe6-56e9-4146-ad50-68bfd5f296f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:50.515366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e240cbe6-56e9-4146-ad50-68bfd5f296f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:50.516179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e240cbe6-56e9-4146-ad50-68bfd5f296f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:50.516729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e240cbe6-56e9-4146-ad50-68bfd5f296f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:50.517193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e240cbe6-56e9-4146-ad50-68bfd5f296f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:50.646177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e240cbe6-56e9-4146-ad50-68bfd5f296f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:50.654177 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e240cbe6-56e9-4146-ad50-68bfd5f296f8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1203 microversion: 2.1 time: 0.151459 Oct 24 11:14:50.654754 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3346/6717] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:50 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:51.677788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-07e7396f-b8a8-44cb-b047-fa035111d5f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:51.678472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-07e7396f-b8a8-44cb-b047-fa035111d5f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:51.685522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07e7396f-b8a8-44cb-b047-fa035111d5f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:51.686011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07e7396f-b8a8-44cb-b047-fa035111d5f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:51.686451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07e7396f-b8a8-44cb-b047-fa035111d5f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:51.687149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07e7396f-b8a8-44cb-b047-fa035111d5f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:51.687613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07e7396f-b8a8-44cb-b047-fa035111d5f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:51.688596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-07e7396f-b8a8-44cb-b047-fa035111d5f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:51.821160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-07e7396f-b8a8-44cb-b047-fa035111d5f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:51.829198 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-07e7396f-b8a8-44cb-b047-fa035111d5f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1203 microversion: 2.1 time: 0.155362 Oct 24 11:14:51.830000 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3372/6718] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:51 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:52.851656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6e0db208-d07c-4252-ba58-3d9adddf4b6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:52.852268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6e0db208-d07c-4252-ba58-3d9adddf4b6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:52.859191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e0db208-d07c-4252-ba58-3d9adddf4b6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:52.859709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e0db208-d07c-4252-ba58-3d9adddf4b6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:52.860142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e0db208-d07c-4252-ba58-3d9adddf4b6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:52.860863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e0db208-d07c-4252-ba58-3d9adddf4b6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:52.861324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e0db208-d07c-4252-ba58-3d9adddf4b6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:52.861754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e0db208-d07c-4252-ba58-3d9adddf4b6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:52.994442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6e0db208-d07c-4252-ba58-3d9adddf4b6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:53.002446 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6e0db208-d07c-4252-ba58-3d9adddf4b6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1203 microversion: 2.1 time: 0.154701 Oct 24 11:14:53.003022 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3347/6719] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:52 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:53.596908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-c1079abc-5619-4b0a-a94c-4ffdc900a15c req-87ac43ae-e3f2-495a-a2fe-cb6ca526d95e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6f646a-8f13-4576-8f5a-09b3d4886e1d", "name": "network-vif-plugged", "status": "completed", "tag": "f8c14498-db24-4e8d-9f52-de1473df8ce5"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:14:53.607315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c1079abc-5619-4b0a-a94c-4ffdc900a15c req-87ac43ae-e3f2-495a-a2fe-cb6ca526d95e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:53.607790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c1079abc-5619-4b0a-a94c-4ffdc900a15c req-87ac43ae-e3f2-495a-a2fe-cb6ca526d95e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:53.608390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c1079abc-5619-4b0a-a94c-4ffdc900a15c req-87ac43ae-e3f2-495a-a2fe-cb6ca526d95e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:53.619971 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-c1079abc-5619-4b0a-a94c-4ffdc900a15c req-87ac43ae-e3f2-495a-a2fe-cb6ca526d95e service nova] Creating event network-vif-plugged:f8c14498-db24-4e8d-9f52-de1473df8ce5 for instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d on n-h1-858383-15 Oct 24 11:14:53.626054 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-c1079abc-5619-4b0a-a94c-4ffdc900a15c req-87ac43ae-e3f2-495a-a2fe-cb6ca526d95e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033166 Oct 24 11:14:53.626762 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3373/6720] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:14:54.025296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-33f4b33e-74cb-4097-b6b3-8af1a735ac19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:54.026068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-33f4b33e-74cb-4097-b6b3-8af1a735ac19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:54.032913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33f4b33e-74cb-4097-b6b3-8af1a735ac19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:54.033404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33f4b33e-74cb-4097-b6b3-8af1a735ac19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:54.033842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33f4b33e-74cb-4097-b6b3-8af1a735ac19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:54.034541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33f4b33e-74cb-4097-b6b3-8af1a735ac19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:54.034999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33f4b33e-74cb-4097-b6b3-8af1a735ac19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:54.035426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-33f4b33e-74cb-4097-b6b3-8af1a735ac19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:54.170779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-33f4b33e-74cb-4097-b6b3-8af1a735ac19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:54.179235 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-33f4b33e-74cb-4097-b6b3-8af1a735ac19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1203 microversion: 2.1 time: 0.158000 Oct 24 11:14:54.179810 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3348/6721] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:54 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:55.204162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8c1a3dff-e79e-44f4-a638-ca994ee43b0a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:55.205564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8c1a3dff-e79e-44f4-a638-ca994ee43b0a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:55.211931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c1a3dff-e79e-44f4-a638-ca994ee43b0a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:55.212423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c1a3dff-e79e-44f4-a638-ca994ee43b0a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:55.212874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c1a3dff-e79e-44f4-a638-ca994ee43b0a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:55.213576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c1a3dff-e79e-44f4-a638-ca994ee43b0a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:55.214041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c1a3dff-e79e-44f4-a638-ca994ee43b0a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:55.214469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c1a3dff-e79e-44f4-a638-ca994ee43b0a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:55.351757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8c1a3dff-e79e-44f4-a638-ca994ee43b0a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:55.359506 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8c1a3dff-e79e-44f4-a638-ca994ee43b0a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1203 microversion: 2.1 time: 0.160589 Oct 24 11:14:55.360096 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3374/6722] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:55 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:56.383139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bc8f17be-5b35-498e-b4b8-6718e7fb1427 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:56.383663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bc8f17be-5b35-498e-b4b8-6718e7fb1427 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:56.386380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:14:56.391723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc8f17be-5b35-498e-b4b8-6718e7fb1427 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:56.392804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc8f17be-5b35-498e-b4b8-6718e7fb1427 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:56.393499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc8f17be-5b35-498e-b4b8-6718e7fb1427 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:56.394204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc8f17be-5b35-498e-b4b8-6718e7fb1427 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:56.394665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc8f17be-5b35-498e-b4b8-6718e7fb1427 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:56.395097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bc8f17be-5b35-498e-b4b8-6718e7fb1427 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:56.398535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=77 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:14:56.530869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bc8f17be-5b35-498e-b4b8-6718e7fb1427 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:56.539272 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bc8f17be-5b35-498e-b4b8-6718e7fb1427 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1390 microversion: 2.1 time: 0.160185 Oct 24 11:14:56.539840 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3349/6723] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:56 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:56.561386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8c561195-5269-4e0e-b36c-a6420f757e89 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:56.562011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8c561195-5269-4e0e-b36c-a6420f757e89 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:56.569128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c561195-5269-4e0e-b36c-a6420f757e89 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:56.569619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c561195-5269-4e0e-b36c-a6420f757e89 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:56.570062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c561195-5269-4e0e-b36c-a6420f757e89 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:56.570756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c561195-5269-4e0e-b36c-a6420f757e89 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:56.571213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c561195-5269-4e0e-b36c-a6420f757e89 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:56.571643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c561195-5269-4e0e-b36c-a6420f757e89 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:56.960744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8c561195-5269-4e0e-b36c-a6420f757e89 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:56.963338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=79 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:14:56.971227 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8c561195-5269-4e0e-b36c-a6420f757e89 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1390 microversion: 2.1 time: 0.413673 Oct 24 11:14:56.971819 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3375/6724] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:56 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1390 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:14:56.993460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf9fa831-e1c1-4371-92db-63a08a7633fe tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:56.994080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bf9fa831-e1c1-4371-92db-63a08a7633fe tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:57.000100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf9fa831-e1c1-4371-92db-63a08a7633fe tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:57.000585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf9fa831-e1c1-4371-92db-63a08a7633fe tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:57.001059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf9fa831-e1c1-4371-92db-63a08a7633fe tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:57.001796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf9fa831-e1c1-4371-92db-63a08a7633fe tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:57.002248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf9fa831-e1c1-4371-92db-63a08a7633fe tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:57.002673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bf9fa831-e1c1-4371-92db-63a08a7633fe tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:57.131969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bf9fa831-e1c1-4371-92db-63a08a7633fe tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:57.139847 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bf9fa831-e1c1-4371-92db-63a08a7633fe tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1390 microversion: 2.1 time: 0.150334 Oct 24 11:14:57.140423 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3350/6725] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:56 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:57.220685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-127df834-84f1-4b5a-b0fc-5e5f79543d3e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:57.221231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-127df834-84f1-4b5a-b0fc-5e5f79543d3e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:57.223281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=33 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:14:57.228673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-127df834-84f1-4b5a-b0fc-5e5f79543d3e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:57.229213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-127df834-84f1-4b5a-b0fc-5e5f79543d3e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:57.229655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-127df834-84f1-4b5a-b0fc-5e5f79543d3e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:57.230358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-127df834-84f1-4b5a-b0fc-5e5f79543d3e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:57.230819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-127df834-84f1-4b5a-b0fc-5e5f79543d3e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:57.231252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-127df834-84f1-4b5a-b0fc-5e5f79543d3e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:57.256223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-127df834-84f1-4b5a-b0fc-5e5f79543d3e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:14:57.331790 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-127df834-84f1-4b5a-b0fc-5e5f79543d3e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 204 len: 0 microversion: 2.1 time: 0.115241 Oct 24 11:14:57.332395 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3376/6726] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:14:57 2022] DELETE /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:14:57.340900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6dfe5f85-e289-40e4-ac7f-853305394317 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:57.341513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6dfe5f85-e289-40e4-ac7f-853305394317 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:57.348240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6dfe5f85-e289-40e4-ac7f-853305394317 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:57.348724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6dfe5f85-e289-40e4-ac7f-853305394317 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:57.349186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6dfe5f85-e289-40e4-ac7f-853305394317 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:57.349873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6dfe5f85-e289-40e4-ac7f-853305394317 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:57.350326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6dfe5f85-e289-40e4-ac7f-853305394317 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:57.350747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6dfe5f85-e289-40e4-ac7f-853305394317 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:57.484889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6dfe5f85-e289-40e4-ac7f-853305394317 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:57.492720 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6dfe5f85-e289-40e4-ac7f-853305394317 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1396 microversion: 2.1 time: 0.155760 Oct 24 11:14:57.493326 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3351/6727] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:57 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1396 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:58.519041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e19f3826-f1ba-4a38-9294-9dfe00565587 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:58.519749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e19f3826-f1ba-4a38-9294-9dfe00565587 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:58.526794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e19f3826-f1ba-4a38-9294-9dfe00565587 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:58.527273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e19f3826-f1ba-4a38-9294-9dfe00565587 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:58.527709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e19f3826-f1ba-4a38-9294-9dfe00565587 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:58.528396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e19f3826-f1ba-4a38-9294-9dfe00565587 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:58.528866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e19f3826-f1ba-4a38-9294-9dfe00565587 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:58.529310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e19f3826-f1ba-4a38-9294-9dfe00565587 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:58.666378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e19f3826-f1ba-4a38-9294-9dfe00565587 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:58.674226 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e19f3826-f1ba-4a38-9294-9dfe00565587 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1396 microversion: 2.1 time: 0.160290 Oct 24 11:14:58.674805 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3377/6728] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:58 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1396 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:14:59.527377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-28625e36-072d-4615-88ac-71e79ab21ae3 req-5f28adee-2486-4c78-8f5a-425747fb042c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6f646a-8f13-4576-8f5a-09b3d4886e1d", "name": "network-vif-deleted", "tag": "f8c14498-db24-4e8d-9f52-de1473df8ce5"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:14:59.553969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-28625e36-072d-4615-88ac-71e79ab21ae3 req-5f28adee-2486-4c78-8f5a-425747fb042c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:59.554931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-28625e36-072d-4615-88ac-71e79ab21ae3 req-5f28adee-2486-4c78-8f5a-425747fb042c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:59.555557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-28625e36-072d-4615-88ac-71e79ab21ae3 req-5f28adee-2486-4c78-8f5a-425747fb042c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:59.570535 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-28625e36-072d-4615-88ac-71e79ab21ae3 req-5f28adee-2486-4c78-8f5a-425747fb042c service nova] Creating event network-vif-deleted:f8c14498-db24-4e8d-9f52-de1473df8ce5 for instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d on n-h1-858383-15 Oct 24 11:14:59.578047 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-28625e36-072d-4615-88ac-71e79ab21ae3 req-5f28adee-2486-4c78-8f5a-425747fb042c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054387 Oct 24 11:14:59.578658 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3352/6729] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:14:59.696813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8ba371bd-dfd0-44df-b6e6-66c440db3433 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:14:59.697649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8ba371bd-dfd0-44df-b6e6-66c440db3433 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:14:59.705263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ba371bd-dfd0-44df-b6e6-66c440db3433 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:59.705759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ba371bd-dfd0-44df-b6e6-66c440db3433 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:59.706194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ba371bd-dfd0-44df-b6e6-66c440db3433 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:59.706892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ba371bd-dfd0-44df-b6e6-66c440db3433 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:14:59.707345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ba371bd-dfd0-44df-b6e6-66c440db3433 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:14:59.707774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ba371bd-dfd0-44df-b6e6-66c440db3433 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:14:59.774666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8ba371bd-dfd0-44df-b6e6-66c440db3433 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:14:59.783767 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8ba371bd-dfd0-44df-b6e6-66c440db3433 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1188 microversion: 2.1 time: 0.090882 Oct 24 11:14:59.784343 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3378/6730] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:14:59 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:00.807027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a840326d-3573-4015-97c8-867a0ebb11c5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:00.807670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a840326d-3573-4015-97c8-867a0ebb11c5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:00.815630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a840326d-3573-4015-97c8-867a0ebb11c5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:00.816116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a840326d-3573-4015-97c8-867a0ebb11c5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:00.816563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a840326d-3573-4015-97c8-867a0ebb11c5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:00.817297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a840326d-3573-4015-97c8-867a0ebb11c5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:00.817762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a840326d-3573-4015-97c8-867a0ebb11c5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:00.818194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a840326d-3573-4015-97c8-867a0ebb11c5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:00.883645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a840326d-3573-4015-97c8-867a0ebb11c5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:00.891697 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a840326d-3573-4015-97c8-867a0ebb11c5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1188 microversion: 2.1 time: 0.089033 Oct 24 11:15:00.892288 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3353/6731] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:00 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:01.914792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-22f9c92d-6887-4559-b830-aab2b0668d2e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:01.915468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-22f9c92d-6887-4559-b830-aab2b0668d2e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:01.925176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22f9c92d-6887-4559-b830-aab2b0668d2e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:01.925670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22f9c92d-6887-4559-b830-aab2b0668d2e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:01.926291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22f9c92d-6887-4559-b830-aab2b0668d2e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:01.927023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22f9c92d-6887-4559-b830-aab2b0668d2e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:01.927660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22f9c92d-6887-4559-b830-aab2b0668d2e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:01.928100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22f9c92d-6887-4559-b830-aab2b0668d2e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:01.993733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-22f9c92d-6887-4559-b830-aab2b0668d2e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:02.002284 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-22f9c92d-6887-4559-b830-aab2b0668d2e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1188 microversion: 2.1 time: 0.091148 Oct 24 11:15:02.003844 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3379/6732] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:01 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:15:03.026145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5d5097de-441f-43d4-a561-a433c5c7c989 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:03.027191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5d5097de-441f-43d4-a561-a433c5c7c989 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:03.034369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d5097de-441f-43d4-a561-a433c5c7c989 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:03.034803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d5097de-441f-43d4-a561-a433c5c7c989 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:03.035238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d5097de-441f-43d4-a561-a433c5c7c989 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:03.035932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d5097de-441f-43d4-a561-a433c5c7c989 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:03.036510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d5097de-441f-43d4-a561-a433c5c7c989 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:03.036985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d5097de-441f-43d4-a561-a433c5c7c989 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:03.099821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5d5097de-441f-43d4-a561-a433c5c7c989 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:03.107700 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5d5097de-441f-43d4-a561-a433c5c7c989 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1188 microversion: 2.1 time: 0.085813 Oct 24 11:15:03.108280 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3354/6733] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:03 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:04.135792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-418f7d02-384e-4f98-b6c1-0807340e3929 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:04.136486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-418f7d02-384e-4f98-b6c1-0807340e3929 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:04.144677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-418f7d02-384e-4f98-b6c1-0807340e3929 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:04.145221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-418f7d02-384e-4f98-b6c1-0807340e3929 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:04.145688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-418f7d02-384e-4f98-b6c1-0807340e3929 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:04.146347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-418f7d02-384e-4f98-b6c1-0807340e3929 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:04.146813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-418f7d02-384e-4f98-b6c1-0807340e3929 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:04.147257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-418f7d02-384e-4f98-b6c1-0807340e3929 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:04.184486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-418f7d02-384e-4f98-b6c1-0807340e3929 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:04.185107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-418f7d02-384e-4f98-b6c1-0807340e3929 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:04.185434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-418f7d02-384e-4f98-b6c1-0807340e3929 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:04.185883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-418f7d02-384e-4f98-b6c1-0807340e3929 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lazy-loading 'fault' on Instance uuid 8d6f646a-8f13-4576-8f5a-09b3d4886e1d {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:15:04.231417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-418f7d02-384e-4f98-b6c1-0807340e3929 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:04.239772 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-418f7d02-384e-4f98-b6c1-0807340e3929 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 200 len: 1147 microversion: 2.1 time: 0.111163 Oct 24 11:15:04.240365 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3380/6734] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:04 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 1147 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:05.263814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a5055572-982c-435b-9d8d-3db780ae7222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:05.264584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a5055572-982c-435b-9d8d-3db780ae7222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:05.272706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5055572-982c-435b-9d8d-3db780ae7222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:05.273342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5055572-982c-435b-9d8d-3db780ae7222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:05.273859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5055572-982c-435b-9d8d-3db780ae7222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:05.274634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5055572-982c-435b-9d8d-3db780ae7222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:05.275415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5055572-982c-435b-9d8d-3db780ae7222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:05.276035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a5055572-982c-435b-9d8d-3db780ae7222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:05.291057 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-a5055572-982c-435b-9d8d-3db780ae7222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] HTTP exception thrown: Instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d could not be found. Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a5055572-982c-435b-9d8d-3db780ae7222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Request method failure captured: Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d HTTP/1.1 Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnM2OqlSOkhfxDfVEeTT94IwX8qn5k49naomhNLud1uic_lKwej-RJQ1PZooBFuUMpS4DQEMNgRR3ENofPbDmyI7Cy_YSVUuCsvfRNdcFM4T5H_sDbiD3-ZTRmSQR0yoz-aOqM9u5ViLunGIsswJX3XnF9XyVytj9jbL6H3Gm1Ht-2Q Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7643b3a05e304f89a945f512536e2df6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ea036c351f864bd0bb927e15e897c9e3 Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d could not be found. Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '8d6f646a-8f13-4576-8f5a-09b3d4886e1d'} Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d could not be found. Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d could not be found. Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:15:05.292740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:15:05.296368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:15:05.296368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:15:05.296368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:15:05.296368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:15:05.296368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:15:05.296368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d could not be found. Oct 24 11:15:05.296368 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:15:05.296368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a5055572-982c-435b-9d8d-3db780ae7222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Returning 404 to user: Instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:15:05.296368 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a5055572-982c-435b-9d8d-3db780ae7222 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 404 len: 111 microversion: 2.1 time: 0.034620 Oct 24 11:15:05.301720 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3355/6735] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:05 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:15:06.386728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-441f3fd8-1475-4d6c-a24c-c6c346984fc3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:06.387241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-441f3fd8-1475-4d6c-a24c-c6c346984fc3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:06.394563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-441f3fd8-1475-4d6c-a24c-c6c346984fc3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:06.395064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-441f3fd8-1475-4d6c-a24c-c6c346984fc3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:06.395529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-441f3fd8-1475-4d6c-a24c-c6c346984fc3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:06.396231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-441f3fd8-1475-4d6c-a24c-c6c346984fc3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:06.396743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-441f3fd8-1475-4d6c-a24c-c6c346984fc3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:06.397207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-441f3fd8-1475-4d6c-a24c-c6c346984fc3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:06.412369 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-441f3fd8-1475-4d6c-a24c-c6c346984fc3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] HTTP exception thrown: Instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d could not be found. Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-441f3fd8-1475-4d6c-a24c-c6c346984fc3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Request method failure captured: Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d HTTP/1.1 Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnM2OqlSOkhfxDfVEeTT94IwX8qn5k49naomhNLud1uic_lKwej-RJQ1PZooBFuUMpS4DQEMNgRR3ENofPbDmyI7Cy_YSVUuCsvfRNdcFM4T5H_sDbiD3-ZTRmSQR0yoz-aOqM9u5ViLunGIsswJX3XnF9XyVytj9jbL6H3Gm1Ht-2Q Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7643b3a05e304f89a945f512536e2df6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ea036c351f864bd0bb927e15e897c9e3 Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d could not be found. Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '8d6f646a-8f13-4576-8f5a-09b3d4886e1d'} Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d could not be found. Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:15:06.414109 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:15:06.417978 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d could not be found. Oct 24 11:15:06.417978 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:15:06.417978 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:15:06.417978 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:15:06.417978 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:15:06.417978 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:15:06.417978 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:15:06.417978 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:15:06.417978 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:15:06.417978 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d could not be found. Oct 24 11:15:06.417978 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:15:06.417978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-441f3fd8-1475-4d6c-a24c-c6c346984fc3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Returning 404 to user: Instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:15:06.417978 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-441f3fd8-1475-4d6c-a24c-c6c346984fc3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 404 len: 111 microversion: 2.1 time: 0.032864 Oct 24 11:15:06.417978 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3381/6736] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:15:06 2022] DELETE /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:15:06.425885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-59a84c67-1869-4f7d-b5d1-3d3a0eaf353a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:06.426508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-59a84c67-1869-4f7d-b5d1-3d3a0eaf353a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 8d6f646a-8f13-4576-8f5a-09b3d4886e1d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:06.433546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59a84c67-1869-4f7d-b5d1-3d3a0eaf353a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:06.434036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59a84c67-1869-4f7d-b5d1-3d3a0eaf353a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:06.434477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59a84c67-1869-4f7d-b5d1-3d3a0eaf353a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:06.435179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59a84c67-1869-4f7d-b5d1-3d3a0eaf353a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:06.435638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59a84c67-1869-4f7d-b5d1-3d3a0eaf353a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:06.436069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-59a84c67-1869-4f7d-b5d1-3d3a0eaf353a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:06.450931 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-59a84c67-1869-4f7d-b5d1-3d3a0eaf353a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] HTTP exception thrown: Instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d could not be found. Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-59a84c67-1869-4f7d-b5d1-3d3a0eaf353a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Request method failure captured: Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d HTTP/1.1 Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnM2OqlSOkhfxDfVEeTT94IwX8qn5k49naomhNLud1uic_lKwej-RJQ1PZooBFuUMpS4DQEMNgRR3ENofPbDmyI7Cy_YSVUuCsvfRNdcFM4T5H_sDbiD3-ZTRmSQR0yoz-aOqM9u5ViLunGIsswJX3XnF9XyVytj9jbL6H3Gm1Ht-2Q Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7643b3a05e304f89a945f512536e2df6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ea036c351f864bd0bb927e15e897c9e3 Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d could not be found. Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '8d6f646a-8f13-4576-8f5a-09b3d4886e1d'} Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d could not be found. Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d could not be found. Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:15:06.452490 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:15:06.457150 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:15:06.457150 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:15:06.457150 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:15:06.457150 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:15:06.457150 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:15:06.457150 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d could not be found. Oct 24 11:15:06.457150 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:15:06.457150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-59a84c67-1869-4f7d-b5d1-3d3a0eaf353a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Returning 404 to user: Instance 8d6f646a-8f13-4576-8f5a-09b3d4886e1d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:15:06.457150 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-59a84c67-1869-4f7d-b5d1-3d3a0eaf353a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d" status: 404 len: 111 microversion: 2.1 time: 0.033038 Oct 24 11:15:06.457150 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3356/6737] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:06 2022] GET /compute/v2.1/servers/8d6f646a-8f13-4576-8f5a-09b3d4886e1d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:15:26.121281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0a011e10-5a0a-4357-82af-d863ff2bc79f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1011836398", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4fb2df6b-16c8-4a4b-b14d-d1777f50e7a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "fd5ed2ae-44e8-4a94-8b2b-fd64f1a0661a"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:15:26.132453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:15:26.133289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:15:26.270133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-0a011e10-5a0a-4357-82af-d863ff2bc79f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] validate_networks() for [('fd5ed2ae-44e8-4a94-8b2b-fd64f1a0661a', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:15:26.676086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0a011e10-5a0a-4357-82af-d863ff2bc79f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:15:26.676527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0a011e10-5a0a-4357-82af-d863ff2bc79f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:15:26.677041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0a011e10-5a0a-4357-82af-d863ff2bc79f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:15:26.677482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0a011e10-5a0a-4357-82af-d863ff2bc79f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:15:26.677895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0a011e10-5a0a-4357-82af-d863ff2bc79f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:15:26.686945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a011e10-5a0a-4357-82af-d863ff2bc79f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:26.687538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a011e10-5a0a-4357-82af-d863ff2bc79f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:26.688215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a011e10-5a0a-4357-82af-d863ff2bc79f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:26.689044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a011e10-5a0a-4357-82af-d863ff2bc79f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:26.689499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a011e10-5a0a-4357-82af-d863ff2bc79f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:26.689930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0a011e10-5a0a-4357-82af-d863ff2bc79f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:26.706602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-0a011e10-5a0a-4357-82af-d863ff2bc79f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Getting quotas for project 7643b3a05e304f89a945f512536e2df6. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:15:26.712194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-0a011e10-5a0a-4357-82af-d863ff2bc79f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Getting quotas for user ea036c351f864bd0bb927e15e897c9e3 and project 7643b3a05e304f89a945f512536e2df6. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:15:26.770456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0a011e10-5a0a-4357-82af-d863ff2bc79f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:15:26.772613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0a011e10-5a0a-4357-82af-d863ff2bc79f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4fb2df6b-16c8-4a4b-b14d-d1777f50e7a9',volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:15:26.896669 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0a011e10-5a0a-4357-82af-d863ff2bc79f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779587 Oct 24 11:15:26.897368 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3382/6738] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:15:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:15:26.909858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bab79a75-c489-436a-b579-7624290b599a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:26.910481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bab79a75-c489-436a-b579-7624290b599a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:26.912644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=15 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:15:26.913348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=35 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:15:26.914774 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:15:26.914909 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:15:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 (ip 10.222.0.50) !!! Oct 24 11:15:27.048605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bab79a75-c489-436a-b579-7624290b599a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:27.056118 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bab79a75-c489-436a-b579-7624290b599a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1071 microversion: 2.1 time: 0.151292 Oct 24 11:15:27.056769 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3357/6739] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:26 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1071 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:28.081043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b19655b5-5687-44b5-9882-d649a959e8a1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:28.081616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b19655b5-5687-44b5-9882-d649a959e8a1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:28.088644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b19655b5-5687-44b5-9882-d649a959e8a1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:28.089181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b19655b5-5687-44b5-9882-d649a959e8a1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:28.089657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b19655b5-5687-44b5-9882-d649a959e8a1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:28.090551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b19655b5-5687-44b5-9882-d649a959e8a1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:28.091019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b19655b5-5687-44b5-9882-d649a959e8a1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:28.091451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b19655b5-5687-44b5-9882-d649a959e8a1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:28.157058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b19655b5-5687-44b5-9882-d649a959e8a1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:28.167426 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b19655b5-5687-44b5-9882-d649a959e8a1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1187 microversion: 2.1 time: 0.092359 Oct 24 11:15:28.168268 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3383/6740] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:28 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:29.192438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a47f6847-fcea-492a-96d2-ef93cc6878d6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:29.193100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a47f6847-fcea-492a-96d2-ef93cc6878d6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:29.199836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a47f6847-fcea-492a-96d2-ef93cc6878d6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:29.200337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a47f6847-fcea-492a-96d2-ef93cc6878d6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:29.200781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a47f6847-fcea-492a-96d2-ef93cc6878d6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:29.201509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a47f6847-fcea-492a-96d2-ef93cc6878d6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:29.202000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a47f6847-fcea-492a-96d2-ef93cc6878d6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:29.202431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a47f6847-fcea-492a-96d2-ef93cc6878d6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:29.341920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a47f6847-fcea-492a-96d2-ef93cc6878d6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:29.350234 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a47f6847-fcea-492a-96d2-ef93cc6878d6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1229 microversion: 2.1 time: 0.162803 Oct 24 11:15:29.350961 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3358/6741] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:29 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1229 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:29.438397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-36d394e3-5334-4d08-9a32-86d5dc4fd034 req-83562242-0b0a-4374-9fdc-4ae66dae896b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d85ba5cc-e982-426e-bc88-6fe3f683e9f2", "tag": "45cf644f-4b17-4480-b979-cac84b1b82b2"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:15:29.451971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-36d394e3-5334-4d08-9a32-86d5dc4fd034 req-83562242-0b0a-4374-9fdc-4ae66dae896b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:29.453763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-36d394e3-5334-4d08-9a32-86d5dc4fd034 req-83562242-0b0a-4374-9fdc-4ae66dae896b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:29.454422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-36d394e3-5334-4d08-9a32-86d5dc4fd034 req-83562242-0b0a-4374-9fdc-4ae66dae896b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:29.467330 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-36d394e3-5334-4d08-9a32-86d5dc4fd034 req-83562242-0b0a-4374-9fdc-4ae66dae896b service nova] Creating event network-changed:45cf644f-4b17-4480-b979-cac84b1b82b2 for instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 on n-h1-858383-15 Oct 24 11:15:29.475139 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-36d394e3-5334-4d08-9a32-86d5dc4fd034 req-83562242-0b0a-4374-9fdc-4ae66dae896b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041580 Oct 24 11:15:29.476141 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3384/6742] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:15:30.373399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e31ae36d-5128-4570-9aab-99235804a1ea tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:30.374120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e31ae36d-5128-4570-9aab-99235804a1ea tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:30.383213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e31ae36d-5128-4570-9aab-99235804a1ea tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:30.383720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e31ae36d-5128-4570-9aab-99235804a1ea tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:30.384165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e31ae36d-5128-4570-9aab-99235804a1ea tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:30.385223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e31ae36d-5128-4570-9aab-99235804a1ea tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:30.385700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e31ae36d-5128-4570-9aab-99235804a1ea tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:30.386167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e31ae36d-5128-4570-9aab-99235804a1ea tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:30.540191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e31ae36d-5128-4570-9aab-99235804a1ea tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:30.548490 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e31ae36d-5128-4570-9aab-99235804a1ea tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1229 microversion: 2.1 time: 0.179170 Oct 24 11:15:30.549117 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3359/6743] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:30 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1229 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:31.572297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d1085fcf-b12b-44b4-8ed3-67e919f08458 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:31.572957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d1085fcf-b12b-44b4-8ed3-67e919f08458 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:31.581033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1085fcf-b12b-44b4-8ed3-67e919f08458 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:31.581548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1085fcf-b12b-44b4-8ed3-67e919f08458 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:31.581991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1085fcf-b12b-44b4-8ed3-67e919f08458 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:31.582701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1085fcf-b12b-44b4-8ed3-67e919f08458 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:31.583160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1085fcf-b12b-44b4-8ed3-67e919f08458 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:31.583589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1085fcf-b12b-44b4-8ed3-67e919f08458 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:31.714282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d1085fcf-b12b-44b4-8ed3-67e919f08458 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:31.722865 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d1085fcf-b12b-44b4-8ed3-67e919f08458 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1229 microversion: 2.1 time: 0.154924 Oct 24 11:15:31.723447 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3385/6744] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:31 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1229 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:32.746070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-60b10b9a-8613-46a9-a554-142dcf139fd4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:32.746692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-60b10b9a-8613-46a9-a554-142dcf139fd4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:32.754165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60b10b9a-8613-46a9-a554-142dcf139fd4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:32.754668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60b10b9a-8613-46a9-a554-142dcf139fd4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:32.755118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60b10b9a-8613-46a9-a554-142dcf139fd4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:32.755839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60b10b9a-8613-46a9-a554-142dcf139fd4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:32.756303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60b10b9a-8613-46a9-a554-142dcf139fd4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:32.756739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60b10b9a-8613-46a9-a554-142dcf139fd4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:32.894017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-60b10b9a-8613-46a9-a554-142dcf139fd4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:32.902850 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-60b10b9a-8613-46a9-a554-142dcf139fd4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1229 microversion: 2.1 time: 0.160156 Oct 24 11:15:32.903447 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3360/6745] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:32 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1229 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:33.928102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5a51f7ca-7046-4a51-a649-79574cf0577b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:33.928719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5a51f7ca-7046-4a51-a649-79574cf0577b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:33.935623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a51f7ca-7046-4a51-a649-79574cf0577b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:33.936107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a51f7ca-7046-4a51-a649-79574cf0577b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:33.936546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a51f7ca-7046-4a51-a649-79574cf0577b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:33.937933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a51f7ca-7046-4a51-a649-79574cf0577b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:33.938401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a51f7ca-7046-4a51-a649-79574cf0577b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:33.938824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a51f7ca-7046-4a51-a649-79574cf0577b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:34.069864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5a51f7ca-7046-4a51-a649-79574cf0577b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:34.077638 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5a51f7ca-7046-4a51-a649-79574cf0577b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1217 microversion: 2.1 time: 0.153507 Oct 24 11:15:34.078343 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3386/6746] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:33 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:35.099723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6ac95676-2d4d-449e-a955-bda0c91adc52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:35.100352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6ac95676-2d4d-449e-a955-bda0c91adc52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:35.107241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ac95676-2d4d-449e-a955-bda0c91adc52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:35.107736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ac95676-2d4d-449e-a955-bda0c91adc52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:35.108182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ac95676-2d4d-449e-a955-bda0c91adc52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:35.108911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ac95676-2d4d-449e-a955-bda0c91adc52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:35.109376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ac95676-2d4d-449e-a955-bda0c91adc52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:35.109807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ac95676-2d4d-449e-a955-bda0c91adc52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:35.239867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ac95676-2d4d-449e-a955-bda0c91adc52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:35.247567 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6ac95676-2d4d-449e-a955-bda0c91adc52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1217 microversion: 2.1 time: 0.151891 Oct 24 11:15:35.248134 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3361/6747] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:35 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:36.271437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-83d3a79c-46e4-449a-90cf-1d9d6de19726 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:36.272062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-83d3a79c-46e4-449a-90cf-1d9d6de19726 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:36.279214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83d3a79c-46e4-449a-90cf-1d9d6de19726 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:36.279698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83d3a79c-46e4-449a-90cf-1d9d6de19726 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:36.280137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83d3a79c-46e4-449a-90cf-1d9d6de19726 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:36.281476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83d3a79c-46e4-449a-90cf-1d9d6de19726 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:36.281938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83d3a79c-46e4-449a-90cf-1d9d6de19726 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:36.282375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83d3a79c-46e4-449a-90cf-1d9d6de19726 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:36.413809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-83d3a79c-46e4-449a-90cf-1d9d6de19726 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:36.421702 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-83d3a79c-46e4-449a-90cf-1d9d6de19726 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1217 microversion: 2.1 time: 0.154158 Oct 24 11:15:36.422274 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3387/6748] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:36 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:37.444341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ec7c4008-9dae-4f0b-92c1-b4c3ed94cdb6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:37.444978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ec7c4008-9dae-4f0b-92c1-b4c3ed94cdb6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:37.447724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:15:37.453387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec7c4008-9dae-4f0b-92c1-b4c3ed94cdb6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:37.453907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec7c4008-9dae-4f0b-92c1-b4c3ed94cdb6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:37.454343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec7c4008-9dae-4f0b-92c1-b4c3ed94cdb6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:37.455033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec7c4008-9dae-4f0b-92c1-b4c3ed94cdb6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:37.455487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec7c4008-9dae-4f0b-92c1-b4c3ed94cdb6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:37.455912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec7c4008-9dae-4f0b-92c1-b4c3ed94cdb6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:37.587191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ec7c4008-9dae-4f0b-92c1-b4c3ed94cdb6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:37.595032 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ec7c4008-9dae-4f0b-92c1-b4c3ed94cdb6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1217 microversion: 2.1 time: 0.154623 Oct 24 11:15:37.595597 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3362/6749] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:37 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:38.618034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-871cdc8c-f966-4b35-95f1-39657f1930d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:38.618648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-871cdc8c-f966-4b35-95f1-39657f1930d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:38.620613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:15:38.621318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:15:38.628668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-871cdc8c-f966-4b35-95f1-39657f1930d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:38.629171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-871cdc8c-f966-4b35-95f1-39657f1930d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:38.629606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-871cdc8c-f966-4b35-95f1-39657f1930d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:38.630327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-871cdc8c-f966-4b35-95f1-39657f1930d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:38.630777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-871cdc8c-f966-4b35-95f1-39657f1930d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:38.631202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-871cdc8c-f966-4b35-95f1-39657f1930d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:38.767139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-871cdc8c-f966-4b35-95f1-39657f1930d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:38.775203 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-871cdc8c-f966-4b35-95f1-39657f1930d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1217 microversion: 2.1 time: 0.160855 Oct 24 11:15:38.775785 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3388/6750] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:38 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:39.798731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f6fce2fd-bbc3-4c17-8558-b0f2f9a850ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:39.799343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f6fce2fd-bbc3-4c17-8558-b0f2f9a850ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:39.806173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6fce2fd-bbc3-4c17-8558-b0f2f9a850ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:39.806656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6fce2fd-bbc3-4c17-8558-b0f2f9a850ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:39.807092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6fce2fd-bbc3-4c17-8558-b0f2f9a850ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:39.807783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6fce2fd-bbc3-4c17-8558-b0f2f9a850ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:39.808236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6fce2fd-bbc3-4c17-8558-b0f2f9a850ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:39.808682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6fce2fd-bbc3-4c17-8558-b0f2f9a850ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:39.936806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f6fce2fd-bbc3-4c17-8558-b0f2f9a850ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:39.945158 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f6fce2fd-bbc3-4c17-8558-b0f2f9a850ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1217 microversion: 2.1 time: 0.150992 Oct 24 11:15:39.945733 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3363/6751] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:39 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:40.967740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-658cdbed-4488-44bf-9482-c66828ea5612 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:40.968454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-658cdbed-4488-44bf-9482-c66828ea5612 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:40.975517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-658cdbed-4488-44bf-9482-c66828ea5612 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:40.976001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-658cdbed-4488-44bf-9482-c66828ea5612 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:40.976437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-658cdbed-4488-44bf-9482-c66828ea5612 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:40.977198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-658cdbed-4488-44bf-9482-c66828ea5612 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:40.977653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-658cdbed-4488-44bf-9482-c66828ea5612 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:40.978080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-658cdbed-4488-44bf-9482-c66828ea5612 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:41.108294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-658cdbed-4488-44bf-9482-c66828ea5612 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:41.119123 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-658cdbed-4488-44bf-9482-c66828ea5612 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1217 microversion: 2.1 time: 0.155231 Oct 24 11:15:41.119718 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3389/6752] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:40 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:42.146317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c21d3e2c-d869-4a3c-b828-f8bda021c5ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:42.146933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c21d3e2c-d869-4a3c-b828-f8bda021c5ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:42.153879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c21d3e2c-d869-4a3c-b828-f8bda021c5ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:42.154365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c21d3e2c-d869-4a3c-b828-f8bda021c5ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:42.154802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c21d3e2c-d869-4a3c-b828-f8bda021c5ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:42.156331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c21d3e2c-d869-4a3c-b828-f8bda021c5ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:42.157176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c21d3e2c-d869-4a3c-b828-f8bda021c5ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:42.157612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c21d3e2c-d869-4a3c-b828-f8bda021c5ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:42.291866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c21d3e2c-d869-4a3c-b828-f8bda021c5ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:42.300542 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c21d3e2c-d869-4a3c-b828-f8bda021c5ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1217 microversion: 2.1 time: 0.158181 Oct 24 11:15:42.301167 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3364/6753] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:42 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:15:43.323493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7a0006b8-73c5-4611-b561-cc35c6be6049 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:43.324101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7a0006b8-73c5-4611-b561-cc35c6be6049 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:43.331252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a0006b8-73c5-4611-b561-cc35c6be6049 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:43.331731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a0006b8-73c5-4611-b561-cc35c6be6049 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:43.332164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a0006b8-73c5-4611-b561-cc35c6be6049 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:43.332868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a0006b8-73c5-4611-b561-cc35c6be6049 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:43.333324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a0006b8-73c5-4611-b561-cc35c6be6049 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:43.333747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a0006b8-73c5-4611-b561-cc35c6be6049 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:43.464513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7a0006b8-73c5-4611-b561-cc35c6be6049 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:43.473550 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7a0006b8-73c5-4611-b561-cc35c6be6049 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1217 microversion: 2.1 time: 0.153900 Oct 24 11:15:43.474135 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3390/6754] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:43 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:43.906586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-55cdbfcf-5b39-4f93-8fb6-1ae74e2723a2 req-9e228dcf-988f-4fe3-bdcc-085feec0fabb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85ba5cc-e982-426e-bc88-6fe3f683e9f2", "name": "network-vif-plugged", "status": "completed", "tag": "45cf644f-4b17-4480-b979-cac84b1b82b2"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:15:43.918084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-55cdbfcf-5b39-4f93-8fb6-1ae74e2723a2 req-9e228dcf-988f-4fe3-bdcc-085feec0fabb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:43.918613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-55cdbfcf-5b39-4f93-8fb6-1ae74e2723a2 req-9e228dcf-988f-4fe3-bdcc-085feec0fabb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:43.919049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-55cdbfcf-5b39-4f93-8fb6-1ae74e2723a2 req-9e228dcf-988f-4fe3-bdcc-085feec0fabb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:43.930900 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-55cdbfcf-5b39-4f93-8fb6-1ae74e2723a2 req-9e228dcf-988f-4fe3-bdcc-085feec0fabb service nova] Creating event network-vif-plugged:45cf644f-4b17-4480-b979-cac84b1b82b2 for instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 on n-h1-858383-15 Oct 24 11:15:43.936077 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-55cdbfcf-5b39-4f93-8fb6-1ae74e2723a2 req-9e228dcf-988f-4fe3-bdcc-085feec0fabb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033168 Oct 24 11:15:43.937424 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3365/6755] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:15:44.496992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aeb0f2f8-6c42-4106-a0d8-1badb5348676 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:44.497631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aeb0f2f8-6c42-4106-a0d8-1badb5348676 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:44.504861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aeb0f2f8-6c42-4106-a0d8-1badb5348676 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:44.505359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aeb0f2f8-6c42-4106-a0d8-1badb5348676 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:44.505795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aeb0f2f8-6c42-4106-a0d8-1badb5348676 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:44.506509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aeb0f2f8-6c42-4106-a0d8-1badb5348676 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:44.506958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aeb0f2f8-6c42-4106-a0d8-1badb5348676 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:44.507381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aeb0f2f8-6c42-4106-a0d8-1badb5348676 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:44.637463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aeb0f2f8-6c42-4106-a0d8-1badb5348676 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:44.645302 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aeb0f2f8-6c42-4106-a0d8-1badb5348676 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1217 microversion: 2.1 time: 0.152452 Oct 24 11:15:44.645874 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3391/6756] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:44 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:45.670499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a9352fd6-0986-44a3-9260-d6f9e084f0cd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:45.671943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a9352fd6-0986-44a3-9260-d6f9e084f0cd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:45.679544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9352fd6-0986-44a3-9260-d6f9e084f0cd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:45.680031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9352fd6-0986-44a3-9260-d6f9e084f0cd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:45.680471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9352fd6-0986-44a3-9260-d6f9e084f0cd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:45.681201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9352fd6-0986-44a3-9260-d6f9e084f0cd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:45.681692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9352fd6-0986-44a3-9260-d6f9e084f0cd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:45.682124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9352fd6-0986-44a3-9260-d6f9e084f0cd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:45.824577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a9352fd6-0986-44a3-9260-d6f9e084f0cd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:45.832555 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a9352fd6-0986-44a3-9260-d6f9e084f0cd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1404 microversion: 2.1 time: 0.167225 Oct 24 11:15:45.833176 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3366/6757] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:45 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1404 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:45.854751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-656db9a1-b271-4672-a357-0200f2af1d2d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:45.856739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-656db9a1-b271-4672-a357-0200f2af1d2d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:45.864224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-656db9a1-b271-4672-a357-0200f2af1d2d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:45.864709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-656db9a1-b271-4672-a357-0200f2af1d2d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:45.865172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-656db9a1-b271-4672-a357-0200f2af1d2d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:45.866152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-656db9a1-b271-4672-a357-0200f2af1d2d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:45.866609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-656db9a1-b271-4672-a357-0200f2af1d2d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:45.867038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-656db9a1-b271-4672-a357-0200f2af1d2d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:45.995953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-656db9a1-b271-4672-a357-0200f2af1d2d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:46.004429 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-656db9a1-b271-4672-a357-0200f2af1d2d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1404 microversion: 2.1 time: 0.153620 Oct 24 11:15:46.005053 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3392/6758] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:45 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:46.027043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-000803fb-1f54-4518-9c24-4f5dbc38fd50 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-103168096"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:15:46.029440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-000803fb-1f54-4518-9c24-4f5dbc38fd50 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:46.035603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-000803fb-1f54-4518-9c24-4f5dbc38fd50 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:46.036089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-000803fb-1f54-4518-9c24-4f5dbc38fd50 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:46.036530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-000803fb-1f54-4518-9c24-4f5dbc38fd50 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:46.037256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-000803fb-1f54-4518-9c24-4f5dbc38fd50 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:46.037721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-000803fb-1f54-4518-9c24-4f5dbc38fd50 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:46.038149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-000803fb-1f54-4518-9c24-4f5dbc38fd50 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:46.135924 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.compute.api [None req-000803fb-1f54-4518-9c24-4f5dbc38fd50 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Attempting to quiesce instance before volume snapshot. Oct 24 11:15:46.207827 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.compute.api [None req-000803fb-1f54-4518-9c24-4f5dbc38fd50 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 24 11:15:46.276431 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-000803fb-1f54-4518-9c24-4f5dbc38fd50 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Creating snapshot from volume 4fb2df6b-16c8-4a4b-b14d-d1777f50e7a9. {{(pid=120425) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 24 11:15:47.101873 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-000803fb-1f54-4518-9c24-4f5dbc38fd50 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "POST /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2/action" status: 202 len: 0 microversion: 2.1 time: 1.079316 Oct 24 11:15:47.103087 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3367/6759] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:15:46 2022] POST /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2/action => generated 0 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 11:15:48.267485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a5727e77-3817-42bc-a8cd-8a55b8f500a6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1313326503", "imageRef": "27848559-4723-40ea-b5a9-8f2a249b68c1", "flavorRef": "452", "networks": [{"uuid": "fd5ed2ae-44e8-4a94-8b2b-fd64f1a0661a"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:15:48.324936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-a5727e77-3817-42bc-a8cd-8a55b8f500a6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] validate_networks() for [('fd5ed2ae-44e8-4a94-8b2b-fd64f1a0661a', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:15:48.690943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a5727e77-3817-42bc-a8cd-8a55b8f500a6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:15:48.691364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a5727e77-3817-42bc-a8cd-8a55b8f500a6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:15:48.691837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a5727e77-3817-42bc-a8cd-8a55b8f500a6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:15:48.692244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a5727e77-3817-42bc-a8cd-8a55b8f500a6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:15:48.692683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a5727e77-3817-42bc-a8cd-8a55b8f500a6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:15:48.701570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a5727e77-3817-42bc-a8cd-8a55b8f500a6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:48.702058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a5727e77-3817-42bc-a8cd-8a55b8f500a6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:48.703209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a5727e77-3817-42bc-a8cd-8a55b8f500a6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:48.703941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a5727e77-3817-42bc-a8cd-8a55b8f500a6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:48.704396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a5727e77-3817-42bc-a8cd-8a55b8f500a6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:48.704824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a5727e77-3817-42bc-a8cd-8a55b8f500a6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:48.721472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-a5727e77-3817-42bc-a8cd-8a55b8f500a6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Getting quotas for project 7643b3a05e304f89a945f512536e2df6. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:15:48.726679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-a5727e77-3817-42bc-a8cd-8a55b8f500a6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Getting quotas for user ea036c351f864bd0bb927e15e897c9e3 and project 7643b3a05e304f89a945f512536e2df6. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:15:48.739604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a5727e77-3817-42bc-a8cd-8a55b8f500a6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:15:48.742191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a5727e77-3817-42bc-a8cd-8a55b8f500a6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='7465e0d5-f2cd-4e81-bcf1-9c389216d365',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:15:48.817853 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a5727e77-3817-42bc-a8cd-8a55b8f500a6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554384 Oct 24 11:15:48.820888 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3393/6760] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:15:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:15:48.832095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0da827ec-5166-447d-ac79-831ad1d37d11 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:48.832971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0da827ec-5166-447d-ac79-831ad1d37d11 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:48.893898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0da827ec-5166-447d-ac79-831ad1d37d11 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:48.901345 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0da827ec-5166-447d-ac79-831ad1d37d11 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1230 microversion: 2.1 time: 0.075181 Oct 24 11:15:48.901925 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3368/6761] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:48 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1230 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:49.924738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-34d727aa-f827-4204-919d-635df9c631c6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:49.925386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-34d727aa-f827-4204-919d-635df9c631c6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:49.932384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34d727aa-f827-4204-919d-635df9c631c6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:49.932911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34d727aa-f827-4204-919d-635df9c631c6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:49.933360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34d727aa-f827-4204-919d-635df9c631c6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:49.934073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34d727aa-f827-4204-919d-635df9c631c6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:49.934564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34d727aa-f827-4204-919d-635df9c631c6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:49.934997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-34d727aa-f827-4204-919d-635df9c631c6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:50.010641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-34d727aa-f827-4204-919d-635df9c631c6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:50.018707 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-34d727aa-f827-4204-919d-635df9c631c6 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1282 microversion: 2.1 time: 0.099025 Oct 24 11:15:50.019357 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3394/6762] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:49 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1282 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:51.043441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-39533dbc-ed74-483f-b0c9-2d30c74ed884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:51.044084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-39533dbc-ed74-483f-b0c9-2d30c74ed884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:51.052415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39533dbc-ed74-483f-b0c9-2d30c74ed884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:51.053190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39533dbc-ed74-483f-b0c9-2d30c74ed884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:51.053821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39533dbc-ed74-483f-b0c9-2d30c74ed884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:51.054737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39533dbc-ed74-483f-b0c9-2d30c74ed884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:51.055370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39533dbc-ed74-483f-b0c9-2d30c74ed884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:51.055821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-39533dbc-ed74-483f-b0c9-2d30c74ed884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:51.206460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-39533dbc-ed74-483f-b0c9-2d30c74ed884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:51.214698 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-39533dbc-ed74-483f-b0c9-2d30c74ed884 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1342 microversion: 2.1 time: 0.175630 Oct 24 11:15:51.215758 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3369/6763] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:51 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1342 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:51.562101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-e5df049e-e26b-40e4-92cc-a6aa69028e6a req-6ef57f65-2989-4928-ba72-9caa4b274038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1922b6cf-5941-457b-89e4-005960357887", "tag": "12365ded-53ec-4d90-9857-981b4a661f4e"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:15:51.574739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e5df049e-e26b-40e4-92cc-a6aa69028e6a req-6ef57f65-2989-4928-ba72-9caa4b274038 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:51.575482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e5df049e-e26b-40e4-92cc-a6aa69028e6a req-6ef57f65-2989-4928-ba72-9caa4b274038 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:51.576135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e5df049e-e26b-40e4-92cc-a6aa69028e6a req-6ef57f65-2989-4928-ba72-9caa4b274038 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:51.593431 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-e5df049e-e26b-40e4-92cc-a6aa69028e6a req-6ef57f65-2989-4928-ba72-9caa4b274038 service nova] Creating event network-changed:12365ded-53ec-4d90-9857-981b4a661f4e for instance 1922b6cf-5941-457b-89e4-005960357887 on n-h2-858383-15 Oct 24 11:15:51.599724 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-e5df049e-e26b-40e4-92cc-a6aa69028e6a req-6ef57f65-2989-4928-ba72-9caa4b274038 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044120 Oct 24 11:15:51.601084 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3395/6764] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:15:52.239571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-90ea1ba5-7089-42c8-b108-ed99c23e33f3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:52.240757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-90ea1ba5-7089-42c8-b108-ed99c23e33f3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:52.247508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90ea1ba5-7089-42c8-b108-ed99c23e33f3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:52.248016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90ea1ba5-7089-42c8-b108-ed99c23e33f3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:52.248474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90ea1ba5-7089-42c8-b108-ed99c23e33f3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:52.249762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90ea1ba5-7089-42c8-b108-ed99c23e33f3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:52.250395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90ea1ba5-7089-42c8-b108-ed99c23e33f3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:52.251271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90ea1ba5-7089-42c8-b108-ed99c23e33f3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:52.404477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-90ea1ba5-7089-42c8-b108-ed99c23e33f3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:52.413511 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-90ea1ba5-7089-42c8-b108-ed99c23e33f3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1342 microversion: 2.1 time: 0.177994 Oct 24 11:15:52.414198 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3370/6765] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:52 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1342 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:53.438995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9793b317-d65a-4614-999e-f525027c8a06 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:53.439824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9793b317-d65a-4614-999e-f525027c8a06 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:53.446117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9793b317-d65a-4614-999e-f525027c8a06 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:53.446601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9793b317-d65a-4614-999e-f525027c8a06 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:53.447036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9793b317-d65a-4614-999e-f525027c8a06 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:53.447728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9793b317-d65a-4614-999e-f525027c8a06 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:53.448180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9793b317-d65a-4614-999e-f525027c8a06 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:53.448663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9793b317-d65a-4614-999e-f525027c8a06 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:53.598456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9793b317-d65a-4614-999e-f525027c8a06 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:53.606466 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9793b317-d65a-4614-999e-f525027c8a06 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1342 microversion: 2.1 time: 0.173519 Oct 24 11:15:53.607417 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3396/6766] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:53 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1342 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:54.632206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c79ba519-a0f4-4872-b1fc-cf525de57ef2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:54.634582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c79ba519-a0f4-4872-b1fc-cf525de57ef2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:54.645054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c79ba519-a0f4-4872-b1fc-cf525de57ef2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:54.645829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c79ba519-a0f4-4872-b1fc-cf525de57ef2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:54.646496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c79ba519-a0f4-4872-b1fc-cf525de57ef2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:54.647726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c79ba519-a0f4-4872-b1fc-cf525de57ef2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:54.648212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c79ba519-a0f4-4872-b1fc-cf525de57ef2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:54.649154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c79ba519-a0f4-4872-b1fc-cf525de57ef2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:54.834387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c79ba519-a0f4-4872-b1fc-cf525de57ef2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:54.844032 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c79ba519-a0f4-4872-b1fc-cf525de57ef2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1342 microversion: 2.1 time: 0.215793 Oct 24 11:15:54.844943 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3371/6767] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:54 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1342 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:55.870505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4d41c569-eb8e-4647-998e-ee0b60363695 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:55.871729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4d41c569-eb8e-4647-998e-ee0b60363695 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:55.879976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d41c569-eb8e-4647-998e-ee0b60363695 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:55.880461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d41c569-eb8e-4647-998e-ee0b60363695 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:55.880928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d41c569-eb8e-4647-998e-ee0b60363695 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:55.881644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d41c569-eb8e-4647-998e-ee0b60363695 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:55.882076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d41c569-eb8e-4647-998e-ee0b60363695 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:55.882664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d41c569-eb8e-4647-998e-ee0b60363695 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:56.033764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4d41c569-eb8e-4647-998e-ee0b60363695 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:56.043876 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4d41c569-eb8e-4647-998e-ee0b60363695 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1342 microversion: 2.1 time: 0.177305 Oct 24 11:15:56.044487 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3397/6768] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:55 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1342 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:57.068519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4bd9f24b-2de3-4973-b66d-2a5bc9da3e0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:57.069240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4bd9f24b-2de3-4973-b66d-2a5bc9da3e0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:57.072306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=35 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:15:57.079243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bd9f24b-2de3-4973-b66d-2a5bc9da3e0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:57.079804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bd9f24b-2de3-4973-b66d-2a5bc9da3e0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:57.080260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bd9f24b-2de3-4973-b66d-2a5bc9da3e0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:57.081008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bd9f24b-2de3-4973-b66d-2a5bc9da3e0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:57.081483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bd9f24b-2de3-4973-b66d-2a5bc9da3e0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:57.081927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bd9f24b-2de3-4973-b66d-2a5bc9da3e0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:57.087083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:15:57.239572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4bd9f24b-2de3-4973-b66d-2a5bc9da3e0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:57.247635 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4bd9f24b-2de3-4973-b66d-2a5bc9da3e0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1342 microversion: 2.1 time: 0.183284 Oct 24 11:15:57.259723 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3372/6769] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:57 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1342 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:58.271475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c4f48abc-d231-40e4-b823-4f17bf558ae7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:58.272088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c4f48abc-d231-40e4-b823-4f17bf558ae7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:58.275147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:15:58.280940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4f48abc-d231-40e4-b823-4f17bf558ae7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:58.281422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4f48abc-d231-40e4-b823-4f17bf558ae7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:58.281856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4f48abc-d231-40e4-b823-4f17bf558ae7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:58.282546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4f48abc-d231-40e4-b823-4f17bf558ae7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:58.282994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4f48abc-d231-40e4-b823-4f17bf558ae7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:58.283418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4f48abc-d231-40e4-b823-4f17bf558ae7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:58.287916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=81 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:15:58.418567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c4f48abc-d231-40e4-b823-4f17bf558ae7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:58.426529 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c4f48abc-d231-40e4-b823-4f17bf558ae7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1342 microversion: 2.1 time: 0.158941 Oct 24 11:15:58.427114 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3398/6770] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:58 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:15:59.450642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7c3bfb95-2d0c-4223-9416-05f00959988f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:15:59.451275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7c3bfb95-2d0c-4223-9416-05f00959988f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:15:59.454637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:15:59.460189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c3bfb95-2d0c-4223-9416-05f00959988f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:59.460633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c3bfb95-2d0c-4223-9416-05f00959988f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:59.461119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c3bfb95-2d0c-4223-9416-05f00959988f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:59.461830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c3bfb95-2d0c-4223-9416-05f00959988f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:15:59.462302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c3bfb95-2d0c-4223-9416-05f00959988f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:15:59.462748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c3bfb95-2d0c-4223-9416-05f00959988f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:15:59.594198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7c3bfb95-2d0c-4223-9416-05f00959988f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:15:59.601934 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7c3bfb95-2d0c-4223-9416-05f00959988f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1342 microversion: 2.1 time: 0.155515 Oct 24 11:15:59.602508 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3373/6771] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:15:59 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1342 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:00.625354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ef3b4694-a982-4cfc-9fb3-389aaff077b3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:00.625972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ef3b4694-a982-4cfc-9fb3-389aaff077b3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:00.627949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:16:00.628611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:16:00.635669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef3b4694-a982-4cfc-9fb3-389aaff077b3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:00.636164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef3b4694-a982-4cfc-9fb3-389aaff077b3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:00.636607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef3b4694-a982-4cfc-9fb3-389aaff077b3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:00.637342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef3b4694-a982-4cfc-9fb3-389aaff077b3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:00.637803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef3b4694-a982-4cfc-9fb3-389aaff077b3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:00.638231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef3b4694-a982-4cfc-9fb3-389aaff077b3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:00.775751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ef3b4694-a982-4cfc-9fb3-389aaff077b3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:00.783781 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ef3b4694-a982-4cfc-9fb3-389aaff077b3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1342 microversion: 2.1 time: 0.162877 Oct 24 11:16:00.784387 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3399/6772] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:00 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:01.807726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-121e08fd-b243-4714-bcbf-57dd55921354 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:01.808436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-121e08fd-b243-4714-bcbf-57dd55921354 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:01.816012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-121e08fd-b243-4714-bcbf-57dd55921354 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:01.816725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-121e08fd-b243-4714-bcbf-57dd55921354 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:01.817212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-121e08fd-b243-4714-bcbf-57dd55921354 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:01.817959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-121e08fd-b243-4714-bcbf-57dd55921354 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:01.818425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-121e08fd-b243-4714-bcbf-57dd55921354 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:01.818865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-121e08fd-b243-4714-bcbf-57dd55921354 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:01.954464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-121e08fd-b243-4714-bcbf-57dd55921354 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:01.962628 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-121e08fd-b243-4714-bcbf-57dd55921354 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1342 microversion: 2.1 time: 0.159416 Oct 24 11:16:01.963228 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3374/6773] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:01 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1342 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:02.987138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-51501eaa-2323-46ca-a786-144bdd417dd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:02.987794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-51501eaa-2323-46ca-a786-144bdd417dd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:02.996318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51501eaa-2323-46ca-a786-144bdd417dd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:02.996900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51501eaa-2323-46ca-a786-144bdd417dd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:02.997507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51501eaa-2323-46ca-a786-144bdd417dd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:02.998210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51501eaa-2323-46ca-a786-144bdd417dd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:02.999025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51501eaa-2323-46ca-a786-144bdd417dd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:02.999736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-51501eaa-2323-46ca-a786-144bdd417dd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:03.146158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-51501eaa-2323-46ca-a786-144bdd417dd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:03.154245 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-51501eaa-2323-46ca-a786-144bdd417dd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1342 microversion: 2.1 time: 0.172129 Oct 24 11:16:03.155502 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3400/6774] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:02 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1342 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:04.177808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f66bf4cc-08a3-4c13-8924-f2d596c2f310 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:04.178441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f66bf4cc-08a3-4c13-8924-f2d596c2f310 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:04.185562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f66bf4cc-08a3-4c13-8924-f2d596c2f310 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:04.186257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f66bf4cc-08a3-4c13-8924-f2d596c2f310 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:04.186688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f66bf4cc-08a3-4c13-8924-f2d596c2f310 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:04.187409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f66bf4cc-08a3-4c13-8924-f2d596c2f310 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:04.187884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f66bf4cc-08a3-4c13-8924-f2d596c2f310 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:04.188331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f66bf4cc-08a3-4c13-8924-f2d596c2f310 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:04.329568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f66bf4cc-08a3-4c13-8924-f2d596c2f310 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:04.337916 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f66bf4cc-08a3-4c13-8924-f2d596c2f310 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1342 microversion: 2.1 time: 0.163988 Oct 24 11:16:04.338818 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3375/6775] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:04 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:05.364388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d1bb13f-9ffb-4657-a34d-415e3c7cde0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:05.365032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2d1bb13f-9ffb-4657-a34d-415e3c7cde0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:05.371910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d1bb13f-9ffb-4657-a34d-415e3c7cde0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:05.372451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d1bb13f-9ffb-4657-a34d-415e3c7cde0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:05.372973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d1bb13f-9ffb-4657-a34d-415e3c7cde0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:05.373906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d1bb13f-9ffb-4657-a34d-415e3c7cde0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:05.374362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d1bb13f-9ffb-4657-a34d-415e3c7cde0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:05.374792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d1bb13f-9ffb-4657-a34d-415e3c7cde0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:05.508112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2d1bb13f-9ffb-4657-a34d-415e3c7cde0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:05.517133 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2d1bb13f-9ffb-4657-a34d-415e3c7cde0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1376 microversion: 2.1 time: 0.156955 Oct 24 11:16:05.517725 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3401/6776] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:05 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:06.541941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-af626dc1-38c9-476f-9e25-ee4c63e918f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:06.542653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-af626dc1-38c9-476f-9e25-ee4c63e918f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:06.550219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af626dc1-38c9-476f-9e25-ee4c63e918f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:06.550730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af626dc1-38c9-476f-9e25-ee4c63e918f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:06.551239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af626dc1-38c9-476f-9e25-ee4c63e918f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:06.551968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af626dc1-38c9-476f-9e25-ee4c63e918f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:06.552447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af626dc1-38c9-476f-9e25-ee4c63e918f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:06.552926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-af626dc1-38c9-476f-9e25-ee4c63e918f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:06.689083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-af626dc1-38c9-476f-9e25-ee4c63e918f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:06.696944 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-af626dc1-38c9-476f-9e25-ee4c63e918f0 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1376 microversion: 2.1 time: 0.159050 Oct 24 11:16:06.697527 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3376/6777] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:06 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:16:07.720093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-70e60062-6d15-4840-ad81-27b64fb6266c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:07.720717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-70e60062-6d15-4840-ad81-27b64fb6266c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:07.727844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70e60062-6d15-4840-ad81-27b64fb6266c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:07.728329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70e60062-6d15-4840-ad81-27b64fb6266c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:07.728782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70e60062-6d15-4840-ad81-27b64fb6266c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:07.729517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70e60062-6d15-4840-ad81-27b64fb6266c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:07.729990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70e60062-6d15-4840-ad81-27b64fb6266c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:07.730422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-70e60062-6d15-4840-ad81-27b64fb6266c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:07.860572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-70e60062-6d15-4840-ad81-27b64fb6266c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:07.868567 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-70e60062-6d15-4840-ad81-27b64fb6266c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1376 microversion: 2.1 time: 0.152651 Oct 24 11:16:07.869232 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3402/6778] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:07 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1376 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:08.892545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f57e3598-6d40-4b86-8ca7-23f2c823662e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:08.893231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f57e3598-6d40-4b86-8ca7-23f2c823662e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:08.900419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f57e3598-6d40-4b86-8ca7-23f2c823662e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:08.900949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f57e3598-6d40-4b86-8ca7-23f2c823662e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:08.901411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f57e3598-6d40-4b86-8ca7-23f2c823662e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:08.902119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f57e3598-6d40-4b86-8ca7-23f2c823662e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:08.902593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f57e3598-6d40-4b86-8ca7-23f2c823662e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:08.903037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f57e3598-6d40-4b86-8ca7-23f2c823662e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:09.046569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f57e3598-6d40-4b86-8ca7-23f2c823662e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:09.054581 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f57e3598-6d40-4b86-8ca7-23f2c823662e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1376 microversion: 2.1 time: 0.166395 Oct 24 11:16:09.055175 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3377/6779] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:08 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1376 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:10.078266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-98f34ae4-7c37-45df-b2ca-18d4dc3e384b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:10.078891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-98f34ae4-7c37-45df-b2ca-18d4dc3e384b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:10.086587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98f34ae4-7c37-45df-b2ca-18d4dc3e384b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:10.087322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98f34ae4-7c37-45df-b2ca-18d4dc3e384b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:10.087833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98f34ae4-7c37-45df-b2ca-18d4dc3e384b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:10.088552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98f34ae4-7c37-45df-b2ca-18d4dc3e384b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:10.089128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98f34ae4-7c37-45df-b2ca-18d4dc3e384b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:10.089574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98f34ae4-7c37-45df-b2ca-18d4dc3e384b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:10.231812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-98f34ae4-7c37-45df-b2ca-18d4dc3e384b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:10.240587 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-98f34ae4-7c37-45df-b2ca-18d4dc3e384b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1376 microversion: 2.1 time: 0.166898 Oct 24 11:16:10.241234 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3403/6780] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:10 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1376 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:11.264466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3dc4d467-04aa-4c29-b79d-2a1ad5eae1be tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:11.265121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3dc4d467-04aa-4c29-b79d-2a1ad5eae1be tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:11.275462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dc4d467-04aa-4c29-b79d-2a1ad5eae1be tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:11.276266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dc4d467-04aa-4c29-b79d-2a1ad5eae1be tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:11.277094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dc4d467-04aa-4c29-b79d-2a1ad5eae1be tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:11.277828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dc4d467-04aa-4c29-b79d-2a1ad5eae1be tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:11.278401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dc4d467-04aa-4c29-b79d-2a1ad5eae1be tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:11.278850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3dc4d467-04aa-4c29-b79d-2a1ad5eae1be tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:11.414095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3dc4d467-04aa-4c29-b79d-2a1ad5eae1be tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:11.421927 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3dc4d467-04aa-4c29-b79d-2a1ad5eae1be tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1376 microversion: 2.1 time: 0.161434 Oct 24 11:16:11.422505 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3378/6781] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:11 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1376 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:12.445822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4202afe1-04f7-467c-906a-af66b199f0b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:12.446433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4202afe1-04f7-467c-906a-af66b199f0b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:12.454004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4202afe1-04f7-467c-906a-af66b199f0b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:12.454497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4202afe1-04f7-467c-906a-af66b199f0b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:12.454964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4202afe1-04f7-467c-906a-af66b199f0b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:12.455674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4202afe1-04f7-467c-906a-af66b199f0b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:12.456214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4202afe1-04f7-467c-906a-af66b199f0b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:12.456648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4202afe1-04f7-467c-906a-af66b199f0b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:12.607465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4202afe1-04f7-467c-906a-af66b199f0b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:12.616250 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4202afe1-04f7-467c-906a-af66b199f0b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1376 microversion: 2.1 time: 0.174521 Oct 24 11:16:12.616894 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3404/6782] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:12 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1376 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:16:13.639600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a4fbd2d-0982-492c-943f-0eee68b581a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:13.640316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0a4fbd2d-0982-492c-943f-0eee68b581a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:13.648034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a4fbd2d-0982-492c-943f-0eee68b581a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:13.648513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a4fbd2d-0982-492c-943f-0eee68b581a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:13.649012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a4fbd2d-0982-492c-943f-0eee68b581a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:13.649996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a4fbd2d-0982-492c-943f-0eee68b581a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:13.650512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a4fbd2d-0982-492c-943f-0eee68b581a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:13.650963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a4fbd2d-0982-492c-943f-0eee68b581a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:13.785373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0a4fbd2d-0982-492c-943f-0eee68b581a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:13.793530 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0a4fbd2d-0982-492c-943f-0eee68b581a7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1376 microversion: 2.1 time: 0.158691 Oct 24 11:16:13.794250 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3379/6783] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:13 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:14.622063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-efea5656-0dd9-454a-8659-417d657485f1 req-0f27c49e-b0d2-43dd-bb0c-8599b0c7500c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1922b6cf-5941-457b-89e4-005960357887", "name": "network-vif-plugged", "status": "completed", "tag": "12365ded-53ec-4d90-9857-981b4a661f4e"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:16:14.634064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-efea5656-0dd9-454a-8659-417d657485f1 req-0f27c49e-b0d2-43dd-bb0c-8599b0c7500c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:14.634504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-efea5656-0dd9-454a-8659-417d657485f1 req-0f27c49e-b0d2-43dd-bb0c-8599b0c7500c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:14.634994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-efea5656-0dd9-454a-8659-417d657485f1 req-0f27c49e-b0d2-43dd-bb0c-8599b0c7500c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:14.648564 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-efea5656-0dd9-454a-8659-417d657485f1 req-0f27c49e-b0d2-43dd-bb0c-8599b0c7500c service nova] Creating event network-vif-plugged:12365ded-53ec-4d90-9857-981b4a661f4e for instance 1922b6cf-5941-457b-89e4-005960357887 on n-h2-858383-15 Oct 24 11:16:14.655265 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-efea5656-0dd9-454a-8659-417d657485f1 req-0f27c49e-b0d2-43dd-bb0c-8599b0c7500c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036846 Oct 24 11:16:14.656173 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3405/6784] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:16:14.820142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a7950677-1177-4484-8e40-518f663c7acb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:14.820142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a7950677-1177-4484-8e40-518f663c7acb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:14.827045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7950677-1177-4484-8e40-518f663c7acb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:14.827554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7950677-1177-4484-8e40-518f663c7acb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:14.828077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7950677-1177-4484-8e40-518f663c7acb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:14.828888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7950677-1177-4484-8e40-518f663c7acb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:14.830137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7950677-1177-4484-8e40-518f663c7acb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:14.830906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7950677-1177-4484-8e40-518f663c7acb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:14.975004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a7950677-1177-4484-8e40-518f663c7acb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:14.984469 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a7950677-1177-4484-8e40-518f663c7acb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1376 microversion: 2.1 time: 0.170440 Oct 24 11:16:14.985306 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3380/6785] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:14 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1376 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:16.013530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-768bae98-9667-425c-88dc-228397349c84 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:16.014667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-768bae98-9667-425c-88dc-228397349c84 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:16.022866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-768bae98-9667-425c-88dc-228397349c84 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:16.023352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-768bae98-9667-425c-88dc-228397349c84 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:16.023949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-768bae98-9667-425c-88dc-228397349c84 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:16.025179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-768bae98-9667-425c-88dc-228397349c84 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:16.025779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-768bae98-9667-425c-88dc-228397349c84 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:16.026285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-768bae98-9667-425c-88dc-228397349c84 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:16.179635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-768bae98-9667-425c-88dc-228397349c84 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:16.187575 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-768bae98-9667-425c-88dc-228397349c84 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1563 microversion: 2.1 time: 0.181284 Oct 24 11:16:16.188147 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3406/6786] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:16 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1563 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:16.210505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1129693e-431a-47bc-8698-1fddf7cad9ec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:16.211140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1129693e-431a-47bc-8698-1fddf7cad9ec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:16.217825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1129693e-431a-47bc-8698-1fddf7cad9ec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:16.218323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1129693e-431a-47bc-8698-1fddf7cad9ec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:16.218780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1129693e-431a-47bc-8698-1fddf7cad9ec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:16.219491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1129693e-431a-47bc-8698-1fddf7cad9ec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:16.220025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1129693e-431a-47bc-8698-1fddf7cad9ec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:16.220474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1129693e-431a-47bc-8698-1fddf7cad9ec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:16.349982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1129693e-431a-47bc-8698-1fddf7cad9ec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:16.357763 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1129693e-431a-47bc-8698-1fddf7cad9ec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1563 microversion: 2.1 time: 0.151159 Oct 24 11:16:16.358342 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3381/6787] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:16 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:16.440142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3f94227a-2839-4f45-b4cd-7bc6b579cfcd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:16.440642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3f94227a-2839-4f45-b4cd-7bc6b579cfcd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:16.446640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f94227a-2839-4f45-b4cd-7bc6b579cfcd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:16.447145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f94227a-2839-4f45-b4cd-7bc6b579cfcd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:16.447582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f94227a-2839-4f45-b4cd-7bc6b579cfcd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:16.448268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f94227a-2839-4f45-b4cd-7bc6b579cfcd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:16.448720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f94227a-2839-4f45-b4cd-7bc6b579cfcd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:16.449175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f94227a-2839-4f45-b4cd-7bc6b579cfcd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:16.477698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3f94227a-2839-4f45-b4cd-7bc6b579cfcd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:16:16.555241 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3f94227a-2839-4f45-b4cd-7bc6b579cfcd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 204 len: 0 microversion: 2.1 time: 0.119281 Oct 24 11:16:16.555854 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3407/6788] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:16:16 2022] DELETE /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:16:16.564942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-debb24ee-3c4b-43be-ad1a-f99943867d0b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:16.565554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-debb24ee-3c4b-43be-ad1a-f99943867d0b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:16.573617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-debb24ee-3c4b-43be-ad1a-f99943867d0b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:16.574227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-debb24ee-3c4b-43be-ad1a-f99943867d0b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:16.574835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-debb24ee-3c4b-43be-ad1a-f99943867d0b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:16.575806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-debb24ee-3c4b-43be-ad1a-f99943867d0b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:16.576542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-debb24ee-3c4b-43be-ad1a-f99943867d0b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:16.577332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-debb24ee-3c4b-43be-ad1a-f99943867d0b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:16.725090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-debb24ee-3c4b-43be-ad1a-f99943867d0b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:16.734460 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-debb24ee-3c4b-43be-ad1a-f99943867d0b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1569 microversion: 2.1 time: 0.174093 Oct 24 11:16:16.735084 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3382/6789] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:16 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:17.760722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-71d5730e-9235-4833-adf8-259913ef3bbc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:17.761463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-71d5730e-9235-4833-adf8-259913ef3bbc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:17.769190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71d5730e-9235-4833-adf8-259913ef3bbc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:17.769671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71d5730e-9235-4833-adf8-259913ef3bbc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:17.770107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71d5730e-9235-4833-adf8-259913ef3bbc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:17.770792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71d5730e-9235-4833-adf8-259913ef3bbc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:17.771241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71d5730e-9235-4833-adf8-259913ef3bbc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:17.771663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71d5730e-9235-4833-adf8-259913ef3bbc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:17.901439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-71d5730e-9235-4833-adf8-259913ef3bbc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:17.909878 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-71d5730e-9235-4833-adf8-259913ef3bbc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1569 microversion: 2.1 time: 0.153362 Oct 24 11:16:17.910457 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3408/6790] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:17 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:18.675629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-cfb4843a-c0a0-44d2-b7ad-2db4e473fda6 req-cc3deb0e-58fb-4a0a-80a3-58def682d337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1922b6cf-5941-457b-89e4-005960357887", "name": "network-vif-deleted", "tag": "12365ded-53ec-4d90-9857-981b4a661f4e"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:16:18.691662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cfb4843a-c0a0-44d2-b7ad-2db4e473fda6 req-cc3deb0e-58fb-4a0a-80a3-58def682d337 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:18.692404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cfb4843a-c0a0-44d2-b7ad-2db4e473fda6 req-cc3deb0e-58fb-4a0a-80a3-58def682d337 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:18.692878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cfb4843a-c0a0-44d2-b7ad-2db4e473fda6 req-cc3deb0e-58fb-4a0a-80a3-58def682d337 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:18.709659 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-cfb4843a-c0a0-44d2-b7ad-2db4e473fda6 req-cc3deb0e-58fb-4a0a-80a3-58def682d337 service nova] Creating event network-vif-deleted:12365ded-53ec-4d90-9857-981b4a661f4e for instance 1922b6cf-5941-457b-89e4-005960357887 on n-h2-858383-15 Oct 24 11:16:18.715731 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-cfb4843a-c0a0-44d2-b7ad-2db4e473fda6 req-cc3deb0e-58fb-4a0a-80a3-58def682d337 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044399 Oct 24 11:16:18.716429 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3383/6791] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:16:18.933794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-204eea70-1e89-4403-851b-e90034fe276c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:18.934411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-204eea70-1e89-4403-851b-e90034fe276c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:18.941383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-204eea70-1e89-4403-851b-e90034fe276c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:18.941911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-204eea70-1e89-4403-851b-e90034fe276c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:18.942295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-204eea70-1e89-4403-851b-e90034fe276c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:18.942986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-204eea70-1e89-4403-851b-e90034fe276c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:18.943434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-204eea70-1e89-4403-851b-e90034fe276c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:18.943857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-204eea70-1e89-4403-851b-e90034fe276c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:19.011805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-204eea70-1e89-4403-851b-e90034fe276c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:19.020403 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-204eea70-1e89-4403-851b-e90034fe276c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1361 microversion: 2.1 time: 0.090531 Oct 24 11:16:19.020997 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3409/6792] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:18 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1361 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:16:20.046069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-32a806e4-722a-46d8-93d5-77ce5820b953 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:20.046804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-32a806e4-722a-46d8-93d5-77ce5820b953 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:20.056772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32a806e4-722a-46d8-93d5-77ce5820b953 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:20.057318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32a806e4-722a-46d8-93d5-77ce5820b953 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:20.057958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32a806e4-722a-46d8-93d5-77ce5820b953 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:20.058525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32a806e4-722a-46d8-93d5-77ce5820b953 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:20.059302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32a806e4-722a-46d8-93d5-77ce5820b953 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:20.060115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32a806e4-722a-46d8-93d5-77ce5820b953 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:20.128567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-32a806e4-722a-46d8-93d5-77ce5820b953 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:20.136813 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-32a806e4-722a-46d8-93d5-77ce5820b953 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1361 microversion: 2.1 time: 0.095959 Oct 24 11:16:20.137430 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3384/6793] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:20 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1361 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:21.161256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c3933795-0b25-473f-9639-a38c834be729 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:21.161909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c3933795-0b25-473f-9639-a38c834be729 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:21.169045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3933795-0b25-473f-9639-a38c834be729 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:21.169535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3933795-0b25-473f-9639-a38c834be729 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:21.169984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3933795-0b25-473f-9639-a38c834be729 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:21.170697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3933795-0b25-473f-9639-a38c834be729 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:21.171155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3933795-0b25-473f-9639-a38c834be729 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:21.171586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c3933795-0b25-473f-9639-a38c834be729 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:21.236645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c3933795-0b25-473f-9639-a38c834be729 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:21.244523 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c3933795-0b25-473f-9639-a38c834be729 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1361 microversion: 2.1 time: 0.087759 Oct 24 11:16:21.245135 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3410/6794] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:21 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1361 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:22.268493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d336d0eb-7998-4b86-887c-7c89a527639a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:22.269121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d336d0eb-7998-4b86-887c-7c89a527639a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:22.277122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d336d0eb-7998-4b86-887c-7c89a527639a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:22.277629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d336d0eb-7998-4b86-887c-7c89a527639a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:22.278086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d336d0eb-7998-4b86-887c-7c89a527639a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:22.278833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d336d0eb-7998-4b86-887c-7c89a527639a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:22.279307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d336d0eb-7998-4b86-887c-7c89a527639a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:22.279755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d336d0eb-7998-4b86-887c-7c89a527639a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:22.351122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d336d0eb-7998-4b86-887c-7c89a527639a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:22.359115 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d336d0eb-7998-4b86-887c-7c89a527639a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1361 microversion: 2.1 time: 0.095482 Oct 24 11:16:22.359913 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3385/6795] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:22 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1361 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:23.382018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1d9bdd1c-6a3c-4b23-b5ba-16dc9bf9ecd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:23.382594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1d9bdd1c-6a3c-4b23-b5ba-16dc9bf9ecd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:23.390726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d9bdd1c-6a3c-4b23-b5ba-16dc9bf9ecd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:23.391199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d9bdd1c-6a3c-4b23-b5ba-16dc9bf9ecd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:23.392513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d9bdd1c-6a3c-4b23-b5ba-16dc9bf9ecd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:23.393249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d9bdd1c-6a3c-4b23-b5ba-16dc9bf9ecd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:23.393882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d9bdd1c-6a3c-4b23-b5ba-16dc9bf9ecd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:23.394499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d9bdd1c-6a3c-4b23-b5ba-16dc9bf9ecd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:23.431949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d9bdd1c-6a3c-4b23-b5ba-16dc9bf9ecd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:23.432440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d9bdd1c-6a3c-4b23-b5ba-16dc9bf9ecd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:23.433093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d9bdd1c-6a3c-4b23-b5ba-16dc9bf9ecd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:23.433714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-1d9bdd1c-6a3c-4b23-b5ba-16dc9bf9ecd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lazy-loading 'fault' on Instance uuid 1922b6cf-5941-457b-89e4-005960357887 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:16:23.482911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1d9bdd1c-6a3c-4b23-b5ba-16dc9bf9ecd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:23.491357 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1d9bdd1c-6a3c-4b23-b5ba-16dc9bf9ecd5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 200 len: 1320 microversion: 2.1 time: 0.113318 Oct 24 11:16:23.491960 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3411/6796] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:23 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 1320 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:16:24.515408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-403ef638-1343-49be-be42-2afbd4a593ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:24.516060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-403ef638-1343-49be-be42-2afbd4a593ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:24.524341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-403ef638-1343-49be-be42-2afbd4a593ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:24.524944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-403ef638-1343-49be-be42-2afbd4a593ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:24.525461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-403ef638-1343-49be-be42-2afbd4a593ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:24.526171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-403ef638-1343-49be-be42-2afbd4a593ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:24.526773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-403ef638-1343-49be-be42-2afbd4a593ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:24.527254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-403ef638-1343-49be-be42-2afbd4a593ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:24.544416 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-403ef638-1343-49be-be42-2afbd4a593ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] HTTP exception thrown: Instance 1922b6cf-5941-457b-89e4-005960357887 could not be found. Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-403ef638-1343-49be-be42-2afbd4a593ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Request method failure captured: Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 HTTP/1.1 Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnM2OqlSOkhfxDfVEeTT94IwX8qn5k49naomhNLud1uic_lKwej-RJQ1PZooBFuUMpS4DQEMNgRR3ENofPbDmyI7Cy_YSVUuCsvfRNdcFM4T5H_sDbiD3-ZTRmSQR0yoz-aOqM9u5ViLunGIsswJX3XnF9XyVytj9jbL6H3Gm1Ht-2Q Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7643b3a05e304f89a945f512536e2df6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ea036c351f864bd0bb927e15e897c9e3 Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 1922b6cf-5941-457b-89e4-005960357887 could not be found. Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '1922b6cf-5941-457b-89e4-005960357887'} Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1922b6cf-5941-457b-89e4-005960357887 could not be found. Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1922b6cf-5941-457b-89e4-005960357887 could not be found. Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:16:24.546335 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:24.551405 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:16:24.551405 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:16:24.551405 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:16:24.551405 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:16:24.551405 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:16:24.551405 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1922b6cf-5941-457b-89e4-005960357887 could not be found. Oct 24 11:16:24.551405 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:24.551405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-403ef638-1343-49be-be42-2afbd4a593ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Returning 404 to user: Instance 1922b6cf-5941-457b-89e4-005960357887 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:16:24.551405 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-403ef638-1343-49be-be42-2afbd4a593ef tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 404 len: 111 microversion: 2.1 time: 0.036999 Oct 24 11:16:24.551405 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3386/6797] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:24 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:16:28.853550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9bbcf619-843e-4896-975a-dca83e1e1e30 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:28.854344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9bbcf619-843e-4896-975a-dca83e1e1e30 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:28.857634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:16:28.864790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bbcf619-843e-4896-975a-dca83e1e1e30 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:28.865400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bbcf619-843e-4896-975a-dca83e1e1e30 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:28.865839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bbcf619-843e-4896-975a-dca83e1e1e30 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:28.866583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bbcf619-843e-4896-975a-dca83e1e1e30 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:28.867037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bbcf619-843e-4896-975a-dca83e1e1e30 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:28.867505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bbcf619-843e-4896-975a-dca83e1e1e30 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:28.873781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:16:28.909434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9bbcf619-843e-4896-975a-dca83e1e1e30 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:16:29.008677 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9bbcf619-843e-4896-975a-dca83e1e1e30 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 204 len: 0 microversion: 2.1 time: 0.159605 Oct 24 11:16:29.009706 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3412/6798] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:16:28 2022] DELETE /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:16:29.018470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1e30133e-435f-4882-8362-51ab58c9cec4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:29.019413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1e30133e-435f-4882-8362-51ab58c9cec4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:29.022857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=30 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:16:29.030441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e30133e-435f-4882-8362-51ab58c9cec4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:29.030961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e30133e-435f-4882-8362-51ab58c9cec4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:29.031421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e30133e-435f-4882-8362-51ab58c9cec4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:29.032992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e30133e-435f-4882-8362-51ab58c9cec4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:29.033605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e30133e-435f-4882-8362-51ab58c9cec4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:29.034067 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1e30133e-435f-4882-8362-51ab58c9cec4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:29.040046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=82 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:16:29.190097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1e30133e-435f-4882-8362-51ab58c9cec4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:29.201608 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1e30133e-435f-4882-8362-51ab58c9cec4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1410 microversion: 2.1 time: 0.187915 Oct 24 11:16:29.202195 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3387/6799] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:29 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1410 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:30.227041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fb62fd6d-8530-4a78-b237-aff324f04719 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:30.227775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fb62fd6d-8530-4a78-b237-aff324f04719 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:30.234589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb62fd6d-8530-4a78-b237-aff324f04719 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:30.235170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb62fd6d-8530-4a78-b237-aff324f04719 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:30.235831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb62fd6d-8530-4a78-b237-aff324f04719 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:30.236529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb62fd6d-8530-4a78-b237-aff324f04719 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:30.237031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb62fd6d-8530-4a78-b237-aff324f04719 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:30.237464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb62fd6d-8530-4a78-b237-aff324f04719 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:30.367438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fb62fd6d-8530-4a78-b237-aff324f04719 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:30.375224 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fb62fd6d-8530-4a78-b237-aff324f04719 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1410 microversion: 2.1 time: 0.152509 Oct 24 11:16:30.376347 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3413/6800] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:30 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1410 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:31.251470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-beaaf221-7df5-4b61-8ca8-902875660a73 req-1c2b29fa-9c65-4382-8fe4-fde94ce622b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85ba5cc-e982-426e-bc88-6fe3f683e9f2", "name": "network-vif-deleted", "tag": "45cf644f-4b17-4480-b979-cac84b1b82b2"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:16:31.263237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-beaaf221-7df5-4b61-8ca8-902875660a73 req-1c2b29fa-9c65-4382-8fe4-fde94ce622b6 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:31.263741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-beaaf221-7df5-4b61-8ca8-902875660a73 req-1c2b29fa-9c65-4382-8fe4-fde94ce622b6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:31.264194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-beaaf221-7df5-4b61-8ca8-902875660a73 req-1c2b29fa-9c65-4382-8fe4-fde94ce622b6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:31.277604 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-beaaf221-7df5-4b61-8ca8-902875660a73 req-1c2b29fa-9c65-4382-8fe4-fde94ce622b6 service nova] Creating event network-vif-deleted:45cf644f-4b17-4480-b979-cac84b1b82b2 for instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 on n-h1-858383-15 Oct 24 11:16:31.284396 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-beaaf221-7df5-4b61-8ca8-902875660a73 req-1c2b29fa-9c65-4382-8fe4-fde94ce622b6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036669 Oct 24 11:16:31.285246 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3388/6801] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:16:31.400575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-53601e72-eeb1-4439-a1b1-da90ee8d6c41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:31.401759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-53601e72-eeb1-4439-a1b1-da90ee8d6c41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:31.410094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53601e72-eeb1-4439-a1b1-da90ee8d6c41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:31.410586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53601e72-eeb1-4439-a1b1-da90ee8d6c41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:31.411066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53601e72-eeb1-4439-a1b1-da90ee8d6c41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:31.411780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53601e72-eeb1-4439-a1b1-da90ee8d6c41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:31.412233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53601e72-eeb1-4439-a1b1-da90ee8d6c41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:31.412660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53601e72-eeb1-4439-a1b1-da90ee8d6c41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:31.484985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-53601e72-eeb1-4439-a1b1-da90ee8d6c41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:31.492944 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-53601e72-eeb1-4439-a1b1-da90ee8d6c41 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1202 microversion: 2.1 time: 0.098358 Oct 24 11:16:31.493517 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3414/6802] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:31 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1202 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:32.518778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a48d66b2-7cee-4643-b090-fdd93a725b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:32.519491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a48d66b2-7cee-4643-b090-fdd93a725b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:32.525968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a48d66b2-7cee-4643-b090-fdd93a725b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:32.526467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a48d66b2-7cee-4643-b090-fdd93a725b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:32.526916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a48d66b2-7cee-4643-b090-fdd93a725b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:32.527621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a48d66b2-7cee-4643-b090-fdd93a725b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:32.528091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a48d66b2-7cee-4643-b090-fdd93a725b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:32.528534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a48d66b2-7cee-4643-b090-fdd93a725b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:32.591740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a48d66b2-7cee-4643-b090-fdd93a725b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:32.600018 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a48d66b2-7cee-4643-b090-fdd93a725b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1202 microversion: 2.1 time: 0.087314 Oct 24 11:16:32.600611 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3389/6803] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:32 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:33.622795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cf6d3063-c7d3-4475-8f14-716406d25a1b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:33.623428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cf6d3063-c7d3-4475-8f14-716406d25a1b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:33.631768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf6d3063-c7d3-4475-8f14-716406d25a1b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:33.632189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf6d3063-c7d3-4475-8f14-716406d25a1b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:33.632632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf6d3063-c7d3-4475-8f14-716406d25a1b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:33.633377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf6d3063-c7d3-4475-8f14-716406d25a1b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:33.633839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf6d3063-c7d3-4475-8f14-716406d25a1b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:33.634271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf6d3063-c7d3-4475-8f14-716406d25a1b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:33.701044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cf6d3063-c7d3-4475-8f14-716406d25a1b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:33.709825 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cf6d3063-c7d3-4475-8f14-716406d25a1b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1202 microversion: 2.1 time: 0.090953 Oct 24 11:16:33.710738 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3415/6804] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:33 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1202 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:34.733298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e419ffd6-2234-4a55-b53f-9af19ea72f59 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:34.733813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e419ffd6-2234-4a55-b53f-9af19ea72f59 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:34.741543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e419ffd6-2234-4a55-b53f-9af19ea72f59 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:34.742043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e419ffd6-2234-4a55-b53f-9af19ea72f59 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:34.742506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e419ffd6-2234-4a55-b53f-9af19ea72f59 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:34.743220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e419ffd6-2234-4a55-b53f-9af19ea72f59 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:34.743691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e419ffd6-2234-4a55-b53f-9af19ea72f59 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:34.744135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e419ffd6-2234-4a55-b53f-9af19ea72f59 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:34.808234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e419ffd6-2234-4a55-b53f-9af19ea72f59 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:34.816746 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e419ffd6-2234-4a55-b53f-9af19ea72f59 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1202 microversion: 2.1 time: 0.087608 Oct 24 11:16:34.817355 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3390/6805] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:34 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:16:35.839941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7c88d7d3-8f91-4c80-af3d-9457cd1ed59a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:35.841214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7c88d7d3-8f91-4c80-af3d-9457cd1ed59a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:35.848166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c88d7d3-8f91-4c80-af3d-9457cd1ed59a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:35.848662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c88d7d3-8f91-4c80-af3d-9457cd1ed59a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:35.849144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c88d7d3-8f91-4c80-af3d-9457cd1ed59a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:35.850035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c88d7d3-8f91-4c80-af3d-9457cd1ed59a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:35.850503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c88d7d3-8f91-4c80-af3d-9457cd1ed59a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:35.850938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c88d7d3-8f91-4c80-af3d-9457cd1ed59a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:35.887180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c88d7d3-8f91-4c80-af3d-9457cd1ed59a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:35.887672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c88d7d3-8f91-4c80-af3d-9457cd1ed59a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:35.888118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7c88d7d3-8f91-4c80-af3d-9457cd1ed59a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:35.888663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-7c88d7d3-8f91-4c80-af3d-9457cd1ed59a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lazy-loading 'fault' on Instance uuid d85ba5cc-e982-426e-bc88-6fe3f683e9f2 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:16:35.934471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7c88d7d3-8f91-4c80-af3d-9457cd1ed59a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:35.945890 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7c88d7d3-8f91-4c80-af3d-9457cd1ed59a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 200 len: 1161 microversion: 2.1 time: 0.110183 Oct 24 11:16:35.946484 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3416/6806] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:35 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 1161 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:36.970754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7e45d760-31ef-4891-b856-b69ba2e9eb19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:36.971387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7e45d760-31ef-4891-b856-b69ba2e9eb19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:36.978353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e45d760-31ef-4891-b856-b69ba2e9eb19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:36.978857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e45d760-31ef-4891-b856-b69ba2e9eb19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:36.979315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e45d760-31ef-4891-b856-b69ba2e9eb19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:36.980037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e45d760-31ef-4891-b856-b69ba2e9eb19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:36.980513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e45d760-31ef-4891-b856-b69ba2e9eb19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:36.980992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7e45d760-31ef-4891-b856-b69ba2e9eb19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:36.997522 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-7e45d760-31ef-4891-b856-b69ba2e9eb19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] HTTP exception thrown: Instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 could not be found. Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7e45d760-31ef-4891-b856-b69ba2e9eb19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Request method failure captured: Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 HTTP/1.1 Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnM2OqlSOkhfxDfVEeTT94IwX8qn5k49naomhNLud1uic_lKwej-RJQ1PZooBFuUMpS4DQEMNgRR3ENofPbDmyI7Cy_YSVUuCsvfRNdcFM4T5H_sDbiD3-ZTRmSQR0yoz-aOqM9u5ViLunGIsswJX3XnF9XyVytj9jbL6H3Gm1Ht-2Q Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7643b3a05e304f89a945f512536e2df6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ea036c351f864bd0bb927e15e897c9e3 Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 could not be found. Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'd85ba5cc-e982-426e-bc88-6fe3f683e9f2'} Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 could not be found. Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 could not be found. Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:16:36.999193 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:37.003770 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:16:37.003770 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:16:37.003770 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:16:37.003770 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:16:37.003770 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:16:37.003770 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 could not be found. Oct 24 11:16:37.003770 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:37.003770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7e45d760-31ef-4891-b856-b69ba2e9eb19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Returning 404 to user: Instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:16:37.003770 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7e45d760-31ef-4891-b856-b69ba2e9eb19 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 404 len: 111 microversion: 2.1 time: 0.034558 Oct 24 11:16:37.003770 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3391/6807] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:36 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 11:16:38.092037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-44d3147b-c587-45ed-9fd9-12f00141a1bd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:38.092546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-44d3147b-c587-45ed-9fd9-12f00141a1bd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:38.099402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44d3147b-c587-45ed-9fd9-12f00141a1bd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:38.099889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44d3147b-c587-45ed-9fd9-12f00141a1bd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:38.100335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44d3147b-c587-45ed-9fd9-12f00141a1bd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:38.101074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44d3147b-c587-45ed-9fd9-12f00141a1bd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:38.101536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44d3147b-c587-45ed-9fd9-12f00141a1bd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:38.101970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44d3147b-c587-45ed-9fd9-12f00141a1bd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:38.115695 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-44d3147b-c587-45ed-9fd9-12f00141a1bd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] HTTP exception thrown: Instance 1922b6cf-5941-457b-89e4-005960357887 could not be found. Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-44d3147b-c587-45ed-9fd9-12f00141a1bd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Request method failure captured: Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 HTTP/1.1 Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnM2OqlSOkhfxDfVEeTT94IwX8qn5k49naomhNLud1uic_lKwej-RJQ1PZooBFuUMpS4DQEMNgRR3ENofPbDmyI7Cy_YSVUuCsvfRNdcFM4T5H_sDbiD3-ZTRmSQR0yoz-aOqM9u5ViLunGIsswJX3XnF9XyVytj9jbL6H3Gm1Ht-2Q Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7643b3a05e304f89a945f512536e2df6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ea036c351f864bd0bb927e15e897c9e3 Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 1922b6cf-5941-457b-89e4-005960357887 could not be found. Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '1922b6cf-5941-457b-89e4-005960357887'} Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1922b6cf-5941-457b-89e4-005960357887 could not be found. Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:16:38.117426 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:16:38.121438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1922b6cf-5941-457b-89e4-005960357887 could not be found. Oct 24 11:16:38.121438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.121438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:16:38.121438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.121438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:16:38.121438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:16:38.121438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:16:38.121438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:16:38.121438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:16:38.121438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1922b6cf-5941-457b-89e4-005960357887 could not be found. Oct 24 11:16:38.121438 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.121438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-44d3147b-c587-45ed-9fd9-12f00141a1bd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Returning 404 to user: Instance 1922b6cf-5941-457b-89e4-005960357887 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:16:38.121438 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-44d3147b-c587-45ed-9fd9-12f00141a1bd tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 404 len: 111 microversion: 2.1 time: 0.030833 Oct 24 11:16:38.121438 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3417/6808] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:16:38 2022] DELETE /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:16:38.129389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab9347ec-dee2-4657-a33d-833f362f78a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:38.130123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ab9347ec-dee2-4657-a33d-833f362f78a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 1922b6cf-5941-457b-89e4-005960357887] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:38.137342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab9347ec-dee2-4657-a33d-833f362f78a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:38.137914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab9347ec-dee2-4657-a33d-833f362f78a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:38.138439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab9347ec-dee2-4657-a33d-833f362f78a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:38.139239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab9347ec-dee2-4657-a33d-833f362f78a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:38.139785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab9347ec-dee2-4657-a33d-833f362f78a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:38.140296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab9347ec-dee2-4657-a33d-833f362f78a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:38.155667 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-ab9347ec-dee2-4657-a33d-833f362f78a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] HTTP exception thrown: Instance 1922b6cf-5941-457b-89e4-005960357887 could not be found. Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab9347ec-dee2-4657-a33d-833f362f78a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Request method failure captured: Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 HTTP/1.1 Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnM2OqlSOkhfxDfVEeTT94IwX8qn5k49naomhNLud1uic_lKwej-RJQ1PZooBFuUMpS4DQEMNgRR3ENofPbDmyI7Cy_YSVUuCsvfRNdcFM4T5H_sDbiD3-ZTRmSQR0yoz-aOqM9u5ViLunGIsswJX3XnF9XyVytj9jbL6H3Gm1Ht-2Q Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7643b3a05e304f89a945f512536e2df6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ea036c351f864bd0bb927e15e897c9e3 Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 1922b6cf-5941-457b-89e4-005960357887 could not be found. Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '1922b6cf-5941-457b-89e4-005960357887'} Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1922b6cf-5941-457b-89e4-005960357887 could not be found. Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1922b6cf-5941-457b-89e4-005960357887 could not be found. Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:16:38.157712 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.162065 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:16:38.162065 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:16:38.162065 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:16:38.162065 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:16:38.162065 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:16:38.162065 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1922b6cf-5941-457b-89e4-005960357887 could not be found. Oct 24 11:16:38.162065 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.162065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab9347ec-dee2-4657-a33d-833f362f78a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Returning 404 to user: Instance 1922b6cf-5941-457b-89e4-005960357887 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:16:38.162065 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ab9347ec-dee2-4657-a33d-833f362f78a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887" status: 404 len: 111 microversion: 2.1 time: 0.037214 Oct 24 11:16:38.162845 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3392/6809] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:38 2022] GET /compute/v2.1/servers/1922b6cf-5941-457b-89e4-005960357887 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:16:38.525373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c5ec1bb2-f2b9-4139-b26e-2d4e8442d6a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:38.525996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c5ec1bb2-f2b9-4139-b26e-2d4e8442d6a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:38.532458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5ec1bb2-f2b9-4139-b26e-2d4e8442d6a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:38.532996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5ec1bb2-f2b9-4139-b26e-2d4e8442d6a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:38.533445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5ec1bb2-f2b9-4139-b26e-2d4e8442d6a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:38.534157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5ec1bb2-f2b9-4139-b26e-2d4e8442d6a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:38.534619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5ec1bb2-f2b9-4139-b26e-2d4e8442d6a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:38.535048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5ec1bb2-f2b9-4139-b26e-2d4e8442d6a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:38.550156 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-c5ec1bb2-f2b9-4139-b26e-2d4e8442d6a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] HTTP exception thrown: Instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 could not be found. Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c5ec1bb2-f2b9-4139-b26e-2d4e8442d6a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Request method failure captured: Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 HTTP/1.1 Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnM2OqlSOkhfxDfVEeTT94IwX8qn5k49naomhNLud1uic_lKwej-RJQ1PZooBFuUMpS4DQEMNgRR3ENofPbDmyI7Cy_YSVUuCsvfRNdcFM4T5H_sDbiD3-ZTRmSQR0yoz-aOqM9u5ViLunGIsswJX3XnF9XyVytj9jbL6H3Gm1Ht-2Q Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7643b3a05e304f89a945f512536e2df6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ea036c351f864bd0bb927e15e897c9e3 Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 could not be found. Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'd85ba5cc-e982-426e-bc88-6fe3f683e9f2'} Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 could not be found. Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:16:38.551721 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:16:38.555768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 could not be found. Oct 24 11:16:38.555768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.555768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:16:38.555768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.555768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:16:38.555768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:16:38.555768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:16:38.555768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:16:38.555768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:16:38.555768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 could not be found. Oct 24 11:16:38.555768 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.555768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c5ec1bb2-f2b9-4139-b26e-2d4e8442d6a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Returning 404 to user: Instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:16:38.555768 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c5ec1bb2-f2b9-4139-b26e-2d4e8442d6a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 404 len: 111 microversion: 2.1 time: 0.032009 Oct 24 11:16:38.555768 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3418/6810] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:16:38 2022] DELETE /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:16:38.562106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d02a69df-2c36-438b-956a-e38280a1945e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:38.562792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d02a69df-2c36-438b-956a-e38280a1945e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: d85ba5cc-e982-426e-bc88-6fe3f683e9f2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:38.568771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d02a69df-2c36-438b-956a-e38280a1945e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:38.569379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d02a69df-2c36-438b-956a-e38280a1945e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:38.569833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d02a69df-2c36-438b-956a-e38280a1945e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:38.570540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d02a69df-2c36-438b-956a-e38280a1945e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:38.571010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d02a69df-2c36-438b-956a-e38280a1945e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:38.571451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d02a69df-2c36-438b-956a-e38280a1945e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:38.585172 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-d02a69df-2c36-438b-956a-e38280a1945e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] HTTP exception thrown: Instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 could not be found. Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d02a69df-2c36-438b-956a-e38280a1945e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Request method failure captured: Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 HTTP/1.1 Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnM2OqlSOkhfxDfVEeTT94IwX8qn5k49naomhNLud1uic_lKwej-RJQ1PZooBFuUMpS4DQEMNgRR3ENofPbDmyI7Cy_YSVUuCsvfRNdcFM4T5H_sDbiD3-ZTRmSQR0yoz-aOqM9u5ViLunGIsswJX3XnF9XyVytj9jbL6H3Gm1Ht-2Q Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7643b3a05e304f89a945f512536e2df6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ea036c351f864bd0bb927e15e897c9e3 Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 could not be found. Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'd85ba5cc-e982-426e-bc88-6fe3f683e9f2'} Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 could not be found. Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 could not be found. Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:16:38.586735 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.590969 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:16:38.590969 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:16:38.590969 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:16:38.590969 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:16:38.590969 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:16:38.590969 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 could not be found. Oct 24 11:16:38.590969 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:16:38.590969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d02a69df-2c36-438b-956a-e38280a1945e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Returning 404 to user: Instance d85ba5cc-e982-426e-bc88-6fe3f683e9f2 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:16:38.590969 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d02a69df-2c36-438b-956a-e38280a1945e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2" status: 404 len: 111 microversion: 2.1 time: 0.030005 Oct 24 11:16:38.590969 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3393/6811] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:38 2022] GET /compute/v2.1/servers/d85ba5cc-e982-426e-bc88-6fe3f683e9f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:16:38.662967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a2547049-8850-4ddd-bd56-bca8dc4268ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Action: 'create', calling method: .version_select at 0x7f04d0e44a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1448891001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4sDwcDieH0U045VJTPrehNjBI6wi3gicGnYDHGjdi8Ln94xMD6Gnibk+qviPZ/7Bm1yXiR/NkIsBNEvh6ys6bIYU61WMfAAAc40xWITyF/yBUBtbJup75qpMch99pvRw=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:16:38.679919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-a2547049-8850-4ddd-bd56-bca8dc4268ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Getting quotas for project 7643b3a05e304f89a945f512536e2df6. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:16:38.685382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-a2547049-8850-4ddd-bd56-bca8dc4268ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Getting quotas for user ea036c351f864bd0bb927e15e897c9e3 and project 7643b3a05e304f89a945f512536e2df6. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:16:38.699298 n-d-858383-15 devstack@n-api.service[120426]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a2547049-8850-4ddd-bd56-bca8dc4268ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [2660e984-5ff8-4471-bc8f-cfede2631425] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 11:16:39.711304 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [None req-a2547049-8850-4ddd-bd56-bca8dc4268ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [2660e984-5ff8-4471-bc8f-cfede2631425] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 46626. Oct 24 11:16:39.727860 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a2547049-8850-4ddd-bd56-bca8dc4268ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.068781 Oct 24 11:16:39.728581 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3419/6812] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:16:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:16:55.944449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5c4c2c37-d8d6-4748-867f-82a0ad54925c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-671175076", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1448891001", "security_groups": [{"name": "tempest-secgroup-smoke-43606284"}], "block_device_mapping_v2": [{"uuid": "a88a78e0-e3d8-4597-b2c8-a11c29fcf6d9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fd5ed2ae-44e8-4a94-8b2b-fd64f1a0661a"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:16:55.955785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=13 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:16:55.956568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=25 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:16:56.058654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-5c4c2c37-d8d6-4748-867f-82a0ad54925c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] validate_networks() for [('fd5ed2ae-44e8-4a94-8b2b-fd64f1a0661a', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:16:56.428790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5c4c2c37-d8d6-4748-867f-82a0ad54925c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:16:56.429277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5c4c2c37-d8d6-4748-867f-82a0ad54925c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:16:56.429779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5c4c2c37-d8d6-4748-867f-82a0ad54925c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:16:56.430207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5c4c2c37-d8d6-4748-867f-82a0ad54925c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:16:56.430640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5c4c2c37-d8d6-4748-867f-82a0ad54925c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:16:56.439510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c4c2c37-d8d6-4748-867f-82a0ad54925c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:56.440019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c4c2c37-d8d6-4748-867f-82a0ad54925c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:56.440479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c4c2c37-d8d6-4748-867f-82a0ad54925c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:56.441271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c4c2c37-d8d6-4748-867f-82a0ad54925c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:56.441752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c4c2c37-d8d6-4748-867f-82a0ad54925c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:56.442226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c4c2c37-d8d6-4748-867f-82a0ad54925c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:56.460024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-5c4c2c37-d8d6-4748-867f-82a0ad54925c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Getting quotas for project 7643b3a05e304f89a945f512536e2df6. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:16:56.465320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-5c4c2c37-d8d6-4748-867f-82a0ad54925c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Getting quotas for user ea036c351f864bd0bb927e15e897c9e3 and project 7643b3a05e304f89a945f512536e2df6. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:16:56.524581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c4c2c37-d8d6-4748-867f-82a0ad54925c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:16:56.526758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c4c2c37-d8d6-4748-867f-82a0ad54925c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a88a78e0-e3d8-4597-b2c8-a11c29fcf6d9',volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:16:56.656225 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5c4c2c37-d8d6-4748-867f-82a0ad54925c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.715273 Oct 24 11:16:56.656943 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3394/6813] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:16:55 2022] POST /compute/v2.1/servers => generated 404 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:16:56.666018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:16:56.667132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:16:56.667950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:16:56.672510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-495e8368-02dc-45f2-bc33-e11302a265ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:56.673163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-495e8368-02dc-45f2-bc33-e11302a265ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:56.731754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-495e8368-02dc-45f2-bc33-e11302a265ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:56.739434 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-495e8368-02dc-45f2-bc33-e11302a265ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1094 microversion: 2.1 time: 0.075376 Oct 24 11:16:56.740370 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3420/6814] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:56 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:57.762633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-176a17a9-5f7b-4a48-b28f-de55d5a84aff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:57.763261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-176a17a9-5f7b-4a48-b28f-de55d5a84aff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:57.772816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-176a17a9-5f7b-4a48-b28f-de55d5a84aff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:57.773348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-176a17a9-5f7b-4a48-b28f-de55d5a84aff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:57.774064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-176a17a9-5f7b-4a48-b28f-de55d5a84aff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:57.774783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-176a17a9-5f7b-4a48-b28f-de55d5a84aff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:57.775254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-176a17a9-5f7b-4a48-b28f-de55d5a84aff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:57.775697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-176a17a9-5f7b-4a48-b28f-de55d5a84aff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:57.842954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-176a17a9-5f7b-4a48-b28f-de55d5a84aff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:57.851746 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-176a17a9-5f7b-4a48-b28f-de55d5a84aff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1210 microversion: 2.1 time: 0.094127 Oct 24 11:16:57.852623 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3395/6815] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:57 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:58.876022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f752d415-87ea-4a14-8c91-4002948c7da7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:16:58.876806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f752d415-87ea-4a14-8c91-4002948c7da7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:16:58.887719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f752d415-87ea-4a14-8c91-4002948c7da7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:58.888483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f752d415-87ea-4a14-8c91-4002948c7da7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:58.888936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f752d415-87ea-4a14-8c91-4002948c7da7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:58.889647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f752d415-87ea-4a14-8c91-4002948c7da7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:58.890774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f752d415-87ea-4a14-8c91-4002948c7da7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:58.891358 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f752d415-87ea-4a14-8c91-4002948c7da7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:59.035582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f752d415-87ea-4a14-8c91-4002948c7da7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:16:59.044436 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f752d415-87ea-4a14-8c91-4002948c7da7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1276 microversion: 2.1 time: 0.172888 Oct 24 11:16:59.051321 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3421/6816] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:16:58 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:16:59.160980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-31ff689f-93b5-4bd3-bdb6-cda89914305f req-dd60e423-5189-4026-bcff-14a2a57c2811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "335172fa-66d1-4427-9a59-5196e804d7c6", "tag": "37ec7f34-fef3-45a9-a416-47ae64d38f15"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:16:59.173850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-31ff689f-93b5-4bd3-bdb6-cda89914305f req-dd60e423-5189-4026-bcff-14a2a57c2811 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:16:59.174829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-31ff689f-93b5-4bd3-bdb6-cda89914305f req-dd60e423-5189-4026-bcff-14a2a57c2811 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:16:59.175425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-31ff689f-93b5-4bd3-bdb6-cda89914305f req-dd60e423-5189-4026-bcff-14a2a57c2811 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:16:59.187799 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-31ff689f-93b5-4bd3-bdb6-cda89914305f req-dd60e423-5189-4026-bcff-14a2a57c2811 service nova] Creating event network-changed:37ec7f34-fef3-45a9-a416-47ae64d38f15 for instance 335172fa-66d1-4427-9a59-5196e804d7c6 on n-h1-858383-15 Oct 24 11:16:59.194274 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-31ff689f-93b5-4bd3-bdb6-cda89914305f req-dd60e423-5189-4026-bcff-14a2a57c2811 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039207 Oct 24 11:16:59.195278 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3396/6817] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:17:00.068015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ea440657-15b6-4722-ab59-65da02f0e206 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:17:00.068674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ea440657-15b6-4722-ab59-65da02f0e206 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:17:00.078874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea440657-15b6-4722-ab59-65da02f0e206 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:00.079651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea440657-15b6-4722-ab59-65da02f0e206 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:00.080163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea440657-15b6-4722-ab59-65da02f0e206 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:00.081130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea440657-15b6-4722-ab59-65da02f0e206 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:00.081840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea440657-15b6-4722-ab59-65da02f0e206 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:00.082437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea440657-15b6-4722-ab59-65da02f0e206 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:00.230639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ea440657-15b6-4722-ab59-65da02f0e206 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:17:00.238791 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ea440657-15b6-4722-ab59-65da02f0e206 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1276 microversion: 2.1 time: 0.175078 Oct 24 11:17:00.239376 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3422/6818] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:17:00 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:17:01.262232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e9b315dd-7fcf-4521-859b-ee03e0c51983 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:17:01.262844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e9b315dd-7fcf-4521-859b-ee03e0c51983 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:17:01.270172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9b315dd-7fcf-4521-859b-ee03e0c51983 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:01.270672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9b315dd-7fcf-4521-859b-ee03e0c51983 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:01.271121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9b315dd-7fcf-4521-859b-ee03e0c51983 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:01.271837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9b315dd-7fcf-4521-859b-ee03e0c51983 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:01.272303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9b315dd-7fcf-4521-859b-ee03e0c51983 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:01.272745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9b315dd-7fcf-4521-859b-ee03e0c51983 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:01.413371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9b315dd-7fcf-4521-859b-ee03e0c51983 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:17:01.422988 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e9b315dd-7fcf-4521-859b-ee03e0c51983 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1276 microversion: 2.1 time: 0.165142 Oct 24 11:17:01.423570 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3397/6819] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:17:01 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:17:02.445157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eb4cd601-ba3b-495b-a7cf-429162473601 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:17:02.445913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-eb4cd601-ba3b-495b-a7cf-429162473601 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:17:02.453999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb4cd601-ba3b-495b-a7cf-429162473601 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:02.454499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb4cd601-ba3b-495b-a7cf-429162473601 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:02.454941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb4cd601-ba3b-495b-a7cf-429162473601 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:02.455656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb4cd601-ba3b-495b-a7cf-429162473601 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:02.456120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb4cd601-ba3b-495b-a7cf-429162473601 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:02.456583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb4cd601-ba3b-495b-a7cf-429162473601 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:02.594653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-eb4cd601-ba3b-495b-a7cf-429162473601 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:17:02.604165 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-eb4cd601-ba3b-495b-a7cf-429162473601 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1276 microversion: 2.1 time: 0.163006 Oct 24 11:17:02.604825 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3423/6820] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:17:02 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:17:03.628347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5b147061-1c46-4dd1-985e-e2d0afa2a477 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:17:03.629003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5b147061-1c46-4dd1-985e-e2d0afa2a477 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:17:03.635820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b147061-1c46-4dd1-985e-e2d0afa2a477 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:03.636316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b147061-1c46-4dd1-985e-e2d0afa2a477 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:03.636770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b147061-1c46-4dd1-985e-e2d0afa2a477 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:03.637505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b147061-1c46-4dd1-985e-e2d0afa2a477 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:03.637972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b147061-1c46-4dd1-985e-e2d0afa2a477 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:03.638414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b147061-1c46-4dd1-985e-e2d0afa2a477 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:03.776721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5b147061-1c46-4dd1-985e-e2d0afa2a477 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:17:03.784491 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5b147061-1c46-4dd1-985e-e2d0afa2a477 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1264 microversion: 2.1 time: 0.160727 Oct 24 11:17:03.785088 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3398/6821] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:17:03 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:17:04.807972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-73782cb5-583b-4ecf-ab5c-123b92ef46f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:17:04.808590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-73782cb5-583b-4ecf-ab5c-123b92ef46f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:17:04.816379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73782cb5-583b-4ecf-ab5c-123b92ef46f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:04.816906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73782cb5-583b-4ecf-ab5c-123b92ef46f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:04.817353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73782cb5-583b-4ecf-ab5c-123b92ef46f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:04.818060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73782cb5-583b-4ecf-ab5c-123b92ef46f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:04.818521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73782cb5-583b-4ecf-ab5c-123b92ef46f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:04.818949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73782cb5-583b-4ecf-ab5c-123b92ef46f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:04.954130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-73782cb5-583b-4ecf-ab5c-123b92ef46f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:17:04.962031 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-73782cb5-583b-4ecf-ab5c-123b92ef46f1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1264 microversion: 2.1 time: 0.158195 Oct 24 11:17:04.962604 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3424/6822] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:17:04 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:17:05.984818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-433ad7bb-f9b6-44d5-93e3-6311e1482883 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:17:05.985386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-433ad7bb-f9b6-44d5-93e3-6311e1482883 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:17:05.992358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-433ad7bb-f9b6-44d5-93e3-6311e1482883 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:05.992895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-433ad7bb-f9b6-44d5-93e3-6311e1482883 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:05.993363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-433ad7bb-f9b6-44d5-93e3-6311e1482883 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:05.994082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-433ad7bb-f9b6-44d5-93e3-6311e1482883 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:05.994562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-433ad7bb-f9b6-44d5-93e3-6311e1482883 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:05.995012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-433ad7bb-f9b6-44d5-93e3-6311e1482883 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:06.128601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-433ad7bb-f9b6-44d5-93e3-6311e1482883 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:17:06.136479 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-433ad7bb-f9b6-44d5-93e3-6311e1482883 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1264 microversion: 2.1 time: 0.155854 Oct 24 11:17:06.137107 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3399/6823] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:17:05 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:17:07.160800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fb31d966-e46d-4c84-a58c-173647c3532f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:17:07.161443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fb31d966-e46d-4c84-a58c-173647c3532f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:17:07.164724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:17:07.170224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb31d966-e46d-4c84-a58c-173647c3532f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:07.170700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb31d966-e46d-4c84-a58c-173647c3532f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:07.171879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb31d966-e46d-4c84-a58c-173647c3532f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:07.172600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb31d966-e46d-4c84-a58c-173647c3532f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:07.173076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb31d966-e46d-4c84-a58c-173647c3532f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:07.173504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb31d966-e46d-4c84-a58c-173647c3532f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:07.307821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fb31d966-e46d-4c84-a58c-173647c3532f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:17:07.315844 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fb31d966-e46d-4c84-a58c-173647c3532f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1264 microversion: 2.1 time: 0.158971 Oct 24 11:17:07.316423 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3425/6824] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:17:07 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:17:08.338790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-62b7e5c6-49f9-4bf9-846d-95453ae8b10e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:17:08.339424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-62b7e5c6-49f9-4bf9-846d-95453ae8b10e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:17:08.341458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:17:08.342142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:17:08.350143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62b7e5c6-49f9-4bf9-846d-95453ae8b10e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:08.350652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62b7e5c6-49f9-4bf9-846d-95453ae8b10e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:08.351115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62b7e5c6-49f9-4bf9-846d-95453ae8b10e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:08.351833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62b7e5c6-49f9-4bf9-846d-95453ae8b10e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:08.352311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62b7e5c6-49f9-4bf9-846d-95453ae8b10e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:08.352763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-62b7e5c6-49f9-4bf9-846d-95453ae8b10e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:08.485456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-62b7e5c6-49f9-4bf9-846d-95453ae8b10e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:17:08.493234 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-62b7e5c6-49f9-4bf9-846d-95453ae8b10e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1264 microversion: 2.1 time: 0.158361 Oct 24 11:17:08.493808 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3400/6825] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:17:08 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:17:09.517132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4f69322e-9f58-4a56-adc6-63af8ad6fccb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:17:09.517780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4f69322e-9f58-4a56-adc6-63af8ad6fccb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:17:09.525069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f69322e-9f58-4a56-adc6-63af8ad6fccb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:09.525576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f69322e-9f58-4a56-adc6-63af8ad6fccb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:09.525997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f69322e-9f58-4a56-adc6-63af8ad6fccb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:09.526692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f69322e-9f58-4a56-adc6-63af8ad6fccb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:09.527149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f69322e-9f58-4a56-adc6-63af8ad6fccb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:09.527577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f69322e-9f58-4a56-adc6-63af8ad6fccb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:09.660770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4f69322e-9f58-4a56-adc6-63af8ad6fccb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:17:09.668578 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4f69322e-9f58-4a56-adc6-63af8ad6fccb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1264 microversion: 2.1 time: 0.156106 Oct 24 11:17:09.669199 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3426/6826] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:17:09 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:17:10.692213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-29cda276-6a4d-46a8-bb2e-ac7d50a31574 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:17:10.692862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-29cda276-6a4d-46a8-bb2e-ac7d50a31574 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:17:10.699884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29cda276-6a4d-46a8-bb2e-ac7d50a31574 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:10.700386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29cda276-6a4d-46a8-bb2e-ac7d50a31574 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:10.700855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29cda276-6a4d-46a8-bb2e-ac7d50a31574 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:10.701583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29cda276-6a4d-46a8-bb2e-ac7d50a31574 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:10.702084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29cda276-6a4d-46a8-bb2e-ac7d50a31574 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:10.702533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29cda276-6a4d-46a8-bb2e-ac7d50a31574 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:10.838673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-29cda276-6a4d-46a8-bb2e-ac7d50a31574 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:17:10.847258 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-29cda276-6a4d-46a8-bb2e-ac7d50a31574 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1264 microversion: 2.1 time: 0.159045 Oct 24 11:17:10.847834 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3401/6827] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:17:10 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:17:11.870770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a301ff08-5682-4bc8-81fe-1d7b7c79262a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:17:11.871389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a301ff08-5682-4bc8-81fe-1d7b7c79262a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:17:11.878369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a301ff08-5682-4bc8-81fe-1d7b7c79262a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:11.878843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a301ff08-5682-4bc8-81fe-1d7b7c79262a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:11.879274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a301ff08-5682-4bc8-81fe-1d7b7c79262a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:11.879958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a301ff08-5682-4bc8-81fe-1d7b7c79262a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:11.880405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a301ff08-5682-4bc8-81fe-1d7b7c79262a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:11.880825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a301ff08-5682-4bc8-81fe-1d7b7c79262a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:12.016993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a301ff08-5682-4bc8-81fe-1d7b7c79262a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:17:12.025005 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a301ff08-5682-4bc8-81fe-1d7b7c79262a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1264 microversion: 2.1 time: 0.158399 Oct 24 11:17:12.025585 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3427/6828] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:17:11 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:17:13.048107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fbb9cdf1-e708-4dd7-9f44-895f6654aab5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:17:13.048744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fbb9cdf1-e708-4dd7-9f44-895f6654aab5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:17:13.055454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbb9cdf1-e708-4dd7-9f44-895f6654aab5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:13.055944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbb9cdf1-e708-4dd7-9f44-895f6654aab5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:13.056394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbb9cdf1-e708-4dd7-9f44-895f6654aab5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:13.057117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbb9cdf1-e708-4dd7-9f44-895f6654aab5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:13.057587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbb9cdf1-e708-4dd7-9f44-895f6654aab5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:13.058026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbb9cdf1-e708-4dd7-9f44-895f6654aab5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:13.191894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fbb9cdf1-e708-4dd7-9f44-895f6654aab5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:17:13.199661 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fbb9cdf1-e708-4dd7-9f44-895f6654aab5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1264 microversion: 2.1 time: 0.155832 Oct 24 11:17:13.200232 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3402/6829] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:17:13 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:17:14.223862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2f756a6b-7f92-4923-8137-007e306e3ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:17:14.224465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2f756a6b-7f92-4923-8137-007e306e3ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:17:14.231126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f756a6b-7f92-4923-8137-007e306e3ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:14.231615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f756a6b-7f92-4923-8137-007e306e3ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:14.232055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f756a6b-7f92-4923-8137-007e306e3ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:14.232755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f756a6b-7f92-4923-8137-007e306e3ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:14.233433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f756a6b-7f92-4923-8137-007e306e3ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:14.233866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f756a6b-7f92-4923-8137-007e306e3ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:14.326173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-89ecc260-3802-4c87-9b9a-93918848bcff req-d4d2ca6c-2f54-493b-b5f9-3a30a5103c0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335172fa-66d1-4427-9a59-5196e804d7c6", "name": "network-vif-plugged", "status": "completed", "tag": "37ec7f34-fef3-45a9-a416-47ae64d38f15"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:17:14.338364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-89ecc260-3802-4c87-9b9a-93918848bcff req-d4d2ca6c-2f54-493b-b5f9-3a30a5103c0e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:14.339543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-89ecc260-3802-4c87-9b9a-93918848bcff req-d4d2ca6c-2f54-493b-b5f9-3a30a5103c0e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:14.339543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-89ecc260-3802-4c87-9b9a-93918848bcff req-d4d2ca6c-2f54-493b-b5f9-3a30a5103c0e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:14.352146 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-89ecc260-3802-4c87-9b9a-93918848bcff req-d4d2ca6c-2f54-493b-b5f9-3a30a5103c0e service nova] Creating event network-vif-plugged:37ec7f34-fef3-45a9-a416-47ae64d38f15 for instance 335172fa-66d1-4427-9a59-5196e804d7c6 on n-h1-858383-15 Oct 24 11:17:14.358236 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-89ecc260-3802-4c87-9b9a-93918848bcff req-d4d2ca6c-2f54-493b-b5f9-3a30a5103c0e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035791 Oct 24 11:17:14.359256 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3403/6830] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:17:14.374584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2f756a6b-7f92-4923-8137-007e306e3ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:17:14.382479 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2f756a6b-7f92-4923-8137-007e306e3ff8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1264 microversion: 2.1 time: 0.162643 Oct 24 11:17:14.382984 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3428/6831] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:17:14 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:17:15.408248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-32b0b5fd-d0c9-4966-9dbb-fb58ef420fc2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:17:15.408903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-32b0b5fd-d0c9-4966-9dbb-fb58ef420fc2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:17:15.415178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32b0b5fd-d0c9-4966-9dbb-fb58ef420fc2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:15.415673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32b0b5fd-d0c9-4966-9dbb-fb58ef420fc2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:15.416124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32b0b5fd-d0c9-4966-9dbb-fb58ef420fc2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:15.416826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32b0b5fd-d0c9-4966-9dbb-fb58ef420fc2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:15.417315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32b0b5fd-d0c9-4966-9dbb-fb58ef420fc2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:15.417753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32b0b5fd-d0c9-4966-9dbb-fb58ef420fc2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:15.553715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-32b0b5fd-d0c9-4966-9dbb-fb58ef420fc2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:17:15.561435 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-32b0b5fd-d0c9-4966-9dbb-fb58ef420fc2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1264 microversion: 2.1 time: 0.158985 Oct 24 11:17:15.562009 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3404/6832] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:17:15 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:17:16.584240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7f2fd0cd-231c-4997-a099-ff07ea6461b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:17:16.584891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7f2fd0cd-231c-4997-a099-ff07ea6461b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:17:16.591442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f2fd0cd-231c-4997-a099-ff07ea6461b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:16.591932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f2fd0cd-231c-4997-a099-ff07ea6461b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:16.592385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f2fd0cd-231c-4997-a099-ff07ea6461b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:16.593131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f2fd0cd-231c-4997-a099-ff07ea6461b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:16.593598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f2fd0cd-231c-4997-a099-ff07ea6461b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:16.594037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7f2fd0cd-231c-4997-a099-ff07ea6461b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:16.722672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7f2fd0cd-231c-4997-a099-ff07ea6461b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:17:16.730418 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7f2fd0cd-231c-4997-a099-ff07ea6461b5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1451 microversion: 2.1 time: 0.150286 Oct 24 11:17:16.730988 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3429/6833] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:17:16 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:17:16.754240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ae68f58f-f254-4072-8647-4c025053c428 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:17:16.754903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ae68f58f-f254-4072-8647-4c025053c428 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:17:16.761624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae68f58f-f254-4072-8647-4c025053c428 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:16.762125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae68f58f-f254-4072-8647-4c025053c428 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:16.762659 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae68f58f-f254-4072-8647-4c025053c428 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:16.763372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae68f58f-f254-4072-8647-4c025053c428 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:16.763842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae68f58f-f254-4072-8647-4c025053c428 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:16.764402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae68f58f-f254-4072-8647-4c025053c428 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:16.898022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ae68f58f-f254-4072-8647-4c025053c428 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:17:16.906770 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ae68f58f-f254-4072-8647-4c025053c428 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1451 microversion: 2.1 time: 0.156672 Oct 24 11:17:16.907343 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3405/6834] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:17:16 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:17:18.789223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-700aeaa0-1501-4331-9008-f7e8e0655067 req-4149f869-b8fc-4c97-a991-e2e8bd4d368b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "335172fa-66d1-4427-9a59-5196e804d7c6", "tag": "37ec7f34-fef3-45a9-a416-47ae64d38f15"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:17:18.800288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-700aeaa0-1501-4331-9008-f7e8e0655067 req-4149f869-b8fc-4c97-a991-e2e8bd4d368b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:17:18.800910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-700aeaa0-1501-4331-9008-f7e8e0655067 req-4149f869-b8fc-4c97-a991-e2e8bd4d368b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:17:18.801422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-700aeaa0-1501-4331-9008-f7e8e0655067 req-4149f869-b8fc-4c97-a991-e2e8bd4d368b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:17:18.814651 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-700aeaa0-1501-4331-9008-f7e8e0655067 req-4149f869-b8fc-4c97-a991-e2e8bd4d368b service nova] Creating event network-changed:37ec7f34-fef3-45a9-a416-47ae64d38f15 for instance 335172fa-66d1-4427-9a59-5196e804d7c6 on n-h1-858383-15 Oct 24 11:17:18.820209 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-700aeaa0-1501-4331-9008-f7e8e0655067 req-4149f869-b8fc-4c97-a991-e2e8bd4d368b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100217 Oct 24 11:17:18.820885 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3430/6835] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:19:14.131675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:19:14.132950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=60 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:19:14.134056 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:19:14.134201 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:19:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 (ip 10.222.0.50) !!! Oct 24 11:19:14.135282 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:19:14.135392 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:19:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 (ip 10.222.0.50) !!! Oct 24 11:19:14.201693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-386d07d5-7528-4946-bb46-62e5fb02493f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:14.202211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-386d07d5-7528-4946-bb46-62e5fb02493f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:14.208307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-386d07d5-7528-4946-bb46-62e5fb02493f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:14.208803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-386d07d5-7528-4946-bb46-62e5fb02493f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:14.209289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-386d07d5-7528-4946-bb46-62e5fb02493f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:14.209991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-386d07d5-7528-4946-bb46-62e5fb02493f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:14.210457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-386d07d5-7528-4946-bb46-62e5fb02493f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:14.210895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-386d07d5-7528-4946-bb46-62e5fb02493f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:14.238796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-386d07d5-7528-4946-bb46-62e5fb02493f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:19:14.313302 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-386d07d5-7528-4946-bb46-62e5fb02493f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "DELETE /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 204 len: 0 microversion: 2.1 time: 0.183408 Oct 24 11:19:14.313921 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3406/6836] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:19:14 2022] DELETE /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:19:14.321431 n-d-858383-15 devstack@n-api.service[120426]: ERROR oslo.messaging._drivers.impl_rabbit [-] [666865aa-442b-4005-907b-9c648cd2f782] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 11:19:14.322556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=24 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:19:14.323382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=56 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:19:14.324478 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:19:14.324606 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:19:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 (ip 10.222.0.50) !!! Oct 24 11:19:14.326892 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 24 11:19:14.337216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e0c15e93-aa47-4800-b3aa-2400df20bf0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:14.337918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e0c15e93-aa47-4800-b3aa-2400df20bf0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:14.347525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0c15e93-aa47-4800-b3aa-2400df20bf0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:14.348011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0c15e93-aa47-4800-b3aa-2400df20bf0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:14.348477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0c15e93-aa47-4800-b3aa-2400df20bf0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:14.349204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0c15e93-aa47-4800-b3aa-2400df20bf0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:14.349667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0c15e93-aa47-4800-b3aa-2400df20bf0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:14.350096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0c15e93-aa47-4800-b3aa-2400df20bf0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:14.485177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e0c15e93-aa47-4800-b3aa-2400df20bf0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:14.494107 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e0c15e93-aa47-4800-b3aa-2400df20bf0f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1574 microversion: 2.1 time: 0.175513 Oct 24 11:19:14.494687 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3431/6837] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:14 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:19:15.518713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1a8672fe-de8c-454d-8dc0-c3a69c900c52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:15.519471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1a8672fe-de8c-454d-8dc0-c3a69c900c52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:15.526681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a8672fe-de8c-454d-8dc0-c3a69c900c52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:15.527191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a8672fe-de8c-454d-8dc0-c3a69c900c52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:15.527680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a8672fe-de8c-454d-8dc0-c3a69c900c52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:15.528388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a8672fe-de8c-454d-8dc0-c3a69c900c52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:15.528904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a8672fe-de8c-454d-8dc0-c3a69c900c52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:15.529366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1a8672fe-de8c-454d-8dc0-c3a69c900c52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:15.664651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1a8672fe-de8c-454d-8dc0-c3a69c900c52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:15.673331 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1a8672fe-de8c-454d-8dc0-c3a69c900c52 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1574 microversion: 2.1 time: 0.158974 Oct 24 11:19:15.673904 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3407/6838] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:15 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:19:16.696231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-684d6e43-56cf-41b7-bf2f-24e73dedb4a2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:16.696854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-684d6e43-56cf-41b7-bf2f-24e73dedb4a2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:16.705175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-684d6e43-56cf-41b7-bf2f-24e73dedb4a2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:16.705656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-684d6e43-56cf-41b7-bf2f-24e73dedb4a2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:16.706088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-684d6e43-56cf-41b7-bf2f-24e73dedb4a2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:16.706835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-684d6e43-56cf-41b7-bf2f-24e73dedb4a2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:16.707285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-684d6e43-56cf-41b7-bf2f-24e73dedb4a2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:16.707729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-684d6e43-56cf-41b7-bf2f-24e73dedb4a2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:16.727444 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] [666865aa-442b-4005-907b-9c648cd2f782] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 46880. Oct 24 11:19:16.772551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-684d6e43-56cf-41b7-bf2f-24e73dedb4a2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:16.781009 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-684d6e43-56cf-41b7-bf2f-24e73dedb4a2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1508 microversion: 2.1 time: 0.088667 Oct 24 11:19:16.781595 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3432/6839] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:16 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1508 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:17.020636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d95ffb71-cfbc-4326-95ad-daeffe4f51bd req-b1b66806-a399-4e0b-bc8b-14b982ec6243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335172fa-66d1-4427-9a59-5196e804d7c6", "name": "network-vif-deleted", "tag": "37ec7f34-fef3-45a9-a416-47ae64d38f15"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:19:17.036163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d95ffb71-cfbc-4326-95ad-daeffe4f51bd req-b1b66806-a399-4e0b-bc8b-14b982ec6243 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:17.037171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d95ffb71-cfbc-4326-95ad-daeffe4f51bd req-b1b66806-a399-4e0b-bc8b-14b982ec6243 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:17.038047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d95ffb71-cfbc-4326-95ad-daeffe4f51bd req-b1b66806-a399-4e0b-bc8b-14b982ec6243 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:17.054693 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d95ffb71-cfbc-4326-95ad-daeffe4f51bd req-b1b66806-a399-4e0b-bc8b-14b982ec6243 service nova] Creating event network-vif-deleted:37ec7f34-fef3-45a9-a416-47ae64d38f15 for instance 335172fa-66d1-4427-9a59-5196e804d7c6 on n-h1-858383-15 Oct 24 11:19:17.060868 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d95ffb71-cfbc-4326-95ad-daeffe4f51bd req-b1b66806-a399-4e0b-bc8b-14b982ec6243 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115115 Oct 24 11:19:17.061517 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3408/6840] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:19:17.805469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a4b0e609-c893-4957-b720-e767f5c1e7c7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:17.806074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a4b0e609-c893-4957-b720-e767f5c1e7c7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:17.814958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4b0e609-c893-4957-b720-e767f5c1e7c7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:17.815459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4b0e609-c893-4957-b720-e767f5c1e7c7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:17.815931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4b0e609-c893-4957-b720-e767f5c1e7c7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:17.816632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4b0e609-c893-4957-b720-e767f5c1e7c7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:17.817297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4b0e609-c893-4957-b720-e767f5c1e7c7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:17.817894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4b0e609-c893-4957-b720-e767f5c1e7c7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:17.894030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a4b0e609-c893-4957-b720-e767f5c1e7c7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:17.903432 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a4b0e609-c893-4957-b720-e767f5c1e7c7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1225 microversion: 2.1 time: 0.102142 Oct 24 11:19:17.908680 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3433/6841] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:17 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:18.928517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d2065f51-597f-44c9-a7d0-c23b1790ed3b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:18.929306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d2065f51-597f-44c9-a7d0-c23b1790ed3b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:18.936523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2065f51-597f-44c9-a7d0-c23b1790ed3b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:18.937055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2065f51-597f-44c9-a7d0-c23b1790ed3b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:18.937519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2065f51-597f-44c9-a7d0-c23b1790ed3b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:18.938241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2065f51-597f-44c9-a7d0-c23b1790ed3b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:18.938718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2065f51-597f-44c9-a7d0-c23b1790ed3b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:18.939168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2065f51-597f-44c9-a7d0-c23b1790ed3b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:19.002824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d2065f51-597f-44c9-a7d0-c23b1790ed3b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:19.010780 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d2065f51-597f-44c9-a7d0-c23b1790ed3b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1225 microversion: 2.1 time: 0.087550 Oct 24 11:19:19.011356 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3409/6842] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:18 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:20.034326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3cf17d1c-798e-44aa-8675-46b8f8f9f1a8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:20.034944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3cf17d1c-798e-44aa-8675-46b8f8f9f1a8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:20.041969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cf17d1c-798e-44aa-8675-46b8f8f9f1a8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:20.042423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cf17d1c-798e-44aa-8675-46b8f8f9f1a8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:20.042858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cf17d1c-798e-44aa-8675-46b8f8f9f1a8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:20.043554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cf17d1c-798e-44aa-8675-46b8f8f9f1a8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:20.044001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cf17d1c-798e-44aa-8675-46b8f8f9f1a8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:20.044422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3cf17d1c-798e-44aa-8675-46b8f8f9f1a8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:20.108494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3cf17d1c-798e-44aa-8675-46b8f8f9f1a8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:20.119002 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3cf17d1c-798e-44aa-8675-46b8f8f9f1a8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1225 microversion: 2.1 time: 0.088554 Oct 24 11:19:20.119711 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3434/6843] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:20 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:21.144216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2904aa69-3424-44cb-8b1e-b5979b1c9982 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:21.144858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2904aa69-3424-44cb-8b1e-b5979b1c9982 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:21.153102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2904aa69-3424-44cb-8b1e-b5979b1c9982 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:21.153823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2904aa69-3424-44cb-8b1e-b5979b1c9982 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:21.154612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2904aa69-3424-44cb-8b1e-b5979b1c9982 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:21.155416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2904aa69-3424-44cb-8b1e-b5979b1c9982 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:21.156080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2904aa69-3424-44cb-8b1e-b5979b1c9982 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:21.156628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2904aa69-3424-44cb-8b1e-b5979b1c9982 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:21.189641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2904aa69-3424-44cb-8b1e-b5979b1c9982 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:21.190154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2904aa69-3424-44cb-8b1e-b5979b1c9982 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:21.190615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2904aa69-3424-44cb-8b1e-b5979b1c9982 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:21.191083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-2904aa69-3424-44cb-8b1e-b5979b1c9982 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lazy-loading 'fault' on Instance uuid 335172fa-66d1-4427-9a59-5196e804d7c6 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:19:21.233985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2904aa69-3424-44cb-8b1e-b5979b1c9982 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:21.241833 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2904aa69-3424-44cb-8b1e-b5979b1c9982 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 200 len: 1230 microversion: 2.1 time: 0.102738 Oct 24 11:19:21.242397 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3410/6844] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:21 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:22.264350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4a9a13ef-517b-4998-b941-5606913716ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:22.265015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4a9a13ef-517b-4998-b941-5606913716ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:22.271903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a9a13ef-517b-4998-b941-5606913716ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:22.272378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a9a13ef-517b-4998-b941-5606913716ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:22.273105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a9a13ef-517b-4998-b941-5606913716ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:22.273793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a9a13ef-517b-4998-b941-5606913716ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:22.274240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a9a13ef-517b-4998-b941-5606913716ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:22.274661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a9a13ef-517b-4998-b941-5606913716ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:22.288722 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-4a9a13ef-517b-4998-b941-5606913716ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] HTTP exception thrown: Instance 335172fa-66d1-4427-9a59-5196e804d7c6 could not be found. Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4a9a13ef-517b-4998-b941-5606913716ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Request method failure captured: Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 HTTP/1.1 Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnM2OqlSOkhfxDfVEeTT94IwX8qn5k49naomhNLud1uic_lKwej-RJQ1PZooBFuUMpS4DQEMNgRR3ENofPbDmyI7Cy_YSVUuCsvfRNdcFM4T5H_sDbiD3-ZTRmSQR0yoz-aOqM9u5ViLunGIsswJX3XnF9XyVytj9jbL6H3Gm1Ht-2Q Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7643b3a05e304f89a945f512536e2df6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ea036c351f864bd0bb927e15e897c9e3 Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 335172fa-66d1-4427-9a59-5196e804d7c6 could not be found. Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '335172fa-66d1-4427-9a59-5196e804d7c6'} Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 335172fa-66d1-4427-9a59-5196e804d7c6 could not be found. Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 335172fa-66d1-4427-9a59-5196e804d7c6 could not be found. Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:19:22.290378 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:19:22.295431 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:19:22.295431 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:19:22.295431 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:19:22.295431 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:19:22.295431 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:19:22.295431 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 335172fa-66d1-4427-9a59-5196e804d7c6 could not be found. Oct 24 11:19:22.295431 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:19:22.295431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4a9a13ef-517b-4998-b941-5606913716ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Returning 404 to user: Instance 335172fa-66d1-4427-9a59-5196e804d7c6 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:19:22.295431 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4a9a13ef-517b-4998-b941-5606913716ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 404 len: 111 microversion: 2.1 time: 0.031438 Oct 24 11:19:22.295431 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3435/6845] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:22 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:19:22.339613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5beaa5b4-b247-401b-b743-ff70556078ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1382051253", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1448891001", "security_groups": [{"name": "tempest-secgroup-smoke-43606284"}], "block_device_mapping_v2": [{"uuid": "a88a78e0-e3d8-4597-b2c8-a11c29fcf6d9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fd5ed2ae-44e8-4a94-8b2b-fd64f1a0661a"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:19:22.462346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-5beaa5b4-b247-401b-b743-ff70556078ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] validate_networks() for [('fd5ed2ae-44e8-4a94-8b2b-fd64f1a0661a', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:19:22.893374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5beaa5b4-b247-401b-b743-ff70556078ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:19:22.893874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5beaa5b4-b247-401b-b743-ff70556078ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:19:22.894418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5beaa5b4-b247-401b-b743-ff70556078ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:19:22.894851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5beaa5b4-b247-401b-b743-ff70556078ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:19:22.895285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-5beaa5b4-b247-401b-b743-ff70556078ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:19:22.904782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5beaa5b4-b247-401b-b743-ff70556078ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:22.905325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5beaa5b4-b247-401b-b743-ff70556078ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:22.905784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5beaa5b4-b247-401b-b743-ff70556078ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:22.906537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5beaa5b4-b247-401b-b743-ff70556078ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:22.907018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5beaa5b4-b247-401b-b743-ff70556078ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:22.907467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5beaa5b4-b247-401b-b743-ff70556078ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:22.924185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-5beaa5b4-b247-401b-b743-ff70556078ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Getting quotas for project 7643b3a05e304f89a945f512536e2df6. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:19:22.929569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-5beaa5b4-b247-401b-b743-ff70556078ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Getting quotas for user ea036c351f864bd0bb927e15e897c9e3 and project 7643b3a05e304f89a945f512536e2df6. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:19:22.988004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5beaa5b4-b247-401b-b743-ff70556078ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:19:22.990194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5beaa5b4-b247-401b-b743-ff70556078ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a88a78e0-e3d8-4597-b2c8-a11c29fcf6d9',volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:19:23.119369 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5beaa5b4-b247-401b-b743-ff70556078ac tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.783580 Oct 24 11:19:23.126693 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3411/6846] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:19:22 2022] POST /compute/v2.1/servers => generated 404 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:19:23.132658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-22505448-fe5f-4531-b205-ddef39db1a91 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:23.133314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-22505448-fe5f-4531-b205-ddef39db1a91 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:23.191517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-22505448-fe5f-4531-b205-ddef39db1a91 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:23.199154 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-22505448-fe5f-4531-b205-ddef39db1a91 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1095 microversion: 2.1 time: 0.071077 Oct 24 11:19:23.199707 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3436/6847] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:23 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:24.223222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-129fecf4-5b0f-45b0-b0ba-265081f9dfff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:24.224046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-129fecf4-5b0f-45b0-b0ba-265081f9dfff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:24.230183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-129fecf4-5b0f-45b0-b0ba-265081f9dfff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:24.230716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-129fecf4-5b0f-45b0-b0ba-265081f9dfff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:24.231303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-129fecf4-5b0f-45b0-b0ba-265081f9dfff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:24.232228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-129fecf4-5b0f-45b0-b0ba-265081f9dfff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:24.232694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-129fecf4-5b0f-45b0-b0ba-265081f9dfff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:24.233171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-129fecf4-5b0f-45b0-b0ba-265081f9dfff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:24.312285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-129fecf4-5b0f-45b0-b0ba-265081f9dfff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:24.321616 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-129fecf4-5b0f-45b0-b0ba-265081f9dfff tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1201 microversion: 2.1 time: 0.102956 Oct 24 11:19:24.322405 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3412/6848] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:24 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1201 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:25.348437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-566d9eb9-4961-4b57-b946-20c0dad98602 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:25.349594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-566d9eb9-4961-4b57-b946-20c0dad98602 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:25.358606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-566d9eb9-4961-4b57-b946-20c0dad98602 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:25.359349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-566d9eb9-4961-4b57-b946-20c0dad98602 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:25.359954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-566d9eb9-4961-4b57-b946-20c0dad98602 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:25.360828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-566d9eb9-4961-4b57-b946-20c0dad98602 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:25.361454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-566d9eb9-4961-4b57-b946-20c0dad98602 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:25.362248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-566d9eb9-4961-4b57-b946-20c0dad98602 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:25.506549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-566d9eb9-4961-4b57-b946-20c0dad98602 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:25.515595 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-566d9eb9-4961-4b57-b946-20c0dad98602 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1277 microversion: 2.1 time: 0.171607 Oct 24 11:19:25.516369 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3437/6849] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:25 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:25.657261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d97f893b-6eb5-4235-bb7a-cf51633a6e07 req-9483c4db-01a0-4d7e-a761-8ad993a08d9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "932f8fd5-a330-4a77-8033-9d74fd330faf", "tag": "87c0d86b-3fd0-485f-b115-422e4031011c"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:19:25.671403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d97f893b-6eb5-4235-bb7a-cf51633a6e07 req-9483c4db-01a0-4d7e-a761-8ad993a08d9f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:25.672292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d97f893b-6eb5-4235-bb7a-cf51633a6e07 req-9483c4db-01a0-4d7e-a761-8ad993a08d9f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:25.673400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d97f893b-6eb5-4235-bb7a-cf51633a6e07 req-9483c4db-01a0-4d7e-a761-8ad993a08d9f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:25.687573 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d97f893b-6eb5-4235-bb7a-cf51633a6e07 req-9483c4db-01a0-4d7e-a761-8ad993a08d9f service nova] Creating event network-changed:87c0d86b-3fd0-485f-b115-422e4031011c for instance 932f8fd5-a330-4a77-8033-9d74fd330faf on n-h1-858383-15 Oct 24 11:19:25.693581 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d97f893b-6eb5-4235-bb7a-cf51633a6e07 req-9483c4db-01a0-4d7e-a761-8ad993a08d9f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040622 Oct 24 11:19:25.694759 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3413/6850] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:19:26.539290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-83588255-67fb-4c05-ab1d-a0447166f118 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:26.540585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-83588255-67fb-4c05-ab1d-a0447166f118 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:26.547790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83588255-67fb-4c05-ab1d-a0447166f118 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:26.548289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83588255-67fb-4c05-ab1d-a0447166f118 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:26.548731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83588255-67fb-4c05-ab1d-a0447166f118 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:26.549495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83588255-67fb-4c05-ab1d-a0447166f118 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:26.549952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83588255-67fb-4c05-ab1d-a0447166f118 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:26.550585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83588255-67fb-4c05-ab1d-a0447166f118 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:26.700264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-83588255-67fb-4c05-ab1d-a0447166f118 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:26.708275 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-83588255-67fb-4c05-ab1d-a0447166f118 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1277 microversion: 2.1 time: 0.172894 Oct 24 11:19:26.708877 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3438/6851] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:26 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:27.732766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ddcd17ab-d37c-4509-aea4-b54e1ee017e4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:27.733397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ddcd17ab-d37c-4509-aea4-b54e1ee017e4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:27.740056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddcd17ab-d37c-4509-aea4-b54e1ee017e4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:27.740585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddcd17ab-d37c-4509-aea4-b54e1ee017e4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:27.741063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddcd17ab-d37c-4509-aea4-b54e1ee017e4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:27.741779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddcd17ab-d37c-4509-aea4-b54e1ee017e4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:27.742242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddcd17ab-d37c-4509-aea4-b54e1ee017e4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:27.742680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ddcd17ab-d37c-4509-aea4-b54e1ee017e4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:27.876527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ddcd17ab-d37c-4509-aea4-b54e1ee017e4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:27.884475 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ddcd17ab-d37c-4509-aea4-b54e1ee017e4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1277 microversion: 2.1 time: 0.157507 Oct 24 11:19:27.885092 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3414/6852] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:27 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:28.908222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3b7356d7-586a-4d38-acaf-371a4b480068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:28.908873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3b7356d7-586a-4d38-acaf-371a4b480068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:28.916282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b7356d7-586a-4d38-acaf-371a4b480068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:28.916772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b7356d7-586a-4d38-acaf-371a4b480068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:28.917239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b7356d7-586a-4d38-acaf-371a4b480068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:28.918629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b7356d7-586a-4d38-acaf-371a4b480068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:28.919132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b7356d7-586a-4d38-acaf-371a4b480068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:28.919563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b7356d7-586a-4d38-acaf-371a4b480068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:29.060244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3b7356d7-586a-4d38-acaf-371a4b480068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:29.069792 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3b7356d7-586a-4d38-acaf-371a4b480068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1277 microversion: 2.1 time: 0.165467 Oct 24 11:19:29.070574 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3439/6853] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:28 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:19:30.094522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e9ad847c-df36-4721-9eaa-a188020de465 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:30.095155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e9ad847c-df36-4721-9eaa-a188020de465 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:30.102168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9ad847c-df36-4721-9eaa-a188020de465 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:30.102672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9ad847c-df36-4721-9eaa-a188020de465 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:30.103131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9ad847c-df36-4721-9eaa-a188020de465 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:30.103849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9ad847c-df36-4721-9eaa-a188020de465 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:30.104328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9ad847c-df36-4721-9eaa-a188020de465 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:30.104777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e9ad847c-df36-4721-9eaa-a188020de465 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:30.241427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e9ad847c-df36-4721-9eaa-a188020de465 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:30.249577 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e9ad847c-df36-4721-9eaa-a188020de465 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1265 microversion: 2.1 time: 0.159836 Oct 24 11:19:30.250152 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3415/6854] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:30 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:31.274487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1af331d1-4090-431b-81c1-8a5bf88917ad tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:31.275112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1af331d1-4090-431b-81c1-8a5bf88917ad tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:31.282239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1af331d1-4090-431b-81c1-8a5bf88917ad tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:31.282729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1af331d1-4090-431b-81c1-8a5bf88917ad tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:31.283173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1af331d1-4090-431b-81c1-8a5bf88917ad tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:31.283881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1af331d1-4090-431b-81c1-8a5bf88917ad tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:31.284345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1af331d1-4090-431b-81c1-8a5bf88917ad tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:31.284781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1af331d1-4090-431b-81c1-8a5bf88917ad tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:31.414495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1af331d1-4090-431b-81c1-8a5bf88917ad tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:31.423141 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1af331d1-4090-431b-81c1-8a5bf88917ad tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1265 microversion: 2.1 time: 0.152825 Oct 24 11:19:31.423714 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3440/6855] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:31 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:32.447684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e53171e2-654b-4653-814d-09ae906739a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:32.448303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e53171e2-654b-4653-814d-09ae906739a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:32.462910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e53171e2-654b-4653-814d-09ae906739a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:32.463419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e53171e2-654b-4653-814d-09ae906739a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:32.464202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e53171e2-654b-4653-814d-09ae906739a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:32.465859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e53171e2-654b-4653-814d-09ae906739a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:32.466655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e53171e2-654b-4653-814d-09ae906739a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:32.467284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e53171e2-654b-4653-814d-09ae906739a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:32.644800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e53171e2-654b-4653-814d-09ae906739a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:32.653397 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e53171e2-654b-4653-814d-09ae906739a5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1265 microversion: 2.1 time: 0.210399 Oct 24 11:19:32.654002 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3416/6856] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:32 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:33.676949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6683da9f-19c0-4eca-b1d6-cfb0d83684c2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:33.677550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6683da9f-19c0-4eca-b1d6-cfb0d83684c2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:33.680296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:19:33.686060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6683da9f-19c0-4eca-b1d6-cfb0d83684c2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:33.686542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6683da9f-19c0-4eca-b1d6-cfb0d83684c2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:33.686979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6683da9f-19c0-4eca-b1d6-cfb0d83684c2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:33.687733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6683da9f-19c0-4eca-b1d6-cfb0d83684c2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:33.688183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6683da9f-19c0-4eca-b1d6-cfb0d83684c2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:33.688606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6683da9f-19c0-4eca-b1d6-cfb0d83684c2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:33.820618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6683da9f-19c0-4eca-b1d6-cfb0d83684c2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:33.829039 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6683da9f-19c0-4eca-b1d6-cfb0d83684c2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1265 microversion: 2.1 time: 0.156234 Oct 24 11:19:33.829683 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3441/6857] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:33 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:34.851728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-42ba84d3-165f-4e1a-870d-b2b8c158881c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:34.852390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-42ba84d3-165f-4e1a-870d-b2b8c158881c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:34.854387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:19:34.855190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:19:34.862697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42ba84d3-165f-4e1a-870d-b2b8c158881c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:34.863197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42ba84d3-165f-4e1a-870d-b2b8c158881c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:34.863651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42ba84d3-165f-4e1a-870d-b2b8c158881c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:34.864361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42ba84d3-165f-4e1a-870d-b2b8c158881c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:34.864853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42ba84d3-165f-4e1a-870d-b2b8c158881c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:34.865304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-42ba84d3-165f-4e1a-870d-b2b8c158881c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:34.995466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-42ba84d3-165f-4e1a-870d-b2b8c158881c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:35.003280 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-42ba84d3-165f-4e1a-870d-b2b8c158881c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1265 microversion: 2.1 time: 0.155548 Oct 24 11:19:35.003862 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3417/6858] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:34 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:36.025494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e458662e-2c06-4da2-872b-e3772704a112 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:36.026107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e458662e-2c06-4da2-872b-e3772704a112 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:36.033847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e458662e-2c06-4da2-872b-e3772704a112 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:36.034328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e458662e-2c06-4da2-872b-e3772704a112 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:36.034764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e458662e-2c06-4da2-872b-e3772704a112 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:36.035451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e458662e-2c06-4da2-872b-e3772704a112 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:36.035936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e458662e-2c06-4da2-872b-e3772704a112 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:36.036364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e458662e-2c06-4da2-872b-e3772704a112 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:36.172193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e458662e-2c06-4da2-872b-e3772704a112 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:36.179970 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e458662e-2c06-4da2-872b-e3772704a112 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1265 microversion: 2.1 time: 0.158751 Oct 24 11:19:36.180546 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3442/6859] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:36 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:37.203820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e530982e-a67c-40ae-b55d-63c62a668b36 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:37.204452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e530982e-a67c-40ae-b55d-63c62a668b36 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:37.211468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e530982e-a67c-40ae-b55d-63c62a668b36 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:37.211971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e530982e-a67c-40ae-b55d-63c62a668b36 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:37.212426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e530982e-a67c-40ae-b55d-63c62a668b36 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:37.213165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e530982e-a67c-40ae-b55d-63c62a668b36 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:37.213639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e530982e-a67c-40ae-b55d-63c62a668b36 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:37.214084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e530982e-a67c-40ae-b55d-63c62a668b36 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:37.347093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e530982e-a67c-40ae-b55d-63c62a668b36 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:37.354853 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e530982e-a67c-40ae-b55d-63c62a668b36 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1265 microversion: 2.1 time: 0.155629 Oct 24 11:19:37.356079 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3418/6860] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:37 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:38.378419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7cb13e63-f921-4dec-87fe-2be801dedc09 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:38.379080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7cb13e63-f921-4dec-87fe-2be801dedc09 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:38.385983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cb13e63-f921-4dec-87fe-2be801dedc09 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:38.386522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cb13e63-f921-4dec-87fe-2be801dedc09 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:38.387278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cb13e63-f921-4dec-87fe-2be801dedc09 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:38.387989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cb13e63-f921-4dec-87fe-2be801dedc09 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:38.388452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cb13e63-f921-4dec-87fe-2be801dedc09 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:38.388906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7cb13e63-f921-4dec-87fe-2be801dedc09 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:38.522256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7cb13e63-f921-4dec-87fe-2be801dedc09 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:38.530467 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7cb13e63-f921-4dec-87fe-2be801dedc09 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1265 microversion: 2.1 time: 0.156294 Oct 24 11:19:38.531035 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3443/6861] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:38 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:39.553636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c0bb2ea0-5efc-4ddc-bb36-164732e3bcf5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:39.554266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c0bb2ea0-5efc-4ddc-bb36-164732e3bcf5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:39.562245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0bb2ea0-5efc-4ddc-bb36-164732e3bcf5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:39.562757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0bb2ea0-5efc-4ddc-bb36-164732e3bcf5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:39.563207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0bb2ea0-5efc-4ddc-bb36-164732e3bcf5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:39.563927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0bb2ea0-5efc-4ddc-bb36-164732e3bcf5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:39.564399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0bb2ea0-5efc-4ddc-bb36-164732e3bcf5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:39.564859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c0bb2ea0-5efc-4ddc-bb36-164732e3bcf5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:39.700103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c0bb2ea0-5efc-4ddc-bb36-164732e3bcf5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:39.708061 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c0bb2ea0-5efc-4ddc-bb36-164732e3bcf5 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1265 microversion: 2.1 time: 0.158316 Oct 24 11:19:39.708641 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3419/6862] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:39 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:40.731961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4a288a44-0c59-4df2-86c2-cf1ed54950fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:40.732601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4a288a44-0c59-4df2-86c2-cf1ed54950fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:40.739435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a288a44-0c59-4df2-86c2-cf1ed54950fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:40.739913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a288a44-0c59-4df2-86c2-cf1ed54950fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:40.740346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a288a44-0c59-4df2-86c2-cf1ed54950fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:40.741064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a288a44-0c59-4df2-86c2-cf1ed54950fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:40.741515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a288a44-0c59-4df2-86c2-cf1ed54950fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:40.741941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a288a44-0c59-4df2-86c2-cf1ed54950fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:40.884113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4a288a44-0c59-4df2-86c2-cf1ed54950fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:40.892069 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4a288a44-0c59-4df2-86c2-cf1ed54950fb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1265 microversion: 2.1 time: 0.164785 Oct 24 11:19:40.892644 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3444/6863] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:40 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:41.053100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e8d94e35-e754-4909-99b1-42f106b22842 req-3cd7dcfa-f223-4340-9b55-497c91166909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "932f8fd5-a330-4a77-8033-9d74fd330faf", "name": "network-vif-plugged", "status": "completed", "tag": "87c0d86b-3fd0-485f-b115-422e4031011c"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:19:41.063461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e8d94e35-e754-4909-99b1-42f106b22842 req-3cd7dcfa-f223-4340-9b55-497c91166909 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:41.063967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e8d94e35-e754-4909-99b1-42f106b22842 req-3cd7dcfa-f223-4340-9b55-497c91166909 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:41.064423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e8d94e35-e754-4909-99b1-42f106b22842 req-3cd7dcfa-f223-4340-9b55-497c91166909 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:41.075455 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e8d94e35-e754-4909-99b1-42f106b22842 req-3cd7dcfa-f223-4340-9b55-497c91166909 service nova] Creating event network-vif-plugged:87c0d86b-3fd0-485f-b115-422e4031011c for instance 932f8fd5-a330-4a77-8033-9d74fd330faf on n-h1-858383-15 Oct 24 11:19:41.080466 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e8d94e35-e754-4909-99b1-42f106b22842 req-3cd7dcfa-f223-4340-9b55-497c91166909 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090216 Oct 24 11:19:41.081112 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3420/6864] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:19:41.915662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c845bd22-b005-42e9-ab43-c25ff09961bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:41.916288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c845bd22-b005-42e9-ab43-c25ff09961bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:41.923774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c845bd22-b005-42e9-ab43-c25ff09961bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:41.924269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c845bd22-b005-42e9-ab43-c25ff09961bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:41.924724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c845bd22-b005-42e9-ab43-c25ff09961bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:41.925438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c845bd22-b005-42e9-ab43-c25ff09961bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:41.925901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c845bd22-b005-42e9-ab43-c25ff09961bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:41.926334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c845bd22-b005-42e9-ab43-c25ff09961bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:42.056529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c845bd22-b005-42e9-ab43-c25ff09961bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:42.064345 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c845bd22-b005-42e9-ab43-c25ff09961bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1265 microversion: 2.1 time: 0.152654 Oct 24 11:19:42.064989 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3445/6865] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:41 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:43.089071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c7379e7f-e025-4bee-b943-0215db33830f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:43.090328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c7379e7f-e025-4bee-b943-0215db33830f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:43.096492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7379e7f-e025-4bee-b943-0215db33830f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:43.097039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7379e7f-e025-4bee-b943-0215db33830f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:43.097502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7379e7f-e025-4bee-b943-0215db33830f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:43.098210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7379e7f-e025-4bee-b943-0215db33830f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:43.098685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7379e7f-e025-4bee-b943-0215db33830f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:43.099131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7379e7f-e025-4bee-b943-0215db33830f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:43.232891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c7379e7f-e025-4bee-b943-0215db33830f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:43.240782 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c7379e7f-e025-4bee-b943-0215db33830f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1452 microversion: 2.1 time: 0.156957 Oct 24 11:19:43.241375 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3421/6866] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:43 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:43.262677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8a4b954f-c6d8-46c5-a9f4-d18318ddda9a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:19:43.263303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8a4b954f-c6d8-46c5-a9f4-d18318ddda9a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:19:43.270241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a4b954f-c6d8-46c5-a9f4-d18318ddda9a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:43.270729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a4b954f-c6d8-46c5-a9f4-d18318ddda9a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:43.271171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a4b954f-c6d8-46c5-a9f4-d18318ddda9a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:43.271877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a4b954f-c6d8-46c5-a9f4-d18318ddda9a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:43.272337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a4b954f-c6d8-46c5-a9f4-d18318ddda9a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:43.273070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8a4b954f-c6d8-46c5-a9f4-d18318ddda9a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:43.406755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8a4b954f-c6d8-46c5-a9f4-d18318ddda9a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:19:43.414568 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8a4b954f-c6d8-46c5-a9f4-d18318ddda9a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1452 microversion: 2.1 time: 0.155794 Oct 24 11:19:43.415150 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3446/6867] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:19:43 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:19:45.315609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-67bdd2fa-4eb8-4b35-839d-1e31c0a1ad66 req-5865b712-e93e-40c3-9ff9-15b52ea59658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "932f8fd5-a330-4a77-8033-9d74fd330faf", "tag": "87c0d86b-3fd0-485f-b115-422e4031011c"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:19:45.321698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:19:45.327818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-67bdd2fa-4eb8-4b35-839d-1e31c0a1ad66 req-5865b712-e93e-40c3-9ff9-15b52ea59658 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:19:45.328414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-67bdd2fa-4eb8-4b35-839d-1e31c0a1ad66 req-5865b712-e93e-40c3-9ff9-15b52ea59658 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:19:45.328986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-67bdd2fa-4eb8-4b35-839d-1e31c0a1ad66 req-5865b712-e93e-40c3-9ff9-15b52ea59658 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:19:45.333472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:19:45.342933 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-67bdd2fa-4eb8-4b35-839d-1e31c0a1ad66 req-5865b712-e93e-40c3-9ff9-15b52ea59658 service nova] Creating event network-changed:87c0d86b-3fd0-485f-b115-422e4031011c for instance 932f8fd5-a330-4a77-8033-9d74fd330faf on n-h1-858383-15 Oct 24 11:19:45.348540 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-67bdd2fa-4eb8-4b35-839d-1e31c0a1ad66 req-5865b712-e93e-40c3-9ff9-15b52ea59658 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036681 Oct 24 11:19:45.349362 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3422/6868] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:21:23.554956 n-d-858383-15 devstack@n-api.service[120426]: ERROR oslo.messaging._drivers.impl_rabbit [-] [05048d7c-6448-4d6e-b9e7-4fa04d95d8b6] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 11:21:23.556048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=34 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:21:23.556999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=86 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:21:23.557797 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:21:23.558027 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:21:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.50) !!! Oct 24 11:21:23.563652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7a662116-c1d0-4d05-aa29-5775d9118b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2107042943", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1448891001", "security_groups": [{"name": "tempest-secgroup-smoke-43606284"}], "block_device_mapping_v2": [{"uuid": "9db0feab-af3a-4b85-91ae-2996fe3f7147", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fd5ed2ae-44e8-4a94-8b2b-fd64f1a0661a"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:21:23.778021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-7a662116-c1d0-4d05-aa29-5775d9118b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] validate_networks() for [('fd5ed2ae-44e8-4a94-8b2b-fd64f1a0661a', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:21:24.205124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7a662116-c1d0-4d05-aa29-5775d9118b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:21:24.205507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7a662116-c1d0-4d05-aa29-5775d9118b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:21:24.205992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7a662116-c1d0-4d05-aa29-5775d9118b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:21:24.206406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7a662116-c1d0-4d05-aa29-5775d9118b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:21:24.206823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7a662116-c1d0-4d05-aa29-5775d9118b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:21:24.216325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a662116-c1d0-4d05-aa29-5775d9118b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:24.216807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a662116-c1d0-4d05-aa29-5775d9118b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:24.217287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a662116-c1d0-4d05-aa29-5775d9118b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:24.218021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a662116-c1d0-4d05-aa29-5775d9118b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:24.218482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a662116-c1d0-4d05-aa29-5775d9118b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:24.218913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a662116-c1d0-4d05-aa29-5775d9118b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:24.235973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-7a662116-c1d0-4d05-aa29-5775d9118b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Getting quotas for project 7643b3a05e304f89a945f512536e2df6. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:21:24.241587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-7a662116-c1d0-4d05-aa29-5775d9118b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Getting quotas for user ea036c351f864bd0bb927e15e897c9e3 and project 7643b3a05e304f89a945f512536e2df6. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:21:24.299769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7a662116-c1d0-4d05-aa29-5775d9118b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:21:24.301964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7a662116-c1d0-4d05-aa29-5775d9118b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9db0feab-af3a-4b85-91ae-2996fe3f7147',volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:21:24.431988 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7a662116-c1d0-4d05-aa29-5775d9118b97 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.878707 Oct 24 11:21:24.432702 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3447/6869] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:21:23 2022] POST /compute/v2.1/servers => generated 404 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:21:24.443181 n-d-858383-15 devstack@n-api.service[120425]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1abc338e-6c14-4311-a7b3-814582834b4a] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 11:21:24.449420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-54d59d36-87c6-4b82-9338-1870649d480b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:21:24.450788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-54d59d36-87c6-4b82-9338-1870649d480b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:21:24.562288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-54d59d36-87c6-4b82-9338-1870649d480b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:21:24.571661 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-54d59d36-87c6-4b82-9338-1870649d480b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1095 microversion: 2.1 time: 0.131053 Oct 24 11:21:24.572249 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3423/6870] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:21:24 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1095 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:21:25.596782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fe023f04-8b2e-4cf7-9cd6-9fdbbccc31a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:21:25.597818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fe023f04-8b2e-4cf7-9cd6-9fdbbccc31a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:21:25.624194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe023f04-8b2e-4cf7-9cd6-9fdbbccc31a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:25.624911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe023f04-8b2e-4cf7-9cd6-9fdbbccc31a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:25.625355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe023f04-8b2e-4cf7-9cd6-9fdbbccc31a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:25.626070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe023f04-8b2e-4cf7-9cd6-9fdbbccc31a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:25.626524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe023f04-8b2e-4cf7-9cd6-9fdbbccc31a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:25.626949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fe023f04-8b2e-4cf7-9cd6-9fdbbccc31a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:25.634393 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] [05048d7c-6448-4d6e-b9e7-4fa04d95d8b6] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 47094. Oct 24 11:21:25.697336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fe023f04-8b2e-4cf7-9cd6-9fdbbccc31a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:21:25.708054 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fe023f04-8b2e-4cf7-9cd6-9fdbbccc31a3 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1211 microversion: 2.1 time: 0.115945 Oct 24 11:21:25.709023 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3448/6871] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:21:25 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1211 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:21:26.733672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-71749614-062f-410c-9843-0d0d224bf7e2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:21:26.739145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-71749614-062f-410c-9843-0d0d224bf7e2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:21:26.755071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71749614-062f-410c-9843-0d0d224bf7e2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:26.755957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71749614-062f-410c-9843-0d0d224bf7e2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:26.756671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71749614-062f-410c-9843-0d0d224bf7e2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:26.757663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71749614-062f-410c-9843-0d0d224bf7e2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:26.758358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71749614-062f-410c-9843-0d0d224bf7e2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:26.759360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71749614-062f-410c-9843-0d0d224bf7e2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:26.764887 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] [1abc338e-6c14-4311-a7b3-814582834b4a] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 47100. Oct 24 11:21:26.912679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-71749614-062f-410c-9843-0d0d224bf7e2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:21:26.921690 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-71749614-062f-410c-9843-0d0d224bf7e2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1277 microversion: 2.1 time: 0.192412 Oct 24 11:21:26.922276 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3424/6872] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:21:26 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:21:27.432196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-91f438b6-ca1b-4d68-9777-5e81ff26377f req-6baa9bf4-0043-43f0-8f78-ffc93d59f179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd8d752e-558d-40ca-8c4e-fda9a6aec649", "tag": "75b2dad8-a10b-4396-a6d0-c18e3d63df81"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:21:27.446196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-91f438b6-ca1b-4d68-9777-5e81ff26377f req-6baa9bf4-0043-43f0-8f78-ffc93d59f179 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:27.446838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-91f438b6-ca1b-4d68-9777-5e81ff26377f req-6baa9bf4-0043-43f0-8f78-ffc93d59f179 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:27.447541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-91f438b6-ca1b-4d68-9777-5e81ff26377f req-6baa9bf4-0043-43f0-8f78-ffc93d59f179 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:27.463547 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-91f438b6-ca1b-4d68-9777-5e81ff26377f req-6baa9bf4-0043-43f0-8f78-ffc93d59f179 service nova] Creating event network-changed:75b2dad8-a10b-4396-a6d0-c18e3d63df81 for instance dd8d752e-558d-40ca-8c4e-fda9a6aec649 on n-h2-858383-15 Oct 24 11:21:27.471607 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-91f438b6-ca1b-4d68-9777-5e81ff26377f req-6baa9bf4-0043-43f0-8f78-ffc93d59f179 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044171 Oct 24 11:21:27.472269 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3449/6873] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:21:27.945427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-48a6fea1-9636-4c2f-8224-2599465f19cc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:21:27.946177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-48a6fea1-9636-4c2f-8224-2599465f19cc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:21:27.954624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48a6fea1-9636-4c2f-8224-2599465f19cc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:27.955252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48a6fea1-9636-4c2f-8224-2599465f19cc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:27.955933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48a6fea1-9636-4c2f-8224-2599465f19cc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:27.956722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48a6fea1-9636-4c2f-8224-2599465f19cc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:27.957565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48a6fea1-9636-4c2f-8224-2599465f19cc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:27.958408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-48a6fea1-9636-4c2f-8224-2599465f19cc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:28.119276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-48a6fea1-9636-4c2f-8224-2599465f19cc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:21:28.129772 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-48a6fea1-9636-4c2f-8224-2599465f19cc tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1277 microversion: 2.1 time: 0.188460 Oct 24 11:21:28.130863 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3425/6874] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:21:27 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:21:29.156314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3267ffad-f0ba-43df-b74f-a7ddf9cbb17d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:21:29.157047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3267ffad-f0ba-43df-b74f-a7ddf9cbb17d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:21:29.163315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3267ffad-f0ba-43df-b74f-a7ddf9cbb17d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:29.164043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3267ffad-f0ba-43df-b74f-a7ddf9cbb17d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:29.164483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3267ffad-f0ba-43df-b74f-a7ddf9cbb17d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:29.165238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3267ffad-f0ba-43df-b74f-a7ddf9cbb17d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:29.165685 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3267ffad-f0ba-43df-b74f-a7ddf9cbb17d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:29.166392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3267ffad-f0ba-43df-b74f-a7ddf9cbb17d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:29.303156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3267ffad-f0ba-43df-b74f-a7ddf9cbb17d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:21:29.311104 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3267ffad-f0ba-43df-b74f-a7ddf9cbb17d tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1277 microversion: 2.1 time: 0.160456 Oct 24 11:21:29.311678 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3450/6875] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:21:29 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:21:30.334662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-456db97e-875d-4c28-bb13-01b6b24c180e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:21:30.335298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-456db97e-875d-4c28-bb13-01b6b24c180e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:21:30.343014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-456db97e-875d-4c28-bb13-01b6b24c180e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:30.343518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-456db97e-875d-4c28-bb13-01b6b24c180e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:30.343979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-456db97e-875d-4c28-bb13-01b6b24c180e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:30.344696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-456db97e-875d-4c28-bb13-01b6b24c180e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:30.345198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-456db97e-875d-4c28-bb13-01b6b24c180e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:30.345651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-456db97e-875d-4c28-bb13-01b6b24c180e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:30.493934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-456db97e-875d-4c28-bb13-01b6b24c180e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:21:30.502206 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-456db97e-875d-4c28-bb13-01b6b24c180e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1277 microversion: 2.1 time: 0.171509 Oct 24 11:21:30.502804 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3426/6876] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:21:30 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:21:31.526550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7fd689d0-197f-4b61-824f-ec8b8deffe64 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:21:31.527225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7fd689d0-197f-4b61-824f-ec8b8deffe64 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:21:31.535607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fd689d0-197f-4b61-824f-ec8b8deffe64 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:31.536096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fd689d0-197f-4b61-824f-ec8b8deffe64 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:31.536599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fd689d0-197f-4b61-824f-ec8b8deffe64 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:31.537399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fd689d0-197f-4b61-824f-ec8b8deffe64 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:31.537862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fd689d0-197f-4b61-824f-ec8b8deffe64 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:31.538317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7fd689d0-197f-4b61-824f-ec8b8deffe64 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:31.679990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7fd689d0-197f-4b61-824f-ec8b8deffe64 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:21:31.688443 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7fd689d0-197f-4b61-824f-ec8b8deffe64 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1265 microversion: 2.1 time: 0.166611 Oct 24 11:21:31.689120 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3451/6877] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:21:31 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:21:32.713434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-adbb3694-a860-4358-8b1c-f3a3376c5ab7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:21:32.714100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-adbb3694-a860-4358-8b1c-f3a3376c5ab7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:21:32.721778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adbb3694-a860-4358-8b1c-f3a3376c5ab7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:32.722350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adbb3694-a860-4358-8b1c-f3a3376c5ab7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:32.722817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adbb3694-a860-4358-8b1c-f3a3376c5ab7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:32.723543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adbb3694-a860-4358-8b1c-f3a3376c5ab7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:32.724019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adbb3694-a860-4358-8b1c-f3a3376c5ab7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:32.724477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-adbb3694-a860-4358-8b1c-f3a3376c5ab7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:32.867237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-adbb3694-a860-4358-8b1c-f3a3376c5ab7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:21:32.876062 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-adbb3694-a860-4358-8b1c-f3a3376c5ab7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1265 microversion: 2.1 time: 0.166346 Oct 24 11:21:32.876661 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3427/6878] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:21:32 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:21:33.900123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-317e03e2-c395-4ebc-a880-23b188c57b4a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:21:33.900751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-317e03e2-c395-4ebc-a880-23b188c57b4a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:21:33.908184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-317e03e2-c395-4ebc-a880-23b188c57b4a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:33.908682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-317e03e2-c395-4ebc-a880-23b188c57b4a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:33.909164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-317e03e2-c395-4ebc-a880-23b188c57b4a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:33.909883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-317e03e2-c395-4ebc-a880-23b188c57b4a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:33.910345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-317e03e2-c395-4ebc-a880-23b188c57b4a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:33.910780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-317e03e2-c395-4ebc-a880-23b188c57b4a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:34.061003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-317e03e2-c395-4ebc-a880-23b188c57b4a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:21:34.070132 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-317e03e2-c395-4ebc-a880-23b188c57b4a tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1265 microversion: 2.1 time: 0.173936 Oct 24 11:21:34.071114 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3452/6879] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:21:33 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:21:35.104122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-db0b410c-6601-4981-93d0-f24a1f2a70b2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:21:35.104648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-db0b410c-6601-4981-93d0-f24a1f2a70b2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:21:35.107449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:21:35.113029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db0b410c-6601-4981-93d0-f24a1f2a70b2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:35.113534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db0b410c-6601-4981-93d0-f24a1f2a70b2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:35.113984 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db0b410c-6601-4981-93d0-f24a1f2a70b2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:35.114689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db0b410c-6601-4981-93d0-f24a1f2a70b2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:35.115155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db0b410c-6601-4981-93d0-f24a1f2a70b2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:35.115590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db0b410c-6601-4981-93d0-f24a1f2a70b2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:35.261836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-db0b410c-6601-4981-93d0-f24a1f2a70b2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:21:35.270617 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-db0b410c-6601-4981-93d0-f24a1f2a70b2 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1265 microversion: 2.1 time: 0.170338 Oct 24 11:21:35.271216 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3428/6880] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:21:35 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:21:36.294118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-96ed38de-a9a9-4b34-b3d1-7fdd878fe23f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:21:36.294660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-96ed38de-a9a9-4b34-b3d1-7fdd878fe23f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:21:36.296596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:21:36.297274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:21:36.303871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96ed38de-a9a9-4b34-b3d1-7fdd878fe23f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:36.304344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96ed38de-a9a9-4b34-b3d1-7fdd878fe23f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:36.304778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96ed38de-a9a9-4b34-b3d1-7fdd878fe23f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:36.305490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96ed38de-a9a9-4b34-b3d1-7fdd878fe23f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:36.305937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96ed38de-a9a9-4b34-b3d1-7fdd878fe23f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:36.306354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96ed38de-a9a9-4b34-b3d1-7fdd878fe23f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:36.436789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-96ed38de-a9a9-4b34-b3d1-7fdd878fe23f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:21:36.444497 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-96ed38de-a9a9-4b34-b3d1-7fdd878fe23f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1265 microversion: 2.1 time: 0.154556 Oct 24 11:21:36.445117 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3453/6881] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:21:36 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:21:37.469161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bb3e3374-49eb-480c-952e-d581a6894e79 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:21:37.469776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bb3e3374-49eb-480c-952e-d581a6894e79 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:21:37.476736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb3e3374-49eb-480c-952e-d581a6894e79 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:37.477261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb3e3374-49eb-480c-952e-d581a6894e79 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:37.477714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb3e3374-49eb-480c-952e-d581a6894e79 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:37.478410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb3e3374-49eb-480c-952e-d581a6894e79 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:37.478880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb3e3374-49eb-480c-952e-d581a6894e79 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:37.479316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bb3e3374-49eb-480c-952e-d581a6894e79 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:37.609923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bb3e3374-49eb-480c-952e-d581a6894e79 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:21:37.617744 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bb3e3374-49eb-480c-952e-d581a6894e79 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1265 microversion: 2.1 time: 0.153386 Oct 24 11:21:37.618331 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3429/6882] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:21:37 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:21:38.642068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b2373bd8-3302-4b64-97f2-0f7345d2038b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:21:38.642849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b2373bd8-3302-4b64-97f2-0f7345d2038b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:21:38.650602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2373bd8-3302-4b64-97f2-0f7345d2038b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:38.651418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2373bd8-3302-4b64-97f2-0f7345d2038b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:38.651860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2373bd8-3302-4b64-97f2-0f7345d2038b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:38.652637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2373bd8-3302-4b64-97f2-0f7345d2038b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:38.653262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2373bd8-3302-4b64-97f2-0f7345d2038b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:38.653693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2373bd8-3302-4b64-97f2-0f7345d2038b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:38.793529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b2373bd8-3302-4b64-97f2-0f7345d2038b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:21:38.801465 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b2373bd8-3302-4b64-97f2-0f7345d2038b tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1265 microversion: 2.1 time: 0.163293 Oct 24 11:21:38.802064 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3454/6883] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:21:38 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:21:39.824325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fd954394-0988-4182-91cf-f64a04f7bf81 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:21:39.825270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fd954394-0988-4182-91cf-f64a04f7bf81 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:21:39.832469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd954394-0988-4182-91cf-f64a04f7bf81 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:39.833009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd954394-0988-4182-91cf-f64a04f7bf81 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:39.833474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd954394-0988-4182-91cf-f64a04f7bf81 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:39.834190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd954394-0988-4182-91cf-f64a04f7bf81 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:39.834670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd954394-0988-4182-91cf-f64a04f7bf81 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:39.835120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd954394-0988-4182-91cf-f64a04f7bf81 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:39.967094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fd954394-0988-4182-91cf-f64a04f7bf81 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:21:39.974897 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fd954394-0988-4182-91cf-f64a04f7bf81 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1265 microversion: 2.1 time: 0.154613 Oct 24 11:21:39.975473 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3430/6884] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:21:39 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:21:40.266009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-c86aa641-fcec-4f52-805f-b4255285db62 req-5bbcd5e4-82f3-42fa-acc9-9e35da48a67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8d752e-558d-40ca-8c4e-fda9a6aec649", "name": "network-vif-plugged", "status": "completed", "tag": "75b2dad8-a10b-4396-a6d0-c18e3d63df81"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:21:40.277830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c86aa641-fcec-4f52-805f-b4255285db62 req-5bbcd5e4-82f3-42fa-acc9-9e35da48a67f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:40.278313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c86aa641-fcec-4f52-805f-b4255285db62 req-5bbcd5e4-82f3-42fa-acc9-9e35da48a67f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:40.278743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c86aa641-fcec-4f52-805f-b4255285db62 req-5bbcd5e4-82f3-42fa-acc9-9e35da48a67f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:40.290211 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-c86aa641-fcec-4f52-805f-b4255285db62 req-5bbcd5e4-82f3-42fa-acc9-9e35da48a67f service nova] Creating event network-vif-plugged:75b2dad8-a10b-4396-a6d0-c18e3d63df81 for instance dd8d752e-558d-40ca-8c4e-fda9a6aec649 on n-h2-858383-15 Oct 24 11:21:40.295978 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-c86aa641-fcec-4f52-805f-b4255285db62 req-5bbcd5e4-82f3-42fa-acc9-9e35da48a67f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033915 Oct 24 11:21:40.296592 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3455/6885] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:21:40.999552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68dbb219-5c9b-4351-85df-cbfef1fcefc1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:21:41.000124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-68dbb219-5c9b-4351-85df-cbfef1fcefc1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:21:41.007145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68dbb219-5c9b-4351-85df-cbfef1fcefc1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:41.007646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68dbb219-5c9b-4351-85df-cbfef1fcefc1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:41.008108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68dbb219-5c9b-4351-85df-cbfef1fcefc1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:41.008822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68dbb219-5c9b-4351-85df-cbfef1fcefc1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:41.009318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68dbb219-5c9b-4351-85df-cbfef1fcefc1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:41.009766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68dbb219-5c9b-4351-85df-cbfef1fcefc1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:41.148149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-68dbb219-5c9b-4351-85df-cbfef1fcefc1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:21:41.156502 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-68dbb219-5c9b-4351-85df-cbfef1fcefc1 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1265 microversion: 2.1 time: 0.161794 Oct 24 11:21:41.157103 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3431/6886] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:21:40 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:21:42.180555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3af83944-7da1-472c-9a98-e089cc1278d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:21:42.181307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3af83944-7da1-472c-9a98-e089cc1278d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:21:42.188438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3af83944-7da1-472c-9a98-e089cc1278d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:42.188958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3af83944-7da1-472c-9a98-e089cc1278d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:42.189397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3af83944-7da1-472c-9a98-e089cc1278d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:42.190088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3af83944-7da1-472c-9a98-e089cc1278d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:42.190538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3af83944-7da1-472c-9a98-e089cc1278d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:42.190961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3af83944-7da1-472c-9a98-e089cc1278d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:42.323700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3af83944-7da1-472c-9a98-e089cc1278d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:21:42.331586 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3af83944-7da1-472c-9a98-e089cc1278d8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1452 microversion: 2.1 time: 0.155248 Oct 24 11:21:42.332168 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3456/6887] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:21:42 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:21:42.354013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7da0cb72-721b-4b66-a9c6-9e79008e2604 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:21:42.354645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7da0cb72-721b-4b66-a9c6-9e79008e2604 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:21:42.362195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7da0cb72-721b-4b66-a9c6-9e79008e2604 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:42.362698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7da0cb72-721b-4b66-a9c6-9e79008e2604 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:42.363155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7da0cb72-721b-4b66-a9c6-9e79008e2604 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:42.363864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7da0cb72-721b-4b66-a9c6-9e79008e2604 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:42.364339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7da0cb72-721b-4b66-a9c6-9e79008e2604 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:42.364784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7da0cb72-721b-4b66-a9c6-9e79008e2604 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:42.499743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7da0cb72-721b-4b66-a9c6-9e79008e2604 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:21:42.507524 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7da0cb72-721b-4b66-a9c6-9e79008e2604 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1452 microversion: 2.1 time: 0.157418 Oct 24 11:21:42.508104 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3432/6888] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:21:42 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:21:44.117311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-5cdc99d5-d1c7-429f-9449-eb80b419da7b req-7476b286-c09f-4de1-9634-13c6867fabc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd8d752e-558d-40ca-8c4e-fda9a6aec649", "tag": "75b2dad8-a10b-4396-a6d0-c18e3d63df81"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:21:44.128411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5cdc99d5-d1c7-429f-9449-eb80b419da7b req-7476b286-c09f-4de1-9634-13c6867fabc2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:21:44.128922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5cdc99d5-d1c7-429f-9449-eb80b419da7b req-7476b286-c09f-4de1-9634-13c6867fabc2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:21:44.129573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5cdc99d5-d1c7-429f-9449-eb80b419da7b req-7476b286-c09f-4de1-9634-13c6867fabc2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:21:44.142845 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-5cdc99d5-d1c7-429f-9449-eb80b419da7b req-7476b286-c09f-4de1-9634-13c6867fabc2 service nova] Creating event network-changed:75b2dad8-a10b-4396-a6d0-c18e3d63df81 for instance dd8d752e-558d-40ca-8c4e-fda9a6aec649 on n-h2-858383-15 Oct 24 11:21:44.148341 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-5cdc99d5-d1c7-429f-9449-eb80b419da7b req-7476b286-c09f-4de1-9634-13c6867fabc2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034528 Oct 24 11:21:44.149145 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3457/6889] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:23:24.123062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-05e997ed-774e-4c15-bada-8e5f7ec3ef1f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:24.123617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-05e997ed-774e-4c15-bada-8e5f7ec3ef1f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:23:24.127251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=23 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:23:24.129185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=55 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:23:24.130189 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:23:24.130830 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:23:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 (ip 10.222.0.50) !!! Oct 24 11:23:24.134211 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:23:24.134211 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:23:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 (ip 10.222.0.50) !!! Oct 24 11:23:24.135276 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:23:24.135463 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:23:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 (ip 10.222.0.50) !!! Oct 24 11:23:24.164509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05e997ed-774e-4c15-bada-8e5f7ec3ef1f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:24.165074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05e997ed-774e-4c15-bada-8e5f7ec3ef1f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:24.165524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05e997ed-774e-4c15-bada-8e5f7ec3ef1f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:24.166247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05e997ed-774e-4c15-bada-8e5f7ec3ef1f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:24.166717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05e997ed-774e-4c15-bada-8e5f7ec3ef1f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:24.167157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05e997ed-774e-4c15-bada-8e5f7ec3ef1f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:24.197443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-05e997ed-774e-4c15-bada-8e5f7ec3ef1f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:23:24.281800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:23:24.284489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=50 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:23:24.285678 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:23:24.285817 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:23:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.50) !!! Oct 24 11:23:24.289184 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-05e997ed-774e-4c15-bada-8e5f7ec3ef1f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 204 len: 0 microversion: 2.1 time: 0.175981 Oct 24 11:23:24.290135 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3433/6890] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:23:24 2022] DELETE /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:23:24.303645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-988cd742-e1d6-4e97-874b-1272cec41bd7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:24.304432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-988cd742-e1d6-4e97-874b-1272cec41bd7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:23:24.310667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-988cd742-e1d6-4e97-874b-1272cec41bd7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:24.311174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-988cd742-e1d6-4e97-874b-1272cec41bd7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:24.311634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-988cd742-e1d6-4e97-874b-1272cec41bd7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:24.312416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-988cd742-e1d6-4e97-874b-1272cec41bd7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:24.312924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-988cd742-e1d6-4e97-874b-1272cec41bd7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:24.313425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-988cd742-e1d6-4e97-874b-1272cec41bd7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:24.381625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a03816c8-e018-4f6f-b345-e7e545c91520 req-288905f7-443e-446c-a899-3d4c175925fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd8d752e-558d-40ca-8c4e-fda9a6aec649", "tag": "75b2dad8-a10b-4396-a6d0-c18e3d63df81"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:23:24.391624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a03816c8-e018-4f6f-b345-e7e545c91520 req-288905f7-443e-446c-a899-3d4c175925fd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:24.392624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a03816c8-e018-4f6f-b345-e7e545c91520 req-288905f7-443e-446c-a899-3d4c175925fd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:24.393106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a03816c8-e018-4f6f-b345-e7e545c91520 req-288905f7-443e-446c-a899-3d4c175925fd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:24.409576 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a03816c8-e018-4f6f-b345-e7e545c91520 req-288905f7-443e-446c-a899-3d4c175925fd service nova] Creating event network-changed:75b2dad8-a10b-4396-a6d0-c18e3d63df81 for instance dd8d752e-558d-40ca-8c4e-fda9a6aec649 on n-h2-858383-15 Oct 24 11:23:24.414814 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a03816c8-e018-4f6f-b345-e7e545c91520 req-288905f7-443e-446c-a899-3d4c175925fd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137753 Oct 24 11:23:24.415425 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3458/6891] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:23:24.592770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-988cd742-e1d6-4e97-874b-1272cec41bd7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:23:24.602015 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-988cd742-e1d6-4e97-874b-1272cec41bd7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1576 microversion: 2.1 time: 0.305278 Oct 24 11:23:24.602839 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3434/6892] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:23:24 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1576 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:23:25.627896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-af6c200c-64b8-4efb-b69a-d50fb11a7174 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:25.628512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-af6c200c-64b8-4efb-b69a-d50fb11a7174 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:23:25.634767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af6c200c-64b8-4efb-b69a-d50fb11a7174 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:25.635255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af6c200c-64b8-4efb-b69a-d50fb11a7174 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:25.635695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af6c200c-64b8-4efb-b69a-d50fb11a7174 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:25.636391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af6c200c-64b8-4efb-b69a-d50fb11a7174 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:25.636869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af6c200c-64b8-4efb-b69a-d50fb11a7174 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:25.637300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af6c200c-64b8-4efb-b69a-d50fb11a7174 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:25.849399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-af6c200c-64b8-4efb-b69a-d50fb11a7174 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:23:25.857185 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-af6c200c-64b8-4efb-b69a-d50fb11a7174 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1576 microversion: 2.1 time: 0.235223 Oct 24 11:23:25.857767 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3459/6893] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:23:25 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1576 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:23:26.722378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ad8ce4a9-0145-4a59-a0ca-9bcae1557906 req-4d8d90d8-47e5-49d2-8de8-a43968ee9d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8d752e-558d-40ca-8c4e-fda9a6aec649", "name": "network-vif-deleted", "tag": "75b2dad8-a10b-4396-a6d0-c18e3d63df81"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:23:26.732528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ad8ce4a9-0145-4a59-a0ca-9bcae1557906 req-4d8d90d8-47e5-49d2-8de8-a43968ee9d00 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:26.733061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ad8ce4a9-0145-4a59-a0ca-9bcae1557906 req-4d8d90d8-47e5-49d2-8de8-a43968ee9d00 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:26.733512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ad8ce4a9-0145-4a59-a0ca-9bcae1557906 req-4d8d90d8-47e5-49d2-8de8-a43968ee9d00 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:26.746196 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ad8ce4a9-0145-4a59-a0ca-9bcae1557906 req-4d8d90d8-47e5-49d2-8de8-a43968ee9d00 service nova] Creating event network-vif-deleted:75b2dad8-a10b-4396-a6d0-c18e3d63df81 for instance dd8d752e-558d-40ca-8c4e-fda9a6aec649 on n-h2-858383-15 Oct 24 11:23:26.751673 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ad8ce4a9-0145-4a59-a0ca-9bcae1557906 req-4d8d90d8-47e5-49d2-8de8-a43968ee9d00 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083083 Oct 24 11:23:26.752481 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3435/6894] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:23:26.882062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-035fbeea-d779-4ef1-b84b-1665d8c2e741 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:26.882713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-035fbeea-d779-4ef1-b84b-1665d8c2e741 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:23:26.889882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-035fbeea-d779-4ef1-b84b-1665d8c2e741 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:26.890809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-035fbeea-d779-4ef1-b84b-1665d8c2e741 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:26.891335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-035fbeea-d779-4ef1-b84b-1665d8c2e741 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:26.892725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-035fbeea-d779-4ef1-b84b-1665d8c2e741 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:26.893378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-035fbeea-d779-4ef1-b84b-1665d8c2e741 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:26.893815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-035fbeea-d779-4ef1-b84b-1665d8c2e741 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:26.963872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-035fbeea-d779-4ef1-b84b-1665d8c2e741 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:23:26.973183 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-035fbeea-d779-4ef1-b84b-1665d8c2e741 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1226 microversion: 2.1 time: 0.095040 Oct 24 11:23:26.973841 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3460/6895] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:23:26 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:23:27.998192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-de32e421-b049-4e29-b21c-8671b6481eec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:27.998913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-de32e421-b049-4e29-b21c-8671b6481eec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:23:28.005780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de32e421-b049-4e29-b21c-8671b6481eec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:28.006299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de32e421-b049-4e29-b21c-8671b6481eec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:28.006730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de32e421-b049-4e29-b21c-8671b6481eec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:28.007434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de32e421-b049-4e29-b21c-8671b6481eec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:28.007900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de32e421-b049-4e29-b21c-8671b6481eec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:28.008403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de32e421-b049-4e29-b21c-8671b6481eec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:28.074719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-de32e421-b049-4e29-b21c-8671b6481eec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:23:28.084243 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-de32e421-b049-4e29-b21c-8671b6481eec tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1226 microversion: 2.1 time: 0.091181 Oct 24 11:23:28.084851 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3436/6896] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:23:27 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:23:29.107344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b46ebfca-5f22-4139-9166-1362a1b69c6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:29.108039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b46ebfca-5f22-4139-9166-1362a1b69c6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:23:29.115211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b46ebfca-5f22-4139-9166-1362a1b69c6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:29.115702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b46ebfca-5f22-4139-9166-1362a1b69c6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:29.116191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b46ebfca-5f22-4139-9166-1362a1b69c6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:29.116932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b46ebfca-5f22-4139-9166-1362a1b69c6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:29.117401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b46ebfca-5f22-4139-9166-1362a1b69c6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:29.117837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b46ebfca-5f22-4139-9166-1362a1b69c6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:29.185389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b46ebfca-5f22-4139-9166-1362a1b69c6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:23:29.193704 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b46ebfca-5f22-4139-9166-1362a1b69c6f tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1226 microversion: 2.1 time: 0.090290 Oct 24 11:23:29.194295 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3461/6897] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:23:29 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:23:30.217868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-827168fc-e5ab-423d-bb30-ae6193e637e9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:30.218786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-827168fc-e5ab-423d-bb30-ae6193e637e9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:23:30.226391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-827168fc-e5ab-423d-bb30-ae6193e637e9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:30.226899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-827168fc-e5ab-423d-bb30-ae6193e637e9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:30.227357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-827168fc-e5ab-423d-bb30-ae6193e637e9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:30.228074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-827168fc-e5ab-423d-bb30-ae6193e637e9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:30.228570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-827168fc-e5ab-423d-bb30-ae6193e637e9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:30.229066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-827168fc-e5ab-423d-bb30-ae6193e637e9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:30.292702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-827168fc-e5ab-423d-bb30-ae6193e637e9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:23:30.302284 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-827168fc-e5ab-423d-bb30-ae6193e637e9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 200 len: 1226 microversion: 2.1 time: 0.088572 Oct 24 11:23:30.302868 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3437/6898] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:23:30 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:23:31.324905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-13bf7cab-6036-4030-af3c-94a3c7017f8c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:31.325571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-13bf7cab-6036-4030-af3c-94a3c7017f8c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: dd8d752e-558d-40ca-8c4e-fda9a6aec649] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:23:31.332960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13bf7cab-6036-4030-af3c-94a3c7017f8c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:31.333442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13bf7cab-6036-4030-af3c-94a3c7017f8c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:31.333881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13bf7cab-6036-4030-af3c-94a3c7017f8c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:31.334573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13bf7cab-6036-4030-af3c-94a3c7017f8c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:31.335025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13bf7cab-6036-4030-af3c-94a3c7017f8c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:31.335450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13bf7cab-6036-4030-af3c-94a3c7017f8c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:31.363516 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-13bf7cab-6036-4030-af3c-94a3c7017f8c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] HTTP exception thrown: Instance dd8d752e-558d-40ca-8c4e-fda9a6aec649 could not be found. Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-13bf7cab-6036-4030-af3c-94a3c7017f8c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Request method failure captured: Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 HTTP/1.1 Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnM2OqlSOkhfxDfVEeTT94IwX8qn5k49naomhNLud1uic_lKwej-RJQ1PZooBFuUMpS4DQEMNgRR3ENofPbDmyI7Cy_YSVUuCsvfRNdcFM4T5H_sDbiD3-ZTRmSQR0yoz-aOqM9u5ViLunGIsswJX3XnF9XyVytj9jbL6H3Gm1Ht-2Q Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7643b3a05e304f89a945f512536e2df6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ea036c351f864bd0bb927e15e897c9e3 Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance dd8d752e-558d-40ca-8c4e-fda9a6aec649 could not be found. Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'dd8d752e-558d-40ca-8c4e-fda9a6aec649'} Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd8d752e-558d-40ca-8c4e-fda9a6aec649 could not be found. Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd8d752e-558d-40ca-8c4e-fda9a6aec649 could not be found. Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:23:31.365120 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:23:31.369579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:23:31.369579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:23:31.369579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:23:31.369579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:23:31.369579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:23:31.369579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd8d752e-558d-40ca-8c4e-fda9a6aec649 could not be found. Oct 24 11:23:31.369579 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:23:31.369579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-13bf7cab-6036-4030-af3c-94a3c7017f8c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Returning 404 to user: Instance dd8d752e-558d-40ca-8c4e-fda9a6aec649 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:23:31.369579 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-13bf7cab-6036-4030-af3c-94a3c7017f8c tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649" status: 404 len: 111 microversion: 2.1 time: 0.045658 Oct 24 11:23:31.369579 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3462/6899] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:23:31 2022] GET /compute/v2.1/servers/dd8d752e-558d-40ca-8c4e-fda9a6aec649 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:23:37.660985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ecd7c0b9-a17d-493f-b5a4-8374faeba9bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:37.661520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a8b1bb64-f716-4fe8-90a8-d1fdff179284 req-2e909fe1-7eee-440d-a7b7-5099284a6f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "932f8fd5-a330-4a77-8033-9d74fd330faf", "tag": "87c0d86b-3fd0-485f-b115-422e4031011c"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:23:37.661875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ecd7c0b9-a17d-493f-b5a4-8374faeba9bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:23:37.669480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecd7c0b9-a17d-493f-b5a4-8374faeba9bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:37.669985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecd7c0b9-a17d-493f-b5a4-8374faeba9bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:37.670550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecd7c0b9-a17d-493f-b5a4-8374faeba9bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:37.671155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecd7c0b9-a17d-493f-b5a4-8374faeba9bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:37.671621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecd7c0b9-a17d-493f-b5a4-8374faeba9bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:37.672061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ecd7c0b9-a17d-493f-b5a4-8374faeba9bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:37.672411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a8b1bb64-f716-4fe8-90a8-d1fdff179284 req-2e909fe1-7eee-440d-a7b7-5099284a6f6c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:37.673585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a8b1bb64-f716-4fe8-90a8-d1fdff179284 req-2e909fe1-7eee-440d-a7b7-5099284a6f6c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:37.674037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a8b1bb64-f716-4fe8-90a8-d1fdff179284 req-2e909fe1-7eee-440d-a7b7-5099284a6f6c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:37.686401 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a8b1bb64-f716-4fe8-90a8-d1fdff179284 req-2e909fe1-7eee-440d-a7b7-5099284a6f6c service nova] Creating event network-changed:87c0d86b-3fd0-485f-b115-422e4031011c for instance 932f8fd5-a330-4a77-8033-9d74fd330faf on n-h1-858383-15 Oct 24 11:23:37.692549 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a8b1bb64-f716-4fe8-90a8-d1fdff179284 req-2e909fe1-7eee-440d-a7b7-5099284a6f6c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035764 Oct 24 11:23:37.693569 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3463/6900] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:23:37.706730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ecd7c0b9-a17d-493f-b5a4-8374faeba9bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:23:37.802275 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ecd7c0b9-a17d-493f-b5a4-8374faeba9bb tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "DELETE /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 204 len: 0 microversion: 2.1 time: 0.150113 Oct 24 11:23:37.802897 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3438/6901] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:23:37 2022] DELETE /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:23:37.813886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-adbde095-f78f-4a9f-846a-4ae7645a054e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:37.814639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-adbde095-f78f-4a9f-846a-4ae7645a054e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:23:37.822113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adbde095-f78f-4a9f-846a-4ae7645a054e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:37.822353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adbde095-f78f-4a9f-846a-4ae7645a054e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:37.822768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adbde095-f78f-4a9f-846a-4ae7645a054e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:37.823536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adbde095-f78f-4a9f-846a-4ae7645a054e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:37.823994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adbde095-f78f-4a9f-846a-4ae7645a054e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:37.824432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-adbde095-f78f-4a9f-846a-4ae7645a054e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:37.969259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-adbde095-f78f-4a9f-846a-4ae7645a054e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:23:37.980411 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-adbde095-f78f-4a9f-846a-4ae7645a054e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1577 microversion: 2.1 time: 0.172265 Oct 24 11:23:37.981391 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3464/6902] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:23:37 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:23:39.015000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2e96653c-20ef-48ce-84fa-391f44f346b7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:39.015763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2e96653c-20ef-48ce-84fa-391f44f346b7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:23:39.022900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e96653c-20ef-48ce-84fa-391f44f346b7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:39.023409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e96653c-20ef-48ce-84fa-391f44f346b7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:39.024139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e96653c-20ef-48ce-84fa-391f44f346b7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:39.024895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e96653c-20ef-48ce-84fa-391f44f346b7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:39.025379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e96653c-20ef-48ce-84fa-391f44f346b7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:39.025830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e96653c-20ef-48ce-84fa-391f44f346b7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:39.168606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2e96653c-20ef-48ce-84fa-391f44f346b7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:23:39.178149 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2e96653c-20ef-48ce-84fa-391f44f346b7 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1577 microversion: 2.1 time: 0.167575 Oct 24 11:23:39.178726 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3439/6903] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:23:39 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:23:40.061678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-afbed56d-f57a-4c92-996e-536c002ed2da req-4aff4f17-f1e9-4045-9e0b-823ee304959d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "932f8fd5-a330-4a77-8033-9d74fd330faf", "name": "network-vif-deleted", "tag": "87c0d86b-3fd0-485f-b115-422e4031011c"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:23:40.073372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-afbed56d-f57a-4c92-996e-536c002ed2da req-4aff4f17-f1e9-4045-9e0b-823ee304959d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:40.073857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-afbed56d-f57a-4c92-996e-536c002ed2da req-4aff4f17-f1e9-4045-9e0b-823ee304959d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:40.074342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-afbed56d-f57a-4c92-996e-536c002ed2da req-4aff4f17-f1e9-4045-9e0b-823ee304959d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:40.086876 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-afbed56d-f57a-4c92-996e-536c002ed2da req-4aff4f17-f1e9-4045-9e0b-823ee304959d service nova] Creating event network-vif-deleted:87c0d86b-3fd0-485f-b115-422e4031011c for instance 932f8fd5-a330-4a77-8033-9d74fd330faf on n-h1-858383-15 Oct 24 11:23:40.091831 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-afbed56d-f57a-4c92-996e-536c002ed2da req-4aff4f17-f1e9-4045-9e0b-823ee304959d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033849 Oct 24 11:23:40.092445 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3465/6904] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:23:40.201998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7b81096a-d0c1-4cab-b2b6-725fefd51da8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:40.203598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7b81096a-d0c1-4cab-b2b6-725fefd51da8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:23:40.211028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b81096a-d0c1-4cab-b2b6-725fefd51da8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:40.211540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b81096a-d0c1-4cab-b2b6-725fefd51da8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:40.212002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b81096a-d0c1-4cab-b2b6-725fefd51da8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:40.212757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b81096a-d0c1-4cab-b2b6-725fefd51da8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:40.213265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b81096a-d0c1-4cab-b2b6-725fefd51da8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:40.213740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7b81096a-d0c1-4cab-b2b6-725fefd51da8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:40.277280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7b81096a-d0c1-4cab-b2b6-725fefd51da8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:23:40.285514 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7b81096a-d0c1-4cab-b2b6-725fefd51da8 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1226 microversion: 2.1 time: 0.087522 Oct 24 11:23:40.286103 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3440/6905] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:23:40 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:23:41.311394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e58e0b36-d991-4e1f-9b64-5e804e4b0068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:41.312021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e58e0b36-d991-4e1f-9b64-5e804e4b0068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:23:41.318768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e58e0b36-d991-4e1f-9b64-5e804e4b0068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:41.319257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e58e0b36-d991-4e1f-9b64-5e804e4b0068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:41.319724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e58e0b36-d991-4e1f-9b64-5e804e4b0068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:41.320458 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e58e0b36-d991-4e1f-9b64-5e804e4b0068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:41.320935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e58e0b36-d991-4e1f-9b64-5e804e4b0068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:41.321391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e58e0b36-d991-4e1f-9b64-5e804e4b0068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:41.385075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e58e0b36-d991-4e1f-9b64-5e804e4b0068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:23:41.393901 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e58e0b36-d991-4e1f-9b64-5e804e4b0068 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1226 microversion: 2.1 time: 0.087945 Oct 24 11:23:41.394482 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3466/6906] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:23:41 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:23:42.418404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-75c0087b-2ba3-42a0-864e-7e7b1d28f7d9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:42.419040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-75c0087b-2ba3-42a0-864e-7e7b1d28f7d9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:23:42.426837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75c0087b-2ba3-42a0-864e-7e7b1d28f7d9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:42.427346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75c0087b-2ba3-42a0-864e-7e7b1d28f7d9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:42.427808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75c0087b-2ba3-42a0-864e-7e7b1d28f7d9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:42.428537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75c0087b-2ba3-42a0-864e-7e7b1d28f7d9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:42.429038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75c0087b-2ba3-42a0-864e-7e7b1d28f7d9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:42.429493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-75c0087b-2ba3-42a0-864e-7e7b1d28f7d9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:42.501967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-75c0087b-2ba3-42a0-864e-7e7b1d28f7d9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:23:42.510638 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-75c0087b-2ba3-42a0-864e-7e7b1d28f7d9 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1226 microversion: 2.1 time: 0.096144 Oct 24 11:23:42.511238 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3441/6907] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:23:42 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:23:43.534106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ee6b1f6c-e5fa-4206-b349-6bf0e40d06ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:43.534738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ee6b1f6c-e5fa-4206-b349-6bf0e40d06ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:23:43.541646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee6b1f6c-e5fa-4206-b349-6bf0e40d06ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:43.542131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee6b1f6c-e5fa-4206-b349-6bf0e40d06ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:43.542630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee6b1f6c-e5fa-4206-b349-6bf0e40d06ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:43.543275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee6b1f6c-e5fa-4206-b349-6bf0e40d06ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:43.543733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee6b1f6c-e5fa-4206-b349-6bf0e40d06ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:43.544161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee6b1f6c-e5fa-4206-b349-6bf0e40d06ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:43.606881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ee6b1f6c-e5fa-4206-b349-6bf0e40d06ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea036c351f864bd0bb927e15e897c9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7643b3a05e304f89a945f512536e2df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:23:43.615442 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ee6b1f6c-e5fa-4206-b349-6bf0e40d06ce tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 200 len: 1226 microversion: 2.1 time: 0.085623 Oct 24 11:23:43.616028 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3467/6908] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:23:43 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:23:44.638362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6aef79da-4d47-46fc-85d2-6fcdff21a964 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:44.638993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6aef79da-4d47-46fc-85d2-6fcdff21a964 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 932f8fd5-a330-4a77-8033-9d74fd330faf] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:23:44.646897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aef79da-4d47-46fc-85d2-6fcdff21a964 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:44.647401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aef79da-4d47-46fc-85d2-6fcdff21a964 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:44.647858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aef79da-4d47-46fc-85d2-6fcdff21a964 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:44.648570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aef79da-4d47-46fc-85d2-6fcdff21a964 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:44.649319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aef79da-4d47-46fc-85d2-6fcdff21a964 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:44.649764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6aef79da-4d47-46fc-85d2-6fcdff21a964 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:44.663497 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-6aef79da-4d47-46fc-85d2-6fcdff21a964 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] HTTP exception thrown: Instance 932f8fd5-a330-4a77-8033-9d74fd330faf could not be found. Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6aef79da-4d47-46fc-85d2-6fcdff21a964 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Request method failure captured: Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf HTTP/1.1 Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnM2OqlSOkhfxDfVEeTT94IwX8qn5k49naomhNLud1uic_lKwej-RJQ1PZooBFuUMpS4DQEMNgRR3ENofPbDmyI7Cy_YSVUuCsvfRNdcFM4T5H_sDbiD3-ZTRmSQR0yoz-aOqM9u5ViLunGIsswJX3XnF9XyVytj9jbL6H3Gm1Ht-2Q Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7643b3a05e304f89a945f512536e2df6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ea036c351f864bd0bb927e15e897c9e3 Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 932f8fd5-a330-4a77-8033-9d74fd330faf could not be found. Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '932f8fd5-a330-4a77-8033-9d74fd330faf'} Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 932f8fd5-a330-4a77-8033-9d74fd330faf could not be found. Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 932f8fd5-a330-4a77-8033-9d74fd330faf could not be found. Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:23:44.665178 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:23:44.668994 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:23:44.668994 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:23:44.668994 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:23:44.668994 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:23:44.668994 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:23:44.668994 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 932f8fd5-a330-4a77-8033-9d74fd330faf could not be found. Oct 24 11:23:44.668994 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:23:44.668994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6aef79da-4d47-46fc-85d2-6fcdff21a964 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Returning 404 to user: Instance 932f8fd5-a330-4a77-8033-9d74fd330faf could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:23:44.668994 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6aef79da-4d47-46fc-85d2-6fcdff21a964 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf" status: 404 len: 111 microversion: 2.1 time: 0.032264 Oct 24 11:23:44.668994 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3442/6909] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:23:44 2022] GET /compute/v2.1/servers/932f8fd5-a330-4a77-8033-9d74fd330faf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:23:45.107859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8b1a99b7-9596-4334-a202-95dd9a7f2eaa tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:45.108361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8b1a99b7-9596-4334-a202-95dd9a7f2eaa tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:23:45.116130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b1a99b7-9596-4334-a202-95dd9a7f2eaa tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:45.116609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b1a99b7-9596-4334-a202-95dd9a7f2eaa tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:45.117122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b1a99b7-9596-4334-a202-95dd9a7f2eaa tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:45.117947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b1a99b7-9596-4334-a202-95dd9a7f2eaa tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:45.118407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b1a99b7-9596-4334-a202-95dd9a7f2eaa tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:45.118832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8b1a99b7-9596-4334-a202-95dd9a7f2eaa tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:45.133634 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-8b1a99b7-9596-4334-a202-95dd9a7f2eaa tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] HTTP exception thrown: Instance 335172fa-66d1-4427-9a59-5196e804d7c6 could not be found. Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8b1a99b7-9596-4334-a202-95dd9a7f2eaa tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Request method failure captured: Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 HTTP/1.1 Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnM2OqlSOkhfxDfVEeTT94IwX8qn5k49naomhNLud1uic_lKwej-RJQ1PZooBFuUMpS4DQEMNgRR3ENofPbDmyI7Cy_YSVUuCsvfRNdcFM4T5H_sDbiD3-ZTRmSQR0yoz-aOqM9u5ViLunGIsswJX3XnF9XyVytj9jbL6H3Gm1Ht-2Q Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7643b3a05e304f89a945f512536e2df6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: ea036c351f864bd0bb927e15e897c9e3 Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 335172fa-66d1-4427-9a59-5196e804d7c6 could not be found. Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '335172fa-66d1-4427-9a59-5196e804d7c6'} Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 335172fa-66d1-4427-9a59-5196e804d7c6 could not be found. Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:23:45.135305 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:23:45.139647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 335172fa-66d1-4427-9a59-5196e804d7c6 could not be found. Oct 24 11:23:45.139647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:23:45.139647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:23:45.139647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:23:45.139647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:23:45.139647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:23:45.139647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:23:45.139647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:23:45.139647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:23:45.139647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 335172fa-66d1-4427-9a59-5196e804d7c6 could not be found. Oct 24 11:23:45.139647 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:23:45.139647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8b1a99b7-9596-4334-a202-95dd9a7f2eaa tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Returning 404 to user: Instance 335172fa-66d1-4427-9a59-5196e804d7c6 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:23:45.139647 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8b1a99b7-9596-4334-a202-95dd9a7f2eaa tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "DELETE /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 404 len: 111 microversion: 2.1 time: 0.032743 Oct 24 11:23:45.139647 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3468/6910] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:23:45 2022] DELETE /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:23:45.145820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3f2f4695-d28b-40b3-bb5d-7c4759c3b26e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:45.146458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3f2f4695-d28b-40b3-bb5d-7c4759c3b26e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] [instance: 335172fa-66d1-4427-9a59-5196e804d7c6] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:23:45.152789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f2f4695-d28b-40b3-bb5d-7c4759c3b26e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:45.153327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f2f4695-d28b-40b3-bb5d-7c4759c3b26e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:45.153788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f2f4695-d28b-40b3-bb5d-7c4759c3b26e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:45.154504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f2f4695-d28b-40b3-bb5d-7c4759c3b26e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:23:45.154979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f2f4695-d28b-40b3-bb5d-7c4759c3b26e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:23:45.155865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f2f4695-d28b-40b3-bb5d-7c4759c3b26e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:23:45.172619 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-3f2f4695-d28b-40b3-bb5d-7c4759c3b26e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] HTTP exception thrown: Instance 335172fa-66d1-4427-9a59-5196e804d7c6 could not be found. Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3f2f4695-d28b-40b3-bb5d-7c4759c3b26e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Request method failure captured: Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 HTTP/1.1 Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnM2OqlSOkhfxDfVEeTT94IwX8qn5k49naomhNLud1uic_lKwej-RJQ1PZooBFuUMpS4DQEMNgRR3ENofPbDmyI7Cy_YSVUuCsvfRNdcFM4T5H_sDbiD3-ZTRmSQR0yoz-aOqM9u5ViLunGIsswJX3XnF9XyVytj9jbL6H3Gm1Ht-2Q Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7643b3a05e304f89a945f512536e2df6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7643b3a05e304f89a945f512536e2df6", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 7643b3a05e304f89a945f512536e2df6 Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestVolumeBootPattern-1865381720 Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: ea036c351f864bd0bb927e15e897c9e3 Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestVolumeBootPattern-1865381720-project Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 335172fa-66d1-4427-9a59-5196e804d7c6 could not be found. Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '335172fa-66d1-4427-9a59-5196e804d7c6'} Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 335172fa-66d1-4427-9a59-5196e804d7c6 could not be found. Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 335172fa-66d1-4427-9a59-5196e804d7c6 could not be found. Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:23:45.175921 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:23:45.182136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:23:45.182136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:23:45.182136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:23:45.182136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:23:45.182136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:23:45.182136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 335172fa-66d1-4427-9a59-5196e804d7c6 could not be found. Oct 24 11:23:45.182136 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:23:45.182136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3f2f4695-d28b-40b3-bb5d-7c4759c3b26e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Returning 404 to user: Instance 335172fa-66d1-4427-9a59-5196e804d7c6 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:23:45.182136 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3f2f4695-d28b-40b3-bb5d-7c4759c3b26e tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6" status: 404 len: 111 microversion: 2.1 time: 0.035618 Oct 24 11:23:45.182136 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3443/6911] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:23:45 2022] GET /compute/v2.1/servers/335172fa-66d1-4427-9a59-5196e804d7c6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:23:48.598143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b14118c7-283b-4f5d-8c45-b157b58db1b4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] Calling method '.version_select at 0x7f04d01bbb80>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:23:48.625623 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b14118c7-283b-4f5d-8c45-b157b58db1b4 tempest-TestVolumeBootPattern-1865381720 tempest-TestVolumeBootPattern-1865381720-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1448891001" status: 202 len: 0 microversion: 2.1 time: 0.031280 Oct 24 11:23:48.635878 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3469/6912] 10.222.0.50 () {58 vars in 1263 bytes} [Mon Oct 24 11:23:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1448891001 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:24:07.415070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:24:07.415820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:24:07.522364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f88c24e1-dc97-4fe0-9847-6a493cdac119 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1539038064", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:24:07.574794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-f88c24e1-dc97-4fe0-9847-6a493cdac119 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] validate_networks() for None {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:24:07.841977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-f88c24e1-dc97-4fe0-9847-6a493cdac119 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:24:07.842418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-f88c24e1-dc97-4fe0-9847-6a493cdac119 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:24:07.842911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-f88c24e1-dc97-4fe0-9847-6a493cdac119 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:24:07.843339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-f88c24e1-dc97-4fe0-9847-6a493cdac119 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:24:07.843779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-f88c24e1-dc97-4fe0-9847-6a493cdac119 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:24:07.857928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f88c24e1-dc97-4fe0-9847-6a493cdac119 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:07.858429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f88c24e1-dc97-4fe0-9847-6a493cdac119 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:07.858889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f88c24e1-dc97-4fe0-9847-6a493cdac119 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:07.859639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f88c24e1-dc97-4fe0-9847-6a493cdac119 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:07.860115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f88c24e1-dc97-4fe0-9847-6a493cdac119 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:07.860564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f88c24e1-dc97-4fe0-9847-6a493cdac119 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:07.882260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-f88c24e1-dc97-4fe0-9847-6a493cdac119 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Getting quotas for project ba8846233d1f4473840503af3d0d2c58. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:24:07.889629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-f88c24e1-dc97-4fe0-9847-6a493cdac119 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Getting quotas for user 46f6061ceb664822af8f33b6ebcf1d40 and project ba8846233d1f4473840503af3d0d2c58. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:24:07.904685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f88c24e1-dc97-4fe0-9847-6a493cdac119 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:24:07.907033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f88c24e1-dc97-4fe0-9847-6a493cdac119 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:24:07.952003 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f88c24e1-dc97-4fe0-9847-6a493cdac119 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542441 Oct 24 11:24:07.952926 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3444/6913] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:24:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:24:07.963451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=46 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:24:07.964396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:24:07.969656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1a065873-1206-4092-a755-ae306e825e16 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:07.970316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1a065873-1206-4092-a755-ae306e825e16 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:08.034905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1a065873-1206-4092-a755-ae306e825e16 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f6061ceb664822af8f33b6ebcf1d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8846233d1f4473840503af3d0d2c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:08.045466 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1a065873-1206-4092-a755-ae306e825e16 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] 10.222.0.50 "GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74" status: 200 len: 1222 microversion: 2.1 time: 0.083701 Oct 24 11:24:08.046126 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3470/6914] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:07 2022] GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:09.069414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6bf0fecb-de2d-43fc-8461-732f59fc3c74 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:09.070044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6bf0fecb-de2d-43fc-8461-732f59fc3c74 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:09.077168 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bf0fecb-de2d-43fc-8461-732f59fc3c74 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:09.077934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bf0fecb-de2d-43fc-8461-732f59fc3c74 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:09.078392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bf0fecb-de2d-43fc-8461-732f59fc3c74 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:09.079466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bf0fecb-de2d-43fc-8461-732f59fc3c74 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:09.079942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bf0fecb-de2d-43fc-8461-732f59fc3c74 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:09.080560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6bf0fecb-de2d-43fc-8461-732f59fc3c74 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:09.150886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6bf0fecb-de2d-43fc-8461-732f59fc3c74 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f6061ceb664822af8f33b6ebcf1d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8846233d1f4473840503af3d0d2c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:09.158744 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6bf0fecb-de2d-43fc-8461-732f59fc3c74 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] 10.222.0.50 "GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74" status: 200 len: 1292 microversion: 2.1 time: 0.094848 Oct 24 11:24:09.159982 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3445/6915] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:09 2022] GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74 => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:10.183728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-46f9d29a-dc9a-4a0c-af53-25064c22bba3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:10.184379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-46f9d29a-dc9a-4a0c-af53-25064c22bba3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:10.192395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46f9d29a-dc9a-4a0c-af53-25064c22bba3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:10.192915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46f9d29a-dc9a-4a0c-af53-25064c22bba3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:10.193364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46f9d29a-dc9a-4a0c-af53-25064c22bba3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:10.194078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46f9d29a-dc9a-4a0c-af53-25064c22bba3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:10.194537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46f9d29a-dc9a-4a0c-af53-25064c22bba3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:10.194969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46f9d29a-dc9a-4a0c-af53-25064c22bba3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:10.334377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-46f9d29a-dc9a-4a0c-af53-25064c22bba3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f6061ceb664822af8f33b6ebcf1d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8846233d1f4473840503af3d0d2c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:10.342399 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-46f9d29a-dc9a-4a0c-af53-25064c22bba3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] 10.222.0.50 "GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74" status: 200 len: 1322 microversion: 2.1 time: 0.162722 Oct 24 11:24:10.343094 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3471/6916] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:10 2022] GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:10.556282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d3def83a-9b10-4531-9856-935cd5c0d814 req-66b7e9d7-cc72-4532-a7c5-81fae494d207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2984895-0581-4586-b436-9bf0fbd59b74", "tag": "2a3790da-7a4f-4644-8ab7-63479a93acc3"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:24:10.569557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d3def83a-9b10-4531-9856-935cd5c0d814 req-66b7e9d7-cc72-4532-a7c5-81fae494d207 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:10.570064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d3def83a-9b10-4531-9856-935cd5c0d814 req-66b7e9d7-cc72-4532-a7c5-81fae494d207 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:10.570509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d3def83a-9b10-4531-9856-935cd5c0d814 req-66b7e9d7-cc72-4532-a7c5-81fae494d207 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:10.581924 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d3def83a-9b10-4531-9856-935cd5c0d814 req-66b7e9d7-cc72-4532-a7c5-81fae494d207 service nova] Creating event network-changed:2a3790da-7a4f-4644-8ab7-63479a93acc3 for instance d2984895-0581-4586-b436-9bf0fbd59b74 on n-h1-858383-15 Oct 24 11:24:10.588427 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d3def83a-9b10-4531-9856-935cd5c0d814 req-66b7e9d7-cc72-4532-a7c5-81fae494d207 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036467 Oct 24 11:24:10.589159 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3446/6917] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:24:11.366249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b4ac4295-3d47-44c8-a441-42c2c9b14c07 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:11.366868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b4ac4295-3d47-44c8-a441-42c2c9b14c07 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:11.373797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ac4295-3d47-44c8-a441-42c2c9b14c07 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:11.374285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ac4295-3d47-44c8-a441-42c2c9b14c07 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:11.374730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ac4295-3d47-44c8-a441-42c2c9b14c07 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:11.375423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ac4295-3d47-44c8-a441-42c2c9b14c07 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:11.375880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ac4295-3d47-44c8-a441-42c2c9b14c07 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:11.376310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ac4295-3d47-44c8-a441-42c2c9b14c07 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:11.508631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b4ac4295-3d47-44c8-a441-42c2c9b14c07 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f6061ceb664822af8f33b6ebcf1d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8846233d1f4473840503af3d0d2c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:11.516466 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b4ac4295-3d47-44c8-a441-42c2c9b14c07 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] 10.222.0.50 "GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74" status: 200 len: 1322 microversion: 2.1 time: 0.154447 Oct 24 11:24:11.517075 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3472/6918] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:11 2022] GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:12.542287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4384fe12-1ba1-4129-9746-66af31915ad3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:12.543007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4384fe12-1ba1-4129-9746-66af31915ad3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:12.549217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4384fe12-1ba1-4129-9746-66af31915ad3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:12.549716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4384fe12-1ba1-4129-9746-66af31915ad3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:12.550173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4384fe12-1ba1-4129-9746-66af31915ad3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:12.550888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4384fe12-1ba1-4129-9746-66af31915ad3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:12.551361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4384fe12-1ba1-4129-9746-66af31915ad3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:12.551807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4384fe12-1ba1-4129-9746-66af31915ad3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:12.679924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4384fe12-1ba1-4129-9746-66af31915ad3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f6061ceb664822af8f33b6ebcf1d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8846233d1f4473840503af3d0d2c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:12.687600 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4384fe12-1ba1-4129-9746-66af31915ad3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] 10.222.0.50 "GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74" status: 200 len: 1322 microversion: 2.1 time: 0.150537 Oct 24 11:24:12.688170 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3447/6919] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:12 2022] GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:13.710581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2bd647c2-6538-4e9a-9d6b-1176afe44472 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:13.711221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2bd647c2-6538-4e9a-9d6b-1176afe44472 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:13.718164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bd647c2-6538-4e9a-9d6b-1176afe44472 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:13.718594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bd647c2-6538-4e9a-9d6b-1176afe44472 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:13.719032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bd647c2-6538-4e9a-9d6b-1176afe44472 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:13.719729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bd647c2-6538-4e9a-9d6b-1176afe44472 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:13.720186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bd647c2-6538-4e9a-9d6b-1176afe44472 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:13.720625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bd647c2-6538-4e9a-9d6b-1176afe44472 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:13.853618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2bd647c2-6538-4e9a-9d6b-1176afe44472 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f6061ceb664822af8f33b6ebcf1d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8846233d1f4473840503af3d0d2c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:13.861234 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2bd647c2-6538-4e9a-9d6b-1176afe44472 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] 10.222.0.50 "GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74" status: 200 len: 1322 microversion: 2.1 time: 0.155005 Oct 24 11:24:13.861813 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3473/6920] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:13 2022] GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:14.885038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ec9481f8-65a1-4cac-8c2c-1e73cb158e21 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:14.885672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ec9481f8-65a1-4cac-8c2c-1e73cb158e21 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:14.893758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec9481f8-65a1-4cac-8c2c-1e73cb158e21 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:14.894274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec9481f8-65a1-4cac-8c2c-1e73cb158e21 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:14.894737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec9481f8-65a1-4cac-8c2c-1e73cb158e21 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:14.895504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec9481f8-65a1-4cac-8c2c-1e73cb158e21 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:14.895982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec9481f8-65a1-4cac-8c2c-1e73cb158e21 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:14.896434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ec9481f8-65a1-4cac-8c2c-1e73cb158e21 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:15.027011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ec9481f8-65a1-4cac-8c2c-1e73cb158e21 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f6061ceb664822af8f33b6ebcf1d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8846233d1f4473840503af3d0d2c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:15.034708 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ec9481f8-65a1-4cac-8c2c-1e73cb158e21 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] 10.222.0.50 "GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74" status: 200 len: 1322 microversion: 2.1 time: 0.153696 Oct 24 11:24:15.035274 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3448/6921] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:14 2022] GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:16.057979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4bbdd4e4-91a7-4396-8570-06b7fa7d16f2 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:16.058606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4bbdd4e4-91a7-4396-8570-06b7fa7d16f2 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:16.065541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bbdd4e4-91a7-4396-8570-06b7fa7d16f2 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:16.066033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bbdd4e4-91a7-4396-8570-06b7fa7d16f2 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:16.066496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bbdd4e4-91a7-4396-8570-06b7fa7d16f2 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:16.067204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bbdd4e4-91a7-4396-8570-06b7fa7d16f2 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:16.067669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bbdd4e4-91a7-4396-8570-06b7fa7d16f2 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:16.068136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bbdd4e4-91a7-4396-8570-06b7fa7d16f2 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:16.205272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4bbdd4e4-91a7-4396-8570-06b7fa7d16f2 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f6061ceb664822af8f33b6ebcf1d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8846233d1f4473840503af3d0d2c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:16.213238 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4bbdd4e4-91a7-4396-8570-06b7fa7d16f2 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] 10.222.0.50 "GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74" status: 200 len: 1322 microversion: 2.1 time: 0.159067 Oct 24 11:24:16.213825 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3474/6922] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:16 2022] GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:16.467629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-cc2c11db-a401-4019-8b0f-1d70d6ad6f22 req-fe83a8b0-74de-4d6d-9481-8c25bd460ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2984895-0581-4586-b436-9bf0fbd59b74", "name": "network-vif-plugged", "status": "completed", "tag": "2a3790da-7a4f-4644-8ab7-63479a93acc3"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:24:16.477817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cc2c11db-a401-4019-8b0f-1d70d6ad6f22 req-fe83a8b0-74de-4d6d-9481-8c25bd460ef8 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:16.478317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cc2c11db-a401-4019-8b0f-1d70d6ad6f22 req-fe83a8b0-74de-4d6d-9481-8c25bd460ef8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:16.478766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cc2c11db-a401-4019-8b0f-1d70d6ad6f22 req-fe83a8b0-74de-4d6d-9481-8c25bd460ef8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:16.489618 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-cc2c11db-a401-4019-8b0f-1d70d6ad6f22 req-fe83a8b0-74de-4d6d-9481-8c25bd460ef8 service nova] Creating event network-vif-plugged:2a3790da-7a4f-4644-8ab7-63479a93acc3 for instance d2984895-0581-4586-b436-9bf0fbd59b74 on n-h1-858383-15 Oct 24 11:24:16.494594 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-cc2c11db-a401-4019-8b0f-1d70d6ad6f22 req-fe83a8b0-74de-4d6d-9481-8c25bd460ef8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086175 Oct 24 11:24:16.495213 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3449/6923] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:24:17.235829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-79392c02-77e5-4c40-a63b-79b77d2483f3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:17.236443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-79392c02-77e5-4c40-a63b-79b77d2483f3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:17.243413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79392c02-77e5-4c40-a63b-79b77d2483f3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:17.243894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79392c02-77e5-4c40-a63b-79b77d2483f3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:17.244325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79392c02-77e5-4c40-a63b-79b77d2483f3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:17.245045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79392c02-77e5-4c40-a63b-79b77d2483f3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:17.245500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79392c02-77e5-4c40-a63b-79b77d2483f3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:17.245924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79392c02-77e5-4c40-a63b-79b77d2483f3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:17.378778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-79392c02-77e5-4c40-a63b-79b77d2483f3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f6061ceb664822af8f33b6ebcf1d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8846233d1f4473840503af3d0d2c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:17.386423 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-79392c02-77e5-4c40-a63b-79b77d2483f3 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] 10.222.0.50 "GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74" status: 200 len: 1322 microversion: 2.1 time: 0.154701 Oct 24 11:24:17.387009 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3475/6924] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:17 2022] GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:18.407666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:24:18.408463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:24:18.412819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-70c6d125-d9a9-44f8-b9ae-32262917354d tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:18.413594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-70c6d125-d9a9-44f8-b9ae-32262917354d tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:18.420658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70c6d125-d9a9-44f8-b9ae-32262917354d tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:18.421144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70c6d125-d9a9-44f8-b9ae-32262917354d tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:18.421597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70c6d125-d9a9-44f8-b9ae-32262917354d tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:18.422305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70c6d125-d9a9-44f8-b9ae-32262917354d tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:18.422777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70c6d125-d9a9-44f8-b9ae-32262917354d tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:18.423223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-70c6d125-d9a9-44f8-b9ae-32262917354d tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:18.554153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-70c6d125-d9a9-44f8-b9ae-32262917354d tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f6061ceb664822af8f33b6ebcf1d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8846233d1f4473840503af3d0d2c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:18.561994 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-70c6d125-d9a9-44f8-b9ae-32262917354d tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] 10.222.0.50 "GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74" status: 200 len: 1472 microversion: 2.1 time: 0.156090 Oct 24 11:24:18.562514 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3450/6925] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:18 2022] GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74 => generated 1472 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:18.588645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:24:18.638992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c210b351-11f5-446a-b489-09e214360b58 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Calling method '.version_select at 0x7f04d0b62ca0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:18.702825 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c210b351-11f5-446a-b489-09e214360b58 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/fe1fc3f81d7b4d1aaa7ea2037bbd4fde" status: 200 len: 371 microversion: 2.1 time: 0.118712 Oct 24 11:24:18.703402 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3476/6926] 10.222.0.50 () {58 vars in 1242 bytes} [Mon Oct 24 11:24:18 2022] GET /compute/v2.1/os-quota-sets/fe1fc3f81d7b4d1aaa7ea2037bbd4fde => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:24:18.715449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-685bb114-8de3-475c-a130-b55db518b653 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1386166199", "id": 1782457321, "os-flavor-access:is_public": "True"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:24:18.733080 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-685bb114-8de3-475c-a130-b55db518b653 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021369 Oct 24 11:24:18.733645 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3451/6927] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:24:18 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:24:18.746134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1782457321"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:24:18.748384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:18.755349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:18.755834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:18.756276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:18.757003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:18.757459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:18.757886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:18.980054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '591d1bc36b7d44c6bd25dd829bef2109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1fc3f81d7b4d1aaa7ea2037bbd4fde', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:18.986277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1386166199 {{(pid=120426) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 24 11:24:18.993514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:18.993981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:18.994413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:18.995131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:18.995576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:18.996000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:19.018701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Getting quotas for project ba8846233d1f4473840503af3d0d2c58. Resources: {'cores', 'ram'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:24:19.023682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Getting quotas for user 46f6061ceb664822af8f33b6ebcf1d40 and project ba8846233d1f4473840503af3d0d2c58. Resources: {'cores', 'ram'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:24:19.036399 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.compute.api [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] ram quota exceeded for fe1fc3f81d7b4d1aaa7ea2037bbd4fde, tried to resize instance. Oct 24 11:24:19.036961 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Request method failure captured: Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74/action HTTP/1.1 Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 39 Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnXXDk0akaumlT7Wx9FfSpPR9Xd9KKY9KwLm9kGi0JVR0Rq1AyySLHkA-3_3qVc5UBLK2W97UZOUl22Vp9W-XnUJtTn2HHyQFANeZqJBzZVSU94KUcu7g9lw2MvSWgdgOuVi-ZD9VYyEMfd7a2Lyq00-NM1YdaXSPtbwe4rf9bU_hy0 Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: fe1fc3f81d7b4d1aaa7ea2037bbd4fde Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2111501525 Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,admin,member Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,admin,member Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fe1fc3f81d7b4d1aaa7ea2037bbd4fde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fe1fc3f81d7b4d1aaa7ea2037bbd4fde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fe1fc3f81d7b4d1aaa7ea2037bbd4fde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fe1fc3f81d7b4d1aaa7ea2037bbd4fde", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2111501525 Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: fe1fc3f81d7b4d1aaa7ea2037bbd4fde Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2111501525 Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersAdminNegativeTestJSON-2111501525-project-admin Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 591d1bc36b7d44c6bd25dd829bef2109 Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2111501525-project-admin Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: {"resize": {"flavorRef": "1782457321"}} Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'd2984895-0581-4586-b436-9bf0fbd59b74', 'body': {'resize': {'flavorRef': '1782457321'}}} Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3880, in _check_quota_for_upsize Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 11:24:19.038890 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4246, in resize Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3898, in _check_quota_for_upsize Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-32c7f68d-c183-4e40-be0d-08f45ac89f37 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74/action" status: 403 len: 118 microversion: 2.1 time: 0.298063 Oct 24 11:24:19.046917 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3477/6928] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:24:18 2022] POST /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74/action => generated 118 bytes in 299 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:24:19.050790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1b1b0559-8a86-4d97-8d70-ea70aec1e09f tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:19.066654 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1b1b0559-8a86-4d97-8d70-ea70aec1e09f tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1782457321" status: 202 len: 0 microversion: 2.1 time: 0.020890 Oct 24 11:24:19.067227 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3452/6929] 10.222.0.50 () {58 vars in 1161 bytes} [Mon Oct 24 11:24:19 2022] DELETE /compute/v2.1/flavors/1782457321 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:24:19.075021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-45810695-9338-42cd-b051-952580607c3b tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:19.095399 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-45810695-9338-42cd-b051-952580607c3b tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023909 Oct 24 11:24:19.095886 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3478/6930] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 11:24:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:24:19.116955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-94a49d56-f9e4-4f50-8906-0c3cd5cc6fdb tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Calling method '.version_select at 0x7f04d0a33160>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:19.183887 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-94a49d56-f9e4-4f50-8906-0c3cd5cc6fdb tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/fe1fc3f81d7b4d1aaa7ea2037bbd4fde" status: 200 len: 371 microversion: 2.1 time: 0.071353 Oct 24 11:24:19.184451 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3453/6931] 10.222.0.50 () {58 vars in 1242 bytes} [Mon Oct 24 11:24:19 2022] GET /compute/v2.1/os-quota-sets/fe1fc3f81d7b4d1aaa7ea2037bbd4fde => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:24:19.196374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3bae44c3-1481-450f-8c71-641ac7f658b4 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1122778260", "id": 1264001882, "os-flavor-access:is_public": "True"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:24:19.214578 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3bae44c3-1481-450f-8c71-641ac7f658b4 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021914 Oct 24 11:24:19.215155 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3479/6932] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:24:19 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:24:19.228119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1264001882"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:24:19.230547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:19.236495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:19.237638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:19.238136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:19.238848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:19.239321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:19.239763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:19.402753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '591d1bc36b7d44c6bd25dd829bef2109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1fc3f81d7b4d1aaa7ea2037bbd4fde', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:19.409562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1122778260 {{(pid=120425) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 24 11:24:19.417001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:19.417490 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:19.417936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:19.418669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:19.419132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:19.419567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:19.445423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Getting quotas for project ba8846233d1f4473840503af3d0d2c58. Resources: {'cores', 'ram'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:24:19.450486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Getting quotas for user 46f6061ceb664822af8f33b6ebcf1d40 and project ba8846233d1f4473840503af3d0d2c58. Resources: {'cores', 'ram'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:24:19.464420 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.compute.api [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] cores quota exceeded for fe1fc3f81d7b4d1aaa7ea2037bbd4fde, tried to resize instance. Oct 24 11:24:19.465004 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Request method failure captured: Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74/action HTTP/1.1 Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 39 Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnXXDk0akaumlT7Wx9FfSpPR9Xd9KKY9KwLm9kGi0JVR0Rq1AyySLHkA-3_3qVc5UBLK2W97UZOUl22Vp9W-XnUJtTn2HHyQFANeZqJBzZVSU94KUcu7g9lw2MvSWgdgOuVi-ZD9VYyEMfd7a2Lyq00-NM1YdaXSPtbwe4rf9bU_hy0 Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: fe1fc3f81d7b4d1aaa7ea2037bbd4fde Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2111501525 Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,admin,member Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,admin,member Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fe1fc3f81d7b4d1aaa7ea2037bbd4fde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fe1fc3f81d7b4d1aaa7ea2037bbd4fde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fe1fc3f81d7b4d1aaa7ea2037bbd4fde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fe1fc3f81d7b4d1aaa7ea2037bbd4fde", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2111501525 Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: fe1fc3f81d7b4d1aaa7ea2037bbd4fde Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2111501525 Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersAdminNegativeTestJSON-2111501525-project-admin Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 591d1bc36b7d44c6bd25dd829bef2109 Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2111501525-project-admin Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: {"resize": {"flavorRef": "1264001882"}} Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'd2984895-0581-4586-b436-9bf0fbd59b74', 'body': {'resize': {'flavorRef': '1264001882'}}} Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3880, in _check_quota_for_upsize Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 11:24:19.467464 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4246, in resize Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3898, in _check_quota_for_upsize Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5b5bef0d-d781-4c2c-8bfb-e170f9305146 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74/action" status: 403 len: 113 microversion: 2.1 time: 0.244701 Oct 24 11:24:19.473006 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3454/6933] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:24:19 2022] POST /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74/action => generated 113 bytes in 246 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:24:19.479426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d9339448-48e1-43cb-ab3f-cff5d75268cb tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:19.495998 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d9339448-48e1-43cb-ab3f-cff5d75268cb tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1264001882" status: 202 len: 0 microversion: 2.1 time: 0.020902 Oct 24 11:24:19.496548 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3480/6934] 10.222.0.50 () {58 vars in 1161 bytes} [Mon Oct 24 11:24:19 2022] DELETE /compute/v2.1/flavors/1264001882 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:24:19.504969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a35cbbce-02fc-451b-9303-8d56fc8badd4 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:19.525985 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a35cbbce-02fc-451b-9303-8d56fc8badd4 tempest-ServersAdminNegativeTestJSON-2111501525 tempest-ServersAdminNegativeTestJSON-2111501525-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025180 Oct 24 11:24:19.526548 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3455/6935] 10.222.0.50 () {58 vars in 1146 bytes} [Mon Oct 24 11:24:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:19.547653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d86dbee7-14a8-40cb-9b29-a6506c126760 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:19.548159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d86dbee7-14a8-40cb-9b29-a6506c126760 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:19.554255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d86dbee7-14a8-40cb-9b29-a6506c126760 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:19.554746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d86dbee7-14a8-40cb-9b29-a6506c126760 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:19.555193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d86dbee7-14a8-40cb-9b29-a6506c126760 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:19.555893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d86dbee7-14a8-40cb-9b29-a6506c126760 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:19.556355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d86dbee7-14a8-40cb-9b29-a6506c126760 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:19.556795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d86dbee7-14a8-40cb-9b29-a6506c126760 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:19.582324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d86dbee7-14a8-40cb-9b29-a6506c126760 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:24:19.658651 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d86dbee7-14a8-40cb-9b29-a6506c126760 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74" status: 204 len: 0 microversion: 2.1 time: 0.114485 Oct 24 11:24:19.659474 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3481/6936] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:24:19 2022] DELETE /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:24:19.668252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-162a53ce-e16a-4afe-842f-ede537fd6886 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:19.668899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-162a53ce-e16a-4afe-842f-ede537fd6886 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:19.675033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-162a53ce-e16a-4afe-842f-ede537fd6886 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:19.675528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-162a53ce-e16a-4afe-842f-ede537fd6886 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:19.675977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-162a53ce-e16a-4afe-842f-ede537fd6886 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:19.676676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-162a53ce-e16a-4afe-842f-ede537fd6886 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:19.677195 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-162a53ce-e16a-4afe-842f-ede537fd6886 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:19.677760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-162a53ce-e16a-4afe-842f-ede537fd6886 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:19.813540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-162a53ce-e16a-4afe-842f-ede537fd6886 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f6061ceb664822af8f33b6ebcf1d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8846233d1f4473840503af3d0d2c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:19.821903 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-162a53ce-e16a-4afe-842f-ede537fd6886 tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] 10.222.0.50 "GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74" status: 200 len: 1478 microversion: 2.1 time: 0.157728 Oct 24 11:24:19.822493 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3456/6937] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:19 2022] GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74 => generated 1478 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:20.846268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e5dd30f-3017-4b1a-8fcc-255627f69e6c tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:20.847013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3e5dd30f-3017-4b1a-8fcc-255627f69e6c tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:20.854849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e5dd30f-3017-4b1a-8fcc-255627f69e6c tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:20.855330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e5dd30f-3017-4b1a-8fcc-255627f69e6c tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:20.855766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e5dd30f-3017-4b1a-8fcc-255627f69e6c tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:20.856456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e5dd30f-3017-4b1a-8fcc-255627f69e6c tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:20.856932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e5dd30f-3017-4b1a-8fcc-255627f69e6c tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:20.857363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e5dd30f-3017-4b1a-8fcc-255627f69e6c tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:20.993243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3e5dd30f-3017-4b1a-8fcc-255627f69e6c tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f6061ceb664822af8f33b6ebcf1d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8846233d1f4473840503af3d0d2c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:21.000930 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3e5dd30f-3017-4b1a-8fcc-255627f69e6c tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] 10.222.0.50 "GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74" status: 200 len: 1478 microversion: 2.1 time: 0.158883 Oct 24 11:24:21.001502 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3482/6938] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:20 2022] GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74 => generated 1478 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:21.681135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c0e77401-615a-491b-bbcd-a88d0225adf5 req-5e18e6d7-9689-4e69-8d15-db061b6d523c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2984895-0581-4586-b436-9bf0fbd59b74", "name": "network-vif-deleted", "tag": "2a3790da-7a4f-4644-8ab7-63479a93acc3"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:24:21.694177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c0e77401-615a-491b-bbcd-a88d0225adf5 req-5e18e6d7-9689-4e69-8d15-db061b6d523c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:21.695046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c0e77401-615a-491b-bbcd-a88d0225adf5 req-5e18e6d7-9689-4e69-8d15-db061b6d523c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:21.695500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c0e77401-615a-491b-bbcd-a88d0225adf5 req-5e18e6d7-9689-4e69-8d15-db061b6d523c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:21.707982 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c0e77401-615a-491b-bbcd-a88d0225adf5 req-5e18e6d7-9689-4e69-8d15-db061b6d523c service nova] Creating event network-vif-deleted:2a3790da-7a4f-4644-8ab7-63479a93acc3 for instance d2984895-0581-4586-b436-9bf0fbd59b74 on n-h1-858383-15 Oct 24 11:24:21.713362 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c0e77401-615a-491b-bbcd-a88d0225adf5 req-5e18e6d7-9689-4e69-8d15-db061b6d523c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036479 Oct 24 11:24:21.713984 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3457/6939] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:24:22.024349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cd877c72-d86b-488e-9a8d-b583d8dda9ec tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:22.025024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cd877c72-d86b-488e-9a8d-b583d8dda9ec tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:22.031817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd877c72-d86b-488e-9a8d-b583d8dda9ec tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:22.032332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd877c72-d86b-488e-9a8d-b583d8dda9ec tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:22.032781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd877c72-d86b-488e-9a8d-b583d8dda9ec tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:22.033503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd877c72-d86b-488e-9a8d-b583d8dda9ec tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:22.034464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd877c72-d86b-488e-9a8d-b583d8dda9ec tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:22.034904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd877c72-d86b-488e-9a8d-b583d8dda9ec tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:22.066489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd877c72-d86b-488e-9a8d-b583d8dda9ec tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:22.066976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd877c72-d86b-488e-9a8d-b583d8dda9ec tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:22.067418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd877c72-d86b-488e-9a8d-b583d8dda9ec tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:22.067863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-cd877c72-d86b-488e-9a8d-b583d8dda9ec tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lazy-loading 'fault' on Instance uuid d2984895-0581-4586-b436-9bf0fbd59b74 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:24:22.109899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cd877c72-d86b-488e-9a8d-b583d8dda9ec tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f6061ceb664822af8f33b6ebcf1d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8846233d1f4473840503af3d0d2c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:22.118413 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cd877c72-d86b-488e-9a8d-b583d8dda9ec tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] 10.222.0.50 "GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74" status: 200 len: 1312 microversion: 2.1 time: 0.098195 Oct 24 11:24:22.119004 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3483/6940] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:22 2022] GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:23.141854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-56c0f245-6b2e-44a0-b7e4-a7bcf3a7bbfb tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:23.142575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-56c0f245-6b2e-44a0-b7e4-a7bcf3a7bbfb tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] [instance: d2984895-0581-4586-b436-9bf0fbd59b74] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:23.149846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56c0f245-6b2e-44a0-b7e4-a7bcf3a7bbfb tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:23.150340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56c0f245-6b2e-44a0-b7e4-a7bcf3a7bbfb tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:23.150792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56c0f245-6b2e-44a0-b7e4-a7bcf3a7bbfb tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:23.151494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56c0f245-6b2e-44a0-b7e4-a7bcf3a7bbfb tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:23.151960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56c0f245-6b2e-44a0-b7e4-a7bcf3a7bbfb tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:23.152398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56c0f245-6b2e-44a0-b7e4-a7bcf3a7bbfb tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:23.165438 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-56c0f245-6b2e-44a0-b7e4-a7bcf3a7bbfb tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] HTTP exception thrown: Instance d2984895-0581-4586-b436-9bf0fbd59b74 could not be found. Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-56c0f245-6b2e-44a0-b7e4-a7bcf3a7bbfb tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Request method failure captured: Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74 HTTP/1.1 Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnXWzvAlQkPEf2xoXTKj6vDjPMYHs5OATM7hI64fuMB2ZEmo8HPSUx3Z5WHjPd1_tG7E3M67lD7dP8TJ2gwd8e5slQ6eCziikckHpHFK6N8YAdymObz9OSGTLDzwPc-IWuJuVsAUMtrwW7EaGg47rlKYm5GKJZ1QFELt14blw27VTKQ Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: ba8846233d1f4473840503af3d0d2c58 Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1655695614 Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ba8846233d1f4473840503af3d0d2c58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ba8846233d1f4473840503af3d0d2c58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ba8846233d1f4473840503af3d0d2c58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ba8846233d1f4473840503af3d0d2c58", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1655695614 Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: ba8846233d1f4473840503af3d0d2c58 Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1655695614 Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersAdminNegativeTestJSON-1655695614-project Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 46f6061ceb664822af8f33b6ebcf1d40 Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1655695614-project Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance d2984895-0581-4586-b436-9bf0fbd59b74 could not be found. Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'd2984895-0581-4586-b436-9bf0fbd59b74'} Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2984895-0581-4586-b436-9bf0fbd59b74 could not be found. Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2984895-0581-4586-b436-9bf0fbd59b74 could not be found. Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:24:23.167042 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:24:23.170991 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:24:23.170991 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:24:23.170991 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:24:23.170991 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:24:23.170991 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:24:23.170991 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:24:23.170991 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2984895-0581-4586-b436-9bf0fbd59b74 could not be found. Oct 24 11:24:23.170991 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:24:23.170991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-56c0f245-6b2e-44a0-b7e4-a7bcf3a7bbfb tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] Returning 404 to user: Instance d2984895-0581-4586-b436-9bf0fbd59b74 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:24:23.170991 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-56c0f245-6b2e-44a0-b7e4-a7bcf3a7bbfb tempest-ServersAdminNegativeTestJSON-1655695614 tempest-ServersAdminNegativeTestJSON-1655695614-project] 10.222.0.50 "GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74" status: 404 len: 111 microversion: 2.1 time: 0.030862 Oct 24 11:24:23.170991 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3458/6941] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:23 2022] GET /compute/v2.1/servers/d2984895-0581-4586-b436-9bf0fbd59b74 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:24:29.265473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:24:29.266695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:24:29.384424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2004771793", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "f89f9deb-360b-4f4b-985e-d353fd1c1bed"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:24:29.449543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] validate_networks() for [('f89f9deb-360b-4f4b-985e-d353fd1c1bed', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:24:29.848483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:24:29.848939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:24:29.849639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:24:29.850051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:24:29.850485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:24:29.860756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:29.861591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:29.862767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:29.863578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:29.864038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:29.864465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:29.887987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Getting quotas for project 6acdbdfddd30465691f14d07bea8d5c4. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:24:29.893922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Getting quotas for user 31100d3595d4498893a0a45cd603fb37 and project 6acdbdfddd30465691f14d07bea8d5c4. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:24:29.911104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:24:29.913497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:24:29.959676 n-d-858383-15 devstack@n-api.service[120426]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [ecea82d8-105f-4644-a19a-49dac1cbf827] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 11:24:30.967042 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [ecea82d8-105f-4644-a19a-49dac1cbf827] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 47606. Oct 24 11:24:30.971751 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8920bbcb-29a9-4d1f-9b56-a8718b9286de tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.711437 Oct 24 11:24:30.972729 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3484/6942] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:24:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:24:30.983917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0602aac-88f4-4148-9577-58883bf45b6d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:30.984643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f0602aac-88f4-4148-9577-58883bf45b6d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:30.988340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:24:30.989617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:24:31.066380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f0602aac-88f4-4148-9577-58883bf45b6d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:31.074134 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f0602aac-88f4-4148-9577-58883bf45b6d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1215 microversion: 2.1 time: 0.093774 Oct 24 11:24:31.081298 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3459/6943] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:30 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:32.100470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e6ff8c09-7870-47b9-b044-2af4d7804242 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:32.101088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e6ff8c09-7870-47b9-b044-2af4d7804242 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:32.120373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6ff8c09-7870-47b9-b044-2af4d7804242 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:32.121165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6ff8c09-7870-47b9-b044-2af4d7804242 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:32.122798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6ff8c09-7870-47b9-b044-2af4d7804242 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:32.124531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6ff8c09-7870-47b9-b044-2af4d7804242 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:32.127203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6ff8c09-7870-47b9-b044-2af4d7804242 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:32.127910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6ff8c09-7870-47b9-b044-2af4d7804242 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:32.248406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e6ff8c09-7870-47b9-b044-2af4d7804242 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:32.261762 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e6ff8c09-7870-47b9-b044-2af4d7804242 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1275 microversion: 2.1 time: 0.167655 Oct 24 11:24:32.264979 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3485/6944] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:32 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:33.287292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4f9ab797-e1e0-4ccd-a13a-4aae79482e80 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:33.287929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4f9ab797-e1e0-4ccd-a13a-4aae79482e80 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:33.290857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=53 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:24:33.297385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f9ab797-e1e0-4ccd-a13a-4aae79482e80 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:33.297899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f9ab797-e1e0-4ccd-a13a-4aae79482e80 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:33.298358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f9ab797-e1e0-4ccd-a13a-4aae79482e80 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:33.299081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f9ab797-e1e0-4ccd-a13a-4aae79482e80 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:33.299911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f9ab797-e1e0-4ccd-a13a-4aae79482e80 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:33.300537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f9ab797-e1e0-4ccd-a13a-4aae79482e80 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:33.434640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4f9ab797-e1e0-4ccd-a13a-4aae79482e80 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:33.443256 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4f9ab797-e1e0-4ccd-a13a-4aae79482e80 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1315 microversion: 2.1 time: 0.160218 Oct 24 11:24:33.443838 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3460/6945] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:33 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:33.590658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-f2c84464-752f-47a5-ad11-8a85555f4f6a req-b6a97e88-f327-4a9c-8fd9-99d26b2129ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df7ee2ae-b1ff-47e0-bd40-44566443e664", "tag": "af2f2e95-5133-43a7-a414-a99c2a92ccb0"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:24:33.603203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f2c84464-752f-47a5-ad11-8a85555f4f6a req-b6a97e88-f327-4a9c-8fd9-99d26b2129ad service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:33.603940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f2c84464-752f-47a5-ad11-8a85555f4f6a req-b6a97e88-f327-4a9c-8fd9-99d26b2129ad service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:33.604376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f2c84464-752f-47a5-ad11-8a85555f4f6a req-b6a97e88-f327-4a9c-8fd9-99d26b2129ad service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:33.616449 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f2c84464-752f-47a5-ad11-8a85555f4f6a req-b6a97e88-f327-4a9c-8fd9-99d26b2129ad service nova] Creating event network-changed:af2f2e95-5133-43a7-a414-a99c2a92ccb0 for instance df7ee2ae-b1ff-47e0-bd40-44566443e664 on n-h1-858383-15 Oct 24 11:24:33.622965 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-f2c84464-752f-47a5-ad11-8a85555f4f6a req-b6a97e88-f327-4a9c-8fd9-99d26b2129ad service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036901 Oct 24 11:24:33.623987 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3486/6946] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:24:34.468931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0f56694-6057-4933-adae-86580605c5a0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:34.469642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f0f56694-6057-4933-adae-86580605c5a0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:34.477310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0f56694-6057-4933-adae-86580605c5a0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:34.477816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0f56694-6057-4933-adae-86580605c5a0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:34.478276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0f56694-6057-4933-adae-86580605c5a0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:34.478992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0f56694-6057-4933-adae-86580605c5a0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:34.479473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0f56694-6057-4933-adae-86580605c5a0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:34.479920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0f56694-6057-4933-adae-86580605c5a0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:34.614395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f0f56694-6057-4933-adae-86580605c5a0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:34.622111 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f0f56694-6057-4933-adae-86580605c5a0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1315 microversion: 2.1 time: 0.157176 Oct 24 11:24:34.622690 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3461/6947] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:34 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:35.647178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9e4f9239-ae04-411b-819a-74c49e18dc93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:35.647795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9e4f9239-ae04-411b-819a-74c49e18dc93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:35.654196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e4f9239-ae04-411b-819a-74c49e18dc93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:35.654701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e4f9239-ae04-411b-819a-74c49e18dc93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:35.655135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e4f9239-ae04-411b-819a-74c49e18dc93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:35.656027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e4f9239-ae04-411b-819a-74c49e18dc93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:35.656479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e4f9239-ae04-411b-819a-74c49e18dc93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:35.656929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e4f9239-ae04-411b-819a-74c49e18dc93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:35.786853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9e4f9239-ae04-411b-819a-74c49e18dc93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:35.794402 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9e4f9239-ae04-411b-819a-74c49e18dc93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1315 microversion: 2.1 time: 0.152708 Oct 24 11:24:35.794972 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3487/6948] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:35 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:36.818292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e77eda13-15e8-417f-8174-1ab4181d8537 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:36.818919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e77eda13-15e8-417f-8174-1ab4181d8537 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:36.825716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e77eda13-15e8-417f-8174-1ab4181d8537 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:36.826231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e77eda13-15e8-417f-8174-1ab4181d8537 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:36.826725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e77eda13-15e8-417f-8174-1ab4181d8537 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:36.827376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e77eda13-15e8-417f-8174-1ab4181d8537 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:36.827843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e77eda13-15e8-417f-8174-1ab4181d8537 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:36.828279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e77eda13-15e8-417f-8174-1ab4181d8537 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:36.965258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e77eda13-15e8-417f-8174-1ab4181d8537 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:36.973256 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e77eda13-15e8-417f-8174-1ab4181d8537 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1315 microversion: 2.1 time: 0.159536 Oct 24 11:24:36.973850 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3462/6949] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:36 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:37.995689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a2472e84-fdc6-468b-bb55-bbfd1ddaf054 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:37.996306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a2472e84-fdc6-468b-bb55-bbfd1ddaf054 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:37.999165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:24:38.005746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2472e84-fdc6-468b-bb55-bbfd1ddaf054 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:38.006227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2472e84-fdc6-468b-bb55-bbfd1ddaf054 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:38.006679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2472e84-fdc6-468b-bb55-bbfd1ddaf054 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:38.007363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2472e84-fdc6-468b-bb55-bbfd1ddaf054 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:38.007856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2472e84-fdc6-468b-bb55-bbfd1ddaf054 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:38.008284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a2472e84-fdc6-468b-bb55-bbfd1ddaf054 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:38.012734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:24:38.144765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a2472e84-fdc6-468b-bb55-bbfd1ddaf054 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:38.152860 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a2472e84-fdc6-468b-bb55-bbfd1ddaf054 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1315 microversion: 2.1 time: 0.161064 Oct 24 11:24:38.153436 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3488/6950] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:37 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:38.552970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-8a7829c8-efbc-4829-b60f-4f9a324dc240 req-f49f4d76-27a3-4357-82fa-3e0e2f8de487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7ee2ae-b1ff-47e0-bd40-44566443e664", "name": "network-vif-plugged", "status": "completed", "tag": "af2f2e95-5133-43a7-a414-a99c2a92ccb0"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:24:38.559283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:24:38.565517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8a7829c8-efbc-4829-b60f-4f9a324dc240 req-f49f4d76-27a3-4357-82fa-3e0e2f8de487 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:38.566042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8a7829c8-efbc-4829-b60f-4f9a324dc240 req-f49f4d76-27a3-4357-82fa-3e0e2f8de487 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:38.566582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8a7829c8-efbc-4829-b60f-4f9a324dc240 req-f49f4d76-27a3-4357-82fa-3e0e2f8de487 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:38.582963 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-8a7829c8-efbc-4829-b60f-4f9a324dc240 req-f49f4d76-27a3-4357-82fa-3e0e2f8de487 service nova] Creating event network-vif-plugged:af2f2e95-5133-43a7-a414-a99c2a92ccb0 for instance df7ee2ae-b1ff-47e0-bd40-44566443e664 on n-h1-858383-15 Oct 24 11:24:38.588697 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-8a7829c8-efbc-4829-b60f-4f9a324dc240 req-f49f4d76-27a3-4357-82fa-3e0e2f8de487 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040401 Oct 24 11:24:38.589365 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3463/6951] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:24:39.181386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-230d9274-6ac7-464b-85b9-e07d8ec0f27a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:39.182037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-230d9274-6ac7-464b-85b9-e07d8ec0f27a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:39.188803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-230d9274-6ac7-464b-85b9-e07d8ec0f27a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:39.189320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-230d9274-6ac7-464b-85b9-e07d8ec0f27a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:39.189808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-230d9274-6ac7-464b-85b9-e07d8ec0f27a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:39.190533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-230d9274-6ac7-464b-85b9-e07d8ec0f27a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:39.190992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-230d9274-6ac7-464b-85b9-e07d8ec0f27a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:39.191422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-230d9274-6ac7-464b-85b9-e07d8ec0f27a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:39.348746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-230d9274-6ac7-464b-85b9-e07d8ec0f27a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:39.356349 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-230d9274-6ac7-464b-85b9-e07d8ec0f27a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1315 microversion: 2.1 time: 0.178882 Oct 24 11:24:39.356940 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3489/6952] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:39 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:40.382630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-36e99c85-fc45-4aa6-91b1-d4872c8e9905 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:40.383260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-36e99c85-fc45-4aa6-91b1-d4872c8e9905 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:40.389724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36e99c85-fc45-4aa6-91b1-d4872c8e9905 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:40.390214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36e99c85-fc45-4aa6-91b1-d4872c8e9905 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:40.390658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36e99c85-fc45-4aa6-91b1-d4872c8e9905 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:40.391356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36e99c85-fc45-4aa6-91b1-d4872c8e9905 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:40.391818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36e99c85-fc45-4aa6-91b1-d4872c8e9905 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:40.392256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-36e99c85-fc45-4aa6-91b1-d4872c8e9905 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:40.557013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-36e99c85-fc45-4aa6-91b1-d4872c8e9905 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:40.565405 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-36e99c85-fc45-4aa6-91b1-d4872c8e9905 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1502 microversion: 2.1 time: 0.189340 Oct 24 11:24:40.565990 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3464/6953] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:40 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:40.587874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bafb69b0-ed62-4725-8068-4eb3e3bd2355 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:24:40.590119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bafb69b0-ed62-4725-8068-4eb3e3bd2355 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:40.591953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:24:40.592618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:24:40.600584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bafb69b0-ed62-4725-8068-4eb3e3bd2355 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:40.601093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bafb69b0-ed62-4725-8068-4eb3e3bd2355 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:40.601604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bafb69b0-ed62-4725-8068-4eb3e3bd2355 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:40.602293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bafb69b0-ed62-4725-8068-4eb3e3bd2355 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:40.602741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bafb69b0-ed62-4725-8068-4eb3e3bd2355 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:40.603162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bafb69b0-ed62-4725-8068-4eb3e3bd2355 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:40.634393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bafb69b0-ed62-4725-8068-4eb3e3bd2355 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:40.639998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bafb69b0-ed62-4725-8068-4eb3e3bd2355 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Old instance type m1.heat2, new instance type m1.heat {{(pid=120426) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 24 11:24:40.646988 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-bafb69b0-ed62-4725-8068-4eb3e3bd2355 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:24:40.647466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-bafb69b0-ed62-4725-8068-4eb3e3bd2355 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:24:40.647938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-bafb69b0-ed62-4725-8068-4eb3e3bd2355 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:24:40.648342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-bafb69b0-ed62-4725-8068-4eb3e3bd2355 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:24:40.648752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-bafb69b0-ed62-4725-8068-4eb3e3bd2355 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:24:40.748003 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bafb69b0-ed62-4725-8068-4eb3e3bd2355 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "POST /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664/action" status: 202 len: 0 microversion: 2.1 time: 0.164081 Oct 24 11:24:40.748636 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3490/6954] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:24:40 2022] POST /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:24:40.757393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7aa97591-fad6-44f7-b363-ece54ed23fd2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:40.758056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7aa97591-fad6-44f7-b363-ece54ed23fd2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:40.764942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7aa97591-fad6-44f7-b363-ece54ed23fd2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:40.765664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7aa97591-fad6-44f7-b363-ece54ed23fd2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:40.766314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7aa97591-fad6-44f7-b363-ece54ed23fd2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:40.767349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7aa97591-fad6-44f7-b363-ece54ed23fd2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:40.768081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7aa97591-fad6-44f7-b363-ece54ed23fd2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:40.768719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7aa97591-fad6-44f7-b363-ece54ed23fd2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:40.918927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7aa97591-fad6-44f7-b363-ece54ed23fd2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:40.927281 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7aa97591-fad6-44f7-b363-ece54ed23fd2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1511 microversion: 2.1 time: 0.174016 Oct 24 11:24:40.928081 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3465/6955] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:40 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:41.952423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e3562753-32b9-4609-b97e-bee63c715d5f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:41.953064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e3562753-32b9-4609-b97e-bee63c715d5f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:41.959560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3562753-32b9-4609-b97e-bee63c715d5f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:41.960041 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3562753-32b9-4609-b97e-bee63c715d5f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:41.960471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3562753-32b9-4609-b97e-bee63c715d5f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:41.961192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3562753-32b9-4609-b97e-bee63c715d5f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:41.961645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3562753-32b9-4609-b97e-bee63c715d5f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:41.962063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3562753-32b9-4609-b97e-bee63c715d5f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:42.115164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e3562753-32b9-4609-b97e-bee63c715d5f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:42.123896 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e3562753-32b9-4609-b97e-bee63c715d5f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1511 microversion: 2.1 time: 0.176174 Oct 24 11:24:42.124401 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3491/6956] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:41 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:43.148376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ee6bf03-1537-4881-bad1-0671065fd475 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:43.149101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0ee6bf03-1537-4881-bad1-0671065fd475 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:43.151552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:24:43.157428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ee6bf03-1537-4881-bad1-0671065fd475 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:43.157935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ee6bf03-1537-4881-bad1-0671065fd475 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:43.158420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ee6bf03-1537-4881-bad1-0671065fd475 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:43.159414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ee6bf03-1537-4881-bad1-0671065fd475 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:43.159900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ee6bf03-1537-4881-bad1-0671065fd475 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:43.160350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ee6bf03-1537-4881-bad1-0671065fd475 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:43.303689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0ee6bf03-1537-4881-bad1-0671065fd475 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:43.311483 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0ee6bf03-1537-4881-bad1-0671065fd475 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.167329 Oct 24 11:24:43.312122 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3466/6957] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:43 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:44.335802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2cd52a23-60e8-4458-a15b-34122176fce2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:44.336335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2cd52a23-60e8-4458-a15b-34122176fce2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:44.343123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2cd52a23-60e8-4458-a15b-34122176fce2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:44.343605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2cd52a23-60e8-4458-a15b-34122176fce2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:44.344042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2cd52a23-60e8-4458-a15b-34122176fce2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:44.344736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2cd52a23-60e8-4458-a15b-34122176fce2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:44.345217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2cd52a23-60e8-4458-a15b-34122176fce2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:44.345645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2cd52a23-60e8-4458-a15b-34122176fce2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:44.474260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2cd52a23-60e8-4458-a15b-34122176fce2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:44.482066 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2cd52a23-60e8-4458-a15b-34122176fce2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.150230 Oct 24 11:24:44.482635 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3492/6958] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:44 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:45.506584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0333045d-b71b-41f1-b099-cd67d725ef0d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:45.507209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0333045d-b71b-41f1-b099-cd67d725ef0d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:45.514628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0333045d-b71b-41f1-b099-cd67d725ef0d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:45.515162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0333045d-b71b-41f1-b099-cd67d725ef0d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:45.515671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0333045d-b71b-41f1-b099-cd67d725ef0d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:45.516410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0333045d-b71b-41f1-b099-cd67d725ef0d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:45.516911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0333045d-b71b-41f1-b099-cd67d725ef0d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:45.517358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0333045d-b71b-41f1-b099-cd67d725ef0d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:45.654349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0333045d-b71b-41f1-b099-cd67d725ef0d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:45.662294 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0333045d-b71b-41f1-b099-cd67d725ef0d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.160530 Oct 24 11:24:45.662865 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3467/6959] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:45 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:46.685990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-259098ef-9029-45e3-a110-6a03f4b6752e tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:46.686639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-259098ef-9029-45e3-a110-6a03f4b6752e tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:46.694166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-259098ef-9029-45e3-a110-6a03f4b6752e tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:46.694645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-259098ef-9029-45e3-a110-6a03f4b6752e tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:46.695082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-259098ef-9029-45e3-a110-6a03f4b6752e tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:46.695785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-259098ef-9029-45e3-a110-6a03f4b6752e tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:46.696238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-259098ef-9029-45e3-a110-6a03f4b6752e tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:46.696665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-259098ef-9029-45e3-a110-6a03f4b6752e tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:46.829065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-259098ef-9029-45e3-a110-6a03f4b6752e tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:46.837512 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-259098ef-9029-45e3-a110-6a03f4b6752e tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.155385 Oct 24 11:24:46.838099 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3493/6960] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:46 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:47.859482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-82c37d98-52d0-44a9-a248-51380a81b280 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:47.860155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-82c37d98-52d0-44a9-a248-51380a81b280 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:47.867165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82c37d98-52d0-44a9-a248-51380a81b280 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:47.867655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82c37d98-52d0-44a9-a248-51380a81b280 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:47.868103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82c37d98-52d0-44a9-a248-51380a81b280 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:47.868803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82c37d98-52d0-44a9-a248-51380a81b280 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:47.869295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82c37d98-52d0-44a9-a248-51380a81b280 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:47.869734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-82c37d98-52d0-44a9-a248-51380a81b280 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:48.004295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-82c37d98-52d0-44a9-a248-51380a81b280 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:48.012036 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-82c37d98-52d0-44a9-a248-51380a81b280 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.156419 Oct 24 11:24:48.012612 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3468/6961] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:47 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:49.036348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-afa34187-9c86-4c63-a43b-4ea184cfca04 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:49.037020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-afa34187-9c86-4c63-a43b-4ea184cfca04 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:49.043843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afa34187-9c86-4c63-a43b-4ea184cfca04 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:49.044328 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afa34187-9c86-4c63-a43b-4ea184cfca04 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:49.044770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afa34187-9c86-4c63-a43b-4ea184cfca04 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:49.045492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afa34187-9c86-4c63-a43b-4ea184cfca04 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:49.045946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afa34187-9c86-4c63-a43b-4ea184cfca04 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:49.046372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-afa34187-9c86-4c63-a43b-4ea184cfca04 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:49.177028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-afa34187-9c86-4c63-a43b-4ea184cfca04 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:49.184771 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-afa34187-9c86-4c63-a43b-4ea184cfca04 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.152844 Oct 24 11:24:49.185378 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3494/6962] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:49 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:50.208995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d3ccafe3-cf27-4f62-8596-1aa7876ee522 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:50.209630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d3ccafe3-cf27-4f62-8596-1aa7876ee522 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:50.216543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3ccafe3-cf27-4f62-8596-1aa7876ee522 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:50.217080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3ccafe3-cf27-4f62-8596-1aa7876ee522 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:50.217540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3ccafe3-cf27-4f62-8596-1aa7876ee522 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:50.218251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3ccafe3-cf27-4f62-8596-1aa7876ee522 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:50.218724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3ccafe3-cf27-4f62-8596-1aa7876ee522 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:50.219169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d3ccafe3-cf27-4f62-8596-1aa7876ee522 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:50.354627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d3ccafe3-cf27-4f62-8596-1aa7876ee522 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:50.362556 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d3ccafe3-cf27-4f62-8596-1aa7876ee522 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.157938 Oct 24 11:24:50.363760 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3469/6963] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:50 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:51.386917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3b1d557e-1bbf-428c-ac49-0c80613665c4 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:51.387465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3b1d557e-1bbf-428c-ac49-0c80613665c4 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:51.395236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1d557e-1bbf-428c-ac49-0c80613665c4 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:51.395989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1d557e-1bbf-428c-ac49-0c80613665c4 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:51.396634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1d557e-1bbf-428c-ac49-0c80613665c4 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:51.397524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1d557e-1bbf-428c-ac49-0c80613665c4 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:51.398005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1d557e-1bbf-428c-ac49-0c80613665c4 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:51.398430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3b1d557e-1bbf-428c-ac49-0c80613665c4 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:51.533950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3b1d557e-1bbf-428c-ac49-0c80613665c4 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:51.541694 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3b1d557e-1bbf-428c-ac49-0c80613665c4 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.158775 Oct 24 11:24:51.542284 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3495/6964] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:51 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:52.565131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09fe72ad-6608-4370-9545-0f30272602e5 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:52.565768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09fe72ad-6608-4370-9545-0f30272602e5 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:52.574526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09fe72ad-6608-4370-9545-0f30272602e5 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:52.575027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09fe72ad-6608-4370-9545-0f30272602e5 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:52.575480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09fe72ad-6608-4370-9545-0f30272602e5 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:52.576187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09fe72ad-6608-4370-9545-0f30272602e5 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:52.576657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09fe72ad-6608-4370-9545-0f30272602e5 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:52.577166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09fe72ad-6608-4370-9545-0f30272602e5 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:52.707717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-09fe72ad-6608-4370-9545-0f30272602e5 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:52.715537 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-09fe72ad-6608-4370-9545-0f30272602e5 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.154384 Oct 24 11:24:52.716114 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3470/6965] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:52 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:53.739752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5609a8b2-287d-4411-9103-9d0ddf38c2aa tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:53.740365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5609a8b2-287d-4411-9103-9d0ddf38c2aa tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:53.747214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5609a8b2-287d-4411-9103-9d0ddf38c2aa tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:53.747693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5609a8b2-287d-4411-9103-9d0ddf38c2aa tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:53.748129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5609a8b2-287d-4411-9103-9d0ddf38c2aa tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:53.748819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5609a8b2-287d-4411-9103-9d0ddf38c2aa tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:53.749291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5609a8b2-287d-4411-9103-9d0ddf38c2aa tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:53.749714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5609a8b2-287d-4411-9103-9d0ddf38c2aa tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:53.885314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5609a8b2-287d-4411-9103-9d0ddf38c2aa tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:53.893001 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5609a8b2-287d-4411-9103-9d0ddf38c2aa tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.157903 Oct 24 11:24:53.893578 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3496/6966] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:53 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:54.916030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f4ea1f83-ee6b-43a0-a010-69f1410d43ac tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:54.916670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f4ea1f83-ee6b-43a0-a010-69f1410d43ac tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:54.923700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4ea1f83-ee6b-43a0-a010-69f1410d43ac tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:54.924210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4ea1f83-ee6b-43a0-a010-69f1410d43ac tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:54.924677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4ea1f83-ee6b-43a0-a010-69f1410d43ac tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:54.925414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4ea1f83-ee6b-43a0-a010-69f1410d43ac tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:54.925894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4ea1f83-ee6b-43a0-a010-69f1410d43ac tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:54.926344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f4ea1f83-ee6b-43a0-a010-69f1410d43ac tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:55.054934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f4ea1f83-ee6b-43a0-a010-69f1410d43ac tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:55.062571 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f4ea1f83-ee6b-43a0-a010-69f1410d43ac tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.150705 Oct 24 11:24:55.063145 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3471/6967] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:54 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:56.086736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-20f5f8a9-6f6c-42ef-a336-8a5bee0e37e2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:56.087382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-20f5f8a9-6f6c-42ef-a336-8a5bee0e37e2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:56.094261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20f5f8a9-6f6c-42ef-a336-8a5bee0e37e2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:56.094749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20f5f8a9-6f6c-42ef-a336-8a5bee0e37e2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:56.095193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20f5f8a9-6f6c-42ef-a336-8a5bee0e37e2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:56.095893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20f5f8a9-6f6c-42ef-a336-8a5bee0e37e2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:56.096352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20f5f8a9-6f6c-42ef-a336-8a5bee0e37e2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:56.096781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-20f5f8a9-6f6c-42ef-a336-8a5bee0e37e2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:56.229899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-20f5f8a9-6f6c-42ef-a336-8a5bee0e37e2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:56.237720 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-20f5f8a9-6f6c-42ef-a336-8a5bee0e37e2 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.155523 Oct 24 11:24:56.238303 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3497/6968] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:56 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:57.261303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd1d959c-6e00-4c8f-89ae-d2c44569d1ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:57.261932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bd1d959c-6e00-4c8f-89ae-d2c44569d1ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:57.268470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd1d959c-6e00-4c8f-89ae-d2c44569d1ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:57.268939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd1d959c-6e00-4c8f-89ae-d2c44569d1ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:57.269417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd1d959c-6e00-4c8f-89ae-d2c44569d1ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:57.270102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd1d959c-6e00-4c8f-89ae-d2c44569d1ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:57.270574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd1d959c-6e00-4c8f-89ae-d2c44569d1ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:57.271015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd1d959c-6e00-4c8f-89ae-d2c44569d1ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:57.400471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bd1d959c-6e00-4c8f-89ae-d2c44569d1ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:57.408295 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bd1d959c-6e00-4c8f-89ae-d2c44569d1ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.151123 Oct 24 11:24:57.408896 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3472/6969] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:57 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:58.432266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1f78a174-78f0-4a7a-be28-9a8c50fd78f0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:58.432913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1f78a174-78f0-4a7a-be28-9a8c50fd78f0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:58.439732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f78a174-78f0-4a7a-be28-9a8c50fd78f0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:58.440209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f78a174-78f0-4a7a-be28-9a8c50fd78f0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:58.440640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f78a174-78f0-4a7a-be28-9a8c50fd78f0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:58.441369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f78a174-78f0-4a7a-be28-9a8c50fd78f0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:58.441822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f78a174-78f0-4a7a-be28-9a8c50fd78f0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:58.442276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1f78a174-78f0-4a7a-be28-9a8c50fd78f0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:58.575455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1f78a174-78f0-4a7a-be28-9a8c50fd78f0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:58.583235 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1f78a174-78f0-4a7a-be28-9a8c50fd78f0 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.155586 Oct 24 11:24:58.583816 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3498/6970] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:58 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:24:59.606649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7f382074-f67b-4fbf-84d0-5417eee00804 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:24:59.607282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7f382074-f67b-4fbf-84d0-5417eee00804 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:24:59.614221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f382074-f67b-4fbf-84d0-5417eee00804 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:59.614723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f382074-f67b-4fbf-84d0-5417eee00804 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:59.615761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f382074-f67b-4fbf-84d0-5417eee00804 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:59.616603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f382074-f67b-4fbf-84d0-5417eee00804 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:24:59.617097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f382074-f67b-4fbf-84d0-5417eee00804 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:24:59.617542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f382074-f67b-4fbf-84d0-5417eee00804 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:24:59.748561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7f382074-f67b-4fbf-84d0-5417eee00804 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:24:59.757073 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7f382074-f67b-4fbf-84d0-5417eee00804 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.154329 Oct 24 11:24:59.757659 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3473/6971] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:24:59 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:00.780040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8ef1d1db-fa2d-4173-8edd-97a79e41a498 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:00.780694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8ef1d1db-fa2d-4173-8edd-97a79e41a498 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:00.787575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ef1d1db-fa2d-4173-8edd-97a79e41a498 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:00.788062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ef1d1db-fa2d-4173-8edd-97a79e41a498 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:00.788504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ef1d1db-fa2d-4173-8edd-97a79e41a498 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:00.789233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ef1d1db-fa2d-4173-8edd-97a79e41a498 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:00.789693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ef1d1db-fa2d-4173-8edd-97a79e41a498 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:00.790125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8ef1d1db-fa2d-4173-8edd-97a79e41a498 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:00.917447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8ef1d1db-fa2d-4173-8edd-97a79e41a498 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:00.925100 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8ef1d1db-fa2d-4173-8edd-97a79e41a498 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.149229 Oct 24 11:25:00.925675 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3499/6972] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:00 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:01.948013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a4fdadd2-dd7c-4e81-87b0-7ae2d80f33ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:01.948763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a4fdadd2-dd7c-4e81-87b0-7ae2d80f33ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:01.955667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4fdadd2-dd7c-4e81-87b0-7ae2d80f33ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:01.956169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4fdadd2-dd7c-4e81-87b0-7ae2d80f33ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:01.956628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4fdadd2-dd7c-4e81-87b0-7ae2d80f33ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:01.957366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4fdadd2-dd7c-4e81-87b0-7ae2d80f33ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:01.957842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4fdadd2-dd7c-4e81-87b0-7ae2d80f33ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:01.958321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4fdadd2-dd7c-4e81-87b0-7ae2d80f33ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:02.091914 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a4fdadd2-dd7c-4e81-87b0-7ae2d80f33ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:02.100211 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a4fdadd2-dd7c-4e81-87b0-7ae2d80f33ab tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.155934 Oct 24 11:25:02.100800 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3474/6973] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:01 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:03.123784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fefa2911-4eaf-4a5f-8c03-859a44d0f015 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:03.124505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fefa2911-4eaf-4a5f-8c03-859a44d0f015 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:03.131547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fefa2911-4eaf-4a5f-8c03-859a44d0f015 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:03.132110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fefa2911-4eaf-4a5f-8c03-859a44d0f015 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:03.132557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fefa2911-4eaf-4a5f-8c03-859a44d0f015 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:03.133368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fefa2911-4eaf-4a5f-8c03-859a44d0f015 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:03.133821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fefa2911-4eaf-4a5f-8c03-859a44d0f015 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:03.134243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fefa2911-4eaf-4a5f-8c03-859a44d0f015 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:03.262553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fefa2911-4eaf-4a5f-8c03-859a44d0f015 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:03.270204 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fefa2911-4eaf-4a5f-8c03-859a44d0f015 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.150376 Oct 24 11:25:03.270780 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3500/6974] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:03 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:04.293742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-49c9e12c-693a-41c3-a32f-4ad76aa18dcc tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:04.294402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-49c9e12c-693a-41c3-a32f-4ad76aa18dcc tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:04.301889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49c9e12c-693a-41c3-a32f-4ad76aa18dcc tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:04.302393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49c9e12c-693a-41c3-a32f-4ad76aa18dcc tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:04.302848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49c9e12c-693a-41c3-a32f-4ad76aa18dcc tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:04.303554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49c9e12c-693a-41c3-a32f-4ad76aa18dcc tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:04.304684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49c9e12c-693a-41c3-a32f-4ad76aa18dcc tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:04.305201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-49c9e12c-693a-41c3-a32f-4ad76aa18dcc tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:04.311088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=87 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:25:04.440391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-49c9e12c-693a-41c3-a32f-4ad76aa18dcc tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:04.448997 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-49c9e12c-693a-41c3-a32f-4ad76aa18dcc tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.159122 Oct 24 11:25:04.449598 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3475/6975] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:04 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:05.472181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b7d1dbc6-2a1a-4d4f-a264-dbf06a2ca786 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:05.472784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b7d1dbc6-2a1a-4d4f-a264-dbf06a2ca786 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:05.480309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7d1dbc6-2a1a-4d4f-a264-dbf06a2ca786 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:05.480784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7d1dbc6-2a1a-4d4f-a264-dbf06a2ca786 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:05.481245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7d1dbc6-2a1a-4d4f-a264-dbf06a2ca786 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:05.481934 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7d1dbc6-2a1a-4d4f-a264-dbf06a2ca786 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:05.482385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7d1dbc6-2a1a-4d4f-a264-dbf06a2ca786 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:05.482811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7d1dbc6-2a1a-4d4f-a264-dbf06a2ca786 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:05.618396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b7d1dbc6-2a1a-4d4f-a264-dbf06a2ca786 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:05.626314 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b7d1dbc6-2a1a-4d4f-a264-dbf06a2ca786 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.158062 Oct 24 11:25:05.626894 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3501/6976] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:05 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:06.650979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-039231d4-afc3-43c1-8067-1e54428fc337 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:06.651622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-039231d4-afc3-43c1-8067-1e54428fc337 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:06.658595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-039231d4-afc3-43c1-8067-1e54428fc337 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:06.659104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-039231d4-afc3-43c1-8067-1e54428fc337 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:06.659567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-039231d4-afc3-43c1-8067-1e54428fc337 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:06.660292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-039231d4-afc3-43c1-8067-1e54428fc337 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:06.660775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-039231d4-afc3-43c1-8067-1e54428fc337 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:06.661279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-039231d4-afc3-43c1-8067-1e54428fc337 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:06.795183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-039231d4-afc3-43c1-8067-1e54428fc337 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:06.802949 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-039231d4-afc3-43c1-8067-1e54428fc337 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.156857 Oct 24 11:25:06.803541 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3476/6977] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:06 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:25:07.826834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e9f6d88-a7be-4bed-a533-8e5da4f06f61 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:07.827446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3e9f6d88-a7be-4bed-a533-8e5da4f06f61 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:07.834211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e9f6d88-a7be-4bed-a533-8e5da4f06f61 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:07.834692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e9f6d88-a7be-4bed-a533-8e5da4f06f61 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:07.835756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e9f6d88-a7be-4bed-a533-8e5da4f06f61 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:07.836445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e9f6d88-a7be-4bed-a533-8e5da4f06f61 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:07.836917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e9f6d88-a7be-4bed-a533-8e5da4f06f61 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:07.837343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e9f6d88-a7be-4bed-a533-8e5da4f06f61 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:07.969883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3e9f6d88-a7be-4bed-a533-8e5da4f06f61 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:07.977974 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3e9f6d88-a7be-4bed-a533-8e5da4f06f61 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.155104 Oct 24 11:25:07.978565 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3502/6978] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:07 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:09.002455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d2f754fd-525e-40fa-9cd3-f1109bff42b3 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:09.003085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d2f754fd-525e-40fa-9cd3-f1109bff42b3 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:09.010872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2f754fd-525e-40fa-9cd3-f1109bff42b3 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:09.011380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2f754fd-525e-40fa-9cd3-f1109bff42b3 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:09.011838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2f754fd-525e-40fa-9cd3-f1109bff42b3 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:09.012551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2f754fd-525e-40fa-9cd3-f1109bff42b3 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:09.013066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2f754fd-525e-40fa-9cd3-f1109bff42b3 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:09.013515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d2f754fd-525e-40fa-9cd3-f1109bff42b3 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:09.142885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d2f754fd-525e-40fa-9cd3-f1109bff42b3 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:09.151693 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d2f754fd-525e-40fa-9cd3-f1109bff42b3 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1516 microversion: 2.1 time: 0.153143 Oct 24 11:25:09.152271 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3477/6979] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:08 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:10.175514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dc89e168-dfda-4ec0-b8f6-4abc29e2e2c7 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:10.176136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dc89e168-dfda-4ec0-b8f6-4abc29e2e2c7 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:10.179544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=34 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:25:10.185706 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc89e168-dfda-4ec0-b8f6-4abc29e2e2c7 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:10.186197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc89e168-dfda-4ec0-b8f6-4abc29e2e2c7 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:10.186649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc89e168-dfda-4ec0-b8f6-4abc29e2e2c7 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:10.187334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc89e168-dfda-4ec0-b8f6-4abc29e2e2c7 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:10.187815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc89e168-dfda-4ec0-b8f6-4abc29e2e2c7 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:10.188249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc89e168-dfda-4ec0-b8f6-4abc29e2e2c7 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:10.192379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:25:10.327385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dc89e168-dfda-4ec0-b8f6-4abc29e2e2c7 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:10.335751 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dc89e168-dfda-4ec0-b8f6-4abc29e2e2c7 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1515 microversion: 2.1 time: 0.164173 Oct 24 11:25:10.336451 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3503/6980] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:10 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:10.555758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-6cf297cc-5a02-4175-aefa-1aba2ac03aaf req-5ca9507f-aa0c-48f6-b877-ac23acca15d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7ee2ae-b1ff-47e0-bd40-44566443e664", "name": "network-vif-unplugged", "status": "completed", "tag": "af2f2e95-5133-43a7-a414-a99c2a92ccb0"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:25:10.561527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=30 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:25:10.567353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6cf297cc-5a02-4175-aefa-1aba2ac03aaf req-5ca9507f-aa0c-48f6-b877-ac23acca15d2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:10.567844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6cf297cc-5a02-4175-aefa-1aba2ac03aaf req-5ca9507f-aa0c-48f6-b877-ac23acca15d2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:10.568289 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6cf297cc-5a02-4175-aefa-1aba2ac03aaf req-5ca9507f-aa0c-48f6-b877-ac23acca15d2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:10.581332 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-6cf297cc-5a02-4175-aefa-1aba2ac03aaf req-5ca9507f-aa0c-48f6-b877-ac23acca15d2 service nova] Creating event network-vif-unplugged:af2f2e95-5133-43a7-a414-a99c2a92ccb0 for instance df7ee2ae-b1ff-47e0-bd40-44566443e664 on n-h2-858383-15 Oct 24 11:25:10.587480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-6cf297cc-5a02-4175-aefa-1aba2ac03aaf req-5ca9507f-aa0c-48f6-b877-ac23acca15d2 service nova] Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:25:10.599014 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-6cf297cc-5a02-4175-aefa-1aba2ac03aaf req-5ca9507f-aa0c-48f6-b877-ac23acca15d2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047037 Oct 24 11:25:10.599641 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3478/6981] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:25:11.359652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aa71bd3c-3927-4f93-a659-119ff3112783 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:11.360306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aa71bd3c-3927-4f93-a659-119ff3112783 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:11.367235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa71bd3c-3927-4f93-a659-119ff3112783 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:11.367720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa71bd3c-3927-4f93-a659-119ff3112783 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:11.368160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa71bd3c-3927-4f93-a659-119ff3112783 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:11.368880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa71bd3c-3927-4f93-a659-119ff3112783 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:11.369339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa71bd3c-3927-4f93-a659-119ff3112783 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:11.369768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aa71bd3c-3927-4f93-a659-119ff3112783 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:11.508466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aa71bd3c-3927-4f93-a659-119ff3112783 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:11.516434 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aa71bd3c-3927-4f93-a659-119ff3112783 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1515 microversion: 2.1 time: 0.160601 Oct 24 11:25:11.517321 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3504/6982] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:11 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:12.540760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-32fdda4f-2637-476a-b175-508cb4fafe9f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:12.541499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-32fdda4f-2637-476a-b175-508cb4fafe9f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:12.548713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32fdda4f-2637-476a-b175-508cb4fafe9f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:12.549225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32fdda4f-2637-476a-b175-508cb4fafe9f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:12.549678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32fdda4f-2637-476a-b175-508cb4fafe9f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:12.550375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32fdda4f-2637-476a-b175-508cb4fafe9f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:12.550840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32fdda4f-2637-476a-b175-508cb4fafe9f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:12.551276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-32fdda4f-2637-476a-b175-508cb4fafe9f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:12.630597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-f2a225f0-452d-4a5a-a06d-579edb825b32 req-6b1a0c0c-360d-48ed-8688-9ae97017e99d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df7ee2ae-b1ff-47e0-bd40-44566443e664", "tag": "af2f2e95-5133-43a7-a414-a99c2a92ccb0"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:25:12.641537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f2a225f0-452d-4a5a-a06d-579edb825b32 req-6b1a0c0c-360d-48ed-8688-9ae97017e99d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:12.642013 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f2a225f0-452d-4a5a-a06d-579edb825b32 req-6b1a0c0c-360d-48ed-8688-9ae97017e99d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:12.642474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f2a225f0-452d-4a5a-a06d-579edb825b32 req-6b1a0c0c-360d-48ed-8688-9ae97017e99d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:12.654396 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f2a225f0-452d-4a5a-a06d-579edb825b32 req-6b1a0c0c-360d-48ed-8688-9ae97017e99d service nova] Creating event network-changed:af2f2e95-5133-43a7-a414-a99c2a92ccb0 for instance df7ee2ae-b1ff-47e0-bd40-44566443e664 on n-h2-858383-15 Oct 24 11:25:12.659729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [req-f2a225f0-452d-4a5a-a06d-579edb825b32 req-6b1a0c0c-360d-48ed-8688-9ae97017e99d service nova] Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120426) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:25:12.670829 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-f2a225f0-452d-4a5a-a06d-579edb825b32 req-6b1a0c0c-360d-48ed-8688-9ae97017e99d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043862 Oct 24 11:25:12.671437 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3505/6983] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:25:12.683005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-32fdda4f-2637-476a-b175-508cb4fafe9f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:12.690689 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-32fdda4f-2637-476a-b175-508cb4fafe9f tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1513 microversion: 2.1 time: 0.154289 Oct 24 11:25:12.691256 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3479/6984] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:12 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:13.717505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-808807b7-f79f-4e8a-addf-3d33c973f213 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:13.718236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-808807b7-f79f-4e8a-addf-3d33c973f213 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:13.724314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-808807b7-f79f-4e8a-addf-3d33c973f213 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:13.724800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-808807b7-f79f-4e8a-addf-3d33c973f213 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:13.725267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-808807b7-f79f-4e8a-addf-3d33c973f213 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:13.725957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-808807b7-f79f-4e8a-addf-3d33c973f213 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:13.726407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-808807b7-f79f-4e8a-addf-3d33c973f213 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:13.729327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-808807b7-f79f-4e8a-addf-3d33c973f213 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:13.866211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-808807b7-f79f-4e8a-addf-3d33c973f213 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:13.874556 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-808807b7-f79f-4e8a-addf-3d33c973f213 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1510 microversion: 2.1 time: 0.162521 Oct 24 11:25:13.875134 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3506/6985] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:13 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:13.897919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c1b8cb5b-9b78-4cef-afd4-a17db651235d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:13.898520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c1b8cb5b-9b78-4cef-afd4-a17db651235d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:13.905646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1b8cb5b-9b78-4cef-afd4-a17db651235d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:13.906157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1b8cb5b-9b78-4cef-afd4-a17db651235d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:13.906628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1b8cb5b-9b78-4cef-afd4-a17db651235d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:13.907338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1b8cb5b-9b78-4cef-afd4-a17db651235d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:13.907809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1b8cb5b-9b78-4cef-afd4-a17db651235d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:13.908280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1b8cb5b-9b78-4cef-afd4-a17db651235d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:13.934513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c1b8cb5b-9b78-4cef-afd4-a17db651235d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:25:13.984173 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.compute.api [None req-c1b8cb5b-9b78-4cef-afd4-a17db651235d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Found an unconfirmed migration during delete, id: 16, status: finished Oct 24 11:25:15.361753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-ec3ed0a3-619e-4c75-8c41-aa416c65e016 req-8c7b3324-8a3e-4e3d-b290-91d3a8a201ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7ee2ae-b1ff-47e0-bd40-44566443e664", "name": "network-vif-plugged", "status": "completed", "tag": "af2f2e95-5133-43a7-a414-a99c2a92ccb0"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:25:15.374382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ec3ed0a3-619e-4c75-8c41-aa416c65e016 req-8c7b3324-8a3e-4e3d-b290-91d3a8a201ec service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:15.374873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ec3ed0a3-619e-4c75-8c41-aa416c65e016 req-8c7b3324-8a3e-4e3d-b290-91d3a8a201ec service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:15.375950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ec3ed0a3-619e-4c75-8c41-aa416c65e016 req-8c7b3324-8a3e-4e3d-b290-91d3a8a201ec service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:15.390119 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ec3ed0a3-619e-4c75-8c41-aa416c65e016 req-8c7b3324-8a3e-4e3d-b290-91d3a8a201ec service nova] Creating event network-vif-plugged:af2f2e95-5133-43a7-a414-a99c2a92ccb0 for instance df7ee2ae-b1ff-47e0-bd40-44566443e664 on n-h2-858383-15 Oct 24 11:25:15.395325 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-ec3ed0a3-619e-4c75-8c41-aa416c65e016 req-8c7b3324-8a3e-4e3d-b290-91d3a8a201ec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037759 Oct 24 11:25:15.396431 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3507/6986] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:25:15.449825 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c1b8cb5b-9b78-4cef-afd4-a17db651235d tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "DELETE /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 204 len: 0 microversion: 2.1 time: 1.555497 Oct 24 11:25:15.450696 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3480/6987] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:25:13 2022] DELETE /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 0 bytes in 1557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:25:15.460099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0e0499ca-45c3-4af1-b00a-916e67b7b693 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:15.460803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0e0499ca-45c3-4af1-b00a-916e67b7b693 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:15.467280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e0499ca-45c3-4af1-b00a-916e67b7b693 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:15.467761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e0499ca-45c3-4af1-b00a-916e67b7b693 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:15.468197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e0499ca-45c3-4af1-b00a-916e67b7b693 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:15.468976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e0499ca-45c3-4af1-b00a-916e67b7b693 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:15.469465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e0499ca-45c3-4af1-b00a-916e67b7b693 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:15.469893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e0499ca-45c3-4af1-b00a-916e67b7b693 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:15.602221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0e0499ca-45c3-4af1-b00a-916e67b7b693 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:15.610333 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0e0499ca-45c3-4af1-b00a-916e67b7b693 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1502 microversion: 2.1 time: 0.154932 Oct 24 11:25:15.610906 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3508/6988] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:15 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:16.635149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0e5eb18-d2e2-4ac2-94ff-40915ce59bef tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:16.635888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f0e5eb18-d2e2-4ac2-94ff-40915ce59bef tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:16.642746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0e5eb18-d2e2-4ac2-94ff-40915ce59bef tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:16.643285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0e5eb18-d2e2-4ac2-94ff-40915ce59bef tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:16.643753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0e5eb18-d2e2-4ac2-94ff-40915ce59bef tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:16.644467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0e5eb18-d2e2-4ac2-94ff-40915ce59bef tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:16.644981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0e5eb18-d2e2-4ac2-94ff-40915ce59bef tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:16.645434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0e5eb18-d2e2-4ac2-94ff-40915ce59bef tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:16.780851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f0e5eb18-d2e2-4ac2-94ff-40915ce59bef tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31100d3595d4498893a0a45cd603fb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6acdbdfddd30465691f14d07bea8d5c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:16.788633 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f0e5eb18-d2e2-4ac2-94ff-40915ce59bef tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 200 len: 1502 microversion: 2.1 time: 0.158405 Oct 24 11:25:16.789254 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3481/6989] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:16 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:25:17.321290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-6df533d3-a37f-48ab-979d-f940dc7cbd45 req-56a4ec31-0f58-4549-866e-c3aa2db840dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7ee2ae-b1ff-47e0-bd40-44566443e664", "name": "network-vif-deleted", "tag": "af2f2e95-5133-43a7-a414-a99c2a92ccb0"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:25:17.332371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6df533d3-a37f-48ab-979d-f940dc7cbd45 req-56a4ec31-0f58-4549-866e-c3aa2db840dd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:17.332866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6df533d3-a37f-48ab-979d-f940dc7cbd45 req-56a4ec31-0f58-4549-866e-c3aa2db840dd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:17.333312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6df533d3-a37f-48ab-979d-f940dc7cbd45 req-56a4ec31-0f58-4549-866e-c3aa2db840dd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:17.348397 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-6df533d3-a37f-48ab-979d-f940dc7cbd45 req-56a4ec31-0f58-4549-866e-c3aa2db840dd service nova] Creating event network-vif-deleted:af2f2e95-5133-43a7-a414-a99c2a92ccb0 for instance df7ee2ae-b1ff-47e0-bd40-44566443e664 on n-h2-858383-15 Oct 24 11:25:17.354697 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-6df533d3-a37f-48ab-979d-f940dc7cbd45 req-56a4ec31-0f58-4549-866e-c3aa2db840dd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037992 Oct 24 11:25:17.355326 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3509/6990] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:25:17.811642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b20b46e1-2f71-4334-b2f9-60df5204662a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:17.812209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b20b46e1-2f71-4334-b2f9-60df5204662a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:17.818996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b20b46e1-2f71-4334-b2f9-60df5204662a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:17.819488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b20b46e1-2f71-4334-b2f9-60df5204662a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:17.819943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b20b46e1-2f71-4334-b2f9-60df5204662a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:17.820656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b20b46e1-2f71-4334-b2f9-60df5204662a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:17.821143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b20b46e1-2f71-4334-b2f9-60df5204662a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:17.821580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b20b46e1-2f71-4334-b2f9-60df5204662a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:17.834703 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-b20b46e1-2f71-4334-b2f9-60df5204662a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] HTTP exception thrown: Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 could not be found. Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b20b46e1-2f71-4334-b2f9-60df5204662a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Request method failure captured: Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 HTTP/1.1 Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnXtGTWSJM2xIV17PHGWmGqFR6f7yJ6G7XXdzp3HOCR_Wb4zGxnvWWXfISAsjl5UVDLymXMKEdQyCjAuhvLVMUG7gwPAL6cCDgjnKseuvcSwQRan9smFl5t6esxaoTi4Q670NIXymaTyUYZikpzUQrwzKoy1a9EE4BUoCzSoA9_ANmw Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 6acdbdfddd30465691f14d07bea8d5c4 Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-188883756 Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acdbdfddd30465691f14d07bea8d5c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acdbdfddd30465691f14d07bea8d5c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acdbdfddd30465691f14d07bea8d5c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acdbdfddd30465691f14d07bea8d5c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-188883756 Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 6acdbdfddd30465691f14d07bea8d5c4 Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-188883756 Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-188883756-project Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 31100d3595d4498893a0a45cd603fb37 Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-188883756-project Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 could not be found. Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'df7ee2ae-b1ff-47e0-bd40-44566443e664'} Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 could not be found. Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 could not be found. Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:25:17.837120 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:25:17.841899 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:25:17.841899 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:25:17.841899 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:25:17.841899 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:25:17.841899 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:25:17.841899 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 could not be found. Oct 24 11:25:17.841899 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:25:17.841899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b20b46e1-2f71-4334-b2f9-60df5204662a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Returning 404 to user: Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:25:17.841899 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b20b46e1-2f71-4334-b2f9-60df5204662a tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 404 len: 111 microversion: 2.1 time: 0.030891 Oct 24 11:25:17.841899 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3482/6991] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:17 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:25:17.856366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a90c87aa-f1f2-4d22-9051-266695a59750 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:17.857006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a90c87aa-f1f2-4d22-9051-266695a59750 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:17.863142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a90c87aa-f1f2-4d22-9051-266695a59750 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:17.863626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a90c87aa-f1f2-4d22-9051-266695a59750 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:17.864065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a90c87aa-f1f2-4d22-9051-266695a59750 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:17.864765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a90c87aa-f1f2-4d22-9051-266695a59750 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:17.865263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a90c87aa-f1f2-4d22-9051-266695a59750 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:17.865694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a90c87aa-f1f2-4d22-9051-266695a59750 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:17.879203 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-a90c87aa-f1f2-4d22-9051-266695a59750 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] HTTP exception thrown: Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 could not be found. Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a90c87aa-f1f2-4d22-9051-266695a59750 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Request method failure captured: Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 HTTP/1.1 Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnXtGTWSJM2xIV17PHGWmGqFR6f7yJ6G7XXdzp3HOCR_Wb4zGxnvWWXfISAsjl5UVDLymXMKEdQyCjAuhvLVMUG7gwPAL6cCDgjnKseuvcSwQRan9smFl5t6esxaoTi4Q670NIXymaTyUYZikpzUQrwzKoy1a9EE4BUoCzSoA9_ANmw Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 6acdbdfddd30465691f14d07bea8d5c4 Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-DeleteServersTestJSON-188883756 Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acdbdfddd30465691f14d07bea8d5c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acdbdfddd30465691f14d07bea8d5c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acdbdfddd30465691f14d07bea8d5c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acdbdfddd30465691f14d07bea8d5c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-DeleteServersTestJSON-188883756 Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 6acdbdfddd30465691f14d07bea8d5c4 Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-DeleteServersTestJSON-188883756 Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-DeleteServersTestJSON-188883756-project Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 31100d3595d4498893a0a45cd603fb37 Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-DeleteServersTestJSON-188883756-project Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 could not be found. Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'df7ee2ae-b1ff-47e0-bd40-44566443e664'} Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 could not be found. Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:25:17.880881 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:25:17.885596 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 could not be found. Oct 24 11:25:17.885596 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:25:17.885596 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:25:17.885596 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:25:17.885596 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:25:17.885596 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:25:17.885596 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:25:17.885596 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:25:17.885596 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:25:17.885596 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 could not be found. Oct 24 11:25:17.885596 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:25:17.885596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a90c87aa-f1f2-4d22-9051-266695a59750 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Returning 404 to user: Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:25:17.885596 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a90c87aa-f1f2-4d22-9051-266695a59750 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "DELETE /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 404 len: 111 microversion: 2.1 time: 0.031183 Oct 24 11:25:17.885596 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3510/6992] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:25:17 2022] DELETE /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 11:25:17.890759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a6a72c33-c4a8-42a0-a88d-c83fc4027a93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:17.891384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a6a72c33-c4a8-42a0-a88d-c83fc4027a93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] [instance: df7ee2ae-b1ff-47e0-bd40-44566443e664] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:17.897273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6a72c33-c4a8-42a0-a88d-c83fc4027a93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:17.897765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6a72c33-c4a8-42a0-a88d-c83fc4027a93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:17.898214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6a72c33-c4a8-42a0-a88d-c83fc4027a93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:17.899791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6a72c33-c4a8-42a0-a88d-c83fc4027a93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:17.900254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6a72c33-c4a8-42a0-a88d-c83fc4027a93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:17.900692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6a72c33-c4a8-42a0-a88d-c83fc4027a93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:17.913832 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-a6a72c33-c4a8-42a0-a88d-c83fc4027a93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] HTTP exception thrown: Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 could not be found. Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a6a72c33-c4a8-42a0-a88d-c83fc4027a93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Request method failure captured: Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 HTTP/1.1 Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnXtGTWSJM2xIV17PHGWmGqFR6f7yJ6G7XXdzp3HOCR_Wb4zGxnvWWXfISAsjl5UVDLymXMKEdQyCjAuhvLVMUG7gwPAL6cCDgjnKseuvcSwQRan9smFl5t6esxaoTi4Q670NIXymaTyUYZikpzUQrwzKoy1a9EE4BUoCzSoA9_ANmw Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 6acdbdfddd30465691f14d07bea8d5c4 Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-DeleteServersTestJSON-188883756 Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acdbdfddd30465691f14d07bea8d5c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6acdbdfddd30465691f14d07bea8d5c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6acdbdfddd30465691f14d07bea8d5c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6acdbdfddd30465691f14d07bea8d5c4", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-DeleteServersTestJSON-188883756 Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 6acdbdfddd30465691f14d07bea8d5c4 Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-DeleteServersTestJSON-188883756 Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-DeleteServersTestJSON-188883756-project Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 31100d3595d4498893a0a45cd603fb37 Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-DeleteServersTestJSON-188883756-project Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 could not be found. Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'df7ee2ae-b1ff-47e0-bd40-44566443e664'} Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 could not be found. Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 could not be found. Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:25:17.916153 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:25:17.920633 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:25:17.920633 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:25:17.920633 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:25:17.920633 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:25:17.920633 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:25:17.920633 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 could not be found. Oct 24 11:25:17.920633 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:25:17.920633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a6a72c33-c4a8-42a0-a88d-c83fc4027a93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] Returning 404 to user: Instance df7ee2ae-b1ff-47e0-bd40-44566443e664 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:25:17.920633 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a6a72c33-c4a8-42a0-a88d-c83fc4027a93 tempest-DeleteServersTestJSON-188883756 tempest-DeleteServersTestJSON-188883756-project] 10.222.0.50 "GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664" status: 404 len: 111 microversion: 2.1 time: 0.030734 Oct 24 11:25:17.920633 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3483/6993] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:17 2022] GET /compute/v2.1/servers/df7ee2ae-b1ff-47e0-bd40-44566443e664 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:25:26.753059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8f5ed9e8-db45-47d7-8963-8bd89f1823f5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1829132003", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "3c7df3b2-4ae3-4445-9019-f1884fde194e"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:25:26.809307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-8f5ed9e8-db45-47d7-8963-8bd89f1823f5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] validate_networks() for [('3c7df3b2-4ae3-4445-9019-f1884fde194e', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:25:27.185190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8f5ed9e8-db45-47d7-8963-8bd89f1823f5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:25:27.185614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8f5ed9e8-db45-47d7-8963-8bd89f1823f5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:25:27.186269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8f5ed9e8-db45-47d7-8963-8bd89f1823f5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:25:27.186679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8f5ed9e8-db45-47d7-8963-8bd89f1823f5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:25:27.187092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8f5ed9e8-db45-47d7-8963-8bd89f1823f5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:25:27.197489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f5ed9e8-db45-47d7-8963-8bd89f1823f5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:27.197903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f5ed9e8-db45-47d7-8963-8bd89f1823f5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:27.198395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f5ed9e8-db45-47d7-8963-8bd89f1823f5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:27.199321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f5ed9e8-db45-47d7-8963-8bd89f1823f5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:27.199783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f5ed9e8-db45-47d7-8963-8bd89f1823f5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:27.200245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f5ed9e8-db45-47d7-8963-8bd89f1823f5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:27.218384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-8f5ed9e8-db45-47d7-8963-8bd89f1823f5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Getting quotas for project 39796f68d9c64213963dbf4cffcb8590. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:25:27.223602 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-8f5ed9e8-db45-47d7-8963-8bd89f1823f5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Getting quotas for user 264263b947ca4a7ea1beb528460a52f2 and project 39796f68d9c64213963dbf4cffcb8590. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:25:27.236394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8f5ed9e8-db45-47d7-8963-8bd89f1823f5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:25:27.238746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8f5ed9e8-db45-47d7-8963-8bd89f1823f5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:25:27.285116 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8f5ed9e8-db45-47d7-8963-8bd89f1823f5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683773 Oct 24 11:25:27.285773 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3511/6994] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:25:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:25:27.297789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-140bde8d-16f7-49a4-bce2-cb380658aad9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:27.298543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-140bde8d-16f7-49a4-bce2-cb380658aad9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:27.355103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-140bde8d-16f7-49a4-bce2-cb380658aad9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:27.362082 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-140bde8d-16f7-49a4-bce2-cb380658aad9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1218 microversion: 2.1 time: 0.068122 Oct 24 11:25:27.362644 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3484/6995] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:27 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:28.395838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dfff6aef-7caf-4d71-9189-0bc7548ffee0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:28.401016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dfff6aef-7caf-4d71-9189-0bc7548ffee0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:28.411759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dfff6aef-7caf-4d71-9189-0bc7548ffee0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:28.412296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dfff6aef-7caf-4d71-9189-0bc7548ffee0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:28.412738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dfff6aef-7caf-4d71-9189-0bc7548ffee0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:28.413516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dfff6aef-7caf-4d71-9189-0bc7548ffee0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:28.414671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dfff6aef-7caf-4d71-9189-0bc7548ffee0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:28.415107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dfff6aef-7caf-4d71-9189-0bc7548ffee0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:28.498830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dfff6aef-7caf-4d71-9189-0bc7548ffee0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:28.509266 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dfff6aef-7caf-4d71-9189-0bc7548ffee0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1278 microversion: 2.1 time: 0.127301 Oct 24 11:25:28.510472 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3512/6996] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:28 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1278 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:25:29.533575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6849e9ef-0318-464d-856d-b5a9d340a7f3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:29.534801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6849e9ef-0318-464d-856d-b5a9d340a7f3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:29.539758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:25:29.545752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6849e9ef-0318-464d-856d-b5a9d340a7f3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:29.546990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6849e9ef-0318-464d-856d-b5a9d340a7f3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:29.547678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6849e9ef-0318-464d-856d-b5a9d340a7f3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:29.548656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6849e9ef-0318-464d-856d-b5a9d340a7f3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:29.549481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6849e9ef-0318-464d-856d-b5a9d340a7f3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:29.550182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6849e9ef-0318-464d-856d-b5a9d340a7f3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:29.734622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6849e9ef-0318-464d-856d-b5a9d340a7f3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:29.744042 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6849e9ef-0318-464d-856d-b5a9d340a7f3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1318 microversion: 2.1 time: 0.214888 Oct 24 11:25:29.744672 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3485/6997] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:29 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:30.256550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-bd081480-a6c8-4f7d-87e3-e9e3a272491f req-8e56a643-2fa8-4a6e-890e-3c357629660e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b12d91-c528-4616-b031-b1f037180074", "tag": "d0b63091-7a0e-460c-8127-b20ad1e607a3"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:25:30.269059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-bd081480-a6c8-4f7d-87e3-e9e3a272491f req-8e56a643-2fa8-4a6e-890e-3c357629660e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:30.269977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-bd081480-a6c8-4f7d-87e3-e9e3a272491f req-8e56a643-2fa8-4a6e-890e-3c357629660e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:30.270652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-bd081480-a6c8-4f7d-87e3-e9e3a272491f req-8e56a643-2fa8-4a6e-890e-3c357629660e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:30.283847 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-bd081480-a6c8-4f7d-87e3-e9e3a272491f req-8e56a643-2fa8-4a6e-890e-3c357629660e service nova] Creating event network-changed:d0b63091-7a0e-460c-8127-b20ad1e607a3 for instance 83b12d91-c528-4616-b031-b1f037180074 on n-h2-858383-15 Oct 24 11:25:30.290607 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-bd081480-a6c8-4f7d-87e3-e9e3a272491f req-8e56a643-2fa8-4a6e-890e-3c357629660e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038616 Oct 24 11:25:30.292053 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3513/6998] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:25:30.768283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e4030849-d52f-4026-875c-e1be85ce81b3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:30.768880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e4030849-d52f-4026-875c-e1be85ce81b3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:30.776173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4030849-d52f-4026-875c-e1be85ce81b3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:30.776681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4030849-d52f-4026-875c-e1be85ce81b3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:30.777171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4030849-d52f-4026-875c-e1be85ce81b3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:30.777886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4030849-d52f-4026-875c-e1be85ce81b3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:30.778360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4030849-d52f-4026-875c-e1be85ce81b3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:30.778808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e4030849-d52f-4026-875c-e1be85ce81b3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:30.908630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e4030849-d52f-4026-875c-e1be85ce81b3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:30.917199 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e4030849-d52f-4026-875c-e1be85ce81b3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1318 microversion: 2.1 time: 0.152915 Oct 24 11:25:30.917773 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3486/6999] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:30 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:31.942177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-22f39263-6f19-41a8-81e3-67a2b176d5f9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:31.942881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-22f39263-6f19-41a8-81e3-67a2b176d5f9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:31.949698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22f39263-6f19-41a8-81e3-67a2b176d5f9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:31.950183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22f39263-6f19-41a8-81e3-67a2b176d5f9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:31.950614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22f39263-6f19-41a8-81e3-67a2b176d5f9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:31.951312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22f39263-6f19-41a8-81e3-67a2b176d5f9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:31.951760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22f39263-6f19-41a8-81e3-67a2b176d5f9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:31.952182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-22f39263-6f19-41a8-81e3-67a2b176d5f9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:32.088217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-22f39263-6f19-41a8-81e3-67a2b176d5f9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:32.096393 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-22f39263-6f19-41a8-81e3-67a2b176d5f9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1318 microversion: 2.1 time: 0.160013 Oct 24 11:25:32.097070 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3514/7000] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:31 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:33.119643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-56f38545-e0f1-448a-92e4-caafa028d58a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:33.120306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-56f38545-e0f1-448a-92e4-caafa028d58a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:33.127245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56f38545-e0f1-448a-92e4-caafa028d58a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:33.128038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56f38545-e0f1-448a-92e4-caafa028d58a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:33.128153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56f38545-e0f1-448a-92e4-caafa028d58a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:33.128808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56f38545-e0f1-448a-92e4-caafa028d58a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:33.129296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56f38545-e0f1-448a-92e4-caafa028d58a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:33.129733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56f38545-e0f1-448a-92e4-caafa028d58a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:33.259726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-56f38545-e0f1-448a-92e4-caafa028d58a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:33.268030 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-56f38545-e0f1-448a-92e4-caafa028d58a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1318 microversion: 2.1 time: 0.151999 Oct 24 11:25:33.268155 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3487/7001] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:33 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:34.292255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-322cf47d-fa5b-49bf-85a8-543cc6ecdd73 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:34.292913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-322cf47d-fa5b-49bf-85a8-543cc6ecdd73 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:34.299863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-322cf47d-fa5b-49bf-85a8-543cc6ecdd73 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:34.300343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-322cf47d-fa5b-49bf-85a8-543cc6ecdd73 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:34.300781 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-322cf47d-fa5b-49bf-85a8-543cc6ecdd73 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:34.301499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-322cf47d-fa5b-49bf-85a8-543cc6ecdd73 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:34.301951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-322cf47d-fa5b-49bf-85a8-543cc6ecdd73 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:34.302378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-322cf47d-fa5b-49bf-85a8-543cc6ecdd73 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:34.431820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-322cf47d-fa5b-49bf-85a8-543cc6ecdd73 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:34.439615 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-322cf47d-fa5b-49bf-85a8-543cc6ecdd73 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1318 microversion: 2.1 time: 0.152034 Oct 24 11:25:34.440182 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3515/7002] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:34 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:35.445136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d6a92602-64c3-412d-aa22-ab498a3b67c7 req-35e05428-8953-4294-8ae3-e805f18ffa32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b12d91-c528-4616-b031-b1f037180074", "name": "network-vif-plugged", "status": "completed", "tag": "d0b63091-7a0e-460c-8127-b20ad1e607a3"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:25:35.456079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d6a92602-64c3-412d-aa22-ab498a3b67c7 req-35e05428-8953-4294-8ae3-e805f18ffa32 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:35.456775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d6a92602-64c3-412d-aa22-ab498a3b67c7 req-35e05428-8953-4294-8ae3-e805f18ffa32 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:35.457396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d6a92602-64c3-412d-aa22-ab498a3b67c7 req-35e05428-8953-4294-8ae3-e805f18ffa32 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:35.462802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8d4bc3c6-31fd-445f-aa7d-906adf8b4756 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:35.463525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8d4bc3c6-31fd-445f-aa7d-906adf8b4756 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:35.469814 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d6a92602-64c3-412d-aa22-ab498a3b67c7 req-35e05428-8953-4294-8ae3-e805f18ffa32 service nova] Creating event network-vif-plugged:d0b63091-7a0e-460c-8127-b20ad1e607a3 for instance 83b12d91-c528-4616-b031-b1f037180074 on n-h2-858383-15 Oct 24 11:25:35.470452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d4bc3c6-31fd-445f-aa7d-906adf8b4756 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:35.470946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d4bc3c6-31fd-445f-aa7d-906adf8b4756 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:35.471391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d4bc3c6-31fd-445f-aa7d-906adf8b4756 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:35.472106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d4bc3c6-31fd-445f-aa7d-906adf8b4756 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:35.472564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d4bc3c6-31fd-445f-aa7d-906adf8b4756 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:35.473026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d4bc3c6-31fd-445f-aa7d-906adf8b4756 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:35.477871 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d6a92602-64c3-412d-aa22-ab498a3b67c7 req-35e05428-8953-4294-8ae3-e805f18ffa32 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034712 Oct 24 11:25:35.478797 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3488/7003] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:25:35.618593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d4bc3c6-31fd-445f-aa7d-906adf8b4756 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:35.626334 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8d4bc3c6-31fd-445f-aa7d-906adf8b4756 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1318 microversion: 2.1 time: 0.167474 Oct 24 11:25:35.626914 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3516/7004] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:35 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:25:36.652245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-039d4e1a-29cf-4476-a10a-638bf2510829 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:36.653004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-039d4e1a-29cf-4476-a10a-638bf2510829 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:36.659461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-039d4e1a-29cf-4476-a10a-638bf2510829 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:36.660051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-039d4e1a-29cf-4476-a10a-638bf2510829 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:36.660894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-039d4e1a-29cf-4476-a10a-638bf2510829 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:36.662008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-039d4e1a-29cf-4476-a10a-638bf2510829 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:36.662576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-039d4e1a-29cf-4476-a10a-638bf2510829 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:36.663221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-039d4e1a-29cf-4476-a10a-638bf2510829 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:36.800648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-039d4e1a-29cf-4476-a10a-638bf2510829 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:36.809102 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-039d4e1a-29cf-4476-a10a-638bf2510829 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1507 microversion: 2.1 time: 0.162855 Oct 24 11:25:36.809733 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3489/7005] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:36 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:36.832242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c0eb4708-9d57-479e-aa91-ff30b05cedde tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:36.832801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c0eb4708-9d57-479e-aa91-ff30b05cedde tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:36.840648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0eb4708-9d57-479e-aa91-ff30b05cedde tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:36.841174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0eb4708-9d57-479e-aa91-ff30b05cedde tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:36.841616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0eb4708-9d57-479e-aa91-ff30b05cedde tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:36.842313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0eb4708-9d57-479e-aa91-ff30b05cedde tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:36.842769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0eb4708-9d57-479e-aa91-ff30b05cedde tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:36.843198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c0eb4708-9d57-479e-aa91-ff30b05cedde tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:36.978772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c0eb4708-9d57-479e-aa91-ff30b05cedde tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:36.986512 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c0eb4708-9d57-479e-aa91-ff30b05cedde tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1507 microversion: 2.1 time: 0.158162 Oct 24 11:25:36.987088 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3517/7006] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:36 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:37.009603 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dd16c634-5f06-474b-b20f-2cdb75542a5a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:25:37.012052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dd16c634-5f06-474b-b20f-2cdb75542a5a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:37.018084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd16c634-5f06-474b-b20f-2cdb75542a5a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:37.018593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd16c634-5f06-474b-b20f-2cdb75542a5a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:37.019055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd16c634-5f06-474b-b20f-2cdb75542a5a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:37.019772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd16c634-5f06-474b-b20f-2cdb75542a5a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:37.020249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd16c634-5f06-474b-b20f-2cdb75542a5a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:37.020700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd16c634-5f06-474b-b20f-2cdb75542a5a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:37.083333 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dd16c634-5f06-474b-b20f-2cdb75542a5a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "PUT /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1079 microversion: 2.1 time: 0.078080 Oct 24 11:25:37.084105 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3490/7007] 10.222.0.50 () {60 vars in 1256 bytes} [Mon Oct 24 11:25:37 2022] PUT /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1079 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:37.104097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f2c4fdbc-2562-417e-bb6f-da63b56ba217 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:37.104744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f2c4fdbc-2562-417e-bb6f-da63b56ba217 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:37.110818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2c4fdbc-2562-417e-bb6f-da63b56ba217 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:37.111302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2c4fdbc-2562-417e-bb6f-da63b56ba217 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:37.111745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2c4fdbc-2562-417e-bb6f-da63b56ba217 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:37.112436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2c4fdbc-2562-417e-bb6f-da63b56ba217 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:37.112921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2c4fdbc-2562-417e-bb6f-da63b56ba217 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:37.113348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2c4fdbc-2562-417e-bb6f-da63b56ba217 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:37.206519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:25:37.230451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:25:37.246225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f2c4fdbc-2562-417e-bb6f-da63b56ba217 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:37.253948 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f2c4fdbc-2562-417e-bb6f-da63b56ba217 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1505 microversion: 2.1 time: 0.154654 Oct 24 11:25:37.254520 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3518/7008] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:37 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:37.277343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ead28a16-1b12-4773-a44e-c0c469f5b53e tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:37.277982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ead28a16-1b12-4773-a44e-c0c469f5b53e tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:37.284142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ead28a16-1b12-4773-a44e-c0c469f5b53e tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:37.284656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ead28a16-1b12-4773-a44e-c0c469f5b53e tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:37.285143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ead28a16-1b12-4773-a44e-c0c469f5b53e tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:37.285851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ead28a16-1b12-4773-a44e-c0c469f5b53e tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:37.286347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ead28a16-1b12-4773-a44e-c0c469f5b53e tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:37.286817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ead28a16-1b12-4773-a44e-c0c469f5b53e tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:37.359147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:25:37.415617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ead28a16-1b12-4773-a44e-c0c469f5b53e tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:37.423401 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ead28a16-1b12-4773-a44e-c0c469f5b53e tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1505 microversion: 2.1 time: 0.150959 Oct 24 11:25:37.423971 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3491/7009] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:37 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:37.446559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-294adf16-59ea-4ba0-b106-6fc086b596cb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:25:37.448924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-294adf16-59ea-4ba0-b106-6fc086b596cb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:37.454892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-294adf16-59ea-4ba0-b106-6fc086b596cb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:37.455368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-294adf16-59ea-4ba0-b106-6fc086b596cb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:37.455799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-294adf16-59ea-4ba0-b106-6fc086b596cb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:37.456491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-294adf16-59ea-4ba0-b106-6fc086b596cb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:37.456974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-294adf16-59ea-4ba0-b106-6fc086b596cb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:37.457400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-294adf16-59ea-4ba0-b106-6fc086b596cb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:37.487266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-294adf16-59ea-4ba0-b106-6fc086b596cb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:37.492940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-294adf16-59ea-4ba0-b106-6fc086b596cb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Old instance type m1.heat2, new instance type m1.heat {{(pid=120426) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 24 11:25:37.499407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-294adf16-59ea-4ba0-b106-6fc086b596cb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:25:37.499827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-294adf16-59ea-4ba0-b106-6fc086b596cb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:25:37.500295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-294adf16-59ea-4ba0-b106-6fc086b596cb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:25:37.500696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-294adf16-59ea-4ba0-b106-6fc086b596cb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:25:37.501127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-294adf16-59ea-4ba0-b106-6fc086b596cb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:25:37.565364 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-294adf16-59ea-4ba0-b106-6fc086b596cb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "POST /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074/action" status: 202 len: 0 microversion: 2.1 time: 0.123388 Oct 24 11:25:37.565992 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3519/7010] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:25:37 2022] POST /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:25:37.574803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5970dde2-0fbc-4f5d-9272-79dae4412c44 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:37.575443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5970dde2-0fbc-4f5d-9272-79dae4412c44 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:37.581332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5970dde2-0fbc-4f5d-9272-79dae4412c44 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:37.581840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5970dde2-0fbc-4f5d-9272-79dae4412c44 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:37.582297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5970dde2-0fbc-4f5d-9272-79dae4412c44 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:37.583026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5970dde2-0fbc-4f5d-9272-79dae4412c44 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:37.583754 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5970dde2-0fbc-4f5d-9272-79dae4412c44 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:37.583945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5970dde2-0fbc-4f5d-9272-79dae4412c44 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:37.728671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5970dde2-0fbc-4f5d-9272-79dae4412c44 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:37.736712 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5970dde2-0fbc-4f5d-9272-79dae4412c44 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1516 microversion: 2.1 time: 0.165784 Oct 24 11:25:37.737308 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3492/7011] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:37 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:38.763110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a84751f7-383f-4f70-85aa-347ee675f3a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:38.763727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a84751f7-383f-4f70-85aa-347ee675f3a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:38.774257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a84751f7-383f-4f70-85aa-347ee675f3a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:38.775418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a84751f7-383f-4f70-85aa-347ee675f3a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:38.775865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a84751f7-383f-4f70-85aa-347ee675f3a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:38.780479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a84751f7-383f-4f70-85aa-347ee675f3a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:38.780990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a84751f7-383f-4f70-85aa-347ee675f3a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:38.781444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a84751f7-383f-4f70-85aa-347ee675f3a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:38.950049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a84751f7-383f-4f70-85aa-347ee675f3a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:38.957991 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a84751f7-383f-4f70-85aa-347ee675f3a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1516 microversion: 2.1 time: 0.199822 Oct 24 11:25:38.958578 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3520/7012] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:38 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1516 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:39.986327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9dda1971-085e-4d45-ad68-e87b406857f2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:39.986952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9dda1971-085e-4d45-ad68-e87b406857f2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:39.993952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dda1971-085e-4d45-ad68-e87b406857f2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:39.994439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dda1971-085e-4d45-ad68-e87b406857f2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:39.994884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dda1971-085e-4d45-ad68-e87b406857f2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:39.995579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dda1971-085e-4d45-ad68-e87b406857f2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:39.996044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dda1971-085e-4d45-ad68-e87b406857f2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:39.996483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dda1971-085e-4d45-ad68-e87b406857f2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:40.132436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9dda1971-085e-4d45-ad68-e87b406857f2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:40.141743 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9dda1971-085e-4d45-ad68-e87b406857f2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.159278 Oct 24 11:25:40.142335 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3493/7013] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:39 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:41.165230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6c6e136f-a0de-491e-aafe-6e7d756952bb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:41.165848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6c6e136f-a0de-491e-aafe-6e7d756952bb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:41.168569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:25:41.173880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c6e136f-a0de-491e-aafe-6e7d756952bb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:41.174363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c6e136f-a0de-491e-aafe-6e7d756952bb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:41.174804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c6e136f-a0de-491e-aafe-6e7d756952bb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:41.175507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c6e136f-a0de-491e-aafe-6e7d756952bb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:41.175964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c6e136f-a0de-491e-aafe-6e7d756952bb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:41.176393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c6e136f-a0de-491e-aafe-6e7d756952bb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:41.182045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:25:41.308666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6c6e136f-a0de-491e-aafe-6e7d756952bb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:41.316416 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6c6e136f-a0de-491e-aafe-6e7d756952bb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.155198 Oct 24 11:25:41.317027 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3521/7014] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:41 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:42.339902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-67cdd8c8-4a2c-4e18-9e51-d331faa43436 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:42.340469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-67cdd8c8-4a2c-4e18-9e51-d331faa43436 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:42.343982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:25:42.350190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67cdd8c8-4a2c-4e18-9e51-d331faa43436 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:42.350935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67cdd8c8-4a2c-4e18-9e51-d331faa43436 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:42.351482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67cdd8c8-4a2c-4e18-9e51-d331faa43436 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:42.352227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67cdd8c8-4a2c-4e18-9e51-d331faa43436 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:42.352693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67cdd8c8-4a2c-4e18-9e51-d331faa43436 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:42.353172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-67cdd8c8-4a2c-4e18-9e51-d331faa43436 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:42.485248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-67cdd8c8-4a2c-4e18-9e51-d331faa43436 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:42.493908 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-67cdd8c8-4a2c-4e18-9e51-d331faa43436 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.158312 Oct 24 11:25:42.494489 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3494/7015] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:42 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:43.517212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-79db4278-c8c9-4593-829f-b71dca846b28 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:43.517834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-79db4278-c8c9-4593-829f-b71dca846b28 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:43.525585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79db4278-c8c9-4593-829f-b71dca846b28 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:43.526072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79db4278-c8c9-4593-829f-b71dca846b28 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:43.526511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79db4278-c8c9-4593-829f-b71dca846b28 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:43.527203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79db4278-c8c9-4593-829f-b71dca846b28 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:43.527657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79db4278-c8c9-4593-829f-b71dca846b28 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:43.528085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79db4278-c8c9-4593-829f-b71dca846b28 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:43.658343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-79db4278-c8c9-4593-829f-b71dca846b28 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:43.666348 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-79db4278-c8c9-4593-829f-b71dca846b28 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.153042 Oct 24 11:25:43.666925 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3522/7016] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:43 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:44.690839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c39b47c3-3836-413d-9e4b-5589911c61bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:44.691467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c39b47c3-3836-413d-9e4b-5589911c61bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:44.698436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c39b47c3-3836-413d-9e4b-5589911c61bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:44.698929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c39b47c3-3836-413d-9e4b-5589911c61bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:44.699380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c39b47c3-3836-413d-9e4b-5589911c61bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:44.700076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c39b47c3-3836-413d-9e4b-5589911c61bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:44.700540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c39b47c3-3836-413d-9e4b-5589911c61bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:44.701024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c39b47c3-3836-413d-9e4b-5589911c61bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:44.833854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c39b47c3-3836-413d-9e4b-5589911c61bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:44.842366 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c39b47c3-3836-413d-9e4b-5589911c61bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.155507 Oct 24 11:25:44.842948 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3495/7017] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:44 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:45.867332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4197b22a-d0db-4fa4-bad1-565b5b33c8ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:45.867874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4197b22a-d0db-4fa4-bad1-565b5b33c8ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:45.874700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4197b22a-d0db-4fa4-bad1-565b5b33c8ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:45.875181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4197b22a-d0db-4fa4-bad1-565b5b33c8ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:45.875619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4197b22a-d0db-4fa4-bad1-565b5b33c8ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:45.876309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4197b22a-d0db-4fa4-bad1-565b5b33c8ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:45.876761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4197b22a-d0db-4fa4-bad1-565b5b33c8ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:45.877218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4197b22a-d0db-4fa4-bad1-565b5b33c8ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:46.012324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4197b22a-d0db-4fa4-bad1-565b5b33c8ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:46.020077 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4197b22a-d0db-4fa4-bad1-565b5b33c8ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.157314 Oct 24 11:25:46.020650 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3523/7018] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:45 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:47.043579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f2116183-6af2-4066-bce6-15873fa9c0cd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:47.044204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f2116183-6af2-4066-bce6-15873fa9c0cd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:47.051141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2116183-6af2-4066-bce6-15873fa9c0cd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:47.051660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2116183-6af2-4066-bce6-15873fa9c0cd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:47.052108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2116183-6af2-4066-bce6-15873fa9c0cd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:47.052811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2116183-6af2-4066-bce6-15873fa9c0cd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:47.053296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2116183-6af2-4066-bce6-15873fa9c0cd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:47.053733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f2116183-6af2-4066-bce6-15873fa9c0cd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:47.184422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f2116183-6af2-4066-bce6-15873fa9c0cd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:47.192243 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f2116183-6af2-4066-bce6-15873fa9c0cd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.152603 Oct 24 11:25:47.192820 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3496/7019] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:47 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:48.215821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fbc34d3f-4ed9-4b04-a2f5-962082b7841d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:48.216449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fbc34d3f-4ed9-4b04-a2f5-962082b7841d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:48.223278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbc34d3f-4ed9-4b04-a2f5-962082b7841d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:48.223762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbc34d3f-4ed9-4b04-a2f5-962082b7841d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:48.224201 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbc34d3f-4ed9-4b04-a2f5-962082b7841d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:48.224956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbc34d3f-4ed9-4b04-a2f5-962082b7841d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:48.225424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbc34d3f-4ed9-4b04-a2f5-962082b7841d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:48.225852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fbc34d3f-4ed9-4b04-a2f5-962082b7841d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:48.359228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fbc34d3f-4ed9-4b04-a2f5-962082b7841d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:48.366986 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fbc34d3f-4ed9-4b04-a2f5-962082b7841d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.155136 Oct 24 11:25:48.367588 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3524/7020] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:48 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:49.389600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8783e969-ea9b-4185-bfe9-c29c09afc8a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:49.390259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8783e969-ea9b-4185-bfe9-c29c09afc8a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:49.397153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8783e969-ea9b-4185-bfe9-c29c09afc8a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:49.397647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8783e969-ea9b-4185-bfe9-c29c09afc8a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:49.398094 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8783e969-ea9b-4185-bfe9-c29c09afc8a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:49.399498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8783e969-ea9b-4185-bfe9-c29c09afc8a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:49.400325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8783e969-ea9b-4185-bfe9-c29c09afc8a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:49.400764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8783e969-ea9b-4185-bfe9-c29c09afc8a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:49.534531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8783e969-ea9b-4185-bfe9-c29c09afc8a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:49.543240 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8783e969-ea9b-4185-bfe9-c29c09afc8a3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.157496 Oct 24 11:25:49.543809 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3497/7021] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:49 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:50.567074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-21389962-49ce-4287-9d52-039a3677c732 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:50.567721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-21389962-49ce-4287-9d52-039a3677c732 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:50.574771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21389962-49ce-4287-9d52-039a3677c732 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:50.575259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21389962-49ce-4287-9d52-039a3677c732 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:50.575708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21389962-49ce-4287-9d52-039a3677c732 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:50.576408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21389962-49ce-4287-9d52-039a3677c732 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:50.576887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21389962-49ce-4287-9d52-039a3677c732 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:50.577322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-21389962-49ce-4287-9d52-039a3677c732 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:50.707643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-21389962-49ce-4287-9d52-039a3677c732 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:50.715739 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-21389962-49ce-4287-9d52-039a3677c732 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.152641 Oct 24 11:25:50.716334 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3525/7022] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:50 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:51.739504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-63b3356a-b67a-4d58-aedd-3cb092d32073 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:51.740148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-63b3356a-b67a-4d58-aedd-3cb092d32073 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:51.747888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63b3356a-b67a-4d58-aedd-3cb092d32073 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:51.748395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63b3356a-b67a-4d58-aedd-3cb092d32073 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:51.748870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63b3356a-b67a-4d58-aedd-3cb092d32073 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:51.749838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63b3356a-b67a-4d58-aedd-3cb092d32073 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:51.750707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63b3356a-b67a-4d58-aedd-3cb092d32073 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:51.751165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63b3356a-b67a-4d58-aedd-3cb092d32073 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:51.883764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-63b3356a-b67a-4d58-aedd-3cb092d32073 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:51.891476 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-63b3356a-b67a-4d58-aedd-3cb092d32073 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.155984 Oct 24 11:25:51.892057 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3498/7023] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:51 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:52.914887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1ad20825-59b3-4c03-9f9b-976644ca7728 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:52.915502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1ad20825-59b3-4c03-9f9b-976644ca7728 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:52.922262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ad20825-59b3-4c03-9f9b-976644ca7728 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:52.922739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ad20825-59b3-4c03-9f9b-976644ca7728 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:52.923174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ad20825-59b3-4c03-9f9b-976644ca7728 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:52.923863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ad20825-59b3-4c03-9f9b-976644ca7728 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:52.924312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ad20825-59b3-4c03-9f9b-976644ca7728 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:52.924732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1ad20825-59b3-4c03-9f9b-976644ca7728 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:53.053175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1ad20825-59b3-4c03-9f9b-976644ca7728 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:53.060897 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1ad20825-59b3-4c03-9f9b-976644ca7728 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.150511 Oct 24 11:25:53.061481 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3526/7024] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:52 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:54.083632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5cc3154c-7a32-4dce-b7bf-96feb0a7231c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:54.084190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5cc3154c-7a32-4dce-b7bf-96feb0a7231c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:54.091307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cc3154c-7a32-4dce-b7bf-96feb0a7231c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:54.091813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cc3154c-7a32-4dce-b7bf-96feb0a7231c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:54.092271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cc3154c-7a32-4dce-b7bf-96feb0a7231c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:54.093020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cc3154c-7a32-4dce-b7bf-96feb0a7231c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:54.093503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cc3154c-7a32-4dce-b7bf-96feb0a7231c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:54.093948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5cc3154c-7a32-4dce-b7bf-96feb0a7231c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:54.230175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5cc3154c-7a32-4dce-b7bf-96feb0a7231c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:54.238031 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5cc3154c-7a32-4dce-b7bf-96feb0a7231c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.158386 Oct 24 11:25:54.238604 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3499/7025] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:54 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:55.261883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0e9a7f6c-0b52-4a56-b069-76c2bb4988ee tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:55.262499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0e9a7f6c-0b52-4a56-b069-76c2bb4988ee tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:55.269341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e9a7f6c-0b52-4a56-b069-76c2bb4988ee tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:55.269838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e9a7f6c-0b52-4a56-b069-76c2bb4988ee tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:55.270257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e9a7f6c-0b52-4a56-b069-76c2bb4988ee tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:55.270947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e9a7f6c-0b52-4a56-b069-76c2bb4988ee tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:55.271401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e9a7f6c-0b52-4a56-b069-76c2bb4988ee tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:55.271828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e9a7f6c-0b52-4a56-b069-76c2bb4988ee tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:55.404763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0e9a7f6c-0b52-4a56-b069-76c2bb4988ee tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:55.412678 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0e9a7f6c-0b52-4a56-b069-76c2bb4988ee tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.155249 Oct 24 11:25:55.413317 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3527/7026] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:55 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:56.436628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c9da3ab9-8e4b-44fb-80b8-c49e123af828 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:56.437287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c9da3ab9-8e4b-44fb-80b8-c49e123af828 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:56.444100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9da3ab9-8e4b-44fb-80b8-c49e123af828 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:56.444595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9da3ab9-8e4b-44fb-80b8-c49e123af828 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:56.445222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9da3ab9-8e4b-44fb-80b8-c49e123af828 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:56.446209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9da3ab9-8e4b-44fb-80b8-c49e123af828 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:56.446684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9da3ab9-8e4b-44fb-80b8-c49e123af828 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:56.447132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c9da3ab9-8e4b-44fb-80b8-c49e123af828 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:56.583049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c9da3ab9-8e4b-44fb-80b8-c49e123af828 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:56.591250 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c9da3ab9-8e4b-44fb-80b8-c49e123af828 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.158571 Oct 24 11:25:56.591816 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3500/7027] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:56 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:57.614382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4bc52080-5072-4de5-b5f2-5c23d78698b0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:57.615034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4bc52080-5072-4de5-b5f2-5c23d78698b0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:57.622646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bc52080-5072-4de5-b5f2-5c23d78698b0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:57.623123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bc52080-5072-4de5-b5f2-5c23d78698b0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:57.623563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bc52080-5072-4de5-b5f2-5c23d78698b0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:57.624248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bc52080-5072-4de5-b5f2-5c23d78698b0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:57.624705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bc52080-5072-4de5-b5f2-5c23d78698b0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:57.625156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4bc52080-5072-4de5-b5f2-5c23d78698b0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:57.755327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4bc52080-5072-4de5-b5f2-5c23d78698b0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:57.763438 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4bc52080-5072-4de5-b5f2-5c23d78698b0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.153009 Oct 24 11:25:57.764017 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3528/7028] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:57 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:58.790322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-71bc8a4b-6431-4894-8a42-edb5f7191795 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:58.790992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-71bc8a4b-6431-4894-8a42-edb5f7191795 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:58.797697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71bc8a4b-6431-4894-8a42-edb5f7191795 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:58.798188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71bc8a4b-6431-4894-8a42-edb5f7191795 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:58.798634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71bc8a4b-6431-4894-8a42-edb5f7191795 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:58.799335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71bc8a4b-6431-4894-8a42-edb5f7191795 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:58.799802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71bc8a4b-6431-4894-8a42-edb5f7191795 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:58.800236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71bc8a4b-6431-4894-8a42-edb5f7191795 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:58.821856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:25:58.939423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-71bc8a4b-6431-4894-8a42-edb5f7191795 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:25:58.947947 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-71bc8a4b-6431-4894-8a42-edb5f7191795 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.162191 Oct 24 11:25:58.948529 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3501/7029] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:58 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:25:59.971105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-50aea04b-b7e4-4cb1-bbe6-b9ef879a17dd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:25:59.971733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-50aea04b-b7e4-4cb1-bbe6-b9ef879a17dd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:25:59.979255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50aea04b-b7e4-4cb1-bbe6-b9ef879a17dd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:59.979736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50aea04b-b7e4-4cb1-bbe6-b9ef879a17dd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:59.980173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50aea04b-b7e4-4cb1-bbe6-b9ef879a17dd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:25:59.980892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50aea04b-b7e4-4cb1-bbe6-b9ef879a17dd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:25:59.981346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50aea04b-b7e4-4cb1-bbe6-b9ef879a17dd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:25:59.981783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-50aea04b-b7e4-4cb1-bbe6-b9ef879a17dd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:00.117972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-50aea04b-b7e4-4cb1-bbe6-b9ef879a17dd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:00.125902 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-50aea04b-b7e4-4cb1-bbe6-b9ef879a17dd tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.158872 Oct 24 11:26:00.126411 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3529/7030] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:25:59 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:01.149175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-406b4a38-3da2-4197-9b79-35c2e3748850 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:01.149832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-406b4a38-3da2-4197-9b79-35c2e3748850 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:01.157005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-406b4a38-3da2-4197-9b79-35c2e3748850 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:01.157500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-406b4a38-3da2-4197-9b79-35c2e3748850 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:01.157958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-406b4a38-3da2-4197-9b79-35c2e3748850 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:01.158650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-406b4a38-3da2-4197-9b79-35c2e3748850 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:01.159113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-406b4a38-3da2-4197-9b79-35c2e3748850 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:01.159548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-406b4a38-3da2-4197-9b79-35c2e3748850 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:01.287437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-406b4a38-3da2-4197-9b79-35c2e3748850 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:01.296954 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-406b4a38-3da2-4197-9b79-35c2e3748850 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.151664 Oct 24 11:26:01.297534 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3502/7031] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:01 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:02.319852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6c69b838-382b-4eeb-bed5-a6445e8d87bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:02.320532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6c69b838-382b-4eeb-bed5-a6445e8d87bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:02.327487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c69b838-382b-4eeb-bed5-a6445e8d87bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:02.327973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c69b838-382b-4eeb-bed5-a6445e8d87bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:02.328412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c69b838-382b-4eeb-bed5-a6445e8d87bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:02.329121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c69b838-382b-4eeb-bed5-a6445e8d87bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:02.329573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c69b838-382b-4eeb-bed5-a6445e8d87bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:02.329998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6c69b838-382b-4eeb-bed5-a6445e8d87bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:02.462059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6c69b838-382b-4eeb-bed5-a6445e8d87bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:02.469790 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6c69b838-382b-4eeb-bed5-a6445e8d87bc tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.153875 Oct 24 11:26:02.470363 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3530/7032] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:02 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:03.495246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7c1faf4d-f994-4e28-aa23-8f52d685d4a2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:03.495872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7c1faf4d-f994-4e28-aa23-8f52d685d4a2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:03.503694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c1faf4d-f994-4e28-aa23-8f52d685d4a2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:03.504194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c1faf4d-f994-4e28-aa23-8f52d685d4a2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:03.504648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c1faf4d-f994-4e28-aa23-8f52d685d4a2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:03.505391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c1faf4d-f994-4e28-aa23-8f52d685d4a2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:03.505854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c1faf4d-f994-4e28-aa23-8f52d685d4a2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:03.506294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7c1faf4d-f994-4e28-aa23-8f52d685d4a2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:03.639744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7c1faf4d-f994-4e28-aa23-8f52d685d4a2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:03.647494 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7c1faf4d-f994-4e28-aa23-8f52d685d4a2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.157576 Oct 24 11:26:03.648068 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3503/7033] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:03 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:04.670545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a32cc886-b312-421b-8252-1a880ce2f5ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:04.671169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a32cc886-b312-421b-8252-1a880ce2f5ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:04.678075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a32cc886-b312-421b-8252-1a880ce2f5ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:04.678560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a32cc886-b312-421b-8252-1a880ce2f5ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:04.679008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a32cc886-b312-421b-8252-1a880ce2f5ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:04.679756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a32cc886-b312-421b-8252-1a880ce2f5ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:04.680216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a32cc886-b312-421b-8252-1a880ce2f5ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:04.680654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a32cc886-b312-421b-8252-1a880ce2f5ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:04.812549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a32cc886-b312-421b-8252-1a880ce2f5ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:04.820584 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a32cc886-b312-421b-8252-1a880ce2f5ed tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.153862 Oct 24 11:26:04.821195 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3531/7034] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:04 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:05.843923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6206911c-879f-437c-a8dc-18477ad8b215 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:05.844568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6206911c-879f-437c-a8dc-18477ad8b215 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:05.851823 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6206911c-879f-437c-a8dc-18477ad8b215 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:05.852293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6206911c-879f-437c-a8dc-18477ad8b215 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:05.852756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6206911c-879f-437c-a8dc-18477ad8b215 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:05.853524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6206911c-879f-437c-a8dc-18477ad8b215 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:05.854003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6206911c-879f-437c-a8dc-18477ad8b215 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:05.854453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6206911c-879f-437c-a8dc-18477ad8b215 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:05.988565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6206911c-879f-437c-a8dc-18477ad8b215 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:05.996442 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6206911c-879f-437c-a8dc-18477ad8b215 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1521 microversion: 2.1 time: 0.156636 Oct 24 11:26:05.997042 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3504/7035] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:05 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:07.020963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-213d04af-3bd6-4423-94c7-83ead27ce1a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:07.022229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-213d04af-3bd6-4423-94c7-83ead27ce1a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:07.030093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-213d04af-3bd6-4423-94c7-83ead27ce1a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:07.030635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-213d04af-3bd6-4423-94c7-83ead27ce1a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:07.031096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-213d04af-3bd6-4423-94c7-83ead27ce1a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:07.031800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-213d04af-3bd6-4423-94c7-83ead27ce1a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:07.032248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-213d04af-3bd6-4423-94c7-83ead27ce1a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:07.032670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-213d04af-3bd6-4423-94c7-83ead27ce1a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:07.243629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b5870912-e82d-484a-87be-67bc93cb74ba req-088c4cc3-f690-49a6-9c44-2f316c3a6123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b12d91-c528-4616-b031-b1f037180074", "name": "network-vif-unplugged", "status": "completed", "tag": "d0b63091-7a0e-460c-8127-b20ad1e607a3"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:26:07.255155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b5870912-e82d-484a-87be-67bc93cb74ba req-088c4cc3-f690-49a6-9c44-2f316c3a6123 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:07.255868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b5870912-e82d-484a-87be-67bc93cb74ba req-088c4cc3-f690-49a6-9c44-2f316c3a6123 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:07.256392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b5870912-e82d-484a-87be-67bc93cb74ba req-088c4cc3-f690-49a6-9c44-2f316c3a6123 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:07.268524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-213d04af-3bd6-4423-94c7-83ead27ce1a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:07.269292 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b5870912-e82d-484a-87be-67bc93cb74ba req-088c4cc3-f690-49a6-9c44-2f316c3a6123 service nova] Creating event network-vif-unplugged:d0b63091-7a0e-460c-8127-b20ad1e607a3 for instance 83b12d91-c528-4616-b031-b1f037180074 on n-h1-858383-15 Oct 24 11:26:07.276334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-b5870912-e82d-484a-87be-67bc93cb74ba req-088c4cc3-f690-49a6-9c44-2f316c3a6123 service nova] Instance 83b12d91-c528-4616-b031-b1f037180074 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:26:07.281990 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-213d04af-3bd6-4423-94c7-83ead27ce1a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1520 microversion: 2.1 time: 0.265073 Oct 24 11:26:07.289916 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3532/7036] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:07 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:07.301564 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b5870912-e82d-484a-87be-67bc93cb74ba req-088c4cc3-f690-49a6-9c44-2f316c3a6123 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061875 Oct 24 11:26:07.302363 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3505/7037] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:26:08.306529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c4cb4051-c782-43f5-94f6-6966619f1a62 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:08.307147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c4cb4051-c782-43f5-94f6-6966619f1a62 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:08.314067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4cb4051-c782-43f5-94f6-6966619f1a62 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:08.314552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4cb4051-c782-43f5-94f6-6966619f1a62 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:08.314995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4cb4051-c782-43f5-94f6-6966619f1a62 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:08.315689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4cb4051-c782-43f5-94f6-6966619f1a62 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:08.316145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4cb4051-c782-43f5-94f6-6966619f1a62 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:08.316573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4cb4051-c782-43f5-94f6-6966619f1a62 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:08.448929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c4cb4051-c782-43f5-94f6-6966619f1a62 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:08.456804 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c4cb4051-c782-43f5-94f6-6966619f1a62 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1518 microversion: 2.1 time: 0.154249 Oct 24 11:26:08.457409 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3533/7038] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:08 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:09.337463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-23074d65-1864-4fd7-be3b-c5f7a3f798a9 req-a664675a-f33c-4980-bb3a-e9791bb1018a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b12d91-c528-4616-b031-b1f037180074", "tag": "d0b63091-7a0e-460c-8127-b20ad1e607a3"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:26:09.346906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-23074d65-1864-4fd7-be3b-c5f7a3f798a9 req-a664675a-f33c-4980-bb3a-e9791bb1018a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:09.347400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-23074d65-1864-4fd7-be3b-c5f7a3f798a9 req-a664675a-f33c-4980-bb3a-e9791bb1018a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:09.347852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-23074d65-1864-4fd7-be3b-c5f7a3f798a9 req-a664675a-f33c-4980-bb3a-e9791bb1018a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:09.361313 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-23074d65-1864-4fd7-be3b-c5f7a3f798a9 req-a664675a-f33c-4980-bb3a-e9791bb1018a service nova] Creating event network-changed:d0b63091-7a0e-460c-8127-b20ad1e607a3 for instance 83b12d91-c528-4616-b031-b1f037180074 on n-h1-858383-15 Oct 24 11:26:09.366600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-23074d65-1864-4fd7-be3b-c5f7a3f798a9 req-a664675a-f33c-4980-bb3a-e9791bb1018a service nova] Instance 83b12d91-c528-4616-b031-b1f037180074 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:26:09.377179 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-23074d65-1864-4fd7-be3b-c5f7a3f798a9 req-a664675a-f33c-4980-bb3a-e9791bb1018a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045362 Oct 24 11:26:09.377757 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3506/7039] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:26:09.482938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-35980991-ff52-41c6-9c0d-e0719bd58ef0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:09.482938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-35980991-ff52-41c6-9c0d-e0719bd58ef0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:09.489582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35980991-ff52-41c6-9c0d-e0719bd58ef0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:09.490074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35980991-ff52-41c6-9c0d-e0719bd58ef0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:09.490512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35980991-ff52-41c6-9c0d-e0719bd58ef0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:09.491224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35980991-ff52-41c6-9c0d-e0719bd58ef0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:09.491680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35980991-ff52-41c6-9c0d-e0719bd58ef0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:09.492220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35980991-ff52-41c6-9c0d-e0719bd58ef0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:09.627863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-35980991-ff52-41c6-9c0d-e0719bd58ef0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:09.636725 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-35980991-ff52-41c6-9c0d-e0719bd58ef0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1518 microversion: 2.1 time: 0.159326 Oct 24 11:26:09.637352 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3534/7040] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:09 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:10.661221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8fa7c5b0-7a31-43e0-b720-941458776eac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:10.661940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8fa7c5b0-7a31-43e0-b720-941458776eac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:10.668912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fa7c5b0-7a31-43e0-b720-941458776eac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:10.669407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fa7c5b0-7a31-43e0-b720-941458776eac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:10.669884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fa7c5b0-7a31-43e0-b720-941458776eac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:10.670585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fa7c5b0-7a31-43e0-b720-941458776eac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:10.671047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fa7c5b0-7a31-43e0-b720-941458776eac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:10.671481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fa7c5b0-7a31-43e0-b720-941458776eac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:10.807047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8fa7c5b0-7a31-43e0-b720-941458776eac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:10.814880 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8fa7c5b0-7a31-43e0-b720-941458776eac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1518 microversion: 2.1 time: 0.158910 Oct 24 11:26:10.815452 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3507/7041] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:10 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:11.838499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ad44c9b2-252e-46f7-b48f-d3cd05fcae38 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:11.839023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ad44c9b2-252e-46f7-b48f-d3cd05fcae38 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:11.841862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=28 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:26:11.847656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad44c9b2-252e-46f7-b48f-d3cd05fcae38 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:11.848174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad44c9b2-252e-46f7-b48f-d3cd05fcae38 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:11.848613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad44c9b2-252e-46f7-b48f-d3cd05fcae38 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:11.849376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad44c9b2-252e-46f7-b48f-d3cd05fcae38 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:11.849855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad44c9b2-252e-46f7-b48f-d3cd05fcae38 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:11.850288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ad44c9b2-252e-46f7-b48f-d3cd05fcae38 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:11.853296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=84 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:26:11.989788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ad44c9b2-252e-46f7-b48f-d3cd05fcae38 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:11.998492 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ad44c9b2-252e-46f7-b48f-d3cd05fcae38 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1515 microversion: 2.1 time: 0.164266 Oct 24 11:26:11.999090 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3535/7042] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:11 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:12.021020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-600ecc9f-bfec-436e-bada-62b3c126f134 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:26:12.021573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-600ecc9f-bfec-436e-bada-62b3c126f134 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:12.028616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-600ecc9f-bfec-436e-bada-62b3c126f134 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:12.029157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-600ecc9f-bfec-436e-bada-62b3c126f134 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:12.029615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-600ecc9f-bfec-436e-bada-62b3c126f134 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:12.030330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-600ecc9f-bfec-436e-bada-62b3c126f134 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:12.030800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-600ecc9f-bfec-436e-bada-62b3c126f134 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:12.031244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-600ecc9f-bfec-436e-bada-62b3c126f134 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:12.092091 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-600ecc9f-bfec-436e-bada-62b3c126f134 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "POST /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074/action" status: 204 len: 0 microversion: 2.1 time: 0.074791 Oct 24 11:26:12.092657 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3508/7043] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:26:12 2022] POST /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:26:12.102421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-575465ba-eb1f-47a9-97ee-53edfd082cc3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:12.103060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-575465ba-eb1f-47a9-97ee-53edfd082cc3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:12.109878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-575465ba-eb1f-47a9-97ee-53edfd082cc3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:12.110445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-575465ba-eb1f-47a9-97ee-53edfd082cc3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:12.110895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-575465ba-eb1f-47a9-97ee-53edfd082cc3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:12.112437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-575465ba-eb1f-47a9-97ee-53edfd082cc3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:12.112956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-575465ba-eb1f-47a9-97ee-53edfd082cc3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:12.113377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-575465ba-eb1f-47a9-97ee-53edfd082cc3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:12.247059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-575465ba-eb1f-47a9-97ee-53edfd082cc3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:12.254910 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-575465ba-eb1f-47a9-97ee-53edfd082cc3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1515 microversion: 2.1 time: 0.158014 Oct 24 11:26:12.255494 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3536/7044] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:12 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:26:13.045666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e2e10c96-2386-4850-b301-779516d55461 req-f2e87bf0-aff1-4faa-88fa-884c380b1505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b12d91-c528-4616-b031-b1f037180074", "name": "network-vif-plugged", "status": "completed", "tag": "d0b63091-7a0e-460c-8127-b20ad1e607a3"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:26:13.054237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=30 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:26:13.061064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e2e10c96-2386-4850-b301-779516d55461 req-f2e87bf0-aff1-4faa-88fa-884c380b1505 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:13.061559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e2e10c96-2386-4850-b301-779516d55461 req-f2e87bf0-aff1-4faa-88fa-884c380b1505 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:13.062007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e2e10c96-2386-4850-b301-779516d55461 req-f2e87bf0-aff1-4faa-88fa-884c380b1505 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:13.073847 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e2e10c96-2386-4850-b301-779516d55461 req-f2e87bf0-aff1-4faa-88fa-884c380b1505 service nova] Creating event network-vif-plugged:d0b63091-7a0e-460c-8127-b20ad1e607a3 for instance 83b12d91-c528-4616-b031-b1f037180074 on n-h1-858383-15 Oct 24 11:26:13.079170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-e2e10c96-2386-4850-b301-779516d55461 req-f2e87bf0-aff1-4faa-88fa-884c380b1505 service nova] Instance 83b12d91-c528-4616-b031-b1f037180074 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:26:13.090589 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e2e10c96-2386-4850-b301-779516d55461 req-f2e87bf0-aff1-4faa-88fa-884c380b1505 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050512 Oct 24 11:26:13.091197 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3509/7045] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:26:13.279298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-689b571e-03c7-45fd-a6b0-8d0317e84865 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:13.280490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-689b571e-03c7-45fd-a6b0-8d0317e84865 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:13.287591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-689b571e-03c7-45fd-a6b0-8d0317e84865 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:13.288080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-689b571e-03c7-45fd-a6b0-8d0317e84865 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:13.288522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-689b571e-03c7-45fd-a6b0-8d0317e84865 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:13.290352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-689b571e-03c7-45fd-a6b0-8d0317e84865 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:13.290847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-689b571e-03c7-45fd-a6b0-8d0317e84865 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:13.291336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-689b571e-03c7-45fd-a6b0-8d0317e84865 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:13.433191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-689b571e-03c7-45fd-a6b0-8d0317e84865 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:13.441375 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-689b571e-03c7-45fd-a6b0-8d0317e84865 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1515 microversion: 2.1 time: 0.166247 Oct 24 11:26:13.441963 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3537/7046] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:13 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:14.467368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-db3176ad-a573-4f8d-a401-d5aaad4e27f7 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:14.468073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-db3176ad-a573-4f8d-a401-d5aaad4e27f7 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:14.474170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db3176ad-a573-4f8d-a401-d5aaad4e27f7 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:14.474657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db3176ad-a573-4f8d-a401-d5aaad4e27f7 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:14.475098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db3176ad-a573-4f8d-a401-d5aaad4e27f7 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:14.475794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db3176ad-a573-4f8d-a401-d5aaad4e27f7 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:14.476774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db3176ad-a573-4f8d-a401-d5aaad4e27f7 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:14.477226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db3176ad-a573-4f8d-a401-d5aaad4e27f7 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:14.607971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-db3176ad-a573-4f8d-a401-d5aaad4e27f7 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:14.615760 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-db3176ad-a573-4f8d-a401-d5aaad4e27f7 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1507 microversion: 2.1 time: 0.153513 Oct 24 11:26:14.616329 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3510/7047] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:14 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:26:14.637642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4146bd47-db7a-4d35-b8a2-11cab63b5951 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:14.638254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4146bd47-db7a-4d35-b8a2-11cab63b5951 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:14.644928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4146bd47-db7a-4d35-b8a2-11cab63b5951 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:14.645408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4146bd47-db7a-4d35-b8a2-11cab63b5951 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:14.645840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4146bd47-db7a-4d35-b8a2-11cab63b5951 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:14.646529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4146bd47-db7a-4d35-b8a2-11cab63b5951 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:14.646979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4146bd47-db7a-4d35-b8a2-11cab63b5951 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:14.647405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4146bd47-db7a-4d35-b8a2-11cab63b5951 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:14.775871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4146bd47-db7a-4d35-b8a2-11cab63b5951 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:14.783634 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4146bd47-db7a-4d35-b8a2-11cab63b5951 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1507 microversion: 2.1 time: 0.149795 Oct 24 11:26:14.784215 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3538/7048] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:14 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:14.810294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0c05f090-ed77-4fe1-b832-8d0bd3c12fc0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Action: 'create', calling method: .version_select at 0x7f04d0b0bb80>, body: {"keypair": {"name": "tempest-keypair-1785265154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsWG3ee+/nBQQUaK9xLeod1mNljf+1+NIZsPB6gw+is/w1QTK8C3kji8xPOhoWIaicQTLnJBvvGVVp/FwTfhFrNFztfjjQwFWGECG4oYHOcdKQKMGNo/AZgc6IcUQQ45w=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:26:14.825618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0c05f090-ed77-4fe1-b832-8d0bd3c12fc0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Getting quotas for project 39796f68d9c64213963dbf4cffcb8590. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:26:14.830668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0c05f090-ed77-4fe1-b832-8d0bd3c12fc0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Getting quotas for user 264263b947ca4a7ea1beb528460a52f2 and project 39796f68d9c64213963dbf4cffcb8590. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:26:14.859566 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0c05f090-ed77-4fe1-b832-8d0bd3c12fc0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053246 Oct 24 11:26:14.860212 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3511/7049] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:26:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:26:16.389939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4153745c-5d09-4a56-904e-be334406b394 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:16.390587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4153745c-5d09-4a56-904e-be334406b394 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:16.397721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4153745c-5d09-4a56-904e-be334406b394 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:16.398747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4153745c-5d09-4a56-904e-be334406b394 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:16.399484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4153745c-5d09-4a56-904e-be334406b394 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:16.400444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4153745c-5d09-4a56-904e-be334406b394 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:16.400929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4153745c-5d09-4a56-904e-be334406b394 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:16.401360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4153745c-5d09-4a56-904e-be334406b394 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:16.532990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4153745c-5d09-4a56-904e-be334406b394 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:16.542039 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4153745c-5d09-4a56-904e-be334406b394 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 200 len: 1507 microversion: 2.1 time: 0.156001 Oct 24 11:26:16.542611 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3539/7050] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:16 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:16.565598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa59728e-5d4d-45d3-bae8-beac9a691cb2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:16.566116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa59728e-5d4d-45d3-bae8-beac9a691cb2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:16.573303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa59728e-5d4d-45d3-bae8-beac9a691cb2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:16.573804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa59728e-5d4d-45d3-bae8-beac9a691cb2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:16.574257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa59728e-5d4d-45d3-bae8-beac9a691cb2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:16.574969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa59728e-5d4d-45d3-bae8-beac9a691cb2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:16.575441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa59728e-5d4d-45d3-bae8-beac9a691cb2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:16.575887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa59728e-5d4d-45d3-bae8-beac9a691cb2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:16.600600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa59728e-5d4d-45d3-bae8-beac9a691cb2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:26:16.674429 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa59728e-5d4d-45d3-bae8-beac9a691cb2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "DELETE /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 204 len: 0 microversion: 2.1 time: 0.113513 Oct 24 11:26:16.675108 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3512/7051] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:26:16 2022] DELETE /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:26:16.734009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1a15a8c3-6c64-4f4e-800d-80257da5eaf8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2025866804", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "3c7df3b2-4ae3-4445-9019-f1884fde194e"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:26:16.787745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-1a15a8c3-6c64-4f4e-800d-80257da5eaf8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] validate_networks() for [('3c7df3b2-4ae3-4445-9019-f1884fde194e', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:26:17.163353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1a15a8c3-6c64-4f4e-800d-80257da5eaf8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:26:17.164346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1a15a8c3-6c64-4f4e-800d-80257da5eaf8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:26:17.164873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1a15a8c3-6c64-4f4e-800d-80257da5eaf8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:26:17.165313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1a15a8c3-6c64-4f4e-800d-80257da5eaf8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:26:17.165719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-1a15a8c3-6c64-4f4e-800d-80257da5eaf8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:26:17.174547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a15a8c3-6c64-4f4e-800d-80257da5eaf8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:17.175023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a15a8c3-6c64-4f4e-800d-80257da5eaf8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:17.175462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a15a8c3-6c64-4f4e-800d-80257da5eaf8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:17.176179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a15a8c3-6c64-4f4e-800d-80257da5eaf8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:17.176626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a15a8c3-6c64-4f4e-800d-80257da5eaf8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:17.177077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a15a8c3-6c64-4f4e-800d-80257da5eaf8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:17.194438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-1a15a8c3-6c64-4f4e-800d-80257da5eaf8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Getting quotas for project 39796f68d9c64213963dbf4cffcb8590. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:26:17.199803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-1a15a8c3-6c64-4f4e-800d-80257da5eaf8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Getting quotas for user 264263b947ca4a7ea1beb528460a52f2 and project 39796f68d9c64213963dbf4cffcb8590. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:26:17.211949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1a15a8c3-6c64-4f4e-800d-80257da5eaf8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:26:17.214275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1a15a8c3-6c64-4f4e-800d-80257da5eaf8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:26:17.258636 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1a15a8c3-6c64-4f4e-800d-80257da5eaf8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528501 Oct 24 11:26:17.259314 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3540/7052] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:26:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:26:17.271058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4702284d-d09f-4b9b-9414-f4b7bd724c90 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:17.271788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4702284d-d09f-4b9b-9414-f4b7bd724c90 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:17.326183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4702284d-d09f-4b9b-9414-f4b7bd724c90 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:17.333105 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4702284d-d09f-4b9b-9414-f4b7bd724c90 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1218 microversion: 2.1 time: 0.066242 Oct 24 11:26:17.333677 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3513/7053] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:17 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:18.357275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-643a8abb-b719-40ae-bbb4-6ad3ebc32bc0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:18.357815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-643a8abb-b719-40ae-bbb4-6ad3ebc32bc0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:18.364677 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-643a8abb-b719-40ae-bbb4-6ad3ebc32bc0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:18.365189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-643a8abb-b719-40ae-bbb4-6ad3ebc32bc0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:18.365637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-643a8abb-b719-40ae-bbb4-6ad3ebc32bc0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:18.366345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-643a8abb-b719-40ae-bbb4-6ad3ebc32bc0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:18.366804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-643a8abb-b719-40ae-bbb4-6ad3ebc32bc0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:18.367242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-643a8abb-b719-40ae-bbb4-6ad3ebc32bc0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:18.437551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-643a8abb-b719-40ae-bbb4-6ad3ebc32bc0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:18.446140 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-643a8abb-b719-40ae-bbb4-6ad3ebc32bc0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1270 microversion: 2.1 time: 0.093750 Oct 24 11:26:18.446734 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3541/7054] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:18 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:18.739258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-cd11350f-e47d-4248-a74e-1b8e63c259a6 req-fd3944a1-43fa-44a1-8235-84ea595da240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b12d91-c528-4616-b031-b1f037180074", "name": "network-vif-deleted", "tag": "d0b63091-7a0e-460c-8127-b20ad1e607a3"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:26:18.755446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cd11350f-e47d-4248-a74e-1b8e63c259a6 req-fd3944a1-43fa-44a1-8235-84ea595da240 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:18.756231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cd11350f-e47d-4248-a74e-1b8e63c259a6 req-fd3944a1-43fa-44a1-8235-84ea595da240 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:18.757109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cd11350f-e47d-4248-a74e-1b8e63c259a6 req-fd3944a1-43fa-44a1-8235-84ea595da240 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:18.771493 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-cd11350f-e47d-4248-a74e-1b8e63c259a6 req-fd3944a1-43fa-44a1-8235-84ea595da240 service nova] Creating event network-vif-deleted:d0b63091-7a0e-460c-8127-b20ad1e607a3 for instance 83b12d91-c528-4616-b031-b1f037180074 on n-h1-858383-15 Oct 24 11:26:18.781039 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-cd11350f-e47d-4248-a74e-1b8e63c259a6 req-fd3944a1-43fa-44a1-8235-84ea595da240 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046715 Oct 24 11:26:18.781862 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3514/7055] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:26:19.470726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a69b899f-e02a-46da-a908-e105e3f0b733 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:19.471459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a69b899f-e02a-46da-a908-e105e3f0b733 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:19.478405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a69b899f-e02a-46da-a908-e105e3f0b733 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:19.478897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a69b899f-e02a-46da-a908-e105e3f0b733 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:19.479339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a69b899f-e02a-46da-a908-e105e3f0b733 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:19.480059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a69b899f-e02a-46da-a908-e105e3f0b733 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:19.480523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a69b899f-e02a-46da-a908-e105e3f0b733 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:19.480985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a69b899f-e02a-46da-a908-e105e3f0b733 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:19.740301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a69b899f-e02a-46da-a908-e105e3f0b733 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:19.749334 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a69b899f-e02a-46da-a908-e105e3f0b733 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1318 microversion: 2.1 time: 0.283281 Oct 24 11:26:19.749921 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3542/7056] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:19 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:20.404035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-5e682b63-6c2e-4bd8-be2c-d8af08736d9e req-cbb02d30-8191-4446-966e-b5075909f976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e354a81e-92f0-47c2-a0dd-8d947314502d", "tag": "b94e6ffd-082e-4d6d-8f14-f963376b8163"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:26:20.415683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5e682b63-6c2e-4bd8-be2c-d8af08736d9e req-cbb02d30-8191-4446-966e-b5075909f976 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:20.416259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5e682b63-6c2e-4bd8-be2c-d8af08736d9e req-cbb02d30-8191-4446-966e-b5075909f976 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:20.416714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5e682b63-6c2e-4bd8-be2c-d8af08736d9e req-cbb02d30-8191-4446-966e-b5075909f976 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:20.427752 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-5e682b63-6c2e-4bd8-be2c-d8af08736d9e req-cbb02d30-8191-4446-966e-b5075909f976 service nova] Creating event network-changed:b94e6ffd-082e-4d6d-8f14-f963376b8163 for instance e354a81e-92f0-47c2-a0dd-8d947314502d on n-h1-858383-15 Oct 24 11:26:20.433970 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-5e682b63-6c2e-4bd8-be2c-d8af08736d9e req-cbb02d30-8191-4446-966e-b5075909f976 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035992 Oct 24 11:26:20.434781 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3515/7057] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:26:20.772345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dee91022-a12a-4f29-beaf-ed6d60db0844 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:20.773500 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dee91022-a12a-4f29-beaf-ed6d60db0844 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:20.780947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dee91022-a12a-4f29-beaf-ed6d60db0844 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:20.781438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dee91022-a12a-4f29-beaf-ed6d60db0844 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:20.781882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dee91022-a12a-4f29-beaf-ed6d60db0844 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:20.782594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dee91022-a12a-4f29-beaf-ed6d60db0844 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:20.783054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dee91022-a12a-4f29-beaf-ed6d60db0844 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:20.783489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dee91022-a12a-4f29-beaf-ed6d60db0844 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:20.934821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dee91022-a12a-4f29-beaf-ed6d60db0844 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:20.942722 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dee91022-a12a-4f29-beaf-ed6d60db0844 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1318 microversion: 2.1 time: 0.174363 Oct 24 11:26:20.943306 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3543/7058] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:20 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:21.967612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fcc0b417-6b59-4f78-ab60-15d48cbe9b16 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:21.968331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fcc0b417-6b59-4f78-ab60-15d48cbe9b16 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:21.975479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcc0b417-6b59-4f78-ab60-15d48cbe9b16 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:21.975983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcc0b417-6b59-4f78-ab60-15d48cbe9b16 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:21.976679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcc0b417-6b59-4f78-ab60-15d48cbe9b16 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:21.977432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcc0b417-6b59-4f78-ab60-15d48cbe9b16 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:21.977904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcc0b417-6b59-4f78-ab60-15d48cbe9b16 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:21.978345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fcc0b417-6b59-4f78-ab60-15d48cbe9b16 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:22.110522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fcc0b417-6b59-4f78-ab60-15d48cbe9b16 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:22.119259 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fcc0b417-6b59-4f78-ab60-15d48cbe9b16 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1318 microversion: 2.1 time: 0.155865 Oct 24 11:26:22.119850 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3516/7059] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:21 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:23.142866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f00a0107-22d2-40e8-8736-3af0d1e8fed4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:23.143567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f00a0107-22d2-40e8-8736-3af0d1e8fed4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:23.151349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f00a0107-22d2-40e8-8736-3af0d1e8fed4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:23.152038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f00a0107-22d2-40e8-8736-3af0d1e8fed4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:23.152482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f00a0107-22d2-40e8-8736-3af0d1e8fed4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:23.153244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f00a0107-22d2-40e8-8736-3af0d1e8fed4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:23.153705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f00a0107-22d2-40e8-8736-3af0d1e8fed4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:23.154134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f00a0107-22d2-40e8-8736-3af0d1e8fed4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:23.370554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f00a0107-22d2-40e8-8736-3af0d1e8fed4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:23.378248 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f00a0107-22d2-40e8-8736-3af0d1e8fed4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1318 microversion: 2.1 time: 0.239423 Oct 24 11:26:23.378838 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3544/7060] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:23 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:24.402136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2223023f-bf06-4c47-ad98-9d5fda70c3c6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:24.403428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2223023f-bf06-4c47-ad98-9d5fda70c3c6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:24.411946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2223023f-bf06-4c47-ad98-9d5fda70c3c6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:24.412150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2223023f-bf06-4c47-ad98-9d5fda70c3c6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:24.412632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2223023f-bf06-4c47-ad98-9d5fda70c3c6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:24.413640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2223023f-bf06-4c47-ad98-9d5fda70c3c6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:24.414476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2223023f-bf06-4c47-ad98-9d5fda70c3c6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:24.414987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2223023f-bf06-4c47-ad98-9d5fda70c3c6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:24.551285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2223023f-bf06-4c47-ad98-9d5fda70c3c6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:24.559382 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2223023f-bf06-4c47-ad98-9d5fda70c3c6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1318 microversion: 2.1 time: 0.161961 Oct 24 11:26:24.559970 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3517/7061] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:24 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:25.067747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-aa51e0f9-aae2-4a8f-a587-7d802512f8ac req-ea5499d4-597b-4206-b103-411b0918f15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e354a81e-92f0-47c2-a0dd-8d947314502d", "name": "network-vif-plugged", "status": "completed", "tag": "b94e6ffd-082e-4d6d-8f14-f963376b8163"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:26:25.079699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-aa51e0f9-aae2-4a8f-a587-7d802512f8ac req-ea5499d4-597b-4206-b103-411b0918f15d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:25.080182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-aa51e0f9-aae2-4a8f-a587-7d802512f8ac req-ea5499d4-597b-4206-b103-411b0918f15d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:25.080612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-aa51e0f9-aae2-4a8f-a587-7d802512f8ac req-ea5499d4-597b-4206-b103-411b0918f15d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:25.091683 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-aa51e0f9-aae2-4a8f-a587-7d802512f8ac req-ea5499d4-597b-4206-b103-411b0918f15d service nova] Creating event network-vif-plugged:b94e6ffd-082e-4d6d-8f14-f963376b8163 for instance e354a81e-92f0-47c2-a0dd-8d947314502d on n-h1-858383-15 Oct 24 11:26:25.096774 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-aa51e0f9-aae2-4a8f-a587-7d802512f8ac req-ea5499d4-597b-4206-b103-411b0918f15d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032811 Oct 24 11:26:25.097412 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3545/7062] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:26:25.582284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eda4aafb-ca2d-4049-885c-41327c38b05d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:25.582829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eda4aafb-ca2d-4049-885c-41327c38b05d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:25.590628 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eda4aafb-ca2d-4049-885c-41327c38b05d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:25.591126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eda4aafb-ca2d-4049-885c-41327c38b05d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:25.591579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eda4aafb-ca2d-4049-885c-41327c38b05d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:25.592283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eda4aafb-ca2d-4049-885c-41327c38b05d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:25.592749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eda4aafb-ca2d-4049-885c-41327c38b05d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:25.593217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eda4aafb-ca2d-4049-885c-41327c38b05d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:25.721448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eda4aafb-ca2d-4049-885c-41327c38b05d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:25.729830 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eda4aafb-ca2d-4049-885c-41327c38b05d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1318 microversion: 2.1 time: 0.151542 Oct 24 11:26:25.730411 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3518/7063] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:25 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:26.754822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b4875b1a-7803-4eda-920e-5fac66e33fe5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:26.755544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b4875b1a-7803-4eda-920e-5fac66e33fe5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:26.762344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4875b1a-7803-4eda-920e-5fac66e33fe5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:26.762829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4875b1a-7803-4eda-920e-5fac66e33fe5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:26.763269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4875b1a-7803-4eda-920e-5fac66e33fe5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:26.763963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4875b1a-7803-4eda-920e-5fac66e33fe5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:26.764419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4875b1a-7803-4eda-920e-5fac66e33fe5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:26.764861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4875b1a-7803-4eda-920e-5fac66e33fe5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:26.899033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b4875b1a-7803-4eda-920e-5fac66e33fe5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:26.907051 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b4875b1a-7803-4eda-920e-5fac66e33fe5 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1507 microversion: 2.1 time: 0.157539 Oct 24 11:26:26.907795 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3546/7064] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:26 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:26.930720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-574c7d7f-9a96-4c77-bf10-3d8f909426fe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:26.931356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-574c7d7f-9a96-4c77-bf10-3d8f909426fe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:26.937880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-574c7d7f-9a96-4c77-bf10-3d8f909426fe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:26.938387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-574c7d7f-9a96-4c77-bf10-3d8f909426fe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:26.938851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-574c7d7f-9a96-4c77-bf10-3d8f909426fe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:26.939609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-574c7d7f-9a96-4c77-bf10-3d8f909426fe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:26.940088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-574c7d7f-9a96-4c77-bf10-3d8f909426fe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:26.940536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-574c7d7f-9a96-4c77-bf10-3d8f909426fe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:27.073551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-574c7d7f-9a96-4c77-bf10-3d8f909426fe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:27.075909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:26:27.082832 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-574c7d7f-9a96-4c77-bf10-3d8f909426fe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1507 microversion: 2.1 time: 0.156942 Oct 24 11:26:27.083444 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3519/7065] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:26 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:27.106097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cfcebdf4-8b48-447f-b104-114e17c3725d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:26:27.108481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cfcebdf4-8b48-447f-b104-114e17c3725d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:27.114487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfcebdf4-8b48-447f-b104-114e17c3725d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:27.114977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfcebdf4-8b48-447f-b104-114e17c3725d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:27.115422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfcebdf4-8b48-447f-b104-114e17c3725d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:27.116120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfcebdf4-8b48-447f-b104-114e17c3725d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:27.116607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfcebdf4-8b48-447f-b104-114e17c3725d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:27.117083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cfcebdf4-8b48-447f-b104-114e17c3725d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:27.145346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cfcebdf4-8b48-447f-b104-114e17c3725d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:27.151841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cfcebdf4-8b48-447f-b104-114e17c3725d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Old instance type m1.heat2, new instance type m1.heat {{(pid=120426) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 24 11:26:27.158609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-cfcebdf4-8b48-447f-b104-114e17c3725d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:26:27.159038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-cfcebdf4-8b48-447f-b104-114e17c3725d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:26:27.159541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-cfcebdf4-8b48-447f-b104-114e17c3725d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:26:27.159960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-cfcebdf4-8b48-447f-b104-114e17c3725d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:26:27.160383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-cfcebdf4-8b48-447f-b104-114e17c3725d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:26:27.189983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:26:27.211668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:26:27.228115 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cfcebdf4-8b48-447f-b104-114e17c3725d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "POST /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d/action" status: 202 len: 0 microversion: 2.1 time: 0.125939 Oct 24 11:26:27.229052 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3547/7066] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:26:27 2022] POST /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:26:27.237810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6c4a9fc6-a712-4551-b816-ae571a2d6b7c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:27.238516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6c4a9fc6-a712-4551-b816-ae571a2d6b7c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:27.245697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c4a9fc6-a712-4551-b816-ae571a2d6b7c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:27.246202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c4a9fc6-a712-4551-b816-ae571a2d6b7c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:27.246656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c4a9fc6-a712-4551-b816-ae571a2d6b7c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:27.247362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c4a9fc6-a712-4551-b816-ae571a2d6b7c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:27.247825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c4a9fc6-a712-4551-b816-ae571a2d6b7c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:27.248262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6c4a9fc6-a712-4551-b816-ae571a2d6b7c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:27.334767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:26:27.389832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6c4a9fc6-a712-4551-b816-ae571a2d6b7c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:27.397805 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6c4a9fc6-a712-4551-b816-ae571a2d6b7c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1514 microversion: 2.1 time: 0.164463 Oct 24 11:26:27.398560 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3520/7067] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:27 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:28.422530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cd63ce19-b8aa-4b5f-a5df-9cee8289b4a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:28.423141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cd63ce19-b8aa-4b5f-a5df-9cee8289b4a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:28.429543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd63ce19-b8aa-4b5f-a5df-9cee8289b4a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:28.430012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd63ce19-b8aa-4b5f-a5df-9cee8289b4a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:28.430443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd63ce19-b8aa-4b5f-a5df-9cee8289b4a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:28.431379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd63ce19-b8aa-4b5f-a5df-9cee8289b4a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:28.431835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd63ce19-b8aa-4b5f-a5df-9cee8289b4a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:28.432259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cd63ce19-b8aa-4b5f-a5df-9cee8289b4a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:28.573956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cd63ce19-b8aa-4b5f-a5df-9cee8289b4a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:28.581987 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cd63ce19-b8aa-4b5f-a5df-9cee8289b4a9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1514 microversion: 2.1 time: 0.164173 Oct 24 11:26:28.582793 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3548/7068] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:28 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:26:29.606248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a13da601-1f51-4cde-b8f4-9b99c2dccb21 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:29.606876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a13da601-1f51-4cde-b8f4-9b99c2dccb21 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:29.613815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a13da601-1f51-4cde-b8f4-9b99c2dccb21 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:29.614319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a13da601-1f51-4cde-b8f4-9b99c2dccb21 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:29.614774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a13da601-1f51-4cde-b8f4-9b99c2dccb21 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:29.615482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a13da601-1f51-4cde-b8f4-9b99c2dccb21 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:29.615955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a13da601-1f51-4cde-b8f4-9b99c2dccb21 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:29.616398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a13da601-1f51-4cde-b8f4-9b99c2dccb21 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:29.746826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a13da601-1f51-4cde-b8f4-9b99c2dccb21 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:29.754620 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a13da601-1f51-4cde-b8f4-9b99c2dccb21 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.152274 Oct 24 11:26:29.755197 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3521/7069] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:29 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:30.778297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-987dab45-9e82-4a65-92a2-1377977c38c1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:30.778911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-987dab45-9e82-4a65-92a2-1377977c38c1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:30.785771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-987dab45-9e82-4a65-92a2-1377977c38c1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:30.786251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-987dab45-9e82-4a65-92a2-1377977c38c1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:30.786691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-987dab45-9e82-4a65-92a2-1377977c38c1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:30.787384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-987dab45-9e82-4a65-92a2-1377977c38c1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:30.787865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-987dab45-9e82-4a65-92a2-1377977c38c1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:30.788293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-987dab45-9e82-4a65-92a2-1377977c38c1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:30.918257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-987dab45-9e82-4a65-92a2-1377977c38c1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:30.926020 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-987dab45-9e82-4a65-92a2-1377977c38c1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.151860 Oct 24 11:26:30.926598 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3549/7070] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:30 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:31.950960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-19e02e64-6b91-4728-947c-3db8d6e833fb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:31.952027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-19e02e64-6b91-4728-947c-3db8d6e833fb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:31.960137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19e02e64-6b91-4728-947c-3db8d6e833fb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:31.961365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19e02e64-6b91-4728-947c-3db8d6e833fb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:31.961995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19e02e64-6b91-4728-947c-3db8d6e833fb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:31.962706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19e02e64-6b91-4728-947c-3db8d6e833fb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:31.963170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19e02e64-6b91-4728-947c-3db8d6e833fb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:31.963611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-19e02e64-6b91-4728-947c-3db8d6e833fb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:32.097722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-19e02e64-6b91-4728-947c-3db8d6e833fb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:32.105925 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-19e02e64-6b91-4728-947c-3db8d6e833fb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.159657 Oct 24 11:26:32.106877 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3522/7071] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:31 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:26:33.129207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1bb7ddce-64cf-411d-a6f9-7bd52d0ccbd1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:33.129822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1bb7ddce-64cf-411d-a6f9-7bd52d0ccbd1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:33.137400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1bb7ddce-64cf-411d-a6f9-7bd52d0ccbd1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:33.137878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1bb7ddce-64cf-411d-a6f9-7bd52d0ccbd1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:33.138310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1bb7ddce-64cf-411d-a6f9-7bd52d0ccbd1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:33.138993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1bb7ddce-64cf-411d-a6f9-7bd52d0ccbd1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:33.139442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1bb7ddce-64cf-411d-a6f9-7bd52d0ccbd1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:33.139872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1bb7ddce-64cf-411d-a6f9-7bd52d0ccbd1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:33.269233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1bb7ddce-64cf-411d-a6f9-7bd52d0ccbd1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:33.277773 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1bb7ddce-64cf-411d-a6f9-7bd52d0ccbd1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.152503 Oct 24 11:26:33.278346 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3550/7072] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:33 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:34.300737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-74ec3bb7-43f2-4e37-a9da-309bf40fcd22 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:34.301388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-74ec3bb7-43f2-4e37-a9da-309bf40fcd22 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:34.308316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74ec3bb7-43f2-4e37-a9da-309bf40fcd22 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:34.308806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74ec3bb7-43f2-4e37-a9da-309bf40fcd22 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:34.309282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74ec3bb7-43f2-4e37-a9da-309bf40fcd22 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:34.309979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74ec3bb7-43f2-4e37-a9da-309bf40fcd22 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:34.310444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74ec3bb7-43f2-4e37-a9da-309bf40fcd22 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:34.310880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74ec3bb7-43f2-4e37-a9da-309bf40fcd22 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:34.442671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-74ec3bb7-43f2-4e37-a9da-309bf40fcd22 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:34.451008 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-74ec3bb7-43f2-4e37-a9da-309bf40fcd22 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.154171 Oct 24 11:26:34.451572 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3523/7073] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:34 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:35.473717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-eb84801b-de30-4f40-9a22-2a317a8819ac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:35.474329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-eb84801b-de30-4f40-9a22-2a317a8819ac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:35.482299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb84801b-de30-4f40-9a22-2a317a8819ac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:35.482777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb84801b-de30-4f40-9a22-2a317a8819ac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:35.483205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb84801b-de30-4f40-9a22-2a317a8819ac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:35.483892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb84801b-de30-4f40-9a22-2a317a8819ac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:35.484366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb84801b-de30-4f40-9a22-2a317a8819ac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:35.484786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-eb84801b-de30-4f40-9a22-2a317a8819ac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:35.614020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-eb84801b-de30-4f40-9a22-2a317a8819ac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:35.616185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:26:35.623480 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-eb84801b-de30-4f40-9a22-2a317a8819ac tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.153584 Oct 24 11:26:35.624052 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3551/7074] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:35 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:36.646726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a684c0e9-a50b-4c2d-9065-288d85afdf3a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:36.647352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a684c0e9-a50b-4c2d-9065-288d85afdf3a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:36.655367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a684c0e9-a50b-4c2d-9065-288d85afdf3a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:36.655859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a684c0e9-a50b-4c2d-9065-288d85afdf3a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:36.656306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a684c0e9-a50b-4c2d-9065-288d85afdf3a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:36.657041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a684c0e9-a50b-4c2d-9065-288d85afdf3a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:36.657506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a684c0e9-a50b-4c2d-9065-288d85afdf3a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:36.657941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a684c0e9-a50b-4c2d-9065-288d85afdf3a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:36.793839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a684c0e9-a50b-4c2d-9065-288d85afdf3a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:36.801476 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a684c0e9-a50b-4c2d-9065-288d85afdf3a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.158604 Oct 24 11:26:36.802041 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3524/7075] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:36 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:37.825956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-30bca51d-1333-4012-9a62-e4b1d6b1b4c2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:37.826638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-30bca51d-1333-4012-9a62-e4b1d6b1b4c2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:37.836064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30bca51d-1333-4012-9a62-e4b1d6b1b4c2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:37.836545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30bca51d-1333-4012-9a62-e4b1d6b1b4c2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:37.837010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30bca51d-1333-4012-9a62-e4b1d6b1b4c2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:37.837730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30bca51d-1333-4012-9a62-e4b1d6b1b4c2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:37.838177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30bca51d-1333-4012-9a62-e4b1d6b1b4c2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:37.838597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-30bca51d-1333-4012-9a62-e4b1d6b1b4c2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:37.972863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-30bca51d-1333-4012-9a62-e4b1d6b1b4c2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:37.981553 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-30bca51d-1333-4012-9a62-e4b1d6b1b4c2 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.159456 Oct 24 11:26:37.982135 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3552/7076] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:37 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:39.005161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6ae60509-4203-4228-9375-92acd772c48d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:39.005772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6ae60509-4203-4228-9375-92acd772c48d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:39.013197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae60509-4203-4228-9375-92acd772c48d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:39.013685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae60509-4203-4228-9375-92acd772c48d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:39.014131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae60509-4203-4228-9375-92acd772c48d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:39.014832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae60509-4203-4228-9375-92acd772c48d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:39.015296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae60509-4203-4228-9375-92acd772c48d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:39.015735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ae60509-4203-4228-9375-92acd772c48d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:39.146992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ae60509-4203-4228-9375-92acd772c48d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:39.155785 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6ae60509-4203-4228-9375-92acd772c48d tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.154665 Oct 24 11:26:39.156373 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3525/7077] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:38 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:40.179371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e7f83fad-209a-4e31-85fd-f268513dbfae tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:40.180133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e7f83fad-209a-4e31-85fd-f268513dbfae tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:40.188260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7f83fad-209a-4e31-85fd-f268513dbfae tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:40.189131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7f83fad-209a-4e31-85fd-f268513dbfae tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:40.189845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7f83fad-209a-4e31-85fd-f268513dbfae tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:40.191091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7f83fad-209a-4e31-85fd-f268513dbfae tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:40.193939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7f83fad-209a-4e31-85fd-f268513dbfae tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:40.194083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e7f83fad-209a-4e31-85fd-f268513dbfae tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:40.344675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e7f83fad-209a-4e31-85fd-f268513dbfae tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:40.357023 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e7f83fad-209a-4e31-85fd-f268513dbfae tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.181502 Oct 24 11:26:40.357655 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3553/7078] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:40 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:41.382448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2a205adf-1217-42b2-8f22-79e9459d6132 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:41.383236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2a205adf-1217-42b2-8f22-79e9459d6132 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:41.390100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a205adf-1217-42b2-8f22-79e9459d6132 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:41.390596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a205adf-1217-42b2-8f22-79e9459d6132 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:41.391041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a205adf-1217-42b2-8f22-79e9459d6132 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:41.391739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a205adf-1217-42b2-8f22-79e9459d6132 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:41.392203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a205adf-1217-42b2-8f22-79e9459d6132 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:41.392640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a205adf-1217-42b2-8f22-79e9459d6132 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:41.523693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2a205adf-1217-42b2-8f22-79e9459d6132 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:41.531707 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2a205adf-1217-42b2-8f22-79e9459d6132 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.153766 Oct 24 11:26:41.532275 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3526/7079] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:41 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:42.554727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-35cd2480-caa2-4060-a22b-8da5a0250880 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:42.555343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-35cd2480-caa2-4060-a22b-8da5a0250880 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:42.558011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:26:42.563793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35cd2480-caa2-4060-a22b-8da5a0250880 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:42.564562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35cd2480-caa2-4060-a22b-8da5a0250880 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:42.565149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35cd2480-caa2-4060-a22b-8da5a0250880 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:42.565962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35cd2480-caa2-4060-a22b-8da5a0250880 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:42.566498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35cd2480-caa2-4060-a22b-8da5a0250880 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:42.566925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35cd2480-caa2-4060-a22b-8da5a0250880 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:42.699497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-35cd2480-caa2-4060-a22b-8da5a0250880 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:42.707139 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-35cd2480-caa2-4060-a22b-8da5a0250880 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.156588 Oct 24 11:26:42.707707 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3554/7080] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:42 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:43.731284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d0b2c0d6-f328-4a87-8e12-1e343e5a21a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:43.731907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d0b2c0d6-f328-4a87-8e12-1e343e5a21a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:43.734587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:26:43.740181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0b2c0d6-f328-4a87-8e12-1e343e5a21a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:43.740677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0b2c0d6-f328-4a87-8e12-1e343e5a21a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:43.741145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0b2c0d6-f328-4a87-8e12-1e343e5a21a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:43.742575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0b2c0d6-f328-4a87-8e12-1e343e5a21a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:43.743048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0b2c0d6-f328-4a87-8e12-1e343e5a21a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:43.743491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d0b2c0d6-f328-4a87-8e12-1e343e5a21a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:43.872625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d0b2c0d6-f328-4a87-8e12-1e343e5a21a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:43.880365 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d0b2c0d6-f328-4a87-8e12-1e343e5a21a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.152990 Oct 24 11:26:43.880957 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3527/7081] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:43 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:44.903910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b4ff0030-2939-43b8-b4c3-a25ae8018422 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:44.904526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b4ff0030-2939-43b8-b4c3-a25ae8018422 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:44.911355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ff0030-2939-43b8-b4c3-a25ae8018422 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:44.911836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ff0030-2939-43b8-b4c3-a25ae8018422 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:44.912280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ff0030-2939-43b8-b4c3-a25ae8018422 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:44.913004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ff0030-2939-43b8-b4c3-a25ae8018422 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:44.913977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ff0030-2939-43b8-b4c3-a25ae8018422 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:44.914410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b4ff0030-2939-43b8-b4c3-a25ae8018422 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:45.041470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b4ff0030-2939-43b8-b4c3-a25ae8018422 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:45.049221 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b4ff0030-2939-43b8-b4c3-a25ae8018422 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.149539 Oct 24 11:26:45.049799 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3555/7082] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:44 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:46.073270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-89e60073-7d6d-4019-8664-d73a0fca71ef tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:46.073802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-89e60073-7d6d-4019-8664-d73a0fca71ef tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:46.076041 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:26:46.076193 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:26:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d (ip 10.222.0.50) !!! Oct 24 11:26:46.083086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89e60073-7d6d-4019-8664-d73a0fca71ef tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:46.083620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89e60073-7d6d-4019-8664-d73a0fca71ef tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:46.084077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89e60073-7d6d-4019-8664-d73a0fca71ef tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:46.084794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89e60073-7d6d-4019-8664-d73a0fca71ef tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:46.085367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89e60073-7d6d-4019-8664-d73a0fca71ef tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:46.085810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89e60073-7d6d-4019-8664-d73a0fca71ef tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:46.220529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-89e60073-7d6d-4019-8664-d73a0fca71ef tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:46.228659 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-89e60073-7d6d-4019-8664-d73a0fca71ef tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.160260 Oct 24 11:26:46.229271 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3528/7083] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:46 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:47.251720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2fe8365b-9f1a-41d7-a463-df9eaadd5953 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:47.252360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2fe8365b-9f1a-41d7-a463-df9eaadd5953 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:47.254963 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:26:47.255097 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:26:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d (ip 10.222.0.50) !!! Oct 24 11:26:47.263515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fe8365b-9f1a-41d7-a463-df9eaadd5953 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:47.263994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fe8365b-9f1a-41d7-a463-df9eaadd5953 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:47.264429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fe8365b-9f1a-41d7-a463-df9eaadd5953 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:47.265149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fe8365b-9f1a-41d7-a463-df9eaadd5953 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:47.265601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fe8365b-9f1a-41d7-a463-df9eaadd5953 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:47.266021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fe8365b-9f1a-41d7-a463-df9eaadd5953 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:47.397140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2fe8365b-9f1a-41d7-a463-df9eaadd5953 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:47.405554 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2fe8365b-9f1a-41d7-a463-df9eaadd5953 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.157948 Oct 24 11:26:47.406131 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3556/7084] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:47 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:48.428529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2d5e59ec-717a-41a0-8e7e-52334890ed25 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:48.430111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2d5e59ec-717a-41a0-8e7e-52334890ed25 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:48.436948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d5e59ec-717a-41a0-8e7e-52334890ed25 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:48.437447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d5e59ec-717a-41a0-8e7e-52334890ed25 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:48.437899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d5e59ec-717a-41a0-8e7e-52334890ed25 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:48.438599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d5e59ec-717a-41a0-8e7e-52334890ed25 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:48.439066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d5e59ec-717a-41a0-8e7e-52334890ed25 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:48.439505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2d5e59ec-717a-41a0-8e7e-52334890ed25 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:48.572915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2d5e59ec-717a-41a0-8e7e-52334890ed25 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:48.580719 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2d5e59ec-717a-41a0-8e7e-52334890ed25 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.156088 Oct 24 11:26:48.581321 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3529/7085] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:48 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:49.605993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-268191aa-3b93-45d6-a627-0a04f752feeb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:49.606639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-268191aa-3b93-45d6-a627-0a04f752feeb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:49.613707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-268191aa-3b93-45d6-a627-0a04f752feeb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:49.614184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-268191aa-3b93-45d6-a627-0a04f752feeb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:49.614616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-268191aa-3b93-45d6-a627-0a04f752feeb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:49.615301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-268191aa-3b93-45d6-a627-0a04f752feeb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:49.615748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-268191aa-3b93-45d6-a627-0a04f752feeb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:49.616798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-268191aa-3b93-45d6-a627-0a04f752feeb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:49.745860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-268191aa-3b93-45d6-a627-0a04f752feeb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:49.753450 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-268191aa-3b93-45d6-a627-0a04f752feeb tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.151378 Oct 24 11:26:49.754028 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3557/7086] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:49 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:50.776735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80f0dcb8-946b-4c68-97f4-70e3ccad3fa1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:50.777400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-80f0dcb8-946b-4c68-97f4-70e3ccad3fa1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:50.784304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80f0dcb8-946b-4c68-97f4-70e3ccad3fa1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:50.784807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80f0dcb8-946b-4c68-97f4-70e3ccad3fa1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:50.785304 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80f0dcb8-946b-4c68-97f4-70e3ccad3fa1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:50.786017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80f0dcb8-946b-4c68-97f4-70e3ccad3fa1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:50.786491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80f0dcb8-946b-4c68-97f4-70e3ccad3fa1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:50.786941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80f0dcb8-946b-4c68-97f4-70e3ccad3fa1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:50.922244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-80f0dcb8-946b-4c68-97f4-70e3ccad3fa1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:50.930976 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-80f0dcb8-946b-4c68-97f4-70e3ccad3fa1 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.158556 Oct 24 11:26:50.931556 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3530/7087] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:50 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:51.954255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ab53bba2-a51d-4083-9818-479b98cc1e0b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:51.954881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ab53bba2-a51d-4083-9818-479b98cc1e0b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:51.963034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab53bba2-a51d-4083-9818-479b98cc1e0b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:51.963521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab53bba2-a51d-4083-9818-479b98cc1e0b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:51.963965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab53bba2-a51d-4083-9818-479b98cc1e0b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:51.964663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab53bba2-a51d-4083-9818-479b98cc1e0b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:51.965157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab53bba2-a51d-4083-9818-479b98cc1e0b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:51.965589 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab53bba2-a51d-4083-9818-479b98cc1e0b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:52.098508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ab53bba2-a51d-4083-9818-479b98cc1e0b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:52.106248 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ab53bba2-a51d-4083-9818-479b98cc1e0b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.155945 Oct 24 11:26:52.106823 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3558/7088] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:51 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:53.129865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-add112d4-9e93-49dd-8eb2-5d0559b79c57 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:53.130519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-add112d4-9e93-49dd-8eb2-5d0559b79c57 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:53.138225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-add112d4-9e93-49dd-8eb2-5d0559b79c57 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:53.138715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-add112d4-9e93-49dd-8eb2-5d0559b79c57 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:53.139158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-add112d4-9e93-49dd-8eb2-5d0559b79c57 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:53.139856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-add112d4-9e93-49dd-8eb2-5d0559b79c57 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:53.140317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-add112d4-9e93-49dd-8eb2-5d0559b79c57 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:53.140752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-add112d4-9e93-49dd-8eb2-5d0559b79c57 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:53.269599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-add112d4-9e93-49dd-8eb2-5d0559b79c57 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:53.277813 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-add112d4-9e93-49dd-8eb2-5d0559b79c57 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.151803 Oct 24 11:26:53.278384 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3531/7089] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:53 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:54.301946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f0adaa61-90c1-48b5-9918-9523fc81f54c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:54.302516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f0adaa61-90c1-48b5-9918-9523fc81f54c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:54.310045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0adaa61-90c1-48b5-9918-9523fc81f54c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:54.310530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0adaa61-90c1-48b5-9918-9523fc81f54c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:54.310967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0adaa61-90c1-48b5-9918-9523fc81f54c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:54.311670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0adaa61-90c1-48b5-9918-9523fc81f54c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:54.312121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0adaa61-90c1-48b5-9918-9523fc81f54c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:54.312548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0adaa61-90c1-48b5-9918-9523fc81f54c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:54.451256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f0adaa61-90c1-48b5-9918-9523fc81f54c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:54.459041 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f0adaa61-90c1-48b5-9918-9523fc81f54c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.161089 Oct 24 11:26:54.459618 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3559/7090] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:54 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:55.482160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a73fe4e0-4196-4ce6-b22c-b929e7c169f0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:55.482800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a73fe4e0-4196-4ce6-b22c-b929e7c169f0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:55.489829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a73fe4e0-4196-4ce6-b22c-b929e7c169f0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:55.490332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a73fe4e0-4196-4ce6-b22c-b929e7c169f0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:55.490788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a73fe4e0-4196-4ce6-b22c-b929e7c169f0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:55.491732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a73fe4e0-4196-4ce6-b22c-b929e7c169f0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:55.492211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a73fe4e0-4196-4ce6-b22c-b929e7c169f0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:55.492660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a73fe4e0-4196-4ce6-b22c-b929e7c169f0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:55.621242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a73fe4e0-4196-4ce6-b22c-b929e7c169f0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:55.628944 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a73fe4e0-4196-4ce6-b22c-b929e7c169f0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1519 microversion: 2.1 time: 0.150653 Oct 24 11:26:55.629525 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3532/7091] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:55 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:56.591268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-7e3c30e8-c82c-4e37-8438-701cc045b677 req-d4df78af-8ba6-44fd-a59d-13907c3dae34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e354a81e-92f0-47c2-a0dd-8d947314502d", "name": "network-vif-unplugged", "status": "completed", "tag": "b94e6ffd-082e-4d6d-8f14-f963376b8163"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:26:56.602365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7e3c30e8-c82c-4e37-8438-701cc045b677 req-d4df78af-8ba6-44fd-a59d-13907c3dae34 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:56.602851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7e3c30e8-c82c-4e37-8438-701cc045b677 req-d4df78af-8ba6-44fd-a59d-13907c3dae34 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:56.603306 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-7e3c30e8-c82c-4e37-8438-701cc045b677 req-d4df78af-8ba6-44fd-a59d-13907c3dae34 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:56.615670 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-7e3c30e8-c82c-4e37-8438-701cc045b677 req-d4df78af-8ba6-44fd-a59d-13907c3dae34 service nova] Creating event network-vif-unplugged:b94e6ffd-082e-4d6d-8f14-f963376b8163 for instance e354a81e-92f0-47c2-a0dd-8d947314502d on n-h2-858383-15 Oct 24 11:26:56.621275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [req-7e3c30e8-c82c-4e37-8438-701cc045b677 req-d4df78af-8ba6-44fd-a59d-13907c3dae34 service nova] Instance e354a81e-92f0-47c2-a0dd-8d947314502d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120426) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:26:56.632530 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-7e3c30e8-c82c-4e37-8438-701cc045b677 req-d4df78af-8ba6-44fd-a59d-13907c3dae34 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045210 Oct 24 11:26:56.633186 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3560/7092] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:26:56.653826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-079f69c8-ed79-400e-914f-566fcbd296a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:56.654466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-079f69c8-ed79-400e-914f-566fcbd296a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:56.661423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-079f69c8-ed79-400e-914f-566fcbd296a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:56.661939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-079f69c8-ed79-400e-914f-566fcbd296a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:56.662402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-079f69c8-ed79-400e-914f-566fcbd296a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:56.663884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-079f69c8-ed79-400e-914f-566fcbd296a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:56.664370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-079f69c8-ed79-400e-914f-566fcbd296a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:56.664817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-079f69c8-ed79-400e-914f-566fcbd296a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:56.807379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-079f69c8-ed79-400e-914f-566fcbd296a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:56.815261 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-079f69c8-ed79-400e-914f-566fcbd296a4 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1518 microversion: 2.1 time: 0.165623 Oct 24 11:26:56.828854 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3533/7093] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:56 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:26:57.841887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5bd8c384-191c-4711-8f92-8f76a3703ad3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:57.842630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5bd8c384-191c-4711-8f92-8f76a3703ad3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:57.848849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bd8c384-191c-4711-8f92-8f76a3703ad3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:57.849347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bd8c384-191c-4711-8f92-8f76a3703ad3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:57.849785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bd8c384-191c-4711-8f92-8f76a3703ad3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:57.850567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bd8c384-191c-4711-8f92-8f76a3703ad3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:57.851356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bd8c384-191c-4711-8f92-8f76a3703ad3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:57.851788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bd8c384-191c-4711-8f92-8f76a3703ad3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:57.982904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5bd8c384-191c-4711-8f92-8f76a3703ad3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:57.990807 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5bd8c384-191c-4711-8f92-8f76a3703ad3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1516 microversion: 2.1 time: 0.154156 Oct 24 11:26:57.991418 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3561/7094] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:57 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:26:58.660456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-379a15c5-0b10-4e98-9e05-7470839e010a req-bb5f833a-a279-447d-8517-7dfc976c8c81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e354a81e-92f0-47c2-a0dd-8d947314502d", "tag": "b94e6ffd-082e-4d6d-8f14-f963376b8163"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:26:58.671192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-379a15c5-0b10-4e98-9e05-7470839e010a req-bb5f833a-a279-447d-8517-7dfc976c8c81 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:58.671677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-379a15c5-0b10-4e98-9e05-7470839e010a req-bb5f833a-a279-447d-8517-7dfc976c8c81 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:58.672117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-379a15c5-0b10-4e98-9e05-7470839e010a req-bb5f833a-a279-447d-8517-7dfc976c8c81 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:58.674627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=86 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:26:58.685435 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-379a15c5-0b10-4e98-9e05-7470839e010a req-bb5f833a-a279-447d-8517-7dfc976c8c81 service nova] Creating event network-changed:b94e6ffd-082e-4d6d-8f14-f963376b8163 for instance e354a81e-92f0-47c2-a0dd-8d947314502d on n-h2-858383-15 Oct 24 11:26:58.690676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-379a15c5-0b10-4e98-9e05-7470839e010a req-bb5f833a-a279-447d-8517-7dfc976c8c81 service nova] Instance e354a81e-92f0-47c2-a0dd-8d947314502d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:26:58.701774 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-379a15c5-0b10-4e98-9e05-7470839e010a req-bb5f833a-a279-447d-8517-7dfc976c8c81 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044927 Oct 24 11:26:58.702369 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3534/7095] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:26:59.028413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-98c3064f-db4f-4b81-92b3-0bc73ea5e1e8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:26:59.029059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-98c3064f-db4f-4b81-92b3-0bc73ea5e1e8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:26:59.036329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98c3064f-db4f-4b81-92b3-0bc73ea5e1e8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:59.037153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98c3064f-db4f-4b81-92b3-0bc73ea5e1e8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:59.037840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98c3064f-db4f-4b81-92b3-0bc73ea5e1e8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:59.039701 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98c3064f-db4f-4b81-92b3-0bc73ea5e1e8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:26:59.040258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98c3064f-db4f-4b81-92b3-0bc73ea5e1e8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:26:59.040940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-98c3064f-db4f-4b81-92b3-0bc73ea5e1e8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:26:59.247064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-98c3064f-db4f-4b81-92b3-0bc73ea5e1e8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:26:59.254716 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-98c3064f-db4f-4b81-92b3-0bc73ea5e1e8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1516 microversion: 2.1 time: 0.243567 Oct 24 11:26:59.255536 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3562/7096] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:26:59 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1516 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:27:00.279897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c548c8e6-52d3-4a2a-bb4b-7344b1ef1619 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:00.280632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c548c8e6-52d3-4a2a-bb4b-7344b1ef1619 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:00.286894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c548c8e6-52d3-4a2a-bb4b-7344b1ef1619 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:00.287400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c548c8e6-52d3-4a2a-bb4b-7344b1ef1619 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:00.288386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c548c8e6-52d3-4a2a-bb4b-7344b1ef1619 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:00.289292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c548c8e6-52d3-4a2a-bb4b-7344b1ef1619 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:00.289773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c548c8e6-52d3-4a2a-bb4b-7344b1ef1619 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:00.290220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c548c8e6-52d3-4a2a-bb4b-7344b1ef1619 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:00.423760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c548c8e6-52d3-4a2a-bb4b-7344b1ef1619 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:00.432250 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c548c8e6-52d3-4a2a-bb4b-7344b1ef1619 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1513 microversion: 2.1 time: 0.157882 Oct 24 11:27:00.432821 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3535/7097] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:00 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:27:00.456015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9a3eefd4-a47e-4808-8dbf-01221ca0891a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:27:00.456548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9a3eefd4-a47e-4808-8dbf-01221ca0891a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:00.463774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a3eefd4-a47e-4808-8dbf-01221ca0891a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:00.464251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a3eefd4-a47e-4808-8dbf-01221ca0891a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:00.464682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a3eefd4-a47e-4808-8dbf-01221ca0891a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:00.465394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a3eefd4-a47e-4808-8dbf-01221ca0891a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:00.465844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a3eefd4-a47e-4808-8dbf-01221ca0891a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:00.466265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9a3eefd4-a47e-4808-8dbf-01221ca0891a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:00.523835 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9a3eefd4-a47e-4808-8dbf-01221ca0891a tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "POST /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d/action" status: 204 len: 0 microversion: 2.1 time: 0.071446 Oct 24 11:27:00.524391 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3563/7098] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:27:00 2022] POST /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:27:00.533051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-44be88d0-dfd0-4379-8415-4994511bb368 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:00.533696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-44be88d0-dfd0-4379-8415-4994511bb368 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:00.540028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44be88d0-dfd0-4379-8415-4994511bb368 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:00.540635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44be88d0-dfd0-4379-8415-4994511bb368 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:00.541143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44be88d0-dfd0-4379-8415-4994511bb368 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:00.541911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44be88d0-dfd0-4379-8415-4994511bb368 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:00.542433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44be88d0-dfd0-4379-8415-4994511bb368 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:00.542886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44be88d0-dfd0-4379-8415-4994511bb368 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:00.754000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-44be88d0-dfd0-4379-8415-4994511bb368 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:00.762460 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-44be88d0-dfd0-4379-8415-4994511bb368 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1513 microversion: 2.1 time: 0.233379 Oct 24 11:27:00.763041 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3536/7099] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:00 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1513 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:27:01.788600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aaec46bd-627a-45b6-b618-ac0dd691aac9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:01.789722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aaec46bd-627a-45b6-b618-ac0dd691aac9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:01.796300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aaec46bd-627a-45b6-b618-ac0dd691aac9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:01.796911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aaec46bd-627a-45b6-b618-ac0dd691aac9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:01.797536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aaec46bd-627a-45b6-b618-ac0dd691aac9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:01.798459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aaec46bd-627a-45b6-b618-ac0dd691aac9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:01.799116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aaec46bd-627a-45b6-b618-ac0dd691aac9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:01.799674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aaec46bd-627a-45b6-b618-ac0dd691aac9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:01.892392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ac005fdb-eb6b-4178-9719-dc07b0ca2923 req-717ba746-3074-4054-b6f5-6d48abfde560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e354a81e-92f0-47c2-a0dd-8d947314502d", "name": "network-vif-plugged", "status": "completed", "tag": "b94e6ffd-082e-4d6d-8f14-f963376b8163"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:27:01.904621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ac005fdb-eb6b-4178-9719-dc07b0ca2923 req-717ba746-3074-4054-b6f5-6d48abfde560 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:01.905325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ac005fdb-eb6b-4178-9719-dc07b0ca2923 req-717ba746-3074-4054-b6f5-6d48abfde560 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:01.906722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ac005fdb-eb6b-4178-9719-dc07b0ca2923 req-717ba746-3074-4054-b6f5-6d48abfde560 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:01.920249 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ac005fdb-eb6b-4178-9719-dc07b0ca2923 req-717ba746-3074-4054-b6f5-6d48abfde560 service nova] Creating event network-vif-plugged:b94e6ffd-082e-4d6d-8f14-f963376b8163 for instance e354a81e-92f0-47c2-a0dd-8d947314502d on n-h2-858383-15 Oct 24 11:27:01.926251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-ac005fdb-eb6b-4178-9719-dc07b0ca2923 req-717ba746-3074-4054-b6f5-6d48abfde560 service nova] Instance e354a81e-92f0-47c2-a0dd-8d947314502d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:27:01.939837 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ac005fdb-eb6b-4178-9719-dc07b0ca2923 req-717ba746-3074-4054-b6f5-6d48abfde560 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051201 Oct 24 11:27:01.940573 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3537/7100] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:27:02.010078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aaec46bd-627a-45b6-b618-ac0dd691aac9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:02.017931 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aaec46bd-627a-45b6-b618-ac0dd691aac9 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1513 microversion: 2.1 time: 0.235304 Oct 24 11:27:02.018504 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3564/7101] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:01 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:27:03.043092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-47352567-6da1-4753-97c2-e0aa2988a168 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:03.043820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-47352567-6da1-4753-97c2-e0aa2988a168 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:03.050126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47352567-6da1-4753-97c2-e0aa2988a168 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:03.050631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47352567-6da1-4753-97c2-e0aa2988a168 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:03.051089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47352567-6da1-4753-97c2-e0aa2988a168 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:03.051804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47352567-6da1-4753-97c2-e0aa2988a168 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:03.052309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47352567-6da1-4753-97c2-e0aa2988a168 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:03.052763 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47352567-6da1-4753-97c2-e0aa2988a168 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:03.182562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-47352567-6da1-4753-97c2-e0aa2988a168 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:03.190370 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-47352567-6da1-4753-97c2-e0aa2988a168 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1505 microversion: 2.1 time: 0.152340 Oct 24 11:27:03.190955 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3538/7102] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:03 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:27:03.213903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8c17fa8f-202e-4309-a476-6df2e42caef3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:03.214518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8c17fa8f-202e-4309-a476-6df2e42caef3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:03.221287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c17fa8f-202e-4309-a476-6df2e42caef3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:03.221762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c17fa8f-202e-4309-a476-6df2e42caef3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:03.222191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c17fa8f-202e-4309-a476-6df2e42caef3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:03.222877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c17fa8f-202e-4309-a476-6df2e42caef3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:03.223325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c17fa8f-202e-4309-a476-6df2e42caef3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:03.223747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8c17fa8f-202e-4309-a476-6df2e42caef3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:03.357634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8c17fa8f-202e-4309-a476-6df2e42caef3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:03.365179 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8c17fa8f-202e-4309-a476-6df2e42caef3 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1505 microversion: 2.1 time: 0.155960 Oct 24 11:27:03.365753 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3565/7103] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:03 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:27:03.387048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-40117852-2207-4dee-8487-035e8d3c90d0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:03.387684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-40117852-2207-4dee-8487-035e8d3c90d0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:03.393749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40117852-2207-4dee-8487-035e8d3c90d0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:03.394249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40117852-2207-4dee-8487-035e8d3c90d0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:03.394707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40117852-2207-4dee-8487-035e8d3c90d0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:03.395417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40117852-2207-4dee-8487-035e8d3c90d0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:03.395894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40117852-2207-4dee-8487-035e8d3c90d0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:03.396340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40117852-2207-4dee-8487-035e8d3c90d0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:03.532184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-40117852-2207-4dee-8487-035e8d3c90d0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:03.541050 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-40117852-2207-4dee-8487-035e8d3c90d0 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1505 microversion: 2.1 time: 0.157831 Oct 24 11:27:03.541632 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3539/7104] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:03 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:27:03.563771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f464f3d7-d249-4104-b476-08333750649b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:03.564231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f464f3d7-d249-4104-b476-08333750649b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:03.570253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f464f3d7-d249-4104-b476-08333750649b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:03.570739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f464f3d7-d249-4104-b476-08333750649b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:03.571205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f464f3d7-d249-4104-b476-08333750649b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:03.571906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f464f3d7-d249-4104-b476-08333750649b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:03.572362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f464f3d7-d249-4104-b476-08333750649b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:03.572793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f464f3d7-d249-4104-b476-08333750649b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:03.601092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f464f3d7-d249-4104-b476-08333750649b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:27:03.627260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:27:03.675625 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f464f3d7-d249-4104-b476-08333750649b tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 204 len: 0 microversion: 2.1 time: 0.115530 Oct 24 11:27:03.676446 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3566/7105] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:27:03 2022] DELETE /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:27:03.691467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00bebc10-b181-4800-9a6b-1aed65c4bf84 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:03.691978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00bebc10-b181-4800-9a6b-1aed65c4bf84 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:03.698654 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00bebc10-b181-4800-9a6b-1aed65c4bf84 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:03.699153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00bebc10-b181-4800-9a6b-1aed65c4bf84 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:03.699604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00bebc10-b181-4800-9a6b-1aed65c4bf84 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:03.700307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00bebc10-b181-4800-9a6b-1aed65c4bf84 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:03.700775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00bebc10-b181-4800-9a6b-1aed65c4bf84 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:03.701246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00bebc10-b181-4800-9a6b-1aed65c4bf84 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:03.728385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00bebc10-b181-4800-9a6b-1aed65c4bf84 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:27:03.773175 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.compute.api [None req-00bebc10-b181-4800-9a6b-1aed65c4bf84 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Instance is already in deleting state, ignoring this request Oct 24 11:27:03.774018 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-00bebc10-b181-4800-9a6b-1aed65c4bf84 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 204 len: 0 microversion: 2.1 time: 0.086591 Oct 24 11:27:03.774592 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3540/7106] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:27:03 2022] DELETE /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:27:03.783361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a7c7aa4d-ccff-4be1-947c-bf6b4e658ea8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:03.784060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a7c7aa4d-ccff-4be1-947c-bf6b4e658ea8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:03.790301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7c7aa4d-ccff-4be1-947c-bf6b4e658ea8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:03.790780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7c7aa4d-ccff-4be1-947c-bf6b4e658ea8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:03.791255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7c7aa4d-ccff-4be1-947c-bf6b4e658ea8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:03.791939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7c7aa4d-ccff-4be1-947c-bf6b4e658ea8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:03.792386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7c7aa4d-ccff-4be1-947c-bf6b4e658ea8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:03.792808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7c7aa4d-ccff-4be1-947c-bf6b4e658ea8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:03.920913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a7c7aa4d-ccff-4be1-947c-bf6b4e658ea8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:03.928554 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a7c7aa4d-ccff-4be1-947c-bf6b4e658ea8 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1511 microversion: 2.1 time: 0.149335 Oct 24 11:27:03.929145 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3567/7107] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:03 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:27:04.951394 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf6ae7de-e61b-4f03-aaab-43c2d5c18d05 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:04.952014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf6ae7de-e61b-4f03-aaab-43c2d5c18d05 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:04.959117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf6ae7de-e61b-4f03-aaab-43c2d5c18d05 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:04.959801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf6ae7de-e61b-4f03-aaab-43c2d5c18d05 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:04.960585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf6ae7de-e61b-4f03-aaab-43c2d5c18d05 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:04.961379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf6ae7de-e61b-4f03-aaab-43c2d5c18d05 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:04.961858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf6ae7de-e61b-4f03-aaab-43c2d5c18d05 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:04.962302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf6ae7de-e61b-4f03-aaab-43c2d5c18d05 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:05.096718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cf6ae7de-e61b-4f03-aaab-43c2d5c18d05 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:05.105715 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf6ae7de-e61b-4f03-aaab-43c2d5c18d05 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1511 microversion: 2.1 time: 0.158277 Oct 24 11:27:05.106311 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3541/7108] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:04 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:27:05.627728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-2eb703d3-6232-4e4a-b372-c3804a591827 req-9ec8c73c-642d-4595-b03e-54f5ce0b09fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e354a81e-92f0-47c2-a0dd-8d947314502d", "name": "network-vif-deleted", "tag": "b94e6ffd-082e-4d6d-8f14-f963376b8163"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:27:05.643184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2eb703d3-6232-4e4a-b372-c3804a591827 req-9ec8c73c-642d-4595-b03e-54f5ce0b09fc service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:05.643787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2eb703d3-6232-4e4a-b372-c3804a591827 req-9ec8c73c-642d-4595-b03e-54f5ce0b09fc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:05.644300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2eb703d3-6232-4e4a-b372-c3804a591827 req-9ec8c73c-642d-4595-b03e-54f5ce0b09fc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:05.665072 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-2eb703d3-6232-4e4a-b372-c3804a591827 req-9ec8c73c-642d-4595-b03e-54f5ce0b09fc service nova] Creating event network-vif-deleted:b94e6ffd-082e-4d6d-8f14-f963376b8163 for instance e354a81e-92f0-47c2-a0dd-8d947314502d on n-h2-858383-15 Oct 24 11:27:05.670548 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-2eb703d3-6232-4e4a-b372-c3804a591827 req-9ec8c73c-642d-4595-b03e-54f5ce0b09fc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047281 Oct 24 11:27:05.671171 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3568/7109] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:27:06.129864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-68ae05b6-f3e0-48b5-9391-39c38ea24bfe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:06.130722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-68ae05b6-f3e0-48b5-9391-39c38ea24bfe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:06.137506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68ae05b6-f3e0-48b5-9391-39c38ea24bfe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:06.138017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68ae05b6-f3e0-48b5-9391-39c38ea24bfe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:06.138477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68ae05b6-f3e0-48b5-9391-39c38ea24bfe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:06.139362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68ae05b6-f3e0-48b5-9391-39c38ea24bfe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:06.139845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68ae05b6-f3e0-48b5-9391-39c38ea24bfe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:06.140300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68ae05b6-f3e0-48b5-9391-39c38ea24bfe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:06.174699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68ae05b6-f3e0-48b5-9391-39c38ea24bfe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:06.175398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68ae05b6-f3e0-48b5-9391-39c38ea24bfe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:06.175774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-68ae05b6-f3e0-48b5-9391-39c38ea24bfe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:06.176245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-68ae05b6-f3e0-48b5-9391-39c38ea24bfe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lazy-loading 'fault' on Instance uuid e354a81e-92f0-47c2-a0dd-8d947314502d {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:27:06.221345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-68ae05b6-f3e0-48b5-9391-39c38ea24bfe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264263b947ca4a7ea1beb528460a52f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39796f68d9c64213963dbf4cffcb8590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:06.229890 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-68ae05b6-f3e0-48b5-9391-39c38ea24bfe tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 200 len: 1306 microversion: 2.1 time: 0.104165 Oct 24 11:27:06.230790 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3542/7110] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:06 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 1306 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:27:07.254612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cf833f4b-66dc-4335-8368-a23dc80d15e6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:07.255351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cf833f4b-66dc-4335-8368-a23dc80d15e6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: e354a81e-92f0-47c2-a0dd-8d947314502d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:07.262139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf833f4b-66dc-4335-8368-a23dc80d15e6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:07.262624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf833f4b-66dc-4335-8368-a23dc80d15e6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:07.263065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf833f4b-66dc-4335-8368-a23dc80d15e6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:07.263756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf833f4b-66dc-4335-8368-a23dc80d15e6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:07.264213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf833f4b-66dc-4335-8368-a23dc80d15e6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:07.264641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf833f4b-66dc-4335-8368-a23dc80d15e6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:07.278104 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-cf833f4b-66dc-4335-8368-a23dc80d15e6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] HTTP exception thrown: Instance e354a81e-92f0-47c2-a0dd-8d947314502d could not be found. Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cf833f4b-66dc-4335-8368-a23dc80d15e6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Request method failure captured: Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d HTTP/1.1 Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnYmXSbwKCtIhVCj6KoSOVKcWVg5qy1cJbxxCfH84bc6kVKVi7_yX1tbkRSJreSEK1jHqMupxqruomHkXRmSmuSdKT7OfnAIhEYGcnH3UiCK854VQgjwhswYj3pCesItq0VrBRBv9gK-bjDQJi_bHuAlx1KgNEMidgV3cYc5n0jx8Aw Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 39796f68d9c64213963dbf4cffcb8590 Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerDiskConfigTestJSON-772099821 Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/39796f68d9c64213963dbf4cffcb8590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/39796f68d9c64213963dbf4cffcb8590"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/39796f68d9c64213963dbf4cffcb8590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_39796f68d9c64213963dbf4cffcb8590", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerDiskConfigTestJSON-772099821 Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 39796f68d9c64213963dbf4cffcb8590 Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-772099821 Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerDiskConfigTestJSON-772099821-project Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 264263b947ca4a7ea1beb528460a52f2 Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerDiskConfigTestJSON-772099821-project Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance e354a81e-92f0-47c2-a0dd-8d947314502d could not be found. Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'e354a81e-92f0-47c2-a0dd-8d947314502d'} Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e354a81e-92f0-47c2-a0dd-8d947314502d could not be found. Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e354a81e-92f0-47c2-a0dd-8d947314502d could not be found. Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:27:07.279739 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:27:07.284402 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:27:07.284402 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:27:07.284402 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:27:07.284402 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:27:07.284402 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:27:07.284402 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e354a81e-92f0-47c2-a0dd-8d947314502d could not be found. Oct 24 11:27:07.284402 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:27:07.284402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cf833f4b-66dc-4335-8368-a23dc80d15e6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Returning 404 to user: Instance e354a81e-92f0-47c2-a0dd-8d947314502d could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:27:07.284402 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cf833f4b-66dc-4335-8368-a23dc80d15e6 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d" status: 404 len: 111 microversion: 2.1 time: 0.031639 Oct 24 11:27:07.284402 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3569/7111] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:07 2022] GET /compute/v2.1/servers/e354a81e-92f0-47c2-a0dd-8d947314502d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:27:07.289942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7805aeea-1d6e-4340-a080-e1c6b7b5a74e tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '.version_select at 0x7f04cb9155e0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:07.310316 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7805aeea-1d6e-4340-a080-e1c6b7b5a74e tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1785265154" status: 202 len: 0 microversion: 2.1 time: 0.024177 Oct 24 11:27:07.310892 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3543/7112] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Oct 24 11:27:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1785265154 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:27:07.930691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-53a7fd69-34b8-4da8-abd1-1c67f5f4375c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:07.931321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-53a7fd69-34b8-4da8-abd1-1c67f5f4375c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:07.937398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53a7fd69-34b8-4da8-abd1-1c67f5f4375c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:07.937883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53a7fd69-34b8-4da8-abd1-1c67f5f4375c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:07.938323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53a7fd69-34b8-4da8-abd1-1c67f5f4375c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:07.939017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53a7fd69-34b8-4da8-abd1-1c67f5f4375c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:07.939501 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53a7fd69-34b8-4da8-abd1-1c67f5f4375c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:07.939929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53a7fd69-34b8-4da8-abd1-1c67f5f4375c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:07.953440 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-53a7fd69-34b8-4da8-abd1-1c67f5f4375c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] HTTP exception thrown: Instance 83b12d91-c528-4616-b031-b1f037180074 could not be found. Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-53a7fd69-34b8-4da8-abd1-1c67f5f4375c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Request method failure captured: Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 HTTP/1.1 Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnYmXSbwKCtIhVCj6KoSOVKcWVg5qy1cJbxxCfH84bc6kVKVi7_yX1tbkRSJreSEK1jHqMupxqruomHkXRmSmuSdKT7OfnAIhEYGcnH3UiCK854VQgjwhswYj3pCesItq0VrBRBv9gK-bjDQJi_bHuAlx1KgNEMidgV3cYc5n0jx8Aw Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 39796f68d9c64213963dbf4cffcb8590 Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerDiskConfigTestJSON-772099821 Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/39796f68d9c64213963dbf4cffcb8590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/39796f68d9c64213963dbf4cffcb8590"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/39796f68d9c64213963dbf4cffcb8590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_39796f68d9c64213963dbf4cffcb8590", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerDiskConfigTestJSON-772099821 Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 39796f68d9c64213963dbf4cffcb8590 Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-772099821 Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerDiskConfigTestJSON-772099821-project Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 264263b947ca4a7ea1beb528460a52f2 Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerDiskConfigTestJSON-772099821-project Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 83b12d91-c528-4616-b031-b1f037180074 could not be found. Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '83b12d91-c528-4616-b031-b1f037180074'} Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83b12d91-c528-4616-b031-b1f037180074 could not be found. Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:27:07.954962 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:27:07.960415 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83b12d91-c528-4616-b031-b1f037180074 could not be found. Oct 24 11:27:07.960415 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:27:07.960415 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:27:07.960415 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:27:07.960415 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:27:07.960415 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:27:07.960415 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:27:07.960415 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:27:07.960415 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:27:07.960415 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83b12d91-c528-4616-b031-b1f037180074 could not be found. Oct 24 11:27:07.960415 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:27:07.960415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-53a7fd69-34b8-4da8-abd1-1c67f5f4375c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Returning 404 to user: Instance 83b12d91-c528-4616-b031-b1f037180074 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:27:07.960415 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-53a7fd69-34b8-4da8-abd1-1c67f5f4375c tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "DELETE /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 404 len: 111 microversion: 2.1 time: 0.029662 Oct 24 11:27:07.960415 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3570/7113] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:27:07 2022] DELETE /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 11:27:07.965737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-230e5c59-2c23-49f1-a2b4-52d1c798ac68 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:07.966508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-230e5c59-2c23-49f1-a2b4-52d1c798ac68 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] [instance: 83b12d91-c528-4616-b031-b1f037180074] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:07.973241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-230e5c59-2c23-49f1-a2b4-52d1c798ac68 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:07.973741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-230e5c59-2c23-49f1-a2b4-52d1c798ac68 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:07.974200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-230e5c59-2c23-49f1-a2b4-52d1c798ac68 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:07.974909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-230e5c59-2c23-49f1-a2b4-52d1c798ac68 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:07.976004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-230e5c59-2c23-49f1-a2b4-52d1c798ac68 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:07.976455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-230e5c59-2c23-49f1-a2b4-52d1c798ac68 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:07.992158 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-230e5c59-2c23-49f1-a2b4-52d1c798ac68 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] HTTP exception thrown: Instance 83b12d91-c528-4616-b031-b1f037180074 could not be found. Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-230e5c59-2c23-49f1-a2b4-52d1c798ac68 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Request method failure captured: Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 HTTP/1.1 Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnYmXSbwKCtIhVCj6KoSOVKcWVg5qy1cJbxxCfH84bc6kVKVi7_yX1tbkRSJreSEK1jHqMupxqruomHkXRmSmuSdKT7OfnAIhEYGcnH3UiCK854VQgjwhswYj3pCesItq0VrBRBv9gK-bjDQJi_bHuAlx1KgNEMidgV3cYc5n0jx8Aw Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 39796f68d9c64213963dbf4cffcb8590 Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerDiskConfigTestJSON-772099821 Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/39796f68d9c64213963dbf4cffcb8590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/39796f68d9c64213963dbf4cffcb8590"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/39796f68d9c64213963dbf4cffcb8590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_39796f68d9c64213963dbf4cffcb8590", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerDiskConfigTestJSON-772099821 Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 39796f68d9c64213963dbf4cffcb8590 Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-772099821 Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerDiskConfigTestJSON-772099821-project Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 264263b947ca4a7ea1beb528460a52f2 Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerDiskConfigTestJSON-772099821-project Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 83b12d91-c528-4616-b031-b1f037180074 could not be found. Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '83b12d91-c528-4616-b031-b1f037180074'} Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83b12d91-c528-4616-b031-b1f037180074 could not be found. Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83b12d91-c528-4616-b031-b1f037180074 could not be found. Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:27:07.993860 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:27:07.998098 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:27:07.998098 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:27:07.998098 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:27:07.998098 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:27:07.998098 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:27:07.998098 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83b12d91-c528-4616-b031-b1f037180074 could not be found. Oct 24 11:27:07.998098 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:27:07.998098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-230e5c59-2c23-49f1-a2b4-52d1c798ac68 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] Returning 404 to user: Instance 83b12d91-c528-4616-b031-b1f037180074 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:27:08.001107 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-230e5c59-2c23-49f1-a2b4-52d1c798ac68 tempest-ServerDiskConfigTestJSON-772099821 tempest-ServerDiskConfigTestJSON-772099821-project] 10.222.0.50 "GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074" status: 404 len: 111 microversion: 2.1 time: 0.039120 Oct 24 11:27:08.001651 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3544/7114] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:07 2022] GET /compute/v2.1/servers/83b12d91-c528-4616-b031-b1f037180074 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:27:16.681035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-28a6d3b3-769f-4b29-bc38-de8da9f1f8a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Action: 'create', calling method: .version_select at 0x7f04d06a2940>, body: {"keypair": {"name": "tempest-keypair-1192870934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOQTETRUOd5WpOAtO7uitreRS6X3BoT4rl2Kv6Bqkif5m0AN4UhG2ReW9p3IOXMChoWo+xxEdlm023qTlsYze1f/zv3udu/DFQ78Jb575hx73H6jv9kxuwZREW6VPr4rw=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:27:16.686710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:27:16.700065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-28a6d3b3-769f-4b29-bc38-de8da9f1f8a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Getting quotas for project 4c0ac700abd24e4ea516532577c09aa5. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:27:16.705723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-28a6d3b3-769f-4b29-bc38-de8da9f1f8a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Getting quotas for user 879b06d644fa496c94f9226f23d79716 and project 4c0ac700abd24e4ea516532577c09aa5. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:27:16.738275 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-28a6d3b3-769f-4b29-bc38-de8da9f1f8a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179882 Oct 24 11:27:16.738896 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3571/7115] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:27:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:27:18.031474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-74417a76-2e87-43e3-8d3a-7383ab59c9c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-702412264", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8220ee77-95f2-48de-8da4-516f3afce857"}], "security_groups": [{"name": "tempest-securitygroup--485148156"}], "key_name": "tempest-keypair-1192870934", "user_data": "}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:27:18.040671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:27:18.041387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:27:18.147664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-74417a76-2e87-43e3-8d3a-7383ab59c9c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] validate_networks() for [('8220ee77-95f2-48de-8da4-516f3afce857', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:27:18.570451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-74417a76-2e87-43e3-8d3a-7383ab59c9c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:27:18.570903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-74417a76-2e87-43e3-8d3a-7383ab59c9c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:27:18.571426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-74417a76-2e87-43e3-8d3a-7383ab59c9c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:27:18.571858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-74417a76-2e87-43e3-8d3a-7383ab59c9c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:27:18.572292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-74417a76-2e87-43e3-8d3a-7383ab59c9c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:27:18.581536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74417a76-2e87-43e3-8d3a-7383ab59c9c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:18.582040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74417a76-2e87-43e3-8d3a-7383ab59c9c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:18.582511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74417a76-2e87-43e3-8d3a-7383ab59c9c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:18.583258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74417a76-2e87-43e3-8d3a-7383ab59c9c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:18.583738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74417a76-2e87-43e3-8d3a-7383ab59c9c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:18.584186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-74417a76-2e87-43e3-8d3a-7383ab59c9c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:18.601513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-74417a76-2e87-43e3-8d3a-7383ab59c9c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Getting quotas for project 4c0ac700abd24e4ea516532577c09aa5. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:27:18.606993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-74417a76-2e87-43e3-8d3a-7383ab59c9c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Getting quotas for user 879b06d644fa496c94f9226f23d79716 and project 4c0ac700abd24e4ea516532577c09aa5. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:27:18.620561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-74417a76-2e87-43e3-8d3a-7383ab59c9c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:27:18.622960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-74417a76-2e87-43e3-8d3a-7383ab59c9c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:27:18.674751 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-74417a76-2e87-43e3-8d3a-7383ab59c9c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.647717 Oct 24 11:27:18.682142 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3545/7116] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:27:18 2022] POST /compute/v2.1/servers => generated 408 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:27:18.688378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-048e31eb-2d94-4b3c-b3be-0d6d2d190eff tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:18.689095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-048e31eb-2d94-4b3c-b3be-0d6d2d190eff tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:18.693046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=16,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:27:18.755195 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-048e31eb-2d94-4b3c-b3be-0d6d2d190eff tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:18.763989 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-048e31eb-2d94-4b3c-b3be-0d6d2d190eff tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1238 microversion: 2.1 time: 0.080656 Oct 24 11:27:18.764791 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3572/7117] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:18 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:27:19.789596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cae95543-23d7-4dad-bfb1-f94f2112fd82 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:19.790225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cae95543-23d7-4dad-bfb1-f94f2112fd82 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:19.797409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cae95543-23d7-4dad-bfb1-f94f2112fd82 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:19.797916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cae95543-23d7-4dad-bfb1-f94f2112fd82 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:19.798401 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cae95543-23d7-4dad-bfb1-f94f2112fd82 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:19.799302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cae95543-23d7-4dad-bfb1-f94f2112fd82 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:19.799781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cae95543-23d7-4dad-bfb1-f94f2112fd82 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:19.800230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cae95543-23d7-4dad-bfb1-f94f2112fd82 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:19.871162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cae95543-23d7-4dad-bfb1-f94f2112fd82 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:19.879809 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cae95543-23d7-4dad-bfb1-f94f2112fd82 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1290 microversion: 2.1 time: 0.095573 Oct 24 11:27:19.880502 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3546/7118] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:19 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1290 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:27:20.904103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d27359c6-714a-48c2-9eae-4ca89330c77a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:20.904748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d27359c6-714a-48c2-9eae-4ca89330c77a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:20.913364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d27359c6-714a-48c2-9eae-4ca89330c77a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:20.914311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d27359c6-714a-48c2-9eae-4ca89330c77a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:20.914907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d27359c6-714a-48c2-9eae-4ca89330c77a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:20.915819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d27359c6-714a-48c2-9eae-4ca89330c77a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:20.916291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d27359c6-714a-48c2-9eae-4ca89330c77a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:20.916725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d27359c6-714a-48c2-9eae-4ca89330c77a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:21.137604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d27359c6-714a-48c2-9eae-4ca89330c77a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:21.145415 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d27359c6-714a-48c2-9eae-4ca89330c77a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1363 microversion: 2.1 time: 0.245532 Oct 24 11:27:21.145989 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3573/7119] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:20 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:27:21.483265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-860044a5-075d-451c-9f9d-6cff2bbeec8a req-6a84663b-6828-4510-a9b6-5edf2a17076e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1fd1f08-804b-4c97-a19d-211933a7e701", "tag": "f32201b5-f0f3-4a0c-a162-35ae69b61f8d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:27:21.495147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-860044a5-075d-451c-9f9d-6cff2bbeec8a req-6a84663b-6828-4510-a9b6-5edf2a17076e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:21.495738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-860044a5-075d-451c-9f9d-6cff2bbeec8a req-6a84663b-6828-4510-a9b6-5edf2a17076e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:21.496255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-860044a5-075d-451c-9f9d-6cff2bbeec8a req-6a84663b-6828-4510-a9b6-5edf2a17076e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:21.508601 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-860044a5-075d-451c-9f9d-6cff2bbeec8a req-6a84663b-6828-4510-a9b6-5edf2a17076e service nova] Creating event network-changed:f32201b5-f0f3-4a0c-a162-35ae69b61f8d for instance c1fd1f08-804b-4c97-a19d-211933a7e701 on n-h1-858383-15 Oct 24 11:27:21.513719 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-860044a5-075d-451c-9f9d-6cff2bbeec8a req-6a84663b-6828-4510-a9b6-5edf2a17076e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034341 Oct 24 11:27:21.514329 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3547/7120] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:27:22.169277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7d7f959c-fc5a-4041-a0aa-e765ee03e631 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:22.169903 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7d7f959c-fc5a-4041-a0aa-e765ee03e631 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:22.177522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d7f959c-fc5a-4041-a0aa-e765ee03e631 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:22.178009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d7f959c-fc5a-4041-a0aa-e765ee03e631 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:22.179220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d7f959c-fc5a-4041-a0aa-e765ee03e631 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:22.179967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d7f959c-fc5a-4041-a0aa-e765ee03e631 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:22.180426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d7f959c-fc5a-4041-a0aa-e765ee03e631 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:22.180896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d7f959c-fc5a-4041-a0aa-e765ee03e631 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:22.320571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7d7f959c-fc5a-4041-a0aa-e765ee03e631 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:22.328441 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7d7f959c-fc5a-4041-a0aa-e765ee03e631 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1363 microversion: 2.1 time: 0.163039 Oct 24 11:27:22.333003 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3574/7121] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:22 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:27:23.352443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2b47d15d-076d-4a5b-b1ed-49a983cb289f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:23.353190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2b47d15d-076d-4a5b-b1ed-49a983cb289f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:23.359382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b47d15d-076d-4a5b-b1ed-49a983cb289f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:23.359874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b47d15d-076d-4a5b-b1ed-49a983cb289f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:23.360326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b47d15d-076d-4a5b-b1ed-49a983cb289f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:23.361069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b47d15d-076d-4a5b-b1ed-49a983cb289f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:23.361539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b47d15d-076d-4a5b-b1ed-49a983cb289f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:23.361977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2b47d15d-076d-4a5b-b1ed-49a983cb289f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:23.494023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2b47d15d-076d-4a5b-b1ed-49a983cb289f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:23.501799 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2b47d15d-076d-4a5b-b1ed-49a983cb289f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1363 microversion: 2.1 time: 0.154584 Oct 24 11:27:23.502371 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3548/7122] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:23 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:27:24.525498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-25f257f3-f952-4429-a32e-a31d60a83af6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:24.527043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-25f257f3-f952-4429-a32e-a31d60a83af6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:24.534182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25f257f3-f952-4429-a32e-a31d60a83af6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:24.534668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25f257f3-f952-4429-a32e-a31d60a83af6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:24.535135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25f257f3-f952-4429-a32e-a31d60a83af6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:24.535995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25f257f3-f952-4429-a32e-a31d60a83af6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:24.536762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25f257f3-f952-4429-a32e-a31d60a83af6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:24.537210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-25f257f3-f952-4429-a32e-a31d60a83af6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:24.675246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-25f257f3-f952-4429-a32e-a31d60a83af6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:24.683705 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-25f257f3-f952-4429-a32e-a31d60a83af6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1363 microversion: 2.1 time: 0.162264 Oct 24 11:27:24.684295 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3575/7123] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:24 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:27:25.706618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6ad73c7b-2e10-4c54-85a5-955b47c5ea92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:25.707245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6ad73c7b-2e10-4c54-85a5-955b47c5ea92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:25.714852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ad73c7b-2e10-4c54-85a5-955b47c5ea92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:25.715352 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ad73c7b-2e10-4c54-85a5-955b47c5ea92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:25.715810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ad73c7b-2e10-4c54-85a5-955b47c5ea92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:25.716521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ad73c7b-2e10-4c54-85a5-955b47c5ea92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:25.717030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ad73c7b-2e10-4c54-85a5-955b47c5ea92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:25.717478 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ad73c7b-2e10-4c54-85a5-955b47c5ea92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:25.849095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ad73c7b-2e10-4c54-85a5-955b47c5ea92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:25.857042 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6ad73c7b-2e10-4c54-85a5-955b47c5ea92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1363 microversion: 2.1 time: 0.154242 Oct 24 11:27:25.857622 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3549/7124] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:25 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:27:26.879850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c6ac3990-d120-4b66-836a-7a32784409c5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:26.880398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c6ac3990-d120-4b66-836a-7a32784409c5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:26.887606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6ac3990-d120-4b66-836a-7a32784409c5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:26.888081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6ac3990-d120-4b66-836a-7a32784409c5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:26.888778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6ac3990-d120-4b66-836a-7a32784409c5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:26.889494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6ac3990-d120-4b66-836a-7a32784409c5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:26.889943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6ac3990-d120-4b66-836a-7a32784409c5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:26.890366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c6ac3990-d120-4b66-836a-7a32784409c5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:27.020640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c6ac3990-d120-4b66-836a-7a32784409c5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:27.029520 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c6ac3990-d120-4b66-836a-7a32784409c5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1363 microversion: 2.1 time: 0.153773 Oct 24 11:27:27.030105 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3576/7125] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:26 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:27:27.421648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b246c58b-e06e-4d79-a7e7-264cc5d4f261 req-282bb841-d3d7-4c14-8749-5e59bdf7c453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1fd1f08-804b-4c97-a19d-211933a7e701", "name": "network-vif-plugged", "status": "completed", "tag": "f32201b5-f0f3-4a0c-a162-35ae69b61f8d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:27:27.433321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b246c58b-e06e-4d79-a7e7-264cc5d4f261 req-282bb841-d3d7-4c14-8749-5e59bdf7c453 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:27.433826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b246c58b-e06e-4d79-a7e7-264cc5d4f261 req-282bb841-d3d7-4c14-8749-5e59bdf7c453 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:27.434281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b246c58b-e06e-4d79-a7e7-264cc5d4f261 req-282bb841-d3d7-4c14-8749-5e59bdf7c453 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:27.447466 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b246c58b-e06e-4d79-a7e7-264cc5d4f261 req-282bb841-d3d7-4c14-8749-5e59bdf7c453 service nova] Creating event network-vif-plugged:f32201b5-f0f3-4a0c-a162-35ae69b61f8d for instance c1fd1f08-804b-4c97-a19d-211933a7e701 on n-h1-858383-15 Oct 24 11:27:27.452447 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b246c58b-e06e-4d79-a7e7-264cc5d4f261 req-282bb841-d3d7-4c14-8749-5e59bdf7c453 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034503 Oct 24 11:27:27.453108 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3550/7126] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:27:28.053843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7ffcd508-19fb-4625-9a82-231994fb0159 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:28.054475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7ffcd508-19fb-4625-9a82-231994fb0159 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:28.061375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ffcd508-19fb-4625-9a82-231994fb0159 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:28.061864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ffcd508-19fb-4625-9a82-231994fb0159 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:28.062304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ffcd508-19fb-4625-9a82-231994fb0159 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:28.063007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ffcd508-19fb-4625-9a82-231994fb0159 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:28.063466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ffcd508-19fb-4625-9a82-231994fb0159 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:28.063899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ffcd508-19fb-4625-9a82-231994fb0159 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:28.196989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7ffcd508-19fb-4625-9a82-231994fb0159 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:28.204740 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7ffcd508-19fb-4625-9a82-231994fb0159 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1363 microversion: 2.1 time: 0.155516 Oct 24 11:27:28.205405 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3577/7127] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:28 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:27:29.227376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:27:29.228166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:27:29.232209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6026d71d-2ed0-42f7-ac2d-3a9254048e83 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:29.232964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6026d71d-2ed0-42f7-ac2d-3a9254048e83 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:29.240069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6026d71d-2ed0-42f7-ac2d-3a9254048e83 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:29.241373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6026d71d-2ed0-42f7-ac2d-3a9254048e83 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:29.242097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6026d71d-2ed0-42f7-ac2d-3a9254048e83 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:29.242809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6026d71d-2ed0-42f7-ac2d-3a9254048e83 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:29.243286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6026d71d-2ed0-42f7-ac2d-3a9254048e83 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:29.243732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6026d71d-2ed0-42f7-ac2d-3a9254048e83 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:29.372947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6026d71d-2ed0-42f7-ac2d-3a9254048e83 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:27:29.380703 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6026d71d-2ed0-42f7-ac2d-3a9254048e83 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1549 microversion: 2.1 time: 0.155911 Oct 24 11:27:29.381313 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3551/7128] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:27:29 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:27:29.403393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-94f242b3-2a69-4888-80b0-5c5729810891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:27:29.403910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-94f242b3-2a69-4888-80b0-5c5729810891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:27:29.405772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:27:29.411957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94f242b3-2a69-4888-80b0-5c5729810891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:29.412977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94f242b3-2a69-4888-80b0-5c5729810891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:29.413443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94f242b3-2a69-4888-80b0-5c5729810891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:29.414205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94f242b3-2a69-4888-80b0-5c5729810891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:29.414664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94f242b3-2a69-4888-80b0-5c5729810891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:29.415095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94f242b3-2a69-4888-80b0-5c5729810891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:29.492616 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-94f242b3-2a69-4888-80b0-5c5729810891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093334 Oct 24 11:27:29.493296 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3578/7129] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 11:27:29 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:27:30.702468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-fa0aaef4-49c6-472c-b421-90ff85089b6d req-fd1a346d-7c49-4ca0-9e37-021494fd06fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1fd1f08-804b-4c97-a19d-211933a7e701", "tag": "f32201b5-f0f3-4a0c-a162-35ae69b61f8d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:27:30.712861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fa0aaef4-49c6-472c-b421-90ff85089b6d req-fd1a346d-7c49-4ca0-9e37-021494fd06fc service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:27:30.713355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fa0aaef4-49c6-472c-b421-90ff85089b6d req-fd1a346d-7c49-4ca0-9e37-021494fd06fc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:27:30.713813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fa0aaef4-49c6-472c-b421-90ff85089b6d req-fd1a346d-7c49-4ca0-9e37-021494fd06fc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:27:30.728400 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-fa0aaef4-49c6-472c-b421-90ff85089b6d req-fd1a346d-7c49-4ca0-9e37-021494fd06fc service nova] Creating event network-changed:f32201b5-f0f3-4a0c-a162-35ae69b61f8d for instance c1fd1f08-804b-4c97-a19d-211933a7e701 on n-h1-858383-15 Oct 24 11:27:30.734026 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-fa0aaef4-49c6-472c-b421-90ff85089b6d req-fd1a346d-7c49-4ca0-9e37-021494fd06fc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035124 Oct 24 11:27:30.734890 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3552/7130] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:28:45.308181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:28:45.309010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=34 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:28:45.310139 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:28:45.310305 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:28:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 (ip 10.222.0.50) !!! Oct 24 11:28:45.319884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e87f36f4-0758-45f7-a6b4-f46552214d9c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:28:45.320493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e87f36f4-0758-45f7-a6b4-f46552214d9c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:28:45.330981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e87f36f4-0758-45f7-a6b4-f46552214d9c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:45.331470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e87f36f4-0758-45f7-a6b4-f46552214d9c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:45.331905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e87f36f4-0758-45f7-a6b4-f46552214d9c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:45.332628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e87f36f4-0758-45f7-a6b4-f46552214d9c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:45.333126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e87f36f4-0758-45f7-a6b4-f46552214d9c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:45.333586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e87f36f4-0758-45f7-a6b4-f46552214d9c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:45.511587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e87f36f4-0758-45f7-a6b4-f46552214d9c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:28:45.519420 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e87f36f4-0758-45f7-a6b4-f46552214d9c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1668 microversion: 2.1 time: 0.214047 Oct 24 11:28:45.520016 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3579/7131] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:28:45 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1668 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:28:45.541434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:28:45.542363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=32 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:28:45.547982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9c469c15-8a1e-46a1-b5f7-0c5e3332979e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:28:45.548693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9c469c15-8a1e-46a1-b5f7-0c5e3332979e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:28:45.556581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c469c15-8a1e-46a1-b5f7-0c5e3332979e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:45.557106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c469c15-8a1e-46a1-b5f7-0c5e3332979e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:45.558212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c469c15-8a1e-46a1-b5f7-0c5e3332979e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:45.558922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c469c15-8a1e-46a1-b5f7-0c5e3332979e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:45.559397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c469c15-8a1e-46a1-b5f7-0c5e3332979e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:45.559849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9c469c15-8a1e-46a1-b5f7-0c5e3332979e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:45.746947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9c469c15-8a1e-46a1-b5f7-0c5e3332979e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:28:45.754747 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9c469c15-8a1e-46a1-b5f7-0c5e3332979e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1668 microversion: 2.1 time: 0.216047 Oct 24 11:28:45.755321 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3553/7132] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:28:45 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1668 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:28:45.778104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1dc53710-98f4-4c18-bcac-4be53f423049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:28:45.778722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1dc53710-98f4-4c18-bcac-4be53f423049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:28:45.784579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dc53710-98f4-4c18-bcac-4be53f423049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:45.785085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dc53710-98f4-4c18-bcac-4be53f423049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:45.785517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dc53710-98f4-4c18-bcac-4be53f423049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:45.786204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dc53710-98f4-4c18-bcac-4be53f423049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:45.786651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dc53710-98f4-4c18-bcac-4be53f423049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:45.787066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1dc53710-98f4-4c18-bcac-4be53f423049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:45.913495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1dc53710-98f4-4c18-bcac-4be53f423049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:28:45.921379 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1dc53710-98f4-4c18-bcac-4be53f423049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1668 microversion: 2.1 time: 0.147729 Oct 24 11:28:45.921949 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3580/7133] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:28:45 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1668 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:28:45.944200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4158be2f-dc8e-42ca-86f4-4287b017b937 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:28:45.946554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4158be2f-dc8e-42ca-86f4-4287b017b937 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:28:45.953227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4158be2f-dc8e-42ca-86f4-4287b017b937 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:45.953725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4158be2f-dc8e-42ca-86f4-4287b017b937 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:45.954176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4158be2f-dc8e-42ca-86f4-4287b017b937 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:45.954867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4158be2f-dc8e-42ca-86f4-4287b017b937 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:45.955336 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4158be2f-dc8e-42ca-86f4-4287b017b937 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:45.955776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4158be2f-dc8e-42ca-86f4-4287b017b937 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:46.029626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4158be2f-dc8e-42ca-86f4-4287b017b937 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:28:46.035080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4158be2f-dc8e-42ca-86f4-4287b017b937 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Old instance type m1.heat2, new instance type m1.heat {{(pid=120425) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 24 11:28:46.041446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4158be2f-dc8e-42ca-86f4-4287b017b937 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:28:46.042491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4158be2f-dc8e-42ca-86f4-4287b017b937 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:28:46.042977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4158be2f-dc8e-42ca-86f4-4287b017b937 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:28:46.043465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4158be2f-dc8e-42ca-86f4-4287b017b937 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:28:46.043821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4158be2f-dc8e-42ca-86f4-4287b017b937 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:28:46.150616 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4158be2f-dc8e-42ca-86f4-4287b017b937 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "POST /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701/action" status: 202 len: 0 microversion: 2.1 time: 0.210347 Oct 24 11:28:46.151646 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3554/7134] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:28:45 2022] POST /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 11:28:46.159619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4d359d44-1fbd-4757-8f39-66576eaf4bbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:28:46.160241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4d359d44-1fbd-4757-8f39-66576eaf4bbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:28:46.166232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d359d44-1fbd-4757-8f39-66576eaf4bbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:46.167276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d359d44-1fbd-4757-8f39-66576eaf4bbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:46.167871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d359d44-1fbd-4757-8f39-66576eaf4bbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:46.168583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d359d44-1fbd-4757-8f39-66576eaf4bbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:46.169073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d359d44-1fbd-4757-8f39-66576eaf4bbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:46.169509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4d359d44-1fbd-4757-8f39-66576eaf4bbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:46.308218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4d359d44-1fbd-4757-8f39-66576eaf4bbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:28:46.316992 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4d359d44-1fbd-4757-8f39-66576eaf4bbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1677 microversion: 2.1 time: 0.161133 Oct 24 11:28:46.317565 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3581/7135] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:28:46 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:28:47.341383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1f1b8152-a0ae-4899-bcf8-35285ad9089d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:28:47.342018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1f1b8152-a0ae-4899-bcf8-35285ad9089d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:28:47.348811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f1b8152-a0ae-4899-bcf8-35285ad9089d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:47.349333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f1b8152-a0ae-4899-bcf8-35285ad9089d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:47.349790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f1b8152-a0ae-4899-bcf8-35285ad9089d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:47.350500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f1b8152-a0ae-4899-bcf8-35285ad9089d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:47.350975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f1b8152-a0ae-4899-bcf8-35285ad9089d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:47.351419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f1b8152-a0ae-4899-bcf8-35285ad9089d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:47.485151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1f1b8152-a0ae-4899-bcf8-35285ad9089d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:28:47.492972 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1f1b8152-a0ae-4899-bcf8-35285ad9089d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1677 microversion: 2.1 time: 0.156639 Oct 24 11:28:47.501031 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3555/7136] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:28:47 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:28:48.517093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6f4e924c-8e7f-4ba9-b8a0-5e4f3fbc9660 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:28:48.517718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6f4e924c-8e7f-4ba9-b8a0-5e4f3fbc9660 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:28:48.524280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f4e924c-8e7f-4ba9-b8a0-5e4f3fbc9660 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:48.524758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f4e924c-8e7f-4ba9-b8a0-5e4f3fbc9660 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:48.525221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f4e924c-8e7f-4ba9-b8a0-5e4f3fbc9660 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:48.525952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f4e924c-8e7f-4ba9-b8a0-5e4f3fbc9660 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:48.526445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f4e924c-8e7f-4ba9-b8a0-5e4f3fbc9660 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:48.526893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6f4e924c-8e7f-4ba9-b8a0-5e4f3fbc9660 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:48.665396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6f4e924c-8e7f-4ba9-b8a0-5e4f3fbc9660 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:28:48.674578 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6f4e924c-8e7f-4ba9-b8a0-5e4f3fbc9660 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1677 microversion: 2.1 time: 0.161406 Oct 24 11:28:48.675424 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3582/7137] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:28:48 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:28:49.698668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6f90fd76-1922-402d-a600-78263c5e156d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:28:49.699305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6f90fd76-1922-402d-a600-78263c5e156d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:28:49.706106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f90fd76-1922-402d-a600-78263c5e156d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:49.706616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f90fd76-1922-402d-a600-78263c5e156d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:49.707075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f90fd76-1922-402d-a600-78263c5e156d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:49.707800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f90fd76-1922-402d-a600-78263c5e156d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:49.708277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f90fd76-1922-402d-a600-78263c5e156d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:49.708724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f90fd76-1922-402d-a600-78263c5e156d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:49.843938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6f90fd76-1922-402d-a600-78263c5e156d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:28:49.851638 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6f90fd76-1922-402d-a600-78263c5e156d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1677 microversion: 2.1 time: 0.157879 Oct 24 11:28:49.852205 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3556/7138] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:28:49 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:28:50.878335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5a3d4ff1-ec5b-488a-af5b-922e0580b7d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:28:50.878970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5a3d4ff1-ec5b-488a-af5b-922e0580b7d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:28:50.886422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a3d4ff1-ec5b-488a-af5b-922e0580b7d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:50.886907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a3d4ff1-ec5b-488a-af5b-922e0580b7d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:50.887415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a3d4ff1-ec5b-488a-af5b-922e0580b7d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:50.888122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a3d4ff1-ec5b-488a-af5b-922e0580b7d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:50.888578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a3d4ff1-ec5b-488a-af5b-922e0580b7d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:50.889051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5a3d4ff1-ec5b-488a-af5b-922e0580b7d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:51.028315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5a3d4ff1-ec5b-488a-af5b-922e0580b7d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:28:51.036201 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5a3d4ff1-ec5b-488a-af5b-922e0580b7d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1677 microversion: 2.1 time: 0.161913 Oct 24 11:28:51.036688 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3583/7139] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:28:50 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:28:52.061400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4cb4e0dc-eb3c-41a8-88bb-72b65b2bfd45 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:28:52.061959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4cb4e0dc-eb3c-41a8-88bb-72b65b2bfd45 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:28:52.069001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cb4e0dc-eb3c-41a8-88bb-72b65b2bfd45 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:52.069508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cb4e0dc-eb3c-41a8-88bb-72b65b2bfd45 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:52.070251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cb4e0dc-eb3c-41a8-88bb-72b65b2bfd45 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:52.071063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cb4e0dc-eb3c-41a8-88bb-72b65b2bfd45 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:52.071594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cb4e0dc-eb3c-41a8-88bb-72b65b2bfd45 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:52.072047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4cb4e0dc-eb3c-41a8-88bb-72b65b2bfd45 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:52.205396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4cb4e0dc-eb3c-41a8-88bb-72b65b2bfd45 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:28:52.213240 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4cb4e0dc-eb3c-41a8-88bb-72b65b2bfd45 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1682 microversion: 2.1 time: 0.156332 Oct 24 11:28:52.214415 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3557/7140] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:28:52 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:28:53.237571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6904051b-9853-44ff-8c64-c32e4194bbbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:28:53.238209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6904051b-9853-44ff-8c64-c32e4194bbbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:28:53.245080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6904051b-9853-44ff-8c64-c32e4194bbbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:53.245558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6904051b-9853-44ff-8c64-c32e4194bbbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:53.245993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6904051b-9853-44ff-8c64-c32e4194bbbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:53.246682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6904051b-9853-44ff-8c64-c32e4194bbbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:53.247132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6904051b-9853-44ff-8c64-c32e4194bbbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:53.247557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6904051b-9853-44ff-8c64-c32e4194bbbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:53.379718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6904051b-9853-44ff-8c64-c32e4194bbbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:28:53.387837 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6904051b-9853-44ff-8c64-c32e4194bbbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1682 microversion: 2.1 time: 0.154176 Oct 24 11:28:53.388413 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3584/7141] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:28:53 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:28:54.412132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-885b2703-fc91-4e4d-bd2e-b947e3183ded tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:28:54.412757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-885b2703-fc91-4e4d-bd2e-b947e3183ded tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:28:54.419721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-885b2703-fc91-4e4d-bd2e-b947e3183ded tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:54.420218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-885b2703-fc91-4e4d-bd2e-b947e3183ded tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:54.420662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-885b2703-fc91-4e4d-bd2e-b947e3183ded tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:54.421388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-885b2703-fc91-4e4d-bd2e-b947e3183ded tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:54.421853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-885b2703-fc91-4e4d-bd2e-b947e3183ded tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:54.422290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-885b2703-fc91-4e4d-bd2e-b947e3183ded tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:54.551801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-885b2703-fc91-4e4d-bd2e-b947e3183ded tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:28:54.562128 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-885b2703-fc91-4e4d-bd2e-b947e3183ded tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1682 microversion: 2.1 time: 0.153386 Oct 24 11:28:54.562921 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3558/7142] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:28:54 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:28:55.586838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-faf5a478-ff8a-4629-95d6-52ec032aa0d9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:28:55.587450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-faf5a478-ff8a-4629-95d6-52ec032aa0d9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:28:55.594822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-faf5a478-ff8a-4629-95d6-52ec032aa0d9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:55.595302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-faf5a478-ff8a-4629-95d6-52ec032aa0d9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:55.595726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-faf5a478-ff8a-4629-95d6-52ec032aa0d9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:55.596415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-faf5a478-ff8a-4629-95d6-52ec032aa0d9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:55.596893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-faf5a478-ff8a-4629-95d6-52ec032aa0d9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:55.597323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-faf5a478-ff8a-4629-95d6-52ec032aa0d9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:55.730628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-faf5a478-ff8a-4629-95d6-52ec032aa0d9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:28:55.738379 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-faf5a478-ff8a-4629-95d6-52ec032aa0d9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1682 microversion: 2.1 time: 0.155401 Oct 24 11:28:55.738944 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3585/7143] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:28:55 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:28:56.762301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2098d899-15c5-4dee-b3f4-33204b39a7f3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:28:56.762934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2098d899-15c5-4dee-b3f4-33204b39a7f3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:28:56.770014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2098d899-15c5-4dee-b3f4-33204b39a7f3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:56.770513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2098d899-15c5-4dee-b3f4-33204b39a7f3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:56.770962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2098d899-15c5-4dee-b3f4-33204b39a7f3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:56.771668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2098d899-15c5-4dee-b3f4-33204b39a7f3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:56.772199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2098d899-15c5-4dee-b3f4-33204b39a7f3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:56.772647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2098d899-15c5-4dee-b3f4-33204b39a7f3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:56.902500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2098d899-15c5-4dee-b3f4-33204b39a7f3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:28:56.910339 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2098d899-15c5-4dee-b3f4-33204b39a7f3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1682 microversion: 2.1 time: 0.152188 Oct 24 11:28:56.910928 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3559/7144] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:28:56 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:28:57.934078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5f736ad5-2371-4174-8d49-c9e90d1f0768 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:28:57.934696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5f736ad5-2371-4174-8d49-c9e90d1f0768 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:28:57.941813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f736ad5-2371-4174-8d49-c9e90d1f0768 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:57.942297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f736ad5-2371-4174-8d49-c9e90d1f0768 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:57.942728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f736ad5-2371-4174-8d49-c9e90d1f0768 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:57.943417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f736ad5-2371-4174-8d49-c9e90d1f0768 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:57.943929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f736ad5-2371-4174-8d49-c9e90d1f0768 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:57.944352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5f736ad5-2371-4174-8d49-c9e90d1f0768 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:58.075956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5f736ad5-2371-4174-8d49-c9e90d1f0768 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:28:58.083674 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5f736ad5-2371-4174-8d49-c9e90d1f0768 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1682 microversion: 2.1 time: 0.153613 Oct 24 11:28:58.084245 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3586/7145] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:28:57 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:28:59.107831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-06c48e66-dee9-4b67-9872-e1659b877af7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:28:59.108470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-06c48e66-dee9-4b67-9872-e1659b877af7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:28:59.120429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06c48e66-dee9-4b67-9872-e1659b877af7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:59.120429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06c48e66-dee9-4b67-9872-e1659b877af7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:59.120429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06c48e66-dee9-4b67-9872-e1659b877af7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:59.120429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06c48e66-dee9-4b67-9872-e1659b877af7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:28:59.120429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06c48e66-dee9-4b67-9872-e1659b877af7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:28:59.120429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-06c48e66-dee9-4b67-9872-e1659b877af7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:28:59.259308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-06c48e66-dee9-4b67-9872-e1659b877af7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:28:59.267842 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-06c48e66-dee9-4b67-9872-e1659b877af7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1682 microversion: 2.1 time: 0.164136 Oct 24 11:28:59.268569 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3560/7146] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:28:59 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:00.292912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0e161e2a-b43f-4a8c-ba99-3514a0e192d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:00.293508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0e161e2a-b43f-4a8c-ba99-3514a0e192d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:00.300117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e161e2a-b43f-4a8c-ba99-3514a0e192d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:00.300597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e161e2a-b43f-4a8c-ba99-3514a0e192d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:00.301068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e161e2a-b43f-4a8c-ba99-3514a0e192d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:00.301755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e161e2a-b43f-4a8c-ba99-3514a0e192d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:00.302203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e161e2a-b43f-4a8c-ba99-3514a0e192d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:00.302623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e161e2a-b43f-4a8c-ba99-3514a0e192d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:00.434777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0e161e2a-b43f-4a8c-ba99-3514a0e192d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:00.443198 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0e161e2a-b43f-4a8c-ba99-3514a0e192d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1682 microversion: 2.1 time: 0.154320 Oct 24 11:29:00.443786 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3587/7147] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:00 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:29:01.468849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43c19c57-b27d-4b16-a98d-db07ce9a5f8a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:01.469480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-43c19c57-b27d-4b16-a98d-db07ce9a5f8a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:01.476569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43c19c57-b27d-4b16-a98d-db07ce9a5f8a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:01.477095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43c19c57-b27d-4b16-a98d-db07ce9a5f8a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:01.477546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43c19c57-b27d-4b16-a98d-db07ce9a5f8a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:01.478248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43c19c57-b27d-4b16-a98d-db07ce9a5f8a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:01.478713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43c19c57-b27d-4b16-a98d-db07ce9a5f8a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:01.479155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43c19c57-b27d-4b16-a98d-db07ce9a5f8a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:01.614317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-43c19c57-b27d-4b16-a98d-db07ce9a5f8a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:01.622374 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-43c19c57-b27d-4b16-a98d-db07ce9a5f8a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1682 microversion: 2.1 time: 0.158003 Oct 24 11:29:01.622968 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3561/7148] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:01 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:02.645973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8cb724db-e897-4a6b-abe1-2bf40e9caac9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:02.646593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8cb724db-e897-4a6b-abe1-2bf40e9caac9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:02.653947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cb724db-e897-4a6b-abe1-2bf40e9caac9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:02.654441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cb724db-e897-4a6b-abe1-2bf40e9caac9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:02.654884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cb724db-e897-4a6b-abe1-2bf40e9caac9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:02.655583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cb724db-e897-4a6b-abe1-2bf40e9caac9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:02.656042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cb724db-e897-4a6b-abe1-2bf40e9caac9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:02.656470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cb724db-e897-4a6b-abe1-2bf40e9caac9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:02.786617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8cb724db-e897-4a6b-abe1-2bf40e9caac9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:02.795085 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8cb724db-e897-4a6b-abe1-2bf40e9caac9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1682 microversion: 2.1 time: 0.152993 Oct 24 11:29:02.795658 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3588/7149] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:02 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:03.817608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d68420c4-8b01-44c5-9368-8e8e59bf83f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:03.818262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d68420c4-8b01-44c5-9368-8e8e59bf83f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:03.825787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d68420c4-8b01-44c5-9368-8e8e59bf83f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:03.826276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d68420c4-8b01-44c5-9368-8e8e59bf83f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:03.826726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d68420c4-8b01-44c5-9368-8e8e59bf83f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:03.827433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d68420c4-8b01-44c5-9368-8e8e59bf83f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:03.827901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d68420c4-8b01-44c5-9368-8e8e59bf83f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:03.828338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d68420c4-8b01-44c5-9368-8e8e59bf83f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:03.962249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d68420c4-8b01-44c5-9368-8e8e59bf83f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:03.970415 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d68420c4-8b01-44c5-9368-8e8e59bf83f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1682 microversion: 2.1 time: 0.156662 Oct 24 11:29:03.971374 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3562/7150] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:03 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:04.994504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9812dc51-b530-4207-b4d9-c528534fdb46 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:04.995124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9812dc51-b530-4207-b4d9-c528534fdb46 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:05.002429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9812dc51-b530-4207-b4d9-c528534fdb46 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:05.002919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9812dc51-b530-4207-b4d9-c528534fdb46 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:05.003356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9812dc51-b530-4207-b4d9-c528534fdb46 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:05.004060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9812dc51-b530-4207-b4d9-c528534fdb46 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:05.004515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9812dc51-b530-4207-b4d9-c528534fdb46 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:05.004976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9812dc51-b530-4207-b4d9-c528534fdb46 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:05.137407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9812dc51-b530-4207-b4d9-c528534fdb46 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:05.145324 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9812dc51-b530-4207-b4d9-c528534fdb46 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1682 microversion: 2.1 time: 0.154736 Oct 24 11:29:05.145915 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3589/7151] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:04 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:06.170795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bcdeec9c-7aee-4342-8eb8-2937a2078bb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:06.171420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bcdeec9c-7aee-4342-8eb8-2937a2078bb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:06.178204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcdeec9c-7aee-4342-8eb8-2937a2078bb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:06.178699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcdeec9c-7aee-4342-8eb8-2937a2078bb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:06.179145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcdeec9c-7aee-4342-8eb8-2937a2078bb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:06.179874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcdeec9c-7aee-4342-8eb8-2937a2078bb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:06.180344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcdeec9c-7aee-4342-8eb8-2937a2078bb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:06.180781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcdeec9c-7aee-4342-8eb8-2937a2078bb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:06.309948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bcdeec9c-7aee-4342-8eb8-2937a2078bb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:06.317687 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bcdeec9c-7aee-4342-8eb8-2937a2078bb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1682 microversion: 2.1 time: 0.151477 Oct 24 11:29:06.318260 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3563/7152] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:06 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:07.341987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-999d0fcb-2d63-412e-b1b5-8657dd6484c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:07.342599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-999d0fcb-2d63-412e-b1b5-8657dd6484c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:07.349506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-999d0fcb-2d63-412e-b1b5-8657dd6484c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:07.349985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-999d0fcb-2d63-412e-b1b5-8657dd6484c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:07.350413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-999d0fcb-2d63-412e-b1b5-8657dd6484c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:07.351097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-999d0fcb-2d63-412e-b1b5-8657dd6484c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:07.351550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-999d0fcb-2d63-412e-b1b5-8657dd6484c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:07.351971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-999d0fcb-2d63-412e-b1b5-8657dd6484c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:07.483860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-999d0fcb-2d63-412e-b1b5-8657dd6484c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:07.491764 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-999d0fcb-2d63-412e-b1b5-8657dd6484c2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1682 microversion: 2.1 time: 0.154066 Oct 24 11:29:07.492340 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3590/7153] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:07 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:08.516224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-706fb914-ee40-4f3c-a9ee-553ad45c059e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:08.516872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-706fb914-ee40-4f3c-a9ee-553ad45c059e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:08.523797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-706fb914-ee40-4f3c-a9ee-553ad45c059e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:08.524299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-706fb914-ee40-4f3c-a9ee-553ad45c059e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:08.524759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-706fb914-ee40-4f3c-a9ee-553ad45c059e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:08.525490 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-706fb914-ee40-4f3c-a9ee-553ad45c059e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:08.526019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-706fb914-ee40-4f3c-a9ee-553ad45c059e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:08.526464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-706fb914-ee40-4f3c-a9ee-553ad45c059e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:08.660283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-706fb914-ee40-4f3c-a9ee-553ad45c059e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:08.668749 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-706fb914-ee40-4f3c-a9ee-553ad45c059e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1682 microversion: 2.1 time: 0.157156 Oct 24 11:29:08.669390 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3564/7154] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:08 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:09.693388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a02b1405-03f4-4ea0-9be3-1933b341191c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:09.694033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a02b1405-03f4-4ea0-9be3-1933b341191c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:09.700893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a02b1405-03f4-4ea0-9be3-1933b341191c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:09.701384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a02b1405-03f4-4ea0-9be3-1933b341191c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:09.701824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a02b1405-03f4-4ea0-9be3-1933b341191c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:09.702523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a02b1405-03f4-4ea0-9be3-1933b341191c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:09.702980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a02b1405-03f4-4ea0-9be3-1933b341191c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:09.703414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a02b1405-03f4-4ea0-9be3-1933b341191c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:09.836117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-2d0047ac-1c1b-448f-88f7-419875984276 req-731220aa-cbf4-446a-805c-04172f187659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1fd1f08-804b-4c97-a19d-211933a7e701", "name": "network-vif-unplugged", "status": "completed", "tag": "f32201b5-f0f3-4a0c-a162-35ae69b61f8d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:29:09.845734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a02b1405-03f4-4ea0-9be3-1933b341191c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:09.846276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2d0047ac-1c1b-448f-88f7-419875984276 req-731220aa-cbf4-446a-805c-04172f187659 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:09.846772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2d0047ac-1c1b-448f-88f7-419875984276 req-731220aa-cbf4-446a-805c-04172f187659 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:09.847217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2d0047ac-1c1b-448f-88f7-419875984276 req-731220aa-cbf4-446a-805c-04172f187659 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:09.854368 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a02b1405-03f4-4ea0-9be3-1933b341191c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1681 microversion: 2.1 time: 0.164856 Oct 24 11:29:09.854965 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3591/7155] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:09 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:09.860194 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-2d0047ac-1c1b-448f-88f7-419875984276 req-731220aa-cbf4-446a-805c-04172f187659 service nova] Creating event network-vif-unplugged:f32201b5-f0f3-4a0c-a162-35ae69b61f8d for instance c1fd1f08-804b-4c97-a19d-211933a7e701 on n-h2-858383-15 Oct 24 11:29:09.865746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-2d0047ac-1c1b-448f-88f7-419875984276 req-731220aa-cbf4-446a-805c-04172f187659 service nova] Instance c1fd1f08-804b-4c97-a19d-211933a7e701 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:29:09.879019 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-2d0047ac-1c1b-448f-88f7-419875984276 req-731220aa-cbf4-446a-805c-04172f187659 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110860 Oct 24 11:29:09.880058 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3565/7156] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:29:10.879689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-04b25eaf-5245-4182-9582-e3e5232a700c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:10.880915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-04b25eaf-5245-4182-9582-e3e5232a700c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:10.888316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04b25eaf-5245-4182-9582-e3e5232a700c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:10.888856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04b25eaf-5245-4182-9582-e3e5232a700c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:10.889295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04b25eaf-5245-4182-9582-e3e5232a700c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:10.890047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04b25eaf-5245-4182-9582-e3e5232a700c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:10.890455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04b25eaf-5245-4182-9582-e3e5232a700c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:10.890877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04b25eaf-5245-4182-9582-e3e5232a700c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:11.029639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-04b25eaf-5245-4182-9582-e3e5232a700c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:11.037343 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-04b25eaf-5245-4182-9582-e3e5232a700c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1679 microversion: 2.1 time: 0.161743 Oct 24 11:29:11.037926 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3592/7157] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:10 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:11.898666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-77acea33-5ad9-48a3-9694-1018504e3491 req-1841ec73-4b15-4e32-afc5-cddf6ddd5a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1fd1f08-804b-4c97-a19d-211933a7e701", "tag": "f32201b5-f0f3-4a0c-a162-35ae69b61f8d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:29:11.908958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-77acea33-5ad9-48a3-9694-1018504e3491 req-1841ec73-4b15-4e32-afc5-cddf6ddd5a2a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:11.909445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-77acea33-5ad9-48a3-9694-1018504e3491 req-1841ec73-4b15-4e32-afc5-cddf6ddd5a2a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:11.909885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-77acea33-5ad9-48a3-9694-1018504e3491 req-1841ec73-4b15-4e32-afc5-cddf6ddd5a2a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:11.922078 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-77acea33-5ad9-48a3-9694-1018504e3491 req-1841ec73-4b15-4e32-afc5-cddf6ddd5a2a service nova] Creating event network-changed:f32201b5-f0f3-4a0c-a162-35ae69b61f8d for instance c1fd1f08-804b-4c97-a19d-211933a7e701 on n-h2-858383-15 Oct 24 11:29:11.927241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-77acea33-5ad9-48a3-9694-1018504e3491 req-1841ec73-4b15-4e32-afc5-cddf6ddd5a2a service nova] Instance c1fd1f08-804b-4c97-a19d-211933a7e701 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:29:11.937881 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-77acea33-5ad9-48a3-9694-1018504e3491 req-1841ec73-4b15-4e32-afc5-cddf6ddd5a2a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044133 Oct 24 11:29:11.938473 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3566/7158] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:29:12.061978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2d44c126-ae64-45c2-8c42-7f9dce2dc2ac tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:12.062673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2d44c126-ae64-45c2-8c42-7f9dce2dc2ac tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:12.069812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d44c126-ae64-45c2-8c42-7f9dce2dc2ac tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:12.070476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d44c126-ae64-45c2-8c42-7f9dce2dc2ac tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:12.070916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d44c126-ae64-45c2-8c42-7f9dce2dc2ac tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:12.071614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d44c126-ae64-45c2-8c42-7f9dce2dc2ac tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:12.072067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d44c126-ae64-45c2-8c42-7f9dce2dc2ac tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:12.072493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2d44c126-ae64-45c2-8c42-7f9dce2dc2ac tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:12.307614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2d44c126-ae64-45c2-8c42-7f9dce2dc2ac tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:12.315511 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2d44c126-ae64-45c2-8c42-7f9dce2dc2ac tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1679 microversion: 2.1 time: 0.257840 Oct 24 11:29:12.316116 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3593/7159] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:12 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1679 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:13.341649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e84407a9-3baf-4811-aacb-73c93da02970 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:13.342384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e84407a9-3baf-4811-aacb-73c93da02970 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:13.348807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e84407a9-3baf-4811-aacb-73c93da02970 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:13.349346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e84407a9-3baf-4811-aacb-73c93da02970 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:13.349805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e84407a9-3baf-4811-aacb-73c93da02970 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:13.350534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e84407a9-3baf-4811-aacb-73c93da02970 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:13.351006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e84407a9-3baf-4811-aacb-73c93da02970 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:13.351452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e84407a9-3baf-4811-aacb-73c93da02970 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:13.497558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e84407a9-3baf-4811-aacb-73c93da02970 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:13.505772 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e84407a9-3baf-4811-aacb-73c93da02970 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1676 microversion: 2.1 time: 0.169784 Oct 24 11:29:13.506380 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3567/7160] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:13 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:13.530742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-da80cd04-49c2-4e49-8ee8-d8f573e5c2f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:29:13.531409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-da80cd04-49c2-4e49-8ee8-d8f573e5c2f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:13.538657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da80cd04-49c2-4e49-8ee8-d8f573e5c2f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:13.539072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da80cd04-49c2-4e49-8ee8-d8f573e5c2f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:13.539506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da80cd04-49c2-4e49-8ee8-d8f573e5c2f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:13.540212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da80cd04-49c2-4e49-8ee8-d8f573e5c2f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:13.540662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da80cd04-49c2-4e49-8ee8-d8f573e5c2f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:13.541114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da80cd04-49c2-4e49-8ee8-d8f573e5c2f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:13.583592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=100 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:29:13.606617 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-da80cd04-49c2-4e49-8ee8-d8f573e5c2f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "POST /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701/action" status: 204 len: 0 microversion: 2.1 time: 0.079055 Oct 24 11:29:13.607286 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3594/7161] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:29:13 2022] POST /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:29:13.616129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a1f54637-17fe-43e4-9142-4db6a7311c73 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:13.616784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a1f54637-17fe-43e4-9142-4db6a7311c73 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:13.623343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1f54637-17fe-43e4-9142-4db6a7311c73 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:13.623867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1f54637-17fe-43e4-9142-4db6a7311c73 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:13.624302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1f54637-17fe-43e4-9142-4db6a7311c73 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:13.625055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1f54637-17fe-43e4-9142-4db6a7311c73 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:13.625530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1f54637-17fe-43e4-9142-4db6a7311c73 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:13.626073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a1f54637-17fe-43e4-9142-4db6a7311c73 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:13.853669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a1f54637-17fe-43e4-9142-4db6a7311c73 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:13.858774 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:29:13.864376 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a1f54637-17fe-43e4-9142-4db6a7311c73 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1676 microversion: 2.1 time: 0.252361 Oct 24 11:29:13.865729 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3568/7162] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:13 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1676 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:29:14.606733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-ff9b0576-fbae-4a30-b9c5-6a12c1389562 req-0b381154-2018-4813-ae41-9600c8160558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1fd1f08-804b-4c97-a19d-211933a7e701", "name": "network-vif-plugged", "status": "completed", "tag": "f32201b5-f0f3-4a0c-a162-35ae69b61f8d"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:29:14.618052 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ff9b0576-fbae-4a30-b9c5-6a12c1389562 req-0b381154-2018-4813-ae41-9600c8160558 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:14.618542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ff9b0576-fbae-4a30-b9c5-6a12c1389562 req-0b381154-2018-4813-ae41-9600c8160558 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:14.618986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ff9b0576-fbae-4a30-b9c5-6a12c1389562 req-0b381154-2018-4813-ae41-9600c8160558 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:14.631407 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ff9b0576-fbae-4a30-b9c5-6a12c1389562 req-0b381154-2018-4813-ae41-9600c8160558 service nova] Creating event network-vif-plugged:f32201b5-f0f3-4a0c-a162-35ae69b61f8d for instance c1fd1f08-804b-4c97-a19d-211933a7e701 on n-h2-858383-15 Oct 24 11:29:14.637554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [req-ff9b0576-fbae-4a30-b9c5-6a12c1389562 req-0b381154-2018-4813-ae41-9600c8160558 service nova] Instance c1fd1f08-804b-4c97-a19d-211933a7e701 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120426) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:29:14.649932 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-ff9b0576-fbae-4a30-b9c5-6a12c1389562 req-0b381154-2018-4813-ae41-9600c8160558 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048769 Oct 24 11:29:14.650985 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3595/7163] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:29:14.890232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7f541355-86cc-44f5-8bf7-27b391cfe5d3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:14.890783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7f541355-86cc-44f5-8bf7-27b391cfe5d3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:14.898757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f541355-86cc-44f5-8bf7-27b391cfe5d3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:14.899264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f541355-86cc-44f5-8bf7-27b391cfe5d3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:14.899724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f541355-86cc-44f5-8bf7-27b391cfe5d3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:14.900440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f541355-86cc-44f5-8bf7-27b391cfe5d3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:14.900944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f541355-86cc-44f5-8bf7-27b391cfe5d3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:14.901475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f541355-86cc-44f5-8bf7-27b391cfe5d3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:15.040956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7f541355-86cc-44f5-8bf7-27b391cfe5d3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:15.049360 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7f541355-86cc-44f5-8bf7-27b391cfe5d3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1676 microversion: 2.1 time: 0.163801 Oct 24 11:29:15.049949 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3569/7164] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:14 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:16.076126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a67511dd-8822-4cc3-bb3f-e8a944e509c4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:16.076828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a67511dd-8822-4cc3-bb3f-e8a944e509c4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:16.078771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=35 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:29:16.084330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a67511dd-8822-4cc3-bb3f-e8a944e509c4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:16.084808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a67511dd-8822-4cc3-bb3f-e8a944e509c4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:16.085270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a67511dd-8822-4cc3-bb3f-e8a944e509c4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:16.085958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a67511dd-8822-4cc3-bb3f-e8a944e509c4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:16.086408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a67511dd-8822-4cc3-bb3f-e8a944e509c4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:16.086827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a67511dd-8822-4cc3-bb3f-e8a944e509c4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:16.216246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a67511dd-8822-4cc3-bb3f-e8a944e509c4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:16.224012 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a67511dd-8822-4cc3-bb3f-e8a944e509c4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1668 microversion: 2.1 time: 0.153655 Oct 24 11:29:16.224589 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3596/7165] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:16 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:16.247507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-226bbc9d-a746-4b6f-ad7e-7096915be3ea tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:16.248160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-226bbc9d-a746-4b6f-ad7e-7096915be3ea tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:16.250881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=39 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:29:16.256219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-226bbc9d-a746-4b6f-ad7e-7096915be3ea tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:16.256715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-226bbc9d-a746-4b6f-ad7e-7096915be3ea tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:16.257186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-226bbc9d-a746-4b6f-ad7e-7096915be3ea tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:16.257889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-226bbc9d-a746-4b6f-ad7e-7096915be3ea tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:16.258357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-226bbc9d-a746-4b6f-ad7e-7096915be3ea tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:16.258796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-226bbc9d-a746-4b6f-ad7e-7096915be3ea tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:16.390981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-226bbc9d-a746-4b6f-ad7e-7096915be3ea tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:16.398722 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-226bbc9d-a746-4b6f-ad7e-7096915be3ea tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1668 microversion: 2.1 time: 0.155777 Oct 24 11:29:16.399305 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3570/7166] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:16 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:16.421465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b947d3cf-f5a1-4a6d-94ad-ce3526a72736 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:16.422088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b947d3cf-f5a1-4a6d-94ad-ce3526a72736 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:16.427971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b947d3cf-f5a1-4a6d-94ad-ce3526a72736 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:16.428486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b947d3cf-f5a1-4a6d-94ad-ce3526a72736 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:16.428987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b947d3cf-f5a1-4a6d-94ad-ce3526a72736 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:16.429687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b947d3cf-f5a1-4a6d-94ad-ce3526a72736 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:16.430154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b947d3cf-f5a1-4a6d-94ad-ce3526a72736 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:16.430578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b947d3cf-f5a1-4a6d-94ad-ce3526a72736 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:16.561003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b947d3cf-f5a1-4a6d-94ad-ce3526a72736 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:16.568628 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b947d3cf-f5a1-4a6d-94ad-ce3526a72736 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1668 microversion: 2.1 time: 0.151039 Oct 24 11:29:16.569224 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3597/7167] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:16 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:16.591983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4a8d8982-4ae2-41b9-a76e-66fcd82fadd6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:16.592420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4a8d8982-4ae2-41b9-a76e-66fcd82fadd6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:16.598585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a8d8982-4ae2-41b9-a76e-66fcd82fadd6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:16.599090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a8d8982-4ae2-41b9-a76e-66fcd82fadd6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:16.599550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a8d8982-4ae2-41b9-a76e-66fcd82fadd6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:16.600263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a8d8982-4ae2-41b9-a76e-66fcd82fadd6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:16.600740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a8d8982-4ae2-41b9-a76e-66fcd82fadd6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:16.601224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4a8d8982-4ae2-41b9-a76e-66fcd82fadd6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:16.626714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4a8d8982-4ae2-41b9-a76e-66fcd82fadd6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:29:16.704617 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4a8d8982-4ae2-41b9-a76e-66fcd82fadd6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 204 len: 0 microversion: 2.1 time: 0.116745 Oct 24 11:29:16.705247 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3571/7168] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:29:16 2022] DELETE /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:29:16.713821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dd7dafaa-b270-4d4a-b8be-9eaf4395da6b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:16.715256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dd7dafaa-b270-4d4a-b8be-9eaf4395da6b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:16.721299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd7dafaa-b270-4d4a-b8be-9eaf4395da6b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:16.721773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd7dafaa-b270-4d4a-b8be-9eaf4395da6b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:16.722212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd7dafaa-b270-4d4a-b8be-9eaf4395da6b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:16.722892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd7dafaa-b270-4d4a-b8be-9eaf4395da6b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:16.723341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd7dafaa-b270-4d4a-b8be-9eaf4395da6b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:16.723758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd7dafaa-b270-4d4a-b8be-9eaf4395da6b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:16.852633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dd7dafaa-b270-4d4a-b8be-9eaf4395da6b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:16.860355 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dd7dafaa-b270-4d4a-b8be-9eaf4395da6b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1674 microversion: 2.1 time: 0.150456 Oct 24 11:29:16.860958 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3598/7169] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:16 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:17.884757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ebbe457-f5d8-4301-b71b-7479dacfbc03 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:17.885509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0ebbe457-f5d8-4301-b71b-7479dacfbc03 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:17.892156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ebbe457-f5d8-4301-b71b-7479dacfbc03 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:17.892653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ebbe457-f5d8-4301-b71b-7479dacfbc03 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:17.893135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ebbe457-f5d8-4301-b71b-7479dacfbc03 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:17.893832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ebbe457-f5d8-4301-b71b-7479dacfbc03 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:17.894316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ebbe457-f5d8-4301-b71b-7479dacfbc03 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:17.894738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0ebbe457-f5d8-4301-b71b-7479dacfbc03 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:18.033164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0ebbe457-f5d8-4301-b71b-7479dacfbc03 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:18.040787 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0ebbe457-f5d8-4301-b71b-7479dacfbc03 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1674 microversion: 2.1 time: 0.160325 Oct 24 11:29:18.041405 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3572/7170] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:17 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:19.040036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-f9fc955d-8874-499d-bb38-91a5b602fa52 req-1c95790d-3180-495f-a1a7-d1d454b8635f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1fd1f08-804b-4c97-a19d-211933a7e701", "name": "network-vif-deleted", "tag": "f32201b5-f0f3-4a0c-a162-35ae69b61f8d"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:29:19.053014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f9fc955d-8874-499d-bb38-91a5b602fa52 req-1c95790d-3180-495f-a1a7-d1d454b8635f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:19.053897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f9fc955d-8874-499d-bb38-91a5b602fa52 req-1c95790d-3180-495f-a1a7-d1d454b8635f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:19.054687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f9fc955d-8874-499d-bb38-91a5b602fa52 req-1c95790d-3180-495f-a1a7-d1d454b8635f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:19.065164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4d6c406d-f1e5-4b43-bf2d-01b6f1d8141a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:19.067343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4d6c406d-f1e5-4b43-bf2d-01b6f1d8141a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:19.071017 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f9fc955d-8874-499d-bb38-91a5b602fa52 req-1c95790d-3180-495f-a1a7-d1d454b8635f service nova] Creating event network-vif-deleted:f32201b5-f0f3-4a0c-a162-35ae69b61f8d for instance c1fd1f08-804b-4c97-a19d-211933a7e701 on n-h2-858383-15 Oct 24 11:29:19.077237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d6c406d-f1e5-4b43-bf2d-01b6f1d8141a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:19.077720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d6c406d-f1e5-4b43-bf2d-01b6f1d8141a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:19.077867 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-f9fc955d-8874-499d-bb38-91a5b602fa52 req-1c95790d-3180-495f-a1a7-d1d454b8635f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041061 Oct 24 11:29:19.078171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d6c406d-f1e5-4b43-bf2d-01b6f1d8141a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:19.078753 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3599/7171] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:29:19.081930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d6c406d-f1e5-4b43-bf2d-01b6f1d8141a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:19.082419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d6c406d-f1e5-4b43-bf2d-01b6f1d8141a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:19.082871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4d6c406d-f1e5-4b43-bf2d-01b6f1d8141a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:19.149767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4d6c406d-f1e5-4b43-bf2d-01b6f1d8141a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:19.159995 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4d6c406d-f1e5-4b43-bf2d-01b6f1d8141a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 200 len: 1323 microversion: 2.1 time: 0.098371 Oct 24 11:29:19.160609 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3573/7172] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:19 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 1323 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:20.185925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9693cef0-19fc-4d7f-8d1d-769db891da2e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:20.186635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9693cef0-19fc-4d7f-8d1d-769db891da2e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:20.192868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9693cef0-19fc-4d7f-8d1d-769db891da2e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:20.193347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9693cef0-19fc-4d7f-8d1d-769db891da2e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:20.193785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9693cef0-19fc-4d7f-8d1d-769db891da2e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:20.194544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9693cef0-19fc-4d7f-8d1d-769db891da2e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:20.194910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9693cef0-19fc-4d7f-8d1d-769db891da2e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:20.195335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9693cef0-19fc-4d7f-8d1d-769db891da2e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:20.209768 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-9693cef0-19fc-4d7f-8d1d-769db891da2e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] HTTP exception thrown: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9693cef0-19fc-4d7f-8d1d-769db891da2e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Request method failure captured: Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 HTTP/1.1 Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnaUzJMxVmO-HtBWBYSLYY__i8Ec4H_cXbVc5xd3yGDLsMf1ETMejFCnWUyp9G8494iE9lwNZ1O-SL8TGXN5cFSCNrWBYv6wZLOJycdTlyT8sc_7tYAGIgmUERtptmQ1I6PrKjKFKSYn1GiUZKbvWNa596EQvJKNpX9sOkD72kPfq90 Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c0ac700abd24e4ea516532577c09aa5", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 879b06d644fa496c94f9226f23d79716 Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'c1fd1f08-804b-4c97-a19d-211933a7e701'} Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:29:20.211416 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:29:20.216474 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:29:20.216474 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:29:20.216474 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:29:20.216474 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:29:20.216474 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:29:20.216474 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:29:20.216474 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:29:20.216474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9693cef0-19fc-4d7f-8d1d-769db891da2e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Returning 404 to user: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:29:20.216474 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9693cef0-19fc-4d7f-8d1d-769db891da2e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 404 len: 111 microversion: 2.1 time: 0.032885 Oct 24 11:29:20.216474 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3600/7173] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:20 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:29:20.227235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cc84e702-2b3a-44fb-9ae5-363ddcf966a0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:20.227857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cc84e702-2b3a-44fb-9ae5-363ddcf966a0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:20.234920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc84e702-2b3a-44fb-9ae5-363ddcf966a0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:20.235408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc84e702-2b3a-44fb-9ae5-363ddcf966a0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:20.235853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc84e702-2b3a-44fb-9ae5-363ddcf966a0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:20.236547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc84e702-2b3a-44fb-9ae5-363ddcf966a0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:20.237039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc84e702-2b3a-44fb-9ae5-363ddcf966a0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:20.237471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc84e702-2b3a-44fb-9ae5-363ddcf966a0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:20.253952 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-cc84e702-2b3a-44fb-9ae5-363ddcf966a0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] HTTP exception thrown: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cc84e702-2b3a-44fb-9ae5-363ddcf966a0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Request method failure captured: Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 HTTP/1.1 Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnaUzJMxVmO-HtBWBYSLYY__i8Ec4H_cXbVc5xd3yGDLsMf1ETMejFCnWUyp9G8494iE9lwNZ1O-SL8TGXN5cFSCNrWBYv6wZLOJycdTlyT8sc_7tYAGIgmUERtptmQ1I6PrKjKFKSYn1GiUZKbvWNa596EQvJKNpX9sOkD72kPfq90 Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c0ac700abd24e4ea516532577c09aa5", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 879b06d644fa496c94f9226f23d79716 Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'c1fd1f08-804b-4c97-a19d-211933a7e701'} Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:29:20.255575 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:29:20.260284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:29:20.260284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:29:20.260284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:29:20.260284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:29:20.260284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:29:20.260284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:29:20.260284 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:29:20.260284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cc84e702-2b3a-44fb-9ae5-363ddcf966a0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Returning 404 to user: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:29:20.260284 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cc84e702-2b3a-44fb-9ae5-363ddcf966a0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 404 len: 111 microversion: 2.1 time: 0.033666 Oct 24 11:29:20.260284 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3574/7174] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:20 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:29:20.307066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8bf4d8a9-274f-4515-8e34-9dd3ec56444f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-738867567", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "8220ee77-95f2-48de-8da4-516f3afce857"}], "security_groups": [{"name": "tempest-securitygroup--485148156"}], "key_name": "tempest-keypair-1192870934", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:29:20.412748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-8bf4d8a9-274f-4515-8e34-9dd3ec56444f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] validate_networks() for [('8220ee77-95f2-48de-8da4-516f3afce857', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:29:21.090487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8bf4d8a9-274f-4515-8e34-9dd3ec56444f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:29:21.090901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8bf4d8a9-274f-4515-8e34-9dd3ec56444f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:29:21.091366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8bf4d8a9-274f-4515-8e34-9dd3ec56444f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:29:21.091772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8bf4d8a9-274f-4515-8e34-9dd3ec56444f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:29:21.092177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-8bf4d8a9-274f-4515-8e34-9dd3ec56444f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:29:21.101035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bf4d8a9-274f-4515-8e34-9dd3ec56444f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:21.101506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bf4d8a9-274f-4515-8e34-9dd3ec56444f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:21.101937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bf4d8a9-274f-4515-8e34-9dd3ec56444f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:21.102654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bf4d8a9-274f-4515-8e34-9dd3ec56444f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:21.103102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bf4d8a9-274f-4515-8e34-9dd3ec56444f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:21.103520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8bf4d8a9-274f-4515-8e34-9dd3ec56444f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:21.121538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-8bf4d8a9-274f-4515-8e34-9dd3ec56444f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Getting quotas for project 4c0ac700abd24e4ea516532577c09aa5. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:29:21.127648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-8bf4d8a9-274f-4515-8e34-9dd3ec56444f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Getting quotas for user 879b06d644fa496c94f9226f23d79716 and project 4c0ac700abd24e4ea516532577c09aa5. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:29:21.139968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8bf4d8a9-274f-4515-8e34-9dd3ec56444f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:29:21.142336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8bf4d8a9-274f-4515-8e34-9dd3ec56444f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:29:21.191145 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8bf4d8a9-274f-4515-8e34-9dd3ec56444f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.888100 Oct 24 11:29:21.191889 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3601/7175] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:29:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:29:21.203877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c3b616df-cd95-4b19-bf9d-d77489776570 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:21.204475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c3b616df-cd95-4b19-bf9d-d77489776570 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:21.260894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c3b616df-cd95-4b19-bf9d-d77489776570 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:21.269285 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c3b616df-cd95-4b19-bf9d-d77489776570 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1238 microversion: 2.1 time: 0.069327 Oct 24 11:29:21.269857 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3575/7176] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:21 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:22.296569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8350d6bd-e8d3-453a-b54d-b889ee97e09b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:22.297379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8350d6bd-e8d3-453a-b54d-b889ee97e09b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:22.304190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8350d6bd-e8d3-453a-b54d-b889ee97e09b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:22.305134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8350d6bd-e8d3-453a-b54d-b889ee97e09b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:22.305733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8350d6bd-e8d3-453a-b54d-b889ee97e09b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:22.306827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8350d6bd-e8d3-453a-b54d-b889ee97e09b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:22.307457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8350d6bd-e8d3-453a-b54d-b889ee97e09b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:22.308158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8350d6bd-e8d3-453a-b54d-b889ee97e09b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:22.378590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8350d6bd-e8d3-453a-b54d-b889ee97e09b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:22.387136 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8350d6bd-e8d3-453a-b54d-b889ee97e09b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1308 microversion: 2.1 time: 0.096987 Oct 24 11:29:22.387831 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3602/7177] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:22 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:23.411582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-03a04628-df8f-426b-ac04-1c8abf547109 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:23.412208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-03a04628-df8f-426b-ac04-1c8abf547109 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:23.419327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03a04628-df8f-426b-ac04-1c8abf547109 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:23.419826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03a04628-df8f-426b-ac04-1c8abf547109 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:23.420275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03a04628-df8f-426b-ac04-1c8abf547109 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:23.421130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03a04628-df8f-426b-ac04-1c8abf547109 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:23.421545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03a04628-df8f-426b-ac04-1c8abf547109 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:23.422244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-03a04628-df8f-426b-ac04-1c8abf547109 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:23.554807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-03a04628-df8f-426b-ac04-1c8abf547109 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:23.562735 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-03a04628-df8f-426b-ac04-1c8abf547109 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1363 microversion: 2.1 time: 0.155018 Oct 24 11:29:23.563325 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3576/7178] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:23 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:23.685658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-e86420c7-8b40-4548-a3d0-4883c17f4ee3 req-82121b05-54dd-4750-becb-e324c002c87b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9", "tag": "95330681-f93d-4e46-a8ff-6b09d0385732"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:29:23.696856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e86420c7-8b40-4548-a3d0-4883c17f4ee3 req-82121b05-54dd-4750-becb-e324c002c87b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:23.697614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e86420c7-8b40-4548-a3d0-4883c17f4ee3 req-82121b05-54dd-4750-becb-e324c002c87b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:23.698048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-e86420c7-8b40-4548-a3d0-4883c17f4ee3 req-82121b05-54dd-4750-becb-e324c002c87b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:23.709555 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-e86420c7-8b40-4548-a3d0-4883c17f4ee3 req-82121b05-54dd-4750-becb-e324c002c87b service nova] Creating event network-changed:95330681-f93d-4e46-a8ff-6b09d0385732 for instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 on n-h2-858383-15 Oct 24 11:29:23.715538 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-e86420c7-8b40-4548-a3d0-4883c17f4ee3 req-82121b05-54dd-4750-becb-e324c002c87b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034020 Oct 24 11:29:23.716384 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3603/7179] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:29:24.586896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-283c2ac7-3274-4aa7-b96c-4d5420ee90e2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:24.587546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-283c2ac7-3274-4aa7-b96c-4d5420ee90e2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:24.595306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-283c2ac7-3274-4aa7-b96c-4d5420ee90e2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:24.595802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-283c2ac7-3274-4aa7-b96c-4d5420ee90e2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:24.596257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-283c2ac7-3274-4aa7-b96c-4d5420ee90e2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:24.596992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-283c2ac7-3274-4aa7-b96c-4d5420ee90e2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:24.597458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-283c2ac7-3274-4aa7-b96c-4d5420ee90e2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:24.597896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-283c2ac7-3274-4aa7-b96c-4d5420ee90e2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:24.735281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-283c2ac7-3274-4aa7-b96c-4d5420ee90e2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:24.744207 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-283c2ac7-3274-4aa7-b96c-4d5420ee90e2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1363 microversion: 2.1 time: 0.161218 Oct 24 11:29:24.744864 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3577/7180] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:24 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:25.769053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0b4d519f-68d9-4b00-ba1b-a2ab2836ceaa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:25.769767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0b4d519f-68d9-4b00-ba1b-a2ab2836ceaa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:25.777415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b4d519f-68d9-4b00-ba1b-a2ab2836ceaa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:25.778262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b4d519f-68d9-4b00-ba1b-a2ab2836ceaa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:25.778710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b4d519f-68d9-4b00-ba1b-a2ab2836ceaa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:25.779413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b4d519f-68d9-4b00-ba1b-a2ab2836ceaa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:25.779870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b4d519f-68d9-4b00-ba1b-a2ab2836ceaa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:25.780300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b4d519f-68d9-4b00-ba1b-a2ab2836ceaa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:25.908031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0b4d519f-68d9-4b00-ba1b-a2ab2836ceaa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:25.915808 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0b4d519f-68d9-4b00-ba1b-a2ab2836ceaa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1363 microversion: 2.1 time: 0.151087 Oct 24 11:29:25.916390 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3604/7181] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:25 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:26.939955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3ed8851c-282f-4068-838f-4c98c93116f8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:26.940583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3ed8851c-282f-4068-838f-4c98c93116f8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:26.947137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ed8851c-282f-4068-838f-4c98c93116f8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:26.947634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ed8851c-282f-4068-838f-4c98c93116f8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:26.948081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ed8851c-282f-4068-838f-4c98c93116f8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:26.949376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ed8851c-282f-4068-838f-4c98c93116f8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:26.949846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ed8851c-282f-4068-838f-4c98c93116f8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:26.950281 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ed8851c-282f-4068-838f-4c98c93116f8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:27.082152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3ed8851c-282f-4068-838f-4c98c93116f8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:27.090484 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3ed8851c-282f-4068-838f-4c98c93116f8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1363 microversion: 2.1 time: 0.154528 Oct 24 11:29:27.091056 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3578/7182] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:26 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:28.113924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-64ee37c9-6b91-4b96-bd6f-e4dbe53ada5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:28.114550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-64ee37c9-6b91-4b96-bd6f-e4dbe53ada5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:28.121719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64ee37c9-6b91-4b96-bd6f-e4dbe53ada5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:28.122208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64ee37c9-6b91-4b96-bd6f-e4dbe53ada5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:28.122651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64ee37c9-6b91-4b96-bd6f-e4dbe53ada5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:28.123386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64ee37c9-6b91-4b96-bd6f-e4dbe53ada5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:28.123845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64ee37c9-6b91-4b96-bd6f-e4dbe53ada5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:28.124276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-64ee37c9-6b91-4b96-bd6f-e4dbe53ada5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:28.256390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-64ee37c9-6b91-4b96-bd6f-e4dbe53ada5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:28.264146 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-64ee37c9-6b91-4b96-bd6f-e4dbe53ada5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1363 microversion: 2.1 time: 0.154100 Oct 24 11:29:28.264719 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3605/7183] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:28 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:28.846969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-2b61fd1b-24eb-4059-8595-26a025f38da1 req-e7ab4ab5-cd25-4334-bc84-d7c0af70b87b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9", "name": "network-vif-plugged", "status": "completed", "tag": "95330681-f93d-4e46-a8ff-6b09d0385732"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:29:28.857260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2b61fd1b-24eb-4059-8595-26a025f38da1 req-e7ab4ab5-cd25-4334-bc84-d7c0af70b87b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:28.857760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2b61fd1b-24eb-4059-8595-26a025f38da1 req-e7ab4ab5-cd25-4334-bc84-d7c0af70b87b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:28.858240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-2b61fd1b-24eb-4059-8595-26a025f38da1 req-e7ab4ab5-cd25-4334-bc84-d7c0af70b87b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:28.869522 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-2b61fd1b-24eb-4059-8595-26a025f38da1 req-e7ab4ab5-cd25-4334-bc84-d7c0af70b87b service nova] Creating event network-vif-plugged:95330681-f93d-4e46-a8ff-6b09d0385732 for instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 on n-h2-858383-15 Oct 24 11:29:28.874734 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-2b61fd1b-24eb-4059-8595-26a025f38da1 req-e7ab4ab5-cd25-4334-bc84-d7c0af70b87b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098872 Oct 24 11:29:28.875321 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3579/7184] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:29:29.288348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5b6c2dfc-8c63-4328-95b7-64f2908e732c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:29.288960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5b6c2dfc-8c63-4328-95b7-64f2908e732c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:29.295841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b6c2dfc-8c63-4328-95b7-64f2908e732c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:29.296319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b6c2dfc-8c63-4328-95b7-64f2908e732c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:29.296761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b6c2dfc-8c63-4328-95b7-64f2908e732c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:29.297478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b6c2dfc-8c63-4328-95b7-64f2908e732c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:29.297929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b6c2dfc-8c63-4328-95b7-64f2908e732c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:29.298352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5b6c2dfc-8c63-4328-95b7-64f2908e732c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:29.427538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5b6c2dfc-8c63-4328-95b7-64f2908e732c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:29.435864 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5b6c2dfc-8c63-4328-95b7-64f2908e732c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1363 microversion: 2.1 time: 0.151457 Oct 24 11:29:29.436445 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3606/7185] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:29 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:30.459532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ae39027c-f368-4a98-a552-a1e83149b9f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:30.460244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ae39027c-f368-4a98-a552-a1e83149b9f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:30.468049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae39027c-f368-4a98-a552-a1e83149b9f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:30.468538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae39027c-f368-4a98-a552-a1e83149b9f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:30.469019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae39027c-f368-4a98-a552-a1e83149b9f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:30.469728 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae39027c-f368-4a98-a552-a1e83149b9f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:30.470190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae39027c-f368-4a98-a552-a1e83149b9f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:30.470627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae39027c-f368-4a98-a552-a1e83149b9f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:30.603834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ae39027c-f368-4a98-a552-a1e83149b9f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:29:30.612433 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ae39027c-f368-4a98-a552-a1e83149b9f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1549 microversion: 2.1 time: 0.157089 Oct 24 11:29:30.613028 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3580/7186] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:29:30 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:29:30.636819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cf8df446-9b44-4380-987e-38c23b308e08 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:29:30.637374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cf8df446-9b44-4380-987e-38c23b308e08 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:29:30.644145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf8df446-9b44-4380-987e-38c23b308e08 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:30.644629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf8df446-9b44-4380-987e-38c23b308e08 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:30.645110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf8df446-9b44-4380-987e-38c23b308e08 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:30.645813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf8df446-9b44-4380-987e-38c23b308e08 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:30.646270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf8df446-9b44-4380-987e-38c23b308e08 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:30.646696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cf8df446-9b44-4380-987e-38c23b308e08 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:30.724958 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cf8df446-9b44-4380-987e-38c23b308e08 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091894 Oct 24 11:29:30.725604 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3607/7187] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 11:29:30 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:29:31.658741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:29:31.714819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-22b77adf-423a-4e7a-a660-3a5ff17c675b req-b77a5b1a-51be-43c2-ace1-0974ba04e383 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9", "tag": "95330681-f93d-4e46-a8ff-6b09d0385732"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:29:31.725305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-22b77adf-423a-4e7a-a660-3a5ff17c675b req-b77a5b1a-51be-43c2-ace1-0974ba04e383 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:29:31.725801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-22b77adf-423a-4e7a-a660-3a5ff17c675b req-b77a5b1a-51be-43c2-ace1-0974ba04e383 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:29:31.726251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-22b77adf-423a-4e7a-a660-3a5ff17c675b req-b77a5b1a-51be-43c2-ace1-0974ba04e383 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:29:31.738370 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-22b77adf-423a-4e7a-a660-3a5ff17c675b req-b77a5b1a-51be-43c2-ace1-0974ba04e383 service nova] Creating event network-changed:95330681-f93d-4e46-a8ff-6b09d0385732 for instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 on n-h2-858383-15 Oct 24 11:29:31.743338 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-22b77adf-423a-4e7a-a660-3a5ff17c675b req-b77a5b1a-51be-43c2-ace1-0974ba04e383 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089592 Oct 24 11:29:31.743967 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3581/7188] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:30:02.086363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:30:02.087225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:30:02.089476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:30:02.090200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=59,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:30:02.094847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-be6295b4-221e-4b27-ba24-54a44dc55517 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:30:02.104043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be6295b4-221e-4b27-ba24-54a44dc55517 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:02.104523 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be6295b4-221e-4b27-ba24-54a44dc55517 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:02.104997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-be6295b4-221e-4b27-ba24-54a44dc55517 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:02.129287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-be6295b4-221e-4b27-ba24-54a44dc55517 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Going to try to stop instance {{(pid=120426) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 11:30:02.174414 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-be6295b4-221e-4b27-ba24-54a44dc55517 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "POST /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9/action" status: 202 len: 0 microversion: 2.1 time: 0.088642 Oct 24 11:30:02.175036 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3608/7189] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:30:02 2022] POST /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:30:02.183973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f3a799e5-fb99-454c-bce2-fa3379bba240 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:02.184695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f3a799e5-fb99-454c-bce2-fa3379bba240 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:02.187051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:30:02.187755 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:30:02.194993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3a799e5-fb99-454c-bce2-fa3379bba240 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:02.195500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3a799e5-fb99-454c-bce2-fa3379bba240 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:02.195956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3a799e5-fb99-454c-bce2-fa3379bba240 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:02.196685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3a799e5-fb99-454c-bce2-fa3379bba240 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:02.197186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3a799e5-fb99-454c-bce2-fa3379bba240 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:02.197633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f3a799e5-fb99-454c-bce2-fa3379bba240 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:02.335386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f3a799e5-fb99-454c-bce2-fa3379bba240 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:02.343372 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f3a799e5-fb99-454c-bce2-fa3379bba240 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1678 microversion: 2.1 time: 0.163831 Oct 24 11:30:02.343887 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3582/7190] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:02 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:03.368283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-41598964-c5a3-4622-8f6a-012f3dc0ae33 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:03.369034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-41598964-c5a3-4622-8f6a-012f3dc0ae33 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:03.375234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41598964-c5a3-4622-8f6a-012f3dc0ae33 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:03.375732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41598964-c5a3-4622-8f6a-012f3dc0ae33 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:03.376156 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41598964-c5a3-4622-8f6a-012f3dc0ae33 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:03.376852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41598964-c5a3-4622-8f6a-012f3dc0ae33 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:03.377362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41598964-c5a3-4622-8f6a-012f3dc0ae33 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:03.377730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-41598964-c5a3-4622-8f6a-012f3dc0ae33 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:03.512251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-41598964-c5a3-4622-8f6a-012f3dc0ae33 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:03.520581 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-41598964-c5a3-4622-8f6a-012f3dc0ae33 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1678 microversion: 2.1 time: 0.157381 Oct 24 11:30:03.521201 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3609/7191] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:03 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:04.543919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-63416715-f742-4df3-a4b1-02ded9bb6d84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:04.544539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-63416715-f742-4df3-a4b1-02ded9bb6d84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:04.553038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63416715-f742-4df3-a4b1-02ded9bb6d84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:04.553607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63416715-f742-4df3-a4b1-02ded9bb6d84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:04.554148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63416715-f742-4df3-a4b1-02ded9bb6d84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:04.554886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63416715-f742-4df3-a4b1-02ded9bb6d84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:04.555353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63416715-f742-4df3-a4b1-02ded9bb6d84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:04.555790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63416715-f742-4df3-a4b1-02ded9bb6d84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:04.687368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-63416715-f742-4df3-a4b1-02ded9bb6d84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:04.695382 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-63416715-f742-4df3-a4b1-02ded9bb6d84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1678 microversion: 2.1 time: 0.155317 Oct 24 11:30:04.695956 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3583/7192] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:04 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:05.720192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bcb6ed85-056e-43f7-9434-957c062092b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:05.720954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bcb6ed85-056e-43f7-9434-957c062092b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:05.727769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bcb6ed85-056e-43f7-9434-957c062092b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:05.728285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bcb6ed85-056e-43f7-9434-957c062092b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:05.728726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bcb6ed85-056e-43f7-9434-957c062092b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:05.729451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bcb6ed85-056e-43f7-9434-957c062092b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:05.729912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bcb6ed85-056e-43f7-9434-957c062092b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:05.730348 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bcb6ed85-056e-43f7-9434-957c062092b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:05.863502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bcb6ed85-056e-43f7-9434-957c062092b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:05.871711 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bcb6ed85-056e-43f7-9434-957c062092b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1678 microversion: 2.1 time: 0.156155 Oct 24 11:30:05.872298 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3610/7193] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:05 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:06.897815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-91e52283-3a2d-4b89-ad5d-a06eeb996cb0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:06.898465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-91e52283-3a2d-4b89-ad5d-a06eeb996cb0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:06.905667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91e52283-3a2d-4b89-ad5d-a06eeb996cb0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:06.906180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91e52283-3a2d-4b89-ad5d-a06eeb996cb0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:06.906676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91e52283-3a2d-4b89-ad5d-a06eeb996cb0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:06.907953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91e52283-3a2d-4b89-ad5d-a06eeb996cb0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:06.908435 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91e52283-3a2d-4b89-ad5d-a06eeb996cb0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:06.908917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-91e52283-3a2d-4b89-ad5d-a06eeb996cb0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:07.041473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-91e52283-3a2d-4b89-ad5d-a06eeb996cb0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:07.049300 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-91e52283-3a2d-4b89-ad5d-a06eeb996cb0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1678 microversion: 2.1 time: 0.155360 Oct 24 11:30:07.049871 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3584/7194] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:06 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:08.072951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9b384f8f-0f9e-4a12-8ccc-348b6e5d1e63 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:08.073622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9b384f8f-0f9e-4a12-8ccc-348b6e5d1e63 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:08.080368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b384f8f-0f9e-4a12-8ccc-348b6e5d1e63 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:08.080866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b384f8f-0f9e-4a12-8ccc-348b6e5d1e63 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:08.081307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b384f8f-0f9e-4a12-8ccc-348b6e5d1e63 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:08.081997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b384f8f-0f9e-4a12-8ccc-348b6e5d1e63 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:08.082451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b384f8f-0f9e-4a12-8ccc-348b6e5d1e63 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:08.082876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b384f8f-0f9e-4a12-8ccc-348b6e5d1e63 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:08.211284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9b384f8f-0f9e-4a12-8ccc-348b6e5d1e63 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:08.219002 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9b384f8f-0f9e-4a12-8ccc-348b6e5d1e63 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1678 microversion: 2.1 time: 0.150021 Oct 24 11:30:08.220143 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3611/7195] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:08 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:09.243597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad3c3ca1-61a5-48b6-ac21-b276f51df0e9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:09.244253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad3c3ca1-61a5-48b6-ac21-b276f51df0e9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:09.251868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3c3ca1-61a5-48b6-ac21-b276f51df0e9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:09.252375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3c3ca1-61a5-48b6-ac21-b276f51df0e9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:09.252856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3c3ca1-61a5-48b6-ac21-b276f51df0e9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:09.253584 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3c3ca1-61a5-48b6-ac21-b276f51df0e9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:09.254050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3c3ca1-61a5-48b6-ac21-b276f51df0e9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:09.254493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3c3ca1-61a5-48b6-ac21-b276f51df0e9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:09.385759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ad3c3ca1-61a5-48b6-ac21-b276f51df0e9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:09.394129 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad3c3ca1-61a5-48b6-ac21-b276f51df0e9 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1678 microversion: 2.1 time: 0.154512 Oct 24 11:30:09.394703 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3585/7196] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:09 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:10.418391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dd50faff-a89d-4e20-8495-fb0d79ebe905 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:10.419001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dd50faff-a89d-4e20-8495-fb0d79ebe905 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:10.425951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd50faff-a89d-4e20-8495-fb0d79ebe905 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:10.426427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd50faff-a89d-4e20-8495-fb0d79ebe905 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:10.426861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd50faff-a89d-4e20-8495-fb0d79ebe905 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:10.427546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd50faff-a89d-4e20-8495-fb0d79ebe905 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:10.427997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd50faff-a89d-4e20-8495-fb0d79ebe905 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:10.428420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd50faff-a89d-4e20-8495-fb0d79ebe905 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:10.558484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dd50faff-a89d-4e20-8495-fb0d79ebe905 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:10.566233 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dd50faff-a89d-4e20-8495-fb0d79ebe905 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1678 microversion: 2.1 time: 0.151755 Oct 24 11:30:10.566806 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3612/7197] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:10 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:11.589531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8fca8ffd-384c-446f-9cd8-a07c93105b11 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:11.590157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8fca8ffd-384c-446f-9cd8-a07c93105b11 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:11.597138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fca8ffd-384c-446f-9cd8-a07c93105b11 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:11.597634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fca8ffd-384c-446f-9cd8-a07c93105b11 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:11.598085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fca8ffd-384c-446f-9cd8-a07c93105b11 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:11.598790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fca8ffd-384c-446f-9cd8-a07c93105b11 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:11.599255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fca8ffd-384c-446f-9cd8-a07c93105b11 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:11.599694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fca8ffd-384c-446f-9cd8-a07c93105b11 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:11.728260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8fca8ffd-384c-446f-9cd8-a07c93105b11 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:11.736739 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8fca8ffd-384c-446f-9cd8-a07c93105b11 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1678 microversion: 2.1 time: 0.151123 Oct 24 11:30:11.737334 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3586/7198] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:11 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:12.759166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9099c957-7fef-474a-8958-ae2e9b9da9ce tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:12.759792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9099c957-7fef-474a-8958-ae2e9b9da9ce tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:12.766950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9099c957-7fef-474a-8958-ae2e9b9da9ce tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:12.767462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9099c957-7fef-474a-8958-ae2e9b9da9ce tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:12.767905 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9099c957-7fef-474a-8958-ae2e9b9da9ce tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:12.768640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9099c957-7fef-474a-8958-ae2e9b9da9ce tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:12.769132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9099c957-7fef-474a-8958-ae2e9b9da9ce tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:12.769566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9099c957-7fef-474a-8958-ae2e9b9da9ce tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:12.908488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9099c957-7fef-474a-8958-ae2e9b9da9ce tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:12.916254 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9099c957-7fef-474a-8958-ae2e9b9da9ce tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1655 microversion: 2.1 time: 0.160984 Oct 24 11:30:12.916853 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3613/7199] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:12 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1655 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:30:12.938901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e5daebb4-f84a-4f4e-b002-ec8849d1771d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:30:12.941204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e5daebb4-f84a-4f4e-b002-ec8849d1771d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:12.947902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5daebb4-f84a-4f4e-b002-ec8849d1771d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:12.948408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5daebb4-f84a-4f4e-b002-ec8849d1771d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:12.948896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5daebb4-f84a-4f4e-b002-ec8849d1771d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:12.949616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5daebb4-f84a-4f4e-b002-ec8849d1771d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:12.950092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5daebb4-f84a-4f4e-b002-ec8849d1771d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:12.950573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5daebb4-f84a-4f4e-b002-ec8849d1771d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:12.979252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e5daebb4-f84a-4f4e-b002-ec8849d1771d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:12.984740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e5daebb4-f84a-4f4e-b002-ec8849d1771d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Old instance type m1.heat2, new instance type m1.heat {{(pid=120425) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 24 11:30:12.991192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e5daebb4-f84a-4f4e-b002-ec8849d1771d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:30:12.991638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e5daebb4-f84a-4f4e-b002-ec8849d1771d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:30:12.992130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e5daebb4-f84a-4f4e-b002-ec8849d1771d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:30:12.992559 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e5daebb4-f84a-4f4e-b002-ec8849d1771d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:30:12.993019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e5daebb4-f84a-4f4e-b002-ec8849d1771d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:30:13.054932 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e5daebb4-f84a-4f4e-b002-ec8849d1771d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "POST /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9/action" status: 202 len: 0 microversion: 2.1 time: 0.119900 Oct 24 11:30:13.058676 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3587/7200] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:30:12 2022] POST /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:30:13.063839 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ba33d934-30b0-49a6-9726-6087e03a043a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:13.064494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ba33d934-30b0-49a6-9726-6087e03a043a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:13.070647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba33d934-30b0-49a6-9726-6087e03a043a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:13.071514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba33d934-30b0-49a6-9726-6087e03a043a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:13.071653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba33d934-30b0-49a6-9726-6087e03a043a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:13.072269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba33d934-30b0-49a6-9726-6087e03a043a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:13.072726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba33d934-30b0-49a6-9726-6087e03a043a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:13.073181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba33d934-30b0-49a6-9726-6087e03a043a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:13.208438 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ba33d934-30b0-49a6-9726-6087e03a043a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:13.216379 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ba33d934-30b0-49a6-9726-6087e03a043a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1678 microversion: 2.1 time: 0.156440 Oct 24 11:30:13.216995 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3614/7201] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:13 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:14.242227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e31810f2-22e7-4c55-a192-17e637274864 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:14.242863 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e31810f2-22e7-4c55-a192-17e637274864 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:14.252361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e31810f2-22e7-4c55-a192-17e637274864 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:14.252897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e31810f2-22e7-4c55-a192-17e637274864 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:14.253361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e31810f2-22e7-4c55-a192-17e637274864 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:14.254074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e31810f2-22e7-4c55-a192-17e637274864 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:14.254551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e31810f2-22e7-4c55-a192-17e637274864 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:14.255000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e31810f2-22e7-4c55-a192-17e637274864 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:14.387886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e31810f2-22e7-4c55-a192-17e637274864 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:14.396101 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e31810f2-22e7-4c55-a192-17e637274864 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1678 microversion: 2.1 time: 0.158585 Oct 24 11:30:14.396667 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3588/7202] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:14 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:15.420969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9b32cf23-5283-4609-aae3-ab2b3fcc51d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:15.421617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9b32cf23-5283-4609-aae3-ab2b3fcc51d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:15.429094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b32cf23-5283-4609-aae3-ab2b3fcc51d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:15.429577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b32cf23-5283-4609-aae3-ab2b3fcc51d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:15.430067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b32cf23-5283-4609-aae3-ab2b3fcc51d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:15.430758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b32cf23-5283-4609-aae3-ab2b3fcc51d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:15.431206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b32cf23-5283-4609-aae3-ab2b3fcc51d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:15.431627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9b32cf23-5283-4609-aae3-ab2b3fcc51d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:15.563917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9b32cf23-5283-4609-aae3-ab2b3fcc51d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:15.571686 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9b32cf23-5283-4609-aae3-ab2b3fcc51d1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1683 microversion: 2.1 time: 0.154648 Oct 24 11:30:15.572261 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3615/7203] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:15 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:16.596053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-de0b340c-c615-439c-be70-16ea8503d91b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:16.596682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-de0b340c-c615-439c-be70-16ea8503d91b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:16.603568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de0b340c-c615-439c-be70-16ea8503d91b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:16.604068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de0b340c-c615-439c-be70-16ea8503d91b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:16.604523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de0b340c-c615-439c-be70-16ea8503d91b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:16.605261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de0b340c-c615-439c-be70-16ea8503d91b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:16.605730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de0b340c-c615-439c-be70-16ea8503d91b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:16.606174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de0b340c-c615-439c-be70-16ea8503d91b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:16.738506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-de0b340c-c615-439c-be70-16ea8503d91b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:16.746238 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-de0b340c-c615-439c-be70-16ea8503d91b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1683 microversion: 2.1 time: 0.154757 Oct 24 11:30:16.746814 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3589/7204] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:16 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:17.488669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-5b02c9e4-484e-446f-be10-4b6945de4998 req-cd4016b7-fdd7-4a7b-9af0-92a63efcbe6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9", "name": "network-vif-unplugged", "status": "completed", "tag": "95330681-f93d-4e46-a8ff-6b09d0385732"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:30:17.498942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5b02c9e4-484e-446f-be10-4b6945de4998 req-cd4016b7-fdd7-4a7b-9af0-92a63efcbe6a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:17.499421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5b02c9e4-484e-446f-be10-4b6945de4998 req-cd4016b7-fdd7-4a7b-9af0-92a63efcbe6a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:17.499887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5b02c9e4-484e-446f-be10-4b6945de4998 req-cd4016b7-fdd7-4a7b-9af0-92a63efcbe6a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:17.513823 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-5b02c9e4-484e-446f-be10-4b6945de4998 req-cd4016b7-fdd7-4a7b-9af0-92a63efcbe6a service nova] Creating event network-vif-unplugged:95330681-f93d-4e46-a8ff-6b09d0385732 for instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 on n-h1-858383-15 Oct 24 11:30:17.519893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [req-5b02c9e4-484e-446f-be10-4b6945de4998 req-cd4016b7-fdd7-4a7b-9af0-92a63efcbe6a service nova] Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120426) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:30:17.530872 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-5b02c9e4-484e-446f-be10-4b6945de4998 req-cd4016b7-fdd7-4a7b-9af0-92a63efcbe6a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046762 Oct 24 11:30:17.531484 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3616/7205] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:30:17.770607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3a6500c1-3af5-4aa9-aba3-930481ae8214 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:17.771248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3a6500c1-3af5-4aa9-aba3-930481ae8214 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:17.778045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a6500c1-3af5-4aa9-aba3-930481ae8214 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:17.778805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a6500c1-3af5-4aa9-aba3-930481ae8214 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:17.779270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a6500c1-3af5-4aa9-aba3-930481ae8214 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:17.779965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a6500c1-3af5-4aa9-aba3-930481ae8214 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:17.781095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a6500c1-3af5-4aa9-aba3-930481ae8214 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:17.781539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3a6500c1-3af5-4aa9-aba3-930481ae8214 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:17.978317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3a6500c1-3af5-4aa9-aba3-930481ae8214 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:17.986237 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3a6500c1-3af5-4aa9-aba3-930481ae8214 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1682 microversion: 2.1 time: 0.220202 Oct 24 11:30:17.987007 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3590/7206] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:17 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1682 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:19.011697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-160123a3-9b2e-42a3-9522-d279157f43ee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:19.012469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-160123a3-9b2e-42a3-9522-d279157f43ee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:19.019093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-160123a3-9b2e-42a3-9522-d279157f43ee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:19.019577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-160123a3-9b2e-42a3-9522-d279157f43ee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:19.020019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-160123a3-9b2e-42a3-9522-d279157f43ee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:19.020711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-160123a3-9b2e-42a3-9522-d279157f43ee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:19.021273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-160123a3-9b2e-42a3-9522-d279157f43ee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:19.021698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-160123a3-9b2e-42a3-9522-d279157f43ee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:19.153011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-160123a3-9b2e-42a3-9522-d279157f43ee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:19.162181 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-160123a3-9b2e-42a3-9522-d279157f43ee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1680 microversion: 2.1 time: 0.155579 Oct 24 11:30:19.162774 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3617/7207] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:19 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:19.553118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-47882b10-4bcc-4210-8a0e-332e4357a61d req-f1a2efdc-51c9-46be-a2d9-bbb85fb081c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9", "tag": "95330681-f93d-4e46-a8ff-6b09d0385732"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:30:19.564339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-47882b10-4bcc-4210-8a0e-332e4357a61d req-f1a2efdc-51c9-46be-a2d9-bbb85fb081c1 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:19.564851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-47882b10-4bcc-4210-8a0e-332e4357a61d req-f1a2efdc-51c9-46be-a2d9-bbb85fb081c1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:19.565296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-47882b10-4bcc-4210-8a0e-332e4357a61d req-f1a2efdc-51c9-46be-a2d9-bbb85fb081c1 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:19.576610 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-47882b10-4bcc-4210-8a0e-332e4357a61d req-f1a2efdc-51c9-46be-a2d9-bbb85fb081c1 service nova] Creating event network-changed:95330681-f93d-4e46-a8ff-6b09d0385732 for instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 on n-h1-858383-15 Oct 24 11:30:19.582425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-47882b10-4bcc-4210-8a0e-332e4357a61d req-f1a2efdc-51c9-46be-a2d9-bbb85fb081c1 service nova] Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:30:19.593171 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-47882b10-4bcc-4210-8a0e-332e4357a61d req-f1a2efdc-51c9-46be-a2d9-bbb85fb081c1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044396 Oct 24 11:30:19.593758 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3591/7208] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:30:20.185085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a8b70b0b-f763-4c78-b4d8-e2906a87bb25 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:20.185724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a8b70b0b-f763-4c78-b4d8-e2906a87bb25 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:20.192814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8b70b0b-f763-4c78-b4d8-e2906a87bb25 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:20.193332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8b70b0b-f763-4c78-b4d8-e2906a87bb25 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:20.193764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8b70b0b-f763-4c78-b4d8-e2906a87bb25 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:20.194448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8b70b0b-f763-4c78-b4d8-e2906a87bb25 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:20.194897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8b70b0b-f763-4c78-b4d8-e2906a87bb25 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:20.195318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a8b70b0b-f763-4c78-b4d8-e2906a87bb25 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:20.332821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a8b70b0b-f763-4c78-b4d8-e2906a87bb25 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:20.340541 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a8b70b0b-f763-4c78-b4d8-e2906a87bb25 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1680 microversion: 2.1 time: 0.159607 Oct 24 11:30:20.341146 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3618/7209] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:20 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:21.364449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9ce3aecd-905e-4f79-884b-2072c7f6ec2f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:21.365209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9ce3aecd-905e-4f79-884b-2072c7f6ec2f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:21.372280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce3aecd-905e-4f79-884b-2072c7f6ec2f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:21.372783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce3aecd-905e-4f79-884b-2072c7f6ec2f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:21.373263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce3aecd-905e-4f79-884b-2072c7f6ec2f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:21.373971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce3aecd-905e-4f79-884b-2072c7f6ec2f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:21.374442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce3aecd-905e-4f79-884b-2072c7f6ec2f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:21.374884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9ce3aecd-905e-4f79-884b-2072c7f6ec2f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:21.508395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9ce3aecd-905e-4f79-884b-2072c7f6ec2f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:21.516370 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9ce3aecd-905e-4f79-884b-2072c7f6ec2f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1680 microversion: 2.1 time: 0.156225 Oct 24 11:30:21.517598 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3592/7210] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:21 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:22.540820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-93946cf4-b097-469a-b681-7846cdce1d6d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:22.541397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-93946cf4-b097-469a-b681-7846cdce1d6d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:22.548915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93946cf4-b097-469a-b681-7846cdce1d6d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:22.549445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93946cf4-b097-469a-b681-7846cdce1d6d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:22.549913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93946cf4-b097-469a-b681-7846cdce1d6d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:22.550655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93946cf4-b097-469a-b681-7846cdce1d6d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:22.551207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93946cf4-b097-469a-b681-7846cdce1d6d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:22.551720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93946cf4-b097-469a-b681-7846cdce1d6d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:22.683586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-93946cf4-b097-469a-b681-7846cdce1d6d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:22.692170 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-93946cf4-b097-469a-b681-7846cdce1d6d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1676 microversion: 2.1 time: 0.155446 Oct 24 11:30:22.692745 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3619/7211] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:22 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:22.715175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ab9aed6-d975-40a5-8993-f66df89d9655 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:30:22.715756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ab9aed6-d975-40a5-8993-f66df89d9655 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:22.723110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ab9aed6-d975-40a5-8993-f66df89d9655 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:22.723612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ab9aed6-d975-40a5-8993-f66df89d9655 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:22.724064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ab9aed6-d975-40a5-8993-f66df89d9655 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:22.724769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ab9aed6-d975-40a5-8993-f66df89d9655 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:22.725270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ab9aed6-d975-40a5-8993-f66df89d9655 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:22.725709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ab9aed6-d975-40a5-8993-f66df89d9655 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:22.783470 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ab9aed6-d975-40a5-8993-f66df89d9655 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "POST /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9/action" status: 204 len: 0 microversion: 2.1 time: 0.071937 Oct 24 11:30:22.784314 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3593/7212] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:30:22 2022] POST /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:30:22.794038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-90c24e44-7a6d-4d30-841f-4fc0c750960d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:22.794798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-90c24e44-7a6d-4d30-841f-4fc0c750960d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:22.802083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90c24e44-7a6d-4d30-841f-4fc0c750960d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:22.802929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90c24e44-7a6d-4d30-841f-4fc0c750960d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:22.803721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90c24e44-7a6d-4d30-841f-4fc0c750960d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:22.804496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90c24e44-7a6d-4d30-841f-4fc0c750960d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:22.804971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90c24e44-7a6d-4d30-841f-4fc0c750960d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:22.805402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90c24e44-7a6d-4d30-841f-4fc0c750960d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:22.953511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-90c24e44-7a6d-4d30-841f-4fc0c750960d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:22.962169 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-90c24e44-7a6d-4d30-841f-4fc0c750960d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1676 microversion: 2.1 time: 0.173814 Oct 24 11:30:22.962750 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3620/7213] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:22 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:23.988443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2e898779-e87c-4657-98ae-c9aa0b5c5dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:23.989163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2e898779-e87c-4657-98ae-c9aa0b5c5dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:23.995330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e898779-e87c-4657-98ae-c9aa0b5c5dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:23.995830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e898779-e87c-4657-98ae-c9aa0b5c5dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:23.996288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e898779-e87c-4657-98ae-c9aa0b5c5dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:23.997035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e898779-e87c-4657-98ae-c9aa0b5c5dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:23.997516 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e898779-e87c-4657-98ae-c9aa0b5c5dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:23.997965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e898779-e87c-4657-98ae-c9aa0b5c5dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:24.139447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2e898779-e87c-4657-98ae-c9aa0b5c5dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:24.148056 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2e898779-e87c-4657-98ae-c9aa0b5c5dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1676 microversion: 2.1 time: 0.164988 Oct 24 11:30:24.148635 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3594/7214] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:23 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:24.359300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-cf168b27-725b-4042-af04-19822944c7a8 req-e9facb5e-258f-4968-b61d-7f3a2cc2052e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9", "name": "network-vif-plugged", "status": "completed", "tag": "95330681-f93d-4e46-a8ff-6b09d0385732"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:30:24.370425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cf168b27-725b-4042-af04-19822944c7a8 req-e9facb5e-258f-4968-b61d-7f3a2cc2052e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:24.370907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cf168b27-725b-4042-af04-19822944c7a8 req-e9facb5e-258f-4968-b61d-7f3a2cc2052e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:24.371357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-cf168b27-725b-4042-af04-19822944c7a8 req-e9facb5e-258f-4968-b61d-7f3a2cc2052e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:24.383167 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-cf168b27-725b-4042-af04-19822944c7a8 req-e9facb5e-258f-4968-b61d-7f3a2cc2052e service nova] Creating event network-vif-plugged:95330681-f93d-4e46-a8ff-6b09d0385732 for instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 on n-h1-858383-15 Oct 24 11:30:24.388200 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-cf168b27-725b-4042-af04-19822944c7a8 req-e9facb5e-258f-4968-b61d-7f3a2cc2052e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032652 Oct 24 11:30:24.388812 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3621/7215] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:30:25.172715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e6db68f-d809-467a-9cb5-a391e6173b92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:25.173466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0e6db68f-d809-467a-9cb5-a391e6173b92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:25.180446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e6db68f-d809-467a-9cb5-a391e6173b92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:25.181033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e6db68f-d809-467a-9cb5-a391e6173b92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:25.181488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e6db68f-d809-467a-9cb5-a391e6173b92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:25.182189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e6db68f-d809-467a-9cb5-a391e6173b92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:25.182652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e6db68f-d809-467a-9cb5-a391e6173b92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:25.183088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e6db68f-d809-467a-9cb5-a391e6173b92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:25.340398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0e6db68f-d809-467a-9cb5-a391e6173b92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:25.349209 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e6db68f-d809-467a-9cb5-a391e6173b92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1655 microversion: 2.1 time: 0.180257 Oct 24 11:30:25.349793 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3595/7216] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:25 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1655 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:25.369346 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:30:25.369824 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:30:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 (ip 10.222.0.50) !!! Oct 24 11:30:25.375223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cc84aff8-a0a7-4172-91f5-95b7b9f3eeee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:25.377829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cc84aff8-a0a7-4172-91f5-95b7b9f3eeee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:25.385314 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc84aff8-a0a7-4172-91f5-95b7b9f3eeee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:25.385975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc84aff8-a0a7-4172-91f5-95b7b9f3eeee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:25.386466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc84aff8-a0a7-4172-91f5-95b7b9f3eeee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:25.387179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc84aff8-a0a7-4172-91f5-95b7b9f3eeee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:25.387670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc84aff8-a0a7-4172-91f5-95b7b9f3eeee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:25.388110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc84aff8-a0a7-4172-91f5-95b7b9f3eeee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:25.536907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cc84aff8-a0a7-4172-91f5-95b7b9f3eeee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:25.544681 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cc84aff8-a0a7-4172-91f5-95b7b9f3eeee tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1655 microversion: 2.1 time: 0.176553 Oct 24 11:30:25.545299 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3622/7217] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:25 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1655 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:25.568475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6d70bf56-4a04-42b8-8bdf-3119000b222a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:30:25.570836 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:30:25.570989 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:30:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9/action (ip 10.222.0.50) !!! Oct 24 11:30:25.579011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d70bf56-4a04-42b8-8bdf-3119000b222a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:25.580235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d70bf56-4a04-42b8-8bdf-3119000b222a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:25.580697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6d70bf56-4a04-42b8-8bdf-3119000b222a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:25.595539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:30:25.605144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6d70bf56-4a04-42b8-8bdf-3119000b222a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Going to try to start instance {{(pid=120425) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 11:30:25.647346 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6d70bf56-4a04-42b8-8bdf-3119000b222a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "POST /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9/action" status: 202 len: 0 microversion: 2.1 time: 0.083002 Oct 24 11:30:25.647875 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3596/7218] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:30:25 2022] POST /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:30:25.656761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d2d26a3c-76ce-403b-a19a-927579c49601 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:25.657460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d2d26a3c-76ce-403b-a19a-927579c49601 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:25.664278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2d26a3c-76ce-403b-a19a-927579c49601 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:25.664807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2d26a3c-76ce-403b-a19a-927579c49601 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:25.665274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2d26a3c-76ce-403b-a19a-927579c49601 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:25.666218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2d26a3c-76ce-403b-a19a-927579c49601 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:25.667233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2d26a3c-76ce-403b-a19a-927579c49601 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:25.667233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2d26a3c-76ce-403b-a19a-927579c49601 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:25.837690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d2d26a3c-76ce-403b-a19a-927579c49601 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:25.845539 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d2d26a3c-76ce-403b-a19a-927579c49601 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1664 microversion: 2.1 time: 0.192969 Oct 24 11:30:25.846247 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3623/7219] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:25 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1664 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:26.871309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-908f2ebb-42d6-4705-a007-0d86f09a7dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:26.871947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-908f2ebb-42d6-4705-a007-0d86f09a7dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:26.879166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-908f2ebb-42d6-4705-a007-0d86f09a7dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:26.879970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-908f2ebb-42d6-4705-a007-0d86f09a7dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:26.880657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-908f2ebb-42d6-4705-a007-0d86f09a7dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:26.881448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-908f2ebb-42d6-4705-a007-0d86f09a7dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:26.881926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-908f2ebb-42d6-4705-a007-0d86f09a7dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:26.882412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-908f2ebb-42d6-4705-a007-0d86f09a7dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:27.027715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-908f2ebb-42d6-4705-a007-0d86f09a7dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:27.036055 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-908f2ebb-42d6-4705-a007-0d86f09a7dda tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1668 microversion: 2.1 time: 0.170009 Oct 24 11:30:27.036635 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3597/7220] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:26 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1668 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:27.059318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-db1eab43-fe5f-4955-881e-a139a5f612de tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:27.059826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-db1eab43-fe5f-4955-881e-a139a5f612de tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:27.067332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db1eab43-fe5f-4955-881e-a139a5f612de tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:27.067819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db1eab43-fe5f-4955-881e-a139a5f612de tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:27.068263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db1eab43-fe5f-4955-881e-a139a5f612de tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:27.068996 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db1eab43-fe5f-4955-881e-a139a5f612de tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:27.069457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db1eab43-fe5f-4955-881e-a139a5f612de tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:27.069889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db1eab43-fe5f-4955-881e-a139a5f612de tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:27.088989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:30:27.098057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-db1eab43-fe5f-4955-881e-a139a5f612de tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:30:27.175688 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-db1eab43-fe5f-4955-881e-a139a5f612de tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 204 len: 0 microversion: 2.1 time: 0.119966 Oct 24 11:30:27.176286 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3624/7221] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:30:27 2022] DELETE /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:30:27.184567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0e20122-748a-4576-97f6-5fd52a0d03eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:27.185233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f0e20122-748a-4576-97f6-5fd52a0d03eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:27.192380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0e20122-748a-4576-97f6-5fd52a0d03eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:27.192906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0e20122-748a-4576-97f6-5fd52a0d03eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:27.193362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0e20122-748a-4576-97f6-5fd52a0d03eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:27.194077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0e20122-748a-4576-97f6-5fd52a0d03eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:27.194544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0e20122-748a-4576-97f6-5fd52a0d03eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:27.194988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0e20122-748a-4576-97f6-5fd52a0d03eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:27.325692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f0e20122-748a-4576-97f6-5fd52a0d03eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:27.333800 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f0e20122-748a-4576-97f6-5fd52a0d03eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1674 microversion: 2.1 time: 0.153100 Oct 24 11:30:27.334368 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3598/7222] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:27 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:28.358067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-11ed8a83-dc03-4e5d-b754-79af7bd98cc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:28.358812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-11ed8a83-dc03-4e5d-b754-79af7bd98cc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:28.365687 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ed8a83-dc03-4e5d-b754-79af7bd98cc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:28.366166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ed8a83-dc03-4e5d-b754-79af7bd98cc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:28.366595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ed8a83-dc03-4e5d-b754-79af7bd98cc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:28.367276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ed8a83-dc03-4e5d-b754-79af7bd98cc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:28.367724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ed8a83-dc03-4e5d-b754-79af7bd98cc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:28.368145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-11ed8a83-dc03-4e5d-b754-79af7bd98cc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:28.504183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-11ed8a83-dc03-4e5d-b754-79af7bd98cc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:28.512260 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-11ed8a83-dc03-4e5d-b754-79af7bd98cc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1674 microversion: 2.1 time: 0.158415 Oct 24 11:30:28.512852 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3625/7223] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:28 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:29.536076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ce3b4b47-51d8-4f4f-bae7-07222102fd00 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:29.536710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ce3b4b47-51d8-4f4f-bae7-07222102fd00 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:29.543474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce3b4b47-51d8-4f4f-bae7-07222102fd00 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:29.544155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce3b4b47-51d8-4f4f-bae7-07222102fd00 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:29.550617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce3b4b47-51d8-4f4f-bae7-07222102fd00 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:29.551426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce3b4b47-51d8-4f4f-bae7-07222102fd00 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:29.552099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce3b4b47-51d8-4f4f-bae7-07222102fd00 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:29.552485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce3b4b47-51d8-4f4f-bae7-07222102fd00 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:29.598661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-2c5ffe6c-b0f1-490f-be69-fe1f1e99bee3 req-5dc14357-b5ef-4b2a-885f-76e8125a3103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9", "name": "network-vif-deleted", "tag": "95330681-f93d-4e46-a8ff-6b09d0385732"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:30:29.616209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2c5ffe6c-b0f1-490f-be69-fe1f1e99bee3 req-5dc14357-b5ef-4b2a-885f-76e8125a3103 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:29.617165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2c5ffe6c-b0f1-490f-be69-fe1f1e99bee3 req-5dc14357-b5ef-4b2a-885f-76e8125a3103 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:29.617780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2c5ffe6c-b0f1-490f-be69-fe1f1e99bee3 req-5dc14357-b5ef-4b2a-885f-76e8125a3103 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:29.626082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce3b4b47-51d8-4f4f-bae7-07222102fd00 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:29.633180 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-2c5ffe6c-b0f1-490f-be69-fe1f1e99bee3 req-5dc14357-b5ef-4b2a-885f-76e8125a3103 service nova] Creating event network-vif-deleted:95330681-f93d-4e46-a8ff-6b09d0385732 for instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 on n-h1-858383-15 Oct 24 11:30:29.635366 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ce3b4b47-51d8-4f4f-bae7-07222102fd00 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 200 len: 1607 microversion: 2.1 time: 0.103413 Oct 24 11:30:29.636013 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3599/7224] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:29 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 1607 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:29.641400 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-2c5ffe6c-b0f1-490f-be69-fe1f1e99bee3 req-5dc14357-b5ef-4b2a-885f-76e8125a3103 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048350 Oct 24 11:30:29.642551 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3626/7225] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:30:30.660891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-83af5abd-6ed6-494c-b8ab-380dc22bd429 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:30.661521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-83af5abd-6ed6-494c-b8ab-380dc22bd429 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:30.668380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83af5abd-6ed6-494c-b8ab-380dc22bd429 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:30.668909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83af5abd-6ed6-494c-b8ab-380dc22bd429 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:30.669369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83af5abd-6ed6-494c-b8ab-380dc22bd429 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:30.670081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83af5abd-6ed6-494c-b8ab-380dc22bd429 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:30.670551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83af5abd-6ed6-494c-b8ab-380dc22bd429 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:30.670993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-83af5abd-6ed6-494c-b8ab-380dc22bd429 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:30.685422 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-83af5abd-6ed6-494c-b8ab-380dc22bd429 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] HTTP exception thrown: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-83af5abd-6ed6-494c-b8ab-380dc22bd429 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Request method failure captured: Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 HTTP/1.1 Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnaUzJMxVmO-HtBWBYSLYY__i8Ec4H_cXbVc5xd3yGDLsMf1ETMejFCnWUyp9G8494iE9lwNZ1O-SL8TGXN5cFSCNrWBYv6wZLOJycdTlyT8sc_7tYAGIgmUERtptmQ1I6PrKjKFKSYn1GiUZKbvWNa596EQvJKNpX9sOkD72kPfq90 Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c0ac700abd24e4ea516532577c09aa5", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 879b06d644fa496c94f9226f23d79716 Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9'} Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:30:30.687034 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:30:30.691061 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:30:30.691061 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:30:30.691061 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:30:30.691061 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:30:30.691061 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:30:30.691061 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:30:30.691061 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:30:30.691061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-83af5abd-6ed6-494c-b8ab-380dc22bd429 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Returning 404 to user: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:30:30.691061 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-83af5abd-6ed6-494c-b8ab-380dc22bd429 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 404 len: 111 microversion: 2.1 time: 0.032419 Oct 24 11:30:30.691061 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3600/7226] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:30 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:30:30.708374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-191be087-21a0-4f27-92d7-6415c39b9fdd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:30.709138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-191be087-21a0-4f27-92d7-6415c39b9fdd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:30.716134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-191be087-21a0-4f27-92d7-6415c39b9fdd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:30.716623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-191be087-21a0-4f27-92d7-6415c39b9fdd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:30.717093 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-191be087-21a0-4f27-92d7-6415c39b9fdd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:30.717805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-191be087-21a0-4f27-92d7-6415c39b9fdd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:30.718268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-191be087-21a0-4f27-92d7-6415c39b9fdd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:30.718699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-191be087-21a0-4f27-92d7-6415c39b9fdd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:30.733089 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-191be087-21a0-4f27-92d7-6415c39b9fdd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] HTTP exception thrown: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-191be087-21a0-4f27-92d7-6415c39b9fdd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Request method failure captured: Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 HTTP/1.1 Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnaUzJMxVmO-HtBWBYSLYY__i8Ec4H_cXbVc5xd3yGDLsMf1ETMejFCnWUyp9G8494iE9lwNZ1O-SL8TGXN5cFSCNrWBYv6wZLOJycdTlyT8sc_7tYAGIgmUERtptmQ1I6PrKjKFKSYn1GiUZKbvWNa596EQvJKNpX9sOkD72kPfq90 Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c0ac700abd24e4ea516532577c09aa5", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 879b06d644fa496c94f9226f23d79716 Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9'} Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:30:30.734763 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:30:30.744940 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:30:30.744940 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:30:30.744940 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:30:30.744940 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:30:30.744940 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:30:30.744940 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:30:30.744940 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:30:30.744940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-191be087-21a0-4f27-92d7-6415c39b9fdd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Returning 404 to user: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:30:30.744940 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-191be087-21a0-4f27-92d7-6415c39b9fdd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 404 len: 111 microversion: 2.1 time: 0.032939 Oct 24 11:30:30.744940 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3627/7227] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:30 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 11:30:30.788492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-47593a12-9925-4292-a7e6-3eb0db25437b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-639478452", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "8220ee77-95f2-48de-8da4-516f3afce857"}], "security_groups": [{"name": "tempest-securitygroup--485148156"}], "key_name": "tempest-keypair-1192870934", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:30:30.893956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-47593a12-9925-4292-a7e6-3eb0db25437b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] validate_networks() for [('8220ee77-95f2-48de-8da4-516f3afce857', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:30:31.309119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-47593a12-9925-4292-a7e6-3eb0db25437b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:30:31.309573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-47593a12-9925-4292-a7e6-3eb0db25437b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:30:31.310065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-47593a12-9925-4292-a7e6-3eb0db25437b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:30:31.310492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-47593a12-9925-4292-a7e6-3eb0db25437b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:30:31.310922 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-47593a12-9925-4292-a7e6-3eb0db25437b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:30:31.320279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47593a12-9925-4292-a7e6-3eb0db25437b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:31.320777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47593a12-9925-4292-a7e6-3eb0db25437b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:31.321264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47593a12-9925-4292-a7e6-3eb0db25437b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:31.322031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47593a12-9925-4292-a7e6-3eb0db25437b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:31.322490 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47593a12-9925-4292-a7e6-3eb0db25437b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:31.322936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47593a12-9925-4292-a7e6-3eb0db25437b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:31.340102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-47593a12-9925-4292-a7e6-3eb0db25437b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Getting quotas for project 4c0ac700abd24e4ea516532577c09aa5. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:30:31.345510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-47593a12-9925-4292-a7e6-3eb0db25437b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Getting quotas for user 879b06d644fa496c94f9226f23d79716 and project 4c0ac700abd24e4ea516532577c09aa5. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:30:31.357692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-47593a12-9925-4292-a7e6-3eb0db25437b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:30:31.359995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-47593a12-9925-4292-a7e6-3eb0db25437b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:30:31.407153 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-47593a12-9925-4292-a7e6-3eb0db25437b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.622509 Oct 24 11:30:31.408219 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3601/7228] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:30:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:30:31.419481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bf2b2459-388a-4868-b817-93889766cc9f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:31.420225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bf2b2459-388a-4868-b817-93889766cc9f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:31.476763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bf2b2459-388a-4868-b817-93889766cc9f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:31.483797 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bf2b2459-388a-4868-b817-93889766cc9f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1238 microversion: 2.1 time: 0.068189 Oct 24 11:30:31.484373 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3628/7229] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:31 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:32.509344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd43fcf7-54f3-4cb0-950b-fe5ea76897d4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:32.509979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bd43fcf7-54f3-4cb0-950b-fe5ea76897d4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:32.512749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:30:32.518267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd43fcf7-54f3-4cb0-950b-fe5ea76897d4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:32.518778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd43fcf7-54f3-4cb0-950b-fe5ea76897d4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:32.519232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd43fcf7-54f3-4cb0-950b-fe5ea76897d4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:32.520149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd43fcf7-54f3-4cb0-950b-fe5ea76897d4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:32.520624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd43fcf7-54f3-4cb0-950b-fe5ea76897d4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:32.521169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd43fcf7-54f3-4cb0-950b-fe5ea76897d4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:32.590920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bd43fcf7-54f3-4cb0-950b-fe5ea76897d4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:32.599093 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bd43fcf7-54f3-4cb0-950b-fe5ea76897d4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1298 microversion: 2.1 time: 0.094625 Oct 24 11:30:32.599973 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3602/7230] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:32 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:33.623693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a7199cbb-6b20-4ad2-9f2d-d31ea8304427 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:33.624305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a7199cbb-6b20-4ad2-9f2d-d31ea8304427 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:33.628724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:30:33.634698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7199cbb-6b20-4ad2-9f2d-d31ea8304427 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:33.635088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7199cbb-6b20-4ad2-9f2d-d31ea8304427 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:33.635679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7199cbb-6b20-4ad2-9f2d-d31ea8304427 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:33.636389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7199cbb-6b20-4ad2-9f2d-d31ea8304427 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:33.636860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7199cbb-6b20-4ad2-9f2d-d31ea8304427 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:33.637292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7199cbb-6b20-4ad2-9f2d-d31ea8304427 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:33.773741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a7199cbb-6b20-4ad2-9f2d-d31ea8304427 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:33.781640 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a7199cbb-6b20-4ad2-9f2d-d31ea8304427 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1363 microversion: 2.1 time: 0.161845 Oct 24 11:30:33.782214 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3629/7231] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:33 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:34.289671 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e0dd79e1-53b6-4586-a396-8dc118992a2f req-918aa3a7-106f-485f-828c-de560fc6f3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc17bafd-d889-4fab-ad53-9ffd075ba33d", "tag": "f8d6f982-e4ce-4d9e-b8dd-8c8270a68a4d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:30:34.302309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e0dd79e1-53b6-4586-a396-8dc118992a2f req-918aa3a7-106f-485f-828c-de560fc6f3c7 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:34.302814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e0dd79e1-53b6-4586-a396-8dc118992a2f req-918aa3a7-106f-485f-828c-de560fc6f3c7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:34.303293 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e0dd79e1-53b6-4586-a396-8dc118992a2f req-918aa3a7-106f-485f-828c-de560fc6f3c7 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:34.315618 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e0dd79e1-53b6-4586-a396-8dc118992a2f req-918aa3a7-106f-485f-828c-de560fc6f3c7 service nova] Creating event network-changed:f8d6f982-e4ce-4d9e-b8dd-8c8270a68a4d for instance bc17bafd-d889-4fab-ad53-9ffd075ba33d on n-h2-858383-15 Oct 24 11:30:34.320742 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e0dd79e1-53b6-4586-a396-8dc118992a2f req-918aa3a7-106f-485f-828c-de560fc6f3c7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035796 Oct 24 11:30:34.321493 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3603/7232] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:30:34.805771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f13d8193-d499-4c38-b602-aec1ee12198c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:34.806308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f13d8193-d499-4c38-b602-aec1ee12198c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:34.813127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f13d8193-d499-4c38-b602-aec1ee12198c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:34.814333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f13d8193-d499-4c38-b602-aec1ee12198c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:34.814779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f13d8193-d499-4c38-b602-aec1ee12198c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:34.815453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f13d8193-d499-4c38-b602-aec1ee12198c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:34.815899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f13d8193-d499-4c38-b602-aec1ee12198c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:34.816322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f13d8193-d499-4c38-b602-aec1ee12198c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:34.953414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f13d8193-d499-4c38-b602-aec1ee12198c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:34.961250 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f13d8193-d499-4c38-b602-aec1ee12198c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1363 microversion: 2.1 time: 0.159379 Oct 24 11:30:34.961831 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3630/7233] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:34 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:35.986801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0b721a10-e8e3-4b83-8dcb-79d53bfba921 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:35.987653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0b721a10-e8e3-4b83-8dcb-79d53bfba921 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:35.993803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b721a10-e8e3-4b83-8dcb-79d53bfba921 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:35.994303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b721a10-e8e3-4b83-8dcb-79d53bfba921 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:35.994760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b721a10-e8e3-4b83-8dcb-79d53bfba921 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:35.995472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b721a10-e8e3-4b83-8dcb-79d53bfba921 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:35.995942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b721a10-e8e3-4b83-8dcb-79d53bfba921 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:35.996385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b721a10-e8e3-4b83-8dcb-79d53bfba921 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:36.136493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0b721a10-e8e3-4b83-8dcb-79d53bfba921 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:36.144471 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0b721a10-e8e3-4b83-8dcb-79d53bfba921 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1363 microversion: 2.1 time: 0.162941 Oct 24 11:30:36.145073 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3604/7234] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:35 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:37.167507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e8ec4c7-1c00-431f-a109-b5dc5c1c13e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:37.168123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1e8ec4c7-1c00-431f-a109-b5dc5c1c13e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:37.175831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e8ec4c7-1c00-431f-a109-b5dc5c1c13e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:37.176312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e8ec4c7-1c00-431f-a109-b5dc5c1c13e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:37.176748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e8ec4c7-1c00-431f-a109-b5dc5c1c13e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:37.177468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e8ec4c7-1c00-431f-a109-b5dc5c1c13e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:37.177923 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e8ec4c7-1c00-431f-a109-b5dc5c1c13e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:37.178349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e8ec4c7-1c00-431f-a109-b5dc5c1c13e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:37.311814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1e8ec4c7-1c00-431f-a109-b5dc5c1c13e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:37.319684 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1e8ec4c7-1c00-431f-a109-b5dc5c1c13e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1363 microversion: 2.1 time: 0.155976 Oct 24 11:30:37.320268 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3631/7235] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:37 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:38.343364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e2b0ce7-9c6a-4ed9-8cc9-efe7176b2a18 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:38.343993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5e2b0ce7-9c6a-4ed9-8cc9-efe7176b2a18 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:38.351075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e2b0ce7-9c6a-4ed9-8cc9-efe7176b2a18 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:38.351572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e2b0ce7-9c6a-4ed9-8cc9-efe7176b2a18 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:38.352023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e2b0ce7-9c6a-4ed9-8cc9-efe7176b2a18 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:38.352732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e2b0ce7-9c6a-4ed9-8cc9-efe7176b2a18 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:38.353227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e2b0ce7-9c6a-4ed9-8cc9-efe7176b2a18 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:38.353669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e2b0ce7-9c6a-4ed9-8cc9-efe7176b2a18 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:38.487309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5e2b0ce7-9c6a-4ed9-8cc9-efe7176b2a18 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:38.495124 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5e2b0ce7-9c6a-4ed9-8cc9-efe7176b2a18 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1363 microversion: 2.1 time: 0.155648 Oct 24 11:30:38.495699 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3605/7236] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:38 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:39.025020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-b4d11642-9903-45dc-aa2b-4023230709f3 req-f9e53bbf-274c-4756-856a-c168012f3848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc17bafd-d889-4fab-ad53-9ffd075ba33d", "name": "network-vif-plugged", "status": "completed", "tag": "f8d6f982-e4ce-4d9e-b8dd-8c8270a68a4d"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:30:39.035992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b4d11642-9903-45dc-aa2b-4023230709f3 req-f9e53bbf-274c-4756-856a-c168012f3848 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:39.036475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b4d11642-9903-45dc-aa2b-4023230709f3 req-f9e53bbf-274c-4756-856a-c168012f3848 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:39.037126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b4d11642-9903-45dc-aa2b-4023230709f3 req-f9e53bbf-274c-4756-856a-c168012f3848 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:39.048183 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-b4d11642-9903-45dc-aa2b-4023230709f3 req-f9e53bbf-274c-4756-856a-c168012f3848 service nova] Creating event network-vif-plugged:f8d6f982-e4ce-4d9e-b8dd-8c8270a68a4d for instance bc17bafd-d889-4fab-ad53-9ffd075ba33d on n-h2-858383-15 Oct 24 11:30:39.053127 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-b4d11642-9903-45dc-aa2b-4023230709f3 req-f9e53bbf-274c-4756-856a-c168012f3848 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031808 Oct 24 11:30:39.053895 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3632/7237] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:30:39.519330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ace114c3-50f9-42da-a7f6-13a52ea38f7c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:39.519949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ace114c3-50f9-42da-a7f6-13a52ea38f7c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:39.526896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ace114c3-50f9-42da-a7f6-13a52ea38f7c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:39.527391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ace114c3-50f9-42da-a7f6-13a52ea38f7c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:39.527839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ace114c3-50f9-42da-a7f6-13a52ea38f7c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:39.528534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ace114c3-50f9-42da-a7f6-13a52ea38f7c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:39.529294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ace114c3-50f9-42da-a7f6-13a52ea38f7c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:39.529731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ace114c3-50f9-42da-a7f6-13a52ea38f7c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:39.660130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ace114c3-50f9-42da-a7f6-13a52ea38f7c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:39.667784 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ace114c3-50f9-42da-a7f6-13a52ea38f7c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1363 microversion: 2.1 time: 0.152552 Oct 24 11:30:39.668347 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3606/7238] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:39 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:40.692763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c8e14d97-08d0-4218-8dcd-fa67e4ae06dd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:40.693492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c8e14d97-08d0-4218-8dcd-fa67e4ae06dd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:40.700464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8e14d97-08d0-4218-8dcd-fa67e4ae06dd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:40.700969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8e14d97-08d0-4218-8dcd-fa67e4ae06dd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:40.701408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8e14d97-08d0-4218-8dcd-fa67e4ae06dd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:40.702095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8e14d97-08d0-4218-8dcd-fa67e4ae06dd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:40.702548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8e14d97-08d0-4218-8dcd-fa67e4ae06dd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:40.702972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c8e14d97-08d0-4218-8dcd-fa67e4ae06dd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:40.832481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c8e14d97-08d0-4218-8dcd-fa67e4ae06dd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:30:40.840293 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c8e14d97-08d0-4218-8dcd-fa67e4ae06dd tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1549 microversion: 2.1 time: 0.152246 Oct 24 11:30:40.840888 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3633/7239] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:30:40 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:30:40.864208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3086be1e-98f7-479f-8d24-feb3eb8ea786 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:30:40.864742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3086be1e-98f7-479f-8d24-feb3eb8ea786 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:30:40.871499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3086be1e-98f7-479f-8d24-feb3eb8ea786 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:40.871991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3086be1e-98f7-479f-8d24-feb3eb8ea786 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:40.872438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3086be1e-98f7-479f-8d24-feb3eb8ea786 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:40.873174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3086be1e-98f7-479f-8d24-feb3eb8ea786 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:40.873638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3086be1e-98f7-479f-8d24-feb3eb8ea786 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:40.874071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3086be1e-98f7-479f-8d24-feb3eb8ea786 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:40.955254 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3086be1e-98f7-479f-8d24-feb3eb8ea786 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095592 Oct 24 11:30:40.955857 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3607/7240] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 11:30:40 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:30:42.159951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-8ee82b55-c6a6-4b1a-b5bd-8698b7e63891 req-484b4cb3-e1cf-4a73-836a-a7259b3dea24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc17bafd-d889-4fab-ad53-9ffd075ba33d", "tag": "f8d6f982-e4ce-4d9e-b8dd-8c8270a68a4d"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:30:42.165935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:30:42.173684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8ee82b55-c6a6-4b1a-b5bd-8698b7e63891 req-484b4cb3-e1cf-4a73-836a-a7259b3dea24 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:30:42.174572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8ee82b55-c6a6-4b1a-b5bd-8698b7e63891 req-484b4cb3-e1cf-4a73-836a-a7259b3dea24 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:30:42.175081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-8ee82b55-c6a6-4b1a-b5bd-8698b7e63891 req-484b4cb3-e1cf-4a73-836a-a7259b3dea24 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:30:42.187723 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-8ee82b55-c6a6-4b1a-b5bd-8698b7e63891 req-484b4cb3-e1cf-4a73-836a-a7259b3dea24 service nova] Creating event network-changed:f8d6f982-e4ce-4d9e-b8dd-8c8270a68a4d for instance bc17bafd-d889-4fab-ad53-9ffd075ba33d on n-h2-858383-15 Oct 24 11:30:42.194042 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-8ee82b55-c6a6-4b1a-b5bd-8698b7e63891 req-484b4cb3-e1cf-4a73-836a-a7259b3dea24 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037410 Oct 24 11:30:42.194719 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3634/7241] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:31:15.245036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:31:15.245824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:31:15.247828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=11 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:31:15.248550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:31:15.252718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ccea4808-4be4-40e0-90ba-3625a99d31a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:31:15.255134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ccea4808-4be4-40e0-90ba-3625a99d31a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:15.266450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccea4808-4be4-40e0-90ba-3625a99d31a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:15.266952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccea4808-4be4-40e0-90ba-3625a99d31a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:15.267403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccea4808-4be4-40e0-90ba-3625a99d31a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:15.268113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccea4808-4be4-40e0-90ba-3625a99d31a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:15.268592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccea4808-4be4-40e0-90ba-3625a99d31a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:15.269068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccea4808-4be4-40e0-90ba-3625a99d31a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:15.298840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ccea4808-4be4-40e0-90ba-3625a99d31a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:15.304781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ccea4808-4be4-40e0-90ba-3625a99d31a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Old instance type m1.heat2, new instance type m1.heat {{(pid=120425) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 24 11:31:15.312573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ccea4808-4be4-40e0-90ba-3625a99d31a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:31:15.313046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ccea4808-4be4-40e0-90ba-3625a99d31a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:31:15.313537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ccea4808-4be4-40e0-90ba-3625a99d31a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:31:15.313963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ccea4808-4be4-40e0-90ba-3625a99d31a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:31:15.314391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ccea4808-4be4-40e0-90ba-3625a99d31a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:31:15.377701 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ccea4808-4be4-40e0-90ba-3625a99d31a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "POST /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d/action" status: 202 len: 0 microversion: 2.1 time: 0.133379 Oct 24 11:31:15.378429 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3608/7242] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:31:15 2022] POST /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:31:15.387957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2017fbc5-807b-4745-95bb-441de2322b2d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:15.388752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2017fbc5-807b-4745-95bb-441de2322b2d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:15.390971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=11 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:31:15.391659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:31:15.398476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2017fbc5-807b-4745-95bb-441de2322b2d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:15.398964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2017fbc5-807b-4745-95bb-441de2322b2d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:15.399416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2017fbc5-807b-4745-95bb-441de2322b2d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:15.400396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2017fbc5-807b-4745-95bb-441de2322b2d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:15.400909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2017fbc5-807b-4745-95bb-441de2322b2d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:15.401571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2017fbc5-807b-4745-95bb-441de2322b2d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:15.544924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2017fbc5-807b-4745-95bb-441de2322b2d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:15.554323 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2017fbc5-807b-4745-95bb-441de2322b2d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1677 microversion: 2.1 time: 0.170983 Oct 24 11:31:15.555105 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3635/7243] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:15 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:16.579322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef9b01b5-5812-4dc8-854d-9f0d590c85d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:16.579886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ef9b01b5-5812-4dc8-854d-9f0d590c85d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:16.586632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef9b01b5-5812-4dc8-854d-9f0d590c85d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:16.587185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef9b01b5-5812-4dc8-854d-9f0d590c85d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:16.587646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef9b01b5-5812-4dc8-854d-9f0d590c85d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:16.588374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef9b01b5-5812-4dc8-854d-9f0d590c85d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:16.588870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef9b01b5-5812-4dc8-854d-9f0d590c85d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:16.589330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef9b01b5-5812-4dc8-854d-9f0d590c85d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:16.726203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ef9b01b5-5812-4dc8-854d-9f0d590c85d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:16.734149 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef9b01b5-5812-4dc8-854d-9f0d590c85d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1677 microversion: 2.1 time: 0.159684 Oct 24 11:31:16.734719 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3609/7244] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:16 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:17.758433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-146dbcf2-cb2a-4684-abed-f37d3c0af0b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:17.759062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-146dbcf2-cb2a-4684-abed-f37d3c0af0b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:17.765821 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-146dbcf2-cb2a-4684-abed-f37d3c0af0b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:17.766308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-146dbcf2-cb2a-4684-abed-f37d3c0af0b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:17.766750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-146dbcf2-cb2a-4684-abed-f37d3c0af0b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:17.767444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-146dbcf2-cb2a-4684-abed-f37d3c0af0b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:17.767901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-146dbcf2-cb2a-4684-abed-f37d3c0af0b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:17.768363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-146dbcf2-cb2a-4684-abed-f37d3c0af0b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:17.900086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-146dbcf2-cb2a-4684-abed-f37d3c0af0b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:17.908128 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-146dbcf2-cb2a-4684-abed-f37d3c0af0b5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1682 microversion: 2.1 time: 0.153911 Oct 24 11:31:17.908705 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3636/7245] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:17 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:18.932487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-71739277-bdc6-43d5-928d-55abb0a577eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:18.933148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-71739277-bdc6-43d5-928d-55abb0a577eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:18.939938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71739277-bdc6-43d5-928d-55abb0a577eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:18.940430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71739277-bdc6-43d5-928d-55abb0a577eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:18.940907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71739277-bdc6-43d5-928d-55abb0a577eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:18.941609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71739277-bdc6-43d5-928d-55abb0a577eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:18.942079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71739277-bdc6-43d5-928d-55abb0a577eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:18.943217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71739277-bdc6-43d5-928d-55abb0a577eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:19.071345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-71739277-bdc6-43d5-928d-55abb0a577eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:19.079051 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-71739277-bdc6-43d5-928d-55abb0a577eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1682 microversion: 2.1 time: 0.150460 Oct 24 11:31:19.079615 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3610/7246] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:18 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:20.103778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7a29a921-c391-419e-aa11-8f90f7de6dc2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:20.104396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7a29a921-c391-419e-aa11-8f90f7de6dc2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:20.111481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a29a921-c391-419e-aa11-8f90f7de6dc2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:20.111961 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a29a921-c391-419e-aa11-8f90f7de6dc2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:20.112397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a29a921-c391-419e-aa11-8f90f7de6dc2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:20.113123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a29a921-c391-419e-aa11-8f90f7de6dc2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:20.113579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a29a921-c391-419e-aa11-8f90f7de6dc2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:20.114004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7a29a921-c391-419e-aa11-8f90f7de6dc2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:20.258628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7a29a921-c391-419e-aa11-8f90f7de6dc2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:20.266415 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7a29a921-c391-419e-aa11-8f90f7de6dc2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1682 microversion: 2.1 time: 0.166532 Oct 24 11:31:20.266987 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3637/7247] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:20 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:21.291284 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-def91702-3033-468b-86cd-179402debf04 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:21.291910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-def91702-3033-468b-86cd-179402debf04 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:21.298716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-def91702-3033-468b-86cd-179402debf04 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:21.299217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-def91702-3033-468b-86cd-179402debf04 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:21.299677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-def91702-3033-468b-86cd-179402debf04 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:21.300379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-def91702-3033-468b-86cd-179402debf04 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:21.300871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-def91702-3033-468b-86cd-179402debf04 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:21.301318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-def91702-3033-468b-86cd-179402debf04 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:21.429561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-def91702-3033-468b-86cd-179402debf04 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:21.437215 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-def91702-3033-468b-86cd-179402debf04 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1682 microversion: 2.1 time: 0.149830 Oct 24 11:31:21.437787 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3611/7248] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:21 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:22.461793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a3f10608-2cbf-45a3-8636-7eba536e0afe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:22.462435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a3f10608-2cbf-45a3-8636-7eba536e0afe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:22.469176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3f10608-2cbf-45a3-8636-7eba536e0afe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:22.469651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3f10608-2cbf-45a3-8636-7eba536e0afe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:22.470086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3f10608-2cbf-45a3-8636-7eba536e0afe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:22.470774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3f10608-2cbf-45a3-8636-7eba536e0afe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:22.471224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3f10608-2cbf-45a3-8636-7eba536e0afe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:22.471645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a3f10608-2cbf-45a3-8636-7eba536e0afe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:22.604124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a3f10608-2cbf-45a3-8636-7eba536e0afe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:22.612087 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a3f10608-2cbf-45a3-8636-7eba536e0afe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1682 microversion: 2.1 time: 0.154881 Oct 24 11:31:22.612679 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3638/7249] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:22 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:23.636524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-37909b41-61e5-483d-bb40-6b2f5c5f8523 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:23.637177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-37909b41-61e5-483d-bb40-6b2f5c5f8523 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:23.644126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37909b41-61e5-483d-bb40-6b2f5c5f8523 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:23.644620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37909b41-61e5-483d-bb40-6b2f5c5f8523 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:23.645122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37909b41-61e5-483d-bb40-6b2f5c5f8523 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:23.646626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37909b41-61e5-483d-bb40-6b2f5c5f8523 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:23.647119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37909b41-61e5-483d-bb40-6b2f5c5f8523 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:23.647587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-37909b41-61e5-483d-bb40-6b2f5c5f8523 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:23.781834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-37909b41-61e5-483d-bb40-6b2f5c5f8523 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:23.790074 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-37909b41-61e5-483d-bb40-6b2f5c5f8523 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1682 microversion: 2.1 time: 0.157449 Oct 24 11:31:23.790640 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3612/7250] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:23 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:24.814174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b7604683-132e-410a-a29e-9d3fad454f76 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:24.814700 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b7604683-132e-410a-a29e-9d3fad454f76 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:24.822258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7604683-132e-410a-a29e-9d3fad454f76 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:24.822747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7604683-132e-410a-a29e-9d3fad454f76 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:24.823194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7604683-132e-410a-a29e-9d3fad454f76 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:24.823893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7604683-132e-410a-a29e-9d3fad454f76 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:24.824353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7604683-132e-410a-a29e-9d3fad454f76 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:24.824786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b7604683-132e-410a-a29e-9d3fad454f76 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:24.954220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b7604683-132e-410a-a29e-9d3fad454f76 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:24.961982 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b7604683-132e-410a-a29e-9d3fad454f76 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1682 microversion: 2.1 time: 0.151880 Oct 24 11:31:24.962565 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3639/7251] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:24 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:31:25.986390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3834625a-8c54-459b-8caf-f647f17adc55 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:25.987021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3834625a-8c54-459b-8caf-f647f17adc55 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:25.993953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3834625a-8c54-459b-8caf-f647f17adc55 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:25.994444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3834625a-8c54-459b-8caf-f647f17adc55 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:25.994896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3834625a-8c54-459b-8caf-f647f17adc55 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:25.995596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3834625a-8c54-459b-8caf-f647f17adc55 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:25.996059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3834625a-8c54-459b-8caf-f647f17adc55 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:25.996493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3834625a-8c54-459b-8caf-f647f17adc55 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:26.135995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3834625a-8c54-459b-8caf-f647f17adc55 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:26.143877 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3834625a-8c54-459b-8caf-f647f17adc55 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1682 microversion: 2.1 time: 0.162206 Oct 24 11:31:26.144463 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3613/7252] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:25 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:27.168433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1df5187c-74fd-4b62-8583-c68f1c4c416b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:27.169072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1df5187c-74fd-4b62-8583-c68f1c4c416b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:27.175640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1df5187c-74fd-4b62-8583-c68f1c4c416b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:27.176122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1df5187c-74fd-4b62-8583-c68f1c4c416b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:27.177580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1df5187c-74fd-4b62-8583-c68f1c4c416b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:27.178287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1df5187c-74fd-4b62-8583-c68f1c4c416b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:27.178739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1df5187c-74fd-4b62-8583-c68f1c4c416b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:27.179170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1df5187c-74fd-4b62-8583-c68f1c4c416b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:27.318224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1df5187c-74fd-4b62-8583-c68f1c4c416b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:27.326025 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1df5187c-74fd-4b62-8583-c68f1c4c416b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1682 microversion: 2.1 time: 0.161679 Oct 24 11:31:27.326946 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3640/7253] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:27 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:28.350194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-beec36d2-f7fa-4d6e-9224-0833d6884ee4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:28.350813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-beec36d2-f7fa-4d6e-9224-0833d6884ee4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:28.357415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beec36d2-f7fa-4d6e-9224-0833d6884ee4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:28.357907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beec36d2-f7fa-4d6e-9224-0833d6884ee4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:28.358353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beec36d2-f7fa-4d6e-9224-0833d6884ee4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:28.359045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beec36d2-f7fa-4d6e-9224-0833d6884ee4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:28.359505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beec36d2-f7fa-4d6e-9224-0833d6884ee4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:28.359937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-beec36d2-f7fa-4d6e-9224-0833d6884ee4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:28.490445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-beec36d2-f7fa-4d6e-9224-0833d6884ee4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:28.498370 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-beec36d2-f7fa-4d6e-9224-0833d6884ee4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1682 microversion: 2.1 time: 0.152177 Oct 24 11:31:28.498942 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3614/7254] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:28 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:29.523662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-da6e3873-aa6e-43d6-a22f-17d4c1fb60b8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:29.524275 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-da6e3873-aa6e-43d6-a22f-17d4c1fb60b8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:29.531286 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da6e3873-aa6e-43d6-a22f-17d4c1fb60b8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:29.531760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da6e3873-aa6e-43d6-a22f-17d4c1fb60b8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:29.532193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da6e3873-aa6e-43d6-a22f-17d4c1fb60b8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:29.532897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da6e3873-aa6e-43d6-a22f-17d4c1fb60b8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:29.533356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da6e3873-aa6e-43d6-a22f-17d4c1fb60b8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:29.533776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-da6e3873-aa6e-43d6-a22f-17d4c1fb60b8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:29.669753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-da6e3873-aa6e-43d6-a22f-17d4c1fb60b8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:29.677675 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-da6e3873-aa6e-43d6-a22f-17d4c1fb60b8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1682 microversion: 2.1 time: 0.158762 Oct 24 11:31:29.678250 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3641/7255] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:29 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:30.701509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6f506ddd-fe0c-477a-8dcd-999303b0d1eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:30.702145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6f506ddd-fe0c-477a-8dcd-999303b0d1eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:30.709738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f506ddd-fe0c-477a-8dcd-999303b0d1eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:30.710240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f506ddd-fe0c-477a-8dcd-999303b0d1eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:30.710692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f506ddd-fe0c-477a-8dcd-999303b0d1eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:30.711400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f506ddd-fe0c-477a-8dcd-999303b0d1eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:30.711869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f506ddd-fe0c-477a-8dcd-999303b0d1eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:30.712310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f506ddd-fe0c-477a-8dcd-999303b0d1eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:30.841549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6f506ddd-fe0c-477a-8dcd-999303b0d1eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:30.849857 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6f506ddd-fe0c-477a-8dcd-999303b0d1eb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1682 microversion: 2.1 time: 0.152274 Oct 24 11:31:30.850433 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3615/7256] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:30 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:31.873332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f15d002c-a0be-46a9-9c44-69c72fe5d3c7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:31.873950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f15d002c-a0be-46a9-9c44-69c72fe5d3c7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:31.880796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f15d002c-a0be-46a9-9c44-69c72fe5d3c7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:31.881302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f15d002c-a0be-46a9-9c44-69c72fe5d3c7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:31.881733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f15d002c-a0be-46a9-9c44-69c72fe5d3c7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:31.882418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f15d002c-a0be-46a9-9c44-69c72fe5d3c7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:31.882865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f15d002c-a0be-46a9-9c44-69c72fe5d3c7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:31.883285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f15d002c-a0be-46a9-9c44-69c72fe5d3c7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:32.016516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f15d002c-a0be-46a9-9c44-69c72fe5d3c7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:32.024298 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f15d002c-a0be-46a9-9c44-69c72fe5d3c7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1682 microversion: 2.1 time: 0.154820 Oct 24 11:31:32.024885 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3642/7257] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:31 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:33.047558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5a6fda75-c8ea-4b7a-ba8c-c46db99034ec tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:33.048183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5a6fda75-c8ea-4b7a-ba8c-c46db99034ec tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:33.055547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a6fda75-c8ea-4b7a-ba8c-c46db99034ec tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:33.056040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a6fda75-c8ea-4b7a-ba8c-c46db99034ec tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:33.056492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a6fda75-c8ea-4b7a-ba8c-c46db99034ec tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:33.057246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a6fda75-c8ea-4b7a-ba8c-c46db99034ec tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:33.057713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a6fda75-c8ea-4b7a-ba8c-c46db99034ec tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:33.058151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a6fda75-c8ea-4b7a-ba8c-c46db99034ec tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:33.190004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5a6fda75-c8ea-4b7a-ba8c-c46db99034ec tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:33.198141 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5a6fda75-c8ea-4b7a-ba8c-c46db99034ec tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1682 microversion: 2.1 time: 0.154469 Oct 24 11:31:33.198725 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3616/7258] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:33 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:34.222074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8cc6df68-8252-4384-910d-48cc7f2c04a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:34.223333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8cc6df68-8252-4384-910d-48cc7f2c04a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:34.232884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cc6df68-8252-4384-910d-48cc7f2c04a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:34.233371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cc6df68-8252-4384-910d-48cc7f2c04a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:34.233802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cc6df68-8252-4384-910d-48cc7f2c04a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:34.234495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cc6df68-8252-4384-910d-48cc7f2c04a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:34.234951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cc6df68-8252-4384-910d-48cc7f2c04a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:34.235371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8cc6df68-8252-4384-910d-48cc7f2c04a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:34.388697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8cc6df68-8252-4384-910d-48cc7f2c04a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:34.396856 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8cc6df68-8252-4384-910d-48cc7f2c04a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1682 microversion: 2.1 time: 0.178601 Oct 24 11:31:34.397561 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3643/7259] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:34 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:34.777399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-5109aecd-18ab-4096-a398-5e5d7ef653b7 req-4239c01c-fadd-46a4-ad15-79dc92b95be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc17bafd-d889-4fab-ad53-9ffd075ba33d", "name": "network-vif-unplugged", "status": "completed", "tag": "f8d6f982-e4ce-4d9e-b8dd-8c8270a68a4d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:31:34.788466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5109aecd-18ab-4096-a398-5e5d7ef653b7 req-4239c01c-fadd-46a4-ad15-79dc92b95be8 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:34.789428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5109aecd-18ab-4096-a398-5e5d7ef653b7 req-4239c01c-fadd-46a4-ad15-79dc92b95be8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:34.789896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-5109aecd-18ab-4096-a398-5e5d7ef653b7 req-4239c01c-fadd-46a4-ad15-79dc92b95be8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:34.803111 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-5109aecd-18ab-4096-a398-5e5d7ef653b7 req-4239c01c-fadd-46a4-ad15-79dc92b95be8 service nova] Creating event network-vif-unplugged:f8d6f982-e4ce-4d9e-b8dd-8c8270a68a4d for instance bc17bafd-d889-4fab-ad53-9ffd075ba33d on n-h1-858383-15 Oct 24 11:31:34.808778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-5109aecd-18ab-4096-a398-5e5d7ef653b7 req-4239c01c-fadd-46a4-ad15-79dc92b95be8 service nova] Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:31:34.820448 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-5109aecd-18ab-4096-a398-5e5d7ef653b7 req-4239c01c-fadd-46a4-ad15-79dc92b95be8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046808 Oct 24 11:31:34.821227 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3617/7260] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:31:35.420021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3f2518c0-b050-44a5-bba6-b9343fad1fb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:35.420663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3f2518c0-b050-44a5-bba6-b9343fad1fb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:35.428074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f2518c0-b050-44a5-bba6-b9343fad1fb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:35.428554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f2518c0-b050-44a5-bba6-b9343fad1fb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:35.429027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f2518c0-b050-44a5-bba6-b9343fad1fb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:35.429735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f2518c0-b050-44a5-bba6-b9343fad1fb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:35.430161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f2518c0-b050-44a5-bba6-b9343fad1fb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:35.430582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3f2518c0-b050-44a5-bba6-b9343fad1fb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:35.636220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3f2518c0-b050-44a5-bba6-b9343fad1fb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:35.644415 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3f2518c0-b050-44a5-bba6-b9343fad1fb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1681 microversion: 2.1 time: 0.228176 Oct 24 11:31:35.645029 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3644/7261] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:35 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1681 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:36.669715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-547a5f45-7be2-4eb8-aad1-f1645fefcc59 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:36.670460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-547a5f45-7be2-4eb8-aad1-f1645fefcc59 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:36.676670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-547a5f45-7be2-4eb8-aad1-f1645fefcc59 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:36.677912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-547a5f45-7be2-4eb8-aad1-f1645fefcc59 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:36.678373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-547a5f45-7be2-4eb8-aad1-f1645fefcc59 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:36.679086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-547a5f45-7be2-4eb8-aad1-f1645fefcc59 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:36.679562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-547a5f45-7be2-4eb8-aad1-f1645fefcc59 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:36.680008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-547a5f45-7be2-4eb8-aad1-f1645fefcc59 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:36.809590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-547a5f45-7be2-4eb8-aad1-f1645fefcc59 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:36.817237 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-547a5f45-7be2-4eb8-aad1-f1645fefcc59 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1679 microversion: 2.1 time: 0.152809 Oct 24 11:31:36.818373 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3618/7262] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:36 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:36.860177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-c489b593-c5dd-4c94-b48c-0b6c52e64542 req-94f83b19-b880-4b87-b3c8-b4c2534d46db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc17bafd-d889-4fab-ad53-9ffd075ba33d", "tag": "f8d6f982-e4ce-4d9e-b8dd-8c8270a68a4d"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:31:36.871059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c489b593-c5dd-4c94-b48c-0b6c52e64542 req-94f83b19-b880-4b87-b3c8-b4c2534d46db service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:36.871525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c489b593-c5dd-4c94-b48c-0b6c52e64542 req-94f83b19-b880-4b87-b3c8-b4c2534d46db service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:36.871954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c489b593-c5dd-4c94-b48c-0b6c52e64542 req-94f83b19-b880-4b87-b3c8-b4c2534d46db service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:36.884000 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-c489b593-c5dd-4c94-b48c-0b6c52e64542 req-94f83b19-b880-4b87-b3c8-b4c2534d46db service nova] Creating event network-changed:f8d6f982-e4ce-4d9e-b8dd-8c8270a68a4d for instance bc17bafd-d889-4fab-ad53-9ffd075ba33d on n-h1-858383-15 Oct 24 11:31:36.889646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [req-c489b593-c5dd-4c94-b48c-0b6c52e64542 req-94f83b19-b880-4b87-b3c8-b4c2534d46db service nova] Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120426) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:31:36.900666 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-c489b593-c5dd-4c94-b48c-0b6c52e64542 req-94f83b19-b880-4b87-b3c8-b4c2534d46db service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044182 Oct 24 11:31:36.901301 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3645/7263] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:31:37.841727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7f23229f-fc78-4e55-b1de-27f1e3f45849 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:37.842363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7f23229f-fc78-4e55-b1de-27f1e3f45849 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:37.849854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f23229f-fc78-4e55-b1de-27f1e3f45849 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:37.850356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f23229f-fc78-4e55-b1de-27f1e3f45849 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:37.850816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f23229f-fc78-4e55-b1de-27f1e3f45849 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:37.851532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f23229f-fc78-4e55-b1de-27f1e3f45849 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:37.852007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f23229f-fc78-4e55-b1de-27f1e3f45849 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:37.852452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7f23229f-fc78-4e55-b1de-27f1e3f45849 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:37.986665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7f23229f-fc78-4e55-b1de-27f1e3f45849 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:37.995034 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7f23229f-fc78-4e55-b1de-27f1e3f45849 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1679 microversion: 2.1 time: 0.157286 Oct 24 11:31:37.995605 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3619/7264] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:37 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:39.023410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7781dd97-b725-4335-9d91-461dd3129dd1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:39.024625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7781dd97-b725-4335-9d91-461dd3129dd1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:39.031761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7781dd97-b725-4335-9d91-461dd3129dd1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:39.032235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7781dd97-b725-4335-9d91-461dd3129dd1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:39.032670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7781dd97-b725-4335-9d91-461dd3129dd1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:39.033404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7781dd97-b725-4335-9d91-461dd3129dd1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:39.033860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7781dd97-b725-4335-9d91-461dd3129dd1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:39.034528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7781dd97-b725-4335-9d91-461dd3129dd1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:39.222064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7781dd97-b725-4335-9d91-461dd3129dd1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:39.230740 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7781dd97-b725-4335-9d91-461dd3129dd1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1676 microversion: 2.1 time: 0.214905 Oct 24 11:31:39.231326 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3646/7265] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:39 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1676 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:39.253679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-167dd3be-3ba1-498e-92e1-42cc6da3e262 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:31:39.254228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-167dd3be-3ba1-498e-92e1-42cc6da3e262 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:39.262074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-167dd3be-3ba1-498e-92e1-42cc6da3e262 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:39.262570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-167dd3be-3ba1-498e-92e1-42cc6da3e262 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:39.263017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-167dd3be-3ba1-498e-92e1-42cc6da3e262 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:39.264315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-167dd3be-3ba1-498e-92e1-42cc6da3e262 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:39.264315 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-167dd3be-3ba1-498e-92e1-42cc6da3e262 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:39.264625 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-167dd3be-3ba1-498e-92e1-42cc6da3e262 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:39.308464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-167dd3be-3ba1-498e-92e1-42cc6da3e262 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:39.308988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-167dd3be-3ba1-498e-92e1-42cc6da3e262 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:39.309448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-167dd3be-3ba1-498e-92e1-42cc6da3e262 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:39.310200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-167dd3be-3ba1-498e-92e1-42cc6da3e262 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:39.310672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-167dd3be-3ba1-498e-92e1-42cc6da3e262 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:39.311118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-167dd3be-3ba1-498e-92e1-42cc6da3e262 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:39.332184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-167dd3be-3ba1-498e-92e1-42cc6da3e262 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Getting quotas for project 4c0ac700abd24e4ea516532577c09aa5. Resources: {'cores', 'ram'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:31:39.338002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-167dd3be-3ba1-498e-92e1-42cc6da3e262 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Getting quotas for user 879b06d644fa496c94f9226f23d79716 and project 4c0ac700abd24e4ea516532577c09aa5. Resources: {'cores', 'ram'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:31:39.417768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:31:39.440039 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-167dd3be-3ba1-498e-92e1-42cc6da3e262 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "POST /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d/action" status: 202 len: 0 microversion: 2.1 time: 0.190151 Oct 24 11:31:39.440675 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3620/7266] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:31:39 2022] POST /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:31:39.449601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5acc403d-bf4c-4690-81b9-29f59aa7b370 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:39.450313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5acc403d-bf4c-4690-81b9-29f59aa7b370 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:39.456439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5acc403d-bf4c-4690-81b9-29f59aa7b370 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:39.457187 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5acc403d-bf4c-4690-81b9-29f59aa7b370 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:39.457686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5acc403d-bf4c-4690-81b9-29f59aa7b370 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:39.459488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5acc403d-bf4c-4690-81b9-29f59aa7b370 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:39.460034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5acc403d-bf4c-4690-81b9-29f59aa7b370 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:39.460469 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5acc403d-bf4c-4690-81b9-29f59aa7b370 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:39.660448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5acc403d-bf4c-4690-81b9-29f59aa7b370 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:39.668768 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5acc403d-bf4c-4690-81b9-29f59aa7b370 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1675 microversion: 2.1 time: 0.223041 Oct 24 11:31:39.669305 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3647/7267] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:39 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1675 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:40.693131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-60a61672-c511-4bfe-8868-40e27e88525c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:40.693954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-60a61672-c511-4bfe-8868-40e27e88525c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:40.700797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60a61672-c511-4bfe-8868-40e27e88525c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:40.701330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60a61672-c511-4bfe-8868-40e27e88525c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:40.701821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60a61672-c511-4bfe-8868-40e27e88525c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:40.702523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60a61672-c511-4bfe-8868-40e27e88525c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:40.702992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60a61672-c511-4bfe-8868-40e27e88525c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:40.703433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-60a61672-c511-4bfe-8868-40e27e88525c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:40.837028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-60a61672-c511-4bfe-8868-40e27e88525c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:40.844683 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-60a61672-c511-4bfe-8868-40e27e88525c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1675 microversion: 2.1 time: 0.156765 Oct 24 11:31:40.845281 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3621/7268] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:40 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:41.869344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-44d21cfa-b786-4d69-a682-c7c22bb37d88 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:41.869872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-44d21cfa-b786-4d69-a682-c7c22bb37d88 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:41.876760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44d21cfa-b786-4d69-a682-c7c22bb37d88 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:41.877279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44d21cfa-b786-4d69-a682-c7c22bb37d88 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:41.877720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44d21cfa-b786-4d69-a682-c7c22bb37d88 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:41.878422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44d21cfa-b786-4d69-a682-c7c22bb37d88 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:41.878883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44d21cfa-b786-4d69-a682-c7c22bb37d88 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:41.879320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-44d21cfa-b786-4d69-a682-c7c22bb37d88 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:42.019420 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-44d21cfa-b786-4d69-a682-c7c22bb37d88 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:42.028964 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-44d21cfa-b786-4d69-a682-c7c22bb37d88 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1675 microversion: 2.1 time: 0.163544 Oct 24 11:31:42.029541 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3648/7269] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:41 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:43.049524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-aa765fd1-9763-44fc-b3b2-cd7141c27589 req-721d591a-b874-475b-8c25-ef4d46a02052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc17bafd-d889-4fab-ad53-9ffd075ba33d", "tag": "f8d6f982-e4ce-4d9e-b8dd-8c8270a68a4d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:31:43.053758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fce5c3e7-0e08-4327-aac0-615e1af30061 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:43.054489 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fce5c3e7-0e08-4327-aac0-615e1af30061 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:43.060899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-aa765fd1-9763-44fc-b3b2-cd7141c27589 req-721d591a-b874-475b-8c25-ef4d46a02052 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:43.061752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-aa765fd1-9763-44fc-b3b2-cd7141c27589 req-721d591a-b874-475b-8c25-ef4d46a02052 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:43.062376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-aa765fd1-9763-44fc-b3b2-cd7141c27589 req-721d591a-b874-475b-8c25-ef4d46a02052 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:43.064456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fce5c3e7-0e08-4327-aac0-615e1af30061 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:43.065180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fce5c3e7-0e08-4327-aac0-615e1af30061 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:43.065791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fce5c3e7-0e08-4327-aac0-615e1af30061 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:43.066834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fce5c3e7-0e08-4327-aac0-615e1af30061 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:43.069229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fce5c3e7-0e08-4327-aac0-615e1af30061 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:43.069865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fce5c3e7-0e08-4327-aac0-615e1af30061 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:43.076766 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-aa765fd1-9763-44fc-b3b2-cd7141c27589 req-721d591a-b874-475b-8c25-ef4d46a02052 service nova] Creating event network-changed:f8d6f982-e4ce-4d9e-b8dd-8c8270a68a4d for instance bc17bafd-d889-4fab-ad53-9ffd075ba33d on n-h2-858383-15 Oct 24 11:31:43.082468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-aa765fd1-9763-44fc-b3b2-cd7141c27589 req-721d591a-b874-475b-8c25-ef4d46a02052 service nova] Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-15', 'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:31:43.094306 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-aa765fd1-9763-44fc-b3b2-cd7141c27589 req-721d591a-b874-475b-8c25-ef4d46a02052 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050153 Oct 24 11:31:43.095274 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3622/7270] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:31:43.305351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fce5c3e7-0e08-4327-aac0-615e1af30061 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:43.313548 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fce5c3e7-0e08-4327-aac0-615e1af30061 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1675 microversion: 2.1 time: 0.264704 Oct 24 11:31:43.314132 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3649/7271] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:43 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1675 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:31:44.338194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-658aa191-4435-41ed-8ed9-8f7ef1ec7426 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:44.339021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-658aa191-4435-41ed-8ed9-8f7ef1ec7426 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:44.346113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-658aa191-4435-41ed-8ed9-8f7ef1ec7426 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:44.346606 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-658aa191-4435-41ed-8ed9-8f7ef1ec7426 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:44.347057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-658aa191-4435-41ed-8ed9-8f7ef1ec7426 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:44.347753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-658aa191-4435-41ed-8ed9-8f7ef1ec7426 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:44.348216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-658aa191-4435-41ed-8ed9-8f7ef1ec7426 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:44.348681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-658aa191-4435-41ed-8ed9-8f7ef1ec7426 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:44.481496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-658aa191-4435-41ed-8ed9-8f7ef1ec7426 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:44.489722 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-658aa191-4435-41ed-8ed9-8f7ef1ec7426 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1675 microversion: 2.1 time: 0.155261 Oct 24 11:31:44.490380 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3623/7272] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:44 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:45.512603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d63cc6b7-26b8-4aa2-8960-ec395e4bdd90 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:45.513446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d63cc6b7-26b8-4aa2-8960-ec395e4bdd90 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:45.516797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=31 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:31:45.524143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d63cc6b7-26b8-4aa2-8960-ec395e4bdd90 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:45.524634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d63cc6b7-26b8-4aa2-8960-ec395e4bdd90 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:45.525099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d63cc6b7-26b8-4aa2-8960-ec395e4bdd90 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:45.525802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d63cc6b7-26b8-4aa2-8960-ec395e4bdd90 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:45.526253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d63cc6b7-26b8-4aa2-8960-ec395e4bdd90 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:45.526676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d63cc6b7-26b8-4aa2-8960-ec395e4bdd90 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:45.529630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=89 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:31:45.679414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d63cc6b7-26b8-4aa2-8960-ec395e4bdd90 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:45.690557 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d63cc6b7-26b8-4aa2-8960-ec395e4bdd90 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1668 microversion: 2.1 time: 0.181768 Oct 24 11:31:45.691256 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3650/7273] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:45 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1668 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:45.716438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-96703ab4-e9de-46b6-8a7b-3b79088e6a72 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:45.717108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-96703ab4-e9de-46b6-8a7b-3b79088e6a72 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:45.719919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:31:45.728360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96703ab4-e9de-46b6-8a7b-3b79088e6a72 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:45.728898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96703ab4-e9de-46b6-8a7b-3b79088e6a72 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:45.729351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96703ab4-e9de-46b6-8a7b-3b79088e6a72 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:45.730197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96703ab4-e9de-46b6-8a7b-3b79088e6a72 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:45.730694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96703ab4-e9de-46b6-8a7b-3b79088e6a72 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:45.731144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-96703ab4-e9de-46b6-8a7b-3b79088e6a72 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:45.893093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-96703ab4-e9de-46b6-8a7b-3b79088e6a72 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:45.901878 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-96703ab4-e9de-46b6-8a7b-3b79088e6a72 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1668 microversion: 2.1 time: 0.188889 Oct 24 11:31:45.902955 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3624/7274] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:45 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1668 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:45.930341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9848836f-efd1-41ac-b989-855d8605d2d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:45.930922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9848836f-efd1-41ac-b989-855d8605d2d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:45.937261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9848836f-efd1-41ac-b989-855d8605d2d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:45.937756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9848836f-efd1-41ac-b989-855d8605d2d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:45.938194 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9848836f-efd1-41ac-b989-855d8605d2d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:45.938909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9848836f-efd1-41ac-b989-855d8605d2d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:45.939367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9848836f-efd1-41ac-b989-855d8605d2d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:45.939795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9848836f-efd1-41ac-b989-855d8605d2d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:46.088398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9848836f-efd1-41ac-b989-855d8605d2d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:46.100234 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9848836f-efd1-41ac-b989-855d8605d2d5 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1668 microversion: 2.1 time: 0.174459 Oct 24 11:31:46.101268 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3651/7275] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:45 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1668 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:46.124926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4190cdbd-e737-448b-9018-168c0787998d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:46.125453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4190cdbd-e737-448b-9018-168c0787998d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:46.132000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4190cdbd-e737-448b-9018-168c0787998d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:46.132571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4190cdbd-e737-448b-9018-168c0787998d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:46.133217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4190cdbd-e737-448b-9018-168c0787998d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:46.133947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4190cdbd-e737-448b-9018-168c0787998d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:46.134434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4190cdbd-e737-448b-9018-168c0787998d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:46.134879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4190cdbd-e737-448b-9018-168c0787998d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:46.162066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4190cdbd-e737-448b-9018-168c0787998d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:31:46.247060 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4190cdbd-e737-448b-9018-168c0787998d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 204 len: 0 microversion: 2.1 time: 0.126420 Oct 24 11:31:46.247570 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3625/7276] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:31:46 2022] DELETE /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:31:46.257580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-49a5e893-2831-46e4-8044-49780c062789 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:46.258221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-49a5e893-2831-46e4-8044-49780c062789 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:46.266199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49a5e893-2831-46e4-8044-49780c062789 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:46.266684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49a5e893-2831-46e4-8044-49780c062789 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:46.267119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49a5e893-2831-46e4-8044-49780c062789 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:46.267912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49a5e893-2831-46e4-8044-49780c062789 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:46.268365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49a5e893-2831-46e4-8044-49780c062789 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:46.270009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49a5e893-2831-46e4-8044-49780c062789 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:46.425609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-49a5e893-2831-46e4-8044-49780c062789 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:46.433337 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-49a5e893-2831-46e4-8044-49780c062789 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1674 microversion: 2.1 time: 0.181242 Oct 24 11:31:46.433905 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3652/7277] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:46 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1674 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:47.411862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c3647f91-bd85-408c-a6be-ec373b7cc04d req-45d19848-e2d2-4592-957b-fe426b40da71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc17bafd-d889-4fab-ad53-9ffd075ba33d", "name": "network-vif-plugged", "status": "completed", "tag": "f8d6f982-e4ce-4d9e-b8dd-8c8270a68a4d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:31:47.426077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c3647f91-bd85-408c-a6be-ec373b7cc04d req-45d19848-e2d2-4592-957b-fe426b40da71 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:47.426619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c3647f91-bd85-408c-a6be-ec373b7cc04d req-45d19848-e2d2-4592-957b-fe426b40da71 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:47.427609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c3647f91-bd85-408c-a6be-ec373b7cc04d req-45d19848-e2d2-4592-957b-fe426b40da71 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:47.438228 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c3647f91-bd85-408c-a6be-ec373b7cc04d req-45d19848-e2d2-4592-957b-fe426b40da71 service nova] Creating event network-vif-plugged:f8d6f982-e4ce-4d9e-b8dd-8c8270a68a4d for instance bc17bafd-d889-4fab-ad53-9ffd075ba33d on n-h2-858383-15 Oct 24 11:31:47.443609 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c3647f91-bd85-408c-a6be-ec373b7cc04d req-45d19848-e2d2-4592-957b-fe426b40da71 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035983 Oct 24 11:31:47.444364 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3626/7278] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:31:47.458768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e9126586-2ad2-4b53-aa6c-9efaf51395b4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:47.460094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e9126586-2ad2-4b53-aa6c-9efaf51395b4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:47.466964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9126586-2ad2-4b53-aa6c-9efaf51395b4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:47.467526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9126586-2ad2-4b53-aa6c-9efaf51395b4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:47.468031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9126586-2ad2-4b53-aa6c-9efaf51395b4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:47.468796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9126586-2ad2-4b53-aa6c-9efaf51395b4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:47.469350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9126586-2ad2-4b53-aa6c-9efaf51395b4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:47.469784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9126586-2ad2-4b53-aa6c-9efaf51395b4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:47.603860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e9126586-2ad2-4b53-aa6c-9efaf51395b4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:47.611555 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e9126586-2ad2-4b53-aa6c-9efaf51395b4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1674 microversion: 2.1 time: 0.157398 Oct 24 11:31:47.612123 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3653/7279] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:47 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:31:48.572027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-37b29091-4323-4680-a859-8b6f81da2520 req-f1fdd239-cb29-49f1-a1a3-fcf6194f4a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc17bafd-d889-4fab-ad53-9ffd075ba33d", "name": "network-vif-deleted", "tag": "f8d6f982-e4ce-4d9e-b8dd-8c8270a68a4d"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:31:48.582111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-37b29091-4323-4680-a859-8b6f81da2520 req-f1fdd239-cb29-49f1-a1a3-fcf6194f4a95 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:48.582595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-37b29091-4323-4680-a859-8b6f81da2520 req-f1fdd239-cb29-49f1-a1a3-fcf6194f4a95 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:48.583723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-37b29091-4323-4680-a859-8b6f81da2520 req-f1fdd239-cb29-49f1-a1a3-fcf6194f4a95 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:48.636478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-19181951-ff75-4f2b-a108-cb44b4e27a14 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:48.637974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-19181951-ff75-4f2b-a108-cb44b4e27a14 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:48.648470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19181951-ff75-4f2b-a108-cb44b4e27a14 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:48.649061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19181951-ff75-4f2b-a108-cb44b4e27a14 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:48.649448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19181951-ff75-4f2b-a108-cb44b4e27a14 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:48.650191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19181951-ff75-4f2b-a108-cb44b4e27a14 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:48.650655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19181951-ff75-4f2b-a108-cb44b4e27a14 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:48.651085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-19181951-ff75-4f2b-a108-cb44b4e27a14 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:48.740451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-19181951-ff75-4f2b-a108-cb44b4e27a14 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:48.750140 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-19181951-ff75-4f2b-a108-cb44b4e27a14 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 200 len: 1323 microversion: 2.1 time: 0.117459 Oct 24 11:31:48.751259 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3654/7280] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:48 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 1323 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:48.860541 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-37b29091-4323-4680-a859-8b6f81da2520 req-f1fdd239-cb29-49f1-a1a3-fcf6194f4a95 service nova] Creating event network-vif-deleted:f8d6f982-e4ce-4d9e-b8dd-8c8270a68a4d for instance bc17bafd-d889-4fab-ad53-9ffd075ba33d on n-h2-858383-15 Oct 24 11:31:48.866031 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-37b29091-4323-4680-a859-8b6f81da2520 req-f1fdd239-cb29-49f1-a1a3-fcf6194f4a95 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299333 Oct 24 11:31:48.866646 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3627/7281] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:31:49.775330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-548c5a92-78ed-4a92-a8b4-8ea25218ca48 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:49.775944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-548c5a92-78ed-4a92-a8b4-8ea25218ca48 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:49.783318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-548c5a92-78ed-4a92-a8b4-8ea25218ca48 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:49.783797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-548c5a92-78ed-4a92-a8b4-8ea25218ca48 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:49.784231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-548c5a92-78ed-4a92-a8b4-8ea25218ca48 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:49.784946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-548c5a92-78ed-4a92-a8b4-8ea25218ca48 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:49.785414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-548c5a92-78ed-4a92-a8b4-8ea25218ca48 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:49.785819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-548c5a92-78ed-4a92-a8b4-8ea25218ca48 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:49.798931 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-548c5a92-78ed-4a92-a8b4-8ea25218ca48 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] HTTP exception thrown: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-548c5a92-78ed-4a92-a8b4-8ea25218ca48 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Request method failure captured: Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d HTTP/1.1 Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnaUzJMxVmO-HtBWBYSLYY__i8Ec4H_cXbVc5xd3yGDLsMf1ETMejFCnWUyp9G8494iE9lwNZ1O-SL8TGXN5cFSCNrWBYv6wZLOJycdTlyT8sc_7tYAGIgmUERtptmQ1I6PrKjKFKSYn1GiUZKbvWNa596EQvJKNpX9sOkD72kPfq90 Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c0ac700abd24e4ea516532577c09aa5", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 879b06d644fa496c94f9226f23d79716 Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'bc17bafd-d889-4fab-ad53-9ffd075ba33d'} Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:31:49.800537 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:31:49.805530 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:31:49.805530 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:31:49.805530 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:31:49.805530 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:31:49.805530 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:31:49.805530 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:31:49.805530 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:31:49.805530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-548c5a92-78ed-4a92-a8b4-8ea25218ca48 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Returning 404 to user: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:31:49.805530 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-548c5a92-78ed-4a92-a8b4-8ea25218ca48 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 404 len: 111 microversion: 2.1 time: 0.030550 Oct 24 11:31:49.805530 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3655/7282] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:49 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:31:49.816601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:31:49.822312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-349422b0-b288-4302-9fd3-66122472feb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:49.823025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-349422b0-b288-4302-9fd3-66122472feb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:49.829461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-349422b0-b288-4302-9fd3-66122472feb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:49.829954 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-349422b0-b288-4302-9fd3-66122472feb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:49.830404 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-349422b0-b288-4302-9fd3-66122472feb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:49.831102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-349422b0-b288-4302-9fd3-66122472feb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:49.831567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-349422b0-b288-4302-9fd3-66122472feb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:49.832005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-349422b0-b288-4302-9fd3-66122472feb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:49.845201 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-349422b0-b288-4302-9fd3-66122472feb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] HTTP exception thrown: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-349422b0-b288-4302-9fd3-66122472feb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Request method failure captured: Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d HTTP/1.1 Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnaUzJMxVmO-HtBWBYSLYY__i8Ec4H_cXbVc5xd3yGDLsMf1ETMejFCnWUyp9G8494iE9lwNZ1O-SL8TGXN5cFSCNrWBYv6wZLOJycdTlyT8sc_7tYAGIgmUERtptmQ1I6PrKjKFKSYn1GiUZKbvWNa596EQvJKNpX9sOkD72kPfq90 Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c0ac700abd24e4ea516532577c09aa5", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 879b06d644fa496c94f9226f23d79716 Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'bc17bafd-d889-4fab-ad53-9ffd075ba33d'} Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:31:49.846824 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:31:49.852044 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:31:49.852044 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:31:49.852044 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:31:49.852044 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:31:49.852044 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:31:49.852044 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:31:49.852044 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:31:49.852044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-349422b0-b288-4302-9fd3-66122472feb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Returning 404 to user: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:31:49.852044 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-349422b0-b288-4302-9fd3-66122472feb7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 404 len: 111 microversion: 2.1 time: 0.032589 Oct 24 11:31:49.852981 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3628/7283] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:49 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:31:49.896355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1589946753", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "8220ee77-95f2-48de-8da4-516f3afce857"}], "security_groups": [{"name": "tempest-securitygroup--485148156"}], "key_name": "tempest-keypair-1192870934", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:31:50.003648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] validate_networks() for [('8220ee77-95f2-48de-8da4-516f3afce857', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:31:50.386267 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:31:50.386773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:31:50.387344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:31:50.387753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:31:50.388158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:31:50.397484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:50.397958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:50.398391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:50.399103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:50.399549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:50.399967 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:50.417318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Getting quotas for project 4c0ac700abd24e4ea516532577c09aa5. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:31:50.422467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Getting quotas for user 879b06d644fa496c94f9226f23d79716 and project 4c0ac700abd24e4ea516532577c09aa5. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:31:50.434516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:31:50.436880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:31:50.482678 n-d-858383-15 devstack@n-api.service[120426]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [ecea82d8-105f-4644-a19a-49dac1cbf827] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 11:31:51.491304 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [ecea82d8-105f-4644-a19a-49dac1cbf827] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 48794. Oct 24 11:31:51.495139 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5971f3c5-6d44-40c1-a27a-b5bcce671dd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.603154 Oct 24 11:31:51.495785 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3656/7284] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:31:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:31:51.507474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-49dbeeb1-793c-4229-a912-dd9019653d9b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:51.508146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-49dbeeb1-793c-4229-a912-dd9019653d9b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:51.570953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-49dbeeb1-793c-4229-a912-dd9019653d9b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:51.577877 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-49dbeeb1-793c-4229-a912-dd9019653d9b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1239 microversion: 2.1 time: 0.074662 Oct 24 11:31:51.578435 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3629/7285] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:51 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:52.603439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-17ab5a93-e8b9-47d7-a700-61495d1c9f2a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:52.604074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-17ab5a93-e8b9-47d7-a700-61495d1c9f2a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:52.610537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-17ab5a93-e8b9-47d7-a700-61495d1c9f2a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:52.611032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-17ab5a93-e8b9-47d7-a700-61495d1c9f2a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:52.611480 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-17ab5a93-e8b9-47d7-a700-61495d1c9f2a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:52.612196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-17ab5a93-e8b9-47d7-a700-61495d1c9f2a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:52.612658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-17ab5a93-e8b9-47d7-a700-61495d1c9f2a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:52.613117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-17ab5a93-e8b9-47d7-a700-61495d1c9f2a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:52.789237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-17ab5a93-e8b9-47d7-a700-61495d1c9f2a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:52.796889 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-17ab5a93-e8b9-47d7-a700-61495d1c9f2a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1297 microversion: 2.1 time: 0.199018 Oct 24 11:31:52.797448 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3657/7286] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:52 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1297 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:53.821709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4fdcd4da-4adc-445f-a15c-602fc1f35416 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:53.822340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4fdcd4da-4adc-445f-a15c-602fc1f35416 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:53.829111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4fdcd4da-4adc-445f-a15c-602fc1f35416 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:53.829610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4fdcd4da-4adc-445f-a15c-602fc1f35416 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:53.830058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4fdcd4da-4adc-445f-a15c-602fc1f35416 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:53.830766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4fdcd4da-4adc-445f-a15c-602fc1f35416 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:53.831229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4fdcd4da-4adc-445f-a15c-602fc1f35416 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:53.831666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4fdcd4da-4adc-445f-a15c-602fc1f35416 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:54.054727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4fdcd4da-4adc-445f-a15c-602fc1f35416 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:54.062691 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4fdcd4da-4adc-445f-a15c-602fc1f35416 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1364 microversion: 2.1 time: 0.245368 Oct 24 11:31:54.063261 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3630/7287] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:53 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:54.199502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-6a86506c-7b21-4c2e-92cc-1d93006da460 req-1b43ad5e-a19a-4fc2-918a-41fdd0ea1c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b3ca59-a5ea-489a-9576-ce182ef96b36", "tag": "77de97d7-561a-489e-8d49-ed2e7b92353f"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:31:54.212942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6a86506c-7b21-4c2e-92cc-1d93006da460 req-1b43ad5e-a19a-4fc2-918a-41fdd0ea1c17 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:54.213337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6a86506c-7b21-4c2e-92cc-1d93006da460 req-1b43ad5e-a19a-4fc2-918a-41fdd0ea1c17 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:54.213777 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6a86506c-7b21-4c2e-92cc-1d93006da460 req-1b43ad5e-a19a-4fc2-918a-41fdd0ea1c17 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:54.226131 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-6a86506c-7b21-4c2e-92cc-1d93006da460 req-1b43ad5e-a19a-4fc2-918a-41fdd0ea1c17 service nova] Creating event network-changed:77de97d7-561a-489e-8d49-ed2e7b92353f for instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 on n-h1-858383-15 Oct 24 11:31:54.232218 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-6a86506c-7b21-4c2e-92cc-1d93006da460 req-1b43ad5e-a19a-4fc2-918a-41fdd0ea1c17 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037451 Oct 24 11:31:54.232895 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3658/7288] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:31:55.087481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fb574ae8-224a-4e13-becb-5a912ae5ad01 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:55.088001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fb574ae8-224a-4e13-becb-5a912ae5ad01 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:55.095123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb574ae8-224a-4e13-becb-5a912ae5ad01 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:55.095636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb574ae8-224a-4e13-becb-5a912ae5ad01 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:55.096091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb574ae8-224a-4e13-becb-5a912ae5ad01 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:55.096821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb574ae8-224a-4e13-becb-5a912ae5ad01 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:55.097331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb574ae8-224a-4e13-becb-5a912ae5ad01 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:55.097972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb574ae8-224a-4e13-becb-5a912ae5ad01 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:55.348925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fb574ae8-224a-4e13-becb-5a912ae5ad01 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:55.362030 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fb574ae8-224a-4e13-becb-5a912ae5ad01 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1308 microversion: 2.1 time: 0.278486 Oct 24 11:31:55.376857 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3631/7289] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:55 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1308 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:55.512644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a4f20e27-8a15-4588-98f1-945780a09207 req-8cda5013-692c-45ff-8d5d-5973ae3a12db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b3ca59-a5ea-489a-9576-ce182ef96b36", "name": "network-vif-deleted", "tag": "77de97d7-561a-489e-8d49-ed2e7b92353f"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:31:55.525048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a4f20e27-8a15-4588-98f1-945780a09207 req-8cda5013-692c-45ff-8d5d-5973ae3a12db service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:55.525531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a4f20e27-8a15-4588-98f1-945780a09207 req-8cda5013-692c-45ff-8d5d-5973ae3a12db service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:55.525964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a4f20e27-8a15-4588-98f1-945780a09207 req-8cda5013-692c-45ff-8d5d-5973ae3a12db service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:55.539716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.compute.server_external_events [req-a4f20e27-8a15-4588-98f1-945780a09207 req-8cda5013-692c-45ff-8d5d-5973ae3a12db service nova] Unable to find a host for instance 99b3ca59-a5ea-489a-9576-ce182ef96b36. Dropping event network-vif-deleted {{(pid=120426) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 24 11:31:55.540751 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a4f20e27-8a15-4588-98f1-945780a09207 req-8cda5013-692c-45ff-8d5d-5973ae3a12db service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.032397 Oct 24 11:31:55.541965 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3659/7290] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 24 11:31:56.387895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ac241bfc-6b02-4f99-9fcb-38d858e20f0a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:56.388461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ac241bfc-6b02-4f99-9fcb-38d858e20f0a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:56.395379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac241bfc-6b02-4f99-9fcb-38d858e20f0a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:56.395879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac241bfc-6b02-4f99-9fcb-38d858e20f0a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:56.396332 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac241bfc-6b02-4f99-9fcb-38d858e20f0a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:56.397140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac241bfc-6b02-4f99-9fcb-38d858e20f0a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:56.397615 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac241bfc-6b02-4f99-9fcb-38d858e20f0a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:56.398059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac241bfc-6b02-4f99-9fcb-38d858e20f0a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:56.459939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ac241bfc-6b02-4f99-9fcb-38d858e20f0a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:56.467604 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ac241bfc-6b02-4f99-9fcb-38d858e20f0a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1291 microversion: 2.1 time: 0.083660 Oct 24 11:31:56.468170 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3632/7291] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:56 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1291 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:57.491495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-48b41ceb-ade0-4e9a-b144-9aa2be5bd078 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:57.492233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-48b41ceb-ade0-4e9a-b144-9aa2be5bd078 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:57.498991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48b41ceb-ade0-4e9a-b144-9aa2be5bd078 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:57.499473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48b41ceb-ade0-4e9a-b144-9aa2be5bd078 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:57.499906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48b41ceb-ade0-4e9a-b144-9aa2be5bd078 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:57.500605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48b41ceb-ade0-4e9a-b144-9aa2be5bd078 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:57.501081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48b41ceb-ade0-4e9a-b144-9aa2be5bd078 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:57.501506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-48b41ceb-ade0-4e9a-b144-9aa2be5bd078 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:57.567883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-48b41ceb-ade0-4e9a-b144-9aa2be5bd078 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:57.576473 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-48b41ceb-ade0-4e9a-b144-9aa2be5bd078 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1297 microversion: 2.1 time: 0.089581 Oct 24 11:31:57.577091 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3660/7292] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:57 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:58.358189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-834ff0d5-bed8-424b-9172-fedc522e7347 req-0e3fc5c7-49a0-4320-9f7c-06df9688811e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b3ca59-a5ea-489a-9576-ce182ef96b36", "tag": "e96a62fa-912d-4a0f-ac68-733b24553735"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:31:58.369372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-834ff0d5-bed8-424b-9172-fedc522e7347 req-0e3fc5c7-49a0-4320-9f7c-06df9688811e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:58.369956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-834ff0d5-bed8-424b-9172-fedc522e7347 req-0e3fc5c7-49a0-4320-9f7c-06df9688811e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:58.370489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-834ff0d5-bed8-424b-9172-fedc522e7347 req-0e3fc5c7-49a0-4320-9f7c-06df9688811e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:58.381897 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-834ff0d5-bed8-424b-9172-fedc522e7347 req-0e3fc5c7-49a0-4320-9f7c-06df9688811e service nova] Creating event network-changed:e96a62fa-912d-4a0f-ac68-733b24553735 for instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 on n-h2-858383-15 Oct 24 11:31:58.386743 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-834ff0d5-bed8-424b-9172-fedc522e7347 req-0e3fc5c7-49a0-4320-9f7c-06df9688811e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032332 Oct 24 11:31:58.387345 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3633/7293] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:31:58.601049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-370388d9-772d-462c-95d2-424dda979a9f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:58.601823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-370388d9-772d-462c-95d2-424dda979a9f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:58.608789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-370388d9-772d-462c-95d2-424dda979a9f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:58.609315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-370388d9-772d-462c-95d2-424dda979a9f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:58.609756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-370388d9-772d-462c-95d2-424dda979a9f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:58.610460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-370388d9-772d-462c-95d2-424dda979a9f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:58.610916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-370388d9-772d-462c-95d2-424dda979a9f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:58.611345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-370388d9-772d-462c-95d2-424dda979a9f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:58.744323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-370388d9-772d-462c-95d2-424dda979a9f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:58.752223 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-370388d9-772d-462c-95d2-424dda979a9f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1364 microversion: 2.1 time: 0.155835 Oct 24 11:31:58.752797 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3661/7294] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:58 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:31:59.778538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2f0d15c5-eaa9-4d8d-a1ae-b62db8bb7185 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:31:59.779260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2f0d15c5-eaa9-4d8d-a1ae-b62db8bb7185 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:31:59.785855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f0d15c5-eaa9-4d8d-a1ae-b62db8bb7185 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:59.786857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f0d15c5-eaa9-4d8d-a1ae-b62db8bb7185 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:59.787481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f0d15c5-eaa9-4d8d-a1ae-b62db8bb7185 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:59.788202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f0d15c5-eaa9-4d8d-a1ae-b62db8bb7185 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:31:59.788676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f0d15c5-eaa9-4d8d-a1ae-b62db8bb7185 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:31:59.789145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f0d15c5-eaa9-4d8d-a1ae-b62db8bb7185 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:31:59.927762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2f0d15c5-eaa9-4d8d-a1ae-b62db8bb7185 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:31:59.937299 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2f0d15c5-eaa9-4d8d-a1ae-b62db8bb7185 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1364 microversion: 2.1 time: 0.163924 Oct 24 11:31:59.937907 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3634/7295] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:31:59 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:32:00.960466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2b4a3b6a-8916-4971-876b-9e8f1e7ebbc8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:32:00.961136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2b4a3b6a-8916-4971-876b-9e8f1e7ebbc8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:32:00.963879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:32:00.964560 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:32:00.970385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b4a3b6a-8916-4971-876b-9e8f1e7ebbc8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:00.970862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b4a3b6a-8916-4971-876b-9e8f1e7ebbc8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:00.971294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b4a3b6a-8916-4971-876b-9e8f1e7ebbc8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:00.971981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b4a3b6a-8916-4971-876b-9e8f1e7ebbc8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:00.972429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b4a3b6a-8916-4971-876b-9e8f1e7ebbc8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:00.972865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2b4a3b6a-8916-4971-876b-9e8f1e7ebbc8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:01.103950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2b4a3b6a-8916-4971-876b-9e8f1e7ebbc8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:32:01.111882 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2b4a3b6a-8916-4971-876b-9e8f1e7ebbc8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1364 microversion: 2.1 time: 0.155150 Oct 24 11:32:01.112465 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3662/7296] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:32:00 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:32:02.136231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e64279ee-cc83-4fce-b6ef-603db33a6cd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:32:02.136878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e64279ee-cc83-4fce-b6ef-603db33a6cd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:32:02.139662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:32:02.144997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e64279ee-cc83-4fce-b6ef-603db33a6cd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:02.146252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e64279ee-cc83-4fce-b6ef-603db33a6cd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:02.146709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e64279ee-cc83-4fce-b6ef-603db33a6cd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:02.147420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e64279ee-cc83-4fce-b6ef-603db33a6cd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:02.147890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e64279ee-cc83-4fce-b6ef-603db33a6cd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:02.148334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e64279ee-cc83-4fce-b6ef-603db33a6cd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:02.288462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e64279ee-cc83-4fce-b6ef-603db33a6cd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:32:02.296292 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e64279ee-cc83-4fce-b6ef-603db33a6cd3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1364 microversion: 2.1 time: 0.164051 Oct 24 11:32:02.296896 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3635/7297] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:32:02 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:32:03.320603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d6eb40ff-7900-4c22-8519-d51d41f6bdf6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:32:03.321255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d6eb40ff-7900-4c22-8519-d51d41f6bdf6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:32:03.327959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6eb40ff-7900-4c22-8519-d51d41f6bdf6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:03.328442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6eb40ff-7900-4c22-8519-d51d41f6bdf6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:03.328896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6eb40ff-7900-4c22-8519-d51d41f6bdf6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:03.329637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6eb40ff-7900-4c22-8519-d51d41f6bdf6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:03.330030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6eb40ff-7900-4c22-8519-d51d41f6bdf6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:03.330453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6eb40ff-7900-4c22-8519-d51d41f6bdf6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:03.456005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ed796974-3e45-4b53-b4d8-f359941a5985 req-e5735672-981b-4900-ad7e-7a97ee2b4ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b3ca59-a5ea-489a-9576-ce182ef96b36", "name": "network-vif-plugged", "status": "completed", "tag": "e96a62fa-912d-4a0f-ac68-733b24553735"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:32:03.468219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ed796974-3e45-4b53-b4d8-f359941a5985 req-e5735672-981b-4900-ad7e-7a97ee2b4ddf service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:03.468720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ed796974-3e45-4b53-b4d8-f359941a5985 req-e5735672-981b-4900-ad7e-7a97ee2b4ddf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:03.469199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ed796974-3e45-4b53-b4d8-f359941a5985 req-e5735672-981b-4900-ad7e-7a97ee2b4ddf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:03.475613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d6eb40ff-7900-4c22-8519-d51d41f6bdf6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:32:03.481757 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ed796974-3e45-4b53-b4d8-f359941a5985 req-e5735672-981b-4900-ad7e-7a97ee2b4ddf service nova] Creating event network-vif-plugged:e96a62fa-912d-4a0f-ac68-733b24553735 for instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 on n-h2-858383-15 Oct 24 11:32:03.483887 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d6eb40ff-7900-4c22-8519-d51d41f6bdf6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1364 microversion: 2.1 time: 0.168117 Oct 24 11:32:03.484819 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3663/7298] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:32:03 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:32:03.492211 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ed796974-3e45-4b53-b4d8-f359941a5985 req-e5735672-981b-4900-ad7e-7a97ee2b4ddf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039979 Oct 24 11:32:03.493164 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3636/7299] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:32:04.508106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0b56e203-1e3e-4b21-9032-f44239f52c65 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:32:04.508715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0b56e203-1e3e-4b21-9032-f44239f52c65 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:32:04.515541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b56e203-1e3e-4b21-9032-f44239f52c65 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:04.516018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b56e203-1e3e-4b21-9032-f44239f52c65 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:04.516452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b56e203-1e3e-4b21-9032-f44239f52c65 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:04.517173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b56e203-1e3e-4b21-9032-f44239f52c65 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:04.517628 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b56e203-1e3e-4b21-9032-f44239f52c65 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:04.518054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0b56e203-1e3e-4b21-9032-f44239f52c65 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:04.651439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0b56e203-1e3e-4b21-9032-f44239f52c65 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:32:04.660463 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0b56e203-1e3e-4b21-9032-f44239f52c65 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1364 microversion: 2.1 time: 0.156143 Oct 24 11:32:04.664561 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3664/7300] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:32:04 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:32:05.687460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2ef8fe50-1337-480f-a35c-572e49232d05 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:32:05.688215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2ef8fe50-1337-480f-a35c-572e49232d05 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:32:05.694942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ef8fe50-1337-480f-a35c-572e49232d05 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:05.695443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ef8fe50-1337-480f-a35c-572e49232d05 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:05.695903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ef8fe50-1337-480f-a35c-572e49232d05 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:05.696650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ef8fe50-1337-480f-a35c-572e49232d05 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:05.697149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ef8fe50-1337-480f-a35c-572e49232d05 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:05.697596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2ef8fe50-1337-480f-a35c-572e49232d05 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:05.846440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2ef8fe50-1337-480f-a35c-572e49232d05 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:32:05.855092 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2ef8fe50-1337-480f-a35c-572e49232d05 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1551 microversion: 2.1 time: 0.173315 Oct 24 11:32:05.855840 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3637/7301] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:32:05 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1551 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:32:05.878255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9ef72a37-bb6d-4239-8c54-70101a8875f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:32:05.878874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9ef72a37-bb6d-4239-8c54-70101a8875f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:32:05.887294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ef72a37-bb6d-4239-8c54-70101a8875f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:05.887783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ef72a37-bb6d-4239-8c54-70101a8875f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:05.888223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ef72a37-bb6d-4239-8c54-70101a8875f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:05.888952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ef72a37-bb6d-4239-8c54-70101a8875f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:05.889409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ef72a37-bb6d-4239-8c54-70101a8875f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:05.889834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9ef72a37-bb6d-4239-8c54-70101a8875f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:05.969988 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9ef72a37-bb6d-4239-8c54-70101a8875f4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095566 Oct 24 11:32:05.970637 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3665/7302] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 11:32:05 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:32:06.897325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b5a8b31b-34d7-4cf3-8af3-f28eaab31c23 req-d4980bf2-0f52-4f45-8473-68aba46fd6bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b3ca59-a5ea-489a-9576-ce182ef96b36", "tag": "e96a62fa-912d-4a0f-ac68-733b24553735"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:32:06.908096 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b5a8b31b-34d7-4cf3-8af3-f28eaab31c23 req-d4980bf2-0f52-4f45-8473-68aba46fd6bb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:06.908683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b5a8b31b-34d7-4cf3-8af3-f28eaab31c23 req-d4980bf2-0f52-4f45-8473-68aba46fd6bb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:06.909228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b5a8b31b-34d7-4cf3-8af3-f28eaab31c23 req-d4980bf2-0f52-4f45-8473-68aba46fd6bb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:06.921065 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b5a8b31b-34d7-4cf3-8af3-f28eaab31c23 req-d4980bf2-0f52-4f45-8473-68aba46fd6bb service nova] Creating event network-changed:e96a62fa-912d-4a0f-ac68-733b24553735 for instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 on n-h2-858383-15 Oct 24 11:32:06.925950 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b5a8b31b-34d7-4cf3-8af3-f28eaab31c23 req-d4980bf2-0f52-4f45-8473-68aba46fd6bb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032465 Oct 24 11:32:06.927106 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3638/7303] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:32:41.307942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:32:41.308610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=77 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:32:41.312722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dcbb8900-0680-4c1b-a24a-b696dd4a450a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:32:41.313373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dcbb8900-0680-4c1b-a24a-b696dd4a450a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:32:41.321277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dcbb8900-0680-4c1b-a24a-b696dd4a450a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:41.321758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dcbb8900-0680-4c1b-a24a-b696dd4a450a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:41.322198 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dcbb8900-0680-4c1b-a24a-b696dd4a450a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:41.322887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dcbb8900-0680-4c1b-a24a-b696dd4a450a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:41.323339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dcbb8900-0680-4c1b-a24a-b696dd4a450a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:41.323765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dcbb8900-0680-4c1b-a24a-b696dd4a450a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:41.453549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dcbb8900-0680-4c1b-a24a-b696dd4a450a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:32:41.461592 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dcbb8900-0680-4c1b-a24a-b696dd4a450a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1670 microversion: 2.1 time: 0.155681 Oct 24 11:32:41.462208 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3666/7304] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:32:41 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:32:41.482193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:32:41.482930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:32:41.487269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-377f4b33-ce5d-4626-b5c1-a6c05dc60f5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f319d339-58d5-4480-b3b4-54e0ae7bb089"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:32:41.489771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-377f4b33-ce5d-4626-b5c1-a6c05dc60f5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:32:41.497757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-377f4b33-ce5d-4626-b5c1-a6c05dc60f5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:41.498255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-377f4b33-ce5d-4626-b5c1-a6c05dc60f5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:41.498715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-377f4b33-ce5d-4626-b5c1-a6c05dc60f5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:41.499434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-377f4b33-ce5d-4626-b5c1-a6c05dc60f5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:41.499912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-377f4b33-ce5d-4626-b5c1-a6c05dc60f5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:41.500360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-377f4b33-ce5d-4626-b5c1-a6c05dc60f5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:41.767622 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-377f4b33-ce5d-4626-b5c1-a6c05dc60f5a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "POST /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287383 Oct 24 11:32:41.768241 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3639/7305] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 11:32:41 2022] POST /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:32:52.489866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a86470ce-2d62-44da-b49b-63d70425579a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:32:52.492826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a86470ce-2d62-44da-b49b-63d70425579a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:32:52.495409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:32:52.496253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:32:52.501909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a86470ce-2d62-44da-b49b-63d70425579a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:52.502395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a86470ce-2d62-44da-b49b-63d70425579a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:52.502838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a86470ce-2d62-44da-b49b-63d70425579a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:52.503670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a86470ce-2d62-44da-b49b-63d70425579a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:52.504133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a86470ce-2d62-44da-b49b-63d70425579a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:52.504596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a86470ce-2d62-44da-b49b-63d70425579a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:52.533251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a86470ce-2d62-44da-b49b-63d70425579a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:32:52.538712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a86470ce-2d62-44da-b49b-63d70425579a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Old instance type m1.heat2, new instance type m1.heat {{(pid=120426) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 24 11:32:52.545611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a86470ce-2d62-44da-b49b-63d70425579a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:32:52.546036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a86470ce-2d62-44da-b49b-63d70425579a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:32:52.546509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a86470ce-2d62-44da-b49b-63d70425579a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:32:52.546921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a86470ce-2d62-44da-b49b-63d70425579a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:32:52.547331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-a86470ce-2d62-44da-b49b-63d70425579a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:32:52.610556 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a86470ce-2d62-44da-b49b-63d70425579a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "POST /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36/action" status: 202 len: 0 microversion: 2.1 time: 0.124560 Oct 24 11:32:52.611197 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3667/7306] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:32:52 2022] POST /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:32:52.618729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:32:52.619534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:32:52.624073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-de00c512-f927-4149-95e1-dc7cbbeffdc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:32:52.624906 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-de00c512-f927-4149-95e1-dc7cbbeffdc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:32:52.633427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de00c512-f927-4149-95e1-dc7cbbeffdc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:52.634007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de00c512-f927-4149-95e1-dc7cbbeffdc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:52.634541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de00c512-f927-4149-95e1-dc7cbbeffdc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:52.635407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de00c512-f927-4149-95e1-dc7cbbeffdc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:52.635925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de00c512-f927-4149-95e1-dc7cbbeffdc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:52.636378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de00c512-f927-4149-95e1-dc7cbbeffdc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:52.777294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-de00c512-f927-4149-95e1-dc7cbbeffdc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:32:52.786373 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-de00c512-f927-4149-95e1-dc7cbbeffdc7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1725 microversion: 2.1 time: 0.170337 Oct 24 11:32:52.786839 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3640/7307] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:32:52 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:32:53.811302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2894c0d4-38d7-4e55-9dad-d598dc0302cc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:32:53.811916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2894c0d4-38d7-4e55-9dad-d598dc0302cc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:32:53.819427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2894c0d4-38d7-4e55-9dad-d598dc0302cc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:53.820258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2894c0d4-38d7-4e55-9dad-d598dc0302cc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:53.820707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2894c0d4-38d7-4e55-9dad-d598dc0302cc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:53.821442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2894c0d4-38d7-4e55-9dad-d598dc0302cc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:53.821951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2894c0d4-38d7-4e55-9dad-d598dc0302cc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:53.822331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2894c0d4-38d7-4e55-9dad-d598dc0302cc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:53.961121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2894c0d4-38d7-4e55-9dad-d598dc0302cc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:32:53.969535 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2894c0d4-38d7-4e55-9dad-d598dc0302cc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1725 microversion: 2.1 time: 0.162875 Oct 24 11:32:53.970120 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3668/7308] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:32:53 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:32:54.994181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b9dbc2a1-e0f5-481a-86a1-d54bafa69dbe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:32:54.994802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b9dbc2a1-e0f5-481a-86a1-d54bafa69dbe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:32:55.001668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9dbc2a1-e0f5-481a-86a1-d54bafa69dbe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:55.002163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9dbc2a1-e0f5-481a-86a1-d54bafa69dbe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:55.002611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9dbc2a1-e0f5-481a-86a1-d54bafa69dbe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:55.003320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9dbc2a1-e0f5-481a-86a1-d54bafa69dbe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:55.003786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9dbc2a1-e0f5-481a-86a1-d54bafa69dbe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:55.004225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b9dbc2a1-e0f5-481a-86a1-d54bafa69dbe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:55.141403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b9dbc2a1-e0f5-481a-86a1-d54bafa69dbe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:32:55.150324 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b9dbc2a1-e0f5-481a-86a1-d54bafa69dbe tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1730 microversion: 2.1 time: 0.160290 Oct 24 11:32:55.150907 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3641/7309] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:32:54 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:32:56.174058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-894b8e85-3473-4165-82ab-7c1a05082989 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:32:56.174674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-894b8e85-3473-4165-82ab-7c1a05082989 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:32:56.182061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-894b8e85-3473-4165-82ab-7c1a05082989 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:56.182546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-894b8e85-3473-4165-82ab-7c1a05082989 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:56.182978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-894b8e85-3473-4165-82ab-7c1a05082989 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:56.183665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-894b8e85-3473-4165-82ab-7c1a05082989 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:56.184113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-894b8e85-3473-4165-82ab-7c1a05082989 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:56.184534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-894b8e85-3473-4165-82ab-7c1a05082989 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:56.315409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-894b8e85-3473-4165-82ab-7c1a05082989 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:32:56.323901 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-894b8e85-3473-4165-82ab-7c1a05082989 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1730 microversion: 2.1 time: 0.153697 Oct 24 11:32:56.324477 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3669/7310] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:32:56 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:32:57.347154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-71e30457-ef3c-4890-a690-f1d2ecfc602c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:32:57.347791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-71e30457-ef3c-4890-a690-f1d2ecfc602c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:32:57.354385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71e30457-ef3c-4890-a690-f1d2ecfc602c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:57.354886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71e30457-ef3c-4890-a690-f1d2ecfc602c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:57.355351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71e30457-ef3c-4890-a690-f1d2ecfc602c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:57.356061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71e30457-ef3c-4890-a690-f1d2ecfc602c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:57.356540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71e30457-ef3c-4890-a690-f1d2ecfc602c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:57.357031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71e30457-ef3c-4890-a690-f1d2ecfc602c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:57.486943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-71e30457-ef3c-4890-a690-f1d2ecfc602c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:32:57.495975 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-71e30457-ef3c-4890-a690-f1d2ecfc602c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1730 microversion: 2.1 time: 0.152738 Oct 24 11:32:57.496550 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3642/7311] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:32:57 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:32:58.518479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ab0b8a2e-8d8f-4844-94bb-d35cd8cc26f6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:32:58.519088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ab0b8a2e-8d8f-4844-94bb-d35cd8cc26f6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:32:58.526658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab0b8a2e-8d8f-4844-94bb-d35cd8cc26f6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:58.527138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab0b8a2e-8d8f-4844-94bb-d35cd8cc26f6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:58.527571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab0b8a2e-8d8f-4844-94bb-d35cd8cc26f6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:58.528258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab0b8a2e-8d8f-4844-94bb-d35cd8cc26f6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:58.528707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab0b8a2e-8d8f-4844-94bb-d35cd8cc26f6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:58.529152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ab0b8a2e-8d8f-4844-94bb-d35cd8cc26f6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:58.660551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ab0b8a2e-8d8f-4844-94bb-d35cd8cc26f6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:32:58.669370 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ab0b8a2e-8d8f-4844-94bb-d35cd8cc26f6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1730 microversion: 2.1 time: 0.154815 Oct 24 11:32:58.669944 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3670/7312] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:32:58 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:32:59.693200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4bbe6866-bf45-41c8-aea4-81aaf4ae560b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:32:59.693837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4bbe6866-bf45-41c8-aea4-81aaf4ae560b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:32:59.700772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bbe6866-bf45-41c8-aea4-81aaf4ae560b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:59.701310 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bbe6866-bf45-41c8-aea4-81aaf4ae560b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:59.701769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bbe6866-bf45-41c8-aea4-81aaf4ae560b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:59.702493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bbe6866-bf45-41c8-aea4-81aaf4ae560b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:32:59.702971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bbe6866-bf45-41c8-aea4-81aaf4ae560b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:32:59.703416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4bbe6866-bf45-41c8-aea4-81aaf4ae560b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:32:59.831513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4bbe6866-bf45-41c8-aea4-81aaf4ae560b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:32:59.839866 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4bbe6866-bf45-41c8-aea4-81aaf4ae560b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1730 microversion: 2.1 time: 0.150640 Oct 24 11:32:59.840443 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3643/7313] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:32:59 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:00.864181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d78dc634-9dff-442c-92ba-fdb86e3ea71e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:00.864795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d78dc634-9dff-442c-92ba-fdb86e3ea71e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:00.871591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d78dc634-9dff-442c-92ba-fdb86e3ea71e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:00.872073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d78dc634-9dff-442c-92ba-fdb86e3ea71e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:00.872506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d78dc634-9dff-442c-92ba-fdb86e3ea71e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:00.873221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d78dc634-9dff-442c-92ba-fdb86e3ea71e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:00.873675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d78dc634-9dff-442c-92ba-fdb86e3ea71e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:00.874101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d78dc634-9dff-442c-92ba-fdb86e3ea71e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:01.005237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d78dc634-9dff-442c-92ba-fdb86e3ea71e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:01.014230 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d78dc634-9dff-442c-92ba-fdb86e3ea71e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1730 microversion: 2.1 time: 0.153914 Oct 24 11:33:01.014812 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3671/7314] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:00 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:02.039234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e3ae3d4c-514c-405e-b82a-998f964895e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:02.039897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e3ae3d4c-514c-405e-b82a-998f964895e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:02.046745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3ae3d4c-514c-405e-b82a-998f964895e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:02.047245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3ae3d4c-514c-405e-b82a-998f964895e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:02.047696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3ae3d4c-514c-405e-b82a-998f964895e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:02.048398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3ae3d4c-514c-405e-b82a-998f964895e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:02.048893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3ae3d4c-514c-405e-b82a-998f964895e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:02.049338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e3ae3d4c-514c-405e-b82a-998f964895e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:02.178953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e3ae3d4c-514c-405e-b82a-998f964895e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:02.187362 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e3ae3d4c-514c-405e-b82a-998f964895e6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1730 microversion: 2.1 time: 0.152997 Oct 24 11:33:02.187942 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3644/7315] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:02 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:03.210831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cbd0a928-dbf9-469a-a621-73c00738604d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:03.211453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cbd0a928-dbf9-469a-a621-73c00738604d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:03.218508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbd0a928-dbf9-469a-a621-73c00738604d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:03.218987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbd0a928-dbf9-469a-a621-73c00738604d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:03.219423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbd0a928-dbf9-469a-a621-73c00738604d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:03.220123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbd0a928-dbf9-469a-a621-73c00738604d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:03.220575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbd0a928-dbf9-469a-a621-73c00738604d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:03.221025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cbd0a928-dbf9-469a-a621-73c00738604d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:03.351361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cbd0a928-dbf9-469a-a621-73c00738604d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:03.359621 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cbd0a928-dbf9-469a-a621-73c00738604d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1730 microversion: 2.1 time: 0.153425 Oct 24 11:33:03.360184 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3672/7316] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:03 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:04.383381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4f4b6328-7603-43ec-8188-eeb8c3f8a99f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:04.383949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4f4b6328-7603-43ec-8188-eeb8c3f8a99f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:04.391108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f4b6328-7603-43ec-8188-eeb8c3f8a99f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:04.391609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f4b6328-7603-43ec-8188-eeb8c3f8a99f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:04.392063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f4b6328-7603-43ec-8188-eeb8c3f8a99f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:04.392802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f4b6328-7603-43ec-8188-eeb8c3f8a99f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:04.393316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f4b6328-7603-43ec-8188-eeb8c3f8a99f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:04.393758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f4b6328-7603-43ec-8188-eeb8c3f8a99f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:04.524888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4f4b6328-7603-43ec-8188-eeb8c3f8a99f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:04.533361 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4f4b6328-7603-43ec-8188-eeb8c3f8a99f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1730 microversion: 2.1 time: 0.154351 Oct 24 11:33:04.533939 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3645/7317] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:04 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:05.558151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bbdc1703-5831-4a61-9c6f-08423c23da77 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:05.558697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bbdc1703-5831-4a61-9c6f-08423c23da77 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:05.566153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbdc1703-5831-4a61-9c6f-08423c23da77 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:05.566732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbdc1703-5831-4a61-9c6f-08423c23da77 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:05.567242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbdc1703-5831-4a61-9c6f-08423c23da77 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:05.568007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbdc1703-5831-4a61-9c6f-08423c23da77 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:05.568459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbdc1703-5831-4a61-9c6f-08423c23da77 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:05.569100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bbdc1703-5831-4a61-9c6f-08423c23da77 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:05.701388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bbdc1703-5831-4a61-9c6f-08423c23da77 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:05.709599 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bbdc1703-5831-4a61-9c6f-08423c23da77 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1730 microversion: 2.1 time: 0.155990 Oct 24 11:33:05.710326 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3673/7318] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:05 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:06.733681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5d003a01-e6da-4202-adc0-f0c285b96dbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:06.734317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5d003a01-e6da-4202-adc0-f0c285b96dbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:06.741327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d003a01-e6da-4202-adc0-f0c285b96dbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:06.741897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d003a01-e6da-4202-adc0-f0c285b96dbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:06.742360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d003a01-e6da-4202-adc0-f0c285b96dbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:06.743101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d003a01-e6da-4202-adc0-f0c285b96dbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:06.743577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d003a01-e6da-4202-adc0-f0c285b96dbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:06.744029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d003a01-e6da-4202-adc0-f0c285b96dbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:07.166382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5d003a01-e6da-4202-adc0-f0c285b96dbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:07.174698 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5d003a01-e6da-4202-adc0-f0c285b96dbb tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1730 microversion: 2.1 time: 0.444919 Oct 24 11:33:07.175273 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3646/7319] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:06 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1730 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:08.198585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cc348850-986a-49b2-8cd3-caed8629913d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:08.199199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cc348850-986a-49b2-8cd3-caed8629913d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:08.206015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc348850-986a-49b2-8cd3-caed8629913d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:08.206502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc348850-986a-49b2-8cd3-caed8629913d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:08.206925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc348850-986a-49b2-8cd3-caed8629913d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:08.207614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc348850-986a-49b2-8cd3-caed8629913d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:08.208061 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc348850-986a-49b2-8cd3-caed8629913d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:08.208484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cc348850-986a-49b2-8cd3-caed8629913d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:08.337531 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cc348850-986a-49b2-8cd3-caed8629913d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:08.345776 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cc348850-986a-49b2-8cd3-caed8629913d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1730 microversion: 2.1 time: 0.151154 Oct 24 11:33:08.346355 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3674/7320] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:08 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:09.370522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad3eb1e0-4883-4233-81d6-caa883dda28c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:09.371146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad3eb1e0-4883-4233-81d6-caa883dda28c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:09.378076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3eb1e0-4883-4233-81d6-caa883dda28c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:09.378522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3eb1e0-4883-4233-81d6-caa883dda28c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:09.378977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3eb1e0-4883-4233-81d6-caa883dda28c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:09.379684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3eb1e0-4883-4233-81d6-caa883dda28c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:09.380153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3eb1e0-4883-4233-81d6-caa883dda28c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:09.380594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad3eb1e0-4883-4233-81d6-caa883dda28c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:09.515666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ad3eb1e0-4883-4233-81d6-caa883dda28c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:09.523966 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad3eb1e0-4883-4233-81d6-caa883dda28c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1730 microversion: 2.1 time: 0.158120 Oct 24 11:33:09.524555 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3647/7321] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:09 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:10.548448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-90a9923f-1c37-4763-8994-dee0e4510a66 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:10.549092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-90a9923f-1c37-4763-8994-dee0e4510a66 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:10.556455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90a9923f-1c37-4763-8994-dee0e4510a66 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:10.556958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90a9923f-1c37-4763-8994-dee0e4510a66 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:10.557392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90a9923f-1c37-4763-8994-dee0e4510a66 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:10.558080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90a9923f-1c37-4763-8994-dee0e4510a66 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:10.558527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90a9923f-1c37-4763-8994-dee0e4510a66 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:10.558950 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-90a9923f-1c37-4763-8994-dee0e4510a66 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:10.693274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-90a9923f-1c37-4763-8994-dee0e4510a66 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:10.702868 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-90a9923f-1c37-4763-8994-dee0e4510a66 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1730 microversion: 2.1 time: 0.158179 Oct 24 11:33:10.703455 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3675/7322] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:10 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:11.726237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3f1259fe-9862-4b59-b004-a5d7b8052409 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:11.727015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3f1259fe-9862-4b59-b004-a5d7b8052409 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:11.734039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f1259fe-9862-4b59-b004-a5d7b8052409 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:11.734538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f1259fe-9862-4b59-b004-a5d7b8052409 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:11.734989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f1259fe-9862-4b59-b004-a5d7b8052409 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:11.735697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f1259fe-9862-4b59-b004-a5d7b8052409 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:11.736169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f1259fe-9862-4b59-b004-a5d7b8052409 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:11.736605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3f1259fe-9862-4b59-b004-a5d7b8052409 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:11.871255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3f1259fe-9862-4b59-b004-a5d7b8052409 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:11.879667 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3f1259fe-9862-4b59-b004-a5d7b8052409 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1730 microversion: 2.1 time: 0.157830 Oct 24 11:33:11.880247 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3648/7323] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:11 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:12.904095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-35b14a77-ff10-47e9-a9f3-06e56e54f104 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:12.904704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-35b14a77-ff10-47e9-a9f3-06e56e54f104 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:12.912073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35b14a77-ff10-47e9-a9f3-06e56e54f104 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:12.912680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35b14a77-ff10-47e9-a9f3-06e56e54f104 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:12.913837 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35b14a77-ff10-47e9-a9f3-06e56e54f104 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:12.914631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35b14a77-ff10-47e9-a9f3-06e56e54f104 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:12.915152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35b14a77-ff10-47e9-a9f3-06e56e54f104 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:12.915594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35b14a77-ff10-47e9-a9f3-06e56e54f104 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:13.051069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-35b14a77-ff10-47e9-a9f3-06e56e54f104 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:13.060380 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-35b14a77-ff10-47e9-a9f3-06e56e54f104 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1730 microversion: 2.1 time: 0.160059 Oct 24 11:33:13.061252 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3676/7324] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:12 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:13.645756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-4651035f-1a2a-4f3c-b565-469a75213b9f req-215ed8c2-c4d3-4824-a65e-c896d2e8ff69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b3ca59-a5ea-489a-9576-ce182ef96b36", "name": "network-vif-unplugged", "status": "completed", "tag": "e96a62fa-912d-4a0f-ac68-733b24553735"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:33:13.665656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4651035f-1a2a-4f3c-b565-469a75213b9f req-215ed8c2-c4d3-4824-a65e-c896d2e8ff69 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:13.667016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4651035f-1a2a-4f3c-b565-469a75213b9f req-215ed8c2-c4d3-4824-a65e-c896d2e8ff69 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:13.667830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4651035f-1a2a-4f3c-b565-469a75213b9f req-215ed8c2-c4d3-4824-a65e-c896d2e8ff69 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:13.681411 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-4651035f-1a2a-4f3c-b565-469a75213b9f req-215ed8c2-c4d3-4824-a65e-c896d2e8ff69 service nova] Creating event network-vif-unplugged:e96a62fa-912d-4a0f-ac68-733b24553735 for instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 on n-h2-858383-15 Oct 24 11:33:13.687169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-4651035f-1a2a-4f3c-b565-469a75213b9f req-215ed8c2-c4d3-4824-a65e-c896d2e8ff69 service nova] Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:33:13.693842 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-4651035f-1a2a-4f3c-b565-469a75213b9f req-215ed8c2-c4d3-4824-a65e-c896d2e8ff69 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052042 Oct 24 11:33:13.695319 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3649/7325] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:33:14.083932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-73d7d854-3741-4b06-9b36-7cbcdcc9570f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:14.084475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-73d7d854-3741-4b06-9b36-7cbcdcc9570f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:14.092334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73d7d854-3741-4b06-9b36-7cbcdcc9570f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:14.092829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73d7d854-3741-4b06-9b36-7cbcdcc9570f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:14.093335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73d7d854-3741-4b06-9b36-7cbcdcc9570f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:14.094050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73d7d854-3741-4b06-9b36-7cbcdcc9570f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:14.094509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73d7d854-3741-4b06-9b36-7cbcdcc9570f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:14.094944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-73d7d854-3741-4b06-9b36-7cbcdcc9570f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:14.235715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-73d7d854-3741-4b06-9b36-7cbcdcc9570f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:14.245070 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-73d7d854-3741-4b06-9b36-7cbcdcc9570f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1727 microversion: 2.1 time: 0.165099 Oct 24 11:33:14.252608 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3677/7326] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:14 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:15.270287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fb1f31c8-3a0a-4264-8b91-f321570e7951 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:15.271135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fb1f31c8-3a0a-4264-8b91-f321570e7951 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:15.279154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb1f31c8-3a0a-4264-8b91-f321570e7951 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:15.279652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb1f31c8-3a0a-4264-8b91-f321570e7951 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:15.280101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb1f31c8-3a0a-4264-8b91-f321570e7951 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:15.280804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb1f31c8-3a0a-4264-8b91-f321570e7951 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:15.281296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb1f31c8-3a0a-4264-8b91-f321570e7951 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:15.281989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb1f31c8-3a0a-4264-8b91-f321570e7951 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:15.417888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fb1f31c8-3a0a-4264-8b91-f321570e7951 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:15.426629 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fb1f31c8-3a0a-4264-8b91-f321570e7951 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1727 microversion: 2.1 time: 0.160598 Oct 24 11:33:15.427216 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3650/7327] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:15 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:16.451043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ef13a10e-69a4-45c2-a1c3-2a161f18772a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:16.451703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ef13a10e-69a4-45c2-a1c3-2a161f18772a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:16.458659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef13a10e-69a4-45c2-a1c3-2a161f18772a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:16.459154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef13a10e-69a4-45c2-a1c3-2a161f18772a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:16.459595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef13a10e-69a4-45c2-a1c3-2a161f18772a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:16.461072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef13a10e-69a4-45c2-a1c3-2a161f18772a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:16.461533 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef13a10e-69a4-45c2-a1c3-2a161f18772a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:16.461968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef13a10e-69a4-45c2-a1c3-2a161f18772a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:16.593606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ef13a10e-69a4-45c2-a1c3-2a161f18772a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:16.602638 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ef13a10e-69a4-45c2-a1c3-2a161f18772a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1727 microversion: 2.1 time: 0.155585 Oct 24 11:33:16.603227 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3678/7328] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:16 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:17.626232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f9ee697d-6dcd-4566-a5c1-cb7a102990a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:17.626857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f9ee697d-6dcd-4566-a5c1-cb7a102990a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:17.634474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9ee697d-6dcd-4566-a5c1-cb7a102990a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:17.634969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9ee697d-6dcd-4566-a5c1-cb7a102990a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:17.635454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9ee697d-6dcd-4566-a5c1-cb7a102990a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:17.636159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9ee697d-6dcd-4566-a5c1-cb7a102990a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:17.636627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9ee697d-6dcd-4566-a5c1-cb7a102990a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:17.637095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f9ee697d-6dcd-4566-a5c1-cb7a102990a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:17.780271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f9ee697d-6dcd-4566-a5c1-cb7a102990a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:17.789928 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f9ee697d-6dcd-4566-a5c1-cb7a102990a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1727 microversion: 2.1 time: 0.167477 Oct 24 11:33:17.790541 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3651/7329] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:17 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:18.813664 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d7efb852-f281-4a50-a5c1-a0d8459599a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:18.814281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d7efb852-f281-4a50-a5c1-a0d8459599a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:18.820750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7efb852-f281-4a50-a5c1-a0d8459599a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:18.821272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7efb852-f281-4a50-a5c1-a0d8459599a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:18.821711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7efb852-f281-4a50-a5c1-a0d8459599a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:18.822413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7efb852-f281-4a50-a5c1-a0d8459599a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:18.822872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7efb852-f281-4a50-a5c1-a0d8459599a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:18.823298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7efb852-f281-4a50-a5c1-a0d8459599a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:18.954073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d7efb852-f281-4a50-a5c1-a0d8459599a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:18.963159 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d7efb852-f281-4a50-a5c1-a0d8459599a6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1727 microversion: 2.1 time: 0.154312 Oct 24 11:33:18.963737 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3679/7330] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:18 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:19.988038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-72b34384-3f44-4554-ba4c-969f726eafbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:19.988701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-72b34384-3f44-4554-ba4c-969f726eafbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:19.995565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b34384-3f44-4554-ba4c-969f726eafbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:19.996065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b34384-3f44-4554-ba4c-969f726eafbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:19.996523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b34384-3f44-4554-ba4c-969f726eafbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:19.997257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b34384-3f44-4554-ba4c-969f726eafbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:19.997731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b34384-3f44-4554-ba4c-969f726eafbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:19.998176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-72b34384-3f44-4554-ba4c-969f726eafbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:20.129909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-72b34384-3f44-4554-ba4c-969f726eafbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:20.139421 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-72b34384-3f44-4554-ba4c-969f726eafbc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1727 microversion: 2.1 time: 0.155281 Oct 24 11:33:20.140012 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3652/7331] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:19 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:33:21.163713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3dd306fd-3e1a-4a4a-9384-ab791ea8ffc6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:21.164326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3dd306fd-3e1a-4a4a-9384-ab791ea8ffc6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:21.171175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dd306fd-3e1a-4a4a-9384-ab791ea8ffc6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:21.171656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dd306fd-3e1a-4a4a-9384-ab791ea8ffc6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:21.172095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dd306fd-3e1a-4a4a-9384-ab791ea8ffc6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:21.172788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dd306fd-3e1a-4a4a-9384-ab791ea8ffc6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:21.173273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dd306fd-3e1a-4a4a-9384-ab791ea8ffc6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:21.173751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3dd306fd-3e1a-4a4a-9384-ab791ea8ffc6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:21.308259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3dd306fd-3e1a-4a4a-9384-ab791ea8ffc6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:21.316460 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3dd306fd-3e1a-4a4a-9384-ab791ea8ffc6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1727 microversion: 2.1 time: 0.156774 Oct 24 11:33:21.317067 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3680/7332] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:21 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:22.340279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-777f4ef3-ca30-47fb-b001-e9b3136e5c42 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:22.340957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-777f4ef3-ca30-47fb-b001-e9b3136e5c42 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:22.347904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-777f4ef3-ca30-47fb-b001-e9b3136e5c42 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:22.348408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-777f4ef3-ca30-47fb-b001-e9b3136e5c42 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:22.348894 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-777f4ef3-ca30-47fb-b001-e9b3136e5c42 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:22.349612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-777f4ef3-ca30-47fb-b001-e9b3136e5c42 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:22.350092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-777f4ef3-ca30-47fb-b001-e9b3136e5c42 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:22.351045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-777f4ef3-ca30-47fb-b001-e9b3136e5c42 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:22.479483 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-777f4ef3-ca30-47fb-b001-e9b3136e5c42 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:22.487708 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-777f4ef3-ca30-47fb-b001-e9b3136e5c42 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1727 microversion: 2.1 time: 0.151417 Oct 24 11:33:22.488292 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3653/7333] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:22 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:23.511627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ddaff612-bf60-4334-bbef-181eac884e92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:23.512239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ddaff612-bf60-4334-bbef-181eac884e92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:23.514897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=33 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:33:23.520364 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaff612-bf60-4334-bbef-181eac884e92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:23.520851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaff612-bf60-4334-bbef-181eac884e92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:23.521299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaff612-bf60-4334-bbef-181eac884e92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:23.521980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaff612-bf60-4334-bbef-181eac884e92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:23.522452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaff612-bf60-4334-bbef-181eac884e92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:23.522932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ddaff612-bf60-4334-bbef-181eac884e92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:23.525475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:33:23.659717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ddaff612-bf60-4334-bbef-181eac884e92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:23.668491 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ddaff612-bf60-4334-bbef-181eac884e92 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1727 microversion: 2.1 time: 0.161368 Oct 24 11:33:23.669088 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3681/7334] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:23 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:24.692344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-581803f4-2ee5-4775-ba5b-7c434d3fd164 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:24.693016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-581803f4-2ee5-4775-ba5b-7c434d3fd164 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:24.695874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=29 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:33:24.701539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-581803f4-2ee5-4775-ba5b-7c434d3fd164 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:24.702044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-581803f4-2ee5-4775-ba5b-7c434d3fd164 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:24.702501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-581803f4-2ee5-4775-ba5b-7c434d3fd164 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:24.703248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-581803f4-2ee5-4775-ba5b-7c434d3fd164 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:24.703722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-581803f4-2ee5-4775-ba5b-7c434d3fd164 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:24.704171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-581803f4-2ee5-4775-ba5b-7c434d3fd164 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:24.708119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=83 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:33:24.838027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-581803f4-2ee5-4775-ba5b-7c434d3fd164 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:24.846356 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-581803f4-2ee5-4775-ba5b-7c434d3fd164 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1727 microversion: 2.1 time: 0.157938 Oct 24 11:33:24.846949 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3654/7335] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:24 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:25.871803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4f67de56-e89c-4580-bb27-6acc326af049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:25.872472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4f67de56-e89c-4580-bb27-6acc326af049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:25.879341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f67de56-e89c-4580-bb27-6acc326af049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:25.879836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f67de56-e89c-4580-bb27-6acc326af049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:25.880272 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f67de56-e89c-4580-bb27-6acc326af049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:25.881011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f67de56-e89c-4580-bb27-6acc326af049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:25.881455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f67de56-e89c-4580-bb27-6acc326af049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:25.881879 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f67de56-e89c-4580-bb27-6acc326af049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:26.024154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4f67de56-e89c-4580-bb27-6acc326af049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:26.033262 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4f67de56-e89c-4580-bb27-6acc326af049 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1724 microversion: 2.1 time: 0.165888 Oct 24 11:33:26.034252 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3682/7336] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:25 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:26.057741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ae1d8fa8-c7f6-45f7-a0a4-08f5b9181315 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:33:26.058306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ae1d8fa8-c7f6-45f7-a0a4-08f5b9181315 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:26.065485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1d8fa8-c7f6-45f7-a0a4-08f5b9181315 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:26.066135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1d8fa8-c7f6-45f7-a0a4-08f5b9181315 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:26.066592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1d8fa8-c7f6-45f7-a0a4-08f5b9181315 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:26.067317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1d8fa8-c7f6-45f7-a0a4-08f5b9181315 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:26.067779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1d8fa8-c7f6-45f7-a0a4-08f5b9181315 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:26.068222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1d8fa8-c7f6-45f7-a0a4-08f5b9181315 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:26.107161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1d8fa8-c7f6-45f7-a0a4-08f5b9181315 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:26.107581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1d8fa8-c7f6-45f7-a0a4-08f5b9181315 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:26.108023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1d8fa8-c7f6-45f7-a0a4-08f5b9181315 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:26.108761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1d8fa8-c7f6-45f7-a0a4-08f5b9181315 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:26.109253 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1d8fa8-c7f6-45f7-a0a4-08f5b9181315 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:26.109700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae1d8fa8-c7f6-45f7-a0a4-08f5b9181315 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:26.130706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ae1d8fa8-c7f6-45f7-a0a4-08f5b9181315 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Getting quotas for project 4c0ac700abd24e4ea516532577c09aa5. Resources: {'cores', 'ram'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:33:26.136646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ae1d8fa8-c7f6-45f7-a0a4-08f5b9181315 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Getting quotas for user 879b06d644fa496c94f9226f23d79716 and project 4c0ac700abd24e4ea516532577c09aa5. Resources: {'cores', 'ram'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:33:26.240709 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ae1d8fa8-c7f6-45f7-a0a4-08f5b9181315 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "POST /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36/action" status: 202 len: 0 microversion: 2.1 time: 0.187772 Oct 24 11:33:26.241669 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3655/7337] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:33:26 2022] POST /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:33:26.250607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-49edb4a5-2a90-4629-95c5-2ad9f9d2fe7f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:26.251317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-49edb4a5-2a90-4629-95c5-2ad9f9d2fe7f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:26.259984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49edb4a5-2a90-4629-95c5-2ad9f9d2fe7f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:26.260594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49edb4a5-2a90-4629-95c5-2ad9f9d2fe7f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:26.261186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49edb4a5-2a90-4629-95c5-2ad9f9d2fe7f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:26.262032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49edb4a5-2a90-4629-95c5-2ad9f9d2fe7f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:26.262567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49edb4a5-2a90-4629-95c5-2ad9f9d2fe7f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:26.263212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49edb4a5-2a90-4629-95c5-2ad9f9d2fe7f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:26.412608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-49edb4a5-2a90-4629-95c5-2ad9f9d2fe7f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:26.421642 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-49edb4a5-2a90-4629-95c5-2ad9f9d2fe7f tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1723 microversion: 2.1 time: 0.175846 Oct 24 11:33:26.422217 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3683/7338] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:26 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:27.445948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9dab7dd1-39de-4e27-937d-ff87eb2e17f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:27.446794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9dab7dd1-39de-4e27-937d-ff87eb2e17f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:27.453934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dab7dd1-39de-4e27-937d-ff87eb2e17f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:27.454432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dab7dd1-39de-4e27-937d-ff87eb2e17f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:27.454882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dab7dd1-39de-4e27-937d-ff87eb2e17f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:27.455585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dab7dd1-39de-4e27-937d-ff87eb2e17f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:27.456052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dab7dd1-39de-4e27-937d-ff87eb2e17f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:27.456492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9dab7dd1-39de-4e27-937d-ff87eb2e17f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:27.587213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9dab7dd1-39de-4e27-937d-ff87eb2e17f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:27.595575 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9dab7dd1-39de-4e27-937d-ff87eb2e17f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1723 microversion: 2.1 time: 0.154924 Oct 24 11:33:27.596152 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3656/7339] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:27 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:27.763366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-87b54b29-6a82-4376-b346-395a8a10a760 req-f3d393f1-e127-4fa4-b8ed-33ccc90a236c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b3ca59-a5ea-489a-9576-ce182ef96b36", "name": "network-vif-plugged", "status": "completed", "tag": "e96a62fa-912d-4a0f-ac68-733b24553735"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:33:27.773784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-87b54b29-6a82-4376-b346-395a8a10a760 req-f3d393f1-e127-4fa4-b8ed-33ccc90a236c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:27.774783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-87b54b29-6a82-4376-b346-395a8a10a760 req-f3d393f1-e127-4fa4-b8ed-33ccc90a236c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:27.775214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-87b54b29-6a82-4376-b346-395a8a10a760 req-f3d393f1-e127-4fa4-b8ed-33ccc90a236c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:27.787107 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-87b54b29-6a82-4376-b346-395a8a10a760 req-f3d393f1-e127-4fa4-b8ed-33ccc90a236c service nova] Creating event network-vif-plugged:e96a62fa-912d-4a0f-ac68-733b24553735 for instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 on n-h2-858383-15 Oct 24 11:33:27.793072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [req-87b54b29-6a82-4376-b346-395a8a10a760 req-f3d393f1-e127-4fa4-b8ed-33ccc90a236c service nova] Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-15'} {{(pid=120426) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:33:27.799424 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-87b54b29-6a82-4376-b346-395a8a10a760 req-f3d393f1-e127-4fa4-b8ed-33ccc90a236c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040368 Oct 24 11:33:27.800039 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3684/7340] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:33:28.620965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-44edb064-e044-4321-b7de-d8e4b73d17ff tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:28.621595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-44edb064-e044-4321-b7de-d8e4b73d17ff tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:28.629372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44edb064-e044-4321-b7de-d8e4b73d17ff tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:28.629873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44edb064-e044-4321-b7de-d8e4b73d17ff tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:28.630329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44edb064-e044-4321-b7de-d8e4b73d17ff tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:28.631165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44edb064-e044-4321-b7de-d8e4b73d17ff tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:28.631561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44edb064-e044-4321-b7de-d8e4b73d17ff tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:28.632007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44edb064-e044-4321-b7de-d8e4b73d17ff tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:28.771949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-44edb064-e044-4321-b7de-d8e4b73d17ff tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:28.781518 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-44edb064-e044-4321-b7de-d8e4b73d17ff tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1723 microversion: 2.1 time: 0.165440 Oct 24 11:33:28.782389 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3657/7341] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:28 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:29.806098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8f8ebbd9-f3ea-4ce7-87a6-bf89817c2df4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:29.806682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8f8ebbd9-f3ea-4ce7-87a6-bf89817c2df4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:29.812974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f8ebbd9-f3ea-4ce7-87a6-bf89817c2df4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:29.813454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f8ebbd9-f3ea-4ce7-87a6-bf89817c2df4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:29.813885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f8ebbd9-f3ea-4ce7-87a6-bf89817c2df4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:29.814566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f8ebbd9-f3ea-4ce7-87a6-bf89817c2df4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:29.815017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f8ebbd9-f3ea-4ce7-87a6-bf89817c2df4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:29.815425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8f8ebbd9-f3ea-4ce7-87a6-bf89817c2df4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:29.956753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8f8ebbd9-f3ea-4ce7-87a6-bf89817c2df4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:29.967804 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8f8ebbd9-f3ea-4ce7-87a6-bf89817c2df4 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1723 microversion: 2.1 time: 0.166898 Oct 24 11:33:29.968869 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3685/7342] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:29 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:30.990983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ea077352-c504-4009-b710-3e830d2c885d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:30.991630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ea077352-c504-4009-b710-3e830d2c885d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:30.999692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea077352-c504-4009-b710-3e830d2c885d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:31.000231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea077352-c504-4009-b710-3e830d2c885d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:31.000690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea077352-c504-4009-b710-3e830d2c885d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:31.001440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea077352-c504-4009-b710-3e830d2c885d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:31.001921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea077352-c504-4009-b710-3e830d2c885d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:31.002375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea077352-c504-4009-b710-3e830d2c885d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:31.152999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ea077352-c504-4009-b710-3e830d2c885d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:31.161923 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ea077352-c504-4009-b710-3e830d2c885d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1723 microversion: 2.1 time: 0.175112 Oct 24 11:33:31.162510 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3658/7343] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:30 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:31.751694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-3cfb003b-0642-48c5-8baa-d4105cf8e4db req-1ad3c2fe-5aa2-47e1-b203-ff512fb30e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b3ca59-a5ea-489a-9576-ce182ef96b36", "name": "network-vif-unplugged", "status": "completed", "tag": "e96a62fa-912d-4a0f-ac68-733b24553735"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:33:31.764898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3cfb003b-0642-48c5-8baa-d4105cf8e4db req-1ad3c2fe-5aa2-47e1-b203-ff512fb30e26 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:31.765394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3cfb003b-0642-48c5-8baa-d4105cf8e4db req-1ad3c2fe-5aa2-47e1-b203-ff512fb30e26 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:31.766135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3cfb003b-0642-48c5-8baa-d4105cf8e4db req-1ad3c2fe-5aa2-47e1-b203-ff512fb30e26 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:31.779000 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-3cfb003b-0642-48c5-8baa-d4105cf8e4db req-1ad3c2fe-5aa2-47e1-b203-ff512fb30e26 service nova] Creating event network-vif-unplugged:e96a62fa-912d-4a0f-ac68-733b24553735 for instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 on n-h2-858383-15 Oct 24 11:33:31.785219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [req-3cfb003b-0642-48c5-8baa-d4105cf8e4db req-1ad3c2fe-5aa2-47e1-b203-ff512fb30e26 service nova] Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-15'} {{(pid=120426) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:33:31.792547 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-3cfb003b-0642-48c5-8baa-d4105cf8e4db req-1ad3c2fe-5aa2-47e1-b203-ff512fb30e26 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044798 Oct 24 11:33:31.793212 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3686/7344] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:33:32.186753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-197a05ae-a3ec-47c6-950a-ea0f5f0e4bf8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:32.188160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-197a05ae-a3ec-47c6-950a-ea0f5f0e4bf8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:32.195506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-197a05ae-a3ec-47c6-950a-ea0f5f0e4bf8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:32.197230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-197a05ae-a3ec-47c6-950a-ea0f5f0e4bf8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:32.198064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-197a05ae-a3ec-47c6-950a-ea0f5f0e4bf8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:32.198799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-197a05ae-a3ec-47c6-950a-ea0f5f0e4bf8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:32.199301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-197a05ae-a3ec-47c6-950a-ea0f5f0e4bf8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:32.199743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-197a05ae-a3ec-47c6-950a-ea0f5f0e4bf8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:32.337803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-197a05ae-a3ec-47c6-950a-ea0f5f0e4bf8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:32.346833 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-197a05ae-a3ec-47c6-950a-ea0f5f0e4bf8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1723 microversion: 2.1 time: 0.164162 Oct 24 11:33:32.347393 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3659/7345] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:32 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:33.373029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c844637b-3bb3-4e8f-a255-7795c64398aa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:33.373750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c844637b-3bb3-4e8f-a255-7795c64398aa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:33.380081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c844637b-3bb3-4e8f-a255-7795c64398aa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:33.380518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c844637b-3bb3-4e8f-a255-7795c64398aa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:33.381003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c844637b-3bb3-4e8f-a255-7795c64398aa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:33.381704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c844637b-3bb3-4e8f-a255-7795c64398aa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:33.382165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c844637b-3bb3-4e8f-a255-7795c64398aa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:33.382597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c844637b-3bb3-4e8f-a255-7795c64398aa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:33.515071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c844637b-3bb3-4e8f-a255-7795c64398aa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:33.523495 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c844637b-3bb3-4e8f-a255-7795c64398aa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1723 microversion: 2.1 time: 0.156233 Oct 24 11:33:33.524073 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3687/7346] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:33 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:34.547102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ee26348d-4641-4a72-a85f-bb4771954bfa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:34.547735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ee26348d-4641-4a72-a85f-bb4771954bfa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:34.554724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee26348d-4641-4a72-a85f-bb4771954bfa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:34.555262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee26348d-4641-4a72-a85f-bb4771954bfa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:34.555722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee26348d-4641-4a72-a85f-bb4771954bfa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:34.556443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee26348d-4641-4a72-a85f-bb4771954bfa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:34.556942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee26348d-4641-4a72-a85f-bb4771954bfa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:34.557391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ee26348d-4641-4a72-a85f-bb4771954bfa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:34.697798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ee26348d-4641-4a72-a85f-bb4771954bfa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:34.706300 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ee26348d-4641-4a72-a85f-bb4771954bfa tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1723 microversion: 2.1 time: 0.163159 Oct 24 11:33:34.706988 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3660/7347] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:34 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:35.732280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1adb75e1-79d3-4113-b2ca-1947c745d20a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:35.732825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1adb75e1-79d3-4113-b2ca-1947c745d20a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:35.739820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1adb75e1-79d3-4113-b2ca-1947c745d20a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:35.740332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1adb75e1-79d3-4113-b2ca-1947c745d20a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:35.740773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1adb75e1-79d3-4113-b2ca-1947c745d20a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:35.741495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1adb75e1-79d3-4113-b2ca-1947c745d20a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:35.741952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1adb75e1-79d3-4113-b2ca-1947c745d20a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:35.742380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1adb75e1-79d3-4113-b2ca-1947c745d20a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:35.879060 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1adb75e1-79d3-4113-b2ca-1947c745d20a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:35.888867 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1adb75e1-79d3-4113-b2ca-1947c745d20a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1723 microversion: 2.1 time: 0.160746 Oct 24 11:33:35.889797 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3688/7348] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:35 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:36.912734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e82145cb-87c6-460a-8e88-01467a14e511 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:36.913390 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e82145cb-87c6-460a-8e88-01467a14e511 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:36.916550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:33:36.922297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82145cb-87c6-460a-8e88-01467a14e511 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:36.922798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82145cb-87c6-460a-8e88-01467a14e511 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:36.923255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82145cb-87c6-460a-8e88-01467a14e511 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:36.923968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82145cb-87c6-460a-8e88-01467a14e511 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:36.924460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82145cb-87c6-460a-8e88-01467a14e511 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:36.924919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e82145cb-87c6-460a-8e88-01467a14e511 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:37.072252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e82145cb-87c6-460a-8e88-01467a14e511 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:37.080605 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e82145cb-87c6-460a-8e88-01467a14e511 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1723 microversion: 2.1 time: 0.171818 Oct 24 11:33:37.081215 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3661/7349] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:36 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:38.105667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bb78cd16-c655-4217-bb68-d95239762934 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:38.106382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bb78cd16-c655-4217-bb68-d95239762934 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:38.113121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb78cd16-c655-4217-bb68-d95239762934 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:38.113598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb78cd16-c655-4217-bb68-d95239762934 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:38.114057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb78cd16-c655-4217-bb68-d95239762934 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:38.114741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb78cd16-c655-4217-bb68-d95239762934 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:38.115189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb78cd16-c655-4217-bb68-d95239762934 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:38.115637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bb78cd16-c655-4217-bb68-d95239762934 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:38.244477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bb78cd16-c655-4217-bb68-d95239762934 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:38.252757 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bb78cd16-c655-4217-bb68-d95239762934 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1723 microversion: 2.1 time: 0.151035 Oct 24 11:33:38.253353 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3689/7350] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:38 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:39.276789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f74fc006-dcbe-453e-9322-52ad73091891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:39.277446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f74fc006-dcbe-453e-9322-52ad73091891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:39.284567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f74fc006-dcbe-453e-9322-52ad73091891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:39.285105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f74fc006-dcbe-453e-9322-52ad73091891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:39.285564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f74fc006-dcbe-453e-9322-52ad73091891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:39.286274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f74fc006-dcbe-453e-9322-52ad73091891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:39.286750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f74fc006-dcbe-453e-9322-52ad73091891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:39.287201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f74fc006-dcbe-453e-9322-52ad73091891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:39.419822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f74fc006-dcbe-453e-9322-52ad73091891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:39.428230 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f74fc006-dcbe-453e-9322-52ad73091891 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1723 microversion: 2.1 time: 0.156021 Oct 24 11:33:39.428814 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3662/7351] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:39 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:40.452499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d6c335d3-4fe7-49e1-b78d-8b54dea5b73d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:40.453146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d6c335d3-4fe7-49e1-b78d-8b54dea5b73d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:40.460165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6c335d3-4fe7-49e1-b78d-8b54dea5b73d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:40.460645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6c335d3-4fe7-49e1-b78d-8b54dea5b73d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:40.461124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6c335d3-4fe7-49e1-b78d-8b54dea5b73d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:40.461849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6c335d3-4fe7-49e1-b78d-8b54dea5b73d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:40.462885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6c335d3-4fe7-49e1-b78d-8b54dea5b73d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:40.463426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d6c335d3-4fe7-49e1-b78d-8b54dea5b73d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:40.593733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d6c335d3-4fe7-49e1-b78d-8b54dea5b73d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:40.601965 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d6c335d3-4fe7-49e1-b78d-8b54dea5b73d tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1723 microversion: 2.1 time: 0.153355 Oct 24 11:33:40.602577 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3690/7352] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:40 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:41.626642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4507924a-4ab4-4c41-a96d-5b5bbf3f7e49 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:41.627266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4507924a-4ab4-4c41-a96d-5b5bbf3f7e49 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:41.634041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4507924a-4ab4-4c41-a96d-5b5bbf3f7e49 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:41.634563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4507924a-4ab4-4c41-a96d-5b5bbf3f7e49 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:41.635010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4507924a-4ab4-4c41-a96d-5b5bbf3f7e49 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:41.635716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4507924a-4ab4-4c41-a96d-5b5bbf3f7e49 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:41.636183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4507924a-4ab4-4c41-a96d-5b5bbf3f7e49 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:41.636622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4507924a-4ab4-4c41-a96d-5b5bbf3f7e49 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:41.769570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4507924a-4ab4-4c41-a96d-5b5bbf3f7e49 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:41.778174 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4507924a-4ab4-4c41-a96d-5b5bbf3f7e49 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1723 microversion: 2.1 time: 0.155523 Oct 24 11:33:41.778762 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3663/7353] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:41 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:42.802803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b83e023f-1f90-4286-aac9-31971541280c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:42.803477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b83e023f-1f90-4286-aac9-31971541280c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:42.810931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b83e023f-1f90-4286-aac9-31971541280c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:42.811416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b83e023f-1f90-4286-aac9-31971541280c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:42.811854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b83e023f-1f90-4286-aac9-31971541280c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:42.812544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b83e023f-1f90-4286-aac9-31971541280c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:42.813043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b83e023f-1f90-4286-aac9-31971541280c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:42.813476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b83e023f-1f90-4286-aac9-31971541280c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:42.954990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b83e023f-1f90-4286-aac9-31971541280c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:42.963194 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b83e023f-1f90-4286-aac9-31971541280c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1723 microversion: 2.1 time: 0.164290 Oct 24 11:33:42.963764 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3691/7354] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:42 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:43.987107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2e1034ec-2075-4c4a-bde0-eba030260d2b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:43.987747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2e1034ec-2075-4c4a-bde0-eba030260d2b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:43.995079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e1034ec-2075-4c4a-bde0-eba030260d2b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:43.995588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e1034ec-2075-4c4a-bde0-eba030260d2b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:43.996044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e1034ec-2075-4c4a-bde0-eba030260d2b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:43.996759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e1034ec-2075-4c4a-bde0-eba030260d2b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:43.997266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e1034ec-2075-4c4a-bde0-eba030260d2b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:43.997718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2e1034ec-2075-4c4a-bde0-eba030260d2b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:44.126643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2e1034ec-2075-4c4a-bde0-eba030260d2b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:44.135204 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2e1034ec-2075-4c4a-bde0-eba030260d2b tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1716 microversion: 2.1 time: 0.152193 Oct 24 11:33:44.135790 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3664/7355] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:43 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:44.158642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fd2b3676-6fad-4307-b984-22462e7d7474 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:44.159284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fd2b3676-6fad-4307-b984-22462e7d7474 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:44.166939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd2b3676-6fad-4307-b984-22462e7d7474 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:44.167416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd2b3676-6fad-4307-b984-22462e7d7474 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:44.167851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd2b3676-6fad-4307-b984-22462e7d7474 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:44.168548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd2b3676-6fad-4307-b984-22462e7d7474 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:44.169027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd2b3676-6fad-4307-b984-22462e7d7474 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:44.169454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd2b3676-6fad-4307-b984-22462e7d7474 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:44.299792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fd2b3676-6fad-4307-b984-22462e7d7474 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:44.308389 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fd2b3676-6fad-4307-b984-22462e7d7474 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1716 microversion: 2.1 time: 0.153891 Oct 24 11:33:44.308984 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3692/7356] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:44 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:44.330879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7088cedd-e25e-4bbe-ab19-d2551e4c99a2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:44.331536 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7088cedd-e25e-4bbe-ab19-d2551e4c99a2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:44.338185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7088cedd-e25e-4bbe-ab19-d2551e4c99a2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:44.338686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7088cedd-e25e-4bbe-ab19-d2551e4c99a2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:44.339137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7088cedd-e25e-4bbe-ab19-d2551e4c99a2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:44.339874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7088cedd-e25e-4bbe-ab19-d2551e4c99a2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:44.340342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7088cedd-e25e-4bbe-ab19-d2551e4c99a2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:44.340782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7088cedd-e25e-4bbe-ab19-d2551e4c99a2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:44.471141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7088cedd-e25e-4bbe-ab19-d2551e4c99a2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:44.479648 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7088cedd-e25e-4bbe-ab19-d2551e4c99a2 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1716 microversion: 2.1 time: 0.152713 Oct 24 11:33:44.480218 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3665/7357] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:44 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:44.556937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c9cf1a15-d882-4d54-b97f-1a59e900c5f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:44.557373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c9cf1a15-d882-4d54-b97f-1a59e900c5f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:44.563333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9cf1a15-d882-4d54-b97f-1a59e900c5f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:44.563809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9cf1a15-d882-4d54-b97f-1a59e900c5f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:44.564240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9cf1a15-d882-4d54-b97f-1a59e900c5f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:44.564953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9cf1a15-d882-4d54-b97f-1a59e900c5f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:44.565408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9cf1a15-d882-4d54-b97f-1a59e900c5f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:44.565829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9cf1a15-d882-4d54-b97f-1a59e900c5f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:44.592174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c9cf1a15-d882-4d54-b97f-1a59e900c5f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:33:44.671372 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c9cf1a15-d882-4d54-b97f-1a59e900c5f7 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "DELETE /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 204 len: 0 microversion: 2.1 time: 0.118285 Oct 24 11:33:44.671967 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3693/7358] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:33:44 2022] DELETE /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:33:44.680569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0c144398-3b77-4551-8c29-3efde138a2bc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:44.681874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0c144398-3b77-4551-8c29-3efde138a2bc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:44.687867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c144398-3b77-4551-8c29-3efde138a2bc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:44.688363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c144398-3b77-4551-8c29-3efde138a2bc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:44.688815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c144398-3b77-4551-8c29-3efde138a2bc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:44.689541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c144398-3b77-4551-8c29-3efde138a2bc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:44.690007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c144398-3b77-4551-8c29-3efde138a2bc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:44.690445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0c144398-3b77-4551-8c29-3efde138a2bc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:44.818464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0c144398-3b77-4551-8c29-3efde138a2bc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:44.826856 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0c144398-3b77-4551-8c29-3efde138a2bc tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1722 microversion: 2.1 time: 0.150148 Oct 24 11:33:44.827434 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3666/7359] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:44 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:33:45.851551 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f32b7b68-81ae-400e-a1ab-7c3211944c57 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:45.852253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f32b7b68-81ae-400e-a1ab-7c3211944c57 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:45.859393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f32b7b68-81ae-400e-a1ab-7c3211944c57 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:45.859886 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f32b7b68-81ae-400e-a1ab-7c3211944c57 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:45.860320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f32b7b68-81ae-400e-a1ab-7c3211944c57 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:45.861050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f32b7b68-81ae-400e-a1ab-7c3211944c57 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:45.861504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f32b7b68-81ae-400e-a1ab-7c3211944c57 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:45.861931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f32b7b68-81ae-400e-a1ab-7c3211944c57 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:45.886858 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:33:45.887097 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:33:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 (ip 10.222.0.50) !!! Oct 24 11:33:46.095813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f32b7b68-81ae-400e-a1ab-7c3211944c57 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:46.104383 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f32b7b68-81ae-400e-a1ab-7c3211944c57 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1722 microversion: 2.1 time: 0.257114 Oct 24 11:33:46.104980 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3694/7360] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:45 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:47.130162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9a49661a-6245-4255-85e5-fcf982a9bb6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:47.130813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9a49661a-6245-4255-85e5-fcf982a9bb6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:47.134600 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:33:47.134926 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:33:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 (ip 10.222.0.50) !!! Oct 24 11:33:47.136142 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:33:47.136255 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:33:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 (ip 10.222.0.50) !!! Oct 24 11:33:47.144509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a49661a-6245-4255-85e5-fcf982a9bb6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:47.145068 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a49661a-6245-4255-85e5-fcf982a9bb6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:47.145529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a49661a-6245-4255-85e5-fcf982a9bb6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:47.146262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a49661a-6245-4255-85e5-fcf982a9bb6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:47.146736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a49661a-6245-4255-85e5-fcf982a9bb6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:47.147186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a49661a-6245-4255-85e5-fcf982a9bb6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:47.289255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9a49661a-6245-4255-85e5-fcf982a9bb6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:47.293427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:33:47.303252 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9a49661a-6245-4255-85e5-fcf982a9bb6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1655 microversion: 2.1 time: 0.178677 Oct 24 11:33:47.303875 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3667/7361] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:47 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1655 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:47.674766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-34fc5621-04d5-4442-b562-777e0d19095a req-63b0a3e4-03b5-4cfd-9ee3-03879e5f2a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b3ca59-a5ea-489a-9576-ce182ef96b36", "name": "network-vif-deleted", "tag": "e96a62fa-912d-4a0f-ac68-733b24553735"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:33:47.685624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-34fc5621-04d5-4442-b562-777e0d19095a req-63b0a3e4-03b5-4cfd-9ee3-03879e5f2a5f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:47.686126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-34fc5621-04d5-4442-b562-777e0d19095a req-63b0a3e4-03b5-4cfd-9ee3-03879e5f2a5f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:47.686632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-34fc5621-04d5-4442-b562-777e0d19095a req-63b0a3e4-03b5-4cfd-9ee3-03879e5f2a5f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:47.702919 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-34fc5621-04d5-4442-b562-777e0d19095a req-63b0a3e4-03b5-4cfd-9ee3-03879e5f2a5f service nova] Creating event network-vif-deleted:e96a62fa-912d-4a0f-ac68-733b24553735 for instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 on n-h2-858383-15 Oct 24 11:33:47.711126 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-34fc5621-04d5-4442-b562-777e0d19095a req-63b0a3e4-03b5-4cfd-9ee3-03879e5f2a5f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042529 Oct 24 11:33:47.711884 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3695/7362] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:33:48.328169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5fe919ca-f390-4ea4-ac4e-8009cf0b9c5e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:48.329618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5fe919ca-f390-4ea4-ac4e-8009cf0b9c5e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:48.338685 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fe919ca-f390-4ea4-ac4e-8009cf0b9c5e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:48.339209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fe919ca-f390-4ea4-ac4e-8009cf0b9c5e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:48.339831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fe919ca-f390-4ea4-ac4e-8009cf0b9c5e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:48.340571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fe919ca-f390-4ea4-ac4e-8009cf0b9c5e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:48.341072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fe919ca-f390-4ea4-ac4e-8009cf0b9c5e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:48.341718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5fe919ca-f390-4ea4-ac4e-8009cf0b9c5e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:48.410677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5fe919ca-f390-4ea4-ac4e-8009cf0b9c5e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:48.421599 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5fe919ca-f390-4ea4-ac4e-8009cf0b9c5e tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1370 microversion: 2.1 time: 0.098422 Oct 24 11:33:48.422203 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3668/7363] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:48 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1370 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:49.447815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b23f5477-b07b-4bb0-948e-9940ded203e8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:49.448618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b23f5477-b07b-4bb0-948e-9940ded203e8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:49.455054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b23f5477-b07b-4bb0-948e-9940ded203e8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:49.455543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b23f5477-b07b-4bb0-948e-9940ded203e8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:49.455983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b23f5477-b07b-4bb0-948e-9940ded203e8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:49.456693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b23f5477-b07b-4bb0-948e-9940ded203e8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:49.457180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b23f5477-b07b-4bb0-948e-9940ded203e8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:49.457614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b23f5477-b07b-4bb0-948e-9940ded203e8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:49.527177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b23f5477-b07b-4bb0-948e-9940ded203e8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:49.535904 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b23f5477-b07b-4bb0-948e-9940ded203e8 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1370 microversion: 2.1 time: 0.094255 Oct 24 11:33:49.536488 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3696/7364] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:49 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1370 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:50.560750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a6ba3b17-abe4-46e0-acee-a247e661119c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:50.561325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a6ba3b17-abe4-46e0-acee-a247e661119c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:50.568380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6ba3b17-abe4-46e0-acee-a247e661119c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:50.568928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6ba3b17-abe4-46e0-acee-a247e661119c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:50.569393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6ba3b17-abe4-46e0-acee-a247e661119c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:50.570129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6ba3b17-abe4-46e0-acee-a247e661119c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:50.570587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6ba3b17-abe4-46e0-acee-a247e661119c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:50.571038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a6ba3b17-abe4-46e0-acee-a247e661119c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:50.640328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a6ba3b17-abe4-46e0-acee-a247e661119c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:50.648815 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a6ba3b17-abe4-46e0-acee-a247e661119c tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1370 microversion: 2.1 time: 0.092532 Oct 24 11:33:50.658337 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3669/7365] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:50 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1370 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:51.673887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f76fc6af-52e2-4657-9e2b-da00403bd527 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:51.674525 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f76fc6af-52e2-4657-9e2b-da00403bd527 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:51.682129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f76fc6af-52e2-4657-9e2b-da00403bd527 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:51.682604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f76fc6af-52e2-4657-9e2b-da00403bd527 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:51.683038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f76fc6af-52e2-4657-9e2b-da00403bd527 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:51.683738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f76fc6af-52e2-4657-9e2b-da00403bd527 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:51.684190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f76fc6af-52e2-4657-9e2b-da00403bd527 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:51.684611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f76fc6af-52e2-4657-9e2b-da00403bd527 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:51.702393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:33:51.755378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f76fc6af-52e2-4657-9e2b-da00403bd527 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879b06d644fa496c94f9226f23d79716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0ac700abd24e4ea516532577c09aa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:33:51.765281 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f76fc6af-52e2-4657-9e2b-da00403bd527 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 200 len: 1370 microversion: 2.1 time: 0.095621 Oct 24 11:33:51.765891 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3697/7366] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:51 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 1370 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:33:52.789199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e6c954fa-3200-4e38-9705-3915c5898eb3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:52.789866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e6c954fa-3200-4e38-9705-3915c5898eb3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:52.797297 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6c954fa-3200-4e38-9705-3915c5898eb3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:52.797804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6c954fa-3200-4e38-9705-3915c5898eb3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:52.798262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6c954fa-3200-4e38-9705-3915c5898eb3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:52.798975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6c954fa-3200-4e38-9705-3915c5898eb3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:52.799452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6c954fa-3200-4e38-9705-3915c5898eb3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:52.799902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e6c954fa-3200-4e38-9705-3915c5898eb3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:52.813685 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-e6c954fa-3200-4e38-9705-3915c5898eb3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] HTTP exception thrown: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e6c954fa-3200-4e38-9705-3915c5898eb3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Request method failure captured: Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 HTTP/1.1 Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnaUzJMxVmO-HtBWBYSLYY__i8Ec4H_cXbVc5xd3yGDLsMf1ETMejFCnWUyp9G8494iE9lwNZ1O-SL8TGXN5cFSCNrWBYv6wZLOJycdTlyT8sc_7tYAGIgmUERtptmQ1I6PrKjKFKSYn1GiUZKbvWNa596EQvJKNpX9sOkD72kPfq90 Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c0ac700abd24e4ea516532577c09aa5", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 879b06d644fa496c94f9226f23d79716 Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '99b3ca59-a5ea-489a-9576-ce182ef96b36'} Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:52.815389 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:52.819986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:52.819986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:52.819986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:52.819986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:33:52.819986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:33:52.819986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:52.819986 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:52.819986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e6c954fa-3200-4e38-9705-3915c5898eb3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Returning 404 to user: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:33:52.819986 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e6c954fa-3200-4e38-9705-3915c5898eb3 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 404 len: 111 microversion: 2.1 time: 0.031600 Oct 24 11:33:52.819986 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3670/7367] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:52 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:33:52.880993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-db685d03-8212-4a5e-a4c6-e8d7044a23b0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:52.883131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-db685d03-8212-4a5e-a4c6-e8d7044a23b0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:52.890819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db685d03-8212-4a5e-a4c6-e8d7044a23b0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:52.891304 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db685d03-8212-4a5e-a4c6-e8d7044a23b0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:52.891742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db685d03-8212-4a5e-a4c6-e8d7044a23b0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:52.892434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db685d03-8212-4a5e-a4c6-e8d7044a23b0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:52.892912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db685d03-8212-4a5e-a4c6-e8d7044a23b0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:52.893340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-db685d03-8212-4a5e-a4c6-e8d7044a23b0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:52.906629 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-db685d03-8212-4a5e-a4c6-e8d7044a23b0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] HTTP exception thrown: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-db685d03-8212-4a5e-a4c6-e8d7044a23b0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Request method failure captured: Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36/os-volume_attachments HTTP/1.1 Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnaUzJMxVmO-HtBWBYSLYY__i8Ec4H_cXbVc5xd3yGDLsMf1ETMejFCnWUyp9G8494iE9lwNZ1O-SL8TGXN5cFSCNrWBYv6wZLOJycdTlyT8sc_7tYAGIgmUERtptmQ1I6PrKjKFKSYn1GiUZKbvWNa596EQvJKNpX9sOkD72kPfq90 Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c0ac700abd24e4ea516532577c09aa5", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 879b06d644fa496c94f9226f23d79716 Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'server_id': '99b3ca59-a5ea-489a-9576-ce182ef96b36'} Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:33:52.908529 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:33:52.916081 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:52.916081 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:52.916081 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:52.916081 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:52.916081 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:52.916081 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:52.916081 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:52.916081 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:33:52.916081 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:33:52.916081 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:52.916081 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:52.916081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-db685d03-8212-4a5e-a4c6-e8d7044a23b0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Returning 404 to user: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:33:52.916081 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-db685d03-8212-4a5e-a4c6-e8d7044a23b0 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033095 Oct 24 11:33:52.916081 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3698/7368] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:33:52 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:33:56.241666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-24210a3a-dfc5-4866-a5be-a4d395eaf791 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:56.242179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-24210a3a-dfc5-4866-a5be-a4d395eaf791 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:56.245479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:33:56.250817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24210a3a-dfc5-4866-a5be-a4d395eaf791 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:56.251309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24210a3a-dfc5-4866-a5be-a4d395eaf791 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:56.251757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24210a3a-dfc5-4866-a5be-a4d395eaf791 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:56.252463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24210a3a-dfc5-4866-a5be-a4d395eaf791 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:56.252964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24210a3a-dfc5-4866-a5be-a4d395eaf791 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:56.253409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-24210a3a-dfc5-4866-a5be-a4d395eaf791 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:56.268592 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-24210a3a-dfc5-4866-a5be-a4d395eaf791 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] HTTP exception thrown: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-24210a3a-dfc5-4866-a5be-a4d395eaf791 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Request method failure captured: Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 HTTP/1.1 Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnaUzJMxVmO-HtBWBYSLYY__i8Ec4H_cXbVc5xd3yGDLsMf1ETMejFCnWUyp9G8494iE9lwNZ1O-SL8TGXN5cFSCNrWBYv6wZLOJycdTlyT8sc_7tYAGIgmUERtptmQ1I6PrKjKFKSYn1GiUZKbvWNa596EQvJKNpX9sOkD72kPfq90 Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c0ac700abd24e4ea516532577c09aa5", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 879b06d644fa496c94f9226f23d79716 Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '99b3ca59-a5ea-489a-9576-ce182ef96b36'} Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:33:56.270196 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:33:56.274627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:56.274627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.274627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:56.274627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.274627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.274627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:56.274627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:56.274627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:33:56.274627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:33:56.274627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:56.274627 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.274627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-24210a3a-dfc5-4866-a5be-a4d395eaf791 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Returning 404 to user: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:33:56.274627 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-24210a3a-dfc5-4866-a5be-a4d395eaf791 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "DELETE /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 404 len: 111 microversion: 2.1 time: 0.033853 Oct 24 11:33:56.274627 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3671/7369] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:33:56 2022] DELETE /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:33:56.280737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e4622df1-7442-40ed-9660-c62216825cb6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:56.281380 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e4622df1-7442-40ed-9660-c62216825cb6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 99b3ca59-a5ea-489a-9576-ce182ef96b36] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:56.284427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:33:56.289624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e4622df1-7442-40ed-9660-c62216825cb6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:56.290101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e4622df1-7442-40ed-9660-c62216825cb6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:56.290530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e4622df1-7442-40ed-9660-c62216825cb6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:56.291214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e4622df1-7442-40ed-9660-c62216825cb6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:56.291665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e4622df1-7442-40ed-9660-c62216825cb6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:56.292084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e4622df1-7442-40ed-9660-c62216825cb6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:56.306734 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-e4622df1-7442-40ed-9660-c62216825cb6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] HTTP exception thrown: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e4622df1-7442-40ed-9660-c62216825cb6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Request method failure captured: Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 HTTP/1.1 Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnaUzJMxVmO-HtBWBYSLYY__i8Ec4H_cXbVc5xd3yGDLsMf1ETMejFCnWUyp9G8494iE9lwNZ1O-SL8TGXN5cFSCNrWBYv6wZLOJycdTlyT8sc_7tYAGIgmUERtptmQ1I6PrKjKFKSYn1GiUZKbvWNa596EQvJKNpX9sOkD72kPfq90 Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c0ac700abd24e4ea516532577c09aa5", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 879b06d644fa496c94f9226f23d79716 Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '99b3ca59-a5ea-489a-9576-ce182ef96b36'} Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:56.308375 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.313121 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.313121 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:56.313121 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:56.313121 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:33:56.313121 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:33:56.313121 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. Oct 24 11:33:56.313121 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.313121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e4622df1-7442-40ed-9660-c62216825cb6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Returning 404 to user: Instance 99b3ca59-a5ea-489a-9576-ce182ef96b36 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:33:56.313121 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e4622df1-7442-40ed-9660-c62216825cb6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36" status: 404 len: 111 microversion: 2.1 time: 0.032895 Oct 24 11:33:56.313121 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3699/7370] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:56 2022] GET /compute/v2.1/servers/99b3ca59-a5ea-489a-9576-ce182ef96b36 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:33:56.318596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa33666e-037e-46ab-aaaa-1fc570d02e6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:56.319114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-aa33666e-037e-46ab-aaaa-1fc570d02e6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:56.326183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa33666e-037e-46ab-aaaa-1fc570d02e6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:56.326698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa33666e-037e-46ab-aaaa-1fc570d02e6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:56.327153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa33666e-037e-46ab-aaaa-1fc570d02e6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:56.327888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa33666e-037e-46ab-aaaa-1fc570d02e6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:56.328361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa33666e-037e-46ab-aaaa-1fc570d02e6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:56.328814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-aa33666e-037e-46ab-aaaa-1fc570d02e6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:56.343628 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-aa33666e-037e-46ab-aaaa-1fc570d02e6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] HTTP exception thrown: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa33666e-037e-46ab-aaaa-1fc570d02e6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Request method failure captured: Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d HTTP/1.1 Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnaUzJMxVmO-HtBWBYSLYY__i8Ec4H_cXbVc5xd3yGDLsMf1ETMejFCnWUyp9G8494iE9lwNZ1O-SL8TGXN5cFSCNrWBYv6wZLOJycdTlyT8sc_7tYAGIgmUERtptmQ1I6PrKjKFKSYn1GiUZKbvWNa596EQvJKNpX9sOkD72kPfq90 Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c0ac700abd24e4ea516532577c09aa5", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 879b06d644fa496c94f9226f23d79716 Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'bc17bafd-d889-4fab-ad53-9ffd075ba33d'} Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:33:56.345292 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:33:56.349737 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:33:56.349737 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.349737 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:56.349737 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.349737 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.349737 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:56.349737 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:56.349737 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:33:56.349737 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:33:56.349737 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:33:56.349737 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.349737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-aa33666e-037e-46ab-aaaa-1fc570d02e6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Returning 404 to user: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:33:56.349737 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-aa33666e-037e-46ab-aaaa-1fc570d02e6a tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 404 len: 111 microversion: 2.1 time: 0.032225 Oct 24 11:33:56.350658 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3672/7371] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:33:56 2022] DELETE /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:33:56.356000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c966ec0e-f7ea-4d9d-bc40-edadc230e924 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:56.356619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c966ec0e-f7ea-4d9d-bc40-edadc230e924 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: bc17bafd-d889-4fab-ad53-9ffd075ba33d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:56.363020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c966ec0e-f7ea-4d9d-bc40-edadc230e924 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:56.363507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c966ec0e-f7ea-4d9d-bc40-edadc230e924 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:56.363939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c966ec0e-f7ea-4d9d-bc40-edadc230e924 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:56.364649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c966ec0e-f7ea-4d9d-bc40-edadc230e924 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:56.365155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c966ec0e-f7ea-4d9d-bc40-edadc230e924 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:56.365585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c966ec0e-f7ea-4d9d-bc40-edadc230e924 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:56.380563 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-c966ec0e-f7ea-4d9d-bc40-edadc230e924 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] HTTP exception thrown: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c966ec0e-f7ea-4d9d-bc40-edadc230e924 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Request method failure captured: Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d HTTP/1.1 Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnaUzJMxVmO-HtBWBYSLYY__i8Ec4H_cXbVc5xd3yGDLsMf1ETMejFCnWUyp9G8494iE9lwNZ1O-SL8TGXN5cFSCNrWBYv6wZLOJycdTlyT8sc_7tYAGIgmUERtptmQ1I6PrKjKFKSYn1GiUZKbvWNa596EQvJKNpX9sOkD72kPfq90 Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c0ac700abd24e4ea516532577c09aa5", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 879b06d644fa496c94f9226f23d79716 Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'bc17bafd-d889-4fab-ad53-9ffd075ba33d'} Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:56.382138 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.386771 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.386771 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:56.386771 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:56.386771 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:33:56.386771 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:33:56.386771 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. Oct 24 11:33:56.386771 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.386771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c966ec0e-f7ea-4d9d-bc40-edadc230e924 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Returning 404 to user: Instance bc17bafd-d889-4fab-ad53-9ffd075ba33d could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:33:56.386771 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c966ec0e-f7ea-4d9d-bc40-edadc230e924 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d" status: 404 len: 111 microversion: 2.1 time: 0.031660 Oct 24 11:33:56.386771 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3700/7372] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:56 2022] GET /compute/v2.1/servers/bc17bafd-d889-4fab-ad53-9ffd075ba33d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:33:56.393035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-891d40d9-43a4-42a2-a684-e013b740a250 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:56.393547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-891d40d9-43a4-42a2-a684-e013b740a250 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:56.399658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-891d40d9-43a4-42a2-a684-e013b740a250 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:56.400160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-891d40d9-43a4-42a2-a684-e013b740a250 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:56.400614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-891d40d9-43a4-42a2-a684-e013b740a250 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:56.401356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-891d40d9-43a4-42a2-a684-e013b740a250 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:56.401832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-891d40d9-43a4-42a2-a684-e013b740a250 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:56.402270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-891d40d9-43a4-42a2-a684-e013b740a250 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:56.416308 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-891d40d9-43a4-42a2-a684-e013b740a250 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] HTTP exception thrown: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-891d40d9-43a4-42a2-a684-e013b740a250 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Request method failure captured: Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 HTTP/1.1 Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnaUzJMxVmO-HtBWBYSLYY__i8Ec4H_cXbVc5xd3yGDLsMf1ETMejFCnWUyp9G8494iE9lwNZ1O-SL8TGXN5cFSCNrWBYv6wZLOJycdTlyT8sc_7tYAGIgmUERtptmQ1I6PrKjKFKSYn1GiUZKbvWNa596EQvJKNpX9sOkD72kPfq90 Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c0ac700abd24e4ea516532577c09aa5", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 879b06d644fa496c94f9226f23d79716 Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9'} Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:33:56.417903 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:33:56.421771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:33:56.421771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.421771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:56.421771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.421771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.421771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:56.421771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:56.421771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:33:56.421771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:33:56.421771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:33:56.421771 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.421771 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-891d40d9-43a4-42a2-a684-e013b740a250 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Returning 404 to user: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:33:56.421771 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-891d40d9-43a4-42a2-a684-e013b740a250 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 404 len: 111 microversion: 2.1 time: 0.030296 Oct 24 11:33:56.421771 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3673/7373] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:33:56 2022] DELETE /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:33:56.428035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-feb694cc-243c-49d5-b2e7-c1a4b39f5a36 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:56.428722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-feb694cc-243c-49d5-b2e7-c1a4b39f5a36 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:56.435514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-feb694cc-243c-49d5-b2e7-c1a4b39f5a36 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:56.436001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-feb694cc-243c-49d5-b2e7-c1a4b39f5a36 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:56.436442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-feb694cc-243c-49d5-b2e7-c1a4b39f5a36 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:56.437177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-feb694cc-243c-49d5-b2e7-c1a4b39f5a36 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:56.437641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-feb694cc-243c-49d5-b2e7-c1a4b39f5a36 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:56.438072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-feb694cc-243c-49d5-b2e7-c1a4b39f5a36 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:56.452523 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-feb694cc-243c-49d5-b2e7-c1a4b39f5a36 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] HTTP exception thrown: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-feb694cc-243c-49d5-b2e7-c1a4b39f5a36 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Request method failure captured: Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 HTTP/1.1 Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnaUzJMxVmO-HtBWBYSLYY__i8Ec4H_cXbVc5xd3yGDLsMf1ETMejFCnWUyp9G8494iE9lwNZ1O-SL8TGXN5cFSCNrWBYv6wZLOJycdTlyT8sc_7tYAGIgmUERtptmQ1I6PrKjKFKSYn1GiUZKbvWNa596EQvJKNpX9sOkD72kPfq90 Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c0ac700abd24e4ea516532577c09aa5", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 879b06d644fa496c94f9226f23d79716 Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9'} Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:56.454096 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.459210 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.459210 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:56.459210 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:56.459210 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:33:56.459210 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:33:56.459210 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. Oct 24 11:33:56.459210 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.459210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-feb694cc-243c-49d5-b2e7-c1a4b39f5a36 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Returning 404 to user: Instance 9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:33:56.459210 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-feb694cc-243c-49d5-b2e7-c1a4b39f5a36 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9" status: 404 len: 111 microversion: 2.1 time: 0.031463 Oct 24 11:33:56.459210 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3701/7374] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:56 2022] GET /compute/v2.1/servers/9c480bf5-1bb8-4c77-bb6e-8d6fd28bfba9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:33:56.464038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b1cd4271-c5c1-4878-be48-beab3a83d8a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:56.464554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b1cd4271-c5c1-4878-be48-beab3a83d8a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:56.470940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1cd4271-c5c1-4878-be48-beab3a83d8a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:56.471450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1cd4271-c5c1-4878-be48-beab3a83d8a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:56.471913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1cd4271-c5c1-4878-be48-beab3a83d8a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:56.472676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1cd4271-c5c1-4878-be48-beab3a83d8a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:56.473184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1cd4271-c5c1-4878-be48-beab3a83d8a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:56.473637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b1cd4271-c5c1-4878-be48-beab3a83d8a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:56.490923 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-b1cd4271-c5c1-4878-be48-beab3a83d8a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] HTTP exception thrown: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b1cd4271-c5c1-4878-be48-beab3a83d8a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Request method failure captured: Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 HTTP/1.1 Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnaUzJMxVmO-HtBWBYSLYY__i8Ec4H_cXbVc5xd3yGDLsMf1ETMejFCnWUyp9G8494iE9lwNZ1O-SL8TGXN5cFSCNrWBYv6wZLOJycdTlyT8sc_7tYAGIgmUERtptmQ1I6PrKjKFKSYn1GiUZKbvWNa596EQvJKNpX9sOkD72kPfq90 Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c0ac700abd24e4ea516532577c09aa5", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 879b06d644fa496c94f9226f23d79716 Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'c1fd1f08-804b-4c97-a19d-211933a7e701'} Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:33:56.492730 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:33:56.497806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:33:56.497806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.497806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:56.497806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.497806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.497806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:56.497806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:56.497806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:33:56.497806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:33:56.497806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:33:56.497806 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.497806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b1cd4271-c5c1-4878-be48-beab3a83d8a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Returning 404 to user: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:33:56.497806 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b1cd4271-c5c1-4878-be48-beab3a83d8a1 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 404 len: 111 microversion: 2.1 time: 0.034747 Oct 24 11:33:56.497806 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3674/7375] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:33:56 2022] DELETE /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 11:33:56.503383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e43498f-5add-45d5-95ae-b63b536a9c84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:56.504001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1e43498f-5add-45d5-95ae-b63b536a9c84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] [instance: c1fd1f08-804b-4c97-a19d-211933a7e701] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:33:56.510019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e43498f-5add-45d5-95ae-b63b536a9c84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:56.510575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e43498f-5add-45d5-95ae-b63b536a9c84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:56.510939 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e43498f-5add-45d5-95ae-b63b536a9c84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:56.511637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e43498f-5add-45d5-95ae-b63b536a9c84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:33:56.512088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e43498f-5add-45d5-95ae-b63b536a9c84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:33:56.512516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e43498f-5add-45d5-95ae-b63b536a9c84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:33:56.528409 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-1e43498f-5add-45d5-95ae-b63b536a9c84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] HTTP exception thrown: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e43498f-5add-45d5-95ae-b63b536a9c84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Request method failure captured: Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 HTTP/1.1 Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnaUzJMxVmO-HtBWBYSLYY__i8Ec4H_cXbVc5xd3yGDLsMf1ETMejFCnWUyp9G8494iE9lwNZ1O-SL8TGXN5cFSCNrWBYv6wZLOJycdTlyT8sc_7tYAGIgmUERtptmQ1I6PrKjKFKSYn1GiUZKbvWNa596EQvJKNpX9sOkD72kPfq90 Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c0ac700abd24e4ea516532577c09aa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c0ac700abd24e4ea516532577c09aa5", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4c0ac700abd24e4ea516532577c09aa5 Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServerActionsTestJSON-1150090759 Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 879b06d644fa496c94f9226f23d79716 Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServerActionsTestJSON-1150090759-project Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'c1fd1f08-804b-4c97-a19d-211933a7e701'} Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:33:56.529955 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.538130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:33:56.538130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:33:56.538130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:33:56.538130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:33:56.538130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:33:56.538130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. Oct 24 11:33:56.538130 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:33:56.538130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e43498f-5add-45d5-95ae-b63b536a9c84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Returning 404 to user: Instance c1fd1f08-804b-4c97-a19d-211933a7e701 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:33:56.538130 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1e43498f-5add-45d5-95ae-b63b536a9c84 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701" status: 404 len: 111 microversion: 2.1 time: 0.031764 Oct 24 11:33:56.538130 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3702/7376] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:33:56 2022] GET /compute/v2.1/servers/c1fd1f08-804b-4c97-a19d-211933a7e701 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:33:56.540978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-168d2b8b-cf60-4315-8eaa-2a86b40f88b6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] Calling method '.version_select at 0x7f04d0bd9310>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:33:56.566424 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-168d2b8b-cf60-4315-8eaa-2a86b40f88b6 tempest-ServerActionsTestJSON-1150090759 tempest-ServerActionsTestJSON-1150090759-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1192870934" status: 202 len: 0 microversion: 2.1 time: 0.029730 Oct 24 11:33:56.567079 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3675/7377] 10.222.0.50 () {58 vars in 1221 bytes} [Mon Oct 24 11:33:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1192870934 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:34:06.125323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d092df12-1207-4112-adcf-c2ee4e805a34 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2076984403", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "ea2bdd35-9049-485d-a65d-7baa120c52a5"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:34:06.180298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-d092df12-1207-4112-adcf-c2ee4e805a34 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] validate_networks() for [('ea2bdd35-9049-485d-a65d-7baa120c52a5', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:34:06.517204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=13 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:34:06.573544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d092df12-1207-4112-adcf-c2ee4e805a34 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:34:06.573977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d092df12-1207-4112-adcf-c2ee4e805a34 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:34:06.574487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d092df12-1207-4112-adcf-c2ee4e805a34 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:34:06.574901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d092df12-1207-4112-adcf-c2ee4e805a34 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:34:06.575317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d092df12-1207-4112-adcf-c2ee4e805a34 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:34:06.585027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d092df12-1207-4112-adcf-c2ee4e805a34 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:06.585545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d092df12-1207-4112-adcf-c2ee4e805a34 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:06.587851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d092df12-1207-4112-adcf-c2ee4e805a34 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:06.588795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d092df12-1207-4112-adcf-c2ee4e805a34 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:06.589467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d092df12-1207-4112-adcf-c2ee4e805a34 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:06.589938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d092df12-1207-4112-adcf-c2ee4e805a34 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:06.607655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d092df12-1207-4112-adcf-c2ee4e805a34 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Getting quotas for project d3bff7f1fbcc49209c689a03265c16aa. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:34:06.613140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d092df12-1207-4112-adcf-c2ee4e805a34 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Getting quotas for user bf8a06692ac545479b7f1171b2160de7 and project d3bff7f1fbcc49209c689a03265c16aa. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:34:06.628890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d092df12-1207-4112-adcf-c2ee4e805a34 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:34:06.631236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d092df12-1207-4112-adcf-c2ee4e805a34 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:34:06.679086 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d092df12-1207-4112-adcf-c2ee4e805a34 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687547 Oct 24 11:34:06.680081 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3703/7378] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:34:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:34:06.689950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=23 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:34:06.690804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:34:06.694673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-019e0689-deee-4a7a-868d-8fbe85fd306d tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:06.695334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-019e0689-deee-4a7a-868d-8fbe85fd306d tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:06.758673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-019e0689-deee-4a7a-868d-8fbe85fd306d tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:06.768373 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-019e0689-deee-4a7a-868d-8fbe85fd306d tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1217 microversion: 2.1 time: 0.080144 Oct 24 11:34:06.769025 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3676/7379] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:06 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:07.792881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f73185d9-2c58-4af0-b552-3e131c4fb854 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:07.793508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f73185d9-2c58-4af0-b552-3e131c4fb854 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:07.800966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f73185d9-2c58-4af0-b552-3e131c4fb854 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:07.801565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f73185d9-2c58-4af0-b552-3e131c4fb854 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:07.802009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f73185d9-2c58-4af0-b552-3e131c4fb854 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:07.802721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f73185d9-2c58-4af0-b552-3e131c4fb854 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:07.803177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f73185d9-2c58-4af0-b552-3e131c4fb854 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:07.803600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f73185d9-2c58-4af0-b552-3e131c4fb854 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:07.875989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f73185d9-2c58-4af0-b552-3e131c4fb854 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:07.886306 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f73185d9-2c58-4af0-b552-3e131c4fb854 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1269 microversion: 2.1 time: 0.098393 Oct 24 11:34:07.887042 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3704/7380] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:07 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1269 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:08.911969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6a12a966-8509-472a-9905-ed2e6a1a2513 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:08.914614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6a12a966-8509-472a-9905-ed2e6a1a2513 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:08.922564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a12a966-8509-472a-9905-ed2e6a1a2513 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:08.923416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a12a966-8509-472a-9905-ed2e6a1a2513 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:08.923935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a12a966-8509-472a-9905-ed2e6a1a2513 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:08.924891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a12a966-8509-472a-9905-ed2e6a1a2513 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:08.925569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a12a966-8509-472a-9905-ed2e6a1a2513 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:08.926229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6a12a966-8509-472a-9905-ed2e6a1a2513 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:09.092245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6a12a966-8509-472a-9905-ed2e6a1a2513 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:09.100394 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6a12a966-8509-472a-9905-ed2e6a1a2513 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1317 microversion: 2.1 time: 0.193534 Oct 24 11:34:09.116122 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3677/7381] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:08 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:09.424795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-57cc70fe-b981-4606-9fdc-dca535d01ffb req-1fa91e50-0e67-4fa2-a881-06d4801b9c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cce20aa-1e76-47d7-8cff-1638642b2665", "tag": "ae9f7368-b77f-42af-896d-2b6e83211d8a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:34:09.436749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-57cc70fe-b981-4606-9fdc-dca535d01ffb req-1fa91e50-0e67-4fa2-a881-06d4801b9c49 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:09.437191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-57cc70fe-b981-4606-9fdc-dca535d01ffb req-1fa91e50-0e67-4fa2-a881-06d4801b9c49 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:09.437885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-57cc70fe-b981-4606-9fdc-dca535d01ffb req-1fa91e50-0e67-4fa2-a881-06d4801b9c49 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:09.450521 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-57cc70fe-b981-4606-9fdc-dca535d01ffb req-1fa91e50-0e67-4fa2-a881-06d4801b9c49 service nova] Creating event network-changed:ae9f7368-b77f-42af-896d-2b6e83211d8a for instance 2cce20aa-1e76-47d7-8cff-1638642b2665 on n-h2-858383-15 Oct 24 11:34:09.455784 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-57cc70fe-b981-4606-9fdc-dca535d01ffb req-1fa91e50-0e67-4fa2-a881-06d4801b9c49 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034673 Oct 24 11:34:09.456648 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3705/7382] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:34:10.124250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-71bfec4f-662d-42e5-aaf0-046f9530f2fb tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:10.124899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-71bfec4f-662d-42e5-aaf0-046f9530f2fb tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:10.131934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71bfec4f-662d-42e5-aaf0-046f9530f2fb tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:10.132432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71bfec4f-662d-42e5-aaf0-046f9530f2fb tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:10.132916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71bfec4f-662d-42e5-aaf0-046f9530f2fb tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:10.133630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71bfec4f-662d-42e5-aaf0-046f9530f2fb tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:10.134512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71bfec4f-662d-42e5-aaf0-046f9530f2fb tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:10.134963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71bfec4f-662d-42e5-aaf0-046f9530f2fb tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:10.263528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-71bfec4f-662d-42e5-aaf0-046f9530f2fb tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:10.271403 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-71bfec4f-662d-42e5-aaf0-046f9530f2fb tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1317 microversion: 2.1 time: 0.151128 Oct 24 11:34:10.271979 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3678/7383] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:10 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:11.296816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d2f3e651-95a1-41b2-a487-5f27bf3ad780 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:11.297546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d2f3e651-95a1-41b2-a487-5f27bf3ad780 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:11.303847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2f3e651-95a1-41b2-a487-5f27bf3ad780 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:11.304333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2f3e651-95a1-41b2-a487-5f27bf3ad780 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:11.304784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2f3e651-95a1-41b2-a487-5f27bf3ad780 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:11.305504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2f3e651-95a1-41b2-a487-5f27bf3ad780 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:11.306138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2f3e651-95a1-41b2-a487-5f27bf3ad780 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:11.306572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d2f3e651-95a1-41b2-a487-5f27bf3ad780 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:11.442912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d2f3e651-95a1-41b2-a487-5f27bf3ad780 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:11.451241 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d2f3e651-95a1-41b2-a487-5f27bf3ad780 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1317 microversion: 2.1 time: 0.159548 Oct 24 11:34:11.451802 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3706/7384] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:11 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:12.474653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-95cc3904-0eaa-4a12-8e33-931c1fda134a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:12.475283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-95cc3904-0eaa-4a12-8e33-931c1fda134a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:12.482565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95cc3904-0eaa-4a12-8e33-931c1fda134a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:12.483062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95cc3904-0eaa-4a12-8e33-931c1fda134a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:12.483512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95cc3904-0eaa-4a12-8e33-931c1fda134a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:12.484216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95cc3904-0eaa-4a12-8e33-931c1fda134a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:12.484686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95cc3904-0eaa-4a12-8e33-931c1fda134a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:12.485165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95cc3904-0eaa-4a12-8e33-931c1fda134a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:12.616458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-95cc3904-0eaa-4a12-8e33-931c1fda134a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:12.624402 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-95cc3904-0eaa-4a12-8e33-931c1fda134a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1317 microversion: 2.1 time: 0.153760 Oct 24 11:34:12.625008 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3679/7385] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:12 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:13.647702 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fd3ec9b3-6244-4b3f-968c-bf277768b21a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:13.648349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fd3ec9b3-6244-4b3f-968c-bf277768b21a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:13.655478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd3ec9b3-6244-4b3f-968c-bf277768b21a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:13.655964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd3ec9b3-6244-4b3f-968c-bf277768b21a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:13.656399 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd3ec9b3-6244-4b3f-968c-bf277768b21a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:13.657115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd3ec9b3-6244-4b3f-968c-bf277768b21a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:13.657568 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd3ec9b3-6244-4b3f-968c-bf277768b21a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:13.658249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fd3ec9b3-6244-4b3f-968c-bf277768b21a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:13.792261 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fd3ec9b3-6244-4b3f-968c-bf277768b21a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:13.800530 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fd3ec9b3-6244-4b3f-968c-bf277768b21a tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1317 microversion: 2.1 time: 0.156686 Oct 24 11:34:13.801625 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3707/7386] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:13 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:14.824301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b2d0f906-bc9a-41cd-a2c6-bff6aa755eea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:14.825028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b2d0f906-bc9a-41cd-a2c6-bff6aa755eea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:14.831974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2d0f906-bc9a-41cd-a2c6-bff6aa755eea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:14.832479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2d0f906-bc9a-41cd-a2c6-bff6aa755eea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:14.832962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2d0f906-bc9a-41cd-a2c6-bff6aa755eea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:14.833707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2d0f906-bc9a-41cd-a2c6-bff6aa755eea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:14.834182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2d0f906-bc9a-41cd-a2c6-bff6aa755eea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:14.834627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2d0f906-bc9a-41cd-a2c6-bff6aa755eea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:14.970074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b2d0f906-bc9a-41cd-a2c6-bff6aa755eea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:14.977845 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b2d0f906-bc9a-41cd-a2c6-bff6aa755eea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1317 microversion: 2.1 time: 0.157763 Oct 24 11:34:14.978424 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3680/7387] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:14 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:15.940490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-9b0a5155-8d45-472b-a49e-89722291e232 req-783890ab-d9f7-4c66-a9c7-402a88dd4f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cce20aa-1e76-47d7-8cff-1638642b2665", "name": "network-vif-plugged", "status": "completed", "tag": "ae9f7368-b77f-42af-896d-2b6e83211d8a"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:34:15.954766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9b0a5155-8d45-472b-a49e-89722291e232 req-783890ab-d9f7-4c66-a9c7-402a88dd4f4f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:15.955292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9b0a5155-8d45-472b-a49e-89722291e232 req-783890ab-d9f7-4c66-a9c7-402a88dd4f4f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:15.955659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9b0a5155-8d45-472b-a49e-89722291e232 req-783890ab-d9f7-4c66-a9c7-402a88dd4f4f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:15.968502 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-9b0a5155-8d45-472b-a49e-89722291e232 req-783890ab-d9f7-4c66-a9c7-402a88dd4f4f service nova] Creating event network-vif-plugged:ae9f7368-b77f-42af-896d-2b6e83211d8a for instance 2cce20aa-1e76-47d7-8cff-1638642b2665 on n-h2-858383-15 Oct 24 11:34:15.973705 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-9b0a5155-8d45-472b-a49e-89722291e232 req-783890ab-d9f7-4c66-a9c7-402a88dd4f4f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038813 Oct 24 11:34:15.974376 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3708/7388] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:34:16.000729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d679b451-a266-43c7-8bb5-eddecf2d72f2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:16.001391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d679b451-a266-43c7-8bb5-eddecf2d72f2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:16.008926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d679b451-a266-43c7-8bb5-eddecf2d72f2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:16.009803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d679b451-a266-43c7-8bb5-eddecf2d72f2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:16.010274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d679b451-a266-43c7-8bb5-eddecf2d72f2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:16.011002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d679b451-a266-43c7-8bb5-eddecf2d72f2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:16.011481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d679b451-a266-43c7-8bb5-eddecf2d72f2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:16.011928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d679b451-a266-43c7-8bb5-eddecf2d72f2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:16.150309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d679b451-a266-43c7-8bb5-eddecf2d72f2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:16.158286 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d679b451-a266-43c7-8bb5-eddecf2d72f2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1317 microversion: 2.1 time: 0.161320 Oct 24 11:34:16.158866 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3681/7389] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:15 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:17.179601 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:34:17.180495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:34:17.187319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b2970d72-0cc8-4bdb-8438-bd3721e927a5 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:17.188719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b2970d72-0cc8-4bdb-8438-bd3721e927a5 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:17.195979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2970d72-0cc8-4bdb-8438-bd3721e927a5 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:17.196462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2970d72-0cc8-4bdb-8438-bd3721e927a5 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:17.196921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2970d72-0cc8-4bdb-8438-bd3721e927a5 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:17.197638 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2970d72-0cc8-4bdb-8438-bd3721e927a5 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:17.198149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2970d72-0cc8-4bdb-8438-bd3721e927a5 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:17.198720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b2970d72-0cc8-4bdb-8438-bd3721e927a5 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:17.337916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b2970d72-0cc8-4bdb-8438-bd3721e927a5 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:17.345669 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b2970d72-0cc8-4bdb-8438-bd3721e927a5 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1506 microversion: 2.1 time: 0.167003 Oct 24 11:34:17.346254 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3709/7390] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:17 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:17.407498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d42ede02-ccbe-4c00-a70b-57eac9d70bfe tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-921542360", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "ea2bdd35-9049-485d-a65d-7baa120c52a5"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:34:17.417208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:34:17.468000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-d42ede02-ccbe-4c00-a70b-57eac9d70bfe tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] validate_networks() for [('ea2bdd35-9049-485d-a65d-7baa120c52a5', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:34:17.834669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d42ede02-ccbe-4c00-a70b-57eac9d70bfe tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:34:17.835107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d42ede02-ccbe-4c00-a70b-57eac9d70bfe tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:34:17.835593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d42ede02-ccbe-4c00-a70b-57eac9d70bfe tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:34:17.836033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d42ede02-ccbe-4c00-a70b-57eac9d70bfe tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:34:17.836495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-d42ede02-ccbe-4c00-a70b-57eac9d70bfe tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:34:17.846021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42ede02-ccbe-4c00-a70b-57eac9d70bfe tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:17.846514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42ede02-ccbe-4c00-a70b-57eac9d70bfe tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:17.846964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42ede02-ccbe-4c00-a70b-57eac9d70bfe tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:17.847699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42ede02-ccbe-4c00-a70b-57eac9d70bfe tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:17.848166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42ede02-ccbe-4c00-a70b-57eac9d70bfe tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:17.848605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d42ede02-ccbe-4c00-a70b-57eac9d70bfe tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:17.865324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-d42ede02-ccbe-4c00-a70b-57eac9d70bfe tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Getting quotas for project d3bff7f1fbcc49209c689a03265c16aa. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:34:17.871150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-d42ede02-ccbe-4c00-a70b-57eac9d70bfe tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Getting quotas for user bf8a06692ac545479b7f1171b2160de7 and project d3bff7f1fbcc49209c689a03265c16aa. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:34:17.883298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d42ede02-ccbe-4c00-a70b-57eac9d70bfe tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:34:17.886357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d42ede02-ccbe-4c00-a70b-57eac9d70bfe tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 9b5adf25-cd6a-44ad-a804-16ab9a82e43d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:34:17.937504 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d42ede02-ccbe-4c00-a70b-57eac9d70bfe tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533930 Oct 24 11:34:17.938176 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3682/7391] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:34:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:34:17.949676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-982ed886-d20b-4f9a-afd2-65ef1c9d1d9c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:17.950287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-982ed886-d20b-4f9a-afd2-65ef1c9d1d9c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 9b5adf25-cd6a-44ad-a804-16ab9a82e43d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:18.006887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-982ed886-d20b-4f9a-afd2-65ef1c9d1d9c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:18.014831 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-982ed886-d20b-4f9a-afd2-65ef1c9d1d9c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d" status: 200 len: 1216 microversion: 2.1 time: 0.069599 Oct 24 11:34:18.015461 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3710/7392] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:17 2022] GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:19.039803 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-40e68121-8b48-43be-90f2-4ea8d4ec90b7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:19.041078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-40e68121-8b48-43be-90f2-4ea8d4ec90b7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 9b5adf25-cd6a-44ad-a804-16ab9a82e43d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:19.048354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40e68121-8b48-43be-90f2-4ea8d4ec90b7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:19.048913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40e68121-8b48-43be-90f2-4ea8d4ec90b7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:19.049378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40e68121-8b48-43be-90f2-4ea8d4ec90b7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:19.050105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40e68121-8b48-43be-90f2-4ea8d4ec90b7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:19.050631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40e68121-8b48-43be-90f2-4ea8d4ec90b7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:19.051079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40e68121-8b48-43be-90f2-4ea8d4ec90b7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:19.132554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-40e68121-8b48-43be-90f2-4ea8d4ec90b7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:19.141109 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-40e68121-8b48-43be-90f2-4ea8d4ec90b7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d" status: 200 len: 1276 microversion: 2.1 time: 0.106845 Oct 24 11:34:19.141697 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3683/7393] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:19 2022] GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d => generated 1276 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:20.163807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6b4ad089-f184-40bb-86ce-3e24226e161c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:20.164462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6b4ad089-f184-40bb-86ce-3e24226e161c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 9b5adf25-cd6a-44ad-a804-16ab9a82e43d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:20.175822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b4ad089-f184-40bb-86ce-3e24226e161c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:20.176349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b4ad089-f184-40bb-86ce-3e24226e161c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:20.176799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b4ad089-f184-40bb-86ce-3e24226e161c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:20.177534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b4ad089-f184-40bb-86ce-3e24226e161c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:20.177995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b4ad089-f184-40bb-86ce-3e24226e161c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:20.178432 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6b4ad089-f184-40bb-86ce-3e24226e161c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:20.593682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-8e11a080-e864-4851-a598-c783bcb4712a req-03d1dee4-fa4d-4f57-baae-1f13d623aedb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b5adf25-cd6a-44ad-a804-16ab9a82e43d", "tag": "0814cb7f-f66c-4f7e-a78c-2137ccc5326b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:34:20.604252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8e11a080-e864-4851-a598-c783bcb4712a req-03d1dee4-fa4d-4f57-baae-1f13d623aedb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:20.605193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8e11a080-e864-4851-a598-c783bcb4712a req-03d1dee4-fa4d-4f57-baae-1f13d623aedb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:20.605658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8e11a080-e864-4851-a598-c783bcb4712a req-03d1dee4-fa4d-4f57-baae-1f13d623aedb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:20.617626 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-8e11a080-e864-4851-a598-c783bcb4712a req-03d1dee4-fa4d-4f57-baae-1f13d623aedb service nova] Creating event network-changed:0814cb7f-f66c-4f7e-a78c-2137ccc5326b for instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d on n-h2-858383-15 Oct 24 11:34:20.619847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6b4ad089-f184-40bb-86ce-3e24226e161c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:20.623399 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-8e11a080-e864-4851-a598-c783bcb4712a req-03d1dee4-fa4d-4f57-baae-1f13d623aedb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126090 Oct 24 11:34:20.624530 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3684/7394] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:34:20.629135 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6b4ad089-f184-40bb-86ce-3e24226e161c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d" status: 200 len: 1316 microversion: 2.1 time: 0.469147 Oct 24 11:34:20.629805 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3711/7395] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:20 2022] GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:21.653911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6b282023-cef9-4126-a4e3-b7db4ae24fea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:21.654644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6b282023-cef9-4126-a4e3-b7db4ae24fea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 9b5adf25-cd6a-44ad-a804-16ab9a82e43d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:21.662034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b282023-cef9-4126-a4e3-b7db4ae24fea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:21.662539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b282023-cef9-4126-a4e3-b7db4ae24fea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:21.662999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b282023-cef9-4126-a4e3-b7db4ae24fea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:21.663718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b282023-cef9-4126-a4e3-b7db4ae24fea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:21.664198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b282023-cef9-4126-a4e3-b7db4ae24fea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:21.664651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6b282023-cef9-4126-a4e3-b7db4ae24fea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:21.796366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6b282023-cef9-4126-a4e3-b7db4ae24fea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:21.804220 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6b282023-cef9-4126-a4e3-b7db4ae24fea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d" status: 200 len: 1316 microversion: 2.1 time: 0.155165 Oct 24 11:34:21.804810 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3685/7396] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:21 2022] GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:22.827478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c5930543-51b9-4ab8-8f47-75e6a28ba576 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:22.828098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c5930543-51b9-4ab8-8f47-75e6a28ba576 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 9b5adf25-cd6a-44ad-a804-16ab9a82e43d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:22.834956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5930543-51b9-4ab8-8f47-75e6a28ba576 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:22.835439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5930543-51b9-4ab8-8f47-75e6a28ba576 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:22.835878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5930543-51b9-4ab8-8f47-75e6a28ba576 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:22.836573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5930543-51b9-4ab8-8f47-75e6a28ba576 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:22.837077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5930543-51b9-4ab8-8f47-75e6a28ba576 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:22.837509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c5930543-51b9-4ab8-8f47-75e6a28ba576 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:22.970404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c5930543-51b9-4ab8-8f47-75e6a28ba576 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:22.978669 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c5930543-51b9-4ab8-8f47-75e6a28ba576 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d" status: 200 len: 1316 microversion: 2.1 time: 0.155195 Oct 24 11:34:22.979230 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3712/7397] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:22 2022] GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:24.004372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ebe1df2d-9d6b-4b12-bf43-1050260cd9f6 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:24.005185 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ebe1df2d-9d6b-4b12-bf43-1050260cd9f6 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 9b5adf25-cd6a-44ad-a804-16ab9a82e43d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:24.013907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebe1df2d-9d6b-4b12-bf43-1050260cd9f6 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:24.014414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebe1df2d-9d6b-4b12-bf43-1050260cd9f6 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:24.014898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebe1df2d-9d6b-4b12-bf43-1050260cd9f6 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:24.015618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebe1df2d-9d6b-4b12-bf43-1050260cd9f6 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:24.016115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebe1df2d-9d6b-4b12-bf43-1050260cd9f6 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:24.016558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ebe1df2d-9d6b-4b12-bf43-1050260cd9f6 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:24.146992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ebe1df2d-9d6b-4b12-bf43-1050260cd9f6 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:24.155632 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ebe1df2d-9d6b-4b12-bf43-1050260cd9f6 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d" status: 200 len: 1316 microversion: 2.1 time: 0.156831 Oct 24 11:34:24.156220 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3686/7398] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:23 2022] GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:25.179675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b0c4531d-d741-408c-af83-5a113aa066d8 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:25.180290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b0c4531d-d741-408c-af83-5a113aa066d8 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 9b5adf25-cd6a-44ad-a804-16ab9a82e43d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:25.187803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b0c4531d-d741-408c-af83-5a113aa066d8 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:25.188290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b0c4531d-d741-408c-af83-5a113aa066d8 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:25.188728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b0c4531d-d741-408c-af83-5a113aa066d8 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:25.189467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b0c4531d-d741-408c-af83-5a113aa066d8 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:25.189927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b0c4531d-d741-408c-af83-5a113aa066d8 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:25.190356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b0c4531d-d741-408c-af83-5a113aa066d8 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:25.322395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b0c4531d-d741-408c-af83-5a113aa066d8 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:25.330801 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b0c4531d-d741-408c-af83-5a113aa066d8 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d" status: 200 len: 1316 microversion: 2.1 time: 0.154990 Oct 24 11:34:25.331374 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3713/7399] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:25 2022] GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:25.965130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-e155a9be-2aed-4283-8e24-eea9298f5968 req-2d2956fd-5f38-4359-9e41-d17e0dc14098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b5adf25-cd6a-44ad-a804-16ab9a82e43d", "name": "network-vif-plugged", "status": "completed", "tag": "0814cb7f-f66c-4f7e-a78c-2137ccc5326b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:34:25.975877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e155a9be-2aed-4283-8e24-eea9298f5968 req-2d2956fd-5f38-4359-9e41-d17e0dc14098 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:25.976462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e155a9be-2aed-4283-8e24-eea9298f5968 req-2d2956fd-5f38-4359-9e41-d17e0dc14098 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:25.976965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-e155a9be-2aed-4283-8e24-eea9298f5968 req-2d2956fd-5f38-4359-9e41-d17e0dc14098 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:25.989174 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-e155a9be-2aed-4283-8e24-eea9298f5968 req-2d2956fd-5f38-4359-9e41-d17e0dc14098 service nova] Creating event network-vif-plugged:0814cb7f-f66c-4f7e-a78c-2137ccc5326b for instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d on n-h2-858383-15 Oct 24 11:34:25.994686 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-e155a9be-2aed-4283-8e24-eea9298f5968 req-2d2956fd-5f38-4359-9e41-d17e0dc14098 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034072 Oct 24 11:34:25.995298 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3687/7400] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:34:26.354424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-838d4904-814a-447a-9da5-1ebf470e0f03 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:26.355070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-838d4904-814a-447a-9da5-1ebf470e0f03 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 9b5adf25-cd6a-44ad-a804-16ab9a82e43d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:26.357395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:34:26.362760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-838d4904-814a-447a-9da5-1ebf470e0f03 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:26.363237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-838d4904-814a-447a-9da5-1ebf470e0f03 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:26.363679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-838d4904-814a-447a-9da5-1ebf470e0f03 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:26.364414 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-838d4904-814a-447a-9da5-1ebf470e0f03 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:26.364883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-838d4904-814a-447a-9da5-1ebf470e0f03 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:26.365309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-838d4904-814a-447a-9da5-1ebf470e0f03 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:26.501245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-838d4904-814a-447a-9da5-1ebf470e0f03 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:26.508968 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-838d4904-814a-447a-9da5-1ebf470e0f03 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d" status: 200 len: 1316 microversion: 2.1 time: 0.158537 Oct 24 11:34:26.509540 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3714/7401] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:26 2022] GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:27.532455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf7a4647-e87e-42f8-9584-89b1cbd8e6ea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:27.533494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf7a4647-e87e-42f8-9584-89b1cbd8e6ea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 9b5adf25-cd6a-44ad-a804-16ab9a82e43d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:27.540819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf7a4647-e87e-42f8-9584-89b1cbd8e6ea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:27.541463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf7a4647-e87e-42f8-9584-89b1cbd8e6ea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:27.541930 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf7a4647-e87e-42f8-9584-89b1cbd8e6ea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:27.542653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf7a4647-e87e-42f8-9584-89b1cbd8e6ea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:27.543132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf7a4647-e87e-42f8-9584-89b1cbd8e6ea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:27.543582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf7a4647-e87e-42f8-9584-89b1cbd8e6ea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:27.673570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cf7a4647-e87e-42f8-9584-89b1cbd8e6ea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:27.681682 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf7a4647-e87e-42f8-9584-89b1cbd8e6ea tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d" status: 200 len: 1505 microversion: 2.1 time: 0.153451 Oct 24 11:34:27.682266 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3688/7402] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:27 2022] GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:27.703898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2bdfe6be-4469-456f-a8fa-411e015e9f1d tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:27.704455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2bdfe6be-4469-456f-a8fa-411e015e9f1d tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 9b5adf25-cd6a-44ad-a804-16ab9a82e43d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:27.714019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bdfe6be-4469-456f-a8fa-411e015e9f1d tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:27.714506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bdfe6be-4469-456f-a8fa-411e015e9f1d tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:27.715166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bdfe6be-4469-456f-a8fa-411e015e9f1d tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:27.715861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bdfe6be-4469-456f-a8fa-411e015e9f1d tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:27.716327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bdfe6be-4469-456f-a8fa-411e015e9f1d tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:27.716761 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2bdfe6be-4469-456f-a8fa-411e015e9f1d tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:27.742318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2bdfe6be-4469-456f-a8fa-411e015e9f1d tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 9b5adf25-cd6a-44ad-a804-16ab9a82e43d] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:34:27.818939 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2bdfe6be-4469-456f-a8fa-411e015e9f1d tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d" status: 204 len: 0 microversion: 2.1 time: 0.118556 Oct 24 11:34:27.819643 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3715/7403] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:34:27 2022] DELETE /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:34:27.827979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f55171ee-07db-4ad4-ab85-df9c59f23ff4 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:27.828618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f55171ee-07db-4ad4-ab85-df9c59f23ff4 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 9b5adf25-cd6a-44ad-a804-16ab9a82e43d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:27.834636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f55171ee-07db-4ad4-ab85-df9c59f23ff4 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:27.835151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f55171ee-07db-4ad4-ab85-df9c59f23ff4 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:27.835655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f55171ee-07db-4ad4-ab85-df9c59f23ff4 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:27.836377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f55171ee-07db-4ad4-ab85-df9c59f23ff4 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:27.836885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f55171ee-07db-4ad4-ab85-df9c59f23ff4 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:27.837861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f55171ee-07db-4ad4-ab85-df9c59f23ff4 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:27.856868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:34:27.877577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:34:27.976669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f55171ee-07db-4ad4-ab85-df9c59f23ff4 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:27.984558 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f55171ee-07db-4ad4-ab85-df9c59f23ff4 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d" status: 200 len: 1511 microversion: 2.1 time: 0.160514 Oct 24 11:34:27.985179 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3689/7404] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:27 2022] GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:29.012283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-33e1cd3d-008f-441a-bf50-3b47146d1e73 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:29.012947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-33e1cd3d-008f-441a-bf50-3b47146d1e73 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 9b5adf25-cd6a-44ad-a804-16ab9a82e43d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:29.014864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:34:29.021729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33e1cd3d-008f-441a-bf50-3b47146d1e73 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:29.022221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33e1cd3d-008f-441a-bf50-3b47146d1e73 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:29.022663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33e1cd3d-008f-441a-bf50-3b47146d1e73 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:29.023359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33e1cd3d-008f-441a-bf50-3b47146d1e73 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:29.023815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33e1cd3d-008f-441a-bf50-3b47146d1e73 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:29.024247 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33e1cd3d-008f-441a-bf50-3b47146d1e73 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:29.163036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-33e1cd3d-008f-441a-bf50-3b47146d1e73 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:29.171170 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-33e1cd3d-008f-441a-bf50-3b47146d1e73 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d" status: 200 len: 1511 microversion: 2.1 time: 0.163661 Oct 24 11:34:29.171747 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3716/7405] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:29 2022] GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:29.848551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-64e315ac-0fb6-4b57-8d7b-1cf11cd63ece req-2a5e0b6a-2da5-4764-a5ae-eee89438e0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b5adf25-cd6a-44ad-a804-16ab9a82e43d", "name": "network-vif-deleted", "tag": "0814cb7f-f66c-4f7e-a78c-2137ccc5326b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:34:29.860928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-64e315ac-0fb6-4b57-8d7b-1cf11cd63ece req-2a5e0b6a-2da5-4764-a5ae-eee89438e0e4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:29.862009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-64e315ac-0fb6-4b57-8d7b-1cf11cd63ece req-2a5e0b6a-2da5-4764-a5ae-eee89438e0e4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:29.862739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-64e315ac-0fb6-4b57-8d7b-1cf11cd63ece req-2a5e0b6a-2da5-4764-a5ae-eee89438e0e4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:29.876170 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-64e315ac-0fb6-4b57-8d7b-1cf11cd63ece req-2a5e0b6a-2da5-4764-a5ae-eee89438e0e4 service nova] Creating event network-vif-deleted:0814cb7f-f66c-4f7e-a78c-2137ccc5326b for instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d on n-h2-858383-15 Oct 24 11:34:29.881703 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-64e315ac-0fb6-4b57-8d7b-1cf11cd63ece req-2a5e0b6a-2da5-4764-a5ae-eee89438e0e4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037040 Oct 24 11:34:29.882563 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3690/7406] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:34:30.194588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2e0e589b-46be-4452-85cc-0256ce2d02e2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:30.195197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2e0e589b-46be-4452-85cc-0256ce2d02e2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 9b5adf25-cd6a-44ad-a804-16ab9a82e43d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:30.202637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e0e589b-46be-4452-85cc-0256ce2d02e2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:30.203109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e0e589b-46be-4452-85cc-0256ce2d02e2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:30.203535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e0e589b-46be-4452-85cc-0256ce2d02e2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:30.204221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e0e589b-46be-4452-85cc-0256ce2d02e2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:30.204670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e0e589b-46be-4452-85cc-0256ce2d02e2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:30.205113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e0e589b-46be-4452-85cc-0256ce2d02e2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:30.236359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e0e589b-46be-4452-85cc-0256ce2d02e2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:30.236861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e0e589b-46be-4452-85cc-0256ce2d02e2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:30.237302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2e0e589b-46be-4452-85cc-0256ce2d02e2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:30.237742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-2e0e589b-46be-4452-85cc-0256ce2d02e2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lazy-loading 'fault' on Instance uuid 9b5adf25-cd6a-44ad-a804-16ab9a82e43d {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:34:30.280848 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2e0e589b-46be-4452-85cc-0256ce2d02e2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:30.288936 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2e0e589b-46be-4452-85cc-0256ce2d02e2 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d" status: 200 len: 1306 microversion: 2.1 time: 0.098225 Oct 24 11:34:30.289515 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3717/7407] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:30 2022] GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d => generated 1306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:31.314021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8e70d2d7-b7c0-4b44-bdb4-9fb77561b410 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:31.314733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8e70d2d7-b7c0-4b44-bdb4-9fb77561b410 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 9b5adf25-cd6a-44ad-a804-16ab9a82e43d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:31.320912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e70d2d7-b7c0-4b44-bdb4-9fb77561b410 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:31.321441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e70d2d7-b7c0-4b44-bdb4-9fb77561b410 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:31.321971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e70d2d7-b7c0-4b44-bdb4-9fb77561b410 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:31.322688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e70d2d7-b7c0-4b44-bdb4-9fb77561b410 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:31.323154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e70d2d7-b7c0-4b44-bdb4-9fb77561b410 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:31.323589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8e70d2d7-b7c0-4b44-bdb4-9fb77561b410 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:31.336815 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-8e70d2d7-b7c0-4b44-bdb4-9fb77561b410 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] HTTP exception thrown: Instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d could not be found. Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8e70d2d7-b7c0-4b44-bdb4-9fb77561b410 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Request method failure captured: Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d HTTP/1.1 Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVngtIav6LfWNIkchZuCOwaj46N0v3OT-EEWGA2nze9ZS5DUioZoc67B8T-4S4lh4tIwhbkK7ENT8bCZQQoQHFZhhJZc0k0pl-69r_6G13UicdCrHYttGOqWWcHzKl0EJd-2mccY5Wxtms2CPY-8XYaYDLo27xrbWYHlY-R6ez_FlRpo Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: d3bff7f1fbcc49209c689a03265c16aa Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d3bff7f1fbcc49209c689a03265c16aa", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: d3bff7f1fbcc49209c689a03265c16aa Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-719401686-project Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: bf8a06692ac545479b7f1171b2160de7 Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-719401686-project Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d could not be found. Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '9b5adf25-cd6a-44ad-a804-16ab9a82e43d'} Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d could not be found. Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d could not be found. Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:34:31.339070 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:31.344568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:31.344568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:34:31.344568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:34:31.344568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:34:31.344568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:34:31.344568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d could not be found. Oct 24 11:34:31.344568 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:31.344568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8e70d2d7-b7c0-4b44-bdb4-9fb77561b410 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Returning 404 to user: Instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:34:31.344568 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8e70d2d7-b7c0-4b44-bdb4-9fb77561b410 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d" status: 404 len: 111 microversion: 2.1 time: 0.031673 Oct 24 11:34:31.344568 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3691/7408] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:31 2022] GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:34:31.350922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-91a26a7f-5259-4615-af6f-9acaea788602 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:31.351544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-91a26a7f-5259-4615-af6f-9acaea788602 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:31.359279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91a26a7f-5259-4615-af6f-9acaea788602 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:31.359769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91a26a7f-5259-4615-af6f-9acaea788602 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:31.360213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91a26a7f-5259-4615-af6f-9acaea788602 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:31.360946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91a26a7f-5259-4615-af6f-9acaea788602 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:31.361410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91a26a7f-5259-4615-af6f-9acaea788602 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:31.361845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91a26a7f-5259-4615-af6f-9acaea788602 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:31.493871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-91a26a7f-5259-4615-af6f-9acaea788602 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:31.501561 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-91a26a7f-5259-4615-af6f-9acaea788602 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1506 microversion: 2.1 time: 0.154541 Oct 24 11:34:31.502126 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3718/7409] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:31 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:31.523686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ae2e81dc-6e7c-43fd-b370-4d5dafedb844 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:34:31.526744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ae2e81dc-6e7c-43fd-b370-4d5dafedb844 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 653cc953-1cb2-42e4-b2fc-3b7910ecb26e] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:31.532230 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-ae2e81dc-6e7c-43fd-b370-4d5dafedb844 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] HTTP exception thrown: Instance 653cc953-1cb2-42e4-b2fc-3b7910ecb26e could not be found. Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ae2e81dc-6e7c-43fd-b370-4d5dafedb844 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Request method failure captured: Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/653cc953-1cb2-42e4-b2fc-3b7910ecb26e/action HTTP/1.1 Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 32 Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVngtIav6LfWNIkchZuCOwaj46N0v3OT-EEWGA2nze9ZS5DUioZoc67B8T-4S4lh4tIwhbkK7ENT8bCZQQoQHFZhhJZc0k0pl-69r_6G13UicdCrHYttGOqWWcHzKl0EJd-2mccY5Wxtms2CPY-8XYaYDLo27xrbWYHlY-R6ez_FlRpo Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: d3bff7f1fbcc49209c689a03265c16aa Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d3bff7f1fbcc49209c689a03265c16aa", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: d3bff7f1fbcc49209c689a03265c16aa Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-719401686-project Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: bf8a06692ac545479b7f1171b2160de7 Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-719401686-project Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: {"resize": {"flavorRef": "452"}} Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 653cc953-1cb2-42e4-b2fc-3b7910ecb26e could not be found. Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '653cc953-1cb2-42e4-b2fc-3b7910ecb26e', 'body': {'resize': {'flavorRef': '452'}}} Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 653cc953-1cb2-42e4-b2fc-3b7910ecb26e could not be found. Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:34:31.534103 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:34:31.539477 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 653cc953-1cb2-42e4-b2fc-3b7910ecb26e could not be found. Oct 24 11:34:31.539477 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:31.539477 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:34:31.539477 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:31.539477 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:31.539477 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:34:31.539477 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:34:31.539477 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:34:31.539477 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:34:31.539477 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 653cc953-1cb2-42e4-b2fc-3b7910ecb26e could not be found. Oct 24 11:34:31.539477 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:31.539477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ae2e81dc-6e7c-43fd-b370-4d5dafedb844 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Returning 404 to user: Instance 653cc953-1cb2-42e4-b2fc-3b7910ecb26e could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:34:31.539477 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ae2e81dc-6e7c-43fd-b370-4d5dafedb844 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "POST /compute/v2.1/servers/653cc953-1cb2-42e4-b2fc-3b7910ecb26e/action" status: 404 len: 111 microversion: 2.1 time: 0.015753 Oct 24 11:34:31.539477 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3692/7410] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:34:31 2022] POST /compute/v2.1/servers/653cc953-1cb2-42e4-b2fc-3b7910ecb26e/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:34:31.544651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d81494f7-039b-4132-8c77-2ca8ed558169 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:31.545318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d81494f7-039b-4132-8c77-2ca8ed558169 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:31.551216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d81494f7-039b-4132-8c77-2ca8ed558169 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:31.551698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d81494f7-039b-4132-8c77-2ca8ed558169 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:31.552136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d81494f7-039b-4132-8c77-2ca8ed558169 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:31.552824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d81494f7-039b-4132-8c77-2ca8ed558169 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:31.553295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d81494f7-039b-4132-8c77-2ca8ed558169 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:31.553724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d81494f7-039b-4132-8c77-2ca8ed558169 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:31.686083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d81494f7-039b-4132-8c77-2ca8ed558169 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:31.694110 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d81494f7-039b-4132-8c77-2ca8ed558169 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1506 microversion: 2.1 time: 0.153881 Oct 24 11:34:31.694749 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3719/7411] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:31 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:31.718055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d81d3dc4-ab4b-44d1-a631-fa9f33cebcd9 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:31.718697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d81d3dc4-ab4b-44d1-a631-fa9f33cebcd9 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:31.725636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d81d3dc4-ab4b-44d1-a631-fa9f33cebcd9 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:31.726140 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d81d3dc4-ab4b-44d1-a631-fa9f33cebcd9 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:31.726594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d81d3dc4-ab4b-44d1-a631-fa9f33cebcd9 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:31.727308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d81d3dc4-ab4b-44d1-a631-fa9f33cebcd9 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:31.727941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d81d3dc4-ab4b-44d1-a631-fa9f33cebcd9 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:31.728393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d81d3dc4-ab4b-44d1-a631-fa9f33cebcd9 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:31.861853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d81d3dc4-ab4b-44d1-a631-fa9f33cebcd9 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:31.869994 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d81d3dc4-ab4b-44d1-a631-fa9f33cebcd9 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1506 microversion: 2.1 time: 0.155735 Oct 24 11:34:31.870574 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3693/7412] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:31 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:31.892518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-37c32f98-9a54-45d4-8f02-029686d5b663 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "413934e3-cfbb-4e09-8e18-aa30687c0a66"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:34:31.894813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-37c32f98-9a54-45d4-8f02-029686d5b663 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:31.901313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37c32f98-9a54-45d4-8f02-029686d5b663 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:31.901791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37c32f98-9a54-45d4-8f02-029686d5b663 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:31.902223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37c32f98-9a54-45d4-8f02-029686d5b663 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:31.902910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37c32f98-9a54-45d4-8f02-029686d5b663 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:31.903361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37c32f98-9a54-45d4-8f02-029686d5b663 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:31.903783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37c32f98-9a54-45d4-8f02-029686d5b663 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:31.923541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:34:32.000785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-37c32f98-9a54-45d4-8f02-029686d5b663 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:32.006282 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-37c32f98-9a54-45d4-8f02-029686d5b663 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] HTTP exception thrown: Flavor 413934e3-cfbb-4e09-8e18-aa30687c0a66 could not be found. Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-37c32f98-9a54-45d4-8f02-029686d5b663 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Request method failure captured: Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: request: POST /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665/action HTTP/1.1 Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 65 Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVngtIav6LfWNIkchZuCOwaj46N0v3OT-EEWGA2nze9ZS5DUioZoc67B8T-4S4lh4tIwhbkK7ENT8bCZQQoQHFZhhJZc0k0pl-69r_6G13UicdCrHYttGOqWWcHzKl0EJd-2mccY5Wxtms2CPY-8XYaYDLo27xrbWYHlY-R6ez_FlRpo Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: d3bff7f1fbcc49209c689a03265c16aa Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d3bff7f1fbcc49209c689a03265c16aa", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: d3bff7f1fbcc49209c689a03265c16aa Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-719401686-project Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: bf8a06692ac545479b7f1171b2160de7 Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-719401686-project Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: {"resize": {"flavorRef": "413934e3-cfbb-4e09-8e18-aa30687c0a66"}} Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: exception: Flavor 413934e3-cfbb-4e09-8e18-aa30687c0a66 could not be found. Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '2cce20aa-1e76-47d7-8cff-1638642b2665', 'body': {'resize': {'flavorRef': '413934e3-cfbb-4e09-8e18-aa30687c0a66'}}} Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4202, in resize Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:34:32.008212 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 413934e3-cfbb-4e09-8e18-aa30687c0a66 could not be found. Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 413934e3-cfbb-4e09-8e18-aa30687c0a66 could not be found. Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 413934e3-cfbb-4e09-8e18-aa30687c0a66 could not be found. Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-37c32f98-9a54-45d4-8f02-029686d5b663 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Returning 400 to user: Flavor 413934e3-cfbb-4e09-8e18-aa30687c0a66 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-37c32f98-9a54-45d4-8f02-029686d5b663 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "POST /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665/action" status: 400 len: 107 microversion: 2.1 time: 0.121237 Oct 24 11:34:32.014149 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3720/7413] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:34:31 2022] POST /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665/action => generated 107 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 11:34:32.021141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-20dd96e9-0ba2-4d05-a792-f1a792bd354c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:32.021776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-20dd96e9-0ba2-4d05-a792-f1a792bd354c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:32.030267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20dd96e9-0ba2-4d05-a792-f1a792bd354c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:32.031133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20dd96e9-0ba2-4d05-a792-f1a792bd354c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:32.031604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20dd96e9-0ba2-4d05-a792-f1a792bd354c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:32.032571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20dd96e9-0ba2-4d05-a792-f1a792bd354c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:32.033690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20dd96e9-0ba2-4d05-a792-f1a792bd354c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:32.034149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20dd96e9-0ba2-4d05-a792-f1a792bd354c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:32.167487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-20dd96e9-0ba2-4d05-a792-f1a792bd354c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:32.175254 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-20dd96e9-0ba2-4d05-a792-f1a792bd354c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1506 microversion: 2.1 time: 0.159303 Oct 24 11:34:32.175827 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3694/7414] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:32 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:32.200244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-80ede76a-d222-41d1-aae5-f2535da3fa2f tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:32.200944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-80ede76a-d222-41d1-aae5-f2535da3fa2f tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:32.207123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80ede76a-d222-41d1-aae5-f2535da3fa2f tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:32.207550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80ede76a-d222-41d1-aae5-f2535da3fa2f tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:32.207994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80ede76a-d222-41d1-aae5-f2535da3fa2f tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:32.208688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80ede76a-d222-41d1-aae5-f2535da3fa2f tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:32.209182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80ede76a-d222-41d1-aae5-f2535da3fa2f tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:32.209614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-80ede76a-d222-41d1-aae5-f2535da3fa2f tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:32.339078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-80ede76a-d222-41d1-aae5-f2535da3fa2f tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:32.346907 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-80ede76a-d222-41d1-aae5-f2535da3fa2f tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1506 microversion: 2.1 time: 0.151553 Oct 24 11:34:32.347491 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3721/7415] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:32 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:32.369109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f8dcd036-20b4-403f-93d1-cfa84057c0c3 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f8dcd036-20b4-403f-93d1-cfa84057c0c3 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Request method failure captured: Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: request: POST /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665/action HTTP/1.1 Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 29 Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVngtIav6LfWNIkchZuCOwaj46N0v3OT-EEWGA2nze9ZS5DUioZoc67B8T-4S4lh4tIwhbkK7ENT8bCZQQoQHFZhhJZc0k0pl-69r_6G13UicdCrHYttGOqWWcHzKl0EJd-2mccY5Wxtms2CPY-8XYaYDLo27xrbWYHlY-R6ez_FlRpo Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: d3bff7f1fbcc49209c689a03265c16aa Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d3bff7f1fbcc49209c689a03265c16aa", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: d3bff7f1fbcc49209c689a03265c16aa Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-719401686-project Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: bf8a06692ac545479b7f1171b2160de7 Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-719401686-project Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: {"resize": {"flavorRef": ""}} Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '2cce20aa-1e76-47d7-8cff-1638642b2665', 'body': {'resize': {'flavorRef': ''}}} Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise error Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi '' Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.373489 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:34:32.378492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.378492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:32.378492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:34:32.378492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:34:32.378492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 11:34:32.378492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 11:34:32.378492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 24 11:34:32.378492 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.378492 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f8dcd036-20b4-403f-93d1-cfa84057c0c3 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:34:32.378492 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f8dcd036-20b4-403f-93d1-cfa84057c0c3 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "POST /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665/action" status: 400 len: 113 microversion: 2.1 time: 0.009904 Oct 24 11:34:32.378492 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3695/7416] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:34:32 2022] POST /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 11:34:32.383389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0e55c6cb-3d2f-493f-bdb1-9ee06c229678 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:32.384015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0e55c6cb-3d2f-493f-bdb1-9ee06c229678 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:32.391582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e55c6cb-3d2f-493f-bdb1-9ee06c229678 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:32.392070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e55c6cb-3d2f-493f-bdb1-9ee06c229678 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:32.392515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e55c6cb-3d2f-493f-bdb1-9ee06c229678 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:32.393262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e55c6cb-3d2f-493f-bdb1-9ee06c229678 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:32.393725 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e55c6cb-3d2f-493f-bdb1-9ee06c229678 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:32.394160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0e55c6cb-3d2f-493f-bdb1-9ee06c229678 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:32.525301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0e55c6cb-3d2f-493f-bdb1-9ee06c229678 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:32.533471 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0e55c6cb-3d2f-493f-bdb1-9ee06c229678 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1506 microversion: 2.1 time: 0.153661 Oct 24 11:34:32.534048 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3722/7417] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:32 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:32.561046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-de2ee641-4c30-4209-8dec-70c0bf39a071 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:32.561609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-de2ee641-4c30-4209-8dec-70c0bf39a071 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 9b5adf25-cd6a-44ad-a804-16ab9a82e43d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:32.568809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de2ee641-4c30-4209-8dec-70c0bf39a071 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:32.569349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de2ee641-4c30-4209-8dec-70c0bf39a071 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:32.569814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de2ee641-4c30-4209-8dec-70c0bf39a071 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:32.570581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de2ee641-4c30-4209-8dec-70c0bf39a071 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:32.571160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de2ee641-4c30-4209-8dec-70c0bf39a071 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:32.571635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-de2ee641-4c30-4209-8dec-70c0bf39a071 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:32.585857 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-de2ee641-4c30-4209-8dec-70c0bf39a071 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] HTTP exception thrown: Instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d could not be found. Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-de2ee641-4c30-4209-8dec-70c0bf39a071 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Request method failure captured: Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d HTTP/1.1 Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVngtIav6LfWNIkchZuCOwaj46N0v3OT-EEWGA2nze9ZS5DUioZoc67B8T-4S4lh4tIwhbkK7ENT8bCZQQoQHFZhhJZc0k0pl-69r_6G13UicdCrHYttGOqWWcHzKl0EJd-2mccY5Wxtms2CPY-8XYaYDLo27xrbWYHlY-R6ez_FlRpo Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: d3bff7f1fbcc49209c689a03265c16aa Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d3bff7f1fbcc49209c689a03265c16aa", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: d3bff7f1fbcc49209c689a03265c16aa Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-719401686-project Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: bf8a06692ac545479b7f1171b2160de7 Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-719401686-project Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d could not be found. Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '9b5adf25-cd6a-44ad-a804-16ab9a82e43d'} Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d could not be found. Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:34:32.587448 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:34:32.592098 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d could not be found. Oct 24 11:34:32.592098 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.592098 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:34:32.592098 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.592098 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:32.592098 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:34:32.592098 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:34:32.592098 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:34:32.592098 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:34:32.592098 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d could not be found. Oct 24 11:34:32.592098 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.592098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-de2ee641-4c30-4209-8dec-70c0bf39a071 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Returning 404 to user: Instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:34:32.592098 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-de2ee641-4c30-4209-8dec-70c0bf39a071 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d" status: 404 len: 111 microversion: 2.1 time: 0.033315 Oct 24 11:34:32.592098 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3696/7418] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:34:32 2022] DELETE /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:34:32.597518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-273408a7-6690-4a6f-a16f-06cdcd5458ab tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:32.598140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-273408a7-6690-4a6f-a16f-06cdcd5458ab tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 9b5adf25-cd6a-44ad-a804-16ab9a82e43d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:32.604196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-273408a7-6690-4a6f-a16f-06cdcd5458ab tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:32.605281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-273408a7-6690-4a6f-a16f-06cdcd5458ab tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:32.605722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-273408a7-6690-4a6f-a16f-06cdcd5458ab tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:32.606423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-273408a7-6690-4a6f-a16f-06cdcd5458ab tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:32.607074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-273408a7-6690-4a6f-a16f-06cdcd5458ab tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:32.607509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-273408a7-6690-4a6f-a16f-06cdcd5458ab tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:32.623965 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-273408a7-6690-4a6f-a16f-06cdcd5458ab tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] HTTP exception thrown: Instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d could not be found. Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-273408a7-6690-4a6f-a16f-06cdcd5458ab tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Request method failure captured: Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d HTTP/1.1 Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVngtIav6LfWNIkchZuCOwaj46N0v3OT-EEWGA2nze9ZS5DUioZoc67B8T-4S4lh4tIwhbkK7ENT8bCZQQoQHFZhhJZc0k0pl-69r_6G13UicdCrHYttGOqWWcHzKl0EJd-2mccY5Wxtms2CPY-8XYaYDLo27xrbWYHlY-R6ez_FlRpo Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: d3bff7f1fbcc49209c689a03265c16aa Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d3bff7f1fbcc49209c689a03265c16aa", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: d3bff7f1fbcc49209c689a03265c16aa Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-ServersNegativeTestJSON-719401686-project Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: bf8a06692ac545479b7f1171b2160de7 Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-ServersNegativeTestJSON-719401686-project Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d could not be found. Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '9b5adf25-cd6a-44ad-a804-16ab9a82e43d'} Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d could not be found. Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d could not be found. Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:34:32.625536 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.630300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:32.630300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:34:32.630300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:34:32.630300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:34:32.630300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:34:32.630300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d could not be found. Oct 24 11:34:32.630300 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:34:32.630300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-273408a7-6690-4a6f-a16f-06cdcd5458ab tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Returning 404 to user: Instance 9b5adf25-cd6a-44ad-a804-16ab9a82e43d could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:34:32.630300 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-273408a7-6690-4a6f-a16f-06cdcd5458ab tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d" status: 404 len: 111 microversion: 2.1 time: 0.033301 Oct 24 11:34:32.630300 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3723/7419] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:32 2022] GET /compute/v2.1/servers/9b5adf25-cd6a-44ad-a804-16ab9a82e43d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:34:32.635695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c4f1ba02-07ec-48aa-bbb5-f9bf05b56aac tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:32.636334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c4f1ba02-07ec-48aa-bbb5-f9bf05b56aac tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:32.642356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4f1ba02-07ec-48aa-bbb5-f9bf05b56aac tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:32.642857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4f1ba02-07ec-48aa-bbb5-f9bf05b56aac tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:32.643319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4f1ba02-07ec-48aa-bbb5-f9bf05b56aac tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:32.644035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4f1ba02-07ec-48aa-bbb5-f9bf05b56aac tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:32.644518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4f1ba02-07ec-48aa-bbb5-f9bf05b56aac tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:32.645008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c4f1ba02-07ec-48aa-bbb5-f9bf05b56aac tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:32.670945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c4f1ba02-07ec-48aa-bbb5-f9bf05b56aac tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:34:32.720398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:34:32.749340 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c4f1ba02-07ec-48aa-bbb5-f9bf05b56aac tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 204 len: 0 microversion: 2.1 time: 0.117086 Oct 24 11:34:32.749993 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3697/7420] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:34:32 2022] DELETE /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:34:32.758212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-af2239e0-3ece-4ed9-87b9-e7f91aaf38fd tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:32.758858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-af2239e0-3ece-4ed9-87b9-e7f91aaf38fd tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:32.765023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af2239e0-3ece-4ed9-87b9-e7f91aaf38fd tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:32.765507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af2239e0-3ece-4ed9-87b9-e7f91aaf38fd tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:32.765943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af2239e0-3ece-4ed9-87b9-e7f91aaf38fd tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:32.766648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af2239e0-3ece-4ed9-87b9-e7f91aaf38fd tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:32.767083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af2239e0-3ece-4ed9-87b9-e7f91aaf38fd tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:32.767506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af2239e0-3ece-4ed9-87b9-e7f91aaf38fd tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:32.896484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-af2239e0-3ece-4ed9-87b9-e7f91aaf38fd tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:32.904992 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-af2239e0-3ece-4ed9-87b9-e7f91aaf38fd tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1512 microversion: 2.1 time: 0.150711 Oct 24 11:34:32.905569 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3724/7421] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:32 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:34:33.929534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7cc8e49d-6f52-419c-984f-0a087830577c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:33.930265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7cc8e49d-6f52-419c-984f-0a087830577c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:33.937193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cc8e49d-6f52-419c-984f-0a087830577c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:33.937701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cc8e49d-6f52-419c-984f-0a087830577c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:33.938159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cc8e49d-6f52-419c-984f-0a087830577c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:33.938883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cc8e49d-6f52-419c-984f-0a087830577c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:33.939357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cc8e49d-6f52-419c-984f-0a087830577c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:33.939806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7cc8e49d-6f52-419c-984f-0a087830577c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:34.082736 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7cc8e49d-6f52-419c-984f-0a087830577c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:34.091332 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7cc8e49d-6f52-419c-984f-0a087830577c tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1512 microversion: 2.1 time: 0.166275 Oct 24 11:34:34.091942 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3698/7422] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:33 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:35.115305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e96f0d73-3fa8-4444-9481-9aad18a046e7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:35.118894 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e96f0d73-3fa8-4444-9481-9aad18a046e7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:35.134157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e96f0d73-3fa8-4444-9481-9aad18a046e7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:35.138190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e96f0d73-3fa8-4444-9481-9aad18a046e7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:35.138840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e96f0d73-3fa8-4444-9481-9aad18a046e7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:35.139735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e96f0d73-3fa8-4444-9481-9aad18a046e7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:35.140320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e96f0d73-3fa8-4444-9481-9aad18a046e7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:35.140895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e96f0d73-3fa8-4444-9481-9aad18a046e7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:35.180013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ce265d13-4531-4aab-8435-70b4b97e4c39 req-26def93f-8777-4ea5-9bdf-cc2957131377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cce20aa-1e76-47d7-8cff-1638642b2665", "name": "network-vif-deleted", "tag": "ae9f7368-b77f-42af-896d-2b6e83211d8a"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:34:35.194695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ce265d13-4531-4aab-8435-70b4b97e4c39 req-26def93f-8777-4ea5-9bdf-cc2957131377 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:35.195116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ce265d13-4531-4aab-8435-70b4b97e4c39 req-26def93f-8777-4ea5-9bdf-cc2957131377 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:35.195566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ce265d13-4531-4aab-8435-70b4b97e4c39 req-26def93f-8777-4ea5-9bdf-cc2957131377 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:35.209793 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ce265d13-4531-4aab-8435-70b4b97e4c39 req-26def93f-8777-4ea5-9bdf-cc2957131377 service nova] Creating event network-vif-deleted:ae9f7368-b77f-42af-896d-2b6e83211d8a for instance 2cce20aa-1e76-47d7-8cff-1638642b2665 on n-h2-858383-15 Oct 24 11:34:35.216403 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ce265d13-4531-4aab-8435-70b4b97e4c39 req-26def93f-8777-4ea5-9bdf-cc2957131377 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042466 Oct 24 11:34:35.217420 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3699/7423] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:34:35.223284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e96f0d73-3fa8-4444-9481-9aad18a046e7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8a06692ac545479b7f1171b2160de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3bff7f1fbcc49209c689a03265c16aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:34:35.232341 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e96f0d73-3fa8-4444-9481-9aad18a046e7 tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 200 len: 1470 microversion: 2.1 time: 0.121161 Oct 24 11:34:35.233053 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3725/7424] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:35 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 1470 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:34:36.256367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-400fa7d6-8578-4f00-b57d-d1a1fe26f7fc tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:34:36.257119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-400fa7d6-8578-4f00-b57d-d1a1fe26f7fc tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] [instance: 2cce20aa-1e76-47d7-8cff-1638642b2665] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:34:36.263849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-400fa7d6-8578-4f00-b57d-d1a1fe26f7fc tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:36.264338 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-400fa7d6-8578-4f00-b57d-d1a1fe26f7fc tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:36.264786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-400fa7d6-8578-4f00-b57d-d1a1fe26f7fc tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:36.265537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-400fa7d6-8578-4f00-b57d-d1a1fe26f7fc tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:34:36.266007 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-400fa7d6-8578-4f00-b57d-d1a1fe26f7fc tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:34:36.266444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-400fa7d6-8578-4f00-b57d-d1a1fe26f7fc tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:34:36.280438 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-400fa7d6-8578-4f00-b57d-d1a1fe26f7fc tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] HTTP exception thrown: Instance 2cce20aa-1e76-47d7-8cff-1638642b2665 could not be found. Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-400fa7d6-8578-4f00-b57d-d1a1fe26f7fc tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Request method failure captured: Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 HTTP/1.1 Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVngtIav6LfWNIkchZuCOwaj46N0v3OT-EEWGA2nze9ZS5DUioZoc67B8T-4S4lh4tIwhbkK7ENT8bCZQQoQHFZhhJZc0k0pl-69r_6G13UicdCrHYttGOqWWcHzKl0EJd-2mccY5Wxtms2CPY-8XYaYDLo27xrbWYHlY-R6ez_FlRpo Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: d3bff7f1fbcc49209c689a03265c16aa Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d3bff7f1fbcc49209c689a03265c16aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d3bff7f1fbcc49209c689a03265c16aa", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: d3bff7f1fbcc49209c689a03265c16aa Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-ServersNegativeTestJSON-719401686 Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-ServersNegativeTestJSON-719401686-project Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: bf8a06692ac545479b7f1171b2160de7 Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-ServersNegativeTestJSON-719401686-project Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 2cce20aa-1e76-47d7-8cff-1638642b2665 could not be found. Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '2cce20aa-1e76-47d7-8cff-1638642b2665'} Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cce20aa-1e76-47d7-8cff-1638642b2665 could not be found. Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cce20aa-1e76-47d7-8cff-1638642b2665 could not be found. Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:34:36.282093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:36.287257 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:34:36.287257 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:34:36.287257 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:34:36.287257 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:34:36.287257 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:34:36.287257 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cce20aa-1e76-47d7-8cff-1638642b2665 could not be found. Oct 24 11:34:36.287257 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:34:36.287257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-400fa7d6-8578-4f00-b57d-d1a1fe26f7fc tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] Returning 404 to user: Instance 2cce20aa-1e76-47d7-8cff-1638642b2665 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:34:36.287257 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-400fa7d6-8578-4f00-b57d-d1a1fe26f7fc tempest-ServersNegativeTestJSON-719401686 tempest-ServersNegativeTestJSON-719401686-project] 10.222.0.50 "GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665" status: 404 len: 111 microversion: 2.1 time: 0.032542 Oct 24 11:34:36.287257 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3700/7425] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:34:36 2022] GET /compute/v2.1/servers/2cce20aa-1e76-47d7-8cff-1638642b2665 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:35:07.690911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:35:07.691815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=26 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:35:07.863131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-48984e11-03a6-450a-b476-c453bfa6e1a5 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Action: 'create', calling method: .version_select at 0x7f04cb624700>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-552661400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5/L2wzjnNEIIBQfC0WK/ihp5MH/pDUKdBfdVZGUyCUhyZ2qtRu04mWd8bd+ivNozSBmN1PsjlcU9FqU/3SNpFGSa2QyMElJSYS0W8pd0eHomYatWQ4XjXHIWIry9i0eA=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:35:07.881098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-48984e11-03a6-450a-b476-c453bfa6e1a5 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Getting quotas for project 4bdd994a2382412dbb2f27dc281a4265. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:35:07.886517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-48984e11-03a6-450a-b476-c453bfa6e1a5 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Getting quotas for user 778ab30c131145b69bbc1c4745480595 and project 4bdd994a2382412dbb2f27dc281a4265. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:35:07.916562 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-48984e11-03a6-450a-b476-c453bfa6e1a5 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.231338 Oct 24 11:35:07.917202 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3726/7426] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:35:07 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:35:07.970986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-20f44ed6-54ee-4529-a04d-28208499a4e1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2124764213", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-552661400", "networks": [{"uuid": "93d088fc-216b-4c0b-b640-fbd32db0b501"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:35:07.993686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:35:07.994405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=10 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:35:08.034720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-20f44ed6-54ee-4529-a04d-28208499a4e1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] validate_networks() for [('93d088fc-216b-4c0b-b640-fbd32db0b501', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:35:08.430571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-20f44ed6-54ee-4529-a04d-28208499a4e1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:35:08.431034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-20f44ed6-54ee-4529-a04d-28208499a4e1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:35:08.431530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-20f44ed6-54ee-4529-a04d-28208499a4e1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:35:08.431960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-20f44ed6-54ee-4529-a04d-28208499a4e1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:35:08.432392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-20f44ed6-54ee-4529-a04d-28208499a4e1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:35:08.441272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20f44ed6-54ee-4529-a04d-28208499a4e1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:08.441775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20f44ed6-54ee-4529-a04d-28208499a4e1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:08.442233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20f44ed6-54ee-4529-a04d-28208499a4e1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:08.442979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20f44ed6-54ee-4529-a04d-28208499a4e1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:08.443475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20f44ed6-54ee-4529-a04d-28208499a4e1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:08.443925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-20f44ed6-54ee-4529-a04d-28208499a4e1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:08.461760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-20f44ed6-54ee-4529-a04d-28208499a4e1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Getting quotas for project 4bdd994a2382412dbb2f27dc281a4265. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:35:08.467950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-20f44ed6-54ee-4529-a04d-28208499a4e1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Getting quotas for user 778ab30c131145b69bbc1c4745480595 and project 4bdd994a2382412dbb2f27dc281a4265. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:35:08.480333 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-20f44ed6-54ee-4529-a04d-28208499a4e1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:35:08.482856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-20f44ed6-54ee-4529-a04d-28208499a4e1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:35:08.535502 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-20f44ed6-54ee-4529-a04d-28208499a4e1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568941 Oct 24 11:35:08.541886 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3701/7427] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:35:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:35:08.548034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-91ec7374-e825-4f7a-9eab-cc5172f37d3d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:08.549904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-91ec7374-e825-4f7a-9eab-cc5172f37d3d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:08.609584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-91ec7374-e825-4f7a-9eab-cc5172f37d3d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:08.617176 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-91ec7374-e825-4f7a-9eab-cc5172f37d3d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569" status: 200 len: 1262 microversion: 2.1 time: 0.072948 Oct 24 11:35:08.617735 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3727/7428] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:08 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569 => generated 1262 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:09.640545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a59972ee-2f5c-4d52-8122-860436802aef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:09.642593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a59972ee-2f5c-4d52-8122-860436802aef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:09.652314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a59972ee-2f5c-4d52-8122-860436802aef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:09.653526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a59972ee-2f5c-4d52-8122-860436802aef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:09.653994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a59972ee-2f5c-4d52-8122-860436802aef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:09.654741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a59972ee-2f5c-4d52-8122-860436802aef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:09.655221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a59972ee-2f5c-4d52-8122-860436802aef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:09.655678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a59972ee-2f5c-4d52-8122-860436802aef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:09.744321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a59972ee-2f5c-4d52-8122-860436802aef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:09.753828 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a59972ee-2f5c-4d52-8122-860436802aef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569" status: 200 len: 1322 microversion: 2.1 time: 0.117143 Oct 24 11:35:09.754368 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3702/7429] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:09 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569 => generated 1322 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:10.780739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-38b1fe5f-0103-4a9d-99f7-33383f9d9306 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:10.781487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-38b1fe5f-0103-4a9d-99f7-33383f9d9306 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:10.790511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38b1fe5f-0103-4a9d-99f7-33383f9d9306 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:10.791300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38b1fe5f-0103-4a9d-99f7-33383f9d9306 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:10.791802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38b1fe5f-0103-4a9d-99f7-33383f9d9306 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:10.792578 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38b1fe5f-0103-4a9d-99f7-33383f9d9306 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:10.793754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38b1fe5f-0103-4a9d-99f7-33383f9d9306 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:10.794586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-38b1fe5f-0103-4a9d-99f7-33383f9d9306 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:10.945056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-38b1fe5f-0103-4a9d-99f7-33383f9d9306 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:10.954848 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-38b1fe5f-0103-4a9d-99f7-33383f9d9306 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569" status: 200 len: 1362 microversion: 2.1 time: 0.179629 Oct 24 11:35:10.957049 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3728/7430] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:10 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:11.104072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b6038dea-889b-4cbb-ba5e-d3375d6aad97 req-7eddcd1f-7fed-472a-b9c0-8bd0929492ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71d8df29-e3fc-428b-bfc8-05ab04b8b569", "tag": "52d8096f-c242-46d3-b3f3-783d8561aff9"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:35:11.117433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b6038dea-889b-4cbb-ba5e-d3375d6aad97 req-7eddcd1f-7fed-472a-b9c0-8bd0929492ae service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:11.117941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b6038dea-889b-4cbb-ba5e-d3375d6aad97 req-7eddcd1f-7fed-472a-b9c0-8bd0929492ae service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:11.118397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b6038dea-889b-4cbb-ba5e-d3375d6aad97 req-7eddcd1f-7fed-472a-b9c0-8bd0929492ae service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:11.135057 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b6038dea-889b-4cbb-ba5e-d3375d6aad97 req-7eddcd1f-7fed-472a-b9c0-8bd0929492ae service nova] Creating event network-changed:52d8096f-c242-46d3-b3f3-783d8561aff9 for instance 71d8df29-e3fc-428b-bfc8-05ab04b8b569 on n-h2-858383-15 Oct 24 11:35:11.140879 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b6038dea-889b-4cbb-ba5e-d3375d6aad97 req-7eddcd1f-7fed-472a-b9c0-8bd0929492ae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042300 Oct 24 11:35:11.142369 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3703/7431] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:35:11.979871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fadc0c37-5cee-4661-8301-4dc5f3c76636 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:11.980492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fadc0c37-5cee-4661-8301-4dc5f3c76636 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:11.987567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fadc0c37-5cee-4661-8301-4dc5f3c76636 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:11.988059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fadc0c37-5cee-4661-8301-4dc5f3c76636 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:11.988499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fadc0c37-5cee-4661-8301-4dc5f3c76636 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:11.989225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fadc0c37-5cee-4661-8301-4dc5f3c76636 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:11.989714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fadc0c37-5cee-4661-8301-4dc5f3c76636 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:11.990168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fadc0c37-5cee-4661-8301-4dc5f3c76636 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:12.133797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fadc0c37-5cee-4661-8301-4dc5f3c76636 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:12.141607 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fadc0c37-5cee-4661-8301-4dc5f3c76636 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569" status: 200 len: 1362 microversion: 2.1 time: 0.165978 Oct 24 11:35:12.142175 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3729/7432] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:11 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:35:13.165545 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fa7b40d8-85b4-4d3e-a266-52158028953f tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:13.166196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fa7b40d8-85b4-4d3e-a266-52158028953f tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:13.172891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa7b40d8-85b4-4d3e-a266-52158028953f tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:13.173402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa7b40d8-85b4-4d3e-a266-52158028953f tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:13.173861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa7b40d8-85b4-4d3e-a266-52158028953f tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:13.174589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa7b40d8-85b4-4d3e-a266-52158028953f tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:13.175288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa7b40d8-85b4-4d3e-a266-52158028953f tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:13.175769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa7b40d8-85b4-4d3e-a266-52158028953f tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:13.320197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fa7b40d8-85b4-4d3e-a266-52158028953f tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:13.329017 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fa7b40d8-85b4-4d3e-a266-52158028953f tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569" status: 200 len: 1362 microversion: 2.1 time: 0.168758 Oct 24 11:35:13.329605 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3704/7433] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:13 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:14.352344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-957f351b-ecc0-4685-bef6-899f618ecfea tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:14.353008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-957f351b-ecc0-4685-bef6-899f618ecfea tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:14.360233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-957f351b-ecc0-4685-bef6-899f618ecfea tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:14.360808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-957f351b-ecc0-4685-bef6-899f618ecfea tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:14.361281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-957f351b-ecc0-4685-bef6-899f618ecfea tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:14.361998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-957f351b-ecc0-4685-bef6-899f618ecfea tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:14.362459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-957f351b-ecc0-4685-bef6-899f618ecfea tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:14.362930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-957f351b-ecc0-4685-bef6-899f618ecfea tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:14.496297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-957f351b-ecc0-4685-bef6-899f618ecfea tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:14.504452 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-957f351b-ecc0-4685-bef6-899f618ecfea tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569" status: 200 len: 1362 microversion: 2.1 time: 0.156110 Oct 24 11:35:14.505229 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3730/7434] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:14 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:15.527629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d7ee1e38-626d-4be3-8c66-9fd7dbe813d9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:15.528327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d7ee1e38-626d-4be3-8c66-9fd7dbe813d9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:15.536324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7ee1e38-626d-4be3-8c66-9fd7dbe813d9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:15.536848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7ee1e38-626d-4be3-8c66-9fd7dbe813d9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:15.537317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7ee1e38-626d-4be3-8c66-9fd7dbe813d9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:15.538040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7ee1e38-626d-4be3-8c66-9fd7dbe813d9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:15.538515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7ee1e38-626d-4be3-8c66-9fd7dbe813d9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:15.538966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d7ee1e38-626d-4be3-8c66-9fd7dbe813d9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:15.672481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d7ee1e38-626d-4be3-8c66-9fd7dbe813d9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:15.680278 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d7ee1e38-626d-4be3-8c66-9fd7dbe813d9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569" status: 200 len: 1362 microversion: 2.1 time: 0.156641 Oct 24 11:35:15.680873 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3705/7435] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:15 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:16.704248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-044ef3a9-3acd-4bd1-9ae4-9c5b0d081182 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:16.704875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-044ef3a9-3acd-4bd1-9ae4-9c5b0d081182 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:16.711669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-044ef3a9-3acd-4bd1-9ae4-9c5b0d081182 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:16.712149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-044ef3a9-3acd-4bd1-9ae4-9c5b0d081182 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:16.712610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-044ef3a9-3acd-4bd1-9ae4-9c5b0d081182 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:16.713332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-044ef3a9-3acd-4bd1-9ae4-9c5b0d081182 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:16.713783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-044ef3a9-3acd-4bd1-9ae4-9c5b0d081182 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:16.714211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-044ef3a9-3acd-4bd1-9ae4-9c5b0d081182 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:16.845029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-044ef3a9-3acd-4bd1-9ae4-9c5b0d081182 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:16.852745 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-044ef3a9-3acd-4bd1-9ae4-9c5b0d081182 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569" status: 200 len: 1362 microversion: 2.1 time: 0.152956 Oct 24 11:35:16.853375 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3731/7436] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:16 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:17.876074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f7002c58-d0d0-4a55-bf2e-8311b8412ce9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:17.876757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f7002c58-d0d0-4a55-bf2e-8311b8412ce9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:17.883660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7002c58-d0d0-4a55-bf2e-8311b8412ce9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:17.884164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7002c58-d0d0-4a55-bf2e-8311b8412ce9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:17.884624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7002c58-d0d0-4a55-bf2e-8311b8412ce9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:17.885361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7002c58-d0d0-4a55-bf2e-8311b8412ce9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:17.885841 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7002c58-d0d0-4a55-bf2e-8311b8412ce9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:17.886286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7002c58-d0d0-4a55-bf2e-8311b8412ce9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:18.017578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f7002c58-d0d0-4a55-bf2e-8311b8412ce9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:18.025292 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f7002c58-d0d0-4a55-bf2e-8311b8412ce9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569" status: 200 len: 1362 microversion: 2.1 time: 0.153382 Oct 24 11:35:18.025888 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3706/7437] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:17 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:18.457499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-d3c02bff-cdd6-47d2-9b7b-c6b607cd88b3 req-c7bf9794-024e-461a-9b22-a9f9e343d93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d8df29-e3fc-428b-bfc8-05ab04b8b569", "name": "network-vif-plugged", "status": "completed", "tag": "52d8096f-c242-46d3-b3f3-783d8561aff9"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:35:18.468412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d3c02bff-cdd6-47d2-9b7b-c6b607cd88b3 req-c7bf9794-024e-461a-9b22-a9f9e343d93d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:18.468964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d3c02bff-cdd6-47d2-9b7b-c6b607cd88b3 req-c7bf9794-024e-461a-9b22-a9f9e343d93d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:18.469396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d3c02bff-cdd6-47d2-9b7b-c6b607cd88b3 req-c7bf9794-024e-461a-9b22-a9f9e343d93d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:18.483729 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-d3c02bff-cdd6-47d2-9b7b-c6b607cd88b3 req-c7bf9794-024e-461a-9b22-a9f9e343d93d service nova] Creating event network-vif-plugged:52d8096f-c242-46d3-b3f3-783d8561aff9 for instance 71d8df29-e3fc-428b-bfc8-05ab04b8b569 on n-h2-858383-15 Oct 24 11:35:18.488987 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-d3c02bff-cdd6-47d2-9b7b-c6b607cd88b3 req-c7bf9794-024e-461a-9b22-a9f9e343d93d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093268 Oct 24 11:35:18.489609 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3732/7438] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:35:19.050481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3bb9cd0b-bd60-4bf3-a5a1-b8081998dab0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:19.051118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3bb9cd0b-bd60-4bf3-a5a1-b8081998dab0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:19.053143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:35:19.053910 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:35:19.061276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bb9cd0b-bd60-4bf3-a5a1-b8081998dab0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:19.061777 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bb9cd0b-bd60-4bf3-a5a1-b8081998dab0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:19.062260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bb9cd0b-bd60-4bf3-a5a1-b8081998dab0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:19.062973 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bb9cd0b-bd60-4bf3-a5a1-b8081998dab0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:19.063445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bb9cd0b-bd60-4bf3-a5a1-b8081998dab0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:19.063890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bb9cd0b-bd60-4bf3-a5a1-b8081998dab0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:19.196653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3bb9cd0b-bd60-4bf3-a5a1-b8081998dab0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:19.204397 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3bb9cd0b-bd60-4bf3-a5a1-b8081998dab0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569" status: 200 len: 1362 microversion: 2.1 time: 0.157912 Oct 24 11:35:19.205002 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3707/7439] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:19 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:20.225101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:35:20.230382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-96463b75-eb5f-4ecb-8e98-5aafc408a5ae tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:20.231112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-96463b75-eb5f-4ecb-8e98-5aafc408a5ae tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:20.237541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96463b75-eb5f-4ecb-8e98-5aafc408a5ae tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:20.238021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96463b75-eb5f-4ecb-8e98-5aafc408a5ae tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:20.238455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96463b75-eb5f-4ecb-8e98-5aafc408a5ae tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:20.239144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96463b75-eb5f-4ecb-8e98-5aafc408a5ae tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:20.239594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96463b75-eb5f-4ecb-8e98-5aafc408a5ae tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:20.240020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-96463b75-eb5f-4ecb-8e98-5aafc408a5ae tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:20.378284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-96463b75-eb5f-4ecb-8e98-5aafc408a5ae tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:20.386552 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-96463b75-eb5f-4ecb-8e98-5aafc408a5ae tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569" status: 200 len: 1554 microversion: 2.1 time: 0.162519 Oct 24 11:35:20.387129 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3733/7440] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:20 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:20.409329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-81fda4b6-9f77-4d05-8b2b-bf4dc8afff9c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:20.409967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-81fda4b6-9f77-4d05-8b2b-bf4dc8afff9c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:20.416812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81fda4b6-9f77-4d05-8b2b-bf4dc8afff9c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:20.417373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81fda4b6-9f77-4d05-8b2b-bf4dc8afff9c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:20.417829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81fda4b6-9f77-4d05-8b2b-bf4dc8afff9c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:20.418543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81fda4b6-9f77-4d05-8b2b-bf4dc8afff9c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:20.419599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81fda4b6-9f77-4d05-8b2b-bf4dc8afff9c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:20.420511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-81fda4b6-9f77-4d05-8b2b-bf4dc8afff9c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:20.555009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-81fda4b6-9f77-4d05-8b2b-bf4dc8afff9c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:20.563375 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-81fda4b6-9f77-4d05-8b2b-bf4dc8afff9c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569" status: 200 len: 1554 microversion: 2.1 time: 0.158309 Oct 24 11:35:20.563944 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3708/7441] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:20 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:22.161471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-87b07c88-ad17-48f4-a239-e35da85cfdef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c61487d1-e12b-4843-bcfa-d9f6eed7712e"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:35:22.163913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-87b07c88-ad17-48f4-a239-e35da85cfdef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:22.171440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87b07c88-ad17-48f4-a239-e35da85cfdef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:22.171918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87b07c88-ad17-48f4-a239-e35da85cfdef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:22.172352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87b07c88-ad17-48f4-a239-e35da85cfdef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:22.173064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87b07c88-ad17-48f4-a239-e35da85cfdef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:22.173514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87b07c88-ad17-48f4-a239-e35da85cfdef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:22.173937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-87b07c88-ad17-48f4-a239-e35da85cfdef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:22.437829 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-87b07c88-ad17-48f4-a239-e35da85cfdef tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "POST /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280367 Oct 24 11:35:22.438505 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3734/7442] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 11:35:22 2022] POST /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:35:33.156543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b07aec73-43f8-4cbe-af8c-5577e6bacf6d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:33.157074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b07aec73-43f8-4cbe-af8c-5577e6bacf6d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:33.160331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:35:33.161157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=40 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:35:33.168038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b07aec73-43f8-4cbe-af8c-5577e6bacf6d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:33.168539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b07aec73-43f8-4cbe-af8c-5577e6bacf6d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:33.169028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b07aec73-43f8-4cbe-af8c-5577e6bacf6d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:33.169735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b07aec73-43f8-4cbe-af8c-5577e6bacf6d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:33.170461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b07aec73-43f8-4cbe-af8c-5577e6bacf6d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:33.171077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b07aec73-43f8-4cbe-af8c-5577e6bacf6d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:33.255002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-b07aec73-43f8-4cbe-af8c-5577e6bacf6d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lazy-loading 'services' on Instance uuid 71d8df29-e3fc-428b-bfc8-05ab04b8b569 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:35:33.327905 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b07aec73-43f8-4cbe-af8c-5577e6bacf6d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "DELETE /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments/c61487d1-e12b-4843-bcfa-d9f6eed7712e" status: 202 len: 0 microversion: 2.1 time: 0.176039 Oct 24 11:35:33.328543 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3709/7443] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 11:35:33 2022] DELETE /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments/c61487d1-e12b-4843-bcfa-d9f6eed7712e => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:35:33.336722 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:35:33.337522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:35:33.342637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fa217c0d-59d1-4aa7-a2d1-8679bfc8a2b3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:33.345091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fa217c0d-59d1-4aa7-a2d1-8679bfc8a2b3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:33.353164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa217c0d-59d1-4aa7-a2d1-8679bfc8a2b3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:33.353652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa217c0d-59d1-4aa7-a2d1-8679bfc8a2b3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:33.354094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa217c0d-59d1-4aa7-a2d1-8679bfc8a2b3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:33.354791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa217c0d-59d1-4aa7-a2d1-8679bfc8a2b3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:33.355240 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa217c0d-59d1-4aa7-a2d1-8679bfc8a2b3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:33.355666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa217c0d-59d1-4aa7-a2d1-8679bfc8a2b3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:33.387522 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fa217c0d-59d1-4aa7-a2d1-8679bfc8a2b3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053230 Oct 24 11:35:33.388268 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3735/7444] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:35:33 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:35:34.401924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c71f6965-8e96-403a-aac2-85da596fa7f6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:34.404384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c71f6965-8e96-403a-aac2-85da596fa7f6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:34.411398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c71f6965-8e96-403a-aac2-85da596fa7f6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:34.411903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c71f6965-8e96-403a-aac2-85da596fa7f6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:34.412362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c71f6965-8e96-403a-aac2-85da596fa7f6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:34.413101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c71f6965-8e96-403a-aac2-85da596fa7f6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:34.413576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c71f6965-8e96-403a-aac2-85da596fa7f6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:34.414021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c71f6965-8e96-403a-aac2-85da596fa7f6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:34.445413 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c71f6965-8e96-403a-aac2-85da596fa7f6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048734 Oct 24 11:35:34.445983 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3710/7445] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:35:34 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:35:35.458434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-49b252f2-3878-43c3-817f-522e0b483875 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:35.460625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-49b252f2-3878-43c3-817f-522e0b483875 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:35.467758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49b252f2-3878-43c3-817f-522e0b483875 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:35.468312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49b252f2-3878-43c3-817f-522e0b483875 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:35.468860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49b252f2-3878-43c3-817f-522e0b483875 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:35.469576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49b252f2-3878-43c3-817f-522e0b483875 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:35.470035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49b252f2-3878-43c3-817f-522e0b483875 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:35.470466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-49b252f2-3878-43c3-817f-522e0b483875 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:35.502521 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-49b252f2-3878-43c3-817f-522e0b483875 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048126 Oct 24 11:35:35.503298 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3736/7446] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:35:35 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:35:36.514243 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cfbfffd1-5247-4d45-bfb8-503d9cea71c7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:36.517519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cfbfffd1-5247-4d45-bfb8-503d9cea71c7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:36.524491 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfbfffd1-5247-4d45-bfb8-503d9cea71c7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:36.525042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfbfffd1-5247-4d45-bfb8-503d9cea71c7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:36.525505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfbfffd1-5247-4d45-bfb8-503d9cea71c7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:36.526228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfbfffd1-5247-4d45-bfb8-503d9cea71c7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:36.526701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfbfffd1-5247-4d45-bfb8-503d9cea71c7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:36.527141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfbfffd1-5247-4d45-bfb8-503d9cea71c7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:36.557838 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cfbfffd1-5247-4d45-bfb8-503d9cea71c7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047688 Oct 24 11:35:36.558405 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3711/7447] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:35:36 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:35:37.571381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9f7d164e-34ef-469c-b891-ad2e9eca56b4 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:37.573600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9f7d164e-34ef-469c-b891-ad2e9eca56b4 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:37.582089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f7d164e-34ef-469c-b891-ad2e9eca56b4 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:37.582588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f7d164e-34ef-469c-b891-ad2e9eca56b4 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:37.583031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f7d164e-34ef-469c-b891-ad2e9eca56b4 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:37.583745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f7d164e-34ef-469c-b891-ad2e9eca56b4 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:37.584205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f7d164e-34ef-469c-b891-ad2e9eca56b4 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:37.584637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9f7d164e-34ef-469c-b891-ad2e9eca56b4 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:37.616516 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9f7d164e-34ef-469c-b891-ad2e9eca56b4 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049002 Oct 24 11:35:37.617043 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3737/7448] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:35:37 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:35:38.629024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5d66b968-b65b-4c56-adb5-cd00e326baff tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:38.631305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5d66b968-b65b-4c56-adb5-cd00e326baff tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:38.638227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d66b968-b65b-4c56-adb5-cd00e326baff tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:38.638679 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d66b968-b65b-4c56-adb5-cd00e326baff tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:38.639112 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d66b968-b65b-4c56-adb5-cd00e326baff tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:38.639820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d66b968-b65b-4c56-adb5-cd00e326baff tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:38.641129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d66b968-b65b-4c56-adb5-cd00e326baff tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:38.641601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d66b968-b65b-4c56-adb5-cd00e326baff tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:38.675199 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5d66b968-b65b-4c56-adb5-cd00e326baff tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050182 Oct 24 11:35:38.675764 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3712/7449] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:35:38 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 11:35:38.686434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d62e554a-bda7-4ead-9a5c-7f1aa669fb04 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:38.687672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d62e554a-bda7-4ead-9a5c-7f1aa669fb04 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:38.694431 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d62e554a-bda7-4ead-9a5c-7f1aa669fb04 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:38.694909 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d62e554a-bda7-4ead-9a5c-7f1aa669fb04 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:38.695344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d62e554a-bda7-4ead-9a5c-7f1aa669fb04 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:38.696028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d62e554a-bda7-4ead-9a5c-7f1aa669fb04 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:38.696472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d62e554a-bda7-4ead-9a5c-7f1aa669fb04 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:38.696992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d62e554a-bda7-4ead-9a5c-7f1aa669fb04 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:38.776147 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-d62e554a-bda7-4ead-9a5c-7f1aa669fb04 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] HTTP exception thrown: Instance 71d8df29-e3fc-428b-bfc8-05ab04b8b569 is not attached to volume c61487d1-e12b-4843-bcfa-d9f6eed7712e Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d62e554a-bda7-4ead-9a5c-7f1aa669fb04 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Request method failure captured: Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments/c61487d1-e12b-4843-bcfa-d9f6eed7712e HTTP/1.1 Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnhmxF1pMntAgXKUvKbPfkR5NJsPhNAfJ9b9WSdT28WlNidz_cObkta2Mo2C5KHrABRsYCPc002p4k9q14JeCzD33rDQ0s6HqkmgiNtd6WSjVZIiffhNSeyFt8F65lVfwNQRyJ4_YPzHPUpM89Pe2eExMrOHuJ4cZK6wlJlRx7BTPVY Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4bdd994a2382412dbb2f27dc281a4265 Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1205050756 Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bdd994a2382412dbb2f27dc281a4265"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bdd994a2382412dbb2f27dc281a4265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4bdd994a2382412dbb2f27dc281a4265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4bdd994a2382412dbb2f27dc281a4265", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestEncryptedCinderVolumes-1205050756 Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4bdd994a2382412dbb2f27dc281a4265 Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1205050756 Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestEncryptedCinderVolumes-1205050756-project Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 778ab30c131145b69bbc1c4745480595 Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestEncryptedCinderVolumes-1205050756-project Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 71d8df29-e3fc-428b-bfc8-05ab04b8b569 is not attached to volume c61487d1-e12b-4843-bcfa-d9f6eed7712e Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'server_id': '71d8df29-e3fc-428b-bfc8-05ab04b8b569', 'id': 'c61487d1-e12b-4843-bcfa-d9f6eed7712e'} Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c61487d1-e12b-4843-bcfa-d9f6eed7712e. Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71d8df29-e3fc-428b-bfc8-05ab04b8b569 is not attached to volume c61487d1-e12b-4843-bcfa-d9f6eed7712e Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:35:38.785231 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:35:38.790347 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:35:38.790347 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:35:38.790347 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71d8df29-e3fc-428b-bfc8-05ab04b8b569 is not attached to volume c61487d1-e12b-4843-bcfa-d9f6eed7712e Oct 24 11:35:38.790347 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:35:38.790347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d62e554a-bda7-4ead-9a5c-7f1aa669fb04 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Returning 404 to user: Instance 71d8df29-e3fc-428b-bfc8-05ab04b8b569 is not attached to volume c61487d1-e12b-4843-bcfa-d9f6eed7712e {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:35:38.790347 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d62e554a-bda7-4ead-9a5c-7f1aa669fb04 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "DELETE /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments/c61487d1-e12b-4843-bcfa-d9f6eed7712e" status: 404 len: 154 microversion: 2.1 time: 0.104334 Oct 24 11:35:38.790347 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3738/7450] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 11:35:38 2022] DELETE /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569/os-volume_attachments/c61487d1-e12b-4843-bcfa-d9f6eed7712e => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:35:42.144641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4437bf3f-2fec-4305-85d8-1c78fdcee9ba tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:42.145216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4437bf3f-2fec-4305-85d8-1c78fdcee9ba tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:42.152235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4437bf3f-2fec-4305-85d8-1c78fdcee9ba tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:42.153110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4437bf3f-2fec-4305-85d8-1c78fdcee9ba tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:42.153684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4437bf3f-2fec-4305-85d8-1c78fdcee9ba tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:42.154974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4437bf3f-2fec-4305-85d8-1c78fdcee9ba tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:42.156173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4437bf3f-2fec-4305-85d8-1c78fdcee9ba tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:42.156956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4437bf3f-2fec-4305-85d8-1c78fdcee9ba tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:42.184152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4437bf3f-2fec-4305-85d8-1c78fdcee9ba tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:35:42.260348 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4437bf3f-2fec-4305-85d8-1c78fdcee9ba tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "DELETE /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569" status: 204 len: 0 microversion: 2.1 time: 0.119985 Oct 24 11:35:42.262310 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3713/7451] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:35:42 2022] DELETE /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:35:42.271085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-47da8f79-ebc3-4e81-a8d0-6a1dad079527 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:42.271643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-47da8f79-ebc3-4e81-a8d0-6a1dad079527 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:42.279565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47da8f79-ebc3-4e81-a8d0-6a1dad079527 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:42.280141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47da8f79-ebc3-4e81-a8d0-6a1dad079527 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:42.281326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47da8f79-ebc3-4e81-a8d0-6a1dad079527 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:42.282202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47da8f79-ebc3-4e81-a8d0-6a1dad079527 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:42.282748 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47da8f79-ebc3-4e81-a8d0-6a1dad079527 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:42.283243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47da8f79-ebc3-4e81-a8d0-6a1dad079527 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:42.421782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-47da8f79-ebc3-4e81-a8d0-6a1dad079527 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:42.429620 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-47da8f79-ebc3-4e81-a8d0-6a1dad079527 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569" status: 200 len: 1560 microversion: 2.1 time: 0.162521 Oct 24 11:35:42.430227 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3739/7452] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:42 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:43.454889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3ad4a4e8-4227-4870-b726-9f7fe56d6af7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:43.455618 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3ad4a4e8-4227-4870-b726-9f7fe56d6af7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:43.462605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ad4a4e8-4227-4870-b726-9f7fe56d6af7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:43.463107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ad4a4e8-4227-4870-b726-9f7fe56d6af7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:43.463567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ad4a4e8-4227-4870-b726-9f7fe56d6af7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:43.464276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ad4a4e8-4227-4870-b726-9f7fe56d6af7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:43.464745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ad4a4e8-4227-4870-b726-9f7fe56d6af7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:43.465213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3ad4a4e8-4227-4870-b726-9f7fe56d6af7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:43.599062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3ad4a4e8-4227-4870-b726-9f7fe56d6af7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:43.606931 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3ad4a4e8-4227-4870-b726-9f7fe56d6af7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569" status: 200 len: 1560 microversion: 2.1 time: 0.157236 Oct 24 11:35:43.607513 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3714/7453] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:43 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:44.456608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-b65bc226-0b59-4728-b7b8-6791a056a6b7 req-b25ee784-62f8-4de6-9493-0a6eca636f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d8df29-e3fc-428b-bfc8-05ab04b8b569", "name": "network-vif-deleted", "tag": "52d8096f-c242-46d3-b3f3-783d8561aff9"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:35:44.467843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b65bc226-0b59-4728-b7b8-6791a056a6b7 req-b25ee784-62f8-4de6-9493-0a6eca636f11 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:44.468586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b65bc226-0b59-4728-b7b8-6791a056a6b7 req-b25ee784-62f8-4de6-9493-0a6eca636f11 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:44.469074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b65bc226-0b59-4728-b7b8-6791a056a6b7 req-b25ee784-62f8-4de6-9493-0a6eca636f11 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:44.481278 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-b65bc226-0b59-4728-b7b8-6791a056a6b7 req-b25ee784-62f8-4de6-9493-0a6eca636f11 service nova] Creating event network-vif-deleted:52d8096f-c242-46d3-b3f3-783d8561aff9 for instance 71d8df29-e3fc-428b-bfc8-05ab04b8b569 on n-h2-858383-15 Oct 24 11:35:44.487832 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-b65bc226-0b59-4728-b7b8-6791a056a6b7 req-b25ee784-62f8-4de6-9493-0a6eca636f11 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034853 Oct 24 11:35:44.488766 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3740/7454] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:35:44.631952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5609dcdd-d76f-4596-b1cf-732fed4f310a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:44.633036 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5609dcdd-d76f-4596-b1cf-732fed4f310a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:44.639935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5609dcdd-d76f-4596-b1cf-732fed4f310a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:44.640441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5609dcdd-d76f-4596-b1cf-732fed4f310a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:44.640923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5609dcdd-d76f-4596-b1cf-732fed4f310a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:44.641678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5609dcdd-d76f-4596-b1cf-732fed4f310a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:44.642148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5609dcdd-d76f-4596-b1cf-732fed4f310a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:44.642592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5609dcdd-d76f-4596-b1cf-732fed4f310a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:44.676927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5609dcdd-d76f-4596-b1cf-732fed4f310a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:44.677371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5609dcdd-d76f-4596-b1cf-732fed4f310a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:44.677656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5609dcdd-d76f-4596-b1cf-732fed4f310a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:44.678143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-5609dcdd-d76f-4596-b1cf-732fed4f310a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lazy-loading 'fault' on Instance uuid 71d8df29-e3fc-428b-bfc8-05ab04b8b569 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:35:44.720114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5609dcdd-d76f-4596-b1cf-732fed4f310a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:44.727854 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5609dcdd-d76f-4596-b1cf-732fed4f310a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569" status: 200 len: 1352 microversion: 2.1 time: 0.100001 Oct 24 11:35:44.728424 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3715/7455] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:44 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:45.752672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2fec4bff-2cf5-4e7b-835d-9c9b69fcdfc9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:45.753404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2fec4bff-2cf5-4e7b-835d-9c9b69fcdfc9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 71d8df29-e3fc-428b-bfc8-05ab04b8b569] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:45.759564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fec4bff-2cf5-4e7b-835d-9c9b69fcdfc9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:45.760045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fec4bff-2cf5-4e7b-835d-9c9b69fcdfc9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:45.760487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fec4bff-2cf5-4e7b-835d-9c9b69fcdfc9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:45.761210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fec4bff-2cf5-4e7b-835d-9c9b69fcdfc9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:45.761665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fec4bff-2cf5-4e7b-835d-9c9b69fcdfc9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:45.762122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fec4bff-2cf5-4e7b-835d-9c9b69fcdfc9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:45.775995 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-2fec4bff-2cf5-4e7b-835d-9c9b69fcdfc9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] HTTP exception thrown: Instance 71d8df29-e3fc-428b-bfc8-05ab04b8b569 could not be found. Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2fec4bff-2cf5-4e7b-835d-9c9b69fcdfc9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Request method failure captured: Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569 HTTP/1.1 Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnhmxF1pMntAgXKUvKbPfkR5NJsPhNAfJ9b9WSdT28WlNidz_cObkta2Mo2C5KHrABRsYCPc002p4k9q14JeCzD33rDQ0s6HqkmgiNtd6WSjVZIiffhNSeyFt8F65lVfwNQRyJ4_YPzHPUpM89Pe2eExMrOHuJ4cZK6wlJlRx7BTPVY Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4bdd994a2382412dbb2f27dc281a4265 Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1205050756 Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bdd994a2382412dbb2f27dc281a4265"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bdd994a2382412dbb2f27dc281a4265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4bdd994a2382412dbb2f27dc281a4265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4bdd994a2382412dbb2f27dc281a4265", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestEncryptedCinderVolumes-1205050756 Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4bdd994a2382412dbb2f27dc281a4265 Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1205050756 Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestEncryptedCinderVolumes-1205050756-project Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 778ab30c131145b69bbc1c4745480595 Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestEncryptedCinderVolumes-1205050756-project Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 71d8df29-e3fc-428b-bfc8-05ab04b8b569 could not be found. Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '71d8df29-e3fc-428b-bfc8-05ab04b8b569'} Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71d8df29-e3fc-428b-bfc8-05ab04b8b569 could not be found. Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71d8df29-e3fc-428b-bfc8-05ab04b8b569 could not be found. Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:35:45.777640 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:35:45.783036 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:35:45.783036 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:35:45.783036 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:35:45.783036 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:35:45.783036 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:35:45.783036 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:35:45.783036 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71d8df29-e3fc-428b-bfc8-05ab04b8b569 could not be found. Oct 24 11:35:45.783036 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:35:45.783036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2fec4bff-2cf5-4e7b-835d-9c9b69fcdfc9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Returning 404 to user: Instance 71d8df29-e3fc-428b-bfc8-05ab04b8b569 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:35:45.783036 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2fec4bff-2cf5-4e7b-835d-9c9b69fcdfc9 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569" status: 404 len: 111 microversion: 2.1 time: 0.031740 Oct 24 11:35:45.783036 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3741/7456] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:45 2022] GET /compute/v2.1/servers/71d8df29-e3fc-428b-bfc8-05ab04b8b569 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:35:45.789012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-453d3b71-3372-46f3-94ee-684bd2d3e4ac tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '.version_select at 0x7f04d0b359d0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:45.808919 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-453d3b71-3372-46f3-94ee-684bd2d3e4ac tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-552661400" status: 202 len: 0 microversion: 2.1 time: 0.023760 Oct 24 11:35:45.809504 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3716/7457] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 11:35:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-552661400 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:35:45.826786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-237983e2-aebc-456c-a336-11d8bc86ed36 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Action: 'create', calling method: .version_select at 0x7f04cb604b80>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-792954944", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtGd+wmJK9PYi2B5I/jEnqtxQNyTWPEX1wMncP0gpjoM+5eJgWrjSEJBoVUaM4Twf8GBCbpznxvZPkDAhf3xPCiJbB+qSp6j6M+Ja+ozHPFb/vMLg9f4qHdNUbDhBcsgw=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:35:45.842655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-237983e2-aebc-456c-a336-11d8bc86ed36 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Getting quotas for project 4bdd994a2382412dbb2f27dc281a4265. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:35:45.849102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-237983e2-aebc-456c-a336-11d8bc86ed36 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Getting quotas for user 778ab30c131145b69bbc1c4745480595 and project 4bdd994a2382412dbb2f27dc281a4265. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:35:45.871948 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-237983e2-aebc-456c-a336-11d8bc86ed36 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.049047 Oct 24 11:35:45.872559 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3742/7458] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:35:45 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:35:45.925125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e7803112-540e-4c13-ba36-7d25cbf11fa3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1986155633", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-792954944", "networks": [{"uuid": "93d088fc-216b-4c0b-b640-fbd32db0b501"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:35:45.978498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-e7803112-540e-4c13-ba36-7d25cbf11fa3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] validate_networks() for [('93d088fc-216b-4c0b-b640-fbd32db0b501', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:35:46.444025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e7803112-540e-4c13-ba36-7d25cbf11fa3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:35:46.444471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e7803112-540e-4c13-ba36-7d25cbf11fa3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:35:46.445004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e7803112-540e-4c13-ba36-7d25cbf11fa3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:35:46.445434 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e7803112-540e-4c13-ba36-7d25cbf11fa3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:35:46.445864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-e7803112-540e-4c13-ba36-7d25cbf11fa3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:35:46.455364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7803112-540e-4c13-ba36-7d25cbf11fa3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:46.455866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7803112-540e-4c13-ba36-7d25cbf11fa3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:46.456325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7803112-540e-4c13-ba36-7d25cbf11fa3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:46.457105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7803112-540e-4c13-ba36-7d25cbf11fa3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:46.457580 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7803112-540e-4c13-ba36-7d25cbf11fa3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:46.458024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e7803112-540e-4c13-ba36-7d25cbf11fa3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:46.475851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-e7803112-540e-4c13-ba36-7d25cbf11fa3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Getting quotas for project 4bdd994a2382412dbb2f27dc281a4265. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:35:46.481418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-e7803112-540e-4c13-ba36-7d25cbf11fa3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Getting quotas for user 778ab30c131145b69bbc1c4745480595 and project 4bdd994a2382412dbb2f27dc281a4265. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:35:46.494241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e7803112-540e-4c13-ba36-7d25cbf11fa3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:35:46.496609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e7803112-540e-4c13-ba36-7d25cbf11fa3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:35:46.544131 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e7803112-540e-4c13-ba36-7d25cbf11fa3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623274 Oct 24 11:35:46.544793 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3717/7459] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:35:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:35:46.557222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-98d8a802-0aa7-482c-a399-0e32c878c3fa tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:46.557845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-98d8a802-0aa7-482c-a399-0e32c878c3fa tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:46.615971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-98d8a802-0aa7-482c-a399-0e32c878c3fa tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:46.624104 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-98d8a802-0aa7-482c-a399-0e32c878c3fa tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a" status: 200 len: 1262 microversion: 2.1 time: 0.071115 Oct 24 11:35:46.625490 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3743/7460] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:46 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a => generated 1262 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:47.649187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1ba02409-e43a-4461-9483-e8e117825c59 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:47.649990 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1ba02409-e43a-4461-9483-e8e117825c59 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:47.659208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ba02409-e43a-4461-9483-e8e117825c59 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:47.660348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ba02409-e43a-4461-9483-e8e117825c59 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:47.661092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ba02409-e43a-4461-9483-e8e117825c59 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:47.662011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ba02409-e43a-4461-9483-e8e117825c59 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:47.662488 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ba02409-e43a-4461-9483-e8e117825c59 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:47.662939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ba02409-e43a-4461-9483-e8e117825c59 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:47.736279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1ba02409-e43a-4461-9483-e8e117825c59 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:47.746170 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1ba02409-e43a-4461-9483-e8e117825c59 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a" status: 200 len: 1322 microversion: 2.1 time: 0.101858 Oct 24 11:35:47.746751 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3718/7461] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:47 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a => generated 1322 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:48.772268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7313f76b-3463-4bab-9d00-3b867b631e88 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:48.773049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7313f76b-3463-4bab-9d00-3b867b631e88 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:48.779771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7313f76b-3463-4bab-9d00-3b867b631e88 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:48.780259 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7313f76b-3463-4bab-9d00-3b867b631e88 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:48.781374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7313f76b-3463-4bab-9d00-3b867b631e88 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:48.782091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7313f76b-3463-4bab-9d00-3b867b631e88 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:48.782547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7313f76b-3463-4bab-9d00-3b867b631e88 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:48.782977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7313f76b-3463-4bab-9d00-3b867b631e88 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:48.918460 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7313f76b-3463-4bab-9d00-3b867b631e88 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:48.926981 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7313f76b-3463-4bab-9d00-3b867b631e88 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a" status: 200 len: 1362 microversion: 2.1 time: 0.158673 Oct 24 11:35:48.927572 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3744/7462] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:48 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:49.054182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-1b61df1c-b5a2-4a43-9ace-51b143b8b42f req-d2332fe7-5dc7-4485-982a-198333fadc71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "008cfbb7-08fe-443e-89e1-f5ac00be681a", "tag": "4ed1cdf0-f2df-4d1f-a109-8df33f17fc08"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:35:49.066070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1b61df1c-b5a2-4a43-9ace-51b143b8b42f req-d2332fe7-5dc7-4485-982a-198333fadc71 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:49.066594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1b61df1c-b5a2-4a43-9ace-51b143b8b42f req-d2332fe7-5dc7-4485-982a-198333fadc71 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:49.067042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-1b61df1c-b5a2-4a43-9ace-51b143b8b42f req-d2332fe7-5dc7-4485-982a-198333fadc71 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:49.080614 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-1b61df1c-b5a2-4a43-9ace-51b143b8b42f req-d2332fe7-5dc7-4485-982a-198333fadc71 service nova] Creating event network-changed:4ed1cdf0-f2df-4d1f-a109-8df33f17fc08 for instance 008cfbb7-08fe-443e-89e1-f5ac00be681a on n-h2-858383-15 Oct 24 11:35:49.086367 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-1b61df1c-b5a2-4a43-9ace-51b143b8b42f req-d2332fe7-5dc7-4485-982a-198333fadc71 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035777 Oct 24 11:35:49.086984 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3719/7463] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:35:49.955845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cb3359d5-f3f7-4c5f-9d7d-88942861526b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:49.969173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cb3359d5-f3f7-4c5f-9d7d-88942861526b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:49.969173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb3359d5-f3f7-4c5f-9d7d-88942861526b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:49.970807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb3359d5-f3f7-4c5f-9d7d-88942861526b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:49.970807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb3359d5-f3f7-4c5f-9d7d-88942861526b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:49.970807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb3359d5-f3f7-4c5f-9d7d-88942861526b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:49.971468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb3359d5-f3f7-4c5f-9d7d-88942861526b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:49.971626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb3359d5-f3f7-4c5f-9d7d-88942861526b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:50.124743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cb3359d5-f3f7-4c5f-9d7d-88942861526b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:50.133006 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cb3359d5-f3f7-4c5f-9d7d-88942861526b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a" status: 200 len: 1362 microversion: 2.1 time: 0.184505 Oct 24 11:35:50.133585 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3745/7464] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:49 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:51.158436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-12e85b5f-7f8a-4b86-9851-5000ddcdaf80 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:51.159154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-12e85b5f-7f8a-4b86-9851-5000ddcdaf80 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:51.165955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12e85b5f-7f8a-4b86-9851-5000ddcdaf80 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:51.166443 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12e85b5f-7f8a-4b86-9851-5000ddcdaf80 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:51.166895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12e85b5f-7f8a-4b86-9851-5000ddcdaf80 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:51.167604 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12e85b5f-7f8a-4b86-9851-5000ddcdaf80 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:51.168075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12e85b5f-7f8a-4b86-9851-5000ddcdaf80 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:51.168513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-12e85b5f-7f8a-4b86-9851-5000ddcdaf80 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:51.296723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-12e85b5f-7f8a-4b86-9851-5000ddcdaf80 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:51.304805 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-12e85b5f-7f8a-4b86-9851-5000ddcdaf80 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a" status: 200 len: 1362 microversion: 2.1 time: 0.152119 Oct 24 11:35:51.305431 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3720/7465] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:51 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:52.327992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-71464b66-f164-4f87-a8a0-e8db26ec8ce1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:52.328649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-71464b66-f164-4f87-a8a0-e8db26ec8ce1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:52.335591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71464b66-f164-4f87-a8a0-e8db26ec8ce1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:52.336069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71464b66-f164-4f87-a8a0-e8db26ec8ce1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:52.336507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71464b66-f164-4f87-a8a0-e8db26ec8ce1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:52.337237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71464b66-f164-4f87-a8a0-e8db26ec8ce1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:52.337693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71464b66-f164-4f87-a8a0-e8db26ec8ce1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:52.338123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71464b66-f164-4f87-a8a0-e8db26ec8ce1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:52.475957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-71464b66-f164-4f87-a8a0-e8db26ec8ce1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:52.484198 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-71464b66-f164-4f87-a8a0-e8db26ec8ce1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a" status: 200 len: 1362 microversion: 2.1 time: 0.159815 Oct 24 11:35:52.484874 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3746/7466] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:52 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:53.507509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9d7ef67c-258c-4734-8473-3f79269ef9e8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:53.508199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9d7ef67c-258c-4734-8473-3f79269ef9e8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:53.515449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d7ef67c-258c-4734-8473-3f79269ef9e8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:53.515960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d7ef67c-258c-4734-8473-3f79269ef9e8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:53.516421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d7ef67c-258c-4734-8473-3f79269ef9e8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:53.517171 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d7ef67c-258c-4734-8473-3f79269ef9e8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:53.517648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d7ef67c-258c-4734-8473-3f79269ef9e8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:53.518101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9d7ef67c-258c-4734-8473-3f79269ef9e8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:53.651065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9d7ef67c-258c-4734-8473-3f79269ef9e8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:53.660001 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9d7ef67c-258c-4734-8473-3f79269ef9e8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a" status: 200 len: 1362 microversion: 2.1 time: 0.156267 Oct 24 11:35:53.660574 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3721/7467] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:53 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:54.487368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-5fa933d8-776b-4573-a2af-5cbc82ff6656 req-2f2e934b-643c-46b0-b9ce-9d81b6a81917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008cfbb7-08fe-443e-89e1-f5ac00be681a", "name": "network-vif-plugged", "status": "completed", "tag": "4ed1cdf0-f2df-4d1f-a109-8df33f17fc08"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:35:54.497635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5fa933d8-776b-4573-a2af-5cbc82ff6656 req-2f2e934b-643c-46b0-b9ce-9d81b6a81917 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:54.498141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5fa933d8-776b-4573-a2af-5cbc82ff6656 req-2f2e934b-643c-46b0-b9ce-9d81b6a81917 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:54.498566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5fa933d8-776b-4573-a2af-5cbc82ff6656 req-2f2e934b-643c-46b0-b9ce-9d81b6a81917 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:54.510029 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-5fa933d8-776b-4573-a2af-5cbc82ff6656 req-2f2e934b-643c-46b0-b9ce-9d81b6a81917 service nova] Creating event network-vif-plugged:4ed1cdf0-f2df-4d1f-a109-8df33f17fc08 for instance 008cfbb7-08fe-443e-89e1-f5ac00be681a on n-h2-858383-15 Oct 24 11:35:54.515037 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-5fa933d8-776b-4573-a2af-5cbc82ff6656 req-2f2e934b-643c-46b0-b9ce-9d81b6a81917 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032403 Oct 24 11:35:54.515640 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3747/7468] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:35:54.683753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2f755571-e7bf-447d-9abc-5e374fa48bde tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:54.685124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2f755571-e7bf-447d-9abc-5e374fa48bde tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:54.692032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f755571-e7bf-447d-9abc-5e374fa48bde tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:54.692539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f755571-e7bf-447d-9abc-5e374fa48bde tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:54.693019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f755571-e7bf-447d-9abc-5e374fa48bde tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:54.693732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f755571-e7bf-447d-9abc-5e374fa48bde tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:54.694204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f755571-e7bf-447d-9abc-5e374fa48bde tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:54.694696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2f755571-e7bf-447d-9abc-5e374fa48bde tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:54.828942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2f755571-e7bf-447d-9abc-5e374fa48bde tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:54.836585 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2f755571-e7bf-447d-9abc-5e374fa48bde tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a" status: 200 len: 1362 microversion: 2.1 time: 0.156868 Oct 24 11:35:54.837190 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3722/7469] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:54 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:55.862262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-55c02690-99d1-4862-bda3-36ca8c2febd7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:55.863024 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-55c02690-99d1-4862-bda3-36ca8c2febd7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:55.869269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55c02690-99d1-4862-bda3-36ca8c2febd7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:55.869752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55c02690-99d1-4862-bda3-36ca8c2febd7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:55.870192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55c02690-99d1-4862-bda3-36ca8c2febd7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:55.870887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55c02690-99d1-4862-bda3-36ca8c2febd7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:55.871342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55c02690-99d1-4862-bda3-36ca8c2febd7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:55.871774 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-55c02690-99d1-4862-bda3-36ca8c2febd7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:56.003608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-55c02690-99d1-4862-bda3-36ca8c2febd7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:56.011390 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-55c02690-99d1-4862-bda3-36ca8c2febd7 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a" status: 200 len: 1554 microversion: 2.1 time: 0.154869 Oct 24 11:35:56.011970 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3748/7470] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:55 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:56.035266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a74fc33-2ad5-4a6e-9c62-eb8268f2b6fe tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:35:56.035896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0a74fc33-2ad5-4a6e-9c62-eb8268f2b6fe tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:56.043448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a74fc33-2ad5-4a6e-9c62-eb8268f2b6fe tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:56.043943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a74fc33-2ad5-4a6e-9c62-eb8268f2b6fe tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:56.044425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a74fc33-2ad5-4a6e-9c62-eb8268f2b6fe tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:56.045163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a74fc33-2ad5-4a6e-9c62-eb8268f2b6fe tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:56.045632 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a74fc33-2ad5-4a6e-9c62-eb8268f2b6fe tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:56.046644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a74fc33-2ad5-4a6e-9c62-eb8268f2b6fe tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:56.179988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0a74fc33-2ad5-4a6e-9c62-eb8268f2b6fe tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:35:56.188036 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0a74fc33-2ad5-4a6e-9c62-eb8268f2b6fe tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a" status: 200 len: 1554 microversion: 2.1 time: 0.157604 Oct 24 11:35:56.188615 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3723/7471] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:35:56 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:35:57.690983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dffa0782-b6f1-47b2-bc1d-330100ff0f71 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f34e66f9-f0f6-4c0f-b985-2c81a131eeb4"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:35:57.693400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dffa0782-b6f1-47b2-bc1d-330100ff0f71 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:35:57.695366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:35:57.701543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dffa0782-b6f1-47b2-bc1d-330100ff0f71 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:57.702027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dffa0782-b6f1-47b2-bc1d-330100ff0f71 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:57.703074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dffa0782-b6f1-47b2-bc1d-330100ff0f71 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:57.703769 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dffa0782-b6f1-47b2-bc1d-330100ff0f71 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:35:57.704230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dffa0782-b6f1-47b2-bc1d-330100ff0f71 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:35:57.704659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dffa0782-b6f1-47b2-bc1d-330100ff0f71 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:35:57.969860 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dffa0782-b6f1-47b2-bc1d-330100ff0f71 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "POST /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283332 Oct 24 11:35:57.970574 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3749/7472] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 11:35:57 2022] POST /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:36:08.690292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5beffafe-d789-49d4-8d34-97af54ae9866 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:08.690819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5beffafe-d789-49d4-8d34-97af54ae9866 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:08.692784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:36:08.693633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:36:08.694810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:36:08.695456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:36:08.702343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5beffafe-d789-49d4-8d34-97af54ae9866 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:08.703645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5beffafe-d789-49d4-8d34-97af54ae9866 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:08.704106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5beffafe-d789-49d4-8d34-97af54ae9866 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:08.704822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5beffafe-d789-49d4-8d34-97af54ae9866 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:08.705316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5beffafe-d789-49d4-8d34-97af54ae9866 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:08.705758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5beffafe-d789-49d4-8d34-97af54ae9866 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:08.790222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-5beffafe-d789-49d4-8d34-97af54ae9866 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lazy-loading 'services' on Instance uuid 008cfbb7-08fe-443e-89e1-f5ac00be681a {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:36:08.864134 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5beffafe-d789-49d4-8d34-97af54ae9866 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "DELETE /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments/f34e66f9-f0f6-4c0f-b985-2c81a131eeb4" status: 202 len: 0 microversion: 2.1 time: 0.178734 Oct 24 11:36:08.864749 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3724/7473] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 11:36:08 2022] DELETE /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments/f34e66f9-f0f6-4c0f-b985-2c81a131eeb4 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:36:08.871575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:36:08.872516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:36:08.877754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-05db6708-0287-40cc-a87a-6f48a1a35bb0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:08.880125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-05db6708-0287-40cc-a87a-6f48a1a35bb0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:08.889606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05db6708-0287-40cc-a87a-6f48a1a35bb0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:08.890203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05db6708-0287-40cc-a87a-6f48a1a35bb0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:08.890750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05db6708-0287-40cc-a87a-6f48a1a35bb0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:08.891587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05db6708-0287-40cc-a87a-6f48a1a35bb0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:08.892097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05db6708-0287-40cc-a87a-6f48a1a35bb0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:08.892580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-05db6708-0287-40cc-a87a-6f48a1a35bb0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:08.927485 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-05db6708-0287-40cc-a87a-6f48a1a35bb0 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057898 Oct 24 11:36:08.928068 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3750/7474] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:36:08 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:36:09.941857 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-166eeb6e-72f6-4f7d-9222-58287d487679 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:09.944450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-166eeb6e-72f6-4f7d-9222-58287d487679 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:09.950865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-166eeb6e-72f6-4f7d-9222-58287d487679 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:09.951373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-166eeb6e-72f6-4f7d-9222-58287d487679 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:09.951830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-166eeb6e-72f6-4f7d-9222-58287d487679 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:09.952612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-166eeb6e-72f6-4f7d-9222-58287d487679 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:09.953159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-166eeb6e-72f6-4f7d-9222-58287d487679 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:09.953731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-166eeb6e-72f6-4f7d-9222-58287d487679 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:09.986158 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-166eeb6e-72f6-4f7d-9222-58287d487679 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050051 Oct 24 11:36:09.986746 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3725/7475] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:36:09 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:36:10.998732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d564e875-c6c9-4679-b3f1-0c73202b5011 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:11.001292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d564e875-c6c9-4679-b3f1-0c73202b5011 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:11.008372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d564e875-c6c9-4679-b3f1-0c73202b5011 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:11.008881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d564e875-c6c9-4679-b3f1-0c73202b5011 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:11.009322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d564e875-c6c9-4679-b3f1-0c73202b5011 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:11.010019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d564e875-c6c9-4679-b3f1-0c73202b5011 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:11.010470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d564e875-c6c9-4679-b3f1-0c73202b5011 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:11.010895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d564e875-c6c9-4679-b3f1-0c73202b5011 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:11.043349 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d564e875-c6c9-4679-b3f1-0c73202b5011 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048510 Oct 24 11:36:11.043831 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3751/7476] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:36:10 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:36:12.057053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5d7cc216-2cf0-4ba4-8677-2fb31e5c5999 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:12.059259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5d7cc216-2cf0-4ba4-8677-2fb31e5c5999 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:12.066184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d7cc216-2cf0-4ba4-8677-2fb31e5c5999 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:12.066686 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d7cc216-2cf0-4ba4-8677-2fb31e5c5999 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:12.067134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d7cc216-2cf0-4ba4-8677-2fb31e5c5999 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:12.067844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d7cc216-2cf0-4ba4-8677-2fb31e5c5999 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:12.068311 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d7cc216-2cf0-4ba4-8677-2fb31e5c5999 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:12.068750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5d7cc216-2cf0-4ba4-8677-2fb31e5c5999 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:12.099398 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5d7cc216-2cf0-4ba4-8677-2fb31e5c5999 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046486 Oct 24 11:36:12.100295 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3726/7477] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:36:12 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:36:13.112678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8d74de3a-9b99-4d44-9e26-bf61613fac97 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:13.115003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8d74de3a-9b99-4d44-9e26-bf61613fac97 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:13.122321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d74de3a-9b99-4d44-9e26-bf61613fac97 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:13.122884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d74de3a-9b99-4d44-9e26-bf61613fac97 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:13.123263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d74de3a-9b99-4d44-9e26-bf61613fac97 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:13.123984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d74de3a-9b99-4d44-9e26-bf61613fac97 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:13.124577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d74de3a-9b99-4d44-9e26-bf61613fac97 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:13.125815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d74de3a-9b99-4d44-9e26-bf61613fac97 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:13.160688 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8d74de3a-9b99-4d44-9e26-bf61613fac97 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052949 Oct 24 11:36:13.161291 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3752/7478] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:36:13 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:36:14.173367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1b876b59-0a2b-4460-b9b9-a7598ae36da6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:14.175612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1b876b59-0a2b-4460-b9b9-a7598ae36da6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:14.182738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b876b59-0a2b-4460-b9b9-a7598ae36da6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:14.183247 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b876b59-0a2b-4460-b9b9-a7598ae36da6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:14.183709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b876b59-0a2b-4460-b9b9-a7598ae36da6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:14.184425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b876b59-0a2b-4460-b9b9-a7598ae36da6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:14.184964 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b876b59-0a2b-4460-b9b9-a7598ae36da6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:14.185419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b876b59-0a2b-4460-b9b9-a7598ae36da6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:14.216295 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1b876b59-0a2b-4460-b9b9-a7598ae36da6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047135 Oct 24 11:36:14.216889 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3727/7479] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:36:14 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 11:36:14.227820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dcb742b1-a5ab-4eeb-9d29-2a58087b7828 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:14.228310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dcb742b1-a5ab-4eeb-9d29-2a58087b7828 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:14.235514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dcb742b1-a5ab-4eeb-9d29-2a58087b7828 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:14.235997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dcb742b1-a5ab-4eeb-9d29-2a58087b7828 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:14.236443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dcb742b1-a5ab-4eeb-9d29-2a58087b7828 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:14.237167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dcb742b1-a5ab-4eeb-9d29-2a58087b7828 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:14.237625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dcb742b1-a5ab-4eeb-9d29-2a58087b7828 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:14.238057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dcb742b1-a5ab-4eeb-9d29-2a58087b7828 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:14.314439 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-dcb742b1-a5ab-4eeb-9d29-2a58087b7828 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] HTTP exception thrown: Instance 008cfbb7-08fe-443e-89e1-f5ac00be681a is not attached to volume f34e66f9-f0f6-4c0f-b985-2c81a131eeb4 Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dcb742b1-a5ab-4eeb-9d29-2a58087b7828 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Request method failure captured: Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments/f34e66f9-f0f6-4c0f-b985-2c81a131eeb4 HTTP/1.1 Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnhmxF1pMntAgXKUvKbPfkR5NJsPhNAfJ9b9WSdT28WlNidz_cObkta2Mo2C5KHrABRsYCPc002p4k9q14JeCzD33rDQ0s6HqkmgiNtd6WSjVZIiffhNSeyFt8F65lVfwNQRyJ4_YPzHPUpM89Pe2eExMrOHuJ4cZK6wlJlRx7BTPVY Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4bdd994a2382412dbb2f27dc281a4265 Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1205050756 Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bdd994a2382412dbb2f27dc281a4265"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bdd994a2382412dbb2f27dc281a4265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4bdd994a2382412dbb2f27dc281a4265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4bdd994a2382412dbb2f27dc281a4265", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestEncryptedCinderVolumes-1205050756 Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4bdd994a2382412dbb2f27dc281a4265 Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1205050756 Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestEncryptedCinderVolumes-1205050756-project Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 778ab30c131145b69bbc1c4745480595 Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestEncryptedCinderVolumes-1205050756-project Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 008cfbb7-08fe-443e-89e1-f5ac00be681a is not attached to volume f34e66f9-f0f6-4c0f-b985-2c81a131eeb4 Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'server_id': '008cfbb7-08fe-443e-89e1-f5ac00be681a', 'id': 'f34e66f9-f0f6-4c0f-b985-2c81a131eeb4'} Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f34e66f9-f0f6-4c0f-b985-2c81a131eeb4. Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 008cfbb7-08fe-443e-89e1-f5ac00be681a is not attached to volume f34e66f9-f0f6-4c0f-b985-2c81a131eeb4 Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:36:14.316056 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:36:14.320897 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:36:14.320897 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:36:14.320897 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 008cfbb7-08fe-443e-89e1-f5ac00be681a is not attached to volume f34e66f9-f0f6-4c0f-b985-2c81a131eeb4 Oct 24 11:36:14.320897 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:36:14.320897 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dcb742b1-a5ab-4eeb-9d29-2a58087b7828 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Returning 404 to user: Instance 008cfbb7-08fe-443e-89e1-f5ac00be681a is not attached to volume f34e66f9-f0f6-4c0f-b985-2c81a131eeb4 {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:36:14.320897 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dcb742b1-a5ab-4eeb-9d29-2a58087b7828 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "DELETE /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments/f34e66f9-f0f6-4c0f-b985-2c81a131eeb4" status: 404 len: 154 microversion: 2.1 time: 0.093756 Oct 24 11:36:14.320897 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3753/7480] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 11:36:14 2022] DELETE /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a/os-volume_attachments/f34e66f9-f0f6-4c0f-b985-2c81a131eeb4 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:36:17.670515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-efef86fc-d737-4fcd-a4a3-e8ebe40d2990 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:17.671063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-efef86fc-d737-4fcd-a4a3-e8ebe40d2990 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:17.679178 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efef86fc-d737-4fcd-a4a3-e8ebe40d2990 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:17.679733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efef86fc-d737-4fcd-a4a3-e8ebe40d2990 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:17.680202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efef86fc-d737-4fcd-a4a3-e8ebe40d2990 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:17.680936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efef86fc-d737-4fcd-a4a3-e8ebe40d2990 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:17.681414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efef86fc-d737-4fcd-a4a3-e8ebe40d2990 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:17.681861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efef86fc-d737-4fcd-a4a3-e8ebe40d2990 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:17.707388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-efef86fc-d737-4fcd-a4a3-e8ebe40d2990 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:36:17.784117 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-efef86fc-d737-4fcd-a4a3-e8ebe40d2990 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "DELETE /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a" status: 204 len: 0 microversion: 2.1 time: 0.117416 Oct 24 11:36:17.784718 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3728/7481] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:36:17 2022] DELETE /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:36:17.793311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ccde10bb-714e-4f5b-8067-b594a9d8900a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:17.793930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ccde10bb-714e-4f5b-8067-b594a9d8900a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:17.801456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ccde10bb-714e-4f5b-8067-b594a9d8900a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:17.801882 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ccde10bb-714e-4f5b-8067-b594a9d8900a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:17.802327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ccde10bb-714e-4f5b-8067-b594a9d8900a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:17.803029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ccde10bb-714e-4f5b-8067-b594a9d8900a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:17.803517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ccde10bb-714e-4f5b-8067-b594a9d8900a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:17.803949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ccde10bb-714e-4f5b-8067-b594a9d8900a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:17.935472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ccde10bb-714e-4f5b-8067-b594a9d8900a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:36:17.944150 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ccde10bb-714e-4f5b-8067-b594a9d8900a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a" status: 200 len: 1560 microversion: 2.1 time: 0.154679 Oct 24 11:36:17.944707 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3754/7482] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:17 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:36:18.971019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be62cdd6-0ac0-44dc-930c-ab1753dce72b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:18.971805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-be62cdd6-0ac0-44dc-930c-ab1753dce72b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:18.979426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be62cdd6-0ac0-44dc-930c-ab1753dce72b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:18.979926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be62cdd6-0ac0-44dc-930c-ab1753dce72b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:18.980378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be62cdd6-0ac0-44dc-930c-ab1753dce72b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:18.981116 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be62cdd6-0ac0-44dc-930c-ab1753dce72b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:18.981586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be62cdd6-0ac0-44dc-930c-ab1753dce72b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:18.982026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be62cdd6-0ac0-44dc-930c-ab1753dce72b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:19.112051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-be62cdd6-0ac0-44dc-930c-ab1753dce72b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:36:19.120051 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-be62cdd6-0ac0-44dc-930c-ab1753dce72b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a" status: 200 len: 1560 microversion: 2.1 time: 0.154207 Oct 24 11:36:19.120995 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3729/7483] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:18 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:36:20.046627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-b9861c7a-ea06-439d-a607-13cd3ddaddd8 req-6e5bea10-f8f7-436c-8301-e2a4d9dd15eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008cfbb7-08fe-443e-89e1-f5ac00be681a", "name": "network-vif-deleted", "tag": "4ed1cdf0-f2df-4d1f-a109-8df33f17fc08"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:36:20.060008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b9861c7a-ea06-439d-a607-13cd3ddaddd8 req-6e5bea10-f8f7-436c-8301-e2a4d9dd15eb service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:20.060496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b9861c7a-ea06-439d-a607-13cd3ddaddd8 req-6e5bea10-f8f7-436c-8301-e2a4d9dd15eb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:20.060968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-b9861c7a-ea06-439d-a607-13cd3ddaddd8 req-6e5bea10-f8f7-436c-8301-e2a4d9dd15eb service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:20.073960 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-b9861c7a-ea06-439d-a607-13cd3ddaddd8 req-6e5bea10-f8f7-436c-8301-e2a4d9dd15eb service nova] Creating event network-vif-deleted:4ed1cdf0-f2df-4d1f-a109-8df33f17fc08 for instance 008cfbb7-08fe-443e-89e1-f5ac00be681a on n-h2-858383-15 Oct 24 11:36:20.080259 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-b9861c7a-ea06-439d-a607-13cd3ddaddd8 req-6e5bea10-f8f7-436c-8301-e2a4d9dd15eb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037497 Oct 24 11:36:20.080902 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3755/7484] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:36:20.145088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3477a519-0a9b-4819-9d03-347ec8b2875d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:20.145880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3477a519-0a9b-4819-9d03-347ec8b2875d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:20.153772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3477a519-0a9b-4819-9d03-347ec8b2875d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:20.154809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3477a519-0a9b-4819-9d03-347ec8b2875d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:20.155403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3477a519-0a9b-4819-9d03-347ec8b2875d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:20.156271 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3477a519-0a9b-4819-9d03-347ec8b2875d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:20.156756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3477a519-0a9b-4819-9d03-347ec8b2875d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:20.157288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3477a519-0a9b-4819-9d03-347ec8b2875d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:20.197998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3477a519-0a9b-4819-9d03-347ec8b2875d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:20.198589 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3477a519-0a9b-4819-9d03-347ec8b2875d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:20.199084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3477a519-0a9b-4819-9d03-347ec8b2875d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:20.199562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-3477a519-0a9b-4819-9d03-347ec8b2875d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lazy-loading 'fault' on Instance uuid 008cfbb7-08fe-443e-89e1-f5ac00be681a {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:36:20.252252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3477a519-0a9b-4819-9d03-347ec8b2875d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:36:20.260644 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3477a519-0a9b-4819-9d03-347ec8b2875d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a" status: 200 len: 1352 microversion: 2.1 time: 0.120341 Oct 24 11:36:20.260943 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3730/7485] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:20 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a => generated 1352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:36:21.286401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fa041349-f152-4f11-bfbf-24875dd86b7d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:21.287111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fa041349-f152-4f11-bfbf-24875dd86b7d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 008cfbb7-08fe-443e-89e1-f5ac00be681a] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:21.293388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa041349-f152-4f11-bfbf-24875dd86b7d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:21.293868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa041349-f152-4f11-bfbf-24875dd86b7d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:21.294305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa041349-f152-4f11-bfbf-24875dd86b7d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:21.294995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa041349-f152-4f11-bfbf-24875dd86b7d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:21.295452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa041349-f152-4f11-bfbf-24875dd86b7d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:21.295881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fa041349-f152-4f11-bfbf-24875dd86b7d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:21.309236 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-fa041349-f152-4f11-bfbf-24875dd86b7d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] HTTP exception thrown: Instance 008cfbb7-08fe-443e-89e1-f5ac00be681a could not be found. Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fa041349-f152-4f11-bfbf-24875dd86b7d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Request method failure captured: Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a HTTP/1.1 Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnhmxF1pMntAgXKUvKbPfkR5NJsPhNAfJ9b9WSdT28WlNidz_cObkta2Mo2C5KHrABRsYCPc002p4k9q14JeCzD33rDQ0s6HqkmgiNtd6WSjVZIiffhNSeyFt8F65lVfwNQRyJ4_YPzHPUpM89Pe2eExMrOHuJ4cZK6wlJlRx7BTPVY Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: 4bdd994a2382412dbb2f27dc281a4265 Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1205050756 Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bdd994a2382412dbb2f27dc281a4265"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bdd994a2382412dbb2f27dc281a4265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4bdd994a2382412dbb2f27dc281a4265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4bdd994a2382412dbb2f27dc281a4265", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestEncryptedCinderVolumes-1205050756 Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: 4bdd994a2382412dbb2f27dc281a4265 Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1205050756 Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestEncryptedCinderVolumes-1205050756-project Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 778ab30c131145b69bbc1c4745480595 Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestEncryptedCinderVolumes-1205050756-project Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 008cfbb7-08fe-443e-89e1-f5ac00be681a could not be found. Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '008cfbb7-08fe-443e-89e1-f5ac00be681a'} Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 008cfbb7-08fe-443e-89e1-f5ac00be681a could not be found. Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 008cfbb7-08fe-443e-89e1-f5ac00be681a could not be found. Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:36:21.310846 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:36:21.315634 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:36:21.315634 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:36:21.315634 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:36:21.315634 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:36:21.315634 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:36:21.315634 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:36:21.315634 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 008cfbb7-08fe-443e-89e1-f5ac00be681a could not be found. Oct 24 11:36:21.315634 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:36:21.315634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fa041349-f152-4f11-bfbf-24875dd86b7d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Returning 404 to user: Instance 008cfbb7-08fe-443e-89e1-f5ac00be681a could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:36:21.315634 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fa041349-f152-4f11-bfbf-24875dd86b7d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a" status: 404 len: 111 microversion: 2.1 time: 0.031817 Oct 24 11:36:21.315634 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3756/7486] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:21 2022] GET /compute/v2.1/servers/008cfbb7-08fe-443e-89e1-f5ac00be681a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:36:21.321169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3a62b8d3-ca0c-4805-9056-9a1189eb5db3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '.version_select at 0x7f04d0ca84c0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:21.341466 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3a62b8d3-ca0c-4805-9056-9a1189eb5db3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-792954944" status: 202 len: 0 microversion: 2.1 time: 0.024126 Oct 24 11:36:21.342055 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3731/7487] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 11:36:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-792954944 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:36:21.359719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-26724ccc-fb93-4ca4-8981-b9001d033ede tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Action: 'create', calling method: .version_select at 0x7f04cb822c10>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-846942340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABv7F5EXO0dOCMw+oZtwpchbCaX+kOCvYhPyR4s9FkEZbnBu8Y+wXMniH36zcVqgMiMZy2NQbDPp8nWqsU49usSbtX+43tuwt8Eu5Dc9MW7vcFAJ97ReNhVap2cTlMS6A=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:36:21.375461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-26724ccc-fb93-4ca4-8981-b9001d033ede tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Getting quotas for project 4bdd994a2382412dbb2f27dc281a4265. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:36:21.380818 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-26724ccc-fb93-4ca4-8981-b9001d033ede tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Getting quotas for user 778ab30c131145b69bbc1c4745480595 and project 4bdd994a2382412dbb2f27dc281a4265. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:36:21.404220 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-26724ccc-fb93-4ca4-8981-b9001d033ede tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048694 Oct 24 11:36:21.404807 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3757/7488] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:36:21 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:36:21.454944 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4f7087b3-731d-4195-bcb0-073561bde6d8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1336179293", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-846942340", "networks": [{"uuid": "93d088fc-216b-4c0b-b640-fbd32db0b501"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:36:21.507622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-4f7087b3-731d-4195-bcb0-073561bde6d8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] validate_networks() for [('93d088fc-216b-4c0b-b640-fbd32db0b501', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:36:21.869687 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4f7087b3-731d-4195-bcb0-073561bde6d8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:36:21.870132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4f7087b3-731d-4195-bcb0-073561bde6d8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:36:21.870626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4f7087b3-731d-4195-bcb0-073561bde6d8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:36:21.871051 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4f7087b3-731d-4195-bcb0-073561bde6d8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:36:21.871485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-4f7087b3-731d-4195-bcb0-073561bde6d8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:36:21.880691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f7087b3-731d-4195-bcb0-073561bde6d8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:21.881222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f7087b3-731d-4195-bcb0-073561bde6d8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:21.881678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f7087b3-731d-4195-bcb0-073561bde6d8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:21.882465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f7087b3-731d-4195-bcb0-073561bde6d8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:21.882939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f7087b3-731d-4195-bcb0-073561bde6d8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:21.883389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f7087b3-731d-4195-bcb0-073561bde6d8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:21.900909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-4f7087b3-731d-4195-bcb0-073561bde6d8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Getting quotas for project 4bdd994a2382412dbb2f27dc281a4265. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:36:21.907148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-4f7087b3-731d-4195-bcb0-073561bde6d8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Getting quotas for user 778ab30c131145b69bbc1c4745480595 and project 4bdd994a2382412dbb2f27dc281a4265. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:36:21.919662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4f7087b3-731d-4195-bcb0-073561bde6d8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:36:21.922489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4f7087b3-731d-4195-bcb0-073561bde6d8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:36:21.969781 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4f7087b3-731d-4195-bcb0-073561bde6d8 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519034 Oct 24 11:36:21.970376 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3732/7489] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:36:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:36:21.981705 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b6fa7b03-c96d-4343-b084-e5e8eca2acc3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:21.982334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b6fa7b03-c96d-4343-b084-e5e8eca2acc3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:22.045668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b6fa7b03-c96d-4343-b084-e5e8eca2acc3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:36:22.052984 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b6fa7b03-c96d-4343-b084-e5e8eca2acc3 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24" status: 200 len: 1262 microversion: 2.1 time: 0.075276 Oct 24 11:36:22.062098 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3758/7490] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:21 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24 => generated 1262 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:36:23.076537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-17bade30-0aba-40d6-9039-37bc6aa7abeb tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:23.078081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-17bade30-0aba-40d6-9039-37bc6aa7abeb tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:23.086667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17bade30-0aba-40d6-9039-37bc6aa7abeb tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:23.087173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17bade30-0aba-40d6-9039-37bc6aa7abeb tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:23.087634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17bade30-0aba-40d6-9039-37bc6aa7abeb tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:23.088372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17bade30-0aba-40d6-9039-37bc6aa7abeb tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:23.088865 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17bade30-0aba-40d6-9039-37bc6aa7abeb tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:23.089321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-17bade30-0aba-40d6-9039-37bc6aa7abeb tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:23.474509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-17bade30-0aba-40d6-9039-37bc6aa7abeb tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:36:23.482883 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-17bade30-0aba-40d6-9039-37bc6aa7abeb tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24" status: 200 len: 1332 microversion: 2.1 time: 0.410987 Oct 24 11:36:23.483491 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3733/7491] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:23 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24 => generated 1332 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:36:24.507000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-83d894f7-3a09-4b30-8651-2a3de0bc4383 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:24.507607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-83d894f7-3a09-4b30-8651-2a3de0bc4383 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:24.515223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83d894f7-3a09-4b30-8651-2a3de0bc4383 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:24.515752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83d894f7-3a09-4b30-8651-2a3de0bc4383 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:24.516202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83d894f7-3a09-4b30-8651-2a3de0bc4383 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:24.516937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83d894f7-3a09-4b30-8651-2a3de0bc4383 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:24.517395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83d894f7-3a09-4b30-8651-2a3de0bc4383 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:24.517825 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83d894f7-3a09-4b30-8651-2a3de0bc4383 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:24.667192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-83d894f7-3a09-4b30-8651-2a3de0bc4383 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:36:24.675834 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-83d894f7-3a09-4b30-8651-2a3de0bc4383 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24" status: 200 len: 1362 microversion: 2.1 time: 0.172736 Oct 24 11:36:24.676421 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3759/7492] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:24 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:36:24.759240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-165317a8-fe7b-4460-b615-78713e15a03f req-5732be9c-1a0e-469f-bab8-d12be2ac4c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a0c8502-76b7-4dd6-9f5b-fb178207de24", "tag": "b2538dff-9feb-4eed-b805-ed2e36cfaa97"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:36:24.773643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-165317a8-fe7b-4460-b615-78713e15a03f req-5732be9c-1a0e-469f-bab8-d12be2ac4c34 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:24.774422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-165317a8-fe7b-4460-b615-78713e15a03f req-5732be9c-1a0e-469f-bab8-d12be2ac4c34 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:24.774868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-165317a8-fe7b-4460-b615-78713e15a03f req-5732be9c-1a0e-469f-bab8-d12be2ac4c34 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:24.787485 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-165317a8-fe7b-4460-b615-78713e15a03f req-5732be9c-1a0e-469f-bab8-d12be2ac4c34 service nova] Creating event network-changed:b2538dff-9feb-4eed-b805-ed2e36cfaa97 for instance 8a0c8502-76b7-4dd6-9f5b-fb178207de24 on n-h2-858383-15 Oct 24 11:36:24.792465 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-165317a8-fe7b-4460-b615-78713e15a03f req-5732be9c-1a0e-469f-bab8-d12be2ac4c34 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037292 Oct 24 11:36:24.793308 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3734/7493] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:36:25.699204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f455e0aa-a2db-406e-b481-00722d59e3c6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:25.699824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f455e0aa-a2db-406e-b481-00722d59e3c6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:25.707196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f455e0aa-a2db-406e-b481-00722d59e3c6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:25.707680 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f455e0aa-a2db-406e-b481-00722d59e3c6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:25.708117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f455e0aa-a2db-406e-b481-00722d59e3c6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:25.708814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f455e0aa-a2db-406e-b481-00722d59e3c6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:25.709291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f455e0aa-a2db-406e-b481-00722d59e3c6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:25.709721 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f455e0aa-a2db-406e-b481-00722d59e3c6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:25.839183 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f455e0aa-a2db-406e-b481-00722d59e3c6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:36:25.847268 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f455e0aa-a2db-406e-b481-00722d59e3c6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24" status: 200 len: 1362 microversion: 2.1 time: 0.152012 Oct 24 11:36:25.847848 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3760/7494] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:25 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:36:26.872154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-458310bf-6898-4cea-9420-5186e84d1dd1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:26.873561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-458310bf-6898-4cea-9420-5186e84d1dd1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:26.880010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-458310bf-6898-4cea-9420-5186e84d1dd1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:26.880518 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-458310bf-6898-4cea-9420-5186e84d1dd1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:26.881194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-458310bf-6898-4cea-9420-5186e84d1dd1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:26.881921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-458310bf-6898-4cea-9420-5186e84d1dd1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:26.882400 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-458310bf-6898-4cea-9420-5186e84d1dd1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:26.882853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-458310bf-6898-4cea-9420-5186e84d1dd1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:27.016141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-458310bf-6898-4cea-9420-5186e84d1dd1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:36:27.023992 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-458310bf-6898-4cea-9420-5186e84d1dd1 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24" status: 200 len: 1362 microversion: 2.1 time: 0.157109 Oct 24 11:36:27.024570 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3735/7495] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:26 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:36:28.048568 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-828480ff-cf49-4ef6-9a56-69b8eef75869 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:28.049230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-828480ff-cf49-4ef6-9a56-69b8eef75869 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:28.056184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-828480ff-cf49-4ef6-9a56-69b8eef75869 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:28.056669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-828480ff-cf49-4ef6-9a56-69b8eef75869 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:28.057141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-828480ff-cf49-4ef6-9a56-69b8eef75869 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:28.057847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-828480ff-cf49-4ef6-9a56-69b8eef75869 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:28.058481 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-828480ff-cf49-4ef6-9a56-69b8eef75869 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:28.058864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-828480ff-cf49-4ef6-9a56-69b8eef75869 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:28.195151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-828480ff-cf49-4ef6-9a56-69b8eef75869 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:36:28.203728 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-828480ff-cf49-4ef6-9a56-69b8eef75869 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24" status: 200 len: 1362 microversion: 2.1 time: 0.159981 Oct 24 11:36:28.204322 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3761/7496] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:28 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:36:29.227210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3c15d32c-2dab-4bf9-addf-d464027e19b6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:29.227872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3c15d32c-2dab-4bf9-addf-d464027e19b6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:29.235343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c15d32c-2dab-4bf9-addf-d464027e19b6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:29.235871 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c15d32c-2dab-4bf9-addf-d464027e19b6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:29.236334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c15d32c-2dab-4bf9-addf-d464027e19b6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:29.237082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c15d32c-2dab-4bf9-addf-d464027e19b6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:29.237558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c15d32c-2dab-4bf9-addf-d464027e19b6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:29.238005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3c15d32c-2dab-4bf9-addf-d464027e19b6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:29.367126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3c15d32c-2dab-4bf9-addf-d464027e19b6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:36:29.375387 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3c15d32c-2dab-4bf9-addf-d464027e19b6 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24" status: 200 len: 1362 microversion: 2.1 time: 0.152044 Oct 24 11:36:29.375966 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3736/7497] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:29 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:36:30.398639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-511719ca-8ace-4648-bbb3-9e2d7f2c09da tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:30.399257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-511719ca-8ace-4648-bbb3-9e2d7f2c09da tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:30.406552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-511719ca-8ace-4648-bbb3-9e2d7f2c09da tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:30.407031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-511719ca-8ace-4648-bbb3-9e2d7f2c09da tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:30.407472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-511719ca-8ace-4648-bbb3-9e2d7f2c09da tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:30.408193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-511719ca-8ace-4648-bbb3-9e2d7f2c09da tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:30.408644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-511719ca-8ace-4648-bbb3-9e2d7f2c09da tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:30.409089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-511719ca-8ace-4648-bbb3-9e2d7f2c09da tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:30.540643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-511719ca-8ace-4648-bbb3-9e2d7f2c09da tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:36:30.548963 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-511719ca-8ace-4648-bbb3-9e2d7f2c09da tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24" status: 200 len: 1362 microversion: 2.1 time: 0.154552 Oct 24 11:36:30.549555 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3762/7498] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:30 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:36:30.638498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-cd287a28-3c91-418a-ba67-23225e5a30a8 req-731d67fd-9759-4fd7-b8da-12345155457c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a0c8502-76b7-4dd6-9f5b-fb178207de24", "name": "network-vif-plugged", "status": "completed", "tag": "b2538dff-9feb-4eed-b805-ed2e36cfaa97"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:36:30.649898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cd287a28-3c91-418a-ba67-23225e5a30a8 req-731d67fd-9759-4fd7-b8da-12345155457c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:30.650808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cd287a28-3c91-418a-ba67-23225e5a30a8 req-731d67fd-9759-4fd7-b8da-12345155457c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:30.651269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-cd287a28-3c91-418a-ba67-23225e5a30a8 req-731d67fd-9759-4fd7-b8da-12345155457c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:30.662917 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-cd287a28-3c91-418a-ba67-23225e5a30a8 req-731d67fd-9759-4fd7-b8da-12345155457c service nova] Creating event network-vif-plugged:b2538dff-9feb-4eed-b805-ed2e36cfaa97 for instance 8a0c8502-76b7-4dd6-9f5b-fb178207de24 on n-h2-858383-15 Oct 24 11:36:30.667864 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-cd287a28-3c91-418a-ba67-23225e5a30a8 req-731d67fd-9759-4fd7-b8da-12345155457c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033110 Oct 24 11:36:30.668463 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3737/7499] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:36:31.572766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3905f1a-66d4-4c2c-9501-ecfe4e218d3b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:31.573412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f3905f1a-66d4-4c2c-9501-ecfe4e218d3b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:31.581074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3905f1a-66d4-4c2c-9501-ecfe4e218d3b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:31.581566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3905f1a-66d4-4c2c-9501-ecfe4e218d3b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:31.582000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3905f1a-66d4-4c2c-9501-ecfe4e218d3b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:31.582697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3905f1a-66d4-4c2c-9501-ecfe4e218d3b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:31.583145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3905f1a-66d4-4c2c-9501-ecfe4e218d3b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:31.583567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3905f1a-66d4-4c2c-9501-ecfe4e218d3b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:31.715377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3905f1a-66d4-4c2c-9501-ecfe4e218d3b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:36:31.725107 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f3905f1a-66d4-4c2c-9501-ecfe4e218d3b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24" status: 200 len: 1362 microversion: 2.1 time: 0.156142 Oct 24 11:36:31.726019 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3763/7500] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:31 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:36:32.749855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-103b321d-a14c-456d-9644-8c8363d60e7c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:32.750550 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-103b321d-a14c-456d-9644-8c8363d60e7c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:32.753462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:36:32.754160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:36:32.759950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-103b321d-a14c-456d-9644-8c8363d60e7c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:32.760445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-103b321d-a14c-456d-9644-8c8363d60e7c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:32.760919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-103b321d-a14c-456d-9644-8c8363d60e7c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:32.761627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-103b321d-a14c-456d-9644-8c8363d60e7c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:32.762093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-103b321d-a14c-456d-9644-8c8363d60e7c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:32.762530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-103b321d-a14c-456d-9644-8c8363d60e7c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:32.890133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-103b321d-a14c-456d-9644-8c8363d60e7c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:36:32.898323 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-103b321d-a14c-456d-9644-8c8363d60e7c tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24" status: 200 len: 1554 microversion: 2.1 time: 0.153409 Oct 24 11:36:32.898893 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3738/7501] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:32 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:36:32.920502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-251b6366-bcac-43b8-bc03-0900432f2140 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:32.921257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-251b6366-bcac-43b8-bc03-0900432f2140 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:32.923237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:36:32.929322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-251b6366-bcac-43b8-bc03-0900432f2140 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:32.929813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-251b6366-bcac-43b8-bc03-0900432f2140 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:32.930257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-251b6366-bcac-43b8-bc03-0900432f2140 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:32.931006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-251b6366-bcac-43b8-bc03-0900432f2140 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:32.931418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-251b6366-bcac-43b8-bc03-0900432f2140 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:32.931850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-251b6366-bcac-43b8-bc03-0900432f2140 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:33.065607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-251b6366-bcac-43b8-bc03-0900432f2140 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:36:33.073362 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-251b6366-bcac-43b8-bc03-0900432f2140 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24" status: 200 len: 1554 microversion: 2.1 time: 0.156704 Oct 24 11:36:33.073959 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3764/7502] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:32 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:36:34.573139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-51fbb74e-7ca5-463b-8d3e-185ed56f1e57 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "367c5d0f-0b7c-40d3-b928-7439d7ea5eaf"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:36:34.575542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-51fbb74e-7ca5-463b-8d3e-185ed56f1e57 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:34.582762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51fbb74e-7ca5-463b-8d3e-185ed56f1e57 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:34.583278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51fbb74e-7ca5-463b-8d3e-185ed56f1e57 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:34.583742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51fbb74e-7ca5-463b-8d3e-185ed56f1e57 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:34.584465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51fbb74e-7ca5-463b-8d3e-185ed56f1e57 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:34.584977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51fbb74e-7ca5-463b-8d3e-185ed56f1e57 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:34.585428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-51fbb74e-7ca5-463b-8d3e-185ed56f1e57 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:34.836047 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:36:34.854730 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-51fbb74e-7ca5-463b-8d3e-185ed56f1e57 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "POST /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285506 Oct 24 11:36:34.855393 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3739/7503] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 11:36:34 2022] POST /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:36:45.577727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-065f9908-911c-4233-98a6-b538ac745016 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:45.578224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-065f9908-911c-4233-98a6-b538ac745016 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:45.581053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:36:45.581759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=70 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:36:45.587390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-065f9908-911c-4233-98a6-b538ac745016 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:45.587871 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-065f9908-911c-4233-98a6-b538ac745016 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:45.588309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-065f9908-911c-4233-98a6-b538ac745016 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:45.589031 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-065f9908-911c-4233-98a6-b538ac745016 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:45.589482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-065f9908-911c-4233-98a6-b538ac745016 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:45.589942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-065f9908-911c-4233-98a6-b538ac745016 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:45.669412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-065f9908-911c-4233-98a6-b538ac745016 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lazy-loading 'services' on Instance uuid 8a0c8502-76b7-4dd6-9f5b-fb178207de24 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:36:45.740091 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-065f9908-911c-4233-98a6-b538ac745016 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments/367c5d0f-0b7c-40d3-b928-7439d7ea5eaf" status: 202 len: 0 microversion: 2.1 time: 0.166053 Oct 24 11:36:45.740779 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3765/7504] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 11:36:45 2022] DELETE /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments/367c5d0f-0b7c-40d3-b928-7439d7ea5eaf => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:36:45.750183 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a4a623d6-6ef3-4838-b789-f151c972ff87 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:45.752609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a4a623d6-6ef3-4838-b789-f151c972ff87 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:45.756324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:36:45.757288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:36:45.764245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4a623d6-6ef3-4838-b789-f151c972ff87 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:45.765325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4a623d6-6ef3-4838-b789-f151c972ff87 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:45.765926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4a623d6-6ef3-4838-b789-f151c972ff87 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:45.766636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4a623d6-6ef3-4838-b789-f151c972ff87 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:45.767106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4a623d6-6ef3-4838-b789-f151c972ff87 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:45.767544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4a623d6-6ef3-4838-b789-f151c972ff87 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:45.802515 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a4a623d6-6ef3-4838-b789-f151c972ff87 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056981 Oct 24 11:36:45.803099 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3740/7505] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:36:45 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:36:46.816065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-77b1025b-f840-47f2-bff6-c4d3f451ef03 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:46.818363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-77b1025b-f840-47f2-bff6-c4d3f451ef03 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:46.824794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77b1025b-f840-47f2-bff6-c4d3f451ef03 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:46.825341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77b1025b-f840-47f2-bff6-c4d3f451ef03 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:46.825784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77b1025b-f840-47f2-bff6-c4d3f451ef03 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:46.826482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77b1025b-f840-47f2-bff6-c4d3f451ef03 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:46.826937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77b1025b-f840-47f2-bff6-c4d3f451ef03 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:46.828293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-77b1025b-f840-47f2-bff6-c4d3f451ef03 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:46.862347 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-77b1025b-f840-47f2-bff6-c4d3f451ef03 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051596 Oct 24 11:36:46.862928 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3766/7506] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:36:46 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:36:47.875147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e5f50617-714c-4635-bd0c-f03ce328245d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:47.877453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e5f50617-714c-4635-bd0c-f03ce328245d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:47.884541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5f50617-714c-4635-bd0c-f03ce328245d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:47.885083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5f50617-714c-4635-bd0c-f03ce328245d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:47.885544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5f50617-714c-4635-bd0c-f03ce328245d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:47.886275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5f50617-714c-4635-bd0c-f03ce328245d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:47.886745 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5f50617-714c-4635-bd0c-f03ce328245d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:47.887190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e5f50617-714c-4635-bd0c-f03ce328245d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:47.918643 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e5f50617-714c-4635-bd0c-f03ce328245d tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047681 Oct 24 11:36:47.919219 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3741/7507] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:36:47 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:36:48.930843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e2df2e7-6cd3-4d1e-9df0-9adead8520ec tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:48.933182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1e2df2e7-6cd3-4d1e-9df0-9adead8520ec tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:48.940810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e2df2e7-6cd3-4d1e-9df0-9adead8520ec tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:48.941318 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e2df2e7-6cd3-4d1e-9df0-9adead8520ec tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:48.941759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e2df2e7-6cd3-4d1e-9df0-9adead8520ec tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:48.942450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e2df2e7-6cd3-4d1e-9df0-9adead8520ec tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:48.942899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e2df2e7-6cd3-4d1e-9df0-9adead8520ec tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:48.943322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e2df2e7-6cd3-4d1e-9df0-9adead8520ec tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:48.972631 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1e2df2e7-6cd3-4d1e-9df0-9adead8520ec tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045791 Oct 24 11:36:48.973219 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3767/7508] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:36:48 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:36:49.987237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d9297f44-e0e0-47ff-ab8c-60e6ffcc3672 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:49.990117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d9297f44-e0e0-47ff-ab8c-60e6ffcc3672 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:49.998207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9297f44-e0e0-47ff-ab8c-60e6ffcc3672 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:49.999766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9297f44-e0e0-47ff-ab8c-60e6ffcc3672 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:50.000738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9297f44-e0e0-47ff-ab8c-60e6ffcc3672 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:50.002084 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9297f44-e0e0-47ff-ab8c-60e6ffcc3672 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:50.002886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9297f44-e0e0-47ff-ab8c-60e6ffcc3672 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:50.003624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d9297f44-e0e0-47ff-ab8c-60e6ffcc3672 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:50.041879 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d9297f44-e0e0-47ff-ab8c-60e6ffcc3672 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060536 Oct 24 11:36:50.042472 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3742/7509] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:36:49 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:36:51.054609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-646bb5ea-9a71-4510-8930-7af34510b327 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:51.056860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-646bb5ea-9a71-4510-8930-7af34510b327 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:51.063643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-646bb5ea-9a71-4510-8930-7af34510b327 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:51.064142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-646bb5ea-9a71-4510-8930-7af34510b327 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:51.064576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-646bb5ea-9a71-4510-8930-7af34510b327 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:51.065292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-646bb5ea-9a71-4510-8930-7af34510b327 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:51.065746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-646bb5ea-9a71-4510-8930-7af34510b327 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:51.066167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-646bb5ea-9a71-4510-8930-7af34510b327 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:51.096800 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-646bb5ea-9a71-4510-8930-7af34510b327 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046146 Oct 24 11:36:51.097381 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3768/7510] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:36:51 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 11:36:51.108033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-478c8033-7a83-46e9-a00e-0e78c3fdefac tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:51.108636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-478c8033-7a83-46e9-a00e-0e78c3fdefac tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:51.115608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-478c8033-7a83-46e9-a00e-0e78c3fdefac tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:51.116163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-478c8033-7a83-46e9-a00e-0e78c3fdefac tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:51.116623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-478c8033-7a83-46e9-a00e-0e78c3fdefac tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:51.117377 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-478c8033-7a83-46e9-a00e-0e78c3fdefac tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:51.117860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-478c8033-7a83-46e9-a00e-0e78c3fdefac tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:51.118313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-478c8033-7a83-46e9-a00e-0e78c3fdefac tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:51.195436 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-478c8033-7a83-46e9-a00e-0e78c3fdefac tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] HTTP exception thrown: Instance 8a0c8502-76b7-4dd6-9f5b-fb178207de24 is not attached to volume 367c5d0f-0b7c-40d3-b928-7439d7ea5eaf Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-478c8033-7a83-46e9-a00e-0e78c3fdefac tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Request method failure captured: Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments/367c5d0f-0b7c-40d3-b928-7439d7ea5eaf HTTP/1.1 Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnhmxF1pMntAgXKUvKbPfkR5NJsPhNAfJ9b9WSdT28WlNidz_cObkta2Mo2C5KHrABRsYCPc002p4k9q14JeCzD33rDQ0s6HqkmgiNtd6WSjVZIiffhNSeyFt8F65lVfwNQRyJ4_YPzHPUpM89Pe2eExMrOHuJ4cZK6wlJlRx7BTPVY Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4bdd994a2382412dbb2f27dc281a4265 Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1205050756 Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bdd994a2382412dbb2f27dc281a4265"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bdd994a2382412dbb2f27dc281a4265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4bdd994a2382412dbb2f27dc281a4265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4bdd994a2382412dbb2f27dc281a4265", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestEncryptedCinderVolumes-1205050756 Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4bdd994a2382412dbb2f27dc281a4265 Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1205050756 Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestEncryptedCinderVolumes-1205050756-project Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 778ab30c131145b69bbc1c4745480595 Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestEncryptedCinderVolumes-1205050756-project Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 8a0c8502-76b7-4dd6-9f5b-fb178207de24 is not attached to volume 367c5d0f-0b7c-40d3-b928-7439d7ea5eaf Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'server_id': '8a0c8502-76b7-4dd6-9f5b-fb178207de24', 'id': '367c5d0f-0b7c-40d3-b928-7439d7ea5eaf'} Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 367c5d0f-0b7c-40d3-b928-7439d7ea5eaf. Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a0c8502-76b7-4dd6-9f5b-fb178207de24 is not attached to volume 367c5d0f-0b7c-40d3-b928-7439d7ea5eaf Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:36:51.197425 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:36:51.201740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:36:51.201740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:36:51.201740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a0c8502-76b7-4dd6-9f5b-fb178207de24 is not attached to volume 367c5d0f-0b7c-40d3-b928-7439d7ea5eaf Oct 24 11:36:51.201740 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:36:51.201740 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-478c8033-7a83-46e9-a00e-0e78c3fdefac tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Returning 404 to user: Instance 8a0c8502-76b7-4dd6-9f5b-fb178207de24 is not attached to volume 367c5d0f-0b7c-40d3-b928-7439d7ea5eaf {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:36:51.201740 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-478c8033-7a83-46e9-a00e-0e78c3fdefac tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments/367c5d0f-0b7c-40d3-b928-7439d7ea5eaf" status: 404 len: 154 microversion: 2.1 time: 0.094944 Oct 24 11:36:51.201740 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3743/7511] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 11:36:51 2022] DELETE /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24/os-volume_attachments/367c5d0f-0b7c-40d3-b928-7439d7ea5eaf => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:36:54.553534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-167d2ce0-d820-4dc4-a236-3c620515d406 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:54.554105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-167d2ce0-d820-4dc4-a236-3c620515d406 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:54.561115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-167d2ce0-d820-4dc4-a236-3c620515d406 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:54.562039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-167d2ce0-d820-4dc4-a236-3c620515d406 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:54.562170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-167d2ce0-d820-4dc4-a236-3c620515d406 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:54.568922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-167d2ce0-d820-4dc4-a236-3c620515d406 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:54.569421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-167d2ce0-d820-4dc4-a236-3c620515d406 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:54.569869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-167d2ce0-d820-4dc4-a236-3c620515d406 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:54.597000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-167d2ce0-d820-4dc4-a236-3c620515d406 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:36:54.682694 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-167d2ce0-d820-4dc4-a236-3c620515d406 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24" status: 204 len: 0 microversion: 2.1 time: 0.132735 Oct 24 11:36:54.684455 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3769/7512] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:36:54 2022] DELETE /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 11:36:54.693073 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a9c9c369-2106-4ea7-ab7c-7c508c1cfc8a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:54.693805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a9c9c369-2106-4ea7-ab7c-7c508c1cfc8a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:54.701577 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9c9c369-2106-4ea7-ab7c-7c508c1cfc8a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:54.702296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9c9c369-2106-4ea7-ab7c-7c508c1cfc8a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:54.702898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9c9c369-2106-4ea7-ab7c-7c508c1cfc8a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:54.703725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9c9c369-2106-4ea7-ab7c-7c508c1cfc8a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:54.704273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9c9c369-2106-4ea7-ab7c-7c508c1cfc8a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:54.705146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9c9c369-2106-4ea7-ab7c-7c508c1cfc8a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:54.841708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a9c9c369-2106-4ea7-ab7c-7c508c1cfc8a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:36:54.850326 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a9c9c369-2106-4ea7-ab7c-7c508c1cfc8a tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24" status: 200 len: 1560 microversion: 2.1 time: 0.161501 Oct 24 11:36:54.850931 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3744/7513] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:54 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:36:55.875604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-83843bba-3648-49eb-b787-7957d717a000 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:55.876297 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-83843bba-3648-49eb-b787-7957d717a000 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:55.883043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83843bba-3648-49eb-b787-7957d717a000 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:55.883517 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83843bba-3648-49eb-b787-7957d717a000 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:55.883949 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83843bba-3648-49eb-b787-7957d717a000 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:55.884629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83843bba-3648-49eb-b787-7957d717a000 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:55.885100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83843bba-3648-49eb-b787-7957d717a000 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:55.885524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83843bba-3648-49eb-b787-7957d717a000 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:56.015642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-83843bba-3648-49eb-b787-7957d717a000 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:36:56.023373 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-83843bba-3648-49eb-b787-7957d717a000 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24" status: 200 len: 1560 microversion: 2.1 time: 0.152761 Oct 24 11:36:56.023948 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3770/7514] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:55 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:36:56.905883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-94a2c7e1-e637-4d17-bd31-d2618e1f6b64 req-c3390a7a-0e2f-4174-abb3-843d9c65349d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a0c8502-76b7-4dd6-9f5b-fb178207de24", "name": "network-vif-deleted", "tag": "b2538dff-9feb-4eed-b805-ed2e36cfaa97"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:36:56.917108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-94a2c7e1-e637-4d17-bd31-d2618e1f6b64 req-c3390a7a-0e2f-4174-abb3-843d9c65349d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:56.917621 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-94a2c7e1-e637-4d17-bd31-d2618e1f6b64 req-c3390a7a-0e2f-4174-abb3-843d9c65349d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:56.918079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-94a2c7e1-e637-4d17-bd31-d2618e1f6b64 req-c3390a7a-0e2f-4174-abb3-843d9c65349d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:56.942745 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-94a2c7e1-e637-4d17-bd31-d2618e1f6b64 req-c3390a7a-0e2f-4174-abb3-843d9c65349d service nova] Creating event network-vif-deleted:b2538dff-9feb-4eed-b805-ed2e36cfaa97 for instance 8a0c8502-76b7-4dd6-9f5b-fb178207de24 on n-h2-858383-15 Oct 24 11:36:56.947977 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-94a2c7e1-e637-4d17-bd31-d2618e1f6b64 req-c3390a7a-0e2f-4174-abb3-843d9c65349d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046244 Oct 24 11:36:56.948608 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3745/7515] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:36:57.048667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e62c648-b4e6-4856-abc0-992f6f4f5cb5 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:57.049264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1e62c648-b4e6-4856-abc0-992f6f4f5cb5 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:57.056150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e62c648-b4e6-4856-abc0-992f6f4f5cb5 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:57.056631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e62c648-b4e6-4856-abc0-992f6f4f5cb5 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:57.057104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e62c648-b4e6-4856-abc0-992f6f4f5cb5 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:57.057807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e62c648-b4e6-4856-abc0-992f6f4f5cb5 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:57.058265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e62c648-b4e6-4856-abc0-992f6f4f5cb5 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:57.058696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e62c648-b4e6-4856-abc0-992f6f4f5cb5 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:57.093575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e62c648-b4e6-4856-abc0-992f6f4f5cb5 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:57.094064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e62c648-b4e6-4856-abc0-992f6f4f5cb5 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:57.094513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e62c648-b4e6-4856-abc0-992f6f4f5cb5 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:57.094968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-1e62c648-b4e6-4856-abc0-992f6f4f5cb5 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lazy-loading 'fault' on Instance uuid 8a0c8502-76b7-4dd6-9f5b-fb178207de24 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:36:57.144139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1e62c648-b4e6-4856-abc0-992f6f4f5cb5 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778ab30c131145b69bbc1c4745480595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdd994a2382412dbb2f27dc281a4265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:36:57.151883 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1e62c648-b4e6-4856-abc0-992f6f4f5cb5 tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24" status: 200 len: 1352 microversion: 2.1 time: 0.108073 Oct 24 11:36:57.152443 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3771/7516] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:57 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24 => generated 1352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:36:58.176437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-73606c9c-d2dd-4d14-992c-88e82a64c21b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:58.177184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-73606c9c-d2dd-4d14-992c-88e82a64c21b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] [instance: 8a0c8502-76b7-4dd6-9f5b-fb178207de24] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:36:58.184159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73606c9c-d2dd-4d14-992c-88e82a64c21b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:58.184653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73606c9c-d2dd-4d14-992c-88e82a64c21b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:58.185129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73606c9c-d2dd-4d14-992c-88e82a64c21b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:58.185835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73606c9c-d2dd-4d14-992c-88e82a64c21b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:36:58.186302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73606c9c-d2dd-4d14-992c-88e82a64c21b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:36:58.186983 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73606c9c-d2dd-4d14-992c-88e82a64c21b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:36:58.200283 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-73606c9c-d2dd-4d14-992c-88e82a64c21b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] HTTP exception thrown: Instance 8a0c8502-76b7-4dd6-9f5b-fb178207de24 could not be found. Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-73606c9c-d2dd-4d14-992c-88e82a64c21b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Request method failure captured: Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24 HTTP/1.1 Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnhmxF1pMntAgXKUvKbPfkR5NJsPhNAfJ9b9WSdT28WlNidz_cObkta2Mo2C5KHrABRsYCPc002p4k9q14JeCzD33rDQ0s6HqkmgiNtd6WSjVZIiffhNSeyFt8F65lVfwNQRyJ4_YPzHPUpM89Pe2eExMrOHuJ4cZK6wlJlRx7BTPVY Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: 4bdd994a2382412dbb2f27dc281a4265 Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1205050756 Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bdd994a2382412dbb2f27dc281a4265"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4bdd994a2382412dbb2f27dc281a4265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4bdd994a2382412dbb2f27dc281a4265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4bdd994a2382412dbb2f27dc281a4265", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestEncryptedCinderVolumes-1205050756 Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: 4bdd994a2382412dbb2f27dc281a4265 Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1205050756 Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestEncryptedCinderVolumes-1205050756-project Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 778ab30c131145b69bbc1c4745480595 Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestEncryptedCinderVolumes-1205050756-project Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 8a0c8502-76b7-4dd6-9f5b-fb178207de24 could not be found. Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '8a0c8502-76b7-4dd6-9f5b-fb178207de24'} Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a0c8502-76b7-4dd6-9f5b-fb178207de24 could not be found. Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a0c8502-76b7-4dd6-9f5b-fb178207de24 could not be found. Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:36:58.202029 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:36:58.206282 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:36:58.206282 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:36:58.206282 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:36:58.206282 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:36:58.206282 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:36:58.206282 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:36:58.206282 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a0c8502-76b7-4dd6-9f5b-fb178207de24 could not be found. Oct 24 11:36:58.206282 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:36:58.206282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-73606c9c-d2dd-4d14-992c-88e82a64c21b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Returning 404 to user: Instance 8a0c8502-76b7-4dd6-9f5b-fb178207de24 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:36:58.206282 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-73606c9c-d2dd-4d14-992c-88e82a64c21b tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24" status: 404 len: 111 microversion: 2.1 time: 0.031286 Oct 24 11:36:58.206282 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3746/7517] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:36:58 2022] GET /compute/v2.1/servers/8a0c8502-76b7-4dd6-9f5b-fb178207de24 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:36:58.212313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-23a2b269-4b99-49ae-a4aa-8efd7cbd243f tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] Calling method '.version_select at 0x7f04cb69a3a0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:36:58.233916 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-23a2b269-4b99-49ae-a4aa-8efd7cbd243f tempest-TestEncryptedCinderVolumes-1205050756 tempest-TestEncryptedCinderVolumes-1205050756-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-846942340" status: 202 len: 0 microversion: 2.1 time: 0.024804 Oct 24 11:36:58.234618 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3772/7518] 10.222.0.50 () {58 vars in 1275 bytes} [Mon Oct 24 11:36:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-846942340 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 11:37:24.888235 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0ceb1481-000d-4200-8485-6f821ee728e3 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Action: 'create', calling method: .version_select at 0x7f04d0bba1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-212634551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiSZXWWeNv771U8TWJtFPAakVgHGYcG6QNK+kC7PTQIB03MSLqUYgQnCVLIUpfmIy/l22eDQugraqdcafCxVTKi8LR94kySmqvs95lEHwG/IpQwxUj4sR74zbINS2nzuA=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:37:24.894945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=14 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:37:24.895611 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=34 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:37:24.908505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0ceb1481-000d-4200-8485-6f821ee728e3 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Getting quotas for project ed3f0cb78cc7439181175560e01c94f1. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:37:24.914987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-0ceb1481-000d-4200-8485-6f821ee728e3 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Getting quotas for user 815407dc849a4da0a3d924139e50cf9f and project ed3f0cb78cc7439181175560e01c94f1. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:37:24.939507 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0ceb1481-000d-4200-8485-6f821ee728e3 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.055029 Oct 24 11:37:24.940162 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3747/7519] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:37:24 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:37:24.990030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:37:24.990790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:37:24.992868 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:37:24.993070 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:37:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.50) !!! Oct 24 11:37:25.000145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-306a9ab2-6ef9-438d-bc96-db8dda1030bd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-417468611", "imageRef": "0e3779d7-d151-4503-a841-944c047bc7b1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-212634551", "networks": [{"uuid": "43b1cf90-d8f6-4cb1-a943-9c20b868ec82"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:37:25.059727 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-306a9ab2-6ef9-438d-bc96-db8dda1030bd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] validate_networks() for [('43b1cf90-d8f6-4cb1-a943-9c20b868ec82', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:37:25.438257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-306a9ab2-6ef9-438d-bc96-db8dda1030bd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:37:25.438724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-306a9ab2-6ef9-438d-bc96-db8dda1030bd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:37:25.439210 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-306a9ab2-6ef9-438d-bc96-db8dda1030bd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:37:25.439629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-306a9ab2-6ef9-438d-bc96-db8dda1030bd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:37:25.440047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-306a9ab2-6ef9-438d-bc96-db8dda1030bd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:37:25.449300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-306a9ab2-6ef9-438d-bc96-db8dda1030bd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:25.449789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-306a9ab2-6ef9-438d-bc96-db8dda1030bd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:25.450234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-306a9ab2-6ef9-438d-bc96-db8dda1030bd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:25.450970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-306a9ab2-6ef9-438d-bc96-db8dda1030bd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:25.451434 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-306a9ab2-6ef9-438d-bc96-db8dda1030bd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:25.452625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-306a9ab2-6ef9-438d-bc96-db8dda1030bd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:25.469315 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-306a9ab2-6ef9-438d-bc96-db8dda1030bd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Getting quotas for project ed3f0cb78cc7439181175560e01c94f1. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:37:25.474514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-306a9ab2-6ef9-438d-bc96-db8dda1030bd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Getting quotas for user 815407dc849a4da0a3d924139e50cf9f and project ed3f0cb78cc7439181175560e01c94f1. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:37:25.487014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-306a9ab2-6ef9-438d-bc96-db8dda1030bd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:37:25.489279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-306a9ab2-6ef9-438d-bc96-db8dda1030bd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0e3779d7-d151-4503-a841-944c047bc7b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:37:25.536603 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-306a9ab2-6ef9-438d-bc96-db8dda1030bd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548430 Oct 24 11:37:25.537311 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3773/7520] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:37:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:37:25.549216 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-503ccdff-f6cd-4214-ad0b-5bf3885e1a64 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:25.549888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-503ccdff-f6cd-4214-ad0b-5bf3885e1a64 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:25.612760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-503ccdff-f6cd-4214-ad0b-5bf3885e1a64 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:25.620687 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-503ccdff-f6cd-4214-ad0b-5bf3885e1a64 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1257 microversion: 2.1 time: 0.076334 Oct 24 11:37:25.621382 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3748/7521] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:25 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1257 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:37:26.644763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-569ae5b8-d9b4-4522-8488-dd0326025613 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:26.646595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-569ae5b8-d9b4-4522-8488-dd0326025613 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:26.654336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-569ae5b8-d9b4-4522-8488-dd0326025613 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:26.655426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-569ae5b8-d9b4-4522-8488-dd0326025613 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:26.656004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-569ae5b8-d9b4-4522-8488-dd0326025613 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:26.656969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-569ae5b8-d9b4-4522-8488-dd0326025613 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:26.657614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-569ae5b8-d9b4-4522-8488-dd0326025613 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:26.658045 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-569ae5b8-d9b4-4522-8488-dd0326025613 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:26.729604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-569ae5b8-d9b4-4522-8488-dd0326025613 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:26.738529 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-569ae5b8-d9b4-4522-8488-dd0326025613 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1327 microversion: 2.1 time: 0.098533 Oct 24 11:37:26.739120 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3774/7522] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:26 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:37:27.762870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e766160f-7f25-4956-8390-fb7ebd50cdb8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:27.763471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e766160f-7f25-4956-8390-fb7ebd50cdb8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:27.772248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e766160f-7f25-4956-8390-fb7ebd50cdb8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:27.772974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e766160f-7f25-4956-8390-fb7ebd50cdb8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:27.773534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e766160f-7f25-4956-8390-fb7ebd50cdb8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:27.774426 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e766160f-7f25-4956-8390-fb7ebd50cdb8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:27.775152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e766160f-7f25-4956-8390-fb7ebd50cdb8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:27.775773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e766160f-7f25-4956-8390-fb7ebd50cdb8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:27.919175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e766160f-7f25-4956-8390-fb7ebd50cdb8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:27.928350 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e766160f-7f25-4956-8390-fb7ebd50cdb8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1357 microversion: 2.1 time: 0.169792 Oct 24 11:37:27.928972 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3749/7523] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:27 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:37:28.954396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c7e2efcf-3da2-48d2-b4c4-b8826f8679f5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:28.955019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c7e2efcf-3da2-48d2-b4c4-b8826f8679f5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:28.963059 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7e2efcf-3da2-48d2-b4c4-b8826f8679f5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:28.963857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7e2efcf-3da2-48d2-b4c4-b8826f8679f5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:28.964046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7e2efcf-3da2-48d2-b4c4-b8826f8679f5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:28.964990 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7e2efcf-3da2-48d2-b4c4-b8826f8679f5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:28.965623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7e2efcf-3da2-48d2-b4c4-b8826f8679f5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:28.966223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c7e2efcf-3da2-48d2-b4c4-b8826f8679f5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:29.118128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c7e2efcf-3da2-48d2-b4c4-b8826f8679f5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:29.127119 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c7e2efcf-3da2-48d2-b4c4-b8826f8679f5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1357 microversion: 2.1 time: 0.177280 Oct 24 11:37:29.127716 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3775/7524] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:28 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:37:30.155142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-38391d0e-e779-4685-974b-fe87609e3f5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:30.155798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-38391d0e-e779-4685-974b-fe87609e3f5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:30.162957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-38391d0e-e779-4685-974b-fe87609e3f5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:30.163461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-38391d0e-e779-4685-974b-fe87609e3f5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:30.163917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-38391d0e-e779-4685-974b-fe87609e3f5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:30.164630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-38391d0e-e779-4685-974b-fe87609e3f5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:30.165130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-38391d0e-e779-4685-974b-fe87609e3f5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:30.165578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-38391d0e-e779-4685-974b-fe87609e3f5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:30.329636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-38391d0e-e779-4685-974b-fe87609e3f5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:30.337818 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-38391d0e-e779-4685-974b-fe87609e3f5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1357 microversion: 2.1 time: 0.186549 Oct 24 11:37:30.338663 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3750/7525] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:30 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:37:31.364436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bf1b98e3-c2ca-4f16-8b83-239dc56c63bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:31.365471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bf1b98e3-c2ca-4f16-8b83-239dc56c63bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:31.372956 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf1b98e3-c2ca-4f16-8b83-239dc56c63bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:31.373454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf1b98e3-c2ca-4f16-8b83-239dc56c63bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:31.373913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf1b98e3-c2ca-4f16-8b83-239dc56c63bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:31.374626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf1b98e3-c2ca-4f16-8b83-239dc56c63bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:31.375118 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf1b98e3-c2ca-4f16-8b83-239dc56c63bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:31.375726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bf1b98e3-c2ca-4f16-8b83-239dc56c63bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:31.519896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bf1b98e3-c2ca-4f16-8b83-239dc56c63bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:31.528501 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bf1b98e3-c2ca-4f16-8b83-239dc56c63bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1357 microversion: 2.1 time: 0.168369 Oct 24 11:37:31.530496 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3776/7526] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:31 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:37:32.555081 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7efd4cd9-5ebe-45f1-9cdf-d5479080697f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:32.555725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7efd4cd9-5ebe-45f1-9cdf-d5479080697f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:32.565989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7efd4cd9-5ebe-45f1-9cdf-d5479080697f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:32.566504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7efd4cd9-5ebe-45f1-9cdf-d5479080697f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:32.566970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7efd4cd9-5ebe-45f1-9cdf-d5479080697f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:32.567690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7efd4cd9-5ebe-45f1-9cdf-d5479080697f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:32.568157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7efd4cd9-5ebe-45f1-9cdf-d5479080697f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:32.568599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7efd4cd9-5ebe-45f1-9cdf-d5479080697f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:32.724026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7efd4cd9-5ebe-45f1-9cdf-d5479080697f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:32.732440 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7efd4cd9-5ebe-45f1-9cdf-d5479080697f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1357 microversion: 2.1 time: 0.181442 Oct 24 11:37:32.733626 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3751/7527] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:32 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:37:33.757105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-69bf31e1-2898-4eac-bfe5-0d27e9eaf81c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:33.757998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-69bf31e1-2898-4eac-bfe5-0d27e9eaf81c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:33.766065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69bf31e1-2898-4eac-bfe5-0d27e9eaf81c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:33.766565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69bf31e1-2898-4eac-bfe5-0d27e9eaf81c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:33.767012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69bf31e1-2898-4eac-bfe5-0d27e9eaf81c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:33.767794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69bf31e1-2898-4eac-bfe5-0d27e9eaf81c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:33.768258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69bf31e1-2898-4eac-bfe5-0d27e9eaf81c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:33.768690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-69bf31e1-2898-4eac-bfe5-0d27e9eaf81c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:33.913050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-69bf31e1-2898-4eac-bfe5-0d27e9eaf81c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:33.920996 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-69bf31e1-2898-4eac-bfe5-0d27e9eaf81c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1357 microversion: 2.1 time: 0.168843 Oct 24 11:37:33.921569 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3777/7528] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:33 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:37:34.949133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ce4e1683-9993-4144-9523-e1928940015a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:34.949782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ce4e1683-9993-4144-9523-e1928940015a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:34.957467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce4e1683-9993-4144-9523-e1928940015a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:34.958011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce4e1683-9993-4144-9523-e1928940015a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:34.958413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce4e1683-9993-4144-9523-e1928940015a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:34.959128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce4e1683-9993-4144-9523-e1928940015a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:34.959596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce4e1683-9993-4144-9523-e1928940015a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:34.960031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ce4e1683-9993-4144-9523-e1928940015a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:35.097549 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ce4e1683-9993-4144-9523-e1928940015a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:35.105457 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ce4e1683-9993-4144-9523-e1928940015a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1357 microversion: 2.1 time: 0.160597 Oct 24 11:37:35.106053 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3752/7529] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:34 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:37:35.167836 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-9491c3b1-1080-4c85-9d62-4d46fe04c439 req-f4b0f60d-60b4-41b3-b549-560e19d6a033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2d727f7-b4a4-4808-a943-070ff34dc897", "tag": "0ec8d161-58d8-4fd8-b70d-e199942b5c61"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:37:35.178987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9491c3b1-1080-4c85-9d62-4d46fe04c439 req-f4b0f60d-60b4-41b3-b549-560e19d6a033 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:35.179470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9491c3b1-1080-4c85-9d62-4d46fe04c439 req-f4b0f60d-60b4-41b3-b549-560e19d6a033 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:35.179904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-9491c3b1-1080-4c85-9d62-4d46fe04c439 req-f4b0f60d-60b4-41b3-b549-560e19d6a033 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:35.191736 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-9491c3b1-1080-4c85-9d62-4d46fe04c439 req-f4b0f60d-60b4-41b3-b549-560e19d6a033 service nova] Creating event network-changed:0ec8d161-58d8-4fd8-b70d-e199942b5c61 for instance b2d727f7-b4a4-4808-a943-070ff34dc897 on n-h2-858383-15 Oct 24 11:37:35.196875 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-9491c3b1-1080-4c85-9d62-4d46fe04c439 req-f4b0f60d-60b4-41b3-b549-560e19d6a033 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033769 Oct 24 11:37:35.197386 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3778/7530] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:37:36.130025 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d75c3867-da1b-434d-8a3f-b7208af691c8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:36.130662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d75c3867-da1b-434d-8a3f-b7208af691c8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:36.132594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:37:36.138992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d75c3867-da1b-434d-8a3f-b7208af691c8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:36.139616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d75c3867-da1b-434d-8a3f-b7208af691c8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:36.140248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d75c3867-da1b-434d-8a3f-b7208af691c8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:36.141004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d75c3867-da1b-434d-8a3f-b7208af691c8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:36.141480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d75c3867-da1b-434d-8a3f-b7208af691c8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:36.141926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d75c3867-da1b-434d-8a3f-b7208af691c8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:36.275968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d75c3867-da1b-434d-8a3f-b7208af691c8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:36.284980 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d75c3867-da1b-434d-8a3f-b7208af691c8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1357 microversion: 2.1 time: 0.158833 Oct 24 11:37:36.285571 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3753/7531] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:36 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:37:37.304953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:37:37.305645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:37:37.310595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-684638ab-a485-47a9-945e-f1cd023d185b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:37.311334 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-684638ab-a485-47a9-945e-f1cd023d185b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:37.318673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-684638ab-a485-47a9-945e-f1cd023d185b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:37.319165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-684638ab-a485-47a9-945e-f1cd023d185b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:37.319604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-684638ab-a485-47a9-945e-f1cd023d185b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:37.320295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-684638ab-a485-47a9-945e-f1cd023d185b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:37.320752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-684638ab-a485-47a9-945e-f1cd023d185b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:37.321206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-684638ab-a485-47a9-945e-f1cd023d185b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:37.455576 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-684638ab-a485-47a9-945e-f1cd023d185b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:37.463421 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-684638ab-a485-47a9-945e-f1cd023d185b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1357 microversion: 2.1 time: 0.159538 Oct 24 11:37:37.464047 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3779/7532] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:37 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:37:38.487746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-775e6271-0e89-403c-94eb-4449fe0c479f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:38.488387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-775e6271-0e89-403c-94eb-4449fe0c479f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:38.495305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-775e6271-0e89-403c-94eb-4449fe0c479f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:38.495807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-775e6271-0e89-403c-94eb-4449fe0c479f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:38.496266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-775e6271-0e89-403c-94eb-4449fe0c479f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:38.497026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-775e6271-0e89-403c-94eb-4449fe0c479f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:38.497507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-775e6271-0e89-403c-94eb-4449fe0c479f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:38.497952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-775e6271-0e89-403c-94eb-4449fe0c479f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:38.627720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-775e6271-0e89-403c-94eb-4449fe0c479f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:38.635732 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-775e6271-0e89-403c-94eb-4449fe0c479f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1357 microversion: 2.1 time: 0.152664 Oct 24 11:37:38.636312 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3754/7533] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:38 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:37:39.659535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ecce3276-fc6a-4cc6-b35c-bbd7bf65e1db tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:39.660132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ecce3276-fc6a-4cc6-b35c-bbd7bf65e1db tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:39.667312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ecce3276-fc6a-4cc6-b35c-bbd7bf65e1db tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:39.667793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ecce3276-fc6a-4cc6-b35c-bbd7bf65e1db tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:39.668234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ecce3276-fc6a-4cc6-b35c-bbd7bf65e1db tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:39.668974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ecce3276-fc6a-4cc6-b35c-bbd7bf65e1db tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:39.669433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ecce3276-fc6a-4cc6-b35c-bbd7bf65e1db tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:39.669862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ecce3276-fc6a-4cc6-b35c-bbd7bf65e1db tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:39.801573 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ecce3276-fc6a-4cc6-b35c-bbd7bf65e1db tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:39.809207 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ecce3276-fc6a-4cc6-b35c-bbd7bf65e1db tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1357 microversion: 2.1 time: 0.154287 Oct 24 11:37:39.809803 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3780/7534] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:39 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:37:40.832396 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-755f79ab-7eda-495d-9fb5-069c375b4be1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:40.832975 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-755f79ab-7eda-495d-9fb5-069c375b4be1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:40.839804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-755f79ab-7eda-495d-9fb5-069c375b4be1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:40.840299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-755f79ab-7eda-495d-9fb5-069c375b4be1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:40.840750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-755f79ab-7eda-495d-9fb5-069c375b4be1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:40.842264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-755f79ab-7eda-495d-9fb5-069c375b4be1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:40.842553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-755f79ab-7eda-495d-9fb5-069c375b4be1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:40.843000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-755f79ab-7eda-495d-9fb5-069c375b4be1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:40.992175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-755f79ab-7eda-495d-9fb5-069c375b4be1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:40.999982 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-755f79ab-7eda-495d-9fb5-069c375b4be1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1357 microversion: 2.1 time: 0.171780 Oct 24 11:37:41.000557 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3755/7535] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:40 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:37:41.087954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-0f32b5be-b70a-4fbc-87c7-d1f8d5e4ff96 req-a7f4ebd9-e2ce-41af-b373-97646a923ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d727f7-b4a4-4808-a943-070ff34dc897", "name": "network-vif-plugged", "status": "completed", "tag": "0ec8d161-58d8-4fd8-b70d-e199942b5c61"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:37:41.099718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-0f32b5be-b70a-4fbc-87c7-d1f8d5e4ff96 req-a7f4ebd9-e2ce-41af-b373-97646a923ea0 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:41.100407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-0f32b5be-b70a-4fbc-87c7-d1f8d5e4ff96 req-a7f4ebd9-e2ce-41af-b373-97646a923ea0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:41.101090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-0f32b5be-b70a-4fbc-87c7-d1f8d5e4ff96 req-a7f4ebd9-e2ce-41af-b373-97646a923ea0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:41.116421 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-0f32b5be-b70a-4fbc-87c7-d1f8d5e4ff96 req-a7f4ebd9-e2ce-41af-b373-97646a923ea0 service nova] Creating event network-vif-plugged:0ec8d161-58d8-4fd8-b70d-e199942b5c61 for instance b2d727f7-b4a4-4808-a943-070ff34dc897 on n-h2-858383-15 Oct 24 11:37:41.122064 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-0f32b5be-b70a-4fbc-87c7-d1f8d5e4ff96 req-a7f4ebd9-e2ce-41af-b373-97646a923ea0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037883 Oct 24 11:37:41.122978 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3781/7536] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:37:42.023056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-554ca6e3-093f-4f00-9cb8-c78a77c3142b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:42.023681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-554ca6e3-093f-4f00-9cb8-c78a77c3142b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:42.030309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-554ca6e3-093f-4f00-9cb8-c78a77c3142b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:42.030802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-554ca6e3-093f-4f00-9cb8-c78a77c3142b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:42.031252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-554ca6e3-093f-4f00-9cb8-c78a77c3142b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:42.031953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-554ca6e3-093f-4f00-9cb8-c78a77c3142b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:42.032514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-554ca6e3-093f-4f00-9cb8-c78a77c3142b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:42.033135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-554ca6e3-093f-4f00-9cb8-c78a77c3142b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:42.163268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-554ca6e3-093f-4f00-9cb8-c78a77c3142b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:42.171018 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-554ca6e3-093f-4f00-9cb8-c78a77c3142b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1357 microversion: 2.1 time: 0.151942 Oct 24 11:37:42.171594 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3756/7537] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:42 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:37:43.195527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f6ea94be-171a-4ae8-9b75-98aa75101eaa tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:43.196265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f6ea94be-171a-4ae8-9b75-98aa75101eaa tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:43.203422 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6ea94be-171a-4ae8-9b75-98aa75101eaa tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:43.203908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6ea94be-171a-4ae8-9b75-98aa75101eaa tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:43.205277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6ea94be-171a-4ae8-9b75-98aa75101eaa tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:43.206065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6ea94be-171a-4ae8-9b75-98aa75101eaa tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:43.206528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6ea94be-171a-4ae8-9b75-98aa75101eaa tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:43.206962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f6ea94be-171a-4ae8-9b75-98aa75101eaa tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:43.339810 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f6ea94be-171a-4ae8-9b75-98aa75101eaa tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:43.347613 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f6ea94be-171a-4ae8-9b75-98aa75101eaa tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1546 microversion: 2.1 time: 0.156394 Oct 24 11:37:43.348186 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3782/7538] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:43 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:37:43.369989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a45b9198-1546-4be1-8c68-2e2df5bbc5d6 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:43.370624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a45b9198-1546-4be1-8c68-2e2df5bbc5d6 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:43.378428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a45b9198-1546-4be1-8c68-2e2df5bbc5d6 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:43.378903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a45b9198-1546-4be1-8c68-2e2df5bbc5d6 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:43.379359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a45b9198-1546-4be1-8c68-2e2df5bbc5d6 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:43.380072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a45b9198-1546-4be1-8c68-2e2df5bbc5d6 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:43.380543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a45b9198-1546-4be1-8c68-2e2df5bbc5d6 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:43.381020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a45b9198-1546-4be1-8c68-2e2df5bbc5d6 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:43.509162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a45b9198-1546-4be1-8c68-2e2df5bbc5d6 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:43.517605 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a45b9198-1546-4be1-8c68-2e2df5bbc5d6 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1546 microversion: 2.1 time: 0.150761 Oct 24 11:37:43.518194 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3757/7539] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:43 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:37:43.539908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-13eb4960-5615-423f-84f8-edd50a2007fd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:43.544570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-13eb4960-5615-423f-84f8-edd50a2007fd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:43.545371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-13eb4960-5615-423f-84f8-edd50a2007fd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Searching by: {'deleted': False, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 11:37:43.550804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13eb4960-5615-423f-84f8-edd50a2007fd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:43.551283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13eb4960-5615-423f-84f8-edd50a2007fd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:43.551718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13eb4960-5615-423f-84f8-edd50a2007fd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:43.552442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13eb4960-5615-423f-84f8-edd50a2007fd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:43.552924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13eb4960-5615-423f-84f8-edd50a2007fd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:43.553355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-13eb4960-5615-423f-84f8-edd50a2007fd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:43.576597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-13eb4960-5615-423f-84f8-edd50a2007fd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 11:37:43.605067 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-13eb4960-5615-423f-84f8-edd50a2007fd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069141 Oct 24 11:37:43.605663 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3783/7540] 10.222.0.50 () {58 vars in 1125 bytes} [Mon Oct 24 11:37:43 2022] GET /compute/v2.1/servers => generated 342 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:37:43.617817 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-640f05c0-9cad-4dcc-9b22-aceff2bfbc0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:43.618446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-640f05c0-9cad-4dcc-9b22-aceff2bfbc0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:43.624460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-640f05c0-9cad-4dcc-9b22-aceff2bfbc0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:43.625078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-640f05c0-9cad-4dcc-9b22-aceff2bfbc0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:43.625537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-640f05c0-9cad-4dcc-9b22-aceff2bfbc0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:43.626462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-640f05c0-9cad-4dcc-9b22-aceff2bfbc0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:43.627187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-640f05c0-9cad-4dcc-9b22-aceff2bfbc0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:43.627642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-640f05c0-9cad-4dcc-9b22-aceff2bfbc0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:43.755533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-640f05c0-9cad-4dcc-9b22-aceff2bfbc0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:43.763566 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-640f05c0-9cad-4dcc-9b22-aceff2bfbc0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1546 microversion: 2.1 time: 0.149699 Oct 24 11:37:43.764141 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3758/7541] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:43 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:37:45.308339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9bcfe6d5-3245-4bf3-907d-0ce886e1a9a1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb205c25-d82d-4a48-a085-7a4d939dffa5"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:37:45.310755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9bcfe6d5-3245-4bf3-907d-0ce886e1a9a1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:45.318465 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bcfe6d5-3245-4bf3-907d-0ce886e1a9a1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:45.318982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bcfe6d5-3245-4bf3-907d-0ce886e1a9a1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:45.319424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bcfe6d5-3245-4bf3-907d-0ce886e1a9a1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:45.320122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bcfe6d5-3245-4bf3-907d-0ce886e1a9a1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:45.320583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bcfe6d5-3245-4bf3-907d-0ce886e1a9a1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:45.321058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9bcfe6d5-3245-4bf3-907d-0ce886e1a9a1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:45.581100 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9bcfe6d5-3245-4bf3-907d-0ce886e1a9a1 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "POST /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275586 Oct 24 11:37:45.581729 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3784/7542] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 11:37:45 2022] POST /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:37:58.641770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a817937d-eaef-499f-85b2-194426c65d6b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:37:58.643064 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a817937d-eaef-499f-85b2-194426c65d6b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:37:58.645789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:37:58.646465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=60 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:37:58.652467 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a817937d-eaef-499f-85b2-194426c65d6b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:58.653000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a817937d-eaef-499f-85b2-194426c65d6b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:58.653457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a817937d-eaef-499f-85b2-194426c65d6b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:58.654170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a817937d-eaef-499f-85b2-194426c65d6b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:37:58.654644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a817937d-eaef-499f-85b2-194426c65d6b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:37:58.655090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a817937d-eaef-499f-85b2-194426c65d6b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:37:58.789571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a817937d-eaef-499f-85b2-194426c65d6b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:37:58.797957 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a817937d-eaef-499f-85b2-194426c65d6b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1592 microversion: 2.1 time: 0.160059 Oct 24 11:37:58.798585 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3759/7543] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:37:58 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1592 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:38:00.830757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-73bc8170-ab78-4ffe-a753-be37b754c0db req-940ca6fd-6f4b-4aba-a20e-b0fcf6c3e18f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2d727f7-b4a4-4808-a943-070ff34dc897", "tag": "0ec8d161-58d8-4fd8-b70d-e199942b5c61"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:38:00.840887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:38:00.841556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:38:00.842317 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:38:00.844861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-73bc8170-ab78-4ffe-a753-be37b754c0db req-940ca6fd-6f4b-4aba-a20e-b0fcf6c3e18f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:38:00.846842 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-73bc8170-ab78-4ffe-a753-be37b754c0db req-940ca6fd-6f4b-4aba-a20e-b0fcf6c3e18f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:38:00.847320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-73bc8170-ab78-4ffe-a753-be37b754c0db req-940ca6fd-6f4b-4aba-a20e-b0fcf6c3e18f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:38:00.861973 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-73bc8170-ab78-4ffe-a753-be37b754c0db req-940ca6fd-6f4b-4aba-a20e-b0fcf6c3e18f service nova] Creating event network-changed:0ec8d161-58d8-4fd8-b70d-e199942b5c61 for instance b2d727f7-b4a4-4808-a943-070ff34dc897 on n-h2-858383-15 Oct 24 11:38:00.867373 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-73bc8170-ab78-4ffe-a753-be37b754c0db req-940ca6fd-6f4b-4aba-a20e-b0fcf6c3e18f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041920 Oct 24 11:38:00.868192 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3785/7544] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:38:01.871282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9a651c79-de64-4153-8688-a5f354181a12 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1481780002"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:38:01.871852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9a651c79-de64-4153-8688-a5f354181a12 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:38:01.878992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a651c79-de64-4153-8688-a5f354181a12 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:38:01.879507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a651c79-de64-4153-8688-a5f354181a12 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:38:01.879971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a651c79-de64-4153-8688-a5f354181a12 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:38:01.880698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a651c79-de64-4153-8688-a5f354181a12 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:38:01.881211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a651c79-de64-4153-8688-a5f354181a12 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:38:01.881663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9a651c79-de64-4153-8688-a5f354181a12 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:38:02.017211 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.network.security_group_api [None req-9a651c79-de64-4153-8688-a5f354181a12 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Adding security group f7ffe51d-7396-4481-bcbd-00554b019cbb to port 0ec8d161-58d8-4fd8-b70d-e199942b5c61 Oct 24 11:38:02.331107 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9a651c79-de64-4153-8688-a5f354181a12 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "POST /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/action" status: 202 len: 0 microversion: 2.1 time: 0.463803 Oct 24 11:38:02.331746 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3760/7545] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:38:01 2022] POST /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:38:02.341374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-66a6959d-dc20-479c-8e1a-c8373dafd5e0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:38:02.342113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-66a6959d-dc20-479c-8e1a-c8373dafd5e0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:38:02.348938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66a6959d-dc20-479c-8e1a-c8373dafd5e0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:38:02.349433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66a6959d-dc20-479c-8e1a-c8373dafd5e0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:38:02.349869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66a6959d-dc20-479c-8e1a-c8373dafd5e0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:38:02.350572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66a6959d-dc20-479c-8e1a-c8373dafd5e0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:38:02.351021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66a6959d-dc20-479c-8e1a-c8373dafd5e0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:38:02.351447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-66a6959d-dc20-479c-8e1a-c8373dafd5e0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:38:02.502602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a165d346-ef41-4489-af6b-3bbb3fae905f req-4098b61e-892e-4179-abcf-c17e8419107b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2d727f7-b4a4-4808-a943-070ff34dc897", "tag": "0ec8d161-58d8-4fd8-b70d-e199942b5c61"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:38:02.513363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a165d346-ef41-4489-af6b-3bbb3fae905f req-4098b61e-892e-4179-abcf-c17e8419107b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:38:02.514175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a165d346-ef41-4489-af6b-3bbb3fae905f req-4098b61e-892e-4179-abcf-c17e8419107b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:38:02.514814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a165d346-ef41-4489-af6b-3bbb3fae905f req-4098b61e-892e-4179-abcf-c17e8419107b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:38:02.528183 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a165d346-ef41-4489-af6b-3bbb3fae905f req-4098b61e-892e-4179-abcf-c17e8419107b service nova] Creating event network-changed:0ec8d161-58d8-4fd8-b70d-e199942b5c61 for instance b2d727f7-b4a4-4808-a943-070ff34dc897 on n-h2-858383-15 Oct 24 11:38:02.530978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-66a6959d-dc20-479c-8e1a-c8373dafd5e0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:38:02.536663 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a165d346-ef41-4489-af6b-3bbb3fae905f req-4098b61e-892e-4179-abcf-c17e8419107b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199715 Oct 24 11:38:02.537817 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3761/7546] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:38:02.540982 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-66a6959d-dc20-479c-8e1a-c8373dafd5e0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1758 microversion: 2.1 time: 0.204641 Oct 24 11:38:02.541779 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3786/7547] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:38:02 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1758 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:39:40.371605 n-d-858383-15 devstack@n-api.service[120425]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1abc338e-6c14-4311-a7b3-814582834b4a] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 11:39:40.373005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:39:40.373816 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:39:40.375476 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:39:40.375608 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:39:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/action (ip 10.222.0.50) !!! Oct 24 11:39:40.387843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-00f5b0a8-4ae6-4d73-8964-ca5bb1412762 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:39:40.390261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-00f5b0a8-4ae6-4d73-8964-ca5bb1412762 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:39:40.397537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00f5b0a8-4ae6-4d73-8964-ca5bb1412762 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:39:40.398046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00f5b0a8-4ae6-4d73-8964-ca5bb1412762 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:39:40.398505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00f5b0a8-4ae6-4d73-8964-ca5bb1412762 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:39:40.399220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00f5b0a8-4ae6-4d73-8964-ca5bb1412762 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:39:40.399965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00f5b0a8-4ae6-4d73-8964-ca5bb1412762 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:39:40.400417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-00f5b0a8-4ae6-4d73-8964-ca5bb1412762 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:39:40.472991 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-00f5b0a8-4ae6-4d73-8964-ca5bb1412762 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "POST /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/action" status: 202 len: 0 microversion: 2.1 time: 0.102921 Oct 24 11:39:40.474350 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3762/7548] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:39:40 2022] POST /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:39:40.480679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:39:40.481495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=8 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:39:40.482429 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 24 11:39:40.487904 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6ae4432b-baf3-4183-ad42-5273c7504832 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:39:40.488520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6ae4432b-baf3-4183-ad42-5273c7504832 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:39:40.495784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ae4432b-baf3-4183-ad42-5273c7504832 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:39:40.496263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ae4432b-baf3-4183-ad42-5273c7504832 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:39:40.496698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ae4432b-baf3-4183-ad42-5273c7504832 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:39:40.497516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ae4432b-baf3-4183-ad42-5273c7504832 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:39:40.497974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ae4432b-baf3-4183-ad42-5273c7504832 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:39:40.498398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6ae4432b-baf3-4183-ad42-5273c7504832 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:39:40.711213 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6ae4432b-baf3-4183-ad42-5273c7504832 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:39:40.719514 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6ae4432b-baf3-4183-ad42-5273c7504832 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1760 microversion: 2.1 time: 0.240827 Oct 24 11:39:40.720116 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3787/7549] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:39:40 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1760 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:39:41.745071 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f6b9fc57-4c11-4408-a9a1-6c8004c07670 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:39:41.745789 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f6b9fc57-4c11-4408-a9a1-6c8004c07670 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:39:41.756209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6b9fc57-4c11-4408-a9a1-6c8004c07670 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:39:41.756709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6b9fc57-4c11-4408-a9a1-6c8004c07670 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:39:41.757188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6b9fc57-4c11-4408-a9a1-6c8004c07670 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:39:41.757896 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6b9fc57-4c11-4408-a9a1-6c8004c07670 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:39:41.758363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6b9fc57-4c11-4408-a9a1-6c8004c07670 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:39:41.758805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f6b9fc57-4c11-4408-a9a1-6c8004c07670 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:39:41.766407 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] [1abc338e-6c14-4311-a7b3-814582834b4a] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 50384. Oct 24 11:39:41.962798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f6b9fc57-4c11-4408-a9a1-6c8004c07670 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:39:41.971077 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f6b9fc57-4c11-4408-a9a1-6c8004c07670 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1758 microversion: 2.1 time: 0.230381 Oct 24 11:39:41.971649 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3763/7550] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:39:41 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1758 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:40:54.911761 n-d-858383-15 devstack@n-api.service[120426]: ERROR oslo.messaging._drivers.impl_rabbit [-] [666865aa-442b-4005-907b-9c648cd2f782] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 11:40:54.912608 n-d-858383-15 devstack@n-api.service[120426]: ERROR oslo.messaging._drivers.impl_rabbit [-] [05048d7c-6448-4d6e-b9e7-4fa04d95d8b6] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 11:40:54.913149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:40:54.913966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:40:54.918263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c485f86a-2ec1-4d35-a7f8-37a78fa8787d tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1481780002"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:40:54.918802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c485f86a-2ec1-4d35-a7f8-37a78fa8787d tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:40:54.925529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c485f86a-2ec1-4d35-a7f8-37a78fa8787d tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:40:54.926014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c485f86a-2ec1-4d35-a7f8-37a78fa8787d tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:40:54.926457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c485f86a-2ec1-4d35-a7f8-37a78fa8787d tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:40:54.927150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c485f86a-2ec1-4d35-a7f8-37a78fa8787d tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:40:54.927603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c485f86a-2ec1-4d35-a7f8-37a78fa8787d tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:40:54.928028 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c485f86a-2ec1-4d35-a7f8-37a78fa8787d tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:40:55.055982 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.network.security_group_api [None req-c485f86a-2ec1-4d35-a7f8-37a78fa8787d tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Removing security group f7ffe51d-7396-4481-bcbd-00554b019cbb from port 0ec8d161-58d8-4fd8-b70d-e199942b5c61 Oct 24 11:40:55.363243 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c485f86a-2ec1-4d35-a7f8-37a78fa8787d tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "POST /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/action" status: 202 len: 0 microversion: 2.1 time: 0.453210 Oct 24 11:40:55.368532 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3788/7551] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:40:54 2022] POST /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:40:55.370523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:40:55.371292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:40:55.375259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-6ae7fc02-e4d0-4408-b62a-e98d76f815ec req-bc2beffc-44df-4e55-9159-4bd08718e1bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2d727f7-b4a4-4808-a943-070ff34dc897", "tag": "0ec8d161-58d8-4fd8-b70d-e199942b5c61"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:40:55.388861 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6ae7fc02-e4d0-4408-b62a-e98d76f815ec req-bc2beffc-44df-4e55-9159-4bd08718e1bc service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:40:55.389358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6ae7fc02-e4d0-4408-b62a-e98d76f815ec req-bc2beffc-44df-4e55-9159-4bd08718e1bc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:40:55.389809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6ae7fc02-e4d0-4408-b62a-e98d76f815ec req-bc2beffc-44df-4e55-9159-4bd08718e1bc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:40:55.402429 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-6ae7fc02-e4d0-4408-b62a-e98d76f815ec req-bc2beffc-44df-4e55-9159-4bd08718e1bc service nova] Creating event network-changed:0ec8d161-58d8-4fd8-b70d-e199942b5c61 for instance b2d727f7-b4a4-4808-a943-070ff34dc897 on n-h2-858383-15 Oct 24 11:40:55.407816 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-6ae7fc02-e4d0-4408-b62a-e98d76f815ec req-bc2beffc-44df-4e55-9159-4bd08718e1bc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039447 Oct 24 11:40:55.408811 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3764/7552] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:40:56.498558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-acc6c315-ef27-4203-9113-8d1dc8bf3246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:40:56.499088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-acc6c315-ef27-4203-9113-8d1dc8bf3246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:40:56.509174 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] [05048d7c-6448-4d6e-b9e7-4fa04d95d8b6] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 50426. Oct 24 11:40:56.509911 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] [666865aa-442b-4005-907b-9c648cd2f782] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 50424. Oct 24 11:40:56.511373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-acc6c315-ef27-4203-9113-8d1dc8bf3246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:40:56.511857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-acc6c315-ef27-4203-9113-8d1dc8bf3246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:40:56.512295 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-acc6c315-ef27-4203-9113-8d1dc8bf3246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:40:56.513032 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-acc6c315-ef27-4203-9113-8d1dc8bf3246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:40:56.513488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-acc6c315-ef27-4203-9113-8d1dc8bf3246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:40:56.513922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-acc6c315-ef27-4203-9113-8d1dc8bf3246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:40:56.599283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-acc6c315-ef27-4203-9113-8d1dc8bf3246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lazy-loading 'services' on Instance uuid b2d727f7-b4a4-4808-a943-070ff34dc897 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:40:56.673406 n-d-858383-15 devstack@n-api.service[120426]: ERROR oslo.messaging._drivers.impl_rabbit [None req-acc6c315-ef27-4203-9113-8d1dc8bf3246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [6f48cbbf-26ce-487a-82f7-1b4fd7c96ef9] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 11:40:57.428042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-99d7bbcf-8b87-437a-bb4c-e60c590d027f req-952df126-6bfe-4f85-9e2c-3aa3a18de5cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2d727f7-b4a4-4808-a943-070ff34dc897", "tag": "0ec8d161-58d8-4fd8-b70d-e199942b5c61"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:40:57.437843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-99d7bbcf-8b87-437a-bb4c-e60c590d027f req-952df126-6bfe-4f85-9e2c-3aa3a18de5cc service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:40:57.438335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-99d7bbcf-8b87-437a-bb4c-e60c590d027f req-952df126-6bfe-4f85-9e2c-3aa3a18de5cc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:40:57.438785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-99d7bbcf-8b87-437a-bb4c-e60c590d027f req-952df126-6bfe-4f85-9e2c-3aa3a18de5cc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:40:57.450138 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-99d7bbcf-8b87-437a-bb4c-e60c590d027f req-952df126-6bfe-4f85-9e2c-3aa3a18de5cc service nova] Creating event network-changed:0ec8d161-58d8-4fd8-b70d-e199942b5c61 for instance b2d727f7-b4a4-4808-a943-070ff34dc897 on n-h2-858383-15 Oct 24 11:40:57.454977 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-99d7bbcf-8b87-437a-bb4c-e60c590d027f req-952df126-6bfe-4f85-9e2c-3aa3a18de5cc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032062 Oct 24 11:40:57.455726 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3765/7553] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:40:57.681878 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [None req-acc6c315-ef27-4203-9113-8d1dc8bf3246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [6f48cbbf-26ce-487a-82f7-1b4fd7c96ef9] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 50434. Oct 24 11:40:57.685811 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-acc6c315-ef27-4203-9113-8d1dc8bf3246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments/cb205c25-d82d-4a48-a085-7a4d939dffa5" status: 202 len: 0 microversion: 2.1 time: 1.193918 Oct 24 11:40:57.686429 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3789/7554] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 11:40:56 2022] DELETE /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments/cb205c25-d82d-4a48-a085-7a4d939dffa5 => generated 0 bytes in 1195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:40:57.696278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-63f8a5f3-cde5-4c40-8d37-da762f3d21cb tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:40:57.698669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-63f8a5f3-cde5-4c40-8d37-da762f3d21cb tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:40:57.705535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63f8a5f3-cde5-4c40-8d37-da762f3d21cb tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:40:57.706053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63f8a5f3-cde5-4c40-8d37-da762f3d21cb tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:40:57.706595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63f8a5f3-cde5-4c40-8d37-da762f3d21cb tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:40:57.707337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63f8a5f3-cde5-4c40-8d37-da762f3d21cb tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:40:57.707887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63f8a5f3-cde5-4c40-8d37-da762f3d21cb tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:40:57.708342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-63f8a5f3-cde5-4c40-8d37-da762f3d21cb tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:40:57.740295 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-63f8a5f3-cde5-4c40-8d37-da762f3d21cb tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049271 Oct 24 11:40:57.745709 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3766/7555] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:40:57 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:40:58.755214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c9fea3d8-a890-4381-9ea5-69ab4de5eab8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:40:58.757968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c9fea3d8-a890-4381-9ea5-69ab4de5eab8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:40:58.765006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9fea3d8-a890-4381-9ea5-69ab4de5eab8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:40:58.765493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9fea3d8-a890-4381-9ea5-69ab4de5eab8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:40:58.765930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9fea3d8-a890-4381-9ea5-69ab4de5eab8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:40:58.766622 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9fea3d8-a890-4381-9ea5-69ab4de5eab8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:40:58.767067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9fea3d8-a890-4381-9ea5-69ab4de5eab8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:40:58.767497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c9fea3d8-a890-4381-9ea5-69ab4de5eab8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:40:58.800192 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c9fea3d8-a890-4381-9ea5-69ab4de5eab8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049979 Oct 24 11:40:58.801070 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3790/7556] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:40:58 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:40:59.813581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7288e105-6fe1-46ec-853c-41d2871fd9f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:40:59.815849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7288e105-6fe1-46ec-853c-41d2871fd9f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:40:59.823658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7288e105-6fe1-46ec-853c-41d2871fd9f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:40:59.824173 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7288e105-6fe1-46ec-853c-41d2871fd9f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:40:59.824673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7288e105-6fe1-46ec-853c-41d2871fd9f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:40:59.825430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7288e105-6fe1-46ec-853c-41d2871fd9f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:40:59.825915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7288e105-6fe1-46ec-853c-41d2871fd9f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:40:59.826365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7288e105-6fe1-46ec-853c-41d2871fd9f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:40:59.858144 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7288e105-6fe1-46ec-853c-41d2871fd9f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048657 Oct 24 11:40:59.858722 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3767/7557] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:40:59 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:41:00.871124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-84bcc6c5-7578-454c-81e1-dc1168e89ae8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:00.873227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-84bcc6c5-7578-454c-81e1-dc1168e89ae8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:00.880091 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84bcc6c5-7578-454c-81e1-dc1168e89ae8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:00.880574 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84bcc6c5-7578-454c-81e1-dc1168e89ae8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:00.881038 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84bcc6c5-7578-454c-81e1-dc1168e89ae8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:00.882330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84bcc6c5-7578-454c-81e1-dc1168e89ae8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:00.882841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84bcc6c5-7578-454c-81e1-dc1168e89ae8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:00.883269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84bcc6c5-7578-454c-81e1-dc1168e89ae8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:00.913460 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-84bcc6c5-7578-454c-81e1-dc1168e89ae8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046434 Oct 24 11:41:00.914030 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3791/7558] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:41:00 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:41:01.926307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d1b06d0c-674b-4e1a-a0e0-bea09754abb2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:01.929241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d1b06d0c-674b-4e1a-a0e0-bea09754abb2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:01.936159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1b06d0c-674b-4e1a-a0e0-bea09754abb2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:01.936666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1b06d0c-674b-4e1a-a0e0-bea09754abb2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:01.937155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1b06d0c-674b-4e1a-a0e0-bea09754abb2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:01.937888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1b06d0c-674b-4e1a-a0e0-bea09754abb2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:01.938363 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1b06d0c-674b-4e1a-a0e0-bea09754abb2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:01.938809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d1b06d0c-674b-4e1a-a0e0-bea09754abb2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:01.970885 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d1b06d0c-674b-4e1a-a0e0-bea09754abb2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048542 Oct 24 11:41:01.971458 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3768/7559] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:41:01 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:41:02.984313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5035314c-f8c5-4261-bb46-cca8966bb55a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:02.987081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5035314c-f8c5-4261-bb46-cca8966bb55a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:02.994878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5035314c-f8c5-4261-bb46-cca8966bb55a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:02.995361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5035314c-f8c5-4261-bb46-cca8966bb55a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:02.995801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5035314c-f8c5-4261-bb46-cca8966bb55a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:02.996493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5035314c-f8c5-4261-bb46-cca8966bb55a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:02.996980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5035314c-f8c5-4261-bb46-cca8966bb55a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:02.997410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5035314c-f8c5-4261-bb46-cca8966bb55a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:03.026578 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5035314c-f8c5-4261-bb46-cca8966bb55a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046343 Oct 24 11:41:03.027137 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3792/7560] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:41:02 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 11:41:03.037811 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d711a9ee-3488-4aae-8641-8d75b3e06cc5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:03.038334 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d711a9ee-3488-4aae-8641-8d75b3e06cc5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:03.045733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d711a9ee-3488-4aae-8641-8d75b3e06cc5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:03.046240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d711a9ee-3488-4aae-8641-8d75b3e06cc5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:03.046704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d711a9ee-3488-4aae-8641-8d75b3e06cc5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:03.047424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d711a9ee-3488-4aae-8641-8d75b3e06cc5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:03.047904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d711a9ee-3488-4aae-8641-8d75b3e06cc5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:03.048353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d711a9ee-3488-4aae-8641-8d75b3e06cc5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:03.124776 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-d711a9ee-3488-4aae-8641-8d75b3e06cc5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] HTTP exception thrown: Instance b2d727f7-b4a4-4808-a943-070ff34dc897 is not attached to volume cb205c25-d82d-4a48-a085-7a4d939dffa5 Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d711a9ee-3488-4aae-8641-8d75b3e06cc5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Request method failure captured: Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: request: DELETE /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments/cb205c25-d82d-4a48-a085-7a4d939dffa5 HTTP/1.1 Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnjmgYK4gup8u2PtLT5CPqekpSei60DHS44JZayMxrR_6YrZLDgEHNUBDNPX3SzLIdpgbYpXUwyTEyqOmrgvDf8G35OTqV9cc-FvlwQuftpgkb2ftFvLgkQ0ekOYhdGvbf9T7So2GeSiWfXEzRMb9jflTEH-POwndSCQcTMpUEiMgxU Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: ed3f0cb78cc7439181175560e01c94f1 Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestMinimumBasicScenario-1454217101 Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed3f0cb78cc7439181175560e01c94f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed3f0cb78cc7439181175560e01c94f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed3f0cb78cc7439181175560e01c94f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed3f0cb78cc7439181175560e01c94f1", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestMinimumBasicScenario-1454217101 Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: ed3f0cb78cc7439181175560e01c94f1 Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1454217101 Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestMinimumBasicScenario-1454217101-project Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 815407dc849a4da0a3d924139e50cf9f Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestMinimumBasicScenario-1454217101-project Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance b2d727f7-b4a4-4808-a943-070ff34dc897 is not attached to volume cb205c25-d82d-4a48-a085-7a4d939dffa5 Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'server_id': 'b2d727f7-b4a4-4808-a943-070ff34dc897', 'id': 'cb205c25-d82d-4a48-a085-7a4d939dffa5'} Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cb205c25-d82d-4a48-a085-7a4d939dffa5. Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2d727f7-b4a4-4808-a943-070ff34dc897 is not attached to volume cb205c25-d82d-4a48-a085-7a4d939dffa5 Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:41:03.126699 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:41:03.130886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:41:03.130886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:41:03.130886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2d727f7-b4a4-4808-a943-070ff34dc897 is not attached to volume cb205c25-d82d-4a48-a085-7a4d939dffa5 Oct 24 11:41:03.130886 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:41:03.130886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d711a9ee-3488-4aae-8641-8d75b3e06cc5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Returning 404 to user: Instance b2d727f7-b4a4-4808-a943-070ff34dc897 is not attached to volume cb205c25-d82d-4a48-a085-7a4d939dffa5 {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:41:03.130886 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d711a9ee-3488-4aae-8641-8d75b3e06cc5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments/cb205c25-d82d-4a48-a085-7a4d939dffa5" status: 404 len: 154 microversion: 2.1 time: 0.094851 Oct 24 11:41:03.130886 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3769/7561] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 11:41:03 2022] DELETE /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897/os-volume_attachments/cb205c25-d82d-4a48-a085-7a4d939dffa5 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:41:06.392020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ea398da8-cd60-4eee-9d54-722ded18e47e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:06.392515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ea398da8-cd60-4eee-9d54-722ded18e47e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:06.400215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea398da8-cd60-4eee-9d54-722ded18e47e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:06.400703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea398da8-cd60-4eee-9d54-722ded18e47e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:06.401167 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea398da8-cd60-4eee-9d54-722ded18e47e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:06.401867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea398da8-cd60-4eee-9d54-722ded18e47e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:06.402326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea398da8-cd60-4eee-9d54-722ded18e47e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:06.402759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ea398da8-cd60-4eee-9d54-722ded18e47e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:06.428509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ea398da8-cd60-4eee-9d54-722ded18e47e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:41:06.515283 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ea398da8-cd60-4eee-9d54-722ded18e47e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 204 len: 0 microversion: 2.1 time: 0.126808 Oct 24 11:41:06.519286 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3793/7562] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:41:06 2022] DELETE /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:41:06.525546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0efbe2d4-e066-4e62-9032-587ec973e08f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:06.526197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0efbe2d4-e066-4e62-9032-587ec973e08f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:06.533500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0efbe2d4-e066-4e62-9032-587ec973e08f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:06.534012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0efbe2d4-e066-4e62-9032-587ec973e08f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:06.534471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0efbe2d4-e066-4e62-9032-587ec973e08f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:06.535209 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0efbe2d4-e066-4e62-9032-587ec973e08f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:06.535710 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0efbe2d4-e066-4e62-9032-587ec973e08f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:06.536494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0efbe2d4-e066-4e62-9032-587ec973e08f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:06.675787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0efbe2d4-e066-4e62-9032-587ec973e08f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:06.683965 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0efbe2d4-e066-4e62-9032-587ec973e08f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1552 microversion: 2.1 time: 0.163303 Oct 24 11:41:06.684554 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3770/7563] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:06 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:07.708320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e247634c-d4ff-4628-b9b5-22de53225af7 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:07.709044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e247634c-d4ff-4628-b9b5-22de53225af7 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:07.715941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e247634c-d4ff-4628-b9b5-22de53225af7 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:07.716416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e247634c-d4ff-4628-b9b5-22de53225af7 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:07.716877 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e247634c-d4ff-4628-b9b5-22de53225af7 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:07.717592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e247634c-d4ff-4628-b9b5-22de53225af7 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:07.718070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e247634c-d4ff-4628-b9b5-22de53225af7 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:07.718492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e247634c-d4ff-4628-b9b5-22de53225af7 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:07.848508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e247634c-d4ff-4628-b9b5-22de53225af7 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:07.857038 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e247634c-d4ff-4628-b9b5-22de53225af7 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1552 microversion: 2.1 time: 0.153200 Oct 24 11:41:07.857606 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3794/7564] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:07 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:41:08.777008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a4e69053-7e9d-49e7-bf31-3773b341c806 req-c0627c57-2c4e-48e0-a0b1-b5cf0ac9e39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d727f7-b4a4-4808-a943-070ff34dc897", "name": "network-vif-deleted", "tag": "0ec8d161-58d8-4fd8-b70d-e199942b5c61"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:41:08.786600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a4e69053-7e9d-49e7-bf31-3773b341c806 req-c0627c57-2c4e-48e0-a0b1-b5cf0ac9e39a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:08.787107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a4e69053-7e9d-49e7-bf31-3773b341c806 req-c0627c57-2c4e-48e0-a0b1-b5cf0ac9e39a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:08.787560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a4e69053-7e9d-49e7-bf31-3773b341c806 req-c0627c57-2c4e-48e0-a0b1-b5cf0ac9e39a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:08.799521 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a4e69053-7e9d-49e7-bf31-3773b341c806 req-c0627c57-2c4e-48e0-a0b1-b5cf0ac9e39a service nova] Creating event network-vif-deleted:0ec8d161-58d8-4fd8-b70d-e199942b5c61 for instance b2d727f7-b4a4-4808-a943-070ff34dc897 on n-h2-858383-15 Oct 24 11:41:08.805418 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a4e69053-7e9d-49e7-bf31-3773b341c806 req-c0627c57-2c4e-48e0-a0b1-b5cf0ac9e39a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087580 Oct 24 11:41:08.806029 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3771/7565] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:41:08.881483 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4140fbc6-6263-4e6b-b8eb-5ce5d79bc476 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:08.882751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4140fbc6-6263-4e6b-b8eb-5ce5d79bc476 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:08.889872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4140fbc6-6263-4e6b-b8eb-5ce5d79bc476 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:08.890361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4140fbc6-6263-4e6b-b8eb-5ce5d79bc476 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:08.890828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4140fbc6-6263-4e6b-b8eb-5ce5d79bc476 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:08.891504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4140fbc6-6263-4e6b-b8eb-5ce5d79bc476 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:08.891959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4140fbc6-6263-4e6b-b8eb-5ce5d79bc476 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:08.892392 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4140fbc6-6263-4e6b-b8eb-5ce5d79bc476 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:08.924303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4140fbc6-6263-4e6b-b8eb-5ce5d79bc476 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:08.924788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4140fbc6-6263-4e6b-b8eb-5ce5d79bc476 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:08.925284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4140fbc6-6263-4e6b-b8eb-5ce5d79bc476 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:08.925732 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-4140fbc6-6263-4e6b-b8eb-5ce5d79bc476 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lazy-loading 'fault' on Instance uuid b2d727f7-b4a4-4808-a943-070ff34dc897 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:41:08.967843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4140fbc6-6263-4e6b-b8eb-5ce5d79bc476 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:08.976076 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4140fbc6-6263-4e6b-b8eb-5ce5d79bc476 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 200 len: 1347 microversion: 2.1 time: 0.098674 Oct 24 11:41:08.976668 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3795/7566] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:08 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 1347 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:41:10.002217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-361a428d-264f-4891-a649-6518592a7539 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:10.002962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-361a428d-264f-4891-a649-6518592a7539 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: b2d727f7-b4a4-4808-a943-070ff34dc897] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:10.009627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-361a428d-264f-4891-a649-6518592a7539 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:10.010124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-361a428d-264f-4891-a649-6518592a7539 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:10.010576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-361a428d-264f-4891-a649-6518592a7539 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:10.011280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-361a428d-264f-4891-a649-6518592a7539 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:10.011750 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-361a428d-264f-4891-a649-6518592a7539 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:10.012189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-361a428d-264f-4891-a649-6518592a7539 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:10.025671 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-361a428d-264f-4891-a649-6518592a7539 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] HTTP exception thrown: Instance b2d727f7-b4a4-4808-a943-070ff34dc897 could not be found. Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-361a428d-264f-4891-a649-6518592a7539 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Request method failure captured: Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 HTTP/1.1 Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnjmgYK4gup8u2PtLT5CPqekpSei60DHS44JZayMxrR_6YrZLDgEHNUBDNPX3SzLIdpgbYpXUwyTEyqOmrgvDf8G35OTqV9cc-FvlwQuftpgkb2ftFvLgkQ0ekOYhdGvbf9T7So2GeSiWfXEzRMb9jflTEH-POwndSCQcTMpUEiMgxU Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: ed3f0cb78cc7439181175560e01c94f1 Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestMinimumBasicScenario-1454217101 Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed3f0cb78cc7439181175560e01c94f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed3f0cb78cc7439181175560e01c94f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed3f0cb78cc7439181175560e01c94f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed3f0cb78cc7439181175560e01c94f1", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestMinimumBasicScenario-1454217101 Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: ed3f0cb78cc7439181175560e01c94f1 Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1454217101 Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestMinimumBasicScenario-1454217101-project Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: 815407dc849a4da0a3d924139e50cf9f Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestMinimumBasicScenario-1454217101-project Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance b2d727f7-b4a4-4808-a943-070ff34dc897 could not be found. Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'b2d727f7-b4a4-4808-a943-070ff34dc897'} Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2d727f7-b4a4-4808-a943-070ff34dc897 could not be found. Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2d727f7-b4a4-4808-a943-070ff34dc897 could not be found. Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:41:10.027301 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:41:10.032582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:41:10.032582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:41:10.032582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:41:10.032582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:41:10.032582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:41:10.032582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2d727f7-b4a4-4808-a943-070ff34dc897 could not be found. Oct 24 11:41:10.032582 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:41:10.032582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-361a428d-264f-4891-a649-6518592a7539 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Returning 404 to user: Instance b2d727f7-b4a4-4808-a943-070ff34dc897 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:41:10.032582 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-361a428d-264f-4891-a649-6518592a7539 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897" status: 404 len: 111 microversion: 2.1 time: 0.031726 Oct 24 11:41:10.032582 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3772/7567] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:09 2022] GET /compute/v2.1/servers/b2d727f7-b4a4-4808-a943-070ff34dc897 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 11:41:10.037665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e10a3acb-ad3b-4a9c-85c5-6993bb338e3d tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '.version_select at 0x7f04cb6fcdc0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:10.063146 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e10a3acb-ad3b-4a9c-85c5-6993bb338e3d tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-212634551" status: 202 len: 0 microversion: 2.1 time: 0.029321 Oct 24 11:41:10.063776 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3796/7568] 10.222.0.50 () {58 vars in 1269 bytes} [Mon Oct 24 11:41:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-212634551 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 11:41:19.368481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-46cf9cf9-cb13-4daf-8f2c-72d21d2c0ba7 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Action: 'create', calling method: .version_select at 0x7f04d4e95700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-779310851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4n3cfJrNKGdh6QH+KEqj6A2ISkLGNJcXA9OO9PQKGjQ9sUx1J7k9cnwoDlpUz0X0//EE1Numhg/51dzNpBI8tEnuSppmPv+uZa3Q+ruxX4doiKuq3o7fEkODQJ80PXHg=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:41:19.384292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-46cf9cf9-cb13-4daf-8f2c-72d21d2c0ba7 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Getting quotas for project ed3f0cb78cc7439181175560e01c94f1. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:41:19.389414 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-46cf9cf9-cb13-4daf-8f2c-72d21d2c0ba7 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Getting quotas for user 815407dc849a4da0a3d924139e50cf9f and project ed3f0cb78cc7439181175560e01c94f1. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:41:19.403777 n-d-858383-15 devstack@n-api.service[120425]: ERROR oslo.messaging._drivers.impl_rabbit [None req-46cf9cf9-cb13-4daf-8f2c-72d21d2c0ba7 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [0abf7c05-d150-487f-8c63-68138362ab14] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 11:41:20.017472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=38 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:41:20.410028 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [None req-46cf9cf9-cb13-4daf-8f2c-72d21d2c0ba7 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [0abf7c05-d150-487f-8c63-68138362ab14] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 50564. Oct 24 11:41:20.425340 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-46cf9cf9-cb13-4daf-8f2c-72d21d2c0ba7 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.061080 Oct 24 11:41:20.425950 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3773/7569] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:41:19 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:41:20.473054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:41:20.473808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:41:20.478747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d0db03ab-4ebb-4c6c-8a56-a5cb4da88800 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-246754989", "imageRef": "83b85d25-bce2-4610-9eb9-a97aed874fa6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-779310851", "networks": [{"uuid": "43b1cf90-d8f6-4cb1-a943-9c20b868ec82"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:41:20.500061 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:41:20.500255 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:41:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.50) !!! Oct 24 11:41:20.536853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-d0db03ab-4ebb-4c6c-8a56-a5cb4da88800 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] validate_networks() for [('43b1cf90-d8f6-4cb1-a943-9c20b868ec82', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:41:20.964873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d0db03ab-4ebb-4c6c-8a56-a5cb4da88800 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:41:20.965307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d0db03ab-4ebb-4c6c-8a56-a5cb4da88800 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:41:20.965786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d0db03ab-4ebb-4c6c-8a56-a5cb4da88800 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:41:20.966199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d0db03ab-4ebb-4c6c-8a56-a5cb4da88800 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:41:20.966671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-d0db03ab-4ebb-4c6c-8a56-a5cb4da88800 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:41:20.975613 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0db03ab-4ebb-4c6c-8a56-a5cb4da88800 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:20.976099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0db03ab-4ebb-4c6c-8a56-a5cb4da88800 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:20.976541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0db03ab-4ebb-4c6c-8a56-a5cb4da88800 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:20.977930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0db03ab-4ebb-4c6c-8a56-a5cb4da88800 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:20.978394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0db03ab-4ebb-4c6c-8a56-a5cb4da88800 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:20.978826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d0db03ab-4ebb-4c6c-8a56-a5cb4da88800 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:20.996512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d0db03ab-4ebb-4c6c-8a56-a5cb4da88800 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Getting quotas for project ed3f0cb78cc7439181175560e01c94f1. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:41:21.001805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-d0db03ab-4ebb-4c6c-8a56-a5cb4da88800 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Getting quotas for user 815407dc849a4da0a3d924139e50cf9f and project ed3f0cb78cc7439181175560e01c94f1. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:41:21.014468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d0db03ab-4ebb-4c6c-8a56-a5cb4da88800 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:41:21.016691 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d0db03ab-4ebb-4c6c-8a56-a5cb4da88800 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='83b85d25-bce2-4610-9eb9-a97aed874fa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:41:21.064629 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d0db03ab-4ebb-4c6c-8a56-a5cb4da88800 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593312 Oct 24 11:41:21.065456 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3797/7570] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:41:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:41:21.076571 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-90ad4c98-9558-4a2f-8362-aeb63249df41 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:21.077364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-90ad4c98-9558-4a2f-8362-aeb63249df41 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:21.135077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-90ad4c98-9558-4a2f-8362-aeb63249df41 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:21.142921 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-90ad4c98-9558-4a2f-8362-aeb63249df41 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1257 microversion: 2.1 time: 0.070364 Oct 24 11:41:21.143697 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3774/7571] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:21 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:22.168111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d1bf4a3e-7d1c-4e6b-b002-e128dddc22fe tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:22.168739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d1bf4a3e-7d1c-4e6b-b002-e128dddc22fe tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:22.175918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1bf4a3e-7d1c-4e6b-b002-e128dddc22fe tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:22.176475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1bf4a3e-7d1c-4e6b-b002-e128dddc22fe tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:22.176974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1bf4a3e-7d1c-4e6b-b002-e128dddc22fe tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:22.177713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1bf4a3e-7d1c-4e6b-b002-e128dddc22fe tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:22.178359 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1bf4a3e-7d1c-4e6b-b002-e128dddc22fe tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:22.178800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1bf4a3e-7d1c-4e6b-b002-e128dddc22fe tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:22.250849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d1bf4a3e-7d1c-4e6b-b002-e128dddc22fe tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:22.258760 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d1bf4a3e-7d1c-4e6b-b002-e128dddc22fe tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1317 microversion: 2.1 time: 0.096415 Oct 24 11:41:22.259557 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3798/7572] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:22 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1317 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:23.285436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10b5d899-c90f-4e13-8df9-1b042ff9a785 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:23.286242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-10b5d899-c90f-4e13-8df9-1b042ff9a785 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:23.304009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10b5d899-c90f-4e13-8df9-1b042ff9a785 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:23.306781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10b5d899-c90f-4e13-8df9-1b042ff9a785 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:23.307292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10b5d899-c90f-4e13-8df9-1b042ff9a785 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:23.308191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10b5d899-c90f-4e13-8df9-1b042ff9a785 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:23.309330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10b5d899-c90f-4e13-8df9-1b042ff9a785 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:23.309966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-10b5d899-c90f-4e13-8df9-1b042ff9a785 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:23.792040 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-10b5d899-c90f-4e13-8df9-1b042ff9a785 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:23.800295 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10b5d899-c90f-4e13-8df9-1b042ff9a785 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1357 microversion: 2.1 time: 0.520785 Oct 24 11:41:23.801545 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3775/7573] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:23 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1357 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:24.827057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-78c682db-7bcf-485f-a8ee-e4d46e816b7e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:24.827604 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-78c682db-7bcf-485f-a8ee-e4d46e816b7e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:24.834816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78c682db-7bcf-485f-a8ee-e4d46e816b7e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:24.835299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78c682db-7bcf-485f-a8ee-e4d46e816b7e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:24.836294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78c682db-7bcf-485f-a8ee-e4d46e816b7e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:24.837068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78c682db-7bcf-485f-a8ee-e4d46e816b7e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:24.837616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78c682db-7bcf-485f-a8ee-e4d46e816b7e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:24.838047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-78c682db-7bcf-485f-a8ee-e4d46e816b7e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:24.984888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-78c682db-7bcf-485f-a8ee-e4d46e816b7e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:24.994154 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-78c682db-7bcf-485f-a8ee-e4d46e816b7e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1357 microversion: 2.1 time: 0.170876 Oct 24 11:41:24.994759 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3799/7574] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:24 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:26.017707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5219735a-c061-4047-b0c8-154680bbad0e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:26.018356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5219735a-c061-4047-b0c8-154680bbad0e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:26.021102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:41:26.027995 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5219735a-c061-4047-b0c8-154680bbad0e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:26.028504 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5219735a-c061-4047-b0c8-154680bbad0e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:26.028997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5219735a-c061-4047-b0c8-154680bbad0e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:26.029722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5219735a-c061-4047-b0c8-154680bbad0e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:26.030202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5219735a-c061-4047-b0c8-154680bbad0e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:26.030653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5219735a-c061-4047-b0c8-154680bbad0e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:26.203731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5219735a-c061-4047-b0c8-154680bbad0e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:26.213132 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5219735a-c061-4047-b0c8-154680bbad0e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1357 microversion: 2.1 time: 0.199233 Oct 24 11:41:26.213946 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3776/7575] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:26 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:27.238330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f3803657-84d7-4966-8857-371f2fb99ce0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:27.239225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f3803657-84d7-4966-8857-371f2fb99ce0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:27.248229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3803657-84d7-4966-8857-371f2fb99ce0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:27.248913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3803657-84d7-4966-8857-371f2fb99ce0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:27.249582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3803657-84d7-4966-8857-371f2fb99ce0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:27.250571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3803657-84d7-4966-8857-371f2fb99ce0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:27.251107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3803657-84d7-4966-8857-371f2fb99ce0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:27.251739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f3803657-84d7-4966-8857-371f2fb99ce0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:27.393176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f3803657-84d7-4966-8857-371f2fb99ce0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:27.402162 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f3803657-84d7-4966-8857-371f2fb99ce0 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1357 microversion: 2.1 time: 0.168942 Oct 24 11:41:27.403025 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3800/7576] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:27 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:28.428787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6f2c6f62-c4d3-4ab8-94ef-531f46390d0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:28.429482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6f2c6f62-c4d3-4ab8-94ef-531f46390d0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:28.436156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f2c6f62-c4d3-4ab8-94ef-531f46390d0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:28.436672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f2c6f62-c4d3-4ab8-94ef-531f46390d0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:28.437172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f2c6f62-c4d3-4ab8-94ef-531f46390d0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:28.437900 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f2c6f62-c4d3-4ab8-94ef-531f46390d0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:28.438376 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f2c6f62-c4d3-4ab8-94ef-531f46390d0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:28.438821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6f2c6f62-c4d3-4ab8-94ef-531f46390d0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:28.576125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6f2c6f62-c4d3-4ab8-94ef-531f46390d0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:28.586642 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6f2c6f62-c4d3-4ab8-94ef-531f46390d0c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1357 microversion: 2.1 time: 0.160315 Oct 24 11:41:28.587662 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3777/7577] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:28 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:29.622417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2fe33a91-3b7e-4673-a32a-7e7f7612dd93 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:29.623133 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2fe33a91-3b7e-4673-a32a-7e7f7612dd93 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:29.631307 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fe33a91-3b7e-4673-a32a-7e7f7612dd93 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:29.631793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fe33a91-3b7e-4673-a32a-7e7f7612dd93 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:29.632228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fe33a91-3b7e-4673-a32a-7e7f7612dd93 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:29.633039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fe33a91-3b7e-4673-a32a-7e7f7612dd93 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:29.633763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fe33a91-3b7e-4673-a32a-7e7f7612dd93 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:29.634174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2fe33a91-3b7e-4673-a32a-7e7f7612dd93 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:29.781555 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2fe33a91-3b7e-4673-a32a-7e7f7612dd93 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:29.790102 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2fe33a91-3b7e-4673-a32a-7e7f7612dd93 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1357 microversion: 2.1 time: 0.172976 Oct 24 11:41:29.790941 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3801/7578] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:29 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:30.813124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fb5af37f-2fa9-4ab4-96a4-fb29a6312abf tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:30.813747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fb5af37f-2fa9-4ab4-96a4-fb29a6312abf tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:30.821387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb5af37f-2fa9-4ab4-96a4-fb29a6312abf tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:30.821907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb5af37f-2fa9-4ab4-96a4-fb29a6312abf tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:30.822357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb5af37f-2fa9-4ab4-96a4-fb29a6312abf tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:30.823059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb5af37f-2fa9-4ab4-96a4-fb29a6312abf tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:30.823524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb5af37f-2fa9-4ab4-96a4-fb29a6312abf tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:30.823961 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fb5af37f-2fa9-4ab4-96a4-fb29a6312abf tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:30.958070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fb5af37f-2fa9-4ab4-96a4-fb29a6312abf tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:30.969656 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fb5af37f-2fa9-4ab4-96a4-fb29a6312abf tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1357 microversion: 2.1 time: 0.160319 Oct 24 11:41:30.970610 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3778/7579] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:30 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:31.993279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b3c5148c-4287-4286-b44c-3eb4656ba184 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:31.993900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b3c5148c-4287-4286-b44c-3eb4656ba184 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:31.996614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:41:31.997296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:41:32.003401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3c5148c-4287-4286-b44c-3eb4656ba184 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:32.003891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3c5148c-4287-4286-b44c-3eb4656ba184 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:32.004337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3c5148c-4287-4286-b44c-3eb4656ba184 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:32.005079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3c5148c-4287-4286-b44c-3eb4656ba184 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:32.005539 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3c5148c-4287-4286-b44c-3eb4656ba184 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:32.005975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b3c5148c-4287-4286-b44c-3eb4656ba184 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:32.137352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b3c5148c-4287-4286-b44c-3eb4656ba184 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:32.145238 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b3c5148c-4287-4286-b44c-3eb4656ba184 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1357 microversion: 2.1 time: 0.156002 Oct 24 11:41:32.145826 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3802/7580] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:31 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:33.072609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d60d8c4e-58a1-486b-b74c-7366430ff09a req-a09a4e72-afb5-49ae-b308-b5e2e96eff69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82c09f3e-23c8-41cb-84fd-529d228fb2f5", "tag": "44a95fb8-6c64-49ac-900a-92afe8f9bcd4"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:41:33.081228 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:41:33.085323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d60d8c4e-58a1-486b-b74c-7366430ff09a req-a09a4e72-afb5-49ae-b308-b5e2e96eff69 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:33.085893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d60d8c4e-58a1-486b-b74c-7366430ff09a req-a09a4e72-afb5-49ae-b308-b5e2e96eff69 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:33.086403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d60d8c4e-58a1-486b-b74c-7366430ff09a req-a09a4e72-afb5-49ae-b308-b5e2e96eff69 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:33.098892 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d60d8c4e-58a1-486b-b74c-7366430ff09a req-a09a4e72-afb5-49ae-b308-b5e2e96eff69 service nova] Creating event network-changed:44a95fb8-6c64-49ac-900a-92afe8f9bcd4 for instance 82c09f3e-23c8-41cb-84fd-529d228fb2f5 on n-h2-858383-15 Oct 24 11:41:33.104808 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d60d8c4e-58a1-486b-b74c-7366430ff09a req-a09a4e72-afb5-49ae-b308-b5e2e96eff69 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036682 Oct 24 11:41:33.105462 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3779/7581] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:41:33.169122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d8b9f237-d5f1-4e97-940b-2fd34c9b2d50 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:33.169867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d8b9f237-d5f1-4e97-940b-2fd34c9b2d50 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:33.177206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8b9f237-d5f1-4e97-940b-2fd34c9b2d50 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:33.177792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8b9f237-d5f1-4e97-940b-2fd34c9b2d50 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:33.178241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8b9f237-d5f1-4e97-940b-2fd34c9b2d50 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:33.178957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8b9f237-d5f1-4e97-940b-2fd34c9b2d50 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:33.179413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8b9f237-d5f1-4e97-940b-2fd34c9b2d50 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:33.179842 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d8b9f237-d5f1-4e97-940b-2fd34c9b2d50 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:33.317180 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d8b9f237-d5f1-4e97-940b-2fd34c9b2d50 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:33.325502 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d8b9f237-d5f1-4e97-940b-2fd34c9b2d50 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1357 microversion: 2.1 time: 0.161570 Oct 24 11:41:33.326103 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3803/7582] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:33 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:41:34.350187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-023e34d5-cbbc-40e2-aafd-a16c93815e75 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:34.350911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-023e34d5-cbbc-40e2-aafd-a16c93815e75 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:34.357534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-023e34d5-cbbc-40e2-aafd-a16c93815e75 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:34.358033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-023e34d5-cbbc-40e2-aafd-a16c93815e75 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:34.358493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-023e34d5-cbbc-40e2-aafd-a16c93815e75 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:34.359197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-023e34d5-cbbc-40e2-aafd-a16c93815e75 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:34.359674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-023e34d5-cbbc-40e2-aafd-a16c93815e75 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:34.360119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-023e34d5-cbbc-40e2-aafd-a16c93815e75 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:34.493709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-023e34d5-cbbc-40e2-aafd-a16c93815e75 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:34.501418 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-023e34d5-cbbc-40e2-aafd-a16c93815e75 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1357 microversion: 2.1 time: 0.156419 Oct 24 11:41:34.501988 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3780/7583] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:34 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:35.524977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-310da24c-22ec-49d7-9235-bd0969607d89 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:35.525624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-310da24c-22ec-49d7-9235-bd0969607d89 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:35.532546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-310da24c-22ec-49d7-9235-bd0969607d89 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:35.533072 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-310da24c-22ec-49d7-9235-bd0969607d89 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:35.533520 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-310da24c-22ec-49d7-9235-bd0969607d89 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:35.534220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-310da24c-22ec-49d7-9235-bd0969607d89 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:35.534679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-310da24c-22ec-49d7-9235-bd0969607d89 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:35.535113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-310da24c-22ec-49d7-9235-bd0969607d89 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:35.663446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-310da24c-22ec-49d7-9235-bd0969607d89 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:35.672108 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-310da24c-22ec-49d7-9235-bd0969607d89 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1357 microversion: 2.1 time: 0.151119 Oct 24 11:41:35.672686 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3804/7584] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:35 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:36.695373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-40f03eb8-8669-431a-9c83-d8486e120e63 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:36.696008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-40f03eb8-8669-431a-9c83-d8486e120e63 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:36.703826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40f03eb8-8669-431a-9c83-d8486e120e63 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:36.704328 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40f03eb8-8669-431a-9c83-d8486e120e63 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:36.704786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40f03eb8-8669-431a-9c83-d8486e120e63 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:36.705529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40f03eb8-8669-431a-9c83-d8486e120e63 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:36.705999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40f03eb8-8669-431a-9c83-d8486e120e63 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:36.706451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-40f03eb8-8669-431a-9c83-d8486e120e63 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:36.837505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-40f03eb8-8669-431a-9c83-d8486e120e63 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:36.845464 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-40f03eb8-8669-431a-9c83-d8486e120e63 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1357 microversion: 2.1 time: 0.153994 Oct 24 11:41:36.845984 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3781/7585] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:36 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:37.869292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-68525e96-59d5-4085-93f8-01cfe418e1a4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:37.869917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-68525e96-59d5-4085-93f8-01cfe418e1a4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:37.876874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68525e96-59d5-4085-93f8-01cfe418e1a4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:37.877370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68525e96-59d5-4085-93f8-01cfe418e1a4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:37.877826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68525e96-59d5-4085-93f8-01cfe418e1a4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:37.878529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68525e96-59d5-4085-93f8-01cfe418e1a4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:37.878993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68525e96-59d5-4085-93f8-01cfe418e1a4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:37.879428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-68525e96-59d5-4085-93f8-01cfe418e1a4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:38.007907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-68525e96-59d5-4085-93f8-01cfe418e1a4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:38.016339 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-68525e96-59d5-4085-93f8-01cfe418e1a4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1357 microversion: 2.1 time: 0.151113 Oct 24 11:41:38.016937 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3805/7586] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:37 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:39.039303 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-677ea234-e58d-4c11-b81b-a0755e4549c5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:39.040786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-677ea234-e58d-4c11-b81b-a0755e4549c5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:39.047649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-677ea234-e58d-4c11-b81b-a0755e4549c5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:39.048153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-677ea234-e58d-4c11-b81b-a0755e4549c5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:39.048639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-677ea234-e58d-4c11-b81b-a0755e4549c5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:39.049413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-677ea234-e58d-4c11-b81b-a0755e4549c5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:39.049893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-677ea234-e58d-4c11-b81b-a0755e4549c5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:39.050342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-677ea234-e58d-4c11-b81b-a0755e4549c5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:39.180002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-677ea234-e58d-4c11-b81b-a0755e4549c5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:39.187739 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-677ea234-e58d-4c11-b81b-a0755e4549c5 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1357 microversion: 2.1 time: 0.152379 Oct 24 11:41:39.188312 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3782/7587] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:39 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:40.211084 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-779bad1a-19b7-4e81-8481-0935581d75dd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:40.212253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-779bad1a-19b7-4e81-8481-0935581d75dd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:40.220008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-779bad1a-19b7-4e81-8481-0935581d75dd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:40.220502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-779bad1a-19b7-4e81-8481-0935581d75dd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:40.220973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-779bad1a-19b7-4e81-8481-0935581d75dd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:40.221684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-779bad1a-19b7-4e81-8481-0935581d75dd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:40.222138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-779bad1a-19b7-4e81-8481-0935581d75dd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:40.222565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-779bad1a-19b7-4e81-8481-0935581d75dd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:40.291194 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-4a9b6c5b-48d4-4706-bd83-6be623f78ae7 req-c60504a1-5eec-4b62-9956-9ae946bf9395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c09f3e-23c8-41cb-84fd-529d228fb2f5", "name": "network-vif-plugged", "status": "completed", "tag": "44a95fb8-6c64-49ac-900a-92afe8f9bcd4"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:41:40.300915 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4a9b6c5b-48d4-4706-bd83-6be623f78ae7 req-c60504a1-5eec-4b62-9956-9ae946bf9395 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:40.301633 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4a9b6c5b-48d4-4706-bd83-6be623f78ae7 req-c60504a1-5eec-4b62-9956-9ae946bf9395 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:40.302258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4a9b6c5b-48d4-4706-bd83-6be623f78ae7 req-c60504a1-5eec-4b62-9956-9ae946bf9395 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:40.316957 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-4a9b6c5b-48d4-4706-bd83-6be623f78ae7 req-c60504a1-5eec-4b62-9956-9ae946bf9395 service nova] Creating event network-vif-plugged:44a95fb8-6c64-49ac-900a-92afe8f9bcd4 for instance 82c09f3e-23c8-41cb-84fd-529d228fb2f5 on n-h2-858383-15 Oct 24 11:41:40.322615 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-4a9b6c5b-48d4-4706-bd83-6be623f78ae7 req-c60504a1-5eec-4b62-9956-9ae946bf9395 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097846 Oct 24 11:41:40.323252 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3783/7588] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:41:40.359672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-779bad1a-19b7-4e81-8481-0935581d75dd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:40.367505 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-779bad1a-19b7-4e81-8481-0935581d75dd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1357 microversion: 2.1 time: 0.160366 Oct 24 11:41:40.368178 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3806/7589] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:40 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:41:41.392543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-05e5c24c-93cc-4da8-9afc-5f0cf896a246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:41.393204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-05e5c24c-93cc-4da8-9afc-5f0cf896a246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:41.400344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05e5c24c-93cc-4da8-9afc-5f0cf896a246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:41.400849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05e5c24c-93cc-4da8-9afc-5f0cf896a246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:41.401307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05e5c24c-93cc-4da8-9afc-5f0cf896a246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:41.402008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05e5c24c-93cc-4da8-9afc-5f0cf896a246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:41.402473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05e5c24c-93cc-4da8-9afc-5f0cf896a246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:41.402913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-05e5c24c-93cc-4da8-9afc-5f0cf896a246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:41.531919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-05e5c24c-93cc-4da8-9afc-5f0cf896a246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:41.539619 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-05e5c24c-93cc-4da8-9afc-5f0cf896a246 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1357 microversion: 2.1 time: 0.151508 Oct 24 11:41:41.541238 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3784/7590] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:41 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:42.563775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ec04012e-8dfd-4fa5-a4cb-5a2cb24457a2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:42.564367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ec04012e-8dfd-4fa5-a4cb-5a2cb24457a2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:42.572205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec04012e-8dfd-4fa5-a4cb-5a2cb24457a2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:42.572675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec04012e-8dfd-4fa5-a4cb-5a2cb24457a2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:42.573219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec04012e-8dfd-4fa5-a4cb-5a2cb24457a2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:42.573913 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec04012e-8dfd-4fa5-a4cb-5a2cb24457a2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:42.574369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec04012e-8dfd-4fa5-a4cb-5a2cb24457a2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:42.574793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec04012e-8dfd-4fa5-a4cb-5a2cb24457a2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:42.707386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ec04012e-8dfd-4fa5-a4cb-5a2cb24457a2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:42.715084 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ec04012e-8dfd-4fa5-a4cb-5a2cb24457a2 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1547 microversion: 2.1 time: 0.155385 Oct 24 11:41:42.715667 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3807/7591] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:42 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:42.737391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0bf515f9-3611-48f6-aaed-253590ec156f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:42.738028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0bf515f9-3611-48f6-aaed-253590ec156f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:42.745260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bf515f9-3611-48f6-aaed-253590ec156f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:42.745790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bf515f9-3611-48f6-aaed-253590ec156f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:42.746250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bf515f9-3611-48f6-aaed-253590ec156f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:42.746958 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bf515f9-3611-48f6-aaed-253590ec156f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:42.747439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bf515f9-3611-48f6-aaed-253590ec156f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:42.747882 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0bf515f9-3611-48f6-aaed-253590ec156f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:42.875875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0bf515f9-3611-48f6-aaed-253590ec156f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:42.883823 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0bf515f9-3611-48f6-aaed-253590ec156f tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1547 microversion: 2.1 time: 0.150244 Oct 24 11:41:42.884407 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3785/7592] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:42 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:42.905558 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-91014033-6b7e-439b-8301-81ae9e77d264 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:42.910369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-91014033-6b7e-439b-8301-81ae9e77d264 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:42.911134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-91014033-6b7e-439b-8301-81ae9e77d264 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Searching by: {'deleted': False, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1'} {{(pid=120426) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 11:41:42.917104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91014033-6b7e-439b-8301-81ae9e77d264 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:42.917577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91014033-6b7e-439b-8301-81ae9e77d264 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:42.918015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91014033-6b7e-439b-8301-81ae9e77d264 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:42.918728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91014033-6b7e-439b-8301-81ae9e77d264 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:42.919179 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91014033-6b7e-439b-8301-81ae9e77d264 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:42.919599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91014033-6b7e-439b-8301-81ae9e77d264 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:42.943753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.multi_cell_list [None req-91014033-6b7e-439b-8301-81ae9e77d264 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120426) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 11:41:42.970906 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-91014033-6b7e-439b-8301-81ae9e77d264 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069117 Oct 24 11:41:42.971495 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3808/7593] 10.222.0.50 () {58 vars in 1125 bytes} [Mon Oct 24 11:41:42 2022] GET /compute/v2.1/servers => generated 342 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:41:42.983696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4b33a22f-e2d1-4af3-8580-142f2cc8886c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:42.984331 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4b33a22f-e2d1-4af3-8580-142f2cc8886c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:42.990417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b33a22f-e2d1-4af3-8580-142f2cc8886c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:42.990912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b33a22f-e2d1-4af3-8580-142f2cc8886c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:42.991366 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b33a22f-e2d1-4af3-8580-142f2cc8886c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:42.992074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b33a22f-e2d1-4af3-8580-142f2cc8886c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:42.992548 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b33a22f-e2d1-4af3-8580-142f2cc8886c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:42.993875 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b33a22f-e2d1-4af3-8580-142f2cc8886c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:43.128627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4b33a22f-e2d1-4af3-8580-142f2cc8886c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:43.136791 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4b33a22f-e2d1-4af3-8580-142f2cc8886c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1547 microversion: 2.1 time: 0.157007 Oct 24 11:41:43.137391 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3786/7594] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:42 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:44.647959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e5c5eeca-4bc1-4c7d-9938-bf1d90e55856 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7156a1cc-e31a-478d-a60a-0b23cef76af5"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:41:44.650645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e5c5eeca-4bc1-4c7d-9938-bf1d90e55856 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:44.657659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5c5eeca-4bc1-4c7d-9938-bf1d90e55856 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:44.658152 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5c5eeca-4bc1-4c7d-9938-bf1d90e55856 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:44.658599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5c5eeca-4bc1-4c7d-9938-bf1d90e55856 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:44.659298 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5c5eeca-4bc1-4c7d-9938-bf1d90e55856 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:44.659758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5c5eeca-4bc1-4c7d-9938-bf1d90e55856 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:44.660190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e5c5eeca-4bc1-4c7d-9938-bf1d90e55856 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:44.926432 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e5c5eeca-4bc1-4c7d-9938-bf1d90e55856 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "POST /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282316 Oct 24 11:41:44.927049 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3809/7595] 10.222.0.50 () {60 vars in 1323 bytes} [Mon Oct 24 11:41:44 2022] POST /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:41:55.722588 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a72253d7-3037-4b6f-b918-2facfbf72dfd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:55.723219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a72253d7-3037-4b6f-b918-2facfbf72dfd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:55.726340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=21 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:41:55.727074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=64 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:41:55.734225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a72253d7-3037-4b6f-b918-2facfbf72dfd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:55.734747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a72253d7-3037-4b6f-b918-2facfbf72dfd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:55.735264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a72253d7-3037-4b6f-b918-2facfbf72dfd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:55.736001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a72253d7-3037-4b6f-b918-2facfbf72dfd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:55.736484 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a72253d7-3037-4b6f-b918-2facfbf72dfd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:55.736963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a72253d7-3037-4b6f-b918-2facfbf72dfd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:55.901630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a72253d7-3037-4b6f-b918-2facfbf72dfd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:55.910244 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a72253d7-3037-4b6f-b918-2facfbf72dfd tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1593 microversion: 2.1 time: 0.191658 Oct 24 11:41:55.910843 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3787/7596] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:55 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1593 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:57.570563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-1fa105a9-bae0-47f6-bb40-c5b635abfd7a req-b1d1bb54-ff7d-4ab0-a21c-84439d5f1bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82c09f3e-23c8-41cb-84fd-529d228fb2f5", "tag": "44a95fb8-6c64-49ac-900a-92afe8f9bcd4"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:41:57.577030 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:41:57.578125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:41:57.579012 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:41:57.585712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1fa105a9-bae0-47f6-bb40-c5b635abfd7a req-b1d1bb54-ff7d-4ab0-a21c-84439d5f1bcf service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:57.586514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1fa105a9-bae0-47f6-bb40-c5b635abfd7a req-b1d1bb54-ff7d-4ab0-a21c-84439d5f1bcf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:57.587819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1fa105a9-bae0-47f6-bb40-c5b635abfd7a req-b1d1bb54-ff7d-4ab0-a21c-84439d5f1bcf service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:57.602102 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-1fa105a9-bae0-47f6-bb40-c5b635abfd7a req-b1d1bb54-ff7d-4ab0-a21c-84439d5f1bcf service nova] Creating event network-changed:44a95fb8-6c64-49ac-900a-92afe8f9bcd4 for instance 82c09f3e-23c8-41cb-84fd-529d228fb2f5 on n-h2-858383-15 Oct 24 11:41:57.608820 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-1fa105a9-bae0-47f6-bb40-c5b635abfd7a req-b1d1bb54-ff7d-4ab0-a21c-84439d5f1bcf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042400 Oct 24 11:41:57.609844 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3810/7597] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:41:58.640697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b69567f2-5a6a-40b1-81c9-d4a2e0ff5248 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1320647308"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:41:58.641382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b69567f2-5a6a-40b1-81c9-d4a2e0ff5248 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:58.649600 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b69567f2-5a6a-40b1-81c9-d4a2e0ff5248 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:58.650564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b69567f2-5a6a-40b1-81c9-d4a2e0ff5248 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:58.651159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b69567f2-5a6a-40b1-81c9-d4a2e0ff5248 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:58.652026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b69567f2-5a6a-40b1-81c9-d4a2e0ff5248 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:58.652515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b69567f2-5a6a-40b1-81c9-d4a2e0ff5248 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:58.653119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b69567f2-5a6a-40b1-81c9-d4a2e0ff5248 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:58.792226 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.network.security_group_api [None req-b69567f2-5a6a-40b1-81c9-d4a2e0ff5248 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Adding security group 8a6f0318-82b7-4017-ac0e-7d69b1cbcccf to port 44a95fb8-6c64-49ac-900a-92afe8f9bcd4 Oct 24 11:41:59.119521 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b69567f2-5a6a-40b1-81c9-d4a2e0ff5248 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "POST /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/action" status: 202 len: 0 microversion: 2.1 time: 0.482951 Oct 24 11:41:59.120340 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3788/7598] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:41:58 2022] POST /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:41:59.135925 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1df0a2cd-f1d6-4bfa-86c7-5459496643e4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:41:59.136678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1df0a2cd-f1d6-4bfa-86c7-5459496643e4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:41:59.143224 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1df0a2cd-f1d6-4bfa-86c7-5459496643e4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:59.143717 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1df0a2cd-f1d6-4bfa-86c7-5459496643e4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:59.144158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1df0a2cd-f1d6-4bfa-86c7-5459496643e4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:59.145147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1df0a2cd-f1d6-4bfa-86c7-5459496643e4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:59.145752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1df0a2cd-f1d6-4bfa-86c7-5459496643e4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:59.146196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1df0a2cd-f1d6-4bfa-86c7-5459496643e4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:59.298144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1df0a2cd-f1d6-4bfa-86c7-5459496643e4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:41:59.307205 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1df0a2cd-f1d6-4bfa-86c7-5459496643e4 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1759 microversion: 2.1 time: 0.179099 Oct 24 11:41:59.307794 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3811/7599] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:41:59 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1759 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:41:59.625630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-efa69841-7a93-4236-ae3c-05842e715cd9 req-e8f40406-1459-482b-9baf-c9709f352c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82c09f3e-23c8-41cb-84fd-529d228fb2f5", "tag": "44a95fb8-6c64-49ac-900a-92afe8f9bcd4"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:41:59.635210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-efa69841-7a93-4236-ae3c-05842e715cd9 req-e8f40406-1459-482b-9baf-c9709f352c4f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:41:59.635713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-efa69841-7a93-4236-ae3c-05842e715cd9 req-e8f40406-1459-482b-9baf-c9709f352c4f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:41:59.636176 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-efa69841-7a93-4236-ae3c-05842e715cd9 req-e8f40406-1459-482b-9baf-c9709f352c4f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:41:59.648358 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-efa69841-7a93-4236-ae3c-05842e715cd9 req-e8f40406-1459-482b-9baf-c9709f352c4f service nova] Creating event network-changed:44a95fb8-6c64-49ac-900a-92afe8f9bcd4 for instance 82c09f3e-23c8-41cb-84fd-529d228fb2f5 on n-h2-858383-15 Oct 24 11:41:59.654197 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-efa69841-7a93-4236-ae3c-05842e715cd9 req-e8f40406-1459-482b-9baf-c9709f352c4f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032658 Oct 24 11:41:59.654812 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3789/7600] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:42:14.319603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54253b13-8ee7-4dd2-82ad-09de12d2f09b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:42:14.322537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-54253b13-8ee7-4dd2-82ad-09de12d2f09b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:42:14.325455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:42:14.326274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=8 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:42:14.332104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54253b13-8ee7-4dd2-82ad-09de12d2f09b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:14.332586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54253b13-8ee7-4dd2-82ad-09de12d2f09b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:14.333049 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54253b13-8ee7-4dd2-82ad-09de12d2f09b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:14.333741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54253b13-8ee7-4dd2-82ad-09de12d2f09b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:14.334192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54253b13-8ee7-4dd2-82ad-09de12d2f09b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:14.334619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54253b13-8ee7-4dd2-82ad-09de12d2f09b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:14.409476 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-54253b13-8ee7-4dd2-82ad-09de12d2f09b tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "POST /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/action" status: 202 len: 0 microversion: 2.1 time: 0.093721 Oct 24 11:42:14.410139 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3812/7601] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:42:14 2022] POST /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:42:14.417239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:42:14.418117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:42:14.422607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9cf69ed4-6b85-4116-8e8c-8deed83d2189 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:42:14.423374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9cf69ed4-6b85-4116-8e8c-8deed83d2189 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:42:14.431291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cf69ed4-6b85-4116-8e8c-8deed83d2189 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:14.431542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cf69ed4-6b85-4116-8e8c-8deed83d2189 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:14.431843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cf69ed4-6b85-4116-8e8c-8deed83d2189 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:14.432570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cf69ed4-6b85-4116-8e8c-8deed83d2189 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:14.433070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cf69ed4-6b85-4116-8e8c-8deed83d2189 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:14.433517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9cf69ed4-6b85-4116-8e8c-8deed83d2189 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:14.586586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9cf69ed4-6b85-4116-8e8c-8deed83d2189 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:42:14.595309 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9cf69ed4-6b85-4116-8e8c-8deed83d2189 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1751 microversion: 2.1 time: 0.180246 Oct 24 11:42:14.595987 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3790/7602] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:42:14 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:42:15.669678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d158b403-ebeb-450f-afd6-a92c466d361a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:42:15.670383 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d158b403-ebeb-450f-afd6-a92c466d361a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:42:15.676467 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d158b403-ebeb-450f-afd6-a92c466d361a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:15.676987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d158b403-ebeb-450f-afd6-a92c466d361a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:15.677428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d158b403-ebeb-450f-afd6-a92c466d361a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:15.678116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d158b403-ebeb-450f-afd6-a92c466d361a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:15.678566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d158b403-ebeb-450f-afd6-a92c466d361a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:15.678987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d158b403-ebeb-450f-afd6-a92c466d361a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:15.822001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d158b403-ebeb-450f-afd6-a92c466d361a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:42:15.830282 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d158b403-ebeb-450f-afd6-a92c466d361a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1756 microversion: 2.1 time: 0.215156 Oct 24 11:42:15.830955 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3813/7603] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:42:15 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1756 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:42:16.855202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-212a4303-4b84-4b6f-90b8-4492143dda77 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:42:16.855841 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-212a4303-4b84-4b6f-90b8-4492143dda77 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:42:16.862864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-212a4303-4b84-4b6f-90b8-4492143dda77 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:16.863316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-212a4303-4b84-4b6f-90b8-4492143dda77 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:16.863779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-212a4303-4b84-4b6f-90b8-4492143dda77 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:16.864498 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-212a4303-4b84-4b6f-90b8-4492143dda77 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:16.865009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-212a4303-4b84-4b6f-90b8-4492143dda77 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:16.865466 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-212a4303-4b84-4b6f-90b8-4492143dda77 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:17.011997 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-212a4303-4b84-4b6f-90b8-4492143dda77 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:42:17.020361 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-212a4303-4b84-4b6f-90b8-4492143dda77 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1756 microversion: 2.1 time: 0.169690 Oct 24 11:42:17.020966 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3791/7604] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:42:16 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:42:18.044528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a4898a24-f598-40a5-b719-a2b755ded335 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:42:18.045168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a4898a24-f598-40a5-b719-a2b755ded335 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:42:18.052008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4898a24-f598-40a5-b719-a2b755ded335 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:18.052484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4898a24-f598-40a5-b719-a2b755ded335 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:18.052948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4898a24-f598-40a5-b719-a2b755ded335 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:18.053659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4898a24-f598-40a5-b719-a2b755ded335 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:18.054110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4898a24-f598-40a5-b719-a2b755ded335 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:18.055143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a4898a24-f598-40a5-b719-a2b755ded335 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:18.195896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a4898a24-f598-40a5-b719-a2b755ded335 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:42:18.204307 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a4898a24-f598-40a5-b719-a2b755ded335 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1756 microversion: 2.1 time: 0.163698 Oct 24 11:42:18.204910 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3814/7605] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:42:18 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:42:19.228931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dd56c178-70a4-44f7-8978-736f14bb7b5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:42:19.229568 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dd56c178-70a4-44f7-8978-736f14bb7b5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:42:19.236521 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd56c178-70a4-44f7-8978-736f14bb7b5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:19.237057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd56c178-70a4-44f7-8978-736f14bb7b5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:19.237515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd56c178-70a4-44f7-8978-736f14bb7b5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:19.238238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd56c178-70a4-44f7-8978-736f14bb7b5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:19.238714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd56c178-70a4-44f7-8978-736f14bb7b5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:19.239165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dd56c178-70a4-44f7-8978-736f14bb7b5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:19.381279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dd56c178-70a4-44f7-8978-736f14bb7b5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:42:19.390450 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dd56c178-70a4-44f7-8978-736f14bb7b5c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1756 microversion: 2.1 time: 0.165697 Oct 24 11:42:19.391041 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3792/7606] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:42:19 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:42:20.413155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c4370c2e-bf52-428e-acb3-a8a88683d2b8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:42:20.414544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c4370c2e-bf52-428e-acb3-a8a88683d2b8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:42:20.421484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4370c2e-bf52-428e-acb3-a8a88683d2b8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:20.421974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4370c2e-bf52-428e-acb3-a8a88683d2b8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:20.422418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4370c2e-bf52-428e-acb3-a8a88683d2b8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:20.423127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4370c2e-bf52-428e-acb3-a8a88683d2b8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:20.423586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4370c2e-bf52-428e-acb3-a8a88683d2b8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:20.424020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c4370c2e-bf52-428e-acb3-a8a88683d2b8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:20.570942 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c4370c2e-bf52-428e-acb3-a8a88683d2b8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:42:20.579269 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c4370c2e-bf52-428e-acb3-a8a88683d2b8 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1756 microversion: 2.1 time: 0.170137 Oct 24 11:42:20.579848 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3815/7607] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:42:20 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:42:21.603626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-918a2f64-ee71-4ded-aba8-25ff34db6783 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:42:21.604277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-918a2f64-ee71-4ded-aba8-25ff34db6783 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:42:21.611347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-918a2f64-ee71-4ded-aba8-25ff34db6783 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:21.611840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-918a2f64-ee71-4ded-aba8-25ff34db6783 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:21.612290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-918a2f64-ee71-4ded-aba8-25ff34db6783 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:21.613104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-918a2f64-ee71-4ded-aba8-25ff34db6783 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:21.613575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-918a2f64-ee71-4ded-aba8-25ff34db6783 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:21.614015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-918a2f64-ee71-4ded-aba8-25ff34db6783 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:21.756730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-918a2f64-ee71-4ded-aba8-25ff34db6783 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:42:21.766080 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-918a2f64-ee71-4ded-aba8-25ff34db6783 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1756 microversion: 2.1 time: 0.166667 Oct 24 11:42:21.766779 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3793/7608] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:42:21 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:42:22.790802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3369f2e5-46df-49a3-9e7a-746f6465be8a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:42:22.791345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3369f2e5-46df-49a3-9e7a-746f6465be8a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:42:22.798503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3369f2e5-46df-49a3-9e7a-746f6465be8a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:22.799025 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3369f2e5-46df-49a3-9e7a-746f6465be8a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:22.799563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3369f2e5-46df-49a3-9e7a-746f6465be8a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:22.800374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3369f2e5-46df-49a3-9e7a-746f6465be8a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:22.801159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3369f2e5-46df-49a3-9e7a-746f6465be8a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:22.801356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3369f2e5-46df-49a3-9e7a-746f6465be8a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:22.946768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3369f2e5-46df-49a3-9e7a-746f6465be8a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:42:22.955077 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3369f2e5-46df-49a3-9e7a-746f6465be8a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1756 microversion: 2.1 time: 0.168755 Oct 24 11:42:22.955651 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3816/7609] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:42:22 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:42:23.979560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4c839b6d-17e0-49e3-929e-3d33d497585a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:42:23.980205 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4c839b6d-17e0-49e3-929e-3d33d497585a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:42:23.987718 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c839b6d-17e0-49e3-929e-3d33d497585a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:23.988199 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c839b6d-17e0-49e3-929e-3d33d497585a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:23.988653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c839b6d-17e0-49e3-929e-3d33d497585a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:23.989397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c839b6d-17e0-49e3-929e-3d33d497585a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:23.989867 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c839b6d-17e0-49e3-929e-3d33d497585a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:23.990312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4c839b6d-17e0-49e3-929e-3d33d497585a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:24.139087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4c839b6d-17e0-49e3-929e-3d33d497585a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:42:24.147417 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4c839b6d-17e0-49e3-929e-3d33d497585a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1756 microversion: 2.1 time: 0.172503 Oct 24 11:42:24.148045 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3794/7610] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:42:23 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:42:25.170978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a7ffa20b-baa9-4a16-ba77-3808007177f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:42:25.171592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a7ffa20b-baa9-4a16-ba77-3808007177f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:42:25.178788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7ffa20b-baa9-4a16-ba77-3808007177f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:25.179831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7ffa20b-baa9-4a16-ba77-3808007177f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:25.180598 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7ffa20b-baa9-4a16-ba77-3808007177f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:25.181341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7ffa20b-baa9-4a16-ba77-3808007177f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:25.181833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7ffa20b-baa9-4a16-ba77-3808007177f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:25.182268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a7ffa20b-baa9-4a16-ba77-3808007177f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:25.324977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a7ffa20b-baa9-4a16-ba77-3808007177f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:42:25.333295 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a7ffa20b-baa9-4a16-ba77-3808007177f9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1756 microversion: 2.1 time: 0.166214 Oct 24 11:42:25.333872 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3817/7611] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:42:25 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:42:26.356907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5a5d21d6-bf91-453a-8a89-42a2fa0bc2a9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:42:26.357537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5a5d21d6-bf91-453a-8a89-42a2fa0bc2a9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:42:26.364566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a5d21d6-bf91-453a-8a89-42a2fa0bc2a9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:26.365093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a5d21d6-bf91-453a-8a89-42a2fa0bc2a9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:26.365544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a5d21d6-bf91-453a-8a89-42a2fa0bc2a9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:26.366252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a5d21d6-bf91-453a-8a89-42a2fa0bc2a9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:26.366793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a5d21d6-bf91-453a-8a89-42a2fa0bc2a9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:26.367370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a5d21d6-bf91-453a-8a89-42a2fa0bc2a9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:26.514772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5a5d21d6-bf91-453a-8a89-42a2fa0bc2a9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:42:26.523436 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5a5d21d6-bf91-453a-8a89-42a2fa0bc2a9 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1759 microversion: 2.1 time: 0.170479 Oct 24 11:42:26.524026 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3795/7612] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:42:26 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:42:58.909162 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7d897585-9eba-4a72-8d55-0ee9045f959e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1320647308"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:42:58.909739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7d897585-9eba-4a72-8d55-0ee9045f959e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:42:58.912040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=12 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:42:58.913080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:42:58.920843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d897585-9eba-4a72-8d55-0ee9045f959e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:58.921346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d897585-9eba-4a72-8d55-0ee9045f959e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:58.921807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d897585-9eba-4a72-8d55-0ee9045f959e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:58.922512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d897585-9eba-4a72-8d55-0ee9045f959e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:58.922973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d897585-9eba-4a72-8d55-0ee9045f959e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:58.923404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7d897585-9eba-4a72-8d55-0ee9045f959e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:59.052448 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.network.security_group_api [None req-7d897585-9eba-4a72-8d55-0ee9045f959e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Removing security group 8a6f0318-82b7-4017-ac0e-7d69b1cbcccf from port 44a95fb8-6c64-49ac-900a-92afe8f9bcd4 Oct 24 11:42:59.360689 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7d897585-9eba-4a72-8d55-0ee9045f959e tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "POST /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/action" status: 202 len: 0 microversion: 2.1 time: 0.455748 Oct 24 11:42:59.361346 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3818/7613] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:42:58 2022] POST /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:42:59.385296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c931a4d1-128f-42cf-952d-04e9d4408991 req-f9a0b6fd-d3ff-43cd-a5ba-705926230190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82c09f3e-23c8-41cb-84fd-529d228fb2f5", "tag": "44a95fb8-6c64-49ac-900a-92afe8f9bcd4"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:42:59.398554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:42:59.399647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=36 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:42:59.409288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c931a4d1-128f-42cf-952d-04e9d4408991 req-f9a0b6fd-d3ff-43cd-a5ba-705926230190 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:42:59.409791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c931a4d1-128f-42cf-952d-04e9d4408991 req-f9a0b6fd-d3ff-43cd-a5ba-705926230190 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:42:59.410238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c931a4d1-128f-42cf-952d-04e9d4408991 req-f9a0b6fd-d3ff-43cd-a5ba-705926230190 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:42:59.431052 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c931a4d1-128f-42cf-952d-04e9d4408991 req-f9a0b6fd-d3ff-43cd-a5ba-705926230190 service nova] Creating event network-changed:44a95fb8-6c64-49ac-900a-92afe8f9bcd4 for instance 82c09f3e-23c8-41cb-84fd-529d228fb2f5 on n-h2-858383-15 Oct 24 11:42:59.437844 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c931a4d1-128f-42cf-952d-04e9d4408991 req-f9a0b6fd-d3ff-43cd-a5ba-705926230190 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056174 Oct 24 11:42:59.439539 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3796/7614] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:43:00.828243 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ceac69d3-37b7-4d08-b172-0b58b44b9e29 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:00.828768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ceac69d3-37b7-4d08-b172-0b58b44b9e29 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:00.835332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ceac69d3-37b7-4d08-b172-0b58b44b9e29 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:00.835947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ceac69d3-37b7-4d08-b172-0b58b44b9e29 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:00.836395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ceac69d3-37b7-4d08-b172-0b58b44b9e29 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:00.837424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ceac69d3-37b7-4d08-b172-0b58b44b9e29 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:00.837916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ceac69d3-37b7-4d08-b172-0b58b44b9e29 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:00.838350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ceac69d3-37b7-4d08-b172-0b58b44b9e29 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:00.925080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-ceac69d3-37b7-4d08-b172-0b58b44b9e29 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lazy-loading 'services' on Instance uuid 82c09f3e-23c8-41cb-84fd-529d228fb2f5 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:43:00.999397 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ceac69d3-37b7-4d08-b172-0b58b44b9e29 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "DELETE /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments/7156a1cc-e31a-478d-a60a-0b23cef76af5" status: 202 len: 0 microversion: 2.1 time: 0.177912 Oct 24 11:43:01.000451 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3819/7615] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 11:43:00 2022] DELETE /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments/7156a1cc-e31a-478d-a60a-0b23cef76af5 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:43:01.009517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-25ecf082-682e-4519-8210-6d37e65e4321 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:01.012409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-25ecf082-682e-4519-8210-6d37e65e4321 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:01.018633 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:43:01.018803 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:43:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments (ip 10.222.0.50) !!! Oct 24 11:43:01.028379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25ecf082-682e-4519-8210-6d37e65e4321 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:01.029192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25ecf082-682e-4519-8210-6d37e65e4321 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:01.029649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25ecf082-682e-4519-8210-6d37e65e4321 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:01.030379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25ecf082-682e-4519-8210-6d37e65e4321 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:01.030846 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25ecf082-682e-4519-8210-6d37e65e4321 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:01.031287 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-25ecf082-682e-4519-8210-6d37e65e4321 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:01.064205 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-25ecf082-682e-4519-8210-6d37e65e4321 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059159 Oct 24 11:43:01.064870 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3797/7616] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:43:01 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:43:01.454138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-c11f458c-9d50-43e7-b5e8-f0fae2d66472 req-2e16ec65-c4d1-470f-a973-c01282c40d73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82c09f3e-23c8-41cb-84fd-529d228fb2f5", "tag": "44a95fb8-6c64-49ac-900a-92afe8f9bcd4"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:43:01.464592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c11f458c-9d50-43e7-b5e8-f0fae2d66472 req-2e16ec65-c4d1-470f-a973-c01282c40d73 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:01.465130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c11f458c-9d50-43e7-b5e8-f0fae2d66472 req-2e16ec65-c4d1-470f-a973-c01282c40d73 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:01.465567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c11f458c-9d50-43e7-b5e8-f0fae2d66472 req-2e16ec65-c4d1-470f-a973-c01282c40d73 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:01.477143 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-c11f458c-9d50-43e7-b5e8-f0fae2d66472 req-2e16ec65-c4d1-470f-a973-c01282c40d73 service nova] Creating event network-changed:44a95fb8-6c64-49ac-900a-92afe8f9bcd4 for instance 82c09f3e-23c8-41cb-84fd-529d228fb2f5 on n-h2-858383-15 Oct 24 11:43:01.482902 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-c11f458c-9d50-43e7-b5e8-f0fae2d66472 req-2e16ec65-c4d1-470f-a973-c01282c40d73 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032841 Oct 24 11:43:01.483513 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3820/7617] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:43:02.077567 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b3b2b58b-06a6-4221-b0a5-632980471349 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:02.080775 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b3b2b58b-06a6-4221-b0a5-632980471349 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:02.087743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3b2b58b-06a6-4221-b0a5-632980471349 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:02.088244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3b2b58b-06a6-4221-b0a5-632980471349 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:02.089262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3b2b58b-06a6-4221-b0a5-632980471349 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:02.089969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3b2b58b-06a6-4221-b0a5-632980471349 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:02.090436 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3b2b58b-06a6-4221-b0a5-632980471349 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:02.090874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b3b2b58b-06a6-4221-b0a5-632980471349 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:02.131352 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b3b2b58b-06a6-4221-b0a5-632980471349 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057991 Oct 24 11:43:02.131973 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3798/7618] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:43:02 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:43:03.146823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ee3ba92d-76ca-4585-b0a2-d3488b08f930 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:03.149230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ee3ba92d-76ca-4585-b0a2-d3488b08f930 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:03.155885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee3ba92d-76ca-4585-b0a2-d3488b08f930 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:03.156344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee3ba92d-76ca-4585-b0a2-d3488b08f930 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:03.156785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee3ba92d-76ca-4585-b0a2-d3488b08f930 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:03.157532 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee3ba92d-76ca-4585-b0a2-d3488b08f930 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:03.157983 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee3ba92d-76ca-4585-b0a2-d3488b08f930 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:03.158407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ee3ba92d-76ca-4585-b0a2-d3488b08f930 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:03.191870 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ee3ba92d-76ca-4585-b0a2-d3488b08f930 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050457 Oct 24 11:43:03.192449 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3821/7619] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:43:03 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:43:04.204747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9851dfd5-9089-44b2-85ae-5ec7344b06cb tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:04.206866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9851dfd5-9089-44b2-85ae-5ec7344b06cb tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:04.214093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9851dfd5-9089-44b2-85ae-5ec7344b06cb tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:04.214601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9851dfd5-9089-44b2-85ae-5ec7344b06cb tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:04.215053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9851dfd5-9089-44b2-85ae-5ec7344b06cb tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:04.215765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9851dfd5-9089-44b2-85ae-5ec7344b06cb tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:04.216234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9851dfd5-9089-44b2-85ae-5ec7344b06cb tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:04.216673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9851dfd5-9089-44b2-85ae-5ec7344b06cb tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:04.246576 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9851dfd5-9089-44b2-85ae-5ec7344b06cb tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045909 Oct 24 11:43:04.247149 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3799/7620] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:43:04 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:43:05.259089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-61fe4d46-d33b-4526-970b-5f6b0a6e5e1a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:05.261932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-61fe4d46-d33b-4526-970b-5f6b0a6e5e1a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:05.269151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61fe4d46-d33b-4526-970b-5f6b0a6e5e1a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:05.269646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61fe4d46-d33b-4526-970b-5f6b0a6e5e1a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:05.270078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61fe4d46-d33b-4526-970b-5f6b0a6e5e1a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:05.270776 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61fe4d46-d33b-4526-970b-5f6b0a6e5e1a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:05.271232 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61fe4d46-d33b-4526-970b-5f6b0a6e5e1a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:05.271656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-61fe4d46-d33b-4526-970b-5f6b0a6e5e1a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:05.302450 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-61fe4d46-d33b-4526-970b-5f6b0a6e5e1a tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047230 Oct 24 11:43:05.303225 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3822/7621] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:43:05 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:43:06.315213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-34f26656-ba8b-476a-84c1-8d50cf2668bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:06.317505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-34f26656-ba8b-476a-84c1-8d50cf2668bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:06.325063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34f26656-ba8b-476a-84c1-8d50cf2668bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:06.325558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34f26656-ba8b-476a-84c1-8d50cf2668bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:06.326004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34f26656-ba8b-476a-84c1-8d50cf2668bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:06.326708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34f26656-ba8b-476a-84c1-8d50cf2668bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:06.327174 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34f26656-ba8b-476a-84c1-8d50cf2668bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:06.327614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34f26656-ba8b-476a-84c1-8d50cf2668bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:06.355664 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-34f26656-ba8b-476a-84c1-8d50cf2668bc tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044549 Oct 24 11:43:06.356221 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3800/7622] 10.222.0.50 () {58 vars in 1302 bytes} [Mon Oct 24 11:43:06 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 11:43:06.366878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8094e7e0-1fa6-4dc7-afc9-c17418314c64 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:06.367374 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8094e7e0-1fa6-4dc7-afc9-c17418314c64 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:06.374866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8094e7e0-1fa6-4dc7-afc9-c17418314c64 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:06.375336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8094e7e0-1fa6-4dc7-afc9-c17418314c64 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:06.375782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8094e7e0-1fa6-4dc7-afc9-c17418314c64 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:06.376482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8094e7e0-1fa6-4dc7-afc9-c17418314c64 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:06.376968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8094e7e0-1fa6-4dc7-afc9-c17418314c64 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:06.377452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8094e7e0-1fa6-4dc7-afc9-c17418314c64 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:06.453279 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-8094e7e0-1fa6-4dc7-afc9-c17418314c64 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] HTTP exception thrown: Instance 82c09f3e-23c8-41cb-84fd-529d228fb2f5 is not attached to volume 7156a1cc-e31a-478d-a60a-0b23cef76af5 Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8094e7e0-1fa6-4dc7-afc9-c17418314c64 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Request method failure captured: Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: request: DELETE /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments/7156a1cc-e31a-478d-a60a-0b23cef76af5 HTTP/1.1 Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnjmgYK4gup8u2PtLT5CPqekpSei60DHS44JZayMxrR_6YrZLDgEHNUBDNPX3SzLIdpgbYpXUwyTEyqOmrgvDf8G35OTqV9cc-FvlwQuftpgkb2ftFvLgkQ0ekOYhdGvbf9T7So2GeSiWfXEzRMb9jflTEH-POwndSCQcTMpUEiMgxU Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: ed3f0cb78cc7439181175560e01c94f1 Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestMinimumBasicScenario-1454217101 Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed3f0cb78cc7439181175560e01c94f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed3f0cb78cc7439181175560e01c94f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed3f0cb78cc7439181175560e01c94f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed3f0cb78cc7439181175560e01c94f1", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestMinimumBasicScenario-1454217101 Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: ed3f0cb78cc7439181175560e01c94f1 Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1454217101 Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestMinimumBasicScenario-1454217101-project Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 815407dc849a4da0a3d924139e50cf9f Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestMinimumBasicScenario-1454217101-project Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 82c09f3e-23c8-41cb-84fd-529d228fb2f5 is not attached to volume 7156a1cc-e31a-478d-a60a-0b23cef76af5 Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'server_id': '82c09f3e-23c8-41cb-84fd-529d228fb2f5', 'id': '7156a1cc-e31a-478d-a60a-0b23cef76af5'} Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7156a1cc-e31a-478d-a60a-0b23cef76af5. Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82c09f3e-23c8-41cb-84fd-529d228fb2f5 is not attached to volume 7156a1cc-e31a-478d-a60a-0b23cef76af5 Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:43:06.454915 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:43:06.459742 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:43:06.459742 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:43:06.459742 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82c09f3e-23c8-41cb-84fd-529d228fb2f5 is not attached to volume 7156a1cc-e31a-478d-a60a-0b23cef76af5 Oct 24 11:43:06.459742 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:43:06.459742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8094e7e0-1fa6-4dc7-afc9-c17418314c64 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Returning 404 to user: Instance 82c09f3e-23c8-41cb-84fd-529d228fb2f5 is not attached to volume 7156a1cc-e31a-478d-a60a-0b23cef76af5 {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:43:06.459742 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8094e7e0-1fa6-4dc7-afc9-c17418314c64 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "DELETE /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments/7156a1cc-e31a-478d-a60a-0b23cef76af5" status: 404 len: 154 microversion: 2.1 time: 0.093564 Oct 24 11:43:06.459742 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3823/7623] 10.222.0.50 () {58 vars in 1416 bytes} [Mon Oct 24 11:43:06 2022] DELETE /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5/os-volume_attachments/7156a1cc-e31a-478d-a60a-0b23cef76af5 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:43:09.709717 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0664864c-5e0e-46e8-822f-f8e790ebdb62 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:09.710221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0664864c-5e0e-46e8-822f-f8e790ebdb62 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:09.717458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0664864c-5e0e-46e8-822f-f8e790ebdb62 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:09.717959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0664864c-5e0e-46e8-822f-f8e790ebdb62 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:09.718412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0664864c-5e0e-46e8-822f-f8e790ebdb62 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:09.719122 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0664864c-5e0e-46e8-822f-f8e790ebdb62 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:09.719595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0664864c-5e0e-46e8-822f-f8e790ebdb62 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:09.720038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0664864c-5e0e-46e8-822f-f8e790ebdb62 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:09.747324 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0664864c-5e0e-46e8-822f-f8e790ebdb62 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:43:09.832923 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0664864c-5e0e-46e8-822f-f8e790ebdb62 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "DELETE /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 204 len: 0 microversion: 2.1 time: 0.126812 Oct 24 11:43:09.834440 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3801/7624] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:43:09 2022] DELETE /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:43:09.842786 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6d92e533-3eaf-4a58-955d-475b7ee56eac tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:09.843404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6d92e533-3eaf-4a58-955d-475b7ee56eac tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:09.851076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d92e533-3eaf-4a58-955d-475b7ee56eac tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:09.851553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d92e533-3eaf-4a58-955d-475b7ee56eac tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:09.851992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d92e533-3eaf-4a58-955d-475b7ee56eac tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:09.852682 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d92e533-3eaf-4a58-955d-475b7ee56eac tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:09.853159 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d92e533-3eaf-4a58-955d-475b7ee56eac tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:09.853585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d92e533-3eaf-4a58-955d-475b7ee56eac tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:09.989855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6d92e533-3eaf-4a58-955d-475b7ee56eac tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:43:09.999125 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6d92e533-3eaf-4a58-955d-475b7ee56eac tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1553 microversion: 2.1 time: 0.160207 Oct 24 11:43:10.012854 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3824/7625] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:43:09 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:43:11.023305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-47f6037f-12e9-420b-a037-0d36bd448253 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:11.024188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-47f6037f-12e9-420b-a037-0d36bd448253 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:11.031885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47f6037f-12e9-420b-a037-0d36bd448253 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:11.032385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47f6037f-12e9-420b-a037-0d36bd448253 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:11.032854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47f6037f-12e9-420b-a037-0d36bd448253 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:11.033564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47f6037f-12e9-420b-a037-0d36bd448253 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:11.034031 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47f6037f-12e9-420b-a037-0d36bd448253 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:11.034470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47f6037f-12e9-420b-a037-0d36bd448253 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:11.164391 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-47f6037f-12e9-420b-a037-0d36bd448253 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:43:11.172806 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-47f6037f-12e9-420b-a037-0d36bd448253 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1553 microversion: 2.1 time: 0.153991 Oct 24 11:43:11.173417 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3802/7626] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:43:11 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:43:12.144703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-d93497c2-2861-47ce-93ab-8c3cdd0984f2 req-e2dd8953-d52c-41b2-b882-cccaef1911e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c09f3e-23c8-41cb-84fd-529d228fb2f5", "name": "network-vif-deleted", "tag": "44a95fb8-6c64-49ac-900a-92afe8f9bcd4"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:43:12.156714 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d93497c2-2861-47ce-93ab-8c3cdd0984f2 req-e2dd8953-d52c-41b2-b882-cccaef1911e3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:12.157279 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d93497c2-2861-47ce-93ab-8c3cdd0984f2 req-e2dd8953-d52c-41b2-b882-cccaef1911e3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:12.158090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-d93497c2-2861-47ce-93ab-8c3cdd0984f2 req-e2dd8953-d52c-41b2-b882-cccaef1911e3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:12.171875 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-d93497c2-2861-47ce-93ab-8c3cdd0984f2 req-e2dd8953-d52c-41b2-b882-cccaef1911e3 service nova] Creating event network-vif-deleted:44a95fb8-6c64-49ac-900a-92afe8f9bcd4 for instance 82c09f3e-23c8-41cb-84fd-529d228fb2f5 on n-h2-858383-15 Oct 24 11:43:12.177569 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-d93497c2-2861-47ce-93ab-8c3cdd0984f2 req-e2dd8953-d52c-41b2-b882-cccaef1911e3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036520 Oct 24 11:43:12.178176 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3825/7627] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:43:12.196966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-80696120-c5f4-4de6-bc63-f56507b11e7c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:12.197596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-80696120-c5f4-4de6-bc63-f56507b11e7c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:12.204760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80696120-c5f4-4de6-bc63-f56507b11e7c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:12.205308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80696120-c5f4-4de6-bc63-f56507b11e7c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:12.205761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80696120-c5f4-4de6-bc63-f56507b11e7c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:12.206470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80696120-c5f4-4de6-bc63-f56507b11e7c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:12.206939 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80696120-c5f4-4de6-bc63-f56507b11e7c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:12.207381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-80696120-c5f4-4de6-bc63-f56507b11e7c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:12.273456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-80696120-c5f4-4de6-bc63-f56507b11e7c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815407dc849a4da0a3d924139e50cf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3f0cb78cc7439181175560e01c94f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:43:12.282214 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-80696120-c5f4-4de6-bc63-f56507b11e7c tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 200 len: 1342 microversion: 2.1 time: 0.089640 Oct 24 11:43:12.282783 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3803/7628] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:43:12 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 1342 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:43:13.306768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-31ba6810-101a-470c-a052-5a8ac3d24326 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:13.307494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-31ba6810-101a-470c-a052-5a8ac3d24326 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] [instance: 82c09f3e-23c8-41cb-84fd-529d228fb2f5] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:13.315311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31ba6810-101a-470c-a052-5a8ac3d24326 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:13.315793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31ba6810-101a-470c-a052-5a8ac3d24326 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:13.316229 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31ba6810-101a-470c-a052-5a8ac3d24326 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:13.316948 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31ba6810-101a-470c-a052-5a8ac3d24326 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:13.317400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31ba6810-101a-470c-a052-5a8ac3d24326 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:13.317826 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-31ba6810-101a-470c-a052-5a8ac3d24326 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:13.334989 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-31ba6810-101a-470c-a052-5a8ac3d24326 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] HTTP exception thrown: Instance 82c09f3e-23c8-41cb-84fd-529d228fb2f5 could not be found. Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-31ba6810-101a-470c-a052-5a8ac3d24326 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Request method failure captured: Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 HTTP/1.1 Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnjmgYK4gup8u2PtLT5CPqekpSei60DHS44JZayMxrR_6YrZLDgEHNUBDNPX3SzLIdpgbYpXUwyTEyqOmrgvDf8G35OTqV9cc-FvlwQuftpgkb2ftFvLgkQ0ekOYhdGvbf9T7So2GeSiWfXEzRMb9jflTEH-POwndSCQcTMpUEiMgxU Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: ed3f0cb78cc7439181175560e01c94f1 Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestMinimumBasicScenario-1454217101 Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed3f0cb78cc7439181175560e01c94f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ed3f0cb78cc7439181175560e01c94f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ed3f0cb78cc7439181175560e01c94f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ed3f0cb78cc7439181175560e01c94f1", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestMinimumBasicScenario-1454217101 Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: ed3f0cb78cc7439181175560e01c94f1 Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1454217101 Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestMinimumBasicScenario-1454217101-project Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 815407dc849a4da0a3d924139e50cf9f Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestMinimumBasicScenario-1454217101-project Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 82c09f3e-23c8-41cb-84fd-529d228fb2f5 could not be found. Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '82c09f3e-23c8-41cb-84fd-529d228fb2f5'} Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82c09f3e-23c8-41cb-84fd-529d228fb2f5 could not be found. Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82c09f3e-23c8-41cb-84fd-529d228fb2f5 could not be found. Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:43:13.336660 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:43:13.341230 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:43:13.341230 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:43:13.341230 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:43:13.341230 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:43:13.341230 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:43:13.341230 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82c09f3e-23c8-41cb-84fd-529d228fb2f5 could not be found. Oct 24 11:43:13.341230 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:43:13.341230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-31ba6810-101a-470c-a052-5a8ac3d24326 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Returning 404 to user: Instance 82c09f3e-23c8-41cb-84fd-529d228fb2f5 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:43:13.341230 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-31ba6810-101a-470c-a052-5a8ac3d24326 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5" status: 404 len: 111 microversion: 2.1 time: 0.035579 Oct 24 11:43:13.341230 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3826/7629] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:43:13 2022] GET /compute/v2.1/servers/82c09f3e-23c8-41cb-84fd-529d228fb2f5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:43:13.347132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-26bb1c7c-fc3a-428a-ad34-0bd7ea4051a3 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] Calling method '.version_select at 0x7f04d0bbadc0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:13.367948 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-26bb1c7c-fc3a-428a-ad34-0bd7ea4051a3 tempest-TestMinimumBasicScenario-1454217101 tempest-TestMinimumBasicScenario-1454217101-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-779310851" status: 202 len: 0 microversion: 2.1 time: 0.024658 Oct 24 11:43:13.368535 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3804/7630] 10.222.0.50 () {58 vars in 1269 bytes} [Mon Oct 24 11:43:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-779310851 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:43:22.762670 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ff231894-e499-4234-b4d2-51c70a1583bd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'create', calling method: .version_select at 0x7f04d078d790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1845504167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ1cKusG2H+uWF//2X8KNnQfDdwk2QZTaQL4cibMz1zoZH6d4LZchXJb5YqEf0qjwsVluWgK0G5ecCvtEDZmeEuxwGFqUf3vAnthZ4eBgs1ogy7NFX6Fi7GGOcZ8I+ziQ=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:43:22.777822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-ff231894-e499-4234-b4d2-51c70a1583bd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:43:22.783805 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-ff231894-e499-4234-b4d2-51c70a1583bd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for user f80525ed5fa842e18c9ec15fe2cd4053 and project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:43:22.811185 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ff231894-e499-4234-b4d2-51c70a1583bd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.210313 Oct 24 11:43:22.817611 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3827/7631] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:43:22 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:43:28.547892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:43:28.550153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:43:28.554552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a9f37053-4cb9-4bf7-982c-0c3c58a39916 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1573807068", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "9a0b0481-aa00-45cf-ae8f-b5ae590a5d42"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1845504167", "security_groups": [{"name": "tempest-secgroup-smoke-1628326183"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:43:28.699446 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-a9f37053-4cb9-4bf7-982c-0c3c58a39916 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] validate_networks() for [('9a0b0481-aa00-45cf-ae8f-b5ae590a5d42', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:43:29.339263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a9f37053-4cb9-4bf7-982c-0c3c58a39916 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:43:29.340133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a9f37053-4cb9-4bf7-982c-0c3c58a39916 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:43:29.340886 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a9f37053-4cb9-4bf7-982c-0c3c58a39916 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:43:29.342019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a9f37053-4cb9-4bf7-982c-0c3c58a39916 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:43:29.342742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a9f37053-4cb9-4bf7-982c-0c3c58a39916 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:43:29.354698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9f37053-4cb9-4bf7-982c-0c3c58a39916 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:29.355965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9f37053-4cb9-4bf7-982c-0c3c58a39916 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:29.356707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9f37053-4cb9-4bf7-982c-0c3c58a39916 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:29.357731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9f37053-4cb9-4bf7-982c-0c3c58a39916 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:29.358574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9f37053-4cb9-4bf7-982c-0c3c58a39916 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:29.360016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9f37053-4cb9-4bf7-982c-0c3c58a39916 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:29.381095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-a9f37053-4cb9-4bf7-982c-0c3c58a39916 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:43:29.387620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-a9f37053-4cb9-4bf7-982c-0c3c58a39916 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for user f80525ed5fa842e18c9ec15fe2cd4053 and project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:43:29.401935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a9f37053-4cb9-4bf7-982c-0c3c58a39916 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:43:29.404556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a9f37053-4cb9-4bf7-982c-0c3c58a39916 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:43:29.462966 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a9f37053-4cb9-4bf7-982c-0c3c58a39916 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.916633 Oct 24 11:43:29.468997 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3805/7632] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:43:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:43:29.476514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-293f64a2-fbd9-4f39-ab7e-7aa1f0b13994 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:29.477773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-293f64a2-fbd9-4f39-ab7e-7aa1f0b13994 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:29.486046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:43:29.488993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:43:29.569398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-293f64a2-fbd9-4f39-ab7e-7aa1f0b13994 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:43:29.580392 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-293f64a2-fbd9-4f39-ab7e-7aa1f0b13994 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1267 microversion: 2.1 time: 0.108568 Oct 24 11:43:29.593863 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3828/7633] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:43:29 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1267 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:43:30.607320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0a92b41a-193a-4acd-ac26-71237edb02ee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:30.607974 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0a92b41a-193a-4acd-ac26-71237edb02ee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:30.616620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a92b41a-193a-4acd-ac26-71237edb02ee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:30.616620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a92b41a-193a-4acd-ac26-71237edb02ee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:30.616620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a92b41a-193a-4acd-ac26-71237edb02ee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:30.617259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a92b41a-193a-4acd-ac26-71237edb02ee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:30.618693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a92b41a-193a-4acd-ac26-71237edb02ee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:30.619189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0a92b41a-193a-4acd-ac26-71237edb02ee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:30.697088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0a92b41a-193a-4acd-ac26-71237edb02ee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:43:30.706892 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0a92b41a-193a-4acd-ac26-71237edb02ee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1319 microversion: 2.1 time: 0.104628 Oct 24 11:43:30.707312 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3806/7634] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:43:30 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1319 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:43:31.731557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7eb9e057-2b8a-49b5-94b4-df4051d049f2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:31.732189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7eb9e057-2b8a-49b5-94b4-df4051d049f2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:31.739857 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7eb9e057-2b8a-49b5-94b4-df4051d049f2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:31.740345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7eb9e057-2b8a-49b5-94b4-df4051d049f2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:31.740792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7eb9e057-2b8a-49b5-94b4-df4051d049f2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:31.741529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7eb9e057-2b8a-49b5-94b4-df4051d049f2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:31.741991 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7eb9e057-2b8a-49b5-94b4-df4051d049f2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:31.742424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7eb9e057-2b8a-49b5-94b4-df4051d049f2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:31.884048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7eb9e057-2b8a-49b5-94b4-df4051d049f2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:43:31.893582 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7eb9e057-2b8a-49b5-94b4-df4051d049f2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1393 microversion: 2.1 time: 0.166242 Oct 24 11:43:31.894270 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3829/7635] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:43:31 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:43:32.313902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-c414fe11-68bf-411e-8822-d7cf9cf7b441 req-95fd6a25-db01-4fd4-ba6e-cbb3daec8bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04", "tag": "af2a3e6a-b3ef-4df8-a28e-27320c4b2303"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:43:32.325730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c414fe11-68bf-411e-8822-d7cf9cf7b441 req-95fd6a25-db01-4fd4-ba6e-cbb3daec8bc5 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:32.326798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c414fe11-68bf-411e-8822-d7cf9cf7b441 req-95fd6a25-db01-4fd4-ba6e-cbb3daec8bc5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:32.327340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-c414fe11-68bf-411e-8822-d7cf9cf7b441 req-95fd6a25-db01-4fd4-ba6e-cbb3daec8bc5 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:32.341620 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-c414fe11-68bf-411e-8822-d7cf9cf7b441 req-95fd6a25-db01-4fd4-ba6e-cbb3daec8bc5 service nova] Creating event network-changed:af2a3e6a-b3ef-4df8-a28e-27320c4b2303 for instance 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 on n-h2-858383-15 Oct 24 11:43:32.346927 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-c414fe11-68bf-411e-8822-d7cf9cf7b441 req-95fd6a25-db01-4fd4-ba6e-cbb3daec8bc5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036988 Oct 24 11:43:32.347546 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3807/7636] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:43:32.917153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-53d4f9c4-bc8f-415e-b724-01416c465520 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:32.917775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-53d4f9c4-bc8f-415e-b724-01416c465520 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:32.924797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53d4f9c4-bc8f-415e-b724-01416c465520 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:32.925319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53d4f9c4-bc8f-415e-b724-01416c465520 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:32.925762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53d4f9c4-bc8f-415e-b724-01416c465520 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:32.926461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53d4f9c4-bc8f-415e-b724-01416c465520 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:32.926919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53d4f9c4-bc8f-415e-b724-01416c465520 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:32.927357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-53d4f9c4-bc8f-415e-b724-01416c465520 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:33.061289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-53d4f9c4-bc8f-415e-b724-01416c465520 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:43:33.068971 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-53d4f9c4-bc8f-415e-b724-01416c465520 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1393 microversion: 2.1 time: 0.155809 Oct 24 11:43:33.069550 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3830/7637] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:43:32 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:43:34.093821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-df56b5f0-d38d-4ced-8323-bec4c62e9caf tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:34.094668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-df56b5f0-d38d-4ced-8323-bec4c62e9caf tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:34.101019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df56b5f0-d38d-4ced-8323-bec4c62e9caf tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:34.101622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df56b5f0-d38d-4ced-8323-bec4c62e9caf tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:34.102154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df56b5f0-d38d-4ced-8323-bec4c62e9caf tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:34.102942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df56b5f0-d38d-4ced-8323-bec4c62e9caf tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:34.103599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df56b5f0-d38d-4ced-8323-bec4c62e9caf tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:34.104707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-df56b5f0-d38d-4ced-8323-bec4c62e9caf tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:34.239885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-df56b5f0-d38d-4ced-8323-bec4c62e9caf tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:43:34.247820 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-df56b5f0-d38d-4ced-8323-bec4c62e9caf tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1393 microversion: 2.1 time: 0.159940 Oct 24 11:43:34.248406 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3808/7638] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:43:34 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:43:35.270022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8d03bd9e-5177-49bb-92ce-e2e36aab9485 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:35.270639 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8d03bd9e-5177-49bb-92ce-e2e36aab9485 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:35.277783 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d03bd9e-5177-49bb-92ce-e2e36aab9485 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:35.278271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d03bd9e-5177-49bb-92ce-e2e36aab9485 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:35.278712 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d03bd9e-5177-49bb-92ce-e2e36aab9485 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:35.279409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d03bd9e-5177-49bb-92ce-e2e36aab9485 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:35.279865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d03bd9e-5177-49bb-92ce-e2e36aab9485 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:35.280294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d03bd9e-5177-49bb-92ce-e2e36aab9485 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:35.409085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d03bd9e-5177-49bb-92ce-e2e36aab9485 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:43:35.417748 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8d03bd9e-5177-49bb-92ce-e2e36aab9485 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1393 microversion: 2.1 time: 0.151521 Oct 24 11:43:35.418340 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3831/7639] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:43:35 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:43:36.441075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ac33d7a9-84ee-473e-bd22-b3f542645e22 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:36.441767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ac33d7a9-84ee-473e-bd22-b3f542645e22 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:36.449291 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac33d7a9-84ee-473e-bd22-b3f542645e22 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:36.449796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac33d7a9-84ee-473e-bd22-b3f542645e22 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:36.450252 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac33d7a9-84ee-473e-bd22-b3f542645e22 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:36.450966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac33d7a9-84ee-473e-bd22-b3f542645e22 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:36.451444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac33d7a9-84ee-473e-bd22-b3f542645e22 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:36.451893 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac33d7a9-84ee-473e-bd22-b3f542645e22 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:36.590346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ac33d7a9-84ee-473e-bd22-b3f542645e22 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:43:36.598158 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ac33d7a9-84ee-473e-bd22-b3f542645e22 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1393 microversion: 2.1 time: 0.161077 Oct 24 11:43:36.598960 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3809/7640] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:43:36 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:43:37.622647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1a4b01a9-7a55-4692-a22b-6bc214dbf0ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:37.623266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1a4b01a9-7a55-4692-a22b-6bc214dbf0ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:37.630095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a4b01a9-7a55-4692-a22b-6bc214dbf0ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:37.630943 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a4b01a9-7a55-4692-a22b-6bc214dbf0ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:37.631393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a4b01a9-7a55-4692-a22b-6bc214dbf0ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:37.632094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a4b01a9-7a55-4692-a22b-6bc214dbf0ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:37.632548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a4b01a9-7a55-4692-a22b-6bc214dbf0ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:37.633016 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1a4b01a9-7a55-4692-a22b-6bc214dbf0ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:37.766053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1a4b01a9-7a55-4692-a22b-6bc214dbf0ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:43:37.773953 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1a4b01a9-7a55-4692-a22b-6bc214dbf0ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1393 microversion: 2.1 time: 0.156336 Oct 24 11:43:37.774878 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3832/7641] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:43:37 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:43:38.797716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-be629252-03e2-44ab-8ae3-e1a61c312a36 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:38.798347 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-be629252-03e2-44ab-8ae3-e1a61c312a36 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:38.805211 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be629252-03e2-44ab-8ae3-e1a61c312a36 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:38.805703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be629252-03e2-44ab-8ae3-e1a61c312a36 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:38.806154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be629252-03e2-44ab-8ae3-e1a61c312a36 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:38.806898 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be629252-03e2-44ab-8ae3-e1a61c312a36 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:38.807362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be629252-03e2-44ab-8ae3-e1a61c312a36 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:38.807827 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-be629252-03e2-44ab-8ae3-e1a61c312a36 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:38.944043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-be629252-03e2-44ab-8ae3-e1a61c312a36 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:43:38.952266 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-be629252-03e2-44ab-8ae3-e1a61c312a36 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1393 microversion: 2.1 time: 0.158435 Oct 24 11:43:38.952870 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3810/7642] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:43:38 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:43:38.992771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-572312d5-dda1-4944-9e44-0d15a0e919fe req-81009845-bc24-4f86-b6d2-3598e87a94e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04", "name": "network-vif-plugged", "status": "completed", "tag": "af2a3e6a-b3ef-4df8-a28e-27320c4b2303"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:43:39.004476 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-572312d5-dda1-4944-9e44-0d15a0e919fe req-81009845-bc24-4f86-b6d2-3598e87a94e9 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:39.005003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-572312d5-dda1-4944-9e44-0d15a0e919fe req-81009845-bc24-4f86-b6d2-3598e87a94e9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:39.005450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-572312d5-dda1-4944-9e44-0d15a0e919fe req-81009845-bc24-4f86-b6d2-3598e87a94e9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:39.017390 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-572312d5-dda1-4944-9e44-0d15a0e919fe req-81009845-bc24-4f86-b6d2-3598e87a94e9 service nova] Creating event network-vif-plugged:af2a3e6a-b3ef-4df8-a28e-27320c4b2303 for instance 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 on n-h2-858383-15 Oct 24 11:43:39.022443 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-572312d5-dda1-4944-9e44-0d15a0e919fe req-81009845-bc24-4f86-b6d2-3598e87a94e9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033377 Oct 24 11:43:39.023052 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3833/7643] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:43:39.976032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-992dbd85-9881-47c9-b59e-29091be6c13b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:39.976665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-992dbd85-9881-47c9-b59e-29091be6c13b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:39.978695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:43:39.979384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:43:39.986160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-992dbd85-9881-47c9-b59e-29091be6c13b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:39.986657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-992dbd85-9881-47c9-b59e-29091be6c13b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:39.987110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-992dbd85-9881-47c9-b59e-29091be6c13b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:39.987821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-992dbd85-9881-47c9-b59e-29091be6c13b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:39.988295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-992dbd85-9881-47c9-b59e-29091be6c13b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:39.988739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-992dbd85-9881-47c9-b59e-29091be6c13b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:40.122765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-992dbd85-9881-47c9-b59e-29091be6c13b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:43:40.131265 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-992dbd85-9881-47c9-b59e-29091be6c13b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1393 microversion: 2.1 time: 0.159162 Oct 24 11:43:40.131875 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3811/7644] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:43:39 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:43:41.153451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:43:41.158953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-84e00f5b-36b7-42d5-8e18-3060d748f630 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:41.159671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-84e00f5b-36b7-42d5-8e18-3060d748f630 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:41.166605 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84e00f5b-36b7-42d5-8e18-3060d748f630 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:41.167095 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84e00f5b-36b7-42d5-8e18-3060d748f630 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:41.167537 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84e00f5b-36b7-42d5-8e18-3060d748f630 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:41.168239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84e00f5b-36b7-42d5-8e18-3060d748f630 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:41.168699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84e00f5b-36b7-42d5-8e18-3060d748f630 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:41.169171 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-84e00f5b-36b7-42d5-8e18-3060d748f630 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:41.301908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-84e00f5b-36b7-42d5-8e18-3060d748f630 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:43:41.309698 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-84e00f5b-36b7-42d5-8e18-3060d748f630 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1562 microversion: 2.1 time: 0.157226 Oct 24 11:43:41.310296 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3834/7645] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:43:41 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:43:41.332234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-71a3e7a1-675d-4fac-ba63-c239b8d23d3d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:41.332903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-71a3e7a1-675d-4fac-ba63-c239b8d23d3d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:41.340515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71a3e7a1-675d-4fac-ba63-c239b8d23d3d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:41.341059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71a3e7a1-675d-4fac-ba63-c239b8d23d3d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:41.341517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71a3e7a1-675d-4fac-ba63-c239b8d23d3d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:41.342233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71a3e7a1-675d-4fac-ba63-c239b8d23d3d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:41.342703 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71a3e7a1-675d-4fac-ba63-c239b8d23d3d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:41.343149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-71a3e7a1-675d-4fac-ba63-c239b8d23d3d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:41.476197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-71a3e7a1-675d-4fac-ba63-c239b8d23d3d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:43:41.484072 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-71a3e7a1-675d-4fac-ba63-c239b8d23d3d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1562 microversion: 2.1 time: 0.155672 Oct 24 11:43:41.484646 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3812/7646] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:43:41 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:43:43.062470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0df037d0-3a00-4f6a-970e-7be82d872ff0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:43:43.063916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0df037d0-3a00-4f6a-970e-7be82d872ff0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:43:43.070958 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0df037d0-3a00-4f6a-970e-7be82d872ff0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:43.072746 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0df037d0-3a00-4f6a-970e-7be82d872ff0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:43.073964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0df037d0-3a00-4f6a-970e-7be82d872ff0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:43.075022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0df037d0-3a00-4f6a-970e-7be82d872ff0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:43.075495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0df037d0-3a00-4f6a-970e-7be82d872ff0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:43.075940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0df037d0-3a00-4f6a-970e-7be82d872ff0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:43.133454 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a8953c5e-27f1-489d-baad-6326585f1b7c req-bc71c5b8-5e29-45dc-8ce3-ec45f7fd6b70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04", "tag": "af2a3e6a-b3ef-4df8-a28e-27320c4b2303"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:43:43.144046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a8953c5e-27f1-489d-baad-6326585f1b7c req-bc71c5b8-5e29-45dc-8ce3-ec45f7fd6b70 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:43:43.144561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a8953c5e-27f1-489d-baad-6326585f1b7c req-bc71c5b8-5e29-45dc-8ce3-ec45f7fd6b70 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:43:43.145058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a8953c5e-27f1-489d-baad-6326585f1b7c req-bc71c5b8-5e29-45dc-8ce3-ec45f7fd6b70 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:43:43.162188 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a8953c5e-27f1-489d-baad-6326585f1b7c req-bc71c5b8-5e29-45dc-8ce3-ec45f7fd6b70 service nova] Creating event network-changed:af2a3e6a-b3ef-4df8-a28e-27320c4b2303 for instance 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 on n-h2-858383-15 Oct 24 11:43:43.168401 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a8953c5e-27f1-489d-baad-6326585f1b7c req-bc71c5b8-5e29-45dc-8ce3-ec45f7fd6b70 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112179 Oct 24 11:43:43.169231 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3813/7647] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:43:43.230676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0df037d0-3a00-4f6a-970e-7be82d872ff0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:43:43.238980 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0df037d0-3a00-4f6a-970e-7be82d872ff0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1562 microversion: 2.1 time: 0.186222 Oct 24 11:43:43.239598 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3835/7648] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:43:43 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1562 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:44:06.492032 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-95786581-8dcb-4c2e-8445-8ea8033b89e7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:44:06.494397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-95786581-8dcb-4c2e-8445-8ea8033b89e7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:06.497968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:44:06.498653 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=42 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:44:06.505002 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95786581-8dcb-4c2e-8445-8ea8033b89e7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:06.505500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95786581-8dcb-4c2e-8445-8ea8033b89e7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:06.505952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95786581-8dcb-4c2e-8445-8ea8033b89e7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:06.506657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95786581-8dcb-4c2e-8445-8ea8033b89e7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:06.507123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95786581-8dcb-4c2e-8445-8ea8033b89e7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:06.507595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-95786581-8dcb-4c2e-8445-8ea8033b89e7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:06.576218 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-95786581-8dcb-4c2e-8445-8ea8033b89e7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04/action" status: 200 len: 24562 microversion: 2.1 time: 0.088287 Oct 24 11:44:06.577126 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3814/7649] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:44:06 2022] POST /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04/action => generated 24562 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 11:44:13.041000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ec6d7dea-9bb8-485e-a813-f18002779103 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:44:13.041556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ec6d7dea-9bb8-485e-a813-f18002779103 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:13.043487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=17 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:44:13.044165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=38 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:44:13.050562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec6d7dea-9bb8-485e-a813-f18002779103 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:13.051051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec6d7dea-9bb8-485e-a813-f18002779103 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:13.051494 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec6d7dea-9bb8-485e-a813-f18002779103 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:13.052188 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec6d7dea-9bb8-485e-a813-f18002779103 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:13.052646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec6d7dea-9bb8-485e-a813-f18002779103 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:13.053112 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ec6d7dea-9bb8-485e-a813-f18002779103 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:13.121090 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ec6d7dea-9bb8-485e-a813-f18002779103 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04/action" status: 202 len: 0 microversion: 2.1 time: 0.082677 Oct 24 11:44:13.121090 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3836/7650] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:44:13 2022] POST /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:44:13.132080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ccadd8af-a55e-4a4d-9160-f79a3cef7796 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:13.132798 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ccadd8af-a55e-4a4d-9160-f79a3cef7796 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:13.140855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccadd8af-a55e-4a4d-9160-f79a3cef7796 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:13.141369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccadd8af-a55e-4a4d-9160-f79a3cef7796 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:13.141854 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccadd8af-a55e-4a4d-9160-f79a3cef7796 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:13.142716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccadd8af-a55e-4a4d-9160-f79a3cef7796 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:13.143190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccadd8af-a55e-4a4d-9160-f79a3cef7796 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:13.143634 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccadd8af-a55e-4a4d-9160-f79a3cef7796 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:13.278450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ccadd8af-a55e-4a4d-9160-f79a3cef7796 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:13.287556 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ccadd8af-a55e-4a4d-9160-f79a3cef7796 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1686 microversion: 2.1 time: 0.160247 Oct 24 11:44:13.288116 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3815/7651] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:13 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:44:14.314350 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ca57bbdc-ee86-40a3-a83b-d25d10e6d6da tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:14.315065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ca57bbdc-ee86-40a3-a83b-d25d10e6d6da tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:14.321424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca57bbdc-ee86-40a3-a83b-d25d10e6d6da tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:14.321911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca57bbdc-ee86-40a3-a83b-d25d10e6d6da tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:14.322352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca57bbdc-ee86-40a3-a83b-d25d10e6d6da tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:14.323053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca57bbdc-ee86-40a3-a83b-d25d10e6d6da tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:14.323511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca57bbdc-ee86-40a3-a83b-d25d10e6d6da tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:14.323945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ca57bbdc-ee86-40a3-a83b-d25d10e6d6da tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:14.463596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ca57bbdc-ee86-40a3-a83b-d25d10e6d6da tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:14.472393 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ca57bbdc-ee86-40a3-a83b-d25d10e6d6da tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1666 microversion: 2.1 time: 0.164511 Oct 24 11:44:14.472996 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3837/7652] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:14 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1666 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:44:15.567153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5e2257a0-29e6-4e0e-80b2-c716727dd89a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:44:15.569385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5e2257a0-29e6-4e0e-80b2-c716727dd89a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:15.577034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e2257a0-29e6-4e0e-80b2-c716727dd89a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:15.577534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e2257a0-29e6-4e0e-80b2-c716727dd89a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:15.577986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e2257a0-29e6-4e0e-80b2-c716727dd89a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:15.578690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e2257a0-29e6-4e0e-80b2-c716727dd89a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:15.579160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e2257a0-29e6-4e0e-80b2-c716727dd89a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:15.579602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5e2257a0-29e6-4e0e-80b2-c716727dd89a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:15.649405 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5e2257a0-29e6-4e0e-80b2-c716727dd89a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04/action" status: 200 len: 32635 microversion: 2.1 time: 0.085966 Oct 24 11:44:15.650075 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3816/7653] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:44:15 2022] POST /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04/action => generated 32635 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 11:44:15.662134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-37348abd-d98f-4551-b4a0-d2d18142415c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:44:15.662678 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-37348abd-d98f-4551-b4a0-d2d18142415c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:15.670235 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37348abd-d98f-4551-b4a0-d2d18142415c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:15.670937 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37348abd-d98f-4551-b4a0-d2d18142415c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:15.671382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37348abd-d98f-4551-b4a0-d2d18142415c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:15.672086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37348abd-d98f-4551-b4a0-d2d18142415c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:15.672541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37348abd-d98f-4551-b4a0-d2d18142415c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:15.673004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-37348abd-d98f-4551-b4a0-d2d18142415c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:15.738042 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-37348abd-d98f-4551-b4a0-d2d18142415c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04/action" status: 202 len: 0 microversion: 2.1 time: 0.080057 Oct 24 11:44:15.738684 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3838/7654] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:44:15 2022] POST /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:44:15.748314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e7c4891-479d-4318-906a-148f426f54c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:15.749362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0e7c4891-479d-4318-906a-148f426f54c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:15.756410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e7c4891-479d-4318-906a-148f426f54c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:15.756949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e7c4891-479d-4318-906a-148f426f54c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:15.757895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e7c4891-479d-4318-906a-148f426f54c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:15.758141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e7c4891-479d-4318-906a-148f426f54c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:15.758614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e7c4891-479d-4318-906a-148f426f54c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:15.759141 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e7c4891-479d-4318-906a-148f426f54c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:15.893909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0e7c4891-479d-4318-906a-148f426f54c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:15.901664 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e7c4891-479d-4318-906a-148f426f54c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1673 microversion: 2.1 time: 0.158312 Oct 24 11:44:15.902250 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3817/7655] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:15 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:44:16.927846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-083d0162-6230-48d1-9bd6-e3c8f905ad11 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:16.928490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-083d0162-6230-48d1-9bd6-e3c8f905ad11 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:16.934660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-083d0162-6230-48d1-9bd6-e3c8f905ad11 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:16.935733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-083d0162-6230-48d1-9bd6-e3c8f905ad11 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:16.936169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-083d0162-6230-48d1-9bd6-e3c8f905ad11 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:16.936876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-083d0162-6230-48d1-9bd6-e3c8f905ad11 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:16.937331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-083d0162-6230-48d1-9bd6-e3c8f905ad11 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:16.937756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-083d0162-6230-48d1-9bd6-e3c8f905ad11 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:17.070137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-083d0162-6230-48d1-9bd6-e3c8f905ad11 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:17.077832 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-083d0162-6230-48d1-9bd6-e3c8f905ad11 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1681 microversion: 2.1 time: 0.155259 Oct 24 11:44:17.078411 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3839/7656] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:16 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:44:17.181778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a08d2943-c930-4e06-ad07-ab4cea5b802a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:44:17.183945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a08d2943-c930-4e06-ad07-ab4cea5b802a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:17.191905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a08d2943-c930-4e06-ad07-ab4cea5b802a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:17.192413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a08d2943-c930-4e06-ad07-ab4cea5b802a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:17.192899 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a08d2943-c930-4e06-ad07-ab4cea5b802a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:17.193620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a08d2943-c930-4e06-ad07-ab4cea5b802a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:17.194110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a08d2943-c930-4e06-ad07-ab4cea5b802a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:17.194560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a08d2943-c930-4e06-ad07-ab4cea5b802a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:17.256099 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a08d2943-c930-4e06-ad07-ab4cea5b802a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04/action" status: 200 len: 36263 microversion: 2.1 time: 0.078166 Oct 24 11:44:17.256736 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3818/7657] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:44:17 2022] POST /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04/action => generated 36263 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 11:44:18.582977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e6ecd050-ee4e-4067-89b9-81365634e5a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:18.583516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e6ecd050-ee4e-4067-89b9-81365634e5a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:18.589053 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-6e64531f-cd76-4427-bc51-ef4b3ba7d965 req-36e0e64b-d5eb-4537-a235-31c796e32259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04", "tag": "af2a3e6a-b3ef-4df8-a28e-27320c4b2303"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:44:18.600139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6ecd050-ee4e-4067-89b9-81365634e5a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:18.600631 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6ecd050-ee4e-4067-89b9-81365634e5a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:18.601369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6ecd050-ee4e-4067-89b9-81365634e5a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:18.602326 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6ecd050-ee4e-4067-89b9-81365634e5a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:18.602851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6ecd050-ee4e-4067-89b9-81365634e5a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:18.603343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6e64531f-cd76-4427-bc51-ef4b3ba7d965 req-36e0e64b-d5eb-4537-a235-31c796e32259 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:18.603473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e6ecd050-ee4e-4067-89b9-81365634e5a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:18.603848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6e64531f-cd76-4427-bc51-ef4b3ba7d965 req-36e0e64b-d5eb-4537-a235-31c796e32259 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:18.604307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6e64531f-cd76-4427-bc51-ef4b3ba7d965 req-36e0e64b-d5eb-4537-a235-31c796e32259 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:18.618711 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-6e64531f-cd76-4427-bc51-ef4b3ba7d965 req-36e0e64b-d5eb-4537-a235-31c796e32259 service nova] Creating event network-changed:af2a3e6a-b3ef-4df8-a28e-27320c4b2303 for instance 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 on n-h2-858383-15 Oct 24 11:44:18.625051 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-6e64531f-cd76-4427-bc51-ef4b3ba7d965 req-36e0e64b-d5eb-4537-a235-31c796e32259 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039865 Oct 24 11:44:18.625865 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3819/7658] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:44:18.639778 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e6ecd050-ee4e-4067-89b9-81365634e5a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:44:18.732167 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e6ecd050-ee4e-4067-89b9-81365634e5a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 204 len: 0 microversion: 2.1 time: 0.152462 Oct 24 11:44:18.733065 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3840/7659] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:44:18 2022] DELETE /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:44:18.742373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c8803732-e52c-429d-b0e2-65be0968d69c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:18.743200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c8803732-e52c-429d-b0e2-65be0968d69c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:18.750102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8803732-e52c-429d-b0e2-65be0968d69c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:18.750702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8803732-e52c-429d-b0e2-65be0968d69c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:18.751175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8803732-e52c-429d-b0e2-65be0968d69c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:18.751912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8803732-e52c-429d-b0e2-65be0968d69c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:18.752546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8803732-e52c-429d-b0e2-65be0968d69c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:18.753030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c8803732-e52c-429d-b0e2-65be0968d69c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:18.892859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c8803732-e52c-429d-b0e2-65be0968d69c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:18.901409 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c8803732-e52c-429d-b0e2-65be0968d69c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1687 microversion: 2.1 time: 0.163869 Oct 24 11:44:18.901996 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3820/7660] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:18 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:44:19.926518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-442ecc8a-22df-43f1-b072-3496651368f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:19.927221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-442ecc8a-22df-43f1-b072-3496651368f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:19.933946 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-442ecc8a-22df-43f1-b072-3496651368f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:19.934430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-442ecc8a-22df-43f1-b072-3496651368f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:19.935612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-442ecc8a-22df-43f1-b072-3496651368f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:19.936485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-442ecc8a-22df-43f1-b072-3496651368f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:19.936964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-442ecc8a-22df-43f1-b072-3496651368f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:19.937396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-442ecc8a-22df-43f1-b072-3496651368f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:20.073461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-442ecc8a-22df-43f1-b072-3496651368f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:20.081503 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-442ecc8a-22df-43f1-b072-3496651368f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1687 microversion: 2.1 time: 0.159273 Oct 24 11:44:20.082078 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3841/7661] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:19 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:44:21.106497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43b7f38f-d330-4538-962d-3676a708abe8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:21.107170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-43b7f38f-d330-4538-962d-3676a708abe8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:21.115079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43b7f38f-d330-4538-962d-3676a708abe8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:21.115581 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43b7f38f-d330-4538-962d-3676a708abe8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:21.116037 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43b7f38f-d330-4538-962d-3676a708abe8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:21.118058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43b7f38f-d330-4538-962d-3676a708abe8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:21.118542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43b7f38f-d330-4538-962d-3676a708abe8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:21.118986 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43b7f38f-d330-4538-962d-3676a708abe8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:21.159070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-1e26e548-f47b-4a7d-8b29-5910442f892d req-55dda674-607f-4fc5-b471-80a4d6d24b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04", "name": "network-vif-deleted", "tag": "af2a3e6a-b3ef-4df8-a28e-27320c4b2303"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:44:21.177866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1e26e548-f47b-4a7d-8b29-5910442f892d req-55dda674-607f-4fc5-b471-80a4d6d24b0a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:21.178417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1e26e548-f47b-4a7d-8b29-5910442f892d req-55dda674-607f-4fc5-b471-80a4d6d24b0a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:21.178772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-1e26e548-f47b-4a7d-8b29-5910442f892d req-55dda674-607f-4fc5-b471-80a4d6d24b0a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:21.192275 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-1e26e548-f47b-4a7d-8b29-5910442f892d req-55dda674-607f-4fc5-b471-80a4d6d24b0a service nova] Creating event network-vif-deleted:af2a3e6a-b3ef-4df8-a28e-27320c4b2303 for instance 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 on n-h2-858383-15 Oct 24 11:44:21.193656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-43b7f38f-d330-4538-962d-3676a708abe8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:21.197466 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-1e26e548-f47b-4a7d-8b29-5910442f892d req-55dda674-607f-4fc5-b471-80a4d6d24b0a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042502 Oct 24 11:44:21.198058 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3842/7662] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:44:21.202722 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-43b7f38f-d330-4538-962d-3676a708abe8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 200 len: 1500 microversion: 2.1 time: 0.100694 Oct 24 11:44:21.203304 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3821/7663] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:21 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 1500 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:44:22.227365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8834a399-f505-4920-8fb6-3715ff129be9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:22.228064 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8834a399-f505-4920-8fb6-3715ff129be9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:22.234357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8834a399-f505-4920-8fb6-3715ff129be9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:22.234843 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8834a399-f505-4920-8fb6-3715ff129be9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:22.235280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8834a399-f505-4920-8fb6-3715ff129be9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:22.235965 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8834a399-f505-4920-8fb6-3715ff129be9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:22.236415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8834a399-f505-4920-8fb6-3715ff129be9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:22.236865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8834a399-f505-4920-8fb6-3715ff129be9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:22.249905 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-8834a399-f505-4920-8fb6-3715ff129be9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] HTTP exception thrown: Instance 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 could not be found. Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8834a399-f505-4920-8fb6-3715ff129be9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Request method failure captured: Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 HTTP/1.1 Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnpaKq5eMD1wOzd3b0sKYUgl2bjacFpSj-y3-0VcKu80EQNHdJhpBnba-f7gM6-ByY9XlAsOphxypaSEGoSP8rdUWPJNC3Qgb060RgWUaFdfTWVPikTJMe6jnvvdIHjl1TPy-V0Mj-4jPkEyPtgT5wAyFasuOciBHUhQoLY-cRXaZzk Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: f84eda4103cf4f2b8c362d83d5394c69 Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1428233327 Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f84eda4103cf4f2b8c362d83d5394c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f84eda4103cf4f2b8c362d83d5394c69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f84eda4103cf4f2b8c362d83d5394c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f84eda4103cf4f2b8c362d83d5394c69", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1428233327 Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: f84eda4103cf4f2b8c362d83d5394c69 Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1428233327 Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestNetworkAdvancedServerOps-1428233327-project Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: f80525ed5fa842e18c9ec15fe2cd4053 Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1428233327-project Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 could not be found. Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04'} Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 could not be found. Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 could not be found. Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:44:22.251485 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:44:22.256796 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:44:22.256796 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:44:22.256796 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:44:22.256796 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:44:22.256796 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:44:22.256796 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:44:22.256796 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 could not be found. Oct 24 11:44:22.256796 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:44:22.256796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8834a399-f505-4920-8fb6-3715ff129be9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Returning 404 to user: Instance 5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:44:22.256796 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8834a399-f505-4920-8fb6-3715ff129be9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04" status: 404 len: 111 microversion: 2.1 time: 0.030599 Oct 24 11:44:22.256796 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3843/7664] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:22 2022] GET /compute/v2.1/servers/5f16b87d-8a8b-4df4-a6c0-5fa269ba0d04 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:44:25.882985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bf90f3b2-c4d3-403a-9520-21a2fa2bc10c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '.version_select at 0x7f04d4f71af0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:25.906201 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bf90f3b2-c4d3-403a-9520-21a2fa2bc10c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1845504167" status: 202 len: 0 microversion: 2.1 time: 0.027144 Oct 24 11:44:25.907148 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3822/7665] 10.222.0.50 () {58 vars in 1284 bytes} [Mon Oct 24 11:44:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1845504167 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:44:25.932600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1dee637a-b869-45e9-85d2-e92b37e221e6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'create', calling method: .version_select at 0x7f04d065e3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1920192919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhkvstEA5gAgFZoJUgHqBv/yw2fNWni7junrDfnsVglNMJ51NLLtwpohjfy7uhoH6vN6ZijzubaWJ9PRIlCyAHJJe9XQuhXxDQaJ+vKodHpUyqlD+fajNW/FOsxeTh3qA=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:44:25.952209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-1dee637a-b869-45e9-85d2-e92b37e221e6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:44:25.958953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-1dee637a-b869-45e9-85d2-e92b37e221e6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for user f80525ed5fa842e18c9ec15fe2cd4053 and project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:44:25.984098 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1dee637a-b869-45e9-85d2-e92b37e221e6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055633 Oct 24 11:44:25.984927 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3844/7666] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:44:25 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:44:31.735966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ad224fee-ff9c-4f3a-b983-69a23a345c5e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-147723137", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "c9991efd-e266-4ad8-9b89-5542495e16eb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1920192919", "security_groups": [{"name": "tempest-secgroup-smoke-370916309"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:44:31.750636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=38 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:44:31.868743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-ad224fee-ff9c-4f3a-b983-69a23a345c5e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] validate_networks() for [('c9991efd-e266-4ad8-9b89-5542495e16eb', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:44:32.282704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ad224fee-ff9c-4f3a-b983-69a23a345c5e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:44:32.283153 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ad224fee-ff9c-4f3a-b983-69a23a345c5e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:44:32.283649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ad224fee-ff9c-4f3a-b983-69a23a345c5e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:44:32.284246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ad224fee-ff9c-4f3a-b983-69a23a345c5e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:44:32.284696 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ad224fee-ff9c-4f3a-b983-69a23a345c5e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:44:32.295260 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad224fee-ff9c-4f3a-b983-69a23a345c5e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:32.295769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad224fee-ff9c-4f3a-b983-69a23a345c5e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:32.296229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad224fee-ff9c-4f3a-b983-69a23a345c5e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:32.297055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad224fee-ff9c-4f3a-b983-69a23a345c5e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:32.297530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad224fee-ff9c-4f3a-b983-69a23a345c5e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:32.297976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ad224fee-ff9c-4f3a-b983-69a23a345c5e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:32.316812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ad224fee-ff9c-4f3a-b983-69a23a345c5e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:44:32.322486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ad224fee-ff9c-4f3a-b983-69a23a345c5e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for user f80525ed5fa842e18c9ec15fe2cd4053 and project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:44:32.335992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad224fee-ff9c-4f3a-b983-69a23a345c5e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:44:32.338361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ad224fee-ff9c-4f3a-b983-69a23a345c5e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:44:32.388459 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ad224fee-ff9c-4f3a-b983-69a23a345c5e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.656123 Oct 24 11:44:32.389337 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3823/7667] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:44:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:44:32.400496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-158a0771-5844-4763-823f-5ff85b3aac39 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:32.401747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-158a0771-5844-4763-823f-5ff85b3aac39 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:32.410018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:44:32.469343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-158a0771-5844-4763-823f-5ff85b3aac39 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:32.478369 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-158a0771-5844-4763-823f-5ff85b3aac39 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1266 microversion: 2.1 time: 0.081505 Oct 24 11:44:32.479125 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3845/7668] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:32 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:44:33.506079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c1a7ab4e-813c-40af-82a5-77be210bee50 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:33.507147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c1a7ab4e-813c-40af-82a5-77be210bee50 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:33.515202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1a7ab4e-813c-40af-82a5-77be210bee50 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:33.516003 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1a7ab4e-813c-40af-82a5-77be210bee50 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:33.516658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1a7ab4e-813c-40af-82a5-77be210bee50 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:33.517505 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1a7ab4e-813c-40af-82a5-77be210bee50 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:33.517993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1a7ab4e-813c-40af-82a5-77be210bee50 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:33.518494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1a7ab4e-813c-40af-82a5-77be210bee50 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:33.610819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c1a7ab4e-813c-40af-82a5-77be210bee50 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:33.619607 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c1a7ab4e-813c-40af-82a5-77be210bee50 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1326 microversion: 2.1 time: 0.119606 Oct 24 11:44:33.620794 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3824/7669] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:33 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1326 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:44:34.644641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ef503808-2b32-4cd1-92e0-d1079f915881 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:34.645393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ef503808-2b32-4cd1-92e0-d1079f915881 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:34.653636 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef503808-2b32-4cd1-92e0-d1079f915881 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:34.654400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef503808-2b32-4cd1-92e0-d1079f915881 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:34.654840 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef503808-2b32-4cd1-92e0-d1079f915881 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:34.655580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef503808-2b32-4cd1-92e0-d1079f915881 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:34.656090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef503808-2b32-4cd1-92e0-d1079f915881 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:34.656586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ef503808-2b32-4cd1-92e0-d1079f915881 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:34.823745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ef503808-2b32-4cd1-92e0-d1079f915881 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:34.832862 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ef503808-2b32-4cd1-92e0-d1079f915881 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1391 microversion: 2.1 time: 0.192219 Oct 24 11:44:34.849412 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3846/7670] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:34 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1391 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:44:35.222569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-fa589b6c-f1bb-4c77-87b8-7e17b9a3dbdc req-aa56d417-34ba-463e-997a-d125a715dfd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b738621-1ed4-429c-963a-89a218d4d7f7", "tag": "72301a4a-ed1f-4384-8e72-09c9dc8027e2"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:44:35.233723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fa589b6c-f1bb-4c77-87b8-7e17b9a3dbdc req-aa56d417-34ba-463e-997a-d125a715dfd8 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:35.234218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fa589b6c-f1bb-4c77-87b8-7e17b9a3dbdc req-aa56d417-34ba-463e-997a-d125a715dfd8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:35.234705 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fa589b6c-f1bb-4c77-87b8-7e17b9a3dbdc req-aa56d417-34ba-463e-997a-d125a715dfd8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:35.247573 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-fa589b6c-f1bb-4c77-87b8-7e17b9a3dbdc req-aa56d417-34ba-463e-997a-d125a715dfd8 service nova] Creating event network-changed:72301a4a-ed1f-4384-8e72-09c9dc8027e2 for instance 8b738621-1ed4-429c-963a-89a218d4d7f7 on n-h2-858383-15 Oct 24 11:44:35.252638 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-fa589b6c-f1bb-4c77-87b8-7e17b9a3dbdc req-aa56d417-34ba-463e-997a-d125a715dfd8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033783 Oct 24 11:44:35.253467 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3825/7671] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:44:35.858026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-46e12727-6273-4803-a718-4ff277378fde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:35.858660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-46e12727-6273-4803-a718-4ff277378fde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:35.865976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46e12727-6273-4803-a718-4ff277378fde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:35.866463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46e12727-6273-4803-a718-4ff277378fde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:35.866902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46e12727-6273-4803-a718-4ff277378fde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:35.867599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46e12727-6273-4803-a718-4ff277378fde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:35.868053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46e12727-6273-4803-a718-4ff277378fde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:35.868509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46e12727-6273-4803-a718-4ff277378fde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:36.005966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-46e12727-6273-4803-a718-4ff277378fde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:36.013784 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-46e12727-6273-4803-a718-4ff277378fde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1391 microversion: 2.1 time: 0.160321 Oct 24 11:44:36.014363 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3847/7672] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:35 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:44:37.037422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-61b5ab5b-2952-41ad-87bc-a8ee2a9e171e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:37.038136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-61b5ab5b-2952-41ad-87bc-a8ee2a9e171e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:37.040927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:44:37.047768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61b5ab5b-2952-41ad-87bc-a8ee2a9e171e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:37.048204 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61b5ab5b-2952-41ad-87bc-a8ee2a9e171e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:37.048657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61b5ab5b-2952-41ad-87bc-a8ee2a9e171e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:37.049395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61b5ab5b-2952-41ad-87bc-a8ee2a9e171e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:37.049868 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61b5ab5b-2952-41ad-87bc-a8ee2a9e171e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:37.050309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-61b5ab5b-2952-41ad-87bc-a8ee2a9e171e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:37.183456 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-61b5ab5b-2952-41ad-87bc-a8ee2a9e171e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:37.191248 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-61b5ab5b-2952-41ad-87bc-a8ee2a9e171e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1391 microversion: 2.1 time: 0.158439 Oct 24 11:44:37.191825 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3826/7673] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:37 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:44:38.214225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3ee007fe-efc0-43ab-b73e-c9420c326e51 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:38.214853 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3ee007fe-efc0-43ab-b73e-c9420c326e51 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:38.222173 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ee007fe-efc0-43ab-b73e-c9420c326e51 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:38.222658 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ee007fe-efc0-43ab-b73e-c9420c326e51 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:38.223100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ee007fe-efc0-43ab-b73e-c9420c326e51 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:38.223793 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ee007fe-efc0-43ab-b73e-c9420c326e51 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:38.224249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ee007fe-efc0-43ab-b73e-c9420c326e51 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:38.224676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3ee007fe-efc0-43ab-b73e-c9420c326e51 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:38.363325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3ee007fe-efc0-43ab-b73e-c9420c326e51 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:38.370988 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3ee007fe-efc0-43ab-b73e-c9420c326e51 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1391 microversion: 2.1 time: 0.160722 Oct 24 11:44:38.371801 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3848/7674] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:38 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:44:39.394716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-410b5f4f-04a4-4098-b223-6f927c2e9b84 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:39.395272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-410b5f4f-04a4-4098-b223-6f927c2e9b84 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:39.402177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-410b5f4f-04a4-4098-b223-6f927c2e9b84 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:39.402714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-410b5f4f-04a4-4098-b223-6f927c2e9b84 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:39.403170 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-410b5f4f-04a4-4098-b223-6f927c2e9b84 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:39.403883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-410b5f4f-04a4-4098-b223-6f927c2e9b84 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:39.404355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-410b5f4f-04a4-4098-b223-6f927c2e9b84 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:39.404800 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-410b5f4f-04a4-4098-b223-6f927c2e9b84 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:39.536256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-410b5f4f-04a4-4098-b223-6f927c2e9b84 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:39.545926 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-410b5f4f-04a4-4098-b223-6f927c2e9b84 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1391 microversion: 2.1 time: 0.155188 Oct 24 11:44:39.546530 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3827/7675] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:39 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:44:40.568865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e3d3989e-4f63-43ac-a730-3e0f9a9410ea tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:40.569484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e3d3989e-4f63-43ac-a730-3e0f9a9410ea tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:40.576930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3d3989e-4f63-43ac-a730-3e0f9a9410ea tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:40.577415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3d3989e-4f63-43ac-a730-3e0f9a9410ea tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:40.577960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3d3989e-4f63-43ac-a730-3e0f9a9410ea tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:40.578650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3d3989e-4f63-43ac-a730-3e0f9a9410ea tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:40.579105 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3d3989e-4f63-43ac-a730-3e0f9a9410ea tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:40.579529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3d3989e-4f63-43ac-a730-3e0f9a9410ea tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:40.771696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e3d3989e-4f63-43ac-a730-3e0f9a9410ea tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:40.779353 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e3d3989e-4f63-43ac-a730-3e0f9a9410ea tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1391 microversion: 2.1 time: 0.214428 Oct 24 11:44:40.779938 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3849/7676] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:40 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1391 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:44:41.225118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-ef727a17-6180-47e8-a347-92ee72e6466f req-5c3f44e5-6146-4118-9a02-638f6f547c56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b738621-1ed4-429c-963a-89a218d4d7f7", "name": "network-vif-plugged", "status": "completed", "tag": "72301a4a-ed1f-4384-8e72-09c9dc8027e2"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:44:41.242095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ef727a17-6180-47e8-a347-92ee72e6466f req-5c3f44e5-6146-4118-9a02-638f6f547c56 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:41.242586 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ef727a17-6180-47e8-a347-92ee72e6466f req-5c3f44e5-6146-4118-9a02-638f6f547c56 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:41.243035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-ef727a17-6180-47e8-a347-92ee72e6466f req-5c3f44e5-6146-4118-9a02-638f6f547c56 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:41.254341 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-ef727a17-6180-47e8-a347-92ee72e6466f req-5c3f44e5-6146-4118-9a02-638f6f547c56 service nova] Creating event network-vif-plugged:72301a4a-ed1f-4384-8e72-09c9dc8027e2 for instance 8b738621-1ed4-429c-963a-89a218d4d7f7 on n-h2-858383-15 Oct 24 11:44:41.259361 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-ef727a17-6180-47e8-a347-92ee72e6466f req-5c3f44e5-6146-4118-9a02-638f6f547c56 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037998 Oct 24 11:44:41.260000 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3828/7677] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:44:41.802506 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-99b7254b-329a-48d1-8af7-34ef86e8314e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:41.803121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-99b7254b-329a-48d1-8af7-34ef86e8314e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:41.805409 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:44:41.805549 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:44:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 (ip 10.222.0.50) !!! Oct 24 11:44:41.813896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99b7254b-329a-48d1-8af7-34ef86e8314e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:41.814382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99b7254b-329a-48d1-8af7-34ef86e8314e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:41.814819 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99b7254b-329a-48d1-8af7-34ef86e8314e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:41.815510 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99b7254b-329a-48d1-8af7-34ef86e8314e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:41.815963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99b7254b-329a-48d1-8af7-34ef86e8314e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:41.816390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99b7254b-329a-48d1-8af7-34ef86e8314e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:41.950844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-99b7254b-329a-48d1-8af7-34ef86e8314e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:41.958707 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-99b7254b-329a-48d1-8af7-34ef86e8314e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1391 microversion: 2.1 time: 0.160075 Oct 24 11:44:41.959297 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3850/7678] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:41 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:44:42.981249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:44:42.982074 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:44:42.986222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c1f0e68d-f051-44f6-9fab-b1f9049d7de5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:42.986994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c1f0e68d-f051-44f6-9fab-b1f9049d7de5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:42.994177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1f0e68d-f051-44f6-9fab-b1f9049d7de5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:42.994677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1f0e68d-f051-44f6-9fab-b1f9049d7de5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:42.995134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1f0e68d-f051-44f6-9fab-b1f9049d7de5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:42.995850 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1f0e68d-f051-44f6-9fab-b1f9049d7de5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:42.997015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1f0e68d-f051-44f6-9fab-b1f9049d7de5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:42.997472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c1f0e68d-f051-44f6-9fab-b1f9049d7de5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:43.184757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c1f0e68d-f051-44f6-9fab-b1f9049d7de5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:43.192943 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c1f0e68d-f051-44f6-9fab-b1f9049d7de5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1564 microversion: 2.1 time: 0.213520 Oct 24 11:44:43.193530 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3829/7679] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:42 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1564 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:44:43.216227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4736c4c0-6742-4d78-8548-8c047ead87ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:43.216878 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4736c4c0-6742-4d78-8548-8c047ead87ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:43.218741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:44:43.220361 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:44:43.227107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4736c4c0-6742-4d78-8548-8c047ead87ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:43.227681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4736c4c0-6742-4d78-8548-8c047ead87ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:43.228130 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4736c4c0-6742-4d78-8548-8c047ead87ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:43.228845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4736c4c0-6742-4d78-8548-8c047ead87ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:43.229320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4736c4c0-6742-4d78-8548-8c047ead87ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:43.229756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4736c4c0-6742-4d78-8548-8c047ead87ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:43.366478 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4736c4c0-6742-4d78-8548-8c047ead87ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:43.375034 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4736c4c0-6742-4d78-8548-8c047ead87ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1564 microversion: 2.1 time: 0.162776 Oct 24 11:44:43.375624 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3851/7680] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:43 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:44:45.239596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b2bbf0ba-5964-4fc3-98c4-ab49ea69ccf0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:44:45.240501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b2bbf0ba-5964-4fc3-98c4-ab49ea69ccf0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:44:45.242009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-46297102-afb4-4439-828a-014526d53547 req-9b509a72-2de1-46f5-b932-0d9ae4b7cae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b738621-1ed4-429c-963a-89a218d4d7f7", "tag": "72301a4a-ed1f-4384-8e72-09c9dc8027e2"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:44:45.248757 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2bbf0ba-5964-4fc3-98c4-ab49ea69ccf0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:45.249295 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2bbf0ba-5964-4fc3-98c4-ab49ea69ccf0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:45.249768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2bbf0ba-5964-4fc3-98c4-ab49ea69ccf0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:45.250806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2bbf0ba-5964-4fc3-98c4-ab49ea69ccf0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:45.251286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2bbf0ba-5964-4fc3-98c4-ab49ea69ccf0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:45.251731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b2bbf0ba-5964-4fc3-98c4-ab49ea69ccf0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:45.253397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-46297102-afb4-4439-828a-014526d53547 req-9b509a72-2de1-46f5-b932-0d9ae4b7cae3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:44:45.253951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-46297102-afb4-4439-828a-014526d53547 req-9b509a72-2de1-46f5-b932-0d9ae4b7cae3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:44:45.254616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-46297102-afb4-4439-828a-014526d53547 req-9b509a72-2de1-46f5-b932-0d9ae4b7cae3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:44:45.267544 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-46297102-afb4-4439-828a-014526d53547 req-9b509a72-2de1-46f5-b932-0d9ae4b7cae3 service nova] Creating event network-changed:72301a4a-ed1f-4384-8e72-09c9dc8027e2 for instance 8b738621-1ed4-429c-963a-89a218d4d7f7 on n-h2-858383-15 Oct 24 11:44:45.272692 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-46297102-afb4-4439-828a-014526d53547 req-9b509a72-2de1-46f5-b932-0d9ae4b7cae3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034783 Oct 24 11:44:45.273341 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3852/7681] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:44:45.399551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b2bbf0ba-5964-4fc3-98c4-ab49ea69ccf0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:44:45.408400 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b2bbf0ba-5964-4fc3-98c4-ab49ea69ccf0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1564 microversion: 2.1 time: 0.172968 Oct 24 11:44:45.409292 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3830/7682] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:44:45 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:45:06.663132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:45:06.663873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=38 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:45:06.668154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e76bfde7-7742-4bca-b0d1-b35e70d2b6c1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:45:06.671172 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e76bfde7-7742-4bca-b0d1-b35e70d2b6c1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:45:06.678155 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e76bfde7-7742-4bca-b0d1-b35e70d2b6c1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:06.678640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e76bfde7-7742-4bca-b0d1-b35e70d2b6c1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:06.679078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e76bfde7-7742-4bca-b0d1-b35e70d2b6c1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:06.679773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e76bfde7-7742-4bca-b0d1-b35e70d2b6c1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:06.680234 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e76bfde7-7742-4bca-b0d1-b35e70d2b6c1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:06.680663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e76bfde7-7742-4bca-b0d1-b35e70d2b6c1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:06.749399 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e76bfde7-7742-4bca-b0d1-b35e70d2b6c1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7/action" status: 200 len: 24573 microversion: 2.1 time: 0.088161 Oct 24 11:45:06.750174 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3853/7683] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:45:06 2022] POST /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7/action => generated 24573 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 11:45:17.421795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-548c106d-4636-4085-b70b-97e50fb790c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:45:17.424086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-548c106d-4636-4085-b70b-97e50fb790c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:45:17.426321 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=9 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:45:17.426976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=36 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:45:17.433524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-548c106d-4636-4085-b70b-97e50fb790c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:17.434022 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-548c106d-4636-4085-b70b-97e50fb790c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:17.434474 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-548c106d-4636-4085-b70b-97e50fb790c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:17.435187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-548c106d-4636-4085-b70b-97e50fb790c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:17.435778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-548c106d-4636-4085-b70b-97e50fb790c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:17.436213 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-548c106d-4636-4085-b70b-97e50fb790c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:17.509540 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-548c106d-4636-4085-b70b-97e50fb790c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7/action" status: 202 len: 0 microversion: 2.1 time: 0.092471 Oct 24 11:45:17.510400 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3831/7684] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:45:17 2022] POST /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:45:17.519086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a9db86e8-2ce4-4c4a-b8a9-4447c2132fcd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:45:17.519790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a9db86e8-2ce4-4c4a-b8a9-4447c2132fcd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:45:17.522817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:45:17.523463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:45:17.530609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9db86e8-2ce4-4c4a-b8a9-4447c2132fcd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:17.531098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9db86e8-2ce4-4c4a-b8a9-4447c2132fcd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:17.531621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9db86e8-2ce4-4c4a-b8a9-4447c2132fcd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:17.532324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9db86e8-2ce4-4c4a-b8a9-4447c2132fcd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:17.532782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9db86e8-2ce4-4c4a-b8a9-4447c2132fcd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:17.533231 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a9db86e8-2ce4-4c4a-b8a9-4447c2132fcd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:17.675812 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a9db86e8-2ce4-4c4a-b8a9-4447c2132fcd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:45:17.683674 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a9db86e8-2ce4-4c4a-b8a9-4447c2132fcd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1674 microversion: 2.1 time: 0.168898 Oct 24 11:45:17.684256 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3854/7685] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:45:17 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:45:18.709668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-18ffb722-f745-4a3a-a1dc-50b7c76364c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:45:18.710359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-18ffb722-f745-4a3a-a1dc-50b7c76364c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:45:18.716641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18ffb722-f745-4a3a-a1dc-50b7c76364c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:18.717181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18ffb722-f745-4a3a-a1dc-50b7c76364c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:18.717642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18ffb722-f745-4a3a-a1dc-50b7c76364c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:18.718361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18ffb722-f745-4a3a-a1dc-50b7c76364c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:18.718838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18ffb722-f745-4a3a-a1dc-50b7c76364c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:18.719290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-18ffb722-f745-4a3a-a1dc-50b7c76364c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:18.853963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-18ffb722-f745-4a3a-a1dc-50b7c76364c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:45:18.862450 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-18ffb722-f745-4a3a-a1dc-50b7c76364c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1679 microversion: 2.1 time: 0.158243 Oct 24 11:45:18.863036 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3832/7686] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:45:18 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:45:19.886953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-118c9d82-aef6-4230-ba96-4bfe40a8aacb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:45:19.887562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-118c9d82-aef6-4230-ba96-4bfe40a8aacb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:45:19.895010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-118c9d82-aef6-4230-ba96-4bfe40a8aacb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:19.895490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-118c9d82-aef6-4230-ba96-4bfe40a8aacb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:19.895927 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-118c9d82-aef6-4230-ba96-4bfe40a8aacb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:19.896610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-118c9d82-aef6-4230-ba96-4bfe40a8aacb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:19.897088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-118c9d82-aef6-4230-ba96-4bfe40a8aacb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:19.897516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-118c9d82-aef6-4230-ba96-4bfe40a8aacb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:20.026789 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-118c9d82-aef6-4230-ba96-4bfe40a8aacb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:45:20.035068 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-118c9d82-aef6-4230-ba96-4bfe40a8aacb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1679 microversion: 2.1 time: 0.151798 Oct 24 11:45:20.035643 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3855/7687] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:45:19 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:45:21.059019 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a501587c-52a9-4d59-8d7b-cf30eed828f5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:45:21.059562 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a501587c-52a9-4d59-8d7b-cf30eed828f5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:45:21.066962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a501587c-52a9-4d59-8d7b-cf30eed828f5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:21.067464 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a501587c-52a9-4d59-8d7b-cf30eed828f5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:21.067921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a501587c-52a9-4d59-8d7b-cf30eed828f5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:21.068636 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a501587c-52a9-4d59-8d7b-cf30eed828f5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:21.069148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a501587c-52a9-4d59-8d7b-cf30eed828f5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:21.069596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a501587c-52a9-4d59-8d7b-cf30eed828f5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:21.207275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a501587c-52a9-4d59-8d7b-cf30eed828f5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:45:21.215109 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a501587c-52a9-4d59-8d7b-cf30eed828f5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1679 microversion: 2.1 time: 0.160133 Oct 24 11:45:21.215685 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3833/7688] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:45:21 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:45:22.239089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0f37b39b-e075-4b4c-97bb-227a08bf2f72 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:45:22.239707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0f37b39b-e075-4b4c-97bb-227a08bf2f72 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:45:22.246833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f37b39b-e075-4b4c-97bb-227a08bf2f72 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:22.247355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f37b39b-e075-4b4c-97bb-227a08bf2f72 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:22.248464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f37b39b-e075-4b4c-97bb-227a08bf2f72 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:22.249217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f37b39b-e075-4b4c-97bb-227a08bf2f72 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:22.249679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f37b39b-e075-4b4c-97bb-227a08bf2f72 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:22.250111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0f37b39b-e075-4b4c-97bb-227a08bf2f72 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:22.380499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0f37b39b-e075-4b4c-97bb-227a08bf2f72 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:45:22.388324 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0f37b39b-e075-4b4c-97bb-227a08bf2f72 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1679 microversion: 2.1 time: 0.153177 Oct 24 11:45:22.389412 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3856/7689] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:45:22 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:45:23.412845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e47480a6-fdd4-430d-8431-23023e322c30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:45:23.413485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e47480a6-fdd4-430d-8431-23023e322c30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:45:23.420413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e47480a6-fdd4-430d-8431-23023e322c30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:23.420947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e47480a6-fdd4-430d-8431-23023e322c30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:23.421406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e47480a6-fdd4-430d-8431-23023e322c30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:23.422109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e47480a6-fdd4-430d-8431-23023e322c30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:23.422578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e47480a6-fdd4-430d-8431-23023e322c30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:23.423018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e47480a6-fdd4-430d-8431-23023e322c30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:23.559222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e47480a6-fdd4-430d-8431-23023e322c30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:45:23.567420 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e47480a6-fdd4-430d-8431-23023e322c30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1679 microversion: 2.1 time: 0.158777 Oct 24 11:45:23.567988 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3834/7690] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:45:23 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:45:24.590912 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-23ab1c05-d4a3-4e4d-bbb0-868e99fff54d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:45:24.591529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-23ab1c05-d4a3-4e4d-bbb0-868e99fff54d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:45:24.599437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ab1c05-d4a3-4e4d-bbb0-868e99fff54d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:24.599924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ab1c05-d4a3-4e4d-bbb0-868e99fff54d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:24.600363 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ab1c05-d4a3-4e4d-bbb0-868e99fff54d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:24.601085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ab1c05-d4a3-4e4d-bbb0-868e99fff54d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:24.601540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ab1c05-d4a3-4e4d-bbb0-868e99fff54d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:24.601970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-23ab1c05-d4a3-4e4d-bbb0-868e99fff54d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:24.736311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-23ab1c05-d4a3-4e4d-bbb0-868e99fff54d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:45:24.744322 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-23ab1c05-d4a3-4e4d-bbb0-868e99fff54d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1679 microversion: 2.1 time: 0.157426 Oct 24 11:45:24.744920 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3857/7691] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:45:24 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:45:25.768419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5bcfbd60-76ce-4243-9ddb-eee55686ca7e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:45:25.769079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5bcfbd60-76ce-4243-9ddb-eee55686ca7e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:45:25.776106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bcfbd60-76ce-4243-9ddb-eee55686ca7e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:25.776609 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bcfbd60-76ce-4243-9ddb-eee55686ca7e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:25.777092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bcfbd60-76ce-4243-9ddb-eee55686ca7e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:25.777805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bcfbd60-76ce-4243-9ddb-eee55686ca7e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:25.778276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bcfbd60-76ce-4243-9ddb-eee55686ca7e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:25.778722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5bcfbd60-76ce-4243-9ddb-eee55686ca7e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:25.910224 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5bcfbd60-76ce-4243-9ddb-eee55686ca7e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:45:25.917971 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5bcfbd60-76ce-4243-9ddb-eee55686ca7e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1679 microversion: 2.1 time: 0.153689 Oct 24 11:45:25.918541 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3835/7692] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:45:25 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:45:26.942203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-94037bef-825b-4cef-9735-b12a197e0065 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:45:26.942822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-94037bef-825b-4cef-9735-b12a197e0065 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:45:26.949451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94037bef-825b-4cef-9735-b12a197e0065 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:26.949933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94037bef-825b-4cef-9735-b12a197e0065 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:26.950371 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94037bef-825b-4cef-9735-b12a197e0065 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:26.951058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94037bef-825b-4cef-9735-b12a197e0065 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:26.951516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94037bef-825b-4cef-9735-b12a197e0065 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:26.951940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-94037bef-825b-4cef-9735-b12a197e0065 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:27.091003 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-94037bef-825b-4cef-9735-b12a197e0065 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:45:27.101413 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-94037bef-825b-4cef-9735-b12a197e0065 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1679 microversion: 2.1 time: 0.163274 Oct 24 11:45:27.102210 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3858/7693] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:45:26 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:45:28.127901 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-180d73a5-cd4b-458a-8bb7-9b5e6074881b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:45:28.128540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-180d73a5-cd4b-458a-8bb7-9b5e6074881b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:45:28.136065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-180d73a5-cd4b-458a-8bb7-9b5e6074881b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:28.136574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-180d73a5-cd4b-458a-8bb7-9b5e6074881b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:28.137143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-180d73a5-cd4b-458a-8bb7-9b5e6074881b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:28.137903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-180d73a5-cd4b-458a-8bb7-9b5e6074881b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:28.138408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-180d73a5-cd4b-458a-8bb7-9b5e6074881b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:28.138855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-180d73a5-cd4b-458a-8bb7-9b5e6074881b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:28.270676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-180d73a5-cd4b-458a-8bb7-9b5e6074881b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:45:28.278546 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-180d73a5-cd4b-458a-8bb7-9b5e6074881b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1679 microversion: 2.1 time: 0.155827 Oct 24 11:45:28.279119 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3836/7694] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:45:28 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:45:29.302502 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3c82690d-0db2-49d0-ad12-d8cf526e6c40 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:45:29.303120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3c82690d-0db2-49d0-ad12-d8cf526e6c40 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:45:29.310068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3c82690d-0db2-49d0-ad12-d8cf526e6c40 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:29.310556 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3c82690d-0db2-49d0-ad12-d8cf526e6c40 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:29.310998 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3c82690d-0db2-49d0-ad12-d8cf526e6c40 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:29.312491 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3c82690d-0db2-49d0-ad12-d8cf526e6c40 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:29.312979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3c82690d-0db2-49d0-ad12-d8cf526e6c40 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:29.313415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3c82690d-0db2-49d0-ad12-d8cf526e6c40 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:29.449372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3c82690d-0db2-49d0-ad12-d8cf526e6c40 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:45:29.457772 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3c82690d-0db2-49d0-ad12-d8cf526e6c40 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1682 microversion: 2.1 time: 0.159235 Oct 24 11:45:29.458348 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3859/7695] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:45:29 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:45:53.640095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a7737f39-3ca4-4086-844b-88a4a9e51d23 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:45:53.642429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a7737f39-3ca4-4086-844b-88a4a9e51d23 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:45:53.644573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:45:53.645275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:45:53.651690 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7737f39-3ca4-4086-844b-88a4a9e51d23 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:53.652186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7737f39-3ca4-4086-844b-88a4a9e51d23 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:53.652637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7737f39-3ca4-4086-844b-88a4a9e51d23 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:53.653365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7737f39-3ca4-4086-844b-88a4a9e51d23 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:45:53.653876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7737f39-3ca4-4086-844b-88a4a9e51d23 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:45:53.654862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7737f39-3ca4-4086-844b-88a4a9e51d23 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:45:53.728082 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a7737f39-3ca4-4086-844b-88a4a9e51d23 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7/action" status: 200 len: 69092 microversion: 2.1 time: 0.092532 Oct 24 11:45:53.728750 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3837/7696] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:45:53 2022] POST /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7/action => generated 69092 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 11:46:00.890353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2c9eb76a-929c-4418-9d73-91b556ca8602 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:00.891287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2c9eb76a-929c-4418-9d73-91b556ca8602 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:00.895079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=12 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:46:00.896360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=36 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:46:00.897879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-90de4304-a42e-410b-9d7b-daf6d4e453e2 req-9a87e0f9-59c7-44b8-af6f-0c7ec7fa2474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b738621-1ed4-429c-963a-89a218d4d7f7", "tag": "72301a4a-ed1f-4384-8e72-09c9dc8027e2"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:46:00.901592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c9eb76a-929c-4418-9d73-91b556ca8602 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:00.902564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c9eb76a-929c-4418-9d73-91b556ca8602 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:00.903216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c9eb76a-929c-4418-9d73-91b556ca8602 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:00.904617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c9eb76a-929c-4418-9d73-91b556ca8602 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:00.905263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c9eb76a-929c-4418-9d73-91b556ca8602 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:00.905947 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c9eb76a-929c-4418-9d73-91b556ca8602 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:00.913318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-90de4304-a42e-410b-9d7b-daf6d4e453e2 req-9a87e0f9-59c7-44b8-af6f-0c7ec7fa2474 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:00.913814 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-90de4304-a42e-410b-9d7b-daf6d4e453e2 req-9a87e0f9-59c7-44b8-af6f-0c7ec7fa2474 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:00.914307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-90de4304-a42e-410b-9d7b-daf6d4e453e2 req-9a87e0f9-59c7-44b8-af6f-0c7ec7fa2474 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:00.929821 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-90de4304-a42e-410b-9d7b-daf6d4e453e2 req-9a87e0f9-59c7-44b8-af6f-0c7ec7fa2474 service nova] Creating event network-changed:72301a4a-ed1f-4384-8e72-09c9dc8027e2 for instance 8b738621-1ed4-429c-963a-89a218d4d7f7 on n-h2-858383-15 Oct 24 11:46:00.936007 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-90de4304-a42e-410b-9d7b-daf6d4e453e2 req-9a87e0f9-59c7-44b8-af6f-0c7ec7fa2474 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042939 Oct 24 11:46:00.936618 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3838/7697] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:46:00.939740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2c9eb76a-929c-4418-9d73-91b556ca8602 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:46:01.039203 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2c9eb76a-929c-4418-9d73-91b556ca8602 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 204 len: 0 microversion: 2.1 time: 0.152901 Oct 24 11:46:01.039773 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3860/7698] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:46:00 2022] DELETE /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:46:01.055150 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2feeeb6e-9c1c-4bf1-9b37-a971855e3dab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:01.055928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2feeeb6e-9c1c-4bf1-9b37-a971855e3dab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:01.064190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2feeeb6e-9c1c-4bf1-9b37-a971855e3dab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:01.064708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2feeeb6e-9c1c-4bf1-9b37-a971855e3dab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:01.065294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2feeeb6e-9c1c-4bf1-9b37-a971855e3dab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:01.066005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2feeeb6e-9c1c-4bf1-9b37-a971855e3dab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:01.066499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2feeeb6e-9c1c-4bf1-9b37-a971855e3dab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:01.066945 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2feeeb6e-9c1c-4bf1-9b37-a971855e3dab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:01.215339 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2feeeb6e-9c1c-4bf1-9b37-a971855e3dab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:46:01.226022 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2feeeb6e-9c1c-4bf1-9b37-a971855e3dab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1688 microversion: 2.1 time: 0.177164 Oct 24 11:46:01.227094 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3839/7699] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:46:01 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:46:02.252158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4923131b-4e84-4e51-bec4-59e54658feb2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:02.252813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4923131b-4e84-4e51-bec4-59e54658feb2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:02.259640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4923131b-4e84-4e51-bec4-59e54658feb2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:02.260122 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4923131b-4e84-4e51-bec4-59e54658feb2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:02.260557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4923131b-4e84-4e51-bec4-59e54658feb2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:02.261277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4923131b-4e84-4e51-bec4-59e54658feb2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:02.261731 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4923131b-4e84-4e51-bec4-59e54658feb2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:02.262153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4923131b-4e84-4e51-bec4-59e54658feb2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:02.398209 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4923131b-4e84-4e51-bec4-59e54658feb2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:46:02.407413 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4923131b-4e84-4e51-bec4-59e54658feb2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1688 microversion: 2.1 time: 0.159741 Oct 24 11:46:02.408079 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3861/7700] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:46:02 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:46:03.334406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-45394ea3-0751-42ad-882d-60faee0c5470 req-b0911b54-8356-4b4d-8e8c-e82e45fa2a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b738621-1ed4-429c-963a-89a218d4d7f7", "name": "network-vif-deleted", "tag": "72301a4a-ed1f-4384-8e72-09c9dc8027e2"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:46:03.346117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-45394ea3-0751-42ad-882d-60faee0c5470 req-b0911b54-8356-4b4d-8e8c-e82e45fa2a05 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:03.346619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-45394ea3-0751-42ad-882d-60faee0c5470 req-b0911b54-8356-4b4d-8e8c-e82e45fa2a05 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:03.347063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-45394ea3-0751-42ad-882d-60faee0c5470 req-b0911b54-8356-4b4d-8e8c-e82e45fa2a05 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:03.358640 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-45394ea3-0751-42ad-882d-60faee0c5470 req-b0911b54-8356-4b4d-8e8c-e82e45fa2a05 service nova] Creating event network-vif-deleted:72301a4a-ed1f-4384-8e72-09c9dc8027e2 for instance 8b738621-1ed4-429c-963a-89a218d4d7f7 on n-h2-858383-15 Oct 24 11:46:03.363585 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-45394ea3-0751-42ad-882d-60faee0c5470 req-b0911b54-8356-4b4d-8e8c-e82e45fa2a05 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032920 Oct 24 11:46:03.364202 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3840/7701] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:46:03.431856 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4a4cecd5-8d60-4f8d-b365-6e038b744f31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:03.432524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4a4cecd5-8d60-4f8d-b365-6e038b744f31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:03.440342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a4cecd5-8d60-4f8d-b365-6e038b744f31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:03.440851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a4cecd5-8d60-4f8d-b365-6e038b744f31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:03.441319 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a4cecd5-8d60-4f8d-b365-6e038b744f31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:03.442078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a4cecd5-8d60-4f8d-b365-6e038b744f31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:03.442540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a4cecd5-8d60-4f8d-b365-6e038b744f31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:03.442973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a4cecd5-8d60-4f8d-b365-6e038b744f31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:03.474333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a4cecd5-8d60-4f8d-b365-6e038b744f31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:03.474888 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a4cecd5-8d60-4f8d-b365-6e038b744f31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:03.475338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4a4cecd5-8d60-4f8d-b365-6e038b744f31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:03.475795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-4a4cecd5-8d60-4f8d-b365-6e038b744f31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lazy-loading 'fault' on Instance uuid 8b738621-1ed4-429c-963a-89a218d4d7f7 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:46:03.518830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4a4cecd5-8d60-4f8d-b365-6e038b744f31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:46:03.526608 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4a4cecd5-8d60-4f8d-b365-6e038b744f31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 200 len: 1356 microversion: 2.1 time: 0.098667 Oct 24 11:46:03.527220 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3862/7702] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:46:03 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 1356 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:46:04.551847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5a8aecc9-cc06-4b1a-841c-e6f50a8d9e90 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:04.552587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5a8aecc9-cc06-4b1a-841c-e6f50a8d9e90 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 8b738621-1ed4-429c-963a-89a218d4d7f7] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:04.560236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a8aecc9-cc06-4b1a-841c-e6f50a8d9e90 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:04.560902 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a8aecc9-cc06-4b1a-841c-e6f50a8d9e90 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:04.561364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a8aecc9-cc06-4b1a-841c-e6f50a8d9e90 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:04.562072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a8aecc9-cc06-4b1a-841c-e6f50a8d9e90 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:04.562540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a8aecc9-cc06-4b1a-841c-e6f50a8d9e90 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:04.562981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5a8aecc9-cc06-4b1a-841c-e6f50a8d9e90 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:04.577423 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-5a8aecc9-cc06-4b1a-841c-e6f50a8d9e90 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] HTTP exception thrown: Instance 8b738621-1ed4-429c-963a-89a218d4d7f7 could not be found. Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5a8aecc9-cc06-4b1a-841c-e6f50a8d9e90 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Request method failure captured: Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 HTTP/1.1 Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnpaKq5eMD1wOzd3b0sKYUgl2bjacFpSj-y3-0VcKu80EQNHdJhpBnba-f7gM6-ByY9XlAsOphxypaSEGoSP8rdUWPJNC3Qgb060RgWUaFdfTWVPikTJMe6jnvvdIHjl1TPy-V0Mj-4jPkEyPtgT5wAyFasuOciBHUhQoLY-cRXaZzk Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: f84eda4103cf4f2b8c362d83d5394c69 Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1428233327 Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f84eda4103cf4f2b8c362d83d5394c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f84eda4103cf4f2b8c362d83d5394c69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f84eda4103cf4f2b8c362d83d5394c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f84eda4103cf4f2b8c362d83d5394c69", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1428233327 Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: f84eda4103cf4f2b8c362d83d5394c69 Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1428233327 Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestNetworkAdvancedServerOps-1428233327-project Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: f80525ed5fa842e18c9ec15fe2cd4053 Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1428233327-project Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 8b738621-1ed4-429c-963a-89a218d4d7f7 could not be found. Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '8b738621-1ed4-429c-963a-89a218d4d7f7'} Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b738621-1ed4-429c-963a-89a218d4d7f7 could not be found. Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b738621-1ed4-429c-963a-89a218d4d7f7 could not be found. Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:46:04.579093 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:46:04.583977 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:46:04.583977 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:46:04.583977 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:46:04.583977 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:46:04.583977 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:46:04.583977 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:46:04.583977 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b738621-1ed4-429c-963a-89a218d4d7f7 could not be found. Oct 24 11:46:04.583977 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:46:04.583977 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5a8aecc9-cc06-4b1a-841c-e6f50a8d9e90 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Returning 404 to user: Instance 8b738621-1ed4-429c-963a-89a218d4d7f7 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:46:04.583977 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5a8aecc9-cc06-4b1a-841c-e6f50a8d9e90 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7" status: 404 len: 111 microversion: 2.1 time: 0.032965 Oct 24 11:46:04.583977 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3841/7703] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:46:04 2022] GET /compute/v2.1/servers/8b738621-1ed4-429c-963a-89a218d4d7f7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:46:08.306534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5e292380-a5e4-423b-8388-5a44807dba12 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '.version_select at 0x7f04d0efd700>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:08.329467 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5e292380-a5e4-423b-8388-5a44807dba12 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1920192919" status: 202 len: 0 microversion: 2.1 time: 0.026780 Oct 24 11:46:08.330062 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3863/7704] 10.222.0.50 () {58 vars in 1284 bytes} [Mon Oct 24 11:46:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1920192919 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:46:08.355055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-10e0d2ff-48d2-492f-bcb6-1d27cd4f0a41 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'create', calling method: .version_select at 0x7f04d0364ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1361861744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDY3a0p9D5YOtG96tyJUcJjJZ+Fig0pFeRsItfyATU5pc/pZyjAzU0FIzf4B8oiLz7oxrTomOFfY+9fzc6zef8O527Z6qVr51svIfsWT98VN2U9F+Qhy21405Drq/KU9GQ=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:46:08.373350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-10e0d2ff-48d2-492f-bcb6-1d27cd4f0a41 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:46:08.378551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-10e0d2ff-48d2-492f-bcb6-1d27cd4f0a41 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for user f80525ed5fa842e18c9ec15fe2cd4053 and project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:46:08.401531 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-10e0d2ff-48d2-492f-bcb6-1d27cd4f0a41 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050427 Oct 24 11:46:08.402132 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3842/7705] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:46:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:46:13.608822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:46:13.613859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ba08f219-0f01-403e-b7ad-ca7e84075e56 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-176503459", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "a8c51625-af0d-4cd0-8994-e8f73fa3436b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1361861744", "security_groups": [{"name": "tempest-secgroup-smoke-1245174943"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:46:13.730716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-ba08f219-0f01-403e-b7ad-ca7e84075e56 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] validate_networks() for [('a8c51625-af0d-4cd0-8994-e8f73fa3436b', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:46:14.192512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ba08f219-0f01-403e-b7ad-ca7e84075e56 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:46:14.192962 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ba08f219-0f01-403e-b7ad-ca7e84075e56 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:46:14.193440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ba08f219-0f01-403e-b7ad-ca7e84075e56 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:46:14.193850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ba08f219-0f01-403e-b7ad-ca7e84075e56 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:46:14.194898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-ba08f219-0f01-403e-b7ad-ca7e84075e56 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:46:14.204870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba08f219-0f01-403e-b7ad-ca7e84075e56 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:14.205711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba08f219-0f01-403e-b7ad-ca7e84075e56 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:14.206078 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba08f219-0f01-403e-b7ad-ca7e84075e56 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:14.207255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba08f219-0f01-403e-b7ad-ca7e84075e56 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:14.208214 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba08f219-0f01-403e-b7ad-ca7e84075e56 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:14.208976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ba08f219-0f01-403e-b7ad-ca7e84075e56 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:14.232817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-ba08f219-0f01-403e-b7ad-ca7e84075e56 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:46:14.238931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-ba08f219-0f01-403e-b7ad-ca7e84075e56 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for user f80525ed5fa842e18c9ec15fe2cd4053 and project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:46:14.258530 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ba08f219-0f01-403e-b7ad-ca7e84075e56 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:46:14.260916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ba08f219-0f01-403e-b7ad-ca7e84075e56 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:46:14.316687 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ba08f219-0f01-403e-b7ad-ca7e84075e56 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.710414 Oct 24 11:46:14.317791 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3864/7706] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:46:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:46:14.331972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a19cb086-3a8c-4149-8a98-0f7cff73a24e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:14.333242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a19cb086-3a8c-4149-8a98-0f7cff73a24e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:14.448765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a19cb086-3a8c-4149-8a98-0f7cff73a24e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:46:14.457770 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a19cb086-3a8c-4149-8a98-0f7cff73a24e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1266 microversion: 2.1 time: 0.132676 Oct 24 11:46:14.458363 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3843/7707] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:46:14 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:46:15.483461 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-728f56ec-b305-421e-8606-3763db0e1b0d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:15.484254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-728f56ec-b305-421e-8606-3763db0e1b0d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:15.491106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-728f56ec-b305-421e-8606-3763db0e1b0d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:15.491595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-728f56ec-b305-421e-8606-3763db0e1b0d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:15.492044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-728f56ec-b305-421e-8606-3763db0e1b0d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:15.492785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-728f56ec-b305-421e-8606-3763db0e1b0d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:15.493277 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-728f56ec-b305-421e-8606-3763db0e1b0d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:15.493715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-728f56ec-b305-421e-8606-3763db0e1b0d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:15.563869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-728f56ec-b305-421e-8606-3763db0e1b0d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:46:15.573094 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-728f56ec-b305-421e-8606-3763db0e1b0d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1318 microversion: 2.1 time: 0.095267 Oct 24 11:46:15.573681 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3865/7708] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:46:15 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1318 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:46:16.598319 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a9d26b5a-e626-4eb5-8406-05606f46d418 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:16.598960 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a9d26b5a-e626-4eb5-8406-05606f46d418 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:16.601320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=16 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:46:16.612299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9d26b5a-e626-4eb5-8406-05606f46d418 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:16.612813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9d26b5a-e626-4eb5-8406-05606f46d418 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:16.613306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9d26b5a-e626-4eb5-8406-05606f46d418 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:16.614043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9d26b5a-e626-4eb5-8406-05606f46d418 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:16.614519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9d26b5a-e626-4eb5-8406-05606f46d418 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:16.614967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a9d26b5a-e626-4eb5-8406-05606f46d418 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:16.687489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a9d26b5a-e626-4eb5-8406-05606f46d418 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:46:16.695742 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a9d26b5a-e626-4eb5-8406-05606f46d418 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1324 microversion: 2.1 time: 0.101395 Oct 24 11:46:16.703263 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3844/7709] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:46:16 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1324 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:46:17.670689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-4f8210f1-0ee5-443a-99c8-8613c6576b2e req-d428b37c-6346-4d56-8222-943ac73e3454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "095022ee-d897-4aa6-ac03-86636ac7370b", "tag": "df990b01-7e6f-4629-882c-5073d070b682"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:46:17.680795 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4f8210f1-0ee5-443a-99c8-8613c6576b2e req-d428b37c-6346-4d56-8222-943ac73e3454 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:17.681313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4f8210f1-0ee5-443a-99c8-8613c6576b2e req-d428b37c-6346-4d56-8222-943ac73e3454 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:17.681742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-4f8210f1-0ee5-443a-99c8-8613c6576b2e req-d428b37c-6346-4d56-8222-943ac73e3454 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:17.693877 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-4f8210f1-0ee5-443a-99c8-8613c6576b2e req-d428b37c-6346-4d56-8222-943ac73e3454 service nova] Creating event network-changed:df990b01-7e6f-4629-882c-5073d070b682 for instance 095022ee-d897-4aa6-ac03-86636ac7370b on n-h2-858383-15 Oct 24 11:46:17.699183 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-4f8210f1-0ee5-443a-99c8-8613c6576b2e req-d428b37c-6346-4d56-8222-943ac73e3454 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097974 Oct 24 11:46:17.700345 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3866/7710] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:46:17.720722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c12d88f8-b7f3-4924-a1c9-0da11408bbde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:17.721416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c12d88f8-b7f3-4924-a1c9-0da11408bbde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:17.728508 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c12d88f8-b7f3-4924-a1c9-0da11408bbde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:17.729048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c12d88f8-b7f3-4924-a1c9-0da11408bbde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:17.729507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c12d88f8-b7f3-4924-a1c9-0da11408bbde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:17.730238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c12d88f8-b7f3-4924-a1c9-0da11408bbde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:17.730713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c12d88f8-b7f3-4924-a1c9-0da11408bbde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:17.731191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c12d88f8-b7f3-4924-a1c9-0da11408bbde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:17.869272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c12d88f8-b7f3-4924-a1c9-0da11408bbde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:46:17.877116 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c12d88f8-b7f3-4924-a1c9-0da11408bbde tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1392 microversion: 2.1 time: 0.161381 Oct 24 11:46:17.877746 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3845/7711] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:46:17 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:46:18.900233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6453a835-b145-478c-878f-8303a38f2c5f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:18.901385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6453a835-b145-478c-878f-8303a38f2c5f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:18.910508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6453a835-b145-478c-878f-8303a38f2c5f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:18.910752 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6453a835-b145-478c-878f-8303a38f2c5f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:18.911456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6453a835-b145-478c-878f-8303a38f2c5f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:18.912177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6453a835-b145-478c-878f-8303a38f2c5f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:18.912643 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6453a835-b145-478c-878f-8303a38f2c5f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:18.913103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6453a835-b145-478c-878f-8303a38f2c5f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:19.053325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6453a835-b145-478c-878f-8303a38f2c5f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:46:19.061797 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6453a835-b145-478c-878f-8303a38f2c5f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1392 microversion: 2.1 time: 0.165865 Oct 24 11:46:19.062368 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3867/7712] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:46:18 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:46:20.085397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-97a61e31-3088-41ee-9130-cd8ee07422f7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:20.085947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-97a61e31-3088-41ee-9130-cd8ee07422f7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:20.093502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97a61e31-3088-41ee-9130-cd8ee07422f7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:20.093998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97a61e31-3088-41ee-9130-cd8ee07422f7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:20.094460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97a61e31-3088-41ee-9130-cd8ee07422f7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:20.095166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97a61e31-3088-41ee-9130-cd8ee07422f7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:20.095637 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97a61e31-3088-41ee-9130-cd8ee07422f7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:20.096110 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97a61e31-3088-41ee-9130-cd8ee07422f7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:20.229360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-97a61e31-3088-41ee-9130-cd8ee07422f7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:46:20.237208 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-97a61e31-3088-41ee-9130-cd8ee07422f7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1392 microversion: 2.1 time: 0.155790 Oct 24 11:46:20.237789 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3846/7713] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:46:20 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:46:21.260846 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c22c15c5-a10d-4b52-8c6d-b2a76cf2a17f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:21.261486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c22c15c5-a10d-4b52-8c6d-b2a76cf2a17f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:21.268668 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c22c15c5-a10d-4b52-8c6d-b2a76cf2a17f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:21.269190 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c22c15c5-a10d-4b52-8c6d-b2a76cf2a17f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:21.269630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c22c15c5-a10d-4b52-8c6d-b2a76cf2a17f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:21.270329 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c22c15c5-a10d-4b52-8c6d-b2a76cf2a17f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:21.270811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c22c15c5-a10d-4b52-8c6d-b2a76cf2a17f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:21.271238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c22c15c5-a10d-4b52-8c6d-b2a76cf2a17f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:21.415151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c22c15c5-a10d-4b52-8c6d-b2a76cf2a17f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:46:21.423246 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c22c15c5-a10d-4b52-8c6d-b2a76cf2a17f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1392 microversion: 2.1 time: 0.166307 Oct 24 11:46:21.423835 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3868/7714] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:46:21 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:46:22.445666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-105c07fc-8ff2-4a89-aadd-9559582c0f7d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:22.446296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-105c07fc-8ff2-4a89-aadd-9559582c0f7d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:22.454154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-105c07fc-8ff2-4a89-aadd-9559582c0f7d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:22.454646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-105c07fc-8ff2-4a89-aadd-9559582c0f7d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:22.455093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-105c07fc-8ff2-4a89-aadd-9559582c0f7d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:22.455795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-105c07fc-8ff2-4a89-aadd-9559582c0f7d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:22.456263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-105c07fc-8ff2-4a89-aadd-9559582c0f7d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:22.456702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-105c07fc-8ff2-4a89-aadd-9559582c0f7d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:22.587109 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-105c07fc-8ff2-4a89-aadd-9559582c0f7d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:46:22.595654 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-105c07fc-8ff2-4a89-aadd-9559582c0f7d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1392 microversion: 2.1 time: 0.153879 Oct 24 11:46:22.596230 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3847/7715] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:46:22 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:46:23.619202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7878a2c1-6c16-4b61-878d-0b8ec627d850 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:23.619841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7878a2c1-6c16-4b61-878d-0b8ec627d850 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:23.628256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7878a2c1-6c16-4b61-878d-0b8ec627d850 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:23.628771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7878a2c1-6c16-4b61-878d-0b8ec627d850 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:23.629313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7878a2c1-6c16-4b61-878d-0b8ec627d850 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:23.630094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7878a2c1-6c16-4b61-878d-0b8ec627d850 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:23.630553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7878a2c1-6c16-4b61-878d-0b8ec627d850 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:23.630978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7878a2c1-6c16-4b61-878d-0b8ec627d850 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:23.766352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7878a2c1-6c16-4b61-878d-0b8ec627d850 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:46:23.767457 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-8ecba48d-9313-4be1-9f78-3e2e65b77da3 req-eb6733eb-3f92-4833-9258-85610d7664d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "095022ee-d897-4aa6-ac03-86636ac7370b", "name": "network-vif-plugged", "status": "completed", "tag": "df990b01-7e6f-4629-882c-5073d070b682"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:46:23.775244 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7878a2c1-6c16-4b61-878d-0b8ec627d850 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1392 microversion: 2.1 time: 0.159737 Oct 24 11:46:23.775532 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:46:23.790998 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3869/7716] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:46:23 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:46:23.791217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8ecba48d-9313-4be1-9f78-3e2e65b77da3 req-eb6733eb-3f92-4833-9258-85610d7664d2 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:23.791217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8ecba48d-9313-4be1-9f78-3e2e65b77da3 req-eb6733eb-3f92-4833-9258-85610d7664d2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:23.791217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8ecba48d-9313-4be1-9f78-3e2e65b77da3 req-eb6733eb-3f92-4833-9258-85610d7664d2 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:23.797538 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-8ecba48d-9313-4be1-9f78-3e2e65b77da3 req-eb6733eb-3f92-4833-9258-85610d7664d2 service nova] Creating event network-vif-plugged:df990b01-7e6f-4629-882c-5073d070b682 for instance 095022ee-d897-4aa6-ac03-86636ac7370b on n-h2-858383-15 Oct 24 11:46:23.802910 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-8ecba48d-9313-4be1-9f78-3e2e65b77da3 req-eb6733eb-3f92-4833-9258-85610d7664d2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040706 Oct 24 11:46:23.803832 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3848/7717] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:46:24.801218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c63d24e2-b4dc-4d49-8fd3-93f8f4e694ca tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:24.801838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c63d24e2-b4dc-4d49-8fd3-93f8f4e694ca tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:24.803854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:46:24.804594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:46:24.811417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c63d24e2-b4dc-4d49-8fd3-93f8f4e694ca tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:24.811901 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c63d24e2-b4dc-4d49-8fd3-93f8f4e694ca tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:24.812341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c63d24e2-b4dc-4d49-8fd3-93f8f4e694ca tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:24.813077 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c63d24e2-b4dc-4d49-8fd3-93f8f4e694ca tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:24.813534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c63d24e2-b4dc-4d49-8fd3-93f8f4e694ca tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:24.813964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c63d24e2-b4dc-4d49-8fd3-93f8f4e694ca tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:24.954488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c63d24e2-b4dc-4d49-8fd3-93f8f4e694ca tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:46:24.962320 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c63d24e2-b4dc-4d49-8fd3-93f8f4e694ca tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1392 microversion: 2.1 time: 0.165017 Oct 24 11:46:24.962925 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3870/7718] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:46:24 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:46:25.987593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1158ceb5-f24a-49ae-abe8-024b3a1642d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:25.988411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1158ceb5-f24a-49ae-abe8-024b3a1642d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:25.990725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:46:25.997738 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1158ceb5-f24a-49ae-abe8-024b3a1642d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:25.998237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1158ceb5-f24a-49ae-abe8-024b3a1642d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:25.998688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1158ceb5-f24a-49ae-abe8-024b3a1642d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:25.999403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1158ceb5-f24a-49ae-abe8-024b3a1642d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:25.999870 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1158ceb5-f24a-49ae-abe8-024b3a1642d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:26.000313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1158ceb5-f24a-49ae-abe8-024b3a1642d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:26.133848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1158ceb5-f24a-49ae-abe8-024b3a1642d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:46:26.141793 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1158ceb5-f24a-49ae-abe8-024b3a1642d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1565 microversion: 2.1 time: 0.158480 Oct 24 11:46:26.142361 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3849/7719] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:46:25 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:46:26.164308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-83b60c79-72a0-4c43-a977-a38d7f0d5fd3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:26.164968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-83b60c79-72a0-4c43-a977-a38d7f0d5fd3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:26.172373 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83b60c79-72a0-4c43-a977-a38d7f0d5fd3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:26.172891 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83b60c79-72a0-4c43-a977-a38d7f0d5fd3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:26.173335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83b60c79-72a0-4c43-a977-a38d7f0d5fd3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:26.174034 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83b60c79-72a0-4c43-a977-a38d7f0d5fd3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:26.174495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83b60c79-72a0-4c43-a977-a38d7f0d5fd3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:26.174926 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-83b60c79-72a0-4c43-a977-a38d7f0d5fd3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:26.311327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-83b60c79-72a0-4c43-a977-a38d7f0d5fd3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:46:26.319106 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-83b60c79-72a0-4c43-a977-a38d7f0d5fd3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1565 microversion: 2.1 time: 0.158849 Oct 24 11:46:26.319680 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3871/7720] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:46:26 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:46:28.180852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d99e1df8-aed4-4faf-94e9-0f606e88bcfb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:46:28.181694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d99e1df8-aed4-4faf-94e9-0f606e88bcfb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:28.183106 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-21585404-e957-4915-a722-7ce793cffe26 req-07b65521-7411-4763-9b53-3c3f89b0a549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "095022ee-d897-4aa6-ac03-86636ac7370b", "tag": "df990b01-7e6f-4629-882c-5073d070b682"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:46:28.189102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d99e1df8-aed4-4faf-94e9-0f606e88bcfb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:28.189695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d99e1df8-aed4-4faf-94e9-0f606e88bcfb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:28.190230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d99e1df8-aed4-4faf-94e9-0f606e88bcfb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:28.191026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d99e1df8-aed4-4faf-94e9-0f606e88bcfb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:28.191662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d99e1df8-aed4-4faf-94e9-0f606e88bcfb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:28.192455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d99e1df8-aed4-4faf-94e9-0f606e88bcfb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:28.196753 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-21585404-e957-4915-a722-7ce793cffe26 req-07b65521-7411-4763-9b53-3c3f89b0a549 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:28.197627 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-21585404-e957-4915-a722-7ce793cffe26 req-07b65521-7411-4763-9b53-3c3f89b0a549 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:28.198377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-21585404-e957-4915-a722-7ce793cffe26 req-07b65521-7411-4763-9b53-3c3f89b0a549 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:28.214853 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-21585404-e957-4915-a722-7ce793cffe26 req-07b65521-7411-4763-9b53-3c3f89b0a549 service nova] Creating event network-changed:df990b01-7e6f-4629-882c-5073d070b682 for instance 095022ee-d897-4aa6-ac03-86636ac7370b on n-h2-858383-15 Oct 24 11:46:28.221343 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-21585404-e957-4915-a722-7ce793cffe26 req-07b65521-7411-4763-9b53-3c3f89b0a549 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042247 Oct 24 11:46:28.222392 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3872/7721] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:46:28.341807 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d99e1df8-aed4-4faf-94e9-0f606e88bcfb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:46:28.350020 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d99e1df8-aed4-4faf-94e9-0f606e88bcfb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1565 microversion: 2.1 time: 0.173506 Oct 24 11:46:28.364856 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3850/7722] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:46:28 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:46:49.592514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:46:49.593293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=42 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:46:49.597951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9cfbede2-c868-41bf-8f1f-ab4574ee7409 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:46:49.600330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9cfbede2-c868-41bf-8f1f-ab4574ee7409 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:46:49.608316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cfbede2-c868-41bf-8f1f-ab4574ee7409 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:49.608797 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cfbede2-c868-41bf-8f1f-ab4574ee7409 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:49.609266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cfbede2-c868-41bf-8f1f-ab4574ee7409 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:49.609955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cfbede2-c868-41bf-8f1f-ab4574ee7409 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:46:49.610406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cfbede2-c868-41bf-8f1f-ab4574ee7409 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:46:49.610834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9cfbede2-c868-41bf-8f1f-ab4574ee7409 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:46:49.680990 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9cfbede2-c868-41bf-8f1f-ab4574ee7409 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b/action" status: 200 len: 24569 microversion: 2.1 time: 0.090110 Oct 24 11:46:49.681879 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3873/7723] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:46:49 2022] POST /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b/action => generated 24569 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 11:47:00.731039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1d760690-1640-4f15-a8d4-000deddcbf0a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:47:00.733343 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1d760690-1640-4f15-a8d4-000deddcbf0a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:00.735670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=5 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:47:00.736462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=38 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:47:00.742341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d760690-1640-4f15-a8d4-000deddcbf0a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:00.742843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d760690-1640-4f15-a8d4-000deddcbf0a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:00.743302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d760690-1640-4f15-a8d4-000deddcbf0a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:00.744014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d760690-1640-4f15-a8d4-000deddcbf0a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:00.744487 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d760690-1640-4f15-a8d4-000deddcbf0a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:00.745644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1d760690-1640-4f15-a8d4-000deddcbf0a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:00.785583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1d760690-1640-4f15-a8d4-000deddcbf0a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:00.791470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1d760690-1640-4f15-a8d4-000deddcbf0a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Old instance type m1.heat2, new instance type m1.heat {{(pid=120425) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 24 11:47:00.798182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1d760690-1640-4f15-a8d4-000deddcbf0a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:47:00.798626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1d760690-1640-4f15-a8d4-000deddcbf0a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:47:00.799120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1d760690-1640-4f15-a8d4-000deddcbf0a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:47:00.799551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1d760690-1640-4f15-a8d4-000deddcbf0a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:47:00.799989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-1d760690-1640-4f15-a8d4-000deddcbf0a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:47:00.863859 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1d760690-1640-4f15-a8d4-000deddcbf0a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b/action" status: 202 len: 0 microversion: 2.1 time: 0.136949 Oct 24 11:47:00.864472 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3851/7724] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:47:00 2022] POST /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:47:00.873982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6d0c0ca2-da34-4560-9032-3a101f0d4de8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:00.874681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6d0c0ca2-da34-4560-9032-3a101f0d4de8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:00.877340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:47:00.878170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=4 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:47:00.883724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d0c0ca2-da34-4560-9032-3a101f0d4de8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:00.884207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d0c0ca2-da34-4560-9032-3a101f0d4de8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:00.884641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d0c0ca2-da34-4560-9032-3a101f0d4de8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:00.885413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d0c0ca2-da34-4560-9032-3a101f0d4de8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:00.886548 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d0c0ca2-da34-4560-9032-3a101f0d4de8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:00.886978 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6d0c0ca2-da34-4560-9032-3a101f0d4de8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:01.033577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6d0c0ca2-da34-4560-9032-3a101f0d4de8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:01.042469 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6d0c0ca2-da34-4560-9032-3a101f0d4de8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1693 microversion: 2.1 time: 0.172771 Oct 24 11:47:01.042835 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3874/7725] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:00 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:02.067522 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2cdd2faa-2708-4a16-9e08-dc677a43033f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:02.068133 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2cdd2faa-2708-4a16-9e08-dc677a43033f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:02.075392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cdd2faa-2708-4a16-9e08-dc677a43033f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:02.075897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cdd2faa-2708-4a16-9e08-dc677a43033f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:02.076361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cdd2faa-2708-4a16-9e08-dc677a43033f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:02.077107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cdd2faa-2708-4a16-9e08-dc677a43033f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:02.077582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cdd2faa-2708-4a16-9e08-dc677a43033f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:02.078028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2cdd2faa-2708-4a16-9e08-dc677a43033f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:02.215546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-2cdd2faa-2708-4a16-9e08-dc677a43033f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:02.223423 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2cdd2faa-2708-4a16-9e08-dc677a43033f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1693 microversion: 2.1 time: 0.161146 Oct 24 11:47:02.223995 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3852/7726] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:02 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:03.247050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-15908cb3-564a-461f-bb67-66c89ca95fff tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:03.247674 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-15908cb3-564a-461f-bb67-66c89ca95fff tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:03.254860 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15908cb3-564a-461f-bb67-66c89ca95fff tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:03.255349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15908cb3-564a-461f-bb67-66c89ca95fff tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:03.255794 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15908cb3-564a-461f-bb67-66c89ca95fff tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:03.256498 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15908cb3-564a-461f-bb67-66c89ca95fff tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:03.256986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15908cb3-564a-461f-bb67-66c89ca95fff tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:03.257418 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-15908cb3-564a-461f-bb67-66c89ca95fff tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:03.410108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-15908cb3-564a-461f-bb67-66c89ca95fff tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:03.418096 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-15908cb3-564a-461f-bb67-66c89ca95fff tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1698 microversion: 2.1 time: 0.175122 Oct 24 11:47:03.418678 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3875/7727] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:03 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1698 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:04.441351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fd51e827-6637-49a0-ba83-0c85a42d147d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:04.441992 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fd51e827-6637-49a0-ba83-0c85a42d147d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:04.449452 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd51e827-6637-49a0-ba83-0c85a42d147d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:04.449953 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd51e827-6637-49a0-ba83-0c85a42d147d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:04.450409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd51e827-6637-49a0-ba83-0c85a42d147d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:04.451123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd51e827-6637-49a0-ba83-0c85a42d147d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:04.451602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd51e827-6637-49a0-ba83-0c85a42d147d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:04.452078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fd51e827-6637-49a0-ba83-0c85a42d147d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:04.582731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fd51e827-6637-49a0-ba83-0c85a42d147d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:04.590987 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fd51e827-6637-49a0-ba83-0c85a42d147d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1698 microversion: 2.1 time: 0.153561 Oct 24 11:47:04.591556 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3853/7728] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:04 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:05.614395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6112767d-d56e-4cdb-967d-29e269d3e94b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:05.614976 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6112767d-d56e-4cdb-967d-29e269d3e94b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:05.622911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6112767d-d56e-4cdb-967d-29e269d3e94b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:05.623409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6112767d-d56e-4cdb-967d-29e269d3e94b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:05.623854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6112767d-d56e-4cdb-967d-29e269d3e94b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:05.624557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6112767d-d56e-4cdb-967d-29e269d3e94b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:05.625057 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6112767d-d56e-4cdb-967d-29e269d3e94b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:05.625493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6112767d-d56e-4cdb-967d-29e269d3e94b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:05.759630 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6112767d-d56e-4cdb-967d-29e269d3e94b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:05.767589 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6112767d-d56e-4cdb-967d-29e269d3e94b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1698 microversion: 2.1 time: 0.157141 Oct 24 11:47:05.768169 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3876/7729] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:05 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:06.791523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-73174663-1ae0-462f-b108-d62884804ab2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:06.792694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-73174663-1ae0-462f-b108-d62884804ab2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:06.799541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73174663-1ae0-462f-b108-d62884804ab2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:06.800075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73174663-1ae0-462f-b108-d62884804ab2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:06.800540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73174663-1ae0-462f-b108-d62884804ab2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:06.801279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73174663-1ae0-462f-b108-d62884804ab2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:06.801751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73174663-1ae0-462f-b108-d62884804ab2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:06.802197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-73174663-1ae0-462f-b108-d62884804ab2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:06.937104 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-73174663-1ae0-462f-b108-d62884804ab2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:06.944881 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-73174663-1ae0-462f-b108-d62884804ab2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1698 microversion: 2.1 time: 0.157463 Oct 24 11:47:06.945450 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3854/7730] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:06 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:07.968258 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6e8cb265-ff9f-4871-8d6a-d1759df056bd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:07.968914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6e8cb265-ff9f-4871-8d6a-d1759df056bd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:07.975822 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e8cb265-ff9f-4871-8d6a-d1759df056bd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:07.976309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e8cb265-ff9f-4871-8d6a-d1759df056bd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:07.976755 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e8cb265-ff9f-4871-8d6a-d1759df056bd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:07.977482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e8cb265-ff9f-4871-8d6a-d1759df056bd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:07.977945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e8cb265-ff9f-4871-8d6a-d1759df056bd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:07.978379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6e8cb265-ff9f-4871-8d6a-d1759df056bd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:08.108907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-6e8cb265-ff9f-4871-8d6a-d1759df056bd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:08.116617 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6e8cb265-ff9f-4871-8d6a-d1759df056bd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1698 microversion: 2.1 time: 0.152862 Oct 24 11:47:08.123094 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3877/7731] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:07 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:09.140999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-22062d4a-82fb-43f8-a1cf-aa56464401f1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:09.141644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-22062d4a-82fb-43f8-a1cf-aa56464401f1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:09.148594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22062d4a-82fb-43f8-a1cf-aa56464401f1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:09.149137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22062d4a-82fb-43f8-a1cf-aa56464401f1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:09.149597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22062d4a-82fb-43f8-a1cf-aa56464401f1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:09.150313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22062d4a-82fb-43f8-a1cf-aa56464401f1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:09.151329 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22062d4a-82fb-43f8-a1cf-aa56464401f1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:09.151785 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-22062d4a-82fb-43f8-a1cf-aa56464401f1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:09.286440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-22062d4a-82fb-43f8-a1cf-aa56464401f1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:09.294451 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-22062d4a-82fb-43f8-a1cf-aa56464401f1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1698 microversion: 2.1 time: 0.157425 Oct 24 11:47:09.295038 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3855/7732] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:09 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:10.318801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1d197330-7991-4829-916f-96da2001eb1b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:10.319514 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1d197330-7991-4829-916f-96da2001eb1b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:10.327062 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d197330-7991-4829-916f-96da2001eb1b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:10.327549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d197330-7991-4829-916f-96da2001eb1b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:10.327979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d197330-7991-4829-916f-96da2001eb1b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:10.328666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d197330-7991-4829-916f-96da2001eb1b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:10.329145 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d197330-7991-4829-916f-96da2001eb1b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:10.329570 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1d197330-7991-4829-916f-96da2001eb1b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:10.461109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1d197330-7991-4829-916f-96da2001eb1b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:10.469562 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1d197330-7991-4829-916f-96da2001eb1b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1698 microversion: 2.1 time: 0.154685 Oct 24 11:47:10.470145 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3878/7733] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:10 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:11.492440 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ae453230-999a-4e36-97be-b197008079f8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:11.493121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ae453230-999a-4e36-97be-b197008079f8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:11.500644 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae453230-999a-4e36-97be-b197008079f8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:11.501186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae453230-999a-4e36-97be-b197008079f8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:11.501642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae453230-999a-4e36-97be-b197008079f8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:11.502354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae453230-999a-4e36-97be-b197008079f8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:11.502826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae453230-999a-4e36-97be-b197008079f8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:11.503273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ae453230-999a-4e36-97be-b197008079f8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:11.645477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ae453230-999a-4e36-97be-b197008079f8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:11.653383 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ae453230-999a-4e36-97be-b197008079f8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1698 microversion: 2.1 time: 0.164909 Oct 24 11:47:11.653961 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3856/7734] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:11 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1698 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:12.677723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-46a049fa-e69e-4dda-8439-1a66d4ee22ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:12.678340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-46a049fa-e69e-4dda-8439-1a66d4ee22ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:12.685540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46a049fa-e69e-4dda-8439-1a66d4ee22ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:12.686020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46a049fa-e69e-4dda-8439-1a66d4ee22ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:12.686455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46a049fa-e69e-4dda-8439-1a66d4ee22ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:12.687147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46a049fa-e69e-4dda-8439-1a66d4ee22ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:12.687596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46a049fa-e69e-4dda-8439-1a66d4ee22ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:12.688021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46a049fa-e69e-4dda-8439-1a66d4ee22ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:12.819941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-46a049fa-e69e-4dda-8439-1a66d4ee22ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:12.828400 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-46a049fa-e69e-4dda-8439-1a66d4ee22ac tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1698 microversion: 2.1 time: 0.154603 Oct 24 11:47:12.829009 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3879/7735] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:12 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:13.852353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fbd19196-3ead-4b88-b1dd-b49009e5a8cb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:13.853009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fbd19196-3ead-4b88-b1dd-b49009e5a8cb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:13.860232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbd19196-3ead-4b88-b1dd-b49009e5a8cb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:13.860935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbd19196-3ead-4b88-b1dd-b49009e5a8cb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:13.861368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbd19196-3ead-4b88-b1dd-b49009e5a8cb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:13.862165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbd19196-3ead-4b88-b1dd-b49009e5a8cb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:13.862712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbd19196-3ead-4b88-b1dd-b49009e5a8cb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:13.863187 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fbd19196-3ead-4b88-b1dd-b49009e5a8cb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:13.995272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fbd19196-3ead-4b88-b1dd-b49009e5a8cb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:14.003111 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fbd19196-3ead-4b88-b1dd-b49009e5a8cb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1698 microversion: 2.1 time: 0.154696 Oct 24 11:47:14.003698 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3857/7736] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:13 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:15.026487 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5c040e0d-8fe9-48d0-b819-11d99d003e12 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:15.027129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5c040e0d-8fe9-48d0-b819-11d99d003e12 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:15.034253 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5c040e0d-8fe9-48d0-b819-11d99d003e12 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:15.034738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5c040e0d-8fe9-48d0-b819-11d99d003e12 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:15.035174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5c040e0d-8fe9-48d0-b819-11d99d003e12 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:15.035876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5c040e0d-8fe9-48d0-b819-11d99d003e12 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:15.036333 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5c040e0d-8fe9-48d0-b819-11d99d003e12 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:15.036765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5c040e0d-8fe9-48d0-b819-11d99d003e12 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:15.175325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5c040e0d-8fe9-48d0-b819-11d99d003e12 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:15.183677 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5c040e0d-8fe9-48d0-b819-11d99d003e12 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1698 microversion: 2.1 time: 0.161436 Oct 24 11:47:15.184268 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3880/7737] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:15 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1698 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:16.207646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-208d5658-a93a-43c6-af13-50b3df95f989 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:16.208268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-208d5658-a93a-43c6-af13-50b3df95f989 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:16.215203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-208d5658-a93a-43c6-af13-50b3df95f989 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:16.215699 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-208d5658-a93a-43c6-af13-50b3df95f989 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:16.216151 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-208d5658-a93a-43c6-af13-50b3df95f989 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:16.216876 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-208d5658-a93a-43c6-af13-50b3df95f989 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:16.217348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-208d5658-a93a-43c6-af13-50b3df95f989 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:16.217787 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-208d5658-a93a-43c6-af13-50b3df95f989 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:16.347697 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-208d5658-a93a-43c6-af13-50b3df95f989 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:16.356134 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-208d5658-a93a-43c6-af13-50b3df95f989 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1698 microversion: 2.1 time: 0.152473 Oct 24 11:47:16.356714 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3858/7738] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:16 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:47:17.379887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-33a608b7-8470-4bc1-b941-36780c9a8d77 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:17.380413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-33a608b7-8470-4bc1-b941-36780c9a8d77 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:17.387244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33a608b7-8470-4bc1-b941-36780c9a8d77 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:17.387742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33a608b7-8470-4bc1-b941-36780c9a8d77 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:17.388157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33a608b7-8470-4bc1-b941-36780c9a8d77 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:17.388852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33a608b7-8470-4bc1-b941-36780c9a8d77 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:17.389313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33a608b7-8470-4bc1-b941-36780c9a8d77 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:17.389739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33a608b7-8470-4bc1-b941-36780c9a8d77 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:17.529492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-33a608b7-8470-4bc1-b941-36780c9a8d77 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:17.537443 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-33a608b7-8470-4bc1-b941-36780c9a8d77 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1698 microversion: 2.1 time: 0.161516 Oct 24 11:47:17.538016 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3881/7739] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:17 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1698 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:18.561998 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5c61ea06-6964-426b-8574-2446cc199b00 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:18.562638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c61ea06-6964-426b-8574-2446cc199b00 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:18.569612 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c61ea06-6964-426b-8574-2446cc199b00 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:18.570120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c61ea06-6964-426b-8574-2446cc199b00 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:18.570585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c61ea06-6964-426b-8574-2446cc199b00 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:18.571305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c61ea06-6964-426b-8574-2446cc199b00 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:18.571810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c61ea06-6964-426b-8574-2446cc199b00 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:18.572778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c61ea06-6964-426b-8574-2446cc199b00 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:18.705909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5c61ea06-6964-426b-8574-2446cc199b00 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:18.714269 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5c61ea06-6964-426b-8574-2446cc199b00 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1698 microversion: 2.1 time: 0.156193 Oct 24 11:47:18.714839 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3859/7740] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:18 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:19.737802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b6ce8610-9be6-4b3f-9e00-163f99fd7aef tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:19.738419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b6ce8610-9be6-4b3f-9e00-163f99fd7aef tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:19.745552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6ce8610-9be6-4b3f-9e00-163f99fd7aef tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:19.746050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6ce8610-9be6-4b3f-9e00-163f99fd7aef tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:19.746495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6ce8610-9be6-4b3f-9e00-163f99fd7aef tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:19.747207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6ce8610-9be6-4b3f-9e00-163f99fd7aef tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:19.747669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6ce8610-9be6-4b3f-9e00-163f99fd7aef tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:19.748102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6ce8610-9be6-4b3f-9e00-163f99fd7aef tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:19.883858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b6ce8610-9be6-4b3f-9e00-163f99fd7aef tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:19.892207 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b6ce8610-9be6-4b3f-9e00-163f99fd7aef tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1698 microversion: 2.1 time: 0.158346 Oct 24 11:47:19.892795 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3882/7741] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:19 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:20.917286 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4252411e-cb83-4811-a061-5f19d29c14d2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:20.917918 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4252411e-cb83-4811-a061-5f19d29c14d2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:20.925078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4252411e-cb83-4811-a061-5f19d29c14d2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:20.925607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4252411e-cb83-4811-a061-5f19d29c14d2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:20.926057 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4252411e-cb83-4811-a061-5f19d29c14d2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:20.926768 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4252411e-cb83-4811-a061-5f19d29c14d2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:20.927240 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4252411e-cb83-4811-a061-5f19d29c14d2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:20.927680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4252411e-cb83-4811-a061-5f19d29c14d2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:21.063660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4252411e-cb83-4811-a061-5f19d29c14d2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:21.071462 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4252411e-cb83-4811-a061-5f19d29c14d2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1695 microversion: 2.1 time: 0.158602 Oct 24 11:47:21.072047 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3860/7742] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:20 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:22.094331 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5eb74b9a-4d96-431b-a48a-816bea3e35a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:22.094959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5eb74b9a-4d96-431b-a48a-816bea3e35a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:22.102599 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5eb74b9a-4d96-431b-a48a-816bea3e35a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:22.103121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5eb74b9a-4d96-431b-a48a-816bea3e35a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:22.104134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5eb74b9a-4d96-431b-a48a-816bea3e35a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:22.104867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5eb74b9a-4d96-431b-a48a-816bea3e35a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:22.105330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5eb74b9a-4d96-431b-a48a-816bea3e35a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:22.105765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5eb74b9a-4d96-431b-a48a-816bea3e35a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:22.242972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5eb74b9a-4d96-431b-a48a-816bea3e35a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:22.252064 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5eb74b9a-4d96-431b-a48a-816bea3e35a5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1695 microversion: 2.1 time: 0.161777 Oct 24 11:47:22.252652 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3883/7743] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:22 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:23.275707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e8f317a3-7e44-4011-8e57-28dd6283050c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:23.276420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e8f317a3-7e44-4011-8e57-28dd6283050c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:23.283688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8f317a3-7e44-4011-8e57-28dd6283050c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:23.284182 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8f317a3-7e44-4011-8e57-28dd6283050c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:23.284631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8f317a3-7e44-4011-8e57-28dd6283050c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:23.285357 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8f317a3-7e44-4011-8e57-28dd6283050c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:23.285828 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8f317a3-7e44-4011-8e57-28dd6283050c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:23.286268 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8f317a3-7e44-4011-8e57-28dd6283050c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:23.419682 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e8f317a3-7e44-4011-8e57-28dd6283050c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:23.427499 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e8f317a3-7e44-4011-8e57-28dd6283050c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1692 microversion: 2.1 time: 0.155827 Oct 24 11:47:23.428075 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3861/7744] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:23 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:23.451141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-886f331c-91cb-462a-834d-6a2b0d77e484 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:47:23.451692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-886f331c-91cb-462a-834d-6a2b0d77e484 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:23.459428 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-886f331c-91cb-462a-834d-6a2b0d77e484 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:23.459917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-886f331c-91cb-462a-834d-6a2b0d77e484 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:23.460352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-886f331c-91cb-462a-834d-6a2b0d77e484 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:23.461083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-886f331c-91cb-462a-834d-6a2b0d77e484 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:23.461540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-886f331c-91cb-462a-834d-6a2b0d77e484 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:23.461968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-886f331c-91cb-462a-834d-6a2b0d77e484 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:23.522953 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-886f331c-91cb-462a-834d-6a2b0d77e484 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b/action" status: 204 len: 0 microversion: 2.1 time: 0.076173 Oct 24 11:47:23.523633 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3884/7745] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:47:23 2022] POST /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:47:23.533280 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09ec4360-4bb7-413a-91ce-367b8c7d8bdb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:23.534013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09ec4360-4bb7-413a-91ce-367b8c7d8bdb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:23.540215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09ec4360-4bb7-413a-91ce-367b8c7d8bdb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:23.540721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09ec4360-4bb7-413a-91ce-367b8c7d8bdb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:23.541210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09ec4360-4bb7-413a-91ce-367b8c7d8bdb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:23.541925 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09ec4360-4bb7-413a-91ce-367b8c7d8bdb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:23.542393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09ec4360-4bb7-413a-91ce-367b8c7d8bdb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:23.542836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09ec4360-4bb7-413a-91ce-367b8c7d8bdb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:23.683716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-09ec4360-4bb7-413a-91ce-367b8c7d8bdb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:23.691640 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-09ec4360-4bb7-413a-91ce-367b8c7d8bdb tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1692 microversion: 2.1 time: 0.163171 Oct 24 11:47:23.692222 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3862/7746] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:23 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:23.714430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-8d65932a-6456-4aef-926e-517c6806c3f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:23.715138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-8d65932a-6456-4aef-926e-517c6806c3f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:23.721509 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d65932a-6456-4aef-926e-517c6806c3f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:23.721992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d65932a-6456-4aef-926e-517c6806c3f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:23.722430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d65932a-6456-4aef-926e-517c6806c3f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:23.723128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d65932a-6456-4aef-926e-517c6806c3f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:23.723656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d65932a-6456-4aef-926e-517c6806c3f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:23.724090 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-8d65932a-6456-4aef-926e-517c6806c3f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:23.864293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-8d65932a-6456-4aef-926e-517c6806c3f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:23.873160 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-8d65932a-6456-4aef-926e-517c6806c3f6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1692 microversion: 2.1 time: 0.162918 Oct 24 11:47:23.873883 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3885/7747] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:23 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:47:24.250232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-fa3ed277-63d1-45fd-8f63-c21a3c816abb req-b6b3ebc4-cf94-4260-9980-dab127d7b56d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "095022ee-d897-4aa6-ac03-86636ac7370b", "name": "network-vif-unplugged", "status": "completed", "tag": "df990b01-7e6f-4629-882c-5073d070b682"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:47:24.260947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fa3ed277-63d1-45fd-8f63-c21a3c816abb req-b6b3ebc4-cf94-4260-9980-dab127d7b56d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:24.261587 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fa3ed277-63d1-45fd-8f63-c21a3c816abb req-b6b3ebc4-cf94-4260-9980-dab127d7b56d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:24.261911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-fa3ed277-63d1-45fd-8f63-c21a3c816abb req-b6b3ebc4-cf94-4260-9980-dab127d7b56d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:24.274922 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-fa3ed277-63d1-45fd-8f63-c21a3c816abb req-b6b3ebc4-cf94-4260-9980-dab127d7b56d service nova] Creating event network-vif-unplugged:df990b01-7e6f-4629-882c-5073d070b682 for instance 095022ee-d897-4aa6-ac03-86636ac7370b on n-h2-858383-15 Oct 24 11:47:24.281801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [req-fa3ed277-63d1-45fd-8f63-c21a3c816abb req-b6b3ebc4-cf94-4260-9980-dab127d7b56d service nova] Instance 095022ee-d897-4aa6-ac03-86636ac7370b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-15'} {{(pid=120425) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 24 11:47:24.288542 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-fa3ed277-63d1-45fd-8f63-c21a3c816abb req-b6b3ebc4-cf94-4260-9980-dab127d7b56d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105936 Oct 24 11:47:24.289205 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3863/7748] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:47:24.896944 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d5ad5e4a-74c7-410a-9cbc-3e0109d5479b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:24.898191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d5ad5e4a-74c7-410a-9cbc-3e0109d5479b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:24.905749 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5ad5e4a-74c7-410a-9cbc-3e0109d5479b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:24.906675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5ad5e4a-74c7-410a-9cbc-3e0109d5479b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:24.907459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5ad5e4a-74c7-410a-9cbc-3e0109d5479b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:24.908615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5ad5e4a-74c7-410a-9cbc-3e0109d5479b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:24.909175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5ad5e4a-74c7-410a-9cbc-3e0109d5479b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:24.909616 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5ad5e4a-74c7-410a-9cbc-3e0109d5479b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:25.057449 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d5ad5e4a-74c7-410a-9cbc-3e0109d5479b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:25.065259 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d5ad5e4a-74c7-410a-9cbc-3e0109d5479b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1684 microversion: 2.1 time: 0.172453 Oct 24 11:47:25.065842 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3886/7749] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:24 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:26.311950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-33c037a5-cc98-4b4c-9abb-52cee731fbf7 req-95e5cbde-0d67-4322-9ebd-9b02f30ef4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "095022ee-d897-4aa6-ac03-86636ac7370b", "name": "network-vif-plugged", "status": "completed", "tag": "df990b01-7e6f-4629-882c-5073d070b682"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:47:26.321539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-33c037a5-cc98-4b4c-9abb-52cee731fbf7 req-95e5cbde-0d67-4322-9ebd-9b02f30ef4d4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:26.322029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-33c037a5-cc98-4b4c-9abb-52cee731fbf7 req-95e5cbde-0d67-4322-9ebd-9b02f30ef4d4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:26.322476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-33c037a5-cc98-4b4c-9abb-52cee731fbf7 req-95e5cbde-0d67-4322-9ebd-9b02f30ef4d4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:26.333423 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-33c037a5-cc98-4b4c-9abb-52cee731fbf7 req-95e5cbde-0d67-4322-9ebd-9b02f30ef4d4 service nova] Creating event network-vif-plugged:df990b01-7e6f-4629-882c-5073d070b682 for instance 095022ee-d897-4aa6-ac03-86636ac7370b on n-h2-858383-15 Oct 24 11:47:26.338985 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-33c037a5-cc98-4b4c-9abb-52cee731fbf7 req-95e5cbde-0d67-4322-9ebd-9b02f30ef4d4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031880 Oct 24 11:47:26.339561 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3864/7750] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:47:47.245609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4e1895d5-935b-4469-9b20-02d45934105e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:47:47.247954 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4e1895d5-935b-4469-9b20-02d45934105e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:47.250200 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=26 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:47:47.250862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:47:47.256580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e1895d5-935b-4469-9b20-02d45934105e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:47.257100 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e1895d5-935b-4469-9b20-02d45934105e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:47.257544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e1895d5-935b-4469-9b20-02d45934105e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:47.258249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e1895d5-935b-4469-9b20-02d45934105e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:47.258709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e1895d5-935b-4469-9b20-02d45934105e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:47.259141 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4e1895d5-935b-4469-9b20-02d45934105e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:47.326759 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4e1895d5-935b-4469-9b20-02d45934105e tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b/action" status: 200 len: 24577 microversion: 2.1 time: 0.085392 Oct 24 11:47:47.327408 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3887/7751] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:47:47 2022] POST /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b/action => generated 24577 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 11:47:54.631854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a6744d05-b39b-4513-b2a2-cd994b3c9457 req-53192484-d3cd-4ef5-9649-b32ccffba47b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "095022ee-d897-4aa6-ac03-86636ac7370b", "tag": "df990b01-7e6f-4629-882c-5073d070b682"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:47:54.633794 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=32 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:47:54.634976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:47:54.640014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2689d1f7-5abc-4efc-ae4b-71a546601847 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:54.640630 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2689d1f7-5abc-4efc-ae4b-71a546601847 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:54.651365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a6744d05-b39b-4513-b2a2-cd994b3c9457 req-53192484-d3cd-4ef5-9649-b32ccffba47b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:54.653150 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a6744d05-b39b-4513-b2a2-cd994b3c9457 req-53192484-d3cd-4ef5-9649-b32ccffba47b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:54.653970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a6744d05-b39b-4513-b2a2-cd994b3c9457 req-53192484-d3cd-4ef5-9649-b32ccffba47b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:54.654819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2689d1f7-5abc-4efc-ae4b-71a546601847 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:54.655486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2689d1f7-5abc-4efc-ae4b-71a546601847 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:54.656130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2689d1f7-5abc-4efc-ae4b-71a546601847 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:54.657017 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2689d1f7-5abc-4efc-ae4b-71a546601847 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:54.657544 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2689d1f7-5abc-4efc-ae4b-71a546601847 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:54.658277 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2689d1f7-5abc-4efc-ae4b-71a546601847 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:54.667682 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a6744d05-b39b-4513-b2a2-cd994b3c9457 req-53192484-d3cd-4ef5-9649-b32ccffba47b service nova] Creating event network-changed:df990b01-7e6f-4629-882c-5073d070b682 for instance 095022ee-d897-4aa6-ac03-86636ac7370b on n-h2-858383-15 Oct 24 11:47:54.673193 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a6744d05-b39b-4513-b2a2-cd994b3c9457 req-53192484-d3cd-4ef5-9649-b32ccffba47b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045233 Oct 24 11:47:54.674166 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3888/7752] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:47:54.689897 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2689d1f7-5abc-4efc-ae4b-71a546601847 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:47:54.772813 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2689d1f7-5abc-4efc-ae4b-71a546601847 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "DELETE /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 204 len: 0 microversion: 2.1 time: 0.147368 Oct 24 11:47:54.773378 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3865/7753] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:47:54 2022] DELETE /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:47:54.783169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0ebd6d63-a798-4a5d-bbc1-9c49dc6cfda7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:54.785216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0ebd6d63-a798-4a5d-bbc1-9c49dc6cfda7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:54.791503 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ebd6d63-a798-4a5d-bbc1-9c49dc6cfda7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:54.791989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ebd6d63-a798-4a5d-bbc1-9c49dc6cfda7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:54.792550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ebd6d63-a798-4a5d-bbc1-9c49dc6cfda7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:54.793357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ebd6d63-a798-4a5d-bbc1-9c49dc6cfda7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:54.794108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ebd6d63-a798-4a5d-bbc1-9c49dc6cfda7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:54.794450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0ebd6d63-a798-4a5d-bbc1-9c49dc6cfda7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:54.941222 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0ebd6d63-a798-4a5d-bbc1-9c49dc6cfda7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:54.949118 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0ebd6d63-a798-4a5d-bbc1-9c49dc6cfda7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1690 microversion: 2.1 time: 0.170822 Oct 24 11:47:54.949958 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3889/7754] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:54 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:55.974026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9201063e-4a7d-4966-bce0-b97cdb77f414 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:55.974746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9201063e-4a7d-4966-bce0-b97cdb77f414 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:55.982294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9201063e-4a7d-4966-bce0-b97cdb77f414 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:55.982793 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9201063e-4a7d-4966-bce0-b97cdb77f414 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:55.983246 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9201063e-4a7d-4966-bce0-b97cdb77f414 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:55.983952 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9201063e-4a7d-4966-bce0-b97cdb77f414 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:55.984419 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9201063e-4a7d-4966-bce0-b97cdb77f414 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:55.984887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9201063e-4a7d-4966-bce0-b97cdb77f414 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:56.117528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9201063e-4a7d-4966-bce0-b97cdb77f414 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:56.126139 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9201063e-4a7d-4966-bce0-b97cdb77f414 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1690 microversion: 2.1 time: 0.156382 Oct 24 11:47:56.126951 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3866/7755] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:55 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:57.149540 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b877450c-0b41-4fc0-a8aa-0687dc02b012 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:57.150166 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b877450c-0b41-4fc0-a8aa-0687dc02b012 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:57.157447 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b877450c-0b41-4fc0-a8aa-0687dc02b012 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:57.158208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b877450c-0b41-4fc0-a8aa-0687dc02b012 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:57.158641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b877450c-0b41-4fc0-a8aa-0687dc02b012 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:57.159353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b877450c-0b41-4fc0-a8aa-0687dc02b012 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:57.159806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b877450c-0b41-4fc0-a8aa-0687dc02b012 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:57.160233 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b877450c-0b41-4fc0-a8aa-0687dc02b012 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:57.187359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-6d72e7ae-3254-470f-b214-f422a408436b req-c652e70b-51d4-41bf-a0c4-5d765afc50fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "095022ee-d897-4aa6-ac03-86636ac7370b", "name": "network-vif-deleted", "tag": "df990b01-7e6f-4629-882c-5073d070b682"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:47:57.199113 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6d72e7ae-3254-470f-b214-f422a408436b req-c652e70b-51d4-41bf-a0c4-5d765afc50fd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:57.199695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6d72e7ae-3254-470f-b214-f422a408436b req-c652e70b-51d4-41bf-a0c4-5d765afc50fd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:57.200415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6d72e7ae-3254-470f-b214-f422a408436b req-c652e70b-51d4-41bf-a0c4-5d765afc50fd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:57.213124 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-6d72e7ae-3254-470f-b214-f422a408436b req-c652e70b-51d4-41bf-a0c4-5d765afc50fd service nova] Creating event network-vif-deleted:df990b01-7e6f-4629-882c-5073d070b682 for instance 095022ee-d897-4aa6-ac03-86636ac7370b on n-h2-858383-15 Oct 24 11:47:57.218278 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-6d72e7ae-3254-470f-b214-f422a408436b req-c652e70b-51d4-41bf-a0c4-5d765afc50fd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036083 Oct 24 11:47:57.218888 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3867/7756] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:47:57.233342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b877450c-0b41-4fc0-a8aa-0687dc02b012 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:47:57.241318 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b877450c-0b41-4fc0-a8aa-0687dc02b012 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 200 len: 1503 microversion: 2.1 time: 0.095851 Oct 24 11:47:57.241899 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3890/7757] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:57 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 1503 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:47:58.266013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f5b83900-7bc6-49d6-9fdd-9703fdebecbd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:47:58.266756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f5b83900-7bc6-49d6-9fdd-9703fdebecbd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: 095022ee-d897-4aa6-ac03-86636ac7370b] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:47:58.273762 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5b83900-7bc6-49d6-9fdd-9703fdebecbd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:58.274258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5b83900-7bc6-49d6-9fdd-9703fdebecbd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:58.274712 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5b83900-7bc6-49d6-9fdd-9703fdebecbd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:58.275444 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5b83900-7bc6-49d6-9fdd-9703fdebecbd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:47:58.275913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5b83900-7bc6-49d6-9fdd-9703fdebecbd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:47:58.276354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f5b83900-7bc6-49d6-9fdd-9703fdebecbd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:47:58.289780 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-f5b83900-7bc6-49d6-9fdd-9703fdebecbd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] HTTP exception thrown: Instance 095022ee-d897-4aa6-ac03-86636ac7370b could not be found. Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f5b83900-7bc6-49d6-9fdd-9703fdebecbd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Request method failure captured: Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b HTTP/1.1 Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnpaKq5eMD1wOzd3b0sKYUgl2bjacFpSj-y3-0VcKu80EQNHdJhpBnba-f7gM6-ByY9XlAsOphxypaSEGoSP8rdUWPJNC3Qgb060RgWUaFdfTWVPikTJMe6jnvvdIHjl1TPy-V0Mj-4jPkEyPtgT5wAyFasuOciBHUhQoLY-cRXaZzk Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: f84eda4103cf4f2b8c362d83d5394c69 Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1428233327 Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f84eda4103cf4f2b8c362d83d5394c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f84eda4103cf4f2b8c362d83d5394c69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f84eda4103cf4f2b8c362d83d5394c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f84eda4103cf4f2b8c362d83d5394c69", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1428233327 Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: f84eda4103cf4f2b8c362d83d5394c69 Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1428233327 Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestNetworkAdvancedServerOps-1428233327-project Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: f80525ed5fa842e18c9ec15fe2cd4053 Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1428233327-project Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 095022ee-d897-4aa6-ac03-86636ac7370b could not be found. Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '095022ee-d897-4aa6-ac03-86636ac7370b'} Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 095022ee-d897-4aa6-ac03-86636ac7370b could not be found. Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 095022ee-d897-4aa6-ac03-86636ac7370b could not be found. Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:47:58.291413 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:47:58.297433 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:47:58.297433 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:47:58.297433 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:47:58.297433 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:47:58.297433 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:47:58.297433 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:47:58.297433 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 095022ee-d897-4aa6-ac03-86636ac7370b could not be found. Oct 24 11:47:58.297433 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:47:58.297433 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f5b83900-7bc6-49d6-9fdd-9703fdebecbd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Returning 404 to user: Instance 095022ee-d897-4aa6-ac03-86636ac7370b could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:47:58.297433 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f5b83900-7bc6-49d6-9fdd-9703fdebecbd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b" status: 404 len: 111 microversion: 2.1 time: 0.031768 Oct 24 11:47:58.297433 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3868/7758] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:47:58 2022] GET /compute/v2.1/servers/095022ee-d897-4aa6-ac03-86636ac7370b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:48:01.627762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0698b072-0776-42af-af53-023d2f960278 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '.version_select at 0x7f04d05acf70>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:01.652798 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0698b072-0776-42af-af53-023d2f960278 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1361861744" status: 202 len: 0 microversion: 2.1 time: 0.028577 Oct 24 11:48:01.653443 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3891/7759] 10.222.0.50 () {58 vars in 1284 bytes} [Mon Oct 24 11:48:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1361861744 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:48:01.680640 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f4a29b59-6e1a-4ac2-a728-3d50ff42fe75 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'create', calling method: .version_select at 0x7f04d0bba040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1155803120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoSJOtDLPZq5DVyHbOHo1TCaYqDb55h9hVmjItXbw2yzhrUvPLoZW2sT2Ui/dZmvoq1z3PkMTq1bKXozlslJA5pdqKd/lR/a1sOSMeiRfoFBCuifRz7hcYYREdnIb1C1g=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:48:01.699596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-f4a29b59-6e1a-4ac2-a728-3d50ff42fe75 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:48:01.704940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-f4a29b59-6e1a-4ac2-a728-3d50ff42fe75 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for user f80525ed5fa842e18c9ec15fe2cd4053 and project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:48:01.731308 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f4a29b59-6e1a-4ac2-a728-3d50ff42fe75 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054606 Oct 24 11:48:01.732014 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3869/7760] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:48:01 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:48:07.281289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0418608d-4981-4a80-a086-16e5b61d1243 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-146379616", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "ca4e52e5-a8a5-4769-8cb7-da89714f6ccf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1155803120", "security_groups": [{"name": "tempest-secgroup-smoke-1232632581"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:48:07.294957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=18 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:48:07.428050 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-0418608d-4981-4a80-a086-16e5b61d1243 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] validate_networks() for [('ca4e52e5-a8a5-4769-8cb7-da89714f6ccf', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:48:07.912129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0418608d-4981-4a80-a086-16e5b61d1243 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:48:07.912632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0418608d-4981-4a80-a086-16e5b61d1243 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:48:07.913254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0418608d-4981-4a80-a086-16e5b61d1243 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:48:07.913763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0418608d-4981-4a80-a086-16e5b61d1243 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:48:07.914251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-0418608d-4981-4a80-a086-16e5b61d1243 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:48:07.923972 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0418608d-4981-4a80-a086-16e5b61d1243 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:07.924455 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0418608d-4981-4a80-a086-16e5b61d1243 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:07.924928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0418608d-4981-4a80-a086-16e5b61d1243 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:07.925648 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0418608d-4981-4a80-a086-16e5b61d1243 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:07.926291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0418608d-4981-4a80-a086-16e5b61d1243 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:07.927378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0418608d-4981-4a80-a086-16e5b61d1243 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:07.945322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-0418608d-4981-4a80-a086-16e5b61d1243 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:48:07.951151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-0418608d-4981-4a80-a086-16e5b61d1243 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for user f80525ed5fa842e18c9ec15fe2cd4053 and project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:48:07.963396 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0418608d-4981-4a80-a086-16e5b61d1243 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:48:07.966369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0418608d-4981-4a80-a086-16e5b61d1243 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:48:08.013603 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0418608d-4981-4a80-a086-16e5b61d1243 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.740102 Oct 24 11:48:08.014429 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3892/7761] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:48:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 11:48:08.025383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4aa000e2-18ae-4b5d-9477-0b32e1bb0733 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:08.026016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4aa000e2-18ae-4b5d-9477-0b32e1bb0733 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:08.087561 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4aa000e2-18ae-4b5d-9477-0b32e1bb0733 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:08.098183 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4aa000e2-18ae-4b5d-9477-0b32e1bb0733 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1266 microversion: 2.1 time: 0.076577 Oct 24 11:48:08.099221 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3870/7762] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:08 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:48:09.124889 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-987182d4-f242-4951-9db9-9001467fdf66 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:09.125457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-987182d4-f242-4951-9db9-9001467fdf66 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:09.141462 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-987182d4-f242-4951-9db9-9001467fdf66 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:09.141964 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-987182d4-f242-4951-9db9-9001467fdf66 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:09.142421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-987182d4-f242-4951-9db9-9001467fdf66 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:09.143143 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-987182d4-f242-4951-9db9-9001467fdf66 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:09.143635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-987182d4-f242-4951-9db9-9001467fdf66 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:09.144099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-987182d4-f242-4951-9db9-9001467fdf66 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:09.225451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-987182d4-f242-4951-9db9-9001467fdf66 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:09.234435 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-987182d4-f242-4951-9db9-9001467fdf66 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1326 microversion: 2.1 time: 0.115188 Oct 24 11:48:09.236164 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3893/7763] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:09 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1326 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:48:10.263700 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-04dacf05-bcfc-4369-b527-fccf25c00e30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:10.264424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-04dacf05-bcfc-4369-b527-fccf25c00e30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:10.266563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:48:10.274393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04dacf05-bcfc-4369-b527-fccf25c00e30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:10.275009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04dacf05-bcfc-4369-b527-fccf25c00e30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:10.275575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04dacf05-bcfc-4369-b527-fccf25c00e30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:10.276554 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04dacf05-bcfc-4369-b527-fccf25c00e30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:10.277479 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04dacf05-bcfc-4369-b527-fccf25c00e30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:10.278257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-04dacf05-bcfc-4369-b527-fccf25c00e30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:10.725751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-04dacf05-bcfc-4369-b527-fccf25c00e30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:10.733903 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-04dacf05-bcfc-4369-b527-fccf25c00e30 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1392 microversion: 2.1 time: 0.478059 Oct 24 11:48:10.734488 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3871/7764] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:10 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1392 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:48:10.773134 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-edd3bcb2-327f-4277-aa96-73fd0e90219e req-366c7413-c5e7-4134-8fee-5c29435d8788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a39b875f-c9b6-4b89-aea7-64baad2d83b2", "tag": "2634c321-f62a-4b4f-a684-c969711243c8"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:48:10.786609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-edd3bcb2-327f-4277-aa96-73fd0e90219e req-366c7413-c5e7-4134-8fee-5c29435d8788 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:10.787720 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-edd3bcb2-327f-4277-aa96-73fd0e90219e req-366c7413-c5e7-4134-8fee-5c29435d8788 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:10.788164 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-edd3bcb2-327f-4277-aa96-73fd0e90219e req-366c7413-c5e7-4134-8fee-5c29435d8788 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:10.801326 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-edd3bcb2-327f-4277-aa96-73fd0e90219e req-366c7413-c5e7-4134-8fee-5c29435d8788 service nova] Creating event network-changed:2634c321-f62a-4b4f-a684-c969711243c8 for instance a39b875f-c9b6-4b89-aea7-64baad2d83b2 on n-h2-858383-15 Oct 24 11:48:10.807224 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-edd3bcb2-327f-4277-aa96-73fd0e90219e req-366c7413-c5e7-4134-8fee-5c29435d8788 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039209 Oct 24 11:48:10.808659 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3894/7765] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:48:11.757723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0c65d95-236c-4a58-b9c7-99fba32ecde6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:11.758354 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f0c65d95-236c-4a58-b9c7-99fba32ecde6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:11.766165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0c65d95-236c-4a58-b9c7-99fba32ecde6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:11.766660 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0c65d95-236c-4a58-b9c7-99fba32ecde6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:11.767111 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0c65d95-236c-4a58-b9c7-99fba32ecde6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:11.767819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0c65d95-236c-4a58-b9c7-99fba32ecde6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:11.768288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0c65d95-236c-4a58-b9c7-99fba32ecde6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:11.768727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0c65d95-236c-4a58-b9c7-99fba32ecde6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:11.899978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f0c65d95-236c-4a58-b9c7-99fba32ecde6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:11.909053 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f0c65d95-236c-4a58-b9c7-99fba32ecde6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1392 microversion: 2.1 time: 0.155284 Oct 24 11:48:11.909634 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3872/7766] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:11 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:48:12.933507 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-af8311ad-dcf5-4477-8e98-6641d9082352 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:12.934271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-af8311ad-dcf5-4477-8e98-6641d9082352 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:12.940565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af8311ad-dcf5-4477-8e98-6641d9082352 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:12.941089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af8311ad-dcf5-4477-8e98-6641d9082352 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:12.941559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af8311ad-dcf5-4477-8e98-6641d9082352 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:12.942262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af8311ad-dcf5-4477-8e98-6641d9082352 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:12.942718 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af8311ad-dcf5-4477-8e98-6641d9082352 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:12.943146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af8311ad-dcf5-4477-8e98-6641d9082352 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:13.084800 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-af8311ad-dcf5-4477-8e98-6641d9082352 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:13.093142 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-af8311ad-dcf5-4477-8e98-6641d9082352 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1392 microversion: 2.1 time: 0.165183 Oct 24 11:48:13.093729 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3895/7767] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:12 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:48:14.115427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef56a4df-0a20-4253-a22b-1841392cfffd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:14.116006 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ef56a4df-0a20-4253-a22b-1841392cfffd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:14.124050 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef56a4df-0a20-4253-a22b-1841392cfffd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:14.124555 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef56a4df-0a20-4253-a22b-1841392cfffd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:14.125117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef56a4df-0a20-4253-a22b-1841392cfffd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:14.125845 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef56a4df-0a20-4253-a22b-1841392cfffd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:14.126317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef56a4df-0a20-4253-a22b-1841392cfffd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:14.126758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef56a4df-0a20-4253-a22b-1841392cfffd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:14.262805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ef56a4df-0a20-4253-a22b-1841392cfffd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:14.270581 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef56a4df-0a20-4253-a22b-1841392cfffd tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1392 microversion: 2.1 time: 0.159213 Oct 24 11:48:14.271151 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3873/7768] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:14 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:48:15.297168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3277a6dc-582e-44a5-8e97-bd78f1d1fbee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:15.297806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3277a6dc-582e-44a5-8e97-bd78f1d1fbee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:15.304660 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3277a6dc-582e-44a5-8e97-bd78f1d1fbee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:15.305170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3277a6dc-582e-44a5-8e97-bd78f1d1fbee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:15.305606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3277a6dc-582e-44a5-8e97-bd78f1d1fbee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:15.306292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3277a6dc-582e-44a5-8e97-bd78f1d1fbee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:15.306747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3277a6dc-582e-44a5-8e97-bd78f1d1fbee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:15.307174 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3277a6dc-582e-44a5-8e97-bd78f1d1fbee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:15.444395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3277a6dc-582e-44a5-8e97-bd78f1d1fbee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:15.452142 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3277a6dc-582e-44a5-8e97-bd78f1d1fbee tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1392 microversion: 2.1 time: 0.159031 Oct 24 11:48:15.452715 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3896/7769] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:15 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:48:16.359388 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-0479da2d-5b8c-4a17-9f3f-cf7ca1c9036b req-99c0dfcd-8d2c-4549-a3be-24941431f3ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a39b875f-c9b6-4b89-aea7-64baad2d83b2", "name": "network-vif-plugged", "status": "completed", "tag": "2634c321-f62a-4b4f-a684-c969711243c8"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:48:16.370279 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0479da2d-5b8c-4a17-9f3f-cf7ca1c9036b req-99c0dfcd-8d2c-4549-a3be-24941431f3ff service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:16.370929 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0479da2d-5b8c-4a17-9f3f-cf7ca1c9036b req-99c0dfcd-8d2c-4549-a3be-24941431f3ff service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:16.371356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-0479da2d-5b8c-4a17-9f3f-cf7ca1c9036b req-99c0dfcd-8d2c-4549-a3be-24941431f3ff service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:16.382645 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-0479da2d-5b8c-4a17-9f3f-cf7ca1c9036b req-99c0dfcd-8d2c-4549-a3be-24941431f3ff service nova] Creating event network-vif-plugged:2634c321-f62a-4b4f-a684-c969711243c8 for instance a39b875f-c9b6-4b89-aea7-64baad2d83b2 on n-h2-858383-15 Oct 24 11:48:16.388086 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-0479da2d-5b8c-4a17-9f3f-cf7ca1c9036b req-99c0dfcd-8d2c-4549-a3be-24941431f3ff service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032446 Oct 24 11:48:16.388844 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3874/7770] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:48:16.475832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-79d09a27-9e23-4460-8205-482813f800c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:16.476377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-79d09a27-9e23-4460-8205-482813f800c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:16.483482 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79d09a27-9e23-4460-8205-482813f800c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:16.483971 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79d09a27-9e23-4460-8205-482813f800c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:16.484411 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79d09a27-9e23-4460-8205-482813f800c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:16.485139 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79d09a27-9e23-4460-8205-482813f800c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:16.485600 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79d09a27-9e23-4460-8205-482813f800c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:16.486029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79d09a27-9e23-4460-8205-482813f800c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:16.617241 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-79d09a27-9e23-4460-8205-482813f800c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:16.625452 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-79d09a27-9e23-4460-8205-482813f800c8 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1392 microversion: 2.1 time: 0.154072 Oct 24 11:48:16.626026 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3897/7771] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:16 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:48:17.653013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e8790a85-e3ab-42fa-a564-2670cb78a711 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:17.653742 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e8790a85-e3ab-42fa-a564-2670cb78a711 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:17.660164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8790a85-e3ab-42fa-a564-2670cb78a711 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:17.660669 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8790a85-e3ab-42fa-a564-2670cb78a711 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:17.661156 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8790a85-e3ab-42fa-a564-2670cb78a711 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:17.661881 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8790a85-e3ab-42fa-a564-2670cb78a711 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:17.662348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8790a85-e3ab-42fa-a564-2670cb78a711 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:17.662791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e8790a85-e3ab-42fa-a564-2670cb78a711 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:17.805099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e8790a85-e3ab-42fa-a564-2670cb78a711 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:17.813188 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e8790a85-e3ab-42fa-a564-2670cb78a711 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1564 microversion: 2.1 time: 0.166161 Oct 24 11:48:17.813766 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3875/7772] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:17 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:48:17.836022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-261375ad-2d5d-44bf-96e7-31a12954ff48 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:17.836644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-261375ad-2d5d-44bf-96e7-31a12954ff48 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:17.840111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:48:17.845579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-261375ad-2d5d-44bf-96e7-31a12954ff48 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:17.846006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-261375ad-2d5d-44bf-96e7-31a12954ff48 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:17.846456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-261375ad-2d5d-44bf-96e7-31a12954ff48 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:17.847157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-261375ad-2d5d-44bf-96e7-31a12954ff48 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:17.847617 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-261375ad-2d5d-44bf-96e7-31a12954ff48 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:17.848051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-261375ad-2d5d-44bf-96e7-31a12954ff48 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:17.935723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:48:17.957936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:48:17.983881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-261375ad-2d5d-44bf-96e7-31a12954ff48 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:17.991464 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-261375ad-2d5d-44bf-96e7-31a12954ff48 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1564 microversion: 2.1 time: 0.159380 Oct 24 11:48:17.992040 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3898/7773] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:17 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:48:19.938161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1ca6c389-e6ad-4e9a-a2f4-31b0d20a0c7c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:19.939085 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1ca6c389-e6ad-4e9a-a2f4-31b0d20a0c7c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:19.940344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-6d1a63d3-956a-4da0-b8be-0968b697ee33 req-2ae291ef-c617-4f23-ab93-c3c85d419381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a39b875f-c9b6-4b89-aea7-64baad2d83b2", "tag": "2634c321-f62a-4b4f-a684-c969711243c8"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:48:19.942349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:48:19.947711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ca6c389-e6ad-4e9a-a2f4-31b0d20a0c7c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:19.948299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ca6c389-e6ad-4e9a-a2f4-31b0d20a0c7c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:19.949198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ca6c389-e6ad-4e9a-a2f4-31b0d20a0c7c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:19.949955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ca6c389-e6ad-4e9a-a2f4-31b0d20a0c7c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:19.950429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ca6c389-e6ad-4e9a-a2f4-31b0d20a0c7c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:19.951160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1ca6c389-e6ad-4e9a-a2f4-31b0d20a0c7c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:19.952633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6d1a63d3-956a-4da0-b8be-0968b697ee33 req-2ae291ef-c617-4f23-ab93-c3c85d419381 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:19.953144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6d1a63d3-956a-4da0-b8be-0968b697ee33 req-2ae291ef-c617-4f23-ab93-c3c85d419381 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:19.953581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-6d1a63d3-956a-4da0-b8be-0968b697ee33 req-2ae291ef-c617-4f23-ab93-c3c85d419381 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:19.966562 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-6d1a63d3-956a-4da0-b8be-0968b697ee33 req-2ae291ef-c617-4f23-ab93-c3c85d419381 service nova] Creating event network-changed:2634c321-f62a-4b4f-a684-c969711243c8 for instance a39b875f-c9b6-4b89-aea7-64baad2d83b2 on n-h2-858383-15 Oct 24 11:48:19.971820 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-6d1a63d3-956a-4da0-b8be-0968b697ee33 req-2ae291ef-c617-4f23-ab93-c3c85d419381 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035742 Oct 24 11:48:19.972721 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3899/7774] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:48:20.098810 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1ca6c389-e6ad-4e9a-a2f4-31b0d20a0c7c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:20.107842 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1ca6c389-e6ad-4e9a-a2f4-31b0d20a0c7c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1564 microversion: 2.1 time: 0.173856 Oct 24 11:48:20.108827 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3876/7775] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:19 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1564 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:48:43.360919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:48:43.361666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=36 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:48:43.413413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e028044b-ec7d-4a38-b553-cb05ff9f60ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:48:43.415831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e028044b-ec7d-4a38-b553-cb05ff9f60ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:43.422987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e028044b-ec7d-4a38-b553-cb05ff9f60ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:43.423474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e028044b-ec7d-4a38-b553-cb05ff9f60ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:43.423916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e028044b-ec7d-4a38-b553-cb05ff9f60ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:43.424615 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e028044b-ec7d-4a38-b553-cb05ff9f60ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:43.425102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e028044b-ec7d-4a38-b553-cb05ff9f60ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:43.425535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e028044b-ec7d-4a38-b553-cb05ff9f60ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:43.495600 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e028044b-ec7d-4a38-b553-cb05ff9f60ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2/action" status: 200 len: 24575 microversion: 2.1 time: 0.136864 Oct 24 11:48:43.496248 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3900/7776] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:48:43 2022] POST /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2/action => generated 24575 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 11:48:49.843511 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a7474679-8362-43c5-b627-b145ec22f4e5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:48:49.845510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:48:49.846358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=32 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:48:49.852916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7474679-8362-43c5-b627-b145ec22f4e5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:49.853422 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7474679-8362-43c5-b627-b145ec22f4e5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:49.853883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a7474679-8362-43c5-b627-b145ec22f4e5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:49.878482 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a7474679-8362-43c5-b627-b145ec22f4e5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Going to try to stop instance {{(pid=120425) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 11:48:49.920250 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a7474679-8362-43c5-b627-b145ec22f4e5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2/action" status: 202 len: 0 microversion: 2.1 time: 0.081262 Oct 24 11:48:49.920873 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3877/7777] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:48:49 2022] POST /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:48:49.930040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b9faf5f4-9baf-497b-ae15-e18466861817 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:49.930750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b9faf5f4-9baf-497b-ae15-e18466861817 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:49.940071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b9faf5f4-9baf-497b-ae15-e18466861817 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:49.940562 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b9faf5f4-9baf-497b-ae15-e18466861817 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:49.941225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b9faf5f4-9baf-497b-ae15-e18466861817 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:49.941940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b9faf5f4-9baf-497b-ae15-e18466861817 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:49.942406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b9faf5f4-9baf-497b-ae15-e18466861817 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:49.942835 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b9faf5f4-9baf-497b-ae15-e18466861817 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:50.081710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b9faf5f4-9baf-497b-ae15-e18466861817 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:50.089958 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b9faf5f4-9baf-497b-ae15-e18466861817 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1692 microversion: 2.1 time: 0.163811 Oct 24 11:48:50.090566 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3901/7778] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:49 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:48:51.117082 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-93a78db9-2560-4c8f-ae6e-d3f1cb0ffa96 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:51.117713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-93a78db9-2560-4c8f-ae6e-d3f1cb0ffa96 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:51.124714 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93a78db9-2560-4c8f-ae6e-d3f1cb0ffa96 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:51.125250 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93a78db9-2560-4c8f-ae6e-d3f1cb0ffa96 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:51.125704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93a78db9-2560-4c8f-ae6e-d3f1cb0ffa96 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:51.126418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93a78db9-2560-4c8f-ae6e-d3f1cb0ffa96 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:51.126888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93a78db9-2560-4c8f-ae6e-d3f1cb0ffa96 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:51.127330 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-93a78db9-2560-4c8f-ae6e-d3f1cb0ffa96 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:51.265473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-93a78db9-2560-4c8f-ae6e-d3f1cb0ffa96 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:51.273225 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-93a78db9-2560-4c8f-ae6e-d3f1cb0ffa96 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1692 microversion: 2.1 time: 0.161387 Oct 24 11:48:51.273800 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3878/7779] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:51 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:48:52.297246 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b6fa4c78-7048-467c-b14e-bd3a0e0393c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:52.297895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b6fa4c78-7048-467c-b14e-bd3a0e0393c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:52.304751 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6fa4c78-7048-467c-b14e-bd3a0e0393c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:52.305257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6fa4c78-7048-467c-b14e-bd3a0e0393c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:52.305692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6fa4c78-7048-467c-b14e-bd3a0e0393c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:52.306381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6fa4c78-7048-467c-b14e-bd3a0e0393c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:52.306832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6fa4c78-7048-467c-b14e-bd3a0e0393c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:52.307255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b6fa4c78-7048-467c-b14e-bd3a0e0393c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:52.438196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b6fa4c78-7048-467c-b14e-bd3a0e0393c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:52.446098 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b6fa4c78-7048-467c-b14e-bd3a0e0393c9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1692 microversion: 2.1 time: 0.152939 Oct 24 11:48:52.446683 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3902/7780] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:52 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:48:53.470241 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9e5ffc6a-7e3b-444f-ac03-4437258159d3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:53.470872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9e5ffc6a-7e3b-444f-ac03-4437258159d3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:53.477872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e5ffc6a-7e3b-444f-ac03-4437258159d3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:53.478368 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e5ffc6a-7e3b-444f-ac03-4437258159d3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:53.478821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e5ffc6a-7e3b-444f-ac03-4437258159d3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:53.479526 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e5ffc6a-7e3b-444f-ac03-4437258159d3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:53.480591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e5ffc6a-7e3b-444f-ac03-4437258159d3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:53.481076 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9e5ffc6a-7e3b-444f-ac03-4437258159d3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:53.616412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9e5ffc6a-7e3b-444f-ac03-4437258159d3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:53.624287 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9e5ffc6a-7e3b-444f-ac03-4437258159d3 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1692 microversion: 2.1 time: 0.157932 Oct 24 11:48:53.624880 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3879/7781] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:53 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:48:54.648463 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-47361c44-e5d0-47e0-af8f-45e11352b347 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:54.649114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-47361c44-e5d0-47e0-af8f-45e11352b347 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:54.656412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47361c44-e5d0-47e0-af8f-45e11352b347 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:54.656929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47361c44-e5d0-47e0-af8f-45e11352b347 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:54.657624 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47361c44-e5d0-47e0-af8f-45e11352b347 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:54.658335 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47361c44-e5d0-47e0-af8f-45e11352b347 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:54.658908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47361c44-e5d0-47e0-af8f-45e11352b347 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:54.659215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-47361c44-e5d0-47e0-af8f-45e11352b347 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:54.797211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-47361c44-e5d0-47e0-af8f-45e11352b347 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:54.805003 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-47361c44-e5d0-47e0-af8f-45e11352b347 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1692 microversion: 2.1 time: 0.160518 Oct 24 11:48:54.805579 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3903/7782] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:54 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:48:55.829708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-26c9ac4a-0c3b-4794-9c91-3c33a77adfd0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:55.830344 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-26c9ac4a-0c3b-4794-9c91-3c33a77adfd0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:55.837306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26c9ac4a-0c3b-4794-9c91-3c33a77adfd0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:55.837809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26c9ac4a-0c3b-4794-9c91-3c33a77adfd0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:55.838273 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26c9ac4a-0c3b-4794-9c91-3c33a77adfd0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:55.838993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26c9ac4a-0c3b-4794-9c91-3c33a77adfd0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:55.840428 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26c9ac4a-0c3b-4794-9c91-3c33a77adfd0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:55.840989 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-26c9ac4a-0c3b-4794-9c91-3c33a77adfd0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:55.972029 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-26c9ac4a-0c3b-4794-9c91-3c33a77adfd0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:55.979854 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-26c9ac4a-0c3b-4794-9c91-3c33a77adfd0 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1692 microversion: 2.1 time: 0.154110 Oct 24 11:48:55.980805 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3880/7783] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:55 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:48:57.004023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d305d6f9-229b-44ff-a859-b10079f660c7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:57.004646 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d305d6f9-229b-44ff-a859-b10079f660c7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:57.011393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d305d6f9-229b-44ff-a859-b10079f660c7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:57.012044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d305d6f9-229b-44ff-a859-b10079f660c7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:57.012490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d305d6f9-229b-44ff-a859-b10079f660c7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:57.013236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d305d6f9-229b-44ff-a859-b10079f660c7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:57.013698 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d305d6f9-229b-44ff-a859-b10079f660c7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:57.014135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d305d6f9-229b-44ff-a859-b10079f660c7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:57.153829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d305d6f9-229b-44ff-a859-b10079f660c7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:57.162019 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d305d6f9-229b-44ff-a859-b10079f660c7 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1692 microversion: 2.1 time: 0.162391 Oct 24 11:48:57.162631 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3904/7784] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:56 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:48:58.187125 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-79b79208-830e-4d1b-8762-285e96abb7de tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:58.187751 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-79b79208-830e-4d1b-8762-285e96abb7de tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:58.194564 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79b79208-830e-4d1b-8762-285e96abb7de tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:58.195059 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79b79208-830e-4d1b-8762-285e96abb7de tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:58.195512 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79b79208-830e-4d1b-8762-285e96abb7de tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:58.196215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79b79208-830e-4d1b-8762-285e96abb7de tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:58.196693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79b79208-830e-4d1b-8762-285e96abb7de tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:58.197162 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-79b79208-830e-4d1b-8762-285e96abb7de tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:58.330472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-79b79208-830e-4d1b-8762-285e96abb7de tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:58.338113 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-79b79208-830e-4d1b-8762-285e96abb7de tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1692 microversion: 2.1 time: 0.155761 Oct 24 11:48:58.338676 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3881/7785] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:58 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:48:59.363541 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e913a01-de34-4aa0-a074-e23acfde593f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:48:59.364191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1e913a01-de34-4aa0-a074-e23acfde593f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:48:59.371629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e913a01-de34-4aa0-a074-e23acfde593f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:59.372114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e913a01-de34-4aa0-a074-e23acfde593f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:59.372554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e913a01-de34-4aa0-a074-e23acfde593f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:59.373280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e913a01-de34-4aa0-a074-e23acfde593f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:48:59.373744 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e913a01-de34-4aa0-a074-e23acfde593f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:48:59.374170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e913a01-de34-4aa0-a074-e23acfde593f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:48:59.512565 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1e913a01-de34-4aa0-a074-e23acfde593f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:48:59.520343 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1e913a01-de34-4aa0-a074-e23acfde593f tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1692 microversion: 2.1 time: 0.160719 Oct 24 11:48:59.520933 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3905/7786] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:48:59 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:49:00.544163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-281466b0-26c4-4db5-9edb-10365d567b5a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:00.544719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-281466b0-26c4-4db5-9edb-10365d567b5a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:00.551752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-281466b0-26c4-4db5-9edb-10365d567b5a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:00.552261 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-281466b0-26c4-4db5-9edb-10365d567b5a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:00.552725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-281466b0-26c4-4db5-9edb-10365d567b5a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:00.553563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-281466b0-26c4-4db5-9edb-10365d567b5a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:00.554048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-281466b0-26c4-4db5-9edb-10365d567b5a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:00.554500 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-281466b0-26c4-4db5-9edb-10365d567b5a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:00.687547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-281466b0-26c4-4db5-9edb-10365d567b5a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:49:00.695321 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-281466b0-26c4-4db5-9edb-10365d567b5a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1669 microversion: 2.1 time: 0.155741 Oct 24 11:49:00.695904 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3882/7787] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:49:00 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:49:01.791603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-6551084f-6408-4b3d-98d8-a1cef60d9cfc tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:49:01.794733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-6551084f-6408-4b3d-98d8-a1cef60d9cfc tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:01.801585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6551084f-6408-4b3d-98d8-a1cef60d9cfc tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:01.802067 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6551084f-6408-4b3d-98d8-a1cef60d9cfc tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:01.802504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6551084f-6408-4b3d-98d8-a1cef60d9cfc tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:01.803193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6551084f-6408-4b3d-98d8-a1cef60d9cfc tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:01.803642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6551084f-6408-4b3d-98d8-a1cef60d9cfc tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:01.804066 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-6551084f-6408-4b3d-98d8-a1cef60d9cfc tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:01.869660 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-6551084f-6408-4b3d-98d8-a1cef60d9cfc tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2/action" status: 200 len: 35255 microversion: 2.1 time: 0.081800 Oct 24 11:49:01.870402 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3906/7788] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:49:01 2022] POST /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2/action => generated 35255 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 11:49:01.882879 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f7f8f7db-1f9c-45c7-b301-552ec80d09c5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:49:01.890118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7f8f7db-1f9c-45c7-b301-552ec80d09c5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:01.890624 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7f8f7db-1f9c-45c7-b301-552ec80d09c5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:01.891080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f7f8f7db-1f9c-45c7-b301-552ec80d09c5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:01.913373 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f7f8f7db-1f9c-45c7-b301-552ec80d09c5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Going to try to start instance {{(pid=120425) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 11:49:01.956331 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f7f8f7db-1f9c-45c7-b301-552ec80d09c5 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2/action" status: 202 len: 0 microversion: 2.1 time: 0.077181 Oct 24 11:49:01.956940 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3883/7789] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:49:01 2022] POST /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:49:01.966161 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bca67588-13a8-4b1d-8ca8-6159fa021d31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:01.966872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bca67588-13a8-4b1d-8ca8-6159fa021d31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:01.974301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bca67588-13a8-4b1d-8ca8-6159fa021d31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:01.974850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bca67588-13a8-4b1d-8ca8-6159fa021d31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:01.975291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bca67588-13a8-4b1d-8ca8-6159fa021d31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:01.976320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bca67588-13a8-4b1d-8ca8-6159fa021d31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:01.976785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bca67588-13a8-4b1d-8ca8-6159fa021d31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:01.977313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bca67588-13a8-4b1d-8ca8-6159fa021d31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:02.120588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bca67588-13a8-4b1d-8ca8-6159fa021d31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:49:02.131215 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bca67588-13a8-4b1d-8ca8-6159fa021d31 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1678 microversion: 2.1 time: 0.169238 Oct 24 11:49:02.131811 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3907/7790] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:49:01 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:49:03.156409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ccbc50eb-b765-422c-bf5a-3de17c95709a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:03.157165 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ccbc50eb-b765-422c-bf5a-3de17c95709a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:03.164547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccbc50eb-b765-422c-bf5a-3de17c95709a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:03.165087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccbc50eb-b765-422c-bf5a-3de17c95709a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:03.165539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccbc50eb-b765-422c-bf5a-3de17c95709a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:03.166256 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccbc50eb-b765-422c-bf5a-3de17c95709a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:03.166724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccbc50eb-b765-422c-bf5a-3de17c95709a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:03.167263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ccbc50eb-b765-422c-bf5a-3de17c95709a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:03.303528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ccbc50eb-b765-422c-bf5a-3de17c95709a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:49:03.312082 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ccbc50eb-b765-422c-bf5a-3de17c95709a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1682 microversion: 2.1 time: 0.160004 Oct 24 11:49:03.312671 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3884/7791] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:49:03 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:49:27.505543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-35c4962b-7504-40c3-80a4-8b4770ec7183 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:49:27.507757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-35c4962b-7504-40c3-80a4-8b4770ec7183 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:27.510625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=16 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:49:27.511282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=44 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:49:27.517583 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35c4962b-7504-40c3-80a4-8b4770ec7183 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:27.518114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35c4962b-7504-40c3-80a4-8b4770ec7183 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:27.518557 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35c4962b-7504-40c3-80a4-8b4770ec7183 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:27.519268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35c4962b-7504-40c3-80a4-8b4770ec7183 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:27.519723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35c4962b-7504-40c3-80a4-8b4770ec7183 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:27.520148 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35c4962b-7504-40c3-80a4-8b4770ec7183 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:27.590317 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-35c4962b-7504-40c3-80a4-8b4770ec7183 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2/action" status: 200 len: 59812 microversion: 2.1 time: 0.088501 Oct 24 11:49:27.591013 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3908/7792] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:49:27 2022] POST /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2/action => generated 59812 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 11:49:34.610938 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-887c3dc3-068f-4a37-8825-56cc366a17d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:34.611547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-887c3dc3-068f-4a37-8825-56cc366a17d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:34.613940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=16 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:49:34.614824 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:49:34.622160 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-887c3dc3-068f-4a37-8825-56cc366a17d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:34.622801 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-887c3dc3-068f-4a37-8825-56cc366a17d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:34.623326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-887c3dc3-068f-4a37-8825-56cc366a17d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:34.624115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-887c3dc3-068f-4a37-8825-56cc366a17d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:34.624820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-887c3dc3-068f-4a37-8825-56cc366a17d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:34.625395 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-887c3dc3-068f-4a37-8825-56cc366a17d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:34.656797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-887c3dc3-068f-4a37-8825-56cc366a17d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:49:34.673079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-97d473ef-eb6c-4414-815a-a7e4b6ddd37c req-24570dc3-0027-40b5-aa6f-cdb5e4fee45e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a39b875f-c9b6-4b89-aea7-64baad2d83b2", "tag": "2634c321-f62a-4b4f-a684-c969711243c8"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:49:34.686040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-97d473ef-eb6c-4414-815a-a7e4b6ddd37c req-24570dc3-0027-40b5-aa6f-cdb5e4fee45e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:34.686526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-97d473ef-eb6c-4414-815a-a7e4b6ddd37c req-24570dc3-0027-40b5-aa6f-cdb5e4fee45e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:34.687128 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-97d473ef-eb6c-4414-815a-a7e4b6ddd37c req-24570dc3-0027-40b5-aa6f-cdb5e4fee45e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:34.698185 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-97d473ef-eb6c-4414-815a-a7e4b6ddd37c req-24570dc3-0027-40b5-aa6f-cdb5e4fee45e service nova] Creating event network-changed:2634c321-f62a-4b4f-a684-c969711243c8 for instance a39b875f-c9b6-4b89-aea7-64baad2d83b2 on n-h2-858383-15 Oct 24 11:49:34.703889 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-97d473ef-eb6c-4414-815a-a7e4b6ddd37c req-24570dc3-0027-40b5-aa6f-cdb5e4fee45e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094244 Oct 24 11:49:34.707679 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3909/7793] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:49:34.742218 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-887c3dc3-068f-4a37-8825-56cc366a17d1 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 204 len: 0 microversion: 2.1 time: 0.135387 Oct 24 11:49:34.743208 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3885/7794] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:49:34 2022] DELETE /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:49:34.753099 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ccba9856-95f8-4b6f-8f75-f619eb8efbf2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:34.755111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ccba9856-95f8-4b6f-8f75-f619eb8efbf2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:34.762008 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ccba9856-95f8-4b6f-8f75-f619eb8efbf2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:34.762697 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ccba9856-95f8-4b6f-8f75-f619eb8efbf2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:34.763344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ccba9856-95f8-4b6f-8f75-f619eb8efbf2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:34.764566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ccba9856-95f8-4b6f-8f75-f619eb8efbf2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:34.765068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ccba9856-95f8-4b6f-8f75-f619eb8efbf2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:34.765596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ccba9856-95f8-4b6f-8f75-f619eb8efbf2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:34.921070 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ccba9856-95f8-4b6f-8f75-f619eb8efbf2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:49:34.928956 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ccba9856-95f8-4b6f-8f75-f619eb8efbf2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1688 microversion: 2.1 time: 0.180573 Oct 24 11:49:34.929567 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3910/7795] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:49:34 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:49:35.954956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-608bb635-4238-48cf-8fe3-725d6b493342 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:35.955683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-608bb635-4238-48cf-8fe3-725d6b493342 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:35.962790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-608bb635-4238-48cf-8fe3-725d6b493342 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:35.963285 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-608bb635-4238-48cf-8fe3-725d6b493342 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:35.963743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-608bb635-4238-48cf-8fe3-725d6b493342 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:35.964453 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-608bb635-4238-48cf-8fe3-725d6b493342 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:35.964962 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-608bb635-4238-48cf-8fe3-725d6b493342 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:35.965412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-608bb635-4238-48cf-8fe3-725d6b493342 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:36.104593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-608bb635-4238-48cf-8fe3-725d6b493342 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:49:36.112983 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-608bb635-4238-48cf-8fe3-725d6b493342 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1688 microversion: 2.1 time: 0.162482 Oct 24 11:49:36.113637 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3886/7796] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:49:35 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:49:37.036346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-64cdfd51-4c9c-48d7-a66f-5bcfb65c6feb req-aaab897a-923a-4d1e-804e-08e9f2b7e120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a39b875f-c9b6-4b89-aea7-64baad2d83b2", "name": "network-vif-deleted", "tag": "2634c321-f62a-4b4f-a684-c969711243c8"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:49:37.047427 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-64cdfd51-4c9c-48d7-a66f-5bcfb65c6feb req-aaab897a-923a-4d1e-804e-08e9f2b7e120 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:37.047911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-64cdfd51-4c9c-48d7-a66f-5bcfb65c6feb req-aaab897a-923a-4d1e-804e-08e9f2b7e120 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:37.048347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-64cdfd51-4c9c-48d7-a66f-5bcfb65c6feb req-aaab897a-923a-4d1e-804e-08e9f2b7e120 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:37.059749 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-64cdfd51-4c9c-48d7-a66f-5bcfb65c6feb req-aaab897a-923a-4d1e-804e-08e9f2b7e120 service nova] Creating event network-vif-deleted:2634c321-f62a-4b4f-a684-c969711243c8 for instance a39b875f-c9b6-4b89-aea7-64baad2d83b2 on n-h2-858383-15 Oct 24 11:49:37.065486 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-64cdfd51-4c9c-48d7-a66f-5bcfb65c6feb req-aaab897a-923a-4d1e-804e-08e9f2b7e120 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033129 Oct 24 11:49:37.066098 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3911/7797] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:49:37.138668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-682efa55-c04b-45e3-ad68-c4688a744842 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:37.139385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-682efa55-c04b-45e3-ad68-c4688a744842 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:37.146593 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-682efa55-c04b-45e3-ad68-c4688a744842 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:37.147124 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-682efa55-c04b-45e3-ad68-c4688a744842 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:37.147578 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-682efa55-c04b-45e3-ad68-c4688a744842 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:37.148346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-682efa55-c04b-45e3-ad68-c4688a744842 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:37.148825 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-682efa55-c04b-45e3-ad68-c4688a744842 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:37.149290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-682efa55-c04b-45e3-ad68-c4688a744842 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:37.181595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-682efa55-c04b-45e3-ad68-c4688a744842 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:37.182152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-682efa55-c04b-45e3-ad68-c4688a744842 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:37.182551 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-682efa55-c04b-45e3-ad68-c4688a744842 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:37.183008 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-682efa55-c04b-45e3-ad68-c4688a744842 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lazy-loading 'fault' on Instance uuid a39b875f-c9b6-4b89-aea7-64baad2d83b2 {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:49:37.230883 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-682efa55-c04b-45e3-ad68-c4688a744842 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:49:37.239553 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-682efa55-c04b-45e3-ad68-c4688a744842 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 200 len: 1356 microversion: 2.1 time: 0.106101 Oct 24 11:49:37.240143 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3887/7798] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:49:37 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:49:38.266262 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e9188221-baf8-4e59-8fbb-7c9da15d5663 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:38.266966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e9188221-baf8-4e59-8fbb-7c9da15d5663 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: a39b875f-c9b6-4b89-aea7-64baad2d83b2] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:38.273189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9188221-baf8-4e59-8fbb-7c9da15d5663 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:38.273675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9188221-baf8-4e59-8fbb-7c9da15d5663 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:38.274115 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9188221-baf8-4e59-8fbb-7c9da15d5663 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:38.274806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9188221-baf8-4e59-8fbb-7c9da15d5663 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:38.275263 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9188221-baf8-4e59-8fbb-7c9da15d5663 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:38.275694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e9188221-baf8-4e59-8fbb-7c9da15d5663 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:38.289469 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-e9188221-baf8-4e59-8fbb-7c9da15d5663 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] HTTP exception thrown: Instance a39b875f-c9b6-4b89-aea7-64baad2d83b2 could not be found. Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e9188221-baf8-4e59-8fbb-7c9da15d5663 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Request method failure captured: Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 HTTP/1.1 Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnpaKq5eMD1wOzd3b0sKYUgl2bjacFpSj-y3-0VcKu80EQNHdJhpBnba-f7gM6-ByY9XlAsOphxypaSEGoSP8rdUWPJNC3Qgb060RgWUaFdfTWVPikTJMe6jnvvdIHjl1TPy-V0Mj-4jPkEyPtgT5wAyFasuOciBHUhQoLY-cRXaZzk Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: f84eda4103cf4f2b8c362d83d5394c69 Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1428233327 Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f84eda4103cf4f2b8c362d83d5394c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f84eda4103cf4f2b8c362d83d5394c69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f84eda4103cf4f2b8c362d83d5394c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f84eda4103cf4f2b8c362d83d5394c69", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1428233327 Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: f84eda4103cf4f2b8c362d83d5394c69 Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1428233327 Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestNetworkAdvancedServerOps-1428233327-project Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: f80525ed5fa842e18c9ec15fe2cd4053 Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1428233327-project Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance a39b875f-c9b6-4b89-aea7-64baad2d83b2 could not be found. Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'a39b875f-c9b6-4b89-aea7-64baad2d83b2'} Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a39b875f-c9b6-4b89-aea7-64baad2d83b2 could not be found. Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a39b875f-c9b6-4b89-aea7-64baad2d83b2 could not be found. Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:49:38.291083 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:49:38.296597 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:49:38.296597 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:49:38.296597 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:49:38.296597 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:49:38.296597 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:49:38.296597 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:49:38.296597 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a39b875f-c9b6-4b89-aea7-64baad2d83b2 could not be found. Oct 24 11:49:38.296597 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:49:38.296597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e9188221-baf8-4e59-8fbb-7c9da15d5663 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Returning 404 to user: Instance a39b875f-c9b6-4b89-aea7-64baad2d83b2 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:49:38.296597 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e9188221-baf8-4e59-8fbb-7c9da15d5663 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2" status: 404 len: 111 microversion: 2.1 time: 0.032591 Oct 24 11:49:38.296597 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3912/7799] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:49:38 2022] GET /compute/v2.1/servers/a39b875f-c9b6-4b89-aea7-64baad2d83b2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:49:41.706429 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-749eb8d7-98b8-4230-8464-a1d0da3a5506 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '.version_select at 0x7f04d0a02820>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:41.727967 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-749eb8d7-98b8-4230-8464-a1d0da3a5506 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1155803120" status: 202 len: 0 microversion: 2.1 time: 0.025437 Oct 24 11:49:41.728567 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3888/7800] 10.222.0.50 () {58 vars in 1284 bytes} [Mon Oct 24 11:49:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1155803120 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:49:41.759902 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-09520e63-62aa-495d-962a-334e3055732a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'create', calling method: .version_select at 0x7f04d09705e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1556931832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSCOXiUTSOkZBdtIA5ZjfiLV6sWOfnLhJuyP419lVbXiI6o1eAO9oTZus9JcGOJiUXF/n56vIlXdnYHUbtzbcMbP7nIaMs+m/IP+4bhYYEo5/GJn5JHgCCtKl0nVCNIjA=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:49:41.777493 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-09520e63-62aa-495d-962a-334e3055732a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:49:41.783933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-09520e63-62aa-495d-962a-334e3055732a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for user f80525ed5fa842e18c9ec15fe2cd4053 and project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:49:41.807338 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-09520e63-62aa-495d-962a-334e3055732a tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051478 Oct 24 11:49:41.807973 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3913/7801] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:49:41 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:49:47.327694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c49f5a5f-64d2-47cb-a975-691cae42067b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1803462877", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "networks": [{"uuid": "c1615278-9a97-42bb-82f1-f52f09e8b8c2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1556931832", "security_groups": [{"name": "tempest-secgroup-smoke-1793660932"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:49:47.343045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:49:47.764158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-c49f5a5f-64d2-47cb-a975-691cae42067b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] validate_networks() for [('c1615278-9a97-42bb-82f1-f52f09e8b8c2', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:49:48.034690 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:49:48.034938 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:49:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.50) !!! Oct 24 11:49:48.266027 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-c49f5a5f-64d2-47cb-a975-691cae42067b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:49:48.266469 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-c49f5a5f-64d2-47cb-a975-691cae42067b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:49:48.268020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-c49f5a5f-64d2-47cb-a975-691cae42067b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:49:48.268461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-c49f5a5f-64d2-47cb-a975-691cae42067b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:49:48.268972 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-c49f5a5f-64d2-47cb-a975-691cae42067b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:49:48.278458 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c49f5a5f-64d2-47cb-a975-691cae42067b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:48.279217 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c49f5a5f-64d2-47cb-a975-691cae42067b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:48.279684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c49f5a5f-64d2-47cb-a975-691cae42067b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:48.280450 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c49f5a5f-64d2-47cb-a975-691cae42067b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:48.280959 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c49f5a5f-64d2-47cb-a975-691cae42067b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:48.281412 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c49f5a5f-64d2-47cb-a975-691cae42067b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:48.302379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c49f5a5f-64d2-47cb-a975-691cae42067b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:49:48.308207 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-c49f5a5f-64d2-47cb-a975-691cae42067b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Getting quotas for user f80525ed5fa842e18c9ec15fe2cd4053 and project f84eda4103cf4f2b8c362d83d5394c69. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:49:48.325622 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c49f5a5f-64d2-47cb-a975-691cae42067b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:49:48.328028 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c49f5a5f-64d2-47cb-a975-691cae42067b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:49:48.378649 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c49f5a5f-64d2-47cb-a975-691cae42067b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.057125 Oct 24 11:49:48.382985 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3889/7802] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:49:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:49:48.393884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-04123af7-b63a-4cc5-b33d-d572b1c3966d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:48.393884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-04123af7-b63a-4cc5-b33d-d572b1c3966d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:48.396528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=16 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:49:48.523248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-04123af7-b63a-4cc5-b33d-d572b1c3966d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:49:48.531251 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-04123af7-b63a-4cc5-b33d-d572b1c3966d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1267 microversion: 2.1 time: 0.144244 Oct 24 11:49:48.531838 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3914/7803] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:49:48 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:49:49.558601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-eba4d7e2-3221-462d-841a-ed7d44072dc4 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:49.561210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-eba4d7e2-3221-462d-841a-ed7d44072dc4 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:49.569397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eba4d7e2-3221-462d-841a-ed7d44072dc4 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:49.570245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eba4d7e2-3221-462d-841a-ed7d44072dc4 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:49.571313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eba4d7e2-3221-462d-841a-ed7d44072dc4 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:49.572350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eba4d7e2-3221-462d-841a-ed7d44072dc4 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:49.573107 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eba4d7e2-3221-462d-841a-ed7d44072dc4 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:49.573773 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-eba4d7e2-3221-462d-841a-ed7d44072dc4 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:49.666788 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-eba4d7e2-3221-462d-841a-ed7d44072dc4 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:49:49.675462 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-eba4d7e2-3221-462d-841a-ed7d44072dc4 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1327 microversion: 2.1 time: 0.123791 Oct 24 11:49:49.676666 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3890/7804] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:49:49 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1327 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:49:50.702405 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7208376a-5874-47be-90f4-cabc25772463 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:50.703082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7208376a-5874-47be-90f4-cabc25772463 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:50.711354 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7208376a-5874-47be-90f4-cabc25772463 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:50.711968 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7208376a-5874-47be-90f4-cabc25772463 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:50.712522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7208376a-5874-47be-90f4-cabc25772463 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:50.713484 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7208376a-5874-47be-90f4-cabc25772463 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:50.714196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7208376a-5874-47be-90f4-cabc25772463 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:50.714716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7208376a-5874-47be-90f4-cabc25772463 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:50.876707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7208376a-5874-47be-90f4-cabc25772463 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:49:50.890052 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7208376a-5874-47be-90f4-cabc25772463 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1393 microversion: 2.1 time: 0.192180 Oct 24 11:49:50.901785 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3915/7805] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:49:50 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1393 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:49:51.073695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-4f8e4766-bd08-4f33-b230-a0781e713245 req-cddb6b72-bbff-4f8e-b5ed-b1922433db12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b195d644-3990-4293-bb07-c4ee6dd36027", "tag": "10f356b4-ffce-47a8-9677-f6d6f423d580"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:49:51.087610 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4f8e4766-bd08-4f33-b230-a0781e713245 req-cddb6b72-bbff-4f8e-b5ed-b1922433db12 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:51.089342 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4f8e4766-bd08-4f33-b230-a0781e713245 req-cddb6b72-bbff-4f8e-b5ed-b1922433db12 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:51.090079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4f8e4766-bd08-4f33-b230-a0781e713245 req-cddb6b72-bbff-4f8e-b5ed-b1922433db12 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:51.108346 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-4f8e4766-bd08-4f33-b230-a0781e713245 req-cddb6b72-bbff-4f8e-b5ed-b1922433db12 service nova] Creating event network-changed:10f356b4-ffce-47a8-9677-f6d6f423d580 for instance b195d644-3990-4293-bb07-c4ee6dd36027 on n-h2-858383-15 Oct 24 11:49:51.127504 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-4f8e4766-bd08-4f33-b230-a0781e713245 req-cddb6b72-bbff-4f8e-b5ed-b1922433db12 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059380 Oct 24 11:49:51.129544 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3891/7806] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:49:51.918271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-33d76266-07a0-4be7-890b-c77da3aaa5b2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:51.919426 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-33d76266-07a0-4be7-890b-c77da3aaa5b2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:51.926376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33d76266-07a0-4be7-890b-c77da3aaa5b2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:51.926862 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33d76266-07a0-4be7-890b-c77da3aaa5b2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:51.927301 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33d76266-07a0-4be7-890b-c77da3aaa5b2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:51.928004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33d76266-07a0-4be7-890b-c77da3aaa5b2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:51.928466 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33d76266-07a0-4be7-890b-c77da3aaa5b2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:51.928928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-33d76266-07a0-4be7-890b-c77da3aaa5b2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:52.070590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-33d76266-07a0-4be7-890b-c77da3aaa5b2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:49:52.078336 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-33d76266-07a0-4be7-890b-c77da3aaa5b2 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1393 microversion: 2.1 time: 0.164400 Oct 24 11:49:52.078937 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3916/7807] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:49:51 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:49:53.102468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cb1365fb-3330-4727-b65f-7eac63f12735 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:53.103222 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cb1365fb-3330-4727-b65f-7eac63f12735 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:53.109614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb1365fb-3330-4727-b65f-7eac63f12735 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:53.110060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb1365fb-3330-4727-b65f-7eac63f12735 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:53.110523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb1365fb-3330-4727-b65f-7eac63f12735 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:53.111238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb1365fb-3330-4727-b65f-7eac63f12735 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:53.111713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb1365fb-3330-4727-b65f-7eac63f12735 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:53.112189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cb1365fb-3330-4727-b65f-7eac63f12735 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:53.248767 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cb1365fb-3330-4727-b65f-7eac63f12735 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:49:53.256538 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cb1365fb-3330-4727-b65f-7eac63f12735 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1393 microversion: 2.1 time: 0.159315 Oct 24 11:49:53.257147 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3892/7808] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:49:53 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:49:54.280357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b197cd4d-9a62-400a-a81a-38259cf091ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:54.281027 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b197cd4d-9a62-400a-a81a-38259cf091ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:54.288109 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b197cd4d-9a62-400a-a81a-38259cf091ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:54.288592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b197cd4d-9a62-400a-a81a-38259cf091ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:54.289058 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b197cd4d-9a62-400a-a81a-38259cf091ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:54.289756 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b197cd4d-9a62-400a-a81a-38259cf091ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:54.290211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b197cd4d-9a62-400a-a81a-38259cf091ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:54.290641 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b197cd4d-9a62-400a-a81a-38259cf091ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:54.426635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b197cd4d-9a62-400a-a81a-38259cf091ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:49:54.435176 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b197cd4d-9a62-400a-a81a-38259cf091ab tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1393 microversion: 2.1 time: 0.158345 Oct 24 11:49:54.435769 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3917/7809] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:49:54 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:49:55.458317 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5b53c047-1c39-4393-8de4-d8075f69601b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:55.458970 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5b53c047-1c39-4393-8de4-d8075f69601b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:55.466225 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b53c047-1c39-4393-8de4-d8075f69601b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:55.466756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b53c047-1c39-4393-8de4-d8075f69601b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:55.467215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b53c047-1c39-4393-8de4-d8075f69601b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:55.467934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b53c047-1c39-4393-8de4-d8075f69601b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:55.468410 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b53c047-1c39-4393-8de4-d8075f69601b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:55.468912 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b53c047-1c39-4393-8de4-d8075f69601b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:55.605288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5b53c047-1c39-4393-8de4-d8075f69601b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:49:55.612941 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5b53c047-1c39-4393-8de4-d8075f69601b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1393 microversion: 2.1 time: 0.158713 Oct 24 11:49:55.613513 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3893/7810] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:49:55 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:49:56.635849 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9992d788-a033-4f61-abc2-85ffb39a4489 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:56.636524 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9992d788-a033-4f61-abc2-85ffb39a4489 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:56.644264 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9992d788-a033-4f61-abc2-85ffb39a4489 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:56.644970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9992d788-a033-4f61-abc2-85ffb39a4489 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:56.645368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9992d788-a033-4f61-abc2-85ffb39a4489 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:56.646196 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9992d788-a033-4f61-abc2-85ffb39a4489 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:56.646654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9992d788-a033-4f61-abc2-85ffb39a4489 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:56.647083 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9992d788-a033-4f61-abc2-85ffb39a4489 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:56.668752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-9de4a70e-7058-4755-ad09-222c5891f08c req-6aaeb7af-da1a-409a-abf2-251038ed37b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b195d644-3990-4293-bb07-c4ee6dd36027", "name": "network-vif-plugged", "status": "completed", "tag": "10f356b4-ffce-47a8-9677-f6d6f423d580"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:49:56.682537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9de4a70e-7058-4755-ad09-222c5891f08c req-6aaeb7af-da1a-409a-abf2-251038ed37b4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:56.683325 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9de4a70e-7058-4755-ad09-222c5891f08c req-6aaeb7af-da1a-409a-abf2-251038ed37b4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:56.684164 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9de4a70e-7058-4755-ad09-222c5891f08c req-6aaeb7af-da1a-409a-abf2-251038ed37b4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:56.696979 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-9de4a70e-7058-4755-ad09-222c5891f08c req-6aaeb7af-da1a-409a-abf2-251038ed37b4 service nova] Creating event network-vif-plugged:10f356b4-ffce-47a8-9677-f6d6f423d580 for instance b195d644-3990-4293-bb07-c4ee6dd36027 on n-h2-858383-15 Oct 24 11:49:56.704036 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-9de4a70e-7058-4755-ad09-222c5891f08c req-6aaeb7af-da1a-409a-abf2-251038ed37b4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039577 Oct 24 11:49:56.705302 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3894/7811] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:49:56.791191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9992d788-a033-4f61-abc2-85ffb39a4489 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:49:56.799166 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9992d788-a033-4f61-abc2-85ffb39a4489 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1393 microversion: 2.1 time: 0.167377 Oct 24 11:49:56.799819 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3918/7812] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:49:56 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:49:57.823675 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b90de7ef-c771-429b-ae99-3f7f3f28d82b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:57.824408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b90de7ef-c771-429b-ae99-3f7f3f28d82b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:57.832455 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b90de7ef-c771-429b-ae99-3f7f3f28d82b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:57.832996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b90de7ef-c771-429b-ae99-3f7f3f28d82b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:57.833462 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b90de7ef-c771-429b-ae99-3f7f3f28d82b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:57.834288 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b90de7ef-c771-429b-ae99-3f7f3f28d82b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:57.834664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b90de7ef-c771-429b-ae99-3f7f3f28d82b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:57.835200 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-b90de7ef-c771-429b-ae99-3f7f3f28d82b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:57.971862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b90de7ef-c771-429b-ae99-3f7f3f28d82b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:49:57.979767 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b90de7ef-c771-429b-ae99-3f7f3f28d82b tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1393 microversion: 2.1 time: 0.160529 Oct 24 11:49:57.980357 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3895/7813] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:49:57 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:49:59.003662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d5d8e921-b580-4de3-982e-d8760ee33499 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:59.004299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d5d8e921-b580-4de3-982e-d8760ee33499 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:59.007108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:49:59.007784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:49:59.014590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5d8e921-b580-4de3-982e-d8760ee33499 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:59.015068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5d8e921-b580-4de3-982e-d8760ee33499 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:59.015499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5d8e921-b580-4de3-982e-d8760ee33499 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:59.016193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5d8e921-b580-4de3-982e-d8760ee33499 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:59.016642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5d8e921-b580-4de3-982e-d8760ee33499 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:59.017098 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d5d8e921-b580-4de3-982e-d8760ee33499 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:59.154782 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d5d8e921-b580-4de3-982e-d8760ee33499 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:49:59.162719 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d5d8e921-b580-4de3-982e-d8760ee33499 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1565 microversion: 2.1 time: 0.163033 Oct 24 11:49:59.163290 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3919/7814] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:49:58 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:49:59.186021 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7bdc8d28-b3b5-412e-bbe3-e51219be519c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:49:59.186670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7bdc8d28-b3b5-412e-bbe3-e51219be519c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:49:59.188649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:49:59.189364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:49:59.196218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bdc8d28-b3b5-412e-bbe3-e51219be519c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:59.196725 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bdc8d28-b3b5-412e-bbe3-e51219be519c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:59.197212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bdc8d28-b3b5-412e-bbe3-e51219be519c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:59.197935 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bdc8d28-b3b5-412e-bbe3-e51219be519c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:49:59.198417 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bdc8d28-b3b5-412e-bbe3-e51219be519c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:49:59.198866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7bdc8d28-b3b5-412e-bbe3-e51219be519c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:49:59.331711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7bdc8d28-b3b5-412e-bbe3-e51219be519c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:49:59.339682 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7bdc8d28-b3b5-412e-bbe3-e51219be519c tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1565 microversion: 2.1 time: 0.158188 Oct 24 11:49:59.340491 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3896/7815] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:49:59 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:50:01.227321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4f01725d-5a9f-43ea-946a-889e874d7dc9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:50:01.228116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4f01725d-5a9f-43ea-946a-889e874d7dc9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:50:01.231826 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-6b0124b6-5834-4230-8252-5e735bf03d7f req-ccbbf80a-57bd-4625-bca4-5ed0b789edfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b195d644-3990-4293-bb07-c4ee6dd36027", "tag": "10f356b4-ffce-47a8-9677-f6d6f423d580"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:50:01.236344 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f01725d-5a9f-43ea-946a-889e874d7dc9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:01.236858 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f01725d-5a9f-43ea-946a-889e874d7dc9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:01.237327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f01725d-5a9f-43ea-946a-889e874d7dc9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:01.238260 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f01725d-5a9f-43ea-946a-889e874d7dc9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:01.238960 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f01725d-5a9f-43ea-946a-889e874d7dc9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:01.239401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4f01725d-5a9f-43ea-946a-889e874d7dc9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:01.244460 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6b0124b6-5834-4230-8252-5e735bf03d7f req-ccbbf80a-57bd-4625-bca4-5ed0b789edfc service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:01.244987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6b0124b6-5834-4230-8252-5e735bf03d7f req-ccbbf80a-57bd-4625-bca4-5ed0b789edfc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:01.245642 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-6b0124b6-5834-4230-8252-5e735bf03d7f req-ccbbf80a-57bd-4625-bca4-5ed0b789edfc service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:01.259692 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-6b0124b6-5834-4230-8252-5e735bf03d7f req-ccbbf80a-57bd-4625-bca4-5ed0b789edfc service nova] Creating event network-changed:10f356b4-ffce-47a8-9677-f6d6f423d580 for instance b195d644-3990-4293-bb07-c4ee6dd36027 on n-h2-858383-15 Oct 24 11:50:01.265676 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-6b0124b6-5834-4230-8252-5e735bf03d7f req-ccbbf80a-57bd-4625-bca4-5ed0b789edfc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038923 Oct 24 11:50:01.266933 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3897/7816] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:50:01.378696 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4f01725d-5a9f-43ea-946a-889e874d7dc9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:50:01.387465 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4f01725d-5a9f-43ea-946a-889e874d7dc9 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1565 microversion: 2.1 time: 0.163997 Oct 24 11:50:01.388059 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3920/7817] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:50:01 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:50:22.634472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:50:22.635231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=38 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:50:22.640172 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0b1badba-1217-4825-944f-a2ea12dab820 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:50:22.642473 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0b1badba-1217-4825-944f-a2ea12dab820 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:50:22.650269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b1badba-1217-4825-944f-a2ea12dab820 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:22.650765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b1badba-1217-4825-944f-a2ea12dab820 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:22.651215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b1badba-1217-4825-944f-a2ea12dab820 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:22.651956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b1badba-1217-4825-944f-a2ea12dab820 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:22.652425 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b1badba-1217-4825-944f-a2ea12dab820 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:22.652907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0b1badba-1217-4825-944f-a2ea12dab820 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:22.734073 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0b1badba-1217-4825-944f-a2ea12dab820 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027/action" status: 200 len: 24551 microversion: 2.1 time: 0.101422 Oct 24 11:50:22.734894 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3898/7818] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:50:22 2022] POST /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027/action => generated 24551 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 11:50:33.764388 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dd953830-18db-40bf-9adc-9d47c9487373 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:50:33.764989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dd953830-18db-40bf-9adc-9d47c9487373 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:50:33.766867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:50:33.767633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=36 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:50:33.773864 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd953830-18db-40bf-9adc-9d47c9487373 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:33.774351 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd953830-18db-40bf-9adc-9d47c9487373 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:33.774790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd953830-18db-40bf-9adc-9d47c9487373 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:33.775479 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd953830-18db-40bf-9adc-9d47c9487373 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:33.775928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd953830-18db-40bf-9adc-9d47c9487373 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:33.776581 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dd953830-18db-40bf-9adc-9d47c9487373 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:33.799723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-dd953830-18db-40bf-9adc-9d47c9487373 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lazy-loading 'flavor' on Instance uuid b195d644-3990-4293-bb07-c4ee6dd36027 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:50:33.868213 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dd953830-18db-40bf-9adc-9d47c9487373 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027/action" status: 202 len: 0 microversion: 2.1 time: 0.108485 Oct 24 11:50:33.869049 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3921/7819] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:50:33 2022] POST /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:50:33.879471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a8cf1cb5-9bb2-4bac-8667-6846a784a242 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:50:33.880306 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a8cf1cb5-9bb2-4bac-8667-6846a784a242 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:50:33.884513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:50:33.885296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:50:33.889842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8cf1cb5-9bb2-4bac-8667-6846a784a242 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:33.890348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8cf1cb5-9bb2-4bac-8667-6846a784a242 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:33.890799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8cf1cb5-9bb2-4bac-8667-6846a784a242 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:33.891524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8cf1cb5-9bb2-4bac-8667-6846a784a242 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:33.892009 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8cf1cb5-9bb2-4bac-8667-6846a784a242 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:33.892427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a8cf1cb5-9bb2-4bac-8667-6846a784a242 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:34.029362 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-a8cf1cb5-9bb2-4bac-8667-6846a784a242 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:50:34.037583 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a8cf1cb5-9bb2-4bac-8667-6846a784a242 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1692 microversion: 2.1 time: 0.162963 Oct 24 11:50:34.038161 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3899/7820] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:50:33 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:50:35.064704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e2c87af2-e0f9-4e34-8e98-d5c8c507a101 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:50:35.065441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e2c87af2-e0f9-4e34-8e98-d5c8c507a101 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:50:35.071654 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2c87af2-e0f9-4e34-8e98-d5c8c507a101 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:35.072137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2c87af2-e0f9-4e34-8e98-d5c8c507a101 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:35.072577 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2c87af2-e0f9-4e34-8e98-d5c8c507a101 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:35.073302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2c87af2-e0f9-4e34-8e98-d5c8c507a101 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:35.073759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2c87af2-e0f9-4e34-8e98-d5c8c507a101 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:35.074184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e2c87af2-e0f9-4e34-8e98-d5c8c507a101 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:35.206151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e2c87af2-e0f9-4e34-8e98-d5c8c507a101 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:50:35.213931 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e2c87af2-e0f9-4e34-8e98-d5c8c507a101 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1675 microversion: 2.1 time: 0.155043 Oct 24 11:50:35.214507 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3922/7821] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:50:35 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:50:36.310494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-efe1ad28-2c2b-413f-9b6a-29af5ddff325 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:50:36.312720 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-efe1ad28-2c2b-413f-9b6a-29af5ddff325 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:50:36.320418 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efe1ad28-2c2b-413f-9b6a-29af5ddff325 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:36.320942 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efe1ad28-2c2b-413f-9b6a-29af5ddff325 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:36.321398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efe1ad28-2c2b-413f-9b6a-29af5ddff325 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:36.322102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efe1ad28-2c2b-413f-9b6a-29af5ddff325 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:36.322570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efe1ad28-2c2b-413f-9b6a-29af5ddff325 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:36.323016 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-efe1ad28-2c2b-413f-9b6a-29af5ddff325 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:36.384389 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-efe1ad28-2c2b-413f-9b6a-29af5ddff325 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027/action" status: 200 len: 38353 microversion: 2.1 time: 0.078035 Oct 24 11:50:36.384955 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3900/7822] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:50:36 2022] POST /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027/action => generated 38353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 11:50:36.397811 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-92fcfb52-051d-42cc-b959-06f5b1a89b01 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:50:36.398360 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-92fcfb52-051d-42cc-b959-06f5b1a89b01 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:50:36.407407 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92fcfb52-051d-42cc-b959-06f5b1a89b01 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:36.408208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92fcfb52-051d-42cc-b959-06f5b1a89b01 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:36.408665 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92fcfb52-051d-42cc-b959-06f5b1a89b01 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:36.409486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92fcfb52-051d-42cc-b959-06f5b1a89b01 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:36.410280 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92fcfb52-051d-42cc-b959-06f5b1a89b01 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:36.411055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92fcfb52-051d-42cc-b959-06f5b1a89b01 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:36.480663 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-92fcfb52-051d-42cc-b959-06f5b1a89b01 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027/action" status: 202 len: 0 microversion: 2.1 time: 0.086585 Oct 24 11:50:36.481580 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3923/7823] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:50:36 2022] POST /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:50:36.490323 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-490c4b1a-42a7-47c1-81b9-1420f3aca2ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:50:36.491056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-490c4b1a-42a7-47c1-81b9-1420f3aca2ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:50:36.498619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-490c4b1a-42a7-47c1-81b9-1420f3aca2ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:36.499117 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-490c4b1a-42a7-47c1-81b9-1420f3aca2ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:36.499573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-490c4b1a-42a7-47c1-81b9-1420f3aca2ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:36.500320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-490c4b1a-42a7-47c1-81b9-1420f3aca2ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:36.500980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-490c4b1a-42a7-47c1-81b9-1420f3aca2ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:36.501221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-490c4b1a-42a7-47c1-81b9-1420f3aca2ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:36.639623 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-490c4b1a-42a7-47c1-81b9-1420f3aca2ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:50:36.647883 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-490c4b1a-42a7-47c1-81b9-1420f3aca2ec tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1681 microversion: 2.1 time: 0.161695 Oct 24 11:50:36.648636 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3901/7824] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:50:36 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:50:37.673375 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f296fa9b-25fc-4f0a-9240-f1122db79142 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:50:37.674079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f296fa9b-25fc-4f0a-9240-f1122db79142 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:50:37.680321 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f296fa9b-25fc-4f0a-9240-f1122db79142 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:37.680803 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f296fa9b-25fc-4f0a-9240-f1122db79142 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:37.681296 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f296fa9b-25fc-4f0a-9240-f1122db79142 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:37.681986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f296fa9b-25fc-4f0a-9240-f1122db79142 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:37.682441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f296fa9b-25fc-4f0a-9240-f1122db79142 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:37.682870 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f296fa9b-25fc-4f0a-9240-f1122db79142 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:37.817283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f296fa9b-25fc-4f0a-9240-f1122db79142 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:50:37.825648 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f296fa9b-25fc-4f0a-9240-f1122db79142 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1681 microversion: 2.1 time: 0.157752 Oct 24 11:50:37.826223 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3924/7825] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:50:37 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:50:38.849732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-fa15c0e9-e620-49d5-8276-c12b56a8dc62 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:50:38.850346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-fa15c0e9-e620-49d5-8276-c12b56a8dc62 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:50:38.858134 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa15c0e9-e620-49d5-8276-c12b56a8dc62 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:38.858629 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa15c0e9-e620-49d5-8276-c12b56a8dc62 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:38.859080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa15c0e9-e620-49d5-8276-c12b56a8dc62 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:38.859808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa15c0e9-e620-49d5-8276-c12b56a8dc62 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:38.860275 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa15c0e9-e620-49d5-8276-c12b56a8dc62 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:38.860713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-fa15c0e9-e620-49d5-8276-c12b56a8dc62 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:38.995075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-fa15c0e9-e620-49d5-8276-c12b56a8dc62 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:50:39.003180 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-fa15c0e9-e620-49d5-8276-c12b56a8dc62 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1684 microversion: 2.1 time: 0.157393 Oct 24 11:50:39.003748 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3902/7826] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:50:38 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:50:39.099872 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a333dba0-af8b-4de4-9319-e3ee348f2904 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:50:39.102182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a333dba0-af8b-4de4-9319-e3ee348f2904 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:50:39.109767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a333dba0-af8b-4de4-9319-e3ee348f2904 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:39.110271 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a333dba0-af8b-4de4-9319-e3ee348f2904 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:39.110709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a333dba0-af8b-4de4-9319-e3ee348f2904 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:39.111406 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a333dba0-af8b-4de4-9319-e3ee348f2904 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:39.111855 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a333dba0-af8b-4de4-9319-e3ee348f2904 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:39.112278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a333dba0-af8b-4de4-9319-e3ee348f2904 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:39.176363 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a333dba0-af8b-4de4-9319-e3ee348f2904 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "POST /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027/action" status: 200 len: 38353 microversion: 2.1 time: 0.080388 Oct 24 11:50:39.177068 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3925/7827] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:50:39 2022] POST /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027/action => generated 38353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 11:50:40.162741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1b457f38-0709-4fd6-8af4-ec97a40f2c6d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:50:40.163859 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1b457f38-0709-4fd6-8af4-ec97a40f2c6d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:50:40.167346 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-409b50b6-8292-4773-94ec-7afa4ad9d0c9 req-7d54f6fc-bb6d-40ad-8e3e-9a9c4cbedfa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b195d644-3990-4293-bb07-c4ee6dd36027", "tag": "10f356b4-ffce-47a8-9677-f6d6f423d580"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:50:40.172219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b457f38-0709-4fd6-8af4-ec97a40f2c6d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:40.173041 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b457f38-0709-4fd6-8af4-ec97a40f2c6d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:40.173729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b457f38-0709-4fd6-8af4-ec97a40f2c6d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:40.174676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b457f38-0709-4fd6-8af4-ec97a40f2c6d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:40.175356 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b457f38-0709-4fd6-8af4-ec97a40f2c6d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:40.176014 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1b457f38-0709-4fd6-8af4-ec97a40f2c6d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:40.178527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-409b50b6-8292-4773-94ec-7afa4ad9d0c9 req-7d54f6fc-bb6d-40ad-8e3e-9a9c4cbedfa6 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:40.179015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-409b50b6-8292-4773-94ec-7afa4ad9d0c9 req-7d54f6fc-bb6d-40ad-8e3e-9a9c4cbedfa6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:40.179446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-409b50b6-8292-4773-94ec-7afa4ad9d0c9 req-7d54f6fc-bb6d-40ad-8e3e-9a9c4cbedfa6 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:40.191669 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-409b50b6-8292-4773-94ec-7afa4ad9d0c9 req-7d54f6fc-bb6d-40ad-8e3e-9a9c4cbedfa6 service nova] Creating event network-changed:10f356b4-ffce-47a8-9677-f6d6f423d580 for instance b195d644-3990-4293-bb07-c4ee6dd36027 on n-h2-858383-15 Oct 24 11:50:40.197185 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-409b50b6-8292-4773-94ec-7afa4ad9d0c9 req-7d54f6fc-bb6d-40ad-8e3e-9a9c4cbedfa6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034011 Oct 24 11:50:40.197779 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3926/7828] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:50:40.204097 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1b457f38-0709-4fd6-8af4-ec97a40f2c6d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:50:40.289106 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1b457f38-0709-4fd6-8af4-ec97a40f2c6d tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 204 len: 0 microversion: 2.1 time: 0.129606 Oct 24 11:50:40.291074 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3903/7829] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:50:40 2022] DELETE /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:50:40.301242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ed23c24c-299b-4d77-bd56-9816ae65eab6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:50:40.302193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ed23c24c-299b-4d77-bd56-9816ae65eab6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:50:40.309867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed23c24c-299b-4d77-bd56-9816ae65eab6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:40.310357 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed23c24c-299b-4d77-bd56-9816ae65eab6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:40.310792 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed23c24c-299b-4d77-bd56-9816ae65eab6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:40.311528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed23c24c-299b-4d77-bd56-9816ae65eab6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:40.311980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed23c24c-299b-4d77-bd56-9816ae65eab6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:40.312404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ed23c24c-299b-4d77-bd56-9816ae65eab6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:40.453798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ed23c24c-299b-4d77-bd56-9816ae65eab6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:50:40.462188 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ed23c24c-299b-4d77-bd56-9816ae65eab6 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1690 microversion: 2.1 time: 0.166903 Oct 24 11:50:40.462776 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3927/7830] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:50:40 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:50:41.488485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0fcc8df4-8fb3-4a73-91aa-2ab966190bba tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:50:41.489238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0fcc8df4-8fb3-4a73-91aa-2ab966190bba tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:50:41.497000 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fcc8df4-8fb3-4a73-91aa-2ab966190bba tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:41.497760 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fcc8df4-8fb3-4a73-91aa-2ab966190bba tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:41.498221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fcc8df4-8fb3-4a73-91aa-2ab966190bba tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:41.498946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fcc8df4-8fb3-4a73-91aa-2ab966190bba tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:41.499421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fcc8df4-8fb3-4a73-91aa-2ab966190bba tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:41.499866 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0fcc8df4-8fb3-4a73-91aa-2ab966190bba tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:41.635093 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0fcc8df4-8fb3-4a73-91aa-2ab966190bba tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:50:41.643068 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0fcc8df4-8fb3-4a73-91aa-2ab966190bba tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1690 microversion: 2.1 time: 0.158896 Oct 24 11:50:41.643848 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3904/7831] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:50:41 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:50:42.636377 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a812f06d-bd26-4848-a70a-095b9710df5a req-55fc76be-4d98-4dbb-863e-d627c890771b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b195d644-3990-4293-bb07-c4ee6dd36027", "name": "network-vif-deleted", "tag": "10f356b4-ffce-47a8-9677-f6d6f423d580"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:50:42.651779 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a812f06d-bd26-4848-a70a-095b9710df5a req-55fc76be-4d98-4dbb-863e-d627c890771b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:42.652656 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a812f06d-bd26-4848-a70a-095b9710df5a req-55fc76be-4d98-4dbb-863e-d627c890771b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:42.654043 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a812f06d-bd26-4848-a70a-095b9710df5a req-55fc76be-4d98-4dbb-863e-d627c890771b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:42.666733 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a812f06d-bd26-4848-a70a-095b9710df5a req-55fc76be-4d98-4dbb-863e-d627c890771b service nova] Creating event network-vif-deleted:10f356b4-ffce-47a8-9677-f6d6f423d580 for instance b195d644-3990-4293-bb07-c4ee6dd36027 on n-h2-858383-15 Oct 24 11:50:42.667043 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef039d1d-d9ae-44a2-9c1c-62362eb49531 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:50:42.667674 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ef039d1d-d9ae-44a2-9c1c-62362eb49531 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:50:42.674990 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a812f06d-bd26-4848-a70a-095b9710df5a req-55fc76be-4d98-4dbb-863e-d627c890771b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042251 Oct 24 11:50:42.675416 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef039d1d-d9ae-44a2-9c1c-62362eb49531 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:42.675920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef039d1d-d9ae-44a2-9c1c-62362eb49531 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:42.676207 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3928/7832] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:50:42.676804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef039d1d-d9ae-44a2-9c1c-62362eb49531 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:42.678146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef039d1d-d9ae-44a2-9c1c-62362eb49531 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:42.678146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef039d1d-d9ae-44a2-9c1c-62362eb49531 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:42.678598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef039d1d-d9ae-44a2-9c1c-62362eb49531 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:42.743869 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ef039d1d-d9ae-44a2-9c1c-62362eb49531 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80525ed5fa842e18c9ec15fe2cd4053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eda4103cf4f2b8c362d83d5394c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:50:42.752488 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef039d1d-d9ae-44a2-9c1c-62362eb49531 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 200 len: 1352 microversion: 2.1 time: 0.089665 Oct 24 11:50:42.753095 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3905/7833] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:50:42 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:50:43.777020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4b42c547-975c-482a-842d-842586885114 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:50:43.778534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4b42c547-975c-482a-842d-842586885114 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] [instance: b195d644-3990-4293-bb07-c4ee6dd36027] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:50:43.786207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b42c547-975c-482a-842d-842586885114 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:43.786686 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b42c547-975c-482a-842d-842586885114 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:43.787154 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b42c547-975c-482a-842d-842586885114 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:43.787847 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b42c547-975c-482a-842d-842586885114 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:50:43.788352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b42c547-975c-482a-842d-842586885114 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:50:43.788780 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4b42c547-975c-482a-842d-842586885114 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:50:43.802019 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-4b42c547-975c-482a-842d-842586885114 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] HTTP exception thrown: Instance b195d644-3990-4293-bb07-c4ee6dd36027 could not be found. Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4b42c547-975c-482a-842d-842586885114 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Request method failure captured: Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 HTTP/1.1 Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVnpaKq5eMD1wOzd3b0sKYUgl2bjacFpSj-y3-0VcKu80EQNHdJhpBnba-f7gM6-ByY9XlAsOphxypaSEGoSP8rdUWPJNC3Qgb060RgWUaFdfTWVPikTJMe6jnvvdIHjl1TPy-V0Mj-4jPkEyPtgT5wAyFasuOciBHUhQoLY-cRXaZzk Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: f84eda4103cf4f2b8c362d83d5394c69 Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1428233327 Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f84eda4103cf4f2b8c362d83d5394c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f84eda4103cf4f2b8c362d83d5394c69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f84eda4103cf4f2b8c362d83d5394c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f84eda4103cf4f2b8c362d83d5394c69", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1428233327 Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: f84eda4103cf4f2b8c362d83d5394c69 Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1428233327 Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestNetworkAdvancedServerOps-1428233327-project Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: f80525ed5fa842e18c9ec15fe2cd4053 Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1428233327-project Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance b195d644-3990-4293-bb07-c4ee6dd36027 could not be found. Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'b195d644-3990-4293-bb07-c4ee6dd36027'} Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b195d644-3990-4293-bb07-c4ee6dd36027 could not be found. Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b195d644-3990-4293-bb07-c4ee6dd36027 could not be found. Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:50:43.803633 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:50:43.809621 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:50:43.809621 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:50:43.809621 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:50:43.809621 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:50:43.809621 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:50:43.809621 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:50:43.809621 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b195d644-3990-4293-bb07-c4ee6dd36027 could not be found. Oct 24 11:50:43.809621 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 11:50:43.809621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4b42c547-975c-482a-842d-842586885114 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Returning 404 to user: Instance b195d644-3990-4293-bb07-c4ee6dd36027 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:50:43.809621 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4b42c547-975c-482a-842d-842586885114 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027" status: 404 len: 111 microversion: 2.1 time: 0.032510 Oct 24 11:50:43.809621 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3929/7834] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:50:43 2022] GET /compute/v2.1/servers/b195d644-3990-4293-bb07-c4ee6dd36027 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:50:46.872320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-42bc56c9-9830-4100-85ec-105953b66616 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] Calling method '.version_select at 0x7f04cb99a700>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:50:46.893182 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-42bc56c9-9830-4100-85ec-105953b66616 tempest-TestNetworkAdvancedServerOps-1428233327 tempest-TestNetworkAdvancedServerOps-1428233327-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1556931832" status: 202 len: 0 microversion: 2.1 time: 0.025249 Oct 24 11:50:46.898205 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3906/7835] 10.222.0.50 () {58 vars in 1284 bytes} [Mon Oct 24 11:50:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1556931832 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:50:58.137089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=18 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:50:58.139181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:50:58.443764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-52c3fae1-c573-47c0-a833-1f315533de0c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Action: 'create', calling method: .version_select at 0x7f04d09abd30>, body: {"keypair": {"name": "tempest-TestShelveInstance-331837165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIx4QZelO7yRVVgobKBZdoDBRRjZ/JmJSpR6kqkNeIhPqdK5Gnn4AlFJQHKfpPkYCFHcTvgHxTq2AIEaUMWbu4edtgr3HWLYgC5btg1ZjYOCGtS4T4xaZsI6GKAI8PgHQ=="}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:50:58.461065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-52c3fae1-c573-47c0-a833-1f315533de0c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Getting quotas for project deefb20157d4407fb9e8824fcfe8441e. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:50:58.467302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-52c3fae1-c573-47c0-a833-1f315533de0c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Getting quotas for user b396cb63e0e541e687ce6740f0b14272 and project deefb20157d4407fb9e8824fcfe8441e. Resources: {'key_pairs'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:50:58.500649 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-52c3fae1-c573-47c0-a833-1f315533de0c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.381163 Oct 24 11:50:58.501349 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3930/7836] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:50:58 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:50:59.538496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:50:59.539926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:50:59.545239 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ab7570d4-f432-4171-95bd-bc3ff875bdf7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-393738304", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-331837165", "security_groups": [{"name": "tempest-secgroup-smoke-1804754856"}], "networks": [{"uuid": "243555e8-cd00-4fe2-b360-4d179b064906"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:50:59.654517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-ab7570d4-f432-4171-95bd-bc3ff875bdf7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] validate_networks() for [('243555e8-cd00-4fe2-b360-4d179b064906', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:51:00.039678 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ab7570d4-f432-4171-95bd-bc3ff875bdf7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:51:00.040233 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ab7570d4-f432-4171-95bd-bc3ff875bdf7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:51:00.040820 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ab7570d4-f432-4171-95bd-bc3ff875bdf7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:51:00.041361 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ab7570d4-f432-4171-95bd-bc3ff875bdf7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:51:00.041815 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-ab7570d4-f432-4171-95bd-bc3ff875bdf7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:51:00.051372 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab7570d4-f432-4171-95bd-bc3ff875bdf7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:00.051888 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab7570d4-f432-4171-95bd-bc3ff875bdf7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:00.052341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab7570d4-f432-4171-95bd-bc3ff875bdf7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:00.053105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab7570d4-f432-4171-95bd-bc3ff875bdf7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:00.053576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab7570d4-f432-4171-95bd-bc3ff875bdf7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:00.054018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ab7570d4-f432-4171-95bd-bc3ff875bdf7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:00.071641 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ab7570d4-f432-4171-95bd-bc3ff875bdf7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Getting quotas for project deefb20157d4407fb9e8824fcfe8441e. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:51:00.077639 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-ab7570d4-f432-4171-95bd-bc3ff875bdf7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Getting quotas for user b396cb63e0e541e687ce6740f0b14272 and project deefb20157d4407fb9e8824fcfe8441e. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:51:00.091299 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ab7570d4-f432-4171-95bd-bc3ff875bdf7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:51:00.093688 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ab7570d4-f432-4171-95bd-bc3ff875bdf7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:51:00.141283 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ab7570d4-f432-4171-95bd-bc3ff875bdf7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.604419 Oct 24 11:51:00.142040 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3907/7837] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:50:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:51:00.155074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0ed80919-de19-4585-992e-dae49f15517e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:51:00.155707 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0ed80919-de19-4585-992e-dae49f15517e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:51:00.231690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0ed80919-de19-4585-992e-dae49f15517e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:51:00.240194 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0ed80919-de19-4585-992e-dae49f15517e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1245 microversion: 2.1 time: 0.090697 Oct 24 11:51:00.241137 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3931/7838] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:51:00 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:51:01.264981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8be3daa8-5008-4652-b0b5-b674bf2bbdaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:51:01.266238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8be3daa8-5008-4652-b0b5-b674bf2bbdaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:51:01.272905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8be3daa8-5008-4652-b0b5-b674bf2bbdaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:01.273407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8be3daa8-5008-4652-b0b5-b674bf2bbdaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:01.273920 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8be3daa8-5008-4652-b0b5-b674bf2bbdaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:01.274643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8be3daa8-5008-4652-b0b5-b674bf2bbdaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:01.275115 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8be3daa8-5008-4652-b0b5-b674bf2bbdaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:01.275556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8be3daa8-5008-4652-b0b5-b674bf2bbdaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:01.359558 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8be3daa8-5008-4652-b0b5-b674bf2bbdaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:51:01.367645 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8be3daa8-5008-4652-b0b5-b674bf2bbdaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1297 microversion: 2.1 time: 0.107800 Oct 24 11:51:01.368233 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3908/7839] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:51:01 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1297 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:51:02.393055 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-183ee6ae-3951-457e-b803-687cc094039c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:51:02.394736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-183ee6ae-3951-457e-b803-687cc094039c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:51:02.406979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-183ee6ae-3951-457e-b803-687cc094039c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:02.408661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-183ee6ae-3951-457e-b803-687cc094039c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:02.409299 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-183ee6ae-3951-457e-b803-687cc094039c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:02.410193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-183ee6ae-3951-457e-b803-687cc094039c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:02.412443 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-183ee6ae-3951-457e-b803-687cc094039c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:02.413269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-183ee6ae-3951-457e-b803-687cc094039c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:02.581370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-183ee6ae-3951-457e-b803-687cc094039c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:51:02.589183 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-183ee6ae-3951-457e-b803-687cc094039c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1371 microversion: 2.1 time: 0.200610 Oct 24 11:51:02.590464 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3932/7840] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:51:02 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:51:02.939943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-42610ff5-aab9-46a9-9e6d-3ef8e0d9d7dd req-c1d7fb5d-cb5d-45ab-8759-601b40b2fdcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee8b5e5c-5866-4a47-8e42-450bf32e5c73", "tag": "7cbb33c4-3372-403a-9fc7-3316f2bbcda4"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:51:02.952144 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-42610ff5-aab9-46a9-9e6d-3ef8e0d9d7dd req-c1d7fb5d-cb5d-45ab-8759-601b40b2fdcd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:02.952966 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-42610ff5-aab9-46a9-9e6d-3ef8e0d9d7dd req-c1d7fb5d-cb5d-45ab-8759-601b40b2fdcd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:02.953519 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-42610ff5-aab9-46a9-9e6d-3ef8e0d9d7dd req-c1d7fb5d-cb5d-45ab-8759-601b40b2fdcd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:02.966787 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-42610ff5-aab9-46a9-9e6d-3ef8e0d9d7dd req-c1d7fb5d-cb5d-45ab-8759-601b40b2fdcd service nova] Creating event network-changed:7cbb33c4-3372-403a-9fc7-3316f2bbcda4 for instance ee8b5e5c-5866-4a47-8e42-450bf32e5c73 on n-h2-858383-15 Oct 24 11:51:02.971746 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-42610ff5-aab9-46a9-9e6d-3ef8e0d9d7dd req-c1d7fb5d-cb5d-45ab-8759-601b40b2fdcd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035533 Oct 24 11:51:02.972349 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3909/7841] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:51:03.614852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-36f538db-8ee7-4f0d-8dcb-23ce095f5f85 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:51:03.615477 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-36f538db-8ee7-4f0d-8dcb-23ce095f5f85 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:51:03.622452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36f538db-8ee7-4f0d-8dcb-23ce095f5f85 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:03.622932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36f538db-8ee7-4f0d-8dcb-23ce095f5f85 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:03.623369 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36f538db-8ee7-4f0d-8dcb-23ce095f5f85 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:03.624063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36f538db-8ee7-4f0d-8dcb-23ce095f5f85 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:03.624516 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36f538db-8ee7-4f0d-8dcb-23ce095f5f85 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:03.624982 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-36f538db-8ee7-4f0d-8dcb-23ce095f5f85 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:03.755309 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-36f538db-8ee7-4f0d-8dcb-23ce095f5f85 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:51:03.763172 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-36f538db-8ee7-4f0d-8dcb-23ce095f5f85 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1371 microversion: 2.1 time: 0.153993 Oct 24 11:51:03.763753 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3933/7842] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:51:03 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:51:04.790128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-294b6f3b-1a55-4a2f-a65e-447a5aa47e10 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:51:04.792380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-294b6f3b-1a55-4a2f-a65e-447a5aa47e10 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:51:04.799780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-294b6f3b-1a55-4a2f-a65e-447a5aa47e10 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:04.800461 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-294b6f3b-1a55-4a2f-a65e-447a5aa47e10 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:04.801980 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-294b6f3b-1a55-4a2f-a65e-447a5aa47e10 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:04.802967 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-294b6f3b-1a55-4a2f-a65e-447a5aa47e10 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:04.803477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-294b6f3b-1a55-4a2f-a65e-447a5aa47e10 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:04.804049 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-294b6f3b-1a55-4a2f-a65e-447a5aa47e10 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:04.976620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-294b6f3b-1a55-4a2f-a65e-447a5aa47e10 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:51:04.989161 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-294b6f3b-1a55-4a2f-a65e-447a5aa47e10 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1371 microversion: 2.1 time: 0.204759 Oct 24 11:51:04.990030 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3910/7843] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:51:04 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:51:06.012737 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-92c4c212-362b-4cdd-bd2d-21f742045848 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:51:06.013378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-92c4c212-362b-4cdd-bd2d-21f742045848 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:51:06.020320 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92c4c212-362b-4cdd-bd2d-21f742045848 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:06.020801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92c4c212-362b-4cdd-bd2d-21f742045848 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:06.021266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92c4c212-362b-4cdd-bd2d-21f742045848 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:06.021953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92c4c212-362b-4cdd-bd2d-21f742045848 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:06.022442 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92c4c212-362b-4cdd-bd2d-21f742045848 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:06.022865 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-92c4c212-362b-4cdd-bd2d-21f742045848 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:06.154743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-92c4c212-362b-4cdd-bd2d-21f742045848 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:51:06.162623 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-92c4c212-362b-4cdd-bd2d-21f742045848 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1371 microversion: 2.1 time: 0.154088 Oct 24 11:51:06.163192 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3934/7844] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:51:06 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:51:06.986832 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-d7bb1d1a-4366-477a-b952-6577f8879b4b req-8a8f70ec-4e99-4b3e-bb79-87322fa42326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee8b5e5c-5866-4a47-8e42-450bf32e5c73", "name": "network-vif-plugged", "status": "completed", "tag": "7cbb33c4-3372-403a-9fc7-3316f2bbcda4"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:51:06.998575 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d7bb1d1a-4366-477a-b952-6577f8879b4b req-8a8f70ec-4e99-4b3e-bb79-87322fa42326 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:07.000167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d7bb1d1a-4366-477a-b952-6577f8879b4b req-8a8f70ec-4e99-4b3e-bb79-87322fa42326 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:07.000808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-d7bb1d1a-4366-477a-b952-6577f8879b4b req-8a8f70ec-4e99-4b3e-bb79-87322fa42326 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:07.012665 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-d7bb1d1a-4366-477a-b952-6577f8879b4b req-8a8f70ec-4e99-4b3e-bb79-87322fa42326 service nova] Creating event network-vif-plugged:7cbb33c4-3372-403a-9fc7-3316f2bbcda4 for instance ee8b5e5c-5866-4a47-8e42-450bf32e5c73 on n-h2-858383-15 Oct 24 11:51:07.017900 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-d7bb1d1a-4366-477a-b952-6577f8879b4b req-8a8f70ec-4e99-4b3e-bb79-87322fa42326 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034818 Oct 24 11:51:07.018516 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3911/7845] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:51:07.186473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1b8b7b20-6ea0-4274-b3eb-213b408b973f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:51:07.187107 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1b8b7b20-6ea0-4274-b3eb-213b408b973f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:51:07.194053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b8b7b20-6ea0-4274-b3eb-213b408b973f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:07.194550 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b8b7b20-6ea0-4274-b3eb-213b408b973f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:07.194993 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b8b7b20-6ea0-4274-b3eb-213b408b973f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:07.195703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b8b7b20-6ea0-4274-b3eb-213b408b973f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:07.196170 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b8b7b20-6ea0-4274-b3eb-213b408b973f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:07.196634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1b8b7b20-6ea0-4274-b3eb-213b408b973f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:07.331716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1b8b7b20-6ea0-4274-b3eb-213b408b973f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:51:07.340289 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1b8b7b20-6ea0-4274-b3eb-213b408b973f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1371 microversion: 2.1 time: 0.158542 Oct 24 11:51:07.340934 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3935/7846] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:51:07 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:51:08.365103 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e1083dbf-d29e-4b59-b0b2-184de8358bac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:51:08.365971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e1083dbf-d29e-4b59-b0b2-184de8358bac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:51:08.372432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1083dbf-d29e-4b59-b0b2-184de8358bac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:08.372963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1083dbf-d29e-4b59-b0b2-184de8358bac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:08.373424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1083dbf-d29e-4b59-b0b2-184de8358bac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:08.374142 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1083dbf-d29e-4b59-b0b2-184de8358bac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:08.374607 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1083dbf-d29e-4b59-b0b2-184de8358bac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:08.375054 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e1083dbf-d29e-4b59-b0b2-184de8358bac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:08.513180 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e1083dbf-d29e-4b59-b0b2-184de8358bac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:51:08.521022 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e1083dbf-d29e-4b59-b0b2-184de8358bac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1555 microversion: 2.1 time: 0.160987 Oct 24 11:51:08.521610 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3912/7847] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:51:08 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:51:08.544785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f2fe2808-a62f-43e7-844e-dff7c5f412d6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:51:08.545437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f2fe2808-a62f-43e7-844e-dff7c5f412d6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:51:08.552410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2fe2808-a62f-43e7-844e-dff7c5f412d6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:08.552933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2fe2808-a62f-43e7-844e-dff7c5f412d6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:08.553393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2fe2808-a62f-43e7-844e-dff7c5f412d6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:08.554075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2fe2808-a62f-43e7-844e-dff7c5f412d6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:08.554529 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2fe2808-a62f-43e7-844e-dff7c5f412d6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:08.554957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f2fe2808-a62f-43e7-844e-dff7c5f412d6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:08.688594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f2fe2808-a62f-43e7-844e-dff7c5f412d6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:51:08.696415 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f2fe2808-a62f-43e7-844e-dff7c5f412d6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1555 microversion: 2.1 time: 0.155605 Oct 24 11:51:08.697011 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3936/7848] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:51:08 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:51:10.723052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-a809646e-7301-448a-9770-ed3da828d786 req-bb1e326a-7bf3-4ce7-ac71-407fe801b8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee8b5e5c-5866-4a47-8e42-450bf32e5c73", "tag": "7cbb33c4-3372-403a-9fc7-3316f2bbcda4"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:51:10.728809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:51:10.730131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:51:10.736520 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a809646e-7301-448a-9770-ed3da828d786 req-bb1e326a-7bf3-4ce7-ac71-407fe801b8f4 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:51:10.737075 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a809646e-7301-448a-9770-ed3da828d786 req-bb1e326a-7bf3-4ce7-ac71-407fe801b8f4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:51:10.737557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-a809646e-7301-448a-9770-ed3da828d786 req-bb1e326a-7bf3-4ce7-ac71-407fe801b8f4 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:51:10.749614 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-a809646e-7301-448a-9770-ed3da828d786 req-bb1e326a-7bf3-4ce7-ac71-407fe801b8f4 service nova] Creating event network-changed:7cbb33c4-3372-403a-9fc7-3316f2bbcda4 for instance ee8b5e5c-5866-4a47-8e42-450bf32e5c73 on n-h2-858383-15 Oct 24 11:51:10.754891 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-a809646e-7301-448a-9770-ed3da828d786 req-bb1e326a-7bf3-4ce7-ac71-407fe801b8f4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035486 Oct 24 11:51:10.755685 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3913/7849] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:53:05.944475 n-d-858383-15 devstack@n-api.service[120426]: ERROR oslo.messaging._drivers.impl_rabbit [-] [05048d7c-6448-4d6e-b9e7-4fa04d95d8b6] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 11:53:05.945445 n-d-858383-15 devstack@n-api.service[120426]: ERROR oslo.messaging._drivers.impl_rabbit [-] [666865aa-442b-4005-907b-9c648cd2f782] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 11:53:05.945845 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:53:05.946690 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:53:05.947649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=30 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:53:05.949064 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 24 11:53:05.949211 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:53:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73/action (ip 10.222.0.50) !!! Oct 24 11:53:05.951405 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:53:05.951531 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:53:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73/action (ip 10.222.0.50) !!! Oct 24 11:53:05.957251 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-46b18bbe-0763-46e2-a4e0-f6e676c771a2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:53:05.957788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-46b18bbe-0763-46e2-a4e0-f6e676c771a2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:05.970165 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46b18bbe-0763-46e2-a4e0-f6e676c771a2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:05.970681 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46b18bbe-0763-46e2-a4e0-f6e676c771a2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:05.971120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46b18bbe-0763-46e2-a4e0-f6e676c771a2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:05.971831 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46b18bbe-0763-46e2-a4e0-f6e676c771a2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:05.972290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46b18bbe-0763-46e2-a4e0-f6e676c771a2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:05.972719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-46b18bbe-0763-46e2-a4e0-f6e676c771a2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:05.997158 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-46b18bbe-0763-46e2-a4e0-f6e676c771a2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lazy-loading 'flavor' on Instance uuid ee8b5e5c-5866-4a47-8e42-450bf32e5c73 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:53:06.198696 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-46b18bbe-0763-46e2-a4e0-f6e676c771a2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "POST /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73/action" status: 202 len: 0 microversion: 2.1 time: 0.256001 Oct 24 11:53:06.199319 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3937/7850] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:53:05 2022] POST /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:53:06.206894 n-d-858383-15 devstack@n-api.service[120425]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1abc338e-6c14-4311-a7b3-814582834b4a] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 11:53:06.207900 n-d-858383-15 devstack@n-api.service[120425]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ebd6dc19-988c-4764-bcee-cebc857bf132] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 11:53:06.208447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:53:06.210045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=26 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:53:06.215349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cf27c72d-aa8d-40bc-89a8-90f8a57f0f7c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:06.216249 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cf27c72d-aa8d-40bc-89a8-90f8a57f0f7c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:06.226320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf27c72d-aa8d-40bc-89a8-90f8a57f0f7c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:06.226830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf27c72d-aa8d-40bc-89a8-90f8a57f0f7c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:06.227292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf27c72d-aa8d-40bc-89a8-90f8a57f0f7c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:06.228026 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf27c72d-aa8d-40bc-89a8-90f8a57f0f7c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:06.228503 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf27c72d-aa8d-40bc-89a8-90f8a57f0f7c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:06.229015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cf27c72d-aa8d-40bc-89a8-90f8a57f0f7c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:06.389821 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cf27c72d-aa8d-40bc-89a8-90f8a57f0f7c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:06.399886 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cf27c72d-aa8d-40bc-89a8-90f8a57f0f7c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1680 microversion: 2.1 time: 0.195740 Oct 24 11:53:06.400480 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3914/7851] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:06 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1680 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:07.428899 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f758bdfb-0d8b-41bc-85bf-d2b99034cfb1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:07.429642 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f758bdfb-0d8b-41bc-85bf-d2b99034cfb1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:07.437830 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f758bdfb-0d8b-41bc-85bf-d2b99034cfb1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:07.438975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f758bdfb-0d8b-41bc-85bf-d2b99034cfb1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:07.439425 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f758bdfb-0d8b-41bc-85bf-d2b99034cfb1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:07.440131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f758bdfb-0d8b-41bc-85bf-d2b99034cfb1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:07.440591 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f758bdfb-0d8b-41bc-85bf-d2b99034cfb1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:07.441047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f758bdfb-0d8b-41bc-85bf-d2b99034cfb1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:07.446780 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] [05048d7c-6448-4d6e-b9e7-4fa04d95d8b6] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 52156. Oct 24 11:53:07.449018 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] [666865aa-442b-4005-907b-9c648cd2f782] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 52158. Oct 24 11:53:07.575051 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f758bdfb-0d8b-41bc-85bf-d2b99034cfb1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:07.582970 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f758bdfb-0d8b-41bc-85bf-d2b99034cfb1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1680 microversion: 2.1 time: 0.160524 Oct 24 11:53:07.587422 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3938/7852] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:07 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:08.606382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-35f294a9-d2cf-40ca-aca3-05a410db1910 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:08.607024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-35f294a9-d2cf-40ca-aca3-05a410db1910 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:08.622350 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35f294a9-d2cf-40ca-aca3-05a410db1910 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:08.622849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35f294a9-d2cf-40ca-aca3-05a410db1910 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:08.623300 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35f294a9-d2cf-40ca-aca3-05a410db1910 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:08.624010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35f294a9-d2cf-40ca-aca3-05a410db1910 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:08.624477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35f294a9-d2cf-40ca-aca3-05a410db1910 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:08.624947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-35f294a9-d2cf-40ca-aca3-05a410db1910 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:08.626711 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] [1abc338e-6c14-4311-a7b3-814582834b4a] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 52162. Oct 24 11:53:08.629855 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] [ebd6dc19-988c-4764-bcee-cebc857bf132] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 52164. Oct 24 11:53:08.765981 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-35f294a9-d2cf-40ca-aca3-05a410db1910 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:08.774584 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-35f294a9-d2cf-40ca-aca3-05a410db1910 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1680 microversion: 2.1 time: 0.172152 Oct 24 11:53:08.775172 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3915/7853] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:08 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:09.798974 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-35fe17db-61c0-471e-a039-94528992e306 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:09.799621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-35fe17db-61c0-471e-a039-94528992e306 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:09.806496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35fe17db-61c0-471e-a039-94528992e306 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:09.806975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35fe17db-61c0-471e-a039-94528992e306 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:09.807410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35fe17db-61c0-471e-a039-94528992e306 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:09.808101 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35fe17db-61c0-471e-a039-94528992e306 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:09.808553 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35fe17db-61c0-471e-a039-94528992e306 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:09.809006 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-35fe17db-61c0-471e-a039-94528992e306 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:09.937237 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-35fe17db-61c0-471e-a039-94528992e306 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:09.945107 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-35fe17db-61c0-471e-a039-94528992e306 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1680 microversion: 2.1 time: 0.150291 Oct 24 11:53:09.945685 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3939/7854] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:09 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:10.968778 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e0699a32-b583-44d8-a345-f85809dca2f7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:10.969965 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e0699a32-b583-44d8-a345-f85809dca2f7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:10.976985 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0699a32-b583-44d8-a345-f85809dca2f7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:10.977493 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0699a32-b583-44d8-a345-f85809dca2f7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:10.977949 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0699a32-b583-44d8-a345-f85809dca2f7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:10.978663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0699a32-b583-44d8-a345-f85809dca2f7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:10.979139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0699a32-b583-44d8-a345-f85809dca2f7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:10.979585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e0699a32-b583-44d8-a345-f85809dca2f7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:11.115409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e0699a32-b583-44d8-a345-f85809dca2f7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:11.123262 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e0699a32-b583-44d8-a345-f85809dca2f7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1680 microversion: 2.1 time: 0.158408 Oct 24 11:53:11.123848 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3916/7855] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:10 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:12.146986 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2debe3d4-ea7f-444f-8493-e0902d65afaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:12.147621 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2debe3d4-ea7f-444f-8493-e0902d65afaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:12.154549 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2debe3d4-ea7f-444f-8493-e0902d65afaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:12.155040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2debe3d4-ea7f-444f-8493-e0902d65afaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:12.155486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2debe3d4-ea7f-444f-8493-e0902d65afaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:12.156189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2debe3d4-ea7f-444f-8493-e0902d65afaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:12.156647 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2debe3d4-ea7f-444f-8493-e0902d65afaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:12.157116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2debe3d4-ea7f-444f-8493-e0902d65afaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:12.290799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2debe3d4-ea7f-444f-8493-e0902d65afaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:12.299175 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2debe3d4-ea7f-444f-8493-e0902d65afaa tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1680 microversion: 2.1 time: 0.156292 Oct 24 11:53:12.299745 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3940/7856] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:12 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:13.322147 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ea9c7345-7067-4ef0-97ca-14745fad39f8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:13.322702 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ea9c7345-7067-4ef0-97ca-14745fad39f8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:13.330264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea9c7345-7067-4ef0-97ca-14745fad39f8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:13.330761 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea9c7345-7067-4ef0-97ca-14745fad39f8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:13.331218 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea9c7345-7067-4ef0-97ca-14745fad39f8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:13.331928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea9c7345-7067-4ef0-97ca-14745fad39f8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:13.332403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea9c7345-7067-4ef0-97ca-14745fad39f8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:13.332890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea9c7345-7067-4ef0-97ca-14745fad39f8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:13.463759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ea9c7345-7067-4ef0-97ca-14745fad39f8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:13.471668 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ea9c7345-7067-4ef0-97ca-14745fad39f8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1680 microversion: 2.1 time: 0.153557 Oct 24 11:53:13.472243 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3917/7857] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:13 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:14.495834 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e4dd558-48a2-49f1-b636-e60493855741 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:14.496454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3e4dd558-48a2-49f1-b636-e60493855741 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:14.504211 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e4dd558-48a2-49f1-b636-e60493855741 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:14.504695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e4dd558-48a2-49f1-b636-e60493855741 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:14.505168 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e4dd558-48a2-49f1-b636-e60493855741 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:14.505868 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e4dd558-48a2-49f1-b636-e60493855741 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:14.506324 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e4dd558-48a2-49f1-b636-e60493855741 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:14.506762 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e4dd558-48a2-49f1-b636-e60493855741 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:14.641283 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3e4dd558-48a2-49f1-b636-e60493855741 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:14.650564 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3e4dd558-48a2-49f1-b636-e60493855741 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1680 microversion: 2.1 time: 0.158632 Oct 24 11:53:14.651153 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3941/7858] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:14 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:15.673982 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6092eef8-9d48-4b9f-a660-2fbe8a815dab tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:15.674620 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6092eef8-9d48-4b9f-a660-2fbe8a815dab tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:15.681557 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6092eef8-9d48-4b9f-a660-2fbe8a815dab tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:15.682058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6092eef8-9d48-4b9f-a660-2fbe8a815dab tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:15.682510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6092eef8-9d48-4b9f-a660-2fbe8a815dab tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:15.683220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6092eef8-9d48-4b9f-a660-2fbe8a815dab tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:15.683694 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6092eef8-9d48-4b9f-a660-2fbe8a815dab tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:15.684139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6092eef8-9d48-4b9f-a660-2fbe8a815dab tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:15.817839 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6092eef8-9d48-4b9f-a660-2fbe8a815dab tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:15.825821 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6092eef8-9d48-4b9f-a660-2fbe8a815dab tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1680 microversion: 2.1 time: 0.155969 Oct 24 11:53:15.826446 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3918/7859] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:15 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:16.850708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-912ee978-94a1-4356-82a7-608d0db758dd tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:16.851322 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-912ee978-94a1-4356-82a7-608d0db758dd tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:16.858256 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-912ee978-94a1-4356-82a7-608d0db758dd tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:16.858736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-912ee978-94a1-4356-82a7-608d0db758dd tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:16.859197 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-912ee978-94a1-4356-82a7-608d0db758dd tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:16.859887 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-912ee978-94a1-4356-82a7-608d0db758dd tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:16.860338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-912ee978-94a1-4356-82a7-608d0db758dd tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:16.860787 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-912ee978-94a1-4356-82a7-608d0db758dd tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:16.995611 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-912ee978-94a1-4356-82a7-608d0db758dd tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:17.003477 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-912ee978-94a1-4356-82a7-608d0db758dd tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1701 microversion: 2.1 time: 0.156635 Oct 24 11:53:17.004047 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3942/7860] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:16 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1701 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:18.027302 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-34292b80-16f1-428f-ac90-6ab2d49c1fee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:18.027921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-34292b80-16f1-428f-ac90-6ab2d49c1fee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:18.035872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34292b80-16f1-428f-ac90-6ab2d49c1fee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:18.036383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34292b80-16f1-428f-ac90-6ab2d49c1fee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:18.036862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34292b80-16f1-428f-ac90-6ab2d49c1fee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:18.037591 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34292b80-16f1-428f-ac90-6ab2d49c1fee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:18.038095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34292b80-16f1-428f-ac90-6ab2d49c1fee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:18.038572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-34292b80-16f1-428f-ac90-6ab2d49c1fee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:18.174540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-34292b80-16f1-428f-ac90-6ab2d49c1fee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:18.182426 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-34292b80-16f1-428f-ac90-6ab2d49c1fee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1701 microversion: 2.1 time: 0.159202 Oct 24 11:53:18.183006 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3919/7861] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:18 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1701 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:19.207675 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-1e7958ec-ba11-4285-8243-cf5680563261 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:19.208292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-1e7958ec-ba11-4285-8243-cf5680563261 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:19.215880 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e7958ec-ba11-4285-8243-cf5680563261 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:19.216362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e7958ec-ba11-4285-8243-cf5680563261 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:19.216815 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e7958ec-ba11-4285-8243-cf5680563261 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:19.217572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e7958ec-ba11-4285-8243-cf5680563261 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:19.218039 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e7958ec-ba11-4285-8243-cf5680563261 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:19.218693 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-1e7958ec-ba11-4285-8243-cf5680563261 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:19.377007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-1e7958ec-ba11-4285-8243-cf5680563261 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:19.384989 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-1e7958ec-ba11-4285-8243-cf5680563261 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1696 microversion: 2.1 time: 0.182564 Oct 24 11:53:19.385983 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3943/7862] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:19 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:19.726670 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-221e3afd-1f3f-433f-8698-01245ab334e8 req-7c4afcce-8d29-40c1-8ad5-397902cc1349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee8b5e5c-5866-4a47-8e42-450bf32e5c73", "name": "network-vif-plugged", "status": "completed", "tag": "7cbb33c4-3372-403a-9fc7-3316f2bbcda4"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:53:19.745309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-221e3afd-1f3f-433f-8698-01245ab334e8 req-7c4afcce-8d29-40c1-8ad5-397902cc1349 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:19.746001 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-221e3afd-1f3f-433f-8698-01245ab334e8 req-7c4afcce-8d29-40c1-8ad5-397902cc1349 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:19.746439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-221e3afd-1f3f-433f-8698-01245ab334e8 req-7c4afcce-8d29-40c1-8ad5-397902cc1349 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:19.760193 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-221e3afd-1f3f-433f-8698-01245ab334e8 req-7c4afcce-8d29-40c1-8ad5-397902cc1349 service nova] Creating event network-vif-plugged:7cbb33c4-3372-403a-9fc7-3316f2bbcda4 for instance ee8b5e5c-5866-4a47-8e42-450bf32e5c73 on n-h2-858383-15 Oct 24 11:53:19.766358 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-221e3afd-1f3f-433f-8698-01245ab334e8 req-7c4afcce-8d29-40c1-8ad5-397902cc1349 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128934 Oct 24 11:53:19.767917 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3920/7863] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:53:20.411009 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d4c6ce30-be8e-49b6-8def-258a75ee4279 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:20.412290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d4c6ce30-be8e-49b6-8def-258a75ee4279 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:20.420254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c6ce30-be8e-49b6-8def-258a75ee4279 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:20.421001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c6ce30-be8e-49b6-8def-258a75ee4279 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:20.421809 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c6ce30-be8e-49b6-8def-258a75ee4279 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:20.423567 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c6ce30-be8e-49b6-8def-258a75ee4279 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:20.424349 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c6ce30-be8e-49b6-8def-258a75ee4279 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:20.424784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d4c6ce30-be8e-49b6-8def-258a75ee4279 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:20.582930 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d4c6ce30-be8e-49b6-8def-258a75ee4279 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:20.591089 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d4c6ce30-be8e-49b6-8def-258a75ee4279 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1696 microversion: 2.1 time: 0.184588 Oct 24 11:53:20.591925 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3944/7864] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:20 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:21.617746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b1e86b2-1c31-4c9a-94df-b46f35ecf32f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:21.618553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8b1e86b2-1c31-4c9a-94df-b46f35ecf32f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:21.625537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b1e86b2-1c31-4c9a-94df-b46f35ecf32f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:21.627069 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b1e86b2-1c31-4c9a-94df-b46f35ecf32f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:21.627547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b1e86b2-1c31-4c9a-94df-b46f35ecf32f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:21.628307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b1e86b2-1c31-4c9a-94df-b46f35ecf32f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:21.628786 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b1e86b2-1c31-4c9a-94df-b46f35ecf32f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:21.629266 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b1e86b2-1c31-4c9a-94df-b46f35ecf32f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:21.777509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8b1e86b2-1c31-4c9a-94df-b46f35ecf32f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:21.784818 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b1e86b2-1c31-4c9a-94df-b46f35ecf32f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1696 microversion: 2.1 time: 0.172374 Oct 24 11:53:21.785754 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3921/7865] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:21 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:22.817445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3c7997af-e69e-4157-8236-0cc014a4e0b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:22.818977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3c7997af-e69e-4157-8236-0cc014a4e0b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:22.826801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3c7997af-e69e-4157-8236-0cc014a4e0b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:22.827386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3c7997af-e69e-4157-8236-0cc014a4e0b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:22.827893 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3c7997af-e69e-4157-8236-0cc014a4e0b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:22.828672 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3c7997af-e69e-4157-8236-0cc014a4e0b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:22.829268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3c7997af-e69e-4157-8236-0cc014a4e0b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:22.829764 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3c7997af-e69e-4157-8236-0cc014a4e0b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:22.982579 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3c7997af-e69e-4157-8236-0cc014a4e0b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:22.992338 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3c7997af-e69e-4157-8236-0cc014a4e0b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1696 microversion: 2.1 time: 0.178727 Oct 24 11:53:23.003072 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3945/7866] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:22 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1696 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:24.015783 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-156d8e96-0c45-4f13-b98b-a1dca3b930ca tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:24.017083 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-156d8e96-0c45-4f13-b98b-a1dca3b930ca tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:24.024432 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-156d8e96-0c45-4f13-b98b-a1dca3b930ca tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:24.025087 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-156d8e96-0c45-4f13-b98b-a1dca3b930ca tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:24.025830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-156d8e96-0c45-4f13-b98b-a1dca3b930ca tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:24.026805 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-156d8e96-0c45-4f13-b98b-a1dca3b930ca tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:24.027739 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-156d8e96-0c45-4f13-b98b-a1dca3b930ca tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:24.028197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-156d8e96-0c45-4f13-b98b-a1dca3b930ca tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:24.186517 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-156d8e96-0c45-4f13-b98b-a1dca3b930ca tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:24.195236 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-156d8e96-0c45-4f13-b98b-a1dca3b930ca tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1696 microversion: 2.1 time: 0.183352 Oct 24 11:53:24.195820 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3922/7867] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:24 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:25.218645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a957ab46-db3d-45a9-b280-faf2d3c30b9b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:25.219284 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a957ab46-db3d-45a9-b280-faf2d3c30b9b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:25.226340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a957ab46-db3d-45a9-b280-faf2d3c30b9b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:25.226844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a957ab46-db3d-45a9-b280-faf2d3c30b9b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:25.227285 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a957ab46-db3d-45a9-b280-faf2d3c30b9b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:25.228004 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a957ab46-db3d-45a9-b280-faf2d3c30b9b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:25.228464 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a957ab46-db3d-45a9-b280-faf2d3c30b9b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:25.228992 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a957ab46-db3d-45a9-b280-faf2d3c30b9b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:25.379300 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a957ab46-db3d-45a9-b280-faf2d3c30b9b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:25.386486 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a957ab46-db3d-45a9-b280-faf2d3c30b9b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1696 microversion: 2.1 time: 0.171728 Oct 24 11:53:25.387279 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3946/7868] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:25 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:26.411048 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-08fe6cac-13c0-4dd6-a4ce-e0592e6389c9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:26.411691 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-08fe6cac-13c0-4dd6-a4ce-e0592e6389c9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:26.418955 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08fe6cac-13c0-4dd6-a4ce-e0592e6389c9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:26.419831 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08fe6cac-13c0-4dd6-a4ce-e0592e6389c9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:26.421409 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08fe6cac-13c0-4dd6-a4ce-e0592e6389c9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:26.427732 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08fe6cac-13c0-4dd6-a4ce-e0592e6389c9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:26.428406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08fe6cac-13c0-4dd6-a4ce-e0592e6389c9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:26.428921 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-08fe6cac-13c0-4dd6-a4ce-e0592e6389c9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:26.632061 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-08fe6cac-13c0-4dd6-a4ce-e0592e6389c9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:26.641228 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-08fe6cac-13c0-4dd6-a4ce-e0592e6389c9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1696 microversion: 2.1 time: 0.234632 Oct 24 11:53:26.646362 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3923/7869] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:26 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1696 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:27.666775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0922fe12-077f-4ae8-af96-3ca3e46400e3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:27.667475 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0922fe12-077f-4ae8-af96-3ca3e46400e3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:27.675114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0922fe12-077f-4ae8-af96-3ca3e46400e3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:27.675741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0922fe12-077f-4ae8-af96-3ca3e46400e3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:27.676184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0922fe12-077f-4ae8-af96-3ca3e46400e3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:27.676907 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0922fe12-077f-4ae8-af96-3ca3e46400e3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:27.677365 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0922fe12-077f-4ae8-af96-3ca3e46400e3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:27.677796 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0922fe12-077f-4ae8-af96-3ca3e46400e3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:27.824178 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0922fe12-077f-4ae8-af96-3ca3e46400e3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:27.833118 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0922fe12-077f-4ae8-af96-3ca3e46400e3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1696 microversion: 2.1 time: 0.170872 Oct 24 11:53:27.847984 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3947/7870] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:27 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:28.858539 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-0e9c424e-fc78-4817-9794-a3c1b2ec6a2f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:28.859201 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-0e9c424e-fc78-4817-9794-a3c1b2ec6a2f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:28.867123 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e9c424e-fc78-4817-9794-a3c1b2ec6a2f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:28.867727 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e9c424e-fc78-4817-9794-a3c1b2ec6a2f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:28.868399 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e9c424e-fc78-4817-9794-a3c1b2ec6a2f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:28.869154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e9c424e-fc78-4817-9794-a3c1b2ec6a2f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:28.869627 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e9c424e-fc78-4817-9794-a3c1b2ec6a2f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:28.870066 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-0e9c424e-fc78-4817-9794-a3c1b2ec6a2f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:29.014309 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-0e9c424e-fc78-4817-9794-a3c1b2ec6a2f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:29.022486 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-0e9c424e-fc78-4817-9794-a3c1b2ec6a2f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1678 microversion: 2.1 time: 0.169039 Oct 24 11:53:29.023084 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3924/7871] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:28 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:30.047610 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-addfcb23-0438-444d-ad36-6e444e5b78b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:30.048227 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-addfcb23-0438-444d-ad36-6e444e5b78b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:30.055593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-addfcb23-0438-444d-ad36-6e444e5b78b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:30.056085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-addfcb23-0438-444d-ad36-6e444e5b78b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:30.056518 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-addfcb23-0438-444d-ad36-6e444e5b78b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:30.057257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-addfcb23-0438-444d-ad36-6e444e5b78b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:30.057713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-addfcb23-0438-444d-ad36-6e444e5b78b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:30.058137 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-addfcb23-0438-444d-ad36-6e444e5b78b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:30.190202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-addfcb23-0438-444d-ad36-6e444e5b78b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:30.198312 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-addfcb23-0438-444d-ad36-6e444e5b78b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1678 microversion: 2.1 time: 0.154643 Oct 24 11:53:30.198884 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3948/7872] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:30 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:31.221445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-30dc82fb-d00f-47a9-b795-dacb465bda90 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:31.222099 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-30dc82fb-d00f-47a9-b795-dacb465bda90 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:31.229018 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30dc82fb-d00f-47a9-b795-dacb465bda90 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:31.229515 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30dc82fb-d00f-47a9-b795-dacb465bda90 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:31.229963 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30dc82fb-d00f-47a9-b795-dacb465bda90 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:31.230672 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30dc82fb-d00f-47a9-b795-dacb465bda90 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:31.231137 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30dc82fb-d00f-47a9-b795-dacb465bda90 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:31.231574 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30dc82fb-d00f-47a9-b795-dacb465bda90 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:31.371507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-30dc82fb-d00f-47a9-b795-dacb465bda90 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:31.380231 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-30dc82fb-d00f-47a9-b795-dacb465bda90 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1621 microversion: 2.1 time: 0.162632 Oct 24 11:53:31.380752 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3925/7873] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:31 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1621 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:31.403138 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-401f729e-c722-4292-979c-bd050f0d430e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:53:31.403768 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-401f729e-c722-4292-979c-bd050f0d430e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:31.410932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-401f729e-c722-4292-979c-bd050f0d430e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:31.411417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-401f729e-c722-4292-979c-bd050f0d430e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:31.411850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-401f729e-c722-4292-979c-bd050f0d430e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:31.412534 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-401f729e-c722-4292-979c-bd050f0d430e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:31.413011 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-401f729e-c722-4292-979c-bd050f0d430e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:31.413436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-401f729e-c722-4292-979c-bd050f0d430e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:31.515596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-401f729e-c722-4292-979c-bd050f0d430e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120426) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 24 11:53:31.591749 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-401f729e-c722-4292-979c-bd050f0d430e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "POST /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73/action" status: 202 len: 0 microversion: 2.1 time: 0.192520 Oct 24 11:53:31.592948 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3949/7874] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:53:31 2022] POST /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:53:31.601359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-e021313c-5376-453d-887f-ba3e81fd0a8e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:31.602269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-e021313c-5376-453d-887f-ba3e81fd0a8e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:31.608652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e021313c-5376-453d-887f-ba3e81fd0a8e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:31.609175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e021313c-5376-453d-887f-ba3e81fd0a8e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:31.609829 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e021313c-5376-453d-887f-ba3e81fd0a8e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:31.610779 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e021313c-5376-453d-887f-ba3e81fd0a8e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:31.612382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e021313c-5376-453d-887f-ba3e81fd0a8e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:31.613101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-e021313c-5376-453d-887f-ba3e81fd0a8e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:31.669497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-245c9e36-5a4d-4004-8312-fb8d7fed7cb7 req-16fa7fdf-2be1-452d-81ba-3d387aaf2d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee8b5e5c-5866-4a47-8e42-450bf32e5c73", "name": "network-vif-unplugged", "status": "completed", "tag": "7cbb33c4-3372-403a-9fc7-3316f2bbcda4"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:53:31.696136 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-245c9e36-5a4d-4004-8312-fb8d7fed7cb7 req-16fa7fdf-2be1-452d-81ba-3d387aaf2d0e service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:31.700884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-245c9e36-5a4d-4004-8312-fb8d7fed7cb7 req-16fa7fdf-2be1-452d-81ba-3d387aaf2d0e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:31.700884 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-245c9e36-5a4d-4004-8312-fb8d7fed7cb7 req-16fa7fdf-2be1-452d-81ba-3d387aaf2d0e service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:31.713820 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.compute.server_external_events [req-245c9e36-5a4d-4004-8312-fb8d7fed7cb7 req-16fa7fdf-2be1-452d-81ba-3d387aaf2d0e service nova] Unable to find a host for instance ee8b5e5c-5866-4a47-8e42-450bf32e5c73. Dropping event network-vif-unplugged {{(pid=120426) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 24 11:53:31.714750 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-245c9e36-5a4d-4004-8312-fb8d7fed7cb7 req-16fa7fdf-2be1-452d-81ba-3d387aaf2d0e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.050476 Oct 24 11:53:31.715711 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3950/7875] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 24 11:53:31.803651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-e021313c-5376-453d-887f-ba3e81fd0a8e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:31.811699 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-e021313c-5376-453d-887f-ba3e81fd0a8e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1629 microversion: 2.1 time: 0.214381 Oct 24 11:53:31.812382 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3926/7876] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:31 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1629 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:32.835739 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-79480b17-5e03-40dd-9fec-8142c3e2a325 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:32.836269 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-79480b17-5e03-40dd-9fec-8142c3e2a325 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:32.843175 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79480b17-5e03-40dd-9fec-8142c3e2a325 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:32.843651 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79480b17-5e03-40dd-9fec-8142c3e2a325 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:32.844081 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79480b17-5e03-40dd-9fec-8142c3e2a325 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:32.844770 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79480b17-5e03-40dd-9fec-8142c3e2a325 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:32.845252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79480b17-5e03-40dd-9fec-8142c3e2a325 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:32.845763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-79480b17-5e03-40dd-9fec-8142c3e2a325 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:32.849823 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:53:32.980415 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-79480b17-5e03-40dd-9fec-8142c3e2a325 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:32.988982 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-79480b17-5e03-40dd-9fec-8142c3e2a325 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1687 microversion: 2.1 time: 0.157077 Oct 24 11:53:32.989573 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3951/7877] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:32 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:53:34.014197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-c7d562fd-d6cc-489c-9ca0-15de293030e8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:34.015486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-c7d562fd-d6cc-489c-9ca0-15de293030e8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:34.023599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7d562fd-d6cc-489c-9ca0-15de293030e8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:34.024470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7d562fd-d6cc-489c-9ca0-15de293030e8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:34.024971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7d562fd-d6cc-489c-9ca0-15de293030e8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:34.025903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7d562fd-d6cc-489c-9ca0-15de293030e8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:34.026673 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7d562fd-d6cc-489c-9ca0-15de293030e8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:34.027196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-c7d562fd-d6cc-489c-9ca0-15de293030e8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:34.183161 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-c7d562fd-d6cc-489c-9ca0-15de293030e8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:34.195581 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-c7d562fd-d6cc-489c-9ca0-15de293030e8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1687 microversion: 2.1 time: 0.185146 Oct 24 11:53:34.207683 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3927/7878] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:34 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1687 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:35.222040 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e3c7dc0d-634d-4c3a-b4f0-dd0c6c4c37a7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:35.222679 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e3c7dc0d-634d-4c3a-b4f0-dd0c6c4c37a7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:35.229735 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3c7dc0d-634d-4c3a-b4f0-dd0c6c4c37a7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:35.230226 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3c7dc0d-634d-4c3a-b4f0-dd0c6c4c37a7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:35.230666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3c7dc0d-634d-4c3a-b4f0-dd0c6c4c37a7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:35.231376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3c7dc0d-634d-4c3a-b4f0-dd0c6c4c37a7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:35.231832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3c7dc0d-634d-4c3a-b4f0-dd0c6c4c37a7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:35.232257 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e3c7dc0d-634d-4c3a-b4f0-dd0c6c4c37a7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:35.377653 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e3c7dc0d-634d-4c3a-b4f0-dd0c6c4c37a7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:35.386121 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e3c7dc0d-634d-4c3a-b4f0-dd0c6c4c37a7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1687 microversion: 2.1 time: 0.168664 Oct 24 11:53:35.396016 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3952/7879] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:35 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:36.411931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3cee024b-59ed-45c5-9d20-3af258f7019b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:36.412579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3cee024b-59ed-45c5-9d20-3af258f7019b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:36.416683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=29 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:53:36.422451 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cee024b-59ed-45c5-9d20-3af258f7019b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:36.422968 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cee024b-59ed-45c5-9d20-3af258f7019b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:36.424242 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cee024b-59ed-45c5-9d20-3af258f7019b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:36.425270 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cee024b-59ed-45c5-9d20-3af258f7019b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:36.425756 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cee024b-59ed-45c5-9d20-3af258f7019b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:36.426441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3cee024b-59ed-45c5-9d20-3af258f7019b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:36.429543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=81 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:53:36.581758 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3cee024b-59ed-45c5-9d20-3af258f7019b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:36.589761 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3cee024b-59ed-45c5-9d20-3af258f7019b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1687 microversion: 2.1 time: 0.183228 Oct 24 11:53:36.590588 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3928/7880] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:36 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:37.615547 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c441ae51-3960-4b42-9a06-d2adee11b4f4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:37.616157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c441ae51-3960-4b42-9a06-d2adee11b4f4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:37.622022 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:53:37.623511 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c441ae51-3960-4b42-9a06-d2adee11b4f4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:37.624047 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c441ae51-3960-4b42-9a06-d2adee11b4f4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:37.624429 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c441ae51-3960-4b42-9a06-d2adee11b4f4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:37.625430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c441ae51-3960-4b42-9a06-d2adee11b4f4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:37.625883 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c441ae51-3960-4b42-9a06-d2adee11b4f4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:37.626308 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c441ae51-3960-4b42-9a06-d2adee11b4f4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:37.768417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c441ae51-3960-4b42-9a06-d2adee11b4f4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:37.776528 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c441ae51-3960-4b42-9a06-d2adee11b4f4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1687 microversion: 2.1 time: 0.165478 Oct 24 11:53:37.777148 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3953/7881] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:37 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:38.802695 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cfd545aa-59aa-44d2-866a-f69085e408c3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:38.803355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cfd545aa-59aa-44d2-866a-f69085e408c3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:38.809542 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfd545aa-59aa-44d2-866a-f69085e408c3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:38.810045 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfd545aa-59aa-44d2-866a-f69085e408c3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:38.810502 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfd545aa-59aa-44d2-866a-f69085e408c3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:38.811230 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfd545aa-59aa-44d2-866a-f69085e408c3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:38.811707 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfd545aa-59aa-44d2-866a-f69085e408c3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:38.812152 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cfd545aa-59aa-44d2-866a-f69085e408c3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:38.967143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cfd545aa-59aa-44d2-866a-f69085e408c3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:38.975991 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cfd545aa-59aa-44d2-866a-f69085e408c3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1687 microversion: 2.1 time: 0.177898 Oct 24 11:53:38.976882 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3929/7882] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:38 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:40.003659 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ce374908-67c4-4f37-b34e-17081d8c06b7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:40.004254 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ce374908-67c4-4f37-b34e-17081d8c06b7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:40.011618 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce374908-67c4-4f37-b34e-17081d8c06b7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:40.012111 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce374908-67c4-4f37-b34e-17081d8c06b7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:40.012566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce374908-67c4-4f37-b34e-17081d8c06b7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:40.013376 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce374908-67c4-4f37-b34e-17081d8c06b7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:40.013900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce374908-67c4-4f37-b34e-17081d8c06b7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:40.014435 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ce374908-67c4-4f37-b34e-17081d8c06b7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:40.160053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ce374908-67c4-4f37-b34e-17081d8c06b7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:40.168642 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ce374908-67c4-4f37-b34e-17081d8c06b7 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1687 microversion: 2.1 time: 0.168851 Oct 24 11:53:40.169591 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3954/7883] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:39 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:41.194698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-47ae412f-82d2-421e-98f2-0eebc9a99395 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:41.195407 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-47ae412f-82d2-421e-98f2-0eebc9a99395 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:41.202465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47ae412f-82d2-421e-98f2-0eebc9a99395 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:41.202969 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47ae412f-82d2-421e-98f2-0eebc9a99395 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:41.203420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47ae412f-82d2-421e-98f2-0eebc9a99395 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:41.204210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47ae412f-82d2-421e-98f2-0eebc9a99395 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:41.205314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47ae412f-82d2-421e-98f2-0eebc9a99395 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:41.205813 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-47ae412f-82d2-421e-98f2-0eebc9a99395 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:41.352941 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-47ae412f-82d2-421e-98f2-0eebc9a99395 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:41.361790 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-47ae412f-82d2-421e-98f2-0eebc9a99395 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1687 microversion: 2.1 time: 0.170941 Oct 24 11:53:41.364170 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3930/7884] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:41 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:42.386097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f0319dfd-808b-4208-b72c-3d028be4c15b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:42.386715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f0319dfd-808b-4208-b72c-3d028be4c15b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:42.394278 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0319dfd-808b-4208-b72c-3d028be4c15b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:42.394757 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0319dfd-808b-4208-b72c-3d028be4c15b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:42.395193 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0319dfd-808b-4208-b72c-3d028be4c15b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:42.395885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0319dfd-808b-4208-b72c-3d028be4c15b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:42.396338 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0319dfd-808b-4208-b72c-3d028be4c15b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:42.396765 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f0319dfd-808b-4208-b72c-3d028be4c15b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:42.539394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f0319dfd-808b-4208-b72c-3d028be4c15b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:42.547119 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f0319dfd-808b-4208-b72c-3d028be4c15b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1687 microversion: 2.1 time: 0.164964 Oct 24 11:53:42.547697 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3955/7885] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:42 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:43.571089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43b4e0d3-be4e-4141-b88f-1ec126f337cb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:43.571704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-43b4e0d3-be4e-4141-b88f-1ec126f337cb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:43.578724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43b4e0d3-be4e-4141-b88f-1ec126f337cb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:43.579227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43b4e0d3-be4e-4141-b88f-1ec126f337cb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:43.580278 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43b4e0d3-be4e-4141-b88f-1ec126f337cb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:43.581257 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43b4e0d3-be4e-4141-b88f-1ec126f337cb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:43.581734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43b4e0d3-be4e-4141-b88f-1ec126f337cb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:43.582196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43b4e0d3-be4e-4141-b88f-1ec126f337cb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:43.720646 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-43b4e0d3-be4e-4141-b88f-1ec126f337cb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:43.728543 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-43b4e0d3-be4e-4141-b88f-1ec126f337cb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1687 microversion: 2.1 time: 0.161373 Oct 24 11:53:43.729371 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3931/7886] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:43 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:44.752957 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-26bdfb5c-1b41-4b72-8453-39e4fa9e25f0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:44.753580 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-26bdfb5c-1b41-4b72-8453-39e4fa9e25f0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:44.760421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26bdfb5c-1b41-4b72-8453-39e4fa9e25f0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:44.760936 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26bdfb5c-1b41-4b72-8453-39e4fa9e25f0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:44.761378 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26bdfb5c-1b41-4b72-8453-39e4fa9e25f0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:44.762074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26bdfb5c-1b41-4b72-8453-39e4fa9e25f0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:44.762536 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26bdfb5c-1b41-4b72-8453-39e4fa9e25f0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:44.762969 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-26bdfb5c-1b41-4b72-8453-39e4fa9e25f0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:44.895832 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-26bdfb5c-1b41-4b72-8453-39e4fa9e25f0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:44.904093 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-26bdfb5c-1b41-4b72-8453-39e4fa9e25f0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1687 microversion: 2.1 time: 0.155498 Oct 24 11:53:44.904674 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3956/7887] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:44 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:45.929463 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d92b96d6-a92b-40fd-ae10-e50a0eda91df tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:45.930237 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d92b96d6-a92b-40fd-ae10-e50a0eda91df tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:45.937481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d92b96d6-a92b-40fd-ae10-e50a0eda91df tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:45.937988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d92b96d6-a92b-40fd-ae10-e50a0eda91df tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:45.938449 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d92b96d6-a92b-40fd-ae10-e50a0eda91df tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:45.939842 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d92b96d6-a92b-40fd-ae10-e50a0eda91df tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:45.940408 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d92b96d6-a92b-40fd-ae10-e50a0eda91df tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:45.940885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d92b96d6-a92b-40fd-ae10-e50a0eda91df tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:46.080860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d92b96d6-a92b-40fd-ae10-e50a0eda91df tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:46.090595 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d92b96d6-a92b-40fd-ae10-e50a0eda91df tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1687 microversion: 2.1 time: 0.164555 Oct 24 11:53:46.106000 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3932/7888] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:45 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1687 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:47.115238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-10d11d96-156a-442f-b030-01a4c2aedf08 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:47.115867 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-10d11d96-156a-442f-b030-01a4c2aedf08 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:47.122929 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10d11d96-156a-442f-b030-01a4c2aedf08 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:47.123368 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10d11d96-156a-442f-b030-01a4c2aedf08 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:47.123817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10d11d96-156a-442f-b030-01a4c2aedf08 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:47.124522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10d11d96-156a-442f-b030-01a4c2aedf08 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:47.125007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10d11d96-156a-442f-b030-01a4c2aedf08 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:47.125440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-10d11d96-156a-442f-b030-01a4c2aedf08 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:47.261684 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-10d11d96-156a-442f-b030-01a4c2aedf08 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:47.269673 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-10d11d96-156a-442f-b030-01a4c2aedf08 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1687 microversion: 2.1 time: 0.158967 Oct 24 11:53:47.270252 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3957/7889] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:47 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:47.784411 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-793a4e7e-3b6b-4bc7-a241-74028f8d14ba req-bd1e2f13-0a55-42d2-8611-9200e2a6913f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee8b5e5c-5866-4a47-8e42-450bf32e5c73", "name": "network-vif-plugged", "status": "completed", "tag": "7cbb33c4-3372-403a-9fc7-3316f2bbcda4"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:53:47.796101 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-793a4e7e-3b6b-4bc7-a241-74028f8d14ba req-bd1e2f13-0a55-42d2-8611-9200e2a6913f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:47.796613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-793a4e7e-3b6b-4bc7-a241-74028f8d14ba req-bd1e2f13-0a55-42d2-8611-9200e2a6913f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:47.797120 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-793a4e7e-3b6b-4bc7-a241-74028f8d14ba req-bd1e2f13-0a55-42d2-8611-9200e2a6913f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:47.809894 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-793a4e7e-3b6b-4bc7-a241-74028f8d14ba req-bd1e2f13-0a55-42d2-8611-9200e2a6913f service nova] Creating event network-vif-plugged:7cbb33c4-3372-403a-9fc7-3316f2bbcda4 for instance ee8b5e5c-5866-4a47-8e42-450bf32e5c73 on n-h2-858383-15 Oct 24 11:53:47.815307 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-793a4e7e-3b6b-4bc7-a241-74028f8d14ba req-bd1e2f13-0a55-42d2-8611-9200e2a6913f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035463 Oct 24 11:53:47.816229 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3933/7890] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:53:48.293395 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fdd04deb-7198-45e9-b25d-58f038a7a8c1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:48.293999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fdd04deb-7198-45e9-b25d-58f038a7a8c1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:48.301103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fdd04deb-7198-45e9-b25d-58f038a7a8c1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:48.301584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fdd04deb-7198-45e9-b25d-58f038a7a8c1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:48.302019 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fdd04deb-7198-45e9-b25d-58f038a7a8c1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:48.302709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fdd04deb-7198-45e9-b25d-58f038a7a8c1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:48.303160 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fdd04deb-7198-45e9-b25d-58f038a7a8c1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:48.303586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fdd04deb-7198-45e9-b25d-58f038a7a8c1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:48.435745 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fdd04deb-7198-45e9-b25d-58f038a7a8c1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:48.444011 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fdd04deb-7198-45e9-b25d-58f038a7a8c1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1687 microversion: 2.1 time: 0.154579 Oct 24 11:53:48.444587 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3958/7891] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:48 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:49.468662 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-263346ea-7eba-4870-a0ac-b07e7086ac5a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:49.469385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-263346ea-7eba-4870-a0ac-b07e7086ac5a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:49.476595 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-263346ea-7eba-4870-a0ac-b07e7086ac5a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:49.477127 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-263346ea-7eba-4870-a0ac-b07e7086ac5a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:49.477583 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-263346ea-7eba-4870-a0ac-b07e7086ac5a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:49.478294 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-263346ea-7eba-4870-a0ac-b07e7086ac5a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:49.478764 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-263346ea-7eba-4870-a0ac-b07e7086ac5a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:49.479208 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-263346ea-7eba-4870-a0ac-b07e7086ac5a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:49.620060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-263346ea-7eba-4870-a0ac-b07e7086ac5a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:49.628106 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-263346ea-7eba-4870-a0ac-b07e7086ac5a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1687 microversion: 2.1 time: 0.164802 Oct 24 11:53:49.628679 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3934/7892] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:49 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:53:50.651933 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-42661dad-849d-4b1e-89b9-576cc569ffdf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:53:50.652563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-42661dad-849d-4b1e-89b9-576cc569ffdf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:53:50.660014 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42661dad-849d-4b1e-89b9-576cc569ffdf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:50.660492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42661dad-849d-4b1e-89b9-576cc569ffdf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:50.660959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42661dad-849d-4b1e-89b9-576cc569ffdf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:50.661655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42661dad-849d-4b1e-89b9-576cc569ffdf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:53:50.662110 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42661dad-849d-4b1e-89b9-576cc569ffdf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:53:50.662566 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-42661dad-849d-4b1e-89b9-576cc569ffdf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:53:50.796941 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-42661dad-849d-4b1e-89b9-576cc569ffdf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:53:50.805250 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-42661dad-849d-4b1e-89b9-576cc569ffdf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1674 microversion: 2.1 time: 0.157171 Oct 24 11:53:50.805821 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3959/7893] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:53:50 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:02.914447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=13 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:55:02.915709 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=37 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:55:02.916912 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:55:02.917065 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:55:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 (ip 10.222.0.50) !!! Oct 24 11:55:02.917400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=13 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:55:02.918290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=52 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:55:02.918438 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:55:02.918536 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:55:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 (ip 10.222.0.50) !!! Oct 24 11:55:02.919841 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:55:02.920422 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:55:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.50) !!! Oct 24 11:55:02.924403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-075539e8-2650-4e13-be46-bacee41630f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:02.924931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-075539e8-2650-4e13-be46-bacee41630f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:02.933335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-075539e8-2650-4e13-be46-bacee41630f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:02.933837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-075539e8-2650-4e13-be46-bacee41630f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:02.934290 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-075539e8-2650-4e13-be46-bacee41630f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:02.935012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-075539e8-2650-4e13-be46-bacee41630f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:02.935485 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-075539e8-2650-4e13-be46-bacee41630f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:02.935933 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-075539e8-2650-4e13-be46-bacee41630f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:02.964668 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-075539e8-2650-4e13-be46-bacee41630f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:55:03.031202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-46c912a1-93c2-4d14-ba31-54244b99b65d req-ca8ddbf6-9af2-4d90-bfdc-52c5141a789a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee8b5e5c-5866-4a47-8e42-450bf32e5c73", "tag": "7cbb33c4-3372-403a-9fc7-3316f2bbcda4"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:55:03.042527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-46c912a1-93c2-4d14-ba31-54244b99b65d req-ca8ddbf6-9af2-4d90-bfdc-52c5141a789a service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:03.043355 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-46c912a1-93c2-4d14-ba31-54244b99b65d req-ca8ddbf6-9af2-4d90-bfdc-52c5141a789a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:03.044037 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-46c912a1-93c2-4d14-ba31-54244b99b65d req-ca8ddbf6-9af2-4d90-bfdc-52c5141a789a service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:03.054538 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-075539e8-2650-4e13-be46-bacee41630f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 204 len: 0 microversion: 2.1 time: 0.142247 Oct 24 11:55:03.055120 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3935/7894] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:55:02 2022] DELETE /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:55:03.061862 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-46c912a1-93c2-4d14-ba31-54244b99b65d req-ca8ddbf6-9af2-4d90-bfdc-52c5141a789a service nova] Creating event network-changed:7cbb33c4-3372-403a-9fc7-3316f2bbcda4 for instance ee8b5e5c-5866-4a47-8e42-450bf32e5c73 on n-h2-858383-15 Oct 24 11:55:03.063878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-01d501d7-0876-4d45-998a-ea8fbd3a4115 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:03.064676 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-01d501d7-0876-4d45-998a-ea8fbd3a4115 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:03.068610 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-46c912a1-93c2-4d14-ba31-54244b99b65d req-ca8ddbf6-9af2-4d90-bfdc-52c5141a789a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153234 Oct 24 11:55:03.069666 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3960/7895] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:55:03.071664 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01d501d7-0876-4d45-998a-ea8fbd3a4115 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:03.072177 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01d501d7-0876-4d45-998a-ea8fbd3a4115 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:03.072730 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01d501d7-0876-4d45-998a-ea8fbd3a4115 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:03.073371 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01d501d7-0876-4d45-998a-ea8fbd3a4115 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:03.073843 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01d501d7-0876-4d45-998a-ea8fbd3a4115 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:03.074267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-01d501d7-0876-4d45-998a-ea8fbd3a4115 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:03.264988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-01d501d7-0876-4d45-998a-ea8fbd3a4115 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:03.273045 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-01d501d7-0876-4d45-998a-ea8fbd3a4115 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1680 microversion: 2.1 time: 0.213145 Oct 24 11:55:03.273952 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3936/7896] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:03 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1680 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:04.299177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-71f29a61-c14e-4461-84b5-644b18371851 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:04.300088 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-71f29a61-c14e-4461-84b5-644b18371851 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:04.306512 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71f29a61-c14e-4461-84b5-644b18371851 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:04.306997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71f29a61-c14e-4461-84b5-644b18371851 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:04.307436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71f29a61-c14e-4461-84b5-644b18371851 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:04.308135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71f29a61-c14e-4461-84b5-644b18371851 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:04.308895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71f29a61-c14e-4461-84b5-644b18371851 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:04.309332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-71f29a61-c14e-4461-84b5-644b18371851 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:04.495386 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-71f29a61-c14e-4461-84b5-644b18371851 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:04.503555 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-71f29a61-c14e-4461-84b5-644b18371851 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1680 microversion: 2.1 time: 0.209650 Oct 24 11:55:04.504149 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3961/7897] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:04 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1680 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:05.239853 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-4ff2d1dd-5901-43dd-a0ef-02913a664ad1 req-8e790e0a-527c-44cb-9050-5eb0feb0bc11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee8b5e5c-5866-4a47-8e42-450bf32e5c73", "name": "network-vif-deleted", "tag": "7cbb33c4-3372-403a-9fc7-3316f2bbcda4"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:55:05.253860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4ff2d1dd-5901-43dd-a0ef-02913a664ad1 req-8e790e0a-527c-44cb-9050-5eb0feb0bc11 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:05.255212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4ff2d1dd-5901-43dd-a0ef-02913a664ad1 req-8e790e0a-527c-44cb-9050-5eb0feb0bc11 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:05.256062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-4ff2d1dd-5901-43dd-a0ef-02913a664ad1 req-8e790e0a-527c-44cb-9050-5eb0feb0bc11 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:05.272548 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-4ff2d1dd-5901-43dd-a0ef-02913a664ad1 req-8e790e0a-527c-44cb-9050-5eb0feb0bc11 service nova] Creating event network-vif-deleted:7cbb33c4-3372-403a-9fc7-3316f2bbcda4 for instance ee8b5e5c-5866-4a47-8e42-450bf32e5c73 on n-h2-858383-15 Oct 24 11:55:05.277728 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-4ff2d1dd-5901-43dd-a0ef-02913a664ad1 req-8e790e0a-527c-44cb-9050-5eb0feb0bc11 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042371 Oct 24 11:55:05.278442 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3937/7898] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:55:05.527666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-beaca909-e627-40e5-8cdb-8e4e581de037 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:05.528302 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-beaca909-e627-40e5-8cdb-8e4e581de037 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:05.537228 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-beaca909-e627-40e5-8cdb-8e4e581de037 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:05.537733 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-beaca909-e627-40e5-8cdb-8e4e581de037 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:05.538223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-beaca909-e627-40e5-8cdb-8e4e581de037 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:05.539337 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-beaca909-e627-40e5-8cdb-8e4e581de037 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:05.539921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-beaca909-e627-40e5-8cdb-8e4e581de037 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:05.540526 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-beaca909-e627-40e5-8cdb-8e4e581de037 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:05.579453 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-beaca909-e627-40e5-8cdb-8e4e581de037 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:05.580042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-beaca909-e627-40e5-8cdb-8e4e581de037 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:05.580496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-beaca909-e627-40e5-8cdb-8e4e581de037 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:05.581951 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-beaca909-e627-40e5-8cdb-8e4e581de037 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lazy-loading 'fault' on Instance uuid ee8b5e5c-5866-4a47-8e42-450bf32e5c73 {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:55:05.625594 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-beaca909-e627-40e5-8cdb-8e4e581de037 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:05.634595 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-beaca909-e627-40e5-8cdb-8e4e581de037 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 200 len: 1335 microversion: 2.1 time: 0.110676 Oct 24 11:55:05.635200 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3962/7899] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:05 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 1335 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:06.659316 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-30b7da56-e1ab-423d-83c6-b5d7957daa1f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:06.660191 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-30b7da56-e1ab-423d-83c6-b5d7957daa1f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: ee8b5e5c-5866-4a47-8e42-450bf32e5c73] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:06.667229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30b7da56-e1ab-423d-83c6-b5d7957daa1f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:06.667719 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30b7da56-e1ab-423d-83c6-b5d7957daa1f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:06.668166 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30b7da56-e1ab-423d-83c6-b5d7957daa1f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:06.669012 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30b7da56-e1ab-423d-83c6-b5d7957daa1f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:06.669596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30b7da56-e1ab-423d-83c6-b5d7957daa1f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:06.670181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-30b7da56-e1ab-423d-83c6-b5d7957daa1f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:06.684420 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-30b7da56-e1ab-423d-83c6-b5d7957daa1f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] HTTP exception thrown: Instance ee8b5e5c-5866-4a47-8e42-450bf32e5c73 could not be found. Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-30b7da56-e1ab-423d-83c6-b5d7957daa1f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Request method failure captured: Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 HTTP/1.1 Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnwd2FC6JJB-0ybDfCymOw5jlWtVuqHv8uqhwvy8vhO3yjL6waBeQrFhbdm3o-ybucQX5vb6vyrBa4SDXpFNiXTqjoKiwEzKMXesQHXhX_lm845wdWvPESKgxrngKg8rL2QwxL-3Ic5KvT0u15cHgj9yAG1yZacMffqzWhUus-06wkE Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: deefb20157d4407fb9e8824fcfe8441e Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestShelveInstance-1829583437 Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/deefb20157d4407fb9e8824fcfe8441e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/deefb20157d4407fb9e8824fcfe8441e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/deefb20157d4407fb9e8824fcfe8441e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_deefb20157d4407fb9e8824fcfe8441e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestShelveInstance-1829583437 Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: deefb20157d4407fb9e8824fcfe8441e Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestShelveInstance-1829583437 Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestShelveInstance-1829583437-project Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: b396cb63e0e541e687ce6740f0b14272 Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestShelveInstance-1829583437-project Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance ee8b5e5c-5866-4a47-8e42-450bf32e5c73 could not be found. Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': 'ee8b5e5c-5866-4a47-8e42-450bf32e5c73'} Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee8b5e5c-5866-4a47-8e42-450bf32e5c73 could not be found. Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee8b5e5c-5866-4a47-8e42-450bf32e5c73 could not be found. Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:55:06.686095 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:55:06.692848 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:55:06.692848 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:55:06.692848 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:55:06.692848 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:55:06.692848 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:55:06.692848 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee8b5e5c-5866-4a47-8e42-450bf32e5c73 could not be found. Oct 24 11:55:06.692848 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:55:06.692848 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-30b7da56-e1ab-423d-83c6-b5d7957daa1f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Returning 404 to user: Instance ee8b5e5c-5866-4a47-8e42-450bf32e5c73 could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:55:06.692848 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-30b7da56-e1ab-423d-83c6-b5d7957daa1f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73" status: 404 len: 111 microversion: 2.1 time: 0.032866 Oct 24 11:55:06.692848 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3938/7900] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:06 2022] GET /compute/v2.1/servers/ee8b5e5c-5866-4a47-8e42-450bf32e5c73 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:55:06.845310 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-38c1f63c-94bb-4670-b0c2-e4109bf7564f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '.version_select at 0x7f04d0e6cb80>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:06.871152 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-38c1f63c-94bb-4670-b0c2-e4109bf7564f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-331837165" status: 202 len: 0 microversion: 2.1 time: 0.030120 Oct 24 11:55:06.872058 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3963/7901] 10.222.0.50 () {58 vars in 1251 bytes} [Mon Oct 24 11:55:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-331837165 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:55:06.895872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b92ed742-dd82-4ef6-893a-2d3dd54a949b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Action: 'create', calling method: .version_select at 0x7f04d0364ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1705844384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCK3EBdaleRBJCQyFl1T4WaZdU81ZsMDBjRt9MZ0GCuNwW5mg/RK+XsbmuVtt37qmBb/XKfvf6wQLb2hQsg1RuVx0yWsZRhMnnTlUOvXCcMecv5HbgPds7Z45uwYVgZjg=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:55:06.912052 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-b92ed742-dd82-4ef6-893a-2d3dd54a949b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Getting quotas for project deefb20157d4407fb9e8824fcfe8441e. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:55:06.917158 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-b92ed742-dd82-4ef6-893a-2d3dd54a949b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Getting quotas for user b396cb63e0e541e687ce6740f0b14272 and project deefb20157d4407fb9e8824fcfe8441e. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:55:06.944220 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b92ed742-dd82-4ef6-893a-2d3dd54a949b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.052746 Oct 24 11:55:06.944873 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3939/7902] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:55:06 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:55:23.123242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=16 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:55:23.123989 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:55:23.129519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-155f7f11-dcdc-47da-a7f9-ad8b82988e6c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-817183223", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1705844384", "security_groups": [{"name": "tempest-secgroup-smoke-684265405"}], "networks": [{"uuid": "243555e8-cd00-4fe2-b360-4d179b064906"}], "block_device_mapping_v2": [{"uuid": "f4b72f22-8d24-4f59-af8b-35d2b6413a24", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:55:23.244390 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-155f7f11-dcdc-47da-a7f9-ad8b82988e6c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] validate_networks() for [('243555e8-cd00-4fe2-b360-4d179b064906', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:55:23.894981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-155f7f11-dcdc-47da-a7f9-ad8b82988e6c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:55:23.895410 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-155f7f11-dcdc-47da-a7f9-ad8b82988e6c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:55:23.895890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-155f7f11-dcdc-47da-a7f9-ad8b82988e6c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:55:23.896305 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-155f7f11-dcdc-47da-a7f9-ad8b82988e6c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:55:23.896724 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-155f7f11-dcdc-47da-a7f9-ad8b82988e6c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:55:23.905920 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-155f7f11-dcdc-47da-a7f9-ad8b82988e6c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:23.906408 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-155f7f11-dcdc-47da-a7f9-ad8b82988e6c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:23.906850 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-155f7f11-dcdc-47da-a7f9-ad8b82988e6c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:23.907606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-155f7f11-dcdc-47da-a7f9-ad8b82988e6c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:23.908332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-155f7f11-dcdc-47da-a7f9-ad8b82988e6c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:23.909412 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-155f7f11-dcdc-47da-a7f9-ad8b82988e6c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:23.927994 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-155f7f11-dcdc-47da-a7f9-ad8b82988e6c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Getting quotas for project deefb20157d4407fb9e8824fcfe8441e. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:55:23.933281 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-155f7f11-dcdc-47da-a7f9-ad8b82988e6c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Getting quotas for user b396cb63e0e541e687ce6740f0b14272 and project deefb20157d4407fb9e8824fcfe8441e. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:55:23.993625 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-155f7f11-dcdc-47da-a7f9-ad8b82988e6c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:55:23.995773 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-155f7f11-dcdc-47da-a7f9-ad8b82988e6c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f4b72f22-8d24-4f59-af8b-35d2b6413a24',volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:55:24.122809 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-155f7f11-dcdc-47da-a7f9-ad8b82988e6c tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.001375 Oct 24 11:55:24.130255 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3964/7903] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:55:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:55:24.133543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:55:24.134348 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=4 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:55:24.135258 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:55:24.139776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-13e73bdb-eaee-43d6-82f4-e616bf2cf2c3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:24.140397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-13e73bdb-eaee-43d6-82f4-e616bf2cf2c3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:24.208650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-13e73bdb-eaee-43d6-82f4-e616bf2cf2c3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:24.215930 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-13e73bdb-eaee-43d6-82f4-e616bf2cf2c3 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1088 microversion: 2.1 time: 0.084371 Oct 24 11:55:24.216512 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3940/7904] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:24 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1088 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:55:25.241572 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5bb519f7-86c1-40e6-9771-2e829b84c4e6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:25.242202 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5bb519f7-86c1-40e6-9771-2e829b84c4e6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:25.249750 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bb519f7-86c1-40e6-9771-2e829b84c4e6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:25.250542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bb519f7-86c1-40e6-9771-2e829b84c4e6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:25.251244 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bb519f7-86c1-40e6-9771-2e829b84c4e6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:25.251973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bb519f7-86c1-40e6-9771-2e829b84c4e6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:25.252423 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bb519f7-86c1-40e6-9771-2e829b84c4e6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:25.252874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5bb519f7-86c1-40e6-9771-2e829b84c4e6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:25.320097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5bb519f7-86c1-40e6-9771-2e829b84c4e6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:25.328650 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5bb519f7-86c1-40e6-9771-2e829b84c4e6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1204 microversion: 2.1 time: 0.092921 Oct 24 11:55:25.329277 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3965/7905] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:25 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1204 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:26.352904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-90d75db1-1191-4651-b7ed-6b67602f25ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:26.353753 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-90d75db1-1191-4651-b7ed-6b67602f25ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:26.360543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90d75db1-1191-4651-b7ed-6b67602f25ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:26.361255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90d75db1-1191-4651-b7ed-6b67602f25ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:26.361911 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90d75db1-1191-4651-b7ed-6b67602f25ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:26.363042 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90d75db1-1191-4651-b7ed-6b67602f25ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:26.363852 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90d75db1-1191-4651-b7ed-6b67602f25ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:26.365227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-90d75db1-1191-4651-b7ed-6b67602f25ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:26.506245 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-90d75db1-1191-4651-b7ed-6b67602f25ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:26.514314 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-90d75db1-1191-4651-b7ed-6b67602f25ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1271 microversion: 2.1 time: 0.165375 Oct 24 11:55:26.515157 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3941/7906] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:26 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:26.678911 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-ecb8e96c-d375-48b8-98cc-ee3c12f86f08 req-0f29e18a-bb8d-4d53-877d-4039c396e401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7344fa14-d4af-4416-8018-2926054b234d", "tag": "7f6de79a-2611-4503-be51-4236c09f34fc"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:55:26.691492 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ecb8e96c-d375-48b8-98cc-ee3c12f86f08 req-0f29e18a-bb8d-4d53-877d-4039c396e401 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:26.692236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ecb8e96c-d375-48b8-98cc-ee3c12f86f08 req-0f29e18a-bb8d-4d53-877d-4039c396e401 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:26.693513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ecb8e96c-d375-48b8-98cc-ee3c12f86f08 req-0f29e18a-bb8d-4d53-877d-4039c396e401 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:26.706576 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ecb8e96c-d375-48b8-98cc-ee3c12f86f08 req-0f29e18a-bb8d-4d53-877d-4039c396e401 service nova] Creating event network-changed:7f6de79a-2611-4503-be51-4236c09f34fc for instance 7344fa14-d4af-4416-8018-2926054b234d on n-h2-858383-15 Oct 24 11:55:26.712586 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-ecb8e96c-d375-48b8-98cc-ee3c12f86f08 req-0f29e18a-bb8d-4d53-877d-4039c396e401 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039245 Oct 24 11:55:26.713807 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3966/7907] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:55:27.541993 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-56382071-4846-4b82-afa8-6f9fd86f4667 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:27.543715 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-56382071-4846-4b82-afa8-6f9fd86f4667 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:27.552130 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56382071-4846-4b82-afa8-6f9fd86f4667 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:27.552752 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56382071-4846-4b82-afa8-6f9fd86f4667 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:27.553327 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56382071-4846-4b82-afa8-6f9fd86f4667 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:27.554159 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56382071-4846-4b82-afa8-6f9fd86f4667 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:27.554649 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56382071-4846-4b82-afa8-6f9fd86f4667 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:27.555102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-56382071-4846-4b82-afa8-6f9fd86f4667 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:27.710106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-56382071-4846-4b82-afa8-6f9fd86f4667 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:27.728118 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-56382071-4846-4b82-afa8-6f9fd86f4667 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1271 microversion: 2.1 time: 0.191621 Oct 24 11:55:27.728728 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3942/7908] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:27 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1271 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:55:28.753065 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cea43f63-04b2-4575-b232-1d26698dcae2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:28.753666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cea43f63-04b2-4575-b232-1d26698dcae2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:28.760268 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cea43f63-04b2-4575-b232-1d26698dcae2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:28.760924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cea43f63-04b2-4575-b232-1d26698dcae2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:28.761472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cea43f63-04b2-4575-b232-1d26698dcae2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:28.762312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cea43f63-04b2-4575-b232-1d26698dcae2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:28.762885 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cea43f63-04b2-4575-b232-1d26698dcae2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:28.763398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cea43f63-04b2-4575-b232-1d26698dcae2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:28.899217 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cea43f63-04b2-4575-b232-1d26698dcae2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:28.907212 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cea43f63-04b2-4575-b232-1d26698dcae2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1271 microversion: 2.1 time: 0.159577 Oct 24 11:55:28.908288 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3967/7909] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:28 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:29.930905 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-853ea1e3-c1ed-40d9-ac2c-581d9a750754 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:29.931579 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-853ea1e3-c1ed-40d9-ac2c-581d9a750754 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:29.938741 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-853ea1e3-c1ed-40d9-ac2c-581d9a750754 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:29.939255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-853ea1e3-c1ed-40d9-ac2c-581d9a750754 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:29.939772 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-853ea1e3-c1ed-40d9-ac2c-581d9a750754 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:29.940818 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-853ea1e3-c1ed-40d9-ac2c-581d9a750754 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:29.941335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-853ea1e3-c1ed-40d9-ac2c-581d9a750754 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:29.941819 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-853ea1e3-c1ed-40d9-ac2c-581d9a750754 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:30.088219 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-853ea1e3-c1ed-40d9-ac2c-581d9a750754 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:30.096096 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-853ea1e3-c1ed-40d9-ac2c-581d9a750754 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1271 microversion: 2.1 time: 0.169409 Oct 24 11:55:30.096682 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3943/7910] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:29 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:31.119740 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5064a5ee-6f5a-4e3d-9d22-bf2341ecc495 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:31.120353 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5064a5ee-6f5a-4e3d-9d22-bf2341ecc495 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:31.128199 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5064a5ee-6f5a-4e3d-9d22-bf2341ecc495 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:31.128528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5064a5ee-6f5a-4e3d-9d22-bf2341ecc495 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:31.129018 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5064a5ee-6f5a-4e3d-9d22-bf2341ecc495 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:31.129728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5064a5ee-6f5a-4e3d-9d22-bf2341ecc495 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:31.130163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5064a5ee-6f5a-4e3d-9d22-bf2341ecc495 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:31.130586 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5064a5ee-6f5a-4e3d-9d22-bf2341ecc495 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:31.261079 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5064a5ee-6f5a-4e3d-9d22-bf2341ecc495 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:31.269318 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5064a5ee-6f5a-4e3d-9d22-bf2341ecc495 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1259 microversion: 2.1 time: 0.153532 Oct 24 11:55:31.269896 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3968/7911] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:31 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:32.293499 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ac306ce1-6999-47a7-aaeb-07710b5596b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:32.294129 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ac306ce1-6999-47a7-aaeb-07710b5596b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:32.301597 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac306ce1-6999-47a7-aaeb-07710b5596b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:32.302098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac306ce1-6999-47a7-aaeb-07710b5596b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:32.302553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac306ce1-6999-47a7-aaeb-07710b5596b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:32.303263 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac306ce1-6999-47a7-aaeb-07710b5596b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:32.303734 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac306ce1-6999-47a7-aaeb-07710b5596b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:32.304181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ac306ce1-6999-47a7-aaeb-07710b5596b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:32.434790 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ac306ce1-6999-47a7-aaeb-07710b5596b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:32.443397 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ac306ce1-6999-47a7-aaeb-07710b5596b2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1259 microversion: 2.1 time: 0.153811 Oct 24 11:55:32.443971 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3944/7912] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:32 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:33.466924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4da8b7de-d4ce-4f8f-b8e5-9e59841ee8c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:33.467603 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4da8b7de-d4ce-4f8f-b8e5-9e59841ee8c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:33.474984 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4da8b7de-d4ce-4f8f-b8e5-9e59841ee8c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:33.475806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4da8b7de-d4ce-4f8f-b8e5-9e59841ee8c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:33.476252 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4da8b7de-d4ce-4f8f-b8e5-9e59841ee8c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:33.476963 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4da8b7de-d4ce-4f8f-b8e5-9e59841ee8c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:33.477440 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4da8b7de-d4ce-4f8f-b8e5-9e59841ee8c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:33.477863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4da8b7de-d4ce-4f8f-b8e5-9e59841ee8c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:33.617807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4da8b7de-d4ce-4f8f-b8e5-9e59841ee8c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:33.625521 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4da8b7de-d4ce-4f8f-b8e5-9e59841ee8c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1259 microversion: 2.1 time: 0.162488 Oct 24 11:55:33.626107 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3969/7913] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:33 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:34.648652 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-321088bb-388f-4d4b-8678-90e89038b91a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:34.649314 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-321088bb-388f-4d4b-8678-90e89038b91a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:34.652055 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:55:34.657683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-321088bb-388f-4d4b-8678-90e89038b91a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:34.659181 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-321088bb-388f-4d4b-8678-90e89038b91a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:34.659806 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-321088bb-388f-4d4b-8678-90e89038b91a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:34.660533 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-321088bb-388f-4d4b-8678-90e89038b91a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:34.661044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-321088bb-388f-4d4b-8678-90e89038b91a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:34.661497 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-321088bb-388f-4d4b-8678-90e89038b91a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:34.796106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-321088bb-388f-4d4b-8678-90e89038b91a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:34.803974 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-321088bb-388f-4d4b-8678-90e89038b91a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1259 microversion: 2.1 time: 0.159320 Oct 24 11:55:34.804557 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3945/7914] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:34 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:35.827766 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-bc4c4c81-fbc4-48b0-ae9d-312e705a0f89 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:35.828362 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-bc4c4c81-fbc4-48b0-ae9d-312e705a0f89 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:35.830881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:55:35.831689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:55:35.838382 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc4c4c81-fbc4-48b0-ae9d-312e705a0f89 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:35.838859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc4c4c81-fbc4-48b0-ae9d-312e705a0f89 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:35.839291 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc4c4c81-fbc4-48b0-ae9d-312e705a0f89 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:35.839987 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc4c4c81-fbc4-48b0-ae9d-312e705a0f89 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:35.840421 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc4c4c81-fbc4-48b0-ae9d-312e705a0f89 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:35.840851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-bc4c4c81-fbc4-48b0-ae9d-312e705a0f89 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:35.977316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-bc4c4c81-fbc4-48b0-ae9d-312e705a0f89 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:35.984962 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-bc4c4c81-fbc4-48b0-ae9d-312e705a0f89 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1259 microversion: 2.1 time: 0.161325 Oct 24 11:55:35.985533 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3970/7915] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:35 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:37.008058 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d770d851-5672-4541-9768-5f2ebe78bf72 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:37.008698 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d770d851-5672-4541-9768-5f2ebe78bf72 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:37.015631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d770d851-5672-4541-9768-5f2ebe78bf72 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:37.016121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d770d851-5672-4541-9768-5f2ebe78bf72 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:37.016576 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d770d851-5672-4541-9768-5f2ebe78bf72 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:37.017305 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d770d851-5672-4541-9768-5f2ebe78bf72 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:37.018397 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d770d851-5672-4541-9768-5f2ebe78bf72 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:37.018836 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d770d851-5672-4541-9768-5f2ebe78bf72 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:37.149782 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d770d851-5672-4541-9768-5f2ebe78bf72 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:37.157525 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d770d851-5672-4541-9768-5f2ebe78bf72 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1259 microversion: 2.1 time: 0.153381 Oct 24 11:55:37.159022 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3946/7916] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:37 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:38.181709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aafd318a-8c52-4161-9453-1ea44aa4af40 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:38.182384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aafd318a-8c52-4161-9453-1ea44aa4af40 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:38.188808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aafd318a-8c52-4161-9453-1ea44aa4af40 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:38.189313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aafd318a-8c52-4161-9453-1ea44aa4af40 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:38.190473 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aafd318a-8c52-4161-9453-1ea44aa4af40 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:38.191515 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aafd318a-8c52-4161-9453-1ea44aa4af40 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:38.191977 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aafd318a-8c52-4161-9453-1ea44aa4af40 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:38.192401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aafd318a-8c52-4161-9453-1ea44aa4af40 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:38.328248 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aafd318a-8c52-4161-9453-1ea44aa4af40 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:38.336273 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aafd318a-8c52-4161-9453-1ea44aa4af40 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1259 microversion: 2.1 time: 0.158709 Oct 24 11:55:38.337021 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3971/7917] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:38 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:39.360525 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-d5ef4551-f62d-4915-bfcf-0a37f2285ea1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:39.361088 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-d5ef4551-f62d-4915-bfcf-0a37f2285ea1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:39.368570 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ef4551-f62d-4915-bfcf-0a37f2285ea1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:39.369227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ef4551-f62d-4915-bfcf-0a37f2285ea1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:39.369684 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ef4551-f62d-4915-bfcf-0a37f2285ea1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:39.370477 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ef4551-f62d-4915-bfcf-0a37f2285ea1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:39.370943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ef4551-f62d-4915-bfcf-0a37f2285ea1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:39.371385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-d5ef4551-f62d-4915-bfcf-0a37f2285ea1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:39.502651 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-d5ef4551-f62d-4915-bfcf-0a37f2285ea1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:39.510799 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-d5ef4551-f62d-4915-bfcf-0a37f2285ea1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1259 microversion: 2.1 time: 0.155058 Oct 24 11:55:39.511375 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3947/7918] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:39 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:40.334381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-2ee463fd-50e8-4d8c-8ba7-ec67b08f36f2 req-81ae06fe-f09c-4263-a26c-60f7ddfa40f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7344fa14-d4af-4416-8018-2926054b234d", "name": "network-vif-plugged", "status": "completed", "tag": "7f6de79a-2611-4503-be51-4236c09f34fc"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:55:40.345336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2ee463fd-50e8-4d8c-8ba7-ec67b08f36f2 req-81ae06fe-f09c-4263-a26c-60f7ddfa40f9 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:40.346595 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2ee463fd-50e8-4d8c-8ba7-ec67b08f36f2 req-81ae06fe-f09c-4263-a26c-60f7ddfa40f9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:40.347104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-2ee463fd-50e8-4d8c-8ba7-ec67b08f36f2 req-81ae06fe-f09c-4263-a26c-60f7ddfa40f9 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:40.358575 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-2ee463fd-50e8-4d8c-8ba7-ec67b08f36f2 req-81ae06fe-f09c-4263-a26c-60f7ddfa40f9 service nova] Creating event network-vif-plugged:7f6de79a-2611-4503-be51-4236c09f34fc for instance 7344fa14-d4af-4416-8018-2926054b234d on n-h2-858383-15 Oct 24 11:55:40.363719 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-2ee463fd-50e8-4d8c-8ba7-ec67b08f36f2 req-81ae06fe-f09c-4263-a26c-60f7ddfa40f9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034018 Oct 24 11:55:40.364338 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3972/7919] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:55:40.534838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-88c91fa7-326e-4483-87bd-8f40be4764ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:40.535601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-88c91fa7-326e-4483-87bd-8f40be4764ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:40.542667 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88c91fa7-326e-4483-87bd-8f40be4764ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:40.543248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88c91fa7-326e-4483-87bd-8f40be4764ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:40.543776 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88c91fa7-326e-4483-87bd-8f40be4764ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:40.544560 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88c91fa7-326e-4483-87bd-8f40be4764ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:40.545136 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88c91fa7-326e-4483-87bd-8f40be4764ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:40.545657 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88c91fa7-326e-4483-87bd-8f40be4764ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:40.676480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-88c91fa7-326e-4483-87bd-8f40be4764ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:40.684276 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-88c91fa7-326e-4483-87bd-8f40be4764ac tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1259 microversion: 2.1 time: 0.154179 Oct 24 11:55:40.684883 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3948/7920] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:40 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:41.709189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-f1a2a51b-28e0-441e-a1a5-1e17d059fdb9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:41.709892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-f1a2a51b-28e0-441e-a1a5-1e17d059fdb9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:41.716044 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1a2a51b-28e0-441e-a1a5-1e17d059fdb9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:41.716528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1a2a51b-28e0-441e-a1a5-1e17d059fdb9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:41.716999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1a2a51b-28e0-441e-a1a5-1e17d059fdb9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:41.717699 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1a2a51b-28e0-441e-a1a5-1e17d059fdb9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:41.718153 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1a2a51b-28e0-441e-a1a5-1e17d059fdb9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:41.718582 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-f1a2a51b-28e0-441e-a1a5-1e17d059fdb9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:41.855121 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-f1a2a51b-28e0-441e-a1a5-1e17d059fdb9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:41.863766 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-f1a2a51b-28e0-441e-a1a5-1e17d059fdb9 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1442 microversion: 2.1 time: 0.160298 Oct 24 11:55:41.864339 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3973/7921] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:41 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1442 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:41.886701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4f8072c2-4cf5-4e4f-a8a1-6fb786e85259 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:55:41.887335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4f8072c2-4cf5-4e4f-a8a1-6fb786e85259 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:55:41.894566 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f8072c2-4cf5-4e4f-a8a1-6fb786e85259 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:41.895070 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f8072c2-4cf5-4e4f-a8a1-6fb786e85259 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:41.895530 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f8072c2-4cf5-4e4f-a8a1-6fb786e85259 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:41.896248 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f8072c2-4cf5-4e4f-a8a1-6fb786e85259 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:41.896723 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f8072c2-4cf5-4e4f-a8a1-6fb786e85259 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:41.897197 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4f8072c2-4cf5-4e4f-a8a1-6fb786e85259 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:42.027223 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4f8072c2-4cf5-4e4f-a8a1-6fb786e85259 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:55:42.035962 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4f8072c2-4cf5-4e4f-a8a1-6fb786e85259 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1442 microversion: 2.1 time: 0.153152 Oct 24 11:55:42.036550 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3949/7922] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:55:41 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1442 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:55:43.687771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-ea36fd5b-7202-42ad-b608-91df4d8be5c1 req-1cb87fc3-905f-43dd-a649-ff9d0bf0655b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7344fa14-d4af-4416-8018-2926054b234d", "tag": "7f6de79a-2611-4503-be51-4236c09f34fc"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:55:43.698400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ea36fd5b-7202-42ad-b608-91df4d8be5c1 req-1cb87fc3-905f-43dd-a649-ff9d0bf0655b service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:55:43.699073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ea36fd5b-7202-42ad-b608-91df4d8be5c1 req-1cb87fc3-905f-43dd-a649-ff9d0bf0655b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:55:43.699587 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ea36fd5b-7202-42ad-b608-91df4d8be5c1 req-1cb87fc3-905f-43dd-a649-ff9d0bf0655b service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:55:43.711719 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ea36fd5b-7202-42ad-b608-91df4d8be5c1 req-1cb87fc3-905f-43dd-a649-ff9d0bf0655b service nova] Creating event network-changed:7f6de79a-2611-4503-be51-4236c09f34fc for instance 7344fa14-d4af-4416-8018-2926054b234d on n-h2-858383-15 Oct 24 11:55:43.717092 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-ea36fd5b-7202-42ad-b608-91df4d8be5c1 req-1cb87fc3-905f-43dd-a649-ff9d0bf0655b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093051 Oct 24 11:55:43.717922 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3974/7923] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 11:57:39.952156 n-d-858383-15 devstack@n-api.service[120425]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ebd6dc19-988c-4764-bcee-cebc857bf132] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 11:57:39.953341 n-d-858383-15 devstack@n-api.service[120425]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1abc338e-6c14-4311-a7b3-814582834b4a] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 11:57:39.953907 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=22 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:57:39.954677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=54 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:57:39.955941 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 24 11:57:39.956084 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:57:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d/action (ip 10.222.0.50) !!! Oct 24 11:57:40.016797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2a67db02-5dc9-4ec1-a26f-522793bb3fc8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:57:40.017385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2a67db02-5dc9-4ec1-a26f-522793bb3fc8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:40.023380 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a67db02-5dc9-4ec1-a26f-522793bb3fc8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:40.023877 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a67db02-5dc9-4ec1-a26f-522793bb3fc8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:40.024360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a67db02-5dc9-4ec1-a26f-522793bb3fc8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:40.025090 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a67db02-5dc9-4ec1-a26f-522793bb3fc8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:40.025552 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a67db02-5dc9-4ec1-a26f-522793bb3fc8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:40.025987 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2a67db02-5dc9-4ec1-a26f-522793bb3fc8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:40.051812 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-2a67db02-5dc9-4ec1-a26f-522793bb3fc8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lazy-loading 'flavor' on Instance uuid 7344fa14-d4af-4416-8018-2926054b234d {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:57:40.128810 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2a67db02-5dc9-4ec1-a26f-522793bb3fc8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "POST /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d/action" status: 202 len: 0 microversion: 2.1 time: 0.178164 Oct 24 11:57:40.129457 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3950/7924] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:57:39 2022] POST /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:57:40.135931 n-d-858383-15 devstack@n-api.service[120426]: ERROR oslo.messaging._drivers.impl_rabbit [-] [666865aa-442b-4005-907b-9c648cd2f782] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 11:57:40.136825 n-d-858383-15 devstack@n-api.service[120426]: ERROR oslo.messaging._drivers.impl_rabbit [-] [05048d7c-6448-4d6e-b9e7-4fa04d95d8b6] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 11:57:40.137452 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:57:40.138191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=50 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:57:40.144327 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2c6991c1-85c5-462f-aad2-6fdaa9739773 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:57:40.145080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2c6991c1-85c5-462f-aad2-6fdaa9739773 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:40.155176 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c6991c1-85c5-462f-aad2-6fdaa9739773 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:40.155662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c6991c1-85c5-462f-aad2-6fdaa9739773 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:40.156103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c6991c1-85c5-462f-aad2-6fdaa9739773 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:40.156806 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c6991c1-85c5-462f-aad2-6fdaa9739773 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:40.157287 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c6991c1-85c5-462f-aad2-6fdaa9739773 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:40.157716 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2c6991c1-85c5-462f-aad2-6fdaa9739773 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:40.296108 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2c6991c1-85c5-462f-aad2-6fdaa9739773 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:57:40.304310 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2c6991c1-85c5-462f-aad2-6fdaa9739773 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1566 microversion: 2.1 time: 0.170230 Oct 24 11:57:40.304912 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3975/7925] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:57:40 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:57:41.332908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5b6655d3-b414-4c2b-8449-e006cbeb6891 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:57:41.333601 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5b6655d3-b414-4c2b-8449-e006cbeb6891 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:41.342402 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b6655d3-b414-4c2b-8449-e006cbeb6891 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:41.342904 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b6655d3-b414-4c2b-8449-e006cbeb6891 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:41.343358 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b6655d3-b414-4c2b-8449-e006cbeb6891 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:41.344072 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b6655d3-b414-4c2b-8449-e006cbeb6891 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:41.344541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b6655d3-b414-4c2b-8449-e006cbeb6891 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:41.345015 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5b6655d3-b414-4c2b-8449-e006cbeb6891 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:41.349736 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] [1abc338e-6c14-4311-a7b3-814582834b4a] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 52700. Oct 24 11:57:41.350453 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] [ebd6dc19-988c-4764-bcee-cebc857bf132] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 52698. Oct 24 11:57:41.482214 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5b6655d3-b414-4c2b-8449-e006cbeb6891 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:57:41.490012 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5b6655d3-b414-4c2b-8449-e006cbeb6891 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1566 microversion: 2.1 time: 0.164527 Oct 24 11:57:41.490587 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3951/7926] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:57:41 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:57:42.514545 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-dc249baa-4677-4a22-a28a-81d6c24624b8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:57:42.515085 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-dc249baa-4677-4a22-a28a-81d6c24624b8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:42.528999 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc249baa-4677-4a22-a28a-81d6c24624b8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:42.529486 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc249baa-4677-4a22-a28a-81d6c24624b8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:42.529919 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc249baa-4677-4a22-a28a-81d6c24624b8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:42.530619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc249baa-4677-4a22-a28a-81d6c24624b8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:42.531151 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc249baa-4677-4a22-a28a-81d6c24624b8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:42.532273 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-dc249baa-4677-4a22-a28a-81d6c24624b8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:42.541162 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] [05048d7c-6448-4d6e-b9e7-4fa04d95d8b6] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 52706. Oct 24 11:57:42.541687 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] [666865aa-442b-4005-907b-9c648cd2f782] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 52704. Oct 24 11:57:42.672528 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-dc249baa-4677-4a22-a28a-81d6c24624b8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:57:42.680352 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-dc249baa-4677-4a22-a28a-81d6c24624b8 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1566 microversion: 2.1 time: 0.170274 Oct 24 11:57:42.681037 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3976/7927] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:57:42 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:57:43.705643 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-89a3dd27-455a-4f71-bd3d-76c623b8ff4a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:57:43.706254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-89a3dd27-455a-4f71-bd3d-76c623b8ff4a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:43.713424 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89a3dd27-455a-4f71-bd3d-76c623b8ff4a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:43.713927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89a3dd27-455a-4f71-bd3d-76c623b8ff4a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:43.714384 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89a3dd27-455a-4f71-bd3d-76c623b8ff4a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:43.716114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89a3dd27-455a-4f71-bd3d-76c623b8ff4a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:43.716596 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89a3dd27-455a-4f71-bd3d-76c623b8ff4a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:43.717092 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-89a3dd27-455a-4f71-bd3d-76c623b8ff4a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:43.852722 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-89a3dd27-455a-4f71-bd3d-76c623b8ff4a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:57:43.860774 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-89a3dd27-455a-4f71-bd3d-76c623b8ff4a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1566 microversion: 2.1 time: 0.159039 Oct 24 11:57:43.861380 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3952/7928] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:57:43 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:57:44.885102 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-99f8cd86-e10c-4afb-b24d-04df952635f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:57:44.885715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-99f8cd86-e10c-4afb-b24d-04df952635f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:44.893129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99f8cd86-e10c-4afb-b24d-04df952635f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:44.893607 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99f8cd86-e10c-4afb-b24d-04df952635f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:44.894068 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99f8cd86-e10c-4afb-b24d-04df952635f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:44.894754 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99f8cd86-e10c-4afb-b24d-04df952635f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:44.895203 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99f8cd86-e10c-4afb-b24d-04df952635f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:44.895623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99f8cd86-e10c-4afb-b24d-04df952635f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:45.033249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-99f8cd86-e10c-4afb-b24d-04df952635f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:57:45.041794 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-99f8cd86-e10c-4afb-b24d-04df952635f2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1566 microversion: 2.1 time: 0.160861 Oct 24 11:57:45.042378 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3977/7929] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:57:44 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:57:46.065889 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-43c3184f-efe8-4a40-9ace-1e0d23f9fcbb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:57:46.066447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-43c3184f-efe8-4a40-9ace-1e0d23f9fcbb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:46.073255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43c3184f-efe8-4a40-9ace-1e0d23f9fcbb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:46.073759 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43c3184f-efe8-4a40-9ace-1e0d23f9fcbb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:46.075030 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43c3184f-efe8-4a40-9ace-1e0d23f9fcbb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:46.075726 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43c3184f-efe8-4a40-9ace-1e0d23f9fcbb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:46.076198 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43c3184f-efe8-4a40-9ace-1e0d23f9fcbb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:46.076635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-43c3184f-efe8-4a40-9ace-1e0d23f9fcbb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:46.208238 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-43c3184f-efe8-4a40-9ace-1e0d23f9fcbb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:57:46.216120 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-43c3184f-efe8-4a40-9ace-1e0d23f9fcbb tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1566 microversion: 2.1 time: 0.154220 Oct 24 11:57:46.216682 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3953/7930] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:57:46 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:57:47.239538 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-af3404ca-147f-4e1c-9edb-741b7416b4c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:57:47.240204 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-af3404ca-147f-4e1c-9edb-741b7416b4c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:47.247223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af3404ca-147f-4e1c-9edb-741b7416b4c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:47.247695 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af3404ca-147f-4e1c-9edb-741b7416b4c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:47.248123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af3404ca-147f-4e1c-9edb-741b7416b4c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:47.248807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af3404ca-147f-4e1c-9edb-741b7416b4c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:47.249282 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af3404ca-147f-4e1c-9edb-741b7416b4c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:47.249703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-af3404ca-147f-4e1c-9edb-741b7416b4c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:47.382730 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-af3404ca-147f-4e1c-9edb-741b7416b4c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:57:47.391626 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-af3404ca-147f-4e1c-9edb-741b7416b4c5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1566 microversion: 2.1 time: 0.155962 Oct 24 11:57:47.392209 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3978/7931] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:57:47 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:57:48.415937 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3d10c3f9-ec2c-403f-8eda-ec220a8b71ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:57:48.416590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3d10c3f9-ec2c-403f-8eda-ec220a8b71ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:48.424335 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d10c3f9-ec2c-403f-8eda-ec220a8b71ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:48.424849 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d10c3f9-ec2c-403f-8eda-ec220a8b71ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:48.425318 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d10c3f9-ec2c-403f-8eda-ec220a8b71ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:48.426023 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d10c3f9-ec2c-403f-8eda-ec220a8b71ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:48.426489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d10c3f9-ec2c-403f-8eda-ec220a8b71ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:48.426931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3d10c3f9-ec2c-403f-8eda-ec220a8b71ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:48.558713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3d10c3f9-ec2c-403f-8eda-ec220a8b71ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:57:48.566492 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3d10c3f9-ec2c-403f-8eda-ec220a8b71ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1566 microversion: 2.1 time: 0.154539 Oct 24 11:57:48.567056 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3954/7932] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:57:48 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:57:49.589255 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-e0bfcba3-b8be-4c06-bf3d-f0f31ae7f746 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:57:49.590042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-e0bfcba3-b8be-4c06-bf3d-f0f31ae7f746 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:49.596852 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0bfcba3-b8be-4c06-bf3d-f0f31ae7f746 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:49.597339 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0bfcba3-b8be-4c06-bf3d-f0f31ae7f746 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:49.597775 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0bfcba3-b8be-4c06-bf3d-f0f31ae7f746 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:49.598472 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0bfcba3-b8be-4c06-bf3d-f0f31ae7f746 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:49.598924 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0bfcba3-b8be-4c06-bf3d-f0f31ae7f746 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:49.599352 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-e0bfcba3-b8be-4c06-bf3d-f0f31ae7f746 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:49.731995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-e0bfcba3-b8be-4c06-bf3d-f0f31ae7f746 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:57:49.739777 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-e0bfcba3-b8be-4c06-bf3d-f0f31ae7f746 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1566 microversion: 2.1 time: 0.154518 Oct 24 11:57:49.740355 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3979/7933] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:57:49 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:57:50.765441 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8911339b-32ce-4229-ac29-98760815ca24 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:57:50.766062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8911339b-32ce-4229-ac29-98760815ca24 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:50.773079 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8911339b-32ce-4229-ac29-98760815ca24 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:50.773582 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8911339b-32ce-4229-ac29-98760815ca24 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:50.774034 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8911339b-32ce-4229-ac29-98760815ca24 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:50.774747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8911339b-32ce-4229-ac29-98760815ca24 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:50.775221 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8911339b-32ce-4229-ac29-98760815ca24 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:50.775666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8911339b-32ce-4229-ac29-98760815ca24 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:50.913916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8911339b-32ce-4229-ac29-98760815ca24 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:57:50.922797 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8911339b-32ce-4229-ac29-98760815ca24 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1566 microversion: 2.1 time: 0.162589 Oct 24 11:57:50.923374 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3955/7934] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:57:50 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:57:51.946508 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-ebfd47bd-973b-4790-95d5-88e79081cf8b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:57:51.947157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-ebfd47bd-973b-4790-95d5-88e79081cf8b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:51.954424 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebfd47bd-973b-4790-95d5-88e79081cf8b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:51.954910 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebfd47bd-973b-4790-95d5-88e79081cf8b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:51.955347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebfd47bd-973b-4790-95d5-88e79081cf8b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:51.956042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebfd47bd-973b-4790-95d5-88e79081cf8b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:51.956496 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebfd47bd-973b-4790-95d5-88e79081cf8b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:51.956959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-ebfd47bd-973b-4790-95d5-88e79081cf8b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:52.090676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-ebfd47bd-973b-4790-95d5-88e79081cf8b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:57:52.098699 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-ebfd47bd-973b-4790-95d5-88e79081cf8b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1566 microversion: 2.1 time: 0.156169 Oct 24 11:57:52.099307 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3980/7935] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:57:51 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:57:53.122908 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bcb1b177-61fc-433a-aff3-65da2c617caf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:57:53.123572 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bcb1b177-61fc-433a-aff3-65da2c617caf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:53.130936 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcb1b177-61fc-433a-aff3-65da2c617caf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:53.131439 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcb1b177-61fc-433a-aff3-65da2c617caf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:53.131890 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcb1b177-61fc-433a-aff3-65da2c617caf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:53.132602 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcb1b177-61fc-433a-aff3-65da2c617caf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:53.133091 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcb1b177-61fc-433a-aff3-65da2c617caf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:53.133529 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bcb1b177-61fc-433a-aff3-65da2c617caf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:53.270891 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bcb1b177-61fc-433a-aff3-65da2c617caf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:57:53.279843 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bcb1b177-61fc-433a-aff3-65da2c617caf tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1566 microversion: 2.1 time: 0.160836 Oct 24 11:57:53.280673 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3956/7936] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:57:53 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:57:54.304468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-c199991d-a3ad-41c1-95dc-24c1efb2190b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:57:54.305288 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-c199991d-a3ad-41c1-95dc-24c1efb2190b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:54.312898 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c199991d-a3ad-41c1-95dc-24c1efb2190b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:54.313381 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c199991d-a3ad-41c1-95dc-24c1efb2190b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:54.313817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c199991d-a3ad-41c1-95dc-24c1efb2190b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:54.314569 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c199991d-a3ad-41c1-95dc-24c1efb2190b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:54.315033 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c199991d-a3ad-41c1-95dc-24c1efb2190b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:54.315459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-c199991d-a3ad-41c1-95dc-24c1efb2190b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:54.453075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-c199991d-a3ad-41c1-95dc-24c1efb2190b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:57:54.460818 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-c199991d-a3ad-41c1-95dc-24c1efb2190b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1567 microversion: 2.1 time: 0.160822 Oct 24 11:57:54.461420 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3981/7937] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:57:54 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:57:54.483913 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-88e241ed-dee8-4d78-a8f9-b69bc2fbd5e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:57:54.484546 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-88e241ed-dee8-4d78-a8f9-b69bc2fbd5e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:54.491427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88e241ed-dee8-4d78-a8f9-b69bc2fbd5e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:54.491932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88e241ed-dee8-4d78-a8f9-b69bc2fbd5e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:54.492393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88e241ed-dee8-4d78-a8f9-b69bc2fbd5e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:54.493135 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88e241ed-dee8-4d78-a8f9-b69bc2fbd5e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:54.493614 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88e241ed-dee8-4d78-a8f9-b69bc2fbd5e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:54.494062 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-88e241ed-dee8-4d78-a8f9-b69bc2fbd5e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:54.580231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-88e241ed-dee8-4d78-a8f9-b69bc2fbd5e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120425) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 24 11:57:54.650734 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-88e241ed-dee8-4d78-a8f9-b69bc2fbd5e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "POST /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d/action" status: 202 len: 0 microversion: 2.1 time: 0.170749 Oct 24 11:57:54.651349 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3957/7938] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 11:57:54 2022] POST /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 11:57:54.660711 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-fb534c76-a1b3-4705-866e-2edf2d8e6a67 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:57:54.661385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-fb534c76-a1b3-4705-866e-2edf2d8e6a67 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:54.667791 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb534c76-a1b3-4705-866e-2edf2d8e6a67 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:54.668276 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb534c76-a1b3-4705-866e-2edf2d8e6a67 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:54.668723 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb534c76-a1b3-4705-866e-2edf2d8e6a67 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:54.670245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb534c76-a1b3-4705-866e-2edf2d8e6a67 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:54.670851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb534c76-a1b3-4705-866e-2edf2d8e6a67 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:54.671289 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-fb534c76-a1b3-4705-866e-2edf2d8e6a67 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:54.828181 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-fb534c76-a1b3-4705-866e-2edf2d8e6a67 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:57:54.836043 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-fb534c76-a1b3-4705-866e-2edf2d8e6a67 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1575 microversion: 2.1 time: 0.179668 Oct 24 11:57:54.836623 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3982/7939] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:57:54 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:57:54.967796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-dfa864a7-b305-4307-8eb0-adb1bc7382e9 req-3a9d4663-5d0b-43fb-8bdc-0a1042c51452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7344fa14-d4af-4416-8018-2926054b234d", "name": "network-vif-unplugged", "status": "completed", "tag": "7f6de79a-2611-4503-be51-4236c09f34fc"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:57:54.979389 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-dfa864a7-b305-4307-8eb0-adb1bc7382e9 req-3a9d4663-5d0b-43fb-8bdc-0a1042c51452 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:54.979729 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-dfa864a7-b305-4307-8eb0-adb1bc7382e9 req-3a9d4663-5d0b-43fb-8bdc-0a1042c51452 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:54.981476 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-dfa864a7-b305-4307-8eb0-adb1bc7382e9 req-3a9d4663-5d0b-43fb-8bdc-0a1042c51452 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:54.994423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.compute.server_external_events [req-dfa864a7-b305-4307-8eb0-adb1bc7382e9 req-3a9d4663-5d0b-43fb-8bdc-0a1042c51452 service nova] Unable to find a host for instance 7344fa14-d4af-4416-8018-2926054b234d. Dropping event network-vif-unplugged {{(pid=120425) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 24 11:57:54.995410 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-dfa864a7-b305-4307-8eb0-adb1bc7382e9 req-3a9d4663-5d0b-43fb-8bdc-0a1042c51452 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032304 Oct 24 11:57:54.996375 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3958/7940] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 24 11:57:55.860637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-54d8d57e-6909-449b-97c2-f7ae13fc79b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:57:55.861274 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-54d8d57e-6909-449b-97c2-f7ae13fc79b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:55.868131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54d8d57e-6909-449b-97c2-f7ae13fc79b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:55.868609 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54d8d57e-6909-449b-97c2-f7ae13fc79b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:55.869071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54d8d57e-6909-449b-97c2-f7ae13fc79b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:55.869760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54d8d57e-6909-449b-97c2-f7ae13fc79b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:55.870208 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54d8d57e-6909-449b-97c2-f7ae13fc79b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:55.870629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-54d8d57e-6909-449b-97c2-f7ae13fc79b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:56.009186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-54d8d57e-6909-449b-97c2-f7ae13fc79b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:57:56.019481 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-54d8d57e-6909-449b-97c2-f7ae13fc79b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1517 microversion: 2.1 time: 0.163043 Oct 24 11:57:56.020665 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3983/7941] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:57:55 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:57:57.046004 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9b80e8a6-5bf0-4c35-ac83-4aaf99de730d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:57:57.046605 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9b80e8a6-5bf0-4c35-ac83-4aaf99de730d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:57.053647 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b80e8a6-5bf0-4c35-ac83-4aaf99de730d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:57.054155 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b80e8a6-5bf0-4c35-ac83-4aaf99de730d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:57.054617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b80e8a6-5bf0-4c35-ac83-4aaf99de730d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:57.055345 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b80e8a6-5bf0-4c35-ac83-4aaf99de730d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:57.055822 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b80e8a6-5bf0-4c35-ac83-4aaf99de730d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:57.056274 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9b80e8a6-5bf0-4c35-ac83-4aaf99de730d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:57.194731 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9b80e8a6-5bf0-4c35-ac83-4aaf99de730d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:57:57.203461 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9b80e8a6-5bf0-4c35-ac83-4aaf99de730d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1517 microversion: 2.1 time: 0.161510 Oct 24 11:57:57.214713 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3959/7942] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:57:57 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:57:58.227451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4ac3716b-3d91-40b4-b988-72f129e21e9a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:57:58.228073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4ac3716b-3d91-40b4-b988-72f129e21e9a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:58.235874 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ac3716b-3d91-40b4-b988-72f129e21e9a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:58.236370 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ac3716b-3d91-40b4-b988-72f129e21e9a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:58.236808 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ac3716b-3d91-40b4-b988-72f129e21e9a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:58.237544 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ac3716b-3d91-40b4-b988-72f129e21e9a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:58.238001 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ac3716b-3d91-40b4-b988-72f129e21e9a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:58.238433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4ac3716b-3d91-40b4-b988-72f129e21e9a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:58.378683 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4ac3716b-3d91-40b4-b988-72f129e21e9a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:57:58.386545 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4ac3716b-3d91-40b4-b988-72f129e21e9a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1517 microversion: 2.1 time: 0.163035 Oct 24 11:57:58.387122 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3984/7943] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:57:58 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:57:59.411184 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8024b6ca-4382-4c31-8c25-cfee36bc483d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:57:59.411932 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8024b6ca-4382-4c31-8c25-cfee36bc483d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:57:59.419226 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8024b6ca-4382-4c31-8c25-cfee36bc483d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:59.419873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8024b6ca-4382-4c31-8c25-cfee36bc483d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:59.420340 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8024b6ca-4382-4c31-8c25-cfee36bc483d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:59.421126 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8024b6ca-4382-4c31-8c25-cfee36bc483d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:57:59.421608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8024b6ca-4382-4c31-8c25-cfee36bc483d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:57:59.422056 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8024b6ca-4382-4c31-8c25-cfee36bc483d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:57:59.554364 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8024b6ca-4382-4c31-8c25-cfee36bc483d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:57:59.562835 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8024b6ca-4382-4c31-8c25-cfee36bc483d tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1517 microversion: 2.1 time: 0.155893 Oct 24 11:57:59.563419 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3960/7944] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:57:59 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:58:00.586325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-99a332d9-0e71-4704-a69c-0e3132a253b5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:58:00.586966 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-99a332d9-0e71-4704-a69c-0e3132a253b5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:58:00.593838 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99a332d9-0e71-4704-a69c-0e3132a253b5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:00.594323 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99a332d9-0e71-4704-a69c-0e3132a253b5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:00.594759 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99a332d9-0e71-4704-a69c-0e3132a253b5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:00.595456 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99a332d9-0e71-4704-a69c-0e3132a253b5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:00.595932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99a332d9-0e71-4704-a69c-0e3132a253b5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:00.596340 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-99a332d9-0e71-4704-a69c-0e3132a253b5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:00.734973 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-99a332d9-0e71-4704-a69c-0e3132a253b5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:58:00.742951 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-99a332d9-0e71-4704-a69c-0e3132a253b5 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1573 microversion: 2.1 time: 0.160574 Oct 24 11:58:00.743538 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3985/7945] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:58:00 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:58:01.768212 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8b4264d7-58ab-4bf6-89e3-84b639575eda tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:58:01.768862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8b4264d7-58ab-4bf6-89e3-84b639575eda tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:58:01.775804 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b4264d7-58ab-4bf6-89e3-84b639575eda tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:01.776298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b4264d7-58ab-4bf6-89e3-84b639575eda tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:01.776748 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b4264d7-58ab-4bf6-89e3-84b639575eda tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:01.777481 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b4264d7-58ab-4bf6-89e3-84b639575eda tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:01.777948 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b4264d7-58ab-4bf6-89e3-84b639575eda tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:01.778608 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8b4264d7-58ab-4bf6-89e3-84b639575eda tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:01.909689 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-8b4264d7-58ab-4bf6-89e3-84b639575eda tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:58:01.917489 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8b4264d7-58ab-4bf6-89e3-84b639575eda tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1573 microversion: 2.1 time: 0.153168 Oct 24 11:58:01.918061 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3961/7946] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:58:01 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:58:02.942124 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-93e00903-78f3-45f1-9d70-cad1c548e1cc tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:58:02.942742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-93e00903-78f3-45f1-9d70-cad1c548e1cc tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:58:02.949790 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93e00903-78f3-45f1-9d70-cad1c548e1cc tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:02.950292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93e00903-78f3-45f1-9d70-cad1c548e1cc tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:02.950817 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93e00903-78f3-45f1-9d70-cad1c548e1cc tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:02.951522 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93e00903-78f3-45f1-9d70-cad1c548e1cc tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:02.951981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93e00903-78f3-45f1-9d70-cad1c548e1cc tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:02.952409 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-93e00903-78f3-45f1-9d70-cad1c548e1cc tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:03.084076 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-93e00903-78f3-45f1-9d70-cad1c548e1cc tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:58:03.092051 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-93e00903-78f3-45f1-9d70-cad1c548e1cc tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1573 microversion: 2.1 time: 0.153929 Oct 24 11:58:03.092620 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3986/7947] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:58:02 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:58:04.115556 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9f01c2a1-9200-4275-9c20-a9c6c6f80a7b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:58:04.116148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-9f01c2a1-9200-4275-9c20-a9c6c6f80a7b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:58:04.123713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f01c2a1-9200-4275-9c20-a9c6c6f80a7b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:04.124203 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f01c2a1-9200-4275-9c20-a9c6c6f80a7b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:04.124650 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f01c2a1-9200-4275-9c20-a9c6c6f80a7b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:04.125386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f01c2a1-9200-4275-9c20-a9c6c6f80a7b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:04.125855 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f01c2a1-9200-4275-9c20-a9c6c6f80a7b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:04.126298 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-9f01c2a1-9200-4275-9c20-a9c6c6f80a7b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:04.262594 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-9f01c2a1-9200-4275-9c20-a9c6c6f80a7b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:58:04.270956 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9f01c2a1-9200-4275-9c20-a9c6c6f80a7b tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1573 microversion: 2.1 time: 0.159286 Oct 24 11:58:04.271530 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3962/7948] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:58:04 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:58:05.295097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-055b5e54-53c3-4188-bf79-3f2a81a24693 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:58:05.295833 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-055b5e54-53c3-4188-bf79-3f2a81a24693 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:58:05.302917 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-055b5e54-53c3-4188-bf79-3f2a81a24693 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:05.303389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-055b5e54-53c3-4188-bf79-3f2a81a24693 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:05.303827 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-055b5e54-53c3-4188-bf79-3f2a81a24693 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:05.304527 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-055b5e54-53c3-4188-bf79-3f2a81a24693 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:05.305020 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-055b5e54-53c3-4188-bf79-3f2a81a24693 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:05.305451 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-055b5e54-53c3-4188-bf79-3f2a81a24693 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:05.439086 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-055b5e54-53c3-4188-bf79-3f2a81a24693 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:58:05.447068 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-055b5e54-53c3-4188-bf79-3f2a81a24693 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1573 microversion: 2.1 time: 0.156511 Oct 24 11:58:05.447649 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3987/7949] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:58:05 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:58:06.471341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ea67fe15-0621-4cda-b68b-b2066eb5989f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:58:06.471971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ea67fe15-0621-4cda-b68b-b2066eb5989f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:58:06.478887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea67fe15-0621-4cda-b68b-b2066eb5989f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:06.479381 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea67fe15-0621-4cda-b68b-b2066eb5989f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:06.479830 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea67fe15-0621-4cda-b68b-b2066eb5989f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:06.480531 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea67fe15-0621-4cda-b68b-b2066eb5989f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:06.481035 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea67fe15-0621-4cda-b68b-b2066eb5989f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:06.481541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ea67fe15-0621-4cda-b68b-b2066eb5989f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:06.617665 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ea67fe15-0621-4cda-b68b-b2066eb5989f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:58:06.625592 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ea67fe15-0621-4cda-b68b-b2066eb5989f tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1573 microversion: 2.1 time: 0.158183 Oct 24 11:58:06.626171 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3963/7950] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:58:06 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:58:07.649448 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-a0c62bf7-3c47-4399-a31f-d6c3e64ea989 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:58:07.650069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-a0c62bf7-3c47-4399-a31f-d6c3e64ea989 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:58:07.657104 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0c62bf7-3c47-4399-a31f-d6c3e64ea989 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:07.657588 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0c62bf7-3c47-4399-a31f-d6c3e64ea989 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:07.658035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0c62bf7-3c47-4399-a31f-d6c3e64ea989 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:07.658726 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0c62bf7-3c47-4399-a31f-d6c3e64ea989 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:07.659446 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0c62bf7-3c47-4399-a31f-d6c3e64ea989 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:07.659875 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-a0c62bf7-3c47-4399-a31f-d6c3e64ea989 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:07.795785 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-a0c62bf7-3c47-4399-a31f-d6c3e64ea989 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:58:07.803587 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-a0c62bf7-3c47-4399-a31f-d6c3e64ea989 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1573 microversion: 2.1 time: 0.158099 Oct 24 11:58:07.804165 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3988/7951] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:58:07 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:58:08.827506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ef86d47b-d037-4d9c-80be-7a142b3f3f7e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:58:08.828131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ef86d47b-d037-4d9c-80be-7a142b3f3f7e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:58:08.834946 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef86d47b-d037-4d9c-80be-7a142b3f3f7e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:08.835445 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef86d47b-d037-4d9c-80be-7a142b3f3f7e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:08.835892 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef86d47b-d037-4d9c-80be-7a142b3f3f7e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:08.836590 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef86d47b-d037-4d9c-80be-7a142b3f3f7e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:08.837086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef86d47b-d037-4d9c-80be-7a142b3f3f7e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:08.837528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ef86d47b-d037-4d9c-80be-7a142b3f3f7e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:08.842139 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:58:08.977563 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ef86d47b-d037-4d9c-80be-7a142b3f3f7e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:58:08.985590 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ef86d47b-d037-4d9c-80be-7a142b3f3f7e tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1573 microversion: 2.1 time: 0.162224 Oct 24 11:58:08.986172 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3964/7952] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:58:08 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:58:10.009017 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-5402119f-6ff9-4007-8ed0-91c5ff7d59ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:58:10.009669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-5402119f-6ff9-4007-8ed0-91c5ff7d59ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:58:10.016914 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5402119f-6ff9-4007-8ed0-91c5ff7d59ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:10.017394 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5402119f-6ff9-4007-8ed0-91c5ff7d59ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:10.017829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5402119f-6ff9-4007-8ed0-91c5ff7d59ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:10.018521 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5402119f-6ff9-4007-8ed0-91c5ff7d59ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:10.018975 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5402119f-6ff9-4007-8ed0-91c5ff7d59ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:10.019402 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-5402119f-6ff9-4007-8ed0-91c5ff7d59ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:10.157571 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-5402119f-6ff9-4007-8ed0-91c5ff7d59ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:58:10.160119 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=89 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:58:10.167032 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-5402119f-6ff9-4007-8ed0-91c5ff7d59ec tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1573 microversion: 2.1 time: 0.161981 Oct 24 11:58:10.167627 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3989/7953] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:58:10 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:58:11.192044 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-3bb19f00-5e7a-4ee9-a8d2-e6fa7a6335ee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:58:11.192617 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-3bb19f00-5e7a-4ee9-a8d2-e6fa7a6335ee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:58:11.195359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:58:11.200743 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bb19f00-5e7a-4ee9-a8d2-e6fa7a6335ee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:11.201276 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bb19f00-5e7a-4ee9-a8d2-e6fa7a6335ee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:11.201733 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bb19f00-5e7a-4ee9-a8d2-e6fa7a6335ee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:11.202448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bb19f00-5e7a-4ee9-a8d2-e6fa7a6335ee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:11.202927 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bb19f00-5e7a-4ee9-a8d2-e6fa7a6335ee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:11.203374 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-3bb19f00-5e7a-4ee9-a8d2-e6fa7a6335ee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:11.334341 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-3bb19f00-5e7a-4ee9-a8d2-e6fa7a6335ee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:58:11.342754 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-3bb19f00-5e7a-4ee9-a8d2-e6fa7a6335ee tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1573 microversion: 2.1 time: 0.154803 Oct 24 11:58:11.343336 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3965/7954] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:58:11 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:58:12.367704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cb1b8411-fd8e-42ae-a896-deaef4ac1bc0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:58:12.368325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cb1b8411-fd8e-42ae-a896-deaef4ac1bc0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:58:12.371015 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=31 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:58:12.377113 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb1b8411-fd8e-42ae-a896-deaef4ac1bc0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:12.377645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb1b8411-fd8e-42ae-a896-deaef4ac1bc0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:12.378042 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb1b8411-fd8e-42ae-a896-deaef4ac1bc0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:12.378743 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb1b8411-fd8e-42ae-a896-deaef4ac1bc0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:12.379205 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb1b8411-fd8e-42ae-a896-deaef4ac1bc0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:12.379634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cb1b8411-fd8e-42ae-a896-deaef4ac1bc0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:12.513829 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cb1b8411-fd8e-42ae-a896-deaef4ac1bc0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:58:12.521725 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cb1b8411-fd8e-42ae-a896-deaef4ac1bc0 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1573 microversion: 2.1 time: 0.158190 Oct 24 11:58:12.522307 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3990/7955] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:58:12 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:58:13.088033 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-eb158880-64e6-424d-ba1a-524f890f6a6b req-3bb87e3c-9b25-425c-93a6-d01f96ec055f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7344fa14-d4af-4416-8018-2926054b234d", "name": "network-vif-plugged", "status": "completed", "tag": "7f6de79a-2611-4503-be51-4236c09f34fc"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:58:13.101655 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eb158880-64e6-424d-ba1a-524f890f6a6b req-3bb87e3c-9b25-425c-93a6-d01f96ec055f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:13.103956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eb158880-64e6-424d-ba1a-524f890f6a6b req-3bb87e3c-9b25-425c-93a6-d01f96ec055f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:13.103956 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-eb158880-64e6-424d-ba1a-524f890f6a6b req-3bb87e3c-9b25-425c-93a6-d01f96ec055f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:13.116153 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-eb158880-64e6-424d-ba1a-524f890f6a6b req-3bb87e3c-9b25-425c-93a6-d01f96ec055f service nova] Creating event network-vif-plugged:7f6de79a-2611-4503-be51-4236c09f34fc for instance 7344fa14-d4af-4416-8018-2926054b234d on n-h2-858383-15 Oct 24 11:58:13.121720 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-eb158880-64e6-424d-ba1a-524f890f6a6b req-3bb87e3c-9b25-425c-93a6-d01f96ec055f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037690 Oct 24 11:58:13.122385 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3966/7956] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:58:13.546928 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-aabcbcfb-218f-413e-83f4-478ba872f640 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:58:13.548063 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-aabcbcfb-218f-413e-83f4-478ba872f640 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:58:13.558144 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aabcbcfb-218f-413e-83f4-478ba872f640 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:13.558940 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aabcbcfb-218f-413e-83f4-478ba872f640 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:13.559688 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aabcbcfb-218f-413e-83f4-478ba872f640 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:13.560918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aabcbcfb-218f-413e-83f4-478ba872f640 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:13.561497 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aabcbcfb-218f-413e-83f4-478ba872f640 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:13.561935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-aabcbcfb-218f-413e-83f4-478ba872f640 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:13.716814 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-aabcbcfb-218f-413e-83f4-478ba872f640 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:58:13.725991 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-aabcbcfb-218f-413e-83f4-478ba872f640 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1573 microversion: 2.1 time: 0.183968 Oct 24 11:58:13.726584 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3991/7957] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:58:13 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1573 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:58:14.756296 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-db0b4041-f172-451f-b933-9e7b45e4943a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:58:14.757046 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-db0b4041-f172-451f-b933-9e7b45e4943a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:58:14.764423 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db0b4041-f172-451f-b933-9e7b45e4943a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:14.764950 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db0b4041-f172-451f-b933-9e7b45e4943a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:14.765403 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db0b4041-f172-451f-b933-9e7b45e4943a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:14.766102 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db0b4041-f172-451f-b933-9e7b45e4943a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:58:14.766573 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db0b4041-f172-451f-b933-9e7b45e4943a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:58:14.767010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-db0b4041-f172-451f-b933-9e7b45e4943a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:58:14.901365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-db0b4041-f172-451f-b933-9e7b45e4943a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:58:14.910266 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-db0b4041-f172-451f-b933-9e7b45e4943a tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1560 microversion: 2.1 time: 0.158228 Oct 24 11:58:14.910847 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3967/7958] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:58:14 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:59:31.538143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=5 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:59:31.539013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=18 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:59:31.540505 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:59:31.540983 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 11:59:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.50) !!! Oct 24 11:59:31.541772 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-91cf8700-0b03-46c7-8844-78ddcaf027f6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:59:31.542955 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-91cf8700-0b03-46c7-8844-78ddcaf027f6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:59:31.545290 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:59:31.546000 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=13 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:59:31.546933 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:59:31.547212 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:59:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d (ip 10.222.0.50) !!! Oct 24 11:59:31.547658 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-b26a2d31-1aa8-422c-b2e7-13066b340f4f req-72dce744-0559-43f0-abda-a2040e8927cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7344fa14-d4af-4416-8018-2926054b234d", "tag": "7f6de79a-2611-4503-be51-4236c09f34fc"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:59:31.549738 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:59:31.549869 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:59:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d (ip 10.222.0.50) !!! Oct 24 11:59:31.551815 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 11:59:31.551944 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 11:59:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d (ip 10.222.0.50) !!! Oct 24 11:59:31.566563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91cf8700-0b03-46c7-8844-78ddcaf027f6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:31.567342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91cf8700-0b03-46c7-8844-78ddcaf027f6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:31.567788 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91cf8700-0b03-46c7-8844-78ddcaf027f6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:31.568689 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91cf8700-0b03-46c7-8844-78ddcaf027f6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:31.569347 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91cf8700-0b03-46c7-8844-78ddcaf027f6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:31.569784 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-91cf8700-0b03-46c7-8844-78ddcaf027f6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:31.574264 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b26a2d31-1aa8-422c-b2e7-13066b340f4f req-72dce744-0559-43f0-abda-a2040e8927cd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:31.574864 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b26a2d31-1aa8-422c-b2e7-13066b340f4f req-72dce744-0559-43f0-abda-a2040e8927cd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:31.575385 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-b26a2d31-1aa8-422c-b2e7-13066b340f4f req-72dce744-0559-43f0-abda-a2040e8927cd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:31.591574 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-b26a2d31-1aa8-422c-b2e7-13066b340f4f req-72dce744-0559-43f0-abda-a2040e8927cd service nova] Creating event network-changed:7f6de79a-2611-4503-be51-4236c09f34fc for instance 7344fa14-d4af-4416-8018-2926054b234d on n-h2-858383-15 Oct 24 11:59:31.597553 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-b26a2d31-1aa8-422c-b2e7-13066b340f4f req-72dce744-0559-43f0-abda-a2040e8927cd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061308 Oct 24 11:59:31.598570 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3968/7959] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:59:31.607225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-91cf8700-0b03-46c7-8844-78ddcaf027f6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 11:59:31.705215 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-91cf8700-0b03-46c7-8844-78ddcaf027f6 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 204 len: 0 microversion: 2.1 time: 0.170896 Oct 24 11:59:31.706364 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3992/7960] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 11:59:31 2022] DELETE /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 11:59:31.719078 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bd0f544a-7016-4e5f-8f00-1fca26fdbb43 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:59:31.719994 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bd0f544a-7016-4e5f-8f00-1fca26fdbb43 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:59:31.726534 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd0f544a-7016-4e5f-8f00-1fca26fdbb43 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:31.727835 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd0f544a-7016-4e5f-8f00-1fca26fdbb43 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:31.728369 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd0f544a-7016-4e5f-8f00-1fca26fdbb43 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:31.729193 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd0f544a-7016-4e5f-8f00-1fca26fdbb43 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:31.729799 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd0f544a-7016-4e5f-8f00-1fca26fdbb43 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:31.730312 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bd0f544a-7016-4e5f-8f00-1fca26fdbb43 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:31.865656 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-bd0f544a-7016-4e5f-8f00-1fca26fdbb43 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:59:31.873818 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bd0f544a-7016-4e5f-8f00-1fca26fdbb43 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1566 microversion: 2.1 time: 0.162464 Oct 24 11:59:31.874418 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3969/7961] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:59:31 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:59:32.898191 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-b942aedf-1ace-48ae-8d34-114572380505 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:59:32.899612 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-b942aedf-1ace-48ae-8d34-114572380505 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:59:32.906592 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b942aedf-1ace-48ae-8d34-114572380505 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:32.907074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b942aedf-1ace-48ae-8d34-114572380505 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:32.907542 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b942aedf-1ace-48ae-8d34-114572380505 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:32.908223 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b942aedf-1ace-48ae-8d34-114572380505 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:32.908676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b942aedf-1ace-48ae-8d34-114572380505 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:32.909125 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-b942aedf-1ace-48ae-8d34-114572380505 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:33.054561 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-b942aedf-1ace-48ae-8d34-114572380505 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:59:33.064251 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-b942aedf-1ace-48ae-8d34-114572380505 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1566 microversion: 2.1 time: 0.170247 Oct 24 11:59:33.064987 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3993/7962] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:59:32 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 11:59:33.951917 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-44a6ee45-cd35-4d92-9c6e-d0c06407c1c6 req-3f2b4b03-b822-440c-8f4c-ec8383837b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7344fa14-d4af-4416-8018-2926054b234d", "name": "network-vif-deleted", "tag": "7f6de79a-2611-4503-be51-4236c09f34fc"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:59:33.965283 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-44a6ee45-cd35-4d92-9c6e-d0c06407c1c6 req-3f2b4b03-b822-440c-8f4c-ec8383837b7d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:33.965770 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-44a6ee45-cd35-4d92-9c6e-d0c06407c1c6 req-3f2b4b03-b822-440c-8f4c-ec8383837b7d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:33.966220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-44a6ee45-cd35-4d92-9c6e-d0c06407c1c6 req-3f2b4b03-b822-440c-8f4c-ec8383837b7d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:33.978857 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-44a6ee45-cd35-4d92-9c6e-d0c06407c1c6 req-3f2b4b03-b822-440c-8f4c-ec8383837b7d service nova] Creating event network-vif-deleted:7f6de79a-2611-4503-be51-4236c09f34fc for instance 7344fa14-d4af-4416-8018-2926054b234d on n-h2-858383-15 Oct 24 11:59:33.986050 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-44a6ee45-cd35-4d92-9c6e-d0c06407c1c6 req-3f2b4b03-b822-440c-8f4c-ec8383837b7d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040473 Oct 24 11:59:33.986659 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3970/7963] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 11:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:59:34.088713 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-cae707a5-c73d-4d5d-91ff-c59c0be32f39 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:59:34.089385 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-cae707a5-c73d-4d5d-91ff-c59c0be32f39 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:59:34.097182 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae707a5-c73d-4d5d-91ff-c59c0be32f39 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:34.097673 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae707a5-c73d-4d5d-91ff-c59c0be32f39 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:34.098097 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae707a5-c73d-4d5d-91ff-c59c0be32f39 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:34.098932 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae707a5-c73d-4d5d-91ff-c59c0be32f39 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:34.099245 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae707a5-c73d-4d5d-91ff-c59c0be32f39 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:34.099881 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-cae707a5-c73d-4d5d-91ff-c59c0be32f39 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:34.171367 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-cae707a5-c73d-4d5d-91ff-c59c0be32f39 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:59:34.179300 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-cae707a5-c73d-4d5d-91ff-c59c0be32f39 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1219 microversion: 2.1 time: 0.095629 Oct 24 11:59:34.179899 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3994/7964] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:59:34 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:59:35.203138 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-ff332352-209e-4267-9a07-5728a9b125b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:59:35.203884 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-ff332352-209e-4267-9a07-5728a9b125b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:59:35.212114 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff332352-209e-4267-9a07-5728a9b125b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:35.212693 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff332352-209e-4267-9a07-5728a9b125b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:35.213215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff332352-209e-4267-9a07-5728a9b125b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:35.213943 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff332352-209e-4267-9a07-5728a9b125b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:35.214438 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff332352-209e-4267-9a07-5728a9b125b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:35.214887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-ff332352-209e-4267-9a07-5728a9b125b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:35.280210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-ff332352-209e-4267-9a07-5728a9b125b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:59:35.288397 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-ff332352-209e-4267-9a07-5728a9b125b1 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1219 microversion: 2.1 time: 0.089531 Oct 24 11:59:35.289007 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3971/7965] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:59:35 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:59:36.311851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-253e2762-c021-4322-9c95-e2e9f17f66a4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:59:36.312468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-253e2762-c021-4322-9c95-e2e9f17f66a4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:59:36.319441 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-253e2762-c021-4322-9c95-e2e9f17f66a4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:36.319931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-253e2762-c021-4322-9c95-e2e9f17f66a4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:36.320908 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-253e2762-c021-4322-9c95-e2e9f17f66a4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:36.321669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-253e2762-c021-4322-9c95-e2e9f17f66a4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:36.322071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-253e2762-c021-4322-9c95-e2e9f17f66a4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:36.322499 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-253e2762-c021-4322-9c95-e2e9f17f66a4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:36.391219 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-253e2762-c021-4322-9c95-e2e9f17f66a4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:59:36.400124 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-253e2762-c021-4322-9c95-e2e9f17f66a4 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1219 microversion: 2.1 time: 0.092134 Oct 24 11:59:36.400861 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3995/7966] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:59:36 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:59:37.424405 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6e982d2a-9241-40f7-9427-3570e60335e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:59:37.425210 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6e982d2a-9241-40f7-9427-3570e60335e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:59:37.432206 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e982d2a-9241-40f7-9427-3570e60335e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:37.432713 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e982d2a-9241-40f7-9427-3570e60335e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:37.433202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e982d2a-9241-40f7-9427-3570e60335e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:37.433916 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e982d2a-9241-40f7-9427-3570e60335e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:37.434393 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e982d2a-9241-40f7-9427-3570e60335e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:37.434844 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6e982d2a-9241-40f7-9427-3570e60335e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:37.501765 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6e982d2a-9241-40f7-9427-3570e60335e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:59:37.510857 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6e982d2a-9241-40f7-9427-3570e60335e2 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1219 microversion: 2.1 time: 0.090330 Oct 24 11:59:37.511678 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3972/7967] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:59:37 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:59:38.534652 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d7b98e0a-b82b-4d93-96b3-59eb68f10535 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:59:38.535662 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d7b98e0a-b82b-4d93-96b3-59eb68f10535 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:59:38.544495 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7b98e0a-b82b-4d93-96b3-59eb68f10535 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:38.545876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7b98e0a-b82b-4d93-96b3-59eb68f10535 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:38.546330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7b98e0a-b82b-4d93-96b3-59eb68f10535 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:38.547048 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7b98e0a-b82b-4d93-96b3-59eb68f10535 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:38.547704 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7b98e0a-b82b-4d93-96b3-59eb68f10535 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:38.548343 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7b98e0a-b82b-4d93-96b3-59eb68f10535 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:38.582980 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7b98e0a-b82b-4d93-96b3-59eb68f10535 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:38.583471 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7b98e0a-b82b-4d93-96b3-59eb68f10535 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:38.583921 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d7b98e0a-b82b-4d93-96b3-59eb68f10535 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:38.584366 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.objects.instance [None req-d7b98e0a-b82b-4d93-96b3-59eb68f10535 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lazy-loading 'fault' on Instance uuid 7344fa14-d4af-4416-8018-2926054b234d {{(pid=120426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 11:59:38.628096 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-d7b98e0a-b82b-4d93-96b3-59eb68f10535 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b396cb63e0e541e687ce6740f0b14272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deefb20157d4407fb9e8824fcfe8441e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:59:38.637570 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d7b98e0a-b82b-4d93-96b3-59eb68f10535 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 200 len: 1224 microversion: 2.1 time: 0.107093 Oct 24 11:59:38.638411 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3996/7968] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:59:38 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 11:59:39.662613 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bab4473c-63f9-4c56-871a-225d510e24ad tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:59:39.663229 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-bab4473c-63f9-4c56-871a-225d510e24ad tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] [instance: 7344fa14-d4af-4416-8018-2926054b234d] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:59:39.671202 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bab4473c-63f9-4c56-871a-225d510e24ad tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:39.671706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bab4473c-63f9-4c56-871a-225d510e24ad tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:39.672167 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bab4473c-63f9-4c56-871a-225d510e24ad tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:39.672903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bab4473c-63f9-4c56-871a-225d510e24ad tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:39.673379 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bab4473c-63f9-4c56-871a-225d510e24ad tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:39.673837 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-bab4473c-63f9-4c56-871a-225d510e24ad tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:39.688607 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.wsgi [None req-bab4473c-63f9-4c56-871a-225d510e24ad tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] HTTP exception thrown: Instance 7344fa14-d4af-4416-8018-2926054b234d could not be found. Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bab4473c-63f9-4c56-871a-225d510e24ad tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Request method failure captured: Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: request: GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d HTTP/1.1 Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: Accept: application/json Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: Accept-Encoding: identity Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: Connection: close Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: Content-Length: 0 Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: Content-Type: application/json Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: Host: 10.222.0.50 Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: Openstack-System-Scope: None Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: User-Agent: python-urllib3/1.26.12 Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-Auth-Token: gAAAAABjVnwd2FC6JJB-0ybDfCymOw5jlWtVuqHv8uqhwvy8vhO3yjL6waBeQrFhbdm3o-ybucQX5vb6vyrBa4SDXpFNiXTqjoKiwEzKMXesQHXhX_lm845wdWvPESKgxrngKg8rL2QwxL-3Ic5KvT0u15cHgj9yAG1yZacMffqzWhUus-06wkE Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Id: None Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-Domain-Name: None Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-Identity-Status: Confirmed Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-Is-Admin-Project: True Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Id: default Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Domain-Name: Default Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Id: deefb20157d4407fb9e8824fcfe8441e Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-Project-Name: tempest-TestShelveInstance-1829583437 Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-Role: reader,member Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-Roles: reader,member Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/deefb20157d4407fb9e8824fcfe8441e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/deefb20157d4407fb9e8824fcfe8441e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/deefb20157d4407fb9e8824fcfe8441e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_deefb20157d4407fb9e8824fcfe8441e", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant: tempest-TestShelveInstance-1829583437 Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Id: deefb20157d4407fb9e8824fcfe8441e Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-Tenant-Name: tempest-TestShelveInstance-1829583437 Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-User: tempest-TestShelveInstance-1829583437-project Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Id: default Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-User-Domain-Name: Default Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-User-Id: b396cb63e0e541e687ce6740f0b14272 Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: X-User-Name: tempest-TestShelveInstance-1829583437-project Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: method: > Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: exception: Instance 7344fa14-d4af-4416-8018-2926054b234d could not be found. Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: action_args: {'id': '7344fa14-d4af-4416-8018-2926054b234d'} Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7344fa14-d4af-4416-8018-2926054b234d could not be found. Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7344fa14-d4af-4416-8018-2926054b234d could not be found. Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 11:59:39.690337 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:59:39.695190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 11:59:39.695190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 11:59:39.695190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 11:59:39.695190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 11:59:39.695190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 11:59:39.695190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7344fa14-d4af-4416-8018-2926054b234d could not be found. Oct 24 11:59:39.695190 n-d-858383-15 devstack@n-api.service[120425]: ERROR nova.api.openstack.wsgi Oct 24 11:59:39.695190 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-bab4473c-63f9-4c56-871a-225d510e24ad tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Returning 404 to user: Instance 7344fa14-d4af-4416-8018-2926054b234d could not be found. {{(pid=120425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 11:59:39.695190 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-bab4473c-63f9-4c56-871a-225d510e24ad tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d" status: 404 len: 111 microversion: 2.1 time: 0.033607 Oct 24 11:59:39.695190 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3973/7969] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:59:39 2022] GET /compute/v2.1/servers/7344fa14-d4af-4416-8018-2926054b234d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 11:59:39.858404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-678f4e2d-8f2d-42b5-9cb7-ca52e4e10737 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] Calling method '.version_select at 0x7f04cb7c70d0>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:59:39.885499 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-678f4e2d-8f2d-42b5-9cb7-ca52e4e10737 tempest-TestShelveInstance-1829583437 tempest-TestShelveInstance-1829583437-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1705844384" status: 202 len: 0 microversion: 2.1 time: 0.031246 Oct 24 11:59:39.886030 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3997/7970] 10.222.0.50 () {58 vars in 1254 bytes} [Mon Oct 24 11:59:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1705844384 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 11:59:57.051940 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=12 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:59:57.052784 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=24 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:59:57.293359 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-01b21077-c924-4349-9d1c-7ccf34314ea9 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Action: 'create', calling method: .version_select at 0x7f04cbae8f70>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-394265303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxpsec5O0q/unlFt1t2JuZXYkBxL6TjOs6Hvtrb+vek0HHkLWHLR4z8AO9B4sDBBP+Boxs5oZqoP91/sW3ok0ZNH5f6+NjlUOjhSKX1uPQhcxky1is9/iCAI4ZHycFYZQ=="}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:59:57.310472 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-01b21077-c924-4349-9d1c-7ccf34314ea9 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Getting quotas for project a671adbfc1f44855887168b0b73cd8f1. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:59:57.316631 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-01b21077-c924-4349-9d1c-7ccf34314ea9 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Getting quotas for user 9ab62c4a4376460eaf10a3685840d8da and project a671adbfc1f44855887168b0b73cd8f1. Resources: {'key_pairs'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:59:57.350927 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-01b21077-c924-4349-9d1c-7ccf34314ea9 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.304224 Oct 24 11:59:57.351546 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3974/7971] 10.222.0.50 () {60 vars in 1159 bytes} [Mon Oct 24 11:59:57 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 11:59:58.375341 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7acbeb8b-cdaa-4649-be00-6c940877e7fd tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1221270106", "imageRef": "a9689e0d-06ef-475e-9c75-9e39befd50b7", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-394265303", "security_groups": [{"name": "tempest-secgroup-smoke-1841054558"}], "networks": [{"uuid": "9b957b59-74ba-4825-ae1d-e6df9d5b43e1"}]}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 11:59:58.385270 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:59:58.385906 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 11:59:58.486010 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.network.neutron [None req-7acbeb8b-cdaa-4649-be00-6c940877e7fd tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] validate_networks() for [('9b957b59-74ba-4825-ae1d-e6df9d5b43e1', None, None, None, None, None)] {{(pid=120426) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 11:59:58.988056 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7acbeb8b-cdaa-4649-be00-6c940877e7fd tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Flavor limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 11:59:58.988552 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7acbeb8b-cdaa-4649-be00-6c940877e7fd tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Image limits 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 11:59:58.989149 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7acbeb8b-cdaa-4649-be00-6c940877e7fd tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Flavor pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 11:59:58.989669 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7acbeb8b-cdaa-4649-be00-6c940877e7fd tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Image pref 0:0:0 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 11:59:58.990169 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.virt.hardware [None req-7acbeb8b-cdaa-4649-be00-6c940877e7fd tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 11:59:59.000092 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7acbeb8b-cdaa-4649-be00-6c940877e7fd tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:59.000692 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7acbeb8b-cdaa-4649-be00-6c940877e7fd tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:59.001225 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7acbeb8b-cdaa-4649-be00-6c940877e7fd tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:59.002021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7acbeb8b-cdaa-4649-be00-6c940877e7fd tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 11:59:59.002543 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7acbeb8b-cdaa-4649-be00-6c940877e7fd tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 11:59:59.003046 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7acbeb8b-cdaa-4649-be00-6c940877e7fd tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 11:59:59.021590 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-7acbeb8b-cdaa-4649-be00-6c940877e7fd tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Getting quotas for project a671adbfc1f44855887168b0b73cd8f1. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 11:59:59.028207 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.quota [None req-7acbeb8b-cdaa-4649-be00-6c940877e7fd tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Getting quotas for user 9ab62c4a4376460eaf10a3685840d8da and project a671adbfc1f44855887168b0b73cd8f1. Resources: {'instances', 'ram', 'cores'} {{(pid=120426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 11:59:59.042206 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7acbeb8b-cdaa-4649-be00-6c940877e7fd tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Going to run 1 instances... {{(pid=120426) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 11:59:59.044634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7acbeb8b-cdaa-4649-be00-6c940877e7fd tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a9689e0d-06ef-475e-9c75-9e39befd50b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 11:59:59.098120 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7acbeb8b-cdaa-4649-be00-6c940877e7fd tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.726727 Oct 24 11:59:59.099117 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3998/7972] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 11:59:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 11:59:59.111351 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-b756f413-5158-4e39-805c-4c4abcb65382 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 11:59:59.112063 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-b756f413-5158-4e39-805c-4c4abcb65382 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 11:59:59.184724 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-b756f413-5158-4e39-805c-4c4abcb65382 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 11:59:59.195538 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-b756f413-5158-4e39-805c-4c4abcb65382 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625" status: 200 len: 1248 microversion: 2.1 time: 0.086775 Oct 24 11:59:59.197298 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3975/7973] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 11:59:59 2022] GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625 => generated 1248 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:00:00.221454 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-01779f26-7fcb-4ccb-8ab7-8e3ddbbdd97c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:00:00.222073 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-01779f26-7fcb-4ccb-8ab7-8e3ddbbdd97c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:00:00.230230 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01779f26-7fcb-4ccb-8ab7-8e3ddbbdd97c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:00.230719 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01779f26-7fcb-4ccb-8ab7-8e3ddbbdd97c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:00.231437 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01779f26-7fcb-4ccb-8ab7-8e3ddbbdd97c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:00.232336 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01779f26-7fcb-4ccb-8ab7-8e3ddbbdd97c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:00.233007 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01779f26-7fcb-4ccb-8ab7-8e3ddbbdd97c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:00.233606 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-01779f26-7fcb-4ccb-8ab7-8e3ddbbdd97c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:00.302393 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-01779f26-7fcb-4ccb-8ab7-8e3ddbbdd97c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:00:00.313607 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-01779f26-7fcb-4ccb-8ab7-8e3ddbbdd97c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625" status: 200 len: 1300 microversion: 2.1 time: 0.097393 Oct 24 12:00:00.314217 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 3999/7974] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:00:00 2022] GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625 => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:00:01.338128 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-1f449754-135f-4f71-956a-9c39b48b284b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:00:01.339383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-1f449754-135f-4f71-956a-9c39b48b284b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:00:01.346468 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f449754-135f-4f71-956a-9c39b48b284b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:01.347234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f449754-135f-4f71-956a-9c39b48b284b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:01.347701 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f449754-135f-4f71-956a-9c39b48b284b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:01.348486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f449754-135f-4f71-956a-9c39b48b284b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:01.348991 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f449754-135f-4f71-956a-9c39b48b284b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:01.349448 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-1f449754-135f-4f71-956a-9c39b48b284b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:01.515645 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-1f449754-135f-4f71-956a-9c39b48b284b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:00:01.527088 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-1f449754-135f-4f71-956a-9c39b48b284b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625" status: 200 len: 1374 microversion: 2.1 time: 0.192907 Oct 24 12:00:01.528732 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3976/7975] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:00:01 2022] GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625 => generated 1374 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:00:01.943895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-c7cf0c53-7c2c-4920-a312-e7d758db6230 req-8477f923-e41b-4f11-b813-619b0c14db93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d3b744a-586a-4395-92e8-dc01af62f625", "tag": "c091c752-2d91-4892-81b6-b6715a0bba15"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 12:00:01.957729 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c7cf0c53-7c2c-4920-a312-e7d758db6230 req-8477f923-e41b-4f11-b813-619b0c14db93 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:01.958218 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c7cf0c53-7c2c-4920-a312-e7d758db6230 req-8477f923-e41b-4f11-b813-619b0c14db93 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:01.958649 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-c7cf0c53-7c2c-4920-a312-e7d758db6230 req-8477f923-e41b-4f11-b813-619b0c14db93 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:01.970477 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-c7cf0c53-7c2c-4920-a312-e7d758db6230 req-8477f923-e41b-4f11-b813-619b0c14db93 service nova] Creating event network-changed:c091c752-2d91-4892-81b6-b6715a0bba15 for instance 5d3b744a-586a-4395-92e8-dc01af62f625 on n-h2-858383-15 Oct 24 12:00:01.976040 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-c7cf0c53-7c2c-4920-a312-e7d758db6230 req-8477f923-e41b-4f11-b813-619b0c14db93 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036610 Oct 24 12:00:01.976644 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4000/7976] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 12:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 12:00:02.553186 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-29f36c6e-b802-4337-b488-a3d56ce7391e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:00:02.553749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-29f36c6e-b802-4337-b488-a3d56ce7391e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:00:02.563538 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29f36c6e-b802-4337-b488-a3d56ce7391e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:02.564244 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29f36c6e-b802-4337-b488-a3d56ce7391e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:02.565080 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29f36c6e-b802-4337-b488-a3d56ce7391e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:02.566386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29f36c6e-b802-4337-b488-a3d56ce7391e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:02.567265 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29f36c6e-b802-4337-b488-a3d56ce7391e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:02.568106 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-29f36c6e-b802-4337-b488-a3d56ce7391e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:02.782833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-29f36c6e-b802-4337-b488-a3d56ce7391e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:00:02.791876 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-29f36c6e-b802-4337-b488-a3d56ce7391e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625" status: 200 len: 1374 microversion: 2.1 time: 0.242832 Oct 24 12:00:02.792463 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3977/7977] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:00:02 2022] GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625 => generated 1374 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:00:03.816216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9de5b4d7-74d4-4b4a-92d4-36c75ccc9391 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:00:03.816953 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9de5b4d7-74d4-4b4a-92d4-36c75ccc9391 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:00:03.824316 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9de5b4d7-74d4-4b4a-92d4-36c75ccc9391 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:03.824799 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9de5b4d7-74d4-4b4a-92d4-36c75ccc9391 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:03.825266 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9de5b4d7-74d4-4b4a-92d4-36c75ccc9391 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:03.825970 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9de5b4d7-74d4-4b4a-92d4-36c75ccc9391 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:03.826436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9de5b4d7-74d4-4b4a-92d4-36c75ccc9391 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:03.826859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9de5b4d7-74d4-4b4a-92d4-36c75ccc9391 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:04.015593 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9de5b4d7-74d4-4b4a-92d4-36c75ccc9391 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:00:04.024696 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9de5b4d7-74d4-4b4a-92d4-36c75ccc9391 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625" status: 200 len: 1374 microversion: 2.1 time: 0.212159 Oct 24 12:00:04.025727 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4001/7978] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:00:03 2022] GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625 => generated 1374 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:00:05.049528 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-09bcf13c-2303-425e-ba70-622c5323f061 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:00:05.050179 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-09bcf13c-2303-425e-ba70-622c5323f061 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:00:05.057735 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09bcf13c-2303-425e-ba70-622c5323f061 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:05.058234 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09bcf13c-2303-425e-ba70-622c5323f061 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:05.058704 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09bcf13c-2303-425e-ba70-622c5323f061 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:05.059392 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09bcf13c-2303-425e-ba70-622c5323f061 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:05.059858 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09bcf13c-2303-425e-ba70-622c5323f061 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:05.060367 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-09bcf13c-2303-425e-ba70-622c5323f061 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:05.196598 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-09bcf13c-2303-425e-ba70-622c5323f061 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:00:05.204541 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-09bcf13c-2303-425e-ba70-622c5323f061 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625" status: 200 len: 1374 microversion: 2.1 time: 0.158969 Oct 24 12:00:05.205211 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3978/7979] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:00:05 2022] GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:00:06.228417 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-659444a5-2c5f-4ef0-b6a6-7dc2c3ca4dc4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:00:06.229126 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-659444a5-2c5f-4ef0-b6a6-7dc2c3ca4dc4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:00:06.235959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-659444a5-2c5f-4ef0-b6a6-7dc2c3ca4dc4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:06.236436 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-659444a5-2c5f-4ef0-b6a6-7dc2c3ca4dc4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:06.236892 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-659444a5-2c5f-4ef0-b6a6-7dc2c3ca4dc4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:06.237584 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-659444a5-2c5f-4ef0-b6a6-7dc2c3ca4dc4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:06.238036 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-659444a5-2c5f-4ef0-b6a6-7dc2c3ca4dc4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:06.238459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-659444a5-2c5f-4ef0-b6a6-7dc2c3ca4dc4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:06.373294 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-659444a5-2c5f-4ef0-b6a6-7dc2c3ca4dc4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:00:06.383533 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-659444a5-2c5f-4ef0-b6a6-7dc2c3ca4dc4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625" status: 200 len: 1374 microversion: 2.1 time: 0.158649 Oct 24 12:00:06.384633 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4002/7980] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:00:06 2022] GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:00:07.411470 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-cc551292-db50-4103-ba0f-3ee45473d993 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:00:07.412100 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-cc551292-db50-4103-ba0f-3ee45473d993 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:00:07.419880 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc551292-db50-4103-ba0f-3ee45473d993 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:07.420382 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc551292-db50-4103-ba0f-3ee45473d993 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:07.420851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc551292-db50-4103-ba0f-3ee45473d993 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:07.421569 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc551292-db50-4103-ba0f-3ee45473d993 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:07.422039 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc551292-db50-4103-ba0f-3ee45473d993 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:07.422480 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-cc551292-db50-4103-ba0f-3ee45473d993 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:07.566307 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-cc551292-db50-4103-ba0f-3ee45473d993 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:00:07.576379 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-cc551292-db50-4103-ba0f-3ee45473d993 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625" status: 200 len: 1374 microversion: 2.1 time: 0.168176 Oct 24 12:00:07.577171 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3979/7981] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:00:07 2022] GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:00:07.631760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-a9a6120a-8b02-42d4-9f97-303d58cde402 req-a6ce4da3-b1be-4666-9ff6-65cb565e9ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d3b744a-586a-4395-92e8-dc01af62f625", "name": "network-vif-plugged", "status": "completed", "tag": "c091c752-2d91-4892-81b6-b6715a0bba15"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 12:00:07.641661 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a9a6120a-8b02-42d4-9f97-303d58cde402 req-a6ce4da3-b1be-4666-9ff6-65cb565e9ba0 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:07.642419 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a9a6120a-8b02-42d4-9f97-303d58cde402 req-a6ce4da3-b1be-4666-9ff6-65cb565e9ba0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:07.642854 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-a9a6120a-8b02-42d4-9f97-303d58cde402 req-a6ce4da3-b1be-4666-9ff6-65cb565e9ba0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:07.657835 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-a9a6120a-8b02-42d4-9f97-303d58cde402 req-a6ce4da3-b1be-4666-9ff6-65cb565e9ba0 service nova] Creating event network-vif-plugged:c091c752-2d91-4892-81b6-b6715a0bba15 for instance 5d3b744a-586a-4395-92e8-dc01af62f625 on n-h2-858383-15 Oct 24 12:00:07.662881 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-a9a6120a-8b02-42d4-9f97-303d58cde402 req-a6ce4da3-b1be-4666-9ff6-65cb565e9ba0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097771 Oct 24 12:00:07.663475 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4003/7982] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 12:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 12:00:08.601494 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f0239e81-7379-4b6c-949b-0c1073179261 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:00:08.602154 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f0239e81-7379-4b6c-949b-0c1073179261 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:00:08.609119 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0239e81-7379-4b6c-949b-0c1073179261 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:08.609626 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0239e81-7379-4b6c-949b-0c1073179261 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:08.610086 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0239e81-7379-4b6c-949b-0c1073179261 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:08.610796 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0239e81-7379-4b6c-949b-0c1073179261 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:08.611269 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0239e81-7379-4b6c-949b-0c1073179261 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:08.611716 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f0239e81-7379-4b6c-949b-0c1073179261 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:08.741781 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f0239e81-7379-4b6c-949b-0c1073179261 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:00:08.749594 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f0239e81-7379-4b6c-949b-0c1073179261 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625" status: 200 len: 1374 microversion: 2.1 time: 0.152004 Oct 24 12:00:08.750164 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3980/7983] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:00:08 2022] GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625 => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:00:09.770916 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:00:09.771694 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=6 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:00:09.776650 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7ae71b42-310f-4b7b-9172-e3b9945cbe93 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:00:09.777404 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7ae71b42-310f-4b7b-9172-e3b9945cbe93 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:00:09.784504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ae71b42-310f-4b7b-9172-e3b9945cbe93 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:09.785026 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ae71b42-310f-4b7b-9172-e3b9945cbe93 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:09.785734 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ae71b42-310f-4b7b-9172-e3b9945cbe93 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:09.786433 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ae71b42-310f-4b7b-9172-e3b9945cbe93 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:09.786896 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ae71b42-310f-4b7b-9172-e3b9945cbe93 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:09.787330 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7ae71b42-310f-4b7b-9172-e3b9945cbe93 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:09.923312 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7ae71b42-310f-4b7b-9172-e3b9945cbe93 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:00:09.931557 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7ae71b42-310f-4b7b-9172-e3b9945cbe93 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625" status: 200 len: 1559 microversion: 2.1 time: 0.162438 Oct 24 12:00:09.932123 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4004/7984] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:00:09 2022] GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:00:09.953874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4b53344a-94be-4c41-be91-1315221c66d4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:00:09.954543 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4b53344a-94be-4c41-be91-1315221c66d4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:00:09.956406 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:00:09.962919 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b53344a-94be-4c41-be91-1315221c66d4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:09.963420 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b53344a-94be-4c41-be91-1315221c66d4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:09.963878 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b53344a-94be-4c41-be91-1315221c66d4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:09.964592 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b53344a-94be-4c41-be91-1315221c66d4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:09.965089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b53344a-94be-4c41-be91-1315221c66d4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:09.965535 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4b53344a-94be-4c41-be91-1315221c66d4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:10.096490 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4b53344a-94be-4c41-be91-1315221c66d4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:00:10.104394 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4b53344a-94be-4c41-be91-1315221c66d4 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625" status: 200 len: 1559 microversion: 2.1 time: 0.154422 Oct 24 12:00:10.104997 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3981/7985] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:00:09 2022] GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:00:12.010742 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-f392aced-bc89-4744-a9da-f0e858b0ec7e req-0a1260ca-af38-4a08-af5a-196083209184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d3b744a-586a-4395-92e8-dc01af62f625", "tag": "c091c752-2d91-4892-81b6-b6715a0bba15"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 12:00:12.021736 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f392aced-bc89-4744-a9da-f0e858b0ec7e req-0a1260ca-af38-4a08-af5a-196083209184 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:00:12.022242 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f392aced-bc89-4744-a9da-f0e858b0ec7e req-0a1260ca-af38-4a08-af5a-196083209184 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:00:12.022671 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-f392aced-bc89-4744-a9da-f0e858b0ec7e req-0a1260ca-af38-4a08-af5a-196083209184 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:00:12.033822 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-f392aced-bc89-4744-a9da-f0e858b0ec7e req-0a1260ca-af38-4a08-af5a-196083209184 service nova] Creating event network-changed:c091c752-2d91-4892-81b6-b6715a0bba15 for instance 5d3b744a-586a-4395-92e8-dc01af62f625 on n-h2-858383-15 Oct 24 12:00:12.039508 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-f392aced-bc89-4744-a9da-f0e858b0ec7e req-0a1260ca-af38-4a08-af5a-196083209184 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033059 Oct 24 12:00:12.040705 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4005/7986] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 12:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 12:02:07.230878 n-d-858383-15 devstack@n-api.service[120425]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1abc338e-6c14-4311-a7b3-814582834b4a] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 12:02:07.231799 n-d-858383-15 devstack@n-api.service[120425]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ebd6dc19-988c-4764-bcee-cebc857bf132] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 24 12:02:07.232565 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:02:07.233398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=36 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:02:07.234671 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 12:02:07.234815 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 12:02:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625/action (ip 10.222.0.50) !!! Oct 24 12:02:07.236734 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 24 12:02:07.236734 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 12:02:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625/action (ip 10.222.0.50) !!! Oct 24 12:02:07.242792 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-8fd59b53-8723-40cb-9618-b4e8c4cc742c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-565611066"}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 12:02:07.245118 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-8fd59b53-8723-40cb-9618-b4e8c4cc742c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:07.258856 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fd59b53-8723-40cb-9618-b4e8c4cc742c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:07.259349 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fd59b53-8723-40cb-9618-b4e8c4cc742c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:07.259802 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fd59b53-8723-40cb-9618-b4e8c4cc742c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:07.260506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fd59b53-8723-40cb-9618-b4e8c4cc742c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:07.261098 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fd59b53-8723-40cb-9618-b4e8c4cc742c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:07.261541 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-8fd59b53-8723-40cb-9618-b4e8c4cc742c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:07.466362 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-8fd59b53-8723-40cb-9618-b4e8c4cc742c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "POST /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625/action" status: 202 len: 0 microversion: 2.1 time: 0.237517 Oct 24 12:02:07.466999 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3982/7987] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 12:02:07 2022] POST /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 12:02:14.155546 n-d-858383-15 devstack@n-api.service[120426]: ERROR oslo.messaging._drivers.impl_rabbit [-] [05048d7c-6448-4d6e-b9e7-4fa04d95d8b6] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 12:02:14.157700 n-d-858383-15 devstack@n-api.service[120426]: ERROR oslo.messaging._drivers.impl_rabbit [-] [666865aa-442b-4005-907b-9c648cd2f782] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 12:02:14.158710 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:02:14.159741 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=32 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:02:14.172313 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-ec2462f3-802e-4915-8a4c-bc1970a65bce req-4eb90aae-49c9-4d6c-9309-ec1db2ede503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d3b744a-586a-4395-92e8-dc01af62f625", "name": "network-vif-plugged", "status": "completed", "tag": "c091c752-2d91-4892-81b6-b6715a0bba15"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 12:02:14.185767 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ec2462f3-802e-4915-8a4c-bc1970a65bce req-4eb90aae-49c9-4d6c-9309-ec1db2ede503 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:14.186640 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ec2462f3-802e-4915-8a4c-bc1970a65bce req-4eb90aae-49c9-4d6c-9309-ec1db2ede503 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:14.187620 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-ec2462f3-802e-4915-8a4c-bc1970a65bce req-4eb90aae-49c9-4d6c-9309-ec1db2ede503 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:14.200524 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-ec2462f3-802e-4915-8a4c-bc1970a65bce req-4eb90aae-49c9-4d6c-9309-ec1db2ede503 service nova] Creating event network-vif-plugged:c091c752-2d91-4892-81b6-b6715a0bba15 for instance 5d3b744a-586a-4395-92e8-dc01af62f625 on n-h2-858383-15 Oct 24 12:02:14.211088 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-ec2462f3-802e-4915-8a4c-bc1970a65bce req-4eb90aae-49c9-4d6c-9309-ec1db2ede503 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058226 Oct 24 12:02:14.212369 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4006/7988] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 12:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 12:02:21.045024 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:02:21.045887 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:02:21.050360 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-a4cc9141-cb19-4a71-b813-eb3bc27cdc67 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1050843487", "imageRef": "ced5c45d-7e87-4368-84a3-a995b0e24205", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-394265303", "security_groups": [{"name": "tempest-secgroup-smoke-1841054558"}], "networks": [{"uuid": "9b957b59-74ba-4825-ae1d-e6df9d5b43e1"}]}} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 12:02:21.078586 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] [ebd6dc19-988c-4764-bcee-cebc857bf132] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 53208. Oct 24 12:02:21.080438 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] [1abc338e-6c14-4311-a7b3-814582834b4a] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 53206. Oct 24 12:02:21.165427 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.network.neutron [None req-a4cc9141-cb19-4a71-b813-eb3bc27cdc67 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] validate_networks() for [('9b957b59-74ba-4825-ae1d-e6df9d5b43e1', None, None, None, None, None)] {{(pid=120425) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 12:02:21.550465 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a4cc9141-cb19-4a71-b813-eb3bc27cdc67 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Flavor limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 12:02:21.550895 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a4cc9141-cb19-4a71-b813-eb3bc27cdc67 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Image limits 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 12:02:21.551386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a4cc9141-cb19-4a71-b813-eb3bc27cdc67 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Flavor pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 12:02:21.551834 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a4cc9141-cb19-4a71-b813-eb3bc27cdc67 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Image pref 0:0:0 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 12:02:21.552262 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.virt.hardware [None req-a4cc9141-cb19-4a71-b813-eb3bc27cdc67 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 12:02:21.561292 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4cc9141-cb19-4a71-b813-eb3bc27cdc67 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:21.561809 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4cc9141-cb19-4a71-b813-eb3bc27cdc67 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:21.562267 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4cc9141-cb19-4a71-b813-eb3bc27cdc67 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:21.563013 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4cc9141-cb19-4a71-b813-eb3bc27cdc67 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:21.563489 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4cc9141-cb19-4a71-b813-eb3bc27cdc67 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:21.563934 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-a4cc9141-cb19-4a71-b813-eb3bc27cdc67 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:21.580486 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-a4cc9141-cb19-4a71-b813-eb3bc27cdc67 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Getting quotas for project a671adbfc1f44855887168b0b73cd8f1. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 12:02:21.585744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.quota [None req-a4cc9141-cb19-4a71-b813-eb3bc27cdc67 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Getting quotas for user 9ab62c4a4376460eaf10a3685840d8da and project a671adbfc1f44855887168b0b73cd8f1. Resources: {'instances', 'ram', 'cores'} {{(pid=120425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 12:02:21.598513 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a4cc9141-cb19-4a71-b813-eb3bc27cdc67 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Going to run 1 instances... {{(pid=120425) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 12:02:21.600947 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-a4cc9141-cb19-4a71-b813-eb3bc27cdc67 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ced5c45d-7e87-4368-84a3-a995b0e24205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 12:02:21.648622 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-a4cc9141-cb19-4a71-b813-eb3bc27cdc67 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.605988 Oct 24 12:02:21.649330 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3983/7989] 10.222.0.50 () {60 vars in 1147 bytes} [Mon Oct 24 12:02:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 12:02:21.663292 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0a0ad943-71a8-46e4-8e83-87b49fb53beb tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:02:21.664002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0a0ad943-71a8-46e4-8e83-87b49fb53beb tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:21.676150 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] [666865aa-442b-4005-907b-9c648cd2f782] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 53224. Oct 24 12:02:21.678941 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] [05048d7c-6448-4d6e-b9e7-4fa04d95d8b6] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 53222. Oct 24 12:02:21.727389 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0a0ad943-71a8-46e4-8e83-87b49fb53beb tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:02:21.735590 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0a0ad943-71a8-46e4-8e83-87b49fb53beb tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1248 microversion: 2.1 time: 0.078169 Oct 24 12:02:21.736161 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4007/7990] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:02:21 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1248 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:02:22.759232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-97c15b6b-7de9-409e-b814-27220e244a21 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:02:22.759872 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-97c15b6b-7de9-409e-b814-27220e244a21 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:22.767447 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97c15b6b-7de9-409e-b814-27220e244a21 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:22.767928 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97c15b6b-7de9-409e-b814-27220e244a21 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:22.768387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97c15b6b-7de9-409e-b814-27220e244a21 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:22.769157 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97c15b6b-7de9-409e-b814-27220e244a21 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:22.769616 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97c15b6b-7de9-409e-b814-27220e244a21 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:22.770060 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-97c15b6b-7de9-409e-b814-27220e244a21 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:22.842175 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-97c15b6b-7de9-409e-b814-27220e244a21 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:02:22.850899 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-97c15b6b-7de9-409e-b814-27220e244a21 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1308 microversion: 2.1 time: 0.096088 Oct 24 12:02:22.851686 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3984/7991] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:02:22 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:02:23.875935 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-04363f97-aa73-45cb-ace8-f0f77ad992f8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:02:23.876666 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-04363f97-aa73-45cb-ace8-f0f77ad992f8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:23.896863 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04363f97-aa73-45cb-ace8-f0f77ad992f8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:23.897869 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04363f97-aa73-45cb-ace8-f0f77ad992f8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:23.898619 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04363f97-aa73-45cb-ace8-f0f77ad992f8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:23.899563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04363f97-aa73-45cb-ace8-f0f77ad992f8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:23.900439 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04363f97-aa73-45cb-ace8-f0f77ad992f8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:23.901082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-04363f97-aa73-45cb-ace8-f0f77ad992f8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:24.054635 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-04363f97-aa73-45cb-ace8-f0f77ad992f8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:02:24.065276 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-04363f97-aa73-45cb-ace8-f0f77ad992f8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1374 microversion: 2.1 time: 0.194319 Oct 24 12:02:24.065873 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4008/7992] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:02:23 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1374 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:02:24.166495 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-3c86a30d-2694-424c-931f-beb918026a33 req-873c0667-b859-41da-bf47-758be8b59c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d3b744a-586a-4395-92e8-dc01af62f625", "name": "network-vif-unplugged", "status": "completed", "tag": "c091c752-2d91-4892-81b6-b6715a0bba15"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 12:02:24.181749 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3c86a30d-2694-424c-931f-beb918026a33 req-873c0667-b859-41da-bf47-758be8b59c1f service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:24.182272 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3c86a30d-2694-424c-931f-beb918026a33 req-873c0667-b859-41da-bf47-758be8b59c1f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:24.182721 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-3c86a30d-2694-424c-931f-beb918026a33 req-873c0667-b859-41da-bf47-758be8b59c1f service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:24.200474 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-3c86a30d-2694-424c-931f-beb918026a33 req-873c0667-b859-41da-bf47-758be8b59c1f service nova] Creating event network-vif-unplugged:c091c752-2d91-4892-81b6-b6715a0bba15 for instance 5d3b744a-586a-4395-92e8-dc01af62f625 on n-h2-858383-15 Oct 24 12:02:24.209218 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-3c86a30d-2694-424c-931f-beb918026a33 req-873c0667-b859-41da-bf47-758be8b59c1f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047487 Oct 24 12:02:24.210079 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3985/7993] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 12:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 12:02:25.092738 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-08f974db-9f2e-4637-b0f8-ae94065b8bbc tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:02:25.093985 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-08f974db-9f2e-4637-b0f8-ae94065b8bbc tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:25.101504 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08f974db-9f2e-4637-b0f8-ae94065b8bbc tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:25.102005 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08f974db-9f2e-4637-b0f8-ae94065b8bbc tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:25.102597 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08f974db-9f2e-4637-b0f8-ae94065b8bbc tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:25.103325 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08f974db-9f2e-4637-b0f8-ae94065b8bbc tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:25.103841 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08f974db-9f2e-4637-b0f8-ae94065b8bbc tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:25.104221 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-08f974db-9f2e-4637-b0f8-ae94065b8bbc tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:25.250332 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-08f974db-9f2e-4637-b0f8-ae94065b8bbc tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:02:25.258437 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-08f974db-9f2e-4637-b0f8-ae94065b8bbc tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1374 microversion: 2.1 time: 0.170428 Oct 24 12:02:25.259037 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4009/7994] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:02:25 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:02:26.284540 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-dc6f579a-9ddd-4965-b0d1-69bd35acff34 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:02:26.285387 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-dc6f579a-9ddd-4965-b0d1-69bd35acff34 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:26.292383 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc6f579a-9ddd-4965-b0d1-69bd35acff34 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:26.292923 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc6f579a-9ddd-4965-b0d1-69bd35acff34 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:26.294011 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc6f579a-9ddd-4965-b0d1-69bd35acff34 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:26.294737 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc6f579a-9ddd-4965-b0d1-69bd35acff34 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:26.295215 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc6f579a-9ddd-4965-b0d1-69bd35acff34 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:26.295663 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-dc6f579a-9ddd-4965-b0d1-69bd35acff34 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:26.440459 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-dc6f579a-9ddd-4965-b0d1-69bd35acff34 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:02:26.448453 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-dc6f579a-9ddd-4965-b0d1-69bd35acff34 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1374 microversion: 2.1 time: 0.169218 Oct 24 12:02:26.449065 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3986/7995] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:02:26 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:02:27.473023 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-894e848f-09eb-4e3a-b42a-4c39d82a8612 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:02:27.473931 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-894e848f-09eb-4e3a-b42a-4c39d82a8612 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:27.481186 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-894e848f-09eb-4e3a-b42a-4c39d82a8612 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:27.481945 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-894e848f-09eb-4e3a-b42a-4c39d82a8612 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:27.482387 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-894e848f-09eb-4e3a-b42a-4c39d82a8612 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:27.483103 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-894e848f-09eb-4e3a-b42a-4c39d82a8612 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:27.483564 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-894e848f-09eb-4e3a-b42a-4c39d82a8612 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:27.483995 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-894e848f-09eb-4e3a-b42a-4c39d82a8612 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:27.628413 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-894e848f-09eb-4e3a-b42a-4c39d82a8612 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:02:27.636655 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-894e848f-09eb-4e3a-b42a-4c39d82a8612 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1374 microversion: 2.1 time: 0.167573 Oct 24 12:02:27.638195 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4010/7996] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:02:27 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:02:28.660220 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-6ec4cb7e-c133-4ef5-8209-4804475a8ef8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:02:28.661010 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-6ec4cb7e-c133-4ef5-8209-4804475a8ef8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:28.668708 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ec4cb7e-c133-4ef5-8209-4804475a8ef8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:28.669537 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ec4cb7e-c133-4ef5-8209-4804475a8ef8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:28.670259 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ec4cb7e-c133-4ef5-8209-4804475a8ef8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:28.671196 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ec4cb7e-c133-4ef5-8209-4804475a8ef8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:28.671680 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ec4cb7e-c133-4ef5-8209-4804475a8ef8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:28.672131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-6ec4cb7e-c133-4ef5-8209-4804475a8ef8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:28.824189 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-6ec4cb7e-c133-4ef5-8209-4804475a8ef8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:02:28.832413 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-6ec4cb7e-c133-4ef5-8209-4804475a8ef8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1374 microversion: 2.1 time: 0.176008 Oct 24 12:02:28.833310 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3987/7997] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:02:28 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:02:29.856400 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-81f051bd-8b51-449b-905a-ffa2a3e1e806 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:02:29.857080 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-81f051bd-8b51-449b-905a-ffa2a3e1e806 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:29.864157 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81f051bd-8b51-449b-905a-ffa2a3e1e806 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:29.864663 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81f051bd-8b51-449b-905a-ffa2a3e1e806 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:29.865192 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81f051bd-8b51-449b-905a-ffa2a3e1e806 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:29.866239 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81f051bd-8b51-449b-905a-ffa2a3e1e806 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:29.866703 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81f051bd-8b51-449b-905a-ffa2a3e1e806 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:29.867135 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-81f051bd-8b51-449b-905a-ffa2a3e1e806 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:30.021345 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-81f051bd-8b51-449b-905a-ffa2a3e1e806 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:02:30.030575 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-81f051bd-8b51-449b-905a-ffa2a3e1e806 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1374 microversion: 2.1 time: 0.178694 Oct 24 12:02:30.031376 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4011/7998] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:02:29 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:02:31.056231 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-4941df4e-db19-4eee-9533-4cae81b7451c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:02:31.056885 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-4941df4e-db19-4eee-9533-4cae81b7451c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:31.066746 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4941df4e-db19-4eee-9533-4cae81b7451c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:31.067251 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4941df4e-db19-4eee-9533-4cae81b7451c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:31.067706 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4941df4e-db19-4eee-9533-4cae81b7451c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:31.068437 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4941df4e-db19-4eee-9533-4cae81b7451c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:31.068931 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4941df4e-db19-4eee-9533-4cae81b7451c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:31.069375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-4941df4e-db19-4eee-9533-4cae81b7451c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:31.224475 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-4941df4e-db19-4eee-9533-4cae81b7451c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:02:31.234089 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-4941df4e-db19-4eee-9533-4cae81b7451c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1374 microversion: 2.1 time: 0.182076 Oct 24 12:02:31.234894 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3988/7999] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:02:31 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1374 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:02:32.258444 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-4932e4b7-2514-4bcb-a49c-19d671ca0d09 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:02:32.259147 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-4932e4b7-2514-4bcb-a49c-19d671ca0d09 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:32.261922 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell0:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:02:32.267632 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4932e4b7-2514-4bcb-a49c-19d671ca0d09 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:32.268120 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4932e4b7-2514-4bcb-a49c-19d671ca0d09 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:32.268559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4932e4b7-2514-4bcb-a49c-19d671ca0d09 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:32.269311 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4932e4b7-2514-4bcb-a49c-19d671ca0d09 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:32.269763 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4932e4b7-2514-4bcb-a49c-19d671ca0d09 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:32.270189 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-4932e4b7-2514-4bcb-a49c-19d671ca0d09 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:32.418807 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-4932e4b7-2514-4bcb-a49c-19d671ca0d09 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:02:32.437053 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-4932e4b7-2514-4bcb-a49c-19d671ca0d09 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1374 microversion: 2.1 time: 0.180981 Oct 24 12:02:32.437713 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4012/8000] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:02:32 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1374 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:02:32.654585 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=2 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:02:32.655496 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell0:SELECT=6 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:02:32.731077 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-bf89cc23-4ffe-4ebe-9cf9-4924a818809c req-408e66f4-f43d-47e3-95c0-98f9738f63d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf93a429-f37f-469d-bdbd-c82da1a0d1af", "tag": "b0769a3a-1970-4793-b344-c95f2e478b5b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 12:02:32.748254 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-bf89cc23-4ffe-4ebe-9cf9-4924a818809c req-408e66f4-f43d-47e3-95c0-98f9738f63d3 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:32.748747 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-bf89cc23-4ffe-4ebe-9cf9-4924a818809c req-408e66f4-f43d-47e3-95c0-98f9738f63d3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:32.749666 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-bf89cc23-4ffe-4ebe-9cf9-4924a818809c req-408e66f4-f43d-47e3-95c0-98f9738f63d3 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:32.761275 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-bf89cc23-4ffe-4ebe-9cf9-4924a818809c req-408e66f4-f43d-47e3-95c0-98f9738f63d3 service nova] Creating event network-changed:b0769a3a-1970-4793-b344-c95f2e478b5b for instance bf93a429-f37f-469d-bdbd-c82da1a0d1af on n-h2-858383-15 Oct 24 12:02:32.766458 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-bf89cc23-4ffe-4ebe-9cf9-4924a818809c req-408e66f4-f43d-47e3-95c0-98f9738f63d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117498 Oct 24 12:02:32.766987 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3989/8001] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 12:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 12:02:33.460623 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-18339fe9-9e60-4690-ad9d-4f0c1fa84c57 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:02:33.461249 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-18339fe9-9e60-4690-ad9d-4f0c1fa84c57 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:33.468132 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18339fe9-9e60-4690-ad9d-4f0c1fa84c57 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:33.468608 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18339fe9-9e60-4690-ad9d-4f0c1fa84c57 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:33.469069 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18339fe9-9e60-4690-ad9d-4f0c1fa84c57 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:33.469760 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18339fe9-9e60-4690-ad9d-4f0c1fa84c57 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:33.470212 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18339fe9-9e60-4690-ad9d-4f0c1fa84c57 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:33.470637 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-18339fe9-9e60-4690-ad9d-4f0c1fa84c57 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:33.602445 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-18339fe9-9e60-4690-ad9d-4f0c1fa84c57 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:02:33.610761 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-18339fe9-9e60-4690-ad9d-4f0c1fa84c57 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1374 microversion: 2.1 time: 0.153995 Oct 24 12:02:33.611332 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4013/8002] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:02:33 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:02:34.635442 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-f24d67b7-0ab7-42be-9ef0-347779281c1a tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:02:34.636192 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-f24d67b7-0ab7-42be-9ef0-347779281c1a tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:34.643169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f24d67b7-0ab7-42be-9ef0-347779281c1a tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:34.643677 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f24d67b7-0ab7-42be-9ef0-347779281c1a tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:34.644163 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f24d67b7-0ab7-42be-9ef0-347779281c1a tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:34.644903 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f24d67b7-0ab7-42be-9ef0-347779281c1a tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:34.645386 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f24d67b7-0ab7-42be-9ef0-347779281c1a tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:34.645838 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-f24d67b7-0ab7-42be-9ef0-347779281c1a tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:34.781065 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-f24d67b7-0ab7-42be-9ef0-347779281c1a tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:02:34.789041 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-f24d67b7-0ab7-42be-9ef0-347779281c1a tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1374 microversion: 2.1 time: 0.158719 Oct 24 12:02:34.789624 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3990/8003] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:02:34 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:02:35.812127 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-7815e8b6-a16f-4a10-8bd1-54a3a04006aa tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:02:35.812747 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-7815e8b6-a16f-4a10-8bd1-54a3a04006aa tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:35.819644 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7815e8b6-a16f-4a10-8bd1-54a3a04006aa tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:35.820123 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7815e8b6-a16f-4a10-8bd1-54a3a04006aa tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:35.820559 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7815e8b6-a16f-4a10-8bd1-54a3a04006aa tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:35.821342 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7815e8b6-a16f-4a10-8bd1-54a3a04006aa tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:35.821798 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7815e8b6-a16f-4a10-8bd1-54a3a04006aa tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:35.822220 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-7815e8b6-a16f-4a10-8bd1-54a3a04006aa tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:35.952450 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-7815e8b6-a16f-4a10-8bd1-54a3a04006aa tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:02:35.960128 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-7815e8b6-a16f-4a10-8bd1-54a3a04006aa tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1374 microversion: 2.1 time: 0.151918 Oct 24 12:02:35.960698 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4014/8004] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:02:35 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:02:36.984599 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-44b78fe1-e305-490b-992c-6ce4049c4be6 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:02:36.985255 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-44b78fe1-e305-490b-992c-6ce4049c4be6 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:36.992145 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44b78fe1-e305-490b-992c-6ce4049c4be6 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:36.992648 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44b78fe1-e305-490b-992c-6ce4049c4be6 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:36.993132 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44b78fe1-e305-490b-992c-6ce4049c4be6 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:36.993847 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44b78fe1-e305-490b-992c-6ce4049c4be6 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:36.994322 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44b78fe1-e305-490b-992c-6ce4049c4be6 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:36.994766 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-44b78fe1-e305-490b-992c-6ce4049c4be6 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:37.130979 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-44b78fe1-e305-490b-992c-6ce4049c4be6 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:02:37.138872 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-44b78fe1-e305-490b-992c-6ce4049c4be6 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1374 microversion: 2.1 time: 0.159084 Oct 24 12:02:37.139444 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3991/8005] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:02:36 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:02:38.161585 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-2f5e9a6d-36cb-497d-b764-99badfe60073 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:02:38.162468 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-2f5e9a6d-36cb-497d-b764-99badfe60073 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:38.169303 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f5e9a6d-36cb-497d-b764-99badfe60073 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:38.169801 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f5e9a6d-36cb-497d-b764-99badfe60073 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:38.170238 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f5e9a6d-36cb-497d-b764-99badfe60073 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:38.170938 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f5e9a6d-36cb-497d-b764-99badfe60073 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:38.171391 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f5e9a6d-36cb-497d-b764-99badfe60073 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:38.171844 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-2f5e9a6d-36cb-497d-b764-99badfe60073 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:38.305959 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-2f5e9a6d-36cb-497d-b764-99badfe60073 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:02:38.314578 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-2f5e9a6d-36cb-497d-b764-99badfe60073 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1374 microversion: 2.1 time: 0.156857 Oct 24 12:02:38.315205 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4015/8006] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:02:38 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:02:38.329862 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-9e43371d-f57f-4c2f-8fe5-adc25876b368 req-3d49b62f-d916-403e-8d42-5ed47e1b1147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf93a429-f37f-469d-bdbd-c82da1a0d1af", "name": "network-vif-plugged", "status": "completed", "tag": "b0769a3a-1970-4793-b344-c95f2e478b5b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 12:02:38.341769 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9e43371d-f57f-4c2f-8fe5-adc25876b368 req-3d49b62f-d916-403e-8d42-5ed47e1b1147 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:38.342355 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9e43371d-f57f-4c2f-8fe5-adc25876b368 req-3d49b62f-d916-403e-8d42-5ed47e1b1147 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:38.342833 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-9e43371d-f57f-4c2f-8fe5-adc25876b368 req-3d49b62f-d916-403e-8d42-5ed47e1b1147 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:38.357927 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-9e43371d-f57f-4c2f-8fe5-adc25876b368 req-3d49b62f-d916-403e-8d42-5ed47e1b1147 service nova] Creating event network-vif-plugged:b0769a3a-1970-4793-b344-c95f2e478b5b for instance bf93a429-f37f-469d-bdbd-c82da1a0d1af on n-h2-858383-15 Oct 24 12:02:38.363014 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-9e43371d-f57f-4c2f-8fe5-adc25876b368 req-3d49b62f-d916-403e-8d42-5ed47e1b1147 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037580 Oct 24 12:02:38.363633 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3992/8007] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 12:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 12:02:39.339216 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-0eaf9983-f23b-4605-a4a0-bb2fed788c69 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:02:39.339824 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-0eaf9983-f23b-4605-a4a0-bb2fed788c69 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:39.347470 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0eaf9983-f23b-4605-a4a0-bb2fed788c69 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:39.347952 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0eaf9983-f23b-4605-a4a0-bb2fed788c69 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:39.348384 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0eaf9983-f23b-4605-a4a0-bb2fed788c69 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:39.349094 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0eaf9983-f23b-4605-a4a0-bb2fed788c69 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:39.349554 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0eaf9983-f23b-4605-a4a0-bb2fed788c69 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:39.349979 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-0eaf9983-f23b-4605-a4a0-bb2fed788c69 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:39.480900 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-0eaf9983-f23b-4605-a4a0-bb2fed788c69 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:02:39.488993 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-0eaf9983-f23b-4605-a4a0-bb2fed788c69 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1374 microversion: 2.1 time: 0.153714 Oct 24 12:02:39.489586 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4016/8008] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:02:39 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:02:40.514971 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-7ad4eacb-fbce-4de7-bfe0-9a31208954d0 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:02:40.515692 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-7ad4eacb-fbce-4de7-bfe0-9a31208954d0 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:40.521976 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ad4eacb-fbce-4de7-bfe0-9a31208954d0 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:40.522471 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ad4eacb-fbce-4de7-bfe0-9a31208954d0 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:40.522926 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ad4eacb-fbce-4de7-bfe0-9a31208954d0 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:40.523635 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ad4eacb-fbce-4de7-bfe0-9a31208954d0 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:40.524108 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ad4eacb-fbce-4de7-bfe0-9a31208954d0 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:40.524553 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-7ad4eacb-fbce-4de7-bfe0-9a31208954d0 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:40.660795 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-7ad4eacb-fbce-4de7-bfe0-9a31208954d0 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:02:40.668843 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-7ad4eacb-fbce-4de7-bfe0-9a31208954d0 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1559 microversion: 2.1 time: 0.159013 Oct 24 12:02:40.669641 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3993/8009] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:02:40 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:02:40.691372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-60847639-eb93-4127-be4d-72b16de4290f tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:02:40.691981 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-60847639-eb93-4127-be4d-72b16de4290f tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:02:40.698758 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-60847639-eb93-4127-be4d-72b16de4290f tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:40.699236 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-60847639-eb93-4127-be4d-72b16de4290f tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:40.699813 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-60847639-eb93-4127-be4d-72b16de4290f tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:40.701142 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-60847639-eb93-4127-be4d-72b16de4290f tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:40.701676 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-60847639-eb93-4127-be4d-72b16de4290f tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:40.702089 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-60847639-eb93-4127-be4d-72b16de4290f tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:40.836074 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-60847639-eb93-4127-be4d-72b16de4290f tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:02:40.844447 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-60847639-eb93-4127-be4d-72b16de4290f tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1559 microversion: 2.1 time: 0.156871 Oct 24 12:02:40.845129 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4017/8010] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:02:40 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:02:42.772131 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-610281d3-c2cf-4d8e-91b2-0b0ffc0666d9 req-8d36484d-c62f-47db-b314-e69c11ca336d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf93a429-f37f-469d-bdbd-c82da1a0d1af", "tag": "b0769a3a-1970-4793-b344-c95f2e478b5b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 12:02:42.782346 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-610281d3-c2cf-4d8e-91b2-0b0ffc0666d9 req-8d36484d-c62f-47db-b314-e69c11ca336d service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:02:42.782840 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-610281d3-c2cf-4d8e-91b2-0b0ffc0666d9 req-8d36484d-c62f-47db-b314-e69c11ca336d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:02:42.783313 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-610281d3-c2cf-4d8e-91b2-0b0ffc0666d9 req-8d36484d-c62f-47db-b314-e69c11ca336d service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:02:42.795450 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-610281d3-c2cf-4d8e-91b2-0b0ffc0666d9 req-8d36484d-c62f-47db-b314-e69c11ca336d service nova] Creating event network-changed:b0769a3a-1970-4793-b344-c95f2e478b5b for instance bf93a429-f37f-469d-bdbd-c82da1a0d1af on n-h2-858383-15 Oct 24 12:02:42.800674 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-610281d3-c2cf-4d8e-91b2-0b0ffc0666d9 req-8d36484d-c62f-47db-b314-e69c11ca336d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087804 Oct 24 12:02:42.801605 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3994/8011] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 12:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 12:04:03.953029 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=26 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:04:03.953804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=62 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:04:03.954768 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 12:04:03.954981 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 12:04:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af/action (ip 10.222.0.50) !!! Oct 24 12:04:03.956418 n-d-858383-15 devstack@n-api.service[120426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 12:04:03.956554 n-d-858383-15 devstack@n-api.service[120426]: Mon Oct 24 12:04:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af/action (ip 10.222.0.50) !!! Oct 24 12:04:03.963546 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-756fc95c-61d1-42de-bd32-bb4939f635f2 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-928348114"}} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 12:04:03.965866 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-756fc95c-61d1-42de-bd32-bb4939f635f2 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:04:03.974459 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-756fc95c-61d1-42de-bd32-bb4939f635f2 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:03.975184 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-756fc95c-61d1-42de-bd32-bb4939f635f2 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:03.975626 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-756fc95c-61d1-42de-bd32-bb4939f635f2 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:03.976490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-756fc95c-61d1-42de-bd32-bb4939f635f2 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:03.977002 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-756fc95c-61d1-42de-bd32-bb4939f635f2 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:03.977397 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-756fc95c-61d1-42de-bd32-bb4939f635f2 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:04.182712 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-756fc95c-61d1-42de-bd32-bb4939f635f2 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "POST /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af/action" status: 202 len: 0 microversion: 2.1 time: 0.231532 Oct 24 12:04:04.183385 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4018/8012] 10.222.0.50 () {60 vars in 1278 bytes} [Mon Oct 24 12:04:03 2022] POST /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 24 12:04:10.786744 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:04:10.787507 n-d-858383-15 devstack@n-api.service[120425]: DEBUG dbcounter [-] [120425] Writing DB stats nova_cell1:SELECT=52 {{(pid=120425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:04:10.788688 n-d-858383-15 devstack@n-api.service[120425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 12:04:10.788892 n-d-858383-15 devstack@n-api.service[120425]: Mon Oct 24 12:04:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.50) !!! Oct 24 12:04:10.793999 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-03a0bf79-c667-4f83-8a9f-8096f4298d4a req-d2554a1b-c94f-468a-994b-3c635cec34a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf93a429-f37f-469d-bdbd-c82da1a0d1af", "name": "network-vif-plugged", "status": "completed", "tag": "b0769a3a-1970-4793-b344-c95f2e478b5b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 12:04:10.805681 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-03a0bf79-c667-4f83-8a9f-8096f4298d4a req-d2554a1b-c94f-468a-994b-3c635cec34a0 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:10.806188 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-03a0bf79-c667-4f83-8a9f-8096f4298d4a req-d2554a1b-c94f-468a-994b-3c635cec34a0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:10.806683 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-03a0bf79-c667-4f83-8a9f-8096f4298d4a req-d2554a1b-c94f-468a-994b-3c635cec34a0 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:10.820067 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-03a0bf79-c667-4f83-8a9f-8096f4298d4a req-d2554a1b-c94f-468a-994b-3c635cec34a0 service nova] Creating event network-vif-plugged:b0769a3a-1970-4793-b344-c95f2e478b5b for instance bf93a429-f37f-469d-bdbd-c82da1a0d1af on n-h2-858383-15 Oct 24 12:04:10.826065 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-03a0bf79-c667-4f83-8a9f-8096f4298d4a req-d2554a1b-c94f-468a-994b-3c635cec34a0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041776 Oct 24 12:04:10.827449 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3995/8013] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 12:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 12:04:18.807513 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_api:SELECT=2 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:04:18.808293 n-d-858383-15 devstack@n-api.service[120426]: DEBUG dbcounter [-] [120426] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 12:04:18.816232 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-8f127fab-92a7-4723-b932-2d66745bbf77 req-c4fd9152-6afa-4f47-b289-d30cb140afcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf93a429-f37f-469d-bdbd-c82da1a0d1af", "tag": "b0769a3a-1970-4793-b344-c95f2e478b5b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 12:04:18.821163 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-729dd754-d81a-4ce2-a389-6b6c0ee39f8e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:04:18.821771 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-729dd754-d81a-4ce2-a389-6b6c0ee39f8e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:04:18.832828 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-729dd754-d81a-4ce2-a389-6b6c0ee39f8e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:18.833634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-729dd754-d81a-4ce2-a389-6b6c0ee39f8e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:18.834082 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-729dd754-d81a-4ce2-a389-6b6c0ee39f8e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:18.834802 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-729dd754-d81a-4ce2-a389-6b6c0ee39f8e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:18.835020 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8f127fab-92a7-4723-b932-2d66745bbf77 req-c4fd9152-6afa-4f47-b289-d30cb140afcd service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:18.835265 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-729dd754-d81a-4ce2-a389-6b6c0ee39f8e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:18.835524 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8f127fab-92a7-4723-b932-2d66745bbf77 req-c4fd9152-6afa-4f47-b289-d30cb140afcd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:18.835709 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-729dd754-d81a-4ce2-a389-6b6c0ee39f8e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:18.835978 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-8f127fab-92a7-4723-b932-2d66745bbf77 req-c4fd9152-6afa-4f47-b289-d30cb140afcd service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:18.848523 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-8f127fab-92a7-4723-b932-2d66745bbf77 req-c4fd9152-6afa-4f47-b289-d30cb140afcd service nova] Creating event network-changed:b0769a3a-1970-4793-b344-c95f2e478b5b for instance bf93a429-f37f-469d-bdbd-c82da1a0d1af on n-h2-858383-15 Oct 24 12:04:18.853759 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-8f127fab-92a7-4723-b932-2d66745bbf77 req-c4fd9152-6afa-4f47-b289-d30cb140afcd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043458 Oct 24 12:04:18.854370 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3996/8014] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 12:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 12:04:18.869379 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-729dd754-d81a-4ce2-a389-6b6c0ee39f8e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Going to try to terminate instance {{(pid=120426) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 12:04:18.958381 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-729dd754-d81a-4ce2-a389-6b6c0ee39f8e tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 204 len: 0 microversion: 2.1 time: 0.152750 Oct 24 12:04:18.962211 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4019/8015] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 12:04:18 2022] DELETE /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 12:04:18.968148 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-5c26e1ff-e7f5-48ae-8150-388a34ba5996 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:04:18.968909 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-5c26e1ff-e7f5-48ae-8150-388a34ba5996 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:04:18.975547 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c26e1ff-e7f5-48ae-8150-388a34ba5996 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:18.976089 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c26e1ff-e7f5-48ae-8150-388a34ba5996 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:18.976527 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c26e1ff-e7f5-48ae-8150-388a34ba5996 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:18.977308 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c26e1ff-e7f5-48ae-8150-388a34ba5996 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:18.977780 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c26e1ff-e7f5-48ae-8150-388a34ba5996 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:18.978227 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-5c26e1ff-e7f5-48ae-8150-388a34ba5996 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:19.131619 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-5c26e1ff-e7f5-48ae-8150-388a34ba5996 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:04:19.139415 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-5c26e1ff-e7f5-48ae-8150-388a34ba5996 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1684 microversion: 2.1 time: 0.175601 Oct 24 12:04:19.140001 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3997/8016] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:04:18 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:04:20.164655 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-3e6efc2d-9672-4150-8356-ecf30e4b0175 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:04:20.165398 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-3e6efc2d-9672-4150-8356-ecf30e4b0175 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:04:20.172146 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e6efc2d-9672-4150-8356-ecf30e4b0175 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:20.172634 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e6efc2d-9672-4150-8356-ecf30e4b0175 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:20.173816 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e6efc2d-9672-4150-8356-ecf30e4b0175 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:20.174667 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e6efc2d-9672-4150-8356-ecf30e4b0175 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:20.175131 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e6efc2d-9672-4150-8356-ecf30e4b0175 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:20.175563 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-3e6efc2d-9672-4150-8356-ecf30e4b0175 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:20.308873 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-3e6efc2d-9672-4150-8356-ecf30e4b0175 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:04:20.316893 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-3e6efc2d-9672-4150-8356-ecf30e4b0175 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1684 microversion: 2.1 time: 0.156794 Oct 24 12:04:20.317484 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4020/8017] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:04:20 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:04:20.791143 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-096c3321-47e9-44e2-96fc-85a409109047 req-eee77b6c-abad-460d-86f3-2e83ca473c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf93a429-f37f-469d-bdbd-c82da1a0d1af", "name": "network-vif-unplugged", "status": "completed", "tag": "b0769a3a-1970-4793-b344-c95f2e478b5b"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 12:04:20.803149 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-096c3321-47e9-44e2-96fc-85a409109047 req-eee77b6c-abad-460d-86f3-2e83ca473c3c service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:20.803874 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-096c3321-47e9-44e2-96fc-85a409109047 req-eee77b6c-abad-460d-86f3-2e83ca473c3c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:20.804510 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-096c3321-47e9-44e2-96fc-85a409109047 req-eee77b6c-abad-460d-86f3-2e83ca473c3c service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:20.817926 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-096c3321-47e9-44e2-96fc-85a409109047 req-eee77b6c-abad-460d-86f3-2e83ca473c3c service nova] Creating event network-vif-unplugged:b0769a3a-1970-4793-b344-c95f2e478b5b for instance bf93a429-f37f-469d-bdbd-c82da1a0d1af on n-h2-858383-15 Oct 24 12:04:20.822978 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-096c3321-47e9-44e2-96fc-85a409109047 req-eee77b6c-abad-460d-86f3-2e83ca473c3c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036418 Oct 24 12:04:20.824432 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3998/8018] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 12:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 12:04:21.203715 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-3f572532-77fc-4c61-8724-36420d46e036 req-14da1f37-fcd1-4613-8176-7970b6e31bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf93a429-f37f-469d-bdbd-c82da1a0d1af", "name": "network-vif-deleted", "tag": "b0769a3a-1970-4793-b344-c95f2e478b5b"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 12:04:21.214918 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3f572532-77fc-4c61-8724-36420d46e036 req-14da1f37-fcd1-4613-8176-7970b6e31bf8 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:21.215401 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3f572532-77fc-4c61-8724-36420d46e036 req-14da1f37-fcd1-4613-8176-7970b6e31bf8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:21.215876 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-3f572532-77fc-4c61-8724-36420d46e036 req-14da1f37-fcd1-4613-8176-7970b6e31bf8 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:21.227812 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-3f572532-77fc-4c61-8724-36420d46e036 req-14da1f37-fcd1-4613-8176-7970b6e31bf8 service nova] Creating event network-vif-deleted:b0769a3a-1970-4793-b344-c95f2e478b5b for instance bf93a429-f37f-469d-bdbd-c82da1a0d1af on n-h2-858383-15 Oct 24 12:04:21.233003 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-3f572532-77fc-4c61-8724-36420d46e036 req-14da1f37-fcd1-4613-8176-7970b6e31bf8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033142 Oct 24 12:04:21.233695 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4021/8019] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 12:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 12:04:21.341501 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-341a82d2-face-43c4-9f85-0b78497ff1e1 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:04:21.342282 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-341a82d2-face-43c4-9f85-0b78497ff1e1 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:04:21.349421 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-341a82d2-face-43c4-9f85-0b78497ff1e1 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:21.349860 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-341a82d2-face-43c4-9f85-0b78497ff1e1 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:21.350320 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-341a82d2-face-43c4-9f85-0b78497ff1e1 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:21.351038 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-341a82d2-face-43c4-9f85-0b78497ff1e1 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:21.351514 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-341a82d2-face-43c4-9f85-0b78497ff1e1 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:21.351957 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-341a82d2-face-43c4-9f85-0b78497ff1e1 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:21.386005 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-341a82d2-face-43c4-9f85-0b78497ff1e1 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:21.386509 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-341a82d2-face-43c4-9f85-0b78497ff1e1 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:21.386988 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-341a82d2-face-43c4-9f85-0b78497ff1e1 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:21.387430 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.objects.instance [None req-341a82d2-face-43c4-9f85-0b78497ff1e1 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lazy-loading 'fault' on Instance uuid bf93a429-f37f-469d-bdbd-c82da1a0d1af {{(pid=120425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 12:04:21.436797 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-341a82d2-face-43c4-9f85-0b78497ff1e1 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:04:21.440565 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-341a82d2-face-43c4-9f85-0b78497ff1e1 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 200 len: 1338 microversion: 2.1 time: 0.103336 Oct 24 12:04:21.441190 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 3999/8020] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:04:21 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:04:22.466117 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d1794b6b-0041-4b4a-9b66-c931a2c3d9d9 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:04:22.466851 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-d1794b6b-0041-4b4a-9b66-c931a2c3d9d9 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: bf93a429-f37f-469d-bdbd-c82da1a0d1af] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:04:22.473114 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1794b6b-0041-4b4a-9b66-c931a2c3d9d9 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:22.473596 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1794b6b-0041-4b4a-9b66-c931a2c3d9d9 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:22.474035 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1794b6b-0041-4b4a-9b66-c931a2c3d9d9 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:22.474728 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1794b6b-0041-4b4a-9b66-c931a2c3d9d9 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:22.475185 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1794b6b-0041-4b4a-9b66-c931a2c3d9d9 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:22.475614 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-d1794b6b-0041-4b4a-9b66-c931a2c3d9d9 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:22.489760 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-d1794b6b-0041-4b4a-9b66-c931a2c3d9d9 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] HTTP exception thrown: Instance bf93a429-f37f-469d-bdbd-c82da1a0d1af could not be found. Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d1794b6b-0041-4b4a-9b66-c931a2c3d9d9 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Request method failure captured: Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af HTTP/1.1 Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVn43M8FSninnLw8nf5oKF-8IyciRkwaW9oK5n-yFefmFzsFq4ERSdsMnZpjS-_c992xaz-Bvxg9HsWoAcEY_MwA-ziWMhyb0iu3RRaCEmheVMMzOOnWFhRBBEZVO5naZXC7XZUHK0kGidbTOY4qQU0jO8MW4s44tC82-6cdugILCG6E Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: a671adbfc1f44855887168b0b73cd8f1 Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestSnapshotPattern-1807326167 Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a671adbfc1f44855887168b0b73cd8f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a671adbfc1f44855887168b0b73cd8f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a671adbfc1f44855887168b0b73cd8f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a671adbfc1f44855887168b0b73cd8f1", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestSnapshotPattern-1807326167 Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: a671adbfc1f44855887168b0b73cd8f1 Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestSnapshotPattern-1807326167 Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestSnapshotPattern-1807326167-project Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 9ab62c4a4376460eaf10a3685840d8da Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestSnapshotPattern-1807326167-project Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance bf93a429-f37f-469d-bdbd-c82da1a0d1af could not be found. Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': 'bf93a429-f37f-469d-bdbd-c82da1a0d1af'} Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf93a429-f37f-469d-bdbd-c82da1a0d1af could not be found. Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf93a429-f37f-469d-bdbd-c82da1a0d1af could not be found. Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 12:04:22.491430 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 12:04:22.497075 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 12:04:22.497075 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 12:04:22.497075 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 12:04:22.497075 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 12:04:22.497075 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 12:04:22.497075 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf93a429-f37f-469d-bdbd-c82da1a0d1af could not be found. Oct 24 12:04:22.497075 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 12:04:22.497075 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-d1794b6b-0041-4b4a-9b66-c931a2c3d9d9 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Returning 404 to user: Instance bf93a429-f37f-469d-bdbd-c82da1a0d1af could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 12:04:22.497075 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-d1794b6b-0041-4b4a-9b66-c931a2c3d9d9 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af" status: 404 len: 111 microversion: 2.1 time: 0.031964 Oct 24 12:04:22.497075 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4022/8021] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:04:22 2022] GET /compute/v2.1/servers/bf93a429-f37f-469d-bdbd-c82da1a0d1af => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 12:04:23.823996 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-2847d512-d6b0-4778-a999-fdc886b0358c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:04:23.824506 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2847d512-d6b0-4778-a999-fdc886b0358c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:04:23.825890 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [req-5b82b119-1d27-487d-a644-c3eee4f527df req-b0015fbc-9a9d-4275-a12e-aac1db8f0827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d3b744a-586a-4395-92e8-dc01af62f625", "tag": "c091c752-2d91-4892-81b6-b6715a0bba15"}]} {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 12:04:23.831415 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2847d512-d6b0-4778-a999-fdc886b0358c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:23.831924 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2847d512-d6b0-4778-a999-fdc886b0358c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:23.832375 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2847d512-d6b0-4778-a999-fdc886b0358c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:23.833121 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2847d512-d6b0-4778-a999-fdc886b0358c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:23.833791 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2847d512-d6b0-4778-a999-fdc886b0358c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:23.834236 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-2847d512-d6b0-4778-a999-fdc886b0358c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:23.840416 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5b82b119-1d27-487d-a644-c3eee4f527df req-b0015fbc-9a9d-4275-a12e-aac1db8f0827 service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:23.841215 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5b82b119-1d27-487d-a644-c3eee4f527df req-b0015fbc-9a9d-4275-a12e-aac1db8f0827 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:23.841645 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [req-5b82b119-1d27-487d-a644-c3eee4f527df req-b0015fbc-9a9d-4275-a12e-aac1db8f0827 service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:23.853690 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.compute.server_external_events [req-5b82b119-1d27-487d-a644-c3eee4f527df req-b0015fbc-9a9d-4275-a12e-aac1db8f0827 service nova] Creating event network-changed:c091c752-2d91-4892-81b6-b6715a0bba15 for instance 5d3b744a-586a-4395-92e8-dc01af62f625 on n-h2-858383-15 Oct 24 12:04:23.858701 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [req-5b82b119-1d27-487d-a644-c3eee4f527df req-b0015fbc-9a9d-4275-a12e-aac1db8f0827 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036352 Oct 24 12:04:23.859327 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4023/8022] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 12:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 12:04:23.866523 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-2847d512-d6b0-4778-a999-fdc886b0358c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] Going to try to terminate instance {{(pid=120425) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 12:04:23.953022 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-2847d512-d6b0-4778-a999-fdc886b0358c tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625" status: 204 len: 0 microversion: 2.1 time: 0.132476 Oct 24 12:04:23.955138 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 4000/8023] 10.222.0.50 () {58 vars in 1239 bytes} [Mon Oct 24 12:04:23 2022] DELETE /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 12:04:23.963535 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-726736dc-f008-444d-b006-c727f6e7f51d tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:04:23.964250 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-726736dc-f008-444d-b006-c727f6e7f51d tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:04:23.970859 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-726736dc-f008-444d-b006-c727f6e7f51d tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:23.971356 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-726736dc-f008-444d-b006-c727f6e7f51d tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:23.971804 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-726736dc-f008-444d-b006-c727f6e7f51d tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:23.972519 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-726736dc-f008-444d-b006-c727f6e7f51d tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:23.973021 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-726736dc-f008-444d-b006-c727f6e7f51d tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:23.973457 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-726736dc-f008-444d-b006-c727f6e7f51d tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:24.109129 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-726736dc-f008-444d-b006-c727f6e7f51d tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:04:24.125150 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-726736dc-f008-444d-b006-c727f6e7f51d tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625" status: 200 len: 1684 microversion: 2.1 time: 0.165753 Oct 24 12:04:24.128139 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4024/8024] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:04:23 2022] GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:04:25.151638 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-584d7364-f836-4987-afef-15fc9d869c76 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:04:25.152365 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.compute.api [None req-584d7364-f836-4987-afef-15fc9d869c76 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] Fetching instance by UUID {{(pid=120425) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:04:25.159370 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-584d7364-f836-4987-afef-15fc9d869c76 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:25.159873 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-584d7364-f836-4987-afef-15fc9d869c76 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:25.160326 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-584d7364-f836-4987-afef-15fc9d869c76 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:25.161146 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-584d7364-f836-4987-afef-15fc9d869c76 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:25.161711 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-584d7364-f836-4987-afef-15fc9d869c76 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:25.162378 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [None req-584d7364-f836-4987-afef-15fc9d869c76 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:25.301105 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.policy [None req-584d7364-f836-4987-afef-15fc9d869c76 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120425) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:04:25.308978 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-584d7364-f836-4987-afef-15fc9d869c76 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625" status: 200 len: 1684 microversion: 2.1 time: 0.161585 Oct 24 12:04:25.309559 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 4001/8025] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:04:25 2022] GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:04:26.335861 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-9e77f512-70ad-43c0-b9a6-80237776007b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:04:26.336474 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-9e77f512-70ad-43c0-b9a6-80237776007b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:04:26.342997 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e77f512-70ad-43c0-b9a6-80237776007b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:26.343488 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e77f512-70ad-43c0-b9a6-80237776007b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:26.344071 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e77f512-70ad-43c0-b9a6-80237776007b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:26.345505 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e77f512-70ad-43c0-b9a6-80237776007b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:26.346140 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e77f512-70ad-43c0-b9a6-80237776007b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:26.346657 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-9e77f512-70ad-43c0-b9a6-80237776007b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:26.491169 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [req-335da024-d536-47e6-afed-60aff13abaf4 req-f0193e5d-6cd6-49be-873d-3d1830187daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d3b744a-586a-4395-92e8-dc01af62f625", "name": "network-vif-deleted", "tag": "c091c752-2d91-4892-81b6-b6715a0bba15"}]} {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 12:04:26.491708 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.policy [None req-9e77f512-70ad-43c0-b9a6-80237776007b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab62c4a4376460eaf10a3685840d8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671adbfc1f44855887168b0b73cd8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120426) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 12:04:26.500795 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-9e77f512-70ad-43c0-b9a6-80237776007b tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625" status: 200 len: 1565 microversion: 2.1 time: 0.170204 Oct 24 12:04:26.502444 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4025/8026] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:04:26 2022] GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 12:04:26.503851 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-335da024-d536-47e6-afed-60aff13abaf4 req-f0193e5d-6cd6-49be-873d-3d1830187daa service nova] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:26.504353 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-335da024-d536-47e6-afed-60aff13abaf4 req-f0193e5d-6cd6-49be-873d-3d1830187daa service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:26.504808 n-d-858383-15 devstack@n-api.service[120425]: DEBUG oslo_concurrency.lockutils [req-335da024-d536-47e6-afed-60aff13abaf4 req-f0193e5d-6cd6-49be-873d-3d1830187daa service nova] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:26.517140 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.compute.server_external_events [req-335da024-d536-47e6-afed-60aff13abaf4 req-f0193e5d-6cd6-49be-873d-3d1830187daa service nova] Creating event network-vif-deleted:c091c752-2d91-4892-81b6-b6715a0bba15 for instance 5d3b744a-586a-4395-92e8-dc01af62f625 on n-h2-858383-15 Oct 24 12:04:26.522655 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [req-335da024-d536-47e6-afed-60aff13abaf4 req-f0193e5d-6cd6-49be-873d-3d1830187daa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035060 Oct 24 12:04:26.523420 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 4002/8027] 10.222.0.50 () {64 vars in 1317 bytes} [Mon Oct 24 12:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 12:04:27.525895 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-197faca0-bdaa-4061-b16b-e53621378357 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '>' {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:04:27.526490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.compute.api [None req-197faca0-bdaa-4061-b16b-e53621378357 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] [instance: 5d3b744a-586a-4395-92e8-dc01af62f625] Fetching instance by UUID {{(pid=120426) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 12:04:27.533575 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-197faca0-bdaa-4061-b16b-e53621378357 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:27.534054 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-197faca0-bdaa-4061-b16b-e53621378357 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:27.534490 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-197faca0-bdaa-4061-b16b-e53621378357 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:27.535177 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-197faca0-bdaa-4061-b16b-e53621378357 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Acquiring lock "75e76125-592d-4292-bea1-3b51451d7165" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 12:04:27.535629 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-197faca0-bdaa-4061-b16b-e53621378357 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 12:04:27.536053 n-d-858383-15 devstack@n-api.service[120426]: DEBUG oslo_concurrency.lockutils [None req-197faca0-bdaa-4061-b16b-e53621378357 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Lock "75e76125-592d-4292-bea1-3b51451d7165" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 12:04:27.549705 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.wsgi [None req-197faca0-bdaa-4061-b16b-e53621378357 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] HTTP exception thrown: Instance 5d3b744a-586a-4395-92e8-dc01af62f625 could not be found. Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-197faca0-bdaa-4061-b16b-e53621378357 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Request method failure captured: Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: request: GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625 HTTP/1.1 Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: Accept: application/json Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: Accept-Encoding: identity Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: Connection: close Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: Content-Length: 0 Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: Content-Type: application/json Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: Host: 10.222.0.50 Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: Openstack-System-Scope: None Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: User-Agent: python-urllib3/1.26.12 Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-Auth-Token: gAAAAABjVn43M8FSninnLw8nf5oKF-8IyciRkwaW9oK5n-yFefmFzsFq4ERSdsMnZpjS-_c992xaz-Bvxg9HsWoAcEY_MwA-ziWMhyb0iu3RRaCEmheVMMzOOnWFhRBBEZVO5naZXC7XZUHK0kGidbTOY4qQU0jO8MW4s44tC82-6cdugILCG6E Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Id: None Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-Domain-Name: None Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-Identity-Status: Confirmed Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-Is-Admin-Project: True Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Id: default Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Domain-Name: Default Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Id: a671adbfc1f44855887168b0b73cd8f1 Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-Project-Name: tempest-TestSnapshotPattern-1807326167 Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-Role: reader,member Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-Roles: reader,member Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a671adbfc1f44855887168b0b73cd8f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a671adbfc1f44855887168b0b73cd8f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a671adbfc1f44855887168b0b73cd8f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a671adbfc1f44855887168b0b73cd8f1", "adminURL": "http://10.222.0.50:8080"}]}] Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant: tempest-TestSnapshotPattern-1807326167 Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Id: a671adbfc1f44855887168b0b73cd8f1 Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-Tenant-Name: tempest-TestSnapshotPattern-1807326167 Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-User: tempest-TestSnapshotPattern-1807326167-project Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Id: default Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-User-Domain-Name: Default Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-User-Id: 9ab62c4a4376460eaf10a3685840d8da Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: X-User-Name: tempest-TestSnapshotPattern-1807326167-project Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: method: > Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: exception: Instance 5d3b744a-586a-4395-92e8-dc01af62f625 could not be found. Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: action_args: {'id': '5d3b744a-586a-4395-92e8-dc01af62f625'} Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: {{(pid=120426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d3b744a-586a-4395-92e8-dc01af62f625 could not be found. Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d3b744a-586a-4395-92e8-dc01af62f625 could not be found. Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 12:04:27.551372 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 12:04:27.557116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 12:04:27.557116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 12:04:27.557116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 12:04:27.557116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 12:04:27.557116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 12:04:27.557116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d3b744a-586a-4395-92e8-dc01af62f625 could not be found. Oct 24 12:04:27.557116 n-d-858383-15 devstack@n-api.service[120426]: ERROR nova.api.openstack.wsgi Oct 24 12:04:27.557116 n-d-858383-15 devstack@n-api.service[120426]: DEBUG nova.api.openstack.wsgi [None req-197faca0-bdaa-4061-b16b-e53621378357 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Returning 404 to user: Instance 5d3b744a-586a-4395-92e8-dc01af62f625 could not be found. {{(pid=120426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 12:04:27.557116 n-d-858383-15 devstack@n-api.service[120426]: INFO nova.api.openstack.requestlog [None req-197faca0-bdaa-4061-b16b-e53621378357 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625" status: 404 len: 111 microversion: 2.1 time: 0.030873 Oct 24 12:04:27.557116 n-d-858383-15 devstack@n-api.service[120426]: [pid: 120426|app: 0|req: 4026/8028] 10.222.0.50 () {58 vars in 1236 bytes} [Mon Oct 24 12:04:27 2022] GET /compute/v2.1/servers/5d3b744a-586a-4395-92e8-dc01af62f625 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 12:04:27.714398 n-d-858383-15 devstack@n-api.service[120425]: DEBUG nova.api.openstack.wsgi [None req-9a4e36c3-3d08-41a9-8b78-eeeafba268d8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] Calling method '.version_select at 0x7f04cbab8ca0>' {{(pid=120425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 12:04:27.739357 n-d-858383-15 devstack@n-api.service[120425]: INFO nova.api.openstack.requestlog [None req-9a4e36c3-3d08-41a9-8b78-eeeafba268d8 tempest-TestSnapshotPattern-1807326167 tempest-TestSnapshotPattern-1807326167-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-394265303" status: 202 len: 0 microversion: 2.1 time: 0.030255 Oct 24 12:04:27.739941 n-d-858383-15 devstack@n-api.service[120425]: [pid: 120425|app: 0|req: 4003/8029] 10.222.0.50 () {58 vars in 1254 bytes} [Mon Oct 24 12:04:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-394265303 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)